This material is based upon work supported by NSF’s National Ecological Observatory Network, a major facility fully funded by the National Science Foundation. This material is based upon work supported by NSF’s National Ecological Observatory Network, a major facility fully funded by the National Science Foundation. Tom Gulbransen - Battelle NEON Data Delivery & Cyberinfrastructure (mission, data products, data delivery, processing, architecture, interoperability, improvement plans) 1
32
Embed
NEON Data Delivery & Cyberinfrastructure · & Cyberinfrastructure (mission, data products, data delivery, processing, ... monitoring a number of critical ecological and environmental
This document is posted to help you gain knowledge. Please leave a comment to let me know what you think about it! Share it to your friends and learn new things together.
Transcript
This material is based upon work supported by NSF’s National Ecological Observatory Network,
a major facility fully funded by the National Science Foundation.
This material is based upon work supported by NSF’s National Ecological Observatory Network,
a major facility fully funded by the National Science Foundation.
Tom Gulbransen - Battelle
NEON Data Delivery & Cyberinfrastructure
(mission, data products, data delivery, processing, architecture, interoperability, improvement plans)
1
This material is based upon work supported by NSF’s National Ecological Observatory Network,
a major facility fully funded by the National Science Foundation.
Why is NEON important?
NEON provides a coordinated national system for
monitoring a number of critical ecological and environmental
properties at multiple spatial and temporal scales.
…transformative science …workforce development
2
This material is based upon work supported by NSF’s National Ecological Observatory Network,
a major facility fully funded by the National Science Foundation.3
Land Related
47Biogeochemistry
85
Ecohydrology
47
Organismal
51
Atmospheric
58
+2 from AeroNet+1 from PhenoCam
+3 from MG-RAST
+11 from
AmeriFlux
H2O, CO2
Heat
Isotopes
Turbulence
Storage
Fluxes
Abundance
Composition
Pathogens
Phenology
DNA Barcodes
Marker Genes
Metagenomics
Water quality
Precipitation
Levels
Discharge
Radiation
Geomorphology
Soil conditions
Chemistry
Particulates
Foliar characteristics
Spectrometry
Hi-Res imagery
LiDAR
NEON’s 176 Data Products Overlap Multiple Themes
This material is based upon work supported by NSF’s National Ecological Observatory Network,
a major facility fully funded by the National Science Foundation.4
National Cyberinfrastructure = resources, tools & services, observation to delivery
Ecological
Observatory
Network - of field observational results
- of sampling protocols
- of algorithms
surface atmospheric exchange/fluxes
meteorological temporal interpolations
- of data science methods
APIs @ PhenoCam, MG-RAST, BOLD
Ecological semantic conventions e.g. EML
Dictionary-driven generic observational pipeline
Data integration via workflow models
- of practitioners
21 Working Groups; ~1,500 unique users & 75k API hits/month
Carpentry workshops & interns
Digital identifiers for data use/provenance
Large data facilities coalitions, e.g. RDA, CDF, ESIP
Data
Process
People
NEON CI & Data Science Offerings
This material is based upon work supported by NSF’s National Ecological Observatory Network,
a major facility fully funded by the National Science Foundation.5
NEON CI Data Delivery
Data Product Type
General Latency from
Sampling to Portal
Primary Influence on
General Latency
Existing
Backlog
Estimated Complete
Publication of Backlog
AOP 2 months Staff during flights 2018 ongoing Nov2018
AOP legacy Reprocessing with new algorithms
2013-2016 Dec2018
Land, Water, Soil,
Meteorology
15th of next month 5 day communications completion buffer
2018 ongoing Monthly
Land, Water, Soil,
Meteorology legacy
Volume of prior site-months 2013-2017 Nov2018
Eddy Covariance 15th of next month 5 day communications completion buffer
2018 ongoing Monthly
Eddy Covariance legacy Volume of prior site-months & configurations
2013-2017 Nov2018
OS – field observations 1-4 months (~9-13 for
fish & veg structure)
Reviews as season progresses. HQ staff.
Oct2018
OS – domain lab results 1-3 months (6 & 13 for
morphospp. & bathy)
Reviews as season progresses. HQ staff.
Sep2018
OS – external lab rolling
batches
1-9 months Reviews as season progresses. Lab deliveries.
Dec2018
OS – one time samples
(megapits, soil)
external lab processing - MBL Dec2018
This material is based upon work supported by NSF’s National Ecological Observatory Network,
a major facility fully funded by the National Science Foundation.