NEON: from scientific strategy to long-term operationoptimise.dcs.aber.ac.uk › wp-content ›...
Transcript of NEON: from scientific strategy to long-term operationoptimise.dcs.aber.ac.uk › wp-content ›...
![Page 1: NEON: from scientific strategy to long-term operationoptimise.dcs.aber.ac.uk › wp-content › uploads › 20180221_COST... · 2018-05-15 · National Ecological Observatory Network](https://reader033.fdocuments.net/reader033/viewer/2022060319/5f0ccf257e708231d4373cd4/html5/thumbnails/1.jpg)
National Ecological Observatory NetworkA project sponsored by the National Science Foundation and operated under cooperative agreement by Battelle.
1
NEON: from scientific strategy to long-term operation
Stefan Metzger1, Ankur R. Desai2, David Durden1, Jörg Hartmann3, Jiahong Li4, Hongyan Luo1, Natchaya Pingintha-Durden1, Torsten Sachs5, Andrei Serafimovich5, Cove Sturtevant1, Ke Xu2
[1]: Battelle Ecology, National Ecological Observatory Network Project, Boulder, CO, USA[2]: University of Wisconsin-Madison, Dept. of Atmospheric and Oceanic Sciences, Madison, WI, USA[3]: Alfred Wegener Institute - Helmholtz Centre for Polar and Marine Research, Bremerhaven, Germany[4]: LI-COR Biosciences, Lincoln, NE, USA[5]: GFZ German Research Centre for Geosciences, Potsdam, Germany
![Page 2: NEON: from scientific strategy to long-term operationoptimise.dcs.aber.ac.uk › wp-content › uploads › 20180221_COST... · 2018-05-15 · National Ecological Observatory Network](https://reader033.fdocuments.net/reader033/viewer/2022060319/5f0ccf257e708231d4373cd4/html5/thumbnails/2.jpg)
• incorporate lessons-learned through collaborations with bottom-up networks like AmeriFlux, ICOS, LTER, TERN…
• NEON's centralized approach lends itself to explore novel systemic solutions
• starting to give back:
• boots on the ground
• software
• data
• educational resources
2
the spirit
![Page 3: NEON: from scientific strategy to long-term operationoptimise.dcs.aber.ac.uk › wp-content › uploads › 20180221_COST... · 2018-05-15 · National Ecological Observatory Network](https://reader033.fdocuments.net/reader033/viewer/2022060319/5f0ccf257e708231d4373cd4/html5/thumbnails/3.jpg)
3
overview
• why bridging observational scales?
• NEON: designed for scaling
• centralized data operations and monitoring
• scalable scientific computing
• combining ground-based, airborne and space-borne data
• summary and outlook
![Page 4: NEON: from scientific strategy to long-term operationoptimise.dcs.aber.ac.uk › wp-content › uploads › 20180221_COST... · 2018-05-15 · National Ecological Observatory Network](https://reader033.fdocuments.net/reader033/viewer/2022060319/5f0ccf257e708231d4373cd4/html5/thumbnails/4.jpg)
4
overview
• why bridging observational scales?
• NEON: designed for scaling
• centralized data operations and monitoring
• scalable scientific computing
• combining ground-based, airborne and space-borne data
• summary and outlook
![Page 5: NEON: from scientific strategy to long-term operationoptimise.dcs.aber.ac.uk › wp-content › uploads › 20180221_COST... · 2018-05-15 · National Ecological Observatory Network](https://reader033.fdocuments.net/reader033/viewer/2022060319/5f0ccf257e708231d4373cd4/html5/thumbnails/5.jpg)
5
How does spatial structure influence ecosystem function and how do we integrate within and between spatial scales to assess function?
![Page 6: NEON: from scientific strategy to long-term operationoptimise.dcs.aber.ac.uk › wp-content › uploads › 20180221_COST... · 2018-05-15 · National Ecological Observatory Network](https://reader033.fdocuments.net/reader033/viewer/2022060319/5f0ccf257e708231d4373cd4/html5/thumbnails/6.jpg)
“…data still remain too sparse spatially to test mechanisms of change using models…”
“…provide the required data at high spatial and temporal resolution with the necessary continuity…”
6
![Page 7: NEON: from scientific strategy to long-term operationoptimise.dcs.aber.ac.uk › wp-content › uploads › 20180221_COST... · 2018-05-15 · National Ecological Observatory Network](https://reader033.fdocuments.net/reader033/viewer/2022060319/5f0ccf257e708231d4373cd4/html5/thumbnails/7.jpg)
7
“... scaling down from global and continental measurements and scaling up from stand-level measurements both are critical for an integrative program of C research.”
“Each approach has different spatial and temporal domains ..., and they have the potential to constrain the next level up or down”
“One of the main barriers to rapid improvement of models is the lack of ground data for validation purposes.”
![Page 8: NEON: from scientific strategy to long-term operationoptimise.dcs.aber.ac.uk › wp-content › uploads › 20180221_COST... · 2018-05-15 · National Ecological Observatory Network](https://reader033.fdocuments.net/reader033/viewer/2022060319/5f0ccf257e708231d4373cd4/html5/thumbnails/8.jpg)
8
overview
• why bridging observational scales?
• NEON: designed for scaling
• centralized data operations and monitoring
• scalable scientific computing
• combining ground-based, airborne and space-borne data
• summary and outlook
![Page 9: NEON: from scientific strategy to long-term operationoptimise.dcs.aber.ac.uk › wp-content › uploads › 20180221_COST... · 2018-05-15 · National Ecological Observatory Network](https://reader033.fdocuments.net/reader033/viewer/2022060319/5f0ccf257e708231d4373cd4/html5/thumbnails/9.jpg)
9
The National Ecological Observatory Network
![Page 10: NEON: from scientific strategy to long-term operationoptimise.dcs.aber.ac.uk › wp-content › uploads › 20180221_COST... · 2018-05-15 · National Ecological Observatory Network](https://reader033.fdocuments.net/reader033/viewer/2022060319/5f0ccf257e708231d4373cd4/html5/thumbnails/10.jpg)
10
NEON multi-scale observing system
![Page 11: NEON: from scientific strategy to long-term operationoptimise.dcs.aber.ac.uk › wp-content › uploads › 20180221_COST... · 2018-05-15 · National Ecological Observatory Network](https://reader033.fdocuments.net/reader033/viewer/2022060319/5f0ccf257e708231d4373cd4/html5/thumbnails/11.jpg)
11
state of the NEON “fairytale”
![Page 12: NEON: from scientific strategy to long-term operationoptimise.dcs.aber.ac.uk › wp-content › uploads › 20180221_COST... · 2018-05-15 · National Ecological Observatory Network](https://reader033.fdocuments.net/reader033/viewer/2022060319/5f0ccf257e708231d4373cd4/html5/thumbnails/12.jpg)
12
state of the NEON “fairytale”
![Page 13: NEON: from scientific strategy to long-term operationoptimise.dcs.aber.ac.uk › wp-content › uploads › 20180221_COST... · 2018-05-15 · National Ecological Observatory Network](https://reader033.fdocuments.net/reader033/viewer/2022060319/5f0ccf257e708231d4373cd4/html5/thumbnails/13.jpg)
instrumented sites
![Page 14: NEON: from scientific strategy to long-term operationoptimise.dcs.aber.ac.uk › wp-content › uploads › 20180221_COST... · 2018-05-15 · National Ecological Observatory Network](https://reader033.fdocuments.net/reader033/viewer/2022060319/5f0ccf257e708231d4373cd4/html5/thumbnails/14.jpg)
instrumented sites
![Page 15: NEON: from scientific strategy to long-term operationoptimise.dcs.aber.ac.uk › wp-content › uploads › 20180221_COST... · 2018-05-15 · National Ecological Observatory Network](https://reader033.fdocuments.net/reader033/viewer/2022060319/5f0ccf257e708231d4373cd4/html5/thumbnails/15.jpg)
instrumented sites
![Page 16: NEON: from scientific strategy to long-term operationoptimise.dcs.aber.ac.uk › wp-content › uploads › 20180221_COST... · 2018-05-15 · National Ecological Observatory Network](https://reader033.fdocuments.net/reader033/viewer/2022060319/5f0ccf257e708231d4373cd4/html5/thumbnails/16.jpg)
instrumented sites
![Page 17: NEON: from scientific strategy to long-term operationoptimise.dcs.aber.ac.uk › wp-content › uploads › 20180221_COST... · 2018-05-15 · National Ecological Observatory Network](https://reader033.fdocuments.net/reader033/viewer/2022060319/5f0ccf257e708231d4373cd4/html5/thumbnails/17.jpg)
instrumented sites
![Page 18: NEON: from scientific strategy to long-term operationoptimise.dcs.aber.ac.uk › wp-content › uploads › 20180221_COST... · 2018-05-15 · National Ecological Observatory Network](https://reader033.fdocuments.net/reader033/viewer/2022060319/5f0ccf257e708231d4373cd4/html5/thumbnails/18.jpg)
instrumented sites
![Page 19: NEON: from scientific strategy to long-term operationoptimise.dcs.aber.ac.uk › wp-content › uploads › 20180221_COST... · 2018-05-15 · National Ecological Observatory Network](https://reader033.fdocuments.net/reader033/viewer/2022060319/5f0ccf257e708231d4373cd4/html5/thumbnails/19.jpg)
instrumented sites
![Page 20: NEON: from scientific strategy to long-term operationoptimise.dcs.aber.ac.uk › wp-content › uploads › 20180221_COST... · 2018-05-15 · National Ecological Observatory Network](https://reader033.fdocuments.net/reader033/viewer/2022060319/5f0ccf257e708231d4373cd4/html5/thumbnails/20.jpg)
instrumented sites
![Page 21: NEON: from scientific strategy to long-term operationoptimise.dcs.aber.ac.uk › wp-content › uploads › 20180221_COST... · 2018-05-15 · National Ecological Observatory Network](https://reader033.fdocuments.net/reader033/viewer/2022060319/5f0ccf257e708231d4373cd4/html5/thumbnails/21.jpg)
instrumented sites
![Page 22: NEON: from scientific strategy to long-term operationoptimise.dcs.aber.ac.uk › wp-content › uploads › 20180221_COST... · 2018-05-15 · National Ecological Observatory Network](https://reader033.fdocuments.net/reader033/viewer/2022060319/5f0ccf257e708231d4373cd4/html5/thumbnails/22.jpg)
instrumented sites
![Page 23: NEON: from scientific strategy to long-term operationoptimise.dcs.aber.ac.uk › wp-content › uploads › 20180221_COST... · 2018-05-15 · National Ecological Observatory Network](https://reader033.fdocuments.net/reader033/viewer/2022060319/5f0ccf257e708231d4373cd4/html5/thumbnails/23.jpg)
instrumented sites
![Page 24: NEON: from scientific strategy to long-term operationoptimise.dcs.aber.ac.uk › wp-content › uploads › 20180221_COST... · 2018-05-15 · National Ecological Observatory Network](https://reader033.fdocuments.net/reader033/viewer/2022060319/5f0ccf257e708231d4373cd4/html5/thumbnails/24.jpg)
instrumented sites
![Page 25: NEON: from scientific strategy to long-term operationoptimise.dcs.aber.ac.uk › wp-content › uploads › 20180221_COST... · 2018-05-15 · National Ecological Observatory Network](https://reader033.fdocuments.net/reader033/viewer/2022060319/5f0ccf257e708231d4373cd4/html5/thumbnails/25.jpg)
25
in-situ sampling, proximal and remote sensing
![Page 26: NEON: from scientific strategy to long-term operationoptimise.dcs.aber.ac.uk › wp-content › uploads › 20180221_COST... · 2018-05-15 · National Ecological Observatory Network](https://reader033.fdocuments.net/reader033/viewer/2022060319/5f0ccf257e708231d4373cd4/html5/thumbnails/26.jpg)
26
in-situ sampling, proximal and remote sensing
![Page 27: NEON: from scientific strategy to long-term operationoptimise.dcs.aber.ac.uk › wp-content › uploads › 20180221_COST... · 2018-05-15 · National Ecological Observatory Network](https://reader033.fdocuments.net/reader033/viewer/2022060319/5f0ccf257e708231d4373cd4/html5/thumbnails/27.jpg)
27
in-situ sampling, proximal and remote sensing
![Page 28: NEON: from scientific strategy to long-term operationoptimise.dcs.aber.ac.uk › wp-content › uploads › 20180221_COST... · 2018-05-15 · National Ecological Observatory Network](https://reader033.fdocuments.net/reader033/viewer/2022060319/5f0ccf257e708231d4373cd4/html5/thumbnails/28.jpg)
28
in-situ sampling, proximal and remote sensing
![Page 29: NEON: from scientific strategy to long-term operationoptimise.dcs.aber.ac.uk › wp-content › uploads › 20180221_COST... · 2018-05-15 · National Ecological Observatory Network](https://reader033.fdocuments.net/reader033/viewer/2022060319/5f0ccf257e708231d4373cd4/html5/thumbnails/29.jpg)
29
in-situ sampling, proximal and remote sensing
![Page 30: NEON: from scientific strategy to long-term operationoptimise.dcs.aber.ac.uk › wp-content › uploads › 20180221_COST... · 2018-05-15 · National Ecological Observatory Network](https://reader033.fdocuments.net/reader033/viewer/2022060319/5f0ccf257e708231d4373cd4/html5/thumbnails/30.jpg)
30
in-situ sampling, proximal and remote sensing
![Page 31: NEON: from scientific strategy to long-term operationoptimise.dcs.aber.ac.uk › wp-content › uploads › 20180221_COST... · 2018-05-15 · National Ecological Observatory Network](https://reader033.fdocuments.net/reader033/viewer/2022060319/5f0ccf257e708231d4373cd4/html5/thumbnails/31.jpg)
31
![Page 32: NEON: from scientific strategy to long-term operationoptimise.dcs.aber.ac.uk › wp-content › uploads › 20180221_COST... · 2018-05-15 · National Ecological Observatory Network](https://reader033.fdocuments.net/reader033/viewer/2022060319/5f0ccf257e708231d4373cd4/html5/thumbnails/32.jpg)
32
the National Ecological Observatory Network
![Page 33: NEON: from scientific strategy to long-term operationoptimise.dcs.aber.ac.uk › wp-content › uploads › 20180221_COST... · 2018-05-15 · National Ecological Observatory Network](https://reader033.fdocuments.net/reader033/viewer/2022060319/5f0ccf257e708231d4373cd4/html5/thumbnails/33.jpg)
33
0 10 20 30Exp
lain
ed
eco
-
clim
ati
c va
ria
bil
ity
Number of Domains
Insufficient Explanatory Power Unbounded Expense
why 20 domains?
![Page 34: NEON: from scientific strategy to long-term operationoptimise.dcs.aber.ac.uk › wp-content › uploads › 20180221_COST... · 2018-05-15 · National Ecological Observatory Network](https://reader033.fdocuments.net/reader033/viewer/2022060319/5f0ccf257e708231d4373cd4/html5/thumbnails/34.jpg)
2/3 detection rate
34
data: science implications
Mahecha et al., 2017
detecting extreme events
128 AF sites
39 NEON sitesAmeriFlux
sites across eco-climatic regions
Hargrove and Hoffman, 1999 & 2004
NEON
![Page 35: NEON: from scientific strategy to long-term operationoptimise.dcs.aber.ac.uk › wp-content › uploads › 20180221_COST... · 2018-05-15 · National Ecological Observatory Network](https://reader033.fdocuments.net/reader033/viewer/2022060319/5f0ccf257e708231d4373cd4/html5/thumbnails/35.jpg)
35
overview
• why bridging observational scales?
• NEON: designed for scaling
• centralized data operations and monitoring
• scalable scientific computing
• combining ground-based, airborne and space-borne data
• summary and outlook
![Page 36: NEON: from scientific strategy to long-term operationoptimise.dcs.aber.ac.uk › wp-content › uploads › 20180221_COST... · 2018-05-15 · National Ecological Observatory Network](https://reader033.fdocuments.net/reader033/viewer/2022060319/5f0ccf257e708231d4373cd4/html5/thumbnails/36.jpg)
36
data operations architecture
![Page 37: NEON: from scientific strategy to long-term operationoptimise.dcs.aber.ac.uk › wp-content › uploads › 20180221_COST... · 2018-05-15 · National Ecological Observatory Network](https://reader033.fdocuments.net/reader033/viewer/2022060319/5f0ccf257e708231d4373cd4/html5/thumbnails/37.jpg)
37
science operations management
• problem tracking and resolution along the entire chain
• training
• sensor preventive maintenance
• sensor calibration
• sensor health status monitoring, incident tracking and resolution
• data processing
• continuous data quality monitoring
• data revisioning
![Page 38: NEON: from scientific strategy to long-term operationoptimise.dcs.aber.ac.uk › wp-content › uploads › 20180221_COST... · 2018-05-15 · National Ecological Observatory Network](https://reader033.fdocuments.net/reader033/viewer/2022060319/5f0ccf257e708231d4373cd4/html5/thumbnails/38.jpg)
38
• problem tracking and resolution along the entire chain
science operations management
![Page 39: NEON: from scientific strategy to long-term operationoptimise.dcs.aber.ac.uk › wp-content › uploads › 20180221_COST... · 2018-05-15 · National Ecological Observatory Network](https://reader033.fdocuments.net/reader033/viewer/2022060319/5f0ccf257e708231d4373cd4/html5/thumbnails/39.jpg)
39
• problem tracking and resolution along the entire chain
science operations management
![Page 40: NEON: from scientific strategy to long-term operationoptimise.dcs.aber.ac.uk › wp-content › uploads › 20180221_COST... · 2018-05-15 · National Ecological Observatory Network](https://reader033.fdocuments.net/reader033/viewer/2022060319/5f0ccf257e708231d4373cd4/html5/thumbnails/40.jpg)
40
data products and access
![Page 41: NEON: from scientific strategy to long-term operationoptimise.dcs.aber.ac.uk › wp-content › uploads › 20180221_COST... · 2018-05-15 · National Ecological Observatory Network](https://reader033.fdocuments.net/reader033/viewer/2022060319/5f0ccf257e708231d4373cd4/html5/thumbnails/41.jpg)
41
data products and access
![Page 42: NEON: from scientific strategy to long-term operationoptimise.dcs.aber.ac.uk › wp-content › uploads › 20180221_COST... · 2018-05-15 · National Ecological Observatory Network](https://reader033.fdocuments.net/reader033/viewer/2022060319/5f0ccf257e708231d4373cd4/html5/thumbnails/42.jpg)
42
data products and access
![Page 43: NEON: from scientific strategy to long-term operationoptimise.dcs.aber.ac.uk › wp-content › uploads › 20180221_COST... · 2018-05-15 · National Ecological Observatory Network](https://reader033.fdocuments.net/reader033/viewer/2022060319/5f0ccf257e708231d4373cd4/html5/thumbnails/43.jpg)
43
data products and access
![Page 44: NEON: from scientific strategy to long-term operationoptimise.dcs.aber.ac.uk › wp-content › uploads › 20180221_COST... · 2018-05-15 · National Ecological Observatory Network](https://reader033.fdocuments.net/reader033/viewer/2022060319/5f0ccf257e708231d4373cd4/html5/thumbnails/44.jpg)
44
data products and access
![Page 45: NEON: from scientific strategy to long-term operationoptimise.dcs.aber.ac.uk › wp-content › uploads › 20180221_COST... · 2018-05-15 · National Ecological Observatory Network](https://reader033.fdocuments.net/reader033/viewer/2022060319/5f0ccf257e708231d4373cd4/html5/thumbnails/45.jpg)
45
data: interoperability
![Page 46: NEON: from scientific strategy to long-term operationoptimise.dcs.aber.ac.uk › wp-content › uploads › 20180221_COST... · 2018-05-15 · National Ecological Observatory Network](https://reader033.fdocuments.net/reader033/viewer/2022060319/5f0ccf257e708231d4373cd4/html5/thumbnails/46.jpg)
46
data: interoperability
![Page 47: NEON: from scientific strategy to long-term operationoptimise.dcs.aber.ac.uk › wp-content › uploads › 20180221_COST... · 2018-05-15 · National Ecological Observatory Network](https://reader033.fdocuments.net/reader033/viewer/2022060319/5f0ccf257e708231d4373cd4/html5/thumbnails/47.jpg)
47
data: interoperability
![Page 48: NEON: from scientific strategy to long-term operationoptimise.dcs.aber.ac.uk › wp-content › uploads › 20180221_COST... · 2018-05-15 · National Ecological Observatory Network](https://reader033.fdocuments.net/reader033/viewer/2022060319/5f0ccf257e708231d4373cd4/html5/thumbnails/48.jpg)
48
data: interoperability
NEON airborne remote sensing
![Page 49: NEON: from scientific strategy to long-term operationoptimise.dcs.aber.ac.uk › wp-content › uploads › 20180221_COST... · 2018-05-15 · National Ecological Observatory Network](https://reader033.fdocuments.net/reader033/viewer/2022060319/5f0ccf257e708231d4373cd4/html5/thumbnails/49.jpg)
49
data: interoperability
collocated1. Bartlett Experimental Forest (US-Bar) / BART2. Harvard Forest (US-Ha1) / HOPB3. Konza Prairie (US-Kon) / KONZ-KING-KONA cluster4. Kansas Field Station (US-KSF) / KFS5. Niwot Ridge (US-NR1) / NIWO-COMO6. Santa Rita Creosote (US-SRC) / SRER7. Eight Mile Lake Permafrost (US-EML) / HEAL8. Barrow (US-NGB & US-Bes) / BARR
adjacent9. Poker Flat Research Range (US-Prr) / CARI-BONA
in vicinity (assignable assets)10. Slashpine Austin Cary (US-SP1) / BARC-OSBS-SUGG cluster11. Sylvania (US-Syv) / UNDE- CRAM cluster
NEON airborne remote sensing
![Page 50: NEON: from scientific strategy to long-term operationoptimise.dcs.aber.ac.uk › wp-content › uploads › 20180221_COST... · 2018-05-15 · National Ecological Observatory Network](https://reader033.fdocuments.net/reader033/viewer/2022060319/5f0ccf257e708231d4373cd4/html5/thumbnails/50.jpg)
50
educational resources
![Page 51: NEON: from scientific strategy to long-term operationoptimise.dcs.aber.ac.uk › wp-content › uploads › 20180221_COST... · 2018-05-15 · National Ecological Observatory Network](https://reader033.fdocuments.net/reader033/viewer/2022060319/5f0ccf257e708231d4373cd4/html5/thumbnails/51.jpg)
51
educational resources
![Page 52: NEON: from scientific strategy to long-term operationoptimise.dcs.aber.ac.uk › wp-content › uploads › 20180221_COST... · 2018-05-15 · National Ecological Observatory Network](https://reader033.fdocuments.net/reader033/viewer/2022060319/5f0ccf257e708231d4373cd4/html5/thumbnails/52.jpg)
52
educational resources
![Page 53: NEON: from scientific strategy to long-term operationoptimise.dcs.aber.ac.uk › wp-content › uploads › 20180221_COST... · 2018-05-15 · National Ecological Observatory Network](https://reader033.fdocuments.net/reader033/viewer/2022060319/5f0ccf257e708231d4373cd4/html5/thumbnails/53.jpg)
53
overview
• why bridging observational scales?
• NEON: designed for scaling
• centralized data operations and monitoring
• scalable scientific computing
• combining ground-based, airborne and space-borne data
• summary and outlook
![Page 54: NEON: from scientific strategy to long-term operationoptimise.dcs.aber.ac.uk › wp-content › uploads › 20180221_COST... · 2018-05-15 · National Ecological Observatory Network](https://reader033.fdocuments.net/reader033/viewer/2022060319/5f0ccf257e708231d4373cd4/html5/thumbnails/54.jpg)
54
data operations architecture
![Page 55: NEON: from scientific strategy to long-term operationoptimise.dcs.aber.ac.uk › wp-content › uploads › 20180221_COST... · 2018-05-15 · National Ecological Observatory Network](https://reader033.fdocuments.net/reader033/viewer/2022060319/5f0ccf257e708231d4373cd4/html5/thumbnails/55.jpg)
• eddy4R family of R-packages (raw data → 30 min)
55
software: eddy4R eddy-covariance R-packages
![Page 56: NEON: from scientific strategy to long-term operationoptimise.dcs.aber.ac.uk › wp-content › uploads › 20180221_COST... · 2018-05-15 · National Ecological Observatory Network](https://reader033.fdocuments.net/reader033/viewer/2022060319/5f0ccf257e708231d4373cd4/html5/thumbnails/56.jpg)
• eddy4R family of R-packages (raw data → 30 min)
• NEON's eddy4R, nneo, metscanner + MPI's REddyProc R-packages: end-to-end, modularly adjustable and extensible workflows in single R-environment
56
software: eddy4R eddy-covariance R-packages
R workflow
tur ulen e
processing
parameters
L1 – L4
HDF5 files
loop around planar-fit/Wavelet period
collect around planar-fit/Wavelet period
ingest remote-sensing data
collect: turbulence data
transform SONIC planar-fit
field-validate IRGA
data-parallel: turbulence data read L0p
transform AMRS
calculate Wavelet
data-parallel: processing core correct frequency response
calculate L1-L4 DPs, Wavelet stats
collect: processing core
model footprint
perform, summarize QA/QC
quantify, summarize uncertainty
lag-correction
![Page 57: NEON: from scientific strategy to long-term operationoptimise.dcs.aber.ac.uk › wp-content › uploads › 20180221_COST... · 2018-05-15 · National Ecological Observatory Network](https://reader033.fdocuments.net/reader033/viewer/2022060319/5f0ccf257e708231d4373cd4/html5/thumbnails/57.jpg)
• Docker shipping container system for code
• eddy4R-Docker: turn-key, reproducible, extensible and portable data processing + analysis environment
• DevOps community development framework
57
software: community access and extensibility
Computer
![Page 58: NEON: from scientific strategy to long-term operationoptimise.dcs.aber.ac.uk › wp-content › uploads › 20180221_COST... · 2018-05-15 · National Ecological Observatory Network](https://reader033.fdocuments.net/reader033/viewer/2022060319/5f0ccf257e708231d4373cd4/html5/thumbnails/58.jpg)
58
data: eddy-covariance
processing pipeline characteristics
• near-real-time (1 week → 1 month)
• extensible: e.g. operational data fusion
![Page 59: NEON: from scientific strategy to long-term operationoptimise.dcs.aber.ac.uk › wp-content › uploads › 20180221_COST... · 2018-05-15 · National Ecological Observatory Network](https://reader033.fdocuments.net/reader033/viewer/2022060319/5f0ccf257e708231d4373cd4/html5/thumbnails/59.jpg)
59
overview
• why bridging observational scales?
• NEON: designed for scaling
• centralized data operations and monitoring
• scalable scientific computing
• combining ground-based, airborne and space-borne data
• summary and outlook
![Page 60: NEON: from scientific strategy to long-term operationoptimise.dcs.aber.ac.uk › wp-content › uploads › 20180221_COST... · 2018-05-15 · National Ecological Observatory Network](https://reader033.fdocuments.net/reader033/viewer/2022060319/5f0ccf257e708231d4373cd4/html5/thumbnails/60.jpg)
60
scope of the taskTe
mpo
ral s
cale
Spatial scale [km2]
Second
Minute
Hour
DayWeekMonth
Year
Decade
Century
Airborne
Space-borne
10−6 100 106 1012
Ground-based
Airborne
Space-borne
Ground-based
Resolution
Coverage
Model-data fusion
Earth systemmodel
![Page 61: NEON: from scientific strategy to long-term operationoptimise.dcs.aber.ac.uk › wp-content › uploads › 20180221_COST... · 2018-05-15 · National Ecological Observatory Network](https://reader033.fdocuments.net/reader033/viewer/2022060319/5f0ccf257e708231d4373cd4/html5/thumbnails/61.jpg)
61
environmental response function virtual control volume
Footprint modeling over coordinated observations of drivers and responses
Metzger (2017)
![Page 62: NEON: from scientific strategy to long-term operationoptimise.dcs.aber.ac.uk › wp-content › uploads › 20180221_COST... · 2018-05-15 · National Ecological Observatory Network](https://reader033.fdocuments.net/reader033/viewer/2022060319/5f0ccf257e708231d4373cd4/html5/thumbnails/62.jpg)
62
environmental response function virtual control volumegrid-projected turbulent heat flux
r CpdT / dt
[W /m3]
2011-08-13 CST
volume-projected heat storage change
Xu et al. (2017)
![Page 63: NEON: from scientific strategy to long-term operationoptimise.dcs.aber.ac.uk › wp-content › uploads › 20180221_COST... · 2018-05-15 · National Ecological Observatory Network](https://reader033.fdocuments.net/reader033/viewer/2022060319/5f0ccf257e708231d4373cd4/html5/thumbnails/63.jpg)
63
environmental response function virtual control volumestorage flux turbulent flux grids surface-atmosphere
exchange grids
[W/m2]
r CpdT / dt
[W /m3]
aaadfweferggdgfa
Xu et al. (2017)
application examples
• near-real-time capability (1 week → 1 month, e.g. AmeriFlux)
• operational data fusion (e.g., NASA ECOSTRESS)
![Page 64: NEON: from scientific strategy to long-term operationoptimise.dcs.aber.ac.uk › wp-content › uploads › 20180221_COST... · 2018-05-15 · National Ecological Observatory Network](https://reader033.fdocuments.net/reader033/viewer/2022060319/5f0ccf257e708231d4373cd4/html5/thumbnails/64.jpg)
64
overview
• why bridging observational scales?
• NEON: designed for scaling
• centralized data operations and monitoring
• scalable scientific computing
• combining ground-based, airborne and space-borne data
• summary and outlook
![Page 65: NEON: from scientific strategy to long-term operationoptimise.dcs.aber.ac.uk › wp-content › uploads › 20180221_COST... · 2018-05-15 · National Ecological Observatory Network](https://reader033.fdocuments.net/reader033/viewer/2022060319/5f0ccf257e708231d4373cd4/html5/thumbnails/65.jpg)
• bridging scales one of the fundamental challenges in ecology
• NEON’s observation hierarchy is designed for scaling (continuity)
• centralized data operations efficiently manage data quality and standardization
• coordinated, interoperable NEON flux, in-situ, proximal and remote sensing data
• public NEON “eddy4R” + GitHub + Docker flux software and usability tools
• combining data across scales with environmental response functions
• joint proposal writing for operational data fusion
65
conclusions and outlook
![Page 66: NEON: from scientific strategy to long-term operationoptimise.dcs.aber.ac.uk › wp-content › uploads › 20180221_COST... · 2018-05-15 · National Ecological Observatory Network](https://reader033.fdocuments.net/reader033/viewer/2022060319/5f0ccf257e708231d4373cd4/html5/thumbnails/66.jpg)
66
• NEON data products span large spatio-temporal scales, e.g. airborne remote sensing and automated tower measurements
• we aim to bridge these spatio-temporal gaps in NEON data products using a unmanned aerial vehicle remote-sensing platform
airborne remote-sensing observation node (ARGON)
• objectives
develop less expensive and more agile remotely sensed data products.
enabling target-of-opportunity measurement campaigns for extreme ecological events
![Page 67: NEON: from scientific strategy to long-term operationoptimise.dcs.aber.ac.uk › wp-content › uploads › 20180221_COST... · 2018-05-15 · National Ecological Observatory Network](https://reader033.fdocuments.net/reader033/viewer/2022060319/5f0ccf257e708231d4373cd4/html5/thumbnails/67.jpg)
67
overview
• why bridging observational scales?
• NEON: designed for scaling
• centralized data operations and monitoring
• scalable scientific computing
• combining ground-based, airborne and space-borne data
• summary and outlook