International Collaboration between DB stations for EOS Data Networking Steve Dutcher, Paolo...

23
International Collaboration between DB stations for EOS Data Networking Steve Dutcher, Paolo Antonelli, Gieuseppe Meoli, Tom Rink, Liam Gumley, Paul Menzel, Tom Whittaker Benevento, Italy Oct. 3, 2005

Transcript of International Collaboration between DB stations for EOS Data Networking Steve Dutcher, Paolo...

Page 1: International Collaboration between DB stations for EOS Data Networking Steve Dutcher, Paolo Antonelli, Gieuseppe Meoli, Tom Rink, Liam Gumley, Paul Menzel,

International Collaboration between DB stations

for EOS Data Networking

Steve Dutcher, Paolo Antonelli, Gieuseppe Meoli, Tom Rink,

Liam Gumley, Paul Menzel, Tom Whittaker

Benevento, Italy

Oct. 3, 2005

Page 2: International Collaboration between DB stations for EOS Data Networking Steve Dutcher, Paolo Antonelli, Gieuseppe Meoli, Tom Rink, Liam Gumley, Paul Menzel,

International Collaboration between DB stations

for EOS Data Networking

In this talk I will be discussing software

packages that can be used for sharing of EOS

Data between DB stations and software for

visualizing this data.

I will also be giving a live demo of this software

with some remote data sets.

Page 3: International Collaboration between DB stations for EOS Data Networking Steve Dutcher, Paolo Antonelli, Gieuseppe Meoli, Tom Rink, Liam Gumley, Paul Menzel,

Outline

● OPeNDAP (software for serving up data to

users) ● Hydra (client software for visualizing

instrument data)● S-HIS example● MODIS/AIRS example

Page 4: International Collaboration between DB stations for EOS Data Networking Steve Dutcher, Paolo Antonelli, Gieuseppe Meoli, Tom Rink, Liam Gumley, Paul Menzel,

OPeNDAP

● OPeNDAP: Open-source Project for a

Network Data Access Protocol.

● Main advantage: Allows user to access

remote data sets without downloading the

entire file. For instance, a user could open a

MODIS 1km hdf file and just grab one band

rather than the entire file.

Page 5: International Collaboration between DB stations for EOS Data Networking Steve Dutcher, Paolo Antonelli, Gieuseppe Meoli, Tom Rink, Liam Gumley, Paul Menzel,

OPeNDAP

● Supported file formats:– both HDF and NetCDF

● Client software:– specialized GUI software package for working

with data like Hydra or IDV– there is also a Matlab toolbox for OPeNDAP so

that you can manipulate the data to your liking

Page 6: International Collaboration between DB stations for EOS Data Networking Steve Dutcher, Paolo Antonelli, Gieuseppe Meoli, Tom Rink, Liam Gumley, Paul Menzel,

OPeNDAP

● Another nice feature of OPeNDAP is that

your data files don't have to be formatted in a

specific way, any NetCDF of HDF file can be

served to the users. ● OPeNDAP runs using http protocol and users

can go view a webpage of available data.

Should they find a data set of interest they

just copy that link into their application.

Page 7: International Collaboration between DB stations for EOS Data Networking Steve Dutcher, Paolo Antonelli, Gieuseppe Meoli, Tom Rink, Liam Gumley, Paul Menzel,

OPeNDAP

● For more information on OPeNDAP, please

visit:

http://www.opendap.org/

Page 8: International Collaboration between DB stations for EOS Data Networking Steve Dutcher, Paolo Antonelli, Gieuseppe Meoli, Tom Rink, Liam Gumley, Paul Menzel,

Hydra

Page 9: International Collaboration between DB stations for EOS Data Networking Steve Dutcher, Paolo Antonelli, Gieuseppe Meoli, Tom Rink, Liam Gumley, Paul Menzel,

Hydra

● Hydra is the Hyperspectral-viewer for

Development of Research Applications

● Hydra was originally developed as a tool for

teaching but many people now use it as a

quick way for browsing through

MODIS/AIRS/GOES and other instrument

data

Page 10: International Collaboration between DB stations for EOS Data Networking Steve Dutcher, Paolo Antonelli, Gieuseppe Meoli, Tom Rink, Liam Gumley, Paul Menzel,

Hydra

● Open source software so anyone can

download it for free.● Built using Java so it is platform independent.● Uses its own scripting language Jython which

is a combination of Python and Java. Using

a scripting language allows for rapid

development.● Uses VisAD libraries.

Page 11: International Collaboration between DB stations for EOS Data Networking Steve Dutcher, Paolo Antonelli, Gieuseppe Meoli, Tom Rink, Liam Gumley, Paul Menzel,

Hydra

● Data access:– local data files– remote data from an

OPeNDAP server– remote data from an

OpenADDE server

Page 12: International Collaboration between DB stations for EOS Data Networking Steve Dutcher, Paolo Antonelli, Gieuseppe Meoli, Tom Rink, Liam Gumley, Paul Menzel,

Hydra

● Here is the list of currently supported

instruments. Others can be added as

needed.

– MODIS/AIRS– GOES/MSG– S-HIS

Page 13: International Collaboration between DB stations for EOS Data Networking Steve Dutcher, Paolo Antonelli, Gieuseppe Meoli, Tom Rink, Liam Gumley, Paul Menzel,

S-HIS

● S-HIS is an aircraft based intereferometer.

This instrument has been used for the

validation of AIRS and other satellite based

interferometers.

Page 14: International Collaboration between DB stations for EOS Data Networking Steve Dutcher, Paolo Antonelli, Gieuseppe Meoli, Tom Rink, Liam Gumley, Paul Menzel,

S-HIS

● The next slide shows Hydra flipping through

the different segments of a flight from the

Pacific THORPEX campaign. In the upper

part of the black window you see a single

SHIS brightness temperature. The bottom

part shows just one BT, 1050 wavenumbers

and then it flips through the flight segments.

Page 15: International Collaboration between DB stations for EOS Data Networking Steve Dutcher, Paolo Antonelli, Gieuseppe Meoli, Tom Rink, Liam Gumley, Paul Menzel,

S-HIS

Pacific

THORPEX:

03 Mar 2003

Page 16: International Collaboration between DB stations for EOS Data Networking Steve Dutcher, Paolo Antonelli, Gieuseppe Meoli, Tom Rink, Liam Gumley, Paul Menzel,

S-HIS

● The next slide shows using Hydra to validate

temperature retrievals using a Radiosonde

for comparison.

Page 17: International Collaboration between DB stations for EOS Data Networking Steve Dutcher, Paolo Antonelli, Gieuseppe Meoli, Tom Rink, Liam Gumley, Paul Menzel,

Temperature Sounding Validation

Page 18: International Collaboration between DB stations for EOS Data Networking Steve Dutcher, Paolo Antonelli, Gieuseppe Meoli, Tom Rink, Liam Gumley, Paul Menzel,

Hydra with AIRS data

● This image shows a single

radiance in the top window.

The green line shows which

wavenumber has been

selected for the bottom

window image. Users can

choose to view any radiance

from the image.

Page 19: International Collaboration between DB stations for EOS Data Networking Steve Dutcher, Paolo Antonelli, Gieuseppe Meoli, Tom Rink, Liam Gumley, Paul Menzel,

Hydra with AIRS data

● One nice feature of Hydra is the ability to do

linear combinations. The image below shows

subtracting wavenumber 903.6 from 1403.5

Page 20: International Collaboration between DB stations for EOS Data Networking Steve Dutcher, Paolo Antonelli, Gieuseppe Meoli, Tom Rink, Liam Gumley, Paul Menzel,

Hydra with AIRS data

● You can also create scatter plots from two

different images you have from doing a linear

combination. And then you can select

regions from either of your images or the

scatter plot to see where the contributing

points come from.

Page 21: International Collaboration between DB stations for EOS Data Networking Steve Dutcher, Paolo Antonelli, Gieuseppe Meoli, Tom Rink, Liam Gumley, Paul Menzel,

In the top left window we have circled a

section and the contributing points show up

on the scatter plot

Page 22: International Collaboration between DB stations for EOS Data Networking Steve Dutcher, Paolo Antonelli, Gieuseppe Meoli, Tom Rink, Liam Gumley, Paul Menzel,

Hydra

● For more information on Hydra please visit

this site:

http://www.ssec.wisc.edu/hydra

● You should be able to download Hydra here

and start using it, you must have Java3D

installed first

Page 23: International Collaboration between DB stations for EOS Data Networking Steve Dutcher, Paolo Antonelli, Gieuseppe Meoli, Tom Rink, Liam Gumley, Paul Menzel,

Conclusion

● Both packages being used here, OPeNDAP

and Hydra have been very useful to us and

we hope that other DB stations consider

running OpeNDAP servers as well. If you

want your station added to the list of sites in

Hydra serving their data please email:

[email protected]