NASA Support for WTF-CEOP Sept 11, 2006 Ken McDonald, NASA Yonsook Enloe, SGT Inc.

CEOS WGISS CEOS WGISS May 2006May 2006

NASA Support for WTF-CEOP

Sept 11, 2006

Ken McDonald, NASAYonsook Enloe, SGT Inc.


CEOP Satellite Data CEOP Satellite Data ServerServer

• CEOP science community is using the CEOP science community is using the OPeNDAP enabled clients and servers to OPeNDAP enabled clients and servers to analyze the field data and model dataanalyze the field data and model data

• CEOP science community had difficulty using CEOP science community had difficulty using satellite data because of the lack of toolssatellite data because of the lack of tools

• NASA’s Satellite Data Server prototype was NASA’s Satellite Data Server prototype was developed that demonstrated OPeNDAP developed that demonstrated OPeNDAP client (Grads) access to the WCS server client (Grads) access to the WCS server capabilities.capabilities.

• Prototype was demonstrated at CEOP Prototype was demonstrated at CEOP Implementation Planning meeting and Implementation Planning meeting and previous WGISS meetings.previous WGISS meetings.


Satellite Data Server Satellite Data Server

NWGISS WCS

WCS Client

Satellite Data, Swath and Grid

Grads Client

Grads-DODSServer (GDS)

Other OPeNDAP Clients

Field DataModel Output

Standard Functionse.g. subsetting

Standard Functionse.g. subsettingCustom Functions(Grads)

OPeNDAPRequest TranslatorDefault georectification

CF Attrubute ConstrtuctionCustom Requests (future)


Integration of Satellite and Model Integration of Satellite and Model DataData


Continuing SupportContinuing Support• Using the prototype as a basis, the NASA team Using the prototype as a basis, the NASA team

(McDonald/GSFC, Di/GMU, Enloe/SGT, (McDonald/GSFC, Di/GMU, Enloe/SGT, Holloway/OPeNDAP) proposed to NASA’s Holloway/OPeNDAP) proposed to NASA’s Advancing Collaborative Connections for Earth-Advancing Collaborative Connections for Earth-Sun System Science (ACCESS) Program.Sun System Science (ACCESS) Program.

• NASA team awarded 2 year ACCESS funding to NASA team awarded 2 year ACCESS funding to develop the Satellite Data Server with an develop the Satellite Data Server with an optional 3optional 3rdrd year. year.

• A second proposal to develop a gateway that A second proposal to develop a gateway that would make OPeNDAP servers accessible to would make OPeNDAP servers accessible to OGC clients was partially supported and OGC clients was partially supported and merged with this effort - added two additional merged with this effort - added two additional team members (Domenico/Unidata, team members (Domenico/Unidata, Rutledge/NOAA-NCDC).Rutledge/NOAA-NCDC).


Status and PlansStatus and Plans• Held kick-off meeting with combined team in MarchHeld kick-off meeting with combined team in March• Finalized work plan for both gatewaysFinalized work plan for both gateways• Satellite Data Server will be developed as proposed, Satellite Data Server will be developed as proposed,

allowing the CEOP scientists to inter-compare allowing the CEOP scientists to inter-compare satellite data with model output data and field datasatellite data with model output data and field data

• Plan to deploy the Satellite Data Server at JAXA and Plan to deploy the Satellite Data Server at JAXA and other sites with satellite data of interest to the CEOP other sites with satellite data of interest to the CEOP communitycommunity

• OGC/Geoscience Gateway will focus on catalog OGC/Geoscience Gateway will focus on catalog services - WCS access will be addressed with 3rd services - WCS access will be addressed with 3rd year fundingyear funding

• Paper describing the Satellite Data Server and the Paper describing the Satellite Data Server and the OGC/Geoscience Gateway presented at the IGARSS OGC/Geoscience Gateway presented at the IGARSS 06 conference.06 conference.

• First phase (very basic) implementation will be First phase (very basic) implementation will be completed in May 2007.completed in May 2007.


OPeNDAP & ECHOOPeNDAP & ECHO• OPeNDAP and ECHO team worked together to OPeNDAP and ECHO team worked together to

provide direct search and access to ECHO via provide direct search and access to ECHO via OPeNDAP enabled clients (e.g. Matlab) using OPeNDAP enabled clients (e.g. Matlab) using ECHO’s web services. Demo following.ECHO’s web services. Demo following.

• ECHO search query implemented as an ECHO web ECHO search query implemented as an ECHO web service, using ECHO’s 8.0 web service APIs. service, using ECHO’s 8.0 web service APIs.

• OPeNDAP Group developed a stand alone Java OPeNDAP Group developed a stand alone Java client to invoke the ECHO search query via a query client to invoke the ECHO search query via a query service. This stand alone client can be invoked by service. This stand alone client can be invoked by matlab and other OPeNDAP enabled clients.matlab and other OPeNDAP enabled clients.

• Michael Burnett will demonstrate this in this Michael Burnett will demonstrate this in this session.session.


JAXA/NASA Meeting JAXA/NASA Meeting ResultsResults

• NASA and JAXA teams met Sept 7-8 to discuss WTF-CEOP NASA and JAXA teams met Sept 7-8 to discuss WTF-CEOP activitiesactivities

• Each team presented information about future plans for the Each team presented information about future plans for the 2 prototypes2 prototypes

• ECHO team gave an extensive briefing on metadata ingest, ECHO team gave an extensive briefing on metadata ingest, client development, and extended services.client development, and extended services.

• NASA team gave an overview of the different types of WCS NASA team gave an overview of the different types of WCS servers available.servers available.

• Potential for JAXA system to access NASA satellite data Potential for JAXA system to access NASA satellite data through the WCS to get the data transforming capabilitiesthrough the WCS to get the data transforming capabilities

• Discussed the need to improve data discovery of CEOP dataDiscussed the need to improve data discovery of CEOP data• NASA and JAXA teams will work together to support multiple NASA and JAXA teams will work together to support multiple

GEO tasks with both prototypesGEO tasks with both prototypes• The CEOP Satellite Data Server and ECHO can be The CEOP Satellite Data Server and ECHO can be

contributions for selected GEO tasks identified by Satoko contributions for selected GEO tasks identified by Satoko earlier.earlier.


Issues for CEOP Issues for CEOP Science Science

• Identify data sources of interest for data Identify data sources of interest for data discovery/search (Max Planck, UCAR, University of discovery/search (Max Planck, UCAR, University of Tokyo, JAXA, NASA, Eumetsat, ESA, NOMADS, .....)Tokyo, JAXA, NASA, Eumetsat, ESA, NOMADS, .....)

• Discuss the CEOP data policy issues for broader data Discuss the CEOP data policy issues for broader data discovery – how to get online access to the CEOIP data discovery – how to get online access to the CEOIP data sources; any special permissions or agreements needed?sources; any special permissions or agreements needed?

• Identify data type – product and geophysical parameter Identify data type – product and geophysical parameter names – have this info from Prof Koike already (list of names – have this info from Prof Koike already (list of satellite products he sent out last year) but the list of satellite products he sent out last year) but the list of NASA satellite products do not have the geophysical NASA satellite products do not have the geophysical parameters listed like those of the ESA productsparameters listed like those of the ESA products

• JAXA team will ask CEOP scientists what addition LAS JAXA team will ask CEOP scientists what addition LAS system functions they would like to have implemented in system functions they would like to have implemented in the JAXA prototypethe JAXA prototype


Need Future Need Future International International ParticipationParticipation• Do you have satellite data of interest Do you have satellite data of interest

to the CEOP science community? to the CEOP science community? • Select and install a WCS Server suited Select and install a WCS Server suited

to your satellite data. to your satellite data. • Install a CEOP Satellite Data Server to Install a CEOP Satellite Data Server to

provide an OPeNDAP gateway to the provide an OPeNDAP gateway to the WCS served satellite dataWCS served satellite data

• CEOP Satellite Data Server expected to CEOP Satellite Data Server expected to be ready for external installation in be ready for external installation in 2008.2008.


Known WCS Servers and Known WCS Servers and ClientsClients• There are many WCS servers and client software available, from both There are many WCS servers and client software available, from both

commercial software vendors and research organizations.commercial software vendors and research organizations.• Many implementations are unknown because there is no requirement to register Many implementations are unknown because there is no requirement to register

your products at a center location.your products at a center location.• Known commercial productsKnown commercial products

– Carbon Tools --- ??? – WCS 1.0 clientCarbon Tools --- ??? – WCS 1.0 client– Compusult Limited – Service Manager 3.0 –WCS 0.7 ServerCompusult Limited – Service Manager 3.0 –WCS 0.7 Server– ESRI -- ??? – WCS 1.0 clientESRI -- ??? – WCS 1.0 client– Generalitat ValencianaGeneralitat Valenciana----gvSIG 0.6gvSIG 0.6 –WCS 1.0 Client –WCS 1.0 Client– IonicIonic

• RedSpider ImageArchive 3.0.1 – WCS 0.7 & WCS 1.0 Server and ClientRedSpider ImageArchive 3.0.1 – WCS 0.7 & WCS 1.0 Server and Client• RedSpider Enterprise 3.4 - WCS 1.0 clientRedSpider Enterprise 3.4 - WCS 1.0 client• RedSpider Web 3.3 - WCS 1.0 server and clientRedSpider Web 3.3 - WCS 1.0 server and client

– MiraMon--MiraMon Map Server 5.0-WCS 0.7 server and clientMiraMon--MiraMon Map Server 5.0-WCS 0.7 server and client• Known research productsKnown research products

– GMU – NWGISS – WCS 0.7 and 1.0 server and clientGMU – NWGISS – WCS 0.7 and 1.0 server and client– Unidata – Unidata server – WCS 1.0 serverUnidata – Unidata server – WCS 1.0 server– DLR – WCS 0.7DLR – WCS 0.7– UK Space AgencyUK Space Agency– U. of FlorenceU. of Florence– Washington University – WCS 1.0 Washington University – WCS 1.0 – Columbia University Columbia University

http://www.gvsig.gva.es/

http://www.opengeospatial.org/resource/products/details/?pid=499


GMU NWGISS WCS GMU NWGISS WCS ServerServer• Support WCS 1.0Support WCS 1.0

• The formats the server can ingest at the back-endThe formats the server can ingest at the back-end– HDF-EOS (both swath and grid)HDF-EOS (both swath and grid)– Format converters are available to convert GeoTiFF and netCDF files to Format converters are available to convert GeoTiFF and netCDF files to

HDF-EOSHDF-EOS– A test version of the server can work directly with netCDF and GeoTiFF A test version of the server can work directly with netCDF and GeoTiFF

files.files.• Potential satellite data that can be servedPotential satellite data that can be served

– All satellite data in HDF-EOS, GeoTIFF, (and potentially netCDF-CF) can All satellite data in HDF-EOS, GeoTIFF, (and potentially netCDF-CF) can be served. be served.

• CRS CRS – All CRSs in GCTP are supported in both input data and output data.All CRSs in GCTP are supported in both input data and output data.– Provide automatic CRS conversion – not completely tested. Provide automatic CRS conversion – not completely tested. – Provide automatic georectification to swath data.Provide automatic georectification to swath data.

• Coverage output formatsCoverage output formats– Operational version support HDF-EOS, GeoTiFF, NITF, and plain Binary.Operational version support HDF-EOS, GeoTiFF, NITF, and plain Binary.– A GALEON test version also support netCDF-CF.A GALEON test version also support netCDF-CF.– A test version supports all formats (about 40) in GDAL library.A test version supports all formats (about 40) in GDAL library.

• Binary of the software is for free downloadBinary of the software is for free download• Installation at GMU sites provide access to all EOS data in data Installation at GMU sites provide access to all EOS data in data

pools as well as 17 TB of Landsat data.pools as well as 17 TB of Landsat data.


Unidata WCS ServerUnidata WCS Server• Support WCS 1.0Support WCS 1.0• The formats the server can ingest at the back-endThe formats the server can ingest at the back-end

– netCDF-CF.netCDF-CF.• Potential satellite data that can be servedPotential satellite data that can be served

– All satellite data in netCDF-CF can be served. All satellite data in netCDF-CF can be served. – The server currently serves mostly the weather dataThe server currently serves mostly the weather data

• CRS CRS – The output is in the same CRS as in the input files at the The output is in the same CRS as in the input files at the

back-end.back-end.– Not CRS conversion between input and output.Not CRS conversion between input and output.

• Coverage output formatsCoverage output formats– netCDF-CF.netCDF-CF.

• Binary of the software is available per request.Binary of the software is available per request.


WCS InstallationsWCS Installations• GMU GeoBrain WCS server – NASA EOS satellite data, Landsat.GMU GeoBrain WCS server – NASA EOS satellite data, Landsat.• Raytheon WCS server – developed by Ionic- Sample EOS data.Raytheon WCS server – developed by Ionic- Sample EOS data.• NASA data pools – Ionic server – Experimental server, not open NASA data pools – Ionic server – Experimental server, not open

to outside.to outside.• SPOT – Ionic server – sample SPOT image.SPOT – Ionic server – sample SPOT image.• Zhejiang University – GMU WCS server – near real time MODIS Zhejiang University – GMU WCS server – near real time MODIS

data.data.• Unidata – Surface meteorological data.Unidata – Surface meteorological data.• Washington University – Surface air quality data (in GML).Washington University – Surface air quality data (in GML).• Columbia University – socio-economic dataColumbia University – socio-economic data• University College London/UK space agency – Landsat data.University College London/UK space agency – Landsat data.• DLR – some samples of satellite dataDLR – some samples of satellite data


OPeNDAP DemoOPeNDAP Demo

NASA Support for WTF-CEOP Sept 11, 2006 Ken McDonald, NASA Yonsook Enloe, SGT Inc.

Documents

Transcript of NASA Support for WTF-CEOP Sept 11, 2006 Ken McDonald, NASA Yonsook Enloe, SGT Inc.