NASA Goddard Space Flight Center, Goddard Earth Sciences Distributed Active Archive...
1
NASA Goddard Space Flight Center, Goddard Earth Sciences Distributed Active Archive Center,Greenbelt, MD, 20771 Acknowledgements: Authors would like to acknowledge all GES DAAC data support teams for their contributions and Edee Ocampo for graphics support. This work is supported by the NASA/GSFC Earth Science Enterprise. A. Gopalan, D. Nickless, D.Ouzounov, A.Savtchenko, L. Pham, C. Lynnes, S. Berrick, Z. Liu and H.Rui http://disc.gsfc.nasa.gov •It is an IDL code wrapped in an IDL batch file. •It is a command-line utility and thus focuses on automatic production of mapped imagery. •Platform independent •Can be easily changed/expanded to fit user needs. •Good for automatic production of unlimited number of mapped images. Features: •Mapping of MODIS L1B, Level 2 Oceans and Atmosphere using all available IDL Map projections. •Uses either native L1B or MOD03 geolocation data. •Detection and interpolation of invalid geolocations. •Stitching of multiple granules in the map space. •Converting to physical units. •Automatically saves the map in image and binary format. •The program is simple so that new modules can be added either in the source code, or in the batch file. •The batch file design allows for inclusion in cron jobs, and shell or Perl scripts. SIMAP http://daac.gsfc.nasa.gov/MODIS/simap SIMAP maps MODIS Level 1B, Level 2 Oceans and Atmosphere Data: MODIS/Terra Level 2: Local Scenes: 5-minute orbital swaths, 1 km (produced with SIMAP) HDFLook-MODIS •Multi granule processing: Mosaic and Stitching •Subsetting: Channel, Parameter, Spatial; Subsampling •Data Conversion: HDF- EOS to ASCII, Binary, JPEG and GeoTIFF •Interactive, operational and batch mode: All current capabilities are available in both interactive and command line modes •AERONET data bank access: Aerosol and other ancillary data are available from the ground based sun- photometer measurements (AERONET data bank). •XWindows CE: SGI and •Modular tool, easy to update, add new features •Free to users obtaining it from DAAC •HDF Data Compatibility: All Land, Atmospheric and Ocean MODIS/Terra and MODIS/Aqua products, AIRS L1B and POLDER; •Mapping and Projections: Geo-projection conversion for L2, L3, and L4 products: LINEAR.GOODE’S, MOLLWEIDE, HAMMER, AZIMUTHAL, LAMBERT, MILLER, MOLLWEIDE, ORTHOGRAPHIC, SINUSOIDAL, VAN DER GRINTEN,WAGNER 7, ISIN,POLDER http://daac.gsfc.nasa.gov/MODIS/HDFLook/ DESKTOP TOOLS DESKTOP TOOLS Overview of GES DAAC Services and Tools Functionality MOVAS (MODIS L3 atmospheric data Online Visualization and Analysis System) is designed for quick exploration, analyses, and visualization of MODIS Atmospheres Monthly Level-3 product. Automated Subscriptions to any Data in the Archive. Subsetting Services: These include On- demand Channel and Paremeter Subset, On- the-Fly subsetting. NADM (Near-line Archive Data Mining) give Users the capability to upload, test their algorithms and mine data from the GDAAC online cache. HDFLook-MODIS is a new, multifunctional, data processing and visualization tool for Radiometric and Geolocation, Atmosphere, Ocean, and Land MODIS HDF-EOS data. Features include: accessing and visualization of all swath (Levels l and 2) MODIS and AIRS products, and gridded (Levels 3 and 4) MODIS products; re-mapping of swath data to world map; interactive and batch mode capabilities; subsetting and multi- granule processing; and data conversion. SIMAP is an IDL-based script that is designed to read and map MODIS Level 1B and Level 2 Ocean and Atmosphere products. The resulting maps are scaled to physical units (e.g., radiances, concentrations, brightness temperatures etc.) and saved in binary files. One of simap's strengths is the composition of global maps, or the stitching together of multiple L1B or L2 granules on a single world map. Summary WebGIS is an online web software that implements the Open GIS Consortium (OGC) standards for mapping requests and rendering. GES DAAC SERVICES: GES DAAC DESKTOP TOOLS: HDFLook-MODIS is a result of joint collaboration between LOA UST, France, and GES DAAC. Features: Manage User’s research data more efficiently Decrease download time by applying algorithm closer to the Data Apply Knowledge Discovery in Database (KDD) Access 50 Tera Byte of online data i.e. MODIS, AIRS and more Automated Subscription Processing To give Users the capability to upload, test their algorithms and mine data from the GDAAC online cache. MODIS L3 Atmospheric Products Online Visualization and Analysis System (MOVAS) •Easy to Use Web-based Tool (aerosol, water vapor and clouds, 1 x 1 degree, monthly, April 2000 - present). Grid Analysis and Display System (GrADS) is used as a back-end engine for analysis. •The basic functions of MOVAS consist of, area plot, time series, Hovmoller diagram, animation, ASCII output for all plot types (excluding animation), multiple ASCII output for time series, and multiple area plots. MOVAS is easy to use. •MOVAS is the result of a Joint Collaboration between GES DAAC and AEROCENTER (GSFC Code 913) http://lake.nascom.nasa.gov/movas/ The aim of this poster is to inform the MODIS User Community about the newest Services and Tools available from the GDAAC. We also show examples (MOVAS) of the same that have resulted from collaborative partnerships with various groups here at GSFC and elsewhere. The Data Services are Applications that run on the GDAAC Systems and manipulate GDAAC data based on User demand. The Data Tools are “Desktop Applications” that Users will need to download along with Data and then execute them on their local systems. GDAAC SERVICES GDAAC SERVICES MODIS Global Browse Images content- based subscripti on content -based subset “Send only scenes where Lake Winnebago, Wisconsin is visible” calibra ted radianc e online cache classi fy pixels content- based cache management (1)Extract useful pixels, or (2)Mask out useless pixels and compress “Least-recently-used” (LRU) algorithm is less useful for very active caches. Content-based caching applies simple heuristics to scene content to: (1) Retain scenes with more useful/interesting pixels (2) Purge less useful scenes quickly Content-based Services (Only for MODIS Direct Broadcast Radiance Data) Data Services Data Pool (Fast Online Disk Cache): This consists (50 TB) Anonymous FTP area where "fresh" data are made available on a rotating basis. Its advantage is the ability for users to directly download data of interest, without having to submit an order. FTP Scripts automatically generated by the System, On- the-Fly Compression Capability can be used to optimize Data transfer process. http://daac.gsfc.nasa.gov/data/datapool/ Automated Data Subscriptions: (10 Gb Limit per Subscription per Day) to any Data in the Archive. Can Customized to various Data Attributes (e.g Area of Interest). Suited to Users who require a regular stream of Data over their Area of Interest. Special arrangements with GDAAC are necessary to use this Service. Please contact ([email protected]). Data Distribution Options: Electronic (FTP) Options include FTPPULL (User will need to FTP Data staged on a GDAAC FTPServer) and FTPPUSH (User FTP Server is Configured to accept Data Transfer from GDAAC). Distribution subject to Limit of 1000 “Granules per Order”. http://daac.gsfc.nasa.gov/MODIS/FAQ/A_max_size.shtml Hard Media Options include DVD (GDAAC supplied Limit: 95 per Year), 8mm Tapes (GDAAC supplied Limit: 65 per Year), DLT (GDAAC supplied Limit: 6 per Year). User will be required to supply their own media if their Data order exceeds above limits. GES DISC/DAAC is pleased to announce the GES DAAC Data User Online Collaboration forums. These Web-based forums have been set up to help you, the Data User, interact and collaborate with other Users and the DISC/DAAC on issues regarding the Data we distribute. The URL to bookmark is: http://disc.gsfc.nasa.gov/forum/ MODIS – User Discussion Forum specifically for users of GES DAAC MODIS data Data -> Aerosol – User Discussion Forum specifically for users of GES DAAC aerosol data. Data -> Cloud - User Discussion Forum specifically for users of GES DAAC cloud data. Data -> Ocean Color – User Discussion Forum specifically for users of GES DAAC ocean color data. NADM FTP Mining Results Original Data onli ne cach e User Developed Algorithm WEB GDAAC Web Site: http://g0dug03u.ecs.nasa.gov/OPS/www/nadm/index.html Near-line Archive Data Mining (NADM)
-
Upload
randall-harrington -
Category
Documents
-
view
221 -
download
1
Transcript of NASA Goddard Space Flight Center, Goddard Earth Sciences Distributed Active Archive...
NASA Goddard Space Flight Center, Goddard Earth Sciences Distributed Active Archive Center,Greenbelt, MD, 20771
Acknowledgements: Authors would like to acknowledge all GES DAAC data support teams for their contributions and Edee Ocampo for graphics support. This work is supported by the NASA/GSFC Earth Science Enterprise.
A. Gopalan, D. Nickless, D.Ouzounov, A.Savtchenko, L. Pham, C. Lynnes, S. Berrick, Z. Liu and H.Ruihttp://disc.gsfc.nasa.gov
•It is an IDL code wrapped in an IDL batch file.•It is a command-line utility and thus focuses on automatic production of mapped imagery.•Platform independent•Can be easily changed/expanded to fit user needs.•Good for automatic production of unlimited number of mapped images.Features:•Mapping of MODIS L1B, Level 2 Oceans and Atmosphere using all available IDL Map projections.•Uses either native L1B or MOD03 geolocation data.•Detection and interpolation of invalid geolocations.•Stitching of multiple granules in the map space.•Converting to physical units.•Automatically saves the map in image and binary format.•The program is simple so that new modules can be added either in the source code, or in the batch file.•The batch file design allows for inclusion in cron jobs, and shell or Perl scripts.
SIMAP http://daac.gsfc.nasa.gov/MODIS/simap
SIMAP maps MODIS Level 1B, Level 2 Oceans and Atmosphere Data:
MODIS/Terra Level 2: Local Scenes: 5-minute orbital swaths, 1 km (produced with SIMAP)
HDFLook-MODIS
•Multi granule processing: Mosaic and Stitching•Subsetting: Channel, Parameter, Spatial; Subsampling•Data Conversion: HDF-EOS to ASCII, Binary, JPEG and GeoTIFF•Interactive, operational and batch mode: All current capabilities are available in both interactive and command line modes•AERONET data bank access: Aerosol and other ancillary data are available from the ground based sun-photometer measurements (AERONET data bank).•XWindows CE: SGI and Linux
•Modular tool, easy to update, add new features•Free to users obtaining it from DAAC•HDF Data Compatibility: All Land, Atmospheric and Ocean MODIS/Terra and MODIS/Aqua products, AIRS L1B and POLDER;•Mapping and Projections: Geo-projection conversion for L2, L3, and L4 products: LINEAR.GOODE’S, MOLLWEIDE, HAMMER, AZIMUTHAL, LAMBERT, MILLER, MOLLWEIDE, ORTHOGRAPHIC, SINUSOIDAL, VAN DER GRINTEN,WAGNER 7, ISIN,POLDER
http://daac.gsfc.nasa.gov/MODIS/HDFLook/
DESKTOP TOOLSDESKTOP TOOLS
Overview of GES DAAC Services and Tools Functionality
MOVAS (MODIS L3 atmospheric data Online Visualization and Analysis System) is designed for quick exploration, analyses, and visualization of MODIS Atmospheres Monthly Level-3 product.
Automated Subscriptions to any Data in the Archive.
Subsetting Services: These include On-demand Channel and Paremeter Subset, On-the-Fly subsetting.
NADM (Near-line Archive Data Mining) give Users the capability to upload, test their algorithms and mine data from the GDAAC online cache.
HDFLook-MODIS is a new, multifunctional, data processing and visualization tool for Radiometric and Geolocation, Atmosphere, Ocean, and Land MODIS HDF-EOS data. Features include: accessing and visualization of all swath (Levels l and 2) MODIS and AIRS products, and gridded (Levels 3 and 4) MODIS products; re-mapping of swath data to world map; interactive and batch mode capabilities; subsetting and multi-granule processing; and data conversion.
SIMAP is an IDL-based script that is designed to read and map MODIS Level 1B and Level 2 Ocean and Atmosphere products. The resulting maps are scaled to physical units (e.g., radiances, concentrations, brightness temperatures etc.) and saved in binary files. One of simap's strengths is the composition of global maps, or the stitching together of multiple L1B or L2 granules on a single world map.
Summary
WebGIS is an online web software that implements the Open GIS Consortium (OGC) standards for mapping requests and rendering.
GES DAAC SERVICES: GES DAAC DESKTOP TOOLS:
HDFLook-MODIS is a result of joint collaboration between LOA UST, France, and GES DAAC.
Features:
Manage User’s research data more efficiently Decrease download time by applying algorithm closer to the Data Apply Knowledge Discovery in Database (KDD) Access 50 Tera Byte of online data i.e. MODIS, AIRS and more Automated Subscription Processing
To give Users the capability to upload, test their algorithms and mine data from the GDAAC online cache.MODIS L3 Atmospheric Products Online Visualization
and Analysis System (MOVAS)
•Easy to Use Web-based Tool (aerosol, water vapor and clouds, 1 x 1 degree, monthly, April 2000 - present). Grid Analysis and Display System (GrADS) is used as a back-end engine for analysis. •The basic functions of MOVAS consist of, area plot, time series, Hovmoller diagram, animation, ASCII output for all plot types (excluding animation), multiple ASCII output for time series, and multiple area plots. MOVAS is easy to use. •MOVAS is the result of a Joint Collaboration between GES DAAC and AEROCENTER (GSFC Code 913)
http://lake.nascom.nasa.gov/movas/
The aim of this poster is to inform the MODIS User Community about the newest Services and Tools available from the GDAAC. We also show examples (MOVAS) of the same that have resulted from collaborative partnerships with various groups here at GSFC and elsewhere.The Data Services are Applications that run on the GDAAC Systems and manipulate GDAAC data
based on User demand.The Data Tools are “Desktop Applications” that Users will need to download along with Data and then
execute them on their local systems.
GDAAC SERVICESGDAAC SERVICES
MODIS Global Browse Images
content-based
subscription
content-based subset
“Send only scenes where Lake Winnebago, Wisconsin is visible”
calibratedradiance
onlinecache
classifypixels
content-based cache management
(1) Extract useful pixels, or(2) Mask out useless pixels and compress
“Least-recently-used” (LRU) algorithm is less useful for very active caches.Content-based caching applies simple heuristics to scene content to: (1) Retain scenes with more useful/interesting pixels(2) Purge less useful scenes quickly
Content-based Services (Only for MODIS Direct Broadcast Radiance Data)
Data Services
Data Pool (Fast Online Disk Cache): This consists (50 TB) Anonymous FTP area where "fresh" data are made available on a rotating basis. Its advantage is the ability for users to directly download data of interest, without having to submit an order. FTP Scripts automatically generated by the System, On-the-Fly Compression Capability can be used to optimize Data transfer process. http://daac.gsfc.nasa.gov/data/datapool/
Automated Data Subscriptions: (10 Gb Limit per Subscription per Day) to any Data in the Archive. Can Customized to various Data Attributes (e.g Area of Interest). Suited to Users who require a regular stream of Data over their Area of Interest. Special arrangements with GDAAC are necessary to use this Service. Please contact ([email protected]).
Data Distribution Options: Electronic (FTP) Options include FTPPULL (User will need to FTP Data staged on a GDAAC FTPServer) and FTPPUSH (User FTP Server is Configured to accept Data Transfer from GDAAC). Distribution subject to Limit of 1000 “Granules per Order”.http://daac.gsfc.nasa.gov/MODIS/FAQ/A_max_size.shtml
Hard Media Options include DVD (GDAAC supplied Limit: 95 per Year), 8mm Tapes (GDAAC supplied Limit: 65 per Year), DLT (GDAAC supplied Limit: 6 per Year). User will be required to supply their own media if their Data order exceeds above limits.
GES DISC/DAAC is pleased to announce the GES DAAC Data User Online Collaboration forums. These Web-based forums have been set up to help you, the Data User, interact and collaborate with other Users and the DISC/DAAC on issues regarding the Data we distribute. The URL to bookmark is: http://disc.gsfc.nasa.gov/forum/
MODIS – User Discussion Forum specifically for users of GES DAAC MODIS dataData -> Aerosol – User Discussion Forum specifically for users of GES DAAC aerosol data.Data -> Cloud - User Discussion Forum specifically for users of GES DAAC cloud data.Data -> Ocean Color – User Discussion Forum specifically for users of GES DAAC ocean color data.
NADM FTPMining Results
Original Data
onlinecache
User Developed Algorithm
WEB
GDAAC Web Site: http://g0dug03u.ecs.nasa.gov/OPS/www/nadm/index.html
Near-line Archive Data Mining (NADM)
![1 ESE Science Review [Meeting on Weather Forecasting] Eric A. Smith; NASA/Goddard Space Flight Center, Greenbelt, MD 20771 [301-286-5770; 301-286-1626;](https://static.fdocuments.net/doc/165x107/56649e615503460f94b5d0fb/1-ese-science-review-meeting-on-weather-forecasting-eric-a-smith-nasagoddard.jpg)
