Science Data Processing Workshop, Greenbelt, MD. February 28, 2002 MISR Products and Tools...

31
Science Data Processing Workshop, Greenbelt, MD. February 28, 2002 MISR Products and Tools Miller/Rheingans - 1 MISR Products and Tools “Life of an HDF-EOS Science Data Product. A gritty, behind-the-scenes exclusive!” Brian Rheingans and Kyle Miller MISR Instrument Team

Transcript of Science Data Processing Workshop, Greenbelt, MD. February 28, 2002 MISR Products and Tools...

Page 1: Science Data Processing Workshop, Greenbelt, MD. February 28, 2002 MISR Products and Tools Miller/Rheingans - 1 MISR Products and Tools “Life of an HDF-EOS.

Science Data Processing Workshop, Greenbelt, MD.February 28, 2002

MISR Products and Tools Miller/Rheingans - 1

MISR Products and Tools

“Life of an HDF-EOS Science Data Product.

A gritty, behind-the-scenes exclusive!”

Brian Rheingans and Kyle Miller

MISR Instrument Team

Page 2: Science Data Processing Workshop, Greenbelt, MD. February 28, 2002 MISR Products and Tools Miller/Rheingans - 1 MISR Products and Tools “Life of an HDF-EOS.

Science Data Processing Workshop, Greenbelt, MD.February 28, 2002

MISR Products and Tools Miller/Rheingans - 2

MISR, EOS-Terra Instrument

Multi-angle Imaging Spectro-Radiometer9 cameras, 4 spectral channels, pushbroom CCD.Continuous daylight swath acquisition.150 TB of HDF at the Langley DAAC.~50 product types, hundreds of fields.

http://www-misr.jpl.nasa.gov

Page 3: Science Data Processing Workshop, Greenbelt, MD. February 28, 2002 MISR Products and Tools Miller/Rheingans - 1 MISR Products and Tools “Life of an HDF-EOS.

Science Data Processing Workshop, Greenbelt, MD.February 28, 2002

MISR Products and Tools Miller/Rheingans - 3

Multi-angle Concept

Page 4: Science Data Processing Workshop, Greenbelt, MD. February 28, 2002 MISR Products and Tools Miller/Rheingans - 1 MISR Products and Tools “Life of an HDF-EOS.

Science Data Processing Workshop, Greenbelt, MD.February 28, 2002

MISR Products and Tools Miller/Rheingans - 4

You Are Here

Only3% of theLength ofOne MISRSwath shown

Page 5: Science Data Processing Workshop, Greenbelt, MD. February 28, 2002 MISR Products and Tools Miller/Rheingans - 1 MISR Products and Tools “Life of an HDF-EOS.

Science Data Processing Workshop, Greenbelt, MD.February 28, 2002

MISR Products and Tools Miller/Rheingans - 5

MISR Swath

400 km swath width.Several product types > 2GB uncompressed.HUGE extent of latitude/longitude.Stringent science constraints on distortion and geolocation.Ambitious algorithms.Stringent size, and computing restraints.HDF-EOS on HDF4

Page 6: Science Data Processing Workshop, Greenbelt, MD. February 28, 2002 MISR Products and Tools Miller/Rheingans - 1 MISR Products and Tools “Life of an HDF-EOS.

Science Data Processing Workshop, Greenbelt, MD.February 28, 2002

MISR Products and Tools Miller/Rheingans - 6

HDF-EOS Stacked-Block Grid

180 blocks per path; fixed locations.Same-size, rectangular in SOM.Each block is compressed as a separate chunk.HDF-EOS Grid meta describes top block.Other blocks offset to follow ground track; part of MISR-unique ext. of HDF-EOS.Foundation of 2 mil. Lines of science code

Page 7: Science Data Processing Workshop, Greenbelt, MD. February 28, 2002 MISR Products and Tools Miller/Rheingans - 1 MISR Products and Tools “Life of an HDF-EOS.

Science Data Processing Workshop, Greenbelt, MD.February 28, 2002

MISR Products and Tools Miller/Rheingans - 7

HDF-EOS File vs. Aligned Image

sample

Red Channel Grid SDS (180 Stacked Blocks)

-SOM coordinates of top-block corners part of Grid metadata.

-Projection and orbital parameters part of Grid Metadata

-Offsets of each block from the one above part ofStacked-block grid extension metadata.

SOM X: 10,000,000 m Y: 450,000 m ( path-specific)

Blockdimension

Sample dim

Line dim

Page 8: Science Data Processing Workshop, Greenbelt, MD. February 28, 2002 MISR Products and Tools Miller/Rheingans - 1 MISR Products and Tools “Life of an HDF-EOS.

Science Data Processing Workshop, Greenbelt, MD.February 28, 2002

MISR Products and Tools Miller/Rheingans - 8

Where does this pixel belong?

Lat/Lon not stored in product.In the SDS pixel = (block, line, sample)

Conversion <-> SOM <-> Lat/Lon require:• Several different metadata reads.• Custom code to do some offset arithmetic.• HDF-EOS grid api and use of the GCTP map proj. lib.• Lots of Patience.

Described in the MISR Data Product Specification, Appendix A.Or BIG ancillary dataset, OR Tools!

Page 9: Science Data Processing Workshop, Greenbelt, MD. February 28, 2002 MISR Products and Tools Miller/Rheingans - 1 MISR Products and Tools “Life of an HDF-EOS.

Science Data Processing Workshop, Greenbelt, MD.February 28, 2002

MISR Products and Tools Miller/Rheingans - 9

Mapping Data Users to Tools

Use only MISR-specific GUI tools:• If you are a MISR-centric scientist with nearly zero

tolerance for anything digital.• If you are a curious individual who want to fiddle with

MISR data or learn about MISR file structure.

Also use geotiff converters:• If you analyze a lot of MISR data.• If you like Photoshop, GIS tools and reprojections.• If you want to co-locate MISR images with other data.

Also use custom GIS converters:• If you want to do serious data analysis involving MISR

science data values (vs images) and other data in a GIS environment.

Also use DPS doc and stacked-block grid api• If you must read lots of MISR data into your custom

software and you possess some programming savvy • If you are a Tool Writer/Vendor.

Page 10: Science Data Processing Workshop, Greenbelt, MD. February 28, 2002 MISR Products and Tools Miller/Rheingans - 1 MISR Products and Tools “Life of an HDF-EOS.

Science Data Processing Workshop, Greenbelt, MD.February 28, 2002

MISR Products and Tools Miller/Rheingans - 10

Path/Orbit-based Web Browse Tool

See images beforeOrdering them.

Explore path, orbitAnd geographicCoverage.

Browse imagesAre jpg and aren’tFull resolution.

http://eosweb.larc.nasa.gov

Page 11: Science Data Processing Workshop, Greenbelt, MD. February 28, 2002 MISR Products and Tools Miller/Rheingans - 1 MISR Products and Tools “Life of an HDF-EOS.

Science Data Processing Workshop, Greenbelt, MD.February 28, 2002

MISR Products and Tools Miller/Rheingans - 11

How can I get at MISR Metadata easily?

• Displays HDF-EOS structures and all metadata easily.• Allows minor editing of the HDF-EOS file.• Performs some statistics on the data.• Can only visualize single un-assembled blocks.

FORTRAN GUTSTcl-Tk GUI

USERS:

Beginner whoWants to learn aboutMISR file structure.

Expert when chasingA problem.

Page 12: Science Data Processing Workshop, Greenbelt, MD. February 28, 2002 MISR Products and Tools Miller/Rheingans - 1 MISR Products and Tools “Life of an HDF-EOS.

Science Data Processing Workshop, Greenbelt, MD.February 28, 2002

MISR Products and Tools Miller/Rheingans - 12

Hdfscan – Main Menu

Page 13: Science Data Processing Workshop, Greenbelt, MD. February 28, 2002 MISR Products and Tools Miller/Rheingans - 1 MISR Products and Tools “Life of an HDF-EOS.

Science Data Processing Workshop, Greenbelt, MD.February 28, 2002

MISR Products and Tools Miller/Rheingans - 13

Hdfscan Image with Histogram

Page 14: Science Data Processing Workshop, Greenbelt, MD. February 28, 2002 MISR Products and Tools Miller/Rheingans - 1 MISR Products and Tools “Life of an HDF-EOS.

Science Data Processing Workshop, Greenbelt, MD.February 28, 2002

MISR Products and Tools Miller/Rheingans - 14

MISRView

• Maps path/orbit to time and date• Assembles multiple MISR blocks• Reports Lat/Lon via static lookup table.• Displays true color MISR imagery• Can reproject MISR imagery

• Perspective tool• Band slider tool• Scroll tool• Vector overlay tool

REQUIRES IDL !!!USER:

MISR-CENTRICSCIENCE DATAANALYST

Page 15: Science Data Processing Workshop, Greenbelt, MD. February 28, 2002 MISR Products and Tools Miller/Rheingans - 1 MISR Products and Tools “Life of an HDF-EOS.

Science Data Processing Workshop, Greenbelt, MD.February 28, 2002

MISR Products and Tools Miller/Rheingans - 15

MISRView – Main Menu

Page 16: Science Data Processing Workshop, Greenbelt, MD. February 28, 2002 MISR Products and Tools Miller/Rheingans - 1 MISR Products and Tools “Life of an HDF-EOS.

Science Data Processing Workshop, Greenbelt, MD.February 28, 2002

MISR Products and Tools Miller/Rheingans - 16

MISRView – L1B2 Radiance Data

Page 17: Science Data Processing Workshop, Greenbelt, MD. February 28, 2002 MISR Products and Tools Miller/Rheingans - 1 MISR Products and Tools “Life of an HDF-EOS.

Science Data Processing Workshop, Greenbelt, MD.February 28, 2002

MISR Products and Tools Miller/Rheingans - 17

MISRView – MISR Vision (R-Ba, G-An, B-Bf)

Page 18: Science Data Processing Workshop, Greenbelt, MD. February 28, 2002 MISR Products and Tools Miller/Rheingans - 1 MISR Products and Tools “Life of an HDF-EOS.

Science Data Processing Workshop, Greenbelt, MD.February 28, 2002

MISR Products and Tools Miller/Rheingans - 18

ERDAS Imagine 8.5

Custom import routines to convert MISR HDF-EOS files into Imagine files preserving geolocation via projection parameters.

SGI Irix utilities for most MISR Grid and some MISR Swath files.

Page 19: Science Data Processing Workshop, Greenbelt, MD. February 28, 2002 MISR Products and Tools Miller/Rheingans - 1 MISR Products and Tools “Life of an HDF-EOS.

Science Data Processing Workshop, Greenbelt, MD.February 28, 2002

MISR Products and Tools Miller/Rheingans - 19

Imagine – Full Swath/Full Res. Geo-linked

Page 20: Science Data Processing Workshop, Greenbelt, MD. February 28, 2002 MISR Products and Tools Miller/Rheingans - 1 MISR Products and Tools “Life of an HDF-EOS.

Science Data Processing Workshop, Greenbelt, MD.February 28, 2002

MISR Products and Tools Miller/Rheingans - 20

ERDAS Imagine – Raster/Vector Overlay

Page 21: Science Data Processing Workshop, Greenbelt, MD. February 28, 2002 MISR Products and Tools Miller/Rheingans - 1 MISR Products and Tools “Life of an HDF-EOS.

Science Data Processing Workshop, Greenbelt, MD.February 28, 2002

MISR Products and Tools Miller/Rheingans - 21

ERDAS Imagine – GIS Data Analysis

Page 22: Science Data Processing Workshop, Greenbelt, MD. February 28, 2002 MISR Products and Tools Miller/Rheingans - 1 MISR Products and Tools “Life of an HDF-EOS.

Science Data Processing Workshop, Greenbelt, MD.February 28, 2002

MISR Products and Tools Miller/Rheingans - 22

ERDAS Imagine – Mount EntaPerspective DEM Overlay

Page 23: Science Data Processing Workshop, Greenbelt, MD. February 28, 2002 MISR Products and Tools Miller/Rheingans - 1 MISR Products and Tools “Life of an HDF-EOS.

Science Data Processing Workshop, Greenbelt, MD.February 28, 2002

MISR Products and Tools Miller/Rheingans - 23

L1B2_to_geotiff Conversion Tool

Convert MISR imagery into generic format readable by any preferred GIS tool:

tiff / geotiff format

Preserve geolocation / projection information

Reproject to any GCTP-supported projection

Facilitate subset and mosaic procedures.

Page 24: Science Data Processing Workshop, Greenbelt, MD. February 28, 2002 MISR Products and Tools Miller/Rheingans - 1 MISR Products and Tools “Life of an HDF-EOS.

Science Data Processing Workshop, Greenbelt, MD.February 28, 2002

MISR Products and Tools Miller/Rheingans - 24

L1B2_to_geotiff – Ross Ice ShelfSOM Path 51 Oribt 5089

Page 25: Science Data Processing Workshop, Greenbelt, MD. February 28, 2002 MISR Products and Tools Miller/Rheingans - 1 MISR Products and Tools “Life of an HDF-EOS.

Science Data Processing Workshop, Greenbelt, MD.February 28, 2002

MISR Products and Tools Miller/Rheingans - 25

L1B2_to_geotiff – Ross Ice ShelfSOM Path 50 Oribt 5220

Page 26: Science Data Processing Workshop, Greenbelt, MD. February 28, 2002 MISR Products and Tools Miller/Rheingans - 1 MISR Products and Tools “Life of an HDF-EOS.

Science Data Processing Workshop, Greenbelt, MD.February 28, 2002

MISR Products and Tools Miller/Rheingans - 26

L1B2_to_geotiff – Ross Ice ShelfPolar Stereographic Path 51 Oribt 5089

Page 27: Science Data Processing Workshop, Greenbelt, MD. February 28, 2002 MISR Products and Tools Miller/Rheingans - 1 MISR Products and Tools “Life of an HDF-EOS.

Science Data Processing Workshop, Greenbelt, MD.February 28, 2002

MISR Products and Tools Miller/Rheingans - 27

L1B2_to_geotiff – Ross Ice ShelfPolar Stereographic Path 50 Oribt 5220

Page 28: Science Data Processing Workshop, Greenbelt, MD. February 28, 2002 MISR Products and Tools Miller/Rheingans - 1 MISR Products and Tools “Life of an HDF-EOS.

Science Data Processing Workshop, Greenbelt, MD.February 28, 2002

MISR Products and Tools Miller/Rheingans - 28

L1B2_to_geotiff – Pine Island Glacier Time Series

Page 29: Science Data Processing Workshop, Greenbelt, MD. February 28, 2002 MISR Products and Tools Miller/Rheingans - 1 MISR Products and Tools “Life of an HDF-EOS.

Science Data Processing Workshop, Greenbelt, MD.February 28, 2002

MISR Products and Tools Miller/Rheingans - 29

Lambert Conformal Conic

Page 30: Science Data Processing Workshop, Greenbelt, MD. February 28, 2002 MISR Products and Tools Miller/Rheingans - 1 MISR Products and Tools “Life of an HDF-EOS.

Science Data Processing Workshop, Greenbelt, MD.February 28, 2002

MISR Products and Tools Miller/Rheingans - 30

Interrupted Goode Homolosine

Page 31: Science Data Processing Workshop, Greenbelt, MD. February 28, 2002 MISR Products and Tools Miller/Rheingans - 1 MISR Products and Tools “Life of an HDF-EOS.

Science Data Processing Workshop, Greenbelt, MD.February 28, 2002

MISR Products and Tools Miller/Rheingans - 31

US/Mexico Geographic MosaicCourtesy Jim Knighton, JPL

Multiple MISRSwaths wereReprojected withL1B2_to_geotiffPrior to customMosaic, cloudRemoval andEqualizations.