NASA’s Planetary Data System (PDS)
description
Transcript of NASA’s Planetary Data System (PDS)
NASA’s Planetary Data System (PDS)
Michael F. A’Hearn
24 Jul 2007 mfa - 2
PDS Overview
• PDS - the organization– An organization that archives and distributes all of
NASA’s planetary mission data (and much other planetary data) according to PDS standards
• PDS - the archiving standard– A standard that defines how to label data products in
order to make them automatically readable and interpretable and how to document everything for future generations
• PDS - the archive– A distributed but centrally searchable archive of all
data from NASA’s planetary missions
24 Jul 2007 mfa - 3
PDS Goals
• Ensure that all data from NASA’s planetary missions are archived in a manner that will make them usable far into the future
• Acquire and archive other planetary data relevant to NASA’s missions
• Distribute the data to researchers• Provide appropriate tools for finding the right
data• Work with non-US partners to ensure
compatible archiving of all planetary missions
• A wealth of data - waiting to be analyzed!
24 Jul 2007 mfa - 4
PDS Organization
• PDS is a distributed system, with Discipline Nodes headed by various scientific specialists– DN leads selected competitively based on
management and on scientific approach to data– PDS started as part of the R&A program run by
active researchers• PDS has centralized capabilities for searching
data at all the nodes and also a central repository for PDS-wide documents, standards, policies, etc.– At the Engineering Node at JPL
• Individual scientific discipline nodes provide capabilities that are special to their area as well as archiving all the data relevant to that discipline
24 Jul 2007 mfa - 5
PDS Organization
Program Executive: Bill Knopf at NASA HQ Program Manager: Ed Grayzeck at NASA GSFC
24 Jul 2007 mfa - 6
PDS Organization - Staff
• Key planetary scientists you may recognize– Atmospheres - Reta Beebe, Nancy Chanover– Geosciences - Ray Arvidsen, Ed Guinness– Imaging - Lisa Gaddis– Planetary Plasma Interactions - Ray Walker, Steve Joy– Rings - Mark Showalter, Mitch Gordon– Small Bodies - Mike A’Hearn, Ludmilla Kolokolova, Don
Davis, Mark Sykes, Dave Tholen• The scientists ensure the scientific value and
usability of the data• Many other staff are better known for their
PDS activities rather than for scientific work• With many different scientific PIs, PDS
functions as much like a federation as like a coherent entity
24 Jul 2007 mfa - 7
PDS - An Archiving Standard
• Standards go back to Proto-PDS in late 1980s, prior to the current structure of discipline nodes
• Standards allow many different types of data
• Standard evolves to accommodate new needs
24 Jul 2007 mfa - 8
PDS Standards - Data Model
24 Jul 2007 mfa - 9
PDS Standards - Data Products
• Product = image or spectrum or time series, etc. including label and, e.g., supplementary data
• Labels are like FITS headers– Keyword = value format
• Important differences from FITS– Label can be attached to data product or a separate file
(FITS headers must be attached)– Keywords are ALL defined (FITS defines only a few and
allows almost unlimited user-defined keywords)– Format of data is not prescribed (FITS requires, e.g., 2880-
byte records) but the format must be described in the label– There are significant differences among discipline nodes,
e.g., in how data are formatted
24 Jul 2007 mfa - 10
PDS Standards - DI Image
• FITS version has FITS extensions for quality factors and SNR
• Generally in PDS, the PDS label is more reliable than the FITS header for documenting the data product– But it is often less
extensive - many engineering keywords are omitted
• Product ID = MV0173728448_9001040_001_R_FIT– Used to find the image
in indices or other toolsJPEG version of image described in previous label
24 Jul 2007 mfa - 11
PDS Standards - Sample Label
And continuing with more …..
24 Jul 2007 mfa - 12
Label continued
24 Jul 2007 mfa - 13
PDS Standards - Cassini Image
24 Jul 2007 mfa - 14
PDS Standards - Different Image
A Cassini image of Titan - very different structure
24 Jul 2007 mfa - 15
PDS Standards - Data Organization
• PDS requires a lot of ancillary information– Both raw and calibrated (physical units) data are required from
NASA missions– Geometry is required either in the labels or in separate files or in
SPICE– Catalog files are used to load the central search facility– Documents (including ascii versions) are required to explain
enough that any intelligent scientist 20 years from now should be able to recalibrate and use the data (with the help of library references)
24 Jul 2007 mfa - 16
PDS - The Archive
• All NASA planetary missions are required to archive in PDS (since mid 1990s)– Require raw data, calibrated data, & derived products
(maps, etc.) as appropriate– Generally basic raw & calibrated data due in 6 months
• Archive also includes data from ESA and IKI and ISAS missions to comets Halley & Grigg-Skjellerup & some more recent shared archives
• Archive also includes selected planetary data from astrophysics missions (IUE, HST, etc.)
• Archive includes selected ground-based datasets, particularly at SBN and at Geosciences
• Archive includes comparative databases for small bodies
24 Jul 2007 mfa - 17
PDS - Using The Archive
Get a viewer for PDS dataTry NASAView
Get some data
http://pds.nasa.gov/
Nodes
24 Jul 2007 mfa - 18
PDS - Searching the Archive
• Central search facility searches by mission, target, instrument, or instrument type
• Start at http://pds.nasa.gov/
• Click on search to go to http://starbrite.jpl.nasa.gov/pds/index.jsp– Shown at right
33 interplanetary missionsplus earth-orbital & ground-based data
24 Jul 2007 mfa - 19
Searching at DNs
http://pds-smallbodies.astro.umd.edu/
Start at the central, PDS-wide search if you aren’t sure which data you want or where the data are availableStart at a DN or even at a subnode of a DN if you know which data you want and which DN has it
http://pds-geosciences.wustl.edu/
24 Jul 2007 mfa - 20
PDS - Sample Ground-based Data
• You can even find your own data in PDS
• This is one of many ground-based surveys and special datasets
• And you see whom to ask locally about the PDS!
http://www.psi.edu/pds/resource/s3os2.html
24 Jul 2007 mfa - 21
PDS - Searching at PPI
• Find the magnetic field measurements (tables) at Gaspra & Ida at PPI
• In this case, the data are off-line and will be mailed to you
• In this case, they also have some errors noted after the CDs were produced
http://www.igpp.ucla.edu/cgi-bin/ditdos?filter=GOMA_3001,GOMW_0001,GOPR_2001&title=Gaspra_DataGetting here from the top level is easy
24 Jul 2007 mfa - 22
Tools You Should Have
• Simple Viewers (all free, available on-line)– NASAView - intended for all PDS products but has some limitations (I
broke it yesterday on a product from Geosciences)– ds9 and fv - useful only for PDS-labeled FITS files
• A good analysis environment– IDL (somewhat expensive)
• A versatile environment for “exploring” your data as well as analyzing it• Library of astronomical routines at NASA-GSFC• Needs an I/O routine such as SBN’s readpds.pro (which works on many
but not all products)– ISIS (free)
• Widely used by planetary geologists with many built-in functions• Supported via Imaging Node of PDS at USGS• I/O works only with products designed for ISIS compliance (not FITS)
– IRAF (free)• Can be used only for PDS-labelled FITS files since there are not (yet) any
I/O routines for PDS-labeled products• SPICE (free)
– Tool for working out geometry of measurements (if not already in keywords or for updating the values)
– Supported via NAIF on many platforms & languages
24 Jul 2007 mfa - 23
Problems?
• Go back and read the “help” pages, e.g. at SBN– Guidelines to help
reviewers access the data as well as review them
• Includes a list of tools– Guideline for all the
mysterious file types that you will encounter
• Contact PDS– Usually the node closest
to the data with which you have a problem
24 Jul 2007 mfa - 24
PDS - Help functions
24 Jul 2007 mfa - 25
PDS - Software Tools
24 Jul 2007 mfa - 26
PDS - Archive File Types
24 Jul 2007 mfa - 27
PDS - Archive File Types (cont.)
24 Jul 2007 mfa - 28
PDS - Archiving Future
The volume of data is growing faster than the number of scientists working with the data!