NASA Direct Readout - LCLUC Programlcluc.umd.edu/sites/default/files/lcluc_documents/... ·...

24
NASA Direct Readout - Providing a Bridge between NASA Direct Broadcast Earth Science Missions and the Direct Readout User Community - Patrick Coronado NASA / GSFC/ 606.3 Direct Readout Laboratory

Transcript of NASA Direct Readout - LCLUC Programlcluc.umd.edu/sites/default/files/lcluc_documents/... ·...

Page 1: NASA Direct Readout - LCLUC Programlcluc.umd.edu/sites/default/files/lcluc_documents/... · References Product References DSM/NCS Interface DSM/NCS Interface DATA STORAGE MANAGER

NASA Direct Readout

- Providing a Bridge between NASA Direct Broadcast Earth Science Missions and the

Direct Readout User Community -

Patrick CoronadoNASA / GSFC/ 606.3

Direct Readout Laboratory

Page 2: NASA Direct Readout - LCLUC Programlcluc.umd.edu/sites/default/files/lcluc_documents/... · References Product References DSM/NCS Interface DSM/NCS Interface DATA STORAGE MANAGER

Direct Readout Program

The Direct Readout Laboratory (DRL) at Goddard Space Flight Center (GSFC) is the implementation arm of NASA's Direct Readout Program

The DRL designs, develops, integrates and tests technologies that enable validation and testing of satellite and instrument specific hardware, decoding software, data processing and management systems necessary to acquire and process NASA’s directly broadcasted space-borne and airborne instrument data. Under this directive we endeavor to:

• Provide all necessary software technologies, knowledge, information and lessons learned to the general public though technology transfer and public domain releases.• Serve as a guide to the commercial sector on the utility of Earth remote sensing satellites and its instruments.• Provide cost saving solutions for the acquisition, processing and distribution of Earth remote sensing directly broadcasted data.

The Direct Readout Laboratory supports several NASA missions and collaborates with other government agencies, universities and the commercial sector to execute the above directive.

Page 3: NASA Direct Readout - LCLUC Programlcluc.umd.edu/sites/default/files/lcluc_documents/... · References Product References DSM/NCS Interface DSM/NCS Interface DATA STORAGE MANAGER

What We Do– Provide spacecraft Direct Broadcast RF configuration and data encoding designs

• Provide trade-off analysis for bandwidth optimization promoting DB continuity while meeting enhanced performance requirements of new missions.

• Provide risk reduction for future missions.– Develop prototype upgrades to existing DB receiving capabilities which will enable users

to receive and process NASA-specific instrument data• System modules have backward-compatibility to receive and pre-process legacy

data.• Prototype design technology is transferred to the private sector for

commercialization; DB users purchase system upgrades directly from commercial sources.

– Deliver algorithm support tools that contain instrument-specific formats, parameters, configurations and information.

– Provide Direct Broadcast-converted geo-registration and calibration (Level-1/SDR) algorithms for all instruments.

– Provide select Level-2 DB science algorithms implementations• 6 for MODIS• TBD for VIIRS

– Provide end-to-end testing of the spacecraft’s DB link to ensure compatibility with existing DB ground systems.

– Develop a Commercialization and Technology Transfer Plan for each technology and science algorithm.

– Provide and stage all technologies, algorithms and supporting data sets for distribution to the DB user community

Page 4: NASA Direct Readout - LCLUC Programlcluc.umd.edu/sites/default/files/lcluc_documents/... · References Product References DSM/NCS Interface DSM/NCS Interface DATA STORAGE MANAGER

How We Do It

• We have a working model that allows the DRL to efficiently interact with both the DB user community and NASA’s mission.– Allows us to understand what continuity means to

the public and how to minimize their impact– Allows for focused technology and algorithm

development• Established a web portal for controlled

technology, algorithm, information and data release to the public

Page 5: NASA Direct Readout - LCLUC Programlcluc.umd.edu/sites/default/files/lcluc_documents/... · References Product References DSM/NCS Interface DSM/NCS Interface DATA STORAGE MANAGER

Direct Readout Model

The Direct Readout Laboratory (DRL) acts as a bridge between the missions and the DB community

Page 6: NASA Direct Readout - LCLUC Programlcluc.umd.edu/sites/default/files/lcluc_documents/... · References Product References DSM/NCS Interface DSM/NCS Interface DATA STORAGE MANAGER

Direct Readout Program Roadmap

Page 7: NASA Direct Readout - LCLUC Programlcluc.umd.edu/sites/default/files/lcluc_documents/... · References Product References DSM/NCS Interface DSM/NCS Interface DATA STORAGE MANAGER

Direct Readout Testbed Architectural Model

Page 8: NASA Direct Readout - LCLUC Programlcluc.umd.edu/sites/default/files/lcluc_documents/... · References Product References DSM/NCS Interface DSM/NCS Interface DATA STORAGE MANAGER

Real-time Software TelemetryProcessing System (RT-STPS)

RawTelemetry PacketsB_PDUsVCDUsCADUsFrames

FrameSynchronizer

RS/CRC/PNDecoders

CCSDSServices Network

Ports

Server

Core FilesAcquisition

Board

Editor WebViewerSetupFiles

Status Setup StatusRemote User Interfaces

Page 9: NASA Direct Readout - LCLUC Programlcluc.umd.edu/sites/default/files/lcluc_documents/... · References Product References DSM/NCS Interface DSM/NCS Interface DATA STORAGE MANAGER

User Configurable RT-STPS

The Real-time Software Telemetry Processing System (RT-STPS) is a standalone processing software system that takes a raw satellite data stream from the output of the receiver and processes it to EOS Level-0 or an RDR. Functionally, this system will take packets/frames and do the following:• Frame synchronize• PN decode• Reed-Solomon decode• Packet process• Time order• Separate instrument data streams into independent files• Write to socket for real-time data relay• Process data to EOS Level-0 or RDR

• Status: Working for user interface and NPP instrument configuration

Page 10: NASA Direct Readout - LCLUC Programlcluc.umd.edu/sites/default/files/lcluc_documents/... · References Product References DSM/NCS Interface DSM/NCS Interface DATA STORAGE MANAGER

Data Storage Manager (DSM)

NCS STATIONS

DSM LIBRARY

SERVER

CLEANERPRODUCT

MOVERPRODUCT

MOVER

CLEANER

COMPUTER 1COMPUTER 3

COMPUTER 2

COMPUTER n

STORE PRODUCTS,QUERIES

STORE

QUERY

STORE PRODUCTS,QUERIES

DATABASE

NCS STATIONS

DSM LIBRARY

Page 11: NASA Direct Readout - LCLUC Programlcluc.umd.edu/sites/default/files/lcluc_documents/... · References Product References DSM/NCS Interface DSM/NCS Interface DATA STORAGE MANAGER

Data Processing Tools

Data Storage Manager (DSM)• Primary job is to serve the NISDS Control System (NCS)• Stores references to products and ancillary files in the

database• Finds specific products by product type, time, and other

user defined criteria• Moves files between computers• Deletes obsolete products• Components include a MySQL database, a Java library,

a maintenance agent and a mover agent

• Status: Build 3, Version 1.0 undergoing operational testing

Page 12: NASA Direct Readout - LCLUC Programlcluc.umd.edu/sites/default/files/lcluc_documents/... · References Product References DSM/NCS Interface DSM/NCS Interface DATA STORAGE MANAGER

NISDS Control System (NCS)

CommandLine

ApplicationProgram

Products

BuildEnvironment

BuildEnvironment

ExecuteApplicationExecute

Application

EnvironmentEnvironment

ProductReferencesProduct

References

DSM/NCSInterface

DSM/NCSInterface

DATASTORAGEMANAGER

NCSCONTROLPROGRAM

NCSCONTROLPROGRAM

Page 13: NASA Direct Readout - LCLUC Programlcluc.umd.edu/sites/default/files/lcluc_documents/... · References Product References DSM/NCS Interface DSM/NCS Interface DATA STORAGE MANAGER

Data Processing Tools

NISDS Control System (NCS)• Controls product generation• Acts as the interface between the Data Storage Manager

(DSM) and the Science Processing Algorithms (SPAs)• Retrieves SPAs input products from the DSM• Creates environment for SPA programs, and registers

output products with the DSM• Scalable to accommodate indefinite increasing processing

loads• Easily accommodates addition of new SPAs

• Status: Build 3, Version 1.0 undergoing operational testing

Page 14: NASA Direct Readout - LCLUC Programlcluc.umd.edu/sites/default/files/lcluc_documents/... · References Product References DSM/NCS Interface DSM/NCS Interface DATA STORAGE MANAGER

Data Processing Tools

Information Services

• A passive repository for in-house (GSFC) products for NISGS

• A passive repository for DSM-registered ancillary and auxiliary data

• Functions as a permanent repository of global ancillary and auxiliary data available to the Direct Readout community

• Satisfies legacy and script users of Direct Readout community

• Status: Build 3, Version 1.0 undergoing operational testing

Page 15: NASA Direct Readout - LCLUC Programlcluc.umd.edu/sites/default/files/lcluc_documents/... · References Product References DSM/NCS Interface DSM/NCS Interface DATA STORAGE MANAGER

Data Processing Tools

NISGS Status/Event Logging System (NSLS)

• Logs status events that occur• Allows real-time display of events• Supports filtered searching of past events• Provides a real-time diagnostic tool

• Status: Build 3, Version 1.0 undergoing operational testing

Page 16: NASA Direct Readout - LCLUC Programlcluc.umd.edu/sites/default/files/lcluc_documents/... · References Product References DSM/NCS Interface DSM/NCS Interface DATA STORAGE MANAGER

Simulcast

Page 17: NASA Direct Readout - LCLUC Programlcluc.umd.edu/sites/default/files/lcluc_documents/... · References Product References DSM/NCS Interface DSM/NCS Interface DATA STORAGE MANAGER

Simulcast Client

Page 18: NASA Direct Readout - LCLUC Programlcluc.umd.edu/sites/default/files/lcluc_documents/... · References Product References DSM/NCS Interface DSM/NCS Interface DATA STORAGE MANAGER

Simulcast

• View MODIS Aqua and Terra data in real time• Supports multiple instruments and spacecraft with single client• Distributed server capability• Replay recent satellite passes

Status:• Version 3.0 to be released next week, enhanced as follows:

– Real-time geolocation, and projected on Mercator and Polar map– Aqua and Terra orbits predicted and projected on Mercator and Polar

map– Auto Day/Night mode to allow passes near a pole to be viewed in

TrueColor mode during the day portion, and Infrared mode during the night portion

– Reorganized Client windows to maximize viewable image area

Page 19: NASA Direct Readout - LCLUC Programlcluc.umd.edu/sites/default/files/lcluc_documents/... · References Product References DSM/NCS Interface DSM/NCS Interface DATA STORAGE MANAGER

Common Science Processing Algorithm (SPA) Wrapper

• The Common SPA Wrapper is a uniform external interface on top of the underlying algorithm code (whatever that underlying code may be) that allows an arbitrary algorithm to be added to a generic processing environment.

Status: • The DRL is testing two wrapped EOS algorithms (fire &

NDVI vs.4). The wrapped MODIS L1 is undergoing testing at U-W.

• The NPP Science Team, NPOESS Cal/Val Team and DRL are working together to establish criteria for a common wrapper model for NPOESS

Page 20: NASA Direct Readout - LCLUC Programlcluc.umd.edu/sites/default/files/lcluc_documents/... · References Product References DSM/NCS Interface DSM/NCS Interface DATA STORAGE MANAGER

Common SPA Wrapper Model

ALGORITHM

TLE LUT DEM

PARAMETERS

WRAPPED ALGORITHM

LABEL

Veg.indexVI image

FILE

ndvi.hdfvi.tiff

OUTPUT FILES

LABEL

attitudeephemerisimagedata

FILE

att.hdfeph.hdfimg.hdf

INPUT FILES

KEYTLE = Two-Line ElementLUT = Look-Up TableDEM = Digital Elevation Model

Common API

• Java implementation• Run at command line• Commonly defined API interface

Page 21: NASA Direct Readout - LCLUC Programlcluc.umd.edu/sites/default/files/lcluc_documents/... · References Product References DSM/NCS Interface DSM/NCS Interface DATA STORAGE MANAGER

MODIS Algorithms

• Will make available select version 5 land algorithms in June. NDVI/EVI and Fire.

• Algorithms will be Common SPA wrapped

Page 22: NASA Direct Readout - LCLUC Programlcluc.umd.edu/sites/default/files/lcluc_documents/... · References Product References DSM/NCS Interface DSM/NCS Interface DATA STORAGE MANAGER

Bridging NASA EOS HDF Products to the GIS World

• Providing tools that will generate – from EOS HDF files - product specific GeoTiff data product files (level-2) for ingest by a GIS– EOS Level-2 products would be generated as a

GIS layer with access to product-specific metadata

• Status– Beta testing the Fire and NDVI GeoTiff conversion

tool with Gras and ENVI

Page 23: NASA Direct Readout - LCLUC Programlcluc.umd.edu/sites/default/files/lcluc_documents/... · References Product References DSM/NCS Interface DSM/NCS Interface DATA STORAGE MANAGER

Direct Readout Laboratory Web Portal

http://directreadout.gsfc.nasa.gov/

Page 24: NASA Direct Readout - LCLUC Programlcluc.umd.edu/sites/default/files/lcluc_documents/... · References Product References DSM/NCS Interface DSM/NCS Interface DATA STORAGE MANAGER

Presently Verified EOS DR Ground Stations

• 100 ingest sites around the world for Terra/Aqua DB downlink• Thousands of users based on these sites.