11Next Generation of Operational Earth Observations From the National Polar-

Orbiting Operational Environmental Satellite System (NPOESS): Program Overview and Status II

Evolution of NOAA's Satellite Archive: Transition of CLASS

Development to Operations at NOAA's Data Centers and Future

Plans

John J. Bates, NOAA’s National Climatic Data CenterKen Casey, NOAA’s National Oceanographic Data

CenterEric Kihn, NOAA’s National Geophysical Data Center

22Next Generation of Operational Earth Observations From the National Polar-

Orbiting Operational Environmental Satellite System (NPOESS): Program Overview and Status II

Outline

What is an Archive Current State of NOAA’s Archive Archive Plans for NPOESS Challenges and New Opportunities

33Next Generation of Operational Earth Observations From the National Polar-

Orbiting Operational Environmental Satellite System (NPOESS): Program Overview and Status II

What is an Archive?Archive Responsibilities

Negotiates and accepts information from Producers Obtains sufficient control to ensure long-term

preservation Ensures the information to be preserved is

independently understandable to identified Designated Communities

Follows documented policies and procedures that ensure the information is preserved against all reasonable contingencies

Makes the preserved information available to the Designated Communities in forms understandable to those communities

NOAA’s Data Centers = NOAA’s Archive; CLASS is IT

44Next Generation of Operational Earth Observations From the National Polar-

Orbiting Operational Environmental Satellite System (NPOESS): Program Overview and Status II

The Archive Environment Producer provides information to be preserved Management sets overall policy Consumer seeks and acquires preserved

information

OAIS(Archive)

Management

Producer Consumer

The Archive Environment from 30,000 ft

CLASS Operations and Planning Board (COPB)

55Next Generation of Operational Earth Observations From the National Polar-

Orbiting Operational Environmental Satellite System (NPOESS): Program Overview and Status II

SIP = Submission Information Package

AIP = Archival Information Package

DIP = Dissemination Information Package

SIP

DIP

Administration

PRODUCER

CONSUMER

queriesresult sets

MANAGEMENT

Ingest Access

DataManagement

ArchivalStorage

DescriptiveInfo.

Preservation Planning

orders

AIP

Archive Functional Entities

The Archive Environment from 10,000 ft

CONSUMER

PRODUCER

MANAGEMENT

66Next Generation of Operational Earth Observations From the National Polar-

Orbiting Operational Environmental Satellite System (NPOESS): Program Overview and Status II

Current State – NOAA Archives

CLASS

Web Interface

Users

CLASS Data Providers

NOAA’sData

Centers

Web Interfaces

Users

Data Providers

MirrorTape

Warehouses

FGDC Metadata FGDC Metadata

Centers of Data

Users

Web Interfaces

Metadata?

?

Courtesy NGDC

77Next Generation of Operational Earth Observations From the National Polar-

Orbiting Operational Environmental Satellite System (NPOESS): Program Overview and Status II

Transitional State – NOAA Archives

CLASS

Web Interface

Users

CLASS Data Providers

NOAA’s Data Centers

Direct Access

Users

Data Providers

Application Interface (NOAA Server)

APIs APIs

Mirror Services Mirror

NOAA Metadata Manager and Repository

Users

Interfaces

Warehouse

Centers of Data

Metadata?

?

Courtesy NGDC

88Next Generation of Operational Earth Observations From the National Polar-

Orbiting Operational Environmental Satellite System (NPOESS): Program Overview and Status II

Final State – NOAA Archives

CLASS

Web Interface

Users

CLASS Data Providers

NOAA’s DataCenters

Direct Access

Users

Data Providers

NOAA Web Services

APIs APIs

Mirror Services Mirror

Centers of Data

Centers of Data Providers

APIs

Mirror

NOAA Metadata Manager and Repository

Data Discovery

Users

99Next Generation of Operational Earth Observations From the National Polar-

Orbiting Operational Environmental Satellite System (NPOESS): Program Overview and Status II

Cal

Production &

Validation

IT Arch

STAR/GSICS

DataProcessing

&Re-Processing

Character-ization

CDR

CIR

Standards

CDR/CIR Production Segment

Working Groups

Archive Plans for NPOESS

1010Next Generation of Operational Earth Observations From the National Polar-

Orbiting Operational Environmental Satellite System (NPOESS): Program Overview and Status II

Archive Plans for NPOESS Interface Data Processing Segment (IDPS)

– Data Delivery Subsystem (DDS) - request for & receipt of:– NPP Data Products (RDRs, SDRs/TDRs, IPs, EDR/ARPs, geolocation)– Two-line Elements (TLEs) and Mission Schedules– Official Dynamic Ancillary Data– Data Delivery Reports (DDR)– Consolidated Data Delivery Reports (CDDR)

– Data Quality Monitoring (DQM) - receipt of:– DQM Reports

NOAA’s Climate Data Record Project– Long-term Climate data and metadata

Ground Integrated Support Facility (GISF) - receipt of:– Software Release Packages that include source code and Look Up

Tables– Documentation Release Packages that include External Interface

Control Documents, the CDFCB-X Volumes, Product Profiles, OADs, and ATBDs.

– Supporting Data Release Packages that include Processing Coefficient Tables, Sensor Calibration Table Updates, DQTTs, QST IPs, and Official Static Ancillary Data.

– Test Data Release Packages Command, Control and Communications Segment (C3S) - request for:

– request via the WRS for DQM Reports

1111Next Generation of Operational Earth Observations From the National Polar-

Orbiting Operational Environmental Satellite System (NPOESS): Program Overview and Status II

Challenges and New Opportunities

Archive must validate the data are independently understandable– Work with customers to use archived

data Archive will receive different and

more data than centrals– Build ISO 19115 metadata catalog for

easy customer access Volume of data is daunting

– Explore compression and use of raw data records