Next Generation Data Access at NCDC

Achieving world class data access

The problem

• Multiple data sources and formats that will persist indefinitely

• Approaches to solve this problem are optimized for specific users and systems. IE, point data access requires a different solution than model data.

• NCDC must provide the bridge that joins these systems for users.

Access Roadmap

• Ingest - get the data and QC • Archive – capture the data and provenance• Discover – make the system aware of the new

data or changed state of data• Deliver – deliver the data in the way that best

suits it – THREDDS, Oracle, GeoPortal, FTP, etc.

Ingest – Archive – Discover - Deliver

Metadata Discovery Service

• A metadata discovery Service that spans all of NCDC’s holdings is needed

• It must be simple and fast so that it can scale infinitely. • It functions as a “lookup” for data – like your user/pass

does for Hotmail. • It provides services that can be utilized by other

organizations. • All newly ingested or updated data must be registered

and updated in the MDS.

Metadata Discovery Service cont.

• Fits into an end-to-end approach for NCDC • System integrity – one input and one output• Provides access to the archive’s content without

direct access to the archive.• The metadata service can be updated and new

better services can be deployed when available. The rest of the system can stay in place and isn’t at risk.

• Shared asset across the center.