DMAC: Infrastructure to enable delivery of IOOS ® information Presentation to the IOOS Advisory...

14
DMAC: Infrastructure to enable delivery of IOOS ® information Presentation to the IOOS Advisory Committee Derrick Snowden, System Architect, U.S. IOOS Program April 15, 2014

Transcript of DMAC: Infrastructure to enable delivery of IOOS ® information Presentation to the IOOS Advisory...

DMAC: Infrastructure to enable delivery of IOOS®

information

Presentation to the IOOS Advisory CommitteeDerrick Snowden, System Architect, U.S. IOOS Program

April 15, 2014

What is DMAC?

DMAC is the collection of people, process, and technology that enable the dissemination of diverse and distributed data sets using the WWW as the platform.

IOOS is deploying, and in some cases building, infrastructure to enable this dissemination.

2014-04-15 2

US IOOS Program Office DMAC efforts span three areas of focus.

Technical solutions

Imag

e co

urte

sy s

teve

-dal

e.ne

t

Building community

Implementation across the enterprise

Imag

e co

urte

sy p

roac

tive

IT

Technical solutions

2014-04-15 3

A layered view of the primary roles within IOOS/DMAC

2014-04-15Technical Solutions 4

5

Operational Use of HF Radar Surface Currents for Search And Rescue

Surface Currents

Search And Rescue Optimal Planning

System (SAROPS)

Data Acquisition

Data Product Generation & Management

2014-04-15

HFR SAROPS as an example of the layered architecture in practice.

Application or Service Provider

Brokering Systems

Interoperability Services for Data Distribution on the Web

Data, Models, Metadata, Raw information

Service, Data, Asset Catalogs

Intermediate Product Developers

THREDDS Servers

2014-04-15Technical solutions 6

IOOS Model Data Interoperability Design

ClientsNetCDF-Java

NetCDF4-Python ERDDAP

ROMS

ADCIRC

HYCOM

SELFENCOM

FVCOM

Observed data (buoy, gauge, ADCP, glider)

Matlab PanoplyIDV ArcGIS Python Godiva2

Co

mm

on

D

ata

Mo

del

Apply Standardization

Distribute via

Web Services

OPeNDAP+CF

WCS

NetCDF Subset

WMS

ncISO

SOS

GridUgridTimeSeriesProfileTrajectoryTimeSeriesProfile

Application or Service Provider

Brokering Systems

Interoperability Services for Data Distribution on the Web

Data, Models, Metadata, Raw information

2014-04-15Technical solutions

Advances in a Distributed Approach for Ocean Model Data Interoperability; http://www.mdpi.com/2077-1312/2/1/194

7

Use Case: Model Data comparison using web services

33 Tb 4D model output on a triangular mesh grid

CO-OPS offers 1019 data sets via their SOS containing water level and met parameters

Plot the time series of observed water level and model simulation sampled at the observation locations, via web services.

2014-04-15Technical solutions 8

http://tidesandcurrents.noaa.gov/map/

Model Data comparison con’t

2014-04-15

http://nbviewer.ipython.org/urls/raw.githubusercontent.com/rsignell-usgs/notebook/

fef9438303b49a923024892db1ef3115e34d8271/CSW/IOOS_inundation.ipynb

9

Modify in your browser; Runs in the cloud; No need to download data;

Exposing Data!

102014-04-15Implementation across the enterprise

Functional DACs complement the regional footprint

Deployment view of the infrastructure available to regional associations to distribute in situ data.

2014-04-15Implementation across the enterprise 11

Who does the program office work with most closely on DMAC technology issues?

2014-04-15Building community 12

Software supports the infrastructure: Reduce/reuse/recycle on github.com

https

://g

ithub

.com

/ioo

s

2014-04-15Building community 13

US IOOS Program Office DMAC efforts span three areas of focus.

Technical solutions

Imag

e co

urte

sy s

teve

-dal

e.ne

t

Building community

Implementation across the enterprise

Imag

e co

urte

sy p

roac

tive

IT

Technical solutions

2014-04-15 14

PeopleProcessTechnology