Creating an Operational Pilot for a Pacific Region In-situ Data Display Website

by integrating PMEL Argo & IPRC EPIC Web

Nancy Soreide, NOAA/PMELJim Potemra, IPRCGang Yuan, IPRC

Willa Zhu, NOAA/PMEL-University of Washington Joe Sirott, NOAA/PMEL – Sirott and Associates

NOAA PRIDE Meeting, August 9-10, 2005, Honolulu, Hi

Project Summary

• Enhance IPRC in-situ data access to ocean/atmospheric observations by adding web-based data selection and visualization specifically customized for realtime and retrospective Argo data and the Pacific Region.

– Integrate the PMEL Argo Data Display system features with EPIC Web Browser

• The growing importance of the Argo data collection and the increasing numbers of Argo floats make this an important priority for the Pacific region and the IPRC.

Relevance to PRIDE Objectives

• By providing integrated customized web-based displays of important Pacific Region data collections, this project:– Supports cooperation and coordination amongst Federal and

State facilities in the region – Provides an effective mechanism for data sharing– Standards-based methods and tools for data management – Supports the identification of needs for regional data– Complements other PRIDE projects

• Use of OPeNDAP standards (dapper) for in-situ data assures data accessibility with multiple clients

• Low bandwidth data delivery efforts

Relevance to Climate and Coastal Communities theme

• Addresses recognized need to improve and foster integrated data services – Identified in NOAA Pacific Islands Region Data Management Report

(prepared in response to Senate Report No 108-144)• Integrated data website supports scientists, managers and decision

makers: – to reduce vulnerability of coastal communities to climate variability– to support adaptation to climate change by providing scientifically

validated data. – Argo is an increasingly important dataset viewed by IPRC management as

critical for the future, and this effort:• Addresses the IPRC requirement for sophisticated Argo data support

• Major step towards a Pacific Region In-situ Data Display Website• Illustrates use of integrated web access to data to support cooperative

efforts in Marine and Coastal Ecosystems and Risk Management.

Key Project Partners

• NOAA/Pacific Marine Environmental Laboratory• IPRC/Asia Pacific Data Research Center• NOAA/National Oceanographic Data Center• University of Washington/Joint Institute for the

Study of the Atmosphere and Ocean• (NOAA/National Severe Storms Laboratory)• (NOAA/Atlantic Oceanographic and Meteorological

Laboratory)

Leveraged Resources• EPIC Web

– Multiple in-situ (observed) data types– General purpose oceanographic in-situ data access, graphics– OPeNDAP-standard dapper support for in-situ data: metadata,

data selection and subsetting• Argo Web display

– Customized Argo data selection, graphics• cdfsync

– Fast, synchronized downloads of realtime Argo netcdf data files to the IPRC

• Dapper – OPeNDAP-standard sever for in-situ data– Dapper client development (eg. Data selection, data graphics)

EPIC WebMultiple data types

EPIC Web Data selection, graphics, download

PMEL Argo Web GraphicsCustomized displays

Work PlanProcedures to download Argo data to IPRC

• Synchronize realtime Argo netCDF files between IPRC and Argo Global Data Assembly Centers – GODAE GDAC (US) and Ifremer GDAC (France)

• Use CDFsync – Fast synchronization times

• Only transmits the differences between netCDF files • Integration of Open Source rsync program, with a number of

optimizations including:– Special handling of netCDF files for faster synchronization calculations

• Much faster updates of large numbers of small netCDF files• Faster in-place updates of large netCDF files

– http://www.epic.noaa.gov/epic/software/cdfsync

Work PlanDevelop IPRC Data Service

• Integrate EPIC Web and PMEL Argo Web • Customize overall functionality

– Interface for the Pacific Region – Specific requirements identified by the IPRC

• Convert to Linux from Solaris• Local data format issues• Output netCDF files in a tar file, output in GIS shape files• Coordinate closely between scientists and IT staff at IPRC and

PMEL to assure that desired functionality and requirements are addressed

• Software installed and maintained operationally by the IPRC

Dapper In-situ data viewerOPeNDAP-standard, next-generation EPIC Web

• Web interface to get station data from dapper• Full-fledged “Google maps” type interface

– Zoom in and out, drag, etc.• Next: Data plots, data download, plug-in for custom graphics

New!

JavaScript/DHTML Realtime Display Client

New!

New!

JavaScript/DHTML Realtime Display Client

New!

JavaScript/DHTML Realtime Display Client

New!

JavaScript/DHTML Realtime Display Client

Future Vision A Pacific Region In-situ Data Display Website

• Observed oceanographic and atmospheric data– Argo, CTD, XBT, Bottle, Sea Level, ADCP, time series,

atmospheric profiles , surface meteorological time series data, and buoy time series, …

– Available to common desktop tools • Matlab, Grads, Java OceanAtlas, Ferret, ncBrowse, … • OPeNDAP dapper server

• Extract model data at observed data locations• Seamless integration with complementary PRIDE

efforts– Integrated Pacific Region Data Delivery for Low and High

Bandwidth Internet Connections (C.Sun & N. Soreide)