OOI CI EOI LCA REVIEW December 13, 2010 Ocean Observatories Initiative External Observatory...
-
Upload
virginia-logan -
Category
Documents
-
view
216 -
download
0
Transcript of OOI CI EOI LCA REVIEW December 13, 2010 Ocean Observatories Initiative External Observatory...
OOI CI EOI LCA REVIEWDecember 13, 2010
Ocean Observatories Initiative
External Observatory Integration
Christopher MuellerLife Cycle Architecture ReviewDecember 13, 2010
OOI CI EOI LCA REVIEWDecember 13, 2010
Agenda
Life Cycle Architecture Review
• Subsystem Purpose
• Release 1 Product Description Use Case Overview
• Architectural Overview
• Status of Progress
• Use Cases Address, Use Cases Demonstrated
• Technology Challenges and Achievements
• Plan for Construction
• Risk Assessment
• Demonstration
2
OOI CI EOI LCA REVIEWDecember 13, 2010
External Observatory Integration Subsystem: Purpose
1.Integrates external observatories (IOOS in R1)
with the OOI Integrated Observatory
2.Facilitates inclusion of external data
3.Delivers data in community specific forms
4.Allows immediate full scale testing of the OOI-CI
System
5.Introduces OOI to a community of early adopters
3
OOI CI EOI LCA REVIEWDecember 13, 2010
EOI R1 Product Description Use Case Overview
Responsible For
Supports
Uses
4
OOI CI EOI LCA REVIEWDecember 13, 2010
Dataset Agents Supporting UC.R1.04
•EOI Supports this use case by providing Dataset
Agents that facilitate acquisition of data from
external repositories (such as NDBC and AOML)
•The Dataset Agents are responsible for mapping
between the data format provided by the
external repository and the OOI Canonical Data
Model
5
OOI CI EOI LCA REVIEWDecember 13, 2010
UC.R1.21: Derive Data Product Externally
•Normalization of disparate data sources
•Transformation to the desired output format
•Automated delivery of data to the end user (R1
modeling groups)
•Automated launching of client-side processing
scripts
•Resulting data may be sent back to OOI-CI
6
OOI CI EOI LCA REVIEWDecember 13, 2010
Architectural Overview – Client View2010 OOI-CI – IOOS Collaboration
NDBCWx
NDBCHFR
CO-OPSWL
USGS AOML
IOOS Data Sources Non-IOOS Sources
SOS TDS SOS HTTP
WaterML
OOI-CIService
TranslationFormat
ConversionNotification
Feeds/Subscriptions
Espresso ROMS
other models
IOOSCatalo
g IOOSRAs
SOS
External Observatory Integration (EOI)
OOI-CIService
TranslationFormat
ConversionNotification
Feeds/Subscriptions
External Observatory Integration (EOI)External Observatory Integration (EOI)
IOOSCatalo
g
8
OOI CI EOI LCA REVIEWDecember 13, 2010
User Interfaces
Core Infrastructure Services
Architectural Overview – OOI-CI View
CommonOperating
Infrastructure
Data Distribution andPreservation Infrastructure
CommonExecution
Infrastructure
DataManagement
Application LevelServices
Externalization andIntegration
InstrumentAgents
External Observatory Integration
Sensing & Acquisition
IOOS Modeling Groups
10
OOI CI EOI LCA REVIEWDecember 13, 2010
2650-00007 OV2 CI
Architectural Overview – OOI-CI View
ApplicationServices
InfrastructureServices
IOOS Modeling Groups
11
OOI CI EOI LCA REVIEWDecember 13, 2010
Architectural Overview – OOI-CI View
Subscribe(Dispatcher)
Publish(Dataset Agents)
http://oceanobservatories.org/spaces/display/syseng/CIAD+OV+06+External+Observatory+Integration
12
OOI CI EOI LCA REVIEWDecember 13, 2010
Architectural Overview – Dataset Agent
http://oceanobservatories.org/spaces/display/syseng/CIAD+EOI+Dataset+Agents
13
(1)(2)
(4)
(5)
(3)
(7)
(6)
OOI CI EOI LCA REVIEWDecember 13, 2010
Architectural Overview – Dataset Agent
http://oceanobservatories.org/spaces/display/syseng/CIAD+EOI+Dataset+Agents
14
OOI CI EOI LCA REVIEWDecember 13, 2010
Architectural Overview – Dispatcher
http://oceanobservatories.org/spaces/display/syseng/CIAD+EOI+Dispatcher
15
OOI CI EOI LCA REVIEWDecember 13, 2010
Status of Progress
• Implemented end-to-end exchange of messages on
both the Publication (Dataset Agent) and
Subscription (Dispatcher) sides of the system.
• Completed Dataset Agent implementations for all
data required by Rutgers modeling group
• Completed Dispatcher implementation capable of
receiving notification and reacting by launching an
external workflow script
16
OOI CI EOI LCA REVIEWDecember 13, 2010
Status of Progress –Rutgers Data SourcesCurrently Implemented Capabilities
•Providers:
• PFEG, NAVY, USGS, RADS, NCEP, AOML, NDBC
•Acquisition Protocols:
• OPeNDAP, SOS, WaterML, urlread
•CDM Types:
• Grid, Station, Station Profile, Trajectory
•Data Variables:
• Sea Surface Height, Currents, Winds, Salinity, Temperature, River
Discharge, …
•Acquisition Forms:
• NetCDF, ASCII
17
OOI CI EOI LCA REVIEWDecember 13, 2010
Plan for Construction
Current Schedule:
•Three 6 week Construction Iterations – 12/20/2010 5/2/2011
•IOC Review – week of 5/3/2011
Considering rescheduling to bring EOI into alignment with core
subsystems:
•Two 8 week Construction Iterations – 12/20/2011 4/1/2011
• EOI will be aligned for the 2nd iteration
•R1 Deployment concurrent with the rest of the systemhttp://www.oceanobservatories.org/spaces/display/CIDev/EOI+Release+1+Construction+Plan
19
OOI CI EOI LCA REVIEWDecember 13, 2010
Plan for Construction – R1C1
Theme: Analysis of 2nd & 3rd Modeling Group & Refinement
of Elaboration Implementations
•Analysis of modeling group data needs• University of Hawaii• Texas A&M
•Integration of mature ION capabilities• Refactoring of Dataset Agent & Dispatcher
implementations•Thorough documentation
http://www.oceanobservatories.org/spaces/display/CIDev/EOI+Release+1+Construction+Plan
20
OOI CI EOI LCA REVIEWDecember 13, 2010
Plan for Construction – R1C2
Theme: Development of Additional Dataset Agents &
Adoption of OOI-CI as the Data Provider for R1 Modeling
Groups
•Continued integration of mature ION capabilities•Development of Additional Dataset Agents• For University of Hawaii data• For Texas A&M data
•Incorporation of OOI-CI as the data provider in the acquisition scripts of the 3 R1 Modeling Groups
http://www.oceanobservatories.org/spaces/display/CIDev/EOI+Release+1+Construction+Plan
21
OOI CI EOI LCA REVIEWDecember 13, 2010
Risk Assessment – EOI
Use Case
ID Name Delivery Risk Maturity Level Target Use
UC.R1.21 Derive Data Product Externally (Merge Data) Low Required User
22
OOI CI EOI LCA REVIEWDecember 13, 2010
End-to-end Demonstration
https://docs.google.com/drawings/edit?id=1HDMg7rLhic5dIeZ_iWpez8EokfTh0bnFrpNZHXteNYA&hl=en&authkey=CLG0xoMI
Translation from raw form to OOI-CI Canonical Data
Model
Transmission of data via ION
Messages
24
For Demo Only!!