The 900-Pound Gorilla

20
The 900-Pound Gorilla How STORET Affects the Development of Other Data Management Tools Gerald Burnette HydroGeoLogic, Inc. (865) 995-9953 www.hgl.com

description

The 900-Pound Gorilla. How STORET Affects the Development of Other Data Management Tools. Gerald Burnette HydroGeoLogic, Inc. (865) 995-9953 www.hgl.com. Why? Because problems with the system they were currently using were causing missed deadlines, delays, and other frustrations. - PowerPoint PPT Presentation

Transcript of The 900-Pound Gorilla

Page 1: The 900-Pound Gorilla

The 900-Pound Gorilla

How STORET Affects the Development of Other Data

Management Tools

Gerald BurnetteHydroGeoLogic, Inc.(865) 995-9953www.hgl.com

Page 2: The 900-Pound Gorilla

This Story Begins in an Earlier Time

The Corps of Engineers contracted for the development of a new surface water quality data management system.

Why? Because problems with the system they were currently using were causing missed deadlines, delays, and other frustrations.

Page 3: The 900-Pound Gorilla

Design Goals of the New System Update the user interface

Improve performance and data access

Fix problems with the data model

Add biological sampling capabilities

Provide compatibility with GIS

Enhance graphics and reporting functions

…and export data to STORET

Page 4: The 900-Pound Gorilla

The DASLER SystemData

Management Interface

GIS Interface

Plotting Utilities

DData Management andata Management andAAnalysisnalysisSSystem forystem forLLakes,akes,EEstuaries, andstuaries, andRRiversivers

Page 5: The 900-Pound Gorilla

DASLER and STORET: Worlds Apart?

“DASLER Is from Mars, STORET Is from Venus”

(with apologies to John Gray)

DData Management andata Management andAAnalysisnalysisSSystem forystem forLLakes,akes,EEstuaries, andstuaries, andRRiversivers

Page 6: The 900-Pound Gorilla

Connecting DASLER to (Legacy) STORET

DData Management andata Management andAAnalysisnalysisSSystem forystem forLLakes,akes,EEstuaries, andstuaries, andRRiversivers

Approximately 1% of DASLER code devoted to connecting to STORET.

(Text files)

Page 7: The 900-Pound Gorilla

New STORET is Introduced

DData Management andata Management andAAnalysisnalysisSSystem forystem forLLakes,akes,EEstuaries, andstuaries, andRRiversivers

The connection between DASLER and STORET is broken.

Page 8: The 900-Pound Gorilla

What to Do?Meeting of the interested Corps parties held in Nashville.

Discussion of differences between DASLER data model and STORET data model.

Page 9: The 900-Pound Gorilla

Program Similarities

Objectives were the same

Structures were similar (locations, characteristics, samples, results)

Common data pool (characteristics, methods, etc.)

Page 10: The 900-Pound Gorilla

Program DifferencesDASLERSTORET

More metadata requirements

Configuration required

Station visits and trips

Explicit procedure references

Gear configuration information

Less metadata requirements

“Pre-configured”

Sampling events only

Procedures and gear information tied to collection method field

Page 11: The 900-Pound Gorilla

Why the Differences?To understand why DASLER and STORET are different, you need only look at the target audiences.

STORET: much larger user base, with vastly different backgrounds and procedures

DASLER: relatively small number of users, with common backgrounds and procedures

Page 12: The 900-Pound Gorilla

Consensus of the MeetingThe only option – if connection to STORET is to be re-established – is to modify DASLER.

Plan developed for altering DASLER to meet new STORET requirements.

Construction of the new version began in February 2001.

Page 13: The 900-Pound Gorilla

Changes to DASLER

Database changes – to enforce some of the same metadata requirements found in STORET

User interface changes – to capture some of the additional information

Export routines – to send data to STORET via SIM

Page 14: The 900-Pound Gorilla

Connection Re-established

DData Management andata Management andAAnalysisnalysisSSystem forystem forLLakes,akes,EEstuaries, andstuaries, andRRiversivers

Now, approximately 5% of DASLER code devoted to connecting to STORET.

(SIM)

Page 15: The 900-Pound Gorilla

DASLER User Base Expands

Page 16: The 900-Pound Gorilla

Expanded User Base Produces Unexpected Side Effect

DData Management andata Management andAAnalysisnalysisSSystem forystem forLLakes,akes,EEstuaries, andstuaries, andRRiversivers

DData Management andata Management andAAnalysisnalysisSSystem forystem forLLakes,akes,EEstuaries, andstuaries, andRRiversivers

DData Management andata Management andAAnalysisnalysisSSystem forystem forLLakes,akes,EEstuaries, andstuaries, andRRiversivers

DASLER-CE DASLER-X

“Two DASLERs diverged in a yellow wood…”

(with apologies to Robert Frost)

Page 17: The 900-Pound Gorilla

DASLER-X Reaches Wider Audience

DData Management andata Management andAAnalysisnalysisSSystem forystem forLLakes,akes,EEstuaries, andstuaries, andRRiversivers

Approximately 15% of DASLER-X code devoted to connecting to STORET.

(SIM)

Page 18: The 900-Pound Gorilla

Wider Audience Requires More Changes

Addition of project concept with support tables

Personnel information, including training

Location and parameter aliases

Support for continuous monitoring data

More “special” entries for STORET exports

As the audience expands, the amount of effort spent making DASLER compatible with STORET increases.

Page 19: The 900-Pound Gorilla

A Good Thing or A Bad Thing?Good

More robust data model

Broader applicability

Increased client base

Increased development time

Requires more support

Constant need to monitor STORET developments

Bad

Page 20: The 900-Pound Gorilla

Conclusions

STORET has had a major influence on development efforts.

This influence has a measurable effect on project budget.

Despite these factors, maintaining compatibility with STORET is a worthwhile goal that has many positive outcomes.