Hydrologic Information System for North Texas

12
Hydrologic Information System for North Texas John A. McEnery, University of Texas at Arlington Paul W. McKee, National Weather Service Gregory P. Shelton, National Weather Service December 10, 2010

description

Hydrologic Information System for North Texas. John A. McEnery, University of Texas at Arlington Paul W. McKee, National Weather Service Gregory P. Shelton, National Weather Service December 10, 2010. HRAP centers / MPE /U.S. & Mexico. SQL Database Scalability Considerations. - PowerPoint PPT Presentation

Transcript of Hydrologic Information System for North Texas

Page 1: Hydrologic Information System for North Texas

Hydrologic Information System for

North Texas

John A. McEnery, University of Texas at ArlingtonPaul W. McKee, National Weather Service

Gregory P. Shelton, National Weather Service

December 10, 2010

Page 2: Hydrologic Information System for North Texas

HRAP centers / MPE /U.S. & Mexico

Page 3: Hydrologic Information System for North Texas

SQL DatabaseScalability Considerations

– Database Search Indexes • written & applied to several data sets

– Outcome: performance trade off– The positive:

• Substantially increased data retrieval time• Data download time for registered sets of Daily

and Hourly values now range between quick to nearly instantaneous!!

– The negative:• Substantially slower data entry. Nearly an hour to

load a one hour set of values. Not a sustainable process.

Page 4: Hydrologic Information System for North Texas

SQL DatabaseScalability Considerations

– Solution: Recent Values vs. Archive• 2 separate sets• Small dynamic set containing recent values

(no indexes needed). This will receive current updates.

• Large static set with full 15/17 yr history of archive values.

– Additional Solution: New platform at Arlington Regional Data Center (ARDC)

• Fail-over power back up• 24/7 sys-op support• Enterprise class data server

Page 5: Hydrologic Information System for North Texas

ARDC System

• 12 3.5 GHz HT processing cores

• 96 Gb memory

• 12 TB integrated storage for faster IO functions

• MS Server 2008, SQL Server 2008 & ArcGIS Server

Page 6: Hydrologic Information System for North Texas

Update stream via Unidata Local Data Manager (LDM)

• LDM Connection became active and remained active November 22nd.– Routed from WGRFC through NWS Southern

Region Headquarters and then to UTA.– Extremely dedicated effort by Mike Thompson

of NWS to coordinate the configuration for LDM.

Page 7: Hydrologic Information System for North Texas

UTA HIS Architecture

Reservoir

WaterShed

Microsoft Server 2008MS SQL Server 2008CUAHSI ODMWaterOneFlow Services(2.83Ghz IC7 – 20 Gb SDRAM)

QNAP NAS16Tb External Storage

NWS WGRFC

CUAHSI Central

WaterML

C# Script

XMRG ContentArchive Values

Page 8: Hydrologic Information System for North Texas

UTA HIS Architecture

Reservoir

WaterDrop

Linux Red Hat 5.0LDM 6.8 Data Manager

WaterShed

Microsoft Server 2008MS SQL Server 2008CUAHSI ODMWaterOneFlow Services(2.83Ghz IC7 – 20 Gb SDRAM)

QNAP NAS16Tb External Storage

NWS WGRFC / SRH CUAHSI Central

WaterML

C# Script

XMRG ContentCurrent Values

Page 9: Hydrologic Information System for North Texas

Student participants

• Kulsawasd Jitkajomwanich

• Brad Jewell

• Ryan Ramsey

Page 10: Hydrologic Information System for North Texas

Extension of Work

• Lower Mississippi RFC

• Arkansas Red Basin RFC

Page 11: Hydrologic Information System for North Texas

NWS RFC Service Areas

Page 12: Hydrologic Information System for North Texas

New Project

• Tarrant Regional Water District

• Implement a similar data system to stream multiple data sources.

• MPE, QPF, stream flow, lake levels.

• Purpose: Input for Fort Worth Floodway Model.

• Collaborators: TRWD, NWS, USGS, USACE.