Rivero - VIPER

16
VIPER Data Science Platform Southeast Fisheries Science Center SEFSC June 17, 2014

Transcript of Rivero - VIPER

Page 1: Rivero - VIPER

VIPER

Data Science PlatformSoutheast Fisheries Science Center SEFSC

June 17, 2014

Page 2: Rivero - VIPER

DefinitionA data value chain describes the evolution of data from information to intelligence within an organization.It encapsulates the various forms data can take as individual departments transform it to fit their needs.As such, its inherent value increases the more it is used. A feedback loop is created when changes to data collection programs are implemented due to the identification of knowledge gaps.Thus, supporting a virtuous cycle of continuous improvement.

U.S. Department of Commerce | National Oceanic and Atmospheric Administration | NOAA Fisheries | Page 2

Page 3: Rivero - VIPER

Links in the Chain

U.S. Department of Commerce | National Oceanic and Atmospheric Administration | NOAA Fisheries | Page 3

• Intelligence (integrated)• Knowledge (assimilated)• Information (interpreted)• Data (collected)

Page 4: Rivero - VIPER

NOAAs Knowledge Powerhouse

U.S. Department of Commerce | National Oceanic and Atmospheric Administration | NOAA Fisheries | Page 4

Belter, C., S. Davis, and J. Thomas. 2014. A Bibliometric Analysis of Articles by NOAA-Affiliated Authors Published During Fiscal Year 2013. NOAA Central and Regional Libraries.

Page 5: Rivero - VIPER

Virtuous Cycle Characteristics

U.S. Department of Commerce | National Oceanic and Atmospheric Administration | NOAA Fisheries | Page 5

• Data Entry Applications• Web/Mobile Devices• Electronic Reporting/Monitoring• Remote Sensing

• Interpret and analyze• Queries and reports• Visualizations to discern patterns• Statistical analyses to understand

relationships

• Prescribe and Act• Integrated into the decision-making

process at multiple levels (strategic, tactical, operational)

• Drives data collection improvements

• Publications• Model development• Institutional awareness• Predict

Knowledge Intelligence

Data Information

Page 6: Rivero - VIPER

Virtuous Cycle Technologies

U.S. Department of Commerce | National Oceanic and Atmospheric Administration | NOAA Fisheries | Page 6

• Programming Languages • Web/Mobile Devices• In-situ, Remote Sensors, AUVs• Databases and Data Storage

• Spreadsheets and Desktop Databases• Statistical Software Packages• Geographic Information Systems/Data

Visualization• Structured Query Language

• Cloud Computing• Performance Dashboards• Business Rule Development• Decision-Support Systems

• Data Mining• Predictive Analytics & Modeling• Business Intelligence• NoSQL Databases/Hadoop• Big Data

Knowledge Intelligence

Data Information

Page 7: Rivero - VIPER

How it works …

U.S. Department of Commerce | National Oceanic and Atmospheric Administration | NOAA Fisheries | Page 7

OLTP

SERO

Labs

FIN

OLE

S&T

StatesVendors

OLAP

ETL

Page 8: Rivero - VIPER

VIPER System• Visualization• Integration• Prediction• Extraction• Reporting

U.S. Department of Commerce | National Oceanic and Atmospheric Administration | NOAA Fisheries | Page 8

Page 9: Rivero - VIPER

DescriptionVIPER brings the algorithms to the data and not the other way

around. Data mining-ready tables are transferred to the VIPER data cluster at regular system-dependent intervals from the existing Oracle data warehouse. VIPER will not change the way operational data is collected or managed at the SEFSC. VIPER will leverage the data collection, quality control, quality assurance, and data management enhancements by extracting only science-quality data from each system. The data will be stored within the easily expandable cluster to maintain high performance.

U.S. Department of Commerce | National Oceanic and Atmospheric Administration | NOAA Fisheries | Page 9

Page 10: Rivero - VIPER

Capabilities• Interactive Data Visualization• Exploratory Data Analysis• Predictive Analytics• Customized Reporting• Performance Dashboards (key performance indicators)• Dynamic Off-Site Built-In Replication (Disaster

Recovery/COOP)• Ability to quickly add resources as needed through cloud-

based computing

U.S. Department of Commerce | National Oceanic and Atmospheric Administration | NOAA Fisheries | Page 10

Page 11: Rivero - VIPER

Architecture

U.S. Department of Commerce | National Oceanic and Atmospheric Administration | NOAA Fisheries | Page 11

Page 12: Rivero - VIPER

VIPER Log In

U.S. Department of Commerce | National Oceanic and Atmospheric Administration | NOAA Fisheries | Page 12

Page 13: Rivero - VIPER

VIPER Landing Page

U.S. Department of Commerce | National Oceanic and Atmospheric Administration | NOAA Fisheries | Page 13

Page 14: Rivero - VIPER

VIPER Personnel Dashboard

U.S. Department of Commerce | National Oceanic and Atmospheric Administration | NOAA Fisheries | Page 14

Page 15: Rivero - VIPER

VIPER Personnel Dashboard

U.S. Department of Commerce | National Oceanic and Atmospheric Administration | NOAA Fisheries | Page 15

Page 16: Rivero - VIPER

VIPER Employee Performance Monitoring

U.S. Department of Commerce | National Oceanic and Atmospheric Administration | NOAA Fisheries | Page 16