Bringing Life Back to a Data System Through AWS and Tableau · Bringing Life Back to a Data System...
42
Transcript of Bringing Life Back to a Data System Through AWS and Tableau · Bringing Life Back to a Data System...
Bringing Life Back to a Data System Through AWS and Tableau
Rob Walker, MSEpidemiologist/Data Scientist
Iowa Department of Public Health
Environmental Public Health Tracking
#TC18
Disclaimer: This presentation was created by an Environmental Public Health Tracking grantee. but the findings and conclusions in this presentation are those of the authors and do not necessarily represent the official position of the Centers for Disease Control
and Prevention.
AgendaHistory of Tracking program
Original Portal Infrastructure
Redesign Improvements
Future Tableau Uses
Examples of Value Added Uses
Environmental Public Health Tracking
Collection
Integration
Analysis
Interpretation
Dissemination
DataExposure to
HazardsAction
Environmental hazards
Exposures to those hazards
Health effects that may be related to the exposures.
Plan
Apply
Evaluate
"We can track the flu, West Nile virus, and mad cow disease but not enough of the chronic illnesses that are the biggest killers of Americans, because we just don't have enough of that basic information."
Thomas Burke, Ph.D., Professor, John Hopkins University
Iowa Public Health Tracking (IPHT) Portal
Funding from the CDC
2 years of planning
2 years to build and launch
12 content areas
2010 Grant 2014 Renewal 2017 Renewal
3 year maintenance
Portal Update
Expansion and outreach
15 content areas
5 year expansion
Portal overhaul
Major expansion and outreach
20 content areas
IPHT Portal Requirements
Tables Charts
Graphs MapsAll downloadable
Aggregation & suppressionRole based access
Data Presentation:
Security & Confidentiality:
What is being presentedWhy is it important to health?
Content Messaging:
Strengths and limitationsData interpretation and use
Descriptive Metadata:
IPHT Portal Requirements
Generate visual displaysCount and rate spatial and temporal
Sort and change dimensionsAbility to zoom in on data
Dynamic Query:
Public Portal: Interaction:
Section 508 Compliant:
Public access withstructured flow
Maintain visual consistency
Assist with visual impairmentsColor blindness
"A successful tracking system will provide our citizens with critical information on the threats to their health posed by the environment and how well we, as a nation, a state, or a community, are dealing with those threats.“
Michael McGeehin, Ph.D., Director, Division of Environmental Hazards and Health Effects, National Center for Environmental Health, CDC
Planning for the End of Time
PerformancePoint EOL
Geriatric Data Center
Cloud solution looking more feasible
Exploration
Picking a Winner
• Microsoft BI
• Tableau
• Amazon QuickSight
• Google Data Studio
• IBM Cognos
BI Platforms
Research Portal Replacement
15 copies of Desktop
Began Proof of Concept of portal
Created full demo
Tableau
Accelerated Plans
Timeline went from 18-24 months to 6-8 months
Choose a replacement product
Plan and implement replacement
Timeline
Redesign Process
Purchased Tableau Server (8 core) subscription and installed in AWS
Design and develop visualizations
SME and clear language review
Build pages in DNN
Launch
Portal Build
Where to Now?
Migrate data center to AWS (First phase of production – Highest priority)
Expand Tableau throughout department
Evaluate benefits
Next Steps
Expected Benefits
IM Focus on dataProgrammatic staff optimization
No longer constrained to cubesCan use Excel for use test cases
Reduction of Resources:
Data Flexibility:
Programmatic level Quick fix to content or visualizations
Portal Changes:
Can be done through Tableau scriptsFlexibility
Data Suppression:
Expected Benefits
Near real time data Maps in seconds, not hours
Emergency Response:
Mapping:
Improved customer satisfactionQuick fix to content or visualizations
Ease of use:
Staff savingsInvest in data exploration
ROI:
AWS Pre-Migration
Pre-migration Planning – 18-24 months
Application Inventory
Why?
Application Inventory
Red – Application upgrade or replacement required
Yellow – Application should be upgraded but can be migrated
Green – Application can be migrated in current state
Independent Review
Service Agent
Memory
Processor usage
IO
Planning to Implementation
Contractor
Mapped entire system
Developed “sprints” for deployment
Complete phases of deployment
Deployment
Phases
Foundation
dev – test – production
Data Center
Common Apps
High priority to low
Garners 5 R’s
Hybrid
Infrastructure as a Service (IAAS)
Platform as a Service (PAAS)
Software as a Service (SAAS)
Security
PHI Data
Scanning
Encrypt within app
Move to “Gov” side of AWS
Evaluation
Successes
Previous experiences
Great staff
Training
Sandbox
Evaluation
Challenges
Start earlier
Move quicker
Communication
Take Home
Start planning early
Comprehensive inventory
Build for the future
Sample Tableau Uses
EMS Survey Work– Sample for review
IM Services Tracking
IM Asset Tracking
Please complete the
session survey from the
Session Details screen
in your TC18 app
