Data Story Toolkit Updated 2020
Transcript of Data Story Toolkit Updated 2020
Data Story ToolkitProject Three
“ I want to have a standardized and user-centric process to create data stories..
User-centric design is misunderstood in the Business Intelligence world
+4.88% 7,200
+5.68% 5,765
+2.53% 3,200
-5.05% 2,544
+1.88% 6,100
-20.00% 4,300
+1.88% 6,731
At Risk PopulationsAverage Days Supply
Average Prescribers
5
1
1
1
N/A
2.2
1
664.22
161.31
207.5
39.15
N/A
40
171.42
Received treatment services
Neonatal Abstinence Syndrome (NAS)
First opioid prescription in 3 months
Non-fatal overdose
Received opioid prescription(s)
Substance Use Disorder and/ or Opioid Use Disorder diagnosis
Enrolled in Medication Assisted Treatment (MAT) Service
Members Count(Year-Over-Year)
Average Prescriptions(Year-Over-Year)
Total Net Paid(Year-Over-Year)
Male Female
Members age and gender(At Risk)
10,000
20,000
30,000
0 2-4 5-140-1 19-21 22-24 45-64 65-84 85+
Members
Age
Prescriptions - Morphine Milligram Equivalent Per Day(At Risk)
1000
2000
3000
0 50-89 90-990-49 100-200 >200
Prescriptions
Distribution of MME on Prescriptions
+3331, +5.95%5,000From 01/01/18 to 12/31/1832% of the State Providers
Total number of providers who prescribed opioid above 7 days supply in reporting period.
High Prescribing Providers
1,000
0MarJan Jun Sep Dec
5,000
+233, +48.5%543From 01/01/18 to 12/31/1810% of the At Risk Population
Total number of non-fatal opioid overdoses
Non-Fatal Opioid Overdoses
300
0MarJan DecJun Sep
600
CPT© is copyright 2017 American Medical Association (AMA). All rights reserved. Fee schedules, relative value units, conversion factors and/or related components are not assigned by the AMA, are not part of CPT, and the AMA is not recommending their use. The AMA does not directly or indirectly practice medicine or dispense medical services. The AMA assumes no liability for data contained or not contained herein. Applicable FARS/DFARS restrictions apply to government use. CPT is a registered trademark of the American Medical Association.
RED BOOK© data are copyright 2018 IBM Corporation. All rights reserved.AND/OR FDB MedKnowledge™ is copyright 2018 First Data Bank. All rights reserved. (and additional information as required by FDB).
Applicable FARS/DFARS Restrictions Apply to Government Use.
Licenses
U.S. Government Rights
Legend: Opioid Prescription Total Allowed AmountMember
Reporting Time Period: 01 Jan 2017 - 31 May 2018
Summary Utilization Opioid Risk
Opioid Epidemic Insights
IBM Watson Health and Human Services Analytics Foundation Hi Sue
View Report List
100 - 500 500 - 1000 1000 - 6000 > 6000
*Number represents member count
Members per County(At Risk)
Members with Multiple Opioid Prescriptions(At Risk)
Over 500 members 500 members or under
>25
25
20
15
10
5
0 2 3 51 4 6 >6
Prescriptions
Prescribers
July2017
July2017
Jun2017
Jun2017
Aug2017
Aug2017
Sep2017
Sep2017
Oct2017
Oct2017
Nov2017
Nov2017
Dec2017
Dec2017
Jan2018
Jan2018
Feb2018
Feb2018
Mar2018
Mar2018
Apr2018
Apr2018
May2018
May2018
45
Total Net Paid
Average Prescriptions
Patient Count
$74,309
42,840
50
$85,000
40
$75,000
30
$65,000
25
$60,000
45
$80,000
35
$70,000
40,000
30,000
20,000
15,000
35,000
25,000
At Risk Population (Month by Month)
NoneFilters applied:
+3331, +5.95%42,840From 01/01/18 to 12/31/1810% of the State Population
Total members identified as at risk in the reporting period
At Risk Opioid Populations
20,000
0MarJan DecJun Sep
40,000
Members identified as at risk of opioid dependance as they a members of an identified at risk cohort
At Risk: 42,840Members who belong to multiple opioid cohorts or have dangerous consumption behaviors.
High Risk: 5,000Members who have greater than 60 days supply of opioids in a 90 day period.
Chronic Risk: 543
Members Count Prescriptions Total Net Paid Previous Year
Different user mental models (non-linear, safari)
Neglect of data
Distinction between business objectives and user needs
Evaluation of feasibility
Lack of highly domain-specific business knowledge
Doesn’t speak data scientists’ language
Knowledge of the BI tools and standards
No consensus on UX designer’s responsibility
Problem with Standard DT Exercises Designer Challenge
A Data Story Toolkit Based on Design Thinking Framework
Business Outcome
Needs Statement
Story Template
Reasoning
Story Outline Wireframe
Translate top business objectives into user needs
Map user mental model and place data in context
Decide on the best structure to tell a compelling story and
visualize it
Business Outcome
Need Statement
Story Template
Reasoning
Story Outline Wireframe
Traditional Empathy Map
Key Takeaway
Focus on the actionable insights
Consider data sources
Actions that
Understand User Needs
Does Thinks
Says Feels
I do I want to
I need data I feel
Write Need Statement
I do I want to
I need data I feel
To achieve a business outcome, a user needs to discover
actionable insights in the area of data sets.
Example: To achieve an annual saving of 5% on operational cost, a COO needs to discover excessively inefficient
administrative activities in the distribution chain.
Business Outcome
Need Statement
Story Template
Reasoning
Story Outline Wireframe
Intent
Questions
Data sources
Measures
Story TemplateComprehend Explore Monitor Evaluate
To achieve a business
outcome, a user needs to
discover actionable insights in
the area of data sets.
Discovery Needs
Intent
Questions
Data sources
Measures
Comprehend Explore Monitor Evaluate Synthesize Test
Find
Compare
Analyze
Correlate
Model
These needs shaped via client research
n=744 Clients
Business Outcome
Need Statement
Story Template
Reasoning
Story Outline Wireframe
Intent
Questions
Data sources
Measures
ReasoningComprehend Explore Monitor Evaluate
Given the data sources and measures available, how many of these questions can be answered?A “compelling” story will have more questions answered on the latter part of this data discovery journey.
Question?
Question?
Question?
Question?
Question?
Question?
Question?
Question?
Question?
Measure
Measure
Measure
Measure
Measure
Measure
Measure
Measure
Measure
Measure
Measure
Measure
Data Source
Data Source
Data Source
Data Source
Data Source
Data Source
I want to.. I want to.. I want to.. I want to..
Discovery Needs
Intent
Questions
Data sources
Measures
Comprehend Explore Monitor Evaluate
Question?
Question?
Question?
Question?
Question?
Question?
Question?
Question?
Question?
Measure
Measure
Measure
Measure
Measure
Measure
Measure
Measure
Measure
Measure
Measure
Measure
Data Source
Data Source
Data Source
Data Source
Data Source
Data Source
I want to.. I want to.. I want to.. I want to..
Question?
Question?
Question?
√X √ √ √ X
√ X√√
Business Outcome
Need Statement
Story Template
Reasoning
Story Outline Wireframe
Use lo-fi wireframes to validate information
structure, chart essentials and flows
Wireframe
30 June 2019
01 July 2017
Report Time Period
Admissions Report List
IBM Watson and Human Services Analytics Foundation
Description
Admissions Net Paid Total
Trendline$120,000+2%
Description
Admissions - Total
Trendline45,000+2%
Admissions Key Performance Indicators % Change Total Trend
Description
Admissions Net Paid PMPY
Trendline$2,345+2%
Description
Average Net Paid Per Admission
Trendline$2,345+2%
Description
Admissions per 1000
Trendline500+2%
Top Admissions by Diagnostic Catefgory
Chart
Variables: Avoidable admissions % and cost
Potentially Avoidable Admissions
Variables: Readmissions % and cost (They will need to determine which are preventable but all we will do it report the numbers)
Chart
Readmissions Percentage
CardioVascular Disorder
Signs/Symptoms/Other Conditions NEC
Raspiratory Disorders
Diabetes
$2000 $2000 $2000
$2000 $2000 $2000
$2000 $2000 $2000
$2000 $2000 $2000
$2000 $2000 $2000
$2000 $2000 $2000
$2000 $2000 $2000
Infections
Injury
Headache
Category Net Paid per Admission PMPM PMPY
Chart
Variables: County, number of admissions
Admissions Per County
Admit Types
Surgical
Medical
Total Net Pay: $172053%
Total Net Pay: $172053%
Total Net Pay: $172053%
Maternity/Newborn
Total Net Pay: $172053%
Psychiatric/Substance Abuse
Total Net Pay: $172053%
Missing/Unknown
30 June 2019
01 July 2017
Report Time Period
Admissions Report List
IBM Watson and Human Services Analytics Foundation
CPT© is copyright 2017 American Medical Association (AMA). All rights reserved. Fee schedules, relative value units, conversion factors and/or related components are not assigned by the AMA, are not part of CPT, and the AMA is not recommending their use. The AMA does not directly or indirectly practice medicine or dispense medical services. The AMA assumes no liability for data contained or not contained herein. Applicable FARS/DFARS restrictions apply to government use. CPT is a registered trademark of the American Medical Association.
RED BOOK© data are copyright 2018 IBM Corporation. All rights reserved.AND/OR FDB MedKnowledge™ is copyright 2018 First Data Bank. All rights reserved. (and additional information as required by FDB).
Applicable FARS/DFARS Restrictions Apply to Government Use.
Licenses
U.S. Government Rights
Description
Admissions Net Paid Total
Trendline$120,000+2%
Description
Admissions - Total
Trendline45,000+2%
Admissions Key Performance Indicators % Change Total Trend
Description
Admissions Net Paid PMPY
Trendline$2,345+2%
Description
Average Net Paid Per Admission
Trendline$2,345+2%
Description
Admissions per 1000
Trendline500+2%
Top Admissions by Diagnostic Catefgory
Chart
Variables: Avoidable admissions % and cost
Potentially Avoidable Admissions
Variables: Readmissions % and cost (They will need to determine which are preventable but all we will do it report the numbers)
Chart
Readmissions Percentage
CardioVascular Disorder
Signs/Symptoms/Other Conditions NEC
Raspiratory Disorders
Diabetes
$2000 $2000 $2000
$2000 $2000 $2000
$2000 $2000 $2000
$2000 $2000 $2000
$2000 $2000 $2000
$2000 $2000 $2000
$2000 $2000 $2000
Infections
Injury
Headache
Category Net Paid per Admission PMPM PMPY
Chart
Variables: County, number of admissions
Admissions Per County
Admit Types
Surgical
Medical
Total Net Pay: $172053%
Total Net Pay: $172053%
Total Net Pay: $172053%
Maternity/Newborn
Total Net Pay: $172053%
Psychiatric/Substance Abuse
Total Net Pay: $172053%
Missing/UnknownInformation Structure
What are the main admission
categories or service groups
being admitted? Can I help prevent
these?
What is being spent on certain disease
categories by place setting?
(Outpatient, Inpatient , RX? actual and %)
How’s my cost compare to last
year?
What are the main inpatient visit
reasons conditions / surgeries etc?
What are the admissions and ER
visits costing ?
What are my admission trends?
How much are manageable
conditions costing me? Asthma, Depression,
Hypertension, Diabetes, CAD?
What are my top episodes by
member counts and cost?
I want to view detailed information about hospital admissions by population and care
plan.
30 June 2019
01 July 2017
Report Time Period
Admissions Report List
IBM Watson and Human Services Analytics Foundation
Description
Admissions Net Paid Total
Trendline$120,000+2%
Description
Admissions - Total
Trendline45,000+2%
Admissions Key Performance Indicators % Change Total Trend
Description
Admissions Net Paid PMPY
Trendline$2,345+2%
Description
Average Net Paid Per Admission
Trendline$2,345+2%
Description
Admissions per 1000
Trendline500+2%
Top Admissions by Diagnostic Catefgory
Chart
Variables: Avoidable admissions % and cost
Potentially Avoidable Admissions
Variables: Readmissions % and cost (They will need to determine which are preventable but all we will do it report the numbers)
Chart
Readmissions Percentage
CardioVascular Disorder
Signs/Symptoms/Other Conditions NEC
Raspiratory Disorders
Diabetes
$2000 $2000 $2000
$2000 $2000 $2000
$2000 $2000 $2000
$2000 $2000 $2000
$2000 $2000 $2000
$2000 $2000 $2000
$2000 $2000 $2000
Infections
Injury
Headache
Category Net Paid per Admission PMPM PMPY
Chart
Variables: County, number of admissions
Admissions Per County
Admit Types
Surgical
Medical
Total Net Pay: $172053%
Total Net Pay: $172053%
Total Net Pay: $172053%
Maternity/Newborn
Total Net Pay: $172053%
Psychiatric/Substance Abuse
Total Net Pay: $172053%
Missing/Unknown
Chart Essentials
How’s my cost compare to last
year?
What are my admission trends?
30 June 2019
01 July 2017
Report Time Period
Admissions Report List
IBM Watson and Human Services Analytics Foundation
CPT© is copyright 2017 American Medical Association (AMA). All rights reserved. Fee schedules, relative value units, conversion factors and/or related components are not assigned by the AMA, are not part of CPT, and the AMA is not recommending their use. The AMA does not directly or indirectly practice medicine or dispense medical services. The AMA assumes no liability for data contained or not contained herein. Applicable FARS/DFARS restrictions apply to government use. CPT is a registered trademark of the American Medical Association.
RED BOOK© data are copyright 2018 IBM Corporation. All rights reserved.AND/OR FDB MedKnowledge™ is copyright 2018 First Data Bank. All rights reserved. (and additional information as required by FDB).
Applicable FARS/DFARS Restrictions Apply to Government Use.
Licenses
U.S. Government Rights
Description
Admissions Net Paid Total
Trendline$120,000+2%
Description
Admissions - Total
Trendline45,000+2%
Admissions Key Performance Indicators % Change Total Trend
Description
Admissions Net Paid PMPY
Trendline$2,345+2%
Description
Average Net Paid Per Admission
Trendline$2,345+2%
Description
Admissions per 1000
Trendline500+2%
Top Admissions by Diagnostic Catefgory
Chart
Variables: Avoidable admissions % and cost
Potentially Avoidable Admissions
Variables: Readmissions % and cost (They will need to determine which are preventable but all we will do it report the numbers)
Chart
Readmissions Percentage
CardioVascular Disorder
Signs/Symptoms/Other Conditions NEC
Raspiratory Disorders
Diabetes
$2000 $2000 $2000
$2000 $2000 $2000
$2000 $2000 $2000
$2000 $2000 $2000
$2000 $2000 $2000
$2000 $2000 $2000
$2000 $2000 $2000
Infections
Injury
Headache
Category Net Paid per Admission PMPM PMPY
Chart
Variables: County, number of admissions
Admissions Per County
Admit Types
Surgical
Medical
Total Net Pay: $172053%
Total Net Pay: $172053%
Total Net Pay: $172053%
Maternity/Newborn
Total Net Pay: $172053%
Psychiatric/Substance Abuse
Total Net Pay: $172053%
Missing/Unknown
Average Net Paid Per Member
Per Year
Average Net Paid Per Admission
Admissions Per 1000 members
Year-over-year comparison
Total Admission
Chart Type: year-over-year comparison; monthly trend Measures: see left side Variables: total cost, change% Data update: every month Interaction: show each month’s cost on hover Data density: 2-year data
Flow
Dashboards Reports Drill-Through Paths
30 June 2019
01 July 2017
Report Time Period
Admissions Report List
IBM Watson and Human Services Analytics Foundation
CPT© is copyright 2017 American Medical Association (AMA). All rights reserved. Fee schedules, relative value units, conversion factors and/or related components are not assigned by the AMA, are not part of CPT, and the AMA is not recommending their use. The AMA does not directly or indirectly practice medicine or dispense medical services. The AMA assumes no liability for data contained or not contained herein. Applicable FARS/DFARS restrictions apply to government use. CPT is a registered trademark of the American Medical Association.
RED BOOK© data are copyright 2018 IBM Corporation. All rights reserved.AND/OR FDB MedKnowledge™ is copyright 2018 First Data Bank. All rights reserved. (and additional information as required by FDB).
Applicable FARS/DFARS Restrictions Apply to Government Use.
Licenses
U.S. Government Rights
Description
Admissions Net Paid Total
Trendline$120,000+2%
Description
Admissions - Total
Trendline45,000+2%
Admissions Key Performance Indicators % Change Total Trend
Description
Admissions Net Paid PMPY
Trendline$2,345+2%
Description
Average Net Paid Per Admission
Trendline$2,345+2%
Description
Admissions per 1000
Trendline500+2%
Top Admissions by Diagnostic Catefgory
Chart
Variables: Avoidable admissions % and cost
Potentially Avoidable Admissions
Variables: Readmissions % and cost (They will need to determine which are preventable but all we will do it report the numbers)
Chart
Readmissions Percentage
CardioVascular Disorder
Signs/Symptoms/Other Conditions NEC
Raspiratory Disorders
Diabetes
$2000 $2000 $2000
$2000 $2000 $2000
$2000 $2000 $2000
$2000 $2000 $2000
$2000 $2000 $2000
$2000 $2000 $2000
$2000 $2000 $2000
Infections
Injury
Headache
Category Net Paid per Admission PMPM PMPY
Chart
Variables: County, number of admissions
Admissions Per County
Admit Types
Surgical
Medical
Total Net Pay: $172053%
Total Net Pay: $172053%
Total Net Pay: $172053%
Maternity/Newborn
Total Net Pay: $172053%
Psychiatric/Substance Abuse
Total Net Pay: $172053%
Missing/Unknown
Comprehend
Explore
Monitor
Evaluate
30 June 2019
01 July 2017
Report Time Period
Admissions Report List
IBM Watson and Human Services Analytics Foundation
CPT© is copyright 2017 American Medical Association (AMA). All rights reserved. Fee schedules, relative value units, conversion factors and/or related components are not assigned by the AMA, are not part of CPT, and the AMA is not recommending their use. The AMA does not directly or indirectly practice medicine or dispense medical services. The AMA assumes no liability for data contained or not contained herein. Applicable FARS/DFARS restrictions apply to government use. CPT is a registered trademark of the American Medical Association.
RED BOOK© data are copyright 2018 IBM Corporation. All rights reserved.AND/OR FDB MedKnowledge™ is copyright 2018 First Data Bank. All rights reserved. (and additional information as required by FDB).
Applicable FARS/DFARS Restrictions Apply to Government Use.
Licenses
U.S. Government Rights
Description
Admissions Net Paid Total
Trendline$120,000+2%
Description
Admissions - Total
Trendline45,000+2%
Admissions Key Performance Indicators % Change Total Trend
Description
Admissions Net Paid PMPY
Trendline$2,345+2%
Description
Average Net Paid Per Admission
Trendline$2,345+2%
Description
Admissions per 1000
Trendline500+2%
Top Admissions by Diagnostic Catefgory
Chart
Variables: Avoidable admissions % and cost
Potentially Avoidable Admissions
Variables: Readmissions % and cost (They will need to determine which are preventable but all we will do it report the numbers)
Chart
Readmissions Percentage
CardioVascular Disorder
Signs/Symptoms/Other Conditions NEC
Raspiratory Disorders
Diabetes
$2000 $2000 $2000
$2000 $2000 $2000
$2000 $2000 $2000
$2000 $2000 $2000
$2000 $2000 $2000
$2000 $2000 $2000
$2000 $2000 $2000
Infections
Injury
Headache
Category Net Paid per Admission PMPM PMPY
Chart
Variables: County, number of admissions
Admissions Per County
Admit Types
Surgical
Medical
Total Net Pay: $172053%
Total Net Pay: $172053%
Total Net Pay: $172053%
Maternity/Newborn
Total Net Pay: $172053%
Psychiatric/Substance Abuse
Total Net Pay: $172053%
Missing/Unknown
Testing - Step One
Designer User
Before you start validating the content on the dashboard, ask these questions first
Timeliness: How frequently is the data in the dashboard updated?
Aesthetic value: How important is it that the dashboard look attractive, or can it be purely utilitarian?
Platform: Does the audience need to access the information on-the-go?
Connectivity: Does the dashboard need to connect to live data sources?
Collaboration: Is it important that your audience be able to easily share findings?
Testing - Step Two
Designer User
Can this chart answer your questions? Is this the right chart type? Validate the other chart attributes.
Chart Type: year-over-year comparison; monthly trend Measures: see left side Variables: total cost, change% Data update: every month Interaction: show each month’s cost on hover Data density: 2-year data
value: total cost, number of membersyear-over-year changesMeasures
I want to know the total number of admissions and the cost associated with it.“
Testing - Step Three
Designer User
Define the requirements for basic dashboard functions
1. Filters (global/local) Allow users to define the scope of the data in the dashboard to reflect their needs. Filters can either be global (refining scope for the entire dashboard) or local (refining scope for a specific chart or metric or view).
2. Alerts Highlight information based on pre-defined criteria. The alert may be activated when a metric goes outside of a particular threshold.
3. Export Give users the ability to pull information out of a dashboard. Export to formats that let users do more with the data like Excel and CSV rather than PDF.
IBM Watson and Human Services Analytics Foundation
Apply Clear filters
1-4
<1
5-9
15-17
20-24
10-14
18-19
Age Group
Aid Category
Benefit Plan
County
Gender
Payer Plan
FiltersFilters
“I think allows us all a structured approach to get on a shared view”
“it provides a nice look back (in mural ) of analysis and shared understanding” “It brings consistency to the design process” “business people and design people can swap in and out and it works”
"A great way to ensure consistency and maintain standards across the team when developing requirements." “Forces you to ask the right questions” “Helps us to ensure we are answering the right questions in the designs”
“Helps us ensure we are presenting the right data with the right charts to help it be understood” “Helps us to ensure the designs close the loop” “The design matrix helps the design and business team ensure we are focused on solving the right problem or question for the right user"
Quotes
1. Bring user-centric thinking back
2. Create a story instead of a few snapshots
3. Promote consistency and coherence
What is the value of UX
2+1
-30%
Outcome
Team Adoption
Development Time
1. Successfully brought 2 state services teams onboard to replace their standard reports with our data packages.
2. One design team outside of my organization has started using this Toolkit for BI products.
3. BAs have saved 30% of the time on writing requirements and user stories.
4. Design and FED teams have continuously been shortening development time.