Unleashing Data: The Key To Driving Massive Improvements

1

Transcript of Unleashing Data: The Key To Driving Massive Improvements

Unleashing Data: The Key to Driving Massive Improvements

Tom Burton, MBA

Co-Founder & Chief Improvement

Officer, Health Catalyst

© 2017 Health Catalyst

2

Learning Objectives

• Illustrate the importance of investing in analytics training and infrastructure to prepare for massive improvement in healthcare outcomes.

• Demonstrate how to unleash data at your organization with efforts across the improvement spectrum.

• Recognize how to sustain and spread improvements across your entire organization.

© 2017 Health Catalyst

3

To unleash the full potential of data,

organizations should adopt a

balanced approach to improvement

across the spectrums of both

effort and value.

© 2017 Health Catalyst

Proprietary and Confidential4

Our Mission: Be the Catalyst for Massive Improvement in Healthcare Outcomes

510+Team Members

113+Improvement

Case Studies

22Best Places to

Work Awards

90+ MillionPatients

400+Hospitals

4,000+ Clinics

Our Customers Our Company

Academic Medical CentersCommunity Hospitals

Children’s HospitalsManaged Service Organizations

Integrated Delivery Systems

Accountable Care Organizations

• Stanford – Palo Alto, CA

• Albany Medical – Albany, NY

• Indiana University – Indianapolis, IN

• KUHA – Kansas City, KS

• UTMB – Galveston, TX

• Dartmouth-Hitchcock – Lebanon, NH

• Health Share of Oregon – Portland, OR

• CEPAmerica – Oakland, CA

• USMM – Troy, MI

• North Memorial – Minneapolis, MN

• Gulfport Memorial – Gulfport, MS

• Thibodaux – Thibodaux, LA

• NorthBay – Fairfield, CA

• John Muir – Walnut Creek, CA

• Gunnison Valley – Gunnison, UT

• Texas Children’s – Houston, TX

• Children’s Hospital Wisconsin – Milwaukee, WI

• MultiCare – Tacoma, WA

• Providence – Portland, OR

• Alberta Health Services – Edmonton, CA

• Memorial Care – Fountain Valley, CA

• Cedars-Sinai – Los Angeles, CA

• Kaiser – Denver, CO

• Unity Point – Des Moines, IA

• Queens Health – Honolulu, HI

• Community Health Network – Indianapolis, IN

• Health Quest – Poughkeepsie, NY

• Hawaii Pacific Health – Honolulu, HI

• UPMC – Pittsburg, PA

• King’s Daughters Medical Center – Ashland, KY

• Piedmont – Atlanta, GA

• Mission – Asheville, NC

• Orlando Health – Orlando, FL

• Cone Health – Greensboro, NC

• Christiana Care – Wilmington, DE

• Westchester – Valhalla, NY

• Allina – Minneapolis, MN

• Partners – Boston, MA

• OSF – Peoria, IL

• Springfield Clinic – Springfield, IL

• Crystal Run – Middletown, NY

• OneCare Vermont – Colchester, VT

• Adirondacks ACO – Pittsburg, NY

• Adirondacks Health Institute – Glens Falls, NY

Health Catalyst Clients:

© 2017 Health Catalyst

Proprietary and Confidential5

Unleashing Data to Achieve Massive Improvements

Organic Improvement

Let innovation happen - Light Effort

Fast Track Improvement

Medium Effort

Comprehensive Outcomes

High Effort

Value Across the spectrum of improvement effort, the value may be light, medium, or high value.

Enablers Highly trained and engaged team members and a robust analytics infrastructure (both platform & applications)

Volume1,000s of day-to-day, better, data-driven

decisions100s of quick win improvements using data

10s of deep changes, eliminating unwarranted

clinical, operational and/or financial variation

Examples

• 2-hour ad-hoc analysis by senior analyst

reveals insight that expanding clinic hours,

versus building an observation wing, will save

$3M in capital expense.

• Automated dashboard saves 4 hours of

manual data collection/reporting per week.

• Data helps clinicians identify high maternal

hypertension rates; insights + interventions

results in 15% improvement in hypertension

rates.

• Dashboard helps identify missing

documentation on high dollar accounts,

improving AR days by 10%.

• Deep process redesign, leveraging

predictive models, reduces sepsis mortality

rate by 15%, saves 125 lives per year, and

reduces costs by $1.6 M.

• Redesigning care management workflow

using mobile technology increases care plan

effectiveness by 28% and saves $3.4 M.

Sample Results

Measures

Technology utilization, number of lives impacted/saved, intervention rates, number/percent improvement, additional revenue, cost savings, cost

avoidance…

Sample

CommunicationsVignettes, improvement snapshots, case study briefs, case studies, webinars, publications…

© 2017 Health Catalyst

Proprietary and Confidential6

Financial Value

Clinical Value

Experience Value

XEffort

High

Light High

Value

Improvement Type

The Improvement Spectrum Matrix – Value and Effort

© 2017 Health Catalyst

Proprietary and Confidential7

Effort

High

Light High

Financial Value

Clinical Value

Experience Value

Improvement Type

Overemphasis on Deep Improvement Projects

© 2017 Health Catalyst

Proprietary and Confidential8

Financial Value

Clinical Value

Experience Value

Effort

High

Light High

Value

Improvement Type

Overemphasis on Light Effort Projects

© 2017 Health Catalyst

Proprietary and Confidential9

Financial Value

Clinical Value

Experience Value

Effort

High

Light High

Value

Improvement Type

Overemphasis on One Value Type

© 2017 Health Catalyst

Proprietary and Confidential10

Financial Value

Clinical Value

Experience Value

Effort

High

Light High

Value

Improvement Type

Overemphasis on One Value Type

© 2017 Health Catalyst

Proprietary and Confidential11

Effort

Financial Value

Clinical Value

Experience Value

High

Light High

Value

Improvement Type

IDEAL: Even Spread Across the Improvement Spectrum Matrix

© 2017 Health Catalyst

Which type of improvements does your organization focus on? 147

respondents

1. Clinical – 20%

2. Financial – 13%

3. Patient Experience – 10%

4. Balanced mix – 58%

Poll Question #1

12

© 2017 Health Catalyst

Which quadrant does your organization tend to gravitate toward? 137

respondents

1. High Effort and High Value – 24%

2. High Effort and Light Value – 9%

3. Light Effort and High Value – 24%

4. Light Effort and Light Value – 6%

5. Balanced approach across both spectrums avoiding high effort,

light value – 37%

Poll Question #2

13

© 2017 Health Catalyst

Proprietary and Confidential14

Analogy Is the Key to Understanding

© 2017 Health Catalyst

Proprietary and Confidential15

Introducing the Game: SPECTRUM

• Adapted by Health Catalyst from the popular strategy game, 7 Wonders.

• Objective of the game: Gain the most improvement points.

• There are multiple ways to earn improvement points .

• 3 years, 7 cards per year.

• Play a card and pass the rest to your neighbor.

© 2017 Health Catalyst

Proprietary and Confidential16

Each Table Represents a Care Delivery SystemEach Player Represents a Department in that System

© 2017 Health Catalyst

Proprietary and Confidential17

• Competition/conflict Between Departments(+ or - Points Calculated at the End of Each Year)

• Budget for Improvement Efforts (1 point / 3 coins)

• Data-Driven Culture (on game board)

• Light Effort Improvements

• Collaboration Between Departments

• System-Wide Adoption

• High Effort Clinical, Financial, and Patient Experience Improvements

Scoring: Improvement Point Categories

Improvement

point symbol

At the end of Year III, once the budget disputes have been resolved, the players total

their improvement points on the scoring sheet in each of the following categories:

© 2017 Health Catalyst

Proprietary and Confidential18

Game Board Layout

Key

© 2017 Health Catalyst

Proprietary and Confidential19

Principles – Spectrum Year 1 – Invest for Success• Invest in Data Infrastructure (The Brown Cards)

– Acquire Data

– Grant Access to Data

– Build Actionable Metrics

– Find Insights in Data

• Invest in People - Train Key Roles and Skills (The Gray Cards)

– Analytics Engineer

– Change Agent

– Key Stakeholder

• Progress on your journey toward a Data-Driven Culture (Game Board)

– From Scorecards to Embedded Analytics

– Data-driven Culture Core Capabilities

© 2017 Health Catalyst

Proprietary and Confidential20

Only 8% of data required

for the population health

and precision medicine

strategy resides in

today’s EMR/EHR.Source: Alberta Innovates Health Solutions, Secondary

Data Use Project, March 2016

http://www.aihealthsolutions.ca/initiatives-

partnerships/secondary-use-data-project/presentations/

Acquire Data . . .

© 2017 Health Catalyst

Proprietary and Confidential21

Just Beginning: Digitization of Health

The Growing Ecosystem of Human Health Data

Healthcare

Encounter

Data

7x24

Biometric

Data

Consumer

Data

Genomic

&

Familial

Data

Social

Data

Outcomes

Data

© 2017 Health Catalyst

Proprietary and Confidential22

Imagine the Richness of the Picture

22

The Growing Ecosystem of Human Health Data

Healthcare

Encounter

Data

7x24

Biometric

Data

Consumer

Data

Genomic

&

Familial

Data

Social

Data

Outcomes

Data

What is your 1, 3, and 5 year strategic data acquisition plan?

© 2017 Health Catalyst

Proprietary and Confidential23

Acquire DataGartner: Health Data Convergence Hub

“Definition: The health data convergence hub is the

orchestration platform that brings together data from across the

consumer/citizen/patient health and wellness continuum and

prepares the data for delivery to downstream consumption

platforms, applications, analytics and "things." It automates the

ingestion of data — both structured and unstructured — from all

identified and permissioned sources; provides tracking and

traceability; and manages identity, compliance and security. It

may process algorithms and deliver the output to the correct

modality.”

- Laura Craft, Vi Shaffer, “Gartner: Hype Cycle for Healthcare Providers, 2017”

© 2017 Health Catalyst

Proprietary and Confidential24

From Data Warehouse to Data Operating System

Traditional Data WarehouseHealth Data Convergence Hub

HC: Data Operating System

1. Collects data from EHR & Claims

2. Enables creating static reports

3. Enables SQL queries

4. Data is updated nightly

5. Not available in the EHR workflow

6. Requires replacing your existing DW

7. Proprietary schemas

8. Deals with tables and columns

1. Collects data from many sources

2. Enables creating static reports and web/mobile apps

3. Enables SQL, R, Python, Deep Learning queries

4. Data is always up-to-date

5. Insights are easily available in the EHR workflow

6. Works with your existing DW (or use our DW)

7. Industry standard schemas e.g., FHIR

8. Deals with tables, columns and clinical entities like

registries, measures

9. Provides centralized security at app and data levels

10. Machine Learning is as easy to use as SQL

11. Content Marketplace to share executable content with

other health systems

© 2017 Health Catalyst

Proprietary and Confidential25

Acquire DataKey Concepts To Accelerate Data Acquisition

Late-binding – don’t early bind complex data and waste valuable time during

data acquisitions by binding raw data into strict definitions, unless there is

persistent and global agreement, rather co-locate data into Source Data Marts or

Data Lakes with minimal transformation, allowing for flexibility in multiple future

use-cases.

Automation Tools – Use tools which automate the tedious and predictable

steps of building data marts. (e.g. Source Connectors, SMD, SAMD)

Leverage Big Data Capabilities – Make sure your data platform can leverage

silicon valley technologies like Hadoop/Spark, Machine Learning, Natural

Language Processing etc.

© 2017 Health Catalyst

Proprietary and Confidential26

Grant Access

One of the most challenging

polarities for organizations to

balance is how to grant

access to data.

© 2017 Health Catalyst

Proprietary and Confidential27

Data Access Polarity: Data Protection AND Data Sharing

Symptoms of Extreme:• Legitimate data request denied.

• IT controls all final signoff for

data access.

• 6 month process to get access.

Symptoms of Extreme:• Data breach.

• Inappropriate data use.

Evidence of Balance:

• Streamlined access

approval process.

• Consistent regular

auditing.

• Appropriate use of

data.

• Data stewards

grant access.

© 2017 Health Catalyst

Proprietary and Confidential28

Grant Access#1 Polarity: Data Sharing AND Data Protection

Key Concepts in Granting Access effectively

Data Steward Ownership - Shift access decision away from IT into

clinical/business owners hands – IT usually overemphasizes data protection.

Trust but Verify – Assume good intent and grant access to data more liberally

but increase your frequency and depth of your auditing capability.

Create Team- or Role-based data access policies – Streamline granting

access to entire teams or role groups to access data for improvement purposes.

When a new individual joins a group or gets a new role, access is automatically

granted.

© 2017 Health Catalyst

Proprietary and Confidential29

Build Actionable Metrics

The most sophisticated and accurate

predictive model is worthless

unless it promotes an action

that would otherwise

not have happened.

© 2017 Health Catalyst

Proprietary and Confidential30

The 5 Rights of Information Delivery

The How:

We believe if you get the

• Right Information, to the

• Right Audience, at the

• Right Granularity, at the

• Right Time, in the

• Right Visualization/Modality

… you produce the Right Action,

to Improve Outcomes

The Why:

© 2017 Health Catalyst

Proprietary and Confidential31

Discover Insight

Data becomes valuable

when an insight is discovered,

such as a trend, pattern, correlation, or

causation.

© 2017 Health Catalyst

Proprietary and Confidential32

Average Before=8 hours delayAverage After=3 hours delay

Is This Result Good?

Adapted from The Health Care Data Guide, p. 16-17

Poor sample size,

looks like

improvement but no

improvement

occurred in reality

Trend occurred

naturally,

Intervention didn’t

cause improvement

Change wasn’t

permanent,

numbers are

slipping

Improvement

happened before

intervention, not

because of

intervention

Outlier caused

process to look like

it needed

improvement

Real

improvement

caused by

intervention

© 2017 Health Catalyst

Proprietary and Confidential33

Why Traditional Scorecards Lack Insight

Metric Region 1 Region 2 Overall Score

Financial Metric XX.X XX.X XX.X

Quality Metric YY.Y YY.Y YY.Y

Experience Metric ZZ.Z ZZ.Z ZZ.Z

Scorecard Shows:

Current Measurement vs.

Target.

Does not show:

Trend, Variation, Noise vs.

Signal, Drill-down detail.

Static Report Shows:

Current Measurement

compared with Historic.

Does not show:

Variation, Noise vs. Signal,

Trend (very well), drill-down

detail.

Metric Last Year Current Year

LY Current Month LY Year To Date Current Month Year to Date

Financial Metric XX.X XX.X XX.X XX.X

Quality Metric YY.Y YY.Y YY.Y YY.Y

Experience Metric ZZ.Z ZZ.Z ZZ.Z ZZ.Z

Scorecard

Static Report

© 2017 Health Catalyst

Proprietary and Confidential34

Insight Trap: Rush to Judgment and Punish the Outliers

Current Condition

• Significant Volume.

• Significant Variation.

Option 1: “Punish the Outliers” or

“Cut Off the Tail”

Strategy

• Set a minimum standard of quality.

• Focus improvement effort on those people not meeting the

minimum standard.

# of

Cases

Mean

Excellent OutcomesPoor Outcomes

# of

Cases

Focus on

Minimum

Standard

Metric

Excellent OutcomesPoor Outcomes

© 2017 Health Catalyst

Proprietary and Confidential35

Leveraging InsightLearning Approach: Focus on Better Process

Option 2: Identify Best Practice

“Narrow the curve and shift it to the right”

Strategy

• Identify evidenced based “Shared Baseline.”

• Focus improvement effort on reducing process variation by

following the “Shared Baseline.”

• Often those performing the best make the greatest improvements.

Excellent Outcomes

# of

Cases

Focus on Best

Practice Care

Process Model

Poor Outcomes

Current Condition

• Significant Volume.

• Significant Variation.

# of

Cases

Mean

Excellent OutcomesPoor Outcomes

© 2017 Health Catalyst

Proprietary and Confidential36

Variation Over Time

Mean

Upper Control Limit

Lower Control Limit

Adapted from R.C. Lloyd & Associates

Current Condition

© 2017 Health Catalyst

Proprietary and Confidential37

Mean

Upper Control Limit

Lower Control Limit

Adapted from R.C. Lloyd & Associates

Variation Over Time

Variation Reduction

© 2017 Health Catalyst

Proprietary and Confidential38

New Mean

Reduce Variation and Improve Outcomes

Intervention

© 2017 Health Catalyst

Proprietary and Confidential39

Using Control Charts to Discover Insights

Adapted from The Health Care Data Guide, p. 116

© 2017 Health Catalyst

Proprietary and Confidential40

Principles – Spectrum Year 1 – Invest for Success• Invest in Data Infrastructure (The Brown Cards)

– Acquire Data

– Grant Access to data

– Build Actionable Metrics

– Find Insights in data

• Invest in People - Train Key Roles and Skills (The Gray Cards)

– Analytics Engineer

– Change Agent

– Key Stakeholder

• Progress on your Journey Toward a Data-Driven Culture (Game Board)

– From Scorecards to Embedded Analytics

– Data-driven Culture Core Capabilities

© 2017 Health Catalyst

Proprietary and Confidential41

“I told you I wasn’t a hunter gather. I’m an analyst!”

28

Train Analytics Engineer

© 2017 Health Catalyst

Proprietary and Confidential42

Once Better Infrastructure Is in Place Analytics Engineers Have More Time to Interpret Data

Non value-add work Value-add work

Understanding the question

Hunting for data

Interpreting dataDistributing data

Gathering, compiling or running

Weak Analytic System Strong Analytic System

Understanding the question

Hunting for data

Interpreting data

Distributing data

Gather, compiling or running

*poll of Analyst customer pre Catalyst Analytics Platform install

75%* of analyst time is spent in hunting & gathering in a weak analytics system

© 2017 Health Catalyst

Proprietary and Confidential43

Core

Create insights

Present insights in a

compelling way

Understanding of

healthcare data

Core Technical

PL/SQL

Data modeling

Visualization &

reporting tools

Needed for the Future

• Stats, predictive, machine learning, AI, etc. • Visualization principles (e.g. Tufte, Few)

• Quality improvement (e.g. Lean, 6 Sigma) • Project management

The Skills Needed in the Analytics Space

© 2017 Health Catalyst

Proprietary and Confidential44

You must have both the technical skill AND the clinical or

operational context (this is usually best achieved by partnering

with a change agent who has deep domain knowledge).

Otherwise, you might jump to the wrong conclusions …

Insights Require Technical Skill AND Context

Higher ice

cream sales

We taste

better

More shark

attacks

- -

Stop selling ice cream!

Warmer weather

Higher ice

cream sales

More shark

attacks

© 2017 Health Catalyst

Proprietary and Confidential45

Recruit Change Agent

"In times of change, learners inherit the

future, while the learned find

themselves beautifully equipped to deal

with a world that no longer exists."

- Eric Hoffer

© 2017 Health Catalyst

Proprietary and Confidential46

Diffusion of InnovationChange Agents Are Typically Early Adopter SMEs

Innovators

earlyadopters

earlymajority

laggards(never adopters)

* Adapted from Rogers, E. Diffusion of Innovations. New York, NY: 1995.

latemajority

Innovators. Recruit

innovators to re-design

care delivery

processes

Th

e C

ha

sm

N = number of individuals in group

N

N = number needed to influence group

(but they must be the right individuals)

Early adopters. Recruit early adopters to

chair improvement and to lead

implementation at each site.

(key individuals who can rally support)

© 2017 Health Catalyst

Proprietary and Confidential47

Select Early Adopters Leaders

• You need both willing and able leaders.

• Identify those wanting to lead permanent improvement efforts –throw their hat in the ring (willingness).

• Allow those not wishing to lead to participate in the selection process (recommend top 3 picks – those with natural leadership = ability ).

• Executive leadership can select from top recommendations the most open minded leaders and give them decision rights.

• Involvement in the selection process leads to much, much better adoption later (“Onboard for the take-off not just the crash-landing.” – Dr. David Burton).

© 2017 Health Catalyst

Proprietary and Confidential48

Change Agent Role: Preparing People for Change

Awareness

Desire

Knowledge

& Ability

Actively

Sustaining

Time

Pro

ductivity &

Perf

orm

ance

High

Low

Keep the chaos period as

short as possible

Minimize the loss of

Productivity & Engagement

Change!

Ensure managers/leaders are informed and preparedto lead their teams through the change – available and active.

Warn people that the process may be uncomfortable, but that they will survive.

Identify champions to represent key player groups in the design and implementation process.

Leadership defines the why the change is needed, sets the vision, then defines the sandbox for those impacted to participate in designing the future.

© 2017 Health Catalyst

Proprietary and Confidential49

Engage Key Stakeholders

“Things get done only if the data we

gather can inform and inspire those in

a position to make a difference.”

–Mike Schmoker

© 2017 Health Catalyst

Proprietary and Confidential50

Four Levels of Stakeholder Information Needs

Stakeholder

Group

Key Data Need Group Role

Executive Prioritization & Visibility Controls resources and funding allocations.

Domain

Leadership

Prioritization & Visibility Understands domain interactions and

tradeoffs (clinical, operational or financial).

Adoption Best Practice Tracking &

Actionable Metrics

Influences others and encourages change

(adoption of new processes).

Innovation Process Design &

Outcomes Prediction

Identifies root cause of poor outcomes and

designs better processes to produce better

outcomes.

© 2017 Health Catalyst

Proprietary and Confidential51

Example Stakeholder Analysis

STAKEHOLDER IMPACT IMPORTANCE MATRIX AREA (see Stakeholder Matrix)

Current HEATProjected

HEATProjected HEAT

Name of functional role/group

affected by the change

Degree of impact on

this stakeholder

Level of

stakeholder's

influence on the

success of the

change

Where do they land on

the stakeholder matrix?Today

After CEO Email

goes out

After the details

of the role changes

are shared

SVPs (SEL) significant medium a. KEY PLAYER productive zone productive zone productive zone

SVPs (IL) significant high a. KEY PLAYER overwhelmed overwhelmed overwhelmed

EL significant medium a. KEY PLAYER underwhelmed productive zone productive zone

STDs significant high a. KEY PLAYER underwhelmed overwhelmed overwhelmed

TDs significant high a. KEY PLAYER underwhelmed productive zone productive zone

SDAs / DAs

(Tech Ops Pool)significant high a. KEY PLAYER underwhelmed underwhelmed overwhelmed

Domain Experts (IL) significant high a. KEY PLAYER underwhelmed overwhelmed overwhelmed

Analytic Dirs (IL) significant a. KEY PLAYER underwhelmed overwhelmed overwhelmed

SDAs / DAs (IL) significant high a. KEY PLAYER underwhelmed underwhelmed overwhelmed

Analysts (Prod Dev) significant a. KEY PLAYER underwhelmed underwhelmed overwhelmed

Leadership Team moderate high a. KEY PLAYER overwhelmed overwhelmed overwhelmed

HR minor or none medium c. keep informed productive zone productive zone productive zone

Finance - FPA moderate medium a. KEY PLAYER underwhelmed productive zone productive zone

Accounting moderate Low c. keep informed underwhelmed productive zone productive zone

Marketing minor or none Low c. keep informed underwhelmed productive zone productive zone

Customers moderate Low d. Keep satisfied productive zone underwhelmed productive zone

Identify Champions

to represent large

groups.

Keep Satisfied

Meet Their Needs

Key Player

Manage Closely

Monitor

Minimum Effort

Keep Informed

Show Consideration

Low High

High

Low

Interest of Stakeholders

Po

we

r / In

flu

en

ce

of

Sta

ke

ho

lde

rs

© 2017 Health Catalyst

Proprietary and Confidential52

Provide Visibility to All StakeholdersShared Accountability Date: 10/1/2015 Overall Status

Risks and Uncertainties

Recruit /Train Kickoff AIM Intervention Rollout plan Results

Aug 2015 Aug 2015 Sep 2015 -- Sep 2015 Oct 2015

Guidance teamMission, charter,

roles confirmed

Review draft

cohort and dataFinalize cohort

Define rollout

plan

Review initial

results

Content and

Analytics Lead

Review AIM

options

Data quality

issues identified

Identify

intervention(s)

Guidance team

validation

Implementation

plan adjusted

Implementation

team

Best practice

gathering

Direct

observation

Direct

observation

Solicit front-line

plan input

Review lessons

learned

Workgroup

team

Profile prelim.

data and cohort

Prioritize, select

AIM

Solicit front line

input

Finalize rollout

plan

Create AIM

statement #2

Workgroup

training

Guidance team

validation

Refine cohort and

metrics

Analytics dev &

test

Guidance team

validationRepeat process

Guidance team

validation

Improvement Initiative Progress

Keynot

startedIn

processdone well

someconcerns

strongconcerns

Accomplishments Next Steps Issues / Help needed

• Feedback sessions with SMEs • Consolidate app versions

• Define rollout plan

• QV access

Long-term

AIM Goal

To realize X% in shared savings in the JCL ACO by the end of 2015. Going forward, achieve and sustain a

X% reduction in the PMPM, a X% reduction in patient leakage, and a X% decrease in out-of-network referrals

by February 2016.

AIM Performance

Goal #1:

Source CMS Claims data into the EDW by September 15th, 2015. Wire up the Shared Accountability application to

claims data, and show incremental value via the ability to determine JCL ACO network leakage as well as PMPM costs,

by October 1st, 2015.

Lau

nc

h/R

oll

ou

t d

ate

: 1

0/1

/20

15

© 2017 Health Catalyst

Proprietary and Confidential53

Principles – Spectrum Year 1 – Invest for Success• Invest in Data Infrastructure (The Brown Cards)

– Acquire Data

– Grant Access to data

– Build Actionable Metrics

– Find Insights in data

• Invest in People - Train Key Roles and Skills (The Gray Cards)

– Analytics Engineer

– Change Agent

– Key Stakeholder

• Progress on your Journey Toward a Data-Driven Culture (Game Board)

– From Scorecards to Embedded Analytics

– Data-driven Culture Core Capabilities

© 2017 Health Catalyst

Proprietary and Confidential54

Developing a Data Driven Culture

“We’ve got to use every piece of data and

piece of information, and hopefully that will

help us be accurate with our player

evaluation. For us, that’s our life blood.”

- Billy Beane, General Manager Oakland A’s

© 2017 Health Catalyst

Proprietary and Confidential55

The Journey Towards a Data-Driven Culture

Spreadsheet

Silos

• Silos or pockets of analysis.

• Conflicting spreadsheet reports and

interpretations of data.

• Battles over data ownership.

• Most time spent on hunting for and

gathering data.

• Focus is on is the data “right.”

Centralized

Reporting

Diabetes

Sepsis

Readmissions

Common, linkable

vocabulary

Financial

Source Marts

Administrative

Source Marts

Departmental

Source Marts

EMR

Source Marts

Patient

Satisfaction

Source Mart

FINANCIAL SOURCES

(e.g. EPSi, Peoplesoft, Lawson)

ADMINISTRATIVE SOURCES

(e.g. API Time Tracking)

EMR SOURCEs

(e.g. Cerner, Allscripts, NextGen)

DEPARTMENTAL SOURCES

(e.g. Apollo)

Pt. SATISFACTION

SOURCES

(e.g. NRC Picker, Press Ganey)

• Centralized single source of truth

established in EDW.

• Significant time spent on

standardizing definitions.

• Data begins to be trusted.

• Report queue begins to build.

• Focus is on requirements for

dashboard applications and

reports.

Data-Driven

Improvement Culture

• Improvement teams use analytics to

accelerate best practice adoption.

• Data drives decisions and actions.

• Focus is on growing and sustaining

outcomes improvement through

elimination of waste and variation

leveraging analytics.

© 2017 Health Catalyst

Proprietary and Confidential56

Analytics Embedded in WorkflowImagine: Facebook as an EHR

From a blog Dale Sanders wrote in 2010

• Patient’s evolving health story at the

center of the record, not the encounter.

• Embedded video and images.

• Text and discrete data.

• Secure messaging.

• Social support from family & friends

• Flexible security, defined by the patient.

They expand our sense of connectedness.

Analytics is embedded…it’s ambient to the experience.

© 2017 Health Catalyst

Proprietary and Confidential57

Analytics Embedded in WorkflowImagine: Amazon as a Clinical Order Entry System

• Drug and device availability

• Pricing

• Home delivery

• Automatic refills

• Patient reported outcomes

From a blog Dale Sanders wrote in 2010

© 2017 Health Catalyst

Proprietary and Confidential58

Kawamoto et al, University of Utah, BMJ, 2005

Physicians are 15x more likely to change their ordering and

treatment protocols if presented with substantiating data at the

point of care vs. presented with the same data in a clinical

process improvement meeting.

© 2017 Health Catalyst

Proprietary and Confidential59

The Journey Towards a Data-Driven Culture

Info

rmation C

ost

Information Benefit

High

Low High

Bubble Size = Count of Information Type

Lower the cost of

building reports through

more automated data

acquisition tools.

Analytics Embedded in

Workflow Software

Predictive Models/

Machine Learning

Dynamic Visualizations

(e.g. Qlik Tableau)

Parameter Based

Reports

Static Reports &

Score Cards

© 2017 Health Catalyst

Proprietary and Confidential60

The Journey Towards a Data-Driven Culture

Analytics Embedded in

Workflow Software

Predictive Models/

Machine Learning

Dynamic Visualizations

(e.g. Qlik Tableau)

Parameter Based

Reports

Static Reports &

Score Cards

Info

rmation C

ost

Information Benefit

High

Low High

Bubble Size = Count of Information Type

Lower the cost of

building more advanced

analytics by leveraging

better design tools and

well trained Analytics

Engineers.

© 2017 Health Catalyst

Proprietary and Confidential61

The Journey Towards a Data-Driven Culture

Info

rmation C

ost

Information Benefit

High

Low High

Bubble Size = Count of Information Type

Replace & consolidate static

reports and score cards with more

advanced analytics over time. Analytics Embedded in

Workflow Software

Predictive Models/

Machine Learning

Dynamic Visualizations

(e.g. Qlik Tableau)

Parameter Based

Reports

Static Reports &

Score Cards

© 2017 Health Catalyst

Proprietary and Confidential62

The Journey Towards a Data-Driven Culture

Info

rmation C

ost

Information Benefit

High

Low High

Bubble Size = Count of Information Type

Dramatically increase analytics

embedded in workflow as they are

15 X more likely to be adopted. Analytics Embedded in

Workflow Software

Predictive Models/

Machine Learning

Dynamic Visualizations

(e.g. Qlik Tableau)

Parameter Based

Reports

Static Reports &

Score Cards

© 2017 Health Catalyst

Proprietary and Confidential63

Capabilities to SCALE Outcomes Improvement

Leadership, Culture, and Governance

Financial Alignment

Where do we focus?

How are we compensated?

What should we

be doing?

How are we doing?

How do we change?

Clinical Outcomes

Cost Outcomes

Experience Outcomes

© 2017 Health Catalyst

Proprietary and Confidential64

Principles – Spectrum Year 1 – Invest for Success• Invest in Data Infrastructure (The Brown Cards)

– Acquire Data

– Grant Access to data

– Build Actionable Metrics

– Find Insights in data

• Invest in People - Train Key Roles and Skills (The Gray Cards)

– Analytics Engineer

– Change Agent

– Key Stakeholder

• Progress on your Journey Toward a Data-Driven Culture (Game Board)

– From Scorecards to Embedded Analytics

– Data-driven Culture Core Capabilities

© 2017 Health Catalyst

Which infrastructure component does your organization struggle with?

154 respondents

1. Acquiring data – 29%

2. Granting access to data – 10%

3. Building actionable metrics – 32%

4. Finding insights in data – 29%

Poll Question #3

65

© 2017 Health Catalyst

Which role is the most scarce in your organization? 154 respondents

1. Analytics engineer – 51%

2. Change agent – 43%

3. Key stakeholder – 6%

Poll Question #4

66

© 2017 Health Catalyst

Which capability/question does your organization struggle with most?

151 respondents

1. Analytics: How are we doing? – 14%

2. Best Practice: What should we be doing? – 7%

3. Adoption: How do we change? – 51%

4. Financial Alignment: How are we compensated? – 10%

5. Governance: Where do we focus? – 18%

Poll Question #5

67

© 2017 Health Catalyst

Proprietary and Confidential68

Principles – Spectrum Year 2 – Leverage the Entire Spectrum• On-Going Opportunity Analysis (What card should I play?)

– Return on Luck

– Build an Opportunity Pipeline (at least 3 X your capacity)

– Evaluate Each Opportunity (Effort, Value, Capability, Capacity, and Willingness)

• Light Effort Improvements (The Blue Cards)

– The Prerequisites of Organic Improvement

– Be Opportunistic – TCH – Chest X-ray Story

• Deep Continuous Improvement (The Green Cards)

– Avoiding the Tower of Babel – Pick ONE Improvement Methodology

– Organize Consistent On-going Interdisciplinary Teams

• No Margin, No Mission (The Coins)

– Involve the Finance Team Early and Establish Baselines for ROI Calculations

– Fund Clinical Outcomes with Financial Results in Other Domains

– Overhead Value Analysis

© 2017 Health Catalyst

Proprietary and Confidential69

On-Going Opportunity Analysis

“Luck is not the key.

How you handle good or bad luck

is what matters.”

- Jim Collins

© 2017 Health Catalyst

Proprietary and Confidential70

Return on Luck – Jim Collins

Return on Luck Keys

• Do both great and mediocre companies encounter the same amount of luck, good and bad? -YES

• What can you do to capitalize on your luck?

• Have you turned your bad-luck events into a big part of what makes your company great?

• Are you squandering your good luck events?

Good Luck• Governor with healthcare background is elected.

• Payer agrees to shared savings upside opportunity.

• Local provider wants to join healthcare system and open an institute.

Bad Luck

• Joint Commission visits at a bad time.

• New regulatory reporting required.

• Major philanthropy contributor stops giving.

• Competitor opens new facility.

• PCP refers out of network.

Common “Luck” Events in Healthcare

© 2017 Health Catalyst

Proprietary and Confidential71

Build a Pipeline of Opportunities

One of the Analytics Engineer’s primary roles is to fill the pipeline of insights

and potential improvement opportunities.

Pipeline should exceed the execution capacity

of the organization.

• Motivates an increase in capacity.

• Teaches the organization to prioritize based on highest value.

• Allows for back-up opportunities to be advanced should a high priority

initiative stall indefinitely.

Do not limit pipeline to high-effort opportunities. Many organic improvements

can occur simply by exposing the opportunity.

© 2017 Health Catalyst

Proprietary and Confidential72

Value

Type

Financial

(Hard $)

Clinical /

OperationalExperience

Light< 1 FTE or

$XXX

Process

Metric

Improved

Save

Clinician or

Patient Time

Medium > 1 < 3 FTE

Patient

Outcome

Improved

Overall

Satisfaction

score

improves

High > 3 FTE Life Saved

Evaluate Each Opportunity

Return on Investment

Effort to Achieve

• Light: < 1 FTE investment

• Medium: > 1 but < 3 FTE

• High: > 3 FTE investment

Value of Opportunity

Capability

• Do we have the skills required? What would it take to gain skills?

• Do we have the equipment/tools required?

Capacity

• Do the stakeholders required to make the change have the time to focus on this improvement? What can we take off their plate?

Willingness

• Is there an acceptance of the need for change? Do we have front-line buy-in?

• How much resistance will be encountered? From whom? (mini stakeholder analysis)

Organizational Readiness

© 2017 Health Catalyst

Proprietary and Confidential73

Readiness Assessment• Quickly asses readiness with on-line surveys. (e.g. use something like survey monkey or

Health Catalyst provides a free on-line Outcomes Improvement Readiness Assessment

at https://oira.healthcatalyst.com .

• As you focus in on specific initiatives spend the time to interview key stakeholders of the

most important improvement initiatives and assess capability, capacity and willingness.

© 2017 Health Catalyst

Proprietary and Confidential74

Principles – Spectrum Year 2 – Leverage the Entire Spectrum• On-Going Opportunity Analysis (What card should I play?)

– Return on Luck

– Build an Opportunity Pipeline (at least 3 X your capacity)

– Evaluate Each Opportunity (Effort, Value, Capability, Capacity, and Willingness)

• Light Effort Improvements (The Blue Cards)

– The Prerequisites of Organic Improvement

– Be Opportunistic – TCH – Chest X-ray Story

• Deep Continuous Improvement (The Green Cards)

– Avoiding the Tower of Babel – Pick ONE Improvement Methodology

– Organize Consistent On-going Interdisciplinary Teams

• No Margin, No Mission (The Coins)

– Involve the Finance Team Early and Establish Baselines for ROI Calculations

– Fund Clinical Outcomes with Financial Results in Other Domains

– Overhead Value Analysis

© 2017 Health Catalyst

Proprietary and Confidential75

Light Effort Organic Improvements

To promote organic improvements organize Analytic Resources in a Hub and Spoke model

Centralized (Hub)

• Analytics Infrastructure.

• Analytic Engineer Training.

– Tool Training.

– Visualization standards.

– Statistical Analysis.

– Machine learning.

• Data Governance.

– Data Steward Training.

– Common Metric definitions.

– Data Quality Standards.

– Standardized Visualization Look & Feel to promote ease of use.

De-centralized (Spoke)

• Responding to departmental

questions using Ad-hoc queries

or analysis.

• Custom dashboard

development.

• Interpretation of data, based on

local context and knowledge.

76

• Access to content

enabled through a

security model

endorsed by senior

leadership.

• Provisioning process

well defined and

operationalized.

Broadly Accessible Data

• Analytic tool

capabilities support

what end users are

trying to do.

• Analytic community

has the ability to share

and distribute content.

Analytic Toolset Alignment

• Teams are provided

education on the core

capabilities to support

their use of the data.

• Support function

available to answer

and direct questions.

Training & Support

• Continuants

understand what is

available, what is

changing, and what is

coming.

• Value being delivered

by the platform is

consistently and

broadly being

messaged.

Communication

• Individual or group is on point to grow analytics capabilities.

• Ensure evolving roadmap aligns with business/clinical priorities.

Analytics Leadership

The Prerequisites of Organic Improvement

© 2017 Health Catalyst

Proprietary and Confidential77

Organic Improvements – Be Opportunistic

Texas Children’s Example

Context

• Working on Asthma Action Plan Initiative.

Discovery

• While exploring the data MD Leader and Analytics

Engineer find anomalies in data around chest x-rays

unrelated to the asthma action plan initiative.

• Appears high percentage of chest x-rays from ED are

unwarranted.

• Analytics Engineer, performs deeper analysis within a

few hours and discovers highly utilized order set used

by Resident MDs in ED.

Intervention

• New default orders set using best practice

intervention criteria for x-ray designed to

replaces old order set.

• Resident MDs in ED instructed to use new

order set for children presenting with asthma.

Result

• Achieved and sustained a 49 % decrease in unnecessary chest x-ray orders.

– Better Care for Patients

– Elimination of Unnecessary Cost

– No Extra X-ray Exposure to Kids

• Value = High

• Effort = Light

© 2017 Health Catalyst

Proprietary and Confidential78

Principles – Spectrum Year 2 – Leverage the Entire Spectrum• On-Going Opportunity Analysis (What card should I play?)

– Return on Luck

– Build an Opportunity Pipeline (at least 3 X your capacity)

– Evaluate Each Opportunity (Effort, Value, Capability, Capacity, and Willingness)

• Light Effort Improvements (The Blue Cards)

– The Prerequisites of Organic Improvement

– Be Opportunistic – TCH – Chest X-ray Story

• Deep Continuous Improvement (The Green Cards)

– Avoiding the Tower of Babel – Pick ONE Improvement Methodology

– Organize Consistent On-going Interdisciplinary Teams

• No Margin, No Mission (The Coins)

– Involve the Finance Team Early and Establish Baselines for ROI Calculations

– Fund Clinical Outcomes with Financial Results in Other Domains

– Overhead Value Analysis

© 2017 Health Catalyst

Proprietary and Confidential79

Rosetta Stone: Translation between different

improvement methodologies.

Key Principle: Pick ONE Methodology and use it

consistently across your organization

Avoiding the Tower of Babel –Pick ONE Improvement Methodology

© 2017 Health Catalyst

Proprietary and Confidential80

1 2 3 4 5 6 7

Analyze the Opportunity

and Define the Problem.

Scope the Opportunity

and Set Goals.

Explore Root Causes and Set Process

Aims.

Design Interventions

and Plan Initial Implementation

Implement Interventions and Measure

Results.

Monitor, Adjust, and Continually

Learn.

Diffuse and Sustain.

Is it an adoption problem?

Are data valid?

Do we need to adjust our interventions?

Do we need to reevaluate root cause?

Start with a directive from executive leadership based on high-level opportunity analysis and readiness assessment

The Seven Essential Elements of Improvement

© 2017 Health Catalyst

Proprietary and Confidential81

Organization of TeamsClinical and Technical

Prioritization

Adoption

Innovation

etc.

Outcomes Improvement

Executive Leadership Team

Content & Analytics Team(s)

Data Governance

CommitteeDomain Guidance Team

Provides domain oversight

and drives priorities

Outcomes

Improvement Team(s)Drives innovation & adoption

Workgroup(s)

as neededWorkgroup(s)

as neededInnovates

Domain 1

Domain 2

© 2017 Health Catalyst

Proprietary and Confidential82

Women & Newborn Guidance Team - Prioritization

Key

Key Stakeholder

Change Agent/SME

Analytics Engineer

Structure Typically Needed for Deep Effort Improvements

• Meet quarterly to prioritize allocation of

technical staff.

• Approves improvement AIMs

• Reviews progress and removes road

blocks.

OB NewbornGYN

Women & Newborn Guidance Leadership Dyad:

1) MD Clinical Program Director 2) Administrative Director

Domain Leadership Dyads:

1) MD Lead & 2) RN Lead.

SME

Data Steward

Analytics

Engineer

Analytics Team covers

entire guidance team.Financial

Analyst

Small Teams - Innovation • Integrates Data from all relevant sources.

• Meet weekly in iteration planning meeting to identify improvement opportunity and insights.

• Build DRAFT processes, metrics, interventions & presents DRAFT work to Broader Teams.

• Grants access of analytic assets to broader team.

Domain Leadership Dyad

+ Analytics Team

OB Workgroup

Broad Teams – Adoption

• Broad RN and MD representation across system.

• Meet monthly to review, adjust and approve DRAFTs.

• Act as change agents to lead rollout of new process and measurement.

Guidance Leadership Dyad.

+ Domain Leadership Dyad.

+ Analytics Team.

+ Clinical representation from across system.

*All resources serve in these improvement roles part time ranging from

5% (MDs) to 50% (Analytics Engineer) of their time.

© 2017 Health Catalyst

Proprietary and Confidential83

Process Aim: By X date increase the number of patients who have

follow-up completed within 7 days from X% to Y%.

Outcome Goal:By X date decrease readmits from 22.1% to 17.7%.

Track follow-up compliance

(hospitalists, advanced practitioner,

cardiology nurse) discharge and

post results weekly.

Develop, educate, and implement

on a discharge scheduling protocol

to facilitate improved appointment

follow-up 7 days per week.

Intervention #1 Intervention #2

Heart Failure Example, Focus on Transitions

© 2017 Health Catalyst

Proprietary and Confidential84

Principles – Spectrum Year 2 – Leverage the Entire Spectrum• On-Going Opportunity Analysis (What card should I play?)

– Return on Luck

– Build an Opportunity Pipeline (at least 3 X your capacity)

– Evaluate Each Opportunity (Effort, Value, Capability, Capacity, and Willingness)

• Light Effort Improvements (The Blue Cards)

– The Prerequisites of Organic Improvement

– Be Opportunistic – TCH – Chest X-ray Story

• Deep Continuous Improvement (The Green Cards)

– Avoiding the Tower of Babel – Pick ONE Improvement Methodology

– Organize Consistent On-going Interdisciplinary Teams

• No Margin, No Mission (The Coins)

– Involve the Finance Team Early and Establish Baselines for ROI Calculations

– Fund Clinical Outcomes with Financial Results in Other Domains

– Overhead Value Analysis

© 2017 Health Catalyst

Proprietary and Confidential85

Funding Improvement Work

“No Margin, No Mission”»Sister Irene Kraus

Founding Chief Executive of the Daughters of Charity National Health System

American Hospital Association Chair

© 2017 Health Catalyst

Proprietary and Confidential86

Funding Improvement WorkInvolve the Finance Team Early in the ProcessWorking with CFO sanctioned financial analyst or other key stakeholders:

Set baseline costs for current process

Calculate improvement value:

- Hard Cost Savings = $ will be removed from the budget next year

- Soft Cost Efficiency Gain = Improvement efficiency will allow for employee to work on higher priority tasks

- Cost Avoidance = Project the value of reversing a trend such as an upward cost trend that becomes flat due to improvement efforts

Negotiate with Payers on shared savings opportunities

© 2017 Health Catalyst

Proprietary and Confidential87

The Right Granularity: Best Practice Compliance

Admits/1000 members

IP days/1000 members

OP visits/1000 members

Procedures/1000 members

ED visits/1000 members

Readmissions/1000 members

UtilizationWho should

get the care?

Cost/case

Cost/procedure

OR minutes

L&D minutes

Other LOSOrder Sets

Clinical

Support

Workflow

Cost per case

Nursing hours by unit

OR minutes

L&D minutes

Cycle times

Cost per ancillary test

Environmental services

What care

should be

included?

How can care

be delivered

efficiently ?

Indications for Intervention

Diagnostic algorithms

Indications for Referral

Triage Criteria

Treatment and Monitoring

Algorithms

Health Maintenance and

Preventive Guidelines

Standardized Follow-up Checklist

Post-acute care order sets

IP (SNF, IRF)

Home health, Hospice

Clinical Ops Procedure Guidelines

Granularity

Substance Selection Clinical Supply Chain

Management

Admission Order Sets Supplementary Order Sets

Pre-Procedure Order Sets

Post-procedure Order Sets

Bedside Care Practice Guidelines

Discharge Checklist

Patient Injury Prevention Protocol

Risk Assessment

Transfer Checklist

Question Examples of Best Practice Standard Possible Measures

Administrative

Support

Workflow

How can

administrative

operations be

performed

efficiently ?

AR Escalation Process

Network Design Process

Recruiting/Onboarding Process

AR Days

% out of network utilization

% Turnover

Team member

satisfaction/engagement

AR Escalation Process

Budgeting Process

Supply Chain Procurement

© 2017 Health Catalyst

Proprietary and Confidential88

Involve Finance Early: Payment Model Considerations

= Negative Impact = Positive or Negative = Positive Impact

Improvement TypeDiscounted

FFS Per Diem

Per Case Bundled Per CaseCondition

Capitation

Full

CapitationCMS Commercial CMS Commercial

Workflow

Diagnostic Variation

Standing Orders

Medication Selection

Triage

Patient Safety

Ambulatory Treatment

and Monitoring

Indications for Referral

Indications for

Intervention

Operational Workflow

Diagnostic Variation

Standing Orders

Substance Selection

Triage Criteria

Patient Safety

Treatment and Monitoring

Algorithms

Indications for Referral

Indications for Intervention

25

Administrative Workflow

Depending on the

type of

improvement,

the financial impact

could be positive

or negative based

on the payment

model mix.

Therefore,

proactively involve

finance and

negotiate shared

savings with payers

up-front when

possible.

© 2017 Health Catalyst

Proprietary and Confidential89

Funding Improvement Work: Balancing Value Mix Helps Fund Clinical & Experience Improvements

High

Light High

Value

IDEAL: Even spread across the Improvement Spectrum Matrix

Effort

Financial Value

Clinical Value

Experience Value

Improvement Type

As your governance team

prioritizes improvement initiative

make sure that the projected

hard $ cost savings can fund

the improvement efforts required

across all value types.

© 2017 Health Catalyst

Proprietary and Confidential90

Funding Improvement Work:Overhead Value Analysis

• Frequently an organization has built up a large

inventory of regularly produced reports (with an

associated cost)

• In addition, many vended technical

point-solutions continue to be maintained over

decades (with an associated maintenance fee)

• Overhead Value Analysis is the “spring

cleaning process” of reviewing the cost to

maintain or produce these analytic assets

compared with the benefit each currently is

providing the organization.

© 2017 Health Catalyst

Proprietary and Confidential91

Principles – Spectrum Year 2 – Leverage the Entire Spectrum• On-Going Opportunity Analysis (What card should I play?)

– Return on Luck

– Build an Opportunity Pipeline (at least 3 X your capacity)

– Evaluate Each Opportunity (Effort, Value, Capability, Capacity, and Willingness)

• Light Effort Improvements (The Blue Cards)

– The Prerequisites of Organic Improvement

– Be Opportunistic – TCH – Chest X-ray Story

• Deep Continuous Improvement (The Green Cards)

– Avoiding the Tower of Babel – Pick ONE Improvement Methodology

– Organize Consistent On-going Interdisciplinary Teams

• No Margin, No Mission (The Coins)

– Involve the Finance Team Early and Establish Baselines for ROI Calculations

– Fund Clinical Outcomes with Financial Results in Other Domains

– Overhead Value Analysis

© 2017 Health Catalyst

How does your organization prioritize opportunities for outcomes

improvement? 122 respondents

1. We can’t say no to anything. – 14%

2. We estimate the value to the organization. – 9%

3. We estimate both effort and value. – 20%

4. We estimate effort, value, and readiness. – 25%

5. It’s all about the politics. – 32%

Poll Question #6

92

© 2017 Health Catalyst

Which of the prerequisites of organic improvement is weakest in your

organization? 121 respondents

1. Broadly accessible data. – 22%

2. Alignment around an analytic toolset. – 18%

3. Analytic training and support. – 25%

4. Communication of analytic value and roadmap. – 31%

5. All of these components are working well. – 4%

Poll Question #7

93

© 2017 Health Catalyst

True or False: My organization has stale analytic reports that are

never used but continue to be produced? 144 respondents

1. True – 73%

2. False – 27%

Poll Question #8

94

© 2017 Health Catalyst

Proprietary and Confidential95

Principles – Spectrum Year 3 – Sustain and Spread• Interdepartmental Collaboration Requires Good Data Governance (The Yellow

Cards)

– Improve Data Quality.

– Train for Data Literacy.

– Promote Appropriate Data Access.

• System-Wide Adoption (The Purple Cards)

– Establishing an Analytic Services Working Group (User Group).

– Marketing your Analytics Like a Small Business (The Improvement Vignette).

– Establish Improvement Governance.

• Avoiding Conflict and Contention (The Red Cards)

– The Worst 10 Practices in Healthcare Analytic Interactions.

– The Productive Zone – Helping Everyone Engage in the Work.

– Improving Interdepartmental Communication (Intent and Impact).

© 2017 Health Catalyst

Proprietary and Confidential96

Interdepartmental Collaboration

“Coming together is a beginning.

Keeping together is progress.

Working together is success.”

-Henry Ford

© 2017 Health Catalyst

Proprietary and Confidential97

Definition of Data Governance

Data governance refers to the plans, processes, and

principles that are proactively applied to ensure that an

organization’s data is managed in such a way to

maximize the value of that data to the organization.

© 2017 Health Catalyst

Proprietary and Confidential98

The Triple Aim of Data Governance

1. Ensuring Data Quality

• Data Quality = Completeness x Accuracy x Timeliness.

2. Building Data Literacy

• Train on analytics basics (Data Awareness).

• Technical tools and analytic techniques (Analytics Team).

• Data content (Context provided by Data Stewards).

3. Maximizing Data Utilization

• Promote cross-department appropriate usage of data. Track # of users

per month by dashboard. Measure direct access.

https://www.healthcatalyst.com/demystifying-healthcare-data-governance

Utilization

© 2017 Health Catalyst

Proprietary and Confidential99

Data Use Defines Data Quality Requirements

Balance the cost of achieving data quality with benefit.

Data Use Category Improvement Comparison or

Accountability

Research

Aim Outcomes Improvement Comparison, Choice,

Spur Change

Discover New

Knowledge

Test observability Test Observable No Test Test Blinded

Sample size Just Enough Obtain 100% Just in case

Flexibility of hypothesis Flexible, Changes as

Learning Takes Place

No Hypothesis Fixed

Is change an

improvement?Run Charts and

Shewart Charts

No Change Focus T-Test, F-Test, p-value

Cost of data quality Low/Medium High Medium/High

Common challenges Tendency to Apply

More Rigor Than

Needed

Data Often Used for

Punishment

Access to Data

Sometimes

Problematic

Adapted from The Health Care Data Guide, p. 27

© 2017 Health Catalyst

Proprietary and Confidential100

Data Literacy - Typical Current State

• Large backlogs of

analytic/report

requests.

• Knowledge workers = clinical

or operational knowledge

AND access to tools and

data.

Knowledge

Workers

Drillers

Viewers

User Distribution

© 2017 Health Catalyst

Proprietary and Confidential101

Authors or

Knowledge

Workers

Viewers

Drillers

Knowledge

Workers

Data Literacy - Desired Future State

Increase number of knowledge workers by

doing the following:

• Expand data access.

• Simplify data structures.

• Continue use of naming standards.

• Provide better tools.

Promote shift in culture by rewarding process

knowledge discovery rather than punishing

outliers.

Desired User Distribution

© 2017 Health Catalyst

Proprietary and Confidential102

Trust but Verify: The Importance of Broad Access AND Auditing Key Polarity: Grant Broad Access to Promote Utilization AND Rigorously Audit Appropriate Use of Data

https://www.idera.com/productssolutions/sqlserver/sqlcompliancemanager

Idera Compliance Manager

Audit tool example:

Idera Compliance Manager

© 2017 Health Catalyst

Proprietary and Confidential103

Principles – Spectrum Year 3 – Sustain and Spread• Interdepartmental Collaboration Requires Good Data Governance (The Yellow

Cards)

– Improve Data Quality.

– Train for Data Literacy.

– Promote Appropriate Data Access.

• System-Wide Adoption (The Purple Cards)

– Establishing an Analytic Services Working Group (User Group).

– Marketing your Analytics Like a Small Business (The Improvement Vignette).

– Establish Improvement Governance.

• Avoiding Conflict and Contention (The Red Cards)

– The Worst 10 Practices in Healthcare Analytic Interactions.

– The Productive Zone – Helping Everyone Engage in the Work.

– Improving Interdepartmental Communication (Intent and Impact).

© 2017 Health Catalyst

Proprietary and Confidential104

Analytical Services Working Group (ASWG) User Group

Purpose of ASWG:

Serve as a forum where analysts from the various

domains within the organization can collaborate to

define standards and share knowledge.

© 2017 Health Catalyst

Proprietary and Confidential105

Analytical Services Working Group (ASWG)

Responsibility Summary

Define information and analytical standards.

• Standardize calculations and definitions.

• Recommend tools and processes.

• Establish data quality standards.

Provide technical and domain cross-training.

Information consumers (analysts) provide feedback to technical staff on tools, information,

performance, processes, etc…

Technical staff (analytics engineer team) provides status updates and notices to analysts on

infrastructure and content.

© 2017 Health Catalyst

Proprietary and Confidential106

System-Wide Adoption

“Run your analytics department

like a small business.”

- Dale Sanders

© 2017 Health Catalyst

Proprietary and Confidential107

Data-Driven Outcomes Improvement & Decision Making

Service

Oriented

Engaged,

High Contributing

Analytics Engineers Satisfied, Empowered

Analytics Customers

Scalable, Sustainable

Products

Employee

Focused

Technically

Sound

Analytic Asset Adoption

Running Your Analytics Department Like a Small Business

© 2017 Health Catalyst

Proprietary and Confidential108

System-wide Adoption: Effective Marketing

Effectively Marketing your Analytics Department requires

Two key elements:

• Educate

– Let the organization know what’s available.

– Help them become more sophisticated users of analytics.

• Share Results

– Success breeds success.

– Publish Improvement Vignettes.

© 2017 Health Catalyst

Proprietary and Confidential109

NO READMITS Bundle Successfully Lowers COPD Readmissions

Chronic Obstructive Pulmonary

Disease (COPD) is responsible for

approximately 135,000 deaths

annually, making it the third

leading cause of death in the U.S.

Nationally, there are

approximately 700,000

hospitalizations with the principal

diagnosis of COPD each year,

with one in five patients being

readmitted within 30 days. The

national average cost for a COPD

readmission is between $9,000

and $12,000.

95% of COPD patients assessed for readmission risk.

17% reduction in readmission rate. Approximately 34 fewer

patients with COPD readmitted each year, saving an

estimated $360,000 annually based on national benchmarks.

9% improvement in PCP notification.

97% of patients with COPD get an order set.

Building from work done by the Heart Failure team, MultiCare's

Medicine Collaborative developed a NOREADMITS bundle

consisting of nine interventions for patients with COPD who are not

mechanically ventilated. The intent of the bundle was to decrease

the likelihood of readmission. After less than nine months, they

achieved the following results:

© 2017 Health Catalyst

Proprietary and Confidential110

[Headline – the One Sentence Grabber]

The Setting:

What is the situation and

context?

The Challenge:

What was the complication?

What problem are we solving?The Result:

What happened?

What was improved?

The Turning Point:

What interventions where used to make a difference?

How were analytics used in solving the problem?

What expertise was needed for the improvement?

Organization Logo

© 2017 Health Catalyst

Proprietary and Confidential111

System-Wide Adoption: Improvement Governance

Stakeholders:Starting at the top, engage all stakeholders around a common vision.

Shared Understanding:Have a common understanding of organizational needs, capabilities, and readiness.

Alignment:Use a consistent improvement methodology, align incentives, and balance polarities.

Focus:Practice disciplined decision-making to prioritize, fund, organize, and sustain initiatives.

Key Objective of Improvement Governance:

Move from a loose federation of hospitals and clinics

that share supply purchasing . . .

. . . to an integrated care delivery system that delivers

consistent high quality, coordinate care everywhere

across the continuum at the lowest appropriate cost.

Governance Quest

HAS 16 Game

© 2017 Health Catalyst

Proprietary and Confidential112

Principles – Spectrum Year 3 – Sustain and Spread• Interdepartmental Collaboration Requires Good Data Governance (The Yellow

Cards)

– Improve Data Quality.

– Train for Data Literacy.

– Promote Appropriate Data Access.

• System-Wide Adoption (The Purple Cards)

– Establishing an Analytic Services Working Group (User Group).

– Marketing your Analytics Like a Small Business (The Improvement Vignette).

– Establish Improvement Governance.

• Avoiding Conflict and Contention (The Red Cards)

– The Worst 10 Practices in Healthcare Analytic Interactions.

– The Productive Zone – Helping Everyone Engage in the Work.

– Improving Interdepartmental Communication (Intent and Impact).

© 2017 Health Catalyst

Proprietary and Confidential113

Avoiding Conflict & Contention: Creating a Pause

“Freedom is the ability to pause between stimulus and response and in the

pause to choose.”

- Viktor Frankl

© 2017 Health Catalyst

Proprietary and Confidential114

The 10 Worst Practices in Healthcare Analytic Interactions

1. Use Data as a Weapon.

2. Misrepresent Data.

3. Prevent Appropriate Data Access.

4. Disengage from the Process.

5. Highlight Data Imperfections / Discredit.

6. Analysis Paralysis.

7. Political Favoritism.

8. Budget Cuts Across the Board.

9. Delay a Decision with Stall Tactics.

10. Stick to the Status Quo.

© 2017 Health Catalyst

Proprietary and Confidential115

Signs Someone Is Outside the Productive Zone

Blame others, distract attention, denial

© 2017 Health Catalyst

Proprietary and Confidential116

Start With Compassion

When you don’t know what to try first,

lower the heat.

• Validate feelings, acknowledge loss.

• Simplify and clarify.

• Address the technical aspects.

• Break the problem into parts.

• Restore, add, or reallocate resources.

• Temporarily reclaim responsibility for tough issues.

• Give your attention.

• Take stock of what is available.

• A lot more time, enrich knowledge and skills.

Nobody misbehaves from a place of strength.

© 2017 Health Catalyst

Proprietary and Confidential117

Avoiding Contention: Understand Intent & Impact

“I know that you believe you

understood what you think I said, but I

am not sure you realize that what you

heard is not what I meant.”

- Robert McCloskey

© 2017 Health Catalyst

Proprietary and Confidential118

Other’s impact on me

My intention Intention of other

My impact

Harvard Negotiation Project

Mine Other’s

Intention

Impact

© 2017 Health Catalyst

Proprietary and Confidential119

Mine Other’s

Intention

Impact

Harvard Negotiation Project

© 2017 Health Catalyst

Proprietary and Confidential120

Our assumptions about intentionsare often wrong.

Good intentionsdo not make bad

impact unimportantor irrelevant.

Harvard Negotiation Project

Mine Other’s

Intention

Impact

© 2017 Health Catalyst

Proprietary and Confidential121

Other’s

This is what I meant.

This is how it felt/seemed to me.

Is that what you meant?

How did it feel/land with you?

Harvard Negotiation Project

Mine

Intention

Impact

© 2017 Health Catalyst

Proprietary and Confidential122

Principles – Spectrum Year 3 – Sustain and Spread• Interdepartmental Collaboration Requires Good Data Governance (The Yellow

Cards)

– Improve Data Quality.

– Train for Data Literacy.

– Promote Appropriate Data Access.

• System-Wide Adoption (The Purple Cards)

– Establishing an Analytic Services Working Group (User Group).

– Marketing your Analytics Like a Small Business (The Improvement Vignette).

– Establish Improvement Governance.

• Avoiding Conflict and Contention (The Red Cards)

– The Worst 10 Practices in Healthcare Analytic Interactions.

– The Productive Zone – Helping Everyone Engage in the Work.

– Improving Interdepartmental Communication (Intent and Impact).

© 2017 Health Catalyst

Within the triple aim of data governance, our organization struggles

most with? 113 respondents

1. Data Quality. – 25%

2. Data Literacy. – 31%

3. Data Utilization. – 41%

4. We’re great at all three of these. – 3%

Poll Question #9

123

© 2017 Health Catalyst

Which of these 5 practices have you seen at your organization?

(select all that apply) 109 respondents

1. Use Data as a Weapon. – 32%

2. Misrepresent Data. – 41%

3. Prevent Appropriate Data Access. – 39%

4. Disengage from the Process. – 54%

5. Highlight Data Imperfections / Discredit. – 55%

Poll Question #10

124

© 2017 Health Catalyst

Proprietary and Confidential125

Spectrum - Key Takeaways and Lessons Learned

Set your organization up for success

• Invest in Infrastructure (Acquire Data, Grant Access, Build Actionable Metrics and Discover Insights).

• Train Key Roles and Skills (Train Analytics Engineers, Recruit Change Agents and Engage Key Stakeholders).

• Create a Data-Driven Culture (Embed Analytics in Workflow, Invest in 5 Core Capabilities for improvement 1) Leadership,

Governance & Culture, 2) Analytics, 3) Best Practice, 4) Adoption and 5) Financial Alignment).

Unleash data across the Spectrum of Improvement

• Perform On-going Opportunity Analysis – Asses Value, Effort, Capabilities, Capacity and Willingness.

• Enable Light Effort Improvements – Prerequisites 1) Grant Broad Access, 2) Analytic Toolset Alignment, 3) Training and Support,

4) Communication and 5) Analytic Leadership; Be Opportunistic – improve your Return on Luck.

• Invest in Deep Effort, High-Value Improvement - Pick ONE Improvement Methodology, and Organize consistent on-going

interdisciplinary teams.

• Understand No Margin, No Mission – Involve the Finance time early, Fund clinical outcomes with financial results in other

domains, and use Overhead Value Analysis to eliminate less value reports and point solutions.

Sustaining and Spreading Improvement

• Collaborate with information & resources – Establish Data Governance – increase Data Quality, Data Literacy and Data Access.

• Promote system-wide adoption – Create an Analytic Services Working Group to promote standards & knowledge sharing, Market

you Analytics like a small business and establish improvement governance.

• Reduce wasteful contention – Avoid worst practices such as using data as a weapon, help everyone engage in the work by staying

in the ”Productive Zone, and improving communication by understanding intent and impact.

© 2017 Health Catalyst

Proprietary and Confidential126

A

Questions &Answers

© 2017 Health Catalyst

Proprietary and Confidential127

Thank You