Chief Analytics Officer Fall USA 2017 - Oleg Pianykh - Massachussets General Hospital
-
Upload
corinium-coriniumglobal -
Category
Data & Analytics
-
view
67 -
download
2
Transcript of Chief Analytics Officer Fall USA 2017 - Oleg Pianykh - Massachussets General Hospital
![Page 1: Chief Analytics Officer Fall USA 2017 - Oleg Pianykh - Massachussets General Hospital](https://reader034.fdocuments.net/reader034/viewer/2022051521/5a6542987f8b9a5b558b5c3f/html5/thumbnails/1.jpg)
Predictive analytics for patient wait-time management, and on-time clinical
workflow
Oleg S. Pianykh, PhD
Medical Analytics Group Department of Radiology, Massachusetts General Hospital
Harvard Medical School
Chief Analytics Officer October 2017, Boston
![Page 2: Chief Analytics Officer Fall USA 2017 - Oleg Pianykh - Massachussets General Hospital](https://reader034.fdocuments.net/reader034/viewer/2022051521/5a6542987f8b9a5b558b5c3f/html5/thumbnails/2.jpg)
Outline
• Assessing the importance of patient wait-time management and predictability.
• Creating wait-time models.
• Lessons learned in predicting wait-time and impact on hospital efficiency. Queuing bottlenecks.
• Implementation challenges: culture changes, best interventions, and organic growth of data-driven solutions.
Oleg Pianykh [email protected] https://www.chiefanalyticsofficerforum.com/seminar/keynote-presentation-harnessing-analytics-personalisation-precision-health-applications/
![Page 4: Chief Analytics Officer Fall USA 2017 - Oleg Pianykh - Massachussets General Hospital](https://reader034.fdocuments.net/reader034/viewer/2022051521/5a6542987f8b9a5b558b5c3f/html5/thumbnails/4.jpg)
Big Data in healthcare: Hype and reality
0
200
400
600
800
1000
1200
1400
1980 1985 1990 1995 2000 2005 2010 2015
Pu
bM
ed p
ub
licat
ion
co
un
t
Year
PubMed publications with "Big Data"
Big Data on paper: exponential growth (wow!)
Big Data in reality: “business as usual”
Oleg Pianykh [email protected]
![Page 6: Chief Analytics Officer Fall USA 2017 - Oleg Pianykh - Massachussets General Hospital](https://reader034.fdocuments.net/reader034/viewer/2022051521/5a6542987f8b9a5b558b5c3f/html5/thumbnails/6.jpg)
Important timelines to predict in healthcare
• Length of stay
• Discharge time
• Patient wait
• Survival time, clinical prognosis
• Recurrence time (cancer etc.) and probability
… and many more
Oleg Pianykh [email protected]
![Page 7: Chief Analytics Officer Fall USA 2017 - Oleg Pianykh - Massachussets General Hospital](https://reader034.fdocuments.net/reader034/viewer/2022051521/5a6542987f8b9a5b558b5c3f/html5/thumbnails/7.jpg)
Benefits of predictability
• One can run hospital operations much better knowing what to expect. Resources can be allocated more appropriately and ahead of time, expected bottlenecks can be avoided or dealt with more efficiently.
• All workflow participants (patients, staff, management) are less stressed and more satisfied when events are predictable and everything goes “as planned”
• Workflow predictability, in essence, is synonymous to successful workflow management. You cannot manage unpredictable.
Oleg Pianykh [email protected]
![Page 8: Chief Analytics Officer Fall USA 2017 - Oleg Pianykh - Massachussets General Hospital](https://reader034.fdocuments.net/reader034/viewer/2022051521/5a6542987f8b9a5b558b5c3f/html5/thumbnails/8.jpg)
Problem: Patient wait time
• Patient wait time was shown to be the #1 satisfaction factor for patient experience in a hospital.
Oleg Pianykh [email protected] http://www.hhnmag.com/articles/6417-the-push-is-on-to-eliminate-hospital-wait-times
![Page 9: Chief Analytics Officer Fall USA 2017 - Oleg Pianykh - Massachussets General Hospital](https://reader034.fdocuments.net/reader034/viewer/2022051521/5a6542987f8b9a5b558b5c3f/html5/thumbnails/9.jpg)
Problem: Patient wait time
Oleg Pianykh [email protected]
Wait time W Exam length EL
Time on the floor F
![Page 10: Chief Analytics Officer Fall USA 2017 - Oleg Pianykh - Massachussets General Hospital](https://reader034.fdocuments.net/reader034/viewer/2022051521/5a6542987f8b9a5b558b5c3f/html5/thumbnails/10.jpg)
Mining wait time data
• Q: How do we find patient wait time ?
Oleg Pianykh [email protected]
W = Tb - Ta
Patient Accession Arrival Ta Begin Tb Complete Resource Exam Tech
123456 E33445 2016-08-15 14:23:45
2016-08-15 15:03:09
2016-08-15 15:19:45
MR1 MRKNEE John Smith
… … … … … … … …
![Page 11: Chief Analytics Officer Fall USA 2017 - Oleg Pianykh - Massachussets General Hospital](https://reader034.fdocuments.net/reader034/viewer/2022051521/5a6542987f8b9a5b558b5c3f/html5/thumbnails/11.jpg)
Patient wait line size
• Q: How do we find the number of patients waiting for exams at any given time T ?
Oleg Pianykh [email protected]
Number L of patients such that Ta < T < Tb
![Page 12: Chief Analytics Officer Fall USA 2017 - Oleg Pianykh - Massachussets General Hospital](https://reader034.fdocuments.net/reader034/viewer/2022051521/5a6542987f8b9a5b558b5c3f/html5/thumbnails/12.jpg)
Patient Wait Time: Changing patterns
Oleg Pianykh [email protected]
Afternoon drop, Th & Fr
Lunch drop
Worst hour 10:30-11:30 AM
Number of patients waiting in line: average (black) and
worst (blue) cases
![Page 13: Chief Analytics Officer Fall USA 2017 - Oleg Pianykh - Massachussets General Hospital](https://reader034.fdocuments.net/reader034/viewer/2022051521/5a6542987f8b9a5b558b5c3f/html5/thumbnails/13.jpg)
“The doctor will be with you momentarily”…
Oleg Pianykh [email protected]
Patients waiting for different exam types
![Page 14: Chief Analytics Officer Fall USA 2017 - Oleg Pianykh - Massachussets General Hospital](https://reader034.fdocuments.net/reader034/viewer/2022051521/5a6542987f8b9a5b558b5c3f/html5/thumbnails/14.jpg)
• Facing the reality: noise/randomness, temporal trends, different patterns in W values…
• It is obvious that static prediction (“10 minutes on average”) won’t work
Oleg Pianykh [email protected] 0
5
10
15
20
25
30
35
40
1 51 101 151 201 251 301 351 401 451 501
Wai
t ti
me
W, m
inu
tes
D
B
C A
Patient timeline
Wait times for the first 500 X-ray patients
“The doctor will be with you momentarily”…
![Page 16: Chief Analytics Officer Fall USA 2017 - Oleg Pianykh - Massachussets General Hospital](https://reader034.fdocuments.net/reader034/viewer/2022051521/5a6542987f8b9a5b558b5c3f/html5/thumbnails/16.jpg)
Main goal: let’s develop a practical solution
• Scenario: • A new patient walks into a waiting room. The most frequently question
he/she will ask when checking in would be “How long will it take?”. Can we answer it intelligently?
• Most frequent (and the most misleading) answer: “The doctor will be with you momentarily”. Then, after some 47 minutes of waiting...
• We know that the wait for the patient arriving at T=Ta time can be found as W=Tb-Ta. We can also use BD to find some other information about the patients, exams, waiting lines. Can this help?
Oleg Pianykh [email protected]
![Page 17: Chief Analytics Officer Fall USA 2017 - Oleg Pianykh - Massachussets General Hospital](https://reader034.fdocuments.net/reader034/viewer/2022051521/5a6542987f8b9a5b558b5c3f/html5/thumbnails/17.jpg)
How would you predict patient wait?
• Q: What predictors would you use? • How many?
• Which ones are the best?
• Q: What model would you prefer?
Oleg Pianykh [email protected]
Features = ?
Model = ?
![Page 18: Chief Analytics Officer Fall USA 2017 - Oleg Pianykh - Massachussets General Hospital](https://reader034.fdocuments.net/reader034/viewer/2022051521/5a6542987f8b9a5b558b5c3f/html5/thumbnails/18.jpg)
Predicting with basic linear models
• Predictors: anything we can get from our HIS! p1, p2, p3, p4, p5, …
• Model: Linear regression W = c0 + c1p1 + c2p2 +c3p3 +c4p4 + c5p5 + … = [I P] × C
(where I is a vector of 1, “intercept”)
• Optimal/important predictors – let the model decide!
Oleg Pianykh [email protected]
![Page 19: Chief Analytics Officer Fall USA 2017 - Oleg Pianykh - Massachussets General Hospital](https://reader034.fdocuments.net/reader034/viewer/2022051521/5a6542987f8b9a5b558b5c3f/html5/thumbnails/19.jpg)
“State of the Art”: very simple predictions
1. p1 = “previous patient wait time”, c0 = 0, c1= 1, c2 = 0, then
- “waiting the same as the previous patient”
2. p1 , p2 = “previous patient wait time”, c0 = 3 (time to fill patient form), c1 = c2 = 1/2, then
- “filling the form, then waiting the same as the average of the previous two patients”
Oleg Pianykh [email protected]
W = c0 + c1p1 + c2p2 + … = p1
W = c0 + c1p1 + c2p2 + … = 3 + (p1+p2)/2
Can we do better than this?
![Page 21: Chief Analytics Officer Fall USA 2017 - Oleg Pianykh - Massachussets General Hospital](https://reader034.fdocuments.net/reader034/viewer/2022051521/5a6542987f8b9a5b558b5c3f/html5/thumbnails/21.jpg)
Let the model decide!
Oleg Pianykh [email protected]
Prediction error
Predictor count (model size) Highest
impact Highest accuracy
Small models – great for understanding Large models – might provide better accuracy
![Page 22: Chief Analytics Officer Fall USA 2017 - Oleg Pianykh - Massachussets General Hospital](https://reader034.fdocuments.net/reader034/viewer/2022051521/5a6542987f8b9a5b558b5c3f/html5/thumbnails/22.jpg)
Let the model decide!
Oleg Pianykh [email protected]
Small model size: understanding
Best model: W = c0 + c1L1 + c2L2 +c3L3, where L1 , L2 and L3 are the line sizes – number of patients waiting now, 5 minutes ago, and 10 minutes ago
Use stepwise regression to reduce model size
![Page 23: Chief Analytics Officer Fall USA 2017 - Oleg Pianykh - Massachussets General Hospital](https://reader034.fdocuments.net/reader034/viewer/2022051521/5a6542987f8b9a5b558b5c3f/html5/thumbnails/23.jpg)
Predicting patient wait time
• Not bad for a simple model:
Oleg Pianykh [email protected]
No filtering!
![Page 27: Chief Analytics Officer Fall USA 2017 - Oleg Pianykh - Massachussets General Hospital](https://reader034.fdocuments.net/reader034/viewer/2022051521/5a6542987f8b9a5b558b5c3f/html5/thumbnails/27.jpg)
ML in predicting patient wait
• More complex model:
Oleg Pianykh [email protected]
No filtering!
Real wait
Predicted wait Patient timeline
Del
ay t
ime
![Page 28: Chief Analytics Officer Fall USA 2017 - Oleg Pianykh - Massachussets General Hospital](https://reader034.fdocuments.net/reader034/viewer/2022051521/5a6542987f8b9a5b558b5c3f/html5/thumbnails/28.jpg)
Patient wait time: Action
• Patient wait time displays in waiting rooms
• Patient satisfaction
• Staff paying more attention to workflow
88% of patients: “We love those displays, you should have them in all hospital rooms”
![Page 30: Chief Analytics Officer Fall USA 2017 - Oleg Pianykh - Massachussets General Hospital](https://reader034.fdocuments.net/reader034/viewer/2022051521/5a6542987f8b9a5b558b5c3f/html5/thumbnails/30.jpg)
Principal lessons learned
• Own your data
• Stay engaged
• Value negative feedback
• Look for impact
Oleg Pianykh [email protected]
![Page 31: Chief Analytics Officer Fall USA 2017 - Oleg Pianykh - Massachussets General Hospital](https://reader034.fdocuments.net/reader034/viewer/2022051521/5a6542987f8b9a5b558b5c3f/html5/thumbnails/31.jpg)
Data is everything
10-min bins
5-min bins
1-min bins
What’s going on??
Oleg Pianykh [email protected]
![Page 33: Chief Analytics Officer Fall USA 2017 - Oleg Pianykh - Massachussets General Hospital](https://reader034.fdocuments.net/reader034/viewer/2022051521/5a6542987f8b9a5b558b5c3f/html5/thumbnails/33.jpg)
Randomness
STD = 0.27×Average Longer scans are harder
to schedule !
If anything can go wrong it will
Oleg Pianykh [email protected]
![Page 34: Chief Analytics Officer Fall USA 2017 - Oleg Pianykh - Massachussets General Hospital](https://reader034.fdocuments.net/reader034/viewer/2022051521/5a6542987f8b9a5b558b5c3f/html5/thumbnails/34.jpg)
Uneven workload
Exams completed, hourly pattern
Oleg Pianykh [email protected]
What operational decisions can you make based on this chart?
![Page 38: Chief Analytics Officer Fall USA 2017 - Oleg Pianykh - Massachussets General Hospital](https://reader034.fdocuments.net/reader034/viewer/2022051521/5a6542987f8b9a5b558b5c3f/html5/thumbnails/38.jpg)
0
5
10
15
20
25
30
6 8 10 12 14 16 18 20 22 24
Scheduled to First Image, minutes
ScheduledToFirstImageTime
Scheduling discipline • Let’s visualize time from the scheduled exam start (when we want it
to start) to the first scanned image: d = Ti-Ts
Oleg Pianykh [email protected]
We start late
It gets only worse We run
completely behind
![Page 39: Chief Analytics Officer Fall USA 2017 - Oleg Pianykh - Massachussets General Hospital](https://reader034.fdocuments.net/reader034/viewer/2022051521/5a6542987f8b9a5b558b5c3f/html5/thumbnails/39.jpg)
-10
-5
0
5
10
15
20
25
30
6 8 10 12 14 16 18 20 22 24
Scheduled to First Image, minutes
ScheduledToFirstImageTime ScheduledToFirstImageTime_14
Scheduling discipline: Starting the first exam on time
• Trying to start on time:
Oleg Pianykh [email protected]
We start on time
We start late
![Page 40: Chief Analytics Officer Fall USA 2017 - Oleg Pianykh - Massachussets General Hospital](https://reader034.fdocuments.net/reader034/viewer/2022051521/5a6542987f8b9a5b558b5c3f/html5/thumbnails/40.jpg)
Using the right metrics: Old approach
M: “Average MRI scan should take 45 minutes”
D: “Currently, it takes 50 minutes”
C: “Shorten MRI protocols by 10%”
Metrics Data Compliance
![Page 41: Chief Analytics Officer Fall USA 2017 - Oleg Pianykh - Massachussets General Hospital](https://reader034.fdocuments.net/reader034/viewer/2022051521/5a6542987f8b9a5b558b5c3f/html5/thumbnails/41.jpg)
Using the right metrics: New approach:
P: “Patients have to wait 3 weeks for MRI scans”
Da: “Poor scheduling and lack of resources”
S: “Improve scheduling, optimize resources”
Problem Data analysis Solution
metrics (distance to success)
![Page 42: Chief Analytics Officer Fall USA 2017 - Oleg Pianykh - Massachussets General Hospital](https://reader034.fdocuments.net/reader034/viewer/2022051521/5a6542987f8b9a5b558b5c3f/html5/thumbnails/42.jpg)
Putting Big Data to work
Action
Big Data
Patterns
Logic
Oleg Pianykh [email protected]
Iterate until proven success!
![Page 43: Chief Analytics Officer Fall USA 2017 - Oleg Pianykh - Massachussets General Hospital](https://reader034.fdocuments.net/reader034/viewer/2022051521/5a6542987f8b9a5b558b5c3f/html5/thumbnails/43.jpg)
Conclusions
• Patterns are everything
• You have to identify the underlying logic which creates certain patterns
• You have to convert this logic into actions to improve your system
• You can use data to verify the success of your actions
Oleg Pianykh [email protected]
Action
Data
Patterns
Logic
![Page 45: Chief Analytics Officer Fall USA 2017 - Oleg Pianykh - Massachussets General Hospital](https://reader034.fdocuments.net/reader034/viewer/2022051521/5a6542987f8b9a5b558b5c3f/html5/thumbnails/45.jpg)
Oleg Pianykh [email protected]
![Page 47: Chief Analytics Officer Fall USA 2017 - Oleg Pianykh - Massachussets General Hospital](https://reader034.fdocuments.net/reader034/viewer/2022051521/5a6542987f8b9a5b558b5c3f/html5/thumbnails/47.jpg)
Big Data in Healthcare applications
• We all are getting extremely used to the “Big Data” buzzwords. But what does it mean, practically?
• Larger data volume?
• Better data?
• More diverse data?
• … ?
Oleg Pianykh [email protected]
![Page 50: Chief Analytics Officer Fall USA 2017 - Oleg Pianykh - Massachussets General Hospital](https://reader034.fdocuments.net/reader034/viewer/2022051521/5a6542987f8b9a5b558b5c3f/html5/thumbnails/50.jpg)
Exam Duration Time
• Pattern: Unusually frequent exam durations
• Logic: Invalid input (rounding time to multiples of 5 or 10). Can we confirm this?
• Action: What can we do?
Oleg Pianykh [email protected]
1-min bins
![Page 51: Chief Analytics Officer Fall USA 2017 - Oleg Pianykh - Massachussets General Hospital](https://reader034.fdocuments.net/reader034/viewer/2022051521/5a6542987f8b9a5b558b5c3f/html5/thumbnails/51.jpg)
Data validity analysis: Action
Oleg Pianykh [email protected]
0
0.1
0.2
0.3
0.4
0.5
0.6
0.7
0.8
1 3 5 7 9 11 13 15 17 19 21 23 25 27 29 31 33 35 37 39 41 43 45 47 49 51 53 55 57 59 61 63 65 67 69 71 73 75 77 79 81 83
Bia
s R
atio
Tech Bias Ratio in CT and MRI
MRI CT
Honest
Zero-bias
Tempted
Champs
![Page 53: Chief Analytics Officer Fall USA 2017 - Oleg Pianykh - Massachussets General Hospital](https://reader034.fdocuments.net/reader034/viewer/2022051521/5a6542987f8b9a5b558b5c3f/html5/thumbnails/53.jpg)
Predicting healthcare
• Q: Can we use BD to predict the future? How? Examples: Stock market predictions, finance, weather forecasting etc. heavily rely on dynamic predictive models. How about healthcare?
• Q: Why and what would one like to predict in healthcare?
Oleg Pianykh [email protected]
![Page 54: Chief Analytics Officer Fall USA 2017 - Oleg Pianykh - Massachussets General Hospital](https://reader034.fdocuments.net/reader034/viewer/2022051521/5a6542987f8b9a5b558b5c3f/html5/thumbnails/54.jpg)
Example: Google Flu project
• Predicting flu outbreaks in real time from… search engine data:
Oleg Pianykh [email protected] Source: Detecting influenza epidemics using search engine query data Jeremy Ginsberg1, Matthew H. Mohebbi1, Rajan S. Patel1, Lynnette Brammer2, Mark S. Smolinski1 & Larry Brilliant1
Google-predicted
Real
ILI – “Influenza-like illness”