High Reliability Organizationssummit.carnegiefoundation.org/session_materials/C4. High...Begin to...

34
High Reliability Organizations Alicia Grunow Improvement Collective Senior Fellow, Carnegie Foundation Louis Gomez UCLA Senior Fellow, Carnegie Foundation Uma Kotagal Population and Community Health Senior Fellow, Cincinnati Children’s

Transcript of High Reliability Organizationssummit.carnegiefoundation.org/session_materials/C4. High...Begin to...

Page 1: High Reliability Organizationssummit.carnegiefoundation.org/session_materials/C4. High...Begin to imagine high reliability organizations in education AGENDA PART 1: Reliability 101

High Reliability Organizations

Alicia Grunow Improvement Collective

Senior Fellow, Carnegie Foundation

Louis Gomez UCLA

Senior Fellow, Carnegie Foundation

Uma Kotagal Population and Community Health Senior Fellow, Cincinnati Children’s

Page 2: High Reliability Organizationssummit.carnegiefoundation.org/session_materials/C4. High...Begin to imagine high reliability organizations in education AGENDA PART 1: Reliability 101

Defining Systems Reliability

Failure free operation over time

DEFINING SYSTEMS RELIABILITY

2

Page 3: High Reliability Organizationssummit.carnegiefoundation.org/session_materials/C4. High...Begin to imagine high reliability organizations in education AGENDA PART 1: Reliability 101

_________

_________

_________

_________

_________

_________

_________

_________

Enrollment in Early Education

?

?

?

? ? ?

? ?

Rank order the pictures from least reliable = 8 to most reliable = 1

3

Page 4: High Reliability Organizationssummit.carnegiefoundation.org/session_materials/C4. High...Begin to imagine high reliability organizations in education AGENDA PART 1: Reliability 101

_________

_________

_________

_________

_________

_________

_________

_________

Enrollment in Early Education

1

2

3

4 5 6

7 8

4

Page 5: High Reliability Organizationssummit.carnegiefoundation.org/session_materials/C4. High...Begin to imagine high reliability organizations in education AGENDA PART 1: Reliability 101

Defining Systems Reliability

How did we get interested in reliability?

5

Page 6: High Reliability Organizationssummit.carnegiefoundation.org/session_materials/C4. High...Begin to imagine high reliability organizations in education AGENDA PART 1: Reliability 101

Ms. Grunow 1st grade, Transitional Bilingual

1999-2000 6

Page 7: High Reliability Organizationssummit.carnegiefoundation.org/session_materials/C4. High...Begin to imagine high reliability organizations in education AGENDA PART 1: Reliability 101

Only English (2)

Only Spanish (4)

Both Spanish and English

(7)

Neither (11)

ON GRADE LEVEL READING 2005-2006

7

Page 8: High Reliability Organizationssummit.carnegiefoundation.org/session_materials/C4. High...Begin to imagine high reliability organizations in education AGENDA PART 1: Reliability 101

Only English (2)

Only Spanish (4)

Both Spanish and English

(7)

Neither (11)

ON GRADE LEVEL READING 2005-2006

8

Page 9: High Reliability Organizationssummit.carnegiefoundation.org/session_materials/C4. High...Begin to imagine high reliability organizations in education AGENDA PART 1: Reliability 101

Fixated General Strategies

Focus matters to Address Disparity

9

Page 10: High Reliability Organizationssummit.carnegiefoundation.org/session_materials/C4. High...Begin to imagine high reliability organizations in education AGENDA PART 1: Reliability 101

A Journey Towards Zero Harm

10

Page 11: High Reliability Organizationssummit.carnegiefoundation.org/session_materials/C4. High...Begin to imagine high reliability organizations in education AGENDA PART 1: Reliability 101

For the next hour…..

OBJECTIVES

Understand the concept of “reliability” and the specific actions you can take to pursue reliability

Understand how high reliability organizations operate

Begin to imagine high reliability organizations in education

AGENDA

PART 1: Reliability 101

Activity

PART 2: The journey to reliability

Facilitated conversation

Q&A

11

Page 12: High Reliability Organizationssummit.carnegiefoundation.org/session_materials/C4. High...Begin to imagine high reliability organizations in education AGENDA PART 1: Reliability 101

Outcome ZERO

FAILURES

HIGH RELIABILITY

“Unnecessary harm” 2nd grader that is not a

“thriving reader”

12

Page 13: High Reliability Organizationssummit.carnegiefoundation.org/session_materials/C4. High...Begin to imagine high reliability organizations in education AGENDA PART 1: Reliability 101

Outcome ZERO

FAILURES

ESSENTIAL QUESTION:

How do you organize to move in this direction?

HIGH RELIABILITY

13

Page 14: High Reliability Organizationssummit.carnegiefoundation.org/session_materials/C4. High...Begin to imagine high reliability organizations in education AGENDA PART 1: Reliability 101

PROCESS B

PROCESS

PROCESS

PROCESS A

PROCESS C

PROCESS

PROCESS

PROCESS

PROCESS

PROCESS

PROCESS

PROCESS

Outcome ZERO

FAILURES

“Every system is designed to get exactly the results that it

gets”

14

Page 15: High Reliability Organizationssummit.carnegiefoundation.org/session_materials/C4. High...Begin to imagine high reliability organizations in education AGENDA PART 1: Reliability 101

PROCESS B

PROCESS

PROCESS

PROCESS A

PROCESS C

PROCESS

PROCESS

PROCESS

PROCESS

PROCESS

PROCESS

PROCESS

Outcome ZERO

FAILURES

15

Page 16: High Reliability Organizationssummit.carnegiefoundation.org/session_materials/C4. High...Begin to imagine high reliability organizations in education AGENDA PART 1: Reliability 101

PROCESS B

PROCESS

PROCESS

PROCESS A

PROCESS C

PROCESS

Outcome ZERO

FAILURES

16

Page 17: High Reliability Organizationssummit.carnegiefoundation.org/session_materials/C4. High...Begin to imagine high reliability organizations in education AGENDA PART 1: Reliability 101

Moving Towards Reliability

(1) Identify the key processes that impact your outcome

(2) Measure the reliability of each of those processes

(3) (Re)design the processes to make each process (and their combination) more reliable

17

Page 18: High Reliability Organizationssummit.carnegiefoundation.org/session_materials/C4. High...Begin to imagine high reliability organizations in education AGENDA PART 1: Reliability 101

PROCESS B

PROCESS

PROCESS

PROCESS A

PROCESS C

PROCESS

PROCESS

PROCESS

PROCESS

PROCESS

PROCESS

PROCESS

Outcome ZERO

FAILURES

18

Page 19: High Reliability Organizationssummit.carnegiefoundation.org/session_materials/C4. High...Begin to imagine high reliability organizations in education AGENDA PART 1: Reliability 101

Step 1 Step 2 Step 3 Step 4 Step 5

Start with an understanding of the system

PROCESS B

90% 90% 90% 90% 90%

19

Page 20: High Reliability Organizationssummit.carnegiefoundation.org/session_materials/C4. High...Begin to imagine high reliability organizations in education AGENDA PART 1: Reliability 101

Step 1 Step 2 Step 3 Step 4 Step 5

Multiple the success rate of each step and hand over to assess outcome reliability

90% 90% 90% 90% 90%

Step 1 Step 2 Step 3 Step 4 Step 5

.9 x .9 x .9 x .9 x .9

Only 59% reliability!

Why might this matter?

20

Page 21: High Reliability Organizationssummit.carnegiefoundation.org/session_materials/C4. High...Begin to imagine high reliability organizations in education AGENDA PART 1: Reliability 101

Identify struggling

readers

Create an intervention

schedule

Pull small groups of students

Provide targeted instructio

n

Reassess progress

Multiple the success rate of each step and hand over to assess outcome reliability

90% 90% 90% 90% 90%

PROCESS: Intervention for struggling readers in 1st grade

OUTCOME: Delivering the right targeted instruction to the

right kids

59% of intended dosage

21

Page 22: High Reliability Organizationssummit.carnegiefoundation.org/session_materials/C4. High...Begin to imagine high reliability organizations in education AGENDA PART 1: Reliability 101

INTERVENTION

PROCESS

PROCESS

READ ALOUDs

PROCESS C

MENTAL HEALTH

SUPPORT

PROCESS

PROCESS

PROCESS

PROCESS

PROCESS

PROCESS

Outcome FAILURES

59%

59%

59%

59%

22

Page 23: High Reliability Organizationssummit.carnegiefoundation.org/session_materials/C4. High...Begin to imagine high reliability organizations in education AGENDA PART 1: Reliability 101

Moving Towards Reliability

(1) Identify the key processes that impact your outcome

(2) Measure the reliability of each of those processes

(3) (Re)design the processes to make each process (and their combination) more reliable

23

Page 24: High Reliability Organizationssummit.carnegiefoundation.org/session_materials/C4. High...Begin to imagine high reliability organizations in education AGENDA PART 1: Reliability 101

Apply (in TRIADs)

Choose one of the scenarios below (or your own!)

Identify ONE key process related to your outcome (quickly sketch it out if you can)

Estimate the reliability of the process (in a context you are familiar with)

Identify other key processes related to your scenario. Repeat.

Delivering the “right dosage” of GUIDED

READING to all students in a 2nd grade classroom

MORNING ROUTINE that gets

you out of your house on time

Equitable DISCIPLINE

PROCEDURES that maximize time for

learning

Your personal life In a classroom In a school

24

Page 25: High Reliability Organizationssummit.carnegiefoundation.org/session_materials/C4. High...Begin to imagine high reliability organizations in education AGENDA PART 1: Reliability 101

25

Page 26: High Reliability Organizationssummit.carnegiefoundation.org/session_materials/C4. High...Begin to imagine high reliability organizations in education AGENDA PART 1: Reliability 101

The Journey to Zero

“CHAOS”

LEVEL 1 RELIABILITY (1 or 2 failures out of 10 opportunities) LEVEL 2 RELIABILITY (<5 failures out of 100 opportunities) LEVEL 3 RELIABILITY (<5 failures out of 1000 opportunities)

26

Page 27: High Reliability Organizationssummit.carnegiefoundation.org/session_materials/C4. High...Begin to imagine high reliability organizations in education AGENDA PART 1: Reliability 101

The Journey to Zero

To get to…. Focus on…

LEVEL 1 RELIABILITY (1 or 2 failures out of 10 opportunities)

Identification and design of key processes

LEVEL 2 RELIABILITY (<5 failures out of 100 opportunities) LEVEL 3 RELIABILITY (<5 failures out of 1000 opportunities)

27

Page 28: High Reliability Organizationssummit.carnegiefoundation.org/session_materials/C4. High...Begin to imagine high reliability organizations in education AGENDA PART 1: Reliability 101

(1) IDENTIFY KEY PROCESSES

(2) MEASURE RELIABILITY

(3) IMPROVE RELIABILITY

(1b) COMMON PROCESS DESIGN

Step Step Step Step Step

FRO

M C

HA

OS

to L

EVEL

1 R

ELIA

BILI

TY

28

Page 29: High Reliability Organizationssummit.carnegiefoundation.org/session_materials/C4. High...Begin to imagine high reliability organizations in education AGENDA PART 1: Reliability 101

The Journey to Zero

To get to…. Focus on…

LEVEL 1 RELIABILITY (1 or 2 failures out of 10 opportunities)

Identification and design of key processes

LEVEL 2 RELIABILITY (<5 failures out of 100 opportunities)

Human factors and reliability science

LEVEL 3 RELIABILITY (<5 failures out of 1000 opportunities)

29

Page 30: High Reliability Organizationssummit.carnegiefoundation.org/session_materials/C4. High...Begin to imagine high reliability organizations in education AGENDA PART 1: Reliability 101

FRO

M L

EVEL

1 t

o LE

VEL

2 R

ELIA

BILI

TY

What changes might we introduce?

How do we make doing “the right thing” the default?

CHANGE CONCEPTS: Reminders Constraints Affordances Contingency Plans

30

Page 31: High Reliability Organizationssummit.carnegiefoundation.org/session_materials/C4. High...Begin to imagine high reliability organizations in education AGENDA PART 1: Reliability 101

The Journey to Zero

To get to…. Focus on…

LEVEL 1 RELIABILITY (1 or 2 failures out of 10 opportunities)

Identification and design of key processes

LEVEL 2 RELIABILITY (<5 failures out of 100 opportunities)

Human Factors and Reliability Science

LEVEL 3 RELIABILITY (<5 failures out of 1000 opportunities)

Create a high reliability culture

31

Page 32: High Reliability Organizationssummit.carnegiefoundation.org/session_materials/C4. High...Begin to imagine high reliability organizations in education AGENDA PART 1: Reliability 101

1. Preoccupation with failure

2. Sensitivity to operations 3. Reluctance to simplify

High Reliability Organizations

Identify

Mitigate 4. Commitment to resilience 5. Deference to expertise

32

Page 33: High Reliability Organizationssummit.carnegiefoundation.org/session_materials/C4. High...Begin to imagine high reliability organizations in education AGENDA PART 1: Reliability 101

THIRD GRADING READING IN A

SCHOOL

33

Page 34: High Reliability Organizationssummit.carnegiefoundation.org/session_materials/C4. High...Begin to imagine high reliability organizations in education AGENDA PART 1: Reliability 101

Alicia Grunow

[email protected]

Louis Gomez

[email protected]

Uma Kotagal

[email protected]