Saving the Titanic: Using CAR to Rescue a Sinking Process ......Saving the Titanic: Using CAR to...

29
Copyright 2008 by Leading Edge Process Consultants LLC Saving the Titanic : Using CAR to Rescue a Sinking Process Improvement Program 2008 CMMI Technology Conference and User Group Denver, Colorado November 18, 2008 Bill Smith President, Principal Consultant SEI-Authorized CMMI Instructor Leading Edge Process Consultants LLC www.leadingedgeprocess.com

Transcript of Saving the Titanic: Using CAR to Rescue a Sinking Process ......Saving the Titanic: Using CAR to...

Page 1: Saving the Titanic: Using CAR to Rescue a Sinking Process ......Saving the Titanic: Using CAR to Rescue a Sinking Process Improvement Program 2008 CMMI Technology Conference and User

Copyright 2008 by Leading Edge Process Consultants LLC

Saving the Titanic:Using CAR to Rescue a Sinking Process Improvement Program

2008 CMMI Technology Conference and User GroupDenver, ColoradoNovember 18, 2008

Bill SmithPresident, Principal ConsultantSEI-Authorized CMMI InstructorLeading Edge Process Consultants LLCwww.leadingedgeprocess.com

Page 2: Saving the Titanic: Using CAR to Rescue a Sinking Process ......Saving the Titanic: Using CAR to Rescue a Sinking Process Improvement Program 2008 CMMI Technology Conference and User

Copyright 2008 by Leading Edge Process Consultants LLC Using CAR to Rescue a Sinking PI Program – Page 2

The situation:• It’s Fall 2003• An organization is moving

toward SW-CMM (CMM for Software) Level 3

• Their process improvement (PI) consultant is yours truly

A Plea for Help

And I get a call…

Page 3: Saving the Titanic: Using CAR to Rescue a Sinking Process ......Saving the Titanic: Using CAR to Rescue a Sinking Process Improvement Program 2008 CMMI Technology Conference and User

Copyright 2008 by Leading Edge Process Consultants LLC Using CAR to Rescue a Sinking PI Program – Page 3

That’s Customer Service?

My client

We’ve fallen hopelessly behind on our process improvement program. Can you help us develop a new schedule?

Me(stunt double)

Ummm, no...

…at least, not unless we also address the reasons why we’re behind schedule.

Page 4: Saving the Titanic: Using CAR to Rescue a Sinking Process ......Saving the Titanic: Using CAR to Rescue a Sinking Process Improvement Program 2008 CMMI Technology Conference and User

Copyright 2008 by Leading Edge Process Consultants LLC Using CAR to Rescue a Sinking PI Program – Page 4

Developing a new schedule without addressing root causes of the slippage is not likely to prevent future slippages.

Stop the Insanity!

Build Plan

Execute Plan

Fall Behind

Fire Consultant, Try Again

Tired Yet?

Y

N

“Insanity: doing the same thing over and over again and

expecting different results.”

- Albert Einstein

The Process Improvement Insanity Cycle

Page 5: Saving the Titanic: Using CAR to Rescue a Sinking Process ......Saving the Titanic: Using CAR to Rescue a Sinking Process Improvement Program 2008 CMMI Technology Conference and User

Copyright 2008 by Leading Edge Process Consultants LLC Using CAR to Rescue a Sinking PI Program – Page 5

Purpose

The purpose of Causal Analysis and Resolution (CAR) is to identify causes of defects andother problems and take action to prevent them from occurring in the future.

SG 1 Determine Causes of Defects

SP 1.1 Select Defect Data for AnalysisSP 1.2 Analyze Causes

SG 2 Address Causes of Defects

SP 2.1 Implement the Action ProposalsSP 2.2 Evaluate the Effect of ChangesSP 2.3 Record Data

What the Book Says

CMMI Second Edition: Guidelines for Process Integration and Product Improvement; Chrissis, Konrad, Shrum

Page 6: Saving the Titanic: Using CAR to Rescue a Sinking Process ......Saving the Titanic: Using CAR to Rescue a Sinking Process Improvement Program 2008 CMMI Technology Conference and User

Copyright 2008 by Leading Edge Process Consultants LLC Using CAR to Rescue a Sinking PI Program – Page 6

Determining What WentWrong

I draft a “fishbone” diagram…

hop on a plane…

meet with my client… …and we refine the diagram.

SP 1.2 Analyze CausesPerform causal analysis of selected defects and other problems and propose actions to address them.

Page 7: Saving the Titanic: Using CAR to Rescue a Sinking Process ......Saving the Titanic: Using CAR to Rescue a Sinking Process Improvement Program 2008 CMMI Technology Conference and User

Copyright 2008 by Leading Edge Process Consultants LLC Using CAR to Rescue a Sinking PI Program – Page 7

Drawing Our Fishbone

Also known as:

• Cause-and-effect diagram

• Ishikawa diagram

Page 8: Saving the Titanic: Using CAR to Rescue a Sinking Process ......Saving the Titanic: Using CAR to Rescue a Sinking Process Improvement Program 2008 CMMI Technology Conference and User

Copyright 2008 by Leading Edge Process Consultants LLC Using CAR to Rescue a Sinking PI Program – Page 8

PI EffortBehind

Schedule

Drawing Our Fishbone

Insufficientplanning

InadequatemonitoringInexperienced

PATleadership

Limited resources Insufficient

buy-in toPI program

Inefficient review cycles

PI EffortBehind

Schedule

1. Define the problem2. Ask “Why?”Why?

Why?

Why?

Why?Why?

Why?

3. Repeat As Needed

Page 9: Saving the Titanic: Using CAR to Rescue a Sinking Process ......Saving the Titanic: Using CAR to Rescue a Sinking Process Improvement Program 2008 CMMI Technology Conference and User

Copyright 2008 by Leading Edge Process Consultants LLC Using CAR to Rescue a Sinking PI Program – Page 9

PI EffortBehind

Schedule

Cause: Insufficient PlanningInadequatemonitoringInexperienced

PATleadership

Limited resources Insufficient

buy-in toPI program

Inefficient review cycles

Highly sequential schedule

Planning guidance unheeded

Feeling that effort is “unplannable”

No resources on schedule

Unrealistic durations

Many efforts unestimated

Insufficientplanning

Page 10: Saving the Titanic: Using CAR to Rescue a Sinking Process ......Saving the Titanic: Using CAR to Rescue a Sinking Process Improvement Program 2008 CMMI Technology Conference and User

Copyright 2008 by Leading Edge Process Consultants LLC Using CAR to Rescue a Sinking PI Program – Page 10

Cause: Inexperienced PAT Leadership

Insufficientplanning

Inadequatemonitoring

Limited resources Insufficient

buy-in toPI program

Inefficient review cycles

Little trainingLimited pool

PI EffortBehind

Schedule

Inexperienced PAT

leadership

Page 11: Saving the Titanic: Using CAR to Rescue a Sinking Process ......Saving the Titanic: Using CAR to Rescue a Sinking Process Improvement Program 2008 CMMI Technology Conference and User

Copyright 2008 by Leading Edge Process Consultants LLC Using CAR to Rescue a Sinking PI Program – Page 11

PI EffortBehind

Schedule

Cause: Inadequate Monitoring

Insufficientplanning

Inexperienced PAT

leadership

Limited resources Insufficient

buy-in toPI program

Inefficient review cycles

Inexperience

Limited action item tracking

No schedule discussions at PAT level

No actions taken when schedule slips

Limited slippage awareness

Reluctance to update plans

Inadequatemonitoring

Page 12: Saving the Titanic: Using CAR to Rescue a Sinking Process ......Saving the Titanic: Using CAR to Rescue a Sinking Process Improvement Program 2008 CMMI Technology Conference and User

Copyright 2008 by Leading Edge Process Consultants LLC Using CAR to Rescue a Sinking PI Program – Page 12

PI EffortBehind

Schedule

Cause: Limited Resources

Insufficientplanning

InadequatemonitoringInexperienced

PATleadership

Insufficientbuy-in to

PI program

Inefficient review cycles

Developers working OT on projects

Not as important as “real” work

Proj. participation not planned/ budgeted

Small organization

Limited resources

Page 13: Saving the Titanic: Using CAR to Rescue a Sinking Process ......Saving the Titanic: Using CAR to Rescue a Sinking Process Improvement Program 2008 CMMI Technology Conference and User

Copyright 2008 by Leading Edge Process Consultants LLC Using CAR to Rescue a Sinking PI Program – Page 13

PI EffortBehind

Schedule

Cause: Inefficient Review Cycles

Insufficientplanning

InadequatemonitoringInexperienced

PATleadership

Limited resources Insufficient

buy-in toPI program

No documented PAT review process

One individual trying to do too much

No distinction between forgotten & rejected inputs

Inefficient review cycles

Page 14: Saving the Titanic: Using CAR to Rescue a Sinking Process ......Saving the Titanic: Using CAR to Rescue a Sinking Process Improvement Program 2008 CMMI Technology Conference and User

Copyright 2008 by Leading Edge Process Consultants LLC Using CAR to Rescue a Sinking PI Program – Page 14

PI EffortBehind

Schedule

Cause: Insufficient Buy-in to PI Program

Insufficientplanning

InadequatemonitoringInexperienced

PATleadership

Limited resources

Inefficient review cycles

Not addressing “What’s in it for me?”

Limited management support

Little Software Lead buy-in

Insufficientbuy-in to

PI program

Page 15: Saving the Titanic: Using CAR to Rescue a Sinking Process ......Saving the Titanic: Using CAR to Rescue a Sinking Process Improvement Program 2008 CMMI Technology Conference and User

Copyright 2008 by Leading Edge Process Consultants LLC Using CAR to Rescue a Sinking PI Program – Page 15

No documented PAT review.

process

One individual trying to do too

much

No distinction between forgotten &

rejected inputs

Little training

Little Software Lead buy-in

Not addressing “What’s in it for

me?”

Limited mgt support

Inexperience

Limited action item tracking

No schedule discussions at

PAT levelPlanning guidance unheeded

No actions taken when schedule slips

Limited slippage awareness

Reluctance to update plans

Not as important as “real” work

Proj. participation not planned/

budgeted

Small org.

Developers working OT on projects

Feeling that effort is “unplannable”

Many efforts unestimated

No resources on schedule

Highly sequential schedule

(Some)unrealistic durations

Limited pool

Our actual diagram was a bit more complex. The one we present here has been sanitizedand simplified.

PI EffortBehind

Schedule

Insufficientplanning

Inadequatemonitoring

Inexperienced PAT leadership

Limited resources

Insufficient buy-in to PI program

Inefficient review cycles

Final Fishbone Diagram

Page 16: Saving the Titanic: Using CAR to Rescue a Sinking Process ......Saving the Titanic: Using CAR to Rescue a Sinking Process Improvement Program 2008 CMMI Technology Conference and User

Copyright 2008 by Leading Edge Process Consultants LLC Using CAR to Rescue a Sinking PI Program – Page 16

We’ve Identified Causes… Now What?

We brainstorm solutions…

and run these by the appropriate people.

SP 1.2 Analyze CausesPerform causal analysis of selected defects and other problems and propose actions to address them.

Page 17: Saving the Titanic: Using CAR to Rescue a Sinking Process ......Saving the Titanic: Using CAR to Rescue a Sinking Process Improvement Program 2008 CMMI Technology Conference and User

Copyright 2008 by Leading Edge Process Consultants LLC Using CAR to Rescue a Sinking PI Program – Page 17

No documented PAT review.

process

One individual trying to do too

much

No distinction between forgotten &

rejected inputs

Little training

Little Software Lead buy-in

Not addressing “What’s in it for

me?”

Limited mgt support

Inexperience

Limited action item tracking

No schedule discussions at

PAT levelPlanning guidance unheeded

No actions taken when schedule slips

Limited slippage awareness

Reluctance to update plans

Not as important as “real” work

Proj. participation not planned/

budgeted

Small org.

Developers working OT on projects

Feeling that effort is “unplannable”

Many efforts unestimated

No resources on schedule

Highly sequential schedule

(Some)unrealistic durations

Limited pool

Insufficientplanning Inadequate

monitoringInexperienced PAT leadership

Limited resources

Insufficient buy-in to PI program

Inefficient review cycles

Insufficient Planning: Action

New schedule is being developed, and will:• include resource assignments (names)• better consider resource constraints• be based on labor hour estimates

PI EffortBehind

Schedule

Page 18: Saving the Titanic: Using CAR to Rescue a Sinking Process ......Saving the Titanic: Using CAR to Rescue a Sinking Process Improvement Program 2008 CMMI Technology Conference and User

Copyright 2008 by Leading Edge Process Consultants LLC Using CAR to Rescue a Sinking PI Program – Page 18

No documented PAT review.

process

One individual trying to do too

much

No distinction between forgotten &

rejected inputs

Little training

Little Software Lead buy-in

Not addressing “What’s in it for

me?”

Limited mgt support

Inexperience

Limited action item tracking

No schedule discussions at

PAT levelPlanning guidance unheeded

No actions taken when schedule slips

Limited slippage awareness

Reluctance to update plans

Not as important as “real” work

Proj. participation not planned/

budgeted

Small org.

Developers working OT on projects

Feeling that effort is “unplannable”

Many efforts unestimated

No resources on schedule

Highly sequential schedule

(Some)unrealistic durations

Limited pool

Insufficientplanning

Inadequatemonitoring

Inexperienced PAT leadership

Limited resources

Insufficient buy-in to PI program

Inefficient review cycles

Inexperienced PAT Leadership: Action

Level of mentoringassociated with PI program planning and monitoring will be increased

PI EffortBehind

Schedule

PI EffortBehind

Schedule

Page 19: Saving the Titanic: Using CAR to Rescue a Sinking Process ......Saving the Titanic: Using CAR to Rescue a Sinking Process Improvement Program 2008 CMMI Technology Conference and User

Copyright 2008 by Leading Edge Process Consultants LLC Using CAR to Rescue a Sinking PI Program – Page 19

No documented PAT review.

process

One individual trying to do too

much

No distinction between forgotten &

rejected inputs

Little training

Little Software Lead buy-in

Not addressing “What’s in it for

me?”

Limited mgt support

Inexperience

Limited action item tracking

No schedule discussions at

PAT levelPlanning guidance unheeded

No actions taken when schedule slips

Limited slippage awareness

Reluctance to update plans

Not as important as “real” work

Proj. participation not planned/

budgeted

Small org.

Developers working OT on projects

Feeling that effort is “unplannable”

Many efforts unestimated

No resources on schedule

Highly sequential schedule

(Some)unrealistic durations

Limited pool

Insufficientplanning

InadequatemonitoringInexperienced

PAT leadership

Limited resources

Insufficient buy-in to PI program

Inefficient review cycles

Inadequate Monitoring: Action

“Schedule” will appear as first item on all future PAT meeting agendas

PI EffortBehind

Schedule

Page 20: Saving the Titanic: Using CAR to Rescue a Sinking Process ......Saving the Titanic: Using CAR to Rescue a Sinking Process Improvement Program 2008 CMMI Technology Conference and User

Copyright 2008 by Leading Edge Process Consultants LLC Using CAR to Rescue a Sinking PI Program – Page 20

No documented PAT review.

process

One individual trying to do too

much

No distinction between forgotten &

rejected inputs

Little training

Little Software Lead buy-in

Not addressing “What’s in it for

me?”

Limited mgt support

Inexperience

Limited action item tracking

No schedule discussions at

PAT levelPlanning guidance unheeded

No actions taken when schedule slips

Limited slippage awareness

Reluctance to update plans

Not as important as “real” work

Proj. participation not planned/

budgeted

Small org.

Developers working OT on projects

Feeling that effort is “unplannable”

Many efforts unestimated

No resources on schedule

Highly sequential schedule

(Some)unrealistic durations

Limited pool

Insufficientplanning

Inadequatemonitoring

Inexperienced PAT leadership

Limited resources

Insufficient buy-in to PI program

Inefficient review cycles

Limited Resources: Action

PI Lead is requesting a budget increase, and has received a verbal commitment (11/19) of increased project participation

PI EffortBehind

Schedule

Page 21: Saving the Titanic: Using CAR to Rescue a Sinking Process ......Saving the Titanic: Using CAR to Rescue a Sinking Process Improvement Program 2008 CMMI Technology Conference and User

Copyright 2008 by Leading Edge Process Consultants LLC Using CAR to Rescue a Sinking PI Program – Page 21

No documented PAT review.

process

One individual trying to do too

much

No distinction between forgotten &

rejected inputs

Little training

Little Software Lead buy-in

Not addressing “What’s in it for

me?”

Limited mgt support

Inexperience

Limited action item tracking

No schedule discussions at

PAT levelPlanning guidance unheeded

No actions taken when schedule slips

Limited slippage awareness

Reluctance to update plans

Not as important as “real” work

Proj. participation not planned/

budgeted

Small org.

Developers working OT on projects

Feeling that effort is “unplannable”

Many efforts unestimated

No resources on schedule

Highly sequential schedule

(Some)unrealistic durations

Limited pool

Insufficientplanning

Inadequatemonitoring

Inexperienced PAT leadership

Limited resources

Insufficient buy-in to PI programInefficient

review cycles

Inefficient Review Cycles: Action

Consider formalizing key comments;New schedule will include key review-related milestones

PI EffortBehind

Schedule

Page 22: Saving the Titanic: Using CAR to Rescue a Sinking Process ......Saving the Titanic: Using CAR to Rescue a Sinking Process Improvement Program 2008 CMMI Technology Conference and User

Copyright 2008 by Leading Edge Process Consultants LLC Using CAR to Rescue a Sinking PI Program – Page 22

No documented PAT review.

process

One individual trying to do too

much

No distinction between forgotten &

rejected inputs

Little training

Little Software Lead buy-in

Not addressing “What’s in it for

me?”

Limited mgt support

Inexperience

Limited action item tracking

No schedule discussions at

PAT levelPlanning guidance unheeded

No actions taken when schedule slips

Limited slippage awareness

Reluctance to update plans

Not as important as “real” work

Proj. participation not planned/

budgeted

Small org.

Developers working OT on projects

Feeling that effort is “unplannable”

Many efforts unestimated

No resources on schedule

Highly sequential schedule

(Some)unrealistic durations

Limited pool

Insufficientplanning

Inadequatemonitoring

Inexperienced PAT leadership

Limited resources Insufficient

buy-in to PI program

Inefficient review cycles

Insufficient Buy-in to PI Program: Action

Post-POC lessons learnedmeeting has been scheduled for 11/25, and will tie into PI program

PI EffortBehind

Schedule

Page 23: Saving the Titanic: Using CAR to Rescue a Sinking Process ......Saving the Titanic: Using CAR to Rescue a Sinking Process Improvement Program 2008 CMMI Technology Conference and User

Copyright 2008 by Leading Edge Process Consultants LLC Using CAR to Rescue a Sinking PI Program – Page 23

No documented PAT review.

process

One individual trying to do too

much

No distinction between forgotten &

rejected inputs

Little training

Little Software Lead buy-in

Not addressing “What’s in it for

me?”

Limited mgt support

Inexperience

Limited action item tracking

No schedule discussions at

PAT levelPlanning guidance unheeded

No actions taken when schedule slips

Limited slippage awareness

Reluctance to update plans

Not as important as “real” work

Proj. participation not planned/

budgeted

Small org.

Developers working OT on projects

Feeling that effort is “unplannable”

Many efforts unestimated

No resources on schedule

Highly sequential schedule

(Some)unrealistic durations

Limited pool

Insufficientplanning

Inadequatemonitoring

Inexperienced PAT leadership

Limited resources

Insufficient buy-in to PI program

Inefficient review cycles

“Schedule” will appear as first item on all future PAT meeting agendas

Level of mentoringassociated with PI program planning and monitoring will be increased

New schedule is being developed, and will:• include resource assignments (names)• better consider resource constraints• be based on labor hour estimates

PI Lead is requesting a budget increase, and has received a verbal commitment (11/19) of increased project participation

Consider formalizing key comments;New schedule will include key review-related milestones

Post-POC lessons learnedmeeting has been scheduled for 11/25, and will tie into PI program

Fishbone Diagram with Selected Actions

PI EffortBehind

Schedule

We also had several additional actions. For simplicity, we’ve only chosen one per high-level “cause” in this presentation.

Page 24: Saving the Titanic: Using CAR to Rescue a Sinking Process ......Saving the Titanic: Using CAR to Rescue a Sinking Process Improvement Program 2008 CMMI Technology Conference and User

Copyright 2008 by Leading Edge Process Consultants LLC Using CAR to Rescue a Sinking PI Program – Page 24

Measure results

SP 2.2 Evaluate the Effect of ChangesEvaluate the effect of changes on process performance.

Finally… Time for Action

Take action!

SP 2.1 Implement the Action

ProposalsImplement the selected action proposals

that were developed in causal analysis.

Resolve conflicts

Page 25: Saving the Titanic: Using CAR to Rescue a Sinking Process ......Saving the Titanic: Using CAR to Rescue a Sinking Process Improvement Program 2008 CMMI Technology Conference and User

Copyright 2008 by Leading Edge Process Consultants LLC Using CAR to Rescue a Sinking PI Program – Page 25

Measuring Our Results

The health of the PI program improved significantly.Several months later we were able to quantify the effect of the changes:

Page 26: Saving the Titanic: Using CAR to Rescue a Sinking Process ......Saving the Titanic: Using CAR to Rescue a Sinking Process Improvement Program 2008 CMMI Technology Conference and User

Copyright 2008 by Leading Edge Process Consultants LLC Using CAR to Rescue a Sinking PI Program – Page 26

Measuring Our Results

The health of the PI program improved significantly.Several months later we were able to quantify the effect of the changes:

Copyright 2008 by Leading Edge Process Consultants LLC Using CAR to Rescue a Sinking PI Program – Page 26

Page 27: Saving the Titanic: Using CAR to Rescue a Sinking Process ......Saving the Titanic: Using CAR to Rescue a Sinking Process Improvement Program 2008 CMMI Technology Conference and User

Copyright 2008 by Leading Edge Process Consultants LLC Using CAR to Rescue a Sinking PI Program – Page 27

Conclusions and Recommendations [1 of 2]

• Our application of CAR was imperfect and abbreviated, but extremely useful nonetheless.- Walk before you run; don’t pursue perfection as a short-term goal

• Several root causes were beyond our direct control, but we were still able to successfully exert influence to ensure many of these were addressed- Don’t give up when you find many causes are beyond your control;

apply WIFM (“what’s in it for me?”) to gain support• We could have saved additional time by involving some key

stakeholders sooner in the CAR process- You’ll need buy-in from all key players eventually; do it sooner

rather than later – it’s cheaper!•his organization’s process improvement problems were certainly not unique- A cause-and-effect diagram can become a re-usable asset!

Page 28: Saving the Titanic: Using CAR to Rescue a Sinking Process ......Saving the Titanic: Using CAR to Rescue a Sinking Process Improvement Program 2008 CMMI Technology Conference and User

Copyright 2008 by Leading Edge Process Consultants LLC Using CAR to Rescue a Sinking PI Program – Page 28

Conclusions and Recommendations [2 of 2]

• Many of the causes were related to the process improvement program not truly being planned and managed like a project- Apply basic project management principles to your PI program

(minimally, see PP and PMC)• By using causal analysis and resolution techniques, we were

almost certainly able to reduce the schedule and overall cost ofthe process improvement program. (Overall time from organization’s initial exposure to SW-CMM until successful Level 3 rating: 16 months.)- Applying a healthy dose of CAR to your significant process

improvement –related problems

Page 29: Saving the Titanic: Using CAR to Rescue a Sinking Process ......Saving the Titanic: Using CAR to Rescue a Sinking Process Improvement Program 2008 CMMI Technology Conference and User

Copyright 2008 by Leading Edge Process Consultants LLC Using CAR to Rescue a Sinking PI Program – Page 29

Bill SmithPresident, Principal Consultant

Leading Edge Process Consultants LLCVienna, Virginia

[email protected]

My Website: www.leadingedgeprocess.comMy Blog: cmmiforhumans.blogspot.com

(CMMI For Humans)

Check out mypublic CMMI classes

Questions?