Statistical Thinking (for Statisticians) -...

23
Statistical Thinking (for Statisticians) Lynne Hare ASA, Delaware Section April 24, 1998

Transcript of Statistical Thinking (for Statisticians) -...

Page 1: Statistical Thinking (for Statisticians) - ASQasq.org/statistics/1998/04/statistical-thinking-for-statisticians.pdf · Statistical Thinking for Statisticians Examples of Statistical

Statistical Thinking(for Statisticians)

Lynne Hare

ASA, Delaware SectionApril 24, 1998

Page 2: Statistical Thinking (for Statisticians) - ASQasq.org/statistics/1998/04/statistical-thinking-for-statisticians.pdf · Statistical Thinking for Statisticians Examples of Statistical

2Statistical Thinking for Statisticians

Goal

To create a common understanding of

Statistical Thinking

within our own profession

Page 3: Statistical Thinking (for Statisticians) - ASQasq.org/statistics/1998/04/statistical-thinking-for-statisticians.pdf · Statistical Thinking for Statisticians Examples of Statistical

3Statistical Thinking for Statisticians

Background

• JSM Roundtable Luncheon - Chicago– ST for Process Improvement

• JSM Roundtable Luncheons - Anaheim– ST for Statisticians– Hoerl and Hare (AMSTAT News Article)

• C. Mallows - 1997 Fisher Memorial Lecture, “The Zeroth Problem,” The American Statistician, Feb. ‘98.

Page 4: Statistical Thinking (for Statisticians) - ASQasq.org/statistics/1998/04/statistical-thinking-for-statisticians.pdf · Statistical Thinking for Statisticians Examples of Statistical

4Statistical Thinking for Statisticians

Definition

• All work occurs in a system of interconnectedprocesses,

• Variation exists in all processes, and

• Understanding and reducing variation are keys to success.

Statistical Thinking is a philosophy of learning and action based on the following fundamental principles:

Source: Glossary of Statistical Terms, ASQ Quality Press

Page 5: Statistical Thinking (for Statisticians) - ASQasq.org/statistics/1998/04/statistical-thinking-for-statisticians.pdf · Statistical Thinking for Statisticians Examples of Statistical

5Statistical Thinking for Statisticians

Definition

Statistical Thinking is a philosophy of learning and action based on the following fundamental principles:

Source: Glossary of Statistical Terms, ASQ Quality Press

Page 6: Statistical Thinking (for Statisticians) - ASQasq.org/statistics/1998/04/statistical-thinking-for-statisticians.pdf · Statistical Thinking for Statisticians Examples of Statistical

6Statistical Thinking for Statisticians

Definition

• All work occurs in a system of interconnectedprocesses,

Statistical Thinking is a philosophy of learning and action based on the following fundamental principles:

Source: Glossary of Statistical Terms, ASQ Quality Press

Page 7: Statistical Thinking (for Statisticians) - ASQasq.org/statistics/1998/04/statistical-thinking-for-statisticians.pdf · Statistical Thinking for Statisticians Examples of Statistical

7Statistical Thinking for Statisticians

Definition

• All work occurs in a system of interconnectedprocesses,

• Variation exists in all processes, and

Statistical Thinking is a philosophy of learning and action based on the following fundamental principles:

Source: Glossary of Statistical Terms, ASQ Quality Press

Page 8: Statistical Thinking (for Statisticians) - ASQasq.org/statistics/1998/04/statistical-thinking-for-statisticians.pdf · Statistical Thinking for Statisticians Examples of Statistical

8Statistical Thinking for Statisticians

Source: Glossary of Statistical Terms, ASQ Quality Press

Definition

• All work occurs in a system of interconnectedprocesses,

• Variation exists in all processes, and

.• Understanding and reducing variation are keys to success

Statistical Thinking is a philosophy of learning and action based on the following fundamental principles:

Page 9: Statistical Thinking (for Statisticians) - ASQasq.org/statistics/1998/04/statistical-thinking-for-statisticians.pdf · Statistical Thinking for Statisticians Examples of Statistical

9Statistical Thinking for Statisticians

Statistical Thinking and Methods

Process Variation Data Statistical Tools

Statistical Thinking Statistical Methods

Page 10: Statistical Thinking (for Statisticians) - ASQasq.org/statistics/1998/04/statistical-thinking-for-statisticians.pdf · Statistical Thinking for Statisticians Examples of Statistical

10Statistical Thinking for Statisticians

Statistical Thinking

Key Concepts

Role of Data

• Process and systems thinking• Variation• Analysis increases knowledge• Taking action• Improvement

• Quantify variation• Measure effects

Page 11: Statistical Thinking (for Statisticians) - ASQasq.org/statistics/1998/04/statistical-thinking-for-statisticians.pdf · Statistical Thinking for Statisticians Examples of Statistical

11Statistical Thinking for Statisticians

Without a Process View

• People have problems understanding the problem and their role in its solution (turf).

• It is difficult to define the scope of the problem.• It is difficult to get to root causes.• People get blamed when the process is the problem

(85/15 Rule).• Process management is ineffective• Improvement is slowed

“You can’t improve a processthat you don’t understand”

Page 12: Statistical Thinking (for Statisticians) - ASQasq.org/statistics/1998/04/statistical-thinking-for-statisticians.pdf · Statistical Thinking for Statisticians Examples of Statistical

12Statistical Thinking for Statisticians

Without Understanding Variation

• Management by the last data point• There’s lots of fire fighting

– Using special cause methods to solve common cause problems

• Tampering and micromanaging abound• Goals and methods to attain them fail• Understanding the process is handicapped

– Learning is slowed• Process management is ineffective• Improvement is slowed

Page 13: Statistical Thinking (for Statisticians) - ASQasq.org/statistics/1998/04/statistical-thinking-for-statisticians.pdf · Statistical Thinking for Statisticians Examples of Statistical

13Statistical Thinking for Statisticians

Without Data

• Everyone is an expert: discussions produce more heat than light

• Historical memory is poor• Difficult to get agreement on:

– What the problem is– What success looks like– Progress made

• Process management is ineffective• Improvement is slowed

Page 14: Statistical Thinking (for Statisticians) - ASQasq.org/statistics/1998/04/statistical-thinking-for-statisticians.pdf · Statistical Thinking for Statisticians Examples of Statistical

14Statistical Thinking for Statisticians

Without Statistical Thinking• Your management and improvement processes are

handicapped• It’s like

– Football without a passing attack– Growing a lawn without fertilizer– Doing research without measurements– Playing golf without your irons

“Early on, we failed to focus adequately on core work processes and statistics.”

David Kearns and David Nelder, Xerox Corporation

Page 15: Statistical Thinking (for Statisticians) - ASQasq.org/statistics/1998/04/statistical-thinking-for-statisticians.pdf · Statistical Thinking for Statisticians Examples of Statistical

15Statistical Thinking for Statisticians

Use of Statistical ThinkingDepends on levels of activity and job responsibility.

Where we're headed

Managerial processesto guide us

Where the work getsdone

Strategic

Managerial

Operational

Executives

Managers

Workers

Page 16: Statistical Thinking (for Statisticians) - ASQasq.org/statistics/1998/04/statistical-thinking-for-statisticians.pdf · Statistical Thinking for Statisticians Examples of Statistical

16Statistical Thinking for Statisticians

Examples of Statistical Thinkingat the Strategic Level

• Executives use systems approach.• Core processes have been flow charted• Strategic direction defined and deployed.• Measurement systems in place.• Employee, customer, and benchmarking studies

are used to drive improvement.• Experimentation is encouraged.

Page 17: Statistical Thinking (for Statisticians) - ASQasq.org/statistics/1998/04/statistical-thinking-for-statisticians.pdf · Statistical Thinking for Statisticians Examples of Statistical

17Statistical Thinking for Statisticians

Examples of Statistical Thinking at the Managerial Level

.

• Managers use meeting management techniques• Standardized project management systems are in place.• Both project process and results are reviewed.• Process variation is considered when setting goals.• Measurement is viewed as a process.• The number of suppliers is reduced• A variety of communication media are used.

Page 18: Statistical Thinking (for Statisticians) - ASQasq.org/statistics/1998/04/statistical-thinking-for-statisticians.pdf · Statistical Thinking for Statisticians Examples of Statistical

18Statistical Thinking for Statisticians

Examples of Statistical Thinking at the Operational Level

• Work processes are flowcharted and documented• Key measurements are identified.

– Time plots displayed• Process management and improvement utilize:

– Knowledge of variation, and– Data

• Improvement activities focus on the process, not blaming employees.

Page 19: Statistical Thinking (for Statisticians) - ASQasq.org/statistics/1998/04/statistical-thinking-for-statisticians.pdf · Statistical Thinking for Statisticians Examples of Statistical

19Statistical Thinking for Statisticians

Statistical Thinking at the Operational Level

A Recent Experience

• Huge quantities of data• Limited understanding of structure• Consultants applied artificial neural nets• Didn’t work

Page 20: Statistical Thinking (for Statisticians) - ASQasq.org/statistics/1998/04/statistical-thinking-for-statisticians.pdf · Statistical Thinking for Statisticians Examples of Statistical

20Statistical Thinking for Statisticians

Statistical Thinking at the Operational Level

A Recent Experience

• Artificial Neural Nets apply nicely in many situations (NIST Examples):– Optical Character Recognition– Finger Printing– Face Printing for the FBI

• Example

Page 21: Statistical Thinking (for Statisticians) - ASQasq.org/statistics/1998/04/statistical-thinking-for-statisticians.pdf · Statistical Thinking for Statisticians Examples of Statistical

21Statistical Thinking for Statisticians

WANTEDBY THE FBI

Baby Face Hare

Page 22: Statistical Thinking (for Statisticians) - ASQasq.org/statistics/1998/04/statistical-thinking-for-statisticians.pdf · Statistical Thinking for Statisticians Examples of Statistical

22Statistical Thinking for Statisticians

…. But,

Unless you sample the process taking theright amount of the right kind ofdata (rational subgroups) you will neverapproach process understanding.

Without process understanding, there is noprocess control.

Page 23: Statistical Thinking (for Statisticians) - ASQasq.org/statistics/1998/04/statistical-thinking-for-statisticians.pdf · Statistical Thinking for Statisticians Examples of Statistical

23Statistical Thinking for Statisticians

Key Learnings from ST Efforts

• Statisticians don’t understand ST as well as they think they do.

• Those who do understand it have limited access to managerial and strategic levels.

• There’s much more work to be done.– Spread the word– Focus on process