1 CADDIS - Risk-based Prioritization and Diagnosing the Risk Drivers Susan Cormier, Ph.D....

52
1 CADDIS - Risk-based Prioritization and Diagnosing the Risk Drivers Susan Cormier, Ph.D. NCEA-Cincinnati and the whole CADDIS team

Transcript of 1 CADDIS - Risk-based Prioritization and Diagnosing the Risk Drivers Susan Cormier, Ph.D....

Page 1: 1 CADDIS - Risk-based Prioritization and Diagnosing the Risk Drivers Susan Cormier, Ph.D. NCEA-Cincinnati and the whole CADDIS team.

1

CADDIS - Risk-based Prioritization and Diagnosing the Risk Drivers

Susan Cormier, Ph.D. NCEA-Cincinnatiand the whole CADDIS team

Page 2: 1 CADDIS - Risk-based Prioritization and Diagnosing the Risk Drivers Susan Cormier, Ph.D. NCEA-Cincinnati and the whole CADDIS team.

2

Assessments of Cumulative Causes, CADDIS,

and a Case

Cumulative Causes

Cumulative Risks

Page 3: 1 CADDIS - Risk-based Prioritization and Diagnosing the Risk Drivers Susan Cormier, Ph.D. NCEA-Cincinnati and the whole CADDIS team.

3Given this cause, what is the probable effect?

Risk Given C what will E be?– Given what we know of the mixture or the

individual components of the mixture, what are the probabilities and types of effects that may occur?

Given this effect, what is the probable cause?

Cause Given E what was C?– Given what we know of the effects, what is

the likely exposure scenario or combination of exposures that caused these effects?

Page 4: 1 CADDIS - Risk-based Prioritization and Diagnosing the Risk Drivers Susan Cormier, Ph.D. NCEA-Cincinnati and the whole CADDIS team.

4

Cumulative Causes

Cumulative Risks

Different Questions Different Analyses

Different Logic

Page 5: 1 CADDIS - Risk-based Prioritization and Diagnosing the Risk Drivers Susan Cormier, Ph.D. NCEA-Cincinnati and the whole CADDIS team.

5

Cumulative Risks

Cumulative Causes

Different Kinds of Assessments

Different Questions Different Analyses

Different Logic

Page 6: 1 CADDIS - Risk-based Prioritization and Diagnosing the Risk Drivers Susan Cormier, Ph.D. NCEA-Cincinnati and the whole CADDIS team.

6

The Basic EA Framework

Condition Assessment

Outcome Assessment

Predictive Assessments

Causal Assessments

Page 7: 1 CADDIS - Risk-based Prioritization and Diagnosing the Risk Drivers Susan Cormier, Ph.D. NCEA-Cincinnati and the whole CADDIS team.

7

The Basic EA Framework

Condition Assessment

Outcome Assessment

Predictive Assessments

Causal Assessments

Problem Detection

Page 8: 1 CADDIS - Risk-based Prioritization and Diagnosing the Risk Drivers Susan Cormier, Ph.D. NCEA-Cincinnati and the whole CADDIS team.

8

The Basic EA Framework

Condition Assessment

Outcome Assessment

Predictive Assessments

Causal Assessments

Problem Resolution

Page 9: 1 CADDIS - Risk-based Prioritization and Diagnosing the Risk Drivers Susan Cormier, Ph.D. NCEA-Cincinnati and the whole CADDIS team.

9

The Basic EA Framework

Condition Assessment

Outcome Assessment

Predictive Assessments

Causal Assessments

En

viro

nm

enta

l E

pid

emio

log

y

Analysis from Effect to Cause

Page 10: 1 CADDIS - Risk-based Prioritization and Diagnosing the Risk Drivers Susan Cormier, Ph.D. NCEA-Cincinnati and the whole CADDIS team.

10

The Basic EA Framework

Condition Assessment

Outcome Assessment

Predictive Assessments

Causal Assessments

Analysis from Cause to Effect

En

viro

nm

enta

l M

ana

gem

ent

Page 11: 1 CADDIS - Risk-based Prioritization and Diagnosing the Risk Drivers Susan Cormier, Ph.D. NCEA-Cincinnati and the whole CADDIS team.

11

The Basic EA Framework

Condition Assessment

Outcome Assessment

Predictive Assessments

Causal Assessments

Analysis from Cause to Effect

En

viro

nm

enta

l M

ana

gem

ent

En

viro

nm

enta

l E

pid

emio

log

y

Problem Resolution

Problem Detection

Analysis from Effect to Cause

Page 12: 1 CADDIS - Risk-based Prioritization and Diagnosing the Risk Drivers Susan Cormier, Ph.D. NCEA-Cincinnati and the whole CADDIS team.

12

Condition Assessment

Problem Detection

Causal Assessment

Environmental Epidemiology

Predictive Assessment

Risk

Outcome Assessment

Environmental Management

Problem Resolution

Problem Resolution

Criteria Setting, Risk Assessment

Page 13: 1 CADDIS - Risk-based Prioritization and Diagnosing the Risk Drivers Susan Cormier, Ph.D. NCEA-Cincinnati and the whole CADDIS team.

13

Condition Assessment

Biological

Problem Detection

Causal Assessment

Environmental Epidemiology

Predictive AssessmentOutcome Assessment

Environmental Management

Problem Resolution

Problem Resolution

Meet Aquatic Life Standards

Page 14: 1 CADDIS - Risk-based Prioritization and Diagnosing the Risk Drivers Susan Cormier, Ph.D. NCEA-Cincinnati and the whole CADDIS team.

14

Condition Assessment

Problem Detection

Causal Assessment

Environmental Epidemiology

Predictive Assessment

Management

Risk

Outcome Assessment

Environmental Management

Problem Resolution

SourceCause

Outcome

Endangered Species

Problem Resolution

Page 15: 1 CADDIS - Risk-based Prioritization and Diagnosing the Risk Drivers Susan Cormier, Ph.D. NCEA-Cincinnati and the whole CADDIS team.

15

Condition Assessment

Problem Detection

Causal Assessment

Environmental Epidemiology

Predictive Assessment

Management

Risk

Outcome Assessment

Environmental Management

Problem Resolution

Outcome

Hurricane Approaching

Problem Resolution

Page 16: 1 CADDIS - Risk-based Prioritization and Diagnosing the Risk Drivers Susan Cormier, Ph.D. NCEA-Cincinnati and the whole CADDIS team.

16

CADDIS: EPA Website for Ecological Causal Assessment

Condition Assessment

Outcome Assessment

Analysis from Cause to Effect

En

viro

nm

enta

l M

ana

gem

ent

En

viro

nm

enta

l E

pid

emio

log

y

Problem Resolution

Problem Detection

Analysis from Effect to Cause

Causal Assessments

Predictive Assessments

Page 17: 1 CADDIS - Risk-based Prioritization and Diagnosing the Risk Drivers Susan Cormier, Ph.D. NCEA-Cincinnati and the whole CADDIS team.

17

Ecoepidemiological assessments reflect cumulative causes and effects

CADDIS is a guide to causal inference for specific cases

larvae adult

Condition Assessment

Outcome Assessment

Predictive Assessments

Causal Assessments

www.epa.gov/caddis

Page 18: 1 CADDIS - Risk-based Prioritization and Diagnosing the Risk Drivers Susan Cormier, Ph.D. NCEA-Cincinnati and the whole CADDIS team.

18

Home Page

Page 19: 1 CADDIS - Risk-based Prioritization and Diagnosing the Risk Drivers Susan Cormier, Ph.D. NCEA-Cincinnati and the whole CADDIS team.

19

Page 20: 1 CADDIS - Risk-based Prioritization and Diagnosing the Risk Drivers Susan Cormier, Ph.D. NCEA-Cincinnati and the whole CADDIS team.

20

Step-by Step Guide Introduction

Page 21: 1 CADDIS - Risk-based Prioritization and Diagnosing the Risk Drivers Susan Cormier, Ph.D. NCEA-Cincinnati and the whole CADDIS team.

21

Candidate CausesAlso useful for

Risk Assessment

Page 22: 1 CADDIS - Risk-based Prioritization and Diagnosing the Risk Drivers Susan Cormier, Ph.D. NCEA-Cincinnati and the whole CADDIS team.

22

Analyzing DataAlso useful for

Risk Assessment

Page 23: 1 CADDIS - Risk-based Prioritization and Diagnosing the Risk Drivers Susan Cormier, Ph.D. NCEA-Cincinnati and the whole CADDIS team.

23

Conceptual Models Also useful for

Risk Assessment

Databases

Page 24: 1 CADDIS - Risk-based Prioritization and Diagnosing the Risk Drivers Susan Cormier, Ph.D. NCEA-Cincinnati and the whole CADDIS team.

24

The Basic EA Framework

Condition Assessment

Outcome Assessment

Predictive Assessments

Causal Assessments

Page 25: 1 CADDIS - Risk-based Prioritization and Diagnosing the Risk Drivers Susan Cormier, Ph.D. NCEA-Cincinnati and the whole CADDIS team.

25

Stream Organisms

Degraded Stream

Organisms

mayfly caddisflystonefly

blackfly

pouch snail

chironomid

Page 26: 1 CADDIS - Risk-based Prioritization and Diagnosing the Risk Drivers Susan Cormier, Ph.D. NCEA-Cincinnati and the whole CADDIS team.

26

Page 27: 1 CADDIS - Risk-based Prioritization and Diagnosing the Risk Drivers Susan Cormier, Ph.D. NCEA-Cincinnati and the whole CADDIS team.

27

Case Study - Willimantic River, CT

#

Clean Water Act305b report to Congress

TMDLs target Cu, Pb, Zn

POTW

Page 28: 1 CADDIS - Risk-based Prioritization and Diagnosing the Risk Drivers Susan Cormier, Ph.D. NCEA-Cincinnati and the whole CADDIS team.

28

Roaring Brook, Willimantic River Watershed

Page 29: 1 CADDIS - Risk-based Prioritization and Diagnosing the Risk Drivers Susan Cormier, Ph.D. NCEA-Cincinnati and the whole CADDIS team.

29

Below POTW

Willimantic River

Above POTW

Page 30: 1 CADDIS - Risk-based Prioritization and Diagnosing the Risk Drivers Susan Cormier, Ph.D. NCEA-Cincinnati and the whole CADDIS team.

30

Invertebrate Index Scores as % of reference site RB1

0

20

40

60

80

100

RB1 FB2 FB5 MR1 MR2 MR3 WL1 WL2 WL3 WL4 SR HR TR

Moderately impaired

Define the Biological Impairment

First appearance of downstream impairment

Compared to further upstream

Not impaired

Impaired

Page 31: 1 CADDIS - Risk-based Prioritization and Diagnosing the Risk Drivers Susan Cormier, Ph.D. NCEA-Cincinnati and the whole CADDIS team.

31

Willimantic River Study Area

• Area of concern

• Upstream impairment identified

POTW

#

MR1 MR3

Page 32: 1 CADDIS - Risk-based Prioritization and Diagnosing the Risk Drivers Susan Cormier, Ph.D. NCEA-Cincinnati and the whole CADDIS team.

32

The Basic EA Framework

Condition Assessment

Outcome Assessment

Predictive Assessments

Causal Assessments

Page 33: 1 CADDIS - Risk-based Prioritization and Diagnosing the Risk Drivers Susan Cormier, Ph.D. NCEA-Cincinnati and the whole CADDIS team.

33

• Specific Causation– Causal: Did smoking cause my cancer– Risk: Will my smoking cause cancer

• General Causation– Causal: Does smoking cause cancer– Risk: Can smoking cause cancer

Types of Causation

Page 34: 1 CADDIS - Risk-based Prioritization and Diagnosing the Risk Drivers Susan Cormier, Ph.D. NCEA-Cincinnati and the whole CADDIS team.

34

• General Causation– Does C cause E– Can C cause E

• Specific Causation– Did C cause E– Will C cause E

Types of Causation

Evidence from the Case

Evidence from

the Elsewhere

Sources of Data for Evidence

Page 35: 1 CADDIS - Risk-based Prioritization and Diagnosing the Risk Drivers Susan Cormier, Ph.D. NCEA-Cincinnati and the whole CADDIS team.

35

Develop and Evaluate Evidence

• Refutation

• Diagnosis

• Weight of evidence

Page 36: 1 CADDIS - Risk-based Prioritization and Diagnosing the Risk Drivers Susan Cormier, Ph.D. NCEA-Cincinnati and the whole CADDIS team.

36Percent Fines

Pro

babi

lity

of

Obs

ervi

ng <

9 E

PT

Tax

a

0 20 40 60 80 100

0.0

0.2

0.4

0.6

0.8

1.0

Exposure Characterization

Cause/Effect Model

Logistic Regression MAIA Probability of <9 EPT for %fines

Risk of effect

Risk

Assessment

Page 37: 1 CADDIS - Risk-based Prioritization and Diagnosing the Risk Drivers Susan Cormier, Ph.D. NCEA-Cincinnati and the whole CADDIS team.

37Percent Fines

Pro

babi

lity

of

Obs

ervi

ng <

9 E

PT

Tax

a

0 20 40 60 80 100

0.0

0.2

0.4

0.6

0.8

1.0

Exposure Characterization

Cause/Effect Model

Logistic Regression MAIA Probability of <9 EPT for %finesCausal

Assessment

Page 38: 1 CADDIS - Risk-based Prioritization and Diagnosing the Risk Drivers Susan Cormier, Ph.D. NCEA-Cincinnati and the whole CADDIS team.

38

Middle River

Page 39: 1 CADDIS - Risk-based Prioritization and Diagnosing the Risk Drivers Susan Cormier, Ph.D. NCEA-Cincinnati and the whole CADDIS team.

39

Furnace Brook

Page 40: 1 CADDIS - Risk-based Prioritization and Diagnosing the Risk Drivers Susan Cormier, Ph.D. NCEA-Cincinnati and the whole CADDIS team.

40

List of Candidate Causes

1. toxicity from metals, ammonia (NH3), or a complex mixture

2. high flows removal of organisms during

3. settled particles filling interstitial habitat

4. low dissolved oxygen

5. thermal stress 6. altered food resources favoring filter feeders

Page 41: 1 CADDIS - Risk-based Prioritization and Diagnosing the Risk Drivers Susan Cormier, Ph.D. NCEA-Cincinnati and the whole CADDIS team.

41

Weight of evidence

• Types of evidence – Adapted from Hill’s Considerations

• Scoring– Source of information

• Observation• Manipulation• General Knowledge

– Quality of evidence• From the case or elsewhere• Specificity, Consistency and other qualities

Page 42: 1 CADDIS - Risk-based Prioritization and Diagnosing the Risk Drivers Susan Cormier, Ph.D. NCEA-Cincinnati and the whole CADDIS team.

42

Willimantic case study Metals NH3 Flow SiltLow DO

Temp Food Episodic

Mix

Spatial/Temporal Co-Occurrence

+ - + - - - + +

Evidence of Biological Mechanism

+ + - - + + + +

Causal Pathway - + - - + + +

Stressor-Response from the Field

+ - - + +

Manipulation of Exposure + + +

Verified Predictions + + +

Stressor-Response from Other Field Studies

- - +

Stressor-Response from Laboratory

+ + - - +

Consistency of Evidence - - - - - + + + + +

Weighted Body of Evidence

Page 43: 1 CADDIS - Risk-based Prioritization and Diagnosing the Risk Drivers Susan Cormier, Ph.D. NCEA-Cincinnati and the whole CADDIS team.

43

Invertebrate Index Scores as % of reference site RB1

0

20

40

60

80

100

RB1 FB2 FB5 MR1 MR2 MR3 WL1 WL2 WL3 WL4 SR HR TR

Cause: Toxic mixture

Source: Broken effluent pipe

Moderately impaired

Not impaired

Impaired

Page 44: 1 CADDIS - Risk-based Prioritization and Diagnosing the Risk Drivers Susan Cormier, Ph.D. NCEA-Cincinnati and the whole CADDIS team.

44

Unknown source

Sustained exposure

Episodic exposure

Ammonia levels greater upstream

Cr Cd & CuAl, Fe, Pb,

Ni, ZnAmmonia Mixture

Cr benchmark exceeded, but form not likely hexavalent Cr

Cu & Cd benchmarks

exceeded, but unimpaired sites also exceeded

Al, Fe, Pb, Ni, Zn did not exceed toxic benchmarks

Ammonia did not exceed toxic levels

After repairing broken pipe, Al, Cd, Cr, Pb, Fe, Zn decreased &

more species observed

Death or reproductive

failure

Loss of invertebrate

species

~ ~~~

~

Page 45: 1 CADDIS - Risk-based Prioritization and Diagnosing the Risk Drivers Susan Cormier, Ph.D. NCEA-Cincinnati and the whole CADDIS team.

45

Invertebrate Index Scores as % of reference site RB1

0

20

40

60

80

100

RB1 FB2 FB5 MR1 MR2 MR3 WL1 WL2 WL3 WL4 SR HR TR

Moderately impaired

Not impaired

Impaired

Cause: Heat &Altered food resources

Sources: Impoundments

Page 46: 1 CADDIS - Risk-based Prioritization and Diagnosing the Risk Drivers Susan Cormier, Ph.D. NCEA-Cincinnati and the whole CADDIS team.

46

Predictive Assessment

Risk: Repairing broken effluent pipe and reducing metal release from POTW—no risk assessment, legally required remedies and no associated risks.

Expectation: reduce toxic effects, returning this segment to condition similar to those upstream. Moderate effects from stressors associated unless old mill dams were

removed.

Risk: Removing dams: risk assessments of removal options necessary because unmanaged release of sediment would bury downstream reach and may contain toxic substances

Page 47: 1 CADDIS - Risk-based Prioritization and Diagnosing the Risk Drivers Susan Cormier, Ph.D. NCEA-Cincinnati and the whole CADDIS team.

47

Predictive AssessmentManagement: • Repair pipe —None, responsible parties complied. • More stringent NPDES permit at POTW—none,

responsible parties complied and monitoring of effluent continues.

• Removal of dams—Due to concerns about cost, social acceptance, and uncertainty of causes, CT DEP chose to study effects of impervious surfaces and dams on biological condition throughout the state. Small dams could provide aesthetically attractive cascades. Consultation with public would be required for optimizing benefits of selective dam removal.

Page 48: 1 CADDIS - Risk-based Prioritization and Diagnosing the Risk Drivers Susan Cormier, Ph.D. NCEA-Cincinnati and the whole CADDIS team.

48

The Basic EA Framework

Condition Assessment

Outcome Assessment

Predictive Assessments

Causal Assessments

Page 49: 1 CADDIS - Risk-based Prioritization and Diagnosing the Risk Drivers Susan Cormier, Ph.D. NCEA-Cincinnati and the whole CADDIS team.

49

After fixing the illicit discharge

Willimantic River WL 1

0102030405060708090

100

1999 2000 2001 2002 2003

% o

f Ref

eren

ce S

iteMiddle River MR3

0

20

40

60

80

100

1999 2000 2001 2002 2003

% o

f Ref

eren

ce S

ite

Meets Water Quality Criteria

Meets Water Quality Criteria

Willimantic River WL 1

0102030405060708090

100

1999 2000 2001 2002 2003

% o

f Ref

eren

ce S

iteMiddle River MR3

0

20

40

60

80

100

1999 2000 2001 2002 2003

% o

f Ref

eren

ce S

ite

Meets Water Quality Criteria

Meets Water Quality Criteria

Page 50: 1 CADDIS - Risk-based Prioritization and Diagnosing the Risk Drivers Susan Cormier, Ph.D. NCEA-Cincinnati and the whole CADDIS team.

50

CADDIS is a guide to causal inference for specific cases

www.epa.gov/caddis

[email protected]

513-569-7995

Page 51: 1 CADDIS - Risk-based Prioritization and Diagnosing the Risk Drivers Susan Cormier, Ph.D. NCEA-Cincinnati and the whole CADDIS team.

51

SHORT COURSE: Causal Analysis/Stressor Identification

by Susan Cormier

National Center for Environmental Assessment, USEPA, Cincinnati

Page 52: 1 CADDIS - Risk-based Prioritization and Diagnosing the Risk Drivers Susan Cormier, Ph.D. NCEA-Cincinnati and the whole CADDIS team.

52

Thank You

After viewing the links to additional resources, please complete our online feedback form.

Thank You

Links to Additional ResourcesLinks to Additional Resources

Feedback FormFeedback Form

52