AREVA RISK MANAGEMENT CONSULTING · process in to the UK, the process known as Data Quality...

40
AREVA RISK MANAGEMENT CONSULTING Application of Systematic Planning and Visual Sample Plan Software Steven Wilcox 14 th June 2016

Transcript of AREVA RISK MANAGEMENT CONSULTING · process in to the UK, the process known as Data Quality...

Page 1: AREVA RISK MANAGEMENT CONSULTING · process in to the UK, the process known as Data Quality Objectives is a seven step planning process that aids in the development of statistical

AREVA RISK MANAGEMENT CONSULTING

Application of Systematic Planning and Visual Sample Plan Software

Steven Wilcox 14th June 2016

Page 2: AREVA RISK MANAGEMENT CONSULTING · process in to the UK, the process known as Data Quality Objectives is a seven step planning process that aids in the development of statistical

2

11 Years in the Nuclear IndustrySteven Wilcox

Profile:

Steven has gained 11 years experience of environmental work through working directly within the nuclear industry. His work has primarily focussed on systematic planning and assessment (radiological and non-radiological) using the USEPA,s systematic planning process. Steven was part of a team that introduced this process in to the UK, the process known as Data Quality Objectives is a seven step planning process that aids in the development of statistical and non-statistical sampling designs.

• DQO Facilitator for a major site de-licensing project

• Development and delivery of a UK 5-day residential Training course.

• Development and Delivery of Sampling Plans for CBRN (Biological & Chemical)

• DQO support for various projects within the UK

• DQO support for major Characterisation project

• Appointed by PNNL as a beta tester for VSP, the only person in the UK to have this privilege, which enables him to direct the development to take into account of UK usage

• Data Quality Objective studies (Facilitation, Development, Training)

• Sampling and analysis identification, Data processing, document review, statistical analysis and assessment

[email protected]

Telephone: 01235 555755

Contact Email:

Experience: Key Skills areas:

Page 3: AREVA RISK MANAGEMENT CONSULTING · process in to the UK, the process known as Data Quality Objectives is a seven step planning process that aids in the development of statistical

Agenda

3

Systematic Planning

• Life Cycle

• Why

• How

Support Tools

• Visual Sample Plan

Sample Collection

Sample Assessment

Applications

Page 4: AREVA RISK MANAGEMENT CONSULTING · process in to the UK, the process known as Data Quality Objectives is a seven step planning process that aids in the development of statistical

How Many Samples?

How many samples do I need?

Always the first question we are asked.

4

5? or 50?

Page 5: AREVA RISK MANAGEMENT CONSULTING · process in to the UK, the process known as Data Quality Objectives is a seven step planning process that aids in the development of statistical

Systematic PlanningLife Cycle

Planning

Implementation

Assessment

Decision

Survey design developed and documented

Survey design is implemented

Data are validated to ensure that the resultscollected support the survey objectives

Decisions made based on the conclusionsdrawn from the assessment process

Page 6: AREVA RISK MANAGEMENT CONSULTING · process in to the UK, the process known as Data Quality Objectives is a seven step planning process that aids in the development of statistical

Systematic planning

6

Why?

First Level Avoids wasting time and money

Just the right amount of data is collected

Samples taken represent the whole population

Easily balance resources with cost

Minimises useless data

Promotes Communication

Reduces risk of third-party challenges

Reduces unnecessary re-work / clean up

Page 7: AREVA RISK MANAGEMENT CONSULTING · process in to the UK, the process known as Data Quality Objectives is a seven step planning process that aids in the development of statistical

Systematic planning

7

How?

Sample and Analysis Plans

Full TransparencyUses Proven

Statistical techniques

Partnership Approach

Page 8: AREVA RISK MANAGEMENT CONSULTING · process in to the UK, the process known as Data Quality Objectives is a seven step planning process that aids in the development of statistical

Why Plan?

8

Provides a framework to correctly define the criteria that the

data collection design should satisfy

Helps to assure the type, quantity, and quality of data used in a decision is appropriate

Project managers do not commit resources to collecting data that

will not ultimately be used

Provides clarity to all stakeholders on the information to be collected and how it will be used.

One type of structured planning process for collection of "good"environmental data to support decision-making is the “Data Quality Objective” (DQO) methodology.

Page 9: AREVA RISK MANAGEMENT CONSULTING · process in to the UK, the process known as Data Quality Objectives is a seven step planning process that aids in the development of statistical

Seven Logical steps of DQO

9

State the ProblemIdentify the Aims

of the Study

Identify Information

Inputs

Develop the

Sampling Design

Specify Performance/

Acceptance Criteria

Develop Analytical

Approach

Define Boundaries

of the Study

May need to return to prior steps asnew data and information become

available

Page 10: AREVA RISK MANAGEMENT CONSULTING · process in to the UK, the process known as Data Quality Objectives is a seven step planning process that aids in the development of statistical

DQO is Designed to Answer.....

10

Why is the data

needed?

What type of data

is needed?

Were should the data

be collected?

How will the data

be used?

When should the data

Be collected?

How often are you

willing to make errors ?

How much data

is needed?

PLANNING

PHASE

Page 11: AREVA RISK MANAGEMENT CONSULTING · process in to the UK, the process known as Data Quality Objectives is a seven step planning process that aids in the development of statistical

Support Tool

11

Associated software to determine the number and location of samples to support confident, statistically defensible decisions.

Incorporates Data Quality Assessment

Free VSP Download at http://vsp.pnl.gov

Visual Sample Plan (VSP)

Page 12: AREVA RISK MANAGEMENT CONSULTING · process in to the UK, the process known as Data Quality Objectives is a seven step planning process that aids in the development of statistical

Why VSP

12

Supports and helps underpin the DQO (Planning) methodology

Excellent visualisation

User friendly

Removes the guess work from deciding on samples

Enabled the use of complex statistical equations

• through a guided interface (expert mentor)• produced a visual output of the number and locations of samples required• led to a statistically defensible sampling strategy

Electronic records for the future

Supports defensible decisions

Saves time (example: report generator)

Saves money (less sample numbers)

Identified that its not a “black-box”

Page 13: AREVA RISK MANAGEMENT CONSULTING · process in to the UK, the process known as Data Quality Objectives is a seven step planning process that aids in the development of statistical

VSP Features

13

Supports various statistical sampling options • Simple random sampling• Systematic grid sampling• Sequential sampling • Collaborative sampling• Stratified sampling• Rank-set sampling• Adaptive cluster sampling• Continuous transect sampling• Judgmental sampling• Combined judgmental and probabilistic sampling• Item sampling

Page 14: AREVA RISK MANAGEMENT CONSULTING · process in to the UK, the process known as Data Quality Objectives is a seven step planning process that aids in the development of statistical

Indoor Surface Sampling and Analysis

14

Accurate 3-D Representations

Zoning of Areas

Indoor Coordinate System

Furniture Placement/Sampling

Sample Results Visualized

Wipe or Point Samples

dxf or shp files imported/exported

Page 15: AREVA RISK MANAGEMENT CONSULTING · process in to the UK, the process known as Data Quality Objectives is a seven step planning process that aids in the development of statistical

Outdoor Sampling and Analysis

15

Maps, Photos/Images

Maintains Coordinate System

Output For GPS

Multiple Analytes and Sample Areas

Page 16: AREVA RISK MANAGEMENT CONSULTING · process in to the UK, the process known as Data Quality Objectives is a seven step planning process that aids in the development of statistical

Item Sampling

16

How Many Items Should I Sample?

Drums, Folders, Property, Equipment, Widgets….

X% Confident that Y% Are Acceptable

4 Options Available

• Using Prior Knowledge• Judgment w/ Random• Probabilistic Only• Allow Some Unacceptable

Page 17: AREVA RISK MANAGEMENT CONSULTING · process in to the UK, the process known as Data Quality Objectives is a seven step planning process that aids in the development of statistical

Sampling and Analysis Over Time

17

Sample requirements for confidently detecting trends

Fitting linear and exponential trends

Evaluating consistency of trends over time

Projections of when target concentration will be obtained

Adjustments for seasonal effects

Sampling frequency reduction analyses

Page 18: AREVA RISK MANAGEMENT CONSULTING · process in to the UK, the process known as Data Quality Objectives is a seven step planning process that aids in the development of statistical

Spatial Sampling and Analysis

18

Geospatial Kriging

Spatial sample/well redundancy analysis

Optimization of sample/well placement

Maps of probability of exceeding concentration threshold

Page 19: AREVA RISK MANAGEMENT CONSULTING · process in to the UK, the process known as Data Quality Objectives is a seven step planning process that aids in the development of statistical

Unexploded Ordnance (UXO) Sites

19

Transect design for detection of target areas

Target area flagging, delineation, anomaly density mapping and estimation

Post-remediation verification sampling

This Method has been developed for radiological Surveys

Page 20: AREVA RISK MANAGEMENT CONSULTING · process in to the UK, the process known as Data Quality Objectives is a seven step planning process that aids in the development of statistical

Building The Sample Plan

20

Using Visual Sample Plan

Page 21: AREVA RISK MANAGEMENT CONSULTING · process in to the UK, the process known as Data Quality Objectives is a seven step planning process that aids in the development of statistical

Construct The Sampling Area(s)

21

Page 22: AREVA RISK MANAGEMENT CONSULTING · process in to the UK, the process known as Data Quality Objectives is a seven step planning process that aids in the development of statistical

Identify Possible Risks

22

Classification 1

• Zone/area is known or assumed to be contaminated (e.g. I don’t need to be statically confidence / Collect a few samples)

Classification 2

• Zone/area is likely to be contaminated (e.g. I want 99% confidence)

Classification 3

• Zone/area is unlikely to be contaminated (e.g. I want 95% confidence)

Classification 4

• Zone/area is known or assumed not to be contaminated (e.g. I will just collected a few non-statistical samples)

THIS WILL ALLOW YOU TO ASSIGN A DIFFERENT SAMPLING DESIGN OR ADJUST YOUR CONFIDENCE LEVELS

Page 23: AREVA RISK MANAGEMENT CONSULTING · process in to the UK, the process known as Data Quality Objectives is a seven step planning process that aids in the development of statistical

Select Zone and Choose The Sampling Goal of the Study

23

Based on objective(s) set within your planning phase

Page 24: AREVA RISK MANAGEMENT CONSULTING · process in to the UK, the process known as Data Quality Objectives is a seven step planning process that aids in the development of statistical

Generate Sampling Plan

24

Page 25: AREVA RISK MANAGEMENT CONSULTING · process in to the UK, the process known as Data Quality Objectives is a seven step planning process that aids in the development of statistical

Add Multiple Floors

25

Page 26: AREVA RISK MANAGEMENT CONSULTING · process in to the UK, the process known as Data Quality Objectives is a seven step planning process that aids in the development of statistical

Add a Background Picture

26

Page 27: AREVA RISK MANAGEMENT CONSULTING · process in to the UK, the process known as Data Quality Objectives is a seven step planning process that aids in the development of statistical

Adding More Detail

27

Page 28: AREVA RISK MANAGEMENT CONSULTING · process in to the UK, the process known as Data Quality Objectives is a seven step planning process that aids in the development of statistical

Viewing More Detail

28

(3D Walk round)

Page 29: AREVA RISK MANAGEMENT CONSULTING · process in to the UK, the process known as Data Quality Objectives is a seven step planning process that aids in the development of statistical

Undertake Sample Collection

&Sample Analysis

29

Page 30: AREVA RISK MANAGEMENT CONSULTING · process in to the UK, the process known as Data Quality Objectives is a seven step planning process that aids in the development of statistical

Collect the Samples

30

Page 31: AREVA RISK MANAGEMENT CONSULTING · process in to the UK, the process known as Data Quality Objectives is a seven step planning process that aids in the development of statistical

Undertake AssessmentUndertake Assessment of

Sample Results

Page 32: AREVA RISK MANAGEMENT CONSULTING · process in to the UK, the process known as Data Quality Objectives is a seven step planning process that aids in the development of statistical

Data Quality Assessment

32

(DQA)

Review DQO and

Sampling Design

Conduct Preliminary

Data ReviewSelect Statistical

Test

Draw conclusions

from the Data

Verify the

AssumptionsDQA involves Five Steps

Page 33: AREVA RISK MANAGEMENT CONSULTING · process in to the UK, the process known as Data Quality Objectives is a seven step planning process that aids in the development of statistical

Add Results from Multiple Analysis

33

Page 34: AREVA RISK MANAGEMENT CONSULTING · process in to the UK, the process known as Data Quality Objectives is a seven step planning process that aids in the development of statistical

View the Summary Statistics

34

Page 35: AREVA RISK MANAGEMENT CONSULTING · process in to the UK, the process known as Data Quality Objectives is a seven step planning process that aids in the development of statistical

View the Data Plots

35

Page 36: AREVA RISK MANAGEMENT CONSULTING · process in to the UK, the process known as Data Quality Objectives is a seven step planning process that aids in the development of statistical

Test the Sample Results

36

Page 37: AREVA RISK MANAGEMENT CONSULTING · process in to the UK, the process known as Data Quality Objectives is a seven step planning process that aids in the development of statistical

Generate an Assessment Report

37

Page 38: AREVA RISK MANAGEMENT CONSULTING · process in to the UK, the process known as Data Quality Objectives is a seven step planning process that aids in the development of statistical

Applications

38

UK

• Waste Characterisation• Site Clearance• Site De-licensing• Response and Recovery of Chemical/Biological/Radiation Terrorist Event

US

• Environmental Characterization and Remediation • Environmental Monitoring • Response and Recovery of Chemical/Biological/Radiation Terrorist Event• Footprint Reduction and Remediation of Unexploded Ordnance (UXO) • Sites Sampling of Soils, Buildings, Groundwater, Sediment, Surface Water,

Subsurface Layers

Any time samples are collected to make a decision

This process can be USED

Page 39: AREVA RISK MANAGEMENT CONSULTING · process in to the UK, the process known as Data Quality Objectives is a seven step planning process that aids in the development of statistical

39

Questions?

Page 40: AREVA RISK MANAGEMENT CONSULTING · process in to the UK, the process known as Data Quality Objectives is a seven step planning process that aids in the development of statistical

RISK MANAGEMENT CONSULTING

www.arevarmc.com