Top Banner
1 of 83 The EPA 7-Step DQO Process Step 7 - Optimize Sample Design 30 PM - 4:45 PM (75 minutes) Presenters: Mitzi Miller and Al Robinson Day 2 DQO Training Course Module 9
83

1 of 83 The EPA 7-Step DQO Process Step 7 - Optimize Sample Design 3:30 PM - 4:45 PM (75 minutes) Presenters: Mitzi Miller and Al Robinson Day 2 DQO Training.

Mar 26, 2015

Download

Documents

Lily Snyder
Welcome message from author
This document is posted to help you gain knowledge. Please leave a comment to let me know what you think about it! Share it to your friends and learn new things together.
Transcript
Page 1: 1 of 83 The EPA 7-Step DQO Process Step 7 - Optimize Sample Design 3:30 PM - 4:45 PM (75 minutes) Presenters: Mitzi Miller and Al Robinson Day 2 DQO Training.

1 of 83

The EPA 7-Step DQO Process

Step 7 - Optimize Sample Design

3:30 PM - 4:45 PM (75 minutes)

Presenters:

Mitzi Miller and Al Robinson

Day 2 DQO Training CourseModule 9

Page 2: 1 of 83 The EPA 7-Step DQO Process Step 7 - Optimize Sample Design 3:30 PM - 4:45 PM (75 minutes) Presenters: Mitzi Miller and Al Robinson Day 2 DQO Training.

2 of 83

Terminal Course Objective

To be able to use the output from the previous DQO Process steps to select sampling and analysis designs and understand design alternatives presented to you for a specific project

Page 3: 1 of 83 The EPA 7-Step DQO Process Step 7 - Optimize Sample Design 3:30 PM - 4:45 PM (75 minutes) Presenters: Mitzi Miller and Al Robinson Day 2 DQO Training.

3 of 83

Step Objective:

Identify the most resource-effective data collection and analysis design that satisfies the DQOs specified in the preceding 6 steps

Step 7: Optimize Sample Design

Step 4: Specify Boundaries

Step 2: Identify Decisions

Step 3: Identify Inputs

Step 1: State the Problem

Step 5: Define Decision Rules

Step 6: Specify Error Tolerances

Step 7: Optimize Sample Design

Page 4: 1 of 83 The EPA 7-Step DQO Process Step 7 - Optimize Sample Design 3:30 PM - 4:45 PM (75 minutes) Presenters: Mitzi Miller and Al Robinson Day 2 DQO Training.

4 of 83

Information IN Actions Information OUT

From Previous Step To Next Step

Select the optimal sample size that satisfies the DQOs for each data collection design option

For each design option, select needed mathematical expressions

Check if number of samples exceeds project resource constraints

Decision Error Tolerances

Gray Region

Optimal Sample Design

Go back to Steps 1- 6 and revisit decisions. Yes

No

Review DQO outputs from Steps 1-6 to be sure they are internally consistent

Step 7- Optimize Sample Design

Develop alternative sample designs

Page 5: 1 of 83 The EPA 7-Step DQO Process Step 7 - Optimize Sample Design 3:30 PM - 4:45 PM (75 minutes) Presenters: Mitzi Miller and Al Robinson Day 2 DQO Training.

5 of 83

Information IN Actions Information OUT

From Previous Step To Next Step

Select the optimal sample size that satisfies the DQOs for each data collection design option

For each design option, select needed mathematical expressions

Check if number of samples exceeds project resource constraints

Decision Error Tolerances

Gray Region

Optimal Sample Design

Go back to Steps 1- 6 and revisit decisions. Yes

No

Review DQO outputs from Steps 1-6 to be sure they are internally consistent

Step 7- Optimize Sample Design

Develop alternative sample designsThe outputs should provideinformation on the contextof, requirements for, and constraints on data collectiondesign.

Page 6: 1 of 83 The EPA 7-Step DQO Process Step 7 - Optimize Sample Design 3:30 PM - 4:45 PM (75 minutes) Presenters: Mitzi Miller and Al Robinson Day 2 DQO Training.

6 of 83

Information IN Actions Information OUT

From Previous Step To Next Step

Select the optimal sample size that satisfies the DQOs for each data collection design option

For each design option, select needed mathematical expressions

Check if number of samples exceeds project resource constraints

Decision Error Tolerances

Gray Region

Optimal Sample Design

Go back to Steps 1- 6 and revisit decisions. Yes

No

Review DQO outputs from Steps 1-6 to be sure they are internally consistent

Step 7- Optimize Sample Design

Develop alternative sample designs

Based on the DQO outputs from Steps 1-6, for each decision rule develop one or more sample designs to be considered and evaluated inStep 7.

Page 7: 1 of 83 The EPA 7-Step DQO Process Step 7 - Optimize Sample Design 3:30 PM - 4:45 PM (75 minutes) Presenters: Mitzi Miller and Al Robinson Day 2 DQO Training.

7 of 83

Information IN Actions Information OUT

From Previous Step To Next Step

Select the optimal sample size that satisfies the DQOs for each data collection design option

For each design option, select needed mathematical expressions

Check if number of samples exceeds project resource constraints

Decision Error Tolerances

Gray Region

Optimal Sample Design

Go back to Steps 1- 6 and revisit decisions. Yes

No

Review DQO outputs from Steps 1-6 to be sure they are internally consistent

Step 7- Optimize Sample Design

Develop alternative sample designs

For each option, pay close attention to the Step 4 outputs defining the population to be representedwith the data:• Sample collection method• Sample mass size• Sample particle size• Etc.

Page 8: 1 of 83 The EPA 7-Step DQO Process Step 7 - Optimize Sample Design 3:30 PM - 4:45 PM (75 minutes) Presenters: Mitzi Miller and Al Robinson Day 2 DQO Training.

8 of 83

Information IN Actions Information OUT

From Previous Step To Next Step

Select the optimal sample size that satisfies the DQOs for each data collection design option

For each design option, select needed mathematical expressions

Check if number of samples exceeds project resource constraints

Decision Error Tolerances

Gray Region

Optimal Sample Design

Go back to Steps 1- 6 and revisit decisions. Yes

No

Review DQO outputs from Steps 1-6 to be sure they are internally consistent

Step 7- Optimize Sample Design

Develop alternative sample designs

Remember:Sampling Uncertainty is decreasedwhen sampling density is increased.

Page 9: 1 of 83 The EPA 7-Step DQO Process Step 7 - Optimize Sample Design 3:30 PM - 4:45 PM (75 minutes) Presenters: Mitzi Miller and Al Robinson Day 2 DQO Training.

9 of 83

Types of Designs

Simple Random

Statistical Methods for Environmental Pollution Monitoring, Richard O. Gilbert, 1987

Systematic Grid with random start Geometric Probability or “Hot Spot” Sampling Stratified Random

– Stratified Simple Random– Stratified Systematic Grid with random start

Page 10: 1 of 83 The EPA 7-Step DQO Process Step 7 - Optimize Sample Design 3:30 PM - 4:45 PM (75 minutes) Presenters: Mitzi Miller and Al Robinson Day 2 DQO Training.

10 of 83

Simple Random

Definition- choice of sampling location or time is random

Assumptions– Every portion of the population has equal

chance of being sampled Limitation-may not cover area

Page 11: 1 of 83 The EPA 7-Step DQO Process Step 7 - Optimize Sample Design 3:30 PM - 4:45 PM (75 minutes) Presenters: Mitzi Miller and Al Robinson Day 2 DQO Training.

11 of 83

Simple Random

To generate a simple random design:– Either grid the site - set up equal lateral

triangles or equal side rectangles and number each grid, use a random number generator to pick the grids from which to collect samples

– Randomly select x, y, z coordinates, go to the random coordinates and collect samples

Page 12: 1 of 83 The EPA 7-Step DQO Process Step 7 - Optimize Sample Design 3:30 PM - 4:45 PM (75 minutes) Presenters: Mitzi Miller and Al Robinson Day 2 DQO Training.

12 of 83

Example - Simple Random Using Coordinates

- A Random ly Selected Sam pling Location

- Denotes random length & width Coordinates walked-off bysam pling team

N168'

14

7'

Page 13: 1 of 83 The EPA 7-Step DQO Process Step 7 - Optimize Sample Design 3:30 PM - 4:45 PM (75 minutes) Presenters: Mitzi Miller and Al Robinson Day 2 DQO Training.

13 of 83

Systematic Grid, Random Start

Definition-taking measurements at locations or times according to spatial or temporal pattern (e.g., equidistant intervals along a line or grid pattern)

Assumptions– Good for estimating means, totals and patterns of

contamination– Improved coverage of area

Page 14: 1 of 83 The EPA 7-Step DQO Process Step 7 - Optimize Sample Design 3:30 PM - 4:45 PM (75 minutes) Presenters: Mitzi Miller and Al Robinson Day 2 DQO Training.

14 of 83

Systematic Grid, Random Start (cont.)

Limitations– Biased results can occur if assumed pattern of

contamination does not match the actual pattern of contamination

– Inaccurate if have serial correlation

Page 15: 1 of 83 The EPA 7-Step DQO Process Step 7 - Optimize Sample Design 3:30 PM - 4:45 PM (75 minutes) Presenters: Mitzi Miller and Al Robinson Day 2 DQO Training.

15 of 83

- Equally Spaced SamplingLocations

Nc

- Randomly Selected StartingLocation

Hot spot

Remember:Start at random locationMove in a pre-selected pattern across the site, making measurements at each point

Systematic Grid, Random Start (cont.)

Page 16: 1 of 83 The EPA 7-Step DQO Process Step 7 - Optimize Sample Design 3:30 PM - 4:45 PM (75 minutes) Presenters: Mitzi Miller and Al Robinson Day 2 DQO Training.

16 of 83

Geometric Probability or Hot-Spot Sampling

Uses squares, triangles, or rectangle to determine whether hot spots exist

Finds hot spot, but may not estimate the mean with adequate confidence

Page 17: 1 of 83 The EPA 7-Step DQO Process Step 7 - Optimize Sample Design 3:30 PM - 4:45 PM (75 minutes) Presenters: Mitzi Miller and Al Robinson Day 2 DQO Training.

17 of 83

Number of samples is calculated based on probability of finding hot area or geometric probability

Geometric Probability or Hot-Spot Sampling (cont.)

Assumptions– Target hot spot has circular or elliptical shape

– Samples are taken on square, rectangular or triangular grid

– Definition of what concentration/activity defines hot spot is unambiguous

Page 18: 1 of 83 The EPA 7-Step DQO Process Step 7 - Optimize Sample Design 3:30 PM - 4:45 PM (75 minutes) Presenters: Mitzi Miller and Al Robinson Day 2 DQO Training.

18 of 83

Limitations– Not appropriate for hot spots that are not elliptical

Geometric Probability or Hot-Spot Sampling (cont.)

– Not appropriate if cannot define what is hot or the likely size of hot spot

Page 19: 1 of 83 The EPA 7-Step DQO Process Step 7 - Optimize Sample Design 3:30 PM - 4:45 PM (75 minutes) Presenters: Mitzi Miller and Al Robinson Day 2 DQO Training.

19 of 83

Example Grid for Hot-Spot Sampling

Page 20: 1 of 83 The EPA 7-Step DQO Process Step 7 - Optimize Sample Design 3:30 PM - 4:45 PM (75 minutes) Presenters: Mitzi Miller and Al Robinson Day 2 DQO Training.

20 of 83

Hot-Spot Sampling

In order to use this approach the decision makers MUST – Define the size of the hot spot they wish to find – Define what constitutes HOT (e.g., what

concentration is HOT)– Define the effect of that HOT spot on achieving

the release criteria

Page 21: 1 of 83 The EPA 7-Step DQO Process Step 7 - Optimize Sample Design 3:30 PM - 4:45 PM (75 minutes) Presenters: Mitzi Miller and Al Robinson Day 2 DQO Training.

21 of 83

Stratified Random

Definition-divide population into strata and collect samples in each strata randomly

Attributes– Provides excellent coverage of area– Need process knowledge to create strata– Yields more precise estimate of mean– Typically more efficient then simple random

Limitations– Need process knowledge

Page 22: 1 of 83 The EPA 7-Step DQO Process Step 7 - Optimize Sample Design 3:30 PM - 4:45 PM (75 minutes) Presenters: Mitzi Miller and Al Robinson Day 2 DQO Training.

22 of 83

CS

Stratified Systematic Sampling

Process

Process

Side Slope Soils (Stratum 1)

Bottom of theexcavation

-20 ft(Stratum 2)

10 10020 8030 7040 60500

OriginalTrenchProfile

ft

Page 23: 1 of 83 The EPA 7-Step DQO Process Step 7 - Optimize Sample Design 3:30 PM - 4:45 PM (75 minutes) Presenters: Mitzi Miller and Al Robinson Day 2 DQO Training.

23 of 83

How Many Samples do I Need?

Begin With the Decision in Mind

Optimal Sampling Design

Alternative Sample Designs

, , , Correct Equation for n (Statistical Method)

Population Frequency Distribution

Contaminant Concentrations in the Spatial Distribution of the Population

The end

Data• field• onsite

methods• traditional

laboratory

Page 24: 1 of 83 The EPA 7-Step DQO Process Step 7 - Optimize Sample Design 3:30 PM - 4:45 PM (75 minutes) Presenters: Mitzi Miller and Al Robinson Day 2 DQO Training.

24 of 83

Logic to Assess Distribution and Calculate Number of Samples

SkewedCalculate the number of

samples based on skeweddistributions (e.g.,

nonparametric tests suchas WSR or WRS)

Is frequencydistribution from eachpopulation normal or

approximatelynormal?

NormalUse equations based on

normal distribution.

Option 1 Option 2

Badly SkewedBadly skewed or for any

distribution, use computersimulations

(e.g.,Monte Carlo) to performcalculations to estimate the

number of samples

Yes

No

Page 25: 1 of 83 The EPA 7-Step DQO Process Step 7 - Optimize Sample Design 3:30 PM - 4:45 PM (75 minutes) Presenters: Mitzi Miller and Al Robinson Day 2 DQO Training.

25 of 83

Sampling Approaches

Sampling Approach 1– Traditional fixed laboratory analyses

Sampling Approach 2– Field analytical measurements

– Computer simulations

– Dynamic work plan

Page 26: 1 of 83 The EPA 7-Step DQO Process Step 7 - Optimize Sample Design 3:30 PM - 4:45 PM (75 minutes) Presenters: Mitzi Miller and Al Robinson Day 2 DQO Training.

26 of 83

Sampling Approach 2

1. Perform field analytical (using driver COPCs) 2. Define separate populations (pseudo-homogeneous strata)

3. Estimate the distribution(s) based on field/historical data

4. If reasonably normal, use Equation 6.6 (parametric test)

5. If not, use either non-parametric tests or go on to #6

6. Perform simulations on the estimated distribution(s) to determine the number of multi-increment samples (n) required for lab analyses for each strata,varying , , and

7. Collect n samples, and evaluate m and k and perform lab analysis

8. Perform a red/yellow/green sequential test of data from the labs samples

9. Collect and/or analyze more increments (m) if in yellow region

10. Make the decision(s) when in the red/green region

11. Perform formal, overall DQA to confirm decision(s)

Page 27: 1 of 83 The EPA 7-Step DQO Process Step 7 - Optimize Sample Design 3:30 PM - 4:45 PM (75 minutes) Presenters: Mitzi Miller and Al Robinson Day 2 DQO Training.

27 of 83

Approach 2 Sampling & Lab Analyses

k = 3k = 3

m = 2

Laboratory

Page 28: 1 of 83 The EPA 7-Step DQO Process Step 7 - Optimize Sample Design 3:30 PM - 4:45 PM (75 minutes) Presenters: Mitzi Miller and Al Robinson Day 2 DQO Training.

28 of 83

Approach 2 Sampling & Lab Analyses (cont.)

n = m * k

Remember:Sampling Uncertainty is decreasedwhen sampling density is increased

Select k of specified Mass/diameter3

– FE² 22.5 * d³ / M (to control sampling error)

Prepare m multi-increment samples for lab analysis Perform lab analyses on m samples

Page 29: 1 of 83 The EPA 7-Step DQO Process Step 7 - Optimize Sample Design 3:30 PM - 4:45 PM (75 minutes) Presenters: Mitzi Miller and Al Robinson Day 2 DQO Training.

29 of 83

Information IN Actions Information OUT

From Previous Step To Next Step

Select the optimal sample size that satisfies the DQOs for each data collection design option

For each design option, select needed mathematical expressions

Check if number of samples exceeds project resource constraints

Decision Error Tolerances

Gray Region

Optimal Sample Design

Go back to Steps 1- 6 and revisit decisions. Yes

No

Review DQO outputs from Steps 1-6 to be sure they are internally consistent

Step 7- Optimize Sample Design

Develop alternative sample designs

1. Statistical Method/Sample Size Formula2. Cost Function

Page 30: 1 of 83 The EPA 7-Step DQO Process Step 7 - Optimize Sample Design 3:30 PM - 4:45 PM (75 minutes) Presenters: Mitzi Miller and Al Robinson Day 2 DQO Training.

30 of 83

Information IN Actions Information OUT

From Previous Step To Next Step

Select the optimal sample size that satisfies the DQOs for each data collection design option

For each design option, select needed mathematical expressions

Check if number of samples exceeds project resource constraints

Decision Error Tolerances

Gray Region

Optimal Sample Design

Go back to Steps 1- 6 and revisit decisions. Yes

No

Review DQO outputs from Steps 1-6 to be sure they are internally consistent

Step 7- Optimize Sample Design

Develop alternative sample designs

1. Statistical Method/Sample Size FormulaDefine suggested method(s) for testing the statistical hypothesis and define sample size formula(e) that corresponds to the method(s).

Page 31: 1 of 83 The EPA 7-Step DQO Process Step 7 - Optimize Sample Design 3:30 PM - 4:45 PM (75 minutes) Presenters: Mitzi Miller and Al Robinson Day 2 DQO Training.

31 of 83

Information IN Actions Information OUT

From Previous Step To Next Step

Select the optimal sample size that satisfies the DQOs for each data collection design option

For each design option, select needed mathematical expressions

Check if number of samples exceeds project resource constraints

Decision Error Tolerances

Gray Region

Optimal Sample Design

Go back to Steps 1- 6 and revisit decisions. Yes

No

Review DQO outputs from Steps 1-6 to be sure they are internally consistent

Step 7- Optimize Sample Design

Develop alternative sample designs

Perform a preliminary DQA:• Generate frequency distribution histogram(s) for each population• Select one or more statistical methods that will address the PSQs• List the assumptions for choosing these statistical methods• List the appropriate formula for calculating the number of

samples, n

Page 32: 1 of 83 The EPA 7-Step DQO Process Step 7 - Optimize Sample Design 3:30 PM - 4:45 PM (75 minutes) Presenters: Mitzi Miller and Al Robinson Day 2 DQO Training.

32 of 83

CS

Histogram

0123456789

10

0 0.1 0.2 0.3 0.4 0.5

Perimeter Co-60 Concentration (pCi/g)

Fre

qu

en

cy

Page 33: 1 of 83 The EPA 7-Step DQO Process Step 7 - Optimize Sample Design 3:30 PM - 4:45 PM (75 minutes) Presenters: Mitzi Miller and Al Robinson Day 2 DQO Training.

33 of 83

CS

Histogram (cont.)

0123456789

10

Perimeter Cs-137 Concentration (pCi/g)

Freq

uenc

y

Page 34: 1 of 83 The EPA 7-Step DQO Process Step 7 - Optimize Sample Design 3:30 PM - 4:45 PM (75 minutes) Presenters: Mitzi Miller and Al Robinson Day 2 DQO Training.

34 of 83

CS

Histogram (cont.)

0123456789

10

0 2 4 6 8 10 12 14

Perimeter Eu-152 Concentration (pCi/g)

Fre

qu

en

cy

Page 35: 1 of 83 The EPA 7-Step DQO Process Step 7 - Optimize Sample Design 3:30 PM - 4:45 PM (75 minutes) Presenters: Mitzi Miller and Al Robinson Day 2 DQO Training.

35 of 83

CS

Histogram (cont.)

0

1

23

4

5

6

0 1 2 3 4 5 6

Perimeter Sr-90 Concentration (pCi/g)

Fre

qu

en

cy

Page 36: 1 of 83 The EPA 7-Step DQO Process Step 7 - Optimize Sample Design 3:30 PM - 4:45 PM (75 minutes) Presenters: Mitzi Miller and Al Robinson Day 2 DQO Training.

36 of 83

Information IN Actions Information OUT

From Previous Step To Next Step

Select the optimal sample size that satisfies the DQOs for each data collection design option

For each design option, select needed mathematical expressions

Check if number of samples exceeds project resource constraints

Decision Error Tolerances

Gray Region

Optimal Sample Design

Go back to Steps 1- 6 and revisit decisions. Yes

No

Review DQO outputs from Steps 1-6 to be sure they are internally consistent

Step 7- Optimize Sample Design

Develop alternative sample designs

Using the formulae appropriate to these methods, calculate the number of samples required, varying , for a given .Repeat the same process using new s.

Review all of calculated sample sizes and along withtheir corresponding levels of , , and .

Select those sample sizes that have acceptable levels of , , and associated with them.

Page 37: 1 of 83 The EPA 7-Step DQO Process Step 7 - Optimize Sample Design 3:30 PM - 4:45 PM (75 minutes) Presenters: Mitzi Miller and Al Robinson Day 2 DQO Training.

37 of 83

3 Approaches for Calculating n

Normal approach Skewed approach FAM/DWP approach

– Badly skewed or for all distributions use computer simulation approach

• e.g., Monte Carlo

Page 38: 1 of 83 The EPA 7-Step DQO Process Step 7 - Optimize Sample Design 3:30 PM - 4:45 PM (75 minutes) Presenters: Mitzi Miller and Al Robinson Day 2 DQO Training.

38 of 83

Logic to Assess Distribution and Calculate Number of Samples

SkewedCalculate the number of

samples based on skeweddistributions (e.g.,

nonparametric tests suchas WSR or WRS)

Is frequencydistribution from eachpopulation normal or

approximatelynormal?

NormalUse equations based on

normal distribution.

Option 1 Option 2

Badly SkewedBadly skewed or for any

distribution, use computersimulations

(e.g.,Monte Carlo) to performcalculations to estimate the

number of samples

Yes

No

Page 39: 1 of 83 The EPA 7-Step DQO Process Step 7 - Optimize Sample Design 3:30 PM - 4:45 PM (75 minutes) Presenters: Mitzi Miller and Al Robinson Day 2 DQO Training.

39 of 83

Normal Approach

Due to using only 12 RI/FS samples for initial distribution assessment, one cannot infer a ‘normal’ frequency distribution

Reject the ‘Normal’ Approach and Examine ‘Non-Normal’or ‘Skewed’Approach

CS

Page 40: 1 of 83 The EPA 7-Step DQO Process Step 7 - Optimize Sample Design 3:30 PM - 4:45 PM (75 minutes) Presenters: Mitzi Miller and Al Robinson Day 2 DQO Training.

40 of 83

Logic to Assess Distribution and Calculate Number of Samples

SkewedCalculate the number of

samples based on skeweddistributions (e.g.,

nonparametric tests suchas WSR or WRS)

Is frequencydistribution from eachpopulation normal or

approximatelynormal?

NormalUse equations based on

normal distribution.

Option 1 Option 2

Badly SkewedBadly skewed or for any

distribution, use computersimulations

(e.g.,Monte Carlo) to performcalculations to estimate the

number of samples

Yes

No

Page 41: 1 of 83 The EPA 7-Step DQO Process Step 7 - Optimize Sample Design 3:30 PM - 4:45 PM (75 minutes) Presenters: Mitzi Miller and Al Robinson Day 2 DQO Training.

41 of 83

Design ApproachesApproach 1

Use predominantly fixed traditional laboratory analyses and specify the method specific details at the beginning of DQO and do not change measurement objectives as more information is obtained

Page 42: 1 of 83 The EPA 7-Step DQO Process Step 7 - Optimize Sample Design 3:30 PM - 4:45 PM (75 minutes) Presenters: Mitzi Miller and Al Robinson Day 2 DQO Training.

42 of 83

Cs-137, Eu-152

Because there were multiple COPCs with varied standard deviations, action limits and LBGRs, separate tables for varying alpha, beta, and (LBGR) delta were calculated

For the Cs-137, Eu-152 (in the perimeter samples), the number of samples for a given alpha, beta and delta are presented in the following table

CS

Page 43: 1 of 83 The EPA 7-Step DQO Process Step 7 - Optimize Sample Design 3:30 PM - 4:45 PM (75 minutes) Presenters: Mitzi Miller and Al Robinson Day 2 DQO Training.

43 of 83

Non-Parametric Test

For the Perimeter data Cs-137 and Eu-152 have the largest variance

For the Trench footprint data, Pu-239/240 andCs-137 are the only two COCs with action levels

The following table presents the variation of alpha, beta and deltas for – Cs-137 and Eu-152 in the Perimeter

– Pu-239/240 in the Trench Footprint

CS

Page 44: 1 of 83 The EPA 7-Step DQO Process Step 7 - Optimize Sample Design 3:30 PM - 4:45 PM (75 minutes) Presenters: Mitzi Miller and Al Robinson Day 2 DQO Training.

44 of 83

Cs-137 in Perimeter Based on Non-Parametric Test CSS a m p l e S i z e s B a s e d o n V a r y i n g E r r o r T o l e r a n c e s a n d L B G R

C s - 1 3 7 , A L = 6 . 2 p C i / g

M i s t a k e n l y C o n c l u d i n g < A c t i o n L e v e l

= 0 . 0 1 = 0 . 0 5 = 0 . 1 0

S a m p l e s i z e f o r m u l a :

W i d t h o f t h e G r a y R e g i o n , ( ) = 4 . 3 1 ( S D o f R I / F S d a t a )

= 0 . 1 0 1 9 1 2 9

= 0 . 2 0 1 5 9 7

Mis

tak

enly

Con

clu

din

g>

Act

ion

Lev

el

= 0 . 3 0 1 3 8 5

W i d t h o f t h e G r a y R e g i o n , ( ) = 5 0 % o f A c t i o n L e v e l

= 0 . 1 0 3 1 2 0 1 5

= 0 . 2 0 2 5 1 5 1 1

Mis

tak

enly

Con

clu

din

g>

Act

ion

Lev

el

= 0 . 3 0 2 1 1 2 8

W i d t h o f t h e G r a y R e g i o n , ( ) = 2 0 % o f A c t i o n L e v e l

= 0 . 1 0 1 8 6 1 2 2 9 3

= 0 . 2 0 1 4 4 8 9 6 5

Mis

tak

enly

Con

clu

din

g>

Act

ion

Lev

el

= 0 . 3 0 1 1 7 6 8 4 7

212

211

2

5.016.1

ZZZ

n

Page 45: 1 of 83 The EPA 7-Step DQO Process Step 7 - Optimize Sample Design 3:30 PM - 4:45 PM (75 minutes) Presenters: Mitzi Miller and Al Robinson Day 2 DQO Training.

45 of 83

CSEu-152 in Perimeter Based on Non-Parametric TestS a m p l e S i z e s B a s e d o n V a r y i n g E r r o r T o l e r a n c e s a n d L B G R

E u - 1 5 2 , A L = 3 . 3 p C i / g

M i s t a k e n l y C o n c l u d i n g < A c t i o n L e v e l

= 0 . 0 1 = 0 . 0 5 = 0 . 1 0

S a m p l e s i z e f o r m u l a :

W i d t h o f t h e G r a y R e g i o n , ( ) = 3 . 6 1 5 ( S D o f R I / F S d a t a ) a

= 0 . 1 0 N / A N / A N / A

= 0 . 2 0 N / A N / A N / A

Mis

tak

enly

Con

clu

din

g>

Act

ion

Lev

el

= 0 . 3 0 N / A N / A N / A

W i d t h o f t h e G r a y R e g i o n , ( ) = 5 0 % o f A c t i o n L e v e l

= 0 . 1 0 7 6 5 0 3 8

= 0 . 2 0 6 0 3 6 2 7

Mis

tak

enly

Con

clu

din

g>

Act

ion

Lev

el

= 0 . 3 0 4 9 2 8 2 0

W i d t h o f t h e G r a y R e g i o n , ( ) = 2 0 % o f A c t i o n L e v e l

= 0 . 1 0 4 5 7 3 0 0 2 3 0

= 0 . 2 0 3 5 3 2 1 7 1 5 8

Mis

tak

enly

Con

clu

din

g>

Act

ion

Lev

el

= 0 . 3 0 2 8 6 1 6 6 1 1 5

( a ) T h e d e l t a i s g r e a t e r t h a n t h e A L , s o n o s a m p l e n u m b e r s c a l c u l a t e d .

212

211

2

5.016.1

ZZZ

n

Page 46: 1 of 83 The EPA 7-Step DQO Process Step 7 - Optimize Sample Design 3:30 PM - 4:45 PM (75 minutes) Presenters: Mitzi Miller and Al Robinson Day 2 DQO Training.

46 of 83

Pu-239/240 Trench Footprint Non-Parametric TestS a m p l e S i z e s B a s e d o n V a r y i n g E r r o r T o l e r a n c e s a n d L B G R

P u - 2 3 9 / 2 4 0 , A L = 7 1 8 , 0 0 0 p C i / g

M i s t a k e n l y C o n c l u d i n g < A c t i o n L e v e l

= 0 . 0 1 = 0 . 0 5 = 0 . 1 0

S a m p l e s i z e f o r m u l a :

W i d t h o f t h e G r a y R e g i o n , ( ) = 0 . 7 9 5 ( S D o f R I / F S d a t a )

= 0 . 1 0 1 9 1 2 9

= 0 . 2 0 1 5 9 7

Mis

tak

enly

Con

clu

din

g>

Act

ion

Lev

el

= 0 . 3 0 1 3 8 5

W i d t h o f t h e G r a y R e g i o n , ( ) = 5 0 % o f A c t i o n L e v e l

= 0 . 1 0 4 2 1

= 0 . 2 0 4 2 1

Mis

tak

enly

Con

clu

din

g>

Act

ion

Lev

el

= 0 . 3 0 4 2 1

W i d t h o f t h e G r a y R e g i o n , ( ) = 2 0 % o f A c t i o n L e v e l

= 0 . 1 0 4 2 1

= 0 . 2 0 4 2 1

Mis

tak

enly

Con

clu

din

g>

Act

ion

Lev

el

= 0 . 3 0 4 2 1

212

211

2

5.016.1

ZZZ

n

CS

Page 47: 1 of 83 The EPA 7-Step DQO Process Step 7 - Optimize Sample Design 3:30 PM - 4:45 PM (75 minutes) Presenters: Mitzi Miller and Al Robinson Day 2 DQO Training.

47 of 83

Approach 1 Based Sampling Design Design for Radionuclide COCs in Perimeter Soil

– Alpha = 0.05 & Beta = 0.20; Delta = 20% of AL

– The number of samples in the Perimeter soil was driven by the Eu-152 data as taken from preceding table

• The decision makers agreed on collection of 217 surface samples from the Perimeter side-slope soils when excavation was complete

– The number of samples in the Trench footprint was the same for either the Pu-239/240 or Cs-137

CS

Page 48: 1 of 83 The EPA 7-Step DQO Process Step 7 - Optimize Sample Design 3:30 PM - 4:45 PM (75 minutes) Presenters: Mitzi Miller and Al Robinson Day 2 DQO Training.

48 of 83

Information IN Actions Information OUT

From Previous Step To Next Step

Select the optimal sample size that satisfies the DQOs for each data collection design option

For each design option, select needed mathematical expressions

Check if number of samples exceeds project resource constraints

Decision Error Tolerances

Gray Region

Optimal Sample Design

Go back to Steps 1- 6 and revisit decisions. Yes

No

Review DQO outputs from Steps 1-6 to be sure they are internally consistent

Step 7- Optimize Sample Design

Develop alternative sample designs

2. Cost FunctionFor each selected sample size, develop a costfunction that relates the number of samples to the total cost of sampling and analysis.

Page 49: 1 of 83 The EPA 7-Step DQO Process Step 7 - Optimize Sample Design 3:30 PM - 4:45 PM (75 minutes) Presenters: Mitzi Miller and Al Robinson Day 2 DQO Training.

49 of 83

Information IN Actions Information OUT

From Previous Step To Next Step

Select the optimal sample size that satisfies the DQOs for each data collection design option

For each design option, select needed mathematical expressions

Check if number of samples exceeds project resource constraints

Decision Error Tolerances

Gray Region

Optimal Sample Design

Go back to Steps 1- 6 and revisit decisions. Yes

No

Review DQO outputs from Steps 1-6 to be sure they are internally consistent

Step 7- Optimize Sample Design

Develop alternative sample designs

In order to develop the cost function, the aggregate unit cost persample must be determined. This is the cost of collecting one sample and conducting all the required analyses for a given decision rule.

Page 50: 1 of 83 The EPA 7-Step DQO Process Step 7 - Optimize Sample Design 3:30 PM - 4:45 PM (75 minutes) Presenters: Mitzi Miller and Al Robinson Day 2 DQO Training.

50 of 83

Information IN Actions Information OUT

From Previous Step To Next Step

Select the optimal sample size that satisfies the DQOs for each data collection design option

For each design option, select needed mathematical expressions

Check if number of samples exceeds project resource constraints

Decision Error Tolerances

Gray Region

Optimal Sample Design

Go back to Steps 1- 6 and revisit decisions. Yes

No

Review DQO outputs from Steps 1-6 to be sure they are internally consistent

Step 7- Optimize Sample Design

Develop alternative sample designs

These costs include:• The unit sample collection cost• The unit field analysis cost• The unit laboratory analysis cost

For each analytical method selected in Step 3, there isa unit sample collection cost and a unit sampleanalytical cost.

Page 51: 1 of 83 The EPA 7-Step DQO Process Step 7 - Optimize Sample Design 3:30 PM - 4:45 PM (75 minutes) Presenters: Mitzi Miller and Al Robinson Day 2 DQO Training.

51 of 83

Information IN Actions Information OUT

From Previous Step To Next Step

Select the optimal sample size that satisfies the DQOs for each data collection design option

For each design option, select needed mathematical expressions

Check if number of samples exceeds project resource constraints

Decision Error Tolerances

Gray Region

Optimal Sample Design

Go back to Steps 1- 6 and revisit decisions. Yes

No

Review DQO outputs from Steps 1-6 to be sure they are internally consistent

Step 7- Optimize Sample Design

Develop alternative sample designs

1. Add the unit sample collection cost (USC$) and the unitsample analytical cost (USA$) for each method chosen.

2. Sum each of the above values for all of the analyticalmethods chosen to get the aggregate unit sample collection and analysis cost (AUSCA$).

Page 52: 1 of 83 The EPA 7-Step DQO Process Step 7 - Optimize Sample Design 3:30 PM - 4:45 PM (75 minutes) Presenters: Mitzi Miller and Al Robinson Day 2 DQO Training.

52 of 83

AUSCA$ = USC$ + USA$ Where (here):USC$ = Unit Sample Collection CostUSA$ = Unit Sample Analysis CostAUSCA$ = Aggregate Unit Sample Collection and Analysis Costn = Number of analytical methods planned

Aggregate Unit Sampling and Analysis Cost

i=1

n

Page 53: 1 of 83 The EPA 7-Step DQO Process Step 7 - Optimize Sample Design 3:30 PM - 4:45 PM (75 minutes) Presenters: Mitzi Miller and Al Robinson Day 2 DQO Training.

53 of 83

Total Sampling and Analysis CostAnalytical Methods Unit Sample Analysis Cost ($)

Low Medium HighCs-137, Co-60, Eu-152,154,155 (HPGE) 230.00$ 290.00$ 400.00$

Sr-90 185.00$ 230.00$ 325.00$

Pu-239/240 (AEA) 275.00$ 345.00$ 480.00$

Total USA$ 690.00$ 865.00$ 1,205.00$ Unit Sample Collection Cost 70.00$ 80.00$ 90.00$ AUSCA$ = USC$ + total USA$ 760.00$ 945.00$ 1,295.00$

CS

Page 54: 1 of 83 The EPA 7-Step DQO Process Step 7 - Optimize Sample Design 3:30 PM - 4:45 PM (75 minutes) Presenters: Mitzi Miller and Al Robinson Day 2 DQO Training.

54 of 83

Information IN Actions Information OUT

From Previous Step To Next Step

Select the optimal sample size that satisfies the DQOs for each data collection design option

For each design option, select needed mathematical expressions

Check if number of samples exceeds project resource constraints

Decision Error Tolerances

Gray Region

Optimal Sample Design

Go back to Steps 1- 6 and revisit decisions. Yes

No

Review DQO outputs from Steps 1-6 to be sure they are internally consistent

Step 7- Optimize Sample Design

Develop alternative sample designs

Merge the selected sample size outputs with the Aggregate Unit Sample Collection and Analysis cost output.

This results in a table that shows the product of each selected sample size and the AUSCA$.

This table is used to present the project managers and decision makers with a range of analytical costs and the resulting uncertainties.

From the table, select the optimal sample size that meets the project budgetand uncertainty requirements.

Page 55: 1 of 83 The EPA 7-Step DQO Process Step 7 - Optimize Sample Design 3:30 PM - 4:45 PM (75 minutes) Presenters: Mitzi Miller and Al Robinson Day 2 DQO Training.

55 of 83

CSAreas to be Investigated

Process

10 10020 8030 7040 60500

Process

About 30 ft of layback toaccomodate 1.5/1 slope

from 20 ft down

29.4 mor 97 ft

11.2 mor 37 ft

50.25 m, 166 ft

32.3 m, 106 ft

Original Trench ProfileArea to be left at -20 ft

Plan View

Page 56: 1 of 83 The EPA 7-Step DQO Process Step 7 - Optimize Sample Design 3:30 PM - 4:45 PM (75 minutes) Presenters: Mitzi Miller and Al Robinson Day 2 DQO Training.

56 of 83

Remediation Costs

Trench is a rectangle 106 ft (32.3 m) long and 37 ft (11.2 m) wide

Estimated working zone with trench centered within is 166 ft (50.3 m) by 97 ft (29.4 m)– Area of Trench is 3,922 ft2

– Area of Perimeter Zone is 12,180 ft2 (excluding Trench area)

CS

Page 57: 1 of 83 The EPA 7-Step DQO Process Step 7 - Optimize Sample Design 3:30 PM - 4:45 PM (75 minutes) Presenters: Mitzi Miller and Al Robinson Day 2 DQO Training.

57 of 83

Volume of Trench, -5 to -20 ft, is 1,654 yd3

Assume $200/yd3 for Soil Being Disposed – Cost of Excavation $330,800

Volume of Perimeter Zone, 1.5/1 slope from 20 ft depth, is 4,507 yd3 (excluding Trench area), Volume of 5 ft of Overburden is 551 yd3,

$100/yd3 Onsite Use– Cost of Excavation $505,800

Remediation Costs (cont.)CS

Page 58: 1 of 83 The EPA 7-Step DQO Process Step 7 - Optimize Sample Design 3:30 PM - 4:45 PM (75 minutes) Presenters: Mitzi Miller and Al Robinson Day 2 DQO Training.

58 of 83

Design Options and Costs for RadionuclidesApproach 1, Based on 2 Strata

CS

Radionuclides Traditional Radiochemistry Methods

DR # Alpha BetaWidth of Gray Region

(UBGR-LBGR)Number* of Samples, n AUSCA$

Total Sampling and Analytical

Cost

1, 2 0.01 0.1 0.2 AL 461 $945 $435,6450.05 0.2 0.2 AL 219 $945 $206,9550.1 0.3 0.2 AL 116 $945 $109,620

1, 2 0.01 0.1 0.5 AL 80 $945 $75,6000.05 0.2 0.5 AL 38 $945 $35,9100.1 0.3 0.5 AL 21 $945 $19,845

*n is from slides #44 and #45

Page 59: 1 of 83 The EPA 7-Step DQO Process Step 7 - Optimize Sample Design 3:30 PM - 4:45 PM (75 minutes) Presenters: Mitzi Miller and Al Robinson Day 2 DQO Training.

59 of 83

Approach 1 Based Sampling Design Compare Approach 1 S&A costs versus

remediation costs – Approach 1 S&A costs = $206,955 – Remediation costs = $836,600

• Cost to remediate surface soil around perimeter of trench: $330,800

• Cost to remediate subsurface soil under footprint of trench: $505,800

– Total Analytical + Remediation costs = $1,044,000

CS

Page 60: 1 of 83 The EPA 7-Step DQO Process Step 7 - Optimize Sample Design 3:30 PM - 4:45 PM (75 minutes) Presenters: Mitzi Miller and Al Robinson Day 2 DQO Training.

60 of 83

Information IN Actions Information OUT

From Previous Step To Next Step

Select the optimal sample size that satisfies the DQOs for each data collection design option

For each design option, select needed mathematical expressions

Check if number of samples exceeds project resource constraints

Decision Error Tolerances

Gray Region

Optimal Sample Design

Go back to Steps 1- 6 and revisit decisions. Yes

No

Review DQO outputs from Steps 1-6 to be sure they are internally consistent

Step 7- Optimize Sample Design

Develop alternative sample designs

If no sample design meets the error tolerances within the budget orconsider Approach 2, relax one or more of the constraints or request more funding, etc.

Page 61: 1 of 83 The EPA 7-Step DQO Process Step 7 - Optimize Sample Design 3:30 PM - 4:45 PM (75 minutes) Presenters: Mitzi Miller and Al Robinson Day 2 DQO Training.

61 of 83

Design - ApproachesApproach 2: Dynamic Work Plan (DWP) & Field Analytical Methods (FAMs)

Use DWP to allow more field decisions to meet the measurement objectives and allow the objectives to be refined in the field using dynamic work plans

Manage uncertainty by increasing sample density by using field analytical measurements

Page 62: 1 of 83 The EPA 7-Step DQO Process Step 7 - Optimize Sample Design 3:30 PM - 4:45 PM (75 minutes) Presenters: Mitzi Miller and Al Robinson Day 2 DQO Training.

62 of 83

Approach 2 Sampling Design Phase 1: Cs-137 FAM

– Establish cost of FAM– Provide detailed SOP for performance of in-situ

Cs-137 surveys– Choose a grid size/shape– Following completion of excavation, perform NaI

survey for Cs-137• Will produce a representative distribution used to

calculate the number of samples for laboratory verification analysis for the perimeter side-slope soils after excavation

CS

Page 63: 1 of 83 The EPA 7-Step DQO Process Step 7 - Optimize Sample Design 3:30 PM - 4:45 PM (75 minutes) Presenters: Mitzi Miller and Al Robinson Day 2 DQO Training.

63 of 83

Phase 1: Cs-137

– Approach 2 will not be applied to the floor of the excavation

• Current RI/FS data for the floor of the excavation in the trench shows site is far below the AL

– RIFS data estimate 2 samples needed• Using LBGR of 80% of AL• Alpha=0.05, Beta = 0.2

– Present this information along with the recommended designs to the decision makers for review and approval

Approach 2 Sampling Design (cont.)CS

Page 64: 1 of 83 The EPA 7-Step DQO Process Step 7 - Optimize Sample Design 3:30 PM - 4:45 PM (75 minutes) Presenters: Mitzi Miller and Al Robinson Day 2 DQO Training.

64 of 83

Phase 2: Cs-137

– Evaluate the FAM results • Evaluate distribution for Cs-137 data

– Using the appropriate statistics, • Calculate the mean and standard deviation • Select appropriate alpha, beta, and delta values, and

estimate the resulting n based on the Cs-137 data

– Collect n samples to confirm the FAM data • Using traditional laboratory analysis per SW-846 or

other appropriate methods listed in Step 3

CSApproach 2 Sampling Design (cont.)

Page 65: 1 of 83 The EPA 7-Step DQO Process Step 7 - Optimize Sample Design 3:30 PM - 4:45 PM (75 minutes) Presenters: Mitzi Miller and Al Robinson Day 2 DQO Training.

65 of 83

Utilize in-situ MCA NaI survey of Cs-137 Established a 5 ft square grid over the

perimeter side-slope soils after excavation– 5 ft grid chosen based on professional judgement– Approximately 122 nodes (approximately half a

day to perform)– Used a random start and performed 30 sec.

counts at each node of the grid

CSApproach 2 Sampling Design (cont.)

Page 66: 1 of 83 The EPA 7-Step DQO Process Step 7 - Optimize Sample Design 3:30 PM - 4:45 PM (75 minutes) Presenters: Mitzi Miller and Al Robinson Day 2 DQO Training.

66 of 83

Data from similar site– Data showed a non-normal distribution– Calculated mean of 0.28 pCi/g– Calculated standard deviation of 1.02 pCi/g

Choosing alpha=0.05, beta=0.2, delta = 20% of action level– 7 samples needed

CSApproach 2 Sampling Design (cont.)

Page 67: 1 of 83 The EPA 7-Step DQO Process Step 7 - Optimize Sample Design 3:30 PM - 4:45 PM (75 minutes) Presenters: Mitzi Miller and Al Robinson Day 2 DQO Training.

67 of 83

Basis for Above Analysis CostsNaI

2 person and equipment per day $2,000.00# analyses/day 444cost/sample 4.50$

On-Site Analytical Cost Without PCBs

Unit Sample Analysis Cost

NaI In-situ measurement $4.50

Total USA$ $4.50

Unit Sample Collection Cost NA

AUSCA$ = USC$ + total USA$ $4.50

CS

Approach 2 Sampling Design (cont.)

Page 68: 1 of 83 The EPA 7-Step DQO Process Step 7 - Optimize Sample Design 3:30 PM - 4:45 PM (75 minutes) Presenters: Mitzi Miller and Al Robinson Day 2 DQO Training.

68 of 83

Method Number of Samples, n AUSCA$

Total Sampling and Analytical Cost

NaI In-situ 122 $4.5 $549Total $549

On-Site Analyses Costs

CSApproach 2 Sampling Design (cont.)

Page 69: 1 of 83 The EPA 7-Step DQO Process Step 7 - Optimize Sample Design 3:30 PM - 4:45 PM (75 minutes) Presenters: Mitzi Miller and Al Robinson Day 2 DQO Training.

69 of 83

CS

Approach 2 Sampling Design (cont.)

Number of Samples, n AUSCA$

Total Sampling and Analytical Cost

Subtotal from NaI 122 4.5 $549Radionuclides Traditional Laboratory Methods 7 $945 $6,615Total Costs On-site and Lab Methods $7,164

Confirmatory Traditional Laboratory Analyses Costs

Page 70: 1 of 83 The EPA 7-Step DQO Process Step 7 - Optimize Sample Design 3:30 PM - 4:45 PM (75 minutes) Presenters: Mitzi Miller and Al Robinson Day 2 DQO Training.

70 of 83

Evaluate costs of Approach 2 vs. Approach 1 and remediation costs– Approach 2 S&A costs = $7,164– Approach 1 S&A costs = $206,955– Original budget for S&A = $50,000

– Remediation costs = $836,600• Cost to remediate surface soil around perimeter of trench:

$330,800• Cost to remediate subsurface soil under footprint of

trench: $505,800

CS

Approach 2 Sampling Design (cont.)

Page 71: 1 of 83 The EPA 7-Step DQO Process Step 7 - Optimize Sample Design 3:30 PM - 4:45 PM (75 minutes) Presenters: Mitzi Miller and Al Robinson Day 2 DQO Training.

71 of 83

Approach 2 Was SelectedMost Cost-Effective

andBest Uncertainty Management

Page 72: 1 of 83 The EPA 7-Step DQO Process Step 7 - Optimize Sample Design 3:30 PM - 4:45 PM (75 minutes) Presenters: Mitzi Miller and Al Robinson Day 2 DQO Training.

72 of 83

Analysis for Radionuclide COCs– Methods to analyze all of the COCs in soil

samples are available– All samples will be shipped and processed as

one batch to decrease QC cost

Approach 2 Based Sampling Design (cont.)

CS

Page 73: 1 of 83 The EPA 7-Step DQO Process Step 7 - Optimize Sample Design 3:30 PM - 4:45 PM (75 minutes) Presenters: Mitzi Miller and Al Robinson Day 2 DQO Training.

73 of 83

Design for Radionuclide COCs– For each batch, QC will include, as appropriate

1 LCS, 1 method blank, 1 equipment blank (if field equipment is reused between collection of each sample).

– Step 3 of the DQO lists the QC measurement criteria

Approach 2 Based Sampling Design (cont.)

CS

Page 74: 1 of 83 The EPA 7-Step DQO Process Step 7 - Optimize Sample Design 3:30 PM - 4:45 PM (75 minutes) Presenters: Mitzi Miller and Al Robinson Day 2 DQO Training.

74 of 83

Design for Radionuclide COC Sample analysis– Preservation will not be necessary– QA plan will be written and reviewed by

decision makers before implementation

Approach 2 Based Sampling Design (cont.)

CS

Page 75: 1 of 83 The EPA 7-Step DQO Process Step 7 - Optimize Sample Design 3:30 PM - 4:45 PM (75 minutes) Presenters: Mitzi Miller and Al Robinson Day 2 DQO Training.

75 of 83

Steps 1- 6

Step 7

Optimal Design

Iterative Process

Page 76: 1 of 83 The EPA 7-Step DQO Process Step 7 - Optimize Sample Design 3:30 PM - 4:45 PM (75 minutes) Presenters: Mitzi Miller and Al Robinson Day 2 DQO Training.

76 of 83

Information IN Actions Information OUT

From Previous Step To Next Step

Select the optimal sample size that satisfies the DQOs for each data collection design option

For each design option, select needed mathematical expressions

Check if number of samples exceeds project resource constraints

Decision Error Tolerances

Gray Region

Optimal Sample Design

Go back to Steps 1- 6 and revisit decisions. Yes

No

Review DQO outputs from Steps 1-6 to be sure they are internally consistent

Step 7- Optimize Sample Design

Develop alternative sample designs

Justification for a judgmental sampling design• Timeframe• Qualitative consequences of an inadequate sampling

design (low, moderate, severe)• Re-sampling access after decision has been made

(accessible or inaccessible)

Page 77: 1 of 83 The EPA 7-Step DQO Process Step 7 - Optimize Sample Design 3:30 PM - 4:45 PM (75 minutes) Presenters: Mitzi Miller and Al Robinson Day 2 DQO Training.

77 of 83

WARNING!!If a judgmental design is selected in lieu of a statistical design the

following disclaimer must be stated in the DQO Summary Report:

“Results from a judgmental sampling design can only be used to make decisions about the locations from which the samples were taken and cannot be generalized or extrapolated to any other facility or population, and error analysis cannot be performed on the resulting data. Thus, using judgmental designs prohibits any assessment of uncertainty in the decisions.”

Page 78: 1 of 83 The EPA 7-Step DQO Process Step 7 - Optimize Sample Design 3:30 PM - 4:45 PM (75 minutes) Presenters: Mitzi Miller and Al Robinson Day 2 DQO Training.

78 of 83

Information IN Actions Information OUT

From Previous Step To Next Step

Select the optimal sample size that satisfies the DQOs for each data collection design option

For each design option, select needed mathematical expressions

Check if number of samples exceeds project resource constraints

Decision Error Tolerances

Gray Region

Optimal Sample Design

Go back to Steps 1- 6 and revisit decisions. Yes

No

Review DQO outputs from Steps 1-6 to be sure they are internally consistent

Step 7- Optimize Sample Design

Develop alternative sample designsThe output is the most resource-effective design forthe study that is expected toachieve the DQOs.

Page 79: 1 of 83 The EPA 7-Step DQO Process Step 7 - Optimize Sample Design 3:30 PM - 4:45 PM (75 minutes) Presenters: Mitzi Miller and Al Robinson Day 2 DQO Training.

79 of 83

Data Quality Assessment Step 1: Review DQOs and Sampling Design

Guidance for Data Quality Assessment,EPA QA/G9, 2000

Step 2: Conduct Preliminary Data Review Step 3: Select the Statistical Test Step 4: Verify the Assumptions of the Test Step 5: Draw Conclusions From the Data

Page 80: 1 of 83 The EPA 7-Step DQO Process Step 7 - Optimize Sample Design 3:30 PM - 4:45 PM (75 minutes) Presenters: Mitzi Miller and Al Robinson Day 2 DQO Training.

80 of 83

To succeed in a systematic planning process for environmental decision making, you need need Statistical Support:Statistical Support:

One or more qualified statisticiansqualified statisticians, experienced in environmental data collection designsenvironmental data collection designs and statistical statistical data quality assessmentsdata quality assessments of such designs.

Summary

Page 81: 1 of 83 The EPA 7-Step DQO Process Step 7 - Optimize Sample Design 3:30 PM - 4:45 PM (75 minutes) Presenters: Mitzi Miller and Al Robinson Day 2 DQO Training.

81 of 83

Summary (cont.) Going through the 7-Step DQO Process will

ensure a defensible and cost effective sampling program

In order for the 7-Step DQO Process to be effective: – Senior management MUST provide support

– Inputs must be based on comprehensive scoping and maximum participation/contributions by decision makers

– Sample design must be based on the severity of the consequences of decision error

– Uncertainty must be identified and quantified

Page 82: 1 of 83 The EPA 7-Step DQO Process Step 7 - Optimize Sample Design 3:30 PM - 4:45 PM (75 minutes) Presenters: Mitzi Miller and Al Robinson Day 2 DQO Training.

82 of 83

Information IN Actions Information OUT

From Previous Step To Next Step

Select the optimal sample size that satisfies the DQOs for each data collection design option

For each design option, select needed mathematical expressions

Check if number of samples exceeds project resource constraints

Decision Error Tolerances

Gray Region

Optimal Sample Design

Go back to Steps 1- 6 and revisit decisions. Yes

No

Review DQO outputs from Steps 1-6 to be sure they are internally consistent

Step 7- Optimize Sample Design

Develop alternative sample designs

Page 83: 1 of 83 The EPA 7-Step DQO Process Step 7 - Optimize Sample Design 3:30 PM - 4:45 PM (75 minutes) Presenters: Mitzi Miller and Al Robinson Day 2 DQO Training.

83 of 83

End of Module 9

Thank you