Top Banner
1 of 86 The EPA 7-Step DQO Process Step 7 - Optimize Sample Design (70 minutes) Presenter: Sebastian Tindall Day 2 DQO Training Course Module 7
86

The EPA 7-Step DQO Process

Jan 30, 2016

Download

Documents

Iain

Day 2 DQO Training Course Module 7. The EPA 7-Step DQO Process. Step 7 - Optimize Sample Design. Presenter: Sebastian Tindall. (70 minutes). Terminal Course Objective. - PowerPoint PPT Presentation
Welcome message from author
This document is posted to help you gain knowledge. Please leave a comment to let me know what you think about it! Share it to your friends and learn new things together.
Transcript
Page 1: The EPA 7-Step DQO Process

1 of 86

The EPA 7-Step DQO Process

Step 7 - Optimize Sample Design

(70 minutes)

Presenter:

Sebastian Tindall

Day 2 DQO Training CourseModule 7

Page 2: The EPA 7-Step DQO Process

2 of 86

Terminal Course Objective

To be able to use the output from the previous DQO Process steps to select sampling and analysis designs and understand design alternatives presented to you for a specific project

Page 3: The EPA 7-Step DQO Process

3 of 86

Step Objective:Identify the most resourceeffective data collectionand analysis design thatsatisfies the DQOsspecified in the preceding 6steps

Step 7: Optimize Sample Design

Step 4: Specify Boundaries

Step 2: Identify Decisions

Step 3: Identify Inputs

Step 1: State the Problem

Step 5: Define Decision Rules

Step 6: Specify Error Tolerances

Step 7: Optimize Sample Design

Page 4: The EPA 7-Step DQO Process

4 of 86

Information IN Actions Information OUT

From Previous Step To Next Step

Select the optimal sample size that satisfies the DQOs for each data collection design option

For each design option, select needed mathematical expressions

Check if number of samples exceeds project resource constraints

Decision Error Tolerances

Gray Region

Optimal Sample Design

Go back to Steps 1- 6 and revisit decisions. Yes

No

Review DQO outputs from Steps 1-6 to be sure they are internally consistent

Step 7- Optimize Sample Design

Develop alternative sample designs

Page 5: The EPA 7-Step DQO Process

5 of 86

Information IN Actions Information OUT

From Previous Step To Next Step

Select the optimal sample size that satisfies the DQOs for each data collection design option

For each design option, select needed mathematical expressions

Check if number of samples exceeds project resource constraints

Decision Error Tolerances

Gray Region

Review DQO outputs from Steps 1-6 to be sure they are internally consistent

Step 7- Optimize Sample Design

Develop alternative sample designsThe outputs should provideinformation on the contextof, requirements for, and constraints on data collectiondesign.

Optimal Sample Design

Go back to Steps 1- 6 and revisit decisions. Yes

No

Page 6: The EPA 7-Step DQO Process

6 of 86

Optimal Sample Design

Go back to Steps 1- 6 and revisit decisions. Yes

No

Information IN Actions Information OUT

From Previous Step To Next Step

Select the optimal sample size that satisfies the DQOs for each data collection design option

For each design option, select needed mathematical expressions

Check if number of samples exceeds project resource constraints

Decision Error Tolerances

Gray Region

Review DQO outputs from Steps 1-6 to be sure they are internally consistent

Step 7- Optimize Sample Design

Develop alternative sample designs

Based on the DQO outputs from Steps 1-6, for each decision rule develop one or more sample designs to be considered and evaluated inStep 7.

Page 7: The EPA 7-Step DQO Process

7 of 86

Optimal Sample Design

Go back to Steps 1- 6 and revisit decisions. Yes

No

Information IN Actions Information OUT

From Previous Step To Next Step

Select the optimal sample size that satisfies the DQOs for each data collection design option

For each design option, select needed mathematical expressions

Check if number of samples exceeds project resource constraints

Decision Error Tolerances

Gray Region

Review DQO outputs from Steps 1-6 to be sure they are internally consistent

Step 7- Optimize Sample Design

Develop alternative sample designs

For each option, pay close attention to the Step 4 outputs defining the population to be representedwith the data:• Sample collection method• Sample mass size• Sample particle size• Etc.

Page 8: The EPA 7-Step DQO Process

8 of 86

Information IN Actions Information OUT

From Previous Step To Next Step

Select the optimal sample size that satisfies the DQOs for each data collection design option

For each design option, select needed mathematical expressions

Check if number of samples exceeds project resource constraints

Decision Error Tolerances

Gray Region

Review DQO outputs from Steps 1-6 to be sure they are internally consistent

Step 7- Optimize Sample Design

Develop alternative sample designs

Remember:Sampling Uncertainty is decreasedwhen sampling density is increased.

Optimal Sample Design

Go back to Steps 1- 6 and revisit decisions. Yes

No

Page 9: The EPA 7-Step DQO Process

9 of 86

Types of Designs

Simple Random

Statistical Methods for Environmental Pollution Monitoring, Richard O. Gilbert, 1987

Systematic Grid with random start Geometric Probability or “Hot Spot” Sampling Stratified Random

– Stratified Simple Random– Stratified Systematic Grid with random start

Page 10: The EPA 7-Step DQO Process

10 of 86

Simple Random

Definition- choice of sampling location or time is random

Assumptions– Every portion of the population has equal

chance of being sampled Limitation-may not cover area

Page 11: The EPA 7-Step DQO Process

11 of 86

Simple Random

To generate a simple random design:– Either grid the site - set up equal lateral

triangles or equal side rectangles and number each grid, use a random number generator to pick the grids from which to collect samples

– Randomly select x, y, z coordinates, go to the random coordinates and collect samples

Page 12: The EPA 7-Step DQO Process

12 of 86

Example - Simple Random Using Coordinates

- A Random ly Selected Sam pling Location

- Denotes random length & width Coordinates walked-off bysam pling team

N168'

14

7'

Page 13: The EPA 7-Step DQO Process

13 of 86

Systematic Grid, Random Start

Definition-taking measurements at locations or times according to spatial or temporal pattern (e.g., equidistant intervals along a line or grid pattern)

Assumptions– Good for estimating means, totals and patterns of

contamination– Improved coverage of area

Page 14: The EPA 7-Step DQO Process

14 of 86

Systematic Grid, Random Start (cont.)

Limitations– Biased results can occur if assumed pattern of

contamination does not match the actual pattern of contamination

– Inaccurate if have serial correlation NPDES outfall

– Periodic recurring release; time dependent Groundwater:

– seasonal recurrence; water-level dependence

Page 15: The EPA 7-Step DQO Process

15 of 86

- Equally Spaced SamplingLocations

Nc

- Randomly Selected StartingLocation

Hot spot

Remember:Start at random locationMove in a pre-selected pattern across the site, making measurements at each point

Systematic Grid, Random Start (cont.)

Page 16: The EPA 7-Step DQO Process

16 of 86

Geometric Probability or Hot-Spot Sampling

Uses squares, triangles, or rectangles to determine whether hot spots exist

Finds hot spot, but may not estimate the mean with adequate confidence

Page 17: The EPA 7-Step DQO Process

17 of 86

Number of samples is calculated based on probability of finding hot area or geometric probability

Geometric Probability or Hot-Spot Sampling (cont.)

Assumptions– Target hot spot has circular or elliptical shape

– Samples are taken on square, rectangular or triangular grid

– Definition of what concentration/activity defines hot spot is unambiguous

Page 18: The EPA 7-Step DQO Process

18 of 86

Limitations– Not appropriate for hot spots that are not elliptical

Geometric Probability or Hot-Spot Sampling (cont.)

– Not appropriate if cannot define what is hot or the likely size of hot spot

Page 19: The EPA 7-Step DQO Process

19 of 86

Example Grid for Hot-Spot Sampling

Page 20: The EPA 7-Step DQO Process

20 of 86

In order to use this approach the decision makers MUST – Define the size of the hot spot they wish to find– Provide rationale for specifying that size.– Define what constitutes HOT (e.g., what

concentration is HOT)– Define the effect of that HOT spot on achieving

the release criteria

Geometric Probability or Hot-Spot Sampling (cont.)

Page 21: The EPA 7-Step DQO Process

21 of 86

Stratified Random

Definition-divide population into strata and collect samples in each strata randomly

Attributes– Provides excellent coverage of area– Need process knowledge to create strata– Yields more precise estimate of mean– Typically more efficient then simple random

Limitations– Need process knowledge

Page 22: The EPA 7-Step DQO Process

22 of 86

Example - Stratified SimpleRandom

Strata 1

Strata 2

Page 23: The EPA 7-Step DQO Process

23 of 86

Sampling Approaches

Sampling Approach 1– Simple Random

– Traditional fixed laboratory analyses

Sampling Approach 2– Systematic Grid

– Field analytical measurements

– Computer simulations

– Dynamic work plan

Page 24: The EPA 7-Step DQO Process

24 of 86

Approach 1 Sample DesignCS

Plan View

Former PadLocation

RunoffZone

0 50 100 150 ft0 15 30 46 m

BufferZone

Page 25: The EPA 7-Step DQO Process

25 of 86

Design ApproachesApproach 1

Collect samples using Simple Random design.

Use predominantly fixed traditional laboratory analyses and specify the method specific details at the beginning of DQO and do not change measurement objectives as more information is obtained

Page 26: The EPA 7-Step DQO Process

26 of 86

Information IN Actions Information OUT

From Previous Step To Next Step

Select the optimal sample size that satisfies the DQOs for each data collection design option

For each design option, select needed mathematical expressions

Check if number of samples exceeds project resource constraints

Decision Error Tolerances

Gray Region

Review DQO outputs from Steps 1-6 to be sure they are internally consistent

Step 7- Optimize Sample Design

Develop alternative sample designs

1. Statistical Method/Sample Size Formula2. Cost Function

Optimal Sample Design

Go back to Steps 1- 6 and revisit decisions. Yes

No

Page 27: The EPA 7-Step DQO Process

27 of 86

Optimal Sample Design

Go back to Steps 1- 6 and revisit decisions. Yes

No

Information IN Actions Information OUT

From Previous Step To Next Step

Select the optimal sample size that satisfies the DQOs for each data collection design option

For each design option, select needed mathematical expressions

Check if number of samples exceeds project resource constraints

Decision Error Tolerances

Gray Region

Review DQO outputs from Steps 1-6 to be sure they are internally consistent

Step 7- Optimize Sample Design

Develop alternative sample designs

1. Statistical Method/Sample Size FormulaDefine suggested method(s) for testing the statistical hypothesis and define sample size formula(e) that corresponds to the method(s).

Page 28: The EPA 7-Step DQO Process

28 of 86

Optimal Sample Design

Go back to Steps 1- 6 and revisit decisions. Yes

No

Information IN Actions Information OUT

From Previous Step To Next Step

Select the optimal sample size that satisfies the DQOs for each data collection design option

For each design option, select needed mathematical expressions

Check if number of samples exceeds project resource constraints

Decision Error Tolerances

Gray Region

Review DQO outputs from Steps 1-6 to be sure they are internally consistent

Step 7- Optimize Sample Design

Develop alternative sample designs

Perform a preliminary DQA:• Generate frequency distribution histogram(s) for each population• Select one or more statistical methods that will address the PSQs• List the assumptions for choosing these statistical methods• List the appropriate formula for calculating the number of

samples, n

Page 29: The EPA 7-Step DQO Process

29 of 86

HistogramCS

0

1

2

3

0 7 14 21 28 35

Pb Concentration (mg/kg)

Fre

qu

en

cy

0

1

2

3

4

0 85 95 105 115

U Concentration

Fre

qu

en

cy0

1

2

3

4

0 1.7 3.4 5.1 6.8

TPH Concentration

Fre

qu

en

cy

0

1

2

3

0 0.8 1.6 2.4 3.2

Arochlor 1260

Fre

qu

en

cy

Page 30: The EPA 7-Step DQO Process

30 of 86

3 Approaches for Calculating n

Normal approach Skewed approach FAM/DWP approach

– Badly skewed or for all distributions use computer simulation approach

• e.g., Monte Carlo

Page 31: The EPA 7-Step DQO Process

31 of 86

How Many Samples do I Need?

Begin With the Decision in Mind

Optimal Sampling Design

Alternative Sample Designs

, , , Correct Equation for n (Statistical Method)

Population Frequency Distribution

Contaminant Concentrations in the Spatial Distribution of the Population

The end

Data• field• onsite

methods• traditional

laboratory

Page 32: The EPA 7-Step DQO Process

32 of 86

Logic to Assess Distribution and Calculate Number of Samples

SkewedCalculate the number of

samples based on skeweddistributions (e.g.,

nonparametric tests suchas WSR or WRS)

Is frequencydistribution fromeach populationsymmetrical orapproximatelysymmetrical?

SymmetricalUse equations based onsymmetrical distribution.

Option 1 Option 2

Badly SkewedBadly skewed or for any

distribution, use computersimulations

(e.g.,Monte Carlo) to performcalculations to estimate the

number of samples

Yes

No

Page 33: The EPA 7-Step DQO Process

33 of 86

Normal Approach

Due to using only five samples for initial distribution assessment, one cannot infer a ‘normal’ frequency distribution

Reject the ‘Normal’ Approach and Examine ‘Non-Normal’or ‘Skewed’ Approach

CS

Page 34: The EPA 7-Step DQO Process

34 of 86

Logic to Assess Distribution and Calculate Number of Samples

SkewedCalculate the number of

samples based on skeweddistributions (e.g.,

nonparametric tests suchas WSR or WRS)

Is frequencydistribution fromeach populationsymmetrical orapproximatelysymmetrical?

SymmetricalUse equations based onsymmetrical distribution.

Option 1 Option 2

Badly SkewedBadly skewed or for any

distribution, use computersimulations

(e.g.,Monte Carlo) to performcalculations to estimate the

number of samples

Yes

No

Page 35: The EPA 7-Step DQO Process

35 of 86

Information IN Actions Information OUT

From Previous Step To Next Step

Select the optimal sample size that satisfies the DQOs for each data collection design option

For each design option, select needed mathematical expressions

Check if number of samples exceeds project resource constraints

Decision Error Tolerances

Gray Region

Review DQO outputs from Steps 1-6 to be sure they are internally consistent

Step 7- Optimize Sample Design

Develop alternative sample designs

Using the formulae appropriate to these methods, calculate the number of samples required, varying , for a given .Repeat the same process using new s.

Review all of calculated sample sizes and along withtheir corresponding levels of , , and .

Select those sample sizes that have acceptable levels of , , and associated with them.

Optimal Sample Design

Go back to Steps 1- 6 and revisit decisions. Yes

No

Page 36: The EPA 7-Step DQO Process

36 of 86

Pb, U, TPH (DRO/GRO) Because there were multiple COPCs with

varied standard deviations, action limits and LBGRs, separate tables for varying alpha, beta, and (LBGR) delta were calculated

For the U, Pb, and TPH, the largest number of samples for a given alpha, beta and delta are presented in the following table

CS

Page 37: The EPA 7-Step DQO Process

37 of 86

Pb, U, TPH Based on Non-Parametric Test CSS a m p l e S i z e s B a s e d o n V a r y i n g E r r o r T o l e r a n c e s a n d L B G R

L e a d , U r a n i u m , a n d T P H

M i s t a k e n l y C o n c l u d i n g < A c t i o n L e v e l

s = 1 0 . 5 ( U ) = 0 . 0 1 = 0 . 0 5 = 0 . 1 0

S a m p l e s i z e f o r m u l a : 2)(

)(16.1

12

2

2211

Sn

W i d t h o f t h e G r a y R e g i o n , ( ) = 2 4 0 – 2 2 9 . 5 = 1 0 . 5 ( t o t a l e r r o r e s t i m a t e )

= 0 . 1 0 1 9 1 2 9

= 0 . 2 0 1 5 9 7

Mis

tak

enly

Con

clu

din

g>

Act

ion

Lev

el

= 0 . 3 0 1 3 8 5

W i d t h o f t h e G r a y R e g i o n , ( ) = 2 4 0 – 1 9 2 = 4 8 ( 2 0 % o f a c t i o n l e v e l )

= 0 . 1 0 4 3 2

= 0 . 2 0 4 2 2

Mis

tak

enly

Con

clu

din

g>

Act

ion

Lev

el

= 0 . 3 0 4 2 2

W i d t h o f t h e G r a y R e g i o n , ( ) = 2 4 0 – 1 2 0 = 1 2 0 ( 5 0 % o f a c t i o n l e v e l )

= 0 . 1 0 4 2 2

= 0 . 2 0 4 2 1

Mis

tak

enly

Con

clu

din

g>

Act

ion

Lev

el

= 0 . 3 0 4 2 1

Page 38: The EPA 7-Step DQO Process

38 of 86

Aroclor 1260- Non-Parametric Test

For PCBs, the Aroclor 1260 has the greatest variance and using the standard deviation results in a wide gray region

The following table presents the variation of alpha, beta and deltas for Aroclor 1260

CS

Page 39: The EPA 7-Step DQO Process

39 of 86

Aroclor 1260- Non-Parametric Test CSS a m p l e S i z e s B a s e d o n V a r y i n g E r r o r T o l e r a n c e s a n d L B G R

P C B s ( b a s e d o n A r o c l o r 1 2 6 0 )

M i s t a k e n l y C o n c l u d i n g < A c t i o n L e v e l

s = 0 . 8 8 ( A - 1 2 6 0 ) = 0 . 0 1 = 0 . 0 5 = 0 . 1 0

S a m p l e s i z e f o r m u l a : 2)(

)(16.1

12

2

2211

Sn

W i d t h o f t h e G r a y R e g i o n , ( ) = 1 – 0 . 1 2 = 0 . 8 8 ( t o t a l e r r o r e s t i m a t e ) a

= 0 . 1 0 1 9 1 2 9

= 0 . 2 0 1 5 9 7

Mis

tak

enly

Con

clu

din

g>

Act

ion

Lev

el

= 0 . 3 0 1 3 8 5

W i d t h o f t h e G r a y R e g i o n , ( ) = 1 – 0 . 8 0 = 0 . 2 0 ( 2 0 % o f a c t i o n l i m i t )

= 0 . 1 0 2 9 6 1 9 4 1 4 9

= 0 . 2 0 2 2 9 1 4 1 1 0 3

Mis

tak

enly

Con

clu

din

g>

Act

ion

Lev

el

= 0 . 3 0 1 8 6 1 0 8 7 5

W i d t h o f t h e G r a y R e g i o n , ( ) = 1 - 0 . 5 0 = 0 . 5 0 ( 5 0 % o f a c t i o n l i m i t )

= 0 . 1 0 5 0 3 3 2 5

= 0 . 2 0 4 0 2 4 1 8

Mis

tak

enly

Con

clu

din

g>

Act

ion

Lev

el

= 0 . 3 0 3 3 1 9 1 3

a T h e t o t a l e r r o r e s t i m a t e f o r s u b s u r f a c e c o n c e n t r a t i o n s e x c e e d s t h e a c t i o n l i m i t , t h u s i n a p p r o p r i a t e l y m o v i n g t h e L B G R b e l o w z e r o . O n l y t h e s u r f a c e c o n c e n t r a t i o n e r r o r e s t i m a t e i s c o n s i d e r e d h e r e f o r t h a t r e a s o n .

Page 40: The EPA 7-Step DQO Process

40 of 86

Optimal Sample Design

Go back to Steps 1- 6 and revisit decisions. Yes

No

Information IN Actions Information OUT

From Previous Step To Next Step

Select the optimal sample size that satisfies the DQOs for each data collection design option

For each design option, select needed mathematical expressions

Check if number of samples exceeds project resource constraints

Decision Error Tolerances

Gray Region

Review DQO outputs from Steps 1-6 to be sure they are internally consistent

Step 7- Optimize Sample Design

Develop alternative sample designs

2. Cost FunctionFor each selected sample size, develop a costfunction that relates the number of samples to the total cost of sampling and analysis.

Page 41: The EPA 7-Step DQO Process

41 of 86

Optimal Sample Design

Go back to Steps 1- 6 and revisit decisions. Yes

No

Information IN Actions Information OUT

From Previous Step To Next Step

Select the optimal sample size that satisfies the DQOs for each data collection design option

For each design option, select needed mathematical expressions

Check if number of samples exceeds project resource constraints

Decision Error Tolerances

Gray Region

Review DQO outputs from Steps 1-6 to be sure they are internally consistent

Step 7- Optimize Sample Design

Develop alternative sample designs

In order to develop the cost function, the aggregate unit cost persample must be determined. This is the cost of collecting one sample and conducting all the required analyses for a given decision rule.

Page 42: The EPA 7-Step DQO Process

42 of 86

AUSCA$ = USC$ + USA$i Where (here):USC$ = Unit Sample Collection CostUSA$ = Unit Sample Analysis CostAUSCA$ = Aggregate Unit Sample Collection and Analysis Costj = Number of analytical methods planned

Aggregate Unit Sampling and Analysis Cost

i=1

j

Page 43: The EPA 7-Step DQO Process

43 of 86

CSApproach 1 Sampling Design (cont.) Surface Soils S&A Costs

Lab Analytical Cost Without PCBs

Unit Sample Analysis Cost

Pb by ICP/AES $35U by ICP/AES $65TPH (GRO) by GC $65TPH (DRO) by GC $85

Total USA$ $250

Unit Sample Collection Cost $50AUSCA$ = USC$ + total USA$ $300

Page 44: The EPA 7-Step DQO Process

44 of 86

CSApproach 1 Sampling Design (cont) Sub-surface Soils S&A Costs

Page 45: The EPA 7-Step DQO Process

45 of 86

CSApproach 1 Sampling Design (cont.)

Surface Soils

Lab Analytical Costs for PCBs by GCPolychlorinated biphenyls 150.00$

Total USA$ 150.00$ Unit Sample Collection Cost 50.00$ AUSCA$ = USC$ + total USA$ 200.00$

Page 46: The EPA 7-Step DQO Process

46 of 86

CSApproach 1 Sampling Design (cont.)

Sub-surface Soils

Lab Analytical Costs for PCBs by GCPolychlorinated biphenyls 150.00$

Total USA$ 150.00$ Unit Sample Collection Cost 100.00$ AUSCA$ = USC$ + total USA$ 250.00$

Page 47: The EPA 7-Step DQO Process

47 of 86

Optimal Sample Design

Go back to Steps 1- 6 and revisit decisions. Yes

No

Information IN Actions Information OUT

From Previous Step To Next Step

Select the optimal sample size that satisfies the DQOs for each data collection design option

For each design option, select needed mathematical expressions

Check if number of samples exceeds project resource constraints

Decision Error Tolerances

Gray Region

Review DQO outputs from Steps 1-6 to be sure they are internally consistent

Step 7- Optimize Sample Design

Develop alternative sample designs

Merge the selected sample size outputs with the Aggregate Unit Sample Collection and Analysis cost output.

This results in a table that shows the product of each selected sample size and the AUSCA$.

This table is used to present the project managers and decision makers with a range of analytical costs and the resulting uncertainties.

From the table, select the optimal sample size that meets the project budgetand uncertainty requirements.

Page 48: The EPA 7-Step DQO Process

48 of 86

SHOW EXCEL File

Page 49: The EPA 7-Step DQO Process

49 of 86

Approach 1 Based Sampling Design Design for Pb, U, TPH

– Alpha = 0.05; Beta = 0.2; Delta = total error

– The decision makers agreed on collection of 9 surface samples for Pb, U and TPH (GRO & DRO) from each of the two surface strata, for a total of 18 samples using a stratified random design

– For the sub-surface, 9 borings/probes will be made in each of the two subsurface stratum at random locations; one sample will be collected at a random depth down to 10 feet from each boring, to assess migration through the vadose zone, for a total of 18 samples

Design for PCBs– Alpha = 0.05; Beta = 0.20; Delta = 0.50 (50% of the AL)

– The decision makers agreed on collection of 24 surface samples from each of the two surface strata; total of 48 samples using a stratified random design

– For the sub-surface, 24 borings/probes will be collected from each of the two subsurface stratum at random locations, collected at a random depth down to 10 feet for a total of 48 samples

CS

Page 50: The EPA 7-Step DQO Process

50 of 86

Approach 1 Sample Locations(Surface Strata)

CS

Plan View

Former PadLocation

RunoffZone

0 50 100 150 ft0 15 30 46 m

BufferZone

Page 51: The EPA 7-Step DQO Process

51 of 86

CSApproach 1 Sampling Design (cont.)

Page 52: The EPA 7-Step DQO Process

52 of 86

Remediation Costs*CS

*Does not include layback area

DR#

Description/Depth Area(ft2)

Volume(yd3)

Cost*

1a Pad & Run-off Zone, 0-6” 12,272 227 $45,4001b Buffer Zone (excluding

Pad and Run-off area), 0-6”42,884 794 $158,800

2a Pad & Run-off Zone,6”-10”

12,272 4,318 $863,600

2b Buffer Zone (excludingPad and Run-off area),6”-10”

42,884 15,089 $3,017,800

* Assume $200 per yd3 for all COPCs

Page 53: The EPA 7-Step DQO Process

53 of 86

Approach 1 Based Sampling Design Compare Approach 1 costs versus remediation

costs – Approach 1 S&A costs

• $11,700 (Pb, U, TPH) + $21,600 (PCBs) = $33,300

– Remediation costs• Cost to remediate surface soil under footprint of pad and

buffer area: $204,200• Cost to remediate subsurface soil under footprint of pad and

buffer area: $3,881,400

CS

Page 54: The EPA 7-Step DQO Process

54 of 86

Optimal Sample Design

Go back to Steps 1- 6 and revisit decisions. Yes

No

Information IN Actions Information OUT

From Previous Step To Next Step

Select the optimal sample size that satisfies the DQOs for each data collection design option

For each design option, select needed mathematical expressions

Check if number of samples exceeds project resource constraints

Decision Error Tolerances

Gray Region

Review DQO outputs from Steps 1-6 to be sure they are internally consistent

Step 7- Optimize Sample Design

Develop alternative sample designsIf no sample design meets the error tolerances within the budget: relax one or more of the constraints or request more funding, etc.

Page 55: The EPA 7-Step DQO Process

55 of 86

Design ApproachesApproach 2: Dynamic Work Plan (DWP) & Field Analytical Methods (FAMs)

Use DWP to allow more field decisions to meet the measurement objectives and allow the objectives to be refined in the field using DWP

Manage uncertainty by increasing sample density by using field analytical measurements

Page 56: The EPA 7-Step DQO Process

56 of 86

Approach 2 Sampling Design Phase 1: Pb, U, TPH, PCBs

– Perform field analysis of the four strata on-site using XRF (Pb & U), on-site GC (TPH), and Immunoassay (PCBs) methods. Take into account the chance of false positives at the low detection levels

– This will produce a worse-case distributions that will be used to calculate the number of confirmatory samples for laboratory analysis for the surface and below grade strata

CS

Page 57: The EPA 7-Step DQO Process

57 of 86

Phase 1: Pb, U, TPH, PCBs– Provide detailed SOPs for performance of FAMs: XRF,

GC, & Immunoassay analysis– Divide both surface strata into triangular grids– Use systematic sampling, w/random start (RS), to locate

sample points; sample in center of each grid Pad & Run-off zone

CSM expects contamination more likely here 10 ft equilateral triangle: 43.35 ft2

Pad + Run-off zone = 12,272 ft2

283 sample points

Buffer area: Also 283 sample points CSM expects contamination less likely here Thus, grid triangle has larger area

Approach 2 Sampling Design (cont.)CS

Page 58: The EPA 7-Step DQO Process

58 of 86

Phase 1: Pb, U, TPH, PCBs– Sub-surface strata: Pad & Run-off zone

Use Direct Push Technology (DPT) to collect Push at all surface sample points > ALs Minimum sample locations: 40 (+ 10 >ALs) = ~50 Collect sub-surface samples every 3 feet 50 X 3 = 150 sub-surface samples in this strata Use systematic sampling, w/random start (RS), to locate sample

points

– Buffer area CSM expects contamination less likely here Thus, fewer sample points Same >ALs rationale as above 50 X 3 = 150 sub-surface samples in Buffer area Use systematic sampling, w/RS, to locate sample points

Approach 2 Sampling Design (cont.)CS

Page 59: The EPA 7-Step DQO Process

59 of 86

Stratified Systematic Grid with Random Start(Surface Strata)

CS

Not to scaleSquares will be adjusted according to Step 7 design

NFootprint ofConcrete Pad(Stratum 1)

Runoff Zone(Stratum 1)

Buffer Zone(Stratum 2)

Page 60: The EPA 7-Step DQO Process

60 of 86

Phase 2: Pb, U, TPH, PCBs– Evaluate the FAM results and construct FDs for each COPC

– Using Monte Carlo method, evaluate the alpha, beta and delta and resulting n based on the XRF, on-site GC, and Immunoassay data and select a value (worst case) for n to confirm the FAM data, using traditional laboratory analysis for each of the four strata

– For this Case Study, we will assume that number came out to be 9 per strata or 36 confirmatory lab samples

CSApproach 2 Sampling Design (cont.)

Page 61: The EPA 7-Step DQO Process

61 of 86

CSApproach 2 Sampling Design (cont.)

Surface Soils SC&SA Costs

U by Field XRF $1.5Pb by Field XRF $1.5TPH (GRO) on-site GC $25TPH (DRO) on-site GC $25

PCBs by IMA kits $50

Total USA$ $103

Unit Sample Collection Cost $25AUSCA$ = USC$ + total USA$ $128

Page 62: The EPA 7-Step DQO Process

62 of 86

CSApproach 2 Sampling Design (cont)

Sub-surface Soils SC&SA Costs

U by Field XRF $1.5Pb by Field XRF $1.5TPH (GRO) on-site GC $25TPH (DRO) on-site GC $25

PCBs by IMA kits $50

Total USA$ $103

Unit Sample Collection Cost $50AUSCA$ = USC$ + total USA$ $153

Page 63: The EPA 7-Step DQO Process

63 of 86

CSApproach 2 Sampling Design (cont.)

COPC (Method) Number of Samples, n AUSCA$Total SC&SA Cost

U and Pb (XRF); TPH (On-site GC); PCBs (IMA kits); Surface Soils (strata 1 & 2) 566 $128 $72,448U and Pb (XRF); TPH (On-site GC); PCBs (IMA kits); Sub-Surface Soils (strata 1&2) 300 $153 $45,900Total $118,348

Page 64: The EPA 7-Step DQO Process

64 of 86

CS

Number of Samples, n AUSCA$

Total Sampling and Analytical Cost

Subtotal - Onsite $118,348Pb, U, TPH, PCBs -Surface 18 $250 $4,500Pb, U, TPH, PCBs - Suburface 18 $275 $4,950Subtotal - Lab $9,450

Total Costs On-site and Lab Methods $127,798

Confirmatory Traditional Laboratory Analyses Costs

Approach 2 Sampling Design (cont.)

Page 65: The EPA 7-Step DQO Process

65 of 86

Evaluate costs of Approach 2 vs. remediation costs– Sampling and analysis (S&A) costs $127,798– Original budget for S&A $45,000

– Remediation cost• Cost to remediate surface soil under footprint of pad and

buffer area: $204,200• Cost to remediate subsurface soil under footprint of pad

and buffer area: $3,881,400

CSApproach 2 Sampling Design (cont.)

Page 66: The EPA 7-Step DQO Process

66 of 86

CS

Approach

# Samples, n On-Site

(Surface / Sub-surface)

# Samples, n Off-Site

(Surface / Sub-surface)

Total Sampling and Analytical Cost

1 none 66/66 $33,3002 566/300 18/18 $127,798

Comparison Costs

Remediation Costs:•Surface - $204,200•Sub-surface - $3,881,400

Approach 2 Sampling Design (cont.)

Page 67: The EPA 7-Step DQO Process

67 of 86

A Visual Decision Strategy

S ta rt G e tD a ta

C h e ckD a ta

Fit D a ta

PD F D oH yp oth es is

Te s t

C le a nD irty

Ne e dM o reD a ta

S to pD a ta

G e tS a m ple

S ize

G e tS am pl i n gLocati on s

V ES A

n

V S P

x , y

V is u a l D Q A V is u a l F it V is u a l Te s t

Page 68: The EPA 7-Step DQO Process

68 of 86

Approach 2b Sampling & Lab Analyses

Remember:Sampling Uncertainty is decreasedwhen sampling density is increased

n = m * k Select k of specified Mass/diameter3

– FE² 22.5 * d³ / M (to control sampling error)

Prepare m multi-increment samples for lab analysis Perform lab analyses on m samples

Page 69: The EPA 7-Step DQO Process

69 of 86

n = m * k

k = 3k = 3

m = 2

Laboratory

Collect “n” samples

Group into “k”

Combine “k”into “m”composites

Remember;we want the

AVERAGEover theDecision Unit

Approach 2b Sampling & Lab Analyses

Page 70: The EPA 7-Step DQO Process

70 of 86

Approach 2b Sampling Design Phase 2b: Pb, U, TPH, PCBs

– Let n = 283 (for each Surface strata); n = 150 (for each Sub-surface strata)

– Select appropriate values for m and k, based on cost and managing uncertainty

k = 3 (Surface); k = 3 (Sub-surface); add $5 to SC cost m = 94 (each Surface strata); Total = 188 Surface samples m = 50 (each Sub-surface strata); Total = 100 Sub-surface samples

– Perform field analysis of the four strata on-site using XRF (Pb & U), on-site GC (TPH), and Immunoassay (PCBs) methods.

– Again, this will produce worse-case distributions that will be used to evaluate and errors and to calculate the number of confirmatory samples for laboratory analysis for the surface and below grade strata; Still assume 36 total

CS

Page 71: The EPA 7-Step DQO Process

71 of 86

Stratified Systematic Grid with Random Start(Surface Strata)

CS

Not to scaleSquares will be adjusted according to Step 7 design

NFootprint ofConcrete Pad(Stratum 1)

Runoff Zone(Stratum 1)

Buffer Zone(Stratum 2)

Page 72: The EPA 7-Step DQO Process

72 of 86

CSApproach 2b Sampling Design (cont.)

SC Costs: Surface 564 30 $16,920U and Pb (XRF); TPH (On-site GC); PCBs (IMA kits); Surface Soils (strata 1 & 2) 188 $103 $19,364

SC Costs: Sub-Surface 300 $55 $16,500U and Pb (XRF); TPH (On-site GC); PCBs (IMA kits); Sub-Surface Soils (strata 1&2) 100 $128 $12,800Total $65,584

Page 73: The EPA 7-Step DQO Process

73 of 86

CS

Number of Samples, n AUSCA$

Total Sampling and Analytical Cost

Subtotal - Onsite $65,584Pb, U, TPH, PCBs -Surface 18 $250 $4,500Pb, U, TPH, PCBs - Suburface 18 $275 $4,950Subtotal - Lab $9,450

Total Costs On-site and Lab Methods $75,034

Confirmatory Traditional Laboratory Analyses Costs

Approach 2b Sampling Design (cont.)

Page 74: The EPA 7-Step DQO Process

74 of 86

Evaluate costs of Approach 2b vs. remediation costs– Sampling and analysis (S&A) costs $75,034– Original budget for S&A $45,000

– Remediation cost• Cost to remediate surface soil under footprint of pad and

buffer area: $204,200• Cost to remediate subsurface soil under footprint of pad

and buffer area: $3,881,400

CSApproach 2b Sampling Design (cont.)

Page 75: The EPA 7-Step DQO Process

75 of 86

CS

Approach

# Samples, n On-Site

(Surface / Sub-surface)

# Samples, n Off-Site

(Surface / Sub-surface)

Total Sampling and Analytical Cost

1 none 66/66 $33,3002 566/300 18/18 $127,7983 188/100 18/18 $75,034

Remediation Costs:•Surface - $204,200•Sub-surface - $3,881,400

Approach 2b Sampling Design (cont.)

Page 76: The EPA 7-Step DQO Process

76 of 86

CS

Approach 2b Was SelectedMost Cost-Effective

andBest Management of Uncertainty

Page 77: The EPA 7-Step DQO Process

77 of 86

Measure both gasoline & diesel range fractions (GRO/DRO)

Ship & process all samples in one batch to decrease cost.

QC defined per SW 846 [1 MS/MSD, 1 method blank, 1 equipment blank (if equipment is reused), 1 trip blank for GRO only].

Cool GRO/DRO to 4°C, +/- 2°C. QAP written and approved before implementation.

CSQC and Analysis DetailsUsed in All Approaches

Page 78: The EPA 7-Step DQO Process

78 of 86

Steps 1- 6

Step 7

Optimal Design

Iterative Process

Page 79: The EPA 7-Step DQO Process

79 of 86

Information IN Actions Information OUT

From Previous Step To Next Step

Select the optimal sample size that satisfies the DQOs for each data collection design option

For each design option, select needed mathematical expressions

Check if number of samples exceeds project resource constraints

Decision Error Tolerances

Gray Region

Review DQO outputs from Steps 1-6 to be sure they are internally consistent

Step 7- Optimize Sample Design

Develop alternative sample designs

Justification for a judgmental sampling design• Timeframe• Qualitative consequences of an inadequate sampling

design (low, moderate, severe)• Re-sampling access after decision has been made

(accessible or inaccessible)

Optimal Sample Design

Go back to Steps 1- 6 and revisit decisions. Yes

No

Page 80: The EPA 7-Step DQO Process

80 of 86

WARNING!!If a judgmental design is selected in lieu of a statistical design the

following disclaimer must be stated in the DQO Summary Report:

“Results from a judgmental sampling design can only be used to make decisions about the locations from which the samples were taken and cannot be generalized or extrapolated to any other facility or population, and error analysis cannot be performed on the resulting data. Thus, using judgmental designs prohibits any assessment of uncertainty in the decisions.”

Page 81: The EPA 7-Step DQO Process

81 of 86

Information IN Actions Information OUT

From Previous Step To Next Step

Select the optimal sample size that satisfies the DQOs for each data collection design option

For each design option, select needed mathematical expressions

Check if number of samples exceeds project resource constraints

Decision Error Tolerances

Gray Region

Review DQO outputs from Steps 1-6 to be sure they are internally consistent

Step 7- Optimize Sample Design

Develop alternative sample designsThe output is the most resource-effective design forthe study that is expected toachieve the DQOs.

Optimal Sample Design

Go back to Steps 1- 6 and revisit decisions. Yes

No

Page 82: The EPA 7-Step DQO Process

82 of 86

Data Quality Assessment

Guidance for Data Quality Assessment,EPA QA/G9, 2000

Step 1: Review DQOs and Sampling Design Step 2: Conduct Preliminary Data Review Step 3: Select the Statistical Test Step 4: Verify the Assumptions of the Test Step 5: Draw Conclusions From the Data

Page 83: The EPA 7-Step DQO Process

83 of 86

To succeed in a systematic planning process for environmental decision making, you need need Statistical Support:Statistical Support:

One or more qualified statisticiansqualified statisticians, experienced in environmental data collection designsenvironmental data collection designs and statistical statistical data quality assessmentsdata quality assessments of such designs.

Summary

Page 84: The EPA 7-Step DQO Process

84 of 86

Summary (cont.) Going through the 7-Step DQO Process will

ensure a defensible and cost effective sampling program

In order for the 7-Step DQO Process to be effective: – Senior management MUST provide support

– Inputs must be based on comprehensive scoping and maximum participation/contributions by decision makers

– Sample design must be based on the severity of the consequences of decision error

– Uncertainty must be identified and quantified

Page 85: The EPA 7-Step DQO Process

85 of 86

Information IN Actions Information OUT

From Previous Step To Next Step

Select the optimal sample size that satisfies the DQOs for each data collection design option

For each design option, select needed mathematical expressions

Check if number of samples exceeds project resource constraints

Decision Error Tolerances

Gray Region

Review DQO outputs from Steps 1-6 to be sure they are internally consistent

Step 7- Optimize Sample Design

Develop alternative sample designs

Optimal Sample Design

Go back to Steps 1- 6 and revisit decisions. Yes

No

Page 86: The EPA 7-Step DQO Process

86 of 86

End of Module 7

Thank you