PROTOCOL FOR DATA VERIFICATION PROTOCOL FOR DATA VERIFICATION 1) 1) ION BALANCE < +/- 10% ION BALANCE < +/- 10% 2) ION BALANCE( Na/Cl )= Limit: 0.8 – 1.2 2) ION BALANCE( Na/Cl )= Limit: 0.8 – 1.2 3) EC BALANCE(TDS/EC) = Limit: 0.55 – 0.9 3) EC BALANCE(TDS/EC) = Limit: 0.55 – 0.9 4) CARBON BALANCE (COD/BOD)- 1-10 4) CARBON BALANCE (COD/BOD)- 1-10 5) CO 5) CO 3 BALANCE = BALANCE = IF pH < 8.3 PHEN ALKALINITY = 0 then result IF pH < 8.3 PHEN ALKALINITY = 0 then result is OK is OK IF pH > 8.3 PHEN ALKALINITY >0 then result IF pH > 8.3 PHEN ALKALINITY >0 then result is OK is OK and acceptable and acceptable
41
Embed
PROTOCOL FOR DATA VERIFICATION 1)ION BALANCE < +/- 10% 2) ION BALANCE( Na/Cl )= Limit: 0.8 – 1.2 3) EC BALANCE(TDS/EC) = Limit: 0.55 – 0.9 4) CARBON BALANCE.
This document is posted to help you gain knowledge. Please leave a comment to let me know what you think about it! Share it to your friends and learn new things together.
Transcript
PROTOCOL FOR DATA VERIFICATIONPROTOCOL FOR DATA VERIFICATION
1)1) ION BALANCE < +/- 10% ION BALANCE < +/- 10%
2) ION BALANCE( Na/Cl )= Limit: 0.8 – 1.22) ION BALANCE( Na/Cl )= Limit: 0.8 – 1.2
Various Exercises are performed for detection of outliers
DATA VALIDATION DATA VALIDATION DETECTION OF DATA OUTLIERSDETECTION OF DATA OUTLIERS
Data outliers are extreme (high or low) values that diverge widely from the main body of data set. The presence of one or more outliers may greatly influence any calculated statistics and yield biased results. However, there is also the possibility that the outlier is a legitimate
member of the data set.
Outlier detection tests are to determine whether there is sufficient statistical evidence to conclude that an observation
appears extreme and does not belong to the data set and SHOULD BE REJECTED.
Data outliers may result from----,
FAULTY INSTRUMENTS,ERROR IN TRANSCRIPTION,MISREADING OF INSTRUMENTS,INCONSISTANT METHODOLOGY OF SAMPLING AND ANALYSIS AND SO ON.
These aspects should be investigated and if any of such reasons can be pegged to an outlier , the value may be safely deleted from consideration.
EXERCISE-1 : Exercise for identification of error during analysis in Laboratory
EXERCISE-2: Data Outliers detection test
On the basis of historical data
EXERCISE-3: Other locations where data is accepted
(Historical Data)
1) Medium polluted location ,Takali(Nashik),&
2)Highly polluted location,Manda in Thane district
EXERCISE-4:Inter lab AQC exercise
DATA VALIDATION DATA VALIDATION DETECTION OF DATA OUTLIERSDETECTION OF DATA OUTLIERS
Various Exercise are performed for detection of outliersVarious Exercise are performed for detection of outliers
Table 8.5 : Critical Values for rejection Table 8.5 : Critical Values for rejection quotient quotient Qexp( reject if Qexp >Q crit)Qexp( reject if Qexp >Q crit)
Exercise for identification of error during analysis in LaboratoryExercise for identification of error during analysis in Laboratory
DATA OUTLIERS DETECTION TESTDATA OUTLIERS DETECTION TEST
Example 8.9
Concentration measurements for fluoride were measured as 2.77,2.80,2.90,2.92,3.45,3.95,4.44,4.61,5.21,7.46. Use the Q test to examine whether the highest value is an outlier.
Solution:
Q exp = ( 7.46 – 5.21 ) / ( 7.46 – 2.77 ) = 0.51
Since 0.51 is larger than 0.48.the Q exp value for 96% confidence ,there is a basis for excluding the value.
Exercise for identification of error during analysis in LaboratoryExercise for identification of error during analysis in Laboratory
Exercise performed in Nashik Lab for Na & Cl to identify error during analysis and to check the Ratio
of Na/Cl.
Sample collected from Tap water.
Date of analysis : 15/04/2005
Analysis Result:
Na = 4.7 ,Cl = 9.02
Ratio of Na/Cl = 0.802
Required Limit : 0.8 – 1.2
Observation: Analysis process is correct and results are ACCEPTED
Data Considered for the period of July 97 Data Considered for the period of July 97 TO April 2000 of Bund garden Location for TO April 2000 of Bund garden Location for the parameters like Na and Cl Which is the the parameters like Na and Cl Which is the CRITICAL RATIO for Pune and Kolhapur LabCRITICAL RATIO for Pune and Kolhapur Lab
DATA OUTLIERS DETECTION TEST DATA OUTLIERS DETECTION TEST
On the basis of historical dataOn the basis of historical data
= 0.76 ( Expected value is >0.48 for 10 observations)
Conclusion- The values are not in Ratio at Bundgarden location.
DATA OUTLIERS DETECTION TESTEXERCISE-3
OTHER LOCATION WHERE DATA IS ACCECCEPTED( Historical Data)OTHER LOCATION WHERE DATA IS ACCECCEPTED( Historical Data)
Takali – Na – 3 values (Historical Data)—Polluted Location
1)32.5, 2)47.0 3)18.1,
Qexp = (47.0 – 32.5) / (47.0 – 18.1)
= 0.58 ( Expected value is <0.98 for 3 observations)
Manda – Na – 3 values (Historical Data)Highly Polluted Location
1)1140 , 2)3385 3)3273,
Qexp = (3385 – 3273) / (3385 – 1140)
= 0.049 ( Expected value is <0.98 for 3 observations)
Hence The Data for the above location is ACCEPTED
INTER LABORATORY AQC EXERCISE
1) SAMPLES ARE COLLETED BY PUNE LAB AND SEND TO NAGPUR LAB FOR ANALYSIS TO FIND OUT ERROR IN ANALYSIS.
2) RESULTS SHOWN IN THE TABLE-1
EXERCISE-4
DATA VALIDATION – AQC EXERCISE DATA VALIDATION – AQC EXERCISE
Table 1: Analysis Result collected from Nagpur Division*Table 1: Analysis Result collected from Nagpur Division*
Sr.No Ratios Ankali Bridge-Dt.5/7/04
Bundgarden-Dt.5/7/04
Accepted Limits
Remarks
1 Ion Balance 1.8% 5.14% +/-10% All values are within the limits.There may
be error during
analysis in Pune &
Kolhapur Lab
2 Na/Cl 0.84 0.92 0.8-1.2
3 TDS/EC 0.59 0.58 0.55-0.9
4 COD/BOD 2.77 3.39 >1
5 CO3 Balance OK OK **
** If pH<8.3 phen’ alkalinity is = 0 ?
* The above exercise is performed by Pune Division as directed by SE DAC Nashik vide Lr.No.375 dt.6-5-2004 for verification of above ratios and finding out error in analysis.
Observation: It is observed that All values are within the limits.Observation: It is observed that All values are within the limits.
There may be error during analysis in Pune & Kolhapur LabThere may be error during analysis in Pune & Kolhapur Lab
OTHER OBSERVATIONS FROM OTHER OBSERVATIONS FROM W.Q.DATA BASEW.Q.DATA BASE
PUNE LABPUNE LAB
KOLHAPUR LABKOLHAPUR LAB
In-complete data entry setsIn-complete data entry sets
PUNE LAB
DATA NOT IN VALIDATION RATIO
PUNE LAB
NO DATA
PUNE LAB
REMARKS SHOWN ARE NOT PROPER
PUNE LAB
NO DATANO DATA
PUNE LAB
No proper sampling entry-, i.e Preservation not shown properly
Case study of Daund Location(Ref:EE Pune Lr.No.445 Dt.10/03/2004)
COD Value is 591.4 , BOD is 6.00 on dated 14/12/2003 ,where as on 25/12/2003 it is 15.2 & 1.8 and on date 24/11/2003 it is 7.7 & 1.8 respectively,which indicate
that on dated 14/12/03 the value of COD may be 59.14,required to be verified from the record.
PUNE LAB
Values of DO for corresponding dates are 4.00,8.4 & 8.00 shows the data entry mistake.
PUNE LAB
Corresponding Ratios of Carbon Balance is 4.27,98.57 & 8.44 clearly shows the data entry
mistakes.
Kolhapur Lab
Coliforms sampling – Recommended Quantity is 500ml
Kolhapur Lab
No proper sampling entry-, i.e Sample for DO is not taken
Kolhapur Lab
No proper sampling entry-, How DO Sampler is used for Coliforms?
Kolhapur Lab
Depth of Sample collection is not shown
Kolhapur Lab
No proper sample entry.What is Freezing?
Kolhapur Lab
How Coliforms sample acidified and collected by using DO Sampler?
Kolhapur Lab
Validation ratios are not properly verified
Kolhapur Lab
Validation ratios are not properly verified and remarks shown are not proper
Kolhapur Lab
NO DATA
Kolhapur Lab
NO DATA FOR SHIRSINGI LOCATION
DATA VALIDATION- SOFTWAREDATA VALIDATION- SOFTWARE
THE DATA FLOW
-HP DEVELOPED SOFTWARE FOR WATER QUALITY,SIMILAR TO QUANTITY
-ANLYTICAL RESULTS AND FIELD MEASUREMENTS ENTERED IN TO DATA BASE
-DATA BASE SOFTWARE MAKES DATA VALIDATION CHECKS
-NOT VALIDATED DATA IS FLAGGED,SHOULD BE CHECKED AND REANALYZED
ONLY VALIDATED DATA WILL BE TRANSFERRED TO THE REGIONAL DATA CENTRE ( THIS IS THE DATA FLOW)
REF:-National Workshop on Water Quality Monitoring ---File:DataValid&Analys.doc” --- Version 06-03-00
:CONCLUSION::CONCLUSION:
Instructions given by SE Instructions given by SE DCC/DAC NashikDCC/DAC Nashik
1)Enter the data analysis results in 1)Enter the data analysis results in computer after validation at lab levelcomputer after validation at lab level
2)Collect the sample and send to other 2)Collect the sample and send to other lab for analysis.lab for analysis.
3)Monitor water quality of Baseline 3)Monitor water quality of Baseline locations for three years the stop for locations for three years the stop for three yearsthree years
4)Explanation for continuous monitoring of Baseline locations5)Entry of sample collection as per prescribed methods6)Entry of number of parameter with respect to validation ratios are mentioned in circular issued by SE DCC Nashik on dated 26/06/2003