Datzilla Usage NCDC Perspective. Karsten Shein NOAA National Climatic Data Center [email protected]. NWS Sub-regional data stewardship workshop – Fargo, ND 12-13 May 2007. What is Datzilla?. - PowerPoint PPT Presentation
This document is posted to help you gain knowledge. Please leave a comment to let me know what you think about it! Share it to your friends and learn new things together.
• Datzilla intended to correct Datzilla intended to correct errorserrors• CorrectionsCorrections to observations are to observations are not errorsnot errors..• For changes to recent observations (For changes to recent observations (commoncommon))
– William Angel (COOP / ASOS)William Angel (COOP / ASOS)– Blake Lasher (LCD ASOS)Blake Lasher (LCD ASOS)– Send amended form to NCDC via normal channels.Send amended form to NCDC via normal channels.
• Changes to historical observations (Changes to historical observations (uncommonuncommon))– Amended formsAmended forms– Datzilla (limited to changing estimates of invalid obs)Datzilla (limited to changing estimates of invalid obs)– Must have a compelling reason to change a historical obs.Must have a compelling reason to change a historical obs.
• Corrections due to equipment problems may also require Corrections due to equipment problems may also require a metadata rendition.a metadata rendition.
Some possible reasons for a Some possible reasons for a Datzilla ticket to NCDCDatzilla ticket to NCDC
• Data issue (usually)Data issue (usually)– That TMAX of 74 should be a 47!That TMAX of 74 should be a 47!– Your #$&!@* QC clobbered my data!Your #$&!@* QC clobbered my data!
• System issueSystem issue– CDO inventory doesn’t match the data I got!CDO inventory doesn’t match the data I got!
• Metadata issueMetadata issue– This station’s COOP number is wrong!This station’s COOP number is wrong!
• Pre-report investigation (critical)Pre-report investigation (critical)– Is the error really an error?Is the error really an error?– Is it the right station?Is it the right station?– Is it reproducible (browsers, systems)Is it reproducible (browsers, systems)
• Do you have the right system?Do you have the right system?– ACIS, ThreadEx, NCDC data may be differentACIS, ThreadEx, NCDC data may be different
• Have you proposed a solution?Have you proposed a solution?
Investigating the errorInvestigating the error• xmACIS is a display tool for NOAA dataxmACIS is a display tool for NOAA data
– Interprets data flags from NCDC data setsInterprets data flags from NCDC data sets– Prioritizes simultaneous values from different data setsPrioritizes simultaneous values from different data sets– Displays “M” for invalid as well as missing dataDisplays “M” for invalid as well as missing data– May thread data from several stationsMay thread data from several stations
My ticket’s been open forever!My ticket’s been open forever!
• Some are easy to fixSome are easy to fix– Small-batch keying errorsSmall-batch keying errors– A few missing valuesA few missing values
• Some are notSome are not– May be part of a larger issueMay be part of a larger issue– May exceed NCDC resourcesMay exceed NCDC resources– May not have a straightforward fixMay not have a straightforward fix– May involve parties/systems outside NCDCMay involve parties/systems outside NCDC
Your #$&!@* QC clobbered my Your #$&!@* QC clobbered my data!data!
• You are right to alert us.You are right to alert us.
• However, before you do …However, before you do …– Think about Think about whywhy our QC would flag that data. our QC would flag that data.– Most often, the problem is not our QCMost often, the problem is not our QC
• Observer date shiftingObserver date shifting
• Observing at time different than expected.Observing at time different than expected.