IQuOD An International Quality Control Effort Tim Boyer EDM workshop September 10, 2014.

IQuOD An International Quality Control Effort

Tim BoyerEDM workshop

September 10, 2014

2

Anuual mean global energy flow calculated from Mar. 2000 to May 2004. From Trenberth, Fasullo, and Kiehl (2009)

3

Changes in Earth’s Heat Balance Components (1022 J) During 1955-2003 (from Levitus, Antonov and Boyer, 2005, GRL)

83% or 0.75 W/m2

How is Ocean Content Changing?

How do we reliably estimate the change?

World Ocean Database by Instrument Type

5

2009 Ocean Heat Content 0-700m Levitus (2012) method

Using ENACT-3 Quality Control

Using WOD Quality Control

Red=heat gain (relative to long-term mean)Blue=heat loss (relative to long-term mean)

7

Argo/GODAEGTSPP

Delayed ModeData

NODCPermanent

Archive[non-uniform

Format]

Near Real-Time Availability

World Ocean DatabaseAdditional QC

Uniform format

BuoysPMEL/JAM

Data quality inform

ation

Not AlwaysPublicly Accessible

NODC Information Stream

Data added to World Ocean Database since WOD13Grey – Argo (184,348 cycles)Green – XBT (25,979 casts)Red – bottle/CTD (106,327casts)Blue - Pinniped (14,421 dives)Turquoise – Glider (42,142 half cycles)Orange – tropical buoys (41,832 daily means)

9

Examples of Delayed-mode data Updates to WOD

World Ocean Database Quarterly

Updates

NOAA

Northeast Fisheries

CCHDO

SECARGO

ICES

CalCOFI

Japan Ocean Data Center

CSIROOil Industry

INIDEP (Argentina)

IMOS gliders

Blue – QuarterlyOrange- YearlyGreen - Irregular

10

Example of already aggregated data passed to WOD

CLIVAR and Carbon Hydrographic Data Office

(CCHDO) GO-SHIP

WOCE

BATS

HOT

CDIAC

CARINA

PACIFICAOceanSITES

Other

CLIVAR

11

NODC Quality Control : Automatic Checks

- reveal systematic errors in incoming data and metadata

- eliminate most non-representative data from consideration

Eliminates ~6% of

temperature data from

Consideration

(>800,000 profiles)

Checks include:

Range check

Spike check

Density inversion

Speed check

Standard deviation

Red – Unflagged Black – Flagged

Inversion and Large Gradient Checks

For Temperature: Inversion ≤ -0.3°C/meter Gradient ≥ 0.7°C/meter

MBT with large inversion

°Celsius

Dep

th (m

eter

s)

Inversions presentIn 276,000 temperatureProfiles (2% of profiles)

Large positive gradientsPresent in 534,000Temperature profiles (4% of profiles)

International Quality Controlled Oceanographic Profile Database (IQuOD)

1. Standardize Automatic Quality Control Internationally

2. Expert manual quality control all profiles which fail automatic checks

3. For temperature (1), salinity (2), oxygen, nutrients

4. Disseminate results to oceanographic/climate community

Manual quality control: profile by profileRegional/instrument expertise

15

NODCPermanent

Archive

World Ocean DatabaseIQuOD Automatic QC

Uniform format

IQuOD Manual QC Expert Center

IQuOD Information Stream

IQuOD Manual QCOriginal DataIQuOD QC

Other QC project

16

World Ocean DatabaseInternal Storage

INSIDE THE DATA

Original Profile Data

Altered Profile Data

(if necessary)

QC Flags (orig)

QC Flags (WOD)

QC Flags (IQuOD)

QC Flags (2nd)

Generated on the fly

Data Dissemination:Yearly by instrumentGeographically by instrumentWODselectAll updated quarterly

Format:Native WOD format(compact ASCII) with conversionroutines

netCDF -> feeds intoNODC Geoportal/THREDDS server

Working now on subset dissemination through Geoportal

18

World Ocean DatabaseAdditional QC

Uniform format

NODC to Public Information Stream (Profile Data)

NODCPermanent

Archive

Public Access G

eoportal/THRED

DS

WODselect

19

Ideal NODC to Public Information Stream (Profile Data)

NODCPermanent

ArchivePublic Access

Geoportal/TH

REDD

S

WOD

GTSPP

Argo

PMEL buoys

20

Ideal NODC to Public Information Stream (in situ Data)

NODCPermanent

ArchivePublic Access

Geoportal/TH

REDD

S

Coastal Buoy

Profile

Current

Thermosalinograph

Consolidated Granule Level GeoPortal

Best Copy

World Ocean Database

GTSPP

Argo

Individual Accessions

Get Data Information

Get Data

Get Data

Get Data

Information

Information

Information

See all Information

Summary• Uniformity in quality control of temperature data will benefit the

oceanographic/climate community

• IQuOD will establish internationally agreed set of automatic qc checks

• IQuOD will establish groups of experts for manual qc

• The World Ocean Database (WOD) will be the initial data source, aggregator and data disseminator for IQuOD

• The IODE two tiered flagging system will be used by WOD

• The NODC Geoportal will be the preferred means of dissemination for WOD/Aggregation with other data sources through the granule level tools.