Page 1
An update on obs4MIPs
WDAC Observations for Model Evaluation Task Team Peter Gleckler, co-chair, PCMDI and Duane Waliser, co-chair, JPL/NASA
Mike Bosilovich, GSFC/NASA Helene Chepfer, IPSL
Carol Anne Clayson, WHOI Veronika Erying, DLR
Robert Ferraro, JPL/NASA Pierre-Phillipe Mathieu, ESA
Jerry Potter, GSFC Roger Saunders, UKMO Jörg Schulz, EUMETSAT
Karl Taylor, PCMDI Jean-Noël Thépaut, ECMWF
Additional regular contributors: Otis Brown, Michel Rixen
Tsengdar Lee (NASA) and Renu Joseph (DOE) Luca Cinquini (JPL) – CoG technical support Denis Nadeu (PCMDI) – CMOR development Paul Durack (PCMDI) – Data specifications
Sophie Cloché (IPSL) – CFMIP archive Jim Biard (NCEI) and Matthias Tuma (WCRP) – beta testers
… and many others WDAC7, Geneva, 26-27 March 2018
Page 2
Presenta(onoutline
• Quickreview,generalstatusreport• Challenges,solu6onsintheworks
• Strategicconsidera6onsforWCRPSP
Page 3
• Aprojectforiden6fying,documen6nganddissemina6ngobserva6onsforclimatemodelevalua6oninWCRPmodelintercomparisons,notablyCMIP.
• Data(andtechnotes)accessiblewiththedistributedCMIPmodeloutput,adheringtosameconven6ons
• GuidedbytheWCRPDataAdvisoryCouncilobs4MIPSTaskTeam
obs4MIPshKps://www.earthsystemcog.org/projects/obs4mips/
….andgrowing!
ModelOutput
TargetQuan66es
Griddeddatasets
Complete(~125*)InProgress*(~15)ProposalsfromDataCall(~100)
Page 4
DataaccessibilityforWCRPprojectsTheEarthSystemGridFedera6on(ESGF)isbeingusedforCMIP6andotherWCRPprojects
ESGFDec2016conferencereport(Williamsetal.,2017)ESGFDec2017Recap(finalreportinprepara6on)
Page 5
Dataaccessandprojectconnectedness
• Obs4MIPsdata(andana4MIPs)areavailablethroughtheCoG
• CoGisintegratedwithESGF
• CMIP6willbehostedontheCoG,asaremanyotherprojects
Page 6
Obs4MIPsleverageskeyprotocolsandinfrastructure
• Experiment protocol and CMIP standard output
• Climate Forecast (CF) Convention (as applied in CMIP) • CMIP data governance led by WGCM Infrastructure panel (WIP)
• Utilities to ensure data complies to CMIP structure: CMOR3
• Distribution/replication via ESGF, technically aligned with CMIP data
• CoG: Project information, data search/retrieval, integrating projects
Pros: Pulling together key efforts that serve WCRP projects
Cons: Vulnerable to weak links
Page 7
obs4MIPsplanningmee(ngforCMIP6April2014,NASAHQbuts6llrelevant!
Selectedconsensusrecommenda6onsthatappliedtoallofthemee6ngtopicareas:
• Expandtheinventory
• Includemorehigherfrequencydata(a“goldenperiod”?)• Reliableanddefendableerrorcharacteriza(on/es6ma6onofobserva6ons• Includedatasetsinsupportofoff-linesimulators(primeexample:COSP—CloudFeedbackModelIntercomparisonProject[CFMIP]Observa6onSimulatorPackage)
• Collocatedobserva(ons,includingin-situdatasetsforprocessesleveldiagnos6cs• Precisedefini(onsofdataproducts(what’sactuallybeingreported),includingbiases,andprecisedefini6onsofthemodeloutputvariablesarerequired
Ferraroetal.(2015)BAMSandfullmee(ngreportonCoGwebsite
Page 8
ProgresssinceWDAC6
• 5TTtelecons,mul6plepresenta6onsatscien6ficmee6ngs
• Twomanuscriptsin-prep(#1strategy,#2datadescrip6ongovernance)
• Furtherstreamlining,e.g.,managingcontrolledvocabulariesonGitHub
• Datasetsspanacross7ESGFnodes,completelis6nggenerateddaily• CMIP6/obs4MIPsdataconven(onintegra(oncompleted
(obs4MIPsDataSpecifica(onsODS2.1)
• Collabora6onwithES-DOCtohandleobs4MIPstechnotes,DOI’s
• Twostrategiceffortstobroadenprojectscopeprototyped:
• obs4MIPsdataindicatorsnowestablished
• MechanismforincludingSupplementalInforma(on
Page 9
obs4MIPsDatasetSuitability&MaturityIndicators
IndicatorsforalldatasetswillbedeterminedbyTTinconsulta6onwithdatasetproviders
Page 10
TTwillberesponsibleforconfirmingindicators(proposedbydataproviders)foralldatasets
SIis“freeform”,accessiblefrom“bestes6mate”butnotsearchableindependently
Page 11
CoordinatedCMIP/obs4MIPsglobala_ributes,controlledvocabulary(CV),RegisteredContent(RC),andDataReferenceSyntax(DRS)
Somepredefinedglobala_ributes(therearemanyothers)
VariableID# Source_id*+ Source_version_number*+ Ins(tu(on_id+ Region**# Frequency* Nominal_resolu(on*# License
*Newobs4MIPssearchfacets+RegisteredContent(RC)#CVwithpre-definedop6onsmaintainedongithub
Sample‘sfcWind’
‘NOAA-NCEI-SeaWinds-1-2’‘1.2’
‘NOAA-NCEI’‘globalocean’
‘Amon’‘1x1degree’
Page 12
2018TimelinesWinter'18 Spring'18 Summer'18 Fall'18 Winter'19
Submit two papers
(strategy and conventions)
Possible 2nd Dataset Call:
Beyond Gridded?
Prototype enhanced
CoG features
Make existing obs4MIPs data consistent with ODS2.1
Prepare new datasets including from "1st Dataset Call"
Propogate use of new CoG features across
ESGF nodes (search facets , indicators
and Supplemental Info )
Page 13
SummaryandPerspec(ve
• obs4MIPsiswellposi(onedtohavesubstan(alimpactonCMIP6andotherWCRPMIPs
• WCRPSP:mightobs4MIPsprovideabasisforbe_erconnec(ngmodelsanddata?
• obs4MIPsTThasbeenabletoaddressmanyrecommenda(ons(e.g.,enablemoredataandinforma(ontobeincluded)
• Keychallengecon(nues:further“greasingthewheels”sothatdatasetscanbeefficientlymadetomeettheobs4MIPsdataspecifica8ons,andpublishedonESGF
• Thegoalforthecomingyearistogreatlyexpandtheobs4MIPsarchive,exploi(ngthenewobs4MIPsdataspecifica(ons(ODS2.1),supplementalinforma(onanddataindicators
• Effortstoadvanceobs4MIPsremainfocusedongriddeddatasets.Expandingthescopetoincludein-situdatawillrequirednewcontributorspreparedtodosubstan(alwork
Page 14
SummaryandPerspec(veii
• Presumingobs4MIPscon(nuestosuccessfullymature,therewilllikelybeaneedtorevisithowitissupportedandgoverned.
• Whileagreatdealofinfrastructureisinplace,abroaderobs4MIPswouldrequiremorepeopledoinghandsonwork.
• TheWGCM’sWIPmayserveasagoodexampleofhowtodothis,andperhapscouldbefurtherleveraged.
Page 15
Linkstorelatedmaterial–NEEDSTOBEUPDATED
• ESGFDec2016conferencereport(pdf)
• CMIP6dataspecifica6ons(googledocs)
• obs4MIPsdataspecifica6ons
• obs4MIPstablescontrolledvocabulary(github)
• ClimateModel/obsOutputRewriKer,CMOR(website)
• Drajuserguideforpreparingobs4MIPs(googledocs)
Page 17
1. Use the CMIP* Standard Model Output as guideline for selecting observations
2. Observations to be structured in coordination with the CMIP output (e.g. NetCDF, CF Convention, common vocabularies)
3. Hosted side by side on the ESGF with CMIP model output
4. Include a Technical Note for each variable describing observation and use for model evaluation (at graduate student level)
obs4MIPs:The4Commandments
*obs4MIPsconven(onshavebeenupdatedtobeconsistentwithCMIP6
Page 18
• CMOR3nowsupportsobserva6onaldata!
• Stronglyrecommendedforobs4MIPs–itistheeasiestwaytoensurecompliance
• SupportforCMIPand
obs4MIPsusers• Opensource,canbe
adoptedforotherpurposes
• BeingusedbymostCMIPpar6cipa6ngmodelinggroups
• AvailableviaAnacondawithpython,Candfortraninterfaces
cmor.llnl.gov
Page 19
Beyondthe“bestes(mate”obs4MIPsdataset
SupplementalInforma(onStrategycurrentlyinprepara(on
byWDACtaskteam
Supplementalinfo
Apossiblepathforwardtodealwithmul6pleunresolvedissueswithinobs4MIPs,e.g.:
• Addi6onaldocumenta6on• Uncertaintydata• Dataflags,masks• Suppor6ngvalida6ondata• DetailedMaturitymatrices
Organiza6onofsupplementaldatawillini6allybemoreheterogeneousthanassociated“bestes6mate”,andthereforenotsearchablefromahigherlevel.Itwillbealongsidebestes6mateasazippedarchive
Page 20
Obs4MIPs:StatusofObserva(onHoldings/
SubmissionsEarly2018
DatasetsCurrentlyHostedatobs4MIPs(VariableLongName)
• AirTemperature• AmbientAerosolOp6calThicknessat550nm• CALIPSO3DClearfrac6on• CALIPSO3DUndefinedfrac6on• CALIPSOClearCloudFrac6on• CALIPSOCloudFrac6on• CALIPSOHighLevelCloudFrac6on• CALIPSOLowLevelCloudFrac6on• CALIPSOMidLevelCloudFrac6on• CALIPSOScaKeringRa6o• CALIPSOTotalCloudFrac6on• CloudFrac6onretrievedbyMISR• CloudSat94GHzradarTotalCloudFrac6on• CloudSatRadarReflec6vityCFAD• EastwardNear-SurfaceWind• EastwardWind• Frac6onofAbsorbedPhotosynthe6callyAc6veRadia6on• ISCCPCloudAreaFrac6on(Jointhistogramofop6calthicknessandcloudtop
pressure)• ISCCPMeanCloudAlbedo(Cloud-frac6onweighted&day6meonly)• ISCCPMeanCloudTopPressure(Cloud-frac6onweighted&day6meonly)• ISCCPMeanCloudTopTemperature(Cloud-frac6onweighted&day6meonly)• ISCCPTotalCloudFrac6on(day6meonly)• LeafAreaIndex• MoleFrac6onofO3• Near-SurfaceWindSpeed• NorthwardNear-SurfaceWind• NorthwardWind• PARASOLReflectance• Precipita6on• SeaSurfaceHeightAboveGeoid• SeaSurfaceTemperature• SpecificHumidity• SurfaceDownwellingClear-SkyLongwaveRadia6on• SurfaceDownwellingClear-SkyShortwaveRadia6on• SurfaceDownwellingLongwaveRadia6on• SurfaceDownwellingShortwaveRadia6on• SurfaceUpwellingClear-SkyShortwaveRadia6on• SurfaceUpwellingLongwaveRadia6on• SurfaceUpwellingShortwaveRadia6on• TOAIncidentShortwaveRadia6on• TOAOutgoingClear-SkyLongwaveRadia6on• TOAOutgoingClear-SkyShortwaveRadia6on• TOAOutgoingLongwaveRadia6on• TOAOutgoingShortwaveRadia6on• TotalCloudFrac6on• WaterVaporPath
AirTemperatureSpecificHumidityAirTemperatureSpecificHumiditySeaSurfaceTemperatureTOAOutgoingLongwaveRadia6onTOAOutgoingClear-SkyLongwaveRadia6onTOAOutgoingShortwaveRadia6onTOAOutgoingClear-SkyShortwaveRadia6onTOAIncidentShortwaveRadia6onSurfaceDownwellingLongwaveRadia6onSurfaceDownwellingClear-SkyLongwaveRadia6onSurfaceUpwellingLongwaveRadia6onSurfaceDownwellingShortwaveRadia6onSurfaceDownwellingClear-SkyShortwaveRadia6onSurfaceUpwellingShortwaveRadia6onSurfaceUpwellingClear-SkyShortwaveRadia6onTotalCloudFrac6onSeaSurfaceHeightAboveGeoidPrecipita6on-monthlyPrecipita6on–3hourlyPrecipita6on-dailyPrecipita6on-monthlyNear-SurfaceWindSpeedEastwardNear-SurfaceWindNorthwardNear-SurfaceWindLeafAreaIndexMoleFraciontofOzoneAmbientAerosolOpi6calThicknessat550nmAmbientAerosolOpi6calThicknessat550nmWaterVaporPathISCCPCloudalbedoISCCPCloudalbedoCALIPSOScaKeringRa6o,srbox1CALIPSOScaKeringRa6o,srbox2CloudSatRadarReflec6vityCFADCALIPSOCloudFrac6onCALIPSOClearCloudFrac6onCALIPSOHighLevelCloudFrac6onISCCPCloudFrac6onCALIPSOLowLevelCloudFrac6onCALIPSOMidLevelCloudFrac6onCALIPSO3DClearFrac6onCALIPSOTotalCloudFrac6onCLOUDSATTotalCloudFrac6onISCCPTotalCloudFrac6onISCCPCloudTopTemperatureISCCPCloudTopTemperatureMissingdatafrac6onOverpassesPARASOLReflectanceSolarZenithAngleISCCPCloudTopPressureISCCPCloudTopPressureMISRCTH-ODCloudFrac6onCALIPSO3DUndefinedfrac6on
WaterVaporPathFrac6onofAbsorbedPhotosynthe6callyAc6veRadia6onSnowareafrac6onAmbientAerosolEx6nc6onOp6calThicknessat550nmSeaIcefrac6onSeaIcefrac6onSeaSurfaceTempSeaSurfaceTempSeaSurfaceTempTOAOutgoingLongwaveRadia6onTOAOutgoingLongwaveRadia6onTOAOutgoingShortwaveRadia6onTOAOutgoingLongwaveRadia6onMoleFrac6onofOzonealbedo;Ra6ooftwovariablesIceSheetTemperature?AmbientAerosolOpi6calThicknessat550nmSurfaceAqueousPar6alPressureofCO2dry_atmosphere_mole_frac6on_of_carbon_dioxideNear-SurfaceWindSpeed
Near-SurfaceAirTemperatureAirTemperatureGeopoten6alHeightEastwardNear-SurfaceWindNorthwardNear-SurfaceWindNear-SurfaceWindSpeedNear-SurfaceSpecificHumiditySurfaceDownwardLatentHeatFluxSurfaceDownwardSensibleHeatFluxNear-SurfaceAirTemperaturePrecipita6onSealevelpressureSeaSurfaceTempTotalChlorophyllMassConcentra6onInfraredbrightnesstemperatures(11μm,0.6μm,6.7μm)LeafAreaIndexnormalizeddifferencevegeta6onindexFrac6onofPhotosynthe6callyAc6veRadia6onSeaSurfaceTemperatureprecipita6onairtemperatureBurntAreaFrac6onSurfaceSnowAmountMidTroposphericHumidityUpperTroposphericHumidityAirTemperaturegeopoten6alheightbendinganglerefrac6vityCLARAcloud_area_frac6on;CFMIP45surfacealbedocloud_area_frac6oncloudtopphase;area_frac6on_of_liquid_cloud_water_par6cles_at_cloud_topcloudtoppressure;air_pressure_at_cloud_topcloudop6calthickness;atmosphere_op6cal_thickness_due_to_cloudcloudicewaterpath;atmosphere_cloud_ice_contentsurface_downwelling_shortwave_flux_in_airsurfacedownwellingclearskyshortwavefluxsurface_downwelling_shortwave_flux_in_aircloudicewaterpath;atmosphere_cloud_ice_contentcloudliquidwaterpathccicloudareafrac6on(7x7table);CFMIP45(tbd)cloudareafrac6oncloudtopphase;area_frac6on_of_liquid_cloud_water_par6cles_at_cloud_topcloudtoppressure;air_pressure_at_cloud_topcloudop6calthickness;atmosphere_op6cal_thickness_due_to_cloudSeaIceAreaFrac6onSurfaceTemperatureSeaIceAreaFrac6onsurface(2m)airtemperatureanomalyNear-SurfaceSpecificHumidityNear-SurfaceRela6veHumidity,Near-SurfaceAirTemperature
Complete(~125*)InProgress*(~15)SubmissionsFromDataCall(~90)*Afewtechnotesremaintobecompleted
Page 21
TaskTeamEfforts/Organiza6on• RegularTTtelecons(~monthly)• AllprojectmanagementdataaccessibletoTTviaGoogleDocs• MuchoftheTTefforthasbeenhelpingtobeKerdefine
strategicpath,butincreasingly…• Movingtowardhelpingtoshepherddatasetsfromproposal
topublica6ononESGF
Page 22
Monitoringdatasetsacrossthedistributedfedera6on:AnewcapabilityscansallESGFnodesandgeneratesacatalogofavailabledatasets
~125DataSets