1 Building Supportive and Synergistic Processes: Service Level Agreements Operational Processes Performance Measures Climate Service Meeting Feb 16-17, 2011 Washington, DC
Jan 18, 2018
1
Building Supportive and Synergistic Processes:
Service Level AgreementsOperational ProcessesPerformance Measures
Climate Service Meeting Feb 16-17, 2011Washington, DC
2
Acknowledgments:
Thanks for great discussions so far withRick Rosen
Don AndersonJin Huang
Bill LapentaScott HausmanMike HalpertScott Handel
February 16, 2011 3
Why do we need Service Level Agreements now?
To help build a roadmap for how we will work together.To ensure accountability between the CS & other LOs on center / laboratory / office responsibilities translated into budget.To assist planning (short and long term), redirection / integration, and execution. Functional approach.
Do we need SLA’s for each Climate Service Priority Area?
4
• FY11 Priority Areas– Science– Predictions and Projections– Observations– Data– Monitoring– Science and Services– Partnerships– Regional– Communication– Assessments– Attribution
• 11 Potential SLA’s?• How broad should the SLA’s be?
5
EXAMPLE:
Service Level Agreement Between the CS and the NWS for Predictions and Projections in Support of
Regional Climate Services
February 16, 2011
February 16, 2011 6
Background on the Agreement
Describes a working level relationship between the CS and the NWS for predictions and projections.
Focused on relationships between centers, laboratories and offices within the CS and NWS for this capability and thus does not address other capabilities, priority areas or programs within the individual lines that will not fall under this agreement.
February 16, 2011 7
Outline of Agreement
ObjectivesBackgroundImplementing Arrangement
Contributing Centers, Laboratories and Offices Roles and Responsibilities
Annual Operating PlanFY11 AOP Tasks and Milestones Performance Measures
Issues Memorandum of Agreement
Accountability; Signatures
February 16, 2011 8
Objectives
To ensure an integrated end-to-end program inclusive of climate model development, execution, archive and delivery of climate predictions and projections on time and space scales relevant to decision makers.
To outline details of the relationship between CS and NWS centers, laboratories and offices contributing to the requirements of the CS and NWS for the predictions and projections capability.
February 16, 2011 9
Tiers
3 Tiers are envisionedMemorandum of Agreement (MOA) signed at the AA levelImplementing Arrangement signed at the center / laboratory / office levelAnnual Operating Plan (AOP) milestones and performance measures updated on an annual basis
February 16, 2011 10
Background
CS and NWS will be key partners in NOAA’s program to respond to the NGSP objectives within the long-term climate adaptation and mitigation goal. NOAA requires a prediction and projection capability for past, present and future states of the climate to support preparedness, adaptation and other climate-sensitive decisions.NOAA capacity for predictions and projections is distributed among the NOAA line offices; is located in laboratories, centers, field offices, and programs; depends on strong and continuing internal and external partnerships; and requires formal agreements.
February 16, 2011 11
Implementing Arrangement – Participating Centers, Offices
and LaboratoriesNational Weather Service
Environmental Modeling Center (EMC)NCEP Central Operations (NCO) Office of Hydrology (OHD)Climate Services Division (CSD)
Climate ServiceClimate Prediction Center (CPC)Climate Test Bed (CTB)National Climatic Data Center (NCDC)Geophysical Fluid Dynamics Laboratory (GFDL)Earth System Research Laboratory (ESRL) Physical Sciences Division (PSD)Climate Program Office (NOAA Climate Predictions and Projections [NCPP] Platform, a partnership between the Research Programs Division (RPD) and the Climate Assessment and Services Division (CASD))
February 16, 2011 12
Implementing Arrangement – Roles and Responsibilities
Details the actions planned and coordination between the CS and NWS centers, laboratories and offices contributing to the predictions and projections capability.Example (next); there are many in the document
February 16, 2011 13
Implementing Arrangement – CFS Example
NWSEnvironmental Modeling Center (EMC)
Develop, implement and apply global models, including the CFS and GFS
NCEP Central Operations (NCO)Provide IT infrastructure for operational forecasts (GFS, CFS); Provide reliable, timely and accurate central guidance to service centers, regions and local offices
CSNational Climatic Data Center (NCDC)
Archive and provide public access to NOAA climate models and supporting datasets, including the NCEP CFS forecasts and CFS Reanalysis and Reforecasts
Climate Prediction Center (CPC)Deliver operational climate prediction, monitoring and assessment products on timescales from weeks to yearsNote: CPC will remain an affiliated NCEP Center
February 16, 2011 14
FY11 Annual Operating Plan
Lists Tasks and AOP Milestones for each centerFor FY11, this consists of the AOP milestones from our Seattle quad charts (all predictions and projections milestones are included)
See Document for details
For FY12 and beyond, a more cohesive set of Tasks and draft AOP Milestones would be developed starting with an annual planning meeting (e.g. during late summer, prior to the start of the new fiscal year).
February 16, 2011 15
Performance Measures
Current measures are inadequateSkill of US Seasonal Temperature Forecasts (GPRA)Experimental decadal predictions under unforced conditions and under the action of climate forcingsImproved quantification of the regional distributions of atmospheric species of relevance for climateImproved quantification of the roles of natural and anthropogenic factors in climate changeIncreased contributions to national and international climate-relevant assessmentsCumulative Number of externally peer-reviewed publications from MAPP-funded projects
The Implementing Arrangement and annual AOP planning will enhance development of Logic Models for Performance Measurement and P&P Program Evaluation
February 16, 2011 16
Issues
Issues to Discuss Feb 16-17:A lot of effort is still needed in the “Implementing Arrangement” to focus roles and responsibilities on specific activities that integrate across the LO’s – and this relates to how we develop PMs and how broad the SLAs should be.CTB will be broadened to help bring GFDL, NCEP and other models together to work on topical areas of mutual interest, e.g. by supporting CPTs. GFDL is participating in 3 CPTs jointly funded by NSF and NOAA and a CPPA funded VOCALS project.GSD earth system model based on FIM not mentioned as a contribution to the CS in this SLA. Raises the question of whether an SLA can span more than 2 Los?Missing from the document:
A section on financial considerations / funding strategyA section describing how predictions and projections will develop its Annual Operating Plan in the future, including updates to this document:
» Annual planning meeting (late summer) to draft AOP milestones
February 16, 2011 17
What is an Operational Process
A process is considered operational (by CPC) if it satisfies one or more of the following:• Is required to update an existing climate prediction,
monitoring or assessment product; • Is timely, reliable and accurate;• Produces output that is required as input into
another operational process;• Produces output that is required by one or more
internal or external users.
February 16, 2011 18
Old
Skill of US seasonal temperature outlooks (GPRA)
A measure of Progress in seasonal forecasts
New (Proposed)% of CPC forecasts above thresholds
Combines US extended range, monthly and seasonal temperature and precipitation outlooksThe trend shows ProgressThe thresholds allow users to determine what fraction of CPC forecasts may be useful for their decisions.
CPC Performance Measures
19THE CLIMATE SERVICEFebruary 10, 2011 Climate Service Update