Top Banner
Increasing Forecast Skill through Bridging of Climate Teleconnections: A Hybrid Statistical- Dynamical Prediction System Dan Collins (Climate Prediction Center) Collaborators: Sarah Strazzo, Liwei Jia, and Emily Becker (CPC); Q.J. Wang (U. Melbourne) and Andrew Schepen (CSIRO) 03 August 2017 MAPP/NGGPS PI Meeting
36

a hybrid statistical-dynamical prediction system 2017/Day 2... · Increasing Forecast Skill through Bridging of Climate Teleconnections: A Hybrid Statistical- Dynamical Prediction

Mar 23, 2019

Download

Documents

trannguyet
Welcome message from author
This document is posted to help you gain knowledge. Please leave a comment to let me know what you think about it! Share it to your friends and learn new things together.
Transcript
Page 1: a hybrid statistical-dynamical prediction system 2017/Day 2... · Increasing Forecast Skill through Bridging of Climate Teleconnections: A Hybrid Statistical- Dynamical Prediction

Increasing Forecast Skill through Bridging of Climate Teleconnections:

A Hybrid Statistical- Dynamical Prediction System

Dan Collins (Climate Prediction Center)

Collaborators: Sarah Strazzo, Liwei Jia, and Emily Becker (CPC);

Q.J. Wang (U. Melbourne) and Andrew Schepen (CSIRO)

03 August 2017

MAPP/NGGPS PI Meeting

Page 2: a hybrid statistical-dynamical prediction system 2017/Day 2... · Increasing Forecast Skill through Bridging of Climate Teleconnections: A Hybrid Statistical- Dynamical Prediction

Calibration, Bridging, and Merging (CBaM)

CBaM:

➢ Developed by CSIRO collaborators

➢ Application to NMME and North America

Page 3: a hybrid statistical-dynamical prediction system 2017/Day 2... · Increasing Forecast Skill through Bridging of Climate Teleconnections: A Hybrid Statistical- Dynamical Prediction

➢ Calibration and bridging model uses Bayesian Joint Probability (BJP) modeling (Wang et al. 2009)

○ Predictor (e.g., Niño 3.4) and predictand (e.g., 2-m T) modeled using a bivariate normal

distribution, where the distribution parameters are not assumed to be fixed

○ Individual calibration and bridging BJP models are developed for each NMME member mean,

grid point, lead, and season

○ Comparison to Ensemble Regression (EReg) baseline used at CPC (Unger et al. 2009)

➢ BJP generates a statistical ensemble by sampling from the posterior distribution of the bivariate normal

parameters (n = 1000)

Bayesian Joint Probability (BJP) Model

BJP Niño 3.4 bridged forecast of DJF 2-m temperature for a single grid point (1-month lead)

Te

mpera

ture

(℃

)

Page 4: a hybrid statistical-dynamical prediction system 2017/Day 2... · Increasing Forecast Skill through Bridging of Climate Teleconnections: A Hybrid Statistical- Dynamical Prediction

Calibration, Bridging, and Merging (CBaM)

Raw dynamical model

forecast of North American

2-m temperature

Statistically corrected

(calibrated) forecast of

North American 2-m

temperature

Statistical post-

processing

Page 5: a hybrid statistical-dynamical prediction system 2017/Day 2... · Increasing Forecast Skill through Bridging of Climate Teleconnections: A Hybrid Statistical- Dynamical Prediction

Calibration, Bridging, and Merging (CBaM)

Dynamical model forecast

of a relevant climate index

(e.g., Niño 3.4)

Statistically bridged

forecast of North American

2-m temperature

Statistical post-

processing

Page 6: a hybrid statistical-dynamical prediction system 2017/Day 2... · Increasing Forecast Skill through Bridging of Climate Teleconnections: A Hybrid Statistical- Dynamical Prediction

Calibration, Bridging, and Merging (CBaM)

Statistically bridged

forecast of North American

2-m temperature

Statistically corrected

(calibrated) forecast of

North American 2-m

temperature

w

w

Weighted merging of forecasts

based on performance in hindcast

period

Page 7: a hybrid statistical-dynamical prediction system 2017/Day 2... · Increasing Forecast Skill through Bridging of Climate Teleconnections: A Hybrid Statistical- Dynamical Prediction

Differences in model & observed Nino 3.4 correlation pattern

Page 8: a hybrid statistical-dynamical prediction system 2017/Day 2... · Increasing Forecast Skill through Bridging of Climate Teleconnections: A Hybrid Statistical- Dynamical Prediction

NMME

Observed

Model ensemble means

CFSv2 CMC1 CMC2 GFDL FLOR NASA CCSM4 NMME

Correlation w/obs 0.86 0.96 0.96 0.92 0.94 0.95 0.88 0.95

Skill in forecasts of large-scale climate indices

Page 9: a hybrid statistical-dynamical prediction system 2017/Day 2... · Increasing Forecast Skill through Bridging of Climate Teleconnections: A Hybrid Statistical- Dynamical Prediction

Objective

➢ Question: Does statistical bridging using climate indices improve

forecast skill, beyond the skill of calibrated model forecasts of

temperature and precipitation?

Page 10: a hybrid statistical-dynamical prediction system 2017/Day 2... · Increasing Forecast Skill through Bridging of Climate Teleconnections: A Hybrid Statistical- Dynamical Prediction

Brier Skill Score (BSS):

NMME 1-month lead calibrated forecasts of

2-m temperature for 12 overlapping seasons

Page 11: a hybrid statistical-dynamical prediction system 2017/Day 2... · Increasing Forecast Skill through Bridging of Climate Teleconnections: A Hybrid Statistical- Dynamical Prediction
Page 12: a hybrid statistical-dynamical prediction system 2017/Day 2... · Increasing Forecast Skill through Bridging of Climate Teleconnections: A Hybrid Statistical- Dynamical Prediction

DJF

Page 13: a hybrid statistical-dynamical prediction system 2017/Day 2... · Increasing Forecast Skill through Bridging of Climate Teleconnections: A Hybrid Statistical- Dynamical Prediction

BSS: Model calibrated forecasts of DJF 2-m temperature

NMME

Page 14: a hybrid statistical-dynamical prediction system 2017/Day 2... · Increasing Forecast Skill through Bridging of Climate Teleconnections: A Hybrid Statistical- Dynamical Prediction

BSS: Lead 1 bridged forecasts of DJF 2-m temperature

Page 15: a hybrid statistical-dynamical prediction system 2017/Day 2... · Increasing Forecast Skill through Bridging of Climate Teleconnections: A Hybrid Statistical- Dynamical Prediction

BSS: Lead 1 merged forecasts of DJF 2-m temperature

Page 16: a hybrid statistical-dynamical prediction system 2017/Day 2... · Increasing Forecast Skill through Bridging of Climate Teleconnections: A Hybrid Statistical- Dynamical Prediction

BSS: NMME calibrated, bridged, & merged forecasts

Page 17: a hybrid statistical-dynamical prediction system 2017/Day 2... · Increasing Forecast Skill through Bridging of Climate Teleconnections: A Hybrid Statistical- Dynamical Prediction
Page 18: a hybrid statistical-dynamical prediction system 2017/Day 2... · Increasing Forecast Skill through Bridging of Climate Teleconnections: A Hybrid Statistical- Dynamical Prediction

Bayesian

Joint

Probability

Ensemble

Regression

2-m

Temperature

Page 19: a hybrid statistical-dynamical prediction system 2017/Day 2... · Increasing Forecast Skill through Bridging of Climate Teleconnections: A Hybrid Statistical- Dynamical Prediction

Brier Skill Score: Probabilistic forecasts of below normal US + AK 2-m Temperature (CFSv2)

Brier Skill Score: Probabilistic forecasts of below normal US + AK 2-m Temperature (CMC1)

Page 20: a hybrid statistical-dynamical prediction system 2017/Day 2... · Increasing Forecast Skill through Bridging of Climate Teleconnections: A Hybrid Statistical- Dynamical Prediction

Precipitation bridging

➢ Can lower skill of precipitation forecasts be enhanced by bridging?

Page 21: a hybrid statistical-dynamical prediction system 2017/Day 2... · Increasing Forecast Skill through Bridging of Climate Teleconnections: A Hybrid Statistical- Dynamical Prediction

4-by-2 fig showing BSS diff (brg - cal),

1 panel per model, DJF Brier Skill Score Difference (Bridged − Calibrated):

1-month lead forecasts of precipitation rate

DJF JJA

Page 22: a hybrid statistical-dynamical prediction system 2017/Day 2... · Increasing Forecast Skill through Bridging of Climate Teleconnections: A Hybrid Statistical- Dynamical Prediction

JJA DJF

Page 23: a hybrid statistical-dynamical prediction system 2017/Day 2... · Increasing Forecast Skill through Bridging of Climate Teleconnections: A Hybrid Statistical- Dynamical Prediction

DJF

Page 24: a hybrid statistical-dynamical prediction system 2017/Day 2... · Increasing Forecast Skill through Bridging of Climate Teleconnections: A Hybrid Statistical- Dynamical Prediction

JJA

Page 25: a hybrid statistical-dynamical prediction system 2017/Day 2... · Increasing Forecast Skill through Bridging of Climate Teleconnections: A Hybrid Statistical- Dynamical Prediction

Conclusions

➢ On average, calibrated forecasts are greater skill relative to Nino 3.4 bridging

➢ Bridging models provide greater skill in particular seasons and regions

○ Example: Winter temperatures, over the northern United States

➢ Bridging skill and enhancement of calibrated forecasts varies by model

➢ Merged forecasts result in the most coverage of positive skill.

Page 26: a hybrid statistical-dynamical prediction system 2017/Day 2... · Increasing Forecast Skill through Bridging of Climate Teleconnections: A Hybrid Statistical- Dynamical Prediction

Ongoing and future work

➢Exploring additional climate indices for bridging (e.g., AO/NAO)

➢Incorporating all ensemble members

➢Application to subseasonal forecasts

Page 27: a hybrid statistical-dynamical prediction system 2017/Day 2... · Increasing Forecast Skill through Bridging of Climate Teleconnections: A Hybrid Statistical- Dynamical Prediction

Thank you!

Page 28: a hybrid statistical-dynamical prediction system 2017/Day 2... · Increasing Forecast Skill through Bridging of Climate Teleconnections: A Hybrid Statistical- Dynamical Prediction

Extras

Page 29: a hybrid statistical-dynamical prediction system 2017/Day 2... · Increasing Forecast Skill through Bridging of Climate Teleconnections: A Hybrid Statistical- Dynamical Prediction

Reliability: Lead 1 forecasts of DJF 2-m temperature

Page 30: a hybrid statistical-dynamical prediction system 2017/Day 2... · Increasing Forecast Skill through Bridging of Climate Teleconnections: A Hybrid Statistical- Dynamical Prediction

Reliability plots:

1-month lead calibrated and

bridged CFSv2 forecasts of

DJF 2-m temperature

Page 31: a hybrid statistical-dynamical prediction system 2017/Day 2... · Increasing Forecast Skill through Bridging of Climate Teleconnections: A Hybrid Statistical- Dynamical Prediction

1-Month Lead DJF Pr(Below normal 2-m T)

EReg Niño 3.4 Bridging

1-Month Lead DJF Pr(Below normal 2-m T)

BJP Niño 3.4 Bridging

Page 32: a hybrid statistical-dynamical prediction system 2017/Day 2... · Increasing Forecast Skill through Bridging of Climate Teleconnections: A Hybrid Statistical- Dynamical Prediction
Page 33: a hybrid statistical-dynamical prediction system 2017/Day 2... · Increasing Forecast Skill through Bridging of Climate Teleconnections: A Hybrid Statistical- Dynamical Prediction

BJP probabilities of above/below normal temperature

Page 34: a hybrid statistical-dynamical prediction system 2017/Day 2... · Increasing Forecast Skill through Bridging of Climate Teleconnections: A Hybrid Statistical- Dynamical Prediction

BJP probabilities of above/below normal temperature

Page 35: a hybrid statistical-dynamical prediction system 2017/Day 2... · Increasing Forecast Skill through Bridging of Climate Teleconnections: A Hybrid Statistical- Dynamical Prediction

Brier Skill Score:

NMME 1-month lead bridged forecasts of

DJF 2-m temperature

Page 36: a hybrid statistical-dynamical prediction system 2017/Day 2... · Increasing Forecast Skill through Bridging of Climate Teleconnections: A Hybrid Statistical- Dynamical Prediction