I n t e g r i t y - S e r v i c e - E x c e l l e n c e Air Force Weather Agency Probabilistic Lightning Forecasts Using Deterministic Data Evan Kuchera.

I n t e g r i t y - S e r v i c e - E x c e l l e n c e

Air Force Weather Agency

Probabilistic Lightning Forecasts Using Deterministic

Data

Evan Kuchera and Scott Rentschler16 Aug 2007

2I n t e g r i t y - S e r v i c e - E x c e l l e n c e

Motivation

Air Force operators require skillful and objective probabilistic weather information to maximize efficiency and minimize loss

Typically this is accomplished with ensembles for grid scale phenomena

However, sub grid scale processes are probabilistic in nature even with deterministic data

We believe that ensemble forecast skill will be higher if a probabilistic approach is taken with each ensemble member for sub grid scale phenomena Addresses both sub-grid scale and flow uncertainties

3I n t e g r i t y - S e r v i c e - E x c e l l e n c e

Motivation

Example—lightning forecast with SPC SREF method 10 ensemble members CAPE values of 130,125,120,115,110,105,103,102,101,101

With a forecast threshold of 100 J/kg, this gives a 100% chance of lightning

However, with values so close to the threshold, the true probability is likely much closer to 50% than 100%

This can be accounted for somewhat with real-time calibration after the ensemble is created (as SPC does with success), but this is not necessarily an option for the Air Force (resource constraints, lack of calibration data)

4I n t e g r i t y - S e r v i c e - E x c e l l e n c e

Background

Lightning background: Need graupel and ice particle collisions to transfer

negative charge to the larger particles Thunderstorm updrafts need to grow large graupel

particles with enough fall speed to cause a separation of charge in the vertical

The theoretical value of CAPE required to do this is only 25 J/kg

5I n t e g r i t y - S e r v i c e - E x c e l l e n c e

Background

CAPE background: Accepted parcel theory assumption is that as the parcel

rises, all condensate is immediately removed, and that there is no latent heat of freezing

However, lightning is caused by frozen condensates in an updraft!

We decided to test CAPE both ways—the traditional way, and with condensates/latent heat of freezing

6I n t e g r i t y - S e r v i c e - E x c e l l e n c e

Image from NASA-GHCCWorldwide lightning climatology

7I n t e g r i t y - S e r v i c e - E x c e l l e n c e

Traditional Lifted Index

8I n t e g r i t y - S e r v i c e - E x c e l l e n c e

TEST Lifted Index

9I n t e g r i t y - S e r v i c e - E x c e l l e n c e

Methodology

Goal: create a probabilistic lightning algorithm using a large set of CONUS observations and physical assumptions relevant worldwide 2006 3-hourly 20 km RUC analyses NLDN lightning in the RUC grid box (0-3 hr after

analysis) 3 hour precipitation from METARS

Find which forecast parameters are the best, then curve fit the probability of lightning given a binned value of that parameter

10I n t e g r i t y - S e r v i c e - E x c e l l e n c e

2006 Results

METAR ObservationsNo lightning/no precip 2,014,877

No lightning/precip 147,881lightning/no precip 33,840

lightning/precip 27,143Total 2,223,741

Climatology of lightning 2.7%Climatology of lightning

given precipitation 15.5%Climatology of lightning given non-zero CAPE 4.1%

Climatology of lightning given precipitation and

non-zero CAPE 24.7%

11I n t e g r i t y - S e r v i c e - E x c e l l e n c e

NLDN 3-hourly lightning climatology for a 16 km grid box (2003-2006)

12I n t e g r i t y - S e r v i c e - E x c e l l e n c e

Results

GL CAPE is calculated from the LFC to -20C

Set to zero if equilibrium level is warmer than -20C

TEST is condensate and latent heat of freezing included

13I n t e g r i t y - S e r v i c e - E x c e l l e n c e

CAPE > 0, Precipitation > 0.01

y = 0.14*Ln(x) + 0.005

0

0.1

0.2

0.3

0.4

0.5

0.6

0.7

0.8

0.9

1

0 50 100 150 200 250 300 350 400 450 500

CAPE (J/kg) * Precipitation (inches)Bins with width 5

Lig

htn

ing

Pro

bab

ilit

y

14I n t e g r i t y - S e r v i c e - E x c e l l e n c e

CAPE=0, Precipitation > 0.01

y = 0.36x0.5

0

0.1

0.2

0.3

0.4

0.5

0.6

0.7

0.8

0.9

0 0.5 1 1.5 2 2.5 3 3.5 4

[LI in K (from -4 to 0) + 4] * Precipitation (inches)Bins width 0.10

Lig

htn

ing

Pro

ba

bili

ty

15I n t e g r i t y - S e r v i c e - E x c e l l e n c e

CAPE > 0, Precipitation=0

y = 0.025Ln(x) + 0.03

0

0.02

0.04

0.06

0.08

0.1

0.12

0.14

0.16

0.18

0.2

0 5 10 15 20 25 30 35 40

CAPE / (CIN +100)

Lig

htn

ing

Pro

ba

bili

ty

16I n t e g r i t y - S e r v i c e - E x c e l l e n c e

Results

Forecasts by bin when precipitation occurred

0

10000

20000

30000

40000

50000

60000

70000

80000

90000

0.025 0.075 0.125 0.175 0.225 0.275 0.325 0.375 0.425 0.475 0.525 0.575 0.625 0.675 0.725 0.775 0.825 0.875 0.925 0.975

Climatology=0.155

17I n t e g r i t y - S e r v i c e - E x c e l l e n c e

Results

Reliability--Precipitation only

0

0.1

0.2

0.3

0.4

0.5

0.6

0.7

0.8

0.9

1

0 0.1 0.2 0.3 0.4 0.5 0.6 0.7 0.8 0.9 1

Forecast

Ob

se

rva

tio

ns Perfect Reliability

18I n t e g r i t y - S e r v i c e - E x c e l l e n c e

Results

ROC Curve--precipitation only (probability thresholds on curve)

00.05

0.15

0.25

0.35

0.45

0.55

0.65

0.75

0.850.9510

0.1

0.2

0.3

0.4

0.5

0.6

0.7

0.8

0.9

1

0 0.2 0.4 0.6 0.8 1

FAR

PO

D

No Skill Forecast

19I n t e g r i t y - S e r v i c e - E x c e l l e n c e

Method BSS ROC areaSPC -0.420 0.713NULL -0.180 0.500TEST 0.362 0.888

SPC method: forecast 100% chance of lightning if GL CAPE is greater than 100 J/kg and precipitation is greater than 0.01

inches. Forecast 0% otherwise.

NULL method: Always forecast 0% chance of lightning.

TEST method: Algorithm presented here.

BSS: Brier skill score, compares mean squared error of forecast to mean squared error of climatology. 1 is perfect, 0 is no skill,

negative is worse than climatology.

ROC area: Total integrated area underneath ROC curve. 1 is perfect, 0.5 is no skill.

Results

20I n t e g r i t y - S e r v i c e - E x c e l l e n c e

Summary

Algorithm has been developed to forecast lightning probability given observed instability (RUC analysis) and precipitation (METARS)

Algorithm is somewhat sharp, reliable at all forecast probabilities, and has good resolution of events and non-events

Buoyancy calculations probably need to account for condensate and latent heat of freezing—but our data are not conclusive on this point

21I n t e g r i t y - S e r v i c e - E x c e l l e n c e

Other/Future Work

Equations have been developed (not shown here) to forecast strikes per unit area for application to any model resolution

After knowing strikes per unit area, can forecast probabilities for smaller areas (i.e. Air Force base warning criteria area) based on downscaling climatology—equation has been developed for this purpose as well

Just beginning to look at algorithm with model data and in ensembles—issues with model precipitation forecasts

Acknowledgments: ARM data archive, Dr. Tony Eckel, Stephen Augustyn, Bill Roeder, Dr. David Bright, Jeff Cunningham

22I n t e g r i t y - S e r v i c e - E x c e l l e n c e

Questions?

GFS 66 hour grid point lightning probability forecast valid this afternoon

23I n t e g r i t y - S e r v i c e - E x c e l l e n c e

Backup Slides

Strikes per 400 square km

y = e4.5x

0

10

20

30

40

50

60

70

80

90

100

0 0.2 0.4 0.6 0.8 1

Probability

Str

ikes

24I n t e g r i t y - S e r v i c e - E x c e l l e n c e

Backup Slides

Adjustments for changes in model resolution or area of interest First, re-calculate total number of strikes for the new

model grid box area If model grid is finer than RUC, re-calculate probabilities

using inverse of strikes equation If model grid is coarser than RUC, increase probabilities

using special upscaling equation If area of interest is smaller than area of model grid,

recalculate strikes and use downscaling equation to get probabilities

25I n t e g r i t y - S e r v i c e - E x c e l l e n c e

Backup Slides

Downscaling equation details Inputs:

Strikes (S) horizontal resolution of coarse area in km (C) horizontal resolution of fine area in km (F)

Equation: 1-[1-(F^2/C^2)]^(S^A) Where A is a “fudge factor” depending on F A=1-0.17*LN(F-1)

A equals unity when F is 2 km, and slowly decreases toward zero as F approaches ~350 km

In nature, lightning tends to be randomly distributed at 2 km (storm scale) but more clustered at higher resolutions. “A” attempts to account for this

Best to use this equation from 2 to 128 km grid sizes If strikes is less than one, calculate equation using 1 strike, then multiply

result times number of strikes

26I n t e g r i t y - S e r v i c e - E x c e l l e n c e

Backup Slides

Upscaling Probability added to:

[1-probability]*[1-(F^2/C^2)]*downscaled probability

This ensures high probabilities will only occur when the original probability was high, or the area has increased substantially with moderately high initial probabilities

No testing as to whether this is calibrated

27I n t e g r i t y - S e r v i c e - E x c e l l e n c e

Backup SlidesNWS Topeka forecast taken from the web on 15 Aug:

Friday, August 17 at 7pmTemperature: 89°FThunder: <10%

28I n t e g r i t y - S e r v i c e - E x c e l l e n c e

Backup Slides

29I n t e g r i t y - S e r v i c e - E x c e l l e n c e

Backup Slides