Federal Aviation Administration 1 of 30 A Process to Prove the Payback on Safety Interventions Dr. Bill Johnson Chief Scientific and Technical Advisor.

Post on 12-Jan-2016

214 Views

Category:

Documents

0 Downloads

Preview:

Click to see full reader

Transcript

Federal AviationAdministration

1 of 30

A Process to Prove the Payback on Safety

Interventions

Dr. Bill JohnsonChief Scientific and Technical AdvisorMaintenance Human Factorsbill-dr.johnson@faa.gov

+1.770.500.8217

Shell Aircraft Safety Seminar 2012Human Factors –Safety’s Vital IngredientThe Hague, Netherlands11-12 October 2012

Federal AviationAdministration

Federal AviationAdministration

2 of 30

Presentation Plan• Finance and Safety

• ROI Challenges - Solutions

• Calculating ROI (A detailed example)

• Other Examples

• Cautions

• Q&A

Shell Aircraft Safety Seminar 2012Human Factors –Safety’s Vital IngredientThe Hague, Netherlands11-12 October 2012

Federal AviationAdministration

3 of 30

Why care about ROI

Investment

in Safety

Continuing/

Improving Safetyand/or

Expense Reduction

and/or

Revenue Increase

Federal AviationAdministration

4 of 30

Why care about ROI?

“If you want to implement/revise safety

programs you must show the payoff.”

Federal AviationAdministration

5 of 30

Challenges to ROI of Safety

Intangible

Cause and Effect

Integration-Combination

TimeShell Aircraft Safety Seminar 2012Human Factors –Safety’s Vital IngredientThe Hague, Netherlands11-12 October 2012

Federal AviationAdministration

6 of 30

ROI Solutions

SMS Data Emphasis

Voluntary Reporting

Acceptance

Federal AviationAdministration

7 of 30

Presentation Plan• Finance and Safety

• ROI Challenges - Solutions

• Calculating ROI (A detailed example)

• Other Examples

• Cautions

• Q&A

Shell Aircraft Safety Seminar 2012Human Factors –Safety’s Vital IngredientThe Hague, Netherlands11-12 October 2012

ROI: Any Questions

Shell Aircraft Safety Seminar 2012Human Factors –Safety’s Vital IngredientThe Hague, Netherlands11-12 October 2012

ROI: From Words to Numbers

Federal AviationAdministration

10 of 30

Example: Fatigue Awareness Training at MRO

Shell Aircraft Safety Seminar 2012Human Factors –Safety’s Vital IngredientThe Hague, Netherlands11-12 October 2012

Federal AviationAdministration

11 of 30

A Few More Challenges to ROI

Financial personnel assume ROI responsibility

Executives do not demand ROI

Corporate culture and ROI

Perceived value of ROI

Fix problems rather than assign costs

Focus on costs

Focus on production and schedules

Shell Aircraft Safety Seminar 2012Human Factors –Safety’s Vital IngredientThe Hague, Netherlands11-12 October 2012

Federal AviationAdministration

12 of 30

Example ROI Summary

Reduction in A/C damage: $935K (10% of 2010)

Reduction in OSHA injury: $119K (10% of 2010)

Financial ROI: 312% Probability of success: .8 +/- .1

Reduction in A/C damage: $3M (30% reduction)

Reduction in OSHA injury: $184K (15% reduction)

* Does not include a 1% system-wide efficiency improvement of $900K

Fatigue Awareness Training to 2,500 @ 2 hours eachCost was $205 K during 2011

Investment

Benefit Forecast*

Actual*

Federal AviationAdministration

13 of 30

ROI: Fill in the Boxes

Federal AviationAdministration

14 of 30

The ROI Menu

Federal AviationAdministration

15 of 30

Investment QuestionsHow many personnel trained?

How long is training in hours? 

What is the average hourly rate for trainees?

Were there missed opportunity costs during training time? 

Count time for management and support ? Rate?

Cost of special hardware? Amortize?

Costs for training development & facilities? Amortize?

Schedule for training over time?

Federal AviationAdministration

16 of 30

The Investment

Investment to deliver training$204,500.00

Investment to deliver training$204,500.00

Federal AviationAdministration

17 of 30

Expected Return QuestionsWhat are the safety benefits?

How many current safety incidents?

How many safety incidents can be reduced?

What are the metrics to measure these changes? (e.g., aircraft damage, rework, delivery delay, OSHA injuries,…)

Costs associated with each metric?

How much will personnel efficiency be improved?

Federal AviationAdministration

18 of 30

The Return - Benefits

Investment Benefits$1,053,702

Aircraft DamageOSHA Reportables

$ 934,500$ 119,20210%

Federal AviationAdministration

19 of 30

The Directions to ROI

Federal AviationAdministration

20 of 30

Federal AviationAdministration

21 of 30

Project Summary (1 of 2)

Break Even Point

$204.5K

$638,461/$204.500 = 3.12

Federal AviationAdministration

22 of 30

Project Summary (2 of 2)

Federal AviationAdministration

23 of 30

Recent ROI Findings

Reduction in A/C damage: $935K (10% of 2010)

Reduction in OSHA injury: $119K (10% of 2010)

Financial ROI: 312% Probability of success: .8 +/- .1

Reduction in A/C damage: $3M (30% reduction)

Reduction in OSHA injury: $184K (15% reduction)

* Does not include a 1% efficiency improvement of $900K

Fatigue Awareness Training to 2,500 @ 2 hours eachCost was $205 K during 2011

Investment

Benefit Forecast*

Actual*

Federal AviationAdministration

24 of 30

Presentation Plan• Finance and Safety

• ROI Challenges - Solutions

• Calculating ROI (A detailed example)

• Other Examples

• Cautions

• Q&A

Shell Aircraft Safety Seminar 2012Human Factors –Safety’s Vital IngredientThe Hague, Netherlands11-12 October 2012

Federal AviationAdministration

25 of 30

Need More Examples?Org.

Type

Topic Invest

$

Return

$

Break

Even

ROI 2Q %

ROI 4Q

%

ROI 5Q

%

MRO FRMS

Training205 .0 K 1.1 M 1.5 Qtr. 224 274 312

Airline Wheel

Installation24.5K 1.7 M 0.6 Qtr. 2896 5556 6938

MRO Windscreen

Service1.8K 75.1 K 1.0 Qtr. 1908 3514 3916

Airline Ramp

Comm.3.1 M 6.8 M 5.0 Qtr. 0 77 120

Airline Paint

Hangar16.0 K 120.0 K 1.0 Qtr. 169 598 650

Airline Hangar

Damage56.0 K 390K 2.0 Qtr. 96 381 426

Federal AviationAdministration

26 of 30

Cautions

• Real world vs. Controlled laboratory

• Diligence on estimates

• Be conservative

• Expect surprises

Federal AviationAdministration

27 of 30

What you can do next

Shell Aircraft Safety Seminar 2012Human Factors –Safety’s Vital IngredientThe Hague, Netherlands11-12 October 2012

• Your SMS provides the data

• Try the formula

• ROI considerations will increase

• Knowledge equals power

Federal AviationAdministration

28 of 30

Presentation Summary• Finance and Safety

• ROI Challenges - Solutions

• Calculating ROI (A detailed example)

• Other Examples

• Cautions

• Q&A

Shell Aircraft Safety Seminar 2012Human Factors –Safety’s Vital IngredientThe Hague, Netherlands11-12 October 2012

Federal AviationAdministration

29 of 30

Why care about ROI?

“…safety and profitability are the mutually

inclusive #1 priority for most industries

especially transportation…”

B. Johnson, Paragraph 1 of this conference paper.

Federal AviationAdministration

30 of 30

Questions - Discussion

top related