Six_Sigma Overview

Six Sigma and the CMMSix Sigma and the CMM

Better Software Development Better Software Development

Terrence W. CraftTerrence W. Craft

Omaha SPINOmaha SPINJune 15, 2004June 15, 2004

GoalsGoals

Strive for 0 defectsStrive for 0 defects Proceed systematicallyProceed systematically Check everythingCheck everything Improve continuouslyImprove continuously

Inspect input, observe output

2

What’s a Process?What’s a Process?

A sequence of steps performed for a given purpose, for example, the software development process.

- IEEE-STD-610

as compared to:

Procedure – a written description of a course of action to be taken to perform a given task.

- IEEE-STD-610

3

A Mature ProcessA Mature Process

Consistent with the way work actually gets doneConsistent with the way work actually gets done

Defined, documented, and continuously improvingDefined, documented, and continuously improving

– understoodunderstood– usedused– livingliving

Supported visibly by management and othersSupported visibly by management and others

Well controlled—process fidelity is audited and enforcedWell controlled—process fidelity is audited and enforced

Constructive use of product and process measurementConstructive use of product and process measurement

Disciplined use of technology Disciplined use of technology

4

What Are the Benefits What Are the Benefits of a Mature Process?of a Mature Process?

Enables you to focus on the system (and that’s about 85% of the Enables you to focus on the system (and that’s about 85% of the cause of problems)cause of problems)

People develop their potential more fully and are more People develop their potential more fully and are more effective within the organizationeffective within the organization

By defining, measuring, and controlling the process, improvements By defining, measuring, and controlling the process, improvements are more successful and sustainedare more successful and sustained

The likelihood increases of appropriate technology, techniques, and The likelihood increases of appropriate technology, techniques, and tools being introduced successfullytools being introduced successfully

5

Change Is a ProcessChange Is a Process

Disciplined change is the key to success.Disciplined change is the key to success.

Improvement includesImprovement includes– planningplanning– evaluating improvement proposals and evaluating improvement proposals and

planning actionsplanning actions– establishing process improvement establishing process improvement

teamsteams– conducting pilot programs for process conducting pilot programs for process

improvementimprovement– updating procedures, training, etc.updating procedures, training, etc.

Improvements are transferred into everyday practice across the organization.

6

Error Correction Costs By Phase

$$$

Value of Fixing Defects EarlyValue of Fixing Defects Early

Relative Cost to Correct Error

Operation

DetailedDesign

Integration

Validation

Implementation

TIME

Taking Dead AimTaking Dead Aim

Six Sigma = 99.99966% accurateSix Sigma = 99.99966% accurate Five Sigma = 99.9767%Five Sigma = 99.9767% Four Sigma = 99.379%Four Sigma = 99.379% Three Sigma = 93.32%Three Sigma = 93.32% Two Sigma = 69.1%Two Sigma = 69.1% One Sigma = 31%One Sigma = 31%

Failure is the opportunity to begin again more intelligently. - Henry Ford 8

Why Sigma (Why Sigma () Levels Matter) Levels MatterNumber of defects per million opportunitiesNumber of defects per million opportunities

6 Sigma = 3.46 Sigma = 3.4 5 Sigma = 2335 Sigma = 233 4 Sigma = 6,2104 Sigma = 6,210 3 Sigma = 66, 8073 Sigma = 66, 807 2 Sigma = 308,5372 Sigma = 308,537 1 Sigma = 690,0001 Sigma = 690,000

Six Sigma = process improvement and management philosophy focused on reducing process output variation.

9

Why Close Isn’t Good EnoughWhy Close Isn’t Good Enough99% accuracy equals…99% accuracy equals…

117,000 pieces of lost first-117,000 pieces of lost first-class mail per hourclass mail per hour

800,000 mishandled 800,000 mishandled personal checks each daypersonal checks each day

23,087 lemons among new 23,087 lemons among new computers shipped each computers shipped each monthmonth

7.2 hours per month without 7.2 hours per month without electricityelectricity

Even if you’re on the right track, you’ll get run over if you just sit there. - Will Rogers

99.9% Quality99.9% Quality

Even at 99.9% quality there would be…Even at 99.9% quality there would be…– At least 20,000 wrong drug prescriptions per yearAt least 20,000 wrong drug prescriptions per year– Unsafe drinking water almost 1 hour each monthUnsafe drinking water almost 1 hour each month– No telephone or TV transmission for nearly 10 No telephone or TV transmission for nearly 10

minutes each weekminutes each week– Two long or short landings at O’Hare each dayTwo long or short landings at O’Hare each day– 25,000 lost or incorrectly delivered articles of mail 25,000 lost or incorrectly delivered articles of mail

per hourper hour– Over 9,000 wrong felony convictions per yearOver 9,000 wrong felony convictions per year

11

D-M-A-I-CD-M-A-I-C

Define

Measure

Analyze

Improve

Control

D-M-A-I-C is the roadmap for improving existing processes.

Reduce defects to improve the capability of a process to exceed customer expectations

12

DMAICDMAIC DefineDefine

– Project charterProject charter– Stakeholder analysisStakeholder analysis– SIPOCSIPOC– VOCVOC

MeasureMeasure– Data collectionData collection– Validating the measurement systemValidating the measurement system– Developing a sampling strategyDeveloping a sampling strategy– Understanding variationUnderstanding variation– Process capabilityProcess capability

AnalyzeAnalyze– Organizing potential causesOrganizing potential causes– Verifying causesVerifying causes– Hypothesis testsHypothesis tests– Regression analysisRegression analysis– DOEDOE

ImproveImprove– Generating solutionsGenerating solutions– Assessing risks and piloting Assessing risks and piloting

solutionssolutions– Planning toolsPlanning tools

ControlControl– Quality controlQuality control– StandardizationStandardization– Monitoring control chartsMonitoring control charts– Evaluating resultsEvaluating results– Key learningsKey learnings– CMM assessmentCMM assessment

Where there is an open mind there will always be a frontier.- Charles F. Kettering

Where To Use DMAICWhere To Use DMAIC

Green Belt effortsGreen Belt efforts PITs/PATs/Tiger TeamsPITs/PATs/Tiger Teams Project managementProject management Quick hitsQuick hits Opening a businessOpening a business

Define, Measure, Analyze, Improve, Control14

Did You Know?Did You Know?

Less than 20% of 194 companies monitoring software quality say they use Six Sigma to improve the quality of internally developed applications.

InformationWeek Research’s Software Quality 2003 report.

83% not using Six Sigma

17% using Six Sigma

15

What Are These Things?What Are These Things?

The The Capability Maturity Capability Maturity ModelModel describes the stages describes the stages through which software through which software organizations evolve as they organizations evolve as they define, implement, measure, define, implement, measure, control, and improve their control, and improve their s/w processes. The model s/w processes. The model provides a guide for provides a guide for selecting process selecting process improvement strategies by improvement strategies by facilitating the determination facilitating the determination of current process of current process capabilities and the capabilities and the identification of issues most identification of issues most critical to s/w quality and critical to s/w quality and process improvement.process improvement.

Six SigmaSix Sigma is a smarter way to is a smarter way to manage a business or a manage a business or a department. Six Sigma puts department. Six Sigma puts the customer first and uses the customer first and uses facts and figures to drive facts and figures to drive better solutions. The better solutions. The foundation includes:foundation includes:

– Prevent defects.Prevent defects.– Reduce variation.Reduce variation.– Focus on the customer.Focus on the customer.– Makes decisions based on Makes decisions based on

facts.facts.– Encourage teamwork.Encourage teamwork.

16

What Is the Capability What Is the Capability Maturity Model (CMM)?Maturity Model (CMM)?

A common-sense application of process management A common-sense application of process management and quality improvement concepts to software and quality improvement concepts to software development and maintenancedevelopment and maintenance

A community-developed guideA community-developed guide

A model for organizational improvementA model for organizational improvement

The underlying structure for reliable and consistent The underlying structure for reliable and consistent CMM-based appraisal methodsCMM-based appraisal methods

17

ResultKey Process Areas

Level Characteristic

Continuous process capability improvement

Product quality planning; tracking of measured software process

Management oversightand tracking of project;stable planning andproduct baselines

Key Process Areas

Ad hoc (success depends on heroes)

"People"

Productivity& Quality

RiskRisk

Productivity& Quality

Software configuration management Software quality assurance Software subcontract management Software project tracking & oversightSoftware project planningRequirements management

Peer reviews Intergroup coordinationSoftware product engineering Integrated software managementTraining programOrganization process definitionOrganization process focus

Capability Maturity Model

Software process defined and institutionalized to provide product quality control

Software quality management Quantitative process management

Process change management Technology change management Defect prevention

Optimizing (5)

Managed (4)

Defined (3)

Repeatable (2)

Initial (1)

18

Six Sigma

CMM

Six Sigma & CMM RelationshipSix Sigma & CMM Relationship

It is not necessary to change. Survival is not mandatory.

W. Edwards Deming 19

Working TogetherWorking Together

Showing improvements; ROI, quantifiable Showing improvements; ROI, quantifiable results.results.– Six Sigma tools and focus on measurementsSix Sigma tools and focus on measurements

Requirements – the model assumes you Requirements – the model assumes you have them.have them.– Maybe not. Six Sigma can help define, Maybe not. Six Sigma can help define,

quantify, and illuminatequantify, and illuminate

Do what you can, with what you have, where you are.- Theodore Roosevelt

Why Use Both?Why Use Both?

CMMCMM is the leading framework for is the leading framework for assessing and improving an assessing and improving an organization’s software practices. organization’s software practices. It gives It gives us the “what” should be done.us the “what” should be done.

Six SigmaSix Sigma is a business management is a business management discipline focused on engineering for discipline focused on engineering for superior quality as defined by the superior quality as defined by the customer needs. customer needs. Six Sigma gives us the tools Six Sigma gives us the tools for “how” to do it.for “how” to do it.

21

Capability Versus PerformanceCapability Versus Performance

Process capability – the range of expected results that can be Process capability – the range of expected results that can be achieved by following a process, initially established at the achieved by following a process, initially established at the organization level. A predictor of future project outcomes.organization level. A predictor of future project outcomes.

Process performance – a measure of the actual results achieved Process performance – a measure of the actual results achieved from following a process. Refers to a particular project in the from following a process. Refers to a particular project in the organization.organization.

22

Process VariationProcess Variation

Which pilot would Which pilot would you recommend?you recommend?

Why?Why? How do you think How do you think

your processes your processes perform?perform?

Would you Would you recommend your recommend your process?process?

A1

A2

A3

A4

A5

A6 A

7 A8 A

9A

1 0

B1B3

B2B4B

5

B6B

7

B8B

9B1 0

A project is a problem scheduled for solution- J. M. Juran

THE ROLE OF THE PROCESS OWNER IS TO MANAGE THE PROCESS LIFECYCLE.

UnderstandPerformance gap

Measure process

performance

UnderstandCustomer needsand benchmark

competitors

Definethe

process

Improveindividual

performance(training, tools,

attitudes,replacement)

Improveprocess

Modifydesign

Replacedesign

Performprocess

Set performance target

Develop & execute

improvement plan

DMAIC

DMADV

THE PROCESS IMPROVEMENT LIFECYCLETHE PROCESS IMPROVEMENT LIFECYCLE

24

Quick DefinitionsQuick Definitions

DMAIC – Define, Measure, Analyze, DMAIC – Define, Measure, Analyze, Improve, ControlImprove, Control– Sometimes seen as DMAIIC – Define, Measure, Sometimes seen as DMAIIC – Define, Measure,

Analyze, Improve, Implement, ControlAnalyze, Improve, Implement, Control DMADV – Define, Measure, Analyze, DMADV – Define, Measure, Analyze,

Design, VerifyDesign, Verify

Whatever is worth doing at all is worth doing well.- Philip Dormer Stanhope

PDCA is Where It's AtPDCA is Where It's At

Credit for PDCA to Walter Shewart; also often attributed to W. Edwards Deming.

26

Bottom LineBottom Line

CMM gives us the “what” should be done; Six Sigma gives us the “how” to do it.

When the thinking changes, the organization changes, and vice versa.- Gerald Weinberg 27

SummarySummary

Using Six Sigma to help implement a Using Six Sigma to help implement a CMM will provide:CMM will provide:– discrete and macro measures to ensure discrete and macro measures to ensure

improvement targets are achieved,improvement targets are achieved,– a proven way to close process gaps, anda proven way to close process gaps, and– control processes to insure sustainabilitycontrol processes to insure sustainability

Define, Measure, Analyze, Improve, Control 28

Questions, Comments, Concerns?Questions, Comments, Concerns?

……in other words, does this make sense?in other words, does this make sense?

29

Let’s TalkLet’s Talk

Email & voice– [email protected]– Tel. 402-222-5598/402-880-7656

Follow-up

Thank you for coming today!

30