Dar Training

Decision Analysis and Decision Analysis and Resolution (DAR) ProcessResolution (DAR) Process

Nova TechnologiesNova TechnologiesSystems and Software Systems and Software Engineering ProcessesEngineering Processes

The DAR ProcessThe DAR Process

Established by the Nova Technologies Established by the Nova Technologies Systems and Software Engineering Systems and Software Engineering Working Group (SSEPWG)Working Group (SSEPWG)

The purpose of Decision Analysis and The purpose of Decision Analysis and Resolution (DAR) is to analyze possible Resolution (DAR) is to analyze possible solutions using a formal evaluation solutions using a formal evaluation process that evaluates identified process that evaluates identified alternatives against established criteria. alternatives against established criteria.

Entry & Exit CriteriaEntry & Exit Criteria

A project needs to establish and document in its project A project needs to establish and document in its project plan guidelines to determine which events or items plan guidelines to determine which events or items should be subjected to a formal evaluation process. should be subjected to a formal evaluation process. – DAR is not suitable for every decision, but is important for those

with significant impact on key success factors

Typical guidelines for when a formal evaluation is Typical guidelines for when a formal evaluation is needed include:needed include:– a change in work products under CM,a change in work products under CM,– schedule delays over a certain percentage or specific amount of schedule delays over a certain percentage or specific amount of

time, time, – the ability to achieve project objectives, the ability to achieve project objectives, – cost increase over a certain percentage, cost increase over a certain percentage, – make/buy/reuse decision, make/buy/reuse decision, – significant architectural or requirements changes, significant architectural or requirements changes, – selection of third party solution providers, and selection of third party solution providers, and – selection of organizational tools.selection of organizational tools.

Entry CriteriaEntry Criteria

EntryEntry– Plans exist for establishing this process, Plans exist for establishing this process,

assigning responsibilities, establishing assigning responsibilities, establishing monitoring procedures, and providing for monitoring procedures, and providing for improvement of this process improvement of this process

– Adequate resources are committed to DAR Adequate resources are committed to DAR activities activities

– Personnel are trained on the DAR activities Personnel are trained on the DAR activities and how to use this process and how to use this process

InputInput

A critical or high-risk event or item that requires A critical or high-risk event or item that requires a structured decision-making process. a structured decision-making process.

Examples: Examples: – We need to select a image generator (IG) for a new We need to select a image generator (IG) for a new

simulator.simulator.– There are 3 different architectures which would satisfy There are 3 different architectures which would satisfy

the statement of work – which one should we use?the statement of work – which one should we use?– Do we need to develop software for some Do we need to develop software for some

functionality, buy a COTS product, or find something functionality, buy a COTS product, or find something Open Source (reuse)?Open Source (reuse)?

OutputsOutputs

Selective alternative for event or itemSelective alternative for event or item– Example: The ACME 9900 IGExample: The ACME 9900 IG

Evaluation reportEvaluation report– Example: IGs evaluated, criteria used, Example: IGs evaluated, criteria used,

weights assigned to criteria, selection scores.weights assigned to criteria, selection scores.

DAR notesDAR notes– Example: Any supporting documentation Example: Any supporting documentation

(meeting minutes, vendor brochures, pricing (meeting minutes, vendor brochures, pricing data, etc.)data, etc.)

Exit CritieriaExit Critieria

Evaluation report is complete and Evaluation report is complete and distributed to appropriate stakeholders.distributed to appropriate stakeholders.

Roles & ResponsibilitiesRoles & Responsibilities

A number of roles are required to support A number of roles are required to support the DAR process. These may be filled by the DAR process. These may be filled by different people, a single individual may fill different people, a single individual may fill multiple roles.multiple roles.– Program Manager (PM)Program Manager (PM)– Team LeadTeam Lead– Team MembersTeam Members– Quality Assurance (QA)Quality Assurance (QA)– Configuration Management (CM)Configuration Management (CM)

Program Manager (PM)Program Manager (PM)

Program Manager (PM)Program Manager (PM)– Person with overall responsibility for the Person with overall responsibility for the

successful execution of the program/project.successful execution of the program/project.– Determines that a DAR evaluation is needed, Determines that a DAR evaluation is needed, – Selects decision team and its lead, Selects decision team and its lead, – Assigns resources to the team,Assigns resources to the team,– Receives the evaluation report, andReceives the evaluation report, and– Approves resulting decisions.Approves resulting decisions.

Team LeadTeam Lead

Team LeadTeam Lead– Appointed by the program manager to head Appointed by the program manager to head

up a DAR evaluation.up a DAR evaluation.– Ensures all team members are trained in the Ensures all team members are trained in the

DAR process.DAR process.– Leads team in determining evaluation criteria, Leads team in determining evaluation criteria,

weighting, and scoring.weighting, and scoring.– Leads decision-making discussions, leading Leads decision-making discussions, leading

to selection of a recommended alternative. to selection of a recommended alternative. – Prepares evaluation report.Prepares evaluation report.

Team MembersTeam Members

Team MembersTeam Members– Perform research for alternatives, Perform research for alternatives, – Evaluate alternatives, Evaluate alternatives, – Present findings at team meetings for Present findings at team meetings for

discussion.discussion.

QA & CMQA & CM

Quality Assurance (QA): Quality Assurance (QA): – Ensures the team is using a formal evaluation Ensures the team is using a formal evaluation

process for making critical decisions.process for making critical decisions.

Configuration Management (CM)Configuration Management (CM)– Provides numbering guidance for documents Provides numbering guidance for documents

produced in this process, produced in this process, – Enters DAR work products into CM system, Enters DAR work products into CM system, – Ensures program data plan is followed. Ensures program data plan is followed.

Process Tasks & ActivitiesProcess Tasks & Activities

The DAR process tasks can be combined The DAR process tasks can be combined or expanded as needed as long as the or expanded as needed as long as the intent of the process is maintained. intent of the process is maintained.

Rationale for removal of any item must be Rationale for removal of any item must be documented and approved by the documented and approved by the appropriate party. appropriate party.

More detail may always be added, such as More detail may always be added, such as “how to” information, if desired. “how to” information, if desired.

Process WorkflowProcess Workflow

Plan the DARPlan the DAR

The PM assigns a DAR team lead.The PM assigns a DAR team lead.The PM and DAR team lead assign the team members.The PM and DAR team lead assign the team members.The team lead ensures all team members are trained in The team lead ensures all team members are trained in the DAR process.the DAR process.The PM or his designee creates a working directory to The PM or his designee creates a working directory to hold the DAR artifacts.hold the DAR artifacts.The PM or his designee creates an action item in the The PM or his designee creates an action item in the Project Notebook to track DAR status.Project Notebook to track DAR status.The PM determines the approval signatures required for The PM determines the approval signatures required for this DAR.this DAR.The DAR team plans the effort required to perform the The DAR team plans the effort required to perform the DAR and gets PM approval for expending the needed DAR and gets PM approval for expending the needed resources.resources.

Identify StakeholdersIdentify Stakeholders

The DAR team lead identifies stakeholders The DAR team lead identifies stakeholders for this DAR activity. Stakeholders may for this DAR activity. Stakeholders may include the following:include the following:– Those who provide the alternatives, risks, and Those who provide the alternatives, risks, and

historical data.historical data.– The DAR team.The DAR team.– Those who will implement the decision Those who will implement the decision

recommended by the DAR team. recommended by the DAR team.

Obtain Stakeholder InputObtain Stakeholder Input

The DAR team obtains input from The DAR team obtains input from stakeholders:stakeholders:– A list of requirements applicable to the DAR.A list of requirements applicable to the DAR.– A list of potential alternative approaches. A list of potential alternative approaches. – Suggested evaluation criteria and relative Suggested evaluation criteria and relative

weighting.weighting.– Key risks. Key risks.

Establish Evaluation CriteriaEstablish Evaluation Criteria

The DAR team determines the evaluation The DAR team determines the evaluation criteria and relative weighting after criteria and relative weighting after considering input from all stakeholders.considering input from all stakeholders.The DAR team reviews the evaluation The DAR team reviews the evaluation criteria with the stakeholders before criteria with the stakeholders before finalizing the criteria.finalizing the criteria.The DAR team documents the rationale The DAR team documents the rationale for choosing the selected evaluation for choosing the selected evaluation criteria.criteria.

Identify Alternative SolutionsIdentify Alternative Solutions

The DAR team identifies the alternative The DAR team identifies the alternative solutions to be evaluated after considering solutions to be evaluated after considering stakeholder input. stakeholder input.

Select Evaluation Methods Select Evaluation Methods

The DAR team determines the ranking The DAR team determines the ranking and scoring method.and scoring method.– Suggested ranking and scoring methods are Suggested ranking and scoring methods are

found in the DAR Tools document.found in the DAR Tools document.– The DAR team must agree on a scoring The DAR team must agree on a scoring

method, the scoring range, and have a method, the scoring range, and have a common understanding of what the scores common understanding of what the scores represent.represent.

The DAR team documents the selected The DAR team documents the selected approach. approach.

Evaluate AlternativesEvaluate Alternatives

Acquire data needed to evaluate the Acquire data needed to evaluate the alternatives.alternatives.For each alternative, the DAR team assigns a For each alternative, the DAR team assigns a score to each decision criteria, employing the score to each decision criteria, employing the ranking and scoring method previously selected.ranking and scoring method previously selected.The total weighted score for each alternative is The total weighted score for each alternative is determineddeterminedThe DAR team may consider new alternatives, The DAR team may consider new alternatives, criteria, or methods if the proposed alternatives criteria, or methods if the proposed alternatives do not test well.do not test well.The DAR team documents the evaluation The DAR team documents the evaluation

Evaluation ExampleEvaluation ExampleRe

f Pa

raN

umbe

Continuous(C)Pass 10 BestFail 1 Satisfactory

0 FailMaximum score is 10

Weight:

5 10 10 10 10 10 10 53050 90 80 70 60 80 100 580

10 10 10 10 10 7 10 556100 90 80 70 60 56 100 580

9 10 9 10 10 7 10 53890 90 72 70 60 56 100 580

4 10 10 10 10 10 8 50040 90 80 70 60 80 80 580

10 9 8 7

Sch

edul

e R

isk

6 8 10

Cri

teri

a #1

Cri

teri

a #2

5.x.

x

Tec

hnic

al R

isk

Decision Analysis and Resolution ToolRequirements/Criteria/Objectives

1.x.

x

2.x.

x

3.x.

x

4.x.

x

Cri

teri

a #3

Cri

teri

a #4

Cri

teri

a #5

Risk

Sco

re

58

Tot

al W

eigh

ted

Ratin

g

Perc

ent o

f max

imum

(%)

Rank

ing

Tech

nica

l Sco

re

C COption I: Vistek Mark 8 91%

C C C C C

3 60% 31%

Option 2: ACME 9900 96% 1 69% 27%

27%

Option 4: NewSim Model 2 86% 4 59% 28%

Option 3: QZ Engineering 50 93% 2 66%

You can use tools to help make an objective evaluation of options.You can use tools to help make an objective evaluation of options.

Example: A simple spreadsheet to weight various evaluation Example: A simple spreadsheet to weight various evaluation criteria and obtain a ranking of options.criteria and obtain a ranking of options.

Select SolutionsSelect Solutions

The DAR team makes a decision and The DAR team makes a decision and reviews it with the stakeholders making reviews it with the stakeholders making changes if necessary.changes if necessary.– The DAR team documents the stakeholder The DAR team documents the stakeholder

review review – The DAR team documents the final decision The DAR team documents the final decision

and rationale for the selection. and rationale for the selection.

Perform Post-Mortem Perform Post-Mortem

The DAR team lead obtains and records approval The DAR team lead obtains and records approval signatures.signatures.The DAR team captures lessons learned in the DAR The DAR team captures lessons learned in the DAR notes.notes.The DAR team captures and archives documents per the The DAR team captures and archives documents per the program Data Management Plan.program Data Management Plan.– The completed DAR scoring and analysis worksheets.The completed DAR scoring and analysis worksheets.– The DAR evaluation report.The DAR evaluation report.– DAR notes.DAR notes.

CM is notified that the DAR is complete and that the CM is notified that the DAR is complete and that the DAR artifacts can be archived to the program data DAR artifacts can be archived to the program data management repository. management repository. The PM documents the effort expended vs. planned. The PM documents the effort expended vs. planned.

Metrics and ArtifactsMetrics and Artifacts

The DAR process should capture metrics and The DAR process should capture metrics and artifacts to document the DAR process and artifacts to document the DAR process and support process improvement.support process improvement.

Examples:Examples:– Actual staff hours expended versus planned.Actual staff hours expended versus planned.– DAR evaluation report with scoring and analysis DAR evaluation report with scoring and analysis

worksheets that document the process and worksheets that document the process and recommended solution, along with approval recommended solution, along with approval signatures.signatures.

– DAR notes, with lessons learned.DAR notes, with lessons learned.

References and Additional References and Additional ResourcesResources

Nova Technologies SSEPWG Decision Analysis Nova Technologies SSEPWG Decision Analysis and Resolution Processand Resolution Process– DAR-Process_Ver_1_0DAR-Process_Ver_1_0– my.novatechnologies.com/xxxxxmy.novatechnologies.com/xxxxx

Dare To Use DAR…Dare To Use DAR…– WhitepaperWhitepaper– my.novatechnologies.com/xxxxmy.novatechnologies.com/xxxx

Tools for Decision Analysis and Resolution– SPIN PresentationSPIN Presentation– my.novatechnologies.com/xxxmy.novatechnologies.com/xxx