Human Systems Integration Dr. Ravi Vaidyanathan [email protected] Fundamentals of Systems Engineering
Feb 10, 2016
2
Objectives
• HSI conceptual models• Top-down view of HSI in DoD• Apply systems analysis approach to HSI process• Examine operational HSI applications
• NOTE: This presentation is mostly a compilation of other people’s ideas
3
Challenges in discussing HSI
• Lack of formalism– Language– Processes
• HSI workforce fragmented by specialty• Resulting lack of specificity regarding HSI
INCOSE consensus def (2007): An interdisciplinary technical and management process for integrating human considerations within and across all system elements; an essential enabler to systems engineering.
4
Challenges in discussing HSI
5
HSI principles
1. Top-level leadership2. Human-centered design focus3. Source selection policy4. Organizational integration of HSI domains5. Documentation integration into procurement process6. Quantification of human parameters7. HSI technology8. Test & evaluation/assessments9. Highly qualified practitioners10. Education & training program
6
Booher’s HSI model
HSI Process
Systems Definition Systems Development
Systems Deployment
Highly Concentrated User Focus
Human Related Technologies &
Disciplines
Systems Integrations
People Technology
Organization
DOMAINS PROCESS
DECISION User requirements
User requirements
Human Technologies & Disciplines
Human Technologies & Disciplines
1234567
7
Need for HSI
Source: “Human Systems Integration”, D. Folds, INCOSE 2007
8
Need for HSI
Source: “Human Systems Integration”, D. Folds, INCOSE 2007
9
HSI & human performance
HSI is the acquisition model for human performance
10
Evolving perspective…
11
Human performance optimization
Linking HSI to Survivability KPP…
Proposed model:
(HFE • M • P • T) (ESOH • H • S) Performance
What if these parameters are driven to absolute limits?
• 100% system reliability/0 injuries
• Perfect habitability
• 100% survivable
(HFE • M • P • T) HPO Survivability
12
FAAFNA
FSA
DOTMLPF Analysis
DOTMLPF = Doctrine, Organization, Training, Material, Leadership, Personnel and Facilities; FAA = Functional Area Analysis; FNA = Functional Need Analysis; FSA = Functional Solution Analysis
Capabilities-Based Assessment
Merging the processes…
13
Request to industry
Industry response for agreement
Design & proving of equipment
Overarching system requirements split into equipment vs. human
pathways
Requirements engineering favors equipment pathway
HSI bridges pathways
Unstructured need
Formal statement of required capability
Formal statement of what people, organizations &
procedures must provide
Formal statement of what a system (equipment) must
do to provide the capability
Formal definition of a system (equipment) that meets the requirement
Equipment acceptance
Fielded equipment
(more detail)
Formal description of people, training,
organizations & procedures
Provision of required people & human skills
Trained people & operating procedures
(more detail)
Work together
Capability delivered
Definitive problem statement
Options & tradeoffs
Options & tradeoffs
Options & tradeoffs
Request to industry
Industry response for agreement
Design & proving of equipment
Overarching system requirements split into equipment vs. human
pathways
Requirements engineering favors equipment pathway
HSI bridges pathways
Unstructured need
Formal statement of required capability
Formal statement of required capability
Formal statement of what people, organizations &
procedures must provide
Formal statement of what people, organizations &
procedures must provide
Formal statement of what a system (equipment) must
do to provide the capability
Formal statement of what a system (equipment) must
do to provide the capability
Formal definition of a system (equipment) that meets the requirement
Formal definition of a system (equipment) that meets the requirement
Equipment acceptanceEquipment acceptance
Fielded equipmentFielded equipment
(more detail)
Formal description of people, training,
organizations & procedures
Formal description of people, training,
organizations & procedures
Provision of required people & human skillsProvision of required people & human skills
Trained people & operating procedures
Trained people & operating procedures
(more detail)
Work together
Capability delivered
Definitive problem statement
Options & tradeoffsOptions & tradeoffs
Options & tradeoffsOptions & tradeoffs
Options & tradeoffsOptions & tradeoffs
HSI and System Development
14
Systems Analysis Approach
Identify need and determine
system requirements
Design and develop
system
Manufacture system
(production)
Operate and maintain
system
1.0 2.0 3.0 4.0
Blanchard & Fabrycky (2006), Systems Engineering and Analysis
Requirements analysis
Functional analysis
Requirements allocation
Trade-off studies
1.1 1.2 1.3 1.4
TOP DOWN APPROACH TO BUILDING A HSI PROCESS
15
Derived requirements• Mission definition
– “Optimize total system performance”– “Minimize total ownership costs”– Ensure system is built to accommodate user population
• Critical performance parameters– Measures of system effectiveness– Life cycle costs
• Operational deployment/distribution– “Early in the [defense] acquisition process”– Involving human factors engineering; personnel; habitability; manpower;
training; environ, safety & occ. health (ESOH), survivability • Operational life cycle
– Throughout defense acquisition life cycle• Utilization requirements
– Program managers in formulating acquisition strategy• Effectiveness factors:
– Metrics for cost, schedule &performance
Requirements analysis
Functional analysis
Requirements allocation
Trade-off studies
1.1 1.2 1.3 1.4
Requirements analysis
Functional analysis
Requirements allocation
Trade-off studies
1.1 1.2 1.3 1.4
DOD 5000
Series
DOD 5000
Series
1.1.1
Systems Analysis Approach
16
Technical approach• Acquisition programs shall be managed through the
application of a systems engineering approach that optimizes total system performance and minimizes total ownership costs (DODI 5000.1)
• Effective sustainment of weapon systems begins with the design and development of reliable and maintainable systems through the continuous application of a robust systems engineering methodology (DODI 5000.2)
• [HSI addresses] the human systems elements of the systems engineering process (Defense Acquisition Guide)
Requirements analysis
Functional analysis
Requirements allocation
Trade-off studies
1.1 1.2 1.3 1.4
Requirements analysis
Functional analysis
Requirements allocation
Trade-off studies
1.1 1.2 1.3 1.4
DOD 5000
Series
DOD 5000
Series
DAGDAG
Derived requirements
1.1.1 1.1.2
Systems Analysis Approach
17
Systems engineering Vee-models
Technical Approach in Context
18
Systems Analysis Approach
Identify need and determine
system requirements
Design and develop
system
Manufacture system
(production)
Operate and maintain system
1.0 2.0 3.0 4.0
Requirements analysis
Functional analysis
Requirements allocation
Trade-off studies
1.1 1.2 1.3 1.4
19
Requirements analysis
Functional analysis
Requirements allocation
Trade-off studies
1.1 1.2 1.3 1.4
Define mission goals as
functional system
requirements
Specify system measures of effectiveness
Develop supporting
measures of performance
Analyze trans-domain trade-offs
1.2.1 1.2.2 1.2.3 1.2.4
Allocate requirements to
human
Analyze inter/intra-domain trade-offs
Allocate requirements to
domains
Develop domain measures of performance
1.2.5 1.2.6 1.2.7 1.2.8
Feedback and control
Systems Analysis Approach
20
Types of trade-offs
Level of trade-off Trade-off type Description Example
Systems Trans-domainFunctional allocation between hardware or software and human
Redesign role of operator through automation or remote operation
Sub-system
Zero-order Within domain trade-off (domain optimization)
Lengthen training to improve overall mission effectiveness
First-order Bivariate domain trade-offs
Improve selection criteria to decrease training requirements
Higher-order Multivariate domain trade-offs
Simplify interface design to reduce training and ease selection requirements
Compiled from Barnes & Beevis, 2003; Folds, 2007
21
Weapon System XYZAdapted from Blanchard
& Fabrycky (2006)Requirements
analysisFunctional
analysisRequirements
allocationTrade-off studies
1.1 1.2 1.3 1.4
Hardware functional
group
Software functional
group
Human functional
group
Preliminary system design
Preliminary system design
Software requirements
analysis
Detailed design and development
Detailed design and development
Detailed design and development
Feedback and control
Feedback and control
Feedback and control
Hardware life cycle
Software life cycle
Human systems integration life cycle
Feedback and control
Trans-domain
trade-offs
Inter/intra-domain
trade-offs
22Adapted from Blanchard & Fabrycky (2006)
Identify need and determine
system requirements
Design and develop
system
Manufacture system
(production)
Operate and maintain
system
1.0 2.0 3.0 4.0
CONTROLS/CONSTRAINTS
• Systems engineering process• Economic (cost)• Schedule (time)• Technical (performance)
INPUTS
• System requirements (ICD, CDD, CPD)
• Organizational structure
• Data/documentation
HSI ANALYSIS FUNCTIONS • Design criteria
• Decision support data OUTPUTS
MECHANISMS
• Trained HSI practitioners• Trade-off studies
Systems Analysis Approach
23
Identify need and determine
system requirements
Design and develop
system
Manufacture system
(production)
Operate and maintain
system
1.0 2.0 3.0 4.0
OPTIMIZATION MODELS
Human-system performance optimization (Miller & Shattuck, 2007):
(HFE P M T) (ESOH H S) Human Performance Input domains First order effects Second order effects
where HFE = human factors engineering; P = personnel; M = manpower; T = training; ESOH = environment, safety and occupational health; H = habitability; S = survivability.
Life cycle cost optimization (Blanchard & Fabrycky, 2006):
E = (X, Yd, Yi)
where E = evaluation measure; X = controllable decision variables; Yd = design-dependent system parameters; Yi = design-independent system parameters.
Models for Optimization
24
Identify need and determine
system requirements
Design and develop
system
Manufacture system
(production)
Operate and maintain
system
1.0 2.0 3.0 4.0
Life
cycl
e co
sts =
E =
(X,
Yd,
Y i)
System performance = (human performance) = (HFEPMT)
Cost Objective Concept
HSI Trade Space
DATA FARMING
HSI Trade Space
25
Identify need and determine
system requirements
Design and develop
system
Manufacture system
(production)
Operate and maintain
system
1.0 2.0 3.0 4.0
CONTROLS/CONSTRAINTS
• Systems engineering process• Economic (cost)• Schedule (time)• Technical (performance)
INPUTS
• System requirements (ICD, CDD, CPD)
• Organizational structure
• Data/documentation
• Design criteria• Decision support data OUTPUTS
MECHANISMS
• Trained HSI practitioners• Trade-off studies
Life
cycl
e co
sts =
E =
(X,
Yd,
Y i)
System performance = (human performance) = (HFEPMT)
Cost Objective Concept
HSI Trade Space
HSI Trade Space
26
Two HSI Paradigms?
Concept Refinement
PhaseTech Demo
Phase
System Design &
DevelopmentProduction & Deployment
Operations and Support
Phase
Workstation Design
(HFE domain)
Training
Time (HFE P M T) (ESOH H S) Human Performance
Effi
cacy
COTS items
Personnel & Manpower fixed for foreseeable future
27
UAV HSI
28
UAS Aero-Medical Standards
Tvarynas, 2007
29
Case study UAV mishaps
MAJCOM concern: “recurring landing
mishaps”
Better displays?
30
Sample mishap landing report
Cause: Pilot flared the aircraft higher than normal.
Factors: Late decision to go-around. Due to the lack of visual cues, and the lack of proper instrumentation, the pilot made a late decision to go-around.
Factors: Lack of visual cues, lack of instrumentation.The GCS is lacking in two key areas: peripheral display and radar altimeter. Due to the limited horizontal field of view of the camera, the pilot's peripheral "vision" is limited. Peripheral vision is largely responsible for detecting motion and attitude cues, as well as ground rush/altitude cues, all of which are used during the transition to landing. Without sufficient peripheral cues, a radar altimeter is needed to establish the aircraft height above the runway.
31
32
Landing mishaps HSI analysis
Human-machine displays
Situation awareness
Training tasks
Simulation methods
Accession practices
↑ Attrition
Operating strength
Operator error
33
Paradigm Findings
S&T Technology (HFE domain)
HSI
Technology (HFE domain)PersonnelTrainingManpowerEnviron., safety, & occ. health
Changing paradigms – a multi-factorial world
34
Suboptimal performanceMAJCOM concern: “cases of
performance failure”
Combat stress?
35
Fatigue Survey
Tvaryanas AP. A survey of fatigue in selected United States Air Force shift worker populations. Brooks City-Base, TX: United States Air Force, 311th Human Systems Wing; 2006 Mar. Report No.: HSW-PE-BR-TR-2006-
0003.
36
0
0.2
0.4
0.6
0.8
1
Landing & recovery element(Iraq)
Mission control element(Nevada)
z-sc
ore
FS
CIS-CON
FAS
EF-WHOQOL
MBI-EE
Finding: Predator crews teleoperating in Iraq are at least as fatigued as crews deployed to Iraq.
Tvaryanas AP. A survey of fatigue in selected United States Air Force shift worker populations. Brooks City-Base, TX: United States Air Force, 311th Human Systems Wing; 2006 Mar. Report No.: HSW-PE-BR-TR-2006-0003.
Fatigue Survey
37
Results of survey self-report measure of sleepiness (Epworth Sleepiness Scale) in Predator squadron…
Abnormal is defined as ESS score > 10.
2117
23
21
17 5
0
5
10
15
20
25
30
35
40
45
Pilot Sensor operator Intel
Sur
vey
resp
onde
nts
Excessive sleepinessNormal
Finding: Excessively sleepy SOs 4 times more likely to report moderate-to-high chance of falling asleep in GCS.
Tvaryanas, unpublished data, 2007.
Fatigue Survey
38Tvaryanas, unpublished data, 2005.
Fatigue Survey
39
Fatigue Survey
Tvaryanas, unpublished data, 2007.
40
Combat fatigue HSI case study
Personnel selection
↓ Accession rates
↑ Attrition rates
↓ Operating strength
↑ Fatigue & stress
Improper shift
schedulingManning concepts
41
Notional summary of Predator pilot and SO task analyses…
Imagery analyst Qualified SO Experienced SO MAC qualifiedSO
Pilot
Sensor operator (SO) tasks
Pilot tasks
Nagy JE, Guenther L, Muse K, et al. USAF UAS performance analyses: Predator sensor operator front end analysis report. Wright-Patterson AFB, OH: Survivability/Vulnerability Information Analysis Center (SURVIAC); 2006 Jun.
Knowledge, skills, & aptitudes gap
42
Paradigm FindingsMedical Stress (Survivability domain)
HSI
HFEPersonnelTrainingManpowerEnviron., safety, & occ. healthStress (Survivability domain)
Changing paradigms – a multi-factorial world
43
• Patrol littoral environment• Insert and extract SEALs• Deployable on-scene worldwide in 48 hours via C-5 Galaxy
MK V Special Operations Craft
44
• Naval Special Forces operate high speed boats in calm and rough seas and experience significant shock loading
• Effects of mechanical shock• Personnel injury (acute and chronic)• Equipment failure or degradation• Reduced mission effectiveness
• No shock mitigation systems are currently in-place• Offshore racing industry faces similar problems• Research focuses on bolt-on solutions to existing platforms
(suspension seats, deck padding)
Background
45
Cockpit Video
Footage from at-sea testing, Sea State 2-3, head seas, 35 kts...
46
Time
50 - 100 msec
Ver
tical
Acc
el (
g’s)
Typical Shock Event (on RHIB or Mk V)
Shock pulsestypically have peak accelerationsof 2-10 g’s in the5 - 10 Hz Range
~ 5-8 Hz
~ 10-15 Hz
~ 20 Hz
(Naval Health Research Center, 2000)
Shock and Injury
47
Time in SBUs (in years)
13 to 14
12 to 13
11 to 12
10 to 11
9 to 10
8 to 97 to 8
6 to 7
5 to 6
4 to 53 to 4
2 to 3
1 to 2
less than 1
Num
ber o
f Res
pond
ents
30
20
10
0
Report Injury:
yes
no
SBU Personnel Injury vs. Years of Service
Naval Health Research Center Survey (2000)
Shock Exposure Outcome
48
Summary
• HSI conceptual models• Top-down view of HSI in DoD• Apply systems analysis approach to HSI
process• Examine operational HSI applications