HUMAN FACTORS SOLDIER HEALTH MANPOWER PERSONNEL TRAINING ENGINEERING SAFETY HAZARDS SOLDIER SURVIVABILITY Army MANPRINT Perspective Dr. Bev Knapp Deputy Director, G-1 MANPRINT Office September 11, 2012 NDIA HS Workshop [email protected]
HUMAN FACTORS SOLDIER HEALTH MANPOWER PERSONNEL TRAINING ENGINEERING SAFETY HAZARDS SOLDIER SURVIVABILITY
Army MANPRINT Perspective
Dr. Bev Knapp Deputy Director, G-1 MANPRINT Office
September 11, 2012 NDIA HS Workshop
• MANPRINT One Slide • How MANPRINT Runs • Initiatives
• Moving MANPRINT Left & Human View
• Acquisition Reform & MANPRINT • Technology Readiness Levels • Integration & Tradeoffs
• Frameworks for HS S&T and HSI
TOPICS
3
MANPRINT Mission
MANPRINT accomplishes its mission by • Developing MANPRINT policy • Assessing materiel development programs for MANPRINT compliance • Integrating the MANPRINT domains of manpower, personnel capability, human
factors engineering, training, Soldier safety, health hazards prevention, and Soldier survivability to manage the impact of these domains on system design
• Overseeing assistance to materiel development programs by MANPRINT practitioners
• Serving as the proponent for Soldier-oriented research, development, analysis, and studies
• Advocating MANPRINT education
Optimize total system performance, reduce life cycle costs, and minimize risk of soldier loss or injury by ensuring a systematic
consideration of the impact of materiel design on Soldiers throughout the system development process.
MANPRINT is the Army’s implementation of Human Systems Integration (HSI)
3
How MP Runs
ARL HRED HFID
Redstone Arsenal, AL (9)
Picatinny, NJ (4)
Fort Bliss, TX (4)
Natick, MA (1)
Fort Benning, GA (8)
Fort Rucker, AL (3) Army Safety Center (3)
Warren, MI (3)
Fort Leonard wood, MO (6)
Fort Bragg, NC (2)
Fort Knox, KY (3)
Fort Hood, TX (5)
Fort Gordon, GA (1)
Fort Huachuca, AZ (3)
Fort Leavenworth, KS (1)
Fort Sill, OK (2)
Orlando, FL (3)
APG-EA, MD ARL HRED HQ (118) ARL SLAD HQ (10)
APHC (8)
Fort Belvoir, VA (1)
Alexandria, VA (2)
Information Systems Branch
Weapons Branch
Maneuver & Mobility Br
MANPRINT Manpower, Personnel Training Analysis Br
ARL HRED SPD Cognitive Sciences Branch Fort Sam Houston, TX (5)
The MANPRINT Workforce
ARL-HRED=ARMY RESEARCH LABORATORY HUMAN RESEARCH & ENGINEERING DIRECTORATECARL-SLAD=SURVIVABILITY/LETHALIITY DIRECTORATE ARL HRED-SPD=SOLDIER PERFORMANCE DIVISIONCARL HRED-HFID=HUMAN FACTORS INTEGRATION DIVISION APHC= ARMY PUBLIC HEALTH COMMANDCAPG=ABERDEEN PROVING GROUNDCEA-EDGEWOOD ARSENALCSTTC=SIMULATION TRAINING TECHNOLOGY CENTER
G-1
Pentagon G-1 MANPRINT (5)
MANPRINT Methods & Analysis Branch
META: MANPRINT Enterprise Tracker/Analyzer
59 44
468
237
3
Army Systems in Acquistion
Sep 5, 2012
ACAT I
ACAT II
ACAT III
No ACAT
Pre-MSB
Deliberate Acquisition/Programs of Record w Rapid Equipment Fielding w Quick Reaction Capability/Technology Push
How MP Runs
MANPRINT Support to Programs of Record
XM1116 KIOWA WARRIOR COCKPIT AND SENSOR UPGRADE PROGRAM
JOINT AIR-TO-GROUND MISSILE
NETT WARRIOR
RIFLEMAN RADIO
JOINT SERVICE AIRCREW MASK MPU-5(V)/P
Class-1 Unmanned Aerial System
Vehicle Mounted Mine Detection System
M26 Modular Accessory
Shotgun System
Network Integration Kit
T-UGS
U-UGS
SUGV
Program of Record. The term is used to describe a program that is funded (approved) across the FYDP, through the POM. When this happens, the program becomes a "line item record" in the budget -- hence the term "program of record". This is usually synonymous with Milestone B approval, where a program is given "official" status as a development program.
How MP Runs
Nett Warrior Program Profile Page
How MP Runs
Nett Warrior Program – Tasks Tab
How MP Runs
• Demand Signal:
• Respond to Test & Evaluation Agency Request for Support
• Identify the MANPRINT specific capabilities and limitations of systems fielded under the REF prior to full test and evaluation
• Challenges:
• Communicating the capabilities and limitations of the systems
• Time available to test and assess
• Urgent requirement for these systems
How MP Runs MANPRINT Support to
Rapid Equipment Fielding (REF) Systems
Biometrics Automated Toolset-Army v4
Long Endurance Multi-INT Vehicle (LEMV)
Moving MANPRINT Left (MML)
6
Moving MANPRINT Left
Pre MS A
Pre MS B
(Earlier than before)
Virtual MML
What impact would MML have had?
w
u
v
“MML was established as a deliberate effort to determine whether MANPRINT engagement earlier in a system lifecycle could make a significant difference in total system outcomes by identifying and mitigating persistent MANPRINT/human performance persistent issues.”
DoD Architecture Framework (DoDAF) & the “Human View”
Assess MANPRINT issues in Design
Identify
MANPRINT Issues
Analyze Issues/
Determine Risk
Develop Risk Mitigation
Strategy
Select risk change options: Manpower levels,
Personnel capability, Interface design, training
fix, etc.
MANPRINT Issue
Processing Cycle
CBA Joint Concepts Strategic
Guidance
ICD Technology Development
CDD
Engineering and Manufacturing Development and Demonstration
CPD Production and Deployment O&S
MDD
Materiel Solution Analysis
. . . To Full Rate Production Decision Review
From JCIDS . . .
MS C MS B MS A
Assess MANPRINT
Issues in T&E
MANPRINT Input to T&E
plan
Identify MISSION-
FUNCTION-TASK Constraints
MANPRINT Functions in the Capability Development & System Acquisition Life Cycle
• Determine MANPRINT constraints that may impact concept feasibility, total system performance & affordability (ICD Key Boundary Conditions of AoA) • Set MANPRINT priorities to identify acceptable risks associated with automating critical tasks within functional analysis & allocation decisions • Identify MANPRINT constraints related to Army readiness factors (i.e. ARFORGEN, training) that may adversely affect potential KPPs, KSAs, & MOEs
11
ICD=INITIAL CAPBILITIES DOCUMENT AOA=ANALYSIS OF ALTERNATIVES
ARFORGEN=ARMY FORCE GENERATION MODEL KPP=KEY PERFORMANCE
PARAMETER KSA KEY SYSTEM ATTRIBUTE MOE MEASURE OF EFFECTIVENESS
MML
Program Impact • Include Human-System capabilities &
limitations in functional and task allocation
• Align software & display design with
situational awareness needs
• Develop plans to balance workload
requirements among system operators
• Develop automation schemas to reduce
workload and training demands
• Provide MANPRINT inputs in the
development of embedded training devices
Fire Control and Communications (FCC)
MANPRINT Left Assessment
MANPRINT Assessment (MA)
IOC
Technology Development
Engineering and Manufacturing Development
Operations & Support
FOC
Post- CDR A
B A C Program Initiation
Post PDR A
MA
Pre-Systems Acquisition Systems Acquisition Sustainment
User Needs
Program Impact • Limited opportunity to improve
training materials
• Demands to manpower and training
are identified, but difficult to mitigate
• Need for additional / special expertise
for system operation and support is
identified
Cu
rren
t
Materiel Development Decision
Production & Deployment
FRP Decision Review
Materiel Solution Analysis
Technology Opportunities & Resources
MANPRINT Assessment • Increased Soldier workload
• Decreased SA
• Increased decision making time
• Increased training demand
• Increased program cost to
automate critical tasks
ICD MANPRINT Assistance MANPRINT Assistance
Conduct Cognitive
Task Analysis using
CONOPS to identify
user roles and
critical info
requirements
DHV
In P
rogr
ess
MA MA MA
IOC
Technology Development
Engineering and Manufacturing Development
Production & Deployment
Operations & Support
FRP Decision Review
FOC
Post- CDR A
Materiel Solution Analysis
Materiel Development Decision
B A C Program Initiation
Post PDR A
Pre-Systems Acquisition Systems Acquisition Sustainment
User Needs
Technology Opportunities & Resources
MANPRINT Dynamic Human View (DHV)
ICD
DHV
Identify task type &
criticality to optimize
human automation
interaction
DHV
Define MANPRINT
metrics for
managing risks to
achieving KPPs &
KSAs
Baseline MANPRINT Assessment • Map display & engagement control
functions are critical to mission success
• Alerts are needed based on user-
preference
• MANPRINT priorities identified for
tracking design improvements and for use in
T&E: (Ex: Amt (or %) of critical information
visible for quick response)
MANPRINT Assistance MANPRINT Assistance
12
Acquisition Reform and Revised Regulations
13
MANPRINT/HSI TRL Ratings Initiative
• The technology is ready for the system, but is it ‘usable’? • Will the technology have an adverse impact on the ‘user’ • Apply HSI to TRL process during modeling & simulation analyses
Domain Assessment is a Tradeoff Process We need an actual tool or portal for this.
Color Rating
Domain
Manpower Personnel Training HFE Soldier
Survivability
System
Safety
Health
Hazards
Green Acceptable
Amber Marginal
Red Unacceptable
Slider shows the
number of
manpower required.
As the slider is
moved up, the
number of
manpower required
decreases. As the
slider is moved
down, the number of
manpower required
increases.
Slider shows how
personnel
characteristics
(aptitudes/strengths)
impact system
performance. As the
slider is moved up,
personnel are
becoming more
similar and less
complex. As the
slider is moved
down, personnel
complexity and
uniqueness
increases.
Slider shows the
amount and level
of training
(hours) required.
As the slider is
moved up, the
level of training
decreases. As
the slider is
moved down, the
level of training
increases.
Slider shows the
relative
workload,
suitability, and
acceptability
when operating
the system. As
the slider is
moved up, the
load of the
system
decreases. As
the slider is
moved down, the
load of the
system
increases.
Slider shows
risk of injury
to the system
(and human).
As the slider
up, the level
of safety
increases
(less risk). As
the slider is
moved down,
the level of
safety
decreases
(more risk).
Slider shows
the risk of
health
problems
now or in the
future. As the
slider is
moved up,
the level of
health risk
decreases .
As the slider
is moved
down, the
level of health
risk increases
Slider shows the
chances of soldier
survival. As the
slider is moved up,
the degree of
survivability risk
decreases (less of a
chance). As the
slider is moved
down, the degree of
survivability risk
increases (more of a
chance).
REFERENCE
Fit the Equipment to the Soldier
Not the Soldier to the Equipment
Machinae sit facta hominem Non homo propter machine
Soldier-Centered Design and Assessment*
•Personas, scripted scenarios,
& storyboards (use cases)
Understand
Visualize
•Literature reviews
•Previous MANPRINT assessments
•Product reviews/competitive analysis
•Reverse engineering
•Task analyses (cognitive,
heuristic, etc.)
•Opportunity-driven human
factors research
•Models/mock-ups (hardware & software)
•Job aids
•JACK: human figure modeling
•IMPRINT: modeling & simulation
•Participatory design
techniques
•Integrated product
team working groups
Evaluate •Expert reviews/discount usability techniques
•Usability testing / Experimentation / Eye-tracking studies •Unit training events
•Comparative usability studies
•Large-scale interoperability experiments (NIE, Empire Challenge)
•Formal test events (ATEC)
* Savage-Knepshield, P.A., (2009). Applying a warfighter-centric system design process to a department of defense acquisition program. Journal of Cognitive Engineering & Decision Making, 3(1), 47-66.
•SME interviews
•Focus groups
Goal: Solve real-world problems for a specific group of end users & fill HF and HSI knowledge gaps
• Set realistic system requirements
• Identify future manpower & personnel constraints
• Evaluate operator & crew workload
• Test alternate system-crew function allocations
• Assess required maintenance man-hours
• Assess performance during extreme conditions
• Examine performance as a function of personnel characteristics and training frequency & recency
• Identify areas to focus test and evaluation resources
• Quantify human system integration risks in mission performance terms to support milestone review
• Represent humans in federated simulations
MANPRINT analysis involves trade-offs
Common MANPRINT Analysis Tasks
Moving MANPRINT Left (MML):
Nett Warrior (NW)
Identify Mission-Function-Task
Constraints
IOC
Technology Development
Engineering and Manufacturing Development
Production & Deployment
Operations & Support
FRP Decision Review
FOC
Post- CDR A
Materiel Solution Analysis
Materiel Development Decision
B A C Program Initiation
Post PDR A
P r e - S y s t e m s A c q u i s i t i o n S y s t e m s A c q u i s i t i o n S u s t a i n m e n t
User Needs
Technology Opportunities & Resources
MA
ICD
Set MANPRINT Priorities to identify acceptable risks
associated with task execution
Define MANPRINT metrics for assessing &
managing risks to achieving KPPs & KSAs
Program Impact
• Predicted Soldier load to be at least 3.5 Ibs over
limit. (REF: EPLRS vs JTRS HMS-B, 23 Mar 2010)
• MANPRINT priorities identified for tracking design
improvements and for use in T&E. (REF: voice quality,
quantify burden of system down-time and its impact to
operator SA)
• MANPRINT requirements inserted in contract for
source selection
• Input to SWaP load distribution strategies
MANPRINT Assistance MANPRINT Assessment
20
MANPRINT Assessment (MA)
Capabilities
Based
Assessment
Research &
Development
MANPRINT Working IPT: Issue Identification - Tracking
& Risk Reduction
SWAP=Size Weight and Power
MA
• Analyze how the system will fit into the mission framework for its different target end-users (trainers, operators, maintainers); HSI focused effort for all systems used by target end-users during the course of their missions
• Collaboratively develop use case scenarios to drive system design (System Engineers will find these useful for Agile development and T&E for creating test plans)
• Identify mission critical functions (require extra design attention for accessibility)
• Conduct predictive modeling (manpower and cognitive workload)
• Perform early human figure modeling
• Prepare Training Impact Assessments
• Conduct usability testing with early simulations & prototypes
• Identify user interface and design issue gaps requiring further research
• Iterative DOTmLPF-oriented assessment as the system matures
• Develop user interface and human performance requirements
HSI Early in the Process
HSI Early in the Process
• Research, understand, and translate human performance and HSI research for early system concept design − New requirements and capability needs call for novel technologies,
combinations of systems, and doctrinal changes for which HSI issues are not straightforward
− Novel technologies will fundamentally change the nature of work to be performed which has implications for doctrine & materiel design
− Determine how new technologies, systems and doctrine can be specified to meet Army needs
− Identify best practices for the design of specific user interface and system functionality
− Identify human performance and HSI requirements
− Assist TRADOC with capabilities-based assessment (DOTmLPF perspective)
− Identify lessons learned from predecessor and similar systems through literature reviews (e.g., accident databases, MANPRINT Assessments, Center for Army Lessons Learned)
Improving Army Aviation Systems
Improved maintainability Enhanced accessibility to aircraft components Crew’s Air Warrior Life Support equipment
now accommodated Enabled the development of anthropometric
requirements for the next generation of Army Aviation aircraft
Eye-Tracking Studies
Baseline
Proposed
Decluttered
Human Figure Modeling
Redesigned helicopter hover information cues for the safe control of the aircraft when pilots cannot see external references
Validated tool & methodology
Enabled future work on designing cautions, warnings and advisories
Enabled future work to improve aviation symbology for aircraft control
How can knowledge about human component characteristics enhance the Army's ability to provide mission effective, adaptable, trained and resilient ready forces to meet our Nation's needs? Dimension. (n.) Scope or measureable portion of space that extends in a certain direction. a. the least number of independent coordinates required to uniquely specify the points in a space. b. the range of such a coordinate.
• What are all of the point and integrated human-centered efforts currently underway - in a simple taxonomy with supporting data links? • Short title, Agency, POC • Dimensions – target, scope, priority, links • Status & Timeline
• Can all stakeholders access and view a Common
Operational Picture (COP) of these efforts showing their dimensionality and relationships?
• How do they address the primary human component question?
• Does the HC COP and supporting data facilitate assessment of trends and prediction of success/challenges over time?
Data Warehousing And
Information Architecture
Data Integration And
Management
Analytical
Layer
Presentation
Layer
HC COP
The HC stack
Measuring Human Component Soldier S&T Portfolio
DOTmLPF Analysis
Non-Materiel Approach
Materiel Solution