P1516.4: VV&A Overlay to P1516.4: VV&A Overlay to the FEDEP the FEDEP 20 September 2007 20 September 2007 Briefing for the VV&A Summit Briefing for the VV&A Summit Simone Youngblood Simone Youngblood M&S CO VV&A Proponency Leader 240-228-7958 [email protected]
25
Embed
P1516.4: VV&A Overlay to the FEDEP 20 September 2007 Briefing for the VV&A Summit
This document is posted to help you gain knowledge. Please leave a comment to let me know what you think about it! Share it to your friends and learn new things together.
Transcript
P1516.4: VV&A Overlay to the P1516.4: VV&A Overlay to the FEDEPFEDEP
20 September 200720 September 2007
Briefing for the VV&A SummitBriefing for the VV&A Summit
Simone YoungbloodSimone YoungbloodM&S CO VV&A Proponency Leader
Current VV&A Standards InitiativesCurrent VV&A Standards Initiatives
• VV&A FEDEP Overlay
• VV&A Templates
VV&A FEDEP OverlayVV&A FEDEP Overlay
BackgroundBackground
• VV&A Product Development Group (PDG) initiated in Spring 2004• VV&A Overlay Drafting Group had first meeting in Winter 2004• Draft overlay standard development progress briefed in Spring 2004,
Fall 2004, Spring 2005, Summer 2005 and Fall 2005• Draft overlay standard released to the VV&A PDG for comment on 31
March - 15 May 2006• Drafting Group met to develop comment resolution recommendations
on 5-9 June 2006• VV&A PDG met to approve comment resolutions on 28 June 2006• Revised draft standard released to the VV&A PDG for comment on
4 August - 4 September 2006• Drafting Group met to develop comment resolution recommendations
on 5-9 September 2006• VV&A PDG meets to decide recommended comment resolutions on
14 September 2006
ScopeScope
• Identifies and describes the recommended verification, validation and accreditation (VV&A) processes that one should perform to assure the acceptability and utility of federations for particular purposes.
• Identifies and describes the information feeding and resulting from those processes as well as the relationships between the High Level Architecture (HLA) Federation Development and Execution Process (FEDEP) and the VV&A processes and their respective information products .
• Defines those terms uniquely needed to characterize the FEDEP VV&A overlay (e.g., federation conceptual model, interoperability, representational requirements).
• Takes special care to use and build upon existing standards, standard terms and their definitions whenever possible.
• Focuses upon the VV&A processes that apply to federations.
• Does not address the VV&A processes associated with individual simulations (federates) but does consider using the information produced by those processes.
• Does not describe individual techniques that one might employ to execute the VV&A processes for federations.
Draft VV&A Overlay Standard OutlineDraft VV&A Overlay Standard Outline
• Roles & Responsibilities– Introduction to VV&A Roles &
Responsibilities– Role Mapping to Overlay
Activities
• Assumptions & Tailoring– Assumptions– Tailoring
• Overlay: Top Level View• Overlay: Detailed View
– Phase 1 - Verify Federation Objectives
– Phase 2 - V&V Federation Conceptual Model
– Phase 3 - Verify Federation Design
– Phase 4 - Verify Federation Development Products
– Phase 5 - Validate & Accept Federation
– Phase 6 - V&V Federation Outputs
– Phase 7 - Consolidate Federation VV&A Products
• Conclusion
Some Terms Important to the VV&A OverlaySome Terms Important to the VV&A Overlay
The drafting committee encountered several terms while drafting the VV&A Overlay to the FEDEP that were relevant to federation VV&A:
The drafting committee took special care to use the definitions of terms in the FEDEP and the well respected definitions from other sources whenever possible. They only judiciously crafted new definitions when no existing definition captured the meaning of the terms as they were used in the overlay (marked by an *).
• interoperability
• parameter
• referent
• representational requirements
• results sampling strategy *
• risk
• scenario
• substantive interoperability
• uncertainty *
• traceability
• validation
• verification
• acceptability criteria *
• acceptance *
• accreditation
• credibility *
• error characteristics *
• federate
• federation
• federation conceptual model
• federation objectives
• federation object model
• federation requirements *
• fidelity *
Overview of the Draft Overlay ActivitiesOverview of the Draft Overlay Activities
P1516.4 P1516.4 Recommended Practice for VV&A of a Federation, an Overlay to the HLA Recommended Practice for VV&A of a Federation, an Overlay to the HLA
Federation Development and Execution ProcessFederation Development and Execution Process
Initial BallotInitial Ballot
Ballot Open Date: 04/17/2007 Ballot Close Date: 05/17/2007
RESPONSE RATEThis ballot has met the 75% returned ballot requirement55 eligible people in this ballot group.44 affirmative votes3 negative votes with comments0 negative votes without comments5 abstention votes52 votes received = 95% returned, 10% abstention
APPROVAL RATEThe 75% affirmation requirement is being met44 affirmative votes3 negative votes with comments47 votes = 94% affirmative
P1516.4 P1516.4 Recommended Practice for VV&A of a Federation, an Overlay to Recommended Practice for VV&A of a Federation, an Overlay to
the HLA Federation Development and Execution Processthe HLA Federation Development and Execution Process
Recirculation BallotRecirculation Ballot
Ballot Open Date: 06/26/2007 Ballot Close Date: 07/06/2007
RESPONSE RATEThis ballot has met the 75% returned ballot requirement55 eligible people in this ballot group.45 affirmative votes2 negative votes with comments0 negative votes without comments5 abstention votes52 votes received = 95% returned, 10% abstention
APPROVAL RATEThe 75% affirmation requirement is being met.45 affirmative votes2 negative votes with comments47 votes = 96% affirmative
Summary of AccomplishmentsSummary of Accomplishments
• Developed a succinct and consistent model of the federation VV&A process that guided the the overlay’s formulation
• Crafted definitions for several important terms (e.g., federation requirements, credibility) where no relevant definitions existed in other sources
• Integrated the results from the preliminary NATO VV&A Overlay with the initial draft of the SISO VV&A Overlay to the FEDEP
• Clearly distinguished three important classes of tasks that involve the VV&A Team:
– Support - FEDEP tasks in which the VV&A Team should participate
– Contribute - verification tasks that the VV&A Team should monitor and supplement where necessary
– VV&A unique - tasks for which the VV&A Team are completely responsible
• Clarified the VV&A responsibilities for Steps 6 & 7 of the FEDEP, the life after federation acceptance
• Reached agreement between international representatives (Canada, France, Germany, Sweden, United Kingdom & USA) on the structure and details of the VV&A overlay to the FEDEP
• Ballotted P1516.4 through the IEEE process
VV&A TemplatesVV&A Templates
Mission StatementMission Statement
Enable expanded M&S reuse by building the foundation for consistent V&V information to support accreditation decisions.
Outlines of the Four Core VV&A DocumentsOutlines of the Four Core VV&A Documents
Accreditation Plan V&V Plan V&V Report Accreditation Report
Suggested Appendices:A M&S DescriptionB M&S Requirements Traceability MatrixC Basis of ComparisonD ReferencesE Acronyms F GlossaryG Accreditation ProgrammaticsH Distribution List
Suggested Appendices:A M&S DescriptionB M&S Requirements Traceability MatrixC Basis of Comparison D ReferencesE AcronymsF GlossaryG V&V ProgrammaticsH Distribution ListI Accreditation Plan
Suggested Appendices:A M&S DescriptionB M&S Requirements Traceability MatrixC Basis of ComparisonD ReferencesE AcronymsF GlossaryG V&V ProgrammaticsH Distribution ListI V&V PlanJ Test Information
Suggested Appendices:A M&S DescriptionB M&S Requirements Traceability MatrixC Basis of Comparison D ReferencesE AcronymsF GlossaryG Accreditation ProgrammaticsH Distribution ListI Accreditation PlanJ V&V Report
Templates StatusTemplates Status
• Draft MIL Standard entitled Department of Defense Standard Practice: Modeling and Simulation (M&S) Verification, Validation, and Accreditation (VV&A) Documentation Templates