1 DSTA-MIT/ESD: Armament Safety Project 22 January 2007 MIT Team –Prof. Stuart Madnick ([email protected])[email protected] –Dr. Michael Siegel –Lynn Wu.
This document is posted to help you gain knowledge. Please leave a comment to let me know what you think about it! Share it to your friends and learn new things together.
Transcript
1
DSTA-MIT/ESD: Armament Safety Project22 January 2007
• MIT Team– Prof. Stuart Madnick ([email protected]) – Dr. Michael Siegel– Lynn Wu– Nathan Minami (MIT & US Army)– Allen Moulton– Mihai Lupu (SMA)– Assistance from:
• Prof. Aykut Firat (MIT & Northeastern University)• Prof. Hongwei Zhu (MIT & Old Dominion University)
Data Extraction & Semantic Reconciliation Technologies (1)
Internal sources: Assessment Reports, live firing trials data, incident investigation reports, acceptance test data, qualification trials reports, hazard database for various items, WDA, defect rates, range & training schedule, weapon & ammo procurement and ages, etc.
But also want: (1) multiple countries and (2) military per capita calculation
• First: Multiple countries.– Combine Cameleon web extraction capability with IBM
DB2 Federated Database Server• Technical details explained later
SQL Query:
Select country, population, GDP, MilExpendPercent from cia where country in ("Singapore" , “Israel”, “United States” ,“United Kingdom” ,“Malaysia”)
COUNTRY POPULATION GDP MILEXPENDPERCENTSingapore 4492150 126.5 4.90%Israel 6352117 156.9 7.70%United States 298444215 12.31 4.06%United Kingdom 60609153 1.81 2.40%Malaysia 24385858 287 2.03%
9
Now need military per capita calculation
• DB2 can provide the computation based on the data being extracted by Cameleon
Select country, MilExpendPercent * GDP * 1000000000 / population from cia
where country in (Singapore" , “Israel” ,“United States”, “United Kingdom” ,“Malaysia”)
Note: Is USA really only $1.67 per capita and Singapore $1379 per capita?
COUNTRY MilExpendPercent * GDP * 1000000000 / populationSingapore 1379.85Israel 1901.93United States 1.67United Kingdom 0.72Malaysia 238.91
10
Need to adjust for GDP “billion” and “trillion”
COUNTRY GDP_UNIT MilExpendPercent * GDP * unit/ populationSingapore billion 1379.85Israel billion 1901.93United States trillion 1674.64United Kingdom trillion 716.72Malaysia billion 238.91
Select country, MilExpendPercent * GDP * scalefactor.scale / population from cia, scalefactor where country in ('Singapore', 'Israel','United States','United Kingdom', 'Malaysia') and scalefactor.text=cia.gdp_unit
• Use an auxiliary table– scalefactor
• Now can use database “Join”
text scaleBillion 1000000000Trillion 1000000000000
11
That is great: but want to graph comparisons
• Combine Cameleon web extraction capability with Excel spreadsheet graphing capabilities
• Can put SQL queries to Cameleon in Excel
Query automatically assembled .. And sent to Cameleon
12
Excel provides nice graphics
• Excel can display results in both table form and graphics
13
Need to adjust scale factors
• Some GDP’s are stated in billion and some on trillion – by the way: using USA definition of “billion”
• Can use conditional definition for military_expenditure per capita that handles scale factor adjustment.
14
• Using Excel formula with conditional definition
Final results of “military expenditure per capita” – with scale factor adjusted
(Conditional definition)
15
Much easier to “visualize” graphically• All kinds of additional calculations and graphics possible
country population gdp gdp_unit milexpendpercent miilitary per capitaSingapore 4,492,150 126.5 billion 4.90% 1379.85Israel 6,352,117 156.9 billion 7.70% 1901.93United Kingdom 60,609,153 1.818 trillion 2.40% 719.89United States 298,444,215 12.31 trillion 4.06% 1674.64Malaysia 24,385,858 287 billion 2.03% 238.91
Military expense per capita
Singapore
Israel
United Kingdom
United States
Malaysia
0.00
200.00
400.00
600.00
800.00
1000.00
1200.00
1400.00
1600.00
1800.00
2000.00
miilitary per capita
country
US
do
llars
Singapore
Israel
United Kingdom
United States
Malaysia
16
Military expenditure in multiple currencies• The data in CIA Fact book is all in US dollars.
– Might be more helpful to view in other currencies.
• Currency conversion web sites also exist: www.oanda.com– We “wrapped” it– called it “hzoanda”
Query automatically assembled .. And sent to CameleonSelect anycurrency
These solutions can be even easier through COIN context mediation
• MIT has developed a Context INterchange (COIN) technology that can automatically:– Adjust scale factors and – Provide answers in SG$ (or any currency), etc.
• This query:Select country, MilExpendPercent * GDP * scalefactor.scale /
population from cia, scalefactor where country in ('Singapore', 'Israel','United States','United Kingdom', 'Malaysia') and
scalefactor.text=cia.gdp_unit [currency conversion not shown]
• Could be reduced to:Select country, MilExpendPercent * GDP / population from cia where country in ('Singapore', 'Israel','United States','United Kingdom', 'Malaysia')
• This part of project cannot be demonstrated today due to recent hardware problems that disrupted system and corrupted some software.
19
Information may be scattered across multiple sources
• What if want military expenditure per soldier?
• Can get size of armed forces from http://en.wikipedia.org/wiki/List_of_countries_by_size_of_armed_forces
• Need to combine this data with the information from CIA Fact Book to get military expenditure per soldier
Recent Technology Extensions to Support DSTA Effort
• Cameleon Studio – Makes it much easier/faster to create spec files
• Incorporate Cameleon into IBM’s DB2 Federated Database System *– To handle much more complex SQL queries
• Calculations• OR and IN features
– Required creation of a general-purpose “capability handling” engine
• Web sites are more limited than databases (e.g., may only take one “key” at a time, only certain fields can be used as a “key”, etc.
* For more information see: Lynn Wu, Aykut Firat, Stuart Madnick, Tarik Alatovic, “Querying Web-Sources within a Data Federation”, Proceedings of the International Conference on Information Systems (ICIS), Milwaukee, Minnesota, December 2006.
29
Cameleon Studio tool makes spec file creation (relatively) easy
POE handles complex multi-source query (including “join”s):-Divides query into simpler single source queries-Dispatches the queries to core Cameleon or SQL db- Assembles results together
Problem - POE does not handle full SQL needed:- No calculations ( e.g., gdp/capita)- Allows JOINS and UNIONS but not IN or OR
31
IBM’s DB2 Federated Database System• Uses wrappers to access non-relational data sources.• DB2 first decomposes the original query into query fragments and then sends
them to wrappers.– Some generic wrappers provided (e.g., for XML sources)– For arbitrary sources (such as web sites), custom wrappers must be created
• Wrapper sends the result back to DB2 which then assembles the final results.
DB2 XML Wrapper (Adapted from IBM).
32
IBM’s DB2 Federated database system architecture
Wrapper
Web Sources
Capability
Handler
Wrapper for S1
Capability
Handler
Data
Extraction
Wrapper for S2
Capability
Handler
Data
Extraction
Wrapper for S3
S1-website
Wrapper: Request-Reply Protocol
Federation Engine
Query: Select ..from s1,s2,s3 …
IBM DB2
Data
Extraction
S2-website S3-website
For each web site (S1, S2, S3), a wrapper must be custom crafted.
33
Our Solution: (1) Cameleon as general-purpose wrapper for web sources (2) with new capability engine
Two-Layered Architecture - current IBM solution
Three-Layered Architecture - with general-purpose engines
Wrapper
Web Sources
Capability Handler
Wrapper for S1
Capability Handler
Data Extraction
Wrapper for S2
Capability Handler
Data Extraction
Wrapper for S3
S1-website
Wrapper: Request-Reply Protocol
Federation Engine
Query: Select ..from s1,s2,s3 …
IBM DB2
Data Extraction
S2-website S3-website
Wrapper: Request-Reply Protocol
Federation Engine
Query: Select ..from s1,s2,s3 …
Wrapper, Capability
Engine
S1-website
Web Sources
CameleonDataExtractionEngine
IBM DB2
Data Extraction
Engine
Query planning
with capability
declaration
CR for S1
CR for S3
CR for S2
Capability Record Declaration
DE for S1
DE for S2
DE for S3
Data Extraction Spec Files
Wrapper: Request-Reply Protocol
Federation Engine
Query: Select ..from s1,s2,s3 …
Wrapper, Capability
Engine
Web Sources
IBM DB2
Data Extraction
Engine
Query planning
with capability
declaration
CR for S1
CR for S3
CR for S2
Capability Record Declaration
DE for S1
DE for S2
DE for S3
Data Extraction Spec Files
S2-website S3-website
34
Phase 2 – Evaluation of Policy/Intervention Options for Improving Armament Safety
• Approach: Use of System Dynamics (SD) Modeling– Used by US Government/Military for many purposes– Recent example – evaluating interventions on “State
Stability” (see http://web.mit.edu/smadnick/www/wp/2005-13.pdf )
• Goal: Develop a system dynamics model for Singapore Armament Safety– Represent causalities and linkages– Uncover root causes
• Outcome: Model can be used to predict the likelihood of future accidents and help evaluate policy options and preventive measures.
Philosophy of System Dynamics• Every action has consequences• Often through complex feedback loops
Do you feel crowded in – and frustrated?
36
See if you can get a bit more space by pushing on that wall …
37
Oops …
38
Quick Primer: The What (and Why) of System Dynamics
Consider the domain of Software Development
• Classic “knee jerk” reaction to a project behind schedule is to add people.• “Brooks Law” noted that “Adding people to a late project, just makes it later” (because the new people must be trained, this takes productive people off the project). • Both of these points are fairly well-known by most software developers – but both are much too naïve. There are many other factors: length of project, type of project, expertise of staff available, approach to and time needed to do training, stage of project, etc. Over the years, all of these individual factors have been well-studied individually – but how do they interact ? • System dynamics makes it possible to model & study the dynamics of these interdependencies. Many non-obvious outcomes have been found (e.g., sometimes Brooks is wrong! Important to know when and Why?) Source: Software Project Dynamics: An Integrated Approach, by T.K. Abdel-Hamid and S. Madnick, Prentice-Hall, 1991.
39
History of System Dynamics
SDM used as modeling & simulation method over 30 years• Designed to eliminate limitations of linear logics and over-simplicity
• Typical human assumptions and behaviours• Based on understanding system structure, behavior patterns, interconnections of positive & negative feedback loops, and intended & unintended consequences of action
SDM has been applied to numerous domains, e.g.,• Software development projects• Process Improvement projects• Crisis and threat in the world oil market• Stability and instability of countries• … many many others …
SDM helps to uncover ‘hidden’ dynamics in system• Helps understand ‘unfolding’ of situations, • Helps anticipate & predict new modes• Explore range of unintended consequences
40
Armament Safety Example: consequences and proceeding actions
Soldier injured
Chamber explosion
Damaged ammunition
Weapon had jammed, which damaged ammunition
Weapon had overheated
Did not stop to cool off
Training was behind schedule
Training started late
Safety officer arrived late
Held up due to traffic accident
HypotheticalExample
Was busy dealing withan earlier accident
41
ChamberExplosions
Injuries
WeaponMalfunctions
Immediate ActionOccurences
+
+
FollowRegulations for IA
Incident Reporting
Level of Training
Follow regulations forammo/ WPNs use
-
Range AvailabilityTime
Ceasfires/Delays
Pressure toComplete Training
+
-
Damaged Ammo
+
+
Overconfidence &ComplacencyR1
Ammo Quality
Serviceability ofWPNs
WPN Cleanliness/Maintenance
Quality ofPre-Marksmanship
Instruction
Attention toWarning Signs
Risk AssessmentQuality
-
-
+
+
B3
-B5
Money Available forTraining, Weapons &
Ammo
Size of WarstockAmmunition
+
-
+
+
-
++
-
---
B4
Resolution ofConflicting Goals
Safety Equipment
-
+
Safety Efforts
Training Level
Preparation
Weapon Age
Availability ofReplacement Parts
+
-
+
-
Ammunition War-Stockto Training Cycle Time
AmmunitionPurchase Rate
Age of TrainingAmmunition
+
-+
-
+
+-
-
Emphasis on Safety &Process Improvement
++
+
+
+
B7
ProtectiveEquipment
B1
Ammunition
B9
Training/OperationTempo
B2
Weapons
B6
Direct SafetyImprovement
B8
Indirect SafetyImprovement
Quality of InformationManagement
+
Other CompetingBudget Requirements
-
Preliminary Example of Armament Safety SD Causal Model
Developed based upon Singapore reports provided and Subject Matter Expertise (SME) provided by US Army Major Nathan Minami, Company Commander - 25th Infantry Division and West Point instructor.
42
Plans for Phase 2
• Focus: Armament Safety Projection & Mitigation
(e.g., Understanding Consequences) - Maybe include Vehicle Safety
• Needs:– Access to Subject Matter Experts
(Plan to also explore US Army sources)• To develop causal model• To determine “tipping points” and other “non-obvious”
behaviour
– Access to Data• To parameterize model for simulation