Page 1
Maj Zach “Libi” McCarley, USMC VX-31, NAWS China Lake LtCol Tim “Boomer” Jorris, USAF 412 OG/Hypersonics CTF
NAVAIR Public Release SPR-2013-303 Distribution Statement A approved for public release, distribution is unlimited.
NAVAIR public release SPR-2013-303 1
Page 2
Gun
Problem
DOE
Methodology
Analysis
Lessons
2
Page 3
NAVAIR public release SPR-2013-303 4
Page 4
NAVAIR public release SPR-2013-303 5
Page 5
NAVAIR public release SPR-2013-303 6
Page 6
NAVAIR public release SPR-2013-303 7
Page 7
NAVAIR public release SPR-2013-303 8
Page 8
NAVAIR public release SPR-2013-303 9
Page 9
NAVAIR public release SPR-2013-303 10
Page 10
NAVAIR public release SPR-2013-303 11
Page 11
12
Problem: Fleet reporting valid attacks on soft targets with enemy walking away unscathed.
Should be a hit ... but NOT!
NAVAIR public release SPR-2013-303
Page 12
Rumors of AESA problems
Lots of anecdotal evidence
TOPGUN conducted TAC T&E 3 mil long
2 mils right (8 mil gun dispersion)
Is the software CCIP prediction good or not?
Is it Super Hornet wide or restricted to AESA?
What other factors might affect solution?
NAVAIR public release SPR-2013-303 13
Page 13
TOPGUN said no (3 mils / 2 mils)
What can I offer to the problem?
Scientific method?
Disciplined flight test?
Statistical significance?
If so, then how do I get results with
statistical significance?
If so, is it operationally significant?
NAVAIR public release SPR-2013-303 14
Page 14
Ammo M56 / M55 PGU-28 / PGU-27
Software Legacy / Assembly Language / X-Build / 25X HOL / C++ / H8
BAAT (Best Altitude Above Target) Radar / AGR (Air – Ground Ranging) DTED (Digital Terrain Elevation Data)
Radar APG-73 (Legacy) APG-79 /AESA (Active Electronically Scanned Array)
NAVAIR public release SPR-2013-303 15
Page 15
Example: 250 ft / 200 ft = 1.25
NAVAIR public release SPR-2013-303 16
Page 16
Ammo M56 / M55 PGU-28 / PGU-27
Software Legacy / Assembly Language / X-Build / 25X HOL / C++ / H8
BAAT Radar (AGR) DTED
Radar APG-73 APG-79
NAVAIR public release SPR-2013-303 17
Page 17
Jet type runs with ammo type
PGU-28 M56 PGU-27 all ammo
25X APG-73 AGR (no Legacy AESA) 5 5 5 15
25X APG-73 AGR (no Legacy AESA) 5 5 5 15
25X APG-73 AGR (no Legacy AESA) 5 5 5 15
25X APG-73 DTED (no Legacy AESA) 5 5 5 15
25X APG-73 DTED (no Legacy AESA) 5 5 5 15
25X APG-73 DTED (no Legacy AESA) 5 5 5 15
H8 APG-73 AGR 5 5 5 15
H8 APG-73 AGR 5 5 5 15
H8 APG-73 AGR 5 5 5 15
H8 APG-73 DTED 5 5 5 15
H8 APG-73 DTED 5 5 5 15
H8 APG-73 DTED 5 5 5 15
H8 AESA AGR 5 5 5 15
H8 AESA AGR 5 5 5 15
H8 AESA AGR 5 5 5 15
H8 AESA DTED 5 5 5 15
H8 AESA DTED 5 5 5 15
H8 AESA DTED 5 5 5 15
total runs 90 90 90
sorties 18 18 18
rounds per sorties 250 250 250
total rounds 4500 4500 4500
Run 1/2 AGR and 1/2 DTED -> 12 runs each way -> stat sig both ways
∑ = 54 sorties?
Config:
A
B
C
NAVAIR public release SPR-2013-303 18
Page 18
Y = A (ammo) + B (BAAT) + RS + A·B + A·RS + B·RS
RS -Radar/SW
B-B
AA
T
80 Runs = 10 sorties
NAVAIR public release SPR-2013-303 19
Page 19
Statapult = DOE
Boomer can explain?
NAVAIR public release SPR-2013-303 20
Page 20
Principles
Randomization
Replication
Blocking
Orthogonality
NAVAIR public release SPR-2013-303 21
Page 21
NAVAIR public release SPR-2013-303 22
Page 22
NAVAIR public release SPR-2013-303 23
Page 23
NAVAIR public release SPR-2013-303 24
Page 24
Y = A (ammo) + B (BAAT) + RS + A·B + A·RS + B·RS
B-B
AA
T
RS-Radar/SW
54 Sorties 10 Sorties 6 Sorties!
95% Confidence 80% Power
NAVAIR public release SPR-2013-303 25
Page 25
winds
temperature
pressure
pilot
aircraft
cannon
ammunition lot
slant range
dive angle
airspeed NAVAIR public release SPR-2013-303 26
Page 26
winds
temperature
pressure
pilot
aircraft
cannon
ammunition lot
slant range
dive angle
airspeed
Measure
Standardize
NAVAIR public release SPR-2013-303 27
Page 27
Ammo
Profile
Data requirements
Hits
Aim Point
Range
Bullet Count
Wind
NAVAIR public release SPR-2013-303 28
Page 28
Combat
M56 High explosive incendiary (HEI)
PGU-28 Semi-armor piercing high explosive incendiary (SAPHEI)
Training
M55
PGU-27
NAVAIR public release SPR-2013-303 29
Page 29
NAVAIR public release SPR-2013-303 30
Page 30
NAVAIR public release SPR-2013-303 31
Page 31
Hits
Aim Point
NAVAIR public release SPR-2013-303 32
Page 32
IRSSS is an acoustic-based scoring system for supersonic projectiles
System consists of:
Microphone array in front of the strafing target(s)
Downrange equipment rack hardwired to the target microphones
Outdoor-mounted weather station adjacent to the downrange rack
Scoring console remote from the range
NAVAIR public release SPR-2013-303 33
Page 33
• Mach Angle = sin-1(c / Vp)
• Lateral Velocity VL = Vp * tan() = c / cos()
c
Vp
VL
NAVAIR public release SPR-2013-303 34
Page 34
0
5
10
15
20
25
30
He
ig
ht A
bo
ve
T
ra
ns
du
ce
rs
(ft)
-20 -15 -10 -5 0 5 10 15 20 Dist. From Center of Transducers (ft)
T1 T2 T3
T1-T2 T2-T3 T1-T3
Projectile Passing Thru Point 2
Point 2
(-12.5, 12 .99)
NAVAIR public release SPR-2013-303 35
Page 35
NAVAIR public release SPR-2013-303 36
Page 36
NAVAIR public release SPR-2013-303 37
Page 37
NAVAIR public release SPR-2013-303 38
Page 38
NAVAIR public release SPR-2013-303 39
Page 39
NAVAIR public release SPR-2013-303 40
Page 40
NAVAIR public release SPR-2013-303 41
Page 41
Air Force Solution
Marine Solution
NAVAIR public release SPR-2013-303 42
Page 42
NAVAIR public release SPR-2013-303 43
Page 44
NAVAIR public release SPR-2013-303 45
Page 45
Operational Significant
Operational Significant
Operational Significance
Operational Significance
NAVAIR public release SPR-2013-303 46
Page 46
NAVAIR public release SPR-2013-303 Analyze data between flights
47
Page 47
Instrumentation
SW Tools
Measuring hits
Measuring aim point
Stats – Design Expert
Results
NAVAIR public release SPR-2013-303 48
Page 48
NAVAIR public release SPR-2013-303 49
Page 49
50 NAVAIR public release SPR-2013-303
Page 50
51 NAVAIR public release SPR-2013-303
Page 51
NAVAIR public release SPR-2013-303 52
Page 52
NAVAIR public release SPR-2013-303 53
Page 53
54 NAVAIR public release SPR-2013-303
Page 54
55
significant
significant
significant
not significant
NAVAIR public release SPR-2013-303
Page 55
RS
Op
erat
ion
al S
ign
ific
ance
NAVAIR public release SPR-2013-303 56 Statistical Significance ≠ Operational Significance
Page 56
NAVAIR public release SPR-2013-303
Op
erat
ion
al S
ign
ific
ance
significant
57
Page 57
Op
erat
ion
al
Sig
nif
ican
ce
significant
NAVAIR public release SPR-2013-303 58
Page 58
NAVAIR public release SPR-2013-303
Pointed Travelling
59
Page 59
NAVAIR public release SPR-2013-303 60
Page 60
Boeing explained wind compensation
Software modification in progress
H12 SCS around 2014 release
Procedural / Tactical options based on insight
Weapons Schools
NAVAIR public release SPR-2013-303 61
Page 61
Design of Experiments ≠ Test Methodology
See the target
Extracting HUD video data
Analysis data between flights
Gun Malfunction
Target Visibility
Winds
Statistical Significance may ≠ Operational
Significance
Statistical Significance = Defensible Results
NAVAIR public release SPR-2013-303 62
Page 62
NAVAIR public release SPR-2013-303 63
Page 63
NAVAIR public release SPR-2013-303 64
Maj Zach “Libi” McCarley, USMC [email protected] [email protected] LtCol Tim “Boomer” Jorris, USAF [email protected] [email protected]