Page 1
An Approach to ATMLusing the SSAI RAI Standard
SSAI Proprietary Information: Any distribution or disclosure of this information is subject to prior SSAI approval.
Dr. Ronald C. Salley (321) 724-5566 x274 [email protected] Pritchett 321-724-5566 x260 [email protected]
Page 2
RAI Visualization
Test PlatformRAI
Test Requirement Object
Test Program(test-platform independent)
The SSAI RAI Standard
The only model that completely supports
• complete platform independence and• parallel testing
Page 3
RAI Visualization
RAI
Test Requirement Object
Test PlatformTest Program(test-platform independent)
The Test Requirement - the primary unit of currency for testing
The SSAI RAI Standard
Page 4
Test Requirement vs. Test
Space = what Time = how data objects events
data-definition languages, eg., XML
programming languages, e.g., ATLAS
test platforms tests
test requirements test descriptions
test definitions
Page 5
Test Requirement vs. Test
Space = what Time = how data objects events
data-definition languages, eg., XML
programming languages, e.g., ATLAS
test platforms tests
test requirements test descriptions
test definitions
Traditional Modeling
Page 6
Test Requirement vs. Test
Space = what Time = how data objects events
data-definition languages, eg., XML
programming languages, e.g., ATLAS
test platforms tests
test requirements test descriptions
test definitions
RAI Modeling
Page 7
Test Requirement vs. Test
Space = what Time = how data objects events
data-definition languages, eg., XML
programming languages, e.g., ATLAS
test platforms tests
test requirements test descriptions
test definitions
RAI Modeling
Page 8
Test Requirement vs. Test
Space = what Time = how data objects events
data-definition languages, eg., XML
programming languages, e.g., ATLAS
test platforms tests
test requirements test descriptions
test definitions
RAI Modeling
Page 9
Test Requirement vs. Test
TEST PLATFORM UUT
A, WFGB, WFG
C, DMM
E, DMM
D, DMM
F, DMM
G, DMM
ITA
H, WFG
1
2
3
4
5
6
7
8
9
10
16
15
14
13
12
11
Page 10
Test Requirement vs. Test
TEST PLATFORM
SqW
A, WFG
2 µsec
RMSAvg
SnW
B, WFG
C, DMM
E, DMM
D, DMM
F, DMM
G, DMM
0 µsec5 µsec
3 µsec
ITA
H, WFG
1
2
3
4
5
6
7
8
9
10
16
15
14
13
12
11
UUT
Page 11
Test Requirement vs. Test
TEST PLATFORM
SqW
A, WFG
2 µsec
RMSAvg
SnW
B, WFG
E, DMMF, DMM
0 µsec5 µsec
3 µsec
ITA
2
6
9
13
UUT
test requirement
Page 12
Test Requirement vs. Test
TEST PLATFORM UUT
ITAA, WFG
B, WFG
SqW
5 µsec
E, DMM
2 µsec
RMS
F, DMM
Avg
3 µsec
SnW
0 µsec 2
6
9
13
UUT
test requirement
Page 13
Test Requirement vs. Test
ITAA, WFG
B, WFG
SqW
5 µsec
E, DMM
2 µsec
RMS
F, DMM
Avg
3 µsec
SnW
0 µsec
TEST PLATFORM
2
6
9
13
UUT
test requirement
Page 14
Test Requirement vs. Test
ITAA, WFG
B, WFG
SqW
5 µsec
E, DMM
2 µsec
RMS
F, DMM
Avg
3 µsec
SnW
0 µsec
TEST PLATFORM
2
6
9
13
UUT
test requirement
Page 15
Test Requirement vs. Test
ITAA, WFG
B, WFG
SqW
5 µsec
E, DMM
2 µsec
RMS
F, DMM
Avg
3 µsec
SnW
0 µsec
TEST PLATFORM
2
6
9
13
UUT
test requirement
Page 16
Test Requirement vs. Test
ITAA, WFG
B, WFG
SqW
5 µsec
E, DMM
2 µsec
RMS
F, DMM
Avg
3 µsec
SnW
0 µsec
TEST PLATFORM
2
6
9
13
UUT
test requirement
Page 17
Test Requirement vs. Test
TEST PLATFORM UUT
ITAA, WFG
B, WFG
SqW
5 µsec
E, DMM
2 µsec
RMS
F, DMM
Avg
3 µsec
SnW
0 µsec 2
6
9
13
UUT
test result
Page 18
Test Requirement vs. Test
During the test… the state of the test platform is the test requirement
Immediately after the test… the state of the test platform is the test result
Page 19
Test Requirement vs. Test
A test requirement and its result are states of the same object, viz., the test platform.
Page 20
Test Requirement vs. Test
A test requirement and its result are states of the same object, viz., the test platform.
A test requirement and its result are structurally identical trees whose nodes may have slightly different states.
Page 21
Test Requirement vs. Test
ITA
TEST PLATFORM
A, WFG
B, WFG
E, DMM
F, DMM SqW
5 µsec
2 µsec
RMS
Avg
3 µsec
SnW
0 µsec
UUT
2
6
9
13
UUT
test platform state
Page 22
Test Requirement vs. Test
B, WFG
E, DMM
F, DMM
TEST PLATFORMTEST PLATFORM
SqW
5 µsec
2 µsec
RMS
Avg
3 µsec
SnW
0 µsec
UUT
2
6
9
13
UUT
ITA
test platform state
Page 23
Test Requirement vs. Test
TEST PLATFORM
E, DMM
F, DMM
SqW
5 µsec
2 µsec
RMS
Avg
3 µsec
SnW
0 µsec
UUT
2
6
9
13
ITA
test platform state
Page 24
Test Requirement vs. Test
TEST PLATFORM
E, DMM
UUT
SqW
5 µsec
2 µsec
RMS
Avg
3 µsec
SnW
0 µsec 2
6
9
13
ITA
test platform state
Page 25
Test Requirement vs. Test
SqW
5 µsec
2 µsec
RMS
Avg
3 µsec
SnW
0 µsec
TEST PLATFORM
UUT
2
6
9
13
ITA
test platform state
Page 26
Test Requirement vs. Test
SqW
5 µsec
2 µsec
RMS
Avg
3 µsec
SnW
0 µsec
TEST PLATFORM
2
6
9
13
UUT
ITA
test platform state
Page 27
Test Requirement vs. Test
SqW
5 µsec
2 µsec
RMS
Avg
3 µsec
SnW
0 µsec 2
6
9
13
UUT
ITA
test platform state
Page 28
Test Requirement vs. Test
SqW
5 µsec
2 µsec
RMS
Avg
3 µsec
SnW
0 µsec 2
6
9
13
UUT
ITA
test platform state
Page 29
Test Requirement vs. Test
SqW
5 µsec
2 µsec
RMS
Avg
3 µsec
SnW
0 µsec 2
6
9
13
UUT
test platform state
Page 30
Test Requirement vs. Test
SqW
5 µsec
2 µsec
RMS
Avg
3 µsec
SnW
0 µsec 2
6
9
13UUT
test platform state
Page 31
Test Requirement vs. Test
SqW
5 µsec
2 µsec
RMS
Avg
3 µsec
SnW
0 µsec 2
6
9
13
test platform state
Page 32
Test Requirement vs. Test
SqW
5 µsec
2 µsec
RMS
Avg
3 µsec
SnW
0 µsec 2
6
9
13
test platform state
Page 33
Test Requirement vs. Test
SqW
5 µsec
2 µsec
RMS
Avg
3 µsec
SnW
0 µsec 2
6
9
13
Test-platform Independent
test platform state
Page 34
Test Requirement vs. Test
SqW
5 µsecpin 6
Avg
3 µsecpin 9
SnW
0 µsecpin 2
2 µsec
RMSpin 13
test platform state test requirementtest result{
Test-platform Independent
Page 35
Test Requirement vs. Test
So what?
Page 36
Resource Adapter Interface (RAI)
RAI Visualization
Test Requirement Object
RAITest PlatformTest Program
(test-platform independent)
Page 37
Resource Adapter Interface (RAI)
RAI Visualization
Resource Manager
Test Requirement Object
RAITest PlatformTest Program
(test-platform independent)
Page 38
RAI Visualization
Resource Manager
Test Requirement Object
RAITest PlatformTest Program
(test-platform independent)
Resource Adapter Interface (RAI)
Page 39
RAI Visualization
Resource Manager
Test Requirement Object
RAITest PlatformTest Program
(test-platform independent)
Resource Adapter Interface (RAI)
Page 40
RAI Visualization
Resource Manager
Test Requirement Object
RAITest PlatformTest Program
(test-platform independent)
Resource Adapter Interface (RAI)
Page 41
RAI Visualization
Resource Manager
Test Requirement Object
RAITest PlatformTest Program
(test-platform independent)
Resource Adapter Interface (RAI)
Page 42
RAI Visualization
Resource Manager
RAI
Test Requirement
Test PlatformTest Program(test-platform independent)
Resource Adapter Interface (RAI)
Page 43
RAI Visualization
Resource Manager
RAI
Test Requirement
Test PlatformTest Program(test-platform independent)
Resource Adapter Interface (RAI)
Page 44
RAI Visualization
Resource Manager
RAI
Test Requirement
Test PlatformTest Program(test-platform independent)
Resource Adapter Interface (RAI)
Page 45
RAI Visualization
Resource Manager
RAI
Test Requirement
Test PlatformTest Program(test-platform independent)
Resource Adapter Interface (RAI)
Page 46
RAI Visualization
Resource Manager
RAI
Test Requirement
Test PlatformTest Program(test-platform independent)
Resource Adapter Interface (RAI)
Page 47
RAI Visualization
Resource Manager
RAI
Test Requirement
Test PlatformTest Program(test-platform independent)
Resource Adapter Interface (RAI)
Page 48
RAI Visualization
Resource Manager
RAI
Test Result
Test PlatformTest Program(test-platform independent)
Resource Adapter Interface (RAI)
Page 49
RAI Visualization
Resource Manager
RAI
Test Result
Test PlatformTest Program(test-platform independent)
Resource Adapter Interface (RAI)
Page 50
RAI Visualization
`
Resource Manager
RAI
Test Result Object
Test PlatformTest Program(test-platform independent)
Resource Adapter Interface (RAI)
Page 51
RAI Visualization
`
Resource Manager
RAI
Test Result Object
Test PlatformTest Program(test-platform independent)
Resource Adapter Interface (RAI)
Page 52
RAI Visualization
Resource Manager
RAI
Test Result Object
Test PlatformTest Program(test-platform independent)
Resource Adapter Interface (RAI)
Page 53
RAI Visualization
Resource Manager
RAI
Test Result Object
Test PlatformTest Program(test-platform independent)
Resource Adapter Interface (RAI)
Page 54
RAI Visualization
A map oftest requirements
totest results
Test Requirement Object
RAITest Program
(test-platform independent)
Resource Adapter Interface (RAI)
Page 55
RAI Visualization
A map oftest requirements
totest results
Test Requirement Object
RAITest Program
(test-platform independent)
Resource Adapter Interface (RAI)
Page 56
RAI Visualization
A map oftest requirements
totest results
RAI
Test Requirement Object
Test Program(test-platform independent)
Resource Adapter Interface (RAI)
Page 57
RAI Visualization
A map oftest requirements
totest results
Test Requirement Object
RAITest Program
(test-platform independent)
Resource Adapter Interface (RAI)
Page 58
RAI Visualization
A map oftest requirements
totest results
RAI
Test Requirement Object
Test Program(test-platform independent)
Resource Adapter Interface (RAI)
Page 59
RAI Visualization
A map oftest requirements
totest results
Test Requirement Object
RAITest Program
(test-platform independent)
Resource Adapter Interface (RAI)
Page 60
RAI Visualization
A map oftest requirements
totest results
Test Result Object
RAITest Program
(test-platform independent)
Resource Adapter Interface (RAI)
Page 61
RAI Visualization
A map oftest requirements
totest results
RAI
Test Result Object
Test Program(test-platform independent)
Resource Adapter Interface (RAI)
Page 62
RAI Visualization
A map oftest requirements
totest results
Test Result Object
RAITest Program
(test-platform independent)
Resource Adapter Interface (RAI)
Page 63
RAI Visualization
A map oftest requirements
totest results
Test Result Object
RAITest Program
(test-platform independent)
Resource Adapter Interface (RAI)
Page 64
RAI Visualization
A map oftest requirements
totest results
Test Result Object
RAITest Program
(test-platform independent)
Resource Adapter Interface (RAI)
Page 65
Test requirements can be mapped to test results• dynamically using a test platform or
• statically using pre-collected data.
Page 66
RAI Visualization
A map oftest requirements
totest results
Test Requirement Object
RAITest Program
(test-platform independent)
Resource Adapter Interface (RAI)
Page 67
RAI Visualization
A map oftest requirements
totest results
Test Requirement Object
RAITest Program
(test-platform independent)
Resource Adapter Interface (RAI)
Page 68
RAI Visualization
A map oftest requirements
totest results
RAI
Test Requirement Object
Test Program(test-platform independent)
Resource Adapter Interface (RAI)
Page 69
RAI Visualization
A map oftest requirements
totest results
Test Requirement Object
RAITest Program
(test-platform independent)
Resource Adapter Interface (RAI)
Page 70
RAI Visualization
A map oftest requirements
totest results
RAI
Test Requirement Object
Test Program(test-platform independent)
Resource Adapter Interface (RAI)
Page 71
RAI Visualization
A map oftest requirements
totest results
Test Requirement Object
RAITest Program
(test-platform independent)
Resource Adapter Interface (RAI)
Page 72
RAI Visualization
A map oftest requirements
totest results
Test Result Object
RAITest Program
(test-platform independent)
Resource Adapter Interface (RAI)
Page 73
RAI Visualization
A map oftest requirements
totest results
RAI
Test Result Object
Test Program(test-platform independent)
Resource Adapter Interface (RAI)
Page 74
RAI Visualization
A map oftest requirements
totest results
Test Result Object
RAITest Program
(test-platform independent)
Resource Adapter Interface (RAI)
Page 75
RAI Visualization
A map oftest requirements
totest results
Test Result Object
RAITest Program
(test-platform independent)
Resource Adapter Interface (RAI)
Page 76
RAI Visualization
A map oftest requirements
totest results
Test Result Object
RAITest Program
(test-platform independent)
Resource Adapter Interface (RAI)
Page 77
Test requirements can be mapped to test results• dynamically using a test platform or
• statically using pre-collected data.
Page 78
Test requirements can be mapped to test results• dynamically using a test platform or
• statically using pre-collected data.
RAI test programs are independent of• the type of test platform mapping test
requirements to test results.
Page 79
Test requirements can be mapped to test results• dynamically using a test platform or
• statically using pre-collected data.
RAI test programs are independent of• the type of test platform mapping test
requirements to test results.
RAI test programs are independent of• whether test platforms are mapping test
requirements to test results.
Page 80
Test-platform State, Test Requirement, Test Result
struct TTiming{
Double m_Begin;Double m_End;
};
struct TCapability{
//signal with range, resolution, and accuracyT1641Signal m_T1641Signal;TTiming m_TTiming;string m_PinID;
};
struct TTestPlatformState: TCapability{
TTestPlatformState* m_pTTestPlatformState[ ];};
typedef TTestPlatformState TTestRequirement;typedef TTestPlatformState TTestResult;
SqW
5 µsecpin 6
Avg
3 µsecpin 9
SnW
0 µsecpin 2
2 µsec
RMSpin 13
Capability A
Capability B Capability C
Capability D
Page 81
Test Requirement #1
SqW
5 µsecpin 6
Avg
3 µsecpin 9
SnW
0 µsecpin 2
2 µsec
RMSpin 13
SnW
7 µsecpin 12
Avg
10 µsecpin 7
SnW
0 µsecpin 6
Test Requirement #2 Test Requirement #3
RMS
1 µsecpin 4
SqW
0 µsecpin 2
Platform-independent Testing
Page 82
#include "RAI.h"#include "TestRequirements.h"
void main(){
TTestPlatformState TestResult1, TestResult2, TestResult3;//Map test requirement #1 to test result #1TestResult1 = TestRequirement1;
if (TestResult1.Signal("UUTPin13") > 12.3)cout << "UUT passed" << endl;
else{
//Map test requirement #2 to test result #2TestResult2 = TestRequirement2;//Map test requirement #3 to test result #3TestResult3 = TestRequirement3;
if (TestResult2.Signal("UUTPin4") < TestResult3.Signal("UUTPin7"))cout << "Replace UUT's patudy" << endl;
elsecout << "Failure unknown" << endl;
}}
Platform-independent Testing
Page 83
Test Requirement #1
SqW
5 µsecpin 6
Avg
3 µsecpin 9
SnW
0 µsecpin 2
2 µsec
RMSpin 13
Test Requirement #4
RMS
1 µsecpin 4
SqW
0 µsecpin 2
SnW
7 µsecpin 12
Avg
10 µsecpin 7
SnW
0 µsecpin 6
Test #2 and test #3 can be parallel
Test Requirement #1
SqW
5 µsecpin 6
Avg
3 µsecpin 9
SnW
0 µsecpin 2
2 µsec
RMSpin 13
SnW
7 µsecpin 12
Avg
10 µsecpin 7
SnW
0 µsecpin 6
Test Requirement #2 Test Requirement #3
RMS
1 µsecpin 4
SqW
0 µsecpin 2
Tests #1, #2, and #3 are necessarily sequential
Platform-independent Parallel Testing
Page 84
#include "RAI.h"#include "TestRequirements.h"
void main(){
TTestPlatformState TestResult1, TestResult4;//Map test requirement #1 to test result #1TestResult1 = TestRequirement1;
if (TestResult1.Signal("UUTPin13") > 12.3)cout << "UUT passed" << endl;
else{
//Map test requirement #4 to test result #4TestResult4 = TestRequirement4;
if (TestResult4.Signal("UUTPin4") < TestResult4.Signal("UUTPin7"))cout << "Replace UUT's patudy" << endl;
elsecout << "Failure unknown" << endl;
}}
Platform-independent Parallel Testing
Page 85
RAI Visualization
Test Result Object
RAI
Test Requirement Object
mapstest requirements
totest results
diagnoses,sequences, andcontrols
Test Program(test-platform independent)
The SSAI RAI Standard
Page 86
ATML Capability and ATML Instrument
Page 87
Resource Adapter Interface (RAI)
RAI Visualization
Resource Manager
Test Requirement Object
RAITest PlatformTest Program
(test-platform independent)
Page 88
RAI Visualization
Resource Manager
Test Requirement Object
RAITest PlatformTest Program
(test-platform independent)
Resource Adapter Interface (RAI)
Page 89
RAI Visualization
Resource Manager
Test Requirement Object
RAITest PlatformTest Program
(test-platform independent)
Resource Adapter Interface (RAI)
Page 90
RAI Visualization
Resource Manager
Test Requirement Object
RAITest PlatformTest Program
(test-platform independent)
Resource Adapter Interface (RAI)
Page 91
RAI Visualization
Resource Manager
Test Requirement Object
RAITest PlatformTest Program
(test-platform independent)
Resource Adapter Interface (RAI)
Page 92
RAI Visualization
Resource Manager
RAI
Test Requirement
Test PlatformTest Program(test-platform independent)
Resource Adapter Interface (RAI)
Page 93
Test requirements… trees of capabilities that must be satisfied
Instruments… lists of capabilities that can be satisfied
Test Requirement Instrument
Capabilitity A
Capabilitity B Capabilitity C
Capabilitity D
SqW
5 µsecpin 6
Avg
3 µsecpin 9
SnW
0 µsecpin 2
2 µsec
RMSpin 13
Capabilitity #1
Capabilitity #6
Capabilitity #2
Capabilitity #3 Capabilitity #4
Capabilitity #5
ATML Capability and ATML Instrument
Page 94
struct TTiming{
Double m_Begin;Double m_End;
};
struct TCapability{
T1641Signal m_T1641Signal;TTiming m_TTiming;string m_PinID;
};
Test Requirement Instrument TCapability T16141Signal m_T1641Signal a 1641 signal a 1641 signal TTiming m_TTiming
m_Begin required delay in beginning signal
maximum possible delay in beginning signal
m_End required maximum life of signal
maximum possible life of signal
string m_PinID ID of UUT pin ID of instrument pin
ATML Capability and ATML Instrument
Page 95
Legacy Testing Software
The test requirement is the key that unlocked the solution to the problem of porting legacy testing software across test platforms.
Legacy tests cannot be ported.Legacy test requirements can be ported.
Page 96
The SSAI RAI Standard
• is extremely simple,• is founded in system theory, viz., the Theory of Real Systems,• is based on the (rigorously defined) test requirement,• addresses no testing events, services, or executables,• addresses only data objects, which are directly definable in XML,• completely supports complete test-platform independence,• completely supports parallelism,• allows test programs in most any programming language, and• resolves the problem of porting legacy testing software.
Page 97
For the ATML to fully support the RAI element of the Framework IPT and thus fully support
• complete platform independence and• parallel testing,
the ATML must define an XML schema that supports the
• the test requirement object.
ATML support for the Framework IPT