Predicting Technical Aptitude: Relations between Predictor Variables, Technical Aptitude and Technical Training Performance (O.N.R. Contracts Nr. N00014-10-M-0087 & N00014-10-C-0505) Ryan Glaze & Martin J. Ippel CogniMetrics, Inc., San Antonio, TX 1 Paper presented at the 53 rd Annual Conference of the International Military Testing Association, Bali (Indonesia). October 31 – November 4, 2011
This document is posted to help you gain knowledge. Please leave a comment to let me know what you think about it! Share it to your friends and learn new things together.
Transcript
Predicting Technical Aptitude: Relations between Predictor Variables,
Technical Aptitude and Technical Training Performance
(O.N.R. Contracts Nr. N00014-10-M-0087 & N00014-10-C-0505)
Ryan Glaze & Martin J. Ippel
CogniMetrics, Inc., San Antonio, TX
1
Paper presented at the 53rd Annual Conference of the International Military Testing Association, Bali (Indonesia).
October 31 – November 4, 2011
Preview
Analysis I
Overview of ASVAB and Technical Knowledge Tests
Introduction to Technical Aptitude
Proposed Model
Methods, Results, and Discussion
Analysis II
Incremental Validity Analysis Predicting Technical Aptitude with ASVAB Selection Composites and the ITAB
Methods, Results, and Discussion
2
ASVAB
US Armed Forces must select, classify, and train personnel to work in highly technical work environment
ASVAB and Technical Knowledge Subtests used for technical Navy Ratings
General Science (GS)
Mechanical Comprehension (MC)
Auto Shop (AS)
Electrical Information (EI)
3
Technical Knowledge Subtests
Technical Knowledge Subtests have several limitations:
Represent arbitrary and limited sample of domain
Measures Technical Knowledge but not Technical Skills
Provide modest predictive validity
4
Technical Aptitude
Technical Aptitude (Ippel & Glaze, 2011)
Technical Knowledge Aptitude (TKA) Aptitude to learn technical knowledge (concepts)
Derived from performance on eight common knowledge tests
Technical Skill Aptitude (TSA) Aptitude to learn technical skills
Derived from performance on seven common skill tests
5
Technical Aptitude
Technical Aptitude (TA)
Represents a construct with a short logical distance to criterion performance in Apprentice Technical Training (ATT) performance
Will be used to assess construct validity of TK subtests
6
7
GS
Post-Test
Analysis I
8
Post-Test
GS
Technical Aptitude
9
Technical Aptitude
AFQT
GS
Post-Test
10
Technical Aptitude
AFQT
GS MC AS EI
Post-Test
11
Technical Aptitude
AFQT
GS MC AS EI
Post-Test
12
Technical Aptitude
AFQT
GS MC AS EI
Post-Test
13
Technical Aptitude
AFQT
GS MC AS EI
Post-Test
14
Technical Aptitude
AFQT
GS MC AS EI
Post-Test
15
Technical Aptitude
AFQT
GS MC AS EI
Post-Test
Method
410 Navy Recruits participating in A.T.T. program
ASVAB
TK Subtests: GS, MC, AS, EI
AFQT Considered a measure of crystallized intelligence
A.T.T. post-training test scores
Eight common knowledge tests
Seven common skill tests
Dichotomously scored (Pass/Fail with 70 point cut score)
16
Method
Technical Knowledge Aptitude
IRT-based ability estimate derived from common eight knowledge tests
Technical Skill Aptitude
IRT-based ability estimate derived from common seven skill tests