AMTEC Certification Assessments - AMTEC | …autoworkforce.org/wp-content/uploads/2014/05/AMTEC...Replace, install, and adjust cam followers and rod ends. Assessment Goals 110 Standards
Post on 23-May-2018
217 Views
Preview:
Transcript
AMTEC Certification&
Assessments
C BA
DF
One-to-One
TutoringMastery
Learning
Mastery LearningCompetency-Based Learning
Unit 1Formative
Test A
Formative
Test B
Corrective
activities
Corrective cannot be...
Mastery Learning
Unit 1
Enrichment
Activities
Formative
Test A
Unit 2
Formative
Test B
Corrective
activities
Multi-Skilled Maintenance
• 19 duties
• 110 tasks
Phase 1: AMTEC Occupational
Standards
• 13 courses
• 57 modules
Phase 2: AMTEC Training Standards
& Curriculum
• 1 comprehensive assessments
• 13 diagnostic assessments
• 57 pre- and post-test assessments
Phase 3: AMTEC Test and
Certification
6
DesignDACUM
2
Troubleshoot/repair/replace
gears
a
Perform visual inspection:
alignment, worn/missing teeth,
cracked teeth, etc.
b
Inspect gear to shafts for fitting
(looseness, etc.)
c Replace gear
d Set clearances
e Set backlash
f Check oil level
g Check grease lines for function
h
Apply predictive technology
(vibration analysis, ultrasonic, oil
analysis)
i Select and use correct lubrication
61 Student Learning OutcomesAMT 1086—Gears and Cams
A Gear and cam maintenance safety.
BDescribe the purpose and function of gears and gear drives.
C Open gears.
D Enclosed gears.
E Seals, breathers, and lubrication.
F Gear ratings and application and selection.
GIndustrial cam follower functions, uses, and terms.
HIndustrial cam follower bushing types and operating clearances.
I Gear identification.
J Assemble a parallel shaft gear drive.K Assemble an angle shaft gear drive.L Assemble a worm and wheel gearbox drive unit.
MIdentify the common types of cam followers and rod ends.
NReplace, install, and adjust cam followers and rod ends.
Assessment Goals
110 Standards
• 2 versions of Comprehensive Test –
• 19 topic areas and 110 standards
13 courses
• 13 Diagnostic (topic level) Assessments
57 modules
• 57 pre- and 57 post- tests
Assessment Plan Details110 Standards
• Aligned to Standards
• 2 versions
• Developed by Industry
• NOCTI Business Solutions
13 Diagnostic (topics)
• Aligned to Subset of Standards
• 13 tests
• Developed by Industry
• NOCTI Business Solutions
57 modules
• Aligned to Student Learning Outcomes
• 57 pre- and 57 post-tests
• Developed by Faculty
• Offered in LMS
Comprehensive Assessment
Currently
1 version of a validated comprehensive assessment with passing score
Administered to thousands of incumbent workers
Comprehensive Assessment
DACUM—
• September, 2007
Delphi--three
rounds
Core Standards Identified—
• August, 2008
Item collection
and writing
Pilot Testing
Validation and Cut Score—
• May 28, 2010
Test Specification for Core (Duty)
Fundamental Percent
200
Items
Grand
Mean
N=52
A MECHANICAL EQUIPMENT x 6% 11 3.08
B PNEUMATIC/HYDRAULIC EQUIPMENT x 5% 11 3.04
D. PREDICTIVE/CORRECTIVE MAINTENANCE Knowledge 5% 10 2.77
E BLUEPRINT READING/SCHEMATICS x 6% 12 3.28
F EQUIPMENT CONTROLS AND SENSORS x 6% 12 3.38
G ELECTRICAL EQUIPMENT x 6% 13 3.57
H ELECTRONIC EQUIPMENT Intro 4% 8 2.35
I NETWORKING Intro 4% 8 2.34
J PLC EQUIPMENT x 6% 13 3.56
L. ROBOTS x 5% 11 3.03
M RESISTANCE WELDING x 3% 7 1.92
O FABRICATE x 4% 9 2.47
P COMPUTER LITERACY x 6% 12 3.43
Q PREVENTATIVE MAINTENANCE x 6% 12 3.40
U SPECIALIZED MACHINERY x 5% 10 2.82
V METROLOGY x 5% 9 2.56
W SAFETY AND DOCUMENTATION x 7% 13 3.67
X LASER ETCHER Intro 3% 5 1.43
Y AUTOMATIC WELDER x 3% 7 1.84
Z SPECIALIZED EQUIPMENT x 3% 5 1.44
100% 200
13
Test Specification by Task
Fundamental
Items
Needed
Items
Have
Grand
Mean
N=52
E BLUEPRINT READING/SCHEMATICS
41 Interpret mechanical drawings x 3 0 3.60
42
Interpret pneumatic and hydraulic
drawings x 3 32
3.48
43 Interpret electrical schematics x 3 49 3.73
44
Interpret piping and instrumentation
diagram (P&ID) x 2 0
2.96
45
Operate basic drafting software
(AutoCAD or Visio) Introduction 2 0
2.62
14
Passing ScoreTest Category Number of
Test Questions
Percent Required
for Passing
A: Mechanical Equipment 13 76.9%
B: Pneumatic/Hydraulic Equipment 14 78.6%
D: Predictive/Corrective Maintenance 8 87.5%
E: Blueprint Reading/Schematics 13 76.9%
F: Equipment Controls and Sensors 12 83.3%
G: Electrical Equipment 11 81.8%
H: Electronic Equipment 8 75.0%
I: Networking 8 75.0%
J: PLC 13 92.3%
L: Robots 10 90.0%
M: Resistance Welding 7 85.7%
O: Fabricate 8 87.5%
P: Computer Literacy 11 100.0%
Q: Preventative Maintenance 12 75.0%
U: Specialty Equipment 10 80.0%
V: Metrology 7 85.7%
W: Safety and Documentation 13 76.9%
X: Laser Etcher 5 80.0%
Y: Automatic Welder 4 75.0%
Total Number of Items Deemed Essential 187 154
Total Number of Items 187
Percent Required for Passing 82.4%
Pilot Test DataTest Category Number of Test
Questions
Recalculated
Average Score
Passing Score
Established by
Panel
Percent of Pilot
Group that would
have passed Basic
level by section
N=228
A: Mechanical Equipment 13 69.7% 76.9% 49%
B: Pneumatic/Hydraulic Equipment 14 65.7% 78.6% 35%
D: Predictive/Corrective Maintenance 8 44.8% 87.5% 2%
E: Blueprint Reading/Schematics 13 48.4% 76.9% 5%
F: Equipment Controls and Sensors 12 61.8% 83.3% 14%
G: Electrical Equipment 11 57.9% 81.8% 17%
H: Electronic Equipment 8 57.9% 75.0% 33%
I: Networking 8 40.7% 75.0% 11%
J: PLC 13 60.8% 92.3% 7%
L: Robots 10 75.8% 90.0% 38%
M: Resistance Welding 7 60.8% 85.7% 21%
O: Fabricate 8 63.5% 87.5% 20%
P: Computer Literacy 11 70.2% 100.0% 9%
Q: Preventative Maintenance 12 67.8% 75.0% 50%
U: Specialty Equipment 10 70.8% 80.0% 49%
V: Metrology 7 52.6% 85.7% 5%
W: Safety and Documentation 13 64.6% 76.9% 31%
X: Laser Etcher 5 33.4% 80.0% 7%
Y: Automatic Welder 4 52.5% 75.0% 40%
Total Number of Items Deemed Essential 187 60.7% 82.4% 1%
Cut Score
• “Is it essential that a candidate answer this item correctly in order to be certified as a Multi-Skilled Automotive Maintenance Technician by AMTEC”?
Comprehensive Test• Cuyahoga Community College
• Lorain Community College
• Lakeland Community CollegeMAGNET (Ohio)
•TMMI—Ivy Tech
•TMMK—Bluegrass Community & Technical CollegeToyota•Pune, India
•Flint—Mott Community College
•Orion Plant—Oakland Community college
•UzDaewooAuto
General Motors
•Spartanburg Community CollegeBMW
•Henry Ford Community CollegeSeverstal
•Smyrna-Tennessee Technology Center—MurfreesboroNissan
•Industrial Maintenance CompletersSomerset Community
College
<2012 Comprehensive Test
1,627 tests
7 passed with 82.4%
•3 incumbent workers from TMMK
•4 Nissan North America--Smyrna
Since New VendorOctober, 2013-to current
150 Business and Industry
• Elizabethtown CTC-Workforce Solutions-AMTEC
• Ivy Tech Community College, Columbus-AMTEC
• Lansing Community College-AMTEC
• MAGNET-AMTEC
• Murakami Manufacturing USA, Inc.-AMTEC
• Murakami Mfg USA
• TG Kentucky, LLC. - AMTEC
• Williamston Products, Inc. - AMTEC
54 Postsecondary Students
• Owensboro Community and Tech-AMTEC
• Elizabethtown Community and Tech College-AMTEC
• Bluegrass Community and Technical College-AMTEC
• Somerset Community College-AMTEC
• Big Sandy Community & Technical College - AMTEC
• Jefferson Community and Technical College-AMTEC
• Somerset Community College-AMTEC
• Big Sandy Community & Technical College-AMTEC
Recent Test Results
MECHANICAL
EQUIPMENT
PNEUMATIC/HYDRA
ULICEQUIPME
NT
PREDICTIVE/CORREC
TIVEMAINTEN
ANCE
BLUEPRINT
READING/SCHEMATI
CS
EQUIPMENT
CONTROLSAND
SENSORS
ELECTRICAL
EQUIPMENT
ELECTRONIC
EQUIPMENT
NETWORKING
PLCEQUIPME
NTROBOTS
RESISTANCE
WELDING
FABRICATE
COMPUTER
LITERACY
PREVENTATIVE
MAINTENANCE
SPECIALIZED
MACHINERY
METROLOGY
SAFETYAND
DOCUMENTATION
LASERETCHER
AUTOMATIC
WELDERTotal
B&I (150) 68.6% 71.4% 46.0% 44.8% 62.2% 56.4% 62.7% 45.3% 49.8% 73.1% 58.7% 68.8% 77.9% 70.9% 75.1% 47.3% 70.8% 35.1% 57.8% 61.7%
PS (54) 57.8% 61.8% 45.4% 44.0% 50.0% 48.0% 56.0% 41.2% 38.0% 53.0% 44.7% 68.5% 76.6% 62.2% 65.0% 44.7% 60.7% 25.2% 46.3% 53.4%
0.0%
10.0%
20.0%
30.0%
40.0%
50.0%
60.0%
70.0%
80.0%
90.0%
Cut ScoreGap >35%
MECHANICA
LEQUIPMENT
PNEUMATIC/HYDRAULICEQUIPMENT
PREDICTIVE/CORRECTIVE
MAINTENANC
E
BLUEPRINT
READING/SCHEMATICS
EQUIPMENTCONTR
OLSAND
SENSORS
ELECTRICALEQUIPMENT
ELECTRONICEQUIPMENT
NETWORKIN
G
PLCEQUIPMENT
ROBOTS
RESISTANCEWELDI
NG
FABRICATE
COMPUTER
LITERACY
PREVENTATI
VEMAINTENANC
E
SPECIALIZED
MACHINERY
METROLOGY
SAFETY ANDDOCUMENTATION
LASERETCHE
R
AUTOMATICWELDE
R
Total
Cut Score 76.9% 78.6% 87.5% 76.9% 83.3% 81.8% 75.0% 75.0% 92.3% 90.0% 85.7% 87.5% 100.0% 75.0% 80.0% 85.7% 76.9% 80.0% 75.0% 82.4%
Overall (204) 65.8% 68.9% 45.8% 44.6% 59.0% 54.2% 60.9% 44.2% 46.7% 67.7% 55.0% 68.8% 77.5% 68.6% 72.5% 46.6% 68.1% 32.5% 54.8% 59.5%
B&I (150) 68.6% 71.4% 46.0% 44.8% 62.2% 56.4% 62.7% 45.3% 49.8% 73.1% 58.7% 68.8% 77.9% 70.9% 75.1% 47.3% 70.8% 35.1% 57.8% 61.7%
PS (54) 57.8% 61.8% 45.4% 44.0% 50.0% 48.0% 56.0% 41.2% 38.0% 53.0% 44.7% 68.5% 76.6% 62.2% 65.0% 44.7% 60.7% 25.2% 46.3% 53.4%
0.0%
20.0%
40.0%
60.0%
80.0%
100.0%
120.0%
Percent Passing by Duty
MECHANICALEQUIPMENT
PNEUMATIC/HYDRAUL
ICEQUIPMENT
PREDICTIVE/C
ORRECTIVE
MAINTENANCE
BLUEPRINT
READING/SCHEMATICS
EQUIPMENTCONTR
OLSAND
SENSORS
ELECTRICAL
EQUIPMENT
ELECTRONIC
EQUIPMENT
NETWORKING
PLCEQUIPMENT
ROBOTS
RESISTANCE
WELDING
FABRICATE
COMPUTER
LITERACY
PREVENTATIVEMAINTENANCE
SPECIALIZED
MACHINERY
METROLOGY
SAFETYAND
DOCUMENTATI
ON
LASERETCHER
AUTOMATIC
WELDER
Total
Overall (204) 37% 25% 1% 4% 15% 10% 40% 10% 2% 24% 16% 24% 11% 51% 48% 3% 38% 6% 39% 0%
B&I (150) 42% 30% 1% 4% 20% 13% 42% 12% 3% 32% 20% 23% 10% 55% 56% 3% 45% 7% 45% 0%
PS (54) 24% 9% 0% 4% 2% 4% 33% 4% 0% 2% 6% 26% 15% 39% 26% 4% 17% 4% 24% 0%
0%
10%
20%
30%
40%
50%
60%
Overall (204)
B&I (150)
PS (54)
Participant FeedbackDuty Level
Number of Items
Your % Correct Comment
A MECHANICAL EQUIPMENT 13 69.2% N.I.B PNEUMATIC/HYDRAULIC EQUIPMENT 14 78.6% N.I.
D PREDICTIVE/CORRECTIVE MAINTENANCE 8 37.5% N.I.E BLUEPRINT READING/SCHEMATICS 13 69.2% N.I.
F EQUIPMENT CONTROLS AND SENSORS 12 83.3% passG ELECTRICAL EQUIPMENT 11 63.6% N.I.H ELECTRONIC EQUIPMENT 8 75.0% pass
I NETWORKING 8 37.5% N.I.J PLC EQUIPMENT 13 76.9% N.I.
L ROBOTS 10 90.0% passM RESISTANCE WELDING 7 100.0% passO FABRICATE 8 75.0% N.I.
P COMPUTER LITERACY 11 90.9% N.I.
Q PREVENTATIVE MAINTENANCE 12 75.0% pass
U SPECIALIZED MACHINERY 10 80.0% passV METROLOGY 7 71.4% N.I.W SAFETY AND DOCUMENTATION 13 76.9% pass
X LASER ETCHER 5 40.0% N.I.Y AUTOMATIC WELDER 4 100.0% pass
187 73.8% N.I.
Participant FeedbackTask Level
J PLC EQUIPMENT # Items Your % Correct
70 Create/modify/monitor PLC programs 2 100.0%
71 Program/maintain operator interface software 2 100.0%
72 Troubleshoot communication systems in PLC 2 50.0%
73 Replace PLC processor 2 100.0%
74 Perform backups of PLC software programs 2 50.0%
75 Install/maintain PCL hardware 2 100.0%
76 Edit/Program PLC 1 100.0%
L. ROBOTS # Items
83 Install/Maintain robot systems 6 50.0%
84 Program/edit robot software 4 75.0%
M RESISTANCE WELDING # Items
85
Perform visual inspection of resistance welding equipment
operation 1 100.0%
86 Align components in resistance welding equipment 1 100.0%
87 Repair/replace failed components in resistance welding equipment 1 100.0%
89
Perform parameter adjustments (weld conditions) on resistance
and stud welding 1 0.0%
90 Troubleshoot/repair/replace location pins and datum surfaces 1 100.0%
91 Maintain cooling system in resistance welding equipment 1 0.0%
92
Perform resistance checks (resistance of cable and condition of
insulators) 1 100.0%O FABRICATE # Items
97 Perform pipefitting tasks 2 100.0%
98 Operate machining equipment 3 66.7%
99 Operate welding equipment for fabrication 3 66.7%
Program FeedbackBy Task
E BLUEPRINT READING/SCHEMATICS # Items % of Group Correct
41 Interpret mechanical drawings 3 68.7%
42 Interpret pneumatic and hydraulic drawings 3 24.9%
43 Interpret electrical schematics 3 53.1%
44
Interpret piping and instrumentation diagram
(P&ID) 2 72.7%
45
Operate basic drafting software (AutoCAD or
Visio) 2 30.8%
F EQUIPMENT CONTROLS AND SENSORS # Items % of Group Correct
46 Troubleshoot/replace/install circuit boards 1 74.3%
47 Install/maintain/troubleshoot photo eyes 1 9.3%
48 Install/maintain/troubleshoot servo motors 2 59.3%
49
Install/maintain/troubleshoot VFD drives
(Variable Frequency Drive) 2 45.6%
50
Install/maintain/troubleshoot limit and
proximity switches 2 96.0%
51
Troubleshoot/calibrate/adjust and replace
sensors and input devices 2 84.1%
52 Calibrate process control loop (PID) 1 63.6%
53 Troubleshoot/replace transducers 1 48.6%
Nissan
Source of Training
MECHANICAL
EQUIPMENT
PNEUMATIC/HYDRAULIC
EQUIPMENT
PREDICTIVE/CORR
ECTIVEMAINTENANCE
BLUEPRINT
READING/SCHEM
ATICS
EQUIPMENT
CONTROLS AND
SENSORS
ELECTRICAL
EQUIPMENT
ELECTRONIC
EQUIPMENT
NETWORKING
PLCEQUIPM
ENTROBOTS
RESISTANCE
WELDING
FABRICATE
COMPUTER
LITERACY
PREVENTATIVE
MAINTENANCE
SPECIALIZED
MACHINERY
METROLOGY
SAFETYAND
DOCUMENTATION
LASERETCHER
AUTOMATIC
WELDERTotal
Trade school/career technical center (88) 65.8% 69.0% 47.3% 46.4% 59.3% 56.6% 62.6% 44.7% 49.1% 68.5% 53.7% 71.0% 78.8% 69.6% 72.6% 45.9% 68.2% 31.1% 57.1% 60.3%
Comprehensive high school (41) 64.5% 63.8% 45.1% 47.7% 57.9% 56.1% 56.7% 46.0% 47.3% 65.6% 50.2% 70.4% 73.4% 68.5% 71.0% 43.6% 67.2% 30.2% 49.4% 58.3%
Military (MOS) training (13) 76.3% 74.2% 42.3% 55.6% 67.9% 60.8% 65.4% 51.9% 59.8% 70.8% 60.4% 72.1% 88.1% 78.2% 79.2% 45.1% 72.8% 32.3% 69.2% 66.3%
Apprenticeship/on-the-job training (74) 66.6% 69.1% 46.3% 46.2% 58.9% 55.0% 62.0% 47.3% 47.8% 68.2% 55.2% 73.3% 75.9% 69.8% 74.6% 46.5% 70.7% 29.7% 57.8% 60.5%
External/specialized trianing programs (42) 70.1% 73.8% 44.9% 46.3% 62.7% 56.7% 62.8% 46.4% 55.3% 74.0% 60.2% 70.8% 78.1% 71.8% 75.2% 48.0% 72.7% 32.4% 58.9% 62.9%
community/junior technical college (82) 65.5% 68.6% 44.8% 47.3% 58.8% 57.4% 62.7% 45.0% 48.5% 66.2% 52.3% 71.3% 81.3% 67.7% 71.8% 46.5% 67.3% 30.0% 56.7% 60.0%
four-year college/university (7) 54.9% 76.5% 48.2% 49.5% 57.1% 53.2% 60.7% 44.6% 48.4% 68.6% 69.4% 64.3% 75.3% 69.0% 72.9% 44.9% 70.3% 40.0% 42.9% 60.0%
0.0%
10.0%
20.0%
30.0%
40.0%
50.0%
60.0%
70.0%
80.0%
90.0%
100.0%
Education Level
MECHANICAL
EQUIPMENT
PNEUMATIC/HYDRAULI
CEQUIPM
ENT
PREDICTIVE/CORRECTIVEMAINTENANCE
BLUEPRINT
READING/SCHEMATICS
EQUIPMENT
CONTROLSAND
SENSORS
ELECTRICAL
EQUIPMENT
ELECTRONIC
EQUIPMENT
NETWORKING
PLCEQUIPM
ENTROBOTS
RESISTANCE
WELDING
FABRICATE
COMPUTER
LITERACY
PREVENTATIVEMAINTENANCE
SPECIALIZED
MACHINERY
METROLOGY
SAFETYAND
DOCUMENTATI
ON
LASERETCHER
AUTOMATIC
WELDERTotal
HS (50) 58.0% 58.4% 44.0% 38.3% 47.3% 44.5% 52.5% 38.5% 36.6% 58.8% 45.4% 66.3% 67.3% 62.0% 65.8% 42.0% 63.2% 24.8% 43.5% 51.7%
HS+ (52) 67.6% 72.0% 45.9% 45.6% 61.7% 59.3% 64.2% 48.6% 49.6% 71.2% 59.6% 72.4% 79.5% 71.6% 75.6% 50.3% 71.6% 35.0% 63.0% 62.5%
Assoc (42) 67.0% 72.4% 46.1% 47.8% 61.7% 57.8% 67.0% 43.2% 50.7% 68.6% 50.3% 67.9% 84.2% 70.2% 74.0% 46.6% 69.4% 30.0% 57.1% 61.4%
Bach (4) 63.5% 73.2% 56.3% 42.3% 64.6% 61.4% 62.5% 53.1% 48.1% 80.0% 64.3% 62.5% 84.1% 70.8% 80.0% 32.1% 78.8% 40.0% 37.5% 63.0%
MS (1) 73.1% 67.9% 62.5% 46.2% 70.8% 68.2% 56.3% 62.5% 65.4% 80.0% 64.3% 62.5% 86.4% 75.0% 85.0% 35.7% 65.4% 40.0% 87.5% 66.8%
0.0%10.0%20.0%30.0%40.0%50.0%60.0%70.0%80.0%90.0%
100.0%
Years of Experience
MECHANICAL
EQUIPMENT
PNEUMATIC/HYDRA
ULICEQUIPME
NT
PREDICTIVE/CORREC
TIVEMAINTEN
ANCE
BLUEPRINT
READING/SCHEMATI
CS
EQUIPMENT
CONTROLS AND
SENSORS
ELECTRICAL
EQUIPMENT
ELECTRONIC
EQUIPMENT
NETWORKING
PLCEQUIPME
NTROBOTS
RESISTANCE
WELDING
FABRICATE
COMPUTER
LITERACY
PREVENTATIVE
MAINTENANCE
SPECIALIZED
MACHINERY
METROLOGY
SAFETYAND
DOCUMENTATION
LASERETCHER
AUTOMATIC
WELDERTotal
1 to 3 years 58.6% 64.5% 47.3% 41.7% 50.8% 51.4% 57.2% 38.1% 40.8% 62.0% 43.9% 67.8% 78.5% 64.0% 68.0% 43.5% 64.1% 28.5% 49.6% 55.2%
4 to 6 years 70.9% 68.9% 50.9% 53.3% 61.3% 55.8% 67.0% 51.8% 47.3% 70.0% 61.2% 63.4% 77.9% 68.5% 75.7% 46.9% 67.6% 34.3% 55.4% 61.9%
7 to 9 years 62.5% 62.5% 40.6% 40.4% 55.2% 47.7% 57.8% 46.9% 41.3% 60.0% 41.1% 70.3% 69.3% 66.7% 73.8% 44.6% 69.2% 17.5% 46.9% 55.3%
10 to 12 years 67.2% 68.1% 42.5% 41.5% 61.1% 52.7% 66.7% 43.3% 47.2% 68.7% 55.2% 68.3% 78.2% 67.8% 76.7% 50.5% 75.9% 30.7% 63.3% 60.5%
13 to 15 years 69.2% 70.0% 43.8% 43.1% 62.5% 54.5% 66.3% 38.8% 59.2% 80.0% 68.6% 77.5% 76.4% 76.7% 79.0% 50.0% 75.4% 30.0% 60.0% 63.7%
16 to 20 years 68.1% 67.9% 50.9% 45.1% 56.0% 55.2% 55.4% 55.4% 46.2% 70.7% 65.3% 75.0% 70.8% 76.8% 75.7% 45.9% 73.1% 34.3% 60.7% 61.5%
21 or more years 74.2% 82.7% 42.0% 47.3% 69.6% 69.5% 67.9% 53.6% 58.2% 80.0% 68.4% 72.3% 81.2% 79.8% 77.1% 48.0% 73.1% 37.1% 64.3% 67.4%
0.0%
10.0%
20.0%
30.0%
40.0%
50.0%
60.0%
70.0%
80.0%
90.0%
Job Title
MECHANICAL
EQUIPMENT
PNEUMATIC/HYDR
AULICEQUIPME
NT
PREDICTIVE/CORR
ECTIVEMAINTEN
ANCE
BLUEPRINT
READING/SCHEMAT
ICS
EQUIPMENT
CONTROLS AND
SENSORS
ELECTRICAL
EQUIPMENT
ELECTRONIC
EQUIPMENT
NETWORKING
PLCEQUIPME
NTROBOTS
RESISTANCE
WELDING
FABRICATE
COMPUTER
LITERACY
PREVENTATIVE
MAINTENANCE
SPECIALIZED
MACHINERY
METROLOGY
SAFETYAND
DOCUMENTATION
LASERETCHER
AUTOMATIC
WELDERTotal
Maintenance technician (73) 67.3% 70.5% 44.2% 40.6% 58.0% 55.9% 62.0% 43.5% 46.8% 69.6% 54.0% 68.3% 75.2% 70.0% 74.5% 47.9% 69.9% 32.3% 55.1% 59.7%
Electrician (3) 69.2% 69.0% 58.3% 53.8% 52.8% 57.6% 58.3% 37.5% 61.5% 66.7% 52.4% 66.7% 93.9% 66.7% 76.7% 57.1% 64.1% 33.3% 58.3% 62.4%
Mechanic (3) 51.3% 52.4% 50.0% 38.5% 47.2% 42.4% 41.7% 45.8% 33.3% 56.7% 33.3% 70.8% 51.5% 69.4% 63.3% 47.6% 74.4% 6.7% 41.7% 50.1%
Die Maker (2) 73.1% 75.0% 37.5% 42.3% 54.2% 50.0% 50.0% 31.3% 50.0% 75.0% 50.0% 87.5% 59.1% 75.0% 90.0% 42.9% 69.2% 20.0% 50.0% 59.4%
Machinist (1) 61.5% 35.7% 50.0% 61.5% 50.0% 54.5% 62.5% 37.5% 23.1% 70.0% 42.9% 87.5% 81.8% 83.3% 90.0% 57.1% 69.2% 20.0% 25.0% 57.8%
Supervisor (6) 70.5% 77.4% 47.9% 47.4% 68.1% 56.1% 64.6% 50.0% 55.1% 81.7% 66.7% 64.6% 86.4% 79.2% 76.7% 54.8% 73.1% 20.0% 70.8% 65.5%
0.0%
10.0%
20.0%
30.0%
40.0%
50.0%
60.0%
70.0%
80.0%
90.0%
100.0%
Future Plan
Review and Update Current Comprehensive Test
Develop at least one additional version
Diagnostic Assessments
13 Topic Tests
Computer Literacy
Fluid Power and Electro-hydraulics/ pneumatics
General PM and
Predictive Maintenance
PLC (Siemens)
PLC (Allen Bradley/Rock
well)
Blueprint reading/
schematics
Robotics Controls & Instrumentation
Basic Electricity
and Electronics
Mechanical Systems/
Mechanical Drives/Power Transmission
Safety
Welding and Fabrication
Plan to Complete Diagnostic Tests
Finish Pilot Testing
• May, 2013
Industry SME’s establish cut
score by module
Release for Purchase
Industries in Diagnostics Test Development
• Toyota West Virginia
• Toyota Texas
• Toyota Indiana
• Nissan
• Ford
• BMW
12 tests
Number of
Sections/Modules
Number of Test
Items
1Fluid Power and
Electrohydraulics/pneumatics
7 149
2 General PM and Predictive Maintenance 5 100
3 PLC [ALLEN BRADLEY/ROCKWELL] 4 161
4 Blueprint Reading/Schematics 2 151
5 Robotics--Fanuc 5 83
6 Controls & Instrumentation 4 152
7 Basic Electricity and Electronics 4 150
8Mechanical Systems/Mechanical
Drives/Power Transmissions
6 152
9 Safety 4 137
10 Computer Literacy 4 116
11 Welding and Fabrication 4 169
12 Machine Tool Operations 7 179
Test Spec
A AMT1071: Introduction to Basic Electricity # items1 Demonstrate knowledge of basic electrical principles 11
2 Interpret electrical schematics 14
3 Install/replace wire 13
B AMT 1072: Instruments # items
4 Demonstrate knowledge of instruments 145 Operate electrical/electronic test equipment 19
C AMT 1073: Component & Circuits # items
6 Demonstrate knowledge of components and circuits 137 Install/maintain relays 12
8 Install/replace fuses and circuit breakers 14
D AMT 1074: Solid State Drives # items
9 Demonstrate knowledge of solid state drives 18
10 Maintain/install fiber optics 6
11 Troubleshoot/repair/replace vision systems 4
12 Install/maintain/troubleshoot bar code readers 413 Perform startup and shut down of laser etcher 8
150
Pilot Test
• The pilot test is free to industry and candidates
• Industry will receive diagnostic feedback on the results once the test is finalized
• Pilot test candidates will receive feedback on the results
Ready for Validation• Fluid Power and
Electrohydraulics/pneumatics
• General PM and Predictive Maintenance
• PLC (Allen Bradley)
• Blueprint Reading/Schematics
• Controls & Instrumentation
• Basic Electricity and Electronics
• Mechanical Systems/Mechanical Drives/Power Transmissions
• Machine Tool Operations
Need more Pilot Test Takers
• Safety
• Computer Literacy
• Welding and Fabrication
• Robotics--Fanuc
Need To Be Developed
• Siemens PLC
Validation
• Establish Cut ScoreIndustry Pilot Test
• Industry and Schools
• Diagnose to the module level
Uses
Future Plans
Develop PLC Siemens
Validate tests and establish cut scores
Develop performance (hands on) tests
Pre- and Post Module Assessments
CurriculumDACUM
2
Troubleshoot/repair/replace
gears
a
Perform visual inspection:
alignment, worn/missing teeth,
cracked teeth, etc.
b
Inspect gear to shafts for fitting
(looseness, etc.)
c Replace gear
d Set clearances
e Set backlash
f Check oil level
g Check grease lines for function
h
Apply predictive technology
(vibration analysis, ultrasonic, oil
analysis)
i Select and use correct lubrication
61 Student Learning OutcomesAMT 1086—Gears and Cams
A Gear and cam maintenance safety.
BDescribe the purpose and function of gears and gear drives.
C Open gears.
D Enclosed gears.
E Seals, breathers, and lubrication.
F Gear ratings and application and selection.
GIndustrial cam follower functions, uses, and terms.
HIndustrial cam follower bushing types and operating clearances.
I Gear identification.
J Assemble a parallel shaft gear drive.K Assemble an angle shaft gear drive.L Assemble a worm and wheel gearbox drive unit.
MIdentify the common types of cam followers and rod ends.
NReplace, install, and adjust cam followers and rod ends.
2011 Pre- and Post-Test Development Sessions
• recorded “how-to” webinarMay 25, 2011
• Lansing Community College (pilot test)July 18
• Danville Community CollegeJuly 27-28
• San Antonio Community College DistrictAugust 8-9
• Henry Ford Community CollegeAugust 22-23
AMT 1071Introduction to Basic Electricity
• Lab 1: Electrical Safety
• Lab 2: Sources of Electricity
• Lab 3: Ohmeter Lab Project
• Lab 4: Open & Closed Circuits
• Lab 5: Components & Schematic Symbols
• Lab 6: Voltage & Current Meter Measurements
• Lab 7: Ohm's Law
• Lab 8: Watt's Law
• Lab 9: Resistance in Series Circuits
• Lab 10: Current in Series Circuits
• Lab 11: Voltage in Series Circuits
• Lab 12: Effects of an Open in Series Circuits
• Lab 13: Effects of a Short in Series Circuits
• Lab 14: Variable Resistors
• Lab 15: Equivalent Resistance of a Parallel Circuit
• Lab 16: Voltage in Parallel Circuits
• Lab 17: Current in Parallel Circuits
• Lab 18: Effects of an Open in Parallel Circuits
• Lab 19: AC Sine Wave Generation
• Lab 20: Magnetism
• Lab 21: Magnetism --Electromagnetism (Relay)
Faults
Rubric
Tool
Selection
and Use
Highly Proficient
A Competent
B
Partially
Competent/
Developing
C
Limited
D
Major
Improvement
Required
E
3 Selection of
equipment
25 Correctly and efficiently
selected equipment
Incorrect
selection of
equipment
4 Correct set
up
25 Correctly set up the
equipment for readings
Somewhat
correct
Incorrect set
up
5 Use of Meter 25 Correctly and efficiently
connected meter to device
Somewhat
efficiently
Had to have
assistance in
connecting
the meter to
device
6 Care and use
of tools
15 Handled tools carefully
and respectfully
Mishandled one
or more of the
tools
Showed
disrespect for
the tools
Troubleshooting
Skills Highly
Proficient
A
Competent
B
Partially
Competent/
Developing
C
Limited
D
Major
Improvement
Required
E
7 Sequence of
diagnosing problem
20 Used a logical
sequence to
locate the
problem
Used a trial
and error
approach but
was able to
locate the
problem
Was unable to
locate the
problem
8 Efficient use of time 15 Finished tasks
on or ahead of
time
Barely
finished task
in allocated
time
Did not
complete task
9 Accurately
diagnosed condition
of component
25 Correctly
diagnosed
condition of all
8 components
With
assistance was
able to
diagnose
condition of at
least 6
components
Could not
diagnose
condition of 4
or more of the
components
Work Habits
Highly Proficient
A
Competent
B
Partially
Competent/
Developing
C
Limited
D
Major Improvement
Required
E
10 Work Attitude 15 Alert to finding and
correcting problem
Honestly
attempted to find
and correct
problems
Showed frustration
in finding and
correctly problem
11 Work Procedure 25 Always followed standard
procedures; demonstrated
planning and organization
skills in correcting the
problem
Complied with
standard
procedures;
Showed some plan
and organization
in working
Did not follow
standard procedures;
Disorganized and
slipshod methods;
12 Professionalism 20 Work showed pride in
accomplishment
Tried hard and
shows promise
Work lacks
praiseworthy factors
13 Self-confidence 15 Appeared comfortable and
posed when performing
tasks
Fairly self-
confident;
occasionally
disconnected
Hesitant, timid,
uncertainty
14 Knowledge of job 25 Has an exceptionally
thorough knowledge of the
job
Has good
knowledge but
needed coaching
Has inadequate
knowledge of job
Plan
During Industry Curriculum Review and Revision
•Lab Rubrics being reviewed
•Test items being reviewed
Learning Analytics
AMTEC Data
Pre and post test scores
Lab Rubrics
Diagnostic tests
Comprehensive tests
College and Industry Survey
Measures
• Numbers receiving training, number of degrees and certificates, and student engagementInputs
• Cost of training and assessmentsEfficiency
• Participants Rating of Training QualityReaction
• Percent reporting increased knowledge and skillsLearning
• Percent of employees using the skillsApplication
• Training programs driving business measures (productivity, less downtime, promotions, employer satisfaction, etc.)Impact
• Learning and development program has won awardsAwards
Career Path EntrantsSecondary students articulated through community college
Postsecondary students entering college first time
Postsecondary students seeking retraining
Dislocated/unemployed workers
Incumbent workers skill enhancement by mfg. in general, auto industry, tier supplier
12–13
40%
50%
60%
70%
80%
90%
100%
11–12 13–14 14–15 15–16 16–17 17–18 18–19 19–20
Is it possible?
98%
97%
96.8%
95.6%
92.2%
Incumbent
79%
Overall
65%
Postsecondary
58%
Dislocated
54%
High School
50%
Learning Analysis
What is the difference in scores on the various AMTEC assessments and labs for
• Those that use the AMTEC curriculum and those that are using other curriculum models
• Sources of training or academic degrees/experiences
• Years experience
• Learning Delivery (traditional college classroom, apprenticeship, online, real flipped classroom)
Test Item-level analysis
• Specific questions that were missed more often than others
• Specific student learning outcomes (not taught/covered or poorly taught)
• Specific occupational standards (not taught/covered or poorly taught)
• Faculty member occupational experience or background
Is there anything that would indicate technical issues prevented a successful outcome?
• Those programs that implement open entry/open exit, competency based models
• Those programs that are using the flipped classroom model
• The LMS platform being used
• The use of the AMTEC trainer or alternative simulation equipment
Panel Members
Nissan
• Kevin Smith/Paul Williams
Bluegrass CTC
• Mary Maggard
Somerset Community College
• Nick Tomlinson
By Nick Tomlinson
November 12, 2013
Somerset Community College and the ATMEC Assessment
Brief History of KCTCS and the AMTEC Assessment
• Fall 2010 semester,
– Dr. Annette Parker, former AMTEC director and liaison to the statewide curriculum
– KCTCS Industrial Maintenance Technology (IMT) curriculum committee,
– new Perkins IV assessment legislation for Fall 2012
• October, 2010,
– the IMT committee chose to use the AMTEC General Mechatronics assessment
Brief History of KCTCS and the AMTEC Assessment
• KCTCS involved in the AMTEC DACUM and creation of the AMTEC comprehensive assessment
• Cost benefit of using AMTEC test
SCC and the AMTEC Assessment• Spring 2011
– The Somerset Community College (SCC) Industrial Maintenance Technology (IMT) program began offering the AMTEC General Mechatronics assessment to students
– the SCC IMT faculty, which consists of Butch Tincher, Danny Lester, and Nick Tomlinson agreed to pre-test all incoming students and post-test all graduating students.
– SCC felt that better data concerning student learning could be obtained from comparing pre-test scores to post-test scores.
SCC and the AMTEC Assessment• Butch Tincher was appointed
AMTEC test coordinator.
– ensures that all incoming freshmen and graduates are tested.
– works with the SCC Assessment Center to procure a date for the exams and
– coordinates with all of the other instructors to find release time for the students to take the exam.
SCC and the AMTEC Assessment• April 1, 2011.
– Thirteen (13) students were tested.
– Six of them were pre-tests and seven were post-tests.
• Since that time,
– 51 students have been pre-tested and
– 27 have been post-tested. – The discrepancy between pre-tests and post-tests is due to non-
completers and students who are currently within their 2 years of
study and are not prepared for the post-assessment.
SCC Results
•currently 48.5.The cumulative
average pre-test score for SCC IMT students
•currently 58.2.The cumulative
average post-test score for SCC IMT students
•9.7 points.SCC students are increasing, on average,
SCC Results
•69.5 on 9-6-13.The highest pre-test score ever recorded
•30.5 on 9-6-13.The lowest pre-test
score ever recorded at SCC
•78 on 11-4-11.The highest post-test
score ever recorded at SCC
•28.9 on 11-16-12.The lowest post-test
score ever recorded at SCC
SCC ResultsSCC Student Distribution on Pre-Test
Pre-Test Scores
Score Number %
0-9 0 0
10-19 0 0
20-29 0 0
30-39 7 13.725
40-49 21 41.176
50-59 17 33.333
60-69 6 11.765
70-79 0 0
80-89 0 0
90-100 0 0
Totals: 51 100
SCC Student Distribution on Post-Test
Post-Test Scores
Score Number %
0-9 0 0
10-19 0 0
20-29 1 3.7037
30-39 1 3.7037
40-49 3 11.1111
50-59 10 37.037
60-69 10 37.037
70-79 2 7.4074
80-89 0 0
90-100 0 0
Totals: 27 100
Three Qualifying Factors
• There is a trio of factors that one must consider when looking at the assessment results from SCC.
1. Students did not take the exam seriously
– Example a bright 4.0 G.P.A. student scored a 53 on the pre-test and received the worst score in SCC history with a 28.9. He admitted to not giving the effort needed to score well, because “you just had to take it, not pass it.”
Qualifying Factors2. Sequence of SCC IMT curriculum.
– Content courses involving electricity, motor controls, PLCs, blueprint reading, fluid power, mechanics, welding, and machine tool.
– worst sub-scores on student assessments are generally in those topics that were taken at the beginning of their program.
– best sub-scores on student assessments are generally in those topics that were taken in the last semester of their program.
Qualifying Factors
3. SCC does not use the AMTEC curriculum.
– SCC is using the state approved KCTCS curriculum.
– If SCC used the AMTEC curriculum, the scores would most likely increase.
The Future of SCC and AMTEC• Two critical factors
– Concern of the high cut-score on the AMTEC exam
– Time eroding student memory
• Conclusion
– creating a cumulative course known as IMT 289 Industrial Maintenance Capstone.
The Future of SCC and AMTEC• Fall, 2013
– all incoming students graduating with a diploma or degree will take this 1 credit hour capstone course
– The purpose of this course is to refresh the students’ memory of all of the main ideas in their previous IMT courses.
– At the completion of the course, students are required to take the AMTEC assessment as their final exam.
The Future of SCC and AMTEC
• Perkins IV– Along with this capstone course, Perkins V legislation
requires 70% of all graduates to achieve an approved cut-off score on the end of program assessment.
• On September 6, 2013, – the KCTCS IMT Curriculum Committee met in
Versailles, KY to established a cut-off score for the AMTEC test of 50.8.
– This score is for KCTCS use only in reporting results to the federal government in fulfillment of the Perkins V legislation. It does not supplant the official AMTEC cut-off score of 82.4%.
The Future of SCC and AMTEC
• SCC students will be required to pass the AMTEC test IMT 289 course.
– SCC students who do not meet the 50.8% will be required to retake the IMT 289 course.
top related