Jan 16, 2016
Aligning with state and national standards and certifications whenever possible› AWS endorsement, AIPB, OSDH
Assisting Skills Centers and Student Organizations› Life Skills› Competitive events
~98,000+ tests administered in FY12› 130+ skill standards & 130+ assessments› Tests free to OK teachers
Increasing development efforts towards national assessments› National Consortium for Health Science Education (NCHSE)› National Law, Public Safety, Security and Corrections Core
Assessment
State/National Industry Association Driven › 50% Aligned or Endorsed
Oklahoma Industry Validated › 3:1 Industry to Instructor Committee Ratio
Provides Students & Employers Independent Measure of Competency Provides Valuable Analyses
› Student…remediation› Program…program improvement› State…professional development› Item…assessment improvement
Increase Number of Skills Standards & Assessments
Increase Alignments & Endorsements
Maintain Excellent Online Infrastructure
The Sky’s the Limit!
Skills Standards
Competency Tests
Curriculum
Include a body of knowledge, skills and abilities needed to successfully perform in an occupation
Are developed and validated by industry representatives
Are tied to industry standards whenever possible Provide a basis for identifying/developing
curriculum materials Drive competency test development
Four Key CharacteristicsFour Key Characteristics
Measures readiness for a specific occupation
Follows the Skills Standards for that occupation
Aligns with occupational certification whenever possible
Provides meaningful information for program improvement
Once the Skills Standards list is completed, frequencyfrequency and criticalitycriticality ratings are used to determine the number of test questions
Questions are written by subject matter experts
Questions are then compiled and reviewed by a committee of subject matter experts before the test is administered to students
ANY/EVERY student who…
is enrolled in the program for which the test was developed.
has completed training for an occupation and passed all related performance evaluations for an occupation.
is READYREADY to take the test according to the instructor.
determine which test is to be administered be sure that each student who is being
tested is READYREADY to test schedule a time/date to test the student(s)
with the Testing Liaison (complete test referral form?)
provide the test number and the PIDPID CodeCode to the Testing Liaison
Instructors should…
Prior to administering any assessment, it is the responsibility of the testing liaison to obtain the following information for each student:
• WAVE ID (obtained from Department of Education), the Student’s Social Security Number or a local Student ID number or some other number unique to that student
• PID code (a unique code given to each program to identify it)
• Instructor’s Last Name• Student’s First & Last Names• The type of program the student is enrolled in• The type of student (high school or post secondary)
Testing LiaisonsTesting Liaisons
Administrators at each school designate a Testing LiaisonTesting Liaison to administer the competency tests in a SECURESECURE testing environment.
NEVERNEVER give out username and password Tests are not to be used for pre- or post-
testing Testing Liaisons are to maintain physical
control of testing materials at all times Instructors are NOT allowed to view tests
(unless participating in the annual test review) A student may use a unique ID in lieu of their
SSN (Ex: a student ID number with zeros that precede it to create a nine character ID)
A set of instructions is provided at the beginning of each assessment.› In this set of instructions, any reference materials that
may be used will be listed here.
At the end of the assessment, a link is provided to the Coaching Report.› Don’t forget that a copy should be provided to the
student, the instructor, and that the testing liaison should also keep a copy
The testing environment should be such that participants can concentrate on their assessments with minimal distractions.
Considerations regarding the testing environment include:› Consistent/adequate lighting levels› Temperature at a comfortable level with proper
ventilation› Space is quiet with minimal distractions› Participants should be asked to behave consistently (no
eating, getting up and moving about)› Avoid/delay the test administration when a participant
appears hurried, troubled, or ill
• Participant authentication: a picture ID should always be shown and login should be handled quickly and quietly by the proctor
• Protection of the security of the online testing system. Username AND password should NEVER be revealed
• PROHIBIT THE USE OF ALL COMMUNICATION AND TECHNOLOGY DEVICES (photos of test items and text messaging are common problems)
• Computer usage: Monitor whether participants are trying to access the internet or other programs
• The proctor should be vigilant in their observance of the testing environment: Note passing, hand gestures, etc.
• Reference materials, texts, notes, etc., are not allowed in the testing area unless specifically allowed for in the exam or in a student’s Individualized Education Plan
• If a candidate is caught cheating during an examination, testing will stop immediately The candidate will receive a failing result and the incident will be reported to the CareerTech Testing Center (CTTC)
• Students with an IEP may have special accommodations as specified in an IEP, IRP, 504, LEP, and ELL
In the event a participant fails his or her first (1st) attempt to pass a CTTC test examination (score was less than 70%), the CTTC does not require any specific waiting period between the first (1st) and second (2nd) attempt to pass such examination.
Remediation is required prior to the 2nd or any subsequent administration.
After the second (2nd) attempt, the participant will be required to wait three (3) calendar days to retake the examination. All subsequent attempts require a wait of three calendar days to retake the examination.
If any candidate is caught cheating during an examination, testing will stop immediately The candidate will receive a failing result and the incident will be reported to the CareerTech Testing Center (CTTC).
Several factors to consider when cheating occurs:Widespread cheating (e.g., answer copying)
throws into question the validity of resultsLeaking of items from your repository is
expensive and damaging to an organizations reputation.
New technologies used in cheating.
COACHINGREPORT
The Coaching Report provides:
Mean performance by duty area
Percentage Score
Document competency attainment
Identify relative areas of individual remediation
A method for individual program improvement
A method for state program improvement
The website address for the CareerTech Testing Center:http://www.okcareertech.org/about/state-agency/divisions/testing
The Updates section on the testing website should be checked often:
› You will find information on new alignments, endorsements, and various other information
› If any test numbers change, that information will be listed here
Our Blog is a repository of information on a variety of topics.
(www.careertechtesting.net)
Some topics are original thought, some inspired by the world around us and some are articles and reports generated by others that have application to Testing and career and technology education in Oklahoma and throughout.
We invite you to read and use the information that is provided. Please be aware that some links will lead to articles that do not represent an official view of ODCTE and we are not responsible for their content or accuracy.
We hope that you find our Blog useful and informative! J.T.
CareerTech Testing Center
Oklahoma Department of Career and Technology Education
1500 W. Seventh Avenue
Stillwater, OK 74074
Main Office: 405-743-5412
FAX: 405-743-6885Kerry Eades 405.743.5411
CareerTech Testing Center Blog:
http://careertechtesting.blogspot.com
www.careertechtesting.net
iTeach – CareerTech:
http://iteach-careertech.wikispaces.com
Twitter: @CareerTechTest
Facebook: CareerTech Testing Center
Email: [email protected]
Phone: 405.743.5411