Program Evaluation Data Department of Education SUNY Cortland.

Program Evaluation Data

Department of EducationSUNY Cortland

Points of ViewPoints of View

NYSTCELAST & ATS-WState Dept of Ed

View

Student TeacherRating Scale

Field SupervisorView

Grad SurveyStudent View

Education DepartmentPerformance

New York State Teacher Certification ExaminationsNew York State Teacher

Certification ExaminationsAssessment of Teaching Skills (ATS)

Elementary Version Required for provisional certificate Taken upon completion of pedagogical coursework

and field experiencesLiberal Arts and Sciences Test (LAST)

80 Multiple Choice Questions and an essay questionTaken sophomore or junior yearRequired for provisional certification

NYSTCE . . .

14126 NYSTCE Records14126 NYSTCE Records

Initial examination includes only Overall Scores (n = 2592)

In the Spring we plan to examine subtest scores

2592

11534

Overall Subtests

NYSTCE . . .

2592 Overall Records2592 Overall Records

Many test records were duplicated

Identical dates, tests, scores

Non-identical matriculation status

Non-identical degree type (i.e. BS or BA)

13871205

Original Copies

NYSTCE . . .

1387 Overall Test Scores1387 Overall Test Scores

The LAST & ATS constituted 91% of the scores (1259 records)

The current analysis focuses on LAST & ATS results

25103

688571

LAST ATS content CTSCTS

NYSTCE . . .

Tests taken more than once

Tests taken more than onceAn additional 63 cases were removed from

analysis because they were retakenTest retakes occurred when students failed the

first administrationIf students failed the retake, their most recent

attempt was kept for analysis (previous administrations were removed)

Many of the students in the 2001 administrations have not had the opportunity to retake the test, therefore their scores are lower

Number of Tests TakenNumber of Tests Taken

Less than 100 test scores were reported in 1998

The number of test records have increased substantially each year

2001 administration includes non-graduates (sophomores, juniors & seniors)

NYSTCE . . .

The Pass Rate: GraduatesThe Pass Rate: GraduatesNYSTCE . . .

Decline in 2001 attributable to lack of opportunity for students who failed to retake the exam

Mean Scores: GraduatesMean Scores: GraduatesNYSTCE . . .

Scores show a slight decline since 1998

The cut score for passing = 220

The highest possible score = 300

Field Supervisor RatingsField Supervisor RatingsField supervisors rate candidates’ performance

at the end of student teachingEvaluation rating scales aggregated for the past

three years (1999-2001)Rating scale was modified after the 2000

administration

Student Teaching Evaluations

Rating Scale ModificationsRating Scale Modifications

19 old items were deleted and 18 new items were added

19 items only partially overlapped43 items with nearly complete overlapOnly the 43 overlapping items were compared

across years

Student Teaching Evaluations

Overall EvaluationsOverall Evaluations

43 itemsLarge dip in

the spring 2000 ratings

Student Teaching Evaluations

Content KnowledgeContent Knowledge

5 items

Student Teaching Evaluations

Implementing & Facilitating

Implementing & Facilitating

10 items

Student Teaching Evaluations

Communicating & Questioning

Communicating & Questioning

8 items

Student Teaching Evaluations

DispositionsDispositions

14 items

0

0.2

0.4

0.6

0.8

1

1999 2000 2001

Outstanding

Very Good

Satisfactory

NeedsImprovement

Student Teaching Evaluations

Graduate SurveyGraduate Survey

Aggregated student opinion surveys 1998-2000Survey format changed somewhat, but questions

comparable

Grad Survey . . .

Faculty AdvisementFaculty AdvisementGrad Survey . . .

Faculty SupportFaculty SupportGrad Survey . . .

Quality of TeachingQuality of TeachingGrad Survey . . .

Quality of CoursesQuality of CoursesGrad Survey . . .

Student TeachingStudent TeachingGrad Survey . . .

Academic PreparationAcademic PreparationGrad Survey . . .