Commission on Teacher Credentialing Ensuring Educator Excellence Program Program Assessment Assessment Technical Technical Assistance Assistance Violet Violet and and Indigo Indigo Cohorts Cohorts September 2010 September 2010 1
Co
mm
issi
on
on
Tea
cher
Cre
den
tial
ing
Ensuring Educator Excellence
Program Assessment Program Assessment Technical AssistanceTechnical Assistance
VioletViolet and and IndigoIndigo Cohorts CohortsSeptember 2010September 2010
11
Co
mm
issi
on
on
Tea
cher
Cre
den
tial
ing
Ensuring Educator Excellence
AgendaAgenda Review Accreditation CycleReview Accreditation Cycle IPR versus PAIPR versus PA Program Assessment DocumentProgram Assessment Document New and Transitioning ProgramsNew and Transitioning Programs Relationship to Site VisitRelationship to Site Visit Submission, Review/Feedback, and Submission, Review/Feedback, and
ResubmissionResubmission Guidelines for SubmissionGuidelines for Submission Technology TipsTechnology Tips
22
Co
mm
issi
on
on
Tea
cher
Cre
den
tial
ing
Ensuring Educator Excellence
Review of Accreditation CycleReview of Accreditation Cycle
33
Biennial Report
Data Collecting
Biennial Report
Follow up to site visit
Site Visit
Biennial Report
Co
mm
issi
on
on
Tea
cher
Cre
den
tial
ing
Ensuring Educator Excellence
Review of Accreditation CycleReview of Accreditation Cycle
Biennial Reports
are programs effective in preparing competent educators?
are programs aligned with standards?
Site Visit
Program Assessment
are Common Standards and Program Standards implemented in an integrated, effective manner?
44
Co
mm
issi
on
on
Tea
cher
Cre
den
tial
ing
Ensuring Educator Excellence
IPR versus PAIPR versus PA
Initial Program Approval documentInitial Program Approval document– The DreamThe Dream
Program Assessment DocumentProgram Assessment Document– The RealityThe Reality
55HO # 1 IPR-PA
Co
mm
issi
on
on
Tea
cher
Cre
den
tial
ing
Ensuring Educator Excellence
Purpose of Program Purpose of Program Assessment DocumentAssessment Document
Year 4 of accreditation cycleYear 4 of accreditation cycle Purposes:Purposes:
– To determine To determine ifif and and howhow programs programs are aligned are aligned with with program standardsprogram standards
– To To understand the data understand the data reported on in reported on in Year 3 Year 3 Biennial Report Biennial Report andand comment if appropriate comment if appropriate
– To aid in To aid in focusing the Site Visit focusing the Site Visit that will follow that will follow in Year Sixin Year Six
66
Co
mm
issi
on
on
Tea
cher
Cre
den
tial
ing
Ensuring Educator Excellence
Program Assessment DocumentProgram Assessment Document Part I – Narrative response to standardsPart I – Narrative response to standards Part II – Supporting Documentation (syllabi Part II – Supporting Documentation (syllabi
or course of study )or course of study ) Part III – Assessments (assessment tools Part III – Assessments (assessment tools
reported on in the biennial report and reported on in the biennial report and supporting documentation)supporting documentation)
Summary Summary
77
New this year!
Co
mm
issi
on
on
Tea
cher
Cre
den
tial
ing
Ensuring Educator Excellence
Program Assessment Document Program Assessment Document Part IPart I
Institution response to Institution response to Program StandardsProgram Standards
Describes Describes HOWHOW the program meets the program meets eacheach of the adopted program standardsof the adopted program standards
88
Co
mm
issi
on
on
Tea
cher
Cre
den
tial
ing
Ensuring Educator Excellence
Program Assessment Document Program Assessment Document Part I – Part I – Describing the HOWDescribing the HOW
Begin by understanding the entire Begin by understanding the entire standardstandard
Take the standard apart sentence by Take the standard apart sentence by sentence (chunk by chunk)sentence (chunk by chunk)
Respond to Respond to eacheach part of the standard part of the standard Provide appropriate documentationProvide appropriate documentation
99
Co
mm
issi
on
on
Tea
cher
Cre
den
tial
ing
Ensuring Educator Excellence
Respond to key Respond to key verbsverbs or or phrases phrases from from each sentence of the standardeach sentence of the standard– The program The program provides…provides…
– The program The program prepares candidates to…prepares candidates to…
– Candidates have Candidates have multiple, systematic multiple, systematic opportunities to…opportunities to…
– Candidates are Candidates are required to demonstrate…required to demonstrate…
Program Assessment Document Program Assessment Document Part I – Part I – Describing the HOWDescribing the HOW
1010
Co
mm
issi
on
on
Tea
cher
Cre
den
tial
ing
Ensuring Educator Excellence
Consider what types of documentation will Consider what types of documentation will support your claimssupport your claims– Example: If the “program provides” what might Example: If the “program provides” what might
be in the syllabus/course of study to indicate be in the syllabus/course of study to indicate HOW this is accomplished?HOW this is accomplished?
Course topicCourse topic
Key ReadingsKey Readings
Pacing guidePacing guide
Other?Other?
Program Assessment Document Program Assessment Document Part I – Part I – Describing the HOWDescribing the HOW
1111
Co
mm
issi
on
on
Tea
cher
Cre
den
tial
ing
Ensuring Educator Excellence
Practice by reviewing some current Practice by reviewing some current program standardsprogram standards– Take standard apartTake standard apart– Verbs and phrasesVerbs and phrases– Types of documentationTypes of documentation
Program Assessment Document Program Assessment Document Part I – Part I – Describing the HOWDescribing the HOW
1212HO # 2 Sample Stds
Co
mm
issi
on
on
Tea
cher
Cre
den
tial
ing
Ensuring Educator Excellence
Any questions about Any questions about Part IPart I??
Any ideas to share with others?Any ideas to share with others?
Program Assessment Document Program Assessment Document Part I – Part I – Describing the HOWDescribing the HOW
1313
Co
mm
issi
on
on
Tea
cher
Cre
den
tial
ing
Ensuring Educator Excellence
Program Assessment Document Program Assessment Document Part II - DocumentationPart II - Documentation
Course Syllabi, description of the course of Course Syllabi, description of the course of study, or other documentation to support study, or other documentation to support Part IPart I
No Vitae requiredNo Vitae required
1414
Co
mm
issi
on
on
Tea
cher
Cre
den
tial
ing
Ensuring Educator Excellence
Program Assessment Document Program Assessment Document Part II - Part II - DocumentationDocumentation
If your institution uses a particular form as If your institution uses a particular form as a template or course outline that is a template or course outline that is required required as the core of as the core of each courseeach course::– You may submit You may submit one course outline one course outline in your PA in your PA
document.document.
If instructors designs their section of the If instructors designs their section of the course on their own:course on their own:– Include Include eacheach course syllabi for course syllabi for allall courses courses
taught in the two years prior to PA.taught in the two years prior to PA.
1515
Co
mm
issi
on
on
Tea
cher
Cre
den
tial
ing
Ensuring Educator Excellence
Program Assessment Document Program Assessment Document Part II - DocumentationPart II - Documentation
Any questions about Any questions about Part IIPart II??
Any ideas to share with others?Any ideas to share with others?
1616
Co
mm
issi
on
on
Tea
cher
Cre
den
tial
ing
Ensuring Educator Excellence
Program Assessment Document Program Assessment Document Part III - AssessmentsPart III - Assessments
Provide the Provide the actualactual assessments reported assessments reported on in Biennial Report—template or sampleon in Biennial Report—template or sample– RubricsRubrics
– Observation formsObservation forms
– Portfolio guidelinesPortfolio guidelines
Provide Provide detailed information detailed information on on assessmentsassessments
Readers will have copies of Biennial Readers will have copies of Biennial ReportsReports
1717
Co
mm
issi
on
on
Tea
cher
Cre
den
tial
ing
Ensuring Educator Excellence
Program Assessment Document Program Assessment Document Part III - AssessmentsPart III - Assessments
Description of rubric points Description of rubric points Describe how you ensure that assessment Describe how you ensure that assessment
measures are used in the same manner measures are used in the same manner regardless of location, number of faculty, regardless of location, number of faculty, etc.etc.
Does the range of assessments address all Does the range of assessments address all candidate competencies? candidate competencies?
1818
Co
mm
issi
on
on
Tea
cher
Cre
den
tial
ing
Ensuring Educator Excellence
Program Assessment Document Program Assessment Document Part III - AssessmentsPart III - Assessments
MS/SS Programs MS/SS Programs do not do not need to include need to include information on TPA modelinformation on TPA model
MS/SS Programs MS/SS Programs dodo need to include need to include information oninformation on– Assessor trainingAssessor training
– Rescoring procedures Rescoring procedures
– Information that connects with Standards Information that connects with Standards 17,18,19 17,18,19
1919
Co
mm
issi
on
on
Tea
cher
Cre
den
tial
ing
Ensuring Educator Excellence
Program Assessment Document Program Assessment Document Part III - AssessmentsPart III - Assessments
Induction Programs Induction Programs do not do not need to include need to include FACT or FAS FormsFACT or FAS Forms
Induction Programs Induction Programs dodo need to include need to include information oninformation on– SP trainingSP training– Expectations and pacing of formative Expectations and pacing of formative
assessmentassessment– Information that connects with Standards 5 Information that connects with Standards 5
and 6 and 6
2020
Co
mm
issi
on
on
Tea
cher
Cre
den
tial
ing
Ensuring Educator Excellence
Program Assessment Document Program Assessment Document Part III - AssessmentsPart III - Assessments
PA Readers will use the PA Readers will use the Biennial Report Biennial Report and the and the CTC Feedback CTC Feedback in conjunction with in conjunction with the the program narrative program narrative and the and the assessment assessment toolstools– Provide feedback as to the type of assessments Provide feedback as to the type of assessments
used by the programused by the program
– Comment if the data does not indicate the Comment if the data does not indicate the program is meeting standardsprogram is meeting standards
2121
Co
mm
issi
on
on
Tea
cher
Cre
den
tial
ing
Ensuring Educator Excellence
Program Assessment Document Program Assessment Document Part III - AssessmentsPart III - Assessments
Any questions about Any questions about Part IIIPart III??
Any ideas to share with others?Any ideas to share with others?
2222
Co
mm
issi
on
on
Tea
cher
Cre
den
tial
ing
Ensuring Educator Excellence
Program Assessment Document Program Assessment Document SummarySummary
Document compiled from the program Document compiled from the program narrative describing structure of the narrative describing structure of the program with respect toprogram with respect to– Program DesignProgram Design
– Course of Study (Curriculum and Field Course of Study (Curriculum and Field Experience)Experience)
– Candidate CompetenceCandidate Competence
2323HO # 3
Co
mm
issi
on
on
Tea
cher
Cre
den
tial
ing
Ensuring Educator Excellence
New &Transitioning DocumentsNew &Transitioning Documents
Programs that have been through Initial Programs that have been through Initial Program Review within the Program Review within the last 12 months last 12 months do not do not need to go through PA.need to go through PA.
During TransitionDuring Transition– Institutions have options for responding to PA. Institutions have options for responding to PA.
These options will be noted as new standards These options will be noted as new standards are approvedare approved
– Program should be Program should be operating for 6-12 months operating for 6-12 months before the PA document is submitted – this is before the PA document is submitted – this is not not a pass on PA.a pass on PA.
2424
Co
mm
issi
on
on
Tea
cher
Cre
den
tial
ing
Ensuring Educator Excellence
Reading Certificate and Specialist (2010)Reading Certificate and Specialist (2010)
Education Specialist (2008-09)Education Specialist (2008-09)
MS/SS Clear (2009)MS/SS Clear (2009)
Career Technical Education (2008)Career Technical Education (2008)
School Nurse (2008)School Nurse (2008)
Bilingual Authorization (2008)Bilingual Authorization (2008)
MayMay not be required to do Program Assessment not be required to do Program Assessment
New &Transitioning DocumentsNew &Transitioning DocumentsTransitioning StandardsTransitioning Standards
2525
Co
mm
issi
on
on
Tea
cher
Cre
den
tial
ing
Ensuring Educator Excellence
Relationship to Site VisitRelationship to Site VisitPrior to Site VisitPrior to Site Visit
Results of Program Assessment guide Results of Program Assessment guide selection of site team membersselection of site team members
The program summary introduces the site The program summary introduces the site visit team members to the programsvisit team members to the programs
Preliminary Report of Findings, questions Preliminary Report of Findings, questions and concerns are reviewed by the teamand concerns are reviewed by the team
2626
Co
mm
issi
on
on
Tea
cher
Cre
den
tial
ing
Ensuring Educator Excellence
Relationship to Site VisitRelationship to Site VisitAt the Site VisitAt the Site Visit
Results are confirmed, particularly through Results are confirmed, particularly through interviewsinterviews
Team focuses onTeam focuses on– Program DesignProgram Design– Course of Study (Curriculum and Field Course of Study (Curriculum and Field
Experience)Experience)– Candidate CompetenceCandidate Competence
Inconsistencies with Preliminary Report of Inconsistencies with Preliminary Report of Findings may need additional reviewFindings may need additional review
2727
Co
mm
issi
on
on
Tea
cher
Cre
den
tial
ing
Ensuring Educator Excellence
Relationship to Site VisitRelationship to Site Visit
Preliminary Report of Findings deems Preliminary Report of Findings deems standards to be standards to be PreliminarilyPreliminarily Aligned Aligned
PA readers may identify PA readers may identify specific evidence specific evidence to beto be reviewed at the site visit reviewed at the site visit
Only the Site Visit Team Only the Site Visit Team can deem the can deem the standards to be standards to be metmet..
2828
Co
mm
issi
on
on
Tea
cher
Cre
den
tial
ing
Ensuring Educator Excellence
Relationship to Site VisitRelationship to Site Visit
Work to get all program standards aligned.Work to get all program standards aligned. Finalize the Program Narrative by Finalize the Program Narrative by
incorporating all edits/modifications into incorporating all edits/modifications into the narrative.the narrative.
Keep the narrative up to date.Keep the narrative up to date.
2929
Co
mm
issi
on
on
Tea
cher
Cre
den
tial
ing
Ensuring Educator Excellence
Submission, Review/Feedback, Submission, Review/Feedback, & Resubmission & Resubmission - Submission- Submission
All programs in the All programs in the violetviolet cohort cohort should should have already submitted have already submitted the “Proposed the “Proposed Submission Dates for all Programs” formSubmission Dates for all Programs” form– Informs the Commission of the dates PA Informs the Commission of the dates PA
documents will be submitted (October, documents will be submitted (October, November or December 15, 2010)November or December 15, 2010)
IndigoIndigo cohort will receive a letter early in cohort will receive a letter early in 2011 2011 requesting this form to be filled out.requesting this form to be filled out.
3030
Co
mm
issi
on
on
Tea
cher
Cre
den
tial
ing
Ensuring Educator Excellence
Submission, Review/Feedback, & Submission, Review/Feedback, & Resubmission Resubmission - Submission- Submission
Options for submissionOptions for submission– Email as attachments to Email as attachments to
[email protected] must be must be less than less than 10MB 10MB – – NONO zipped files. zipped files.
– Post on a website & Post on a website & provide an email provide an email with with instructions for review and download. instructions for review and download. Once Once documents are downloaded from this website they documents are downloaded from this website they should retain all hyperlinks.should retain all hyperlinks.
– 1 CD/Flashdrive with all parts mailed in.1 CD/Flashdrive with all parts mailed in.
A confirmation will be sent when documents A confirmation will be sent when documents are receivedare received
3131
Co
mm
issi
on
on
Tea
cher
Cre
den
tial
ing
Ensuring Educator Excellence
Submission, Review/Feedback, Submission, Review/Feedback, & Resubmission & Resubmission - Submission- Submission
ChooseChoose submission date wisely submission date wisely Documents will be read in order received Documents will be read in order received
whenever possible based on reader’s whenever possible based on reader’s expertise at each session.expertise at each session.
Indigo cohort Indigo cohort STRONGLYSTRONGLY encouraged to encouraged to serve as a PA reader in 2010-2011.serve as a PA reader in 2010-2011.
3232
Co
mm
issi
on
on
Tea
cher
Cre
den
tial
ing
Ensuring Educator Excellence
Submission, Review/Feedback, Submission, Review/Feedback, & Resubmission & Resubmission – Review/Feedback– Review/Feedback
Two trained readers per documentTwo trained readers per document Calibration of readers prior to reading first Calibration of readers prior to reading first
documentdocument Each document is initially read during the Each document is initially read during the
meetingmeeting Readers reviewReaders review
– Is the HOW described?Is the HOW described?
– Does the HOW meet the standard?Does the HOW meet the standard?
– Is there adequate supporting documentation?Is there adequate supporting documentation?
3333HO # 4
Co
mm
issi
on
on
Tea
cher
Cre
den
tial
ing
Ensuring Educator Excellence
Preliminary Report of Findings (PRF) Preliminary Report of Findings (PRF) feedback will be eitherfeedback will be either– Preliminarily AlignedPreliminarily Aligned– More information NeededMore information Needed
Feedback for 1Feedback for 1stst round will be in round will be in blueblue. . – Subsequent rounds of feedback (if necessary) will show Subsequent rounds of feedback (if necessary) will show
all of the previous feedback and new comments and all of the previous feedback and new comments and standard status will be shown in a new color:standard status will be shown in a new color:
22ndnd round – round – Green Green 33rdrd round – round – PurplePurple 44thth round - round - OrangeOrange
Submission, Review/Feedback, Submission, Review/Feedback, && Resubmission Resubmission – Review/Feedback– Review/Feedback
3434HO # 5
Co
mm
issi
on
on
Tea
cher
Cre
den
tial
ing
Ensuring Educator Excellence
Resubmissions due within 30 days.Resubmissions due within 30 days. First reading opens dialogue with program First reading opens dialogue with program
that could last for 12-15 months.that could last for 12-15 months. Examples of feedback:Examples of feedback:
– Possible CommentsPossible Comments Specifics of HOW the standard is addressed are neededSpecifics of HOW the standard is addressed are needed
The narrative response needs to reflect the standardThe narrative response needs to reflect the standard
The documentation does not support the narrativeThe documentation does not support the narrative
Submission, Review/Feedback, Submission, Review/Feedback, && Resubmission Resubmission – Review/Feedback– Review/Feedback
3535
Co
mm
issi
on
on
Tea
cher
Cre
den
tial
ing
Ensuring Educator Excellence
Submission, Review/Feedback, Submission, Review/Feedback, && Resubmission Resubmission – Resubmission– Resubmission
Submit additional information Submit additional information within 1 within 1 monthmonth or less. or less.– Inform PA staff if additional time is neededInform PA staff if additional time is needed
– Respond quickly while the document is fresh in Respond quickly while the document is fresh in the reader’s mindsthe reader’s minds
Amend Amend original document original document for resubmissionfor resubmission Use a Use a new font color new font color to indicate requested to indicate requested
additional information addedadditional information added
3636
Co
mm
issi
on
on
Tea
cher
Cre
den
tial
ing
Ensuring Educator Excellence
Submission, Review/Feedback, Submission, Review/Feedback, && Resubmission Resubmission – Resubmission– Resubmission
Amend the table of contents and Amend the table of contents and be sure be sure hyperlinks are accuratehyperlinks are accurate
Submit resubmission via email or on cd/flash Submit resubmission via email or on cd/flash drivedrive
Develop a process to continually update Develop a process to continually update program documents. – See program documents. – See PSA 10-12
Continuous review and update of the Continuous review and update of the document will save programs from having to document will save programs from having to write it all in preparation for Year 4 of the write it all in preparation for Year 4 of the cycle.cycle.
3737
Co
mm
issi
on
on
Tea
cher
Cre
den
tial
ing
Ensuring Educator Excellence
Guidelines for SubmissionGuidelines for Submission Preferred submission for part I, II, and III is a Preferred submission for part I, II, and III is a
singlesingle PDF document with a detailed PDF document with a detailed table of table of contentscontents for all parts and for all parts and hyperlinkshyperlinks..
Multiple files are cumbersome for readers to Multiple files are cumbersome for readers to switch between, and this should be avoided if switch between, and this should be avoided if possible.possible.
NO Paper – 100% Electronic SubmissionNO Paper – 100% Electronic Submission Submit documents on time – inform Submit documents on time – inform
[email protected] if they will [email protected] if they will be latebe late
3838HO # 6 & HO # 7
Co
mm
issi
on
on
Tea
cher
Cre
den
tial
ing
Ensuring Educator Excellence
Guidelines for SubmissionGuidelines for Submission Submission package (3 Pieces)Submission package (3 Pieces)
– 1 document containing parts I, II, and III –PDF1 document containing parts I, II, and III –PDF
– 1 word document containing summary – no 1 word document containing summary – no more than 4 pagesmore than 4 pages
Save Word documents 97-2003 compatibleSave Word documents 97-2003 compatible
– Submission checklist – use a separate checklist Submission checklist – use a separate checklist for each submission (program area)for each submission (program area)
Each program area package should be Each program area package should be sent in a separate email /CD/Flash Drivesent in a separate email /CD/Flash Drive
3939HO # 8
Co
mm
issi
on
on
Tea
cher
Cre
den
tial
ing
Ensuring Educator Excellence
Technology TipsTechnology Tips Search the internet for tips on hyperlinks Search the internet for tips on hyperlinks
and table of contentsand table of contents Use page numbers Use page numbers If possible refrain from linking to a website If possible refrain from linking to a website
– internet is not always available to – internet is not always available to readersreaders
Make sure you are not linking to a local Make sure you are not linking to a local document (another reason for 1 single document (another reason for 1 single document)document)
4040
Co
mm
issi
on
on
Tea
cher
Cre
den
tial
ing
Ensuring Educator Excellence
Technology TipsTechnology Tips How do I create hyperlinks to locations within How do I create hyperlinks to locations within
the same document? the same document? http://support.microsoft.com/kb/291182http://support.microsoft.com/kb/291182
Microsoft Word tutorial – Table of Contents I – Microsoft Word tutorial – Table of Contents I – Basic Table of Contents Basic Table of Contents http://office.microsoft.com/en-us/word-help/overview-RZ001135702.aspx?section=1http://office.microsoft.com/en-us/word-help/overview-RZ001135702.aspx?section=1
Microsoft Word tutorial – Table of Contents II – Microsoft Word tutorial – Table of Contents II – Advanced Table of Contents Advanced Table of Contents http://office.microsoft.com/en-us/word-http://office.microsoft.com/en-us/word-
help/table-of-contents-ii-advanced-tocs-long-documents-and-other-tables-RZ001152580.aspxhelp/table-of-contents-ii-advanced-tocs-long-documents-and-other-tables-RZ001152580.aspx
Creating a Table of Contents and adding Creating a Table of Contents and adding Bookmarks in Word Bookmarks in Word http://www.stanford.edu/group/step/new-step-website/resources/techclub/TOCnBkmk.htmhttp://www.stanford.edu/group/step/new-step-website/resources/techclub/TOCnBkmk.htm
4141
Co
mm
issi
on
on
Tea
cher
Cre
den
tial
ing
Ensuring Educator Excellence
ResourcesResources Program Assessment webpageProgram Assessment webpage PSA 10-12 Maintaining a current program PSA 10-12 Maintaining a current program
document and responding to document document and responding to document feedbackfeedback
PSA 10-13 Update on Program PSA 10-13 Update on Program Assessment: Program SummaryAssessment: Program Summary
Tips for the preparation of program Tips for the preparation of program assessment documentsassessment documents
Contact: [email protected]: [email protected]
4242