SITE REVIEWER SITE REVIEWER TRAINING WORKSHOP TRAINING WORKSHOP October 26, 2012 October 26, 2012
Dec 24, 2015
SITE REVIEWER SITE REVIEWER TRAINING TRAINING WORKSHOPWORKSHOP
October 26, 2012October 26, 2012
Philosophy of the Philosophy of the COSMA Accreditation COSMA Accreditation ModelModelOutcomes based/Mission drivenOutcomes based/Mission drivenAccreditation principles based on Accreditation principles based on
best practices in SM educationbest practices in SM educationDevelopmental – annual reporting Developmental – annual reporting
focused on continuous improvementfocused on continuous improvementFlexible – accommodates various Flexible – accommodates various
institutional models and innovative institutional models and innovative approachesapproaches
Benefits of Benefits of AccreditationAccreditation Dedicated staffDedicated staff Free training, assistanceFree training, assistance Best practices - templates, rubricsBest practices - templates, rubrics External accountabilityExternal accountability Enhanced reputationEnhanced reputation External assurance of qualityExternal assurance of quality Effective mechanism for continuous Effective mechanism for continuous
improvementimprovement Mechanism for program advocacyMechanism for program advocacy
Scope of Accreditation Includes both undergrad and graduate programs Academic unit should be an identifiable entity and led by a doctorally- or professionally-qualified educator Includes off-campus locations All programs included even if through cooperative or interdisciplinary arrangements All modes of delivery should be included (online, distance learning, adult degree, accelerated) In Annual Report, programs notify COSMA if a new program is being added
Scope of Accreditation, con’t Definition of “Program” – track, minor,
concentration• Within sport management degree, include all tracks• “Tracks” outside sport management degree (e.g., physical education), include sport management track
Program must provide rationale for what is included and what is not included in accreditation process If a program “appears” to be accredited by
COSMA, it must be included in the accreditation process or the program must provide rationale for why it’s not included
Steps to AccreditationSteps to Accreditation1)1) Membership application & feeMembership application & fee
2)2) Attain Candidacy Status (CS)Attain Candidacy Status (CS)
3)3) Collect data and begin writing Self Collect data and begin writing Self StudyStudy
4)4) Establish timeline for site visitEstablish timeline for site visit
5)5) Complete Self Study (at least 90 days Complete Self Study (at least 90 days prior to site visit)prior to site visit)
6)6) Site visit (2 days)Site visit (2 days)
7)7) Decision by Board of Commissioners Decision by Board of Commissioners (November/May-June of each year)(November/May-June of each year)
Quiz #1
Experience with Other Accrediting
Bodies?
COSMA individual/institutional COSMA individual/institutional membershipmembership
Submit an electronic CVSubmit an electronic CVAttend a training workshopAttend a training workshopBe familiar with COSMA Be familiar with COSMA
principles, policies & proceduresprinciples, policies & proceduresTime commitment: 2 days, Time commitment: 2 days,
preparation and follow-up preparation and follow-up
Becoming a Site Becoming a Site ReviewerReviewer
Site Visit AssignmentsSite Visit AssignmentsSchedule visits 3-6 months in Schedule visits 3-6 months in
advanceadvanceCOSMA staff, BOC assigns two COSMA staff, BOC assigns two
person team as early as possibleperson team as early as possibleConditionsConditions
Avoid conflicts of interestAvoid conflicts of interest Balance and representationBalance and representation CostsCosts
Honoraria and Travel Honoraria and Travel ReimbursementReimbursement Institution responsible for paying all Institution responsible for paying all
costs:costs: Honoraria - $300/day for team Honoraria - $300/day for team
chair; $200/day for team memberchair; $200/day for team member TravelTravel HotelHotel MealsMeals Miscellaneous costs (e.g. travel to Miscellaneous costs (e.g. travel to
and from home airport)and from home airport)
Prior to visit: 1) Review self study at Prior to visit: 1) Review self study at least twice 2) Discuss preliminary least twice 2) Discuss preliminary impressions by phone 3) Request impressions by phone 3) Request additional materials, as needed 4) additional materials, as needed 4) Modify site visit agenda, as neededModify site visit agenda, as needed
On-site: 1) Meet night before 2) On-site: 1) Meet night before 2) Stick to agenda and remain on time Stick to agenda and remain on time 3) Validate self-study materials 4) 3) Validate self-study materials 4) Write detailed reportWrite detailed report
Post-visit: 1) Write summary reportPost-visit: 1) Write summary report
Site Team Site Team ResponsibilitiesResponsibilities
Designated by COSMA staff, BOC Designated by COSMA staff, BOC Served on at least two other site Served on at least two other site
teamsteams Or, is a past member of the COSMA Or, is a past member of the COSMA
BOCBOC Coordinates visit details with the Coordinates visit details with the
institutioninstitution Review and modify site visit agendaReview and modify site visit agenda Responsible for completing a thorough Responsible for completing a thorough
and objective site visit and objective site visit Submits the completed site team Submits the completed site team
reportreport
Team Chair Role & Team Chair Role & ResponsibilitiesResponsibilities
Campus Coordinator Campus Coordinator RoleRole Person responsible for accreditation Person responsible for accreditation
process (not necessarily the process (not necessarily the department chair)department chair)
Helps team make travel plans, Helps team make travel plans, including transport to and from their including transport to and from their hotel to your campushotel to your campus
Develops site visit scheduleDevelops site visit schedule Makes sure site visit stays on scheduleMakes sure site visit stays on schedule Organizes on campus meeting room Organizes on campus meeting room
for teamfor team
Review all self-study materials and Review all self-study materials and note questions, concernsnote questions, concerns
Communicate with the other team Communicate with the other team member about initial findings, member about initial findings, concernsconcerns
Make necessary travel arrangementsMake necessary travel arrangements Phone training with COSMA Executive Phone training with COSMA Executive
DirectorDirector Develop questions to ask on siteDevelop questions to ask on site
Site Visit Site Visit Preparation/Reviewing Preparation/Reviewing
the Self Studythe Self Study
Arrive the evening before the visitArrive the evening before the visitSite Team MeetingSite Team Meeting
Re-familiarize yourself with self-study Re-familiarize yourself with self-study materialsmaterials
Discuss the schedule for the visit – who Discuss the schedule for the visit – who leads which interviewsleads which interviews
Plan opening session and exit interview Plan opening session and exit interview with Department Chair, On-site with Department Chair, On-site Coordinator, etc.Coordinator, etc.
Discuss report writing processDiscuss report writing process Determine if any additional materials are Determine if any additional materials are
neededneeded
Pre-Visit MeetingPre-Visit Meeting
Sample Site Visit Sample Site Visit Schedule: Day 1Schedule: Day 1Schedule
8:00 am Meet with dept. head to discuss two day visit
9:00 am Meet with President and/or Chief Academic Officer
9:30 am Meet with Outcomes Assessment Coordinator to review institutional plan
10:30 am
Review Sport Management O/A plan with dept. head
Noon Lunch with faculty (no administrators present)
1:30 pmWork time for site team & dept. head to validate self- study and ask questions (3 - 4 hours)
6pm Dinner
Sample Site Visit Sample Site Visit Schedule: Day 2Schedule: Day 2Schedule
8:00 am Meet with students majoring in sport management
9:00 am Tour facilities (library, classrooms, computer labs, etc.)
10:30 am
Exit interview with dept. head (and others, if desired)
Noon Lunch meeting with Advisory Board (or other parties)
1:30 pm Site team works on draft report/time for unexpected issues
3:00 pm Site team departs from campus
Self Study Self Study OrganizationOrganizationVolume 1Volume 1 Title PageTitle Page Table of ContentsTable of Contents Background informationBackground information Documentation of Accreditation PrinciplesDocumentation of Accreditation Principles
Volume 2 - AppendicesVolume 2 - Appendices Catalog (online URL okay)Catalog (online URL okay) Abbreviated SyllabiAbbreviated Syllabi Faculty CVs (full- and part-time)Faculty CVs (full- and part-time) Outcomes Assessment Plan, Results, and ActionsOutcomes Assessment Plan, Results, and Actions Strategic PlanStrategic Plan Faculty Handbook (can be separate document)Faculty Handbook (can be separate document)
Eight Principles of Eight Principles of AccreditationAccreditation Outcomes AssessmentOutcomes Assessment Strategic PlanningStrategic Planning CurriculumCurriculum FacultyFaculty Scholarly & Professional ActivitiesScholarly & Professional Activities ResourcesResources Internal & External RelationshipsInternal & External Relationships Educational InnovationEducational Innovation
Assess Key Content Areas:Assess Key Content Areas: Program assessment Program assessment
Clear and measurable student learning outcomesClear and measurable student learning outcomes
Direct and indirect measures of student learningDirect and indirect measures of student learning
Basic Skills - undergraduate and graduateBasic Skills - undergraduate and graduate
Personal development of studentsPersonal development of students
Operational effectiveness (and measurements)Operational effectiveness (and measurements)
Integration into future budgeting and planningIntegration into future budgeting and planning
Review measurement instruments and Review measurement instruments and rubricsrubrics
Review reported resultsReview reported results Note changes and improvements – Action Note changes and improvements – Action
PlanPlan
Principle 1: Outcomes Principle 1: Outcomes AssessmentAssessment
Quiz #2Which of the following are direct measures of student learning?
1.Capstone course project
2.E-portfolio
3.Comprehensive exam
4.Internship supervisor evaluation
Direct Measures of Student Learning
Demonstrate direct evidence of student learning:
• Comprehensive exams • Standardized national exams • Pretest and posttest assessments • Required structured internship• Portfolios (electronic or traditional)• Capstone project assessment• Thesis/Dissertation• External certification program (e.g., NSSE)
Indirect Measures of Student LearningAsk students (or others) about their
learning:
• Graduate survey• Alumni survey• Employer/internship supervisor survey• Exit interview• Advisory Boards• Student focus groups• Anecdotal evidence
“Closing the Loop”Institutional Goals
Student Learning Outcomes
Benchmark Measurement Tool
Results Action Plan
Communicate effectively both orally and written.
Comprehension and application of professional written and oral communication business skills.
80% of the students meet proficiency standards in writing - measured using writing rubric
Written assignments
in BU210
and BU404
85.6% of the student in BU210 & BU404 met the standard
Continue to record scores for writing evaluation the these two courses.
Discuss the possibility of a standardized test in the core courses to meet this competency
Principle 2: Strategic Principle 2: Strategic PlanningPlanning1.1. Profile of sport management programProfile of sport management program
2.2. Description, assessment of resourcesDescription, assessment of resources
3.3. External analysis – beyond COSMA External analysis – beyond COSMA site visitsite visit
4.4. SWOT analysisSWOT analysis
5.5. Student learning objectives, Student learning objectives, strategies, actions plans, and O/A strategies, actions plans, and O/A processesprocesses
6.6. Operational objectives, strategies, Operational objectives, strategies, action plans, and O/A processesaction plans, and O/A processes
Principle 3: Principle 3: CurriculumCurriculum
3.1 Program Design3.1 Program Design
3.2 Common Professional Component3.2 Common Professional Component
3.3 General Education3.3 General Education
3.4 Breadth and Depth of Curriculum3.4 Breadth and Depth of Curriculum
3.5 Curriculum Review and Improvement3.5 Curriculum Review and Improvement
3.6 Master’s Degree Curriculum3.6 Master’s Degree Curriculum
3.7 Doctoral Curriculum3.7 Doctoral Curriculum
3.2: Common 3.2: Common Professional Professional Component (CPC)Component (CPC)
A) Social, psychological A) Social, psychological and international and international foundations of sportfoundations of sport
B) ManagementB) Management1. Sport mgmt principles1. Sport mgmt principles
2. Sport leadership2. Sport leadership
3. Operations mgmt/event 3. Operations mgmt/event & & venue mgmt venue mgmt
4. Sport governance4. Sport governance
C) EthicsC) Ethics
D) Sport marketing & D) Sport marketing & communicationscommunications
E) Finance/Accounting/E) Finance/Accounting/EconomicsEconomics
1. Sport finance1. Sport finance
2. Accounting2. Accounting
3. Economics of sport3. Economics of sport
F) Legal aspects of sportF) Legal aspects of sport
G) Integrative G) Integrative experience:experience:
1. Strategic mgmt/policy1. Strategic mgmt/policy
2. Internship2. Internship
3. Capstone experience3. Capstone experience
CPC TableCPC Table
Quiz #3
Common Professional Component
Principle 4: FacultyPrinciple 4: Faculty
4.1 Faculty Qualifications4.1 Faculty Qualifications
4.2 Faculty Load4.2 Faculty Load
4.3 Program Coverage4.3 Program Coverage
4.4 Faculty Evaluation4.4 Faculty Evaluation
4.5 Faculty Development4.5 Faculty Development
4.6 Faculty Policies4.6 Faculty Policies
4.1: Faculty 4.1: Faculty QualificationsQualificationsDoctorally qualified:Doctorally qualified:
1.1. Holds Ph.D. in SM or related fieldHolds Ph.D. in SM or related field
2.2. Holds J.D. and teaches in legal environment of SMHolds J.D. and teaches in legal environment of SM
3.3. Holds out-of-field doctorate, with sufficient combination of Holds out-of-field doctorate, with sufficient combination of graduate work, professional experience, scholarly graduate work, professional experience, scholarly achievements, and successful teaching experienceachievements, and successful teaching experience
Professionally qualified:Professionally qualified:
1.1. Be A.B.D.Be A.B.D.
2.2. Hold Master’s degree in SM field and five years teaching Hold Master’s degree in SM field and five years teaching experienceexperience
3.3. Hold Master’s degree in SM-related field with post-graduate Hold Master’s degree in SM-related field with post-graduate training in areas of teaching responsibilitytraining in areas of teaching responsibility
Minimally qualified:Minimally qualified:
1. Master’s degree in field appropriate to teaching 1. Master’s degree in field appropriate to teaching responsibilitiesresponsibilities
4.1: Faculty 4.1: Faculty Qualifications, con’tQualifications, con’t
1)1) Identify the credentials of all full- and part-Identify the credentials of all full- and part-time faculty memberstime faculty members
2)2) Review current vitae for all SM faculty (in Review current vitae for all SM faculty (in Appendix)Appendix)
3)3) Review and validate all tables related to Review and validate all tables related to Faculty Coverage and Load Faculty Coverage and Load
Quiz#4
What are the minimum number of faculty needed for a
program?
Principle 5: Scholarly and Professional Activities
Scholarship of:
Teaching
Discovery
Integration
Application
Professional activities include: consulting, seminars, workshops, professional organizations
Principle 6: ResourcesPrinciple 6: Resources
6.1 Financial Resources6.1 Financial Resources
6.2 Facilities6.2 Facilities
6.3 Learning Resources6.3 Learning Resources
6.4 Educational Technology and Support6.4 Educational Technology and Support
6.5 Off-Campus Locations6.5 Off-Campus Locations
Principle 7: Internal and External Relationships
7.1 Internal Relationships7.1 Internal Relationships7.2 Admissions Processes7.2 Admissions Processes7.3 External Oversight7.3 External Oversight7.4 Business/Industry Linkages7.4 Business/Industry Linkages7.5 External Cooperative Relationships7.5 External Cooperative Relationships7.6 International Cooperation7.6 International Cooperation7.7 Diversity in Sport7.7 Diversity in Sport7.8 External Accountability7.8 External Accountability
Quiz #5
Are internships required by COSMA? a) Yes
b) No
c) Only for big institutions
d) Only if you have enough faculty
Principle 8: Educational Innovation
Evaluate the institution's support Evaluate the institution's support for innovationfor innovation
Evaluate the process in the Evaluate the process in the program for encouraging program for encouraging educational innovationeducational innovation
Review recent examples, Review recent examples, including improvementsincluding improvements
Course syllabiCourse syllabi Institutional catalogInstitutional catalog Copy of last regional accreditation self-Copy of last regional accreditation self-
study report and findingsstudy report and findings Faculty member vitaeFaculty member vitae Faculty handbookFaculty handbook O/A PlanO/A Plan Summary of realized outcomesSummary of realized outcomes
On-site MaterialsOn-site Materials
Who? Up to the department to determine – Who? Up to the department to determine – usually the campus coordinator, chair, and usually the campus coordinator, chair, and facultyfaculty
Review program strengthsReview program strengths Review areas that partially meet the principlesReview areas that partially meet the principles Review areas that do not meet the principlesReview areas that do not meet the principles Answer questions, but do not comment on Answer questions, but do not comment on
accreditation statusaccreditation status Make suggestions for how the program can Make suggestions for how the program can
remedy deficient areasremedy deficient areas Encourage the campus coordinator to talk to Encourage the campus coordinator to talk to
COSMACOSMA
Exit InterviewExit Interview
History of institution, program, degrees, special History of institution, program, degrees, special considerations, thank yous.considerations, thank yous.
Use checklist to help you write and the report Use checklist to help you write and the report templatetemplate
Summary statement: what is your overall Summary statement: what is your overall impression of the program in this area/principle?impression of the program in this area/principle?
Strengths: What does the program do well?Strengths: What does the program do well? Areas of partial compliance: In what ways does Areas of partial compliance: In what ways does
the program not meet the principle?the program not meet the principle? Link principles together, as they are relatedLink principles together, as they are related
Site Visit Report: Site Visit Report: Putting Your Findings in Putting Your Findings in
WritingWriting
Do’s and Don’t’sDo’s and Don’t’sDo Don’t
Validate the self study Express opinions
Provide examples to illustrate your point
“Champion” an issue
Call Heather when in doubt
“Guess” at answers
Use tact and diplomacy in exit interview
Indicate whether the institution will be accredited or not
Team chair submits final report within TWO Team chair submits final report within TWO WEEKSWEEKS
Submit expenses not directly covered by Submit expenses not directly covered by program to COSMAprogram to COSMA
Keep all notes and materials until BOC meets Keep all notes and materials until BOC meets and makes an accreditation decision – may be and makes an accreditation decision – may be questionsquestions
Maintain confidentiality: Do not share your Maintain confidentiality: Do not share your findings, materials, or opinions about the findings, materials, or opinions about the program or the site visit process with anyoneprogram or the site visit process with anyone
Submit evaluation of the site visit process and of Submit evaluation of the site visit process and of your team memberyour team member
Your Role After the Site Your Role After the Site VisitVisit
Evaluation of the Site Evaluation of the Site Team’s VisitTeam’s Visit Fill out and submit evaluation of your Fill out and submit evaluation of your
experienceexperience Site team members evaluate each otherSite team members evaluate each other All comments kept confidentialAll comments kept confidential Questions include:Questions include:
Professional behavior of the teamProfessional behavior of the team Anything overlooked by the teamAnything overlooked by the team Strengths and/or limitations of any team Strengths and/or limitations of any team
membermember
What COSMA Does What COSMA Does After the Site VisitAfter the Site Visit
Institution receives letter summarizing Institution receives letter summarizing visitvisit May include request for additional May include request for additional
informationinformation All materials sent to one member of All materials sent to one member of
Board of Commissioners – self-study, site Board of Commissioners – self-study, site visit team report, any additional visit team report, any additional informationinformation
Commissioner reviews materials and Commissioner reviews materials and prepares detailed report to present at prepares detailed report to present at next Board meetingnext Board meeting
Accreditation DecisionAccreditation Decision
Accredited with NotesAccredited with Notes Accredited with ObservationsAccredited with Observations Accreditation DeferredAccreditation Deferred Accreditation DeniedAccreditation Denied
ConclusionsConclusionsIn today’s training you learned about:In today’s training you learned about:
• The COSMA accreditation processThe COSMA accreditation process
• How site visit teams are chosen and how site visits How site visit teams are chosen and how site visits are coordinatedare coordinated
• The expectations, responsibilities, and roles of the The expectations, responsibilities, and roles of the two members of the site visit teamtwo members of the site visit team
• How to interpret each Principle of accreditationHow to interpret each Principle of accreditation
• How to conduct the exit interviewHow to conduct the exit interview
• What to write in your final reportWhat to write in your final report
• The final steps in the accreditation processThe final steps in the accreditation process
• The role of the Executive Director and the Board of The role of the Executive Director and the Board of CommissionersCommissioners
Upcoming Upcoming Training/EventsTraining/Events• Accreditation Process Training Accreditation Process Training
@AAHPERD National Convention – @AAHPERD National Convention – date TBDdate TBD
• COSMA @Sport Management Day COSMA @Sport Management Day (4/24)(4/24)
• Site Reviewer Training by Webinar – Site Reviewer Training by Webinar – date TBDdate TBD
• Fourth Annual Member Meeting – Fourth Annual Member Meeting – @NASSM, Austin, TX (5/29 – @NASSM, Austin, TX (5/29 – lunchtime)lunchtime)
Questions & Comments