Program Outcomes Assessment Techniques: Overview and Examples Steve Steele, Consultant Faculty Online Technology Training Consortium (FOTTC) Applied Sociologist Anne Arundel Community College sfsteele @mail. aacc .cc. md .us 410-541-2369 “I have never let my schooling interfere with my education.” - Mark Twain
33
Embed
Program Outcomes Assessment Techniques: Overview and Examples Steve Steele, Consultant Faculty Online Technology Training Consortium (FOTTC) Applied Sociologist.
This document is posted to help you gain knowledge. Please leave a comment to let me know what you think about it! Share it to your friends and learn new things together.
Transcript
Program Outcomes Assessment Techniques: Overview and Examples
Steve Steele, Consultant Faculty Online Technology Training Consortium (FOTTC)Applied Sociologist Anne Arundel Community College
Common Conceptualizations of Evaluation/assessment
Is it viewed a “a reign of terror?”
Is it “stuck on like a barnacle”; an afterthought
Is it an ongoing process in itself?
An organized entity in itself
Part of a management information system
Where are We Going Today?
Evaluation? Assessment? Definitions
Reasons For Doing This
Placement of Evaluation/assessment
The Dynamic Fit Between Planning, Evaluation/assessment and Doing In the Improvement Process
Examples
Summary: Strengths and Weaknesses
Evaluation? Assessment? Definitions
The systematic assessment of the operation and/or outcomes of a program or policy, compared to explicit or implicit standards, in order to contribute to the improvement of the program or policy. (Weiss, 1998)
“The key sense of the term... refers to the process of determining the merit, worth, or value of something...” (Scriven, 1991, pp. 139-141)
“evaluation/assessment research... refers to research purpose rather than research method. Babbie,1989, 326)
Critical Components of Definitions
A systematic process
A judgment will likely be made
Standards for judgment, for success
Intervention
Orientation toward Improvement?
Reasons For Doing This Internal
Clients/Stakeholders
The President
The Dean
Your Chairman
Your students
You!
External Clients/Stakeholders
Societal
Middle States
Professional
Granting agencies
Reasons For Doing This
Have you considered the client’s “corporate culture” when constructing this project/design?
Are you sure that you have focused on the client’s needs for ALL relevant clients and stakeholders?
Placement of Evaluation/assessment
Think of evaluation/assessment before the program, not after.
Integrate evaluation/assessment into the grant proposal, plan or program.
Use evaluative data “for all it’s worth!”
Consider evaluation/assessment as constructive criticism, rather than “doing time!”
The Dynamic Fit Between Planning, Evaluation/assessment and Doing In
the Improvement ProcessIs it part of a larger process?
Plan
DoCheck
Act
HERE!!
Based on E. Deming’s work
Plan
DoCheck
Act
“Plan” and Define it.
What is it? Intervention DefinitionsIntervention DefinitionPlan
Strategic Plan
"...the process of determining what (something) intends tobe in the future and how it will get there..."1
"...the process by which guiding members of anorganization envision its future and develop the necessaryprocedures and operations to achieve that future..."2
Program "(An) effort that marshals staff and projects toward some...defined... goals"3
Project "...time-bounded efforts within a program"4
Process "...what happens between input and output..."5
Course, Training orWorkshop
"...an organized effort in which people or persons learnsomething..."
Something OtherPhenomenon (SOP)
Whatever it is, it doesn't fit one or more of the above!
"I Don't Know" This intervention is ill-defined or undefined.