HUNTER COLLEGE ADMINISTRATIVE ASSESSMENT TRAINING SESSION 2009-2010.

HUNTER COLLEGE ADMINISTRATIVE ASSESSMENT TRAINING SESSION 2009-2010

What is Administrative Assessment

•An organizational practice that evaluates administrative services to promote the continuous improvement of the college and to influence planning and budgeting decisions.

Administrative Assessment at Hunter College

Why Assess?1. Achieve Hunter College goals for

Recruitment, Retention, and Graduation of students.

2. Promote the continuous improvement of Hunter College as an institution of higher education.

3. Ensure the accountability of the college departments.

4. Aid in resource and budget allocations.

Administrative Assessment at Hunter College

Assessment at Hunter •Assessment at Hunter is already in

place. •Our goal is to formalize it.

Administrative Assessment at Hunter College

How assessment works

•Who is responsible for Assessment?▫Departments and Programs:

Complete actual assessment practices and reporting.

Directors document assessment on Department Assessment Report online. http://ww3.hunter.cuny.edu/coo/view.php?id=1

Administrative Assessment at Hunter College

How assessment works

• Who is responsible for Assessment?▫Assessment Subcommittees:

Help directors create department assessment plans. Review assessment plans and end reports that are

submitted online. Seven subcommittees in assessment (B.L.A.S.T.E.R.):

Barfit Libraries Advising Scholarship Technology Enterprise Resource

Administrative Assessment at Hunter College

How assessment works

Who is responsible for Assessment? Administrative Assessment Committee (AAC):

Steering committee for Administrative Assessment. Informs subcommittees on large goals of the college

for assessment. Reports to the President at the end of each

assessment cycle.

Administrative Assessment at Hunter College

Administrative Assessment

Committee

Assessment Subcommitte

e

Department/ Program

Assessment Subcommitte

e

AAC identifies broad assessment goals and informs subcommittees

Directed by the AAC, subcommittees work with directors to create a departmental assessment plans.

Departments/Programs complete assessment process and submit completed assessment forms for review and evaluation to subcommittees

Subcommittees summarize and report departmental assessments to AAC

President

College President and CUNY PMP inform AAC on yearly goals and objectives.

AAC gives annual report to College President which informs the next year's CUNY PMP goals and objectives

Assessment Workflow

Administrative Assessment at Hunter College

Documenting Assessment

•The Department Assessment Report:▫Subcommittees work with Directors to

create the Department Assessment Plan (Goals through Timeline).

▫Directors with their departments complete the assessment process (Outcomes through Follow-Up).

▫The Department Assessment Report is completed online at: http://ww3.hunter.cuny.edu/coo/view.php?id=

1

Administrative Assessment at Hunter College

Documenting Assessment HUNTER MISSION GOALS

GOALS Objectives Strategies to Meet Objectives

Assessment Method

Timeline Outcomes / Results

Feedback and Follow-Up

What is the main over arching Hunter goal that the assessment aims to achieve?

Recruitment

Retention

Graduation

PMP Objective

What does the department/ program do to meet the goals --- what practices are currently in place

What is done to meet the objective – how does the department meet the objective (already in place)

How will this practice (objective) be assessed – what tools are used to see if the objective is working

When/how often will assessment take place

What does the data say

Analysis of the data – expected outcomes, successes, weaknesses

Administrative Assessment at Hunter College

Documenting Assessment• Hunter Mission Goals

▫ Recruitment, Retention, Graduation• Goals

▫ PMP Objective• Objectives

▫ What are you doing to meet the PMP Objective?• Strategies to Meet Objectives

▫ How do you meet the department objective? • Assessment Method

▫ How will you assess the strategies in place?• Timeline

▫ When and how often does assessment take place?• Outcomes /Results

▫ What does the assessment show? What is the data?• Feedback and Follow-Up Recommendations

▫ Analysis of the data

Administrative Assessment at Hunter College

Documenting Assessment: Hunter Mission Goals

•Hunter Mission Goals are large, long-term, and general goals.

•These goals are Recruitment, Retention, and Graduation of students.

•Each assessment practice should be directed at one or more of these larger goals.

Administrative Assessment at Hunter College

Documenting Assessment:Goals•Goals refer directly to the PMP objectives. •These goals are more specific to Hunter

College and the CUNY system. •Each assessment practice must aim to reach

one of the PMP objectives as its goal.

Administrative Assessment at Hunter College

Documenting Assessment: Goals

Administrative Assessment at Hunter College

PMP OBJECTIVES = ASSESSMENT GOALS

1. Strengthen CUNY Flagship and college priority programs, and continuously update curricula and program mix

2. Attract and nurture a strong faculty that is recognized for excellent teaching, scholarship and creative activity

3. Ensure that all students receive a quality general education and effective instruction

4. Increase retention and graduation rates and ensure students make timely progress toward degree completion

5. Improve postgraduate outcomes 6. Improve quality of student academic support services7. Increase or maintain access and enrollment; facilitate

movement of eligible students to and among CUNY campuses

8. Increase revenues and decrease expenses 9. Improve administrative services

Documenting Assessment:Objectives•Objectives are short-term,

measurable, and specific goals. •Objectives can reflect the quality of a

service, the quantity of a service, or the learning outcome of a service.

•Example: ▫ Department/Program: AccessABILITY▫ Hunter Mission Goal: Retention▫ Goal: Increase retention and graduation rates and ensure

students make timely progress toward degree completion (4).

▫Objective: 50% of at-risk (2.0-2.5 GPA) “registered” students meet with academic advisor.

Administrative Assessment at Hunter College

Documenting Assessment: Strategies•Strategies are the practices that are

currently being done to achieve the objective.

•Example: ▫ Department/Program: AccessABILITY▫ Hunter Mission Goal: Retention▫ Goal: Increase retention and graduation rates and ensure

students make timely progress toward degree completion (4).▫ Objective: 50% of at-risk (2.0-2.5 GPA) “registered” students

meet with academic advisor.

▫Strategy: Collaborative program/referral with Advising Services; SIMS to ID students; multi-medium communications.

Administrative Assessment at Hunter College

Documenting Assessment: Method• Method of assessment is the process by which

assessment is completed. • Method of assessment outlines how data is

collected and analyzed.• Example:

▫ Department/Program: AccessABILITY▫ Hunter Mission Goal: Retention▫ Goal: Increase retention and graduation rates and ensure

students make timely progress toward degree completion (4).▫ Objective: 50% of at-risk (2.0-2.5 GPA) “registered” students

meet with academic advisor.▫ Strategy: Collaborative program/referral with Advising

Services; SIMS to ID students; multi-medium communications.

▫Method: Program attendance records; SIMS data (GPAs).

Administrative Assessment at Hunter College

Documenting Assessment: Timeline• The Timeline outlines when and for how

long assessment will take place. • Example:

▫ Goal: Increase retention and graduation rates and ensure students make timely progress toward degree completion (4).

▫ Objective: 50% of at-risk (2.0-2.5 GPA) “registered” students meet with academic advisor.

▫ Strategy: Collaborative program/referral with Advising Services; SIMS to ID students; multi-medium communications.

▫ Method: Program attendance records; SIMS data (GPAs).

▫Timeline: Assessment process begins November, 2009 Data Collection completed by March, 2010 Data analysis complete by May, 2010 Follow-up completed by June, 2010.

Administrative Assessment at Hunter College

Documenting Assessment: Outcomes• Outcomes are the data results. • These results should be summarized for each

assessment. • Example:

▫ Goal: Increase retention and graduation rates and ensure students make timely progress toward degree completion (4).

▫ Objective: 50% of at-risk (2.0-2.5 GPA) “registered” students meet with academic advisor.

▫ Strategy: Collaborative program/referral with Advising Services; SIMS to ID students; multi-medium communications.

▫ Method: Program attendance records; SIMS data (GPAs).▫ Timeline: Assessment process begins November, 2009, Data

Collection completed by March, 2010, Data analysis complete by May, 2010, Follow-up completed by June, 2010.

▫Outcomes: XX% of at-risk registered students met with advisors

Administrative Assessment at Hunter College

Documenting Assessment: Follow-Up• Follow-Up is the data analysis step in the assessment

process. • The Follow-Up stage answers the questions: What is the

data saying? What lessons does the data teach us? What improvements can be made? Did the assessment provide an answer for the objective? Did we reach the objective?

• Example: ▫ Strategy: Collaborative program/referral with Advising Services; SIMS to

ID students; multi-medium communications.▫ Method: Program attendance records; SIMS data (GPAs).▫ Timeline: Assessment process begins November, 2009, Data Collection

completed by March, 2010, Data analysis complete by May, 2010, Follow-up completed by June, 2010.

▫ Outcomes: XX% of at-risk registered students met with advisors

▫Follow-Up: Query non-participants re: reasons of non attendance; modify program/ communication outreach, as needed

Administrative Assessment at Hunter College

Examples of Department Assessment Plan

AREA GOAL OBJECTIVE STRATEGY METHOD TIMELINE OUTCOME FOLLOWUP

AccessABILITY Increase Retention

50% of at-risk (2.0 -2.5 GPA) ”registered” students meet with academic advisor

Collaborative program/referral with Advising Services; SIMS to ID students; multi- medium communications

Program attendance records; SIMS data (GPAs)

Fall 2009 - Spring 2010

XX% of at-risk registered students who met with advisors

Query non-participants re: reasons of non-attendance; modify program/ communication outreach, as needed

Administrative Assessment at Hunter College

Examples of Department Assessment Plan

AREA GOAL OBJECTIVE STRATEGY METHOD TIMELINE OUTCOME FOLLOWUPCareer Development Services

Increase Post Graduate Outcome

XX% increased use of NACELink Symplicity ) and Optimal Resume systems (i.e., # of on-campus recruitment programs

Multi- medium communications to promote systems

NACElink Symplicity and Optimal Resume systems data

Fall 2009- Summer 2010

XX% increase in usage

Coordinate with Alumni Relations and Institutional Advancement to track student job placements

Administrative Assessment at Hunter College

What to assess?

•Assessment Practices Already in Place?▫Continue your assessment. Document

it in the Department Assessment Report.

•New to Assessment? ▫Look at what you currently do. Look to

see if you are achieving your mission goals and set tasks.

Administrative Assessment at Hunter College

Qualities of Good Assessment• Choose projects that are able to be assessed:

▫ Manageable projects.▫ Reasonable requirement of human and time resources.▫ Easily attainable data.▫ Cost-effective.

• Choose projects that are most important to the department or program.

• Choose projects that reflect the college goals of Recruitment, Retention, and Graduation.

• Choose projects that can influence budget and planning decisions.

• Choose projects that can provide valuable answers.• Choose projects that can better define problems or change

initiative plans.

Administrative Assessment at Hunter College

Types of Assessment•What can you measure?

▫Quality: Effectiveness, efficiency or quality of a service. Example: How accessible advisors are to students.

▫Quantity: Number of activities, events, students, benchmarks, entries, processes. Example: The number of students who meet with

advisors. ▫Learning Outcomes: knowledge and

comprehension. Example: Student awareness of health precautions.

Administrative Assessment at Hunter College

Types of Assessment

•Methods of Assessment:▫Surveys ▫Data records▫Committees▫Interviews▫Manager feedback▫Focus groups

Administrative Assessment at Hunter College

Schedule of Assessment

•The schedule is created each year by the AAC. It will be distributed to all Assessment participants.

•The schedule will be made available on the Administrative Assessment Website.

•Assessment Cycles begin right before the fall semester.

•Department Assessment Reports are due in June after graduation.

Administrative Assessment at Hunter College

Assessment Resources• At Hunter

▫ Office of Institutional Resource.  http://www.hunter.cuny.edu/institutional-research/assessment-resources-1

▫ CUNY Office of Institutional Research Homepage. http://owl.cuny.edu:7778/portal/page/portal/oira/OIRA_HOME

▫ CUNY Student Experience Survey 2008. http://owl.cuny.edu:7778/portal/page/portal/oira/OIRA_HOME/SES_2008_Final_Report.pdf

▫ Hunter Internal Control Report. Internal Control Reports can be found at the Office of Budget and Planning.

▫ Library Task Force Report 2007. http://www.hunter.cuny.edu/middle-states/repository/files/standard-11/President-Library-Task-Force-2007.pdf

▫ IT Status Report 2008. http://www.hunter.cuny.edu/middle-states/repository/files/standard-2/IT%20Status%20Report%20-%20Nov%202008.pdf

▫ CUNY Faculty Experience Survey 2005. http://www.hunter.cuny.edu/middle-states/repository/files/standard-7/Hunter%20Faculty%20CUNY.pdf

Administrative Assessment at Hunter College

Assessment Resources• Literature on Assessment

▫ Astin, Alexander W. (1990) Assessment for Excellence: The Philosophy and Practice of Assessment and Evaluation in Higher Education, American Council on Education: Series on Education, Oryx Press. http://books.google.com/books?hl=en&lr=&id=Sp7zIMokH00C&oi=fnd&pg=PR9&dq=administrative+evaluation+of+higher+education&ots=4-GajfZcmS&sig=ypxk30n0dsIl0HSsgEXossciGV8#PPP1,M1

▫ Banta, Trudy W. (2007). An Accountability Program Primer for Administration. Recruitment & Retention in Higher Education, Vol. 21 Issue 10, p1-3, 3p; (AN 27339631)

▫ Banta, Trudy W., Lund, J.P. Black, K.E. & Oblander, F.W. (1996). Assessment in practice: Putting principles to work on college campuses. San Francisco: Jossey-Bass.

▫ Cox, Kelline S. and Downey, Ronald G. (2002) Resurgence of Administrative Evaluations and Unit Climate Surveys to Improve and Strengthen Institutional Leadership. Association for Institutional Research. Toronto, Canada, www.k-state.edu/pa/researchinfo/papers/adminevalpaper.doc

▫ Heck, Ronald H., Johnsrud, Linda K. and Rosser, Vicki J. (2000) Administrative Effectiveness in Higher Education: Improving Assessment Procedures. Research in Higher Education. Vol. 41, No. 6, 2000, http://www.springerlink.com/content/hmnr32v1390h71x1/fulltext.pdf

▫ Jennings Jr., Edward T. (1989). Public Administration Review, Vol. 49 Issue 5, p438, 9p, 1 bw; (AN 4589815) http://web.ebscohost.com/ehost/pdf?vid=17&hid=5&sid=91536058-d2d3-42d3-9963-e9bb6fc0c95e%40sessionmgr10

▫ Kotler, Philip and Murphy, Patrick E., Strategic Planning for Higher Education. The Journal of Higher Education, Vol. 52, No. 5 (Sep. - Oct., 1981), pp. 470-489. Ohio State University Press. http://www.jstor.org/stable/1981836?cookieSet=1

▫ Wergin, J. and Braskamp, L.A. (eds.) (1987). Evaluation of Campus Services and Programs. San Francisco, CA: Jossey-Bass.

Administrative Assessment at Hunter College

Assessment Resources• Good Practices Resources

▫Linda Suskie, Middle States Association of Colleges and Schools: Commission on Higher Education (MSA-CHE). 2006. http://planning.iupui.edu/page/download/?key=129728430&path=/consult/conferences/national/06/handouts/monday/suskie.pdf

▫Middle States Report and Requirements - http://www.hunter.cuny.edu/middle-states/institutional-assessment

Administrative Assessment at Hunter College

More information

•For more information on Administrative Assessment at Hunter College, please visit the website. ▫http://www.hunter.cuny.edu/adminassessme

nt

Administrative Assessment at Hunter College