2014 ARPD Unit Review Process ARPD Process Rev. 9Dec14.

2014 ARPD Unit Review 2014 ARPD Unit Review ProcessProcess

ARPD ProcessARPD Process

Rev. 9Dec14Rev. 9Dec14

Covered in today’s session…Covered in today’s session…

Quick review of Program and Unit Review websiteQuick review of Program and Unit Review website

Navigating the Annual Reports of Program Data (ARPD) websiteNavigating the Annual Reports of Program Data (ARPD) website

What are we doing to improve our current program/unit review process?What are we doing to improve our current program/unit review process?

What ARPD information is required (Academic Support, Student Services)What ARPD information is required (Academic Support, Student Services)

Process ownersProcess owners

Joni and/or Joyce will be covering: Any templates used, use of PATH tool, process used Joni and/or Joyce will be covering: Any templates used, use of PATH tool, process used on campus, comprehensive reviews, deadlines, timelines, etcon campus, comprehensive reviews, deadlines, timelines, etc

22

PurposePurpose

The purpose of the presentation today is to review the process we use to input The purpose of the presentation today is to review the process we use to input information into the UHCC systems online Annual Reports of Program Data (ARPD)information into the UHCC systems online Annual Reports of Program Data (ARPD)

tool.tool.

Training specific to units should be provided by VC’s and Directors to their Training specific to units should be provided by VC’s and Directors to their representative groups as outlined here in step #7 of the comprehensive process we representative groups as outlined here in step #7 of the comprehensive process we

followed last year.followed last year.

Comprehensive Program-Unit Review ProcessComprehensive Program-Unit Review Process

We have been asked to produce an annual review for each and every one of our We have been asked to produce an annual review for each and every one of our instructional programs and non-instructional units. They are required of each community instructional programs and non-instructional units. They are required of each community college in the system and will be taken to the U of H Board of Regents for their purview.college in the system and will be taken to the U of H Board of Regents for their purview.

33

Reason for Unit ReviewReason for Unit Review

The review of your unit should be an on-going, year-round, reflective process. The review of your unit should be an on-going, year-round, reflective process. 

Unit review processes assure educational quality and help programs to evaluate and improve their services.Unit review processes assure educational quality and help programs to evaluate and improve their services.

Unit review is an opportunity for self-study, self-renewal, and an opportunity to identify the need for Unit review is an opportunity for self-study, self-renewal, and an opportunity to identify the need for improvement. improvement.

Your unit review may be one of the few opportunities you have to showcase the accomplishments in your Your unit review may be one of the few opportunities you have to showcase the accomplishments in your area. Take this opportunity to shine.area. Take this opportunity to shine.

A robust unit review process is one mechanism available to the college to improve student success.A robust unit review process is one mechanism available to the college to improve student success.

44

How do we improve our program review process?How do we improve our program review process?

Upon conclusion of every program/unit review cycle extra care is taken to ensure that we are improving our Upon conclusion of every program/unit review cycle extra care is taken to ensure that we are improving our program/unit review process on campus. This is accomplished by sending out questionnaires (one for instruction program/unit review process on campus. This is accomplished by sending out questionnaires (one for instruction and one for units), and then meeting with those groups across campus and collecting their feedback.and one for units), and then meeting with those groups across campus and collecting their feedback.

The feedback is reviewed and an action plan is put into place, which is used in the planning phase for our next The feedback is reviewed and an action plan is put into place, which is used in the planning phase for our next review cycle. Your suggestions, and the actions taken for improving this process, are then published to the review cycle. Your suggestions, and the actions taken for improving this process, are then published to the Program Review website and have been linked here for your convenience.Program Review website and have been linked here for your convenience.

2013 Program - Unit Review Process Improvement Summary2013 Program - Unit Review Process Improvement Summary

Starting this year and going forward…Starting this year and going forward…

““The CERC in conjunction with the Admin Team will ensure that the entire program-unit review process is The CERC in conjunction with the Admin Team will ensure that the entire program-unit review process is evaluated every year, once the review process has ended. The evaluation will be prior to Summer break, and evaluated every year, once the review process has ended. The evaluation will be prior to Summer break, and feedback from the campus will drive the plan for the following year’s review. IR will develop the survey and will feedback from the campus will drive the plan for the following year’s review. IR will develop the survey and will ensure that a summary of this work is published every year.” ensure that a summary of this work is published every year.”

55

About the ARPD Web Submission Tool

If you have attended the training session in-person today you can skip the next few slides slides that deal with Navigating the ARPD site. I’ve included the slides here for those that may not have been able to join us today for the live demonstration.for the live demonstration.

The Annual Reports of Program Data Web Submission Tool (or ARPD for short), is a The Annual Reports of Program Data Web Submission Tool (or ARPD for short), is a repository for Annual program and unit reviews for: Instruction, the Academic Support repository for Annual program and unit reviews for: Instruction, the Academic Support Unit, and Student Support Services. Much of the data that you will need to complete Unit, and Student Support Services. Much of the data that you will need to complete your review has been provided by the Office of the Vice President for Community your review has been provided by the Office of the Vice President for Community Colleges. Colleges.

The ARPD is a home-grown tool, developed in-house, and was developed specifically to meet the needs of the community college system.

66

ARPD Web Submission Tool Best PracticesARPD Web Submission Tool Best Practices

Your units data table is available on-line within the tool Your units data table is available on-line within the tool usuallyusually by August 15 by August 15thth every every year. You should have everything you need to begin writing your review within the year. You should have everything you need to begin writing your review within the web submission tool. web submission tool.

Plan to save your work often—especially when switching between screens, and plan Plan to save your work often—especially when switching between screens, and plan to do most of your formatting within the tool if you are copying and pasting in from to do most of your formatting within the tool if you are copying and pasting in from Word. Also plan to spell check and save your review in Word before starting. Word. Also plan to spell check and save your review in Word before starting.

One of the nicest features about the ARPD is that you can go back and look at One of the nicest features about the ARPD is that you can go back and look at reviews from previous years. You can also enhance your own review by leveraging reviews from previous years. You can also enhance your own review by leveraging off similar reviews at other institutions.off similar reviews at other institutions.

The following slides will take you through the process for completing the ARPD for The following slides will take you through the process for completing the ARPD for both Academic Support and Student Services Unit Reviews. The next set of slides is both Academic Support and Student Services Unit Reviews. The next set of slides is specifically for Academic Support. Student Services specific slides follow.specifically for Academic Support. Student Services specific slides follow.

77

Navigating the ARPD Web Submission Tool Navigating the ARPD Web Submission Tool Academic SupportAcademic Support

88

Navigating the ARPD Web Submission Tool Navigating the ARPD Web Submission Tool Academic SupportAcademic Support

While you are on the Analysis screen, click on the “Edit” button, then scroll to the While you are on the Analysis screen, click on the “Edit” button, then scroll to the bottom of the page, under the data sheet. There are 3 sections for you to edit here: bottom of the page, under the data sheet. There are 3 sections for you to edit here: Analysis of your Program, Action Plan, and Resource Implications. Simply click on Analysis of your Program, Action Plan, and Resource Implications. Simply click on the “Edit” link and you will be taken to a screen very similar to MS Word, where you the “Edit” link and you will be taken to a screen very similar to MS Word, where you can begin typing in your analysis. (Note the Save button in the left hand corner!)can begin typing in your analysis. (Note the Save button in the left hand corner!)

In the Action Plan section you will need to include the actions you plan for your unit In the Action Plan section you will need to include the actions you plan for your unit going forward, based on your analysis.going forward, based on your analysis.

If you are requesting additional people, services, or equipment for your program, you If you are requesting additional people, services, or equipment for your program, you will need to make the justification in the “Resource Implications” section. will need to make the justification in the “Resource Implications” section.

Now click on the Now click on the “Description tab” “Description tab” and input the year and web address of your last and input the year and web address of your last comprehensive review. You should be able to copy and paste the link right off the comprehensive review. You should be able to copy and paste the link right off the program-unit review website for the year of your last review. Finish this tab off by program-unit review website for the year of your last review. Finish this tab off by typing in a brief description of your program and mission.typing in a brief description of your program and mission.

Now, click on the Now, click on the “P-SLOs tab” “P-SLOs tab” and go to the next slide…and go to the next slide…

99

What to enter on the “P-SLO” tab in ARPD Web Submission Tool What to enter on the “P-SLO” tab in ARPD Web Submission Tool Academic SupportAcademic Support

Indicate which PLOs were assessed during the reporting year’s assessment(s).Indicate which PLOs were assessed during the reporting year’s assessment(s).

Expected Level of AchievementExpected Level of Achievement

Enter the benchmark for outcome(s) assessed. What represented “excellent,” “good,” “fair,” or Enter the benchmark for outcome(s) assessed. What represented “excellent,” “good,” “fair,” or “poor” performance using a defined rubric and what percentages were set as goals for student “poor” performance using a defined rubric and what percentages were set as goals for student success (for example: “85% of students will achieve good or excellent in the assessed activity.”)success (for example: “85% of students will achieve good or excellent in the assessed activity.”)

Courses Assessed (if applicable)Courses Assessed (if applicable)

List the courses assessed during the reporting period.List the courses assessed during the reporting period.

Assessment Strategy/InstrumentAssessment Strategy/Instrument

Describe what, why, where, when, and from whom assessment artifacts were collected.Describe what, why, where, when, and from whom assessment artifacts were collected.

Results of Program AssessmentResults of Program Assessment

The % of those served who met the outcome(s) and at what level they met the outcome(s).The % of those served who met the outcome(s) and at what level they met the outcome(s).

Other CommentsOther Comments

Include any information that will clarify the assessment process report.Include any information that will clarify the assessment process report.

Next StepsNext Steps

Describe what the program will do to improve the results.  "Next Steps" can include revision to Describe what the program will do to improve the results.  "Next Steps" can include revision to syllabi, curriculum, teaching methods, student support, and other options.syllabi, curriculum, teaching methods, student support, and other options.

1010

““Academic Support Metrics” tab in ARPD Academic Support Metrics” tab in ARPD Academic SupportAcademic Support

Click on the Click on the “Academic Support “Academic Support Metrics” tab then the “Edit” button. tab then the “Edit” button.

For each of the 4 sub units that comprise the Academic Support Unit there will be 2 For each of the 4 sub units that comprise the Academic Support Unit there will be 2 data sections; the Student and Faculty Information Section, and the Sub unit data sections; the Student and Faculty Information Section, and the Sub unit indicators (like Technology Resources Indicators).indicators (like Technology Resources Indicators).

The Student and Faculty Information section at the top of the page will give you The Student and Faculty Information section at the top of the page will give you annual student headcount, and faculty, staff and student fte. The data has been annual student headcount, and faculty, staff and student fte. The data has been provided for you.provided for you.

In the lower section of the form you will find the sub unit Indicators.In the lower section of the form you will find the sub unit Indicators.

To add the data for your sub unit, simply click on the “Edit Section” button on the right To add the data for your sub unit, simply click on the “Edit Section” button on the right hand side of the form and begin to enter the required data. Be sure to click the hand side of the form and begin to enter the required data. Be sure to click the “Save” button at the bottom of the page before leaving the screen.“Save” button at the bottom of the page before leaving the screen.

If you have any questions about the data that you are being asked to provide, please If you have any questions about the data that you are being asked to provide, please consult the glossary. If you still have questions after reviewing the glossary, contact consult the glossary. If you still have questions after reviewing the glossary, contact the VCAA.the VCAA.

Don’t forget to set your health calls prior to closing out.Don’t forget to set your health calls prior to closing out.1111

““Help” tab in ARPD Help” tab in ARPD Academic SupportAcademic Support

The “Help” screen is a very useful resource for some of the documentation needed to The “Help” screen is a very useful resource for some of the documentation needed to support your unit within the review process. It contains all of the glossaries and support your unit within the review process. It contains all of the glossaries and health call scoring rubrics for each year we have used the online tool.health call scoring rubrics for each year we have used the online tool.

1212

Navigating the ARPD Web Submission Tool Navigating the ARPD Web Submission Tool Student ServicesStudent ServicesUHCC Annual Report of Program Data Web Submission Tool

Begin by clicking on the link above. To enter information on your review, click on the button in the lower part of the screen called, “2014 Student Services Submission”. You will be asked to log in by typing in your UH username and password, in order to get to the web submission site. The default will take you to the “Status” tab, where you will be able to view whoever was the last user to modify the information in your review.

Clicking on the “Users” tab will take you to a screen that shows all of the people that have permission to update your program. For each program there is a list of people with specific roles. For Student Services there is only one role, “Support Staff”. The VCSS determines who can update your program. If there is someone you’d like to add to the list, contact the VCSS with your request.

You can enter the information about your program in any order you wish, but moving from left to right across the tabs at the top of the screen follows the same logical path we used when we were filling out the templates in the past. Start by clicking on the “Analysis” tab.

On the Analysis screen you can either preview what has already been inputted by clicking on the “Preview” button, or you can go to the edit screen and begin entering or updating information.

1313

Navigating the ARPD Web Submission Tool Navigating the ARPD Web Submission Tool Student ServicesStudent Services

While you are on the Analysis screen, click on “Edit” button then scroll to the bottom While you are on the Analysis screen, click on “Edit” button then scroll to the bottom of the page, under the data sheet. There are 3 sections for you to edit here: Analysis of the page, under the data sheet. There are 3 sections for you to edit here: Analysis of your Program, Action Plan, and Resource Implications. Simply click on the “Edit” of your Program, Action Plan, and Resource Implications. Simply click on the “Edit” link and you will be taken to a screen very similar to MS Word, where you can begin link and you will be taken to a screen very similar to MS Word, where you can begin typing in your analysis. (Note the Save button in the left hand corner!)typing in your analysis. (Note the Save button in the left hand corner!)

In the Action Plan section you will need to include the actions you plan for your unit In the Action Plan section you will need to include the actions you plan for your unit going forward, based on your analysis.going forward, based on your analysis.

If you are requesting additional people, services, or equipment for your program, you If you are requesting additional people, services, or equipment for your program, you will need to make the justification in the “Resource Implications” section. will need to make the justification in the “Resource Implications” section.

Now click on the Now click on the “Description tab” “Description tab” and input the year and web address of your last and input the year and web address of your last comprehensive review. You should be able to copy and paste the link right off the comprehensive review. You should be able to copy and paste the link right off the program-unit review website for the year of your last review. Finish this tab off by program-unit review website for the year of your last review. Finish this tab off by typing in a brief description of your program and mission.typing in a brief description of your program and mission.

Now, click on the Now, click on the “P-SLOs tab” “P-SLOs tab” and go to the next slide…and go to the next slide…

1414

What to enter on the “P-SLO” tab in ARPD Web Submission Tool What to enter on the “P-SLO” tab in ARPD Web Submission Tool Student ServicesStudent Services

1515

Indicate which PLOs were assessed during the reporting year’s assessment(s).Indicate which PLOs were assessed during the reporting year’s assessment(s).

Expected Level of AchievementExpected Level of Achievement

Enter the benchmark for outcome(s) assessed. What represented “excellent,” “good,” “fair,” or Enter the benchmark for outcome(s) assessed. What represented “excellent,” “good,” “fair,” or “poor” performance using a defined rubric and what percentages were set as goals for student “poor” performance using a defined rubric and what percentages were set as goals for student success (for example: “85% of students will achieve good or excellent in the assessed activity.”)success (for example: “85% of students will achieve good or excellent in the assessed activity.”)

Courses Assessed (if applicable)Courses Assessed (if applicable)

List the courses assessed during the reporting period.List the courses assessed during the reporting period.

Assessment Strategy/InstrumentAssessment Strategy/Instrument

Describe what, why, where, when, and from whom assessment artifacts were collected.Describe what, why, where, when, and from whom assessment artifacts were collected.

Results of Program AssessmentResults of Program Assessment

The % of those served who met the outcome(s) and at what level they met the outcome(s).The % of those served who met the outcome(s) and at what level they met the outcome(s).

Other CommentsOther Comments

Include any information that will clarify the assessment process report.Include any information that will clarify the assessment process report.

Next StepsNext Steps

Describe what the program will do to improve the results.  "Next Steps" can include revision to Describe what the program will do to improve the results.  "Next Steps" can include revision to syllabi, curriculum, teaching methods, student support, and other options.syllabi, curriculum, teaching methods, student support, and other options.

“Cost per Student” tab in ARPD Student Services

Click on the Click on the “Cost per Student” “Cost per Student” tab, then the “Edit” button.tab, then the “Edit” button.

1616

There are 3 different values that need to be added on the Cost per Student screen in There are 3 different values that need to be added on the Cost per Student screen in ARPD. Basically, all of the fund amounts that will be entered are used in the ARPD. Basically, all of the fund amounts that will be entered are used in the calculation for the Cost per Student for your unit. The costs that need to be entered calculation for the Cost per Student for your unit. The costs that need to be entered are:are:

General Funds General Funds = actual personnel costs + b budget expenditures

Federal Funds = dollars from federal grantsFederal Funds = dollars from federal grants

Other Funds = any other funding sourcesOther Funds = any other funding sources

Once the values are loaded and saved in the tool, the values for “Overall Program Once the values are loaded and saved in the tool, the values for “Overall Program Budget Allocation” and “Cost per Student” will auto-calculate into your datasheet.Budget Allocation” and “Cost per Student” will auto-calculate into your datasheet.

“CCSSE” tab in ARPD Student Services

Click on the Click on the “CCSSE” “CCSSE” tab.tab.

1717

You will see that the results of our CCSSE reports going back to 2010. (2010, 2012, You will see that the results of our CCSSE reports going back to 2010. (2010, 2012, 2014) You will want to be sure to include an analysis of the CCSSE data for your 2014) You will want to be sure to include an analysis of the CCSSE data for your program (Analysis tab).program (Analysis tab).

The “Help” screen is a very useful resource for some of the documentation needed to support your unit within the review process. It contains all of the glossaries and health call scoring rubrics for each year we have used the online tool.

“Help” tab Student Services

Does my unit have to complete an Annual Review?

All units have to do an annual review, however some sub units may be combined into one single review. Those units/sub All units have to do an annual review, however some sub units may be combined into one single review. Those units/sub units that have been approved to be combined into a singular annual review are listed here:units that have been approved to be combined into a singular annual review are listed here:

Administrative Affairs Administrative Affairs may turn in one annual review, which will include the contributions from the Business Office, Budget & may turn in one annual review, which will include the contributions from the Business Office, Budget & Fiscal Management, Planning Operations & Maintenance, and Human Resources. The review for Administrative Affairs is Fiscal Management, Planning Operations & Maintenance, and Human Resources. The review for Administrative Affairs is being coordinated by AVP Unebasami. being coordinated by AVP Unebasami.

The The Academic Support Unit Academic Support Unit will complete one annual review will complete one annual review onlineonline, which will include the contributions from: Technology , which will include the contributions from: Technology Resources, Library, Tutoring Services, and Testing Services.Resources, Library, Tutoring Services, and Testing Services.

The The Office of Continuing Education and Training Office of Continuing Education and Training may turn in one annual review, which will include the contributions from may turn in one annual review, which will include the contributions from Apprenticeship, IEP, and Workforce/Community Development/Skills Development.Apprenticeship, IEP, and Workforce/Community Development/Skills Development.

The The Office of Student Services Office of Student Services will complete one annual review will complete one annual review onlineonline, which will include the contributions from Admissions & , which will include the contributions from Admissions & Registration, Counseling, Financial Aid, Student Life, Records & Data Management, and the Information Center.Registration, Counseling, Financial Aid, Student Life, Records & Data Management, and the Information Center.

University of Hawaii Center at West Hawaii University of Hawaii Center at West Hawaii will turn in one singular annual review.will turn in one singular annual review.

1818

Completing the Academic Support and Student Support Services Unit Review Completing the Academic Support and Student Support Services Unit Review

1919

ANNUAL REVIEWSANNUAL REVIEWS

All Units are required to submit an annual review. Please follow this simple 2-step process:All Units are required to submit an annual review. Please follow this simple 2-step process:

Step 1:Step 1: Complete your review using the annual unit review template or PATH tool, and by Complete your review using the annual unit review template or PATH tool, and by following the established Annual Review and Budget Process.following the established Annual Review and Budget Process.

Step 2: Step 2: TheThe VCAA and VCSS will input their information directly into the ARPD online tool. VCAA and VCSS will input their information directly into the ARPD online tool.

Note: The comprehensive review process, annual review and budget process, and their Note: The comprehensive review process, annual review and budget process, and their

associated templates, are brought to you by the VCAA and Dean of CTE Programs. The associated templates, are brought to you by the VCAA and Dean of CTE Programs. The template and instructions should be part of their presentation today.template and instructions should be part of their presentation today.

Process OwnersProcess Owners

The graphic below depicts who is responsible for each part of the program review process—from The graphic below depicts who is responsible for each part of the program review process—from Assessment through CERC. For more information on the processes please use the contact list below.Assessment through CERC. For more information on the processes please use the contact list below.

Contact ListContact List

Assessment: Assessment: VacantVacant 934-xxxx934-xxxxARPD: ARPD: Shawn FloodShawn Flood 934-2648934-2648Annual/Comp Process:Annual/Comp Process: Joyce HamasakiJoyce Hamasaki 934-2522934-2522CERC:CERC: Joni OnishiJoni Onishi 934-2514934-2514

2020

Questions?Questions?

The intention of this presentation was to provide a single source for all of the The intention of this presentation was to provide a single source for all of the documentation related to the Annual Reports for Program Data —specifically for our documentation related to the Annual Reports for Program Data —specifically for our non-instructional units. non-instructional units.

As always, your feedback regarding this process is essential in making improvements As always, your feedback regarding this process is essential in making improvements year over year. Please take a moment to provide feedback at the end of this process.year over year. Please take a moment to provide feedback at the end of this process.

Those wishing to print this presentation without color may set their printer settings to Those wishing to print this presentation without color may set their printer settings to print in “grayscale,” and set to print in portrait orientation, if desired.print in “grayscale,” and set to print in portrait orientation, if desired.

If you need more information on this process please feel free to contact me:If you need more information on this process please feel free to contact me:

HawCC Institutional Analyst HawCC Institutional Analyst Shawn FloodShawn Flood 934-2648934-2648

Mahalo!Mahalo!

2121