Academic Program Review Chair’s Workshop John E. Sawyer, Ph.D. Associate Provost Institutional Research and Effectiveness.

Academic Program Review Chair’s Workshop

John E. Sawyer, Ph.D.Associate Provost

Institutional Research and Effectiveness

Campus Resources

2

Measuring Progress Towards Strategic Goals and Continuous Improvement via Collaboration and the

APR Process

College & Department

Strategic Goals

IR

BI

HECCTAL

OEA

The Center for Teaching &Assessment of Learning (CTAL)

Office of Educational Assessment

Which APR requirements can CTAL can help you with?• Information about student quality, diversity, and achievements.• Description of the undergraduate and graduate student learning

outcomes (including clear statements of expected student learning outcomes in the areas of knowledge, skills, and competencies), assessment plans, and utilization of assessment results.

• Evidence of curricular improvements based on student learning outcomes and changes in the discipline or field of study.

• A statement of the purposes, development and planning for undergraduate and graduate education.

• Description of the undergraduate and graduate curriculum.

CTAL Can Assist…• Curricular Mapping

– Enables a better understanding of how you can build on what your students already know

– Minimizes gaps and repetition in the school wide curriculum– Leads to increased mastery by encouraging subjects to be

revisited from different perspectives

• A course map can help administrators: – Assist with curriculum planning. – Identify courses that directly support program outcomes. – Inform decisions related to resource allocation. – Demonstrate the relevance of a course to the college/school or

institution.

IRE Can Assist…

http://www.udel.edu/IR/apr/index.html

Student Success & Outcomes

http://www.udel.edu/IR/UDEW/index.html

Student Success & Outcomes

http://www.udel.edu/IR/reports/cplans.html

Faculty Scholarly ProductivityAcademic Analytics Productivity Radar

Source: © 2013 Academic Analytics UD Internal Use Only

Academic Benchmarking

https://www.udel.edu/IR/reports/benchmarking/index.html

What is the Delaware Cost Study?• The National Study of Instructional Costs and Productivity (Delaware

Cost Study) is a national benchmarking project and data sharing consortium among four year colleges and universities, with approximately 200 institutions participating annually.

• Since 1996, nearly 600 institutions have participated, and over the past two decades, the Cost Study has matured to become the “tool of choice” for comparative analysis of faculty teaching loads, direct instructional costs, and separately budgeted scholarly activity, all within academic disciplines.

• Currently, the Cost Study is used major data and state agencies including:– Association of American Universities Data Exchange (AAUDE)– Southern Universities Group (SUG)– University of North Carolina (UNC) System– Pennsylvania State System of Higher Education (PaSSHE)– University of Missouri System– University of Nebraska System– Connecticut State University System (CSUS)– City University of New York System (CUNY)

Benchmarking - Institutional Reports

Benchmarking - Academic Program Reviews

Delaware Cost Study Sample Institutional Report

UD College + DisciplineUD College

CodeCIP Discipline

Degrees Awarded

UD Total FTE Faculty

UDUD as Pct of Peer

AvgPeer Avg UD

UD as Pct of Peer

Avg Peer Avg

Peer 25th Percentile

Peer 50th Percentile

Peer 75th Percentile

UD UD as Pct of Peer

Avg Peer Avg

Peer 25th Percentile

Peer 50th Percentile

Peer 75th Percentile

#RVHInst.

A&S Ethnic, Cultural Minority, Gender, and Group Studies 15 A&S 05.02Ethnic, Cultural BM 22.3 12.6 85% 14.9 $ 7,113 98% $ 7,247 $ 5,416 $ 7,771 $ 8,158 $ - 0% $ 2,782 $ 90 $ 786 $ 4,720 14

A&S Communication and Media Studies 15 A&S 09.01Communication BM 43.5 15.7 91% 17.2 $ 4,745 99% $ 4,797 $ 3,891 $ 5,085 $ 5,504 $ 1,996 17% $ 12,036 $ 1,996 $ 5,725 $ 16,413 23

A&S Linguistic, Comparative, and Related Language Studies and Se15 A&S 16.01Linguistic, BMD 72.3 15.1 110% 13.7 $ 4,394 82% $ 5,382 $ 4,272 $ 5,181 $ 7,133 $ 561 7% $ 7,602 $ 226 $ 1,034 $ 6,259 23

A&S Classics and Classical Languages, Literatures, and Linguisti 15 A&S 16.12Classics and BMD 18.9 14.8 86% 17.3 $ 13,318 211% $ 6,314 $ 3,541 $ 5,781 $ 8,574 $ 142,168 6539% $ 2,174 $ 128 $ 1,429 $ 2,043 9

A&S Rhetoric and Composition/Writing Studies 15 A&S 23.01Rhetoric and BMD 105.4 13 98% 13.2 $ 6,526 108% $ 6,017 $ 4,490 $ 5,703 $ 7,527 $ 47 2% $ 2,695 $ 627 $ 1,854 $ 4,068 27

A&S Biology, General 15 A&S 26.01Biology, General BMD 54.0 20.2 109% 18.6 $ 5,686 93% $ 6,107 $ 4,792 $ 5,992 $ 7,551 $ 78,301 49% $ 158,441 $ 89,247 $152,983 $181,447 21

A&S Mathematics 15 A&S 27.01Mathematics BMD 79.2 20.6 102% 20.1 $ 4,473 92% $ 4,872 $ 3,951 $ 4,639 $ 5,784 $ 13,161 33% $ 40,359 $ 16,838 $ 41,027 $ 60,606 28

A&S Philosophy 15 A&S 38.01Philosophy BMD 23.3 12.7 73% 17.4 $ 6,475 122% $ 5,309 $ 3,896 $ 5,244 $ 6,250 $ - 0% $ 1,588 $ - $ 337 $ 2,306 27

A&S Chemistry 15 A&S 40.05Chemistry BMD 59.3 18.5 99% 18.7 $ 6,664 93% $ 7,134 $ 5,948 $ 7,025 $ 8,305 $ 183,946 74% $ 249,016 $182,548 $252,387 $297,140 27

A&S Geological and Earth Sciences/Geosciences 15 A&S 40.06Geological and BMD 19.7 11.8 90% 13.1 $ 10,593 113% $ 9,333 $ 6,647 $ 8,245 $ 11,755 $ 67,170 40% $ 167,126 $ 93,968 $151,718 $243,607 22

A&S Physics 15 A&S 40.08 Physics BMD 46.5 12.7 93% 13.7 $ 8,724 102% $ 8,558 $ 6,991 $ 8,204 $ 10,594 $ 93,094 36% $ 255,703 $143,085 $246,230 $359,760 28 A&S Psychology, General 15 A&S 42.01

Psychology, BMD 49.6 18.6 88% 21.2 $ 5,052 101% $ 5,008 $ 3,947 $ 4,859 $ 5,770 $ 80,018 73% $ 109,702 $ 41,405 $ 76,091 $163,910 28

A&S Anthropology 15 A&S 45.02Anthropology BM 14.9 15.6 97% 16.1 $ 5,387 108% $ 4,969 $ 4,159 $ 5,062 $ 5,659 $ 122,056 377% $ 32,351 $ 5,451 $ 19,866 $ 63,444 21

A&S Geography and Cartography 15 A&S 45.07Geography and BMD 18.0 18.2 111% 16.4 $ 6,244 100% $ 6,216 $ 4,872 $ 6,092 $ 7,383 $ 102,742 116% $ 88,753 $ 40,565 $ 92,921 $117,482 18

A&S Political Science and Government 15 A&S 45.10Political Science BMD 13.8 18.9 106% 17.9 $ 5,113 91% $ 5,640 $ 4,022 $ 5,373 $ 7,027 $ - 0% $ 8,944 $ 2,709 $ 6,758 $ 13,971 25

A&S Sociology 15 A&S 45.11 Sociology BMD 18.5 25 124% 20.1 $ 4,815 106% $ 4,543 $ 3,422 $ 3,938 $ 5,731 $ 6,314 35% $ 18,113 $ 5,272 $ 15,066 $ 29,959 27 A&S History 15 A&S 54.01 History BMD 39.5 15.3 90% 17 $ 4,862 94% $ 5,167 $ 4,119 $ 4,966 $ 6,111 $ - 0% $ 3,481 $ 889 $ 2,851 $ 4,431 28

FTE STUDENTS TAUGHT PER FTE INSTRUCTIONAL FACULTY

INSTRUCTIONAL EXPENDITURES PER FTE STUDENT RESEARCH & PUBLIC SERVICE EXPENDITURES PER T/TT FACULTY

Benchmarking College and Unit Improvement

What parts of the APR can we address?

2. A statement of the purposes, development and planning for undergraduate education .• Statistical data on course enrollments, class size, and number

of majors and number of minors.• Information about student quality, diversity and achievements.• Description of the undergraduate student learning outcomes,

assessment plans, and utilization of assessment results.(CTAL) • Estimation of revenue generated by tuition.

http://provost.udel.edu/content/academic-program-review#SelfStudyGuidelines

What parts of the APR can we address? cont’d

2. A statement of the purposes, development and planning for graduate education.• Statistical data: size of graduate program(s) including: number

and diversity of students in masters and doctoral programs, and number of funded students, source of funding and comparison of funding to (aspirational) peer programs.

• Time-to-degree completion and degree completion statistics for the graduate program.

• Quality of graduate students as defined by numerical indicators.• Description of graduate student learning outcomes, assessment

plans and utilization of assessment results.(CTAL)

4. Staffing of the unit. • Breakdown of FTE faculty, professionals and salaried staff by

rank, function, workload, race, age, and gender.• Information concerning the use of non-faculty instructors (if any)

in the unit, either teaching assistants or supplemental contract holders.

• Demographic data to set the unit into a University-wide context.

Take Away:Resources on Campus are Available!

• Center for Teaching and Assessment of Learning supports programs as they pursue APR by helping faculty design their evaluations of program quality to ascertain how well students are obtaining the programmatic student learning outcomes.

• Institutional Research and Effectiveness (including IR, Business Intelligence (UDEW) supports departmental Academic Program Review by providing department-specific trend information related to student enrollment, student success and outcomes, personnel, instructional costs and productivity, and faculty scholarly productivity.

• The Delaware Cost Study is a useful tool for providing comparative analysis of faculty teaching loads, direct instructional costs, and separately budgeted scholarly activity, all within academic disciplines.