KPIs Guide

MEDICINE COLLEGE

KPIs Guide

DEVELOPMENT & QUALITY UNIT

2

Table of Contents

Table of Contents 2

Speech of Dean of the college of medicine 3

Speech of Vice dean for Development and quality 4

College vision, Mission and Goals 5

Introduction 6

Table -1 Benchmark types 8

Diagram – 1 MECHANISM OF Performance indicators measurement 9

Table – 2 List of the KPIs utilized for the assessement of the strategic objectives,and

college mission, acheivement 10

Diagram –2 Distribution of KPIs in relation to the relevant Strategic objectives 11

KPIs Utilize to follow the quality assurance including NCAAA program KPIs 12

Table - 3.List of the KPIs Utilize to follow the quality assurance including NCAAA

program KPIs 13

Table - 4 Consistency of program key performance indicators and Najran university key

performance indicators 17

Table - 5 Consistency between program KPIs & vision 2030 18

Table – 6 Consistency of program KPIs with, NCAAA KPIs, and Afaaq KPIs 20

Table – 7 Program KPIs according to its type 21

Important links 22

3

Speech of Dean of the college of medicine

The rapid evolving of the medical education institutions all around

the globe, result in shifting target of these institutions from the concept of

quantity to concept of quality of their input in serving local, regional and

international community; by provide competent doctors, trustable

distinguished scientific researches ,and efficient community services to

support community health care and wellbeing.

In college of medicine We adopts quantitative and qualitative measurable

performance indicators in order to evaluate how far we achieve our

strategic objectives, inorder to determine to which extent we fulfill our

mission, so as to Identify deficiencies, and to develop operational plans for

continuous improvement. Moreover we choose benchmarks to compare our

performance with other national colleges, what help to assess the college

wellbeing and quality of the performance in relation to other national

colleges

Prof. DR. Mohamed Zayed Al Ayed

4

Speech of Vice dean for Development and quality

The Vice deanship of college of medicine for Development and quality,

through the unit of Development and quality seeks to spread the culture of

quality and Development, and to ensure that the standards of the National

Center for Academic Accreditation and Assessment (NCAAA) are met; to

ensure the quality of performance at the level of the medicine and surgery

program as an effort to contribute to achieving the vision, mission, and

strategic objectives of the college, and to achieve the leadership that the

college of medicine aspires to; in an integrated and solid manner.

The Development and quality unit also focuses on the process of continuous

Evaluation of all operations and activities within the college through which

it is possible to determine the level of its quality. This Evaluation includes

all aspects of administrative, academic and research activities and other

activities, that the college performs annually, which enables continuous

monitoring of the performance.

Evidence and information to support this Evaluation is needed, among these

evidences are performance indicators, in addition to the necessity for a

benchmark comparison with similar institutions and programs that have

good practices that can be used, or information and measurements that can

be compared with, to evaluate or performance.

In this manual, the focus will be on explaining the types of performance

indicators and how to define and calculate them, as well as the types of

benchmark comparisons.

Dr.Abd-Allah Mofarih Asiri

5

College vision, Mission and Goals

College vision

Excellence in medical education and contribution to scientific research to promote health services and

participate in community service.

College Mission

Preparation of qualified medical personnel capable of providing distinguished medical services,

contributing to scientific research and establishing multiple partnerships to serve the community and

raise the level of health awareness.

College Goals

Continuous Development of curricula and the means of medical education.

Preparation of morally and professionally medical cadres, well qualified, and capable of

continuous self-learning.

Development of the scientific research and cooperation with local, regional, and global

institutions in medical research environment.

Contributing to the health education and medical services provided to the community

Establishing an academic environment attract talented faculty members.

6

Introduction

Introduction

Definitions

Key Performance Indicators -KPIs:

It is the performance indicator that identifies evaluative criteria for scientific

assessment of an educational objective or student learning outcome

performance. A KPI must be measurable or written in a way that is designed

for assessment. When benchmarking and analysis are used with it, together,

they provide evidence for assessment to guide decision-making and

judgments.

Benchmark:

It is the performance level of achievement for a given KPI or performance

indicator. There are many kinds of benchmarks that align with KPIs;

therefore it is necessary to qualify benchmarks in order to understand their

relationship to a given KPI. Benchmarks may be internal or external.

Target Benchmark:

It is the anticipated performance level or desired outcome (goal or aim) for a

KPI.

Finding Benchmark:

7

Also known as actual benchmark; It is the actual outcome determined when the KPI

is measured or calculated. It represents the actual reality of the present situation.

Internal Benchmarks:

They are benchmarks based on information from inside the program or institution.

Internal benchmarks include target or finding benchmark data results from

previous years.

External Benchmarks

They are benchmarks from similar programs or institutions that are outside the

program or institution. For example, external benchmarks for "student to teacher

ration" could be Six students to 1 teacher from a different program within the

institution or another program outside the institution, or for institutions, it refers to

other institutions (national or international).

KPI Analysis:

It is a process in which a comparison and contrast of the benchmarks to determine

strengths and recommendations for improvement. This is sometimes called

"benchmarking." For example, KPI analysis could compare and contrast "student

to teacher ratio" target and actual benchmarks from both internal and external

data banks to determine strengths and recommendations for improvement.

New Target Benchmark:

It is the establishment of a new or desired target.

8

The program of medicine and surgery utilizes quantitative or qualitative

measurable performance indicators in order to evaluate the extent to which

strategic objectives have been achieved, and that indicate how far the program

achieved its mission, to Identify deficiencies, and to develop operational plans for

continuous improvement.

The program measures the key performance indicators with benchmarking

depending on appropriate tools, such as (Surveys, Statistical data, etc.) according to

the nature and objective of each indicator, as well as determining the following

levels for each indicator:

• Actual performance

• Targeted performance level

• Internal reference (Internal benchmark)

• External reference (External benchmark)

• New target performance level

The college selects internal and external benchmarking, to assess the program

wellbeing and performance in relation to

Table -1 Benchmark types

Internal

benchmark

External benchmark

KPI of the same program for

the previous year

KPIs of the Program of

medicine, Qassim

University

KPIs of the Program of

medicine at King Khalid

University.

9

Diagram – 1 MECHANISM OF Performance indicators

measurement

Planning and follow-up

The responsible

committee of the index

OPERATION

Committee & Index

Performance

Measurement

INPUT

Committee & Index

Performance

Measurement

Committee

Formation a committee

to study the results of

the measurement to

identify strengths and

weaknesses.

1. Receive responses from

target groups.

2. Perform the necessary

statistical analyses

using the Statistical

Software Package

(SPSS).).

3. Discuss results, make

comparisons and

report.

Annual reports

for monitoring

approved

performance

indicators.

1. Follow-up on

the implementation

of improvement

plans.

OUTPUT

Committee & Index

Performance

Measurement

1. Paper & Electronic forms

2. The approved timeline

for submitting forms

electronically.

3. Links to the surveys on

the college's website.

4. Advertising procedures

and communication with

target groups to access

links

Planning and follow-up

College Agency for

Development and Quality

01

Table – 2 List of the KPIs utilized for the assessment of the strategic

objectives, and college mission, achievement

College Mission

Statement

Content of

the

Mission

Consistent Objectives Key Performance Indicators

Preparation of

qualified medical

personnel capable of

providing

distinguished

medical services,

contributing to

scientific research

and establishing

multiple partnerships

to serve the

community and raise

the level of health

awareness.

Teaching

and

learning

Continuous Development of

curricula and the means of

medical education.

Percentage of courses adopted new medical

education means

Percentage of teaching staff participated

in training programs regarding teaching

and learning methods.

Preparation of morally and

professionally medical cadres,

well qualified and capable of

continuous self-learning.

Students’s performance in the

professional and/or national

examinations

Graduates' employability and enrolment

in postgraduate programs within one year

of graduation

Establishing an academic

environment attract talented

faculty members.

Number of honored teaching staff by the

college administration

The proportion of teaching staff leaving the

program

Scientific

researches

Development of scientific

research and cooperation with

local, regional, and global

institutions in the medical

research environment.

Percentage of publications of faculty

members

Rate of published research per faculty

member

Citations rate in refereed journals per

faculty member

Community

services

Contributing to the health

education and medical

services provided to the

community

Rate of community services activities

provided to the community per teaching staff

The proportion of the departments provided

at least five community services activities

The number of the medical services provided

to the community.

00

Diagram – 2 Distribution of KPIs in relation to the relevant Strategic

objectives

02

KPIs Utilize to follow the quality assurance including NCAAA

program KPIs

03

KPI code KPI operative KPI description Time of

measurement

Responsibility

KPI-P.01 Percentage of achieved

indicators of the program

operational plan

objectives.

Percentage of performance

indicators of the operational plan

objectives of the program that

achieved the targeted annual level

to the total number of indicators

targeted for these objectives in the

same year

Last four

weeks of the

academic

years

Mission and

Goals

Committee

KPI-

MED.01

The degree of awareness

of the beneficiaries with

the mission and

objectives

The mean of knowledge of faculty

members and undergraduate and

graduate students with the program

mission and objectives. Using a

five-point scale in an annual survey

Last four

weeks of the

academic

years

Mission and

Goals

Committee

KPI-P.02 Students' Evaluation of

quality of learning

experience in the program

The mean of the rating of final year

students for the quality of learning

experience in the program on a

five-point scale in an annual survey

Last four

weeks of the

academic

years

Teaching and

Learning

Committee.

KPI-

MED.02

Percentage of courses

evaluated by the students

during the year

Percentage of courses taught and

then evaluated by the students in

the concerned year to the total

number of delivered courses in the

same year.

In the last

week of the

academic year

Teaching and

Learning

Committee.

KPI-P.03 Students' Evaluation of

the quality of the courses

The mean of students' rating for the

quality of courses on a five-point

scale in an annual survey

In the last

week of the

academic year

Teaching and

Learning

Committee.

KPI-P.04 Completion rate The proportion of undergraduate

students who completed the

program in minimum Time in each

cohort

Beginning of

the second

semester of

the academic

year

Teaching and

Learning

Committee.

KPI-P.05 First-year students'

retention rate

Percentage of first-year

undergraduate students who

continue at the program the next

year to the total number of first-

year students in the same year

In the 1st four

weeks of the

next academic

year-

Teaching and

Learning

Committee.

KPI-P.06 Students' performance in

the professional and/or

national examinations

Percentage of students or graduates

who were successful in the

professional and / or national

According to

the result

disclosed by

Teaching and

Learning

Committee.

Table-3.List of the KPIs Utilize to follow the quality assurance including NCAAA

program KPIs

04

examinations, or their score

average and median (if any)

SMLE

KPI-P.07 Graduates' employability

and enrolment in

postgraduate programs

Percentage of graduates from the

program who within a year of

graduation were:

a. employed

b. enrolled in postgraduate

programs

during the first year of their

graduation to the total number of

graduates in the same year

First 4weeks

of the next

year

Teaching and

Learning

Committee.

KPI-P.08 The average number of

students in the class

The average number of students

per class (in each teaching

session/activity: lecture, small

group, tutorial, laboratory, or

clinical session)

First 4 weeks

of the

academic year

Teaching and

Learning

Committee.

KPI-P.09 Employers' Evaluation of

the program graduate's

proficiency

The mean of the rating of

employers for the proficiency of

the program graduates on a five-

point scale in an annual survey

Last four

weeks of the

academic year

Teaching and

Learning

Committee.

KPI-P.10 Students' satisfaction with

the offered services

The mean of students' satisfaction

with the various services offered

by the program (restaurants, sports

transportation, facilities, academic

advising, ...) on a five-point scale

in an annual survey

Last four

weeks of the

academic year

Students'

Committee.

KPI-

MED.03

Evaluation of students for

academic and

professional guidance

The mean of students' satisfaction

with the appropriate academic and

vocational guidance for the all

teaching period on a five-point

scale in an annual survey for final

year students

Last four

weeks of the

academic year

Students'

Committee.

KPI-P.11 The ratio of students to

teaching staff

The ratio of the total number of

students to the total number of full-

time and full-time equivalent

teaching staff in the program

First four

weeks of the

academic year

Teaching Staff

Committee

KPI-P.12 Percentage of teaching

staff distribution

Percentage of teaching staff

distribution based on:

a. Gender

b. Branches

c. Academic Ranking

First four

weeks of the

academic year

Teaching Staff

Committee

KPI-P.13 The proportion of

teaching staff leaving the

The proportion of teaching staff

leaving the program annually for

In the 1st four

weeks of the

Teaching Staff

Committee

05

program reasons other than age retirement

to the total number of teaching

staff.

next academic

year

KPI-P.14 Percentage of

publications of faculty

members

Percentage of full-time faculty

members who published at least

one research during the year to

total faculty members in the

program

Last four

weeks of the

academic year

Teaching Staff

Committee

KPI-P.15 Rate of published

research per faculty

member

The average number of refereed

and/or published research per each

faculty member during the year

(total number of refereed and/or

published research to the total

number of full-time or equivalent

faculty members during the year)

Last four

weeks of the

academic year

Teaching Staff

Committee

KPI-P.16

Citations rate in refereed

journals per faculty

member

The average number of citations in

refereed journals from published

research per faculty member in the

program (total number of citations

in refereed journals from published

research for full-time or equivalent

faculty members to

the total research published)

Last four

weeks of the

academic year

Teaching Staff

Committee

KPI-

MED.04

Number of researches or

reports submitted in

academic conferences

during the previous year

for all full-time faculty

members

The average number of researches

or reports submitted in academic

conferences during the previous

year per faculty member in the

program

Last four

weeks of the

academic year

Teaching Staff

Committee

KPI-

MED.05

Percentage of staff

members and full-time

co-workers involved in

community service

activities

Percentage of staff members and

full-time co-workers involved in

community service activities to

total faculty members in the

program

Last four

weeks of the

academic year

Teaching Staff

Committee

KPI-

MED.06

Percentage of faculty

members involved in

professional development

activities during the

previous year

Percentage of staff members

involved in professional

development activities during the

previous year to total faculty

members in the program

Last four

weeks of the

academic year

Teaching Staff

Committee

KPI-P-17 The satisfaction of

beneficiaries with the

learning resource

(Students, staff members)

The mean of beneficiaries'

(students') satisfaction with the

adequacy and diversity of learning

resources (references, journals,

Last four

weeks of the

academic year

Learning

Resources,

Facilities, and

Equipment

06

databases; etc.) on a five-point

scale in an annual survey.

Committee

KPI-

MED.07

The satisfaction of

beneficiaries with the

facilities and equipment.

(Students, Staff member)

The mean of beneficiaries' (Staff

members') satisfaction with the

adequacy and diversity of learning

resources. (References, journals,

databases… etc.) On a five-point

scale in an annual survey.

Last four

weeks of the

academic year

Learning

Resources,

Facilities, and

Equipment

Committee

07

Table - 4 Consistency of program key performance indicators and

Najran university key performance indicators

No KPI code KPI program of medicine and

surgery

KPI

code

KPI of Najran university

1 KPI-MED.1 The degree of awareness of the beneficiaries

with the mission and objectives (average

range of knowledge of faculty members and

undergraduate and graduate students in the

thesis using a five-year questionnaire)

NU1.4 Satisfaction of the beneficiaries of

the university's mission and

objectives

2 KPI-P-02 Students' Evaluation of quality of learning

experience in the program

NU1.8 Final year student satisfaction rate

for academic program (calendar)

3 KPI-P-06 Students' performance in the professional

and/or national examinations

NU8.2 Ranking of graduates in

measurement tests at the level of

the Kingdom (health colleges –

teachers.

4 KPI-P-09 Employers' Evaluation of the program

graduates' proficiency

NU8.1 Community and labor market

satisfaction ratio for graduate

performance skills

5 KPI-P-10 Students' satisfaction with the offered services NU6.6

Student satisfaction rate for

services and facilities provided by

the Deanship of Admissions and

Registration

6 KPI-MED.3 Evaluation of students for academic and

professional guidance

NU6.1

Student satisfaction rate for

counselling, social and

psychological services

7 KPI-P-12 Percentage of teaching staff distribution NU3.4 Percentage of Professor,

Associate Professor, Associate

Professor on both women's and

men's

8 KPI-MED.7 the satisfaction of beneficiaries with facilities

and equipment

NU4.1 Faculty satisfaction ratio for

facilities and equipment

9 KPI-MED.8 the satisfaction of beneficiaries with the health

services provided by the university hospital

NU6.4 Students’satisfaction rate for

health services

08

Table – 5 Consistency between program KPIs & vision 2030

KPI Code KPIs Vision 2030

objectives

KPI-P.02 Students' Evaluation of quality of learning

experience in the program

Strategic objective

(1&4&5)

KPI-P.04 Completion rate

KPI-P.05 First-year students retention rate

KPI-P.08 The average number of students in the class

KPI-P.10 Students' satisfaction with the offered services

KPI-MED.03 Evaluation of students for academic and

professional guidance

KPI-P.11 The ratio of students to teaching staff

KPI-P.01 Percentage of achieved indicators of the

program operational plan objectives.

KPI-MED.01 The degree of awareness of the beneficiaries

with the mission and objectives

KPI-MED.02 Percentage of courses students evaluated

during the year Strategic objective

(2) KPI-P.03 Students' Evaluation of the quality of the

courses

KPI-P.17 The satisfaction of beneficiaries with the

learning resource

KPI-MED.07 The satisfaction of beneficiaries with facilities

and equipment.

KPI-P.14 Percentage of publications of faculty members Strategic objective

(2&3) KPI-P.15 Rate of published research per faculty member

KPI-P.16 Citations rate in refereed journals per faculty

member

KPI-MED.04 The number of papers (researches) or reports

presented at academic conferences for all

faculty members

KPI-P.06 Students' performance in the professional

and/or national examinations Strategic objective

09

KPI-P.07 Graduates' employability and enrolment in

postgraduate programs within (4&5)

KPI-P.9 Employers' Evaluation of the program

graduate's proficiency

KPI-P.12 Percentage of teaching staff distribution Strategic objective

(4) KPI-P.13 The proportion of teaching staff leaving the

program

KPI-MED.06 Proportion (percentage) of faculty members

engaged in professional development activities

KPI-MED.05 Proportion (percentage) of faculty members

participating in community service activities Strategic objective

(1&5) KPI-MED.08 the satisfaction of beneficiaries with the health

services provided by the university hospital

21

Table – 6 Consistency of program KPIs with, NCAAA KPIs, and Afaaq

KPIs

No KPI code KPI program of medicine and surgery NCAAA

KPIs

Afaaq

KPIs

1 KPI-P-01 Percentage of achieved indicators of the program operational

plan objectives.

KPI-P-01

2 KPI-P-02 Students' Evaluation of quality of learning experience in the

program

KPI-P-02 A8.2

3 KPI-P-03 Students' Evaluation of the quality of the courses KPI-P-03 A8.2

4 KPI-P-04 Completion rate KPI-P-04 A3.1

5 KPI-P-05 First-year students retention rate KPI-P-05

6 KPI-P-06 Students' performance in the professional and/or national

examinations

KPI-P-06

7 KPI-P-07 Graduates' employability and enrolment in postgraduate

programs within

KPI-P-07 A2.3

8 KPI-P-08 The average number of students in the class KPI-P-08

9 KPI-P-09 Employers' Evaluation of the program graduate's proficiency KPI-P-09 A7.1

10 KPI-P-10 Students' satisfaction with the offered services KPI-P-10 A7.2

11 KPI-P-11 The ratio of students to teaching staff KPI-P-11 A4.2

12 KPI-P-12 Percentage of teaching staff distribution KPI-P-12 A5.1

13 KPI-P-13 The proportion of teaching staff leaving the program KPI-P-13 A5.3

14 KPI-P-14 Percentage of publications of faculty members KPI-P-14 A10.1

15 KPI-P-15 Rate of published research per faculty member KPI-P-15 A12.2

16 KPI-P-16 Citations rate in refereed journals per faculty member KPI-P-16 A12.4

17 KPI-MED.6 Proportion (percentage) of faculty members engaged in

professional development activities

A8.1

18 KPI-P-17 The satisfaction of beneficiaries with the learning resource KPI-P-17

20

Table – 7 Program KPIs according to its type

NO KPI code KPI program of medicine and surgery Type

1 KPI-P-01 Percentage of achieved indicators of the program operational plan

objectives.

Productivity

2 KPI-MED.01 The degree of awareness of the beneficiaries with the mission and

objectives

Quality

3 KPI-P-02 Students' Evaluation of quality of learning experience in the program Quality

4 KPI-MED.02 Percentage of courses evaluated by the students during the year Quality

5 KPI-P-03 Students' Evaluation of the quality of the courses Quality

6 KPI-P-04 Completion rate Productivity

7 KPI-P-05 First-year students retention rate Efficiency

8 KPI-P-06 Students or graduates who were successful in the professional and / or

national examinations

Efficiency

9 KPI-P-07 Graduates' employability and enrolment in postgraduate programs Productivity

10 KPI-P-08 The average number of students in the class Efficiency

11 KPI-P-09 Employers' Evaluation of the program graduate's proficiency Efficiency

12 KPI-P-10 Students' satisfaction with the offered services Quality

13 KPI-MED.03 Evaluation of students for academic and professional guidance Quality

14 KPI-P-11 The ratio of students to teaching staff Efficiency

15 KPI-P-12 Percentage of teaching staff distribution Efficiency

16 KPI-P-13 The proportion of teaching staff leaving the program Efficiency

17 KPI-P-14 Percentage of publications of faculty members Productivity

18 KPI-P-15 Rate of published research per faculty member Productivity

19 KPI-P-16 Citations rate in refereed journals per faculty member Effectiveness

20 KPI-MED.04 The number of papers (researches) or reports presented at academic

conferences for all faculty members

Productivity

21 KPI-MED.05 Proportion (percentage) of faculty members participating in community

service activities

Effectiveness

22 KPI-MED.06 Proportion (percentage) of faculty members engaged in professional

development activities

Effectiveness

23 KPI-P-17 The satisfaction of beneficiaries with the learning resource Efficiency

24 KPI-MED.7 The satisfaction of beneficiaries with facilities and equipment Safety

25 KPI-MED.08 The satisfaction of beneficiaries with the health services provided by

the university hospital

Efficiency

22

Important links

NCAAA KPIs for program accreditation:

Afaaq higher education strategy:

SAUDI ARABIA Vision 2030:

Prepared by:

DR. OSMAN TAGALSIR DR. SOHEIR SOLIMAN DR. ABD ELRAHEEM ALMHBOUB

Supervisor of Supervisor of Chairman of

Development and quality unit Development and quality unit The Performance Measurement

Boys' section Girls' section Committee