. THE TAXONOMY OF TRAINING AND DEVELOPMENT OUTCOMES (TOTADO) EVALUATION FRAMEWORK Dr Kamal Birdi Institute of Work Psychology Management School University of Sheffield Sheffield S10 2TN United Kingdom Email: [email protected]Tel: +44 (0)114 222 3288 This document contains a description of the TOTADO training and development evaluation framework and two tools to help with its implementation and data collection. 1. A paper summarising the TOTADO framework 2. A TOTADO evaluation strategy planning template 3. A TOTADO evaluation interview schedule 1
This document is posted to help you gain knowledge. Please leave a comment to let me know what you think about it! Share it to your friends and learn new things together.
Transcript
.
THE TAXONOMY OF TRAINING AND DEVELOPMENT OUTCOMES (TOTADO)
This document contains a description of the TOTADO training and development evaluation framework and two tools to help with its implementation and data collection.
Type of information Methods of collecting information
Who provides the information
When to collect information
TIME 0 TIME 1 TIME 2 TIME 3
period before the course
at the start of the course
at the end of the course
period after the course
9
.
TOTADO INTERVIEW SCHEDULE
“In the following interview, I shall be asking you to describe any changes that you think have arisen because of programme X.”
A. INDIVIDUAL OUTCOMES
GENERAL LEAD INAs a result of taking part in X, how do you think you have changed?
AFFECTIVEHow has taking part in the X changed the way you FEEL about things?
COGNITIVEWhat type of things have you LEARNED as a result of taking part in X?
PHYSICALHow has taking part in the X changed your LEVELS OF HEALTH AND FITNESS?
BEHAVIOURAL What can you DO now that you couldn’t do before taking part in X?How has taking part in X changed your JOB PERFORMANCE?
INSTRUMENTALHas taking part in X led to any changes in the type of work you do?Has taking part in X led to any changes in your job status or conditions of employment?Has taking part in X helped you form new relationships at work or changed existing relationships?Has taking part in X led to any other changes in your work that we haven’t discussed yet?Has taking part in X led to any changes for you outside work?
IDENTIFYING BARRIERS TO CHANGE IN INDIVIDUAL OUTCOMESHas anything in particular stopped or hindered you changing personally the way you wanted after the training / taking part in Programme X?
Is there anything that could be changed about Programme X, your organisation or other aspects that could help you achieve these desired changes?
10
.
B. TEAM / GROUP OUTCOMES
GENERAL LEAD INAs a result of taking part in the X programme, how do you think your team has changed?
AFFECTIVEHow has taking part in the X changed the way your team FEELS about things?
COGNITIVEWhat type of things has your team LEARNED as a result of taking part in X?
BEHAVIOURAL What can your team DO now that you couldn’t do before taking part in X?How has taking part in X changed your team’s WORK PERFORMANCE?
INSTRUMENTALHas taking part in X led to any changes in the type of work your team does?Has taking part in X led to any other changes in the type of work your team does?Has taking part in X helped your team form new relationships at work or changed existing relationships?Has taking part in X led to any other changes in your team’s work that we haven’t discussed yet?
IDENTIFYING BARRIERS TO CHANGE IN TEAM/GROUP OUTCOMESHas anything in particular stopped or hindered your team or teams changing the way that was wanted after the training / taking part in Programme X?
Is there anything that could be changed about Programme X, your organisation or other aspects that could help you achieve these desired changes?
11
.
C. ORGANISATIONAL OUTCOMES
GENERAL LEAD INAs a result of running the X programme, how do you think your organisation has changed?
OUTPUTSHas running X led to any changes in your organisation’s outputs e.g. its productivity, quality levels, variety of products/sevices offered etc.?
RESOURCESHas running X led to any changes in your organisation’s employees e.g. their performance, morale, absenteeism?Has running X led to any changes in your organisation’s material resources e.g. reductions in wastage?
PROCESSES / OPERATIONSHas running X led to any changes in your organisation’s efficiency or the way work is carried out e.g. speed of production, turnaround on project times?
FINANCIALHas running X led to any changes in your organisation’s financial performance e.g. its profitability, balancing of budgets?
Has taking part in X led to any other changes in your organisation that we haven’t discussed yet?
IDENTIFYING BARRIERS TO CHANGE IN ORGANISATIONAL OUTCOMES
Has anything in particular stopped your department or organisation changing the way that was wanted after the training / taking part in Programme X?
Is there anything that could be changed about Programme X, your organisation or other aspects that could help you achieve these desired changes?
12
.
D. SOCIETAL OUTCOMES
GENERAL LEAD INWhat types of general impact would you say the X programme has had on communities or groups outside the organisation?
ECONOMICWhat types of general impact would you say the X programme has had on the economy in your region ? e.g. £ investment in geographic region, unemployment rates in area
HEALTH AND WELFAREWhat types of general impact would you say the X programme has had on the health or welfare of the community in your region? e.g. no. of deaths from heart disease, alcohol-related illnesses in local population
EDUCATIONALWhat types of general impact would you say the X programme has had on the education levels of the community in your region ? e.g. level of qualifications of local population, % social inclusion of minorities
LAW AND ORDERWhat types of general impact would you say the X programme has had on law and order issues in the community in your region? e.g. no. of robberies in the area, % reduction in drug crime
ENVIRONMENTALWhat types of general impact would you say the X programme has had on the geographical environment of your region? e.g. pollution and waste levels in the region
Has taking part in X had any other impacts on the local or national community that we haven’t discussed yet?
IDENTIFYING BARRIERS TO CHANGE IN SOCIETAL OUTCOMES
Has anything in particular stopped or hindered your organisation’s impact on the community or society in the way you wanted after the training / taking part in Programme X?
Is there anything that could be changed about Programme X, your organisation or other aspects that could help you achieve these desired changes?
13
.
NOTE 1: The above questions can be tailored to different stakeholders (trainees, line
managers, senior managers, customers, regulatory bodies etc) and different types of
programmes.
NOTE 2: Where desired changes have not occurred or undesirable changes have occurred,
then probe for the reasons for this situation (see BARRIERS question). Identifying
barriers to desired change in outcomes can help improve the effectiveness of future