Certificate IV in Training & Assessment (TAA) Desma Moshou.

Certificate IV in Training & Assessment (TAA)

Desma Moshou

AIMS OF TODAY’S SESSION

Revision of the VET-related acronyms

Understanding the components of a Unit of Competency

Understanding the principles of assessment

Planning assessment tools

Assessment

Definition:

Assessment is the process of collecting evidence

and making judgments about whether competency

has been achieved to confirm that an individual can

perform to the standard expected in the workplace

as expressed in the relevant industry-endorsed

competency standards, or the learning outcomes of

an accredited course.

Why assess?

• To recognise current competence

• To determine language, literacy and numeracy needs

• To determine training gaps

• To establish the learner’s or candidates progress

• To gain formal recognition towards a qualification

• To meet organisational requirements for work

• To gain a license

• To operate equipment

• For recruitment

• For promotion

Who can assess?

Any organisation may appoint staff to undertake assessment for their own purposes, and develop their own plan as to how this is done.

However, in VET (vocational education and training),

under the AQTF (Australian Quality Training Framework),

only RTOs (Registered Training Organisations)

can issue nationally recognised qualifications and Statements of Attainment

Assessment by RTOs

AQTF includes the Standards for Registered Training Organisations, which all RTOs must meet in order to obtain and maintain their registration

Definition

AQTF means the nationally agreed quality arrangements for the VET system

Assessment by RTOs

Among other requirements AQTF requires RTOs to ensure that assessment:

Meets the requirements of the qualification as specified in the endorsed components of the Training Package

Cover the full dimensions of competency

Meets the principles of validity, fairness, flexibility and reliability and that Recognition of Prior Learning is offered to all applicants upon enrolment.

Assessment by RTOs

More detail information can be found on the AQTF and copies of the standards can be found on the Department of Further Education, Employment, Science & Training (DFEEST) website at

http://www.training.sa.gov.au

Assessment by non-RTOs

This type of organisation can have their own policies, practices and benchmarks but cannot provide nationally recognised training.

This type of organisation can provide a relevant certificate but cannot provide a nationally recognised certificate or statement of attainment.

Purpose of Assessment

SUMMATIVE

Formal recognition

classify skill level

gain qualification

recognise prior learning

FORMATIVE

Diagnose performance

identify training gaps

confirm learning progress

evaluate training

Two Types of assessment

NORM REFERENCED:

This type of assessment is intrinsically competitive

It compares individuals with each other and ranks them according to the number of places and opportunities available.

An example of this is tertiary entrance rating (TER) related to senior secondary school assessment.

CRITERION REFERENCED:

Also know as standards-based assessment is against fixed criteria or standards.

these predetermined criteria can take different forms EG:

Units of competency (from

Training Packages)Modules (from curriculum)Standard operating proceduresProduct specifications

Activity (1) Norm Criterion

100-metre sprint

Breathalyser test

Job interview

Best and Fairest in Hockey

First Aid Certificate

Best Film of the Year

Assessment must be Participatory

In competency-based assessment, the assessor must:

1. Have the qualification to assess in (or be mentored by a colleague who has the qualification)*

2. Inform the candidate of the criteria which will be assessed

3. Inform the candidate of the assessment process or steps

4. Set a mutually-agreed time and place for assessment

Assessment through training

This is where the candidate needs to learn the skills and knowledge first, and the assessment is conducted:

During the course of training at different intervals (formative assessment)

During, and on completion of training either on or off-the-job (summative assessment)

Assessment through RPL

This is where the skills and knowledge have already been gained, and the candidate is ready to be assessed against the relevant criteria / benchmarks without needing to go through a training program.

This ‘assessment only’ pathway can be referred to as:

Recognition of Prior Learning (RPL)

Recognition of Current Competencies (RCC)

Skills recognition

Recognition

Four Principles of assessment

Validity Reliability

Fairness Flexibility

The four principles of assessment are crucial to effective assessment in VET.

It is critical that all assessment situations reflect these principles.

Principles of assessment: Validity

assesses what it claims to assess evidence collected is relevant to the activity demonstrates that the performance criteria have been met

The validity of assessments is reflected by:

Focusing on the appropriate areas of competence and skills

Sampling a sufficient range of skills and performance

assessment tasks that resemble workplace expectations

Using multiple approaches to assessment

Principles of assessment: Reliability

Refers to consistency or reproductive ability of the assessment Clearly specifying the performance criteria to be met A reliable assessment Shows consistent processes from one

assessment event to the next.

The reliability of assessments is reflected by:

Comparing assessment processes of various assessors

Collecting evidence across different locations and times

Collecting evidence by various assessment methods

Principles of assessment: Fairness

A fair assessment does not disadvantage any person takes into account the characteristics of the person being

assessed.

To be fair, an assessment should:

Help the candidate understand clearly what is expected and what form the assessment will take

Be equitable to all groups of people being assessed.

Provide opportunities for review and an appeal of the assessment decision.

Principles of assessment: Flexibility

allows for assessment either on or off‑the‑job at mutually convenient times and situations

To be flexible assessment should:Provide for the recognition of competencies no matter how, where or when they were acquired

Draw on a range of methods and be appropriate to the context, task, and person

Be made accessible to the candidate so that they can proceed readily from one competency standard to another.

Activity: EXAMPLE 1

An assessor informs all candidates that she will be conducting assessments in two day's time at 2pm during their normal work routine. One candidate tells the assessor that she will not be available on that day as she is required to attend a meeting. The assessor tells her that she cannot make another time and that she will have to wait twelve months for the next assessment to take place.

Which principle of assessment is missing in this example?

What should the assessor have done?

Activity: EXAMPLE 2

Steve has just been assessed loading and unloading a small goods vehicle. The assessment was a fairly easy process and he didn’t have to do anything too difficult. Three months later Steve is assessed again by a different assessor. This time the assessment seems much more difficult and he was required to do a variety of things. To his surprise, Steve is found to be ‘not yet competent’.

What do you think is wrong with the first assessment?

What should the assessor do to ensure the candidate is found competent by another assessor?

Which principle of assessment has been ignored here?

Activity: EXAMPLE 3

An assessor has been working in the mining industry for 25 years, and conducting various assessments for the last ten. Recently he has become involved in CBT assessment of new recruits after they have undergone some training.

He believes that every assessment conducted should include some written material, as good literacy is vital in performing a job well. He insists that all candidates either answer some written questions or write a short paper on the area of competency no matter what it is.

What is the matter with this approach to assessment?

What are the disadvantages of this approach to both the candidate and the assessor?

What should the assessor consider before assessing the candidate in every assessment situation?

Activity: EXAMPLE 4

An assessment event has been organised for the coming Tuesday at a factory. The candidate arrives feeling incredibly nervous, and really does not feel well or up to the assessment. When he meets the assessor, she says not to worry its just nerves, they will pass. The candidate insists that he does not feel well, and does not think he can achieve competence. Disregarding that, the assessor wants to continue. They go through the assessment and the candidate is found to be not yet competent.

What principle of assessment has been ignored in this scenario?

How would this experience make the candidate feel about assessment and the assessor?

What should the assessor have done in this situation?

Methods of Assessment:

• observation of the person doing the job• inspection of finished product• demonstration• oral questioning• written assessment• projects, assignments, case studies• third party feedback• simulations• portfolios of evidence• feedback from other people they work with eg.

supervisor, peer, etc.

Rules of Evidence:

These state that assessment must produce evidence which is:

Valid

Sufficient

Current

Authentic

Can be primary or secondary evidence

Rules of Evidence: Validity

Evidence of competence must cover the broad range of knowledge and skills required to demonstrate competence

Assessors need to ensure that the evidence meets

all the specified criteria of the standards

Evidence should also match or reflect the type of

performance, which is being assessed.

Rules of Evidence: Sufficiency

This relates to the amount of evidence

Assessors must collect enough evidence to satisfy that the candidate is competent across all elements according to the performance criteria

It means collecting evidence over a period of time and in different situations

Rules of Evidence: Currency

An assessor needs to determine whether evidence of competence is recent

The focus is on whether the person being assessed has current competencies

This is particularly relevant to RPL evidence

Currency of evidence can be an accumulation of historical and recent activities.

Rules of Evidence: Authenticity

You must be able to ensure that the evidence to be gathered is the candidates work

To determine authenticity, it may be necessary for a third party to validate may be necessary.

Assessor Biases:

pre-judgements (halo & stereotypes)leniencysimilaritiespersonality factors

The assessment plan in detailthe unit/s of competency and elements or other benchmarks to be assessed - you will need to be familiar with thesethe purpose/s of assessment - this needs to be identified so that the stakeholders are well aware of the reason for the assessmenta profile of the target group - characteristics and needs of the candidatesothers involved in the assessment process teachers/assessors, administrative staff

Planning for assessment

how the assessment will occur - that is, the assessment methods and tools to be used. It can include a description of the method and examples of tools to be used for the assessment

when and where the assessment will occur - this includes details of any due dates for submission of evidence, or dates and times of when the assessment will occur and the proposed location of the assessment.

Planning for assessment

what resources or special arrangements are required - this outlines what is needed to carry out the assessment, given the special needs of candidates, organisational requirements, or other legislative or OHS considerations

context for assessment - this outlines the details of the environment in which the assessment will take place and any changes which need to be made as a result. For example, will it be on-the-job, off-the-job or acombination of both? Or will the assessment be contextualised to the work setting?

instructions for the candidate - this outlines information to be given to the candidate, related to the assessment exercise at hand.

Planning for assessment

Planning (Case Study 1)

Rosie is planning to assess a candidate in the retail industry. David, the candidate, has let her know he is ready to be assessed. Rosie has a quick look at the unit of competency against which she is assessing, since she has not done an assessment on this unit in a while. She thinks about the sorts of assessment methods she can use on the way home from work, and jots down some notes. She phones David and tells him that the assessment will involve observing him carrying out the job function and some question and answer time. When the day comes, she heads off to his workplace and is not expected by the employer. Nobody has told him an assessment is going to take place, but it goes ahead anyway. Rosie finds David and asks him to perform the job function. She has a copy of the competency unit with her and uses that as a reference, whilst taking notes on what he is doing. Then she asks him some questions. The phone in the office they are using rings, and Rosie lets David answer it. Then they continue with some discussion. Rosie tells David he is competent at that unit and heads back to her office, where she results him as a PA on the computer system.

David telephones his assessor, Rosie, to let her know he is ready to be assessed. Rosie and David discuss the details, when, where and how the assessment will be conducted, what evidence will be required and how the evidence will be gathered. Rosie contacts David's employer straight away to arrange the time away from work and the environment for assessment. Then she gets the unit of competency to be assessed and begins interpreting the standard for assessment. She asks herself what evidence is required to demonstrate competence and takes notes, designs a checklist and writes some questions she will ask him.

She visualises the assessment event and what tools, resources, or people might be required to help it run smoothly.

The following day Rosie discusses the upcoming assessment with a colleague as she has not assessed this unit for a while. They talk about the tools to use, the type of person David is, the work environment and so on. Rosie then organises the recording system she will use, gets the relevant documentation together, and checks to ensure she has everything. When Rosie arrives at David's office, David and his employer meet her and they discuss David's progress through his training. Rosie and David undertake the assessment and David is found to be competent.

When Rosie arrives back at her office, she files the assessment checklist with a copy of the assessment instrument. This can be used at the end of the month when the organisation is evaluating their assessors for quality.

Planning (Case Study 2)

Planning (Case Study Questions)

What are the differences between these two examples of planning?

Identify the positive aspects of Case Study 1 and Case Study 2.

From Case Study 2, identify the six stages of assessment planning and list them

FOR INTERACTIVE DISCUSSION

What do you think an assessment

validation process is?

How often do you participate in

assessment validations?

VALIDATION

The Australian Quality Training Framework (AQTF) requires that all

RTOs conduct regular

assessment validations

Validations are intended to ensure consistency, fairness and equity with

regard to assessment and assessment processes

ASSESSMENT

Assessment for this unit will be based on:

Your workshop participation and contribution levels

The completion of the learning activities during the workshop

Completion of the final assessment task