Introduction Methods Results Conclusions and Implications 1.

Introduction

Methods

Results

Conclusions and Implications

2

In 2007, introduce the sunset periodIn 2007, introduce the sunset period

National Technical Qualifications(NTQ) of KoreaNational Technical Qualifications(NTQ) of Korea

☞ ☞ Legal basic of NTQs: the National Technical Qualification ActLegal basic of NTQs: the National Technical Qualification Act

InIn 1973, enacting and declaring legal basics for NTQs1973, enacting and declaring legal basics for NTQs

3

I. Introduction

In 2010, operating 512 NTQsIn 2010, operating 512 NTQs

☞ ☞ 481 NTQs in technical skills fields, 31 NTQs in service and clerical fields.481 NTQs in technical skills fields, 31 NTQs in service and clerical fields.

☞ ☞ 25 job areas, 114 sub job areas25 job areas, 114 sub job areas

Current Levels of NTQs Current Levels of NTQs in the technical skills fieldsin the technical skills fields

Levels in service and clerical fields consist 1~3 or 1~2Levels in service and clerical fields consist 1~3 or 1~2

Assessment criteria / sunset periodAssessment criteria / sunset period

4

I. Introduction

Assessment criteria Assessment criteria

☞ ☞ Each of the NTQs has the assessment criteria except certificate of professional engineerEach of the NTQs has the assessment criteria except certificate of professional engineer ※ ※ certificate of professional engineer has covered all range of techniccertificate of professional engineer has covered all range of technic

☞ ☞ regulated by a law in updating the assessment criteriaregulated by a law in updating the assessment criteria

☞ ☞ a minimal period to updatea minimal period to update

☞ ☞ Each of the sunset period was set up 2~5 yearEach of the sunset period was set up 2~5 year ※ ※ through gathering the opinions of the experts in ‘The assessment criteria development committee’through gathering the opinions of the experts in ‘The assessment criteria development committee’

sunset

period

(years)

levels

totalCraftsman

Industrial

engineer

Engineer

Master craftsm

an

2 - 1 1 - 2

3 10 5 5 2 22

4 18 18 16 6 58

5 152 86 90 20 348

total 180 110 112 28 430

Set up the sunset periodSet up the sunset period

Needs for StudyNeeds for Study

The assessment criteria is played key role in NTQThe assessment criteria is played key role in NTQ

Various efforts to updating the assessment criteriaVarious efforts to updating the assessment criteria

☞ ☞ It has been five years since the sunset period system was introducedIt has been five years since the sunset period system was introduced ☞ ☞ the development of the NCS and its employmentthe development of the NCS and its employment ☞ ☞ Technology has been changedTechnology has been changed

circumstantial changes about NTQcircumstantial changes about NTQ

Reviewing the status of using the assessment criteria/Reviewing the status of using the assessment criteria/Developing new update scheme for Assessment criteriaDeveloping new update scheme for Assessment criteria 5

I. Introduction

☞ ☞ The assessment criteria indicate the range of subject assessmentThe assessment criteria indicate the range of subject assessment ☞ ☞ regulation to develop assessment criteria for the enactmentregulation to develop assessment criteria for the enactment ☞ ☞ revision of the each qualification in accordance with the National Technical Qualifications Lawrevision of the each qualification in accordance with the National Technical Qualifications Law

☞ ☞ set up the sunset period set up the sunset period in each assessment criteria to improve field suitability of the criteriain each assessment criteria to improve field suitability of the criteria

☞ ☞ the job analysis the job analysis is carried out by field specialists in developing the assessment criteria, and since 2005 is carried out by field specialists in developing the assessment criteria, and since 2005

the employment of the employment of the NCS the NCS was expanded.was expanded.

MethodsMethods

II. Methods

6

Analysis Analysis

☞ ☞ literature reviewliterature review - precedent studies- precedent studies on the assessment criteria, on the assessment criteria, policy documentspolicy documents and and statistical resourcesstatistical resources

☞ ☞ interviewinterview - for figure out the actual condition- for figure out the actual condition - six staffs in HRD Korea(which was in charge of assessment), two specialists for developing the assessment criteria - six staffs in HRD Korea(which was in charge of assessment), two specialists for developing the assessment criteria and two exam writers.and two exam writers.

☞ ☞ surveysurvey - for find out the suitability of assessment criteria sunset period by types- for find out the suitability of assessment criteria sunset period by types - complete enumeration(The assessment criteria development committee member)- complete enumeration(The assessment criteria development committee member)

comprised of 52 groups in total with 10 members in each areacomprised of 52 groups in total with 10 members in each area

Development Development

☞ ☞ developing the draftdeveloping the draft - prepared through the examinations of precedent studies and related law and through the result of current status analysis - prepared through the examinations of precedent studies and related law and through the result of current status analysis

and investigation researchand investigation research ☞ ☞ examine the field suitability / applicabilityexamine the field suitability / applicability - - three staffs in HRD Korea, two specialists for developing the assessment criteria and two exam writers.three staffs in HRD Korea, two specialists for developing the assessment criteria and two exam writers.

Usage status of the Assessment criteriaUsage status of the Assessment criteria

III. Results

7

Using the job analysis, resources from the NCS

But, confusion of terms as the forms and names of item were different

ex) C.A use the terms likes key item, sub item and detailed sub item

J.A, NCS use the terms likes competency unit, competency unit element and key item respectively

Development of Assesment CriteriaDevelopment of Assesment CriteriaDevelopment of Assesment CriteriaDevelopment of Assesment Criteria

four or five times questions are made to be stocked in the item pool → the questions are

selected and verified from the item pool to perform an examination

Lack of the sufficient information about the level of difficult and field suitability for exam

writer

※ 73.7% of the exam writer is academic expert

Development of the exam questionsDevelopment of the exam questionsDevelopment of the exam questionsDevelopment of the exam questions

The evidence for selecting the sunset period is not enough

suitability of sunset period : too long(25.7%, especially, IT and materials areas), too

short(7.5%)

requirement to reset the sunset period

reflecting the speed of technical change

Updated status of the Assessment criteria (1)Updated status of the Assessment criteria (1)

III. Results

8

Suitability of sunset period Suitability of sunset period Suitability of sunset period Suitability of sunset period

Same sub job areas: use the same SME pool for updating job analysis and assessment

criteria

Updating at the same time, same areas: ① to prevent the duplication of the A.C

② to achieve the standardization of the terminology

But, 15 areas (13.2%) out of 114 areas had a different sunset period between the areas

The adjustment of the sunset period between A.C in the same sub job areas was

required

Different sunset period between the sub job areasDifferent sunset period between the sub job areasDifferent sunset period between the sub job areasDifferent sunset period between the sub job areas

Revision the A.C in 2008~2010: 195types

※ Due to the expiry of the sunset period: 79.0%

※ A frequent revision: 21.0%

Requirement to frequent revisions

※ the sunset period is a minimal period to update

Updated status of the Assessment criteria (2)Updated status of the Assessment criteria (2)

III. Results

9

Updating the A.CUpdating the A.CUpdating the A.CUpdating the A.C

deviation about the A.C revision deviation about the A.C revision deviation about the A.C revision deviation about the A.C revision

79.0%

21.0%Due to the expiry of the sunset period

A frequent revision

Direction of improvement and new update scheme for Direction of improvement and new update scheme for Assessment criteria(1)Assessment criteria(1)

III. Results

10

reorganization of qualification types for using the NCS

Revision the A.C using the assemble the NCS

※ Every field has its own standard in the future

A scheme to apply the NCS(In updating the A.C )A scheme to apply the NCS(In updating the A.C )A scheme to apply the NCS(In updating the A.C )A scheme to apply the NCS(In updating the A.C )

reset to reflect the speed of technical change, and the sunset period of the same type of

sub job areas

making revision plan (for revising Every year the same number (85~95 types) of the A.C)

Reset the sunset periodReset the sunset periodReset the sunset periodReset the sunset period

the rename of the name of items for use the NCS

※ ex) key item → competency unit

Providing more information(about detailed sub items) to exam writers

the level of difficulty, the level of importance and the level of frequency

Revision of the current A.C forms & name of itemsRevision of the current A.C forms & name of itemsRevision of the current A.C forms & name of itemsRevision of the current A.C forms & name of items

III. Results

11

AA frequentfrequent monitoring system to review the field applicabilitymonitoring system to review the field applicabilityAA frequentfrequent monitoring system to review the field applicabilitymonitoring system to review the field applicability

Revision the A.C

Revision the A.CRequiring change

More than 10%

Sunset period

Restart

The sunset period

Requiring change

less than 10%

통계 DBAssessment

CriteriaAssessment

Criteria

A frequent monitoring(when setting

exam questions)

Direction of improvement and new update scheme for Direction of improvement and new update scheme for Assessment criteria(2)Assessment criteria(2)

A frequent monitoring system to review the field applicability might be introduced

ConclusionsConclusions

IV. Conclusions & Implications

12

The A.C provide accurate information to users, and contain competency to be applicable to the fieldThe A.C provide accurate information to users, and contain competency to be applicable to the field

the A.C must be reviewed frequently and complemented reflecting newly developed technologythe A.C must be reviewed frequently and complemented reflecting newly developed technology

But, less frequent revisions, updates were made obligatory after the expiry of the sunset period.But, less frequent revisions, updates were made obligatory after the expiry of the sunset period.

Necessary to revise the form and items of A.C, reset the sunset period, adopt the frequent update system Necessary to revise the form and items of A.C, reset the sunset period, adopt the frequent update system

ImplicationsImplications

to install a frequent monitoring system working together with the sunset periodto install a frequent monitoring system working together with the sunset period

the NCS resources might be employed positively in the updatethe NCS resources might be employed positively in the update