What Current Research May Mean for the Future of Quality Management Systems LoD Meeting Zurich, 16.02.2004 Dr. Sabine Seufert.

Post on 20-Jan-2016

212 Views

Category:

Documents

0 Downloads

Preview:

Click to see full reader

Transcript

What Current Research May Mean for the Future of Quality Management Systems

LoD Meeting Zurich, 16.02.2004Dr. Sabine Seufert

LoD Zurich16.02.2004

Page 2 SCIL Activity FieldsInnovator

Change Engine

PromotorQuality Catalyst

InitiatorResearch Lab

ModeratorCommunity Platform

TrainerSCIL Academy

LoD Zurich16.02.2004

Page 3 Quality?

Ihre Durchfallquoteist besorgnis-

erregend!

Die Qualitätder Mensa sollteüberprüft werden!

LoD Zurich16.02.2004

Page 4 What is „Quality“? 4 Main Questions

eLearning -Quality

What are thetargeted objects

to evaluate?

ObjectsGoalsWhy to evaluate?

What are thenorms?

LoD Zurich16.02.2004

Page 5

Meso-Level

Programmes,CoursesCertificates

Micro-Level

Products:eMedia,„LearningWare“

Aggregation

Organisation,Universities,Enterprises,Business Units

Macro-Level

Context,Conditions

What is „Quality“?: Objects

LoD Zurich16.02.2004

Page 6 What is „Quality“? 4 Main Questions

eLearning -Quality

Process

How to evaluate? What are the

methods?

What are thetargeted objects

to evaluate?

ObjectsGoalsWhy to evaluate?

What are thenorms?

LoD Zurich16.02.2004

Page 7

ProzessInput

What is „Quality“: Process

Output(Outcome)

• Qualificationof tutors,teachers

• Feedbackto students

• Evaluationof the tutor support

• Process of a Quality Management System: Evaluation- formative evaluation: action use (initiate changes)- summative evaluation: conceptual use (decisions)

e.g.

LoD Zurich16.02.2004

Page 8 What is „Quality“? 4 Main Questions

eLearning -Quality

Process

How to evaluate? What are the

methods?

What are thetargeted objects

to evaluate?

ObjectsGoalsWhy to evaluate?

What are thenorms?

People

Who are the (internal, external)

evaluators?

LoD Zurich16.02.2004

Page 9What is the Quality Initiative „ELIP“?

Cooperation with efmd (European Foundation for Management Development)Accreditation Institute in Brussels:• EQUIS: Accreditation for Universities• CLIP: Accreditation for Corporate Universities

ELIP (eLearning Quality Improvement Programme)

LoD Zurich16.02.2004

Page 10

GoalsWhy to evaluate?

What are thenorms?

People

Who are the (internal, external)

evaluators?

EL

IP

Self-Assessment,External Evaluation:

Auditor Team

What is ELIP?

Process

How to evaluate? What are the

methods?

What are thetargeted objects

to evaluate?

Objects

EL

IP

eLearning Programmes

for ManagementEducation

EL

IP

Input-, Process-Output-QualitiesAuditing Process

Why to evaluate?What are the

norms?

EL

IP Quality standardsbased on research,learner perspective

eLearning -Quality

LoD Zurich16.02.2004

Page 11 Why „ELIP“?

• Marketing Strategy to promote advanced quality ofeLearning (transparency for „end-customers“)

• Implementing quality standards

From a customer perspective:

• No systematic approach for programmes with focus on quality improvement (facing multi-dimensional challenges)

From a market perspective:

• Urge for theoretically sound quality framework• Supported by empirical evidence

From a research perspective:

LoD Zurich16.02.2004

Page 12 Why ELIP?

Object

ApplicationInstitution Programme Product

„Traditional“Education(Face-to-Face)

Total Quality Mana-gement, Accreditation(e.g., efmd, AACSB)

Certification, e.g. A-MBA

Evaluation of Content

DistanceEducation,eLearning

Expansion of existingapproaches, DIN-Norm

A-MBA Certification,Criteria Catalogues,e.g. Inst. f. HE Poli-cy, ELIP-Certification

ASTD Criteria Cata-logue for eLearningSoftware, DIN-Normfor Developing eL

BlendedLearning,(„Dual Mode“)

Expansion of existingapproaches, DIN-Norm

A-MBA Certification(enhanced criteria),ELIP-Certification

ASTD Criteria Catalo-gue, DIN-Norm forDeveloping eLearning

LoD Zurich16.02.2004

Page 13 How does ELIP look like?

StrategyDevelopment

Implementing,Quality Development

Organisation

Culture

Technology

Resources

Pedagogy

Quality Management-Approach

• Quality Framework and Criteria:- Expert Interviews (25 Experts)- Delphi-Study (37 Experts, 2 Rounds)

• Results: 47 Quality Criteria• Self-Assessment Guide and Review

Guide for Auditor Teams• Focus: Quality and Sustainability

Based on:

LoD Zurich16.02.2004

Page 14 How does ELIP look like?

StrategyDevelopment

Implementing,Quality Development

Organisation

Culture

Technology

Resources

Pedagogy

What to do?The strategic (added) value of e-Learning within the programme is explained; clear understanding about the contribution e-Learning is to provide for the success of the programme.

Examples

How to do?Students are provided with programme information (e.g. objectives; structure; estimated study time; required technology and technical competence).

LoD Zurich16.02.2004

Page 15 How does ELIP look like?

StrategyDevelopment

Implementing,Quality Development

Organisation

Culture

Technology

Resources

Pedagogy

LoD Zurich16.02.2004

Page 16

StrategyDevelopment

Implementation,Quality Development

Organisation

Culture

Technology

Resources

Pedagogy

ELIP Quality CriteriaPedagogyUltimate goal “Sustainable Learning Outcome“

• Pedagogic added value of eLearning• Feedback to student questions and assignments• Presentation of contents• Construction of assessments• Integration of eLearning components

Examples

LoD Zurich16.02.2004

Page 17 ELIP Quality Criteria

Strategieentwicklung:Zielsystem

Implementierung,Qualitätsentwicklung

Organisation

Culture

Technology

Resources

Pedagogy

Technology

• Usefulness of eLearning System• Easyness of Use, Usability-Criteria• Technology standards

Ultimate Goal „ stable and problem-adequate functionality“Examples

LoD Zurich16.02.2004

Page 18 ELIP Quality Criteria

Strategieentwicklung:Zielsystem

Implementierung,Qualitätsentwicklung

Organisation

Culture

Technology

Resources

Pedagogy

Resources

• Balance between running and advancing the program

• Allocation of resources reflect the prioritiesaccording to the programme objectives

Ultimate Goal „ Efficient and effective use of resources“Examples

LoD Zurich16.02.2004

Page 19 ELIP Quality Criteria

Strategieentwicklung:Zielsystem

Implementierung,Qualitätsentwicklung

Organisation

Culture

Technology

Resources

Pedagogy

Organisation

• Clearly defined roles and responsibilities• Support structures for students and staff• Processes for student complaints• Efficient programme coordination

Ultimate Goal „Flexibility and Efficiency ofStructures and Processes “

Examples

LoD Zurich16.02.2004

Page 20 ELIP Quality Criteria

Strategieentwicklung:Zielsystem

Implementierung,Qualitätsentwicklung

Organisation

Culture

Technologie

Resources

Pedagogy

Culture

• Enhancing the acceptance of the programmepromoting a motivating environment

• Incentives for the staff and students• Commitment of the management

Ultimate goal „Readiness / willingness for innovation and change, self-organisation”

Examples

LoD Zurich16.02.2004

Page 21 Outlook

• Pilotphase: 2 Universities, 1 Company for testing the ELIP Certification Process

• Validation of the Quality Criteria (Phd contribution):Theoretical basis and empirical proof in practice

• Systematic, Multi-dimensional approaches,considering contextual conditions

• Shift from (static) Quality Assurance towards (dynamic) Quality Development

General Outlook Quality Management Systems:

ELIP Outlook:

LoD Zurich16.02.2004

Page 22 Thank you very much for your attention!

Dr. Sabine Seufert

SCIL -Swiss Centre for Innovations in Learningsabine.seufert@unisg.chwww.scil.ch

Dr. Sabine Seufert

SCIL -Swiss Centre for Innovations in Learningsabine.seufert@unisg.chwww.scil.ch

top related