What Current Research May Mean for the Future of Quality Management Systems LoD Meeting Zurich, 16.02.2004 Dr. Sabine Seufert.

What Current Research May Mean for the Future of Quality Management Systems

LoD Meeting Zurich, 16.02.2004Dr. Sabine Seufert

LoD Zurich16.02.2004

Page 2 SCIL Activity FieldsInnovator

Change Engine

PromotorQuality Catalyst

InitiatorResearch Lab

ModeratorCommunity Platform

TrainerSCIL Academy


Page 3 Quality?

Ihre Durchfallquoteist besorgnis-

erregend!

Die Qualitätder Mensa sollteüberprüft werden!


Page 4 What is „Quality“? 4 Main Questions

eLearning -Quality

What are thetargeted objects

to evaluate?

ObjectsGoalsWhy to evaluate?

What are thenorms?


Page 5

Meso-Level

Programmes,CoursesCertificates

Micro-Level

Products:eMedia,„LearningWare“

Aggregation

Organisation,Universities,Enterprises,Business Units

Macro-Level

Context,Conditions

What is „Quality“?: Objects



eLearning -Quality

Process

How to evaluate? What are the

methods?


to evaluate?


What are thenorms?


Page 7

ProzessInput

What is „Quality“: Process

Output(Outcome)

• Qualificationof tutors,teachers

• Feedbackto students

• Evaluationof the tutor support

• Process of a Quality Management System: Evaluation- formative evaluation: action use (initiate changes)- summative evaluation: conceptual use (decisions)

e.g.



eLearning -Quality

Process


methods?


to evaluate?


What are thenorms?

People

Who are the (internal, external)

evaluators?


Page 9What is the Quality Initiative „ELIP“?

Cooperation with efmd (European Foundation for Management Development)Accreditation Institute in Brussels:• EQUIS: Accreditation for Universities• CLIP: Accreditation for Corporate Universities

ELIP (eLearning Quality Improvement Programme)


Page 10

GoalsWhy to evaluate?

What are thenorms?

People

Who are the (internal, external)

evaluators?

EL

IP

Self-Assessment,External Evaluation:

Auditor Team

What is ELIP?

Process


methods?


to evaluate?

Objects

EL

IP

eLearning Programmes

for ManagementEducation

EL

IP

Input-, Process-Output-QualitiesAuditing Process

Why to evaluate?What are the

norms?

EL

IP Quality standardsbased on research,learner perspective

eLearning -Quality


Page 11 Why „ELIP“?

• Marketing Strategy to promote advanced quality ofeLearning (transparency for „end-customers“)

• Implementing quality standards

From a customer perspective:

• No systematic approach for programmes with focus on quality improvement (facing multi-dimensional challenges)

From a market perspective:

• Urge for theoretically sound quality framework• Supported by empirical evidence

From a research perspective:


Page 12 Why ELIP?

Object

ApplicationInstitution Programme Product

„Traditional“Education(Face-to-Face)

Total Quality Mana-gement, Accreditation(e.g., efmd, AACSB)

Certification, e.g. A-MBA

Evaluation of Content

DistanceEducation,eLearning

Expansion of existingapproaches, DIN-Norm

A-MBA Certification,Criteria Catalogues,e.g. Inst. f. HE Poli-cy, ELIP-Certification

ASTD Criteria Cata-logue for eLearningSoftware, DIN-Normfor Developing eL

BlendedLearning,(„Dual Mode“)

Expansion of existingapproaches, DIN-Norm

A-MBA Certification(enhanced criteria),ELIP-Certification

ASTD Criteria Catalo-gue, DIN-Norm forDeveloping eLearning


Page 13 How does ELIP look like?

StrategyDevelopment

Implementing,Quality Development

Organisation

Culture

Technology

Resources

Pedagogy

Quality Management-Approach

• Quality Framework and Criteria:- Expert Interviews (25 Experts)- Delphi-Study (37 Experts, 2 Rounds)

• Results: 47 Quality Criteria• Self-Assessment Guide and Review

Guide for Auditor Teams• Focus: Quality and Sustainability

Based on:



StrategyDevelopment


Organisation

Culture

Technology

Resources

Pedagogy

What to do?The strategic (added) value of e-Learning within the programme is explained; clear understanding about the contribution e-Learning is to provide for the success of the programme.

Examples

How to do?Students are provided with programme information (e.g. objectives; structure; estimated study time; required technology and technical competence).



StrategyDevelopment


Organisation

Culture

Technology

Resources

Pedagogy


Page 16

StrategyDevelopment

Implementation,Quality Development

Organisation

Culture

Technology

Resources

Pedagogy

ELIP Quality CriteriaPedagogyUltimate goal “Sustainable Learning Outcome“

• Pedagogic added value of eLearning• Feedback to student questions and assignments• Presentation of contents• Construction of assessments• Integration of eLearning components

Examples


Page 17 ELIP Quality Criteria

Strategieentwicklung:Zielsystem

Implementierung,Qualitätsentwicklung

Organisation

Culture

Technology

Resources

Pedagogy

Technology

• Usefulness of eLearning System• Easyness of Use, Usability-Criteria• Technology standards

Ultimate Goal „ stable and problem-adequate functionality“Examples





Organisation

Culture

Technology

Resources

Pedagogy

Resources

• Balance between running and advancing the program

• Allocation of resources reflect the prioritiesaccording to the programme objectives

Ultimate Goal „ Efficient and effective use of resources“Examples





Organisation

Culture

Technology

Resources

Pedagogy

Organisation

• Clearly defined roles and responsibilities• Support structures for students and staff• Processes for student complaints• Efficient programme coordination

Ultimate Goal „Flexibility and Efficiency ofStructures and Processes “

Examples





Organisation

Culture

Technologie

Resources

Pedagogy

Culture

• Enhancing the acceptance of the programmepromoting a motivating environment

• Incentives for the staff and students• Commitment of the management

Ultimate goal „Readiness / willingness for innovation and change, self-organisation”

Examples


Page 21 Outlook

• Pilotphase: 2 Universities, 1 Company for testing the ELIP Certification Process

• Validation of the Quality Criteria (Phd contribution):Theoretical basis and empirical proof in practice

• Systematic, Multi-dimensional approaches,considering contextual conditions

• Shift from (static) Quality Assurance towards (dynamic) Quality Development

General Outlook Quality Management Systems:

ELIP Outlook:


Page 22 Thank you very much for your attention!

Dr. Sabine Seufert

SCIL -Swiss Centre for Innovations in [email protected]

Dr. Sabine Seufert

SCIL -Swiss Centre for Innovations in [email protected]

What Current Research May Mean for the Future of Quality Management Systems LoD Meeting Zurich, 16.02.2004 Dr. Sabine Seufert.

Documents