Top Banner
MOOQ for the quality of MOOCs: “We will make MOOCs better” Quality Reference Framework with indicators for design & comparison www.MOOC-quality.eu Frameworks: MOOQ
27

2017-03-09 OE Global MOOQ Interactive Workshop Results

Mar 20, 2017

Download

Education

Welcome message from author
This document is posted to help you gain knowledge. Please leave a comment to let me know what you think about it! Share it to your friends and learn new things together.
Transcript
Page 1: 2017-03-09 OE Global MOOQ Interactive Workshop Results

MOOQ for the quality of MOOCs: “We will make MOOCs better” Quality Reference Framework with indicators for design & comparison www.MOOC-quality.eu

Frameworks: MOOQ

Page 2: 2017-03-09 OE Global MOOQ Interactive Workshop Results

The quality of MOOCs: Results from three

research surveys and discussion of the QRF

Workshop @ EC-TEL 2016, Lyon by Christian M. Stracke et al.

Open University of the Netherlands

Page 3: 2017-03-09 OE Global MOOQ Interactive Workshop Results

Open CC License for sharing & re-using slides

This work is free to share under the creative commons licence:

"Attribution – Noncommercial – Share Alike 3.0"

You can copy, distribute and transmit the work under the following conditions:

1. Attribution – 2. Noncommercial –

3. Share Alike

Licence: Attribution-Noncommercial-Share Alike Some rights reserved, see: http://creativecommons.org/licenses/by-nc-sa/3.0/

Page 4: 2017-03-09 OE Global MOOQ Interactive Workshop Results

Open University of the Netherlands

Global cooperation: ECNU & KNOU

Global initiative ICORE for OR & OE

Annual international LINQ Conference

eLC European Institute

Standardization Chair in ISO & CEN

Dr. Christian M. Stracke: Open Learning & Education, Innovations, Policies, Quality & Competences, Impact

Page 5: 2017-03-09 OE Global MOOQ Interactive Workshop Results

Source: https://www.flickr.com/photos/opensourceway/

Page 6: 2017-03-09 OE Global MOOQ Interactive Workshop Results

MOOQ for the quality of MOOCs: “We will make MOOCs better” Quality Reference Framework with indicators for design & comparison www.MOOC-quality.eu

Frameworks: MOOQ

Page 7: 2017-03-09 OE Global MOOQ Interactive Workshop Results

Quality Reference Framework with indicators for design & comparison

Our main goal is the collaboration with all to improve future MOOC design for better MOOC learning experiences

Page 8: 2017-03-09 OE Global MOOQ Interactive Workshop Results

Three main surveys for learners, designers and facilitators of MOOCs

Please support us to improve next MOOCs: www.survey.MOOC-quality.eu

Your feedback is most welcome!

Page 9: 2017-03-09 OE Global MOOQ Interactive Workshop Results
Page 10: 2017-03-09 OE Global MOOQ Interactive Workshop Results

Global MOOC Survey

Page 11: 2017-03-09 OE Global MOOQ Interactive Workshop Results

Hands-on-Session

Explore the quality indicators of MOOCs

Page 12: 2017-03-09 OE Global MOOQ Interactive Workshop Results

Our proposal for discussion:

The Quality Reference

Framework (QRF)

Page 13: 2017-03-09 OE Global MOOQ Interactive Workshop Results

What is Open Education (OE)? Quality dimensions of OE in practice? Quality indicators for OE in practice?

Quality Open Education

Page 14: 2017-03-09 OE Global MOOQ Interactive Workshop Results

1. Pedagogical

2. Technological

3. Business Model

MOOQ Matrix

Page 15: 2017-03-09 OE Global MOOQ Interactive Workshop Results

1. MOOC Learners

2. MOOC Designers

3. MOOC Facilitators

4. MOOC Providers

MOOQ Target Groups

Page 16: 2017-03-09 OE Global MOOQ Interactive Workshop Results

Quality constructs Constructs Learners Designers Facilitators

Pedagogical Decisions X

Learning Objectives X X X

Duration & Structure X X

Duration & Interaction X

Learning Resources X X X

Learning Support X X X

Flexibility & Inclusion X X

Learning Progress X

Learning Environment X X

Learning Assessment X X X

Learning Certification X X

Design Process X

Online Facilitation X

Page 17: 2017-03-09 OE Global MOOQ Interactive Workshop Results

Stracke, C.M., 2016: “Openness for learning quality and change by Open Education in theory and practice - Overview, history, innovations and policies: How can Open Learning, OER and MOOCs achieve impact for learners, organizations and in society?” [in print]

ID ISO/IEC 19796-1 New ID Proposed Modification

NA Needs Analysis AANN AAnnaallyyssiiss

FA Framework Analysis

CD Conception / Design DDEE DDeessiiggnn

DP Development / Production PPRR PPrroodduuccttiioonn

IM Implementation

LP Learning Process LLEE LLeeaarrnniinngg

EO Evaluation/ Optimization EEVV EEvvaalluuaattiioonn

OOPP OOppttiimmiizzaattiioonn

Page 18: 2017-03-09 OE Global MOOQ Interactive Workshop Results

Stracke, C.M., 2016: “Openness for learning quality and change by Open Education in theory and practice - Overview, history, innovations and policies: How can Open Learning, OER and MOOCs achieve impact for learners, organizations and in society?” [in print]

Meso

Micro

Macro

Objectives Achievements

Realizations

AN

DE

PR

LE

OP

EV

Page 19: 2017-03-09 OE Global MOOQ Interactive Workshop Results

OE Quality Dimensions

Evaluation

Analysis

Implemen- tation

Learning process

Design

Learner

Page 20: 2017-03-09 OE Global MOOQ Interactive Workshop Results

Quality dimensions of OE in practice Dimension 1: Analysis Dimension 2: Design Dimension 3: Implementation Dimension 4: Learning Process Dimension 5: Evaluation & Optimization

OE Quality Dimensions

Page 21: 2017-03-09 OE Global MOOQ Interactive Workshop Results

Quality indicators for OE in practice For Dimension 1: For Dimension 2: For Dimension n:

OE Quality Indicators

Page 22: 2017-03-09 OE Global MOOQ Interactive Workshop Results

Quality indicators for analysis in OE (1): • Institutional purpose • Existing provisions • Target audiences • Technical limitations (front & back-end) • Learning needs • Licensing • Budget

OE D1: Analysis

Page 23: 2017-03-09 OE Global MOOQ Interactive Workshop Results

Quality indicators for analysis in OE (2): • Team and staff • Content expert • Reputation • Market analysis • Societal need • Inclusion • Long-term usage of the MOOC

OE D1: Analysis

Page 24: 2017-03-09 OE Global MOOQ Interactive Workshop Results

Quality indicators for design in OE: • LD/ID process to be followed (list of examples,

such as …) • Inclusion and accessability • Sustainable solution (wrt resources) • Pedagogical choices & learning theory • Re-usage of former courses & OER • Definition of success indicators

OE D2: Design

Page 25: 2017-03-09 OE Global MOOQ Interactive Workshop Results

Q. indicators for implementation in OE: • Project & time management • Infrastructure & tools • Experts & skills • Usability testing • Training & development for facilitators

OE D3: Implementation

Page 26: 2017-03-09 OE Global MOOQ Interactive Workshop Results

Quality indicators for learning in OE: • Usability questions & feedback from learners • Quality of communication from learners • Engagement from learners • Upfront workload when MOOC is starting • Learners‘ satisfaction • Achievement of learners‘ learning objectives • Achievement of designers‘ learning objectives • Achievement of providers‘ learning objectives

OE D4: Learning Process

Page 27: 2017-03-09 OE Global MOOQ Interactive Workshop Results

Quality indicators for evaluation in OE: • Completion rate • Satisfaction rate (learners‘, facilitators‘

and providers‘) • Achievement of learners‘ learning objectives • Achievement of designers‘ learning objectives • Achievement of providers‘ learning objectives • Learning analytics for evaluation of MOOC • Optimization of MOOC & Innovation

OE D5: Evaluation