Oulu University, FI / Lund University, SE /Ossiannilsson / ICDE 2011 / Beyond benchmarking of eL in HE Beyond benchmarking of e-learning in higher education
Beyond benchmarking of e-learning in higher education
Oulu University, FI / Lund University, SE /Ossiannilsson / ICDE 2011 / Beyond benchmarking of eL in HE
Footprints
W:www.lu.se,
www.oulu.fi
FB:Ebba Ossiannilsson
T:@EbbaOssian
Phone: +4670995448
S:http://www.slideshare.net/EbbaOssiann
Ebba OssiannilssonLund University, SE and Department Industrial Engineering and ManagementOulu University, FI
Oulu University, FI / Lund University, SE /Ossiannilsson / ICDE 2011 / Beyond benchmarking of eL in HE
Outline
• Benchmarking• The benchmarking projects• Working method• Excellence and quality criteria
Oulu University, FI / Lund University, SE /Ossiannilsson / ICDE 2011 / Beyond benchmarking of eL in HE
Oulu University, FI / Lund University, SE /Ossiannilsson / ICDE 2011 / Beyond benchmarking of eL in HE
PERSONALISATION
Wheeler, 3 May 010, UNESCO
Oulu University, FI / Lund University, SE /Ossiannilsson / ICDE 2011 / Beyond benchmarking of eL in HE
Learning in focus
Interpret
Search hReview
Network
Filter
Reflect
Create
Some rights reserved by vanhookc
Oulu University, FI / Lund University, SE /Ossiannilsson / ICDE 2011 / Beyond benchmarking of eL in HE
Benchmarking is a self-improvement tool allowing organisations to compare themselves with others regarding some aspects of performance, with a view to finding ways to improve current performance. Benchmarking deals with changes for quality enhancement but also with identification and implementation of areas of development. Benchmarking is a process that enables comparison of inputs, processes or outputs between institutions or within a single institution over time (UNESCO 2010)
Benchmarking is … a process operating within an organization [sic] with the objective of intentionally changing an existing state of affairs into a superior state of affairs. (Moriarty, 2008, p. 30).
…the ´locus´ of benchmarking lies between the current and desirable states of affairs and contributes to the transformation processes that realise these improvements. (Moriarty and Smallman, 2009, p. 484)
Some definitions
Oulu University, FI / Lund University, SE /Ossiannilsson / ICDE 2011 / Beyond benchmarking of eL in HE
Self evaluation for quality enhancement
benchmark-careers.com
Oulu University, FI / Lund University, SE /Ossiannilsson / ICDE 2011 / Beyond benchmarking of eL in HE
Determine what to benchmark
Form a benchmarking
team
Identify benchmarking
partners
Collect and analyse
benchmarking information
Take action
Ossiannilsson, E. (2011). Findings from European benchmarking exercises on e-learning: value and impact. CreativeEducation. 2(3): 208-219.
The Benhmarking process
Oulu University, FI / Lund University, SE /Ossiannilsson / ICDE 2011 / Beyond benchmarking of eL in HE
Benchmarking projects
• Study A EADTU, E-xcellence+
(5 out of 13 HEI , appr 175)
• Study B ESMU, Benchmarking eLearning exercise 2009 (6 cases with narratives)
Oulu University, FI / Lund University, SE /Ossiannilsson / ICDE 2011 / Beyond benchmarking of eL in HE
EADTU E-xcellence+
• A manual on quality assurance in e-learning covering the 33 benchmarks, with related indicators to the benchmarks, guidance for improvement and references to excellence performance.
• Assessors notes to provide a more detailed account of the issues and the approaches.
• The online tools; the Quick Scan and the Full Assessment.
Oulu University, FI / Lund University, SE /Ossiannilsson / ICDE 2011 / Beyond benchmarking of eL in HE
Services
Management
Products
Strategic managementProducts; Curriculum design, Course design, Course deliverySupport; Student and staff support
EADTU Benchmarks and indicators
Oulu University, FI / Lund University, SE /Ossiannilsson / ICDE 2011 / Beyond benchmarking of eL in HE
htt
p:/
/ww
w.e
adtu
.nl/
e-xc
elle
nce
lab
el
The Excellence project by the European Association of Distance Teaching Universities, EADTU
Services
Management
Products
Oulu University, FI / Lund University, SE /Ossiannilsson / ICDE 2011 / Beyond benchmarking of eL in HE
http://www.esmu.be/projects/94-benchmarking-elearning.html
Benchmarking e-learning in European universities
…exercise on e-learning launched in the spring of 2009…initiated by the University of Southern Denmark (SDU) and gathering a group of nine European universities. April 2009 - December 2009.…co-organised by ESMU and European Association of Distance Teaching Universities (EADTU; www.eadtu.nl), combined ESMU’s collaborative benchmarking approach (benchmarking through a comparative exercise of good practices between universities) and EADTU’s more individually-oriented approach. EADTU’s E-xcellence online tool, consisting of a set of 33 e-learning benchmarks, was used as a starting point to the benchmarking exercise
Oulu University, FI / Lund University, SE /Ossiannilsson / ICDE 2011 / Beyond benchmarking of eL in HE
Method
• Multiple case study strategy (Yin 2003)• Mixed method approach (Creswell & Clarke 2007)
• Study A (5 out of 13 institutions, appr. 175)
Study B (six case studie)
Oulu University, FI / Lund University, SE /Ossiannilsson / ICDE 2011 / Beyond benchmarking of eL in HE
Respondents E-excellence+ e-learning benchmarking exercise
Α Alpha xΒ Beta xΓ Gamma xΔ Delta xΕ Epsilon x Ζ Zeta x x
Respondents involved in the benchmarking projects, EADTU E-xcellence+ and the ESMU e-learning benchmarking exercise. Ossiannilsson, E. (2011). Findings from European benchmarking exercises on e-learning: value and impact. CreativeEducation. 3(2):208 .
Oulu University, FI / Lund University, SE /Ossiannilsson / ICDE 2011 / Beyond benchmarking of eL in HE
Benefitsself-assess institution
better understand the process
measure and compare
discover new ideas,
obtain data to support decision-making
set targets for improvement
strengthen institutional identity
enhance reputation
respond to national performance indicators and benchmarks
set new standards for the sector
van Vught et al., (2008). A practical guide. Benchmarking in European HE. ESMU
Oulu University, FI / Lund University, SE /Ossiannilsson / ICDE 2011 / Beyond benchmarking of eL in HE
ConclusionLong term
Short term
Individual Organisation
Oulu University, FI / Lund University, SE /Ossiannilsson / ICDE 2011 / Beyond benchmarking of eL in HE
Internal processes and involvement
Quality enhancement
Management and commitment.
Collaboration and networking
Cultural issues.
Attitudes
Added values
The concept of rhizome
Critical Reflection
The concept of becoming
Passion
Dedication
CourageCommitment
Involvement
Ubiquitous learning
(Deleuze & Guattari 1987)
Oulu University, FI / Lund University, SE /Ossiannilsson / ICDE 2011 / Beyond benchmarking of eL in HE
Rhizome perspectives• S
Oulu University, FI / Lund University, SE /Ossiannilsson / ICDE 2011 / Beyond benchmarking of eL in HE
Teambuilding
Dialogue
Transparency
Policy statement
Quality improvement and quality assurance
Some key findings on the use of EADTU benchmarking
QuickScan tool. Ossiannilsson (2011).
Benchmarking for quality enhancement
Oulu University, FI / Lund University, SE /Ossiannilsson / ICDE 2011 / Beyond benchmarking of eL in HE
Limitations
Who is involved?
Time?
Benchmarks?
Interpretations?
Language?
Commitment?
Oulu University, FI / Lund University, SE /Ossiannilsson / ICDE 2011 / Beyond benchmarking of eL in HE
Conclusions
• On values and impact of benchmarking eL
Impr
ovem
ents
Impr
ovem
ents
Oulu University, FI / Lund University, SE /Ossiannilsson / ICDE 2011 / Beyond benchmarking of eL in HE
Bild: Wikimedia Commons, Push the button, CC BY SA
The door isopen …
What next?
Terima kasih!