Developing a framework to evaluate usability in m-learning systems: Mapping Study and proposal

“Developing a framework to evaluate usability in m-learning systems: mapping study and proposal”

Christian NavarroAna I. Molina

Miguel A. RedondoSuperior school of Informatics

Salamanca, España.October 2014

Developing a framework to evaluate usability in m-learning systems: mapping study and proposal

Introduction

Motivation and general objectives

Systematic mapping study

Framework proposal for evaluations of

m-learning systems

Conclusions and future work

Contents

2


Introduction

Source: Ericsson mobility report

3

Cell phones are part of our daily live.


UNESCO- Mobile devices: platform to facilitate

educational equity throughout the different countries.

Introduction (Cont.)

4

M-learning


M-learning definition

- Quinn (2000)◦ “e-learning that takes place with the help of mobile

devices”

- O’Malley (2005)◦ “Learning that takes place when the learner takes

advantage of learning opportunities offered by mobile technologies”.

- Crompton (2013)◦ “learning across multiple contexts, through social and

content interactions, using personal electronic devices”.

Introduction (Cont.)

5

Focussed in the students and their learning process


Technologies with larger potential in the education area according to the NMC Horizon Report- Mobile devices (tablets)- MOOC (Massively Open Online Courses)- Game-based learning

◦ TechNavio predicts an increase of 15.6% in the period of 2012 to 2016.

Mobile Usability- Is a specialty in the usability field that is currently

emerging.- Mobile devices face big challenges, mostly in the

educational areas.

Motivation

◦Sensorization ◦Connectivity◦Portability

◦Screen size◦ Interaction styles ◦Capacity 6


Study the current state of m-learning and mobile usability research

Understand the current needs in m-learning

Propose a model/framework to evaluate the usability in m-learning applications

General Objectives

7


Total of papers found in the initial search (1085)

Systematic Mapping Study

Scopus Science Direct

ACM IEEE Xplore

0

100

200

300

400

500

600

700 623

198194

70

Nu

mb

er

of

pa

pe

rs

IEEE Xplore Scopus Science Direct

ACM

0

5

10

15

20

25 2221

14

11

Nu

mb

er

of

pa

pe

rs

Search Results

Number of relevant papers extracted from each Database (68)

8


Research question1- What is the current state of m-learning and mobile

usability research? (Considering only papers using mobile devices like Smartphones and Tablets). Is there an increase in the number of publications during the last years?


2006 2007 2008 2009 2010 2011 2012 2013

21

5

2

9

16

23

10

Nu

mb

er

of

pap

ers

Papers according to the date of publication9



10

Research question 2

- What are the different approaches for publications in the areas of m-learning

and usability?

- What type of mobile devices and operative systems are the most common according to these papers?


M-learning applications◦ The 40% are game-based applications ◦ Only 57% include usability tests

◦ 35% use heuristics or expert reviews


11

Elementary27%

Junior High10%

High school

3%

University43%

Master3%

Special educa-

tion7%

Adults7%

M-learning applications according to

the academic level

Types of mobile devices in m-learning.

Iphone31%

Ipad6%

Android Smartphone 47%

Android Tablet

3%

Win-dows Smar-

tphone6%

Tablet PC3% Java Cell phones

3%


Research question 2

- What are the different approaches for publications in the areas of m-learning

and usability?


12

Clasification 4

(papers that consider both m-learning and

usability)

Clasification 3

(different areas of development and evaluation)

Clasification 2

(Types of Guidelines and Frameworks)

Clasification 1

(different approaches)

Analyzed papers(68)

M-learning applications (30)

Guidelines and Frameworks (25)

Development Guidelines and

Frameworks (16)

- M- learning pps (5)

- M-learning

environments (4)

- MLMS (3)

- M-learning contents

(2)

- Mobile devices

contents (1)

- Mobile environments

(1)

- M- learning

environments (4)

- M-learning

applications(3)

- MLMS (3)

- M-learning

contents(2)

Evaluation Guidelines

and Frameworks

(9)

- Mobile applications (3)

- M-learning pplications

(2)

- Comercial m-learning

applications(1)

- Usability contents (1)

- M-learning devices(1)

- Mobile environments

(1)

- Mobile devices

evaluation(1)

Specific aspects of m-learning (9)

Analysis and tendencies of m-

learning (4)


Results and general conclusions

- There is a lack of evaluation tools for m-learning applications


The creation of an evaluation framework for m-learning applications, considering pedagogical usability and user interface usability.

Research proposal

13


Evaluation Framework Proposal

14

The framework is divided in two factors


15

Evaluation Framework Proposal The framework is divided in two factors


16

Evaluation Framework Proposal The framework is divided in two factors


Analysis - Recent growth in the m-learning research area- Lack of usability evaluation frameworks in m-

learning

We propose a m-learning framework- Based in

◦ Pedagogical aspects◦ UI Usability

- To be used for ◦ evaluation and development

Conclusions

17


Definition and validation of the evaluation Framework

Development of a software tool that will facilitate the evaluation

Propose this framework to be applied along with other methodologies for development

◦ Specifically for e-learning or m-learning

Future Work

18


Contact

Christian X. [email protected]

Developing a framework to evaluate usability in m-learning systems:

mapping Study and proposal

19

Developing a framework to evaluate usability in m-learning systems: Mapping Study and proposal

Education

learning pps

learning process

learning applications7

based learning technavio

learning definition

learningand usability

usability tests

usability field