Empirical Studies Pablo Romero Computer Science Department, IIMAS, UNAM [email protected] pablor/teaching/proyectoInvestigacion.

Empirical Studies

Pablo RomeroComputer Science Department,IIMAS, [email protected]://turing.iimas.unam.mx/~pablor/teaching/proyectoInvestigacion

An embodied view of flow 2 Pablo Romero, IIMAS, UNAM

This talk

The scientific method HCI and User Experience Flow Empirical studies The experiment The evaluation plan

An embodied view of flow 3 Pablo Romero, IIMAS, UNAM

The scientific method

Observation Question / Hypothesis Prediction Experimentation Analysis Reporting

An embodied view of flow 4 Pablo Romero, IIMAS, UNAM

What is HCI?

It has to do with quality of design from the user’s perspective

The study of interaction between people and digital systems

“Designing interactive products to support people in their everyday and working lives”

An embodied view of flow 5 Pablo Romero, IIMAS, UNAM

What HCI is not

Making the interface look pretty Only about desktop computers (and that

goes for computing as well!) Something you do if you can’t program Something that would be nice to do but

usually there’s no time for it

An embodied view of flow 6 Pablo Romero, IIMAS, UNAM

Usability goals

Effective to use Efficient to use Safe to use Have good utility Easy to learn Easy to remember how to use

An embodied view of flow 7 Pablo Romero, IIMAS, UNAM

Design principles

Visibility Feedback Constraints Consistency Affordance

An embodied view of flow 8 Pablo Romero, IIMAS, UNAM

Functionality, usability and user experience

An embodied view of flow 9 Pablo Romero, IIMAS, UNAM

Not sensible, but, oh, the joy of it!

“Beauty. Charm. Delight. Excitement. Ooh. Aah. Wow! Let me at it.

In the end the iPhone is like some glorious early-60s sports car. Not as practical, reliable, economical, sensible or roomy as a family saloon but oh, the joy…

The iPhone is a digital experience in the literal sense of the word. The user's digits roam, stroke, tweak, tweeze, pinch, probe, slide, swipe and tap across the glass screen forging a relationship with the device that is like no other.”

･ Stephen Fry, The Guardian, November 10 2007

An embodied view of flow 10 Pablo Romero, IIMAS, UNAM

User experience goals

– Satisfying - Rewarding– Fun - Support creativity– Enjoyable - Emotionally

fulfilling– Entertaining - Engaging– Helpful …and more– Motivating– Aesthetically pleasing

An embodied view of flow 11 Pablo Romero, IIMAS, UNAM

Flow or optimal experience

Deep and effortless concentration in the task at hand

Body an important part for a deeper and more inclusive concentration

An embodied view of flow 12 Pablo Romero, IIMAS, UNAM

The research question

Does the quality of the user’s experience increase when more parts of him or her are involved?

An embodied view of flow 13 Pablo Romero, IIMAS, UNAM

The relevance of attention

An embodied view of flow 14 Pablo Romero, IIMAS, UNAM

Multimodal analysis of challenges-skills balance

Focusing the physical and cognitive aspects of a person on the same activity will help promote flow episodes more effectively than only considering one of those aspects

Focusing the physical and cognitive aspects of a person on the same activity will help promote flow episodes more effectively than only considering one of those aspects

Preliminary study Develop game Evaluation

An embodied view of flow 15 Pablo Romero, IIMAS, UNAM

Empirical Studies

Test hypotheses to discover new knowledge by investigating the relationship between two or more things – i.e., variables– Independent variable: aspects of a user

(intellectual, physical)– Dependent variable: experience of a user (flow)

Typically compare two or more conditions looking for significant differences

An embodied view of flow 16 Pablo Romero, IIMAS, UNAM

The preliminary study

Two groups– With a count (physical-

intellectual)– As is (physical)

Asking– How well were you

concentrating?– Was it hard to

concentrate?

An embodied view of flow 17 Pablo Romero, IIMAS, UNAM

En este momento me siento

An embodied view of flow 18 Pablo Romero, IIMAS, UNAM

En este momento me siento

An embodied view of flow 19 Pablo Romero, IIMAS, UNAM

Al momento de jugar el juego

An embodied view of flow 20 Pablo Romero, IIMAS, UNAM

Al momento de jugar el juego

An embodied view of flow 21 Pablo Romero, IIMAS, UNAM

Al momento de jugar el juego (cont)

An embodied view of flow 22 Pablo Romero, IIMAS, UNAM

Si comparas las dos versiones del juego

An embodied view of flow 23 Pablo Romero, IIMAS, UNAM

El experimento

Each one run 4 experimental sessions– 2 with count– 2 without

Materials at– http://turing.iimas.unam.mx/~pablor/teaching/

proyectoInvestigacion/Experimento.html

An embodied view of flow 24 Pablo Romero, IIMAS, UNAM

Analysis and reporting

Compare the scores of the two conditions applying a statistical test looking for statistical significance

Write the paper describing the experiment and its results

Send to ACM SIGCHI Conference on Human Factors in Computing Systems (CHI-2012)

An embodied view of flow 25 Pablo Romero, IIMAS, UNAM

Developing and evaluating the game

The preliminary study will inform development

Activity more integrated Evaluation

– At Universum– Taking physiological

data into account

An embodied view of flow 26 Pablo Romero, IIMAS, UNAM

Further work

Embodied view of flow in other domains Discriminating captive, effortful and

effortless attention Effortless attention: narrow or wide? Flow and addictions