TAUCHI – Tampere Unit for Computer-Human Interaction Development of the text entry self-training system for people with low vision Tatiana Evreinova Multimodal.

TAUCHI – Tampere Unit for Computer-Human Interaction

Development of the text entry Development of the text entry self-training system self-training system

for people with low visionfor people with low vision

Tatiana Evreinova

Multimodal Interaction Research Group

Tampere Unit for Computer-Human Interaction


ContentsContents

background (3)

earlier studies / phase 1 (1)

methodology (4)

results (5)

future investigation and applications (1)

earlier studies / phase 2 (2)

forthcoming research (1)

references (1)


ProblemsProblems

– screen magnification software reduces visual field,

evokes image distortion and eyes fatigue

– alternative keyboards cannot emulate habitual

combinations of QWERTY keyboard

– age-related diseases and disorders, most notably

diabetes, can devastate tactile sensitivity

– conventional peripheral displays are expensive devices

for consumer


GoalsGoals

– to develop multisensory approach at typing training by

combining tactile, kinesthetic and visual modalities

– to design the text-entry self-training system using a minimal

resources of the visual perception and natural anatomical

position of the fingers on the keyboard


Features of visual perceptionFeatures of visual perception

within paracentral area (±20º) color vision is existing

and could be used during the text-input process

http://www.yorku.ca/faculty/academic/pkaiser/eye/retdist.html


Earlier studies / Phase 1Earlier studies / Phase 1

a variant of the

compressed light code

was developed using one

two-color LED and its

stimulation through the

blinking dot on the screen


Modifications in Blinking alphabet Modifications in Blinking alphabet

Table 1 Two versions of letters – before and after modification

Letter1st color

unit2nd color

unit3rd color

unit4th color

unit1 2 3 4 5 1 2 3 4 5 1 2 3 4 5 1 2 3 4 5

E

L

M

T

W

E

L

M

T

W


ApparatusApparatus

the peripheral display

consists of only the single

light emitting diode, which

was coupled with the

glasses and placed close

to unfocused peripheral

position peripheral monitor in working condition


the keyboard and loudspeakers

were positioned on a

separate desk away from the

experimenter’s host machine in

special usability

laboratory

Testing (1/2)Testing (1/2)

experimental setup


subjects had two days practice

sessions prior data collection

formal experiment has taken

six days

Testing (2/2)Testing (2/2)

monitoring of the testing on the examiner side


Results / Text entry speed (1/2)Results / Text entry speed (1/2)

the average performance of the entry speed without training (first session)


Results / Text entry speed (2/2)Results / Text entry speed (2/2)

the average performance of the entry speed in the end of testing (sixth session)


Results / Error rateResults / Error rate

lowering of errors (%) with acquiring of the practice


Results / Dynamics of the typing trainingResults / Dynamics of the typing training

the total times of the test completion for whole experimental session (s)


Results / PreferencesResults / Preferences

Training mode

Rating through 6 experimental blocks

Visual feedback

3 4 6 6 6 7

Visual & speech feedback

12 12 12 11 10 10

– rating of the keyboard typing with visual feedback was

tending to increase to the end of the experimental session

– keyboard typing with visual and speech feedback was

constantly preferred through overall experimental blocks


Future investigation and applications Future investigation and applications

– development of wearable assistive devices and

educational applications for visually impaired typists

– a method for correction of the functional state through

color lateral stimulation


Earlier studies / Phase 2 (1/2)Earlier studies / Phase 2 (1/2)

– tactile pointer for 25 keys of the conventional keyboard

was implemented with using transparency film and

copper wire

– the textured pattern has well recognized tactile

markers: angles and lines

– virtual keys were grouped

and several positions were

destined to switch a state

of functional groups


Earlier studies / Phase 2 (2/2)Earlier studies / Phase 2 (2/2)

pilot experiments shown

that during blind

manipulations tactile

feedback allows to

facilitate detection of

different positions of touch

screensnapshot of the program


Forthcoming researchForthcoming research

– based on earlier studies tactile pointer for 15 keys of

the conventional keyboard was implemented

– the software for testing the structure of color patterns

during real time manipulations

with touch screen using

Tactile Pointer currently

under construction

– pilot experiments are planned


ReferencesReferences

[1] Evreinova, T., Evreinov, G., Raisamo, R.

Communication system for the people who are deaf or

have low vision. Proceedings of the HANDICAP2002,

Paris - Porte de Versailles, June 2002, pp. 137-143.

[2] Evreinov, G., Raisamo, R. Tactile Pointer for

Touchscreen Manipulations. Proceedings of the

HANDICAP 2002, Paris - Porte de Versailles, June 2002,

pp. 115-120.

TAUCHI – Tampere Unit for Computer-Human Interaction Development of the text entry self-training system for people with low vision Tatiana Evreinova Multimodal.

Documents