Practical AT session 1 WP4-D4.2. Prepared by: Shams Eldin Mohamed Ahmed Hassan Tools for Facilitating ICT Access.

Practical AT session 1

WP4-D4.2.

Prepared by: Shams Eldin Mohamed Ahmed Hassan

Tools for Facilitating ICT Access

Agenda• Assistive Technology Definition

• Assistive Technology Assessment

• Assistive Technology Accessibility

• Assistive Technology Adaptability and Personalization

• Speech recognition tools

• Special keyboards

• Alternative Input Devices

Assistive Technology Definition

• It usually refers to the devices or services aimed at compensating for functional limitations, facilitating independent living, or enabling older people or disabled people with activity limitations to realize their full potential. • In the context of SWING, we focus on ICT AT. Information

Communication Technology drives Assistive Technology.

Assistive Technology Definition

• Assistive technology is an umbrella term that includes assistive, adaptive, and rehabilitative devices for people with disabilities and also includes the process used in selecting, locating, and using them.• Assistive technology promotes greater independence by enabling

people to perform tasks that they were formerly unable to accomplish, or had great difficulty accomplishing, by providing enhancements to, or changing methods of interacting with, the technology needed to accomplish such tasks.

Assistive Technology Definition

AT is a system• An AT solution is not a single tool or piece of equipment. Most of time it’s

a system composed by different tools, services and skills that interact togheter.

• AT should not be seen as the end itself. How the technology is used is more important than the technology itself. In some situations AT may not be the solution.

• Above all, then, solutions need to be appropriate. That is because appropriate solutions are personalized solutions. An appropriate solution is one that is within the everyday reach of the user and that is fundable, usable, and acceptable to the user across a range of environments.

Assistive Technology Definition

AT are mediators (between the person and the context) Disability is always an interaction between features of the person and

features of the overall context in which the person lives. Within this interaction AT can be either barriers or facilitators (ICF model)

IMPAIRMENTS Body Funcitions and Structures (ICF)

ACTIVITY LIMITATIONS PARTICIPATION RESTRICTIONSActivities and Participations Domains (ICF)

AT TOOLS Contextual and environmental Factors(Barriers or facilitators, ICF)

REDUCTION PROMOTION

ICT tools and services Used by students with disabilities in order to perform learning

activities and participate to university life. Used by academic staff for their teaching activities and that can be

useful for students with disabilities. Used by administrative staff in order to provide university facilities

and that can be useful for students with disabilities

AT Assessment

• 1. Evaluation of AT related students needs• The needs of the student, the student's environments within which technology will be

used, the attitudes and expectations of the student and people significant to the student should be taken into account during assessment and support of AT (compatibility and sustainability)

• 2. ICF’s based checklist as a tool for AT assessment:• a) Identifying student’s needs in relation with University domains of activities and

participation (e.g. Lessons, Studying, Exams, Social engagement, Orientation)• b) Within these domains, pinpoint existent facilitators and barriers (e.g. environment,

tools, resources, network) in different contexts (e.g. university classroom, student dormitory, library, canteen, etc.)

• c) Identifying possible appropriated AT solutions (e.g. ICT devices; mobility, hearing and visual aids, etc)

Assistive Technology Accessibility

1. AT are interfaces (between human and environment)Every AT solution is a combination of hard and software interfaces (e.g. icons, buttons, visual and sound feedback, etc). Accessibility depends on design and interaction of these interfaces.2. Universal DesignThe most pertinent definition on universal design today is put forward by the United Nations (UN) Convention on the Rights of Persons with Disabilities.“Universal design” means the design of products, environments, programs and services to be usable by all people, to the greatest extent possible, without the need for adaptation or specialized design.

Assistive Technology Accessibility

3. There are seven principles of Universal Design• Equitable Use: The design is useful and marketable to people with diverse abilities. • - Flexibility in Use: The design accommodates a wide range of individual

preferences and abilities. • - Simple and Intuitive Use: Use of the design is easy to understand, regardless of

the user’s experience, knowledge, language skills, or current concentration level. • - Perceptible Information: The design communicates necessary information

effectively to the user, regardless of ambient conditions or the user’s sensory abilities.

• - Tolerance for Error: The design minimises hazards and the adverse consequences of accidental or unintended actions.

Assistive Technology Accessibility

• 3. The seven principles of Universal Design • - Low Physical Effort: The design can be used efficiently and

comfortably with minimum fatigue. • - Size and Space for Approach and Use: Appropriate size and space is

provided for approach, reach, manipulation, and use regardless of the user’s body size, posture, or mobility.

Assistive Technology Adaptability and Personalization

• AT could be invented and modified with the user involvement (User Centered Design). Students with disabilities can design workarounds, ways of overcoming the flaws of existing devices.

• Technological innovation should be intended not only as achievement of new products but also as new patterns, new ways of employing technological devices that already exist.

Speech recognition tools

• the new PC power tool• In computer science and electrical engineering, speech recognition (SR) is the

translation of spoken words into text. It is also known as "automatic speech recognition" (ASR), "computer speech recognition", “speaker identification”, or just "speech to text" (STT).• Some SR systems use "speaker-independent speech recognition"[1] while others

use "training" where an individual speaker reads sections of text into the SR system. These systems analyze the person's specific voice and use it to fine-tune the recognition of that person's speech, resulting in more accurate transcription. Systems that do not use training are called "speaker-independent" systems. Systems that use training are called "speaker-dependent" systems.

Speech recognition tools Applications

• In-car systems• Health care (Medical documentation-Therapeutic use)• Military (Military-Helicopters-Training air traffic controllers)• Telephony and other domains• Usage in education and daily life• People with disabilities• Further applications(Robotics-Video games ….. etc)

Models, methods, and algorithms

• Neural networks• Deep Neural Networks and Other Deep Learning Models• Online Dictation https://dictation.io/

SoftwareApplication name Description

Dragon Dictate Mac OS and Windows

MacSpeech Dictate Medical Medical dictation product

Macspeech Dictate Legal Legal-focused dictation

Speech Assistant Provides communication between customers and employees.

iListen PowerPC Macintosh

Speakable items Included with Mac OS

ViaVoice IBM Product. Support ended 2007.

Voice Navigator Original GUI voice control (1989)

TalkText Adds the convenience of converting voicemail to text to all your business locations and for everyone in your company.

iSpeech Translator Mobile app that recognizes speech by sound or text and can translate from web pages, communications, and more.

Dragon NaturallySpeaking

• is a speech recognition software package developed by Dragon Systems of Newton, Massachusetts, and later acquired by Nuance Communications. It runs on Windows personal computers. The most recent package is version 13, which supports 32-bit and 64-bit editions of Windows 7and 8. The Mac OS version is called DragonDictate or Dragon for Mac.

Features

• NaturallySpeaking uses a minimal user interface• The software has three primary areas of functionality1. Dictation2. text-to-speech 3. command input• Dragon NaturallySpeaking 12 is available in the following languages• US English-UK English-French-German-Italian-Spanish-Dutch-Japanes• And Arabic

Alternative Input Devices

• Alternative input devices allow individuals to control their computers through means other than a standard keyboard or pointing device. Examples include:• Alternative keyboards—featuring larger- or smaller-than-standard

keys or keyboards, alternative key configurations, and keyboards for use with one hand.• Electronic pointing devices—used to control the cursor on the screen

without use of hands. Devices used include ultrasound, infrared beams, eye movements, nerve signals, or brain waves.

Alternative Input Devices

• Joysticks—manipulated by hand, feet, chin, etc. and used to control the cursor on screen.• Trackballs—movable balls on top of a base that can be used to move

the cursor on screen.• Foot Mouse

Alternative Input Devices

• Touch screens—allow direct selection or activation of the computer by touching the screen, making it easier to select an option directly rather than through a mouse movement or keyboard. Touch screens are either built into the computer monitor or can be added onto a computer monitor.

Special keyboards

1. Alternative Keyboards including keyboards with large, color-coded keys, oversized keyboards, unique keyboard layouts and keyboard protection.

2. On-screen keyboards provide alternatives for special needs users with severe physical disabilities who are unable to use a standard keyboard. These computer aids provide a customizable keyboard on the computer screen and some include scanning and switch accessible input.

Alternative Input Devices

• No Hands Mouse Allow complete, hands-free computer control through natural head movements with the reliable and accurate No Hands Mouse alternative.

Thank you