Voice Driven User Interface Design

CEWIT 2013 Visual Computing – Voice Driven Computing User Interface Design

IPS Company Confidential- Contains confidential and proprietary intellectual property of IPS. Disclosure of the information contained herein to any third party is strictly prohibited.

Intelligent Product Solutions

WHO ARE WE?

UNRELENTING DEDICATION TO GREAT PRODUCT DESIGN.

THOUGHT THROUGH. REALLY.

JUST STRAIGHT TALK.

IPS Company Confidential- Contains confidential and proprietary intellectual property of IPS. Disclosure of the information contained herein to any third party is strictly prohibited.

Wearable Computing Market Trends

“ABI  Research forecasts the wearable computing device market will grow to 485 million annual device shipments by 2018.”  (ABIresearch, 2013)

“According  to IMS Research, the wearables market is poised to grow from 14 million devices shipped in 2011 to as many as 171 million units shipped by 2016.”  (Ballve, 2013)

IPS Company Confidential- Contains confidential and proprietary intellectual property of IPS. Disclosure of the information contained herein to any third party is strictly prohibited.

Evolution of Head Mounted Computers

1980’s Present

Motorola HC1

Vuzix Smart Glasses M100

IPS Company Confidential- Contains confidential and proprietary intellectual property of IPS. Disclosure of the information contained herein to any third party is strictly prohibited.

Evolution of Voice Driven Applications

• Automobiles

• Phone functions

• GPS navigation

• Media controls

• Radio controls

• General purpose computing for those in need

• Example: Voice activated GPS systems for the blind

• Smart phones

• Siri

• Google Voice

• Wearable computers

• Replaces mouse and keyboard

• Televisions?

• Replaces clunky remote

IPS Company Confidential- Contains confidential and proprietary intellectual property of IPS. Disclosure of the information contained herein to any third party is strictly prohibited.

Two Major Challenges w/ Speech Enabled UI

1. What are the features and are they obvious?? 2. Phrasing

IPS Company Confidential- Contains confidential and proprietary intellectual property of IPS. Disclosure of the information contained herein to any third party is strictly prohibited.

Voice Enabled UI on a Head Mounted Computer - Challenges

• Speech recognition engine personality • Environmental issues (Noise) • Varying accents • Processing different vocabulary • Visual cues to commands – “What  do  I  say?” • Application layout & UI • Voice optimized application workflow • Security

“View  Library” “Item  2” “Item  7”  

IPS Company Confidential- Contains confidential and proprietary intellectual property of IPS. Disclosure of the information contained herein to any third party is strictly prohibited.

SR Personality, Environmental (Noise), Accents, & Vocabulary

IPS Company Confidential- Contains confidential and proprietary intellectual property of IPS. Disclosure of the information contained herein to any third party is strictly prohibited.

Visual Cues – “What  Do  I  Say”?

1. Speech icon 2. Global Commands • “Main  Menu” • “View  Library” • “Get  Message” • “Camera  Feed” • “Request  Expert” • “Logout” • “Quit  Application”

3.  “My  Computer  Help

IPS Company Confidential- Contains confidential and proprietary intellectual property of IPS. Disclosure of the information contained herein to any third party is strictly prohibited.

Application Layout & UI Design Methods – UX Storyboarding

Storyboards are used to consider the system from a human - centered point of view.

Storyboards are used to consider the system from a human - centered point of view.

IPS Company Confidential- Contains confidential and proprietary intellectual property of IPS. Disclosure of the information contained herein to any third party is strictly prohibited.

Application Layout & UI Design Methods – UX Workflows

CAMERA LIBRARY

EXPERT SESSION

LOG IN Workflows are used to fully think the UI experience through

IPS Company Confidential- Contains confidential and proprietary intellectual property of IPS. Disclosure of the information contained herein to any third party is strictly prohibited.

Application Layout & UI Design Methods – UX Behavioral & Flow

The user experience is carefully considered by creating specific detailed use cases for real user goals.

The user experience is carefully considered by creating specific detailed use cases for real user goals. Content Specific

“View  Document”

Search by Voice Library: Levels 1-4

“Alpha,  Chapter…”

Final Selection “View Document”

Main Menu

“Item  3,  Item  7,       Item  5,  Item  3…”

IPS Company Confidential- Contains confidential and proprietary intellectual property of IPS. Disclosure of the information contained herein to any third party is strictly prohibited.

Application Layout & UI Design Methods – UX System Logic: Speech Recognition

Session workflow from the HC1 perspective.

Start Program

Log in to server

Connection successful

Expert Active Camera Active

Verify connectivity

to server

View Document

Real Time Session

Expert voice

connect

Video Streaming

Viewing Camera

Snapshot Saved

Video Recording

View Media

Wait for expert to connect

“Quit  application”

“Item  X”

“View  Library”

Pick machine to

view

“Request  Expert”

Online & waiting for command

“Take  snapshot”

“Camera  feed”

“Video  record”

“Log  out”

IPS Company Confidential- Contains confidential and proprietary intellectual property of IPS. Disclosure of the information contained herein to any third party is strictly prohibited.

Security

Creating a method to log into the system with voice as your only input

IPS Company Confidential- Contains confidential and proprietary intellectual property of IPS. Disclosure of the information contained herein to any third party is strictly prohibited.

Maturing The UI Over Time

ORIGINAL INTERMIDIATE FINAL

IPS Company Confidential- Contains confidential and proprietary intellectual property of IPS. Disclosure of the information contained herein to any third party is strictly prohibited.

Developing A Model That Spans Across Industries & Markets

VEHICLE REPAIR

MANUFACTURING

MILITARY MRO

EMERGENCY MEDICINE

UTILITIES

HOSPITAL

Category A (3)

Category B (2)

Category C (5)

Category D (13)

Category E (1)

Category F (22)

Category A (3)

Category B (2)

Category C (5)

Category D (13)

Category E (1)

Category F (22)

Category G (5)

Category H (11)

Category I (3)

Category J (6)

Category K (8)

Category L (16)

ABC COMPANY

IPS Company Confidential- Contains confidential and proprietary intellectual property of IPS. Disclosure of the information contained herein to any third party is strictly prohibited.

References

ABIresearch (2013).  “Wearable  Computing  Devices,  Like  Apple’s  iWatch,  Will  Exceed  485  Million  Annual  Shipments  by  2018.”  Online.  Available:  

https://www.abiresearch.com/press/wearable-computing-devices-like-apples-iwatch-will

Ballve,  M.  (2013).  “WEARABLE  COMPUTING:  Inside  The  New  Mobile  Market  That  Is  Taking  Shape.”  Online.  Available:

http://www.businessinsider.com/wearables-create-new-mobile-markets-2013-9