Jeffrey Nichols User Interface Software & Technology (UIST) October 30, 2002 Slide #1 Jeffrey Nichols and Brad A. Myers Carnegie Mellon University October 30, 2002 Generating Remote Control Interfaces for Complex Appliances The Fifteenth Annual Symposium on User Interface Software & Technology (UIST) 2002 Paris, France
27
Embed
Jeffrey Nichols User Interface Software & Technology (UIST) October 30, 2002 Slide #0 Jeffrey Nichols and Brad A. Myers Carnegie Mellon University October.
This document is posted to help you gain knowledge. Please leave a comment to let me know what you think about it! Share it to your friends and learn new things together.
Transcript
Jeffrey Nichols User Interface Software & Technology (UIST) October 30, 2002 Slide #� � � 1
Jeffrey Nichols and Brad A. MyersCarnegie Mellon UniversityOctober 30, 2002
Generating Remote Control Interfaces for Complex Appliances
The Fifteenth Annual Symposium on User Interface Software & Technology (UIST) 2002 Paris, France
Jeffrey Nichols User Interface Software & Technology (UIST) October 30, 2002 Slide #� � � 2
The Problem
Appliances are too complex
Jeffrey Nichols User Interface Software & Technology (UIST) October 30, 2002 Slide #� � � 3
The Problem, cont.
Each complex appliances has its own idiosyncratic interface! Stereo systems Telephones VCRs Alarm Clocks …
Increasingly Computerized
Low Usability
Jeffrey Nichols User Interface Software & Technology (UIST) October 30, 2002 Slide #� � � 4
Our Solution
Separate the interface from the appliance!
Handheld becomes personal universal controller (PUC)Key Features
Interface-independent appliance specification Automatic generation of GUI and speech interfaces
Specifications
Control
Feedback
Jeffrey Nichols User Interface Software & Technology (UIST) October 30, 2002 Slide #� � � 5
Automatic Generation of UIs
Benefits All interfaces consistent for the user
With conventions of handheld Even from multiple manufacturers
Addresses hotel alarm clock problem!
Multiple modalities (GUI + Speech UI)
Can take into account user preferences
Will work on special purpose devices (for disabled)
Jeffrey Nichols User Interface Software & Technology (UIST) October 30, 2002 Slide #� � � 6
Important Work By Others INCITS V2 Standardization Effort
Alternative Interface Access Protocol (AIAP)[Zimmermann, CHI 2002]
User Interface Modeling Language (UIML)http:/www.uiml.org/
Jeffrey Nichols User Interface Software & Technology (UIST) October 30, 2002 Slide #� � � 17
Generating Speech Interfaces
Automatically build USI tree from dependencies Allows verbal navigation of functional groups
Automatically generate grammar for parser Phrases for query and control
“What is playmode?”“Set playmode to play”“play”
Automatically generate language model and pronunciation for recognizer
Jeffrey Nichols User Interface Software & Technology (UIST) October 30, 2002 Slide #� � � 18
Controlling Appliances
We have built adaptors for many actual appliances
Sony Digital Camcorder X10 Lighting Audiophase Shelf Stereo AudioReQuest MP3 player Software Media Players (WinAmp, WMP)
Written specifications for others Elevator Telephone/Answering Machine
Jeffrey Nichols User Interface Software & Technology (UIST) October 30, 2002 Slide #� � � 19
Demonstration
Jeffrey Nichols User Interface Software & Technology (UIST) October 30, 2002 Slide #� � � 20
Future Work Improve quality of generated user interfaces
Back-tracking, etc.
Specification and generation of list interfaces Necessary for many appliances
Adaptive interface generation New interfaces modeled on past interfaces
General purpose appliance adaptor for HAVi and UPnP protocols
Jeffrey Nichols User Interface Software & Technology (UIST) October 30, 2002 Slide #� � � 21
Acknowledgements
PUC Project Members Brad A. Myers Michael Higgins Joseph Hughes Thomas K. Harris Roni Rosenfeld Mathilde Pignol Stefanie Shriver Peter Lucas Kevin Litwack
Funding National Science Foundation Pittsburgh Digital
Greenhouse Microsoft
Equipment Grants Mitsubishi (MERL) VividLogic Symbol Technologies Hewlett-Packard Lucent
Jeffrey Nichols User Interface Software & Technology (UIST) October 30, 2002 Slide #� � � 22
User Interface Software & Technology (UIST)October 30, 2002