1 Ken Hinckley Microsoft Research Collaborators: Mike Sinclair, Erik Hanson, Rick Szeliski, Matt Conway Disclaimer: • The devices demonstrated are research prototypes only and do not represent commitments by Microsoft to future products. • Opinions are Ken’s only and may not reflect the views of Microsoft, or anyone else for that matter The Future of the Mouse: An Illustrated Tour of Commercial & Research Mouse-like Input Devices
27
Embed
1 Ken Hinckley Microsoft Research Collaborators: Mike Sinclair, Erik Hanson, Rick Szeliski, Matt Conway Disclaimer: The devices demonstrated are research.
This document is posted to help you gain knowledge. Please leave a comment to let me know what you think about it! Share it to your friends and learn new things together.
Transcript
1
Ken HinckleyMicrosoft ResearchCollaborators: Mike Sinclair, Erik Hanson, Rick
Szeliski, Matt Conway
Disclaimer: • The devices demonstrated are research prototypes only and do not
represent commitments by Microsoft to future products.• Opinions are Ken’s only and may not reflect the views of Microsoft, or
anyone else for that matter
The Future of the Mouse: An Illustrated Tour of Commercial & Research Mouse-like Input Devices
2
The First Mouse
• 1968• Douglas Englebart & colleagues• Stanford Research Institute• Separate rollers for x, y
• Why has it endured for so long?
3
• Approx. as good as pointing with hand itself (Card)
• from Balakrishnan et al. CHI ’97:• Flexibility of grip – both power & precision
grasp• Stability – damps tremor, little overhead to
acquire • vs. stylus; slightly better for high-precision
tasks• Relative mode: limits footprint, no nulling
problem• Buttons integrated & orthogonal to sensed
plane• Dragging works well, no motion when you
click• Familiar, entrenched device; +10% not
enough
Some Desirable Properties of the Mouse
4
Illustrated Tour: Some Axes of Innovation in Computer Mice
• Strictly mouse-like form factors • other devices (tablet/pen, trackball, touchpad,
joystick) have advantageous properties, but not my focus today
• What has been explored for desktop mice?• What strategies are there to improve user
performance?• What has succeeded in the marketplace?• What are some interesting areas for the future?• What are some really silly ideas?
5
• Scrolling: save time to grab scrollbar; maintain visual focus on primary task• Wheel: MS IntelliMouse, Mouse Systems
• Isometric Joystick: IBM ScrollPoint I & II
• Touchpad: Fujitsu ScrollPad Mouse
• Better w/ left hand? (Buxton & Myers)• …
• PadMouse (Balakrishnan)• Gesture-based
command selection
Multi-Channel Inputfor Secondary Tasks
6
New Sensor & Connection Technologies
GyroPoint Microsoft IntelliEye /IntelliMouse Explorer
Wacom Intuos Pen ToolID
• Motion sensing via gyros, CCD camera• Cordless, unique ID • USB, higher DPI, sampling rate, …
• Pressure sensing• Tablet stylus for art software• Area-of-contact in touchpads• Mice: not as well-defined
point(s) of contact
16
• Sense hand contact via capacitance • New events: Touch, Release
• For Palm area • for button, wheel, thumb, …
• Goal: use touch as passive input modality for awareness
• Emulation from software...• Did user release mouse? Or just holding still?• Cannot emulate multiple sensors at all.• Cannot emulate on most non-mouse devices.
Touch-Sensing Devices
17
Integration with Keyboard
• IBM Trackpoint• Reduces device acquisition times• Tiny footprint• Less intuitive cursor control• Dragging problematic
• Other pointing devices in kbd• touchpad, trackball• e.g. Acer Ergo61 Ergonomic Keyboard
18
• Just having 2 cursors is a poor design• Mouse / tablet for scrolling +15%
(Buxton/Myers)• Camera Control & Docking in 3D
(Balakrishnan)• Camera control +20% faster• Supports epistemic actions
• Map Navigation (panning + zooming)
Use Both Hands: Two Mice are Better Than One?
19
Don’t Use Your Hands at All?
• Feet for input (Hunter Digital, I/O Test Inc.)
• Head mice, Eye gaze (Zhai: MAGIC pointing)• All of these have lower bandwidth than hand• Some utility for secondary tasks, disabled use
• Head tracking in games• Hands-busy situations
20
• “optimal” or nonlinear C:D ratio • Gain theoretically does not affect