10-09Zimm.ppt

Human Interfacewhere the bits meet the fleshbits meets eyes and earsTom ZimmermanIBM Almaden Research CenterSan Jose, [email protected] 2007Think beyond the box

Research Theme Transducers; Converting one thing into another User Interface, User Experience, First PersonHooking people to gadgetsBits Meet the FleshBits Meet Eyes & EarsTransducer ExamplesDance into Music (dance synthesizer, suction cup)Hand into Finger Spelling (DataGlove)Sound into Light (Singing Coach)

Violin Home Health Monitoring Contact MicroscopeVR Data Glove Personal Area Network Honda Smart SeatFantasy & Necessity Are the Mothers of Invention

Discrete EventsConverting continuous input into discrete events.

Continuous input examplesbrightness, sound level, pressure

Discrete output; 0/1, off/on, mouse click

Comparator- Ideal SignalSensor Continuous Input

Quantized DigitizedOutputThreshold

Sensor+_ThresholdDigital Output

Comparator- Real World SignalNoise in input causes output jitterthreshold

cross high for on cross low for off

Triggering Discrete Events with HysteresisContinuous Input (e.g. brightness, sound level, pressure)

Quantized/DigitizedOutputHigh threshold

Low thresholdHysteresis, playcross high for on cross low for off

TV Synth Interface

Hacking Remotes, Mice, KbdCircuit Board4066 Quad CMOS SwitchPhoto TransistorComparatorw/ hysteresis60 HzFilterMouseKeyboardIR RemoteSynthesizer TVSensor Signal Processing Switch

Mouse Sensors Microphone; Speaker Radiation Pattern Light; Water Ripple Tank Ultrasonics; Wavelength, Horn Radiation Pattern Temperature; Weather Station Wind speed; See Jet Stream, Car Aerodynamics Pressure Tilt Rpm Vibration Pendulum; Simple Harmonic Motion Acceleration; Seismograph, Earthquakes, Cars/Trucks Voltage Current Resistance Capacitance Magnetic field Electric field Left button Right button X direction X increment Y direction Y increment

1 to 100 Hz

Wireless Doorbell

Wireless Motion Detector

Working with Continuous Output

PowerGlove Protoype (VPL 1983)

DataGlove (Fiber Optic) Fiber Optic Polhemus Magnetic Flex Sensors Position & Orientation

sensorsourceYoung Harvill

Head Mounted Display(NASA 1986)

PowerGlove (Mattel 1987) Computer Data Entry And 1.3 Million SoldManipulation Apparatus And Method $89 Retail

The Spirit Chair (MIT 1994)Mediums use spirit cabinets to guide fieldsto contact spirits who make sounds ...

Data InData OutNear-Field Communication (MIT/IBM 1995)

Contagious Information (MIT 1995)7/11FredJanBill

Car Seat Sensor (NEC 1998)

Musical InstrumentsHuman ActionsMusical

InstrumentPitchAmplitudeTimbreDuration

Vocalizer (Breakaway 1981)

Singing Coach (Exploratorium 1990)

RePerformer (Zim/Wantman 1992)

Pen Input

Pen That Remembers Everything You Write (IBM 2000-2002)Premiere UI unobtrusive, low cognitive load, small, portable, quick, cheap

Universal any languagepopular input methodclassic form factorModelesstext, graphics, doodle comment on documentdirect manipulation

BUT hard to index, search, archive, distribute

Other Pen SystemsPDA; writing on plastic LCD; writing on glass

Tablet; invisible writing CrossPad; writing on 2 lbs.

Toy Pens

Battery (AAA)InkCPU and Flash MemoryCMOS ImagerLensNormal or dot code paperPen Research (IBM 2002)Ultrasonic OpticalIRDA

Electric Field Pen (IBM 1997)

Dynamic Signature VerificationSign and Go (2003) Biometric verification using handwriting cadence (timing) A means to electronically verify customer signatures Customer signs on a digital signature capture station Software checks signature against reference signatures and checks for major changes in signature

Biometrics

Classification of BiometricsPhysical Feature Iris, face, finger, hand, DNACan alter presentationBehavior Trait Signature, voice, gait, keystrokeCan change behavior

Identification & VerificationIdentificationWho am I?1:N matching (difficult, big search)Example: 100k customers @ 0.1% error = 100 errorsUse: Discover identity, Watch listsVerificationAm I who I claim to be?1:1 matching (easier)Requires identifier (not secure but unique)token (loyalty card) memory (phone number)Use: Verify identity

Performance MetricsFalse Accepts (FA) likelihood that someone may be falsely accepted bad guy gets inFalse Rejects (FR)likelihood that a genuine user may be rejected good guy gets rejected Lower the FA and FR, the better the system performanceAcceptance threshold trade-off FA to FREqual Error Rate when FA=FRFailure to enroll, Failure to acquireLight eyes (iris), thin skin (finger), simple/changing signature, noisy environment (voice)Need backup/alternativeExample FA=2% FR=1%2 out of 100 good customers get rejected1 out of 100 bad guy attempts get inIf 1 in 1000 customers are bad guys, 1 forgery per 100,000 transactions

Biometric Comparison* Equal Error Rate estimates for relative comparison only. Actual results are highly dependent on system design, equipment, user population and experience.

Tangible Programming

Logo Cards35mm slide holder

Students Programming With LOGO Playing Cards

Queuing and Scanning Programs into Computer

Programming Robots with Playing CardsThe Robosapian robot comes with a remote control to program robot movements.

The remote control is replaced with a deck of instruction cards and bar code reader.

Students choreograph movements by arranging the cards, then program the robot by scanning the cards with the bar code reader.

TelepresenceWhen you need to be there but you dont want to travel there

Dummy Head Electronics (IBM 2003)

Frame and HandleVGA CameraMegaPixel CameraTilt GimbleYaw MotorSpeaker PhoneBatteryTiny PC w/WLANEthernet AC PowerAnalog Phone LineEthernetDIGITAL HEAD BASE STATION (x-ray view) (100 m range to head)Digital Head Components

Techno HeadQVGA ScreenBinaural Mics20 W SpeakerSeat ClampDigital Camera

Head AppearancesStandards Committee Symposium Trade Show BoothBreakfast Keynote Board Meeting Talk Conference Panel

Shopping BuddyLocation-aware shopping cart provide real-time you are here navigation map and location-based content-driven offers such as coupons and recipes. Infrared ReceiverInfrared BeaconWireless (Bluetooth)Barcode ScannerWLAN

Museum Interfaces

Sizzling Jello

Bubble Machine

Bubble Strobe Machine

Questions???

Badge Computer (IBM 1998)

NZ Airport Travel Card (IBM 1998)PDA running XML Browser, linked by 802.11b WLAN

Multi-Function PDA (IBM 2001)Keypad overlayTouch Pad

Camera with 270 deg swivel Microphones/Structured LightFM antenna along perimeter Speakers802.11 WLAN antennas running along each sideColor Screen (no touch)

BioPDA Wireless Biometric TerminalIris CameraFace & Document CameraInfraRed Lights802.11b WLAN

Intel XScale Processor

Numeric KeypadField Replaceable Biometric Module

Symbol 8000 Handheld TerminalFingerprint Reader

Using the Biometric Wireless TerminalCapturing Face and IrisCapturing FingerprintLining up Iris Cameralines up and frames Face Camera

Continuous mobile networkingMicro Positioning System (MPS)Low cost and fast installationLow power RF mobile transceiversWall mounted powerline transceivers