Mitsubishi Electric Research Labs Raskar, Beardsley, vanBaar, Wang, Dietz, Lee, Leigh, Willwacher R F I G Lamps Ramesh Raskar, Paul Beardsley, Jeroen van Baar, Yao Wang, Paul Dietz, Johnny Lee, Darren Leigh, Thomas Willwacher R F I R F I G G Lamps Lamps : : Interacting with a Self-describing World Interacting with a Self-describing World via Photosensing Wireless Tags and via Photosensing Wireless Tags and Projectors Projectors
50
Embed
Mitsubishi Electric Research Labs Raskar, Beardsley, vanBaar, Wang, Dietz, Lee, Leigh, Willwacher R F I G Lamps Ramesh Raskar, Paul Beardsley, Jeroen van.
This document is posted to help you gain knowledge. Please leave a comment to let me know what you think about it! Share it to your friends and learn new things together.
Transcript
Mitsubishi Electric Research LabsRaskar, Beardsley, vanBaar, Wang, Dietz,
Lee, Leigh, WillwacherR F I G Lamps
Ramesh Raskar, Paul Beardsley, Jeroen van Baar, Yao Wang,
Paul Dietz, Johnny Lee, Darren Leigh, Thomas Willwacher
Mitsubishi Electric Research Labs (MERL), Cambridge, MA
R F I R F I GG Lamps Lamps : : Interacting with a Self-describing World Interacting with a Self-describing World
via Photosensing Wireless Tags and via Photosensing Wireless Tags and ProjectorsProjectors
Mitsubishi Electric Research LabsRaskar, Beardsley, vanBaar, Wang, Dietz,
Lee, Leigh, WillwacherR F I G Lamps
Radio Frequency Identification Tags Radio Frequency Identification Tags (RFID)(RFID)
microchip
Antenna
No batteries,
Small size,
Cost few cents
Mitsubishi Electric Research LabsRaskar, Beardsley, vanBaar, Wang, Dietz,
Lee, Leigh, WillwacherR F I G Lamps
WarehousingWarehousing
RoutingRouting
Library Library
Baggage
handling
Baggage
handling
CurrencyCurrency
Livestock trackingLivestock tracking
Mitsubishi Electric Research LabsRaskar, Beardsley, vanBaar, Wang, Dietz,
Lee, Leigh, WillwacherR F I G Lamps
Micro Controller
Memory Computer
READER
Micro Controller
Memory
Conventional Passive RFID
Mitsubishi Electric Research LabsRaskar, Beardsley, vanBaar, Wang, Dietz,
Lee, Leigh, WillwacherR F I G Lamps
Tagged Books in a LibraryTagged Books in a Library
Id List of books in RF range
No Precise Location Data Are books in sorted order ?Which book is upside down ?
Mitsubishi Electric Research LabsRaskar, Beardsley, vanBaar, Wang, Dietz,
Lee, Leigh, WillwacherR F I G Lamps
Where are boxes with Where are boxes with Products close to Expiry Date ?Products close to Expiry Date ?
Mitsubishi Electric Research LabsRaskar, Beardsley, vanBaar, Wang, Dietz,
Lee, Leigh, WillwacherR F I G Lamps
READER
Micro Controller
RF Data
Memory
Conventional RFID
Computer
READER
Micro Controller
RF Data
Light
Memory
Photosensor
Computer
Conventional RF tag
Photo-sensing RF tag
Mitsubishi Electric Research LabsRaskar, Beardsley, vanBaar, Wang, Dietz,
Lee, Leigh, WillwacherR F I G Lamps
READER
Projector Micro
Controller RF Data
Light
Memory
Photosensor
Computer
Photosensor ?
Compatible with RFID size and power needs
Projector ?
Directional transfer,AR with Image overlay
Mitsubishi Electric Research LabsRaskar, Beardsley, vanBaar, Wang, Dietz,
Lee, Leigh, WillwacherR F I G Lamps
b. Tags respond with date and precise (x,y) pixel location, Projector beams ‘Ok’ at that location
b. Tags respond with date and precise (x,y) pixel location, Projector beams ‘Ok’ at that location
a. Photosensing RFID tagsare queried via RF
a. Photosensing RFID tagsare queried via RF
c. Multiple users can simultaneously work from a distance without RF collision
c. Multiple users can simultaneously work from a distance without RF collision
Mitsubishi Electric Research LabsRaskar, Beardsley, vanBaar, Wang, Dietz,
Lee, Leigh, WillwacherR F I G Lamps
Mitsubishi Electric Research LabsRaskar, Beardsley, vanBaar, Wang, Dietz,
Lee, Leigh, WillwacherR F I G Lamps
RFID
(Radio Frequency Identification)
RFIG
(Radio Frequency Id and Geometry)
Mitsubishi Electric Research LabsRaskar, Beardsley, vanBaar, Wang, Dietz,
Lee, Leigh, WillwacherR F I G Lamps
Prototype TagPrototype Tag
RF tag + photosensor
RF tag + photosensor
Mitsubishi Electric Research LabsRaskar, Beardsley, vanBaar, Wang, Dietz,
Mitsubishi Electric Research LabsRaskar, Beardsley, vanBaar, Wang, Dietz,
Lee, Leigh, WillwacherR F I G Lamps
Find tag location using
handheld Projector
Find tag location using
handheld Projector
Photosensing
Wireless Tags
Photosensing
Wireless Tags
Many geometric ops Many geometric ops
R F I R F I R F I DR F I D
Interactive stabilized projection
Interactive stabilized projection
(Radio Frequency Id & (Radio Frequency Id & GeometryGeometry))GG
Mitsubishi Electric Research LabsRaskar, Beardsley, vanBaar, Wang, Dietz,
Lee, Leigh, WillwacherR F I G Lamps
(End of Presentation)(End of Presentation)
Mitsubishi Electric Research LabsRaskar, Beardsley, vanBaar, Wang, Dietz,
Lee, Leigh, WillwacherR F I G Lamps
Towards Passive RFIDTowards Passive RFID• Photosensor
– Most compatible with passive batteryless RFID– Power: near zero power for sensing– Size: Each photocell is tens of micrometer (smaller than RFID
which are about 500 micrometer)– Very low cost, can be built with silicon of RFID microchip– RFID+Photosensor can be size of grain of rice– RFIG tag is ‘visible’ to projector but not to humans– Current prototype uses battery because passive tags are difficult
to program
• Other possibilities– Adding a light emitting diode (LED)
• Requires on board power• Size has to be considerably large• Size and power requirements are high
Mitsubishi Electric Research LabsRaskar, Beardsley, vanBaar, Wang, Dietz,
Lee, Leigh, WillwacherR F I G Lamps
Future DirectionsFuture Directions
• Sophisticated tags• Light modulation
• Handheld projector
Mitsubishi Electric Research LabsRaskar, Beardsley, vanBaar, Wang, Dietz,
Lee, Leigh, WillwacherR F I G Lamps
Comparison with Bar-codesComparison with Bar-codes
• RFID– Barcodes take up more space– Long bit sequences– Multiple tags can be simultaneously read– Read distance is high
• RFIG– Multiple barcodes per object is cumbersome– Difficult to attach sensor (e.g. temperature)
Mitsubishi Electric Research LabsRaskar, Beardsley, vanBaar, Wang, Dietz,
Lee, Leigh, WillwacherR F I G Lamps
Locate Tags Precisely using a Locate Tags Precisely using a handheld scanner/projectorhandheld scanner/projector
•Handheld device
•Eliminates multiple RF readers for triangulation or large antennas
•Projector indicates location of tag
Illuminate tags with binary coded stripes with projector
Mitsubishi Electric Research LabsRaskar, Beardsley, vanBaar, Wang, Dietz,
Lee, Leigh, WillwacherR F I G Lamps
Photosensor added to RFID tags
Hybrid communication via RF and via light
Solve 3 main issues with conventional RFIDs
1. Locate tags precisely
2. Select a subset of tags for operation
3. Long distance operation without collision
Applications beyond inventory management
1. Warehouse: locate objects for specific queries
2. Training and maintenance: interactive augmented reality
3. Surveillance: keep trail of object locations
Mitsubishi Electric Research LabsRaskar, Beardsley, vanBaar, Wang, Dietz,
Lee, Leigh, WillwacherR F I G Lamps
2. Select subset of tags for operation2. Select subset of tags for operation
Advantages
•Only tags which are illuminated respond to queries
•No RF collision between multiple tags
•Projector also use as a display to indicate result of operation
Technique
•Illuminate subset of tags with flashlight or projector
3. Long distance operation without RF collision3. Long distance operation without RF collision
Mitsubishi Electric Research LabsRaskar, Beardsley, vanBaar, Wang, Dietz,
Lee, Leigh, WillwacherR F I G Lamps
Interactive ProjectionInteractive Projection
• Desktop like interaction– Cursor follows use motion– Center pixel is the pointer– Rest of the image is stabilized– Selection
• Image stabilization– Absolute: camera and inertial sensor– Relative: world markers
• Copy-paste– Camera captures texture during ‘copy’– Projection after geometric/photometric adaptation