Page 1
Sentient Computing
Ubiquitous Computing visionComputing devices everywhere
Access to applications anywhere
Whatever is on hand is available
Sentient Computing visionUbiquitous Computing made context-aware
Physical context used for automatic control
Sensors and space are part of computing systems
Page 2
Programming With Space
The componentsNotions and representations of physical space
Data and computational models
Sensor information
User interface the real world
Page 3
Components for Programming With Space
Devices
Platforms
Sensors
Networks
+Architecture
Conduits
Page 4
Components for Programming With Space
Devices
Platforms
Sensors
+Architecture
Page 5
Sensors: Location Information
Containment– GSM, UMTS, broadband radio– Active badge
Proximity – Bluetooth, IrDA– PICOnet
Co-ordinate– GPS– Active bat
Page 6
Sensors: Location Information
Containment– GSM, UMTS, Broadband Radio– Active Badge
Proximity – Bluetooth, IrDA– PICOnet
Co-ordinate– GPS– Active bat
Page 7
Containment: Active Badge
Infra-Red Network 10 meter range
diffuse
room-scale location
Page 8
Sensors: Location Information
Containment– GSM, UMTS, Broadband Radio– Active Badge
Proximity – Bluetooth, IrDA– PICOnet
Co-ordinate– GPS– Active Bat
Page 9
Sensors: Location Information
Containment– GSM, UMTS, broadband radio– Active badge
Proximity – Bluetooth, IrDA– PICOnet
Co-ordinate– GPS– Active bat
Page 10
Ultrasonic Location System
Mobile transmitter (Bat)
Fixed receiversCeiling
Active BatsUltrasonic transponder
Measure pulse time-of-flight
Radio synchronised
Page 11
DSP Ceiling Array
25,000 MIPS to cover AT&T Laboratories Cambridge!
Page 12
Components for Programming With Space
Devices
Platforms
Sensors
Networks
+Architecture
Conduits
Page 13
Telephone318
Computer“Pumpkin”
Computer“Papaya” Person
“Mike”
Person“Pete”
Representing the Real World
Model real world as collection of objects
Computer“Plantain”
Person“Andy”
Follow-mePhonebook
MobileDesktop
Telephone241
Telephone217
CTIswitch
Resourcemonitor
Keyboardmonitor
Locationservice
Applications
Software objects
Sensors
– Objects maintain state using sensor data
– Applications query relevant sets of objects
Page 14
Data Model Visualisation
Page 15
Spatial Monitoring
Vague spatial facts formalised as geometric containment and overlapping relationships between spaces
X
M
‘X is holding the microphone M’‘X can be seen by
camera B but not by camera A’
A
B
X
Page 16
Spatial Indexing
Generates all positive/negative overlapping or containment events
thro
ug
hp
ut
(‘00
0 u
pd
ates
s-1)
1
3
2
4
population (‘000)10 20 30
non-overlapping spaces
overlapping spaces
Page 17
Putting It All Together
Move user’s desktop to screen in front of them
Visible
A
Visib
le
B
Visible
C
Callbacks
Registration+ve Containment (Andy)-ve Overlapping (Andy)
-ve Overlapping(Andy,”Visible B”)
CLEAR DESKTOP FROM B
-ve Overlapping(Andy,”Visible A”)
CLEAR DESKTOP FROM A
+ve Containment(Andy,”Visible B”)
MACHINE B: NOT IN USEMOVE DESKTOP TO B
+ve Containment(Andy,”Visible C”)MACHINE C: IN USE NO ACTION
Page 18
Example Applications
Corporate memoryRecord me / what’s around me
Annotate multimedia stream
Camera field-of-view
Flat display
Compositedisplay
“Plonk-and-play” systemsSpatial configuration determines logical
configuration
No need to know device IDs
Automatic personalisation
Page 19
Sentient Computing: New User Interfaces
Non-user interfaces!
Objects and people are cursors in the real-world of icons
Aural and visual feedback