Designing with Sensors: Creating Adaptive Experiences #ParisWeb @xgmedia
Designing with Sensors: Creating Adaptive Experiences
#ParisWeb@xgmedia
@xgmediaAvi Itzkovitch UI/UX Designer
What is Adaptive Design?
Responsive Design
Adaptive Design
Minority Report
2002
2007
Homing Device 2007
First iPhone 2007
2013
Examples?
GARMIN Zumo 660 Day and Night Interface
Google Now
Public transit
When you’re near a bus stop or a
subway station, Google Now tells you
what buses or trains are next.
Next appointment
Get a notification for when you should
leave to your next appointment. Based
on synced calendars and current location.
“The most profound technologies are those that disappear.
They weave themselves into the fabric of everyday life until
they are indistinguishable from it.”
Ubiquitous Computing
Mark Weiser
Nest, The Learning Thermostat
TEMPERATURE AND
HUMIDITY SENSOR
WI-FI ANTENNA
NEAR-FIELD MOTION SENSOR
FAR-FIELD MOTION SENSOR
AMBIENT LIGHT SENSOR
TEMPERATURE SENSOR
RADIO - Connects with home Wi-Fi network
WHAT IS AN ADAPTIVE
SENSOR?
Accelerometer
Accelerometer
• Geophone
• Hydrophone
• Lace Sensor a guitar
pickup
• Microphone
• Seismometer
• Breathalyzer
• Carbon dioxide sensor
• Carbon monoxide
detector
• Catalytic bead sensor
• Chemical field-effect
transistor
• Pellistor
• pH glass electrode
• Potentiometric sensor
• Redox electrode
• Smoke detector
• Zinc oxide nanorod
sensor
• Current sensor
• Electroscope
• Galvanometer
• Hall effect sensor
• Hall probe
• Magnetic anomaly
detector
• Magnetometer
• MEMS magnetic field
sensor
• Metal detector
• Planar Hall sensor
• Radio direction finder
• Voltage detector
• Seismometers
• Snow gauge
• Soil moisture sensor
• Stream gauge
• Electrochemical gas
sensor
• Electronic nose
• Electrolyte–insulator–
semiconductor sensor
• Fluorescent chloride
sensors
• Holographic sensor
• Hydrocarbon dew point
analyzer
• Hydrogen sensor
• Hydrogen sulfide sensor
• Infrared point sensor
• Ion-selective electrode
• Nondispersive infrared
sensor
• Microwave chemistry
sensor
• Nitrogen oxide sensor
• Olfactometer
• Optode
• Oxygen sensor
• Actinometer
• Bedwetting alarm
• Ceilometer
• Dew warning
• Electrochemical gas
sensor
• Fish counter
• Frequency domain sensor
• Gas detector
• Hook gauge
evaporimeter
• Humistor
• Hygrometer
• Leaf sensor
• Pyranometer
• Pyrgeometer
• Air flow meter
• Anemometer
• Flow sensor
• Gas meter
• Mass flow sensor
• Water meter
• Bubble chamber
• Cloud chamber
• Geiger counter
• Neutron detection
• Particle detector
• Scintillation counter
• Scintillator
• Wire chamber
• Air speed indicator
• Altimeter
• Attitude indicator
• Depth gauge
• Fluxgate compass
• Gyroscope
• Inertial navigation system
• Inertial reference unit
• Magnetic compass
• MHD sensor
• Ring laser gyroscope
• Turn coordinator
• Variometer
• Vibrating structure
gyroscope
• Yaw rate sensor
• Photoswitch
• Phototube
• Scintillometer
• Shack-Hartmann
• Single-photon avalanche
diode
• Superconducting
nanowire
• Accelerometer
• Auxanometer
• Capacitive displacement
sensor
• Capacitive sensing
• Free fall sensor
• Gravimeter
• Gyroscopic sensor
• Inclinometer
• Integrated circuit
piezoelectric sensor
• Laser rangefinder
• Laser surface velocimeter
• LIDAR
• Linear encoder
• Linear variable differential
transformer (LVDT)
• Liquid capacitive
inclinometers
• Odometer
• Photoelectric sensor
• Piezoelectric
accelerometer
• Position sensor
• Rate sensor
• Rotary encoder
• Rotary variable
differential transformer
• Selsyn
• Sudden Motion Sensor
• Tilt sensor
• Tachometer
• Ultrasonic thickness
gauge
• Variable reluctance
sensor
• Velocity receiver
• single-photon detector
• Charge-coupled device
• Colorimeter
• Contact image sensor
• Electro-optical sensor
• Flame detector
• Infra-red sensor
• Kinetic inductance
detector
• LED as light sensor
• Light-addressable
potentiometric sensor
• Nichols radiometer
• Fiber optic sensors
• Optical position sensor
• Photodetector
• Photodiode
• Photomultiplier tubes
• Phototransistor
• Photoelectric sensor
• Photoionization detector
• Photomultiplier
• Photoresistor
• Bourdon gauge
• Hot filament ionization
gauge
• Ionization gauge
• McLeod gauge
• Oscillating U-tube
• Permanent Downhole
Gauge
• Piezometer
• Pirani gauge
• Pressure sensor
• Pressure gauge
• Tactile sensor
• Time pressure gauge
• Thermistor
• Thermocouple
List of sensors http://en.wikipedia.org/wiki/List_of_sensors
Camera
Samsung GALAXY S
Email Address
API
Gender
Age
Hobbies
Time and Date
“Songza is a simple
answer to a tough
question: what should
I listen to right now?”
WHAT IS THE PROBLEM?
Using sensors to solve a problem
TEMPERATURE AND
HUMIDITY SENSOR
WI-FI ANTENNA
NEAR-FIELD MOTION SENSOR
FAR-FIELD MOTION SENSOR
AMBIENT LIGHT SENSOR
TEMPERATURE SENSOR
RADIO - Connects with home Wi-Fi network
Wattbox Heating Control
Tado - The geolocation app for your heating
CONTEXT FOR ADAPTIVITY
Context is not just the location.
Temporal Constraints
How much time is available for shopping
Time and Date
Boxing Day or Monday afternoon
Physiological and Emotional State
Whether user is enjoying shopping or not
Yoram M Kalman, Ph.D. HCI Markers is a new term suggested for an emerging concept of using data created
during human computer interaction to identify changes in the cognitive, mental,
psychological or physiological state of the user.
Spatial Environment
Which products are nearby
AislePhoneLocation based shopping. Precise In-Store Positioning
Estimote BeaconsA small, wireless device, sometimes also called a ‘mote’. When placed in
a physical space, it broadcasts tiny radio signals around itself.
BCM4752Broadcom introduces new GPS chip, offering a platform for
development of indoor positioning applications.
Indoor Positioning System (IPS)
GPS
Shopping Task Details
What is the intended use of the products
Social Circumstances
Shopping alone or with a partner
General Interests and Preferences
Prefers red or white wine with tuna
Human behavior as a sensor
Weekdays 12:00PM – 2:00PM
Moves iPhone
Records daily walking,
cycling and running.
Recognizes places in
your daily life
Sensegon
300 different behavioral parameters of users' social interactions
Store Loyalty Cards
DESIGNING AN ADAPTIVE
EXPERIENCE
Project Glass
Adaptive Thinking
A FEW MORE EXAMPLES
How adaptive thinking can resolve design problems
Check out this amazing …?
The number of known plant species is around 400,000.
Online flower identifier
1. Pick the flower you don't know the name of. Pick the complete flower from the ground at the end of the stem flush to the ground
2. Take the flower immediately inside. Go to the flower identification website.
3. Select the correct number of petals your flower has on the website. Then select every category thereafter in the list to help decipher the type of flower you have.
4. Click on the photos provided in the flower search with your specific categories. Compare your flower with the images to make sure it is the correct name.
http://www.botanicalkeys.co.uk
Is there another way?
Data Required Sensor Flowers Found
Flower Location GPS 323
Type of Soil Internet 130
Bloom Month Time and Date 52
What color is the flower? User Input 06
*Not a real results
Find my wildflower app
Monarda didyma (Bee Balm)
Monarda didyma is an aromatic herb
in the family Lamiaceae, native to
eastern North America from Maine
west to Ohio and south to northern
Georgia.
Its odor is considered similar to that
of the bergamot orange.
Bicycle Sharing Program
Designing with Sensors
Thank you
Avi Itzkovitchwww.XGmedia.com
@xgmedia