All Rights Reserved © Alcatel-Lucent 2010
Towards user-created applications
on the Internet-of-Things.
“What can the IoT do for the citizen?”
Lieven Trappeniers
Ambient Media department
Bell Labs
November 9th 2010
With support from
Industrial Presentation at the ANT2010 / MMoM / iiWAS conference
8-10 November 2010, Paris
All Rights Reserved © Alcatel-Lucent 20102 | DiY applications for the Internet-of-Things| November 2010
Outline
So, where is the Web-of-Things ?
Multidisciplinary ResearchGetting in touch with reality
ProofpointUser-created applications for Assisted Living
Do-it-YourselfUser-created applications & mass-creativity for the IoT
All Rights Reserved © Alcatel-Lucent 20103 | DiY applications for the Internet-of-Things| November 2010
Ambient Intelligence is a long-standing promise
Standalone Technology Islands
Not beyond personalization
Not embedded in real life
All Rights Reserved © Alcatel-Lucent 20104 | DiY applications for the Internet-of-Things| November 2010
Huge amount of
connected computing devicesEasy Creation of Applications
Rich interactions with the environment
All Rights Reserved © Alcatel-Lucent 20105 | DiY applications for the Internet-of-Things| November 2010
All Rights Reserved © Alcatel-Lucent 20106 | DiY applications for the Internet-of-Things| November 2010
The challenges ahead - Technology Radar
http://lookout.atosconsulting.com
All Rights Reserved © Alcatel-Lucent 20107 | DiY applications for the Internet-of-Things| November 2010
The Internet of Things is happening …
All Rights Reserved © Alcatel-Lucent 20108 | DiY applications for the Internet-of-Things| November 2010
…but People are not in the loop !
All Rights Reserved © Alcatel-Lucent 20109 | DiY applications for the Internet-of-Things| November 2010
What can the Web-of-Things do for me ?
All Rights Reserved © Alcatel-Lucent 201010 | DiY applications for the Internet-of-Things| November 2010
All Rights Reserved © Alcatel-Lucent 201011 | DiY applications for the Internet-of-Things| November 2010
Outline
So, where is the Web-of-Things ?
Multidisciplinary ResearchGetting in touch with reality
ProofpointUser-created applications for Assisted Living
Do-it-YourselfUser-created applications & mass-creativity for the IoT
All Rights Reserved © Alcatel-Lucent 201012 | DiY applications for the Internet-of-Things| November 2010
All Rights Reserved © Alcatel-Lucent 201013 | DiY applications for the Internet-of-Things| November 2010
Multi-disciplinary research
Computer Scientists, Sociologist, Interaction Designer, Engineers, Physicist, …
� From multi-disciplines to multidisciplinary
� Establish processes & toolkit
� conceptualization, paper prototyping,
� multidisciplinary planning
� User research (co-design, cultural probes, …)
Innovate on 3 axis
� Application concepts
� Technology
� The research methodology itself
All Rights Reserved © Alcatel-Lucent 201014 | DiY applications for the Internet-of-Things| November 2010
Getting in touch with reality
All Rights Reserved © Alcatel-Lucent 201015 | DiY applications for the Internet-of-Things| November 2010
Exploring the City as a Communication Platform
All Rights Reserved © Alcatel-Lucent 201016 | DiY applications for the Internet-of-Things| November 2010
Creative End-Users
All Rights Reserved © Alcatel-Lucent 201017 | DiY applications for the Internet-of-Things| November 2010
More user tests
Hidden Tags Visible TagsHidden Tags Visible TagsHidden Tags Visible TagsHidden Tags Visible Tags
All Rights Reserved © Alcatel-Lucent 201018 | DiY applications for the Internet-of-Things| November 2010
Direct involvement of
(proxy) users
•User panels
•Users involved in design
activities
•Living Labs
•Trials
•Market research
•Action Research
•User invention (innofusion)
Constructions of the user
Indirect Evidence about
users
•Visions of technology
•Fictions and myths about users
•Designer as user – Personal
experience of engineers and
intermediaries
•Evidence from existing
services and products
•Competitors
•Reports and studies of
potential user groups
conducted for other reasons
•Secondary analysis of existing
data
Representation
of “the user”
Where do we get Knowledge about ‘Users’ ?
Stewart, J. & Claeys, L. (2009). “Problems and Opportunities of Interdisciplinary Work involving Users in Speculative Research for Innovation of Novel ICT Applications”. Conference Proceedings of COST298 The Good, The Bad and The Challenging. The user and the future of information and communication technologies. Volume I. Sapio, B., Haddon, L., et all (Eds). ABS-Center, Koper, Slovenia, 2009.
All Rights Reserved © Alcatel-Lucent 201019 | DiY applications for the Internet-of-Things| November 2010
Outline
So, where is the Web-of-Things ?
Multidisciplinary ResearchGetting in touch with reality
ProofpointUser-created applications for Assisted Living
Do-it-YourselfUser-created applications & mass-creativity for the IoT
All Rights Reserved © Alcatel-Lucent 201020 | DiY applications for the Internet-of-Things| November 2010
Assisted Living
All Rights Reserved © Alcatel-Lucent 201021 | DiY applications for the Internet-of-Things| November 2010
What value does the Internet-of-Things bring to Elderly ?
All Rights Reserved © Alcatel-Lucent 201022 | DiY applications for the Internet-of-Things| November 2010
So, is this how we want them to live?
All Rights Reserved © Alcatel-Lucent 201023 | DiY applications for the Internet-of-Things| November 2010
User research
Probing with elderly, elderly with early dementia and their caregiver(s)
Methods:
Cultural probing, workshops & interviews
Goals:
To gather knowledge and understanding of
everyday life practices/routines, everyday life hacks and the home environment
of the elderly (with early dementia)
and of the tasks of the caregivers.
All Rights Reserved © Alcatel-Lucent 201024 | DiY applications for the Internet-of-Things| November 2010
Defining routines, problems, rules & sensors
Real-life stories
Problems
Solutions
Rules
Sensors
Human
information
Tech
information
All Rights Reserved © Alcatel-Lucent 201025 | DiY applications for the Internet-of-Things| November 2010
Feeding-back the research results to the users
Exhibition
Focus Groups
Trial/Pilot of functional prototype
+ press & customers
All Rights Reserved © Alcatel-Lucent 201026 | DiY applications for the Internet-of-Things| November 2010
Everyday objects in the house become ‘smart objects’
1 3
2
1-2-3 Personalization:- own pictures - own naming of objects
All Rights Reserved © Alcatel-Lucent 201027 | DiY applications for the Internet-of-Things| November 2010
koffiemachine waterkoker
Koffiemaken
hulp
4. Diversification:
� Tangible user interface
� Different templatesdepending on the role of users:stylists, caregivers, elderly
� Different templates depending onthe skills of users
4
Defining Context Aware Behavior
5
5. Materiality
� Magnetic action cards
� Every context aware behavior is captured in an action card
� Users can personalize andcreate new cards
All Rights Reserved © Alcatel-Lucent 201028 | DiY applications for the Internet-of-Things| November 2010
Activation and Understanding of context-aware behavior.
6. Control is in the hands of the user:
�Casensa board on which action cards can be stuck magnetically
� Behavior is only active if the action card is on the board.
� Visual representation of the context aware behavior
7. Understanding the Casensa home:
� Simple overview of context aware behavior
� Possibility to re-use application templates made by others
� Categorized by domain
6
7
All Rights Reserved © Alcatel-Lucent 201029 | DiY applications for the Internet-of-Things| November 2010
Casensa Movie
YouTube: http://www.youtube.com/watch?v=OMVZIc_MWh8
(search for “Casensa”)
All Rights Reserved © Alcatel-Lucent 201030 | DiY applications for the Internet-of-Things| November 2010
Casensa overview
All Rights Reserved © Alcatel-Lucent 201031 | DiY applications for the Internet-of-Things| November 2010
High level architecture
All Rights Reserved © Alcatel-Lucent 201032 | DiY applications for the Internet-of-Things| November 2010
Outline
So, where is the Web-of-Things ?
Multidisciplinary ResearchGetting in touch with reality
ProofpointUser-created applications for Assisted Living
Do-it-YourselfUser-created applications & mass-creativity for the IoT
All Rights Reserved © Alcatel-Lucent 201033 | DiY applications for the Internet-of-Things| November 2010
All Rights Reserved © Alcatel-Lucent 201034 | DiY applications for the Internet-of-Things| November 2010
All Rights Reserved © Alcatel-Lucent 201035 | DiY applications for the Internet-of-Things| November 2010
“Programming” the Web-of-Things
Design Effort
HighLow
User Value
Low
High
Web1.0top-downapplications
Web2.0bottom-upapplications
Internet-of-ThingsDiY
applications
Design Effort
HighLow
User Value
Low
High
Web1.0top-downapplications
Web2.0bottom-upapplications
Internet-of-ThingsDiY
applications
All Rights Reserved © Alcatel-Lucent 201036 | DiY applications for the Internet-of-Things| November 2010
User Research - Research Questions
“How and why will (different kind of) users create their own smart experiences in an Internet-of-Things world?”
RQ1: How will an Internet-of-Things world look
like?
RQ2: How will users create their own defined
smart experiences?
RQ3: What is an optimal DIY-application creation
of smart experiences culture?
RQ4: What is the role of television in a smart
behavior application creation process?
RQ5: What kind of smart experiences are users willing to create?
All Rights Reserved © Alcatel-Lucent 201037 | DiY applications for the Internet-of-Things| November 2010
The Societal Phenomenon of DiY
Rise of the New Maker & Manufacturer Ecosystem (IFTF, 2008)
All Rights Reserved © Alcatel-Lucent 201038 | DiY applications for the Internet-of-Things| November 2010
Vision: DiY for the proliferation of IoT (What can the IoT do for citizens?)
DiY as a critical need for IoT
� Mass adoption of IoT apps
� Long tail of IoT applications
may be needed to justify the deployment costs
DiY as a driver for IoT
� People value custom or self-made apps
DiY as a solution for IoT
� Beyond App Stores:
Maker Stores (and its enabling infrastructure)
All Rights Reserved © Alcatel-Lucent 201039 | DiY applications for the Internet-of-Things| November 2010
What is DiY in the IoT ?
Wide typology of DiY creation in the IoT
� 3 architectural concepts, as orientation flags in the explored space
The Call-out IoT � The Smart Composables IoT � The Phenomena IoT
Sensor (actuator) data in
DiY web apps
Sensor (actuator) data in
DiY web apps
Use Thing DataUse Thing Data
DiY installation(wireless) sensors/actuators
DiY installation(wireless) sensors/actuators
Connect ThingConnect Thing
Smartening & composing
DiY tangible objects
Smartening & composing
DiY tangible objects
Build ThingBuild Thing
ScratchPicoBoardBugLabs
VoodooIO
All Rights Reserved © Alcatel-Lucent 201040 | DiY applications for the Internet-of-Things| November 2010
The Call-out Internet-of-Things supporting DiY in the IoT
The network provides the capability for people
to expose and exchange “call-outs”
providing a locative, distributed community communication
though (objects & people in) the environment, bringing across
human interaction and stories.
ii
Image recognition(faces and objects as tags)
Augmented ID
Physical tagging(by people or manufacturers)
Location-based(virtual graffiti)
1 1 People augmenting the environmentPeople augmenting the environment
All Rights Reserved © Alcatel-Lucent 201041 | DiY applications for the Internet-of-Things| November 2010
ii
If the Rabbit could update what the cookies say …
And what if these billboards twittered away whatever you wanted ?
Call-outs are a way for people to communicate and collaboratethrough objects and locations, and share locative history
2 2 Communication with objects through the Communication with objects through the IoTIoT
All Rights Reserved © Alcatel-Lucent 201042 | DiY applications for the Internet-of-Things| November 2010
The Smart Composables Internet-of-Things supporting DiY in the IoT
The network provides the capability for people
to augment objects with instructions on
how they can be composed,
how they were produced or
how they can be repurposed.
ii
Instructablesfor physical objects
Physical/VirtualMashups Creationfor physical objects
All Rights Reserved © Alcatel-Lucent 201043 | DiY applications for the Internet-of-Things| November 2010
The Phenomena Internet-of-Things supporting DiY in the IoT
The network provides the capability for people
to shape “phenomena” models & filters
acting upon collected personal, public or community data
by recursing on triggered behaviour user feedback
with reuse in other phenomena-aware applications
Capturing and Capturing and shapingshapingpatterns and flowspatterns and flows
ΣΣΣΣ
Public / personal INPUTPublic / personal INPUT Public / personal OUTPUTPublic / personal OUTPUT
explicit text, etc.
location City behaviour
Personal behaviourAware App
App CreationPhenomena
All Rights Reserved © Alcatel-Lucent 201044 | DiY applications for the Internet-of-Things| November 2010
Things + WebThings + Web
All Rights Reserved © Alcatel-Lucent 201045 | DiY applications for the Internet-of-Things| November 2010
Things + Web + Things + Web + PeoplePeople
All Rights Reserved © Alcatel-Lucent 201046 | DiY applications for the Internet-of-Things| November 2010
Questions ?
Marc Roelands, Marc Godon, Mohamed Ali Feki, Laurence Claeys, Pascal Zontrop, Johan Criel, Koen De Voegt, Marjan Geerts, Lieven Trappeniers (2010)/ “Research Orientation towards Do-it-Yourself Internet-of-Things Mass Creativity”. Pervasive 2010, Workshop on "What can the Internet-of-Things do for Citizens?", May 17-20, 2010, Helsinki, Finland
Geerts Marjan, Claeys Laurence, Criel Johan, Zontrop Pascal, Godon Marc, De Voegt Koen, Lieven Trappeniers, Lieve Dieryckx, Annelies Verschatse, Peter Deboutte. “Seniors Re-engineering Context-aware Applications, The Casensa Research process”. AmI '09, November 18-21 2009, Salzburg
Lieven Trappeniers, Marc Roelands, Marc Godon, Johan Criel, Philippe Dobbelaere (2009). ”Towards Abundant DiY Service Creativity. Successfully Leveraging the Internet-of-Things in the City and at Home“. ICIN2009, October 27th-29th 2009, Bordeaux (www.icin.biz).
Rutten C., De Roeck D., Godon M. (2009). “Getting in Touch with the Users”. In: Tuikka T. & Isomursu M. (Eds.). Touch the Future with a Smart Touch. pp. 204-217.
Stewart, J. & Claeys, L. (2009). “Problems and Opportunities of Interdisciplinary Work involving Users in Speculative Research for Innovation of Novel ICT Applications”. Conference Proceedings of COST298 The Good, The Bad and The Challenging. The user and the future of information and communication technologies. Volume I. Sapio, B., Haddon, L., et all (Eds). ABS-Center, Koper, Slovenia, 2009.
Gee Rittenhouse (2009). "Shaping the Future Internet: opportunities and risks" introducing the Do-it-Yourself Internet-of-Things”. Future of the Internet Conference, May 2009, Prague
Godon M., Claeys L., Criel, J. Lauwers T. et al. (2009). “A Transdisciplinary Work Method: The Suitcase Experiment and the Christmas Media Gift Case”. In: Tuikka T. & Isomursu M. (Eds.). Touch the Future with a Smart Touch. pp. 156-171.
Criel, J. & Claeys, L. (2009). “Mixing Innovation Research Disciplines Using Agile: A R&I Case Study.”. Proceedings of COST298
Criel, Johan & Claeys, Laurence (2008). "A transdisciplinary study design on context-aware applications and environments. A critical view on user participation within calm computing". Observatorio (OBS*), 2(2).
Geerts M., Criel J., Claeys L., Godon M. (Alcatel-Lucent Bell Labs, Antwerp, Belgium), Lieve Dieryckx & Peter Deboutte (In-HAM, Gits, Belgium)(2008). "Let the Seniors Hack! Finding daily life practices and hacks of elderly using cultural probes“, Workshop Capturing Ambient Assisted Living Needs, Ambient Intelligence Conference '08, Nurnberg, Germany.
Claeys, L., Criel, J., Christiaens, S. & Trappeniers, L. (2008) "Ambient Intelligence for the Elderly (AmIE): An Empowering Way of Independent Living of Elderly", In: Jordanova, M. & Lievens, F. Global Telemedicine and E-Health Updates: Knowledge Resources, vol. 1.
Rutten C., De Roeck D., Godon M. (2008). "Co-design and the city". MobileHCI 2008.
Claeys, L. & Criel, J. (2008). "Context aware computing: Future living as a social application". In: Withworth, Brian & Demoor, Aldo (Eds.). Handbook of research on socio-technical design.
Godon, M., & Claeys, L. (2008, February). “Let the Homo Ludens Conquer the City.” Mobile City Conference. Rotterdam.
Lieven Tra
ppeniers
Bell Labs
lieven.tra
ppeniers@
alcatel-luc
ent.com
Lieven Tra
ppeniers
Bell Labs
lieven.tra
ppeniers@
alcatel-luc
ent.com