Social Robotics (for Assisted Living) Rod Walsh Project Manager, Social Robotics Tampere University of Applied Sciences The First DMU workshop on Assisted Living Technologies (ALT2012) 21.November.2012
May 11, 2015
Social Robotics(for Assisted Living)
Rod WalshProject Manager, Social Robotics
Tampere University of Applied SciencesThe First DMU workshop on Assisted Living Technologies
(ALT2012)21.November.2012
2012
TAMKhttp://www.tamk.fi/en
http://www.tamk.fi/tamktoday
http://tamk-en.blogspot.com/
http://www.facebook.com/TampereUAS
TAMK R&D & Innovation (RDI) programmes
Technology• development of energy efficiency in buildings and facilities,
and reduction of environmental impacts • efficiency of mobile machinery • assessment of human activity in genuine operational
environments • development of new business opportunities
Wellbeing• development of services for seniors, including promotion of
wellbeing entrepreneurship and development of wellbeing technology
• promotion of wellbeing at work• promotion of children’s and adolescents’ health
Culture• integration of various fields to create internationally
competitive cultural products with a strong regional flavour • promotion of networking opportunities for companies• helping the development of culture products for the export
market
R&Dat TAMK
Social RoboticsA social robot is an autonomous robot that interacts and communicates with humans or other autonomous physical agents by following social behaviors and rules attached to its role. http://en.wikipedia.org/wiki/Social_robot
Motivations: Aging World
• Demographics changes• Workplace changes• Health care changes
Motivations: Demographic Gap
• Decreased health budget per person• Insufficient (over-stretched) professionals
Motivations: Longer Working Lives
• Assisted self-care• Augmented healthcare• Assisted working
Social Robotics Vision• Semi-autonomous robots and avatars• Interacting with people in their own space• Augmenting healthcare givers• Providing rehabilitation and lifestyle support• Reliable and inexpensive (step-by-step)
A Few Examples
Physical EmotionEmotion, mood & sentiment affect…• Wellbeing• Behaviour• Interaction
Detailed models exist (e.g. Plutchik)
Plutchik, R. "The Nature of Emotions". American Scientist.Ekman, Paul (1992). "An Argument for Basic Emotions". Cognition and Emotion
Darw
in, C
harl
es
(18
72
), T
he e
xp
ress
ion
of
the e
moti
on
s in
man
an
d a
nim
als
, Lo
nd
on
: Jo
hn
Mu
rray.
Physical EmotionEmotion, mood & sentiment affect…• Wellbeing• Behaviour• Interaction
Detailed models exist (e.g. Plutchik)
Most research uses Ekman’s (original) six emotions
Machine emotion is potentially useful
Plutchik, R. "The Nature of Emotions". American Scientist.Ekman, Paul (1992). "An Argument for Basic Emotions". Cognition and Emotion
Darw
in, C
harl
es
(18
72
), T
he e
xp
ress
ion
of
the e
moti
on
s in
man
an
d a
nim
als
, Lo
nd
on
: Jo
hn
Mu
rray.
Real-time Emotion Recognition
Smart cabs:Machines That know their Drivers
Database:state of mind logsensor logs
non-contact sensing:video, image, audio
7/10capability
~7/10capability
state of mind estimation
Match with task
8/10minimum
Pattern recognition
Simulate simple changes• Music, lighting,
airflow, …
real-time
loggedofflinelogged
virtual robot body in unity
vir
tual
robot
face
in
un
ity
actual robot body in the real world
Output-specific compute:“Render” spatial model (behavior)
Model-specific compute:Translate behavior into spatial
model
Full
body fa
ce
User selected behaviors that affect emotional state for 1to1 dialogue and performance cases.
Things like, “be happy”, “welcome”, “reject”, “complain”, “cry”, “superman”, …
Affective Robotics:Physical expression from social robots
Physical Emotion
angerdisgustfearhappinesssadnesssurpriseneutral
Ekman’s sixneutral
Physical Emotion
anger
Physical Emotion
disgust
Physical Emotion
fear
Physical Emotion
happiness
Physical Emotion
sadness
Physical Emotion
surprise
Come and play!http://socialrobotics.tamk.fi/apps/
(work-in-progress) Train One, Train All
Mindreader (Emotion Hero)
Our 2013 FocusTeleportation
(webconf)Physio’ buddy Emotion play
Rich info, video & ambiance in a simple UI
Instant media spaces (smart active cam/mic)
Affordable locomotion (raised tablet on wheels)
Kinetic robot “programming”
Flexible humanoid
Physical/Mobile/PC Avatar “mobility”
Emotion & activity detection & recognition
Playful engagement
Remote nursing
Companionship
Behavioural agent
Augmented care
Probing
Stimulation
Intervention
Our 2013 FocusTeleportation
(webconf)Physio’ buddy Emotion play
Rich info, video & ambiance in a simple UI
Instant media spaces (smart active cam/mic)
Affordable locomotion (raised tablet on wheels)
Kinetic robot “programming”
Flexible humanoid
Physical/Mobile/PC Avatar “mobility”
Emotion & activity detection & recognition
Playful engagement
Remote nursing
Companionship
Behavioural agent
Augmented care
Probing
Stimulation
Intervention
Our 2013 FocusTeleportation
(webconf)Physio’ buddy Emotion play
Rich info, video & ambiance in a simple UI
Instant media spaces (smart active cam/mic)
Affordable locomotion (raised tablet on wheels)
Kinetic robot “programming”
Flexible humanoid
Physical/Mobile/PC Avatar “mobility”
Emotion & activity detection & recognition
Playful engagement
Remote nursing
Companionship
Behavioural agent
Augmented care
Probing
Stimulation
Intervention
Our 2013 FocusTeleportation
(webconf)Physio’ buddy Emotion play
Rich info, video & ambiance in a simple UI
Instant media spaces (smart active cam/mic)
Affordable locomotion (raised tablet on wheels)
Kinetic robot “programming”
Flexible humanoid
Physical/Mobile/PC Avatar “mobility”
Emotion & activity detection & recognition
Playful engagement
Remote nursing
Companionship
Behavioural agent
Augmented care
Probing
Stimulation
Intervention
Teleportation (webconf)
Physio’ buddy Emotion play
Rich info, video & ambiance in a simple UI
Instant media spaces (smart active cam/mic)
Affordable locomotion (raised tablet on wheels)
Kinetic robot “programming”
Flexible humanoid
Physical/Mobile/PC Avatar “mobility”
Emotion & activity detection & recognition
Playful engagement
Remote nursing
Companionship
Behavioural agent
Augmented care
Probing
Stimulation
Intervention
Other ideas?
New Beginnings in 2013
Thank you!
Questions, discussion…