Copyright (C) 2013 ATR, Kyoto, JAPAN All rights reserved. Japan-Europe TeleCare Service Research and Development Project Improving elderly care with telerobotic.

Copyright (C) 2013 ATR, Kyoto, JAPAN All rights reserved.

Japan-Europe TeleCare ServiceResearch and Development Project

Improving elderly care with telerobotic technologies and cloud-based knowledge systems

Takahiro Miyashita 　　 Dylan F. Glas

Intelligent Robotics and Communication LaboratoriesSocial Media Research Laboratory Group

Advanced Telecommunications Research Institute International (ATR)

EU-Japan Workshop on R&D Cooperation in the field of Networked Technologies & Systems

April 18, 2013


Background: Mental Care for the Elderly

“Koekake” in Japanese:

Conversational techniques for• Supporting mental health• Exercising the memory• Delaying or preventing the

onset of dementia

Recognized as important by care experts, but often neglected in practice…


Proposal Overview

Objectives:

1.Reduce the burden on caregivers

2.Support care recipients (e.g. interaction support, monitor to prevent wandering)

3.Create employment opportunities for the elderly (tele-work)

Develop remote conversation support technology enabling teleworkers with caregiving expertise to provide mental care for elderly patients in care facilities using telepresence robots.


Proposed Methodologies• Semi-autonomous robot technology

- Enable care workers to teleoperate multiple robots

• Care Expertise Database - Extract / model expertise from teleoperation logs ofconversations (“Big data” approach).

• International collaboration- AAL technology leaders in Italy and the UK- Experimental care facility environment in Denmark- Multiple time zones -> effortless 24-hour telecare

• Prototype Global TeleCare System Day Night

Teleworker Schedule ManagementTeleworker Schedule Management

Care Expertise DB

Care Expertise DB


• Challenging for amateurs– Cannot locate people– Difficult to follow etiquette

(social rules)

• New system - easy to use as video conferencing

TelepresenceTelepresence robots for Telework

TechnologyTechnologyDevelopmentDevelopment

Usable by experts who know the space

Telepresence robots developed at ATR

Specialists controllinga guide robot in Nara

Conversationvia “Telenoid”

Significance to Industry

• Telepresence robots are an active

sector for startup companies, showing rapid growth 。Ex. ： InTouch Health growth rate: 252 ％　　 used by over 3000 doctors in over 400 hospitals

• Partnering with iRobot since July 2011 。


MealsMeals

ExerciseExerciseBathingBathing

Office WorkOffice Work

CateringCatering

The state of care facilities today…

Recreation therapyRecreation therapy

　　 Mental care is important, but there is

not enough time…

Too few caregivers - cannot provide sufficient mental care

Most modern care robots are focused on physical care.

Too few caregivers - cannot provide sufficient mental care

Most modern care robots are focused on physical care.


Future Vision: Care facilities utilizingtelepresence robotsTelepresence robot services

for recreational therapyTelepresence robot services

for recreational therapy

Telepresence robot servicesto monitor wandering

Telepresence robot servicesto monitor wandering

Internet

Care worker atremote location

These services will be enabled by the Global TeleCare System!

Communication support focusing on mental care, using telepresence robots　　→ Ease the effects of the shortage of caregivers and reduce their workload→ Create opportunities for elderly people to work and participate in society

Communication support focusing on mental care, using telepresence robots　　→ Ease the effects of the shortage of caregivers and reduce their workload→ Create opportunities for elderly people to work and participate in society


昼昼

TranslationIntegration

Global TeleCare Prototype System

Japanese DB

Other LanguageDB’s (EU)

Translation (EU->JP)

Translation (JP->EU)

Multilinguistic Grid (NICT)Multilinguistic Grid (NICT)

Outpatient care facility

Inpatient care facility

Elderly home

Japanese teleworker(experienced caregiver)

Day Night

1. Technologies for Situation Awarenessin Conversational Interaction

2. Technologies for Semi-AutonomousConversational Interaction

3. Global TeleCare System Construction Technology

・ Translation via Multilinguistic Grid

・ Japan-EU shared Care Expertise DB

・ Schedule Management

European teleworker(experienced caregiver)

Teleworker Schedule ManagementTeleworker Schedule Management

Global CareExpertise DB

Accumulation and structuring of knowledgefrom caregivers in each country

•Location / participant data•Extract data for conversation

•Move to appropriate location•Determine appropriate conversational distance•Participate in conversation 　


Technology developed previouslyTechnology developed previously

Research Themes

Technology developed previouslyTechnology developed previously

1 ） Conversational Situation Awareness Technologies

2) Conversational Participation Technologies

Structuring environmental information for pedestrian motion Wheelchair

Window-shopping area

Shopping

Extension to Audio (Conversation)

Extension to Multiple participants &Conversation scenariosThis ProposalThis Proposal This ProposalThis Proposal

Aggregation

MicrophoneArray

Mobile robots trackposition and conversation

Structuring environmentalinformation for conversation

SpeakerSpeaker

AddresseeAddressee

AddresseeAddressee

It’s fun, like shopping with my

grandchild.

It’s convenient that it moves automatically

Received Best Paper Awards in human-robot interaction research:HRI’07, HRI’09, HRI’12 　 (acceptance rate: HRI’07: 22%, ’09: 19%, ’12: 25%)


Internet

Nara City Tourist Information Center

（ Tourist guidance ）

Nara City Tourist Information Center

（ Tourist guidance ）Inside ATR

（ Kyoto, Japan ）（ Teleoperation

②）

Inside ATR（ Kyoto, Japan ）（ Teleoperation

②）

Teleoperated Robot （ Robovie-

R3 ）

Teleoperated Robot （ Robovie-

R3 ）

Tourist Information Headquarters, Nara City（ Teleoperation ① ）

Tourist Information Headquarters, Nara City（ Teleoperation ① ）

Teleoperation Interface

（ Personal Computer ）

Teleoperation Interface

（ Personal Computer ）

Research ThemesTechnology developed previouslyTechnology developed previously

Tourism, shopping, locomotion support:One person teleoperating 4 robots at once

Multilingual ・ Elderly Care

This ProposalThis Proposal

3 ） Global TeleCare System Integration Technologies

Ubiquitous Network Robot Platform (UNR-PF)

Extension to

Merits of Japan-Europe CollaborationComplementary focus:•In Europe: technology focused on elderly people

living alone or receiving in-home care.

•In Japan: focus on group care facilities such as

nursing homes.

Sharing unique facilities:•Early adopters in Denmark have established an

experimental elderly care center (CareLab).

• Can conduct experiments in a real care

environment

• Not easily possible in Japan.

Collaboration: DTI, ECHORD++, AALIANCE2, etc.

•Coordination between projects

•Effective support of care givers / receivers in home /

group care facilities

•Import technology to European society

Proposed Collaborators– Denmark

• Dr. Troels Oliver Vilms Pedersen, Dr. Claus Risager （ DTI ）

• Patient@home

– Italy• Prof. Paolo Dario, Dr. Filippo Cavallo

（ SSSA ）• ECHORD++ 　／　 AALIANCE2 　／　

RobotEra 　／　 RoboLaw

– United Kingdom• Prof. Rossi Setchi, Dr. Renxi Qiu （ Cardiff

Univ. ）• SRS


Coordination between organizations• MOU's already signed with DTI, SSSA - cooperative research is beginning.

– DTI: Collaborative research has begun with P@H– SSSA: Cooperation since 2008. In this case agreed to collaborate. Currently

planning a collaborative workshop for Autumn 2013.

• EU-JAPAN ForumAgeing Societies in Europe and Japan: Policy Responses and Research & Innovation Solutions for Active and Healthy Ageing (Oct. 9-10, 2012)Agreed to coordination between all organizations.


Expanding on Research Results

Enhancing creative innovation / international competition•Development of specific service models for care-focused telework through robot teleoperation

– Variation between cultures– Different service tasks

International standardization　・ UNR Platform (infrastructure supporting TeleCare system): standardization completed: ITU-T SG16 Q25 IoT.

　・ Proposed standard methodologies for telepresence robots: ITU-T SG16 Q5 Telepresence systems.


Application of Research Results• Use in Society

– Creation of service models through Japan-EU collaboration, extending beyond elderly care

– Active seniors able to perform telework in their respective fields

• Personnel training – Development of education courses for nursing

with telepresence robots, training of service providers


ConclusionIn pursuit of these three objectives:

1.Reducing workload of care workers

2.Supporting care receivers (conversation support, monitoring of wandering)

3.Supporting employment for elderly people

We propose to implement a “Global TeleCare Prototype System" enabling effortless 24-hour telecare through Japan-Europe collaboration enabled by the development of a Japan-Europe care expertise database and new teleoperation support technologies for telepresence robots.

Thank you for your attention.


Further References


Patient@Home• Title: Patient-at-home: Innovative Welfare Technology for

the 21st Century• Telework government fund （ SPIR ）• Principal Agency: Southern Denmark University, DTI• Period: 2012.2 – 2018.1• Summary: Develop new social welfare technology and

services for use at home by elderly people living alone, helping increase patients’ motivation with respect to their own healthcare and assemble a reliable framework for health care data collection.

• Merits of collaboration: By using P@H, it is possible to conduct experiments and develop service models, which would be difficult given the current situation in the field of elderly care within Japan.


ECHORD++• Title: European Clearing House for Open Robotics

Development Plus Plus• FP7-ICT • Representative Organization: TUM (Prof. Alois Knoll)• Period: 2013.10 – 2018.9• Overview: European collaborative robotics research is set

up to collaborate directly with SMB’s and startups. Creating experimental environments in which it is possible to easily test research results related to robots and before-market products with end-users.

• Merit of collaboration ： Provides an experimental environment usable for integrated technology development with other European FP7 projects outside of Denmark, and enables the survey of real user needs.


AALIANCE2• Title ：　 The Next Generation European Ambient Assisted Living

Innovation Alliance• FP7-ICT • Primary Institution ： SSSA (Principal members ： 6 other

institutions)• Period ：　 2011.10 – 2013.9• Overview ：　 AALIANCE2 is an Ambient Assisted Living initiative

（ assisted living technologies incorporating environmental sensors and robots) utilizing leading-edge ICT to support health maintenance for the elderly, survey technology trends in the US and Asia, and support collaboration.Created a roadmap for AAL in Europe covering the next 10 years.

• Merit of Collaboration: Through technology exchange and discussion with Europe’s AAL-related industry and research organizations, we can develop an AAL roadmap for the EU and simplify standardization activities and collaboration with individual countries in the EU.


RobotEra

• Title ：　 Implementation and integration of advanced Robotic systems and intelligent Environments in real scenarios for the ageing population

• FP7-ICT • Representative Organization ：　 SSSA• Period ：　 2012.1 – 2015.12• Overview ： An initiative aimed at actual deployment of advanced robot services

in society: development, implementation, and demonstration of services related to effective elderly care and supporting independence, evaluating scientific and technological effectiveness 、 and using surveys to investigate acceptance of these technologies in society.

• Merit of collaboration ： to advance the development of technology for home care and independence support for the elderly, this proposal combined with our technology will cover everything from independent living to group care facilities, and efficient development of tele-care support technologies.


RobotLaw

• Title ：　 Regulating Emerging Robotic Technologies in Europe: Robotics facing Law and Ethics

• FP7-ICT • Representative agency ：　 SSSA• Period ：　 2012.3 – 2014.2• Overview ： To conduct surveys and discussion of

ethical issues and necessary legislation regarding the introduction of robotic and bio-robiotic technology into society, particularly focusing on robots that interact with people, and to consolidate the results into a proposal to the EC.


SRS• Title ：　 Multi-Role Shadow Robotic System for

Independent Living• FP7-ICT • Representative agency ：　 Cardiff Univ.• Period ：　 2010.2 – 2013.1• Overview: The objective of this project is the

development of prototype teleoperation and semi-autonomous robot solutions to support home care for elderly people living alone 。 Surveying customer needs and implementing systems to address them.

Copyright (C) 2013 ATR, Kyoto, JAPAN All rights reserved. Japan-Europe TeleCare Service Research and Development Project Improving elderly care with telerobotic.

Documents

elderly care

care experts

physical care

care workers

modern care robots

sufficient mental care

support care recipients

state of care facilities