Homes for Society 5.0 The Third INternational …...Dependable Smart Homes for Society 5.0 1.1 The Road to Society 5.0 Sunday, June 7, 2020 Yuto LIM (Ph.D.) ‐3/ 35 ‐ Society 5.0

Dependable SmartHomes for Society 5.0 The Third INternational Conference on

InformaTics, Engineering, Science and Technology (INCITEST)by UNIversitas KOMputer Indonesia (UNIKOM), Bandung, Indonesia

11 June 2020

Yuto LIM (Ph.D., Kyoto Univ.)

Wireless, Sensor and Energy (WiSE) LaboratoryJapan Advanced Institute of Science and Technology (JAIST)

Keynote Speaker

Dependable SmartHomes for Society 5.0

Outline1. Introduction

o Society 5.0, Cyber‐Physical Systems, Smart Homes, Dependability

2. Backgroundo Smart Home Environment: iHouse, ECHONET

3. Our Research Activitieso Cyber‐Physical Home Systems (CPHS), Cyber‐Physical Human Centric Systems (CPHCS)

4. Conclusion

Sunday, June 7, 2020 Yuto LIM (Ph.D.) ‐ 2 / 35 ‐


1.1 The Road to Society 5.0


Society 5.0Super‐smart Society

Society 4.0Information Society

Society 3.0Industrial

Society 2.0Agricultural

Society 1.0Hunting & Gathering

Source: Cabinet Office, Government of Japan, “Realizing society 5.0, “ [online] https://www.cao.go.jp/index‐e.html

1. Introduction


1.2 What Makes Japan Possible?


To overcome social challenges such as a decrease in the productive‐age population, aging of local communities and energy and environmental issues ahead of other nations by

improving productivity and creating new value markets

New Society 5.0 model to the rest of the world

Abundant accumulation of real datao Based on health and medical data from a

universal health care system and a wealth of operating data from numerous manufacturing facilities, Japan has rich collection in real and usable raw data for use in the current market economy and industry

Technology cultivated from “物作り”o Japan’s advanced technology that

cultivated from “monozukuri” (means manufacturing of things) and years of basic research, will work as advantages toward creating products using information technologies like Big Data and AI, which can be released into the society

1. Introduction


1.3 Solutions in Society 5.0

Sunday, June 7, 2020 Yuto LIM (Ph.D.)

[Problem] Aging society ahead of other countries

o Japan is suffering from increasing medical and social security expenses and demands for caring for the elderly people

‐ 5 / 35 ‐

Healthcare

Before

Before

[Solution] Connect and share information between medical data users including medical checkup

records, effective treatment and nursing care records Put remote medical care services into practice – elderly people will no longer visit hospital

frequently Use AI and robots at nursing‐care facilities to extend people’s healthy life expectancy

After

After

[Solution] Promote use of autonomous driving taxis and buses for public transportation to make rural

transportation more readily available Improve distribution and logistics efficiency by introducing innovations such as a single

driver cargo truck in a convoy using unmanned‐following‐vehicle system and delivery drones

After

After

[Problem] Underpopulated rural areas lack access

to public transportationo Fast growing e‐commerce segment has

seen a shortage of driver

Mobility

Before

Before

1. Introduction


1.4 Toward Society 5.0 Revolution

around1780

around1870

around1970 2010

90 years 100 years 40 years

Mechanical production systematically using the power of water and stream

IndustrialRevolution Centralized electric

power infrastructure and mass production by division of labor

PowerRevolution Digital computing

and communication technology, enhancing system’s intelligence

DigitalRevolution Everybody and

everything is networked: Networked info. as a “huge brain”

InformationRevolution

Local to global shift

Local to global shift

o First 3 revolutions came about as a result of mechanization, electricity and ITo Internet of Things (IoT) introduces to steer a fourth revolution, which solves some of

the today challenges, like resource and energy efficiency, urban production, and demographic change

Source: Henning Kagermann et al. Acatech, 2013

1. Introduction


Super Smart Society

with IoT, CPS, AI, Big Data, Robot, Quantum Computing

Society 5.0Revolution

Future

20? years

‐ 6 / 35 ‐

Society 3.0Industrial


1.4.1 History and Terms

TeleautomationCybernetics

Apollo guidance computer, which is one of the first embedded systems

Ubiquitous computing

IoT

Source: Abstracted from S. Jeschke, RWTH Aachen Univ., “CPS – History, presence and future,” 27 February 2013

19261948

19991988

1961Charles D. Draper

Mark Weiser

Kevin Ashton

Nikola Tesla

Norbert Wiener

2006

Helen GillNSF, USA

1. Introduction

CPS are physical, biological, and engineered systems whose operations are integrated, monitored, and/or controlled by a computational core

o Components are networked at every scaleo Computing is deeply embedded into every physical component,

possibly even into materialso Computational core is an embedded system, usually demands

real‐time response, and is most often distributed



1.5 What is Cyber‐Physical Systems?

Figure: Overview of Cyber‐Physical Systems

1. Introduction

[2008, Edward A. Lee] CPS is a system featuring a tight combination of, and coordination between

o system’s computational and physical elements

[2008, S. Shankar Sastry] CPS uses computations and communication deeply embedded in and interacting with physical processes to add new capabilities to physical system

o from miniscule to large‐scale systems

o dependably, safely, securely, efficiently and in real‐time

Networks

Real Space

Cyber Space

Object Domain

InformationActuating

Physical Sensing


Interaction via sensors + actuators Operations of systems are monitored, coordinated, controlled and integrated by a computing + communication core

Source: E.A. Lee, “CPS: Design challenges,” Int. Symp. on Object/Component/Service‐Oriented Real‐Time Distributed Computing (ISORC), 2008

‐ 8 / 35 ‐


1.5.1 Size and Scale

Embedded Systemse.g., airbag

Networked Embedded Systemse.g., autonomous aviation

CPSe.g., intelligent networked road junction

IoT, Data and Servicese.g., smart transportation

Source: Acatech 2011

IoTCPS

EmbeddedSystems

1. Introduction



1.5.2 Critical‐Specific Applications

Applications of CPS areo Time‐critical, massive‐critical, and mission‐critical

Applications of IoT areo Event‐critical, massive‐critical, mission‐critical, and also method‐critical

Privacy‐, security‐ and safety‐critical are required for both

1. Introduction

Massive-critical

Time-critical

Smallish-critical

Event-critical

Mission-critical

Method-critical

Air traffic controlsystems (ATCS)

Power grid distribution Industrial automation

Remote Surgeon Vehicle traffic control

Medical Monitoring Agriculture Monitoring

Product Tracking

Inventory Management



1.5.3 Most Popular IoT Applications


Source: Abstracted from IoT Online Store, Smart Office, Smart Home and Smart Cities, Available: https://www.iotonlinestore.com/ [online]

IoT Web 1.0 was about computers connecting to their data Web 2.0 was about people connecting to their data Web 3.0 is about everything connecting to everything

IoT optimizes operations, boosts productivity and saves in resources and costs

IoT explores endless combinations of applications

1. Introduction

‐ 11 / 35 ‐


1.6 What is Smart Homes?

Figure: 3D printed house

1. Introduction

In 1984, smart home is firstly used by the American Association of House Builders (now National Association of House Builders)

Definition Home‐like environment that possesses ambient intelligence

and automatic control, in which it responds to the behavior of residents with various facilities [2012, L.C. De Silva et al.]

o providing convenience, improving security, saving energy, and enriching home care for the elderly and disabled people

Source: Architect WATG, 2018

Source: L.C. De Silva, C. Morikawa, and I.M. Petra, “State of the art of smart homes,” Elsevier J. Eng. Appl. of Artificial Intell., vol.25, no.7, pp.1313–1321, 2012



1.6.1 Smart Homes Challenges


1. Introduction

Figure: Market by products for 2016 and 2025

Source: Inkwood Research. Global Smart Homes Market by Products. [Available] https://www.inkwoodresearch.com/reports/global‐smart‐homes‐market‐2017‐2025/

Market Forecast 2017‐2025o Security = largest market share in 2016

o Energy anticipates to grow at the fastest CAGR of 21.5%

o HVAC (heating, ventilation and air conditioning) control system anticipates to grow at a CAGR of 14.41% Energy Efficient +

Thermal Comfort

Energy HVAC

Entertainment

Security

LightingHealthOthers

2016 2025

CAGR = compound annual growth rate / average growth rate per year

‐ 13 / 35 ‐


1.6.2 Dependability Challenges


Smart Phone

ElectricVehicle

SmartGrid

Cloud

HomeGateway

SmartHomes

Smart Meter

SolarPanel

WindTurbine

FuelCell

StorageBattery

MonitoringSystem

Energy Generation

Home Appliance

Human Interface

Laptop

Tablet

Controller

CommunicationSystem

Energy Supply

Sensor & Actuator

Connectivity among the components Energy provision to all the sensors and actuators Service and operational failures

No 100%Availability

&Reliability

1. Introduction

‐ 14 / 35 ‐


1.7 What is Dependability?


Depe

ndab

ility

Availability

Reliability

Maintainability, Safety, and Integrity

is the ability of a system to deliver a justifiably trusted serviceo probability that a system is operational at any given point in time

o is a measure which is defined as the probability of a system is proper andimproper functioning at time t

o probability that a system works correctly during the entire interval (0,t]

o is a measure used to characterize if a system is properly working its specifications during a specific period

MTTF = mean time to failure, MTTR = mean time to repair, FIT = failure in time

MTTRMTTFMTTFtyAvailabili

MTTFFIT 1

1. Introduction

Source: A. Avizienis, J.C. Laprie, B. Randell, and C. Landwehr, “Basic concepts and taxonomy of dependable and secure computing,” IEEE Trans. on Dependable and Secure Computing, vol. 1, no. 1, pp. 1‐23, 2004

‐ 15 / 35 ‐


1.7.1 Dependable CPS Applications In CPS, dependability can be classified at two

interdependent levels that, combined, can provide a trustworthy platform for building applications

o Infrastructure dependability – how dependable are the components (e.g., sensors, networks, actuators, computing/storage, and software) in the presence of diverse failures that may lead to disruptions

o Information dependability – how dependable is the information generated by the infrastructure given errors/uncertainty in information input (e.g., sensor readings) and data analysis mechanisms

Reflective approach explores an “observe‐analyze‐adapt” of closed loop control that is a driving philosophy in CPS applications, e.g.,

o Building personal thermal comfort in smart homes


1. Introduction

‐ 16 / 35 ‐


1.7.2 Does our House is Dependable?


Figure: Tateana‐shiki (pit‐style dwelling) house

Figure: Ordinary house Figure: Zero energy house Figure: 3D printed house

DependableSecure/Save

EfficientConvenient

HighLow

LowHigh

Neighborhooding Sharing/Caring

Cheap

1. Introduction

‐ 17 / 35 ‐


2.1 Smart Home Environment: iHouse i = ishikawa, internetted, inspiring, and intelligent

Advanced experimental environment for future smart homes in Japan

ECHONET Lite v1.1 > 300 sensors & actuators

Figure: Outside view of iHouse

2. Background



2.1.1 Layout Plan of iHouse

Figure: Layout plan of iHouse

2. Background

1st Floor 2nd Floor

Kitchen

Living and Dining Room Japanese StyleRoom

Master Room

Bedroom B

Bedroom A

Hall

ToiletDown

ToiletWashroom

Hall

Server room

Entrance

Bathroom

Side Door



2.1.2 Location of iHouse

Figure: System throughput of 2 nodes versus their distance

iHouse

Ishikawa Create Laboratory

Solar Panel

2kW (40㎡)

North

Figure: Geographical location of iHouse

2. Background



2.1.3 Photovoltaic & Fuel Cell2. Background


Fuel cell capacity is 0.7 kW using 2 LPG (liquefied petroleum gas)

Solar panel generation capacity is max. 2.0 kW

‐ 21 / 35 ‐


2.1.4 Outlets and Windows


ECHONET Circuit Part for Driving Motor

Power over Ethernet (PoE)

Normal Outlet

Experiment Outlet

2. Background

‐ 22 / 35 ‐


2.1.5 Indoor Sensors


Motion Sensor

Door Open/Close Detection Sensor

Temperature & Brightness Sensor

2. Background

‐ 23 / 35 ‐


2.1.6 Outdoor Sensors


Rain & Snow Gauge

Thermometer& Hygrometer

Sunshine Recorder

Aerovane (Wind Speed & Direction)

Luminometer

2. Background

‐ 24 / 35 ‐


2.1.7 Curtain


Curtain Automatic Motor

Communication Module

Driving Motor Module

2. Background

‐ 25 / 35 ‐


2.1.8 Air‐conditioner


WiFi Communication

Adapter

2. Background

‐ 26 / 35 ‐


2.1.9 Light (DC Powered LED)


2. Background

‐ 27 / 35 ‐


2.2 ECHONET


ECHONET stands for Energy Conservation and Homecare Network In Dec. 1997, ECHONET consortium was established

o 6 promoter members: Toshiba, Panasonic, Hitachi, Mitsubishi, Sharp and TEPCO

o Goal is to build home networks that systematically enable energy, security, and medical care

In Jan. 2009, ECHONET that became a de jure standard was ratified by IEC and ISO

In 2011, ECHONET Lite was released and was approved as an international standard in 2015

o Object concept is remaining, but the protocol is quite differento ECHONET specifies OSI layers 1‐7 and ECHONET Lite specifies OSI layers

5‐7o ECHONET uses ECHONET address and ECHONET Lite uses IP or MAC

address In 2018, the ECHONET‐ready devices have reached a total of 76.58

million units

2. Background

TEPCO = Tokyo Electric Power Company IEC = International Electrotechnical Commission ISO = International Organization for Standardization

‐ 28 / 35 ‐


2.2.1 ECHONET Basic Model


Basic modelo Controller accesses to a variety of deviceso Controller is programmable to send out a

notification according to the specified conditions through any communication media

Various devices are modeled as ‘object’ It is not depend on the communication media It is able to handle any lower‐layer

2. Background

‐ 29 / 35 ‐

Communicationmiddleware

Transmission medium (MAC layer)

Application software

ProfileObject

DeviceObject

Transmission medium (physical layer)e.g., wireless, wired, PLC, etc.

Standards for ECHONET Lite

Controller

System A System B

Device

HGW

HGW Home GatewayDomain

HGW

Non‐ECHONETSystem

HGW

Other Domains

Figure: System Architecture


2.2.2 Major Changes in ECHONET Lite


Remove ECHONET addresso IP address is used by lower‐layer to identify ECHONET node

Add SetGet service Introduce transaction ID (TID) Reduce the message structure

o Old has 12 types of format, new has only one format typePlain message

Secure messageBasic format

Compound format

SEOJ onlyDEOJ only

SEOJ & DEOJ× × Regular message SEOJ & DEOJ×

EHD TID SEOJ DEOJ ESV OPC EPC1 PDC1 EDT1 ・・・

EHD ：ECHONET Lite message header (1 byte)TID ：transaction ID (1 byte)SEOJ ：specifies source ECHONET Lite object (3 bytes)DEOJ ：specifies destination ECHONET Lite object (3 bytes)ESV ：ECHONET Lite service (1 byte)OPC ：number of processing properties (1 byte)EPC ：ECHONET Lite property (1 byte)PDC ：property data counter (1 byte)EDT ：property value data

2. Background

‐ 30 / 35 ‐


2.2.3 ECHONET Lite Objects


Class Group Devices

Sensor-related Device Class Group

gas leak sensor, crime prevention sensor, emergency button, first-aid sensor, earthquake sensor, electric leak sensor, human detection sensor, visitor sensor,call sensor, condensation sensor, air pollution sensor, oxygen sensor, luminance sensor, sound sensor, mailing sensor, weight sensor, temperature sensor, humidity sensor, rain sensor, water level sensor, bath water level sensor, bath heating status sensor, water leak sensor, water overflow sensor, fire sensor, cigarette smoke sensor, CO2 sensor, gas sensor, VOC sensor, differential pressure sensor, air speed sensor, odor sensor, flame sensor, electric energy sensor, current value sensor, water flow rate sensor, micromotion sensor, passage sensor, bed presence sensor, open/close sensor, activity amount sensor, human body location sensor, snow sensor

Air Conditioner-related Device Class Grouphome air conditioner, air conditioner ventilation fan, air cleaner, humidifier, electric heater, Fan heater, package-type commercial air conditioner (indoor unit), package-type commercial air conditioner (outdoor unit)

Housing/Facilities-related Device Class Group

electrically operated shade, electric shutter, electric storm window, sprinkler (for garden), off peak electric water heater, electric toilet seat (warm-water washing toilet seat, heating toilet seat, etc.), electric lock, instantaneous water heater, bathroom heater and dryer, household solar power generation, cold or hot water heat source equipment, floor heater, watt-hour meter, gas meter, LP gas meter, general lighting, buzzer

Cooking/Household-related Device Class Groupelectric hot water pot (electric thermos), refrigerator, combination microwave oven (electronic oven), cooking heater, rice cooker, washing machine, washer and dryer

Health-related Device Class Group weighing machineManagement/Operation-related Device Class Group no objects defined now

Audiovisual-related Device Class Group display, television

2. Background

‐ 31 / 35 ‐


3.1 Cyber‐Physical Home Systems

Cyber‐Physical Home Systems (CPHS) that offer residents to live more cost‐effective, comfortable, convenient, and secure using cyber‐physical systems approach

Summer Winter

SensorSensor

Window

Airconditioner

ServerGatewaySink

Internet

Sensing

Actuating

Inside28C

Inside20C

Outside37C

Outside0C

Inside

Outside

Winter

Summer

Control


3. Our Research Activities

‐ 32 / 35 ‐


3.2 Block Diagram of CPHS

Data Storage

WirelessSensor and

ActuatorNetwork

Sensor Domain

Temperature

Wind speed

Solar radiationOutdoor parameters

Indoor parameters

Wind speed

Temperature

Actuator Domain

TemperatureSetting

Sensor

Air-conditionerCurtain

Window

Physical WorldCyber World

Control Domain

Controller

Computation

Error Temperature Decision

Data transferring Sensing Actuating

Control Signal



‐ 33 / 35 ‐


3.3 Goal of EETCC System [Goal] To reduce energy consumption while satisfying the

thermal comfort level of residents in timely manner by using air‐conditioner, window, and curtain

o Use the natural resources for thermal comfort by opening window and/or curtain

Outside condition meetsthermal comfort level

Outside condition did not meetthermal comfort level

Air-conditioner

Window Curtain

EETCC = energy efficient thermal comfort control



‐ 34 / 35 ‐


3.4 System Model of EETCC

JAIST Network

iHouse

Sensors

Curtain &Window

Air‐conditioner

VPN Server

VPN Client

ECHONET Message Abstraction

EETC

C

MySQLDatabase

Controller

Data Process Daemon

(UDP)

ECHONETDevice Control

Tunneling

Desired Value

Output Value+

_Controller Plant

(iHouse)

Data Transferring



‐ 35 / 35 ‐


3.5 Our Research Activities

2011

HoTC = Home Temperature ControlHyTC = Hybrid Temperature ControlEETCC = Energy Efficient Thermal Comfort ControlPID = Proportional Integral DerivativeMPC = Model Predictive ControlPTC = Personal Thermal Comfort

2013

Shein Wai Wai(2011-2014) PhD

HoTC/PIDNew

EETCC was founded

Cheng Zhuo(2012-2013) MSc

HyTC/PIDNew

EETCC/PIDNew

Ooi Sian En(2017-2019) MSc

EETCC/MPCControllability

Chung Thuy Linh(2015) MSc

HoTC/PIDHeterogeneous Sensing

Ooi Sian En(2016) Internship

EETCC/PIDReal Implementation

Cheng Zhuo(2013-2017) PhD

EETCC/PIDScheduling

Li Cheng(2016-2018) MSc

EETCC/PIDData Availability

EETCC/PTCNew

Fang Yuan(2016-2020) PhD

EETCC/MPCTime Task Model



‐ 36 / 35 ‐


3.6 Our Concept of CPHC Framework


Applications

Network Fabric

Systems &Devices

Com

puta

tion

Mod

ule Task Model

Time Task Model

Sche

dule

r

Time ModelTime Delay Model

Systems & Devices

Control Delay

Computation Delay

Communication DelayDatabase C

ontro

l Mod

ule Control

Algorithm

FeedbackControl

PredictiveControl

Communication ModuleSynchronization Protocol Connectivity

Inte

ract

ions

Human

Sensing Actuating

Cyber World

Physical World

Cyber-Physical Human Centric (CPHC) FrameworkHuman Factors Module Physiological

FactorPsychological Factor Social

Factor

Inte

rMod

ule



3.6.1 Implementation of EETCC/PTC




3.6.2 Data Training and Setup


Table: Brief step of experiment



3.6.3 Thermal Sensation


EETCC/PTCImproves

25.9%



3.6.4 Energy Consumption


EETCC/PTC

EETCC/PTCImproves

30.5%



4.1 Concluding Remarks Summaries

o Presented the CPS approach for smart home environment

o Introduced the our most up‐to‐date research works, i.e., CPHC framework

Collaboration workso Partners who can collaborate together in the fields of CPS/IoT/Smart Grid/Future Wireless and if possible partners who can also work to realize Society 5.0 together

4. Conclusion




Thank you for your [email protected]

‐ 43 / 35 ‐

Human-centered Society

Homes for Society 5.0 The Third INternational …...Dependable Smart Homes for Society 5.0 1.1 The Road to Society 5.0 Sunday, June 7, 2020 Yuto LIM (Ph.D.) ‐3/ 35 ‐ Society 5.0

Documents