Real-Time Communications and the Industrial Internet of Things

Real-Time Communications and the Industrial Internet of ThingsSara Granados Cabeza, [email protected] Innovations Inc.

Who we areand what we do

2014 © Real-Time Innovations Inc.

Let me introduce myself...● Computer Engineering (2001-2006)

○ Final project: Visual processing platform based on artificial retinas

● Master in Computer Engineering and Networks (2006-2007)

● Ph.D. (2007-2012)○ Thesis: Efficient architecture to

condensate visual information driven by attention processes■ SlideShare

○ Research stays in Leuven (Belgium)

● Software Engineer at RTI (2011-)○ Lead engineer of the integration

with LabVIEW○ C/C++ Tools Engineer

http://www.slideshare.net/SaraGranadosCabeza/phd-thesis-presentation-22909405

http://www.slideshare.net/SaraGranadosCabeza/phd-thesis-presentation-22909405


… And let me introduce RTI

● Spin-off Stanford Aerospace Robotic Lab● Worldwide company

○ USA (HQ), Canada, UK, and Spain● We build real-time middleware and related

tools○ Customers: medical, energy, mining,

air traffic control, trading, automotive, unmanned systems, industrial SCADA, ground stations, and science

● OMG members○ Define the DDS standard with other

vendors● Spain Development Center

○ Core, Tools, Performance, Platforms and Support


What we do?

Application

Middleware

Network Stack

Application

Middleware

Network Stack

● We build real-time middleware○ Real Time Connext

● What is middleware?○ Handles discovery, connection,

failures, ...○ Easy programing: simpler APIs

Application

Middleware

Network Stack

pub/subAPI

SocketAPI

Industrial Internet of ThingsHype or revolution?


The Internet of Things

© 2014 Real-Time Innovations, Inc.


Internet of Things?

+


Multiple Definitions

Cisco “Internet of Everything”…the latest wave of the Internet -- connecting physical objects…to provide better safety, comfort, and efficiencyIBM “Internet of Things”…a completely new world-wide web, one comprised of the messages that digitally empowered devices would send to one another. It is the same Internet, but not the same Web.GE “Industrial Internet”…convergence of machine and intelligent data…to create brilliant machinesRTI “Your Systems. Working as One.”…an entirely new utility. As profound as the cell network, GPS, or the Internet itself. The Internet of Things and the Intelligent Systems it enables will fundamentally change our world.


What do we know about IIoT?

Forbes magazine recently published an independent market study that ranked major Industrial IoT influencers, which included RTI, Google, Cisco, GE, Omron and others. CIO Review also recognized RTI as one of the Top 50 Most Promising Internet of Things Companies in 2014.

http://www.forbes.com/sites/brucerogers/2014/07/08/apple-and-google-dominate-internet-of-things-influence-with-home-automation-efforts/

http://dj.appinions.com/iot-july-2014/

http://www.rti.com/docs/CIOReview-2014.pdf




Industrial Internet Consortium

●


The future: Smart Systems

Real-Time Analytics

and Control

OperatorHMI

Sensors Actuators

IT and CloudIntegration

DATA DISTRIBUTION

What connects the Things?IIoT Standard Protocols


IIoT Protocol Taxonomy• Access

– Link sparse endpoints

– XMPP

• Process– Biz intelligence– Centralized/ESB– ~100ms– MQ/AMQP

• Collect– Collect data– Hub & spoke– ~10ms– MQTT/CoAP

• Control, distribute– DataBus– ~0.1 ms– DDS


Web Services and Business Apps

Devices and Intelligent Systems

Control: DDS

Access: XMPP, REST

Collect:

MQTT, CoAP

Process: AMQP


AMQP: Process Device Data


Advanced Message Queuing Protocol (AMQP)


AMQP Queuing Model



XMPP: Access Device Data


Extensible Messaging and Presence Protocol (XMPP)


MQTT: Collect Device Data


Message Queuing Telemetry Transport (MQTT)

2014 © Real-Time Innovations Inc.© 2014 Real-Time Innovations, Inc.


DDS: Distribute Device Data


Real-Time Analytics &

ControlOperator HMI

Sensors Actuators

Cloud Integration

Data Distribution Service (DDS)


Many Others



The DDS Standard

● OMG!● Interoperability● Standards family

○ DDS 1.2 (API)○ RTPS 2.0 (Wire prototocol)○ X-Types (Extensibility)○ WEB-DDS○ UML Profile○ PSM (C++, Java)○ Security (WIP)○ RPC (WIP)

http://portals.omg.org/dds/


Data-centricity example


Data Centric Model

● Data drive the communication○ Data type and content define the interactions○ e.g. Temperature data

● Topic is the exchange unit○ Name + Type○ Samples are univocally identified by keys (like in DB)○ QoS per publication: matched vs. offered

● Global Data Space○ Applications publish topics to a global data space○ Global shared cache

Temp Writer

Temp Writer

Pressure Writer

Temp Reader

Pressure Reader

Pressure Reader

Topic: Temp

Topic: Pressure


Publish/Subscribe

● Paradigm shift:○ From “give me your information” to “send me your data have when

you have more”● Applications specify what can provide and what are they interested in

○ Middleware handles sending, reception and conversion○ e.g. “I offer temperature data”, “I’m interested in pressure data”

● Applications are matched by interests:

Temp Publisher

Temp Subscriber

TempSubscriber

Pressure Subscriber


Data Centric Model

● Decentralized● Acts as a distributed database/cache● No servers involved

Source Longitude Latitude Altitude

UAV1 37.4 -120 500

UAV2 40.1 -23 433

UAV3 50 -1 100

Virtual Data Space

Source Event Code

UAV1 WARNING FUEL_LOW

UAV2 INFO LANDINGUAV1

UAV2

UAV3

All about UAV1

All UAV positions


Quality of Service (QoS)

Quality of Service Quality of service

DURABILITY USER_DATA

HISTORY TOPIC_DATA

READER DATA LIFECYCLE GROUP_DATA

WRITER DATA LIFECYCLE PARTITION

LIFESPAN PRESENTATION

ENTITY FACTORY DESTINATION ORDER

RESOURCE LIMITS OWNERSHIP

RELIABILITY OWNERSHIP STRENGTH

TIME BASED FILTER LIVELINESS

DEADLINE LATENCY BUDGET

CONTENT FILTERS TRANSPORT PRIORITY

Vol

atili

tyIn

frast

ruct

ure

Del

iver

yU

serP

resentationR

edundancyTransport


DDS & IoT

● Access○ Link sparse endpoints○ XMPP

● Process○ Biz intelligence○ Centralized/ESB○ ~100ms○ MQ/AMQP

● Collect○ Collect data○ Hub & spoke○ ~10ms○ MQTT/CoAP

● Control, distribute○ DataBus○ ~.01ms○ DDS


Web services and Bussiness aps

Control

Col

lect

ProcessAc

cess

Who and whereReal world successful examples

http://www.rti.com/industries/iot.html


IIoT from different fields


Industrial control

● Siemens○ Industry 4.0 (video)

■ More flexible manufacturing processes:● customer-defined products

○ Predictive maintenance○ Replenishment location and

weight sensors.● Avionics

○ “Product memory” and smart tools.

● Joy Mining○ Historical data

https://www.youtube.com/watch?v=HPRURtORnis


Robotics

● NASA / ESA○ Share data over

disadvantaged links (video)○ Remote control from satellite

(video)○ Coordination between sensors

and actuators ○ 3D printing replacements

● Unmanned vehicles○ SAR

https://www.youtube.com/watch?v=KyZqSWWKmHQ&spfreload=10

https://www.youtube.com/watch?v=BFl7uPXUfs4

http://www.businessinsider.com/nasa-emails-a-wrench-into-space-using-3d-printing-2014-12

http://www.businessinsider.com/nasa-emails-a-wrench-into-space-using-3d-printing-2014-12


Energy

● Siemens Wind Power○ IT integration for

maintenance● LocalGrid

○ Monitor and control● Grand Coulee Dam

○ Large US Electricity Producer


Medical: Control and Integration

● Hospital management○ Continuous treatment○ Preventing 50.000

deaths/year (article)

● Patient monitoring○ DDS connects devices with

decision engines○ 60% emergency vehicles!

http://blog.iiconsortium.org/2015/01/how-to-industrial-internet-of-things-can-save-50000-lives-a-year.html


Connecting devices with hospitals to provide better treatment while en-route

4G/LTE

EMS: Cloud Integration


Medical: Imaging and treatment

● Imaging○ GE Healtcare (link)

● Treatment○ Mevion’s Proton-Beam

Radiation Therapy system zaps tumors with accelerated protons

http://www.medicaldaily.com/pulse/new-ct-scan-images-ge-show-unprecedented-level-detail-316946


● Volkswagen○ VW Driver Assistance and

Integrated Safety ■ radars, laser range finders,

and video integration○ Avoid obstacles, detect lane

departures, track eye activity, and safely negotiate bends

● Audi○ (video)

● Bridge high speed networking to the CAN bus

Transportation: Smart cars

https://www.youtube.com/watch?v=-WvK5WC4ns0


● A modern car contains 100+ CPUs

● Audi uses hardware-in-the-loop simulation to feed realistic data to components in a lab for testing

● RTI middleware enables a modular test environment that scales to work with hundreds of devices

Transportation: Distributed testing


Transportation

● Rail Tracking

● Flight Training Simulators

● Air Traffic Control○ NAV Canada: 2nd ANSP in

the world○ 24x7 Operation

How to choose a protocol?Picking an Architecture


Types of Middleware

Point-to-Point Client/Server Publish/Subscribe Data-Centric

DataBus

Queuing


How to Choose?


Identify Your Primary Challenge


Web Services and Business Apps


Control: DDS

Access: XMPP, REST

Collect:

MQTT, CoAP

Process: AMQP


Choose MQTT If…

• Think of it as collection?

• Little device-device communications?

• Large number of devices?

• Very small devices?

• 3 or 4 => MQTT


Collect:

MQTT, CoAP


Choose AMQP If…

• Distributing work, not information?

• Just send A to B?

• Speed & CPU use not important?

• Can’t lose anything?

• 3 or 4 => AMQP


Process: AMQP


Choose XMPP/REST If…

• Use the word “my”?

• Few connectivity points in large space?

• Speed & CPU use not important?

• “Always” connected?

• 3 or 4 => XMPP or REST



Choose DDS If…

• Disaster if offline for 5 minutes?

• Measure performance in ms or us? Or scale >100+ applications? Or 10k+ data values?

• Code actively developed for >3 yrs?

• 2 or 3 => DDS


Control: DDS


Unit DataBusUnit DataBus

Extend End-to-End

• Connect…– Fast– Seamless– QoS controlled– Secure– Data centric

• …80 Platforms…– Micro controllers– Certified systems– Embedded– Mobile– Desktop– Cloud

• …over 12 Transports– UDP or TCP– D/TLS (secure)– Wireless or wired– Shared memory– Backplane– Cloud virtual connect


IntelligentMachines

IntelligentSystems

IntelligentIndustrial Internet

Cloud DataBus

Site DataBus

IntelligentSystem of Systems

Unit DataBus

Sense Act

Think HMI

Machine DataBus

Think HMI

Machine DataBus

Sense Act

Think HMI

Machine DataBus


Example Protocol Challenges in Power


Grid Control

Optimize BillingBalance Grid

Collect

Meter Data Turn My Lights

Off

Manage Loading

Distributed Control

SCADA Control

Device ServiceREST CoAP


Conclusions

● The IoT is Huge○ Many challenges!○ Many technologies, many protocols

● Design for Best Fit○ Determine your hardest problem○ Choose the primary protocol to solve it

● Build a coherent data space○ Extend your primary choice to its reasonable limits○ Route to integrate legacy & best-of-class

technologies

RTI CommunityResources


RTI Community

Community Portal:http://community.rti.com/Blog: http://blogs.rti.com/Case+Code:www.rti.com/usecasesGithub:https://github.com/rticommunityTwitter: @RealTimeInnov

https://github.com/rticommunity

https://github.com/rticommunity


Case + Code

https://www.rti.com/resources/usecases/

● Use case based walkthroughs● Design, code and settings

Chocolate Factory Vehicle Tracking

Cloud/IoT Monitoring Video Streaming

https://www.rti.com/resources/usecases/chocolate-factory.html

https://www.rti.com/resources/usecases/vehicle-tracking.html

https://www.rti.com/resources/usecases/streaming-video.html

https://www.rti.com/resources/usecases/real-time-lan-over-wan.html


RTI University Program

● Free licenses for research projects● Conference grants● Projects and Thesis

○ Degree, Master, PhD, …■ Contact us!!

○ Research● Collaboration with Universities

○ University of Granada Tech Challenge○ Open research opportunities and challenges!

■ Security, scalability, ...

http://www.rti.com/resources/university-program.html

2015 © Real-Time Innovations Inc.2015 © Real-Time Innovations Inc.Image from: https://blogs.dal.ca/csc/2012/03/06/internships/


RTI Internships● What are we looking for

○ Software Engineers■ Computer Science Degree

(or similar)○ C/C++○ Java, C# and scripting is a plus○ Ability to work in distributed

teams○ English !!

● Emple@ Joven (link)○ Finish degree in 2011-2012 or

2012-2013○ Live in Andalucia○ 9 months, 25h/week

Spain Development Center● Granada● Young team● Core, Tools, Platforms &

Support Teams

http://www.rti.com/careers

http://cpep.ugr.es/pages/practicas/_doc/becas-idi/resolucionresultados/!

Thanks for your attention!Any questions?

Real-Time Communications and the Industrial Internet of Things

Technology

do2014 realtime innovations

realtime communications

industrial scada

ms dds

ms mqamqp

dds standard

ms mqttcoap control

intelligent systemscontrol