Real time control and communication ( Robots , Machines , IOT )

Real Time Control and Communication for IOT

ALTANAI BISHT & DEEPAK [email protected]://altanaitelecom.wordpress.com

Who am I ?4 Years in Telecom Industry

Frequently write , discuss and contribute to Open source software

Website : http://altanaitelecom.wordpress.com

Author of WebRTC Integrator’s Guide

2

1. Remote Machine Control2. M2M WebRTC3. Robot navigation 4. Robot Live Streaming via CDN

3Altanai Bisht ( http://altanaitelecom.wordpress.com )

IOT full solution stack

4Altanai Bisht ( http://altanaitelecom.wordpress.com )

Remote Machine Control

Controlling a remote machines like lights , fan over internet . Rpi acts as central control hub.

Components

Server side PHP Web-pages JavascriptWeb ServerMySQL

Communication Medium

Wireless ( 3G ) dongle

6Altanai Bisht ( http://altanaitelecom.wordpress.com )

Machine endpointRpi ECUPower MgmtMotor Noise FiltrationSPI

7

Raspberry Pi

7Altanai Bisht ( http://altanaitelecom.wordpress.com )

The Raspberry Pi is a series of credit card–sized single-board computers developed in the UK by the Raspberry Pi Foundation

Motor Driver Circuit

8Altanai Bisht ( http://altanaitelecom.wordpress.com )

9

youtube demo : https://www.youtube.com/watch?v=jrFpzN1jCR8&feature=youtu.be

Altanai Bisht ( http://altanaitelecom.wordpress.com )

Web page for control Electronic devices Hub and Electronic devices

M2M WebRTC

Transmitting media capture stream to Server

Media - WebRTCWebRTC offers real time communication natively from browsers. It is essentially just a media engine without control protocol

Bodies behind standardization

No plugins

Supported browsers

Supported Mobile platforms

11Altanai Bisht ( http://altanaitelecom.wordpress.com )

How does WebRTC work ?

12Altanai Bisht ( http://altanaitelecom.wordpress.com )

Signal

● Web Server/service based signaling

brokering

● Offer/Answer JSEP ( Java Session

Establishment Protocol ) model with

SDP ( Session Description Protocol )

● protocol NOT defined

Media

● Peer to peer media flow

● SRTP/RTCP

Firewall

● Uses ICE for STUN / TURN mechanism

WebRTC stack

13Altanai Bisht ( http://altanaitelecom.wordpress.com )

Components for WebRTC M2M communication

Server side JavascriptWeb ServerWebRTC browser

Communication Medium3G ( min > 2Mbps)

14Altanai Bisht ( http://altanaitelecom.wordpress.com )

Machine endpointRpi Iceweasel browserWebcam SpeakerMicDisplay

WebRTC Comm Network

TURN NodejsSocketio

Simple person-to-machine comm

15Altanai Bisht ( http://altanaitelecom.wordpress.com )

Milestone 2 : Machine-to-machine comm

16Altanai Bisht ( http://altanaitelecom.wordpress.com )

17Altanai Bisht ( http://altanaitelecom.wordpress.com )

Robot navigation

Navigating robot movement using WebRTC stream feed and remote machine control over internet.

Components for WebRTC M2M communication Server side

JavascriptWeb ServerWebRTC browser PHP Web-pages MySQL

Communication Medium3G ( min > 2Mbps)

19Altanai Bisht ( http://altanaitelecom.wordpress.com )

Machine endpointRpi IceweaselWebcam SpeakerMicDisplay

WebRTC Comm Network

TURN NodejsSocketio

Robot4 wheelerECUAl baseSensorGear Motor

20

Robot basic blocks

Altanai Bisht ( http://altanaitelecom.wordpress.com )

Front 1 1

Left 1 0

Right 0 1

21Altanai Bisht ( http://altanaitelecom.wordpress.com )

Standing robot view View from robot moving towards right

Robot Live Streaming via CDN

Capturing the web stream as robot moves and live streaming via CDN

23

1. WebRTC multi peers

2. Torrent based WebRTC chain 3. WebRTC Relay

nodes for multiple peers

4. WebRTC Chunk recorder to Wowza Media Server

Scalable Broadcasting and Live streaming alternatives

Altanai Bisht ( http://altanaitelecom.wordpress.com )

24

1. WebRTC multi peers

Altanai Bisht ( http://altanaitelecom.wordpress.com )

25

3. WebRTC Relay nodes for multiple peers

Altanai Bisht ( http://altanaitelecom.wordpress.com )

26

1 : n Live streaming end-end solution

WebRTC on Robot -> WebRTC peer on Server -> Whammy Recorder -> Wowza Transcoder +Streaming Server -> Amazon Cloudfront -> Multi players

4. WebRTC Chunk recorder to Wowza Media Server

Altanai Bisht ( http://altanaitelecom.wordpress.com )

27

WebRTC -> vp8/webm -> live stream

Note : This method only provides the video . It doent not have audio .

Features

● Cheap and more customised solution to specific use cases

● Recycled components ● No patented or proprietary protocols● Easy person-to-machine and machine-to-

machine comm. ● Can be integrated with other modules like

Recording , Multiplexing , transcoding .

28Altanai Bisht ( http://altanaitelecom.wordpress.com )

Roadmap

Sensor’s triggering Real Time comm.

Solid Real Time Analytics

Machine Learning

Augmented Reality in flowing Media

Integration to IOT frameworks

Thank you29