eProsima RPC over DDS OMG Technical Meeting, Berlin 18/06/2013 Jaime Martin Losa CEO eProsima [email protected] +34 607 91 37 45 www.eProsima.com
eProsima RPC over DDS - OMGeProsima RPC over DDS OMG Technical Meeting, Berlin 18/06/2013 Jaime Martin Losa CEO eProsima [email protected] +34 607 91 37 45 Key phrases:\爀屲1.-
May 22, 2020
Welcome message from author
This document is posted to help you gain knowledge. Please leave a comment to let me know what you think about it! Share it to your friends and learn new things together.
Transcript
eProsima RPC over DDS
OMG Technical Meeting, Berlin 18/06/2013
Jaime Martin Losa
CEO eProsima [email protected]
+34 607 91 37 45 www.eProsima.com
Presenter
Presentation Notes
Key phrases: 1.- Hello Everybody, I am Jaime Martin, CEO of eProsima, a middleware consulting company based in Spain 2.- I am going to present our new product, eProsima RPC over DDS 3.- This product enables Remote Procedure calls over DDS 4.- Let’s see the agenda of this presentation
Agenda
eProsima RPC over DDS – RPC over DDS
Introduction Performance Standarization Hands on Example Interoperability Demo!
About eProsima eProsima Success Cases
Presenter
Presentation Notes
Key phrases: 1.- We are going to present a short introduction about eProsima, and go direclty to RPC over DDS 2.- We will see an introduction, some performance graphs, showing how striking fast is, comparing it to Web Services or Apache Thrift, the ongoing standarization effort, a quick example, to show you how easy is use this product, and a cool interoperability demo, showing the Request/Reply interaction using Clients and Servers based on different implementations.
eProsima RPC over DDS
DDS
DDS uses the concept of Global Data Space. In this Space we define topics of data, and the publishers publish samples of these topics. DDS distributes these samples to all the subscribers of those topics. Any node can be a publisher or a subscriber.
No Remote Procedure Calls
Presenter
Presentation Notes
1.- We all know DDS, a complete Publish/Subscribe middleware, but with NO Remote Procedure calls
RPC over DDS
DDS implements a pub/sub model, but no a direct way to do Remote Procedure Calls (RPC)
DDS Can be used though for RPC with some effort: – We could create a couple of topics, one for the in
parameters of the function we want to call, and the other one for the out parameters, and then implement the client-server interaction through a couple of pub-sub.
Presenter
Presentation Notes
1.- We could implement an remote procedure call over DDS with some effort, 2.- We need a couple of topics, one for the request, and the other for the reply, and the corresponding publishers and subscribers, like is depicted in the next slide.
Client-Server comms over DDS
myService.idl: interface myService{
funReturnValueDataType Fun(DataType1 parameter1, DataType2 parameter2…);
}
Presenter
Presentation Notes
1.- We define a Fun Procedure, and to call it through DDS we need basically: 2.- A topic for the request contaning the request parameters and a Topic for the Reply containing the ourput of the procedure 3.- After that we need to solve the correlation between request and reply, the orchestation of the request/reply schema and other details show in the next slide.
Client-Server comms over DDS: Manual Steps
Common: – Client main, Server main. – Client and Server code for data flow management, initialization
and setup of DDS entities, server threading…
For each operation: – Request and Reply topics – Client and Server code to manage function calls/return-values,
parameters...
Presenter
Presentation Notes
1.- We need code to create …
Client-Server comms over DDS: Automatic (using eProsima RPC over DDS) A parser creates all the stuff you need. For each operation, just implement the behavior.
eProsima RPC: Advantages
Allows to the developer focus in the development of his application.
Approach similar to Apache Thrift, but easier to use and with configurable QoS
Transparent. Multithreaded Server. Automatic Generation of:
– Client and Server Code. – Request and Reply Topic – Development enviroment files: Visual Studio
projects or makefiles
eProsima RPC: Features
Open Source: LGPL – Support available
Main Features: – Windows and Linux support (32 and 64 bits)
Project and makefile generation for VS2010 & gcc 4.x
– Synchronous, asynchronous and one way operations – Different Server threading models
Single threaded, thread by request and thread pool
– Internet enabled: udp (unicast/multicast) and TCP support
– 100% Standard: ISO C++ and OMG DDS RTI DDS and OpenDDS supported
Performance vs Web Services (Throughput)
0
100
200
300
400
500
600
700
10 100 200 300 400 500
Req
uest
s/se
c
Request Payload (bytes)
eProsima RPC vs Web Services (25 Clients)
eProsima RPCWeb Services
Presenter
Presentation Notes
Web Services: Gsoap Server: Regular Dual Core 1.- In this Graph we are measuring the number of request per second per client in an scenario consisting in 25 clients and a server 2.- In the case of WS we are using Gsoap, a very fast implementation of WS. The machines are just dual-core machines. 3.- We can see eProsima RPC for DDS is processing around ten times more requests than WS.
Performance vs Apache Thrift (One to One Latency)
0
100
200
300
400
500
600
700
100 250 500
Late
ncy
(Mic
ro S
econ
ds)
Request/Reply Size (bytes)
One to One Latency
eProsima RPC over DDS
Apache Thrift
Presenter
Presentation Notes
1.- Here we are measuring the latency, and comparing to Apache Thrift, a substitute of WS and CORBA, used internally by facebook and gaining lots of fans in the last year 2.- We are in the same order of magnitude, and better from parameter sizes of 200 bytes. This is because Apache Thrift uses TCP and no protocol headers, so a little advantage when the parametes are small, but for regular operations setting configurations, or getting database data, or sending parameter structs we would be faster
Performance vs Apache Thrift (Many to One Latency)
0
200
400
600
800
1000
1200
1400
100 250 500
Late
ncy
(Mic
ro S
econ
ds)
Request/Reply Size (bytes)
Four to One Latency
eProsima RPC over DDS
Apache Thrift
Presenter
Presentation Notes
1.- Same example, with 4 clients and 1 server
Standarization
OMG Standard ongoing – RPC for DDS RFP (public) – eProsima, RTI, PrismTech – Revised Submission : May, 20, 2013 – To discuss in this OMG meeting
June 17,18 – Berlin See www.eprosima.com for more info.
Presenter
Presentation Notes
1.- RPC over DDS is in the process of standarization now 2.- eProsima, RTI and Prismtech presented submissions 3.- And we will discuss the submissions tomorrow.
Hands on: A First Example
Install the software: – DDS
http://www.rti.com/downloads/connext.html
– eProsima RPC over DDS http://www.eprosima.com/index.php/en/downloads-all
Windows and Linux (32 & 64) supported
Presenter
Presentation Notes
1.- To do a quick example, just download and install the software. RTI Connext DDS and OpenDDS supported at this point, and I was talking to Nina this morning to also support CoreDx, it should be ready in a week or so. 2.- Let’s create the example (next slide)
Hands On: Calculator
Create Calculator.idl Generate Interface Support :
/////////////////////////// // KIARA Webinar Example // /////////////////////////// interface Calculator { float sum (in float x,in float y); // x+y float substract (in float x,in float y); // x-y float multiply (in float x,in float y); // x*y };
rpcddsgen -ppDisable -example x64Win64VS2010 Calculator.idl
Presenter
Presentation Notes
1.- First, We Create Calculator.idl containing an interface with three basic operations. 2.- Second we generate Remote Procedure Call support through the IDL compiler (show the cmd)
Hands On: Calculator
Edit the Example: – Client.cxx
– CalculatorServerImpl.cxx
// Call to remote procedure "sum". try { sum_ret = proxy->sum(2, 2); std::cout << “Server Says 2+2=" << sum_ret << std::endl; }
DDS_Float CalculatorServerImpl::sum(/*in*/ DDS_Float x, /*in*/ DDS_Float y) { DDS_Float sum_ret = 0; sum_ret = x+y; return sum_ret; }
Presenter
Presentation Notes
1.- The IDL compiler generates all we need: A proxy, an skeleton, and the corresponding visual studio projects 2.- We need to modify just a couple of lines of the generated code to implement the behaviour: Our remote procedure call in the client, and the behaviour of the operations in the server skeleton. (show the VS)
Hands On: Calculator
Run the Client and the Server – Same or different connected machines
– Remember to disable/setup firewall
D:\KIARA_Webinar_Examples\math\objs\x64Win64VS2010>CalculatorClient Server says 2+2=4 D:\KIARA_Webinar_Examples\math\objs\x64Win64VS2010>
Presenter
Presentation Notes
1.- Now we compile and execute the server and the client 2.- Show the cmds and execute 3.- And now, let’s see an interoperability demo for RPC over DDS
Interoperability Demo CalculatorServer (Linux, OpenDDS)
CalculatorServer (Linux, RTI Connext DDS)
CalculatorClient (Windows, OpenDDS)
CalculatorClient (Windows,
RTI Connext DDS)
Presenter
Presentation Notes
1.- eProsima RPC over DDS uses just standard DDS, so it is interoperable out of the box. 2.- We are going to show the Calculator Example we have done interoperating this way: A calculator Server using OpenDDS in a Linux Machine A calculator Server using RTI Connext DDS in a Linux Machine A Calculator Client using OpenDDS A Calculator Client using RTI Connext DDS 3.- Show, let’s run the demo (Jaime, usa esta secuencia) -- We Start the CalculatorServer using OpenDDS -- We Start the CalculatorClient using OpenDDS and we wait a little bit for discovery -- -- We have a service selector to switch between the Calculator OpenDDS Server and the Calculator RTI Connext DDS Server -- -- We will be used the opendds server first, -- -- We sum 1+1 -- We Start the CalculatorServer based on RTI Connext DDS and we wait a little bit for discovery -- -- This time we are using DDS interoperability, the client is using openDDS and the Server RTI -- -- We switch to RTI Connext Server -- -- We sum 2+2 -- We Start the CalculatorClient based on RTI Connext DDS -- -- We wait a little bit -- -- We open the service selector -- -- We sum 3+3 using RTI Connext DDS based server -- -- And finally we sum 4+4 using the openDDS based Server So, mission accomplished.
RPC over DDS
Features Summary: – Easy RPC framework – High Perfomance – Windows/Linux Support – 100% Standards Based – Open Source: LGPL
Support Available
– Interoperable!
Presenter
Presentation Notes
1.- We have seen in this presentation, the folowing features: eProsima RPC is very easy to use High Perfomance, as fast as the latest RPC frameworks from Facebook and others Windows & Linux are Supported It is 100% Standards Based and Open Source: LGPL But with Support Contracts Available And it comes with Interoperability out of the box Questions?
About eProsima
Presenter
Presentation Notes
Key phrases: 1.- Let’s start with a veru brief introduction of eProsima
About eProsima
Experts on middleware, focused on DDS. OMG Members. RTI Services Partner and Distributor.
Presenter
Presentation Notes
Key phrases: 1.- eProsima is a company based in Spain, we offer middleware products and services, most of them based on DDS 2.- We are OMG members and participate in standards such as the ongoing RPC over DDS standard 3.- And we have a strong relation ship with RTI, being a services partner for Europe and its distrubutor for Spain and Portugal
About eProsima: Products And Services
eProsima Products: – DDS based: Plugins, add-ons, adaptors, etc
Services: – Communication modules, App development, DDS
training, Support. R&D:
– R&D Projects with enterprises and universities. Quality: ISO 9001
– Design, Development, Marketing and Support of Software.
Presenter
Presentation Notes
1.- We develop products and provide services, but also we do research projects with companies and universities
Customers (I)
Amper Programas: – BMS – Simacet (Main Spanish C2 System)
Cassidian: – UAVs - Neuron, Atlante
Ground Station Comm Server
– Comfut INDRA:
– Defense (BMS, UAV PASI) – Air Traffic Control, – SESAR, ATC Interoperability – Energy (InSpeed)
Spanish Army:, – IDT :Tactical Data Interface
Presenter
Presentation Notes
1.- We have the main customers in the defense and aerospace sector in Spain, including the Army, Cassidian, INDRA… 2.- We develop the communications layer for many projects , such as command and control systems, ground station comm servers, ATC systems, etc.
Customers (II)
Isdefe Spanish Army: JCISAT, DGAM CATEC-FADA: R&D Aerospatial Santa Barbara: Armoured Vehicles RTI GMV
Presenter
Presentation Notes
1.- More customers FADA - Fundación Andaluza para el Desarrollo Aeroespacial y CATEC - Centro Avanzado de Tecnología Aeroespacial.
Customers (III)
Tecnobit: COSMOS, Reserved Projects. IKERLAN: R&D. Navantia: F105 (Aegis) Boeing: Atlantida, Swim suit
Presenter
Presentation Notes
1.- And more
eProsima Products.- Index
eProsima RPC over DDS: – Remote procedure calls framework over DDS.
eProsima Fast Buffers. – Serialization engine. Now in beta.
eProsima DDS Non-Intrusive Recorder. – Stores DDS communication history in a data base.
Presenter
Presentation Notes
1.- We develop products, as the one we are presenting today, RPC over DDS, but also 2.- A very fast Serialization engine, actually faster than protocol buffers, and based on CDR 3.- And a Non-intrusive DDS Recordes, that sniffes the RTPS traffic in the network, saving it as DDS messages in a DB
Ongoing Project
FP7: KIARA, Future Internet Middleware – FI-WARE 1st open call – Based on eProsima RPC over DDS & OMG DDS – Lots of new features:
Improved IDL Direct Use of Application native types New formats of marshalling (SOAP, RestFul) Web Services compatibility Protocol negotiation Extended transport support High performance dispatching agent (RPC)
Presenter
Presentation Notes
1.- Also, we are developing right now an important project based on RPC over DDS and DDS 2.- An FP7 program to develop what they call the Future Internet Middleware 3.- We will develop a lot of new features on top of DDS.
eProsima Success Cases
RTI DDS DIL Plugins: Disconnected and Intermitent Links
eProsima developed the plugins for the Spanish Army Tactical Radios, and later were adquired by RTI.
Allow the use of DDS in very low bandwidth links, such as Tactical Radios and Satellite. – Tested from 2400 bps
Tactical Data Interface: Spanish Army
C2 Interoperability Comm layer: – Tactical Radios
From 2400bps – Satellite
Mandated for all the Spanish Army C2 systems. – Already implemented in the
their main C2 systems
eProsima developed the army C2 comm layer using RTI Connext DDS optimized for low bandwidth enviroments. The project included the design of the Data Model and QoS requisites for the Army.
C2 Systems: INDRA & Amper
eProsima Provides a DDS based comm layer for INDRA and Amper C2 Systems.
eProsima implemented the mandated Spanish Army Tactical Data Interface for Simacet (Main Spanish Army C2 System, Amper) and BMS (Tanks C2 System, INDRA & Amper)
SESAR - INDRA ATC
eProsima provides middleware research and prototyping for ATC Interoperability
Among the different middleware technologies studied, DDS and WS are the SESAR proposed technologies for ATC interoperability.
Cassidian: nEURon and Atlante GS
eProsima provides the comm layer for the ground station comm server.
eProsima Non-Intrusive Recorder is used to record the communications for later analisys.
FI-WARE Middleware
eProsima has been selected to develop Future Internet Middleware in the FI-WARE programme.
DDS will be the core technology
Fi-WARE is a consortium of over more than 30 companies and universities including Telefonica, Siemens, SAP, Atos… eProsima will partner in this project with the German Universities DKFI and CISPA and the Swiss ZHAW.
Remote Application Client / Server, Publisher / Subscriber
Application
API / Data Access
Marshalling
Transport Mechanis
ms Wire- Protocols
Transport Protocols UDP TCP TLS, DTLS
Shared Memory
Backplane/ Fabric
XML JSON CDR
SDN Plugin
Data Transfer
Compile time or Embedded Runtime Compiler/Interpreter
Data / Function Mapping
Declarative Data/Function
descritption
Security / QoS Policy
Security / QoS Parameter
Function Stub
Function Skleleton
QoS
Data Writer
Data Reader
- DDS / RTPS
REST / HTTP
RPC Pub/Sub
Negotiation
Publisher Subscriber RPC Server
RPC Client Prepare Initialize
IDL Parser
• IDL based on OMG IDL
• WADL
Security Dispatching
I2ND GE
FI-WARE Middleware: DDS Based
Related Documents
