OPENMAMA AS A MIDDLEWARE STANDARD: ENSURING USER … › images › stories › pdf › eeus201… · OPENMAMA AS A MIDDLEWARE STANDARD: ENSURING USER CHOICE IN MESSAGING SYSTEMS

OPENMAMA AS A MIDDLEWARE STANDARD:

ENSURING USER CHOICE IN MESSAGING SYSTEMS

FEARGAL O’SULLIVAN – NYSE TECHNOLOGIES

The Linux Foundation Enterprise End User Summit

- April 30, 2012

Agenda

Introduction to NYSE Technologies

Message Oriented Middleware (MOM) Primer

OpenMAMA Overview

Use Case: Solace Systems

Use Case: NYSE Technologies Data Fabric

Summary

Q&A

2

3

The commercial technology arm of NYSE Euronext

Our mission is to

“reduce trading friction”

NYSE Technologies

3

Enabling a Global Market Place…

Frankfurt Toronto São Paulo Mahwah Basildon

Institutional Investors

Equities

Additional Venues

Broker-Dealers Derivatives

FX Systematic Traders

Fixed Income

Market Operators

ATSs / MTFs

Chicago Tokyo

4

4

Focus on the Liquidity Center

Platform As A Service (PAAS)

REAL-TIME MARKET DATA MANAGED TRANSACTIONS TICK HISTORY

Infrastructure As A Service (IAAS)

COMPUTE ON DEMAND PHYSICAL

COMPUTE ON DEMAND VIRTUAL

CO-LOCATION (MIS)

Systematic Traders Broker-Dealers

Institutional Investors

Market Operators

Reduce Costs, Gain Agility and Trade New Markets

5

What is Message Oriented Middleware?

• MOM provides a means for applications to send

information to each other, without establishing explicit

connections, and with little-to-no knowledge of each other

• Two common paradigms: publish/subscribe and queuing

• Topic based naming for routing of messages

• A messaging API is typically proprietary to its own

messaging service

6

Why Message Oriented Middleware?

7

Market Gateway

Feed Handler

Algo

Cache

Quote

Conflation Cache

Desktop Traders

M

o

n

i

t

o

r

i

n

g

Historical Tick

Capture

Trade

Custom FX Rates

Consolidated Feed

Market Gateway

Market Gateway

Algo Algo

The Alternative

8

Market Gateway

Feed Handler

Algo

Cache

Quote

Conflation Cache

Desktop Traders

M

o

n

i

t

o

r

i

n

g

Historical Tick

Capture

Trade

Custom FX Rates

Consolidated Feed

Market Gateway

Market Gateway

Algo Algo

Other Use Cases

High Performance Computing Job distribution

Service Oriented Architecture systems Decoupled ‘objects’

Scalable web database queries Multiple app servers to multiple databases

Transactional applications Multi-phase commits

9

What is OpenMAMA?

OpenMAMA is:

Open Middleware Agnostic Messaging API

Supports a variety of MOM platforms

A consistent abstraction layer

High performance

Open Source

Hosted by the Linux Foundation

Governed by a group of industry stakeholders

10

How does OpenMAMA ensure user

choice?

MamaCache SuperFeed Feed

Handler Feed

Handler Algo Cache Monitoring

Feed Handler

Feed Handler

Feed Handler

Informatica LBM

Let’s say you want to change your middleware to take advantage of new innovations…

LBM API

11

Developed by NYSE Technologies

Developed by Third Party Vendor

Open Source

MamaCache SuperFeed Feed

Handler Feed


Feed Handler

Feed Handler

Feed Handler

TIBCO Rendezvous

Without OpenMAMA: • Each application needs to be written to a new API • Which is time consuming and expensive • And locks you into yet another vendor specific API

RV API

12



Open Source

How does OpenMAMA ensure user choice?

MamaCache

OpenMAMA

SuperFeed Feed

Handler Feed


Feed Handler

Feed Handler

Feed Handler

Informatica LBM

Leveraging OpenMAMA: • OpenMAMA lets you code your apps once

13



Open Source


Data Fabric 6

MamaCache

MultiVerb

RDMA LDMA TCP

OpenMAMA

SuperFeed Feed

Handler Feed


Feed Handler

Feed Handler

Feed Handler

Leveraging OpenMAMA: • OpenMAMA lets you code your apps once • Easily upgrade your Middleware or Applications



Open Source

14


Leveraging OpenMAMA: • OpenMAMA lets you code your apps once • Easily upgrade your Middleware or Applications • Support multiple middlewares with multiple applications

Data Fabric 6

MamaCache

TIBCO

Rendezvous

Avis

Mu

ltiV

erb

RD

MA

LD

MA

TC

P

OpenMAMA

Informatica LBM

SuperFeed Feed

Handler Feed


Feed Handler

Feed Handler

Feed Handler

15



Open Source


Data Fabric 6

MamaCache

T

IBC

O

Re

nd

ezvo

us

Avis

Mu

ltiV

erb

RD

MA

LD

MA

TC

P

OpenMAMA In

form

atica

L

BM

SuperFeed Feed

Handler Feed


IBM

W

ebS

phe

reM

Q

So

lace

Syste

ms

AM

QP

Feed Handler

Feed Handler

Feed Handler

As an Open Solution OpenMAMA: • Enables anyone to write a middleware bridge • 3rd Party applications can support OpenMAMA out of the box • Applications and middleware become pluggable / interchangeable

16



Open Source


Result is flexibility and user choice

OpenMAMA

Feed Handler

Algo

Conflation Cache

NYSE Technologies Data Fabric 6.0

Next Gen Cache

Desktop Traders

M

o

n

i

t

o

r

i

n

g

Historical Tick

Capture

Trade

Custom Feed

handler SuperFeed

Market Gateway

Market Gateway

Algo Algo

OpenMAMA TIBCO RV

OpenMAMA LBM

Feed Handler

MAMA Cache


AMQP



Solace Systems

Market Gateway

AMQP

Quote Quote Quote Quote


Developed by Third Party

Open Source

Ke

y

Who is on the Steering Committee today?

A Major NY based

Hedge Fund 18

How to participate in OpenMAMA?

Participation is open to any developer,

corporation or entity

Use OpenMAMA in your applications –

encourage standardized access to other

proprietary middleware systems

All industries are encouraged to join

Join the Steering Group, Technical Group or just

contribute new features and code

If you want to get involved or have questions please reach out through the OpenMAMA development

mailing list: [email protected]. Alternately if you are considering joining our

steering committee or want to learn more complete the application form or contact Mike Woster at

[email protected]

19

mailto:[email protected]




http://www.openmama.org/join-openmama-steering-group




Presented by: Shawn McAllister

Use Case: Solace Systems

Solace Simplifies Real-Time Information Sharing

Hardware Datapath - Highest throughput, lowest latency

- Consolidation and low TCO with built-in virtualization

Unified Messaging Platform

- Any data, anywhere, any QoS, all with one system

Turnkey Appliance - “Rack and run” deployment speeds time to market

- Integrated HA, Management, Security, Monitoring

Within Datacenters

Across Datacenters Web and Mobile Apps

Across Datacenters Web and Mobile Apps

Typical Solace Use Cases

Across Industries

○ Enterprise Messaging / ESB

○ Mobile Application Communication Infrastructure

○ Distributed Data Synchronization

○ Collection/Routing of Sensor Readings

Solace as an OpenMAMA Transport

Why does Solace see value in

OpenMAMA?

Removes API lock-in and drives innovation to create best of breed

Reduces barriers for adoption of best of breed technologies

Mix & match 3rd party applications – feedhandlers, gateways, Tick DB, Entitlements AND messaging

Isolates custom apps from underlying transport technology – gateways, algos, OMS, desktops

Allows creation of hybrid transport infrastructures that remain uniform as viewed by applications

Potential for usage outside FSI especially in high performance applications

Trading Platform

Today’s Trading Platform

Many Messaging Systems & APIs

Gateway

Algo

Gateway

Messaging Exchanges

Client Orders

Middle/Back Office

Messaging

Market Data FH

Reference Data

Messaging Messaging

Market Data

Cache

Market Data

Entitlements

Tick Data

Capture

With OpenMAMA

Fewer Messaging Systems & APIs, More 3rd Party Apps

Gateway

Algo

Gateway

Messaging Exchanges

Client Orders

Middle/Back Office

Messaging

Market Data FH

Reference Data

Messaging Messaging

Market Data

Cache

Market Data

Entitlements

Tick Data

Capture

Trading Platform

OpenMAMA Enables:

Multiple Transports, Single API, Single Data Model

Peer-to-Peer over Infiniband or Ethernet

WAN

Feed Handlers

Cache Algos

DataFabric Transport

ULL

Solace Transport LAN/WAN

Algos

Tick DB

Entitlements

Cache

Conclusion

Open interface standards change the landscape by

reducing lock-in which promotes competition and

innovation

This is the value Solace sees in OpenMAMA

Presented by: Brian Doherty

Use Case: NYSE Technologies Data

Fabric

Data Fabric MultiVerb

30

• Hardware accelerated, kernel bypass, multicast messaging middleware

• Single-digit microsecond transport latency with scalable fan-out distribution

• No exotic components required – operates on industry standard hardware

Send once - network replicates packets

Publisher

Application


Interrupt/Copy Boundary

Memory Region

Application


HCA

Memory Region


Application


HCA

Memory Region


Application


HCA

Memory Region


Application


HCA

Memory Region


InfiniBand / 10 Gigabit RoCE

HCA

MultiVerb Performance

Intel® CRT Datacenter

Test Details

• 300 servers equipped with dual Intel Westmere X5670s

• 1:1000 publisher-to-consumer application ratio

• Throughput set to 1 million, 200-byte messages per

second

31

Results • Average latency: 4.5 µs • 99.99% latency: 19 µs • Aggregate rate of 1 billion

messages per second over a 7 hour period

Open Platform

Open Platform

Open Platform

Open Platform

Feed Handler

Algo

Conflation Cache


Next Gen Cache

Desktop Traders

Mo

nito

ring

Historical Tick

Capture

SDK built Feed

Handler

TickerPlant HD

Market Gateway

Market Gateway

Algo Algo

TIBCO RV

LBM

SuperFeed

MAMA Cache


AMQP


NYSE Technologies Data Fabric


Market Gateway



Developed by Third Party

Open Source

Key

Smart Order Router

Solace Systems

32

Vendor neutral, standard messaging API

33

Existing pain points ▪ Market Data Growth

▪ Increasing complexity

▪ No standardization

▪ Vendor Specific API’s

▪ Costly and slow to Market

The Result • Eliminate vendor lock-in • Leverage best of breed technology • More flexibility and customer choice • Reduced TCO and time to market • Community contributions • Industry standardization

Industry standard data normalization model

Creating a Neutral, Open Platform

Enabling Flexibility and further standardization

Driving Product Innovation

OpenMAMA

Open Market Data

Model

Next

Generation Offerings

Feed Handler

SDK

Open Platform enabling the

Capital Markets

Community

Summary

NYSE Technologies contributed OpenMAMA to

encourage innovation and promote the Capital

Markets Community Platform

OpenMAMA simplifies the development and

deployment of applications that use Message

Oriented Middleware

It is hosted by The Linux Foundation under an LGPL

2.1 License

Widespread industry participation is highly

encouraged

34

Questions?

http://www.openmama.org

OPENMAMA AS A MIDDLEWARE STANDARD: ENSURING USER … › images › stories › pdf › eeus201… · OPENMAMA AS A MIDDLEWARE STANDARD: ENSURING USER CHOICE IN MESSAGING SYSTEMS

Documents