Top Banner
page © 2015 VoltDB FAST DATA: ACHIEVING REAL-TIME DATA ANALYSIS ACROSS THE FINANCIAL DATA CONTINUUM 1
33

Fast Data: Achieving Real-Time Data Analysis Across the Financial Data Continuum

Aug 15, 2015

Download

Software

VoltDB
Welcome message from author
This document is posted to help you gain knowledge. Please leave a comment to let me know what you think about it! Share it to your friends and learn new things together.
Transcript
Page 1: Fast Data: Achieving Real-Time Data Analysis Across the Financial Data Continuum

page© 2015 VoltDB

FAST DATA: ACHIEVING REAL-TIME DATA ANALYSIS ACROSS THE FINANCIAL DATA CONTINUUM

1

Page 2: Fast Data: Achieving Real-Time Data Analysis Across the Financial Data Continuum

page© 2015 VoltDB

OUR SPEAKERS

Peter VescusoCMO at VoltDB

2

Marc FirenzeCTOEagle Investment Systems

Page 3: Fast Data: Achieving Real-Time Data Analysis Across the Financial Data Continuum

page© 2015 VoltDB page© 2015 VoltDB

OVERVIEW

•  Eagle Investment Systems

•  Solution & Technology

•  Fast vs Big Data

•  Why In-Memory Database Technology?

3

Page 4: Fast Data: Achieving Real-Time Data Analysis Across the Financial Data Continuum
Page 5: Fast Data: Achieving Real-Time Data Analysis Across the Financial Data Continuum

Information Classification: Confidential 5

Eagle Investment Systems

INNOVATIVE •  Since 1989, Eagle has

delivered leading-edge solutions

•  Eagle pioneered the data-centric platform

•  40% of Eagle’s resources in R&D

•  Innovative deployment continuum

Helping the World Grow Assets Efficiently

COMMITTED •  800 resources worldwide •  Operating across five

continents •  International client base

consisting of more than 160 clients

•  Ten years on FinTech 100

EFFICIENT •  $21T AUM managed on

Eagle platform •  Eagle’s effectiveness is

evidenced by the caliber of the clients we service:

§  12 of top 25 largest global money managers are Eagle clients

§  Four of top 10 managers of international/global assets use Eagle software

Page 6: Fast Data: Achieving Real-Time Data Analysis Across the Financial Data Continuum

Information Classification: Confidential 6

Eagle’s Global Presence

Wellesley, MA West Hartford, CT New York, NY

Dubai

London

Toronto Montreal

Pittsburgh, PA

Pune

San Francisco, CA

Singapore

Beijing

Wroclaw, Poland

Clients

Eagle Offices

Chennai

Sydney

Page 7: Fast Data: Achieving Real-Time Data Analysis Across the Financial Data Continuum

Information Classification: Confidential 7

Eagle Investment Systems

Eagle’s mission is to be the recognized global leader of high quality and innovative data management, accounting and performance measurement solutions for the financial

services industry.

§  Subsidiary of BNY Mellon

§  Products and services:

•  Data Management

•  Investment Accounting

•  Performance Measurement & Attribution

•  Eagle ACCESSSM, Secure Private Cloud

•  Implementation Services and Technology Consulting

Page 8: Fast Data: Achieving Real-Time Data Analysis Across the Financial Data Continuum

Information Classification: Confidential 8

Eagle Investment Systems Awards

Page 9: Fast Data: Achieving Real-Time Data Analysis Across the Financial Data Continuum

Information Classification: Confidential 9

Eagle Investment Systems – Target Clients

•  Following Criteria: •  >$20 billion in AUM (prefer over $100 billion and

have clients over $1 trillion) •  Global operating centers •  Values Eagle’s suite of solutions •  Values a long-term, collaborative relationship

•  Focus on Eagle ACCESSSM

•  Eagle Supports: •  Investment Managers (50% of the client base) •  Mutual Funds •  Insurance Companies and Banks

Page 10: Fast Data: Achieving Real-Time Data Analysis Across the Financial Data Continuum

Information Classification: Confidential 10

Our Clients

•  The shift to Eagle ACCESSSM and outsourcing in recent years now comprises over 85% of our new business

•  Over 30% of new clients have been international (non US clients)

•  Eagle has opened offices in Singapore, Beijing, Pune, and Wroclaw

Data Management Accounting Performance

Measurement

Allstate Investments BNY Mellon AEGON

Colonial First State JP Morgan Asset Management

Western Asset Management

Pioneer Investments Capital Group Invesco Ltd

Dimensional Fund Advisors Charles Schwab NYLIM

Voya Financial TIAA-CREF Mellon Capital Management

Deutsche Asset Management AGF Investments

Fort Washington Investment Advisors

Global client base:

•  68% United States •  14% Canada •  11% EMEA •  7% APAC

Page 11: Fast Data: Achieving Real-Time Data Analysis Across the Financial Data Continuum

Information Classification: Confidential 11

The Solution Continuum

Designed to Provide You with Strategic Flexibility as Your Business Evolves

In-house software for accounting,

data management and performance

Operational responsibility split between client and

BNY Mellon

Full operational responsibility outsourced

to BNY Mellon

Partial Investment Services (Co-sourcing)

Operations

Technology

Software Hosting Full Investment Services (Outsourcing)

Eagle software hosted by BNY Mellon

(Eagle ACCESSSM)

•  Continuum covers the spectrum of deployment options from traditional software installation through full business outsourcing/lift-out

•  Market trends shifting away from software (on premise) and down the Continuum.

•  Provides independence and flexibility to move in either direction along continuum as our client’s business evolves

Page 12: Fast Data: Achieving Real-Time Data Analysis Across the Financial Data Continuum

Information Classification: Confidential 12

Eagle ACCESSSM

Lower, Stabilized Cost •  Predictable fee •  Reduce IT infrastructure •  Redeploy valuable IT and business assets

Safe, Secure and Reliable •  BNY Mellon Data Centers •  24x7 High Availability •  Audited •  Business continuity enabled •  Service level commitments

High Touch Support •  Dedicated support resources •  Online real time access for issue resolution •  Proactive environment monitoring •  File monitoring and remediation •  Client Playbooks

Increased Client Satisfaction •  Standard supported interfaces •  Easier upgrades keep you current

Page 13: Fast Data: Achieving Real-Time Data Analysis Across the Financial Data Continuum

Information Classification: Confidential 13

Accounting Rules-Based Architecture •  Multiple business lines

•  Mutual Funds •  Institutional •  Insurance •  Alternatives •  Wealth Management

True Investment Accounting •  Multi Basis – Multi Currency •  Integrated General Ledger •  Multiple Accounting books •  IFRS, GAAP, Tax Statutory (Schedule D) •  Comprehensive instrument coverage •  Full Audit Trail with accurate as-of reporting on stored data (not on the fly)

24x7 Global “Process Centers” •  Prioritize work within regions & perform parallel business processes •  Configure workflows across operational categories •  Event based without needing to “shut down” to process batch jobs •  Delivering information/reports at the right time

Eagle Data Hub

Page 14: Fast Data: Achieving Real-Time Data Analysis Across the Financial Data Continuum

Information Classification: Confidential 14

Performance Performance •  Industry Standard Rate of Return Calculations •  NAV Based Returns and Validation •  Custom Calculation Flexibility – Net of Fees, Principal or Income, Accrued or Tiered Fees •  Internal Rate of Return •  Derivatives at the Leg and/or Deal Level

Attribution •  Equity, Fixed Income Attribution, Multi Currency, Flexible Models

GIPS® Composite Management

Custom Benchmark Construction

Embedded Operational Workflow •  Exception Based Validation •  Preliminary and Final

Reporting •  Flexible, attribute-based “grouping” structures, reporting hierarchies

Eagle Data Hub

Page 15: Fast Data: Achieving Real-Time Data Analysis Across the Financial Data Continuum

Information Classification: Confidential 15

Data Management Multi Source Data Hub •  Data Centric •  Full Audit Trail

Message Based Data Integration •  Data Validation and Enrichment •  Standard Interfaces

Rules Based Workflow •  Security Master Validation & Workflow •  Pricing & FX Validation & Workflow

Unlimited Entity Hierarchy •  Complex Portfolio Structures •  Aggregation and Disaggregation

Information Delivery •  Intelligent Aggregation, Look Through, Dynamic Reporting •  Data Delivery, Client Reporting •  Data Mart, Web Portal

24x7 Global Process Centers •  Configure workflows across operational categories •  Delivering information/reports at the right time

Eagle Data Hub

Page 16: Fast Data: Achieving Real-Time Data Analysis Across the Financial Data Continuum

Information Classification: Confidential 16

The Eagle Solution

Security Level and NAV Returns

Performance Calculations

Distribution

Portal/Web Site Client Reporting Data Mart

Record Keeping

Transaction Processing

General Ledger Accounting

Relational Data Store

Portfolio Management Operational/Analysis Reporting Eagle Data Warehouse

Eagle Performance

Engine

Eagle Accounting

Engine

Eagle Reference Data

Management

Security & Pricing Reference Data Management

Portfolio Attribution

GIPS Composite Management

Derivative & Exposure Analysis

Page 17: Fast Data: Achieving Real-Time Data Analysis Across the Financial Data Continuum

Information Classification: Confidential 17

Eagle’s Technology Strategy

Page 18: Fast Data: Achieving Real-Time Data Analysis Across the Financial Data Continuum

Information Classification: Confidential 18

Target Product Architecture

Page 19: Fast Data: Achieving Real-Time Data Analysis Across the Financial Data Continuum

page© 2015 VoltDB

VOLTDB OVERVIEW

Mike Stonebraker

FASTWorld Record Cloud Benchmark: YCSB (Yahoo Cloud Serving Benchmark) 2.4 million tps

(transactions per second)

Other Stonebraker Companies

19

Technology•  In-Memory (but data is durable to disk)•  Scale-Out shared-nothing architecture•  Reliability and fault tolerance

•  SQL + Java with ACID•  Hadoop and data warehouse integration•  Open source and commercially licensed (24X7)

Co-founded by winner of the 2014 ACM Turing Award

Page 20: Fast Data: Achieving Real-Time Data Analysis Across the Financial Data Continuum

page© 2015 VoltDB

VISION

20

All businesses will compete on a new dimension – the ability to make decisions “in the moment” on Fast Data.

(Grab real-time data and output recommendations, decisions or analyses in milliseconds)

Page 21: Fast Data: Achieving Real-Time Data Analysis Across the Financial Data Continuum

page© 2015 VoltDB

PROBLEMS

21

Companies are not tapping the inherent value in fast data because it’s too difficult/expensive.

We  make  it  simple,  easy.  

Page 22: Fast Data: Achieving Real-Time Data Analysis Across the Financial Data Continuum

page© 2015 VoltDB

PROBLEMS

22

Businesses hack together a bunch of different products that each sort of do different things, tinker and tinker with it, and only realize a small part of the opportunity.

We’re  a  single,  integrated  pla4orm.  

Page 23: Fast Data: Achieving Real-Time Data Analysis Across the Financial Data Continuum

page© 2015 VoltDB

OUR COMPETITIVE ADVANTAGE

23

VoltDB is a new database platform designed to uniquely power fast data applications in a way not possible with existing technologies.

Page 24: Fast Data: Achieving Real-Time Data Analysis Across the Financial Data Continuum

page© 2015 VoltDB

NEW ENTERPRISE ARCHITECTURE: FAST + BIG

24

Page 25: Fast Data: Achieving Real-Time Data Analysis Across the Financial Data Continuum

page© 2015 VoltDB

VOLTDB

StreamingAnalytics-  Filtering-  Windowing-  Aggregation-  Enrichment-  Correlations

Batch/IterativeAnalytics-  Statistical correlations-  Multi-dimensional analysis-  Predictive analyticsOperational

Interaction/ Transactions-  Context-aware-  Personal-  Real-time

+

Data in Motion Data at Rest

Customer-Facing-  Personalization-  Customer experience

Operations-Facing-  Network optimization-  IoT, Sensors-  API monitoring Fast Data Applications

Page 26: Fast Data: Achieving Real-Time Data Analysis Across the Financial Data Continuum

page© 2015 VoltDB

FAST DATA

•  Ingest

•  Analyze

•  Decide

Streaming Analytics

Operational Interaction

}Fast Data =

}

Page 27: Fast Data: Achieving Real-Time Data Analysis Across the Financial Data Continuum

page© 2015 VoltDB

ARCHITECTURE IS IMPORTANT….

Fast data requires a different architecture.

Page 28: Fast Data: Achieving Real-Time Data Analysis Across the Financial Data Continuum

page© 2015 VoltDB

VOLTDB: A SUPERIOR ARCHITECTURE FOR FAST DATA

ü In-Memory performance

ü ACID & SQL & Java

ü Scale-out, shared nothing

ü Reliability and fault tolerance

ü Streaming analytics

Page 29: Fast Data: Achieving Real-Time Data Analysis Across the Financial Data Continuum

page© 2015 VoltDB

FAST DATA INTEGRATIONS FOR IMPORT & EXPORTImporters

•  Kafka Loader

•  JDBC Loader

•  Vertica Udx

•  Apache Hive and Apache Pig

Exporters

•  HDFS Export to Hadoop via WebHDFS and HttpFS

•  HTTP Export•  Delivery and Alerting via HTTP post/get

•  Message queue delivery: Kafka Export, RabbitMQ Expo

•  Export format configurable

•  Avro, CSV, TSV, and more…29

Page 30: Fast Data: Achieving Real-Time Data Analysis Across the Financial Data Continuum

page© 2015 VoltDB

VOLTDB MANAGEMENT CENTER

30

Admin

Query

Monitor

Monitor - Stored Procedures

Page 31: Fast Data: Achieving Real-Time Data Analysis Across the Financial Data Continuum

page© 2015 VoltDB

Performance – YCSB on Bare-Metal Servers and VMs

SoftLayer: Update and Read Latency

Late

ncy

(ms)

Throughput (ops/sec)

IBM SoftLayer

AWS

YCSB Workload B – SoftLayer and AWS

Yahoo Cloud Serving Benchmark (YCSB) is a popular industry-standard performance benchmark for cloud databases

•  2.4 million tps (transactions per second) on a 12-node SoftLayer cluster

Page 32: Fast Data: Achieving Real-Time Data Analysis Across the Financial Data Continuum

page© 2015 VoltDB

WHY VOLTDB?

Faster

Smarter Better

•  Superior architecture for fast data

•  Scale-out, In-Memory, ACID

•  Data durability and HA

•  Fastest in the cloud

•  VoltDB customers realize exceptional business value

Page 33: Fast Data: Achieving Real-Time Data Analysis Across the Financial Data Continuum

page© 2015 VoltDB

QUESTIONS?

•  Use the chat window to type in your questions

•  Try VoltDB yourself:

Ø  Free trial of the Enterprise Edition:

•  www.voltdb.com/Download

Ø  Try VoltDB with our 1-click Docker container

Ø www.voltdb.com/community/demo

Ø  Open source version is available on github.com

•  Email us your question: [email protected]

33