Top Banner
© 2015 VMware Inc. All rights reserved. VMware Continuent Replication Enabling HA, DR, data warehouse loading, and license reduction for Oracle users vCloud Air Data Services September 24 th , 2015
25

Oracle HA, DR, data warehouse loading, and license reduction through edge apps with VMware Continuent Replication

Jan 17, 2017

Download

Software

Continuent
Welcome message from author
This document is posted to help you gain knowledge. Please leave a comment to let me know what you think about it! Share it to your friends and learn new things together.
Transcript
Page 1: Oracle HA, DR, data warehouse loading, and license reduction through edge apps with VMware Continuent Replication

© 2015 VMware Inc. All rights reserved.

VMware Continuent Replication Enabling HA, DR, data warehouse loading, and license reduction for Oracle users

vCloud Air Data Services

September 24th, 2015

Page 2: Oracle HA, DR, data warehouse loading, and license reduction through edge apps with VMware Continuent Replication

2

Agenda

1 Introduction to VMware Continuent

2 Using Continuent Replication to Solve Oracle Use Cases

3 Wrap-up and Questions

Page 3: Oracle HA, DR, data warehouse loading, and license reduction through edge apps with VMware Continuent Replication

Introducing VMware Continuent

Software-as-a-Service (SaaS) Vendors E-commerce Financial Services Mobile Applications Oracle and MySQL Applications

Markets

Business continuity for business-critical Oracle and MySQL databases

Commercial-grade multi-site HA/DR

Database Clustering

Flexible, high-performance replication for Oracle and MySQL databases

Simple data loading into analytics and big data

Data Replication

Oracle to Oracle replication for reporting and data warehouse MySQL replication to and from Oracle MySQL Replication between MySQL, MariaDB and Percona servers

Solution Solution MySQL single site HA MySQL multi-site HA and DR

Page 4: Oracle HA, DR, data warehouse loading, and license reduction through edge apps with VMware Continuent Replication

Architecture of VMware Continuent clusters

4

Manager Replicator

Manager Replicator

Manager Replicator

Secondary Primary Secondary

Continuent Connector Continuent Connector

Page 5: Oracle HA, DR, data warehouse loading, and license reduction through edge apps with VMware Continuent Replication

Select VMware Continuent Customers

Page 6: Oracle HA, DR, data warehouse loading, and license reduction through edge apps with VMware Continuent Replication

The top three RDBMS dominate the market by most measures of popularity and economic value

0%

10%

20%

30%

40%

50%

60%

0

200

400

600

800

1000

1200

1400

1600

Oracle MySQL MS SQL PostgresSQL DB2

Usage

Score

Survey of RDMS Usage

Popularity -- Db-engines.com Sep 2015 Business Critical Usage - InformationWeek 2014

Page 7: Oracle HA, DR, data warehouse loading, and license reduction through edge apps with VMware Continuent Replication

Replication solves important problems for RDBMS users

• Real-time local copies in case the DBMS fails • Real-time remote copies in case the site fails •  Loading data into quickly into analytic systems •  Feeding edge applications from the Oracle mother ship • Migrating from Oracle to:

– New Oracle versions – Less expensive editions – Non-Oracle DBMS

7

Page 8: Oracle HA, DR, data warehouse loading, and license reduction through edge apps with VMware Continuent Replication

8

Agenda

1 Introduction to VMware Continuent

2 Using Continuent Replication to Solve Oracle Use Cases

3 Wrap-up and Questions

Page 9: Oracle HA, DR, data warehouse loading, and license reduction through edge apps with VMware Continuent Replication

VMware Continuent implements flexible, high-performance replication for Oracle and MySQL

9

Replicator mySQL

DBMS Logs

mySQL

Replicator

THL

THL

Download transactions via network or from file system

Apply using JDBC (Transactions + metadata)

(Transactions + metadata)

Primary

Secondary

Source

Target

Low latency transfer

Low application impact

Page 10: Oracle HA, DR, data warehouse loading, and license reduction through edge apps with VMware Continuent Replication

VMware Continuent captures transactions directly from Oracle REDO logs

10

Replicator mySQL

REDO Logs

mySQL

THL

(Transactions + metadata)

Primary

(To secondary)

Capture data

dictionary

Source

Capture raw transactions

Staging area for REDO log

data

Replicator Host Oracle DBMS Host

Convert to serialized row

changes and DDL

Page 11: Oracle HA, DR, data warehouse loading, and license reduction through edge apps with VMware Continuent Replication

VMware Continuent places minimal demands on source and target DBMS instances

•  Source Oracle DBMS requirements: – Supplemental logging – Archive logs – Replicator metadata stored in DBMS – Replicator login with access to catalogs and flashback query –  local process to read REDO logs

•  Target Oracle DBMS requirements: – Replicator metadata stored in DBMS

11

Page 12: Oracle HA, DR, data warehouse loading, and license reduction through edge apps with VMware Continuent Replication

Continuent logical replication applies transactions in serial order to targets

12

Transaction Log (Row changes + Statements)

0 Create table db1.foo 1 Create table db2.foo 2 insert into db1. foo values(1, … 3 Update db1.foo where id=1… 4 Insert into db2.foo values(5,…) 5 Insert into db1.foo values(3,…) 6 Delete from db2.foo where id=5

Source

Target

Page 13: Oracle HA, DR, data warehouse loading, and license reduction through edge apps with VMware Continuent Replication

Continuent can apply transactions in parallel to increase performance and maximize use of target I/O bandwidth

13

THL Parallel queue (Transactions + metadata)

Target

Extract Filter Apply Extract Filter Apply

Extract Filter Apply

Extract Filter Apply

Extract Filter Apply

Stage Stage Stage

Replicator Pipeline

Source replicator

Page 14: Oracle HA, DR, data warehouse loading, and license reduction through edge apps with VMware Continuent Replication

VMware Continuent can extract data in parallel to provision data on target while source applications are running

14

THL

(Transactions + metadata)

Extract Filter Apply Extract Filter Apply

Stage Stage

Replicator Pipeline

Source Multi-threaded data extraction using flashback queries

Page 15: Oracle HA, DR, data warehouse loading, and license reduction through edge apps with VMware Continuent Replication

Continuent supports a wide range of replication topologies

15

Replicator Replicator

Replicator

Fan-in

Replicator Replicator

Replicator

Fan-out

Multi-primary Replicator Replicator

Page 16: Oracle HA, DR, data warehouse loading, and license reduction through edge apps with VMware Continuent Replication

Continuent replication is platform-independent and supports a wide range of targets

16

Replicator Replicator

Replicator

Replicator

Source

Other RDBMS versions and OS platforms

Other RDBMS types

Non-relational DBMS

Page 17: Oracle HA, DR, data warehouse loading, and license reduction through edge apps with VMware Continuent Replication

We can even divide logs into transaction sequences on keys

17

Table=db1.foo, key=1 2 insert into db1. foo values(1, … 3 Update db1.foo where id=1…

Table db2.foo, key=5 4 Insert into db2.foo values(5,…) 6 Delete from db2.foo where id=5

Table=db1.foo, key=3 5 Insert into db1.foo values(3,…) Source

Target

Page 18: Oracle HA, DR, data warehouse loading, and license reduction through edge apps with VMware Continuent Replication

Ordering transactions around keys enables efficient data warehouse loading

18

Replicator

Source DBMS

CSV Files CSV Files CSV Files CSV Files

Load Script

HADOOP CLUSTER

Parallel loading

Map/Reduce View Generation

Page 19: Oracle HA, DR, data warehouse loading, and license reduction through edge apps with VMware Continuent Replication

Demo Time!

19

Oracle Replication Demonstration

Oracle 11G Oracle 12C

Page 20: Oracle HA, DR, data warehouse loading, and license reduction through edge apps with VMware Continuent Replication

Provisioning

Data Loading

Low-Latency Active

Replication

Source

High Availability Disaster Recovery Reporting

VMware Continuent provides a flexible alternative to Oracle GoldenGate and DataGuard

Oracle 9i (9.2), 10g, 11g, 12c Oracle SE, EE, SE One, Oracle RAC and Oracle XE ASM and direct files All common data types DDL operations Linux/Windows/Solaris/AIX

Non-Oracle Edge Applications

Target

Migration

Page 21: Oracle HA, DR, data warehouse loading, and license reduction through edge apps with VMware Continuent Replication

Provisioning

Low-latency active Replication

VMware Continuent enables near real-time loading into analytic systems and big data processing pipelines

Source Nodes Target Data Warehouse

Page 22: Oracle HA, DR, data warehouse loading, and license reduction through edge apps with VMware Continuent Replication

Where is VMware Continuent Going Next?

Provisioning

Data Loading

Low-Latency

Active Replication

Row Stores

DR & reporting

Real-time data loading into analytics and data warehouses

Reporting Data warehouse

Real-time data loading

Front-end web applications

New DBMS sources

Page 23: Oracle HA, DR, data warehouse loading, and license reduction through edge apps with VMware Continuent Replication

23

Agenda

1 Introduction to VMware Continuent

2 Using Continuent Replication to Solve Oracle Use Cases

3 Wrap-up and Questions

Page 24: Oracle HA, DR, data warehouse loading, and license reduction through edge apps with VMware Continuent Replication

Wrap-up •  VMware Continuent Replication provides robust, flexible capabilities that have

been battle-tested in demanding customer environments •  Replication features compare favorably to Oracle GoldenGate and DataGuard •  Continuent VMware handles HA/DR, data warehouse loading, and edge

application use cases

24

Page 25: Oracle HA, DR, data warehouse loading, and license reduction through edge apps with VMware Continuent Replication

For more information, contact us: Robert Noyes Alliance Manager, AMER & LATAM [email protected] +1 (650) 575-0958 Philippe Bernard Alliance Manager, EMEA & APJ [email protected] +41 79 347 1385

Eero Teerikorpi Sr. Director, Strategic Alliance [email protected] +1 (408) 431-3305

www.vmware.com/products/continuent