Top Banner
© 2015 VMware Inc. All rights reserved. New VMware Continuent 5.0 A powerful and cost-efficient Oracle GoldenGate alternative December 17, 2015
35

New VMware Continuent 5.0 - A powerful and cost-efficient Oracle GoldenGate alternative!

Apr 15, 2017

Download

Software

Continuent
Welcome message from author
This document is posted to help you gain knowledge. Please leave a comment to let me know what you think about it! Share it to your friends and learn new things together.
Transcript
Page 1: New VMware Continuent 5.0 - A powerful and cost-efficient Oracle GoldenGate alternative!

© 2015 VMware Inc. All rights reserved.

New VMware Continuent 5.0 A powerful and cost-efficient Oracle GoldenGate alternative

December 17, 2015

Page 2: New VMware Continuent 5.0 - A powerful and cost-efficient Oracle GoldenGate alternative!

Agenda •  VMware Continuent Overview •  Migration. Replicate from an old version of Oracle to a new version of Oracle

•  On-boarding to Cloud and Service Providers' data centers. Replicate from an old version of Oracle into a virtual or cloud-hosted environment

•  Replication into analytics and big data

•  Replication to open source databases, incl. MySQL •  Q & A

2

Page 3: New VMware Continuent 5.0 - A powerful and cost-efficient Oracle GoldenGate alternative!

VMware Continuent Overview

Page 4: New VMware Continuent 5.0 - A powerful and cost-efficient Oracle GoldenGate alternative!

What is VMware Continuent?

•  Provides data replication between Oracle and MySQL relational databases and to data warehouses and analytics engines, to extend Big Data insight for better business decisions.

•  Makes it simple to host MySQL database clusters in the cloud, in tenant’s private datacenter or between these locations, for continuous data availability even during system failure.

•  Globally redundant disaster recovery, commercial-grade high availability, and performance scaling for business-critical database applications.

4

Page 5: New VMware Continuent 5.0 - A powerful and cost-efficient Oracle GoldenGate alternative!

Release History

•  Tungsten Replicator 2.2 – Dec 2013 – Added Oracle CDC support

•  Tungsten Replicator 3.0 – Nov 2014 – Added Improved Data warehouse loading, Hadoop

•  Tungsten Replicator 4.0 - April 2015 – Added integration with MySQL clustering

•  Tungsten Replicator moved to Apache License– August 2015

VMware Confidential 5

Page 6: New VMware Continuent 5.0 - A powerful and cost-efficient Oracle GoldenGate alternative!

Select VMware Continuent Customers

6

Page 7: New VMware Continuent 5.0 - A powerful and cost-efficient Oracle GoldenGate alternative!

VMware Continuent Use Cases 1.  Replication

•  Cost effective alternative to Oracle GoldenGate and Oracle Data Guard. •  Replicate data from Oracle to Oracle, Oracle to MySQL, MySQL to Oracle, and MySQL to MySQL.

2.  Real-time Data Loading into Analytics and Big Data •  Quick and efficient replication from one or more Oracle and MySQL databases to data warehouses and big data

analytics engines such as Hadoop (all distributions), HP Vertica, and Amazon Redshift. •  Extend Big Data insight for better business decisions.

3.  MySQL Clustering for HA •  HA clustering for MySQL databases, including automatic failover, zero downtime maintenance and load balancing. •  Automatically replace a failed primary database server within seconds while maintaining continuous operations.

4.  MySQL Clustering with Disaster Recovery •  Quick and efficient replication to a secondary MySQL database cluster, on tenant’s premise, in cloud, or to a

separate site for disaster recovery. •  Recover quickly and automatically from Database Management System and host failures.

7

Page 8: New VMware Continuent 5.0 - A powerful and cost-efficient Oracle GoldenGate alternative!

Oracle Replication Technical Deep Dive

Page 9: New VMware Continuent 5.0 - A powerful and cost-efficient Oracle GoldenGate alternative!

VMware Continuent for Replication

•  Logical replication from Oracle (and MySQL) • Replication is executed at the transactional level

– Consistent across transactions when reading and writing •  Transactional stored in a neutral format •  Allows us to apply that data back as a transaction to:

– Another Oracle Instance – MySQL – Data warehouses

VMware Confidential 9

Page 10: New VMware Continuent 5.0 - A powerful and cost-efficient Oracle GoldenGate alternative!

Replication solves important problems for RDBMS users

• Real-time local copies in case the DBMS fails • Real-time remote copies in case the site fails •  Loading data into quickly into analytics, big data •  Feeding edge applications from an Oracle central database • Migrating from to:

– New versions – Less expensive editions – Different RDBMS types, e.g., Enterprise to Standard

CONFIDENTIAL 10

Page 11: New VMware Continuent 5.0 - A powerful and cost-efficient Oracle GoldenGate alternative!

How does VMware Continuent Replication for Oracle do this?

11

REDO Logs Replicator

Replicator

Low application impact Low latency

transfer

Extract

Transfer

Apply

Changes DBMS open for reads

Page 12: New VMware Continuent 5.0 - A powerful and cost-efficient Oracle GoldenGate alternative!

The target DBMS does not have to be Oracle!

12

REDO Logs Replicator

Replicator

Extract

Transfer

Apply

Changes

Continuent Continuent

Page 13: New VMware Continuent 5.0 - A powerful and cost-efficient Oracle GoldenGate alternative!

Logical replication applies transactions in serial order to targets

CONFIDENTIAL 13

Transaction Log 0 Create table db1.foo 1 Create table db2.foo 2 insert into db1. foo values(1, … 3 Update db1.foo where id=1… 4 Insert into db2.foo values(5,…) 5 Insert into db1.foo values(3,…) 6 Delete from db2.foo where id=5

Source

Target

Page 14: New VMware Continuent 5.0 - A powerful and cost-efficient Oracle GoldenGate alternative!

Drilling down into the replication architecture

14

Replicator mySQL

DBMS Logs

mySQL

Replicator

THL

THL

Download transactions via network or from file system

Apply using JDBC (Transactions + metadata)

(Transactions + metadata)

Primary

Secondary

Source

Target

Low latency transfer

Low application impact

Page 15: New VMware Continuent 5.0 - A powerful and cost-efficient Oracle GoldenGate alternative!

On-board replication places Oracle DBMS and replicator on a single host

15

Replicator mySQL

REDO Logs

THL

(Transactions + metadata)

Primary

(To secondary)

Capture data

dictionary Plogs

Source

Capture raw transactions

Convert to serialized row changes and DDL

Oracle DBMS and Replicator Host

(Linux)

MINE Process

Page 16: New VMware Continuent 5.0 - A powerful and cost-efficient Oracle GoldenGate alternative!

Off-board replication puts FETCH process on DBMS host and replicator + MINE on another host

16

Replicator mySQL

REDO Logs

THL

(Transactions + metadata)

Primary

(To secondary)

FETCH Process

Capture data

dictionary Plogs

Source

Capture raw transactions

Convert to serialized row changes and DDL

Replicator Host (Linux)

Oracle DBMS Host (5 platforms)

MINE Process

Page 17: New VMware Continuent 5.0 - A powerful and cost-efficient Oracle GoldenGate alternative!

VMware Continuent places minimal demands on source and target DBMS instances

•  Source Oracle DBMS requirements: – Supplemental logging – Archive logs – Replicator metadata stored in DBMS – Replicator login with access to catalogs and flashback query – Local process to read REDO logs

•  Target Oracle DBMS requirements: – Replicator metadata stored in DBMS

CONFIDENTIAL 17

Page 18: New VMware Continuent 5.0 - A powerful and cost-efficient Oracle GoldenGate alternative!

VMware Continuent can apply transactions in parallel to increase performance and maximize use of target I/O bandwidth

18

THL Parallel queue (Transactions + metadata)

Target

Extract Filter Apply Extract Filter Apply

Extract Filter Apply

Extract Filter Apply

Extract Filter Apply

Stage Stage Stage

Replicator Pipeline

Source replicator

Page 19: New VMware Continuent 5.0 - A powerful and cost-efficient Oracle GoldenGate alternative!

VMware Continuent supports a wide range of replication topologies

19

Replicator Replicator

Replicator

Fan-in

Replicator Replicator

Replicator

Fan-out

Multi-primary Replicator Replicator

Page 20: New VMware Continuent 5.0 - A powerful and cost-efficient Oracle GoldenGate alternative!

VMware Continuent replication is platform-independent and supports a wide range of targets

20

Replicator Replicator

Replicator

Replicator

Source

Other RDBMS versions and OS platforms

Other RDBMS types

Non-relational DBMS

Page 21: New VMware Continuent 5.0 - A powerful and cost-efficient Oracle GoldenGate alternative!

VMware Continuent works across sites to enable DR

21

•  Copy control file settings •  Copy schemas and app config info •  Provision using data pump/rman

One-time provisioning

Incremental replication Replicator Replicator

•  Requires a single open port (2112) •  TLS encryption enabled by default •  Authentication between replicators

Page 22: New VMware Continuent 5.0 - A powerful and cost-efficient Oracle GoldenGate alternative!

Migration Use Case

• Migrate data from: – Non-x86 Installation, e.g. Solaris/SPARC, AIX/POWER, HP-UX/PA

RISC – x86 Non-Linux, e.g. Windows – x86 Non-virtualized

• Migrate data to: – Remote datacenter – Remote cloud provider – Remote virtualized environment

VMware Confidential 22

Page 23: New VMware Continuent 5.0 - A powerful and cost-efficient Oracle GoldenGate alternative!

VMware Continuent primes and replicates to enable Migration

23

Initial provisioning

Incremental replication Replicator Replicator

Page 24: New VMware Continuent 5.0 - A powerful and cost-efficient Oracle GoldenGate alternative!

Migration Process

•  Initial provision of data to target database environment • Ongoing replication of data • Migrate your application and environment •  Switch over application to new database environment • Decommission the old environment

VMware Confidential 24

Page 25: New VMware Continuent 5.0 - A powerful and cost-efficient Oracle GoldenGate alternative!

DR is closely related to migration and support for edge applications

25

NON-Oracle DBMS

Incremental replication

Replicator Replicator

Schema generation •  Generate table DDL from source •  Load to target DBMS

Initial provisioning •  Load data using data pump and

sandbox Oracle server

Page 26: New VMware Continuent 5.0 - A powerful and cost-efficient Oracle GoldenGate alternative!

Use for Analytics

26

Replicator Replicator

Oracle

Hadoop

Hadoop

Hadoop

Replicator

Oracle

Replicator

MySQL

Page 27: New VMware Continuent 5.0 - A powerful and cost-efficient Oracle GoldenGate alternative!

Transactionally consistent and ordered for efficient loading

27

Replicator

Source DBMS

CSV Files CSV Files CSV Files CSV Files

Load Script

HADOOP CLUSTER

Parallel loading

Map/Reduce View Generation

Page 28: New VMware Continuent 5.0 - A powerful and cost-efficient Oracle GoldenGate alternative!

Use for Scale-out

28

Oracle

Replicator Replicator

Replicator

Replicator

MySQL

Web App Server

Web App Server

Web App Server

Page 29: New VMware Continuent 5.0 - A powerful and cost-efficient Oracle GoldenGate alternative!

Demo VMware Continuent: Oracle Replication in Action

Page 30: New VMware Continuent 5.0 - A powerful and cost-efficient Oracle GoldenGate alternative!

•  Extract is now very capable:

•  Apply to any Oracle version edition, file format, plus RAC on any OS platform

The latest Continuent 5.0 release adds robust Oracle features

Feature What we support DDL Table-related DDL operations (CREATE TABLE, VIEW, INDEX…) Row changes DML operations on most column types Oracle Versions All versions from Oracle 9.2i onward (9i, 10G, 11G, 12C) Oracle Editions All editions (EE, SE, SE1, XE) OS Platforms Extract from Oracle on: Linux, Solaris, Windows, AIX, HP-UX File Formats OS data files and ASM (Automatic Storage Management, proprietary format) Clustering Supports extraction from RAC

30

Page 31: New VMware Continuent 5.0 - A powerful and cost-efficient Oracle GoldenGate alternative!

Things we still don’t support

Feature Remarks

Transparent Data Encryption aka TDE

Rules out operation on sites with high security requirements

Compressed data Some DDL operations CREATE USER, CREATE/DROP/ALTER TRIGGER,

clustered table setup, etc.

Some data types XMLType, geometric types, BINARY FLOAT/DOUBLE, ANYTYPE, ANYDATA not supported

Certain table types Clustered, nested, and remote tables

Quick failover/failback Currently requires partial replicator reinstallation; not good for local HA use cases

31

Page 32: New VMware Continuent 5.0 - A powerful and cost-efficient Oracle GoldenGate alternative!

Other Features in 5.0 •  Security (authentication, TLS/SSL, certificate) now enabled throughout and by

default •  Improvements to HP Vertica loading and compatibility •  Cleaner installation directory structure

32

Page 33: New VMware Continuent 5.0 - A powerful and cost-efficient Oracle GoldenGate alternative!

Wrap-up •  VMware Continuent replication provides robust, flexible capabilities that have

been battle-tested in demanding customer environments •  Replication features compare favorably to Oracle GoldenGate and Data Guard •  VMware Continuent handles HA/DR, platform and version migration, data

warehouse loading, and edge application use cases

33

Page 34: New VMware Continuent 5.0 - A powerful and cost-efficient Oracle GoldenGate alternative!

34

Page 35: New VMware Continuent 5.0 - A powerful and cost-efficient Oracle GoldenGate alternative!

For more information, contact us: Robert Noyes Alliance Manager, AMER & LATAM [email protected] +1 (650) 575-0958 Philippe Bernard Alliance Manager, EMEA & APJ [email protected] +41 79 347 1385

MC Brown Senior Product Line Manager [email protected] Eero Teerikorpi Sr. Director, Strategic Alliance [email protected] +1 (408) 431-3305

www.vmware.com/products/continuent