Top Banner
69
Welcome message from author
This document is posted to help you gain knowledge. Please leave a comment to let me know what you think about it! Share it to your friends and learn new things together.
Transcript
Page 1: Oracle Golden Gate
Page 2: Oracle Golden Gate

Oracle GoldenGate: Architecture forReal-Time Replication

Fred LouisOracle Enterprise ArchitectOhio Valley Region

Page 3: Oracle Golden Gate

<Insert Picture Here>

Agenda

Introduction to Oracle GoldenGateTechnology OverviewArchitecture Deep Dive: Differentiators

Component ArchitecturePerformance & ScalabilityTransaction Integrity & ReliabilityHeterogeneity

Other Key FeaturesInstantiationSQL InterfaceEvent Marker InfrastructureETL Integration

3

Page 4: Oracle Golden Gate

GoldenGate: A Strategic AcquisitionBest-in-class leader in real-time data movement

• Complements existing Oracle products

• Data replication for heterogeneousdatabases

• Real-time information feeds to OracleBI/EPM

• Zero-downtime migrations and upgradesto Oracle Database and Applications

• Over 400 customers with 4,000+implementations across Fortune 500companies:

• Top 3 of 5 largest commercial banks

• Top 7 of 10 financial data servicescompanies

• Top 4 of 5 telecommunications providers

• Top 3 of 5 largest food & drug stores

4

Page 5: Oracle Golden Gate

5

Performance

Extensible &Flexible

Reliable

Non-intrusive, low-impact, sub-second latency

Open, modular architecture - Supportsheterogeneous sources and targets

Maintains transactional integrity - Resilientagainst interruptions and failures

Oracle GoldenGate Technology Differentiators

Oracle GoldenGate provides low-impact capture, routing, transformation,and delivery of transactional data across heterogeneous environments in

real time

Key Differentiators:

5

Page 6: Oracle Golden Gate

Oracle GoldenGate SolutionsEnterprise-wide Solution for Real Time Data Needs

• Standardize on SingleTechnology for MultipleRequirements

• Deploy for ContinuousAvailability and Real-timeData Access for Reporting /

BI

• Highly Flexible

• Fast Deployments

• Lower TCO & Improved ROI

Log Based, Real-

HeterogeneousSource Systems

EDW

EDW

Standby

(Open & Active)

ReportingDatabase

Time Change DataCapture

OGG

ETL

ODS

ETL

OperationalReporting

Real-time BI

QueryOffloading

DataDistribution

6

DisasterRecovery, Data

Protection

Zero DowntimeMigration andUpgrades

Page 7: Oracle Golden Gate

<Insert Picture Here>

Agenda

Introduction to Oracle GoldenGateTechnology OverviewArchitecture Deep Dive: Differentiators

Component ArchitecturePerformance & ScalabilityTransaction Integrity & ReliabilityHeterogeneity

Other Key FeaturesInstantiationSQL InterfaceEvent Marker InfrastructureETL Integration

7

Page 8: Oracle Golden Gate

TrailFile

PumpCapture Collector DeliverTrailFile

Online BackupsGG Initial Load3rd party Tools

Oracle GoldenGateSimple, Flexible Instantiation

Transaction Logs

LAN / WAN /Internet

(TCP/IP)

Page 9: Oracle Golden Gate

LAN / WAN /Internet

SourceDatabase

TargetDatabase

CaptureSource Trail Target Trail

Deliver

How GoldenGate Works: Modular “Building Blocks”

Capture: Committed changes are captured (and can befiltered) as they occur by reading the transaction logs.

Trail files: Universal data format enables heterogeneity.

9

Page 10: Oracle Golden Gate

LAN / WAN /Internet

SourceDatabase

TargetDatabase

How GoldenGate Works: Modular “Building Blocks”

Capture: Committed changes are captured (and can befiltered) as they occur by reading the transaction logs.

Trail files: Universal data format enables heterogeneity.

Route: No distance constraints via TCP/IP. Compression & encryption.

Delivery: Applies transactional datawith guaranteed integrity.

CaptureSource Trail Target Trail

Deliver

10

Page 11: Oracle Golden Gate

LAN / WAN /Internet

SourceDatabase

TargetDatabaseBi-directional

How GoldenGate Works: Modular “Building Blocks”

Capture: Committed changes are captured (and can befiltered) as they occur by reading the transaction logs.

Trail files: Universal data format enables heterogeneity.

Route: No distance constraints via TCP/IP. Compression & encryption.

Delivery: Applies transactional datawith guaranteed integrity.

CaptureSource Trail Target Trail

Source TrailTarget Trail

Deliver

DeliverCapture

11

Page 12: Oracle Golden Gate

Databases O/S and Platforms

Capture: Oracle

DB2 Microsoft SQL Server Sybase ASE Teradata Enscribe SQL/MP SQL/MX

Delivery: All listed above, plus:

MySQL, TimesTen, Netezza,

Greenplum, HPNeoview and any ODBC compatible

databases ETL products JMS message queues

Windows 2000, 2003, XP

Linux

Sun Solaris

HP NonStop

HP-UX

HP TRU64

HP OpenVMS

IBM AIX

IBM z/OS

Oracle GoldenGate Heterogeneity SupportsApplications Running On…

12

Page 13: Oracle Golden Gate

Oracle GoldenGate Topologies

UnidirectionalQuery Offloading

BroadcastData Distribution

Bi-DirectionalLive Standby or

Active-Active for HA

Integration/ConsolidationData Warehouse

Peer-to-PeerLoad Balancing,

Multi-Master

CascadingData Marts

13

Page 14: Oracle Golden Gate

<Insert Picture Here>

Agenda

Introduction to Oracle GoldenGateTechnology OverviewArchitecture Deep Dive: Differentiators

Component ArchitecturePerformance & ScalabilityTransaction Integrity & ReliabilityHeterogeneity

Other Key FeaturesInstantiationSQL InterfaceEvent Marker InfrastructureETL Integration

14

Page 15: Oracle Golden Gate

Architecture Components (Processes)

CAPTURE

Log-basedVAM-basedLocal/Remote QueuingFilteringParallel CoordinationLocal/Remote*

PUMP

FilteringLocal/RemoteTCP/IPCompressionEncryption

DELIVERY

Native database APIODBCBatched OperationsFilteringTransaction/Operations GroupingParallel CoordinationLocal/Remote*

MANAGER

Queue (Trail) ManagementProcess Management (Dynamic)Monitoring and Administration (Lag reports)Reporting (Events, Errors, Thresholds)Receive/Route requests from UI

On-disk Components

Trail FilesCheckpoint Files (Capture, Pump, Delivery)Data Definition Files (SOURCEDEFS/TARGETDEFS)Configuration FilesDiscard FilesReport/Log FilesBinaries

15

Page 16: Oracle Golden Gate

TargetSource

Oracle GoldenGate ComponentsCommunications and Startup

SourceDatabase

TCP/IP

Process Start

Shared Memory (for Monitoring)

16

TargetDatabase

Capture DeliveryPumpSource Trail Target TrailCollector

GGSCIInteractive

InterfaceManager Manager

GGSCIInteractive

Interface

Network

Page 17: Oracle Golden Gate

TargetSource

Oracle GoldenGate ComponentsCommunications and Startup

SourceDatabase

TCP/IP

Process Start

Shared Memory (for Monitoring)

17

TargetDatabase

Capture DeliveryPumpSource Trail Target TrailCollector

GGSCIInteractive

InterfaceManager Manager

GGSCIInteractive

Interface

Network

Page 18: Oracle Golden Gate

TargetSource

Oracle GoldenGate ComponentsCommunications and Startup

SourceDatabase

TCP/IP

Process Start

Shared Memory (for Monitoring)

18

TargetDatabase

Capture DeliveryPumpSource Trail Target TrailCollector

GGSCIInteractive

InterfaceManager Manager

GGSCIInteractive

Interface

Network

Page 19: Oracle Golden Gate

TargetSource

Oracle GoldenGate ComponentsCommunications and Startup

SourceDatabase

TCP/IP

Process Start

Shared Memory (for Monitoring)

19

TargetDatabase

Capture DeliveryPumpSource Trail Target TrailCollector

GGSCIInteractive

InterfaceManager Manager

GGSCIInteractive

Interface

Network

Page 20: Oracle Golden Gate

TargetSource

Oracle GoldenGate ComponentsCommunications and Startup

Network

SourceDatabase

TCP/IP

Process Start

Shared Memory (for Monitoring)

20

TargetDatabase

Capture DeliveryPumpSource Trail Target TrailCollector

GGSCIInteractive

InterfaceManager Manager

GGSCIInteractive

Interface

Page 21: Oracle Golden Gate

Oracle GoldenGate Capture

Capture

Database Access

VAMAPI/Redo

API

(log readerinterface)

MetadataManager

SQLInterface

FilteringFormatting Transformationand Mapping

TransformationEngine

Serializationand Routing

Messaging Subsystem

Checkpoint Manager

Memory Manager

TransactionLog Reader

GoldenGateTrail Files

GoldenGateEvent Log

GoldenGateCheckpoint

File

Parser

GoldenGateParameter

File

TransactionLogs

Commandand

Control

GoldenGateCommand

Interpreter

MetadataManager

21

SourceDatabase

Page 22: Oracle Golden Gate

Oracle GoldenGate Delivery

Delivery

Read API

SQLInterface

Database Access

FilteringFormatting Transformationand Mapping

TransformationEngine

SQLGeneration

Messaging Subsystem

Checkpoint Manager

Memory Manager

GoldenGateTrail

Reader

GoldenGateEvent Log

GoldenGateCheckpoint

File

Parser

GoldenGateParameter

File

GoldenGateCommand

Interpreter

Commandand

Control

MetadataManager

22

GoldenGateTrail Files

TargetDatabase

Page 23: Oracle Golden Gate

<Insert Picture Here>

Agenda

Introduction to Oracle GoldenGateTechnology OverviewArchitecture Deep Dive: Differentiators

Component ArchitecturePerformance & ScalabilityTransaction Integrity & ReliabilityHeterogeneity

Other Key FeaturesInstantiationSQL InterfaceEvent Marker InfrastructureETL Integration

23

Page 24: Oracle Golden Gate

Differentiator: Performance and ScalabilityGoldenGate Capture

Log-based change data captureHigh volume

Low overhead

Decoupled architectureMultiple capture processes may be usedto scale, but generally not required

Possible to split “hot” tables into aseparate capture process

Filtering and compressionUnnecessary change data is discarded immediately

Updates and deletes are “compressed” by default

Before images are discarded by default

24

Page 25: Oracle Golden Gate

Differentiator: Performance and ScalabilityGoldenGate Delivery

Decoupled architectureMultiple delivery processes may be used to scale

Possible to split “hot” tables into a separate delivery process

Possible for multiple delivery processes to split the work for asingle table

Transaction groupingSmall transactions are grouped by default to reduce commitoverhead

Record batchingRecords are batched by table and operation within a singleSQL execution

Automatic reordering of batches

25

Page 26: Oracle Golden Gate

<Insert Picture Here>

Agenda

Introduction to Oracle GoldenGateTechnology OverviewArchitecture Deep Dive: Differentiators

Component ArchitecturePerformance & ScalabilityTransaction Integrity & ReliabilityHeterogeneity

Other Key FeaturesInstantiationSQL InterfaceEvent Marker InfrastructureETL Integration

26

Page 27: Oracle Golden Gate

Differentiator: Transaction Integrity

Transaction boundariesRecorded in GoldenGate trail file

Transactions ordered in commit sequence

Boundaries adjusted automatically due torecord filtering or trail splits

Transaction integrityCheckpointing and recovery are based ontransaction boundaries

Original commit sequence is maintainedby the delivery process

27

Page 28: Oracle Golden Gate

Differentiator: Reliability

Decoupled architectureIndividual processes can be restarted automatically

Tolerance to network outages (configurable)

RecoveryRecovery ensures that no operations are skipped orduplicated after failure of any kind

Recovery of the Capture process is more involved thanrecovery the Delivery process

Although GoldenGate processes are completely decoupled,the Delivery process must be aware of a recovery performedby the Capture process or pump

28

Page 29: Oracle Golden Gate

GoldenGate Checkpointing

Capture, Pump, and Delivery save positions to a checkpoint file so they canrecover in case of failure

CaptureCommit Ordered

Source TrailSourceDatabase

29

Begin, TX 1

Insert, TX 1

Begin, TX 2

Update, TX 1

Insert, TX 2

Commit, TX 2

Begin, TX 3

Insert, TX 3

Begin, TX 4

Commit, TX 3

Begin, TX 3

Insert, TX 3

Commit, TX 3

Start of Oldest Open (Uncommitted)Transaction

Begin, TX 2

Insert, TX 2

Commit, TX 2

Delete, TX 4Current Read

Position

CaptureCheckpoint

CurrentWrite

Position

Page 30: Oracle Golden Gate

GoldenGate Checkpointing

Capture, Pump, and Delivery save positions to a checkpoint file so they canrecover in case of failure

Capture PumpCommit OrderedSource Trail

Commit OrderedTarget TrailSource

Database

30

Begin, TX 1

Insert, TX 1

Begin, TX 2

Update, TX 1

Insert, TX 2

Commit, TX 2

Begin, TX 3

Insert, TX 3

Begin, TX 4

Commit, TX 3

Begin, TX 2

Insert, TX 2

Commit, TX 2

Begin, TX 3

Insert, TX 3

Commit, TX 3

Begin, TX 2

Insert, TX 2

Commit, TX 2

Start of Oldest Open (Uncommitted)Transaction

Delete, TX 4Current Read

Position

CaptureCheckpoint

CurrentWrite

Position

CurrentRead

Position

PumpCheckpoint

CurrentWrite

Position

Page 31: Oracle Golden Gate

GoldenGate Checkpointing

Capture, Pump, and Delivery save positions to a checkpoint file so they canrecover in case of failure

31

Capture DeliveryPumpCommit OrderedSource Trail

Commit OrderedTarget TrailSource

DatabaseTarget

Database

Begin, TX 1

Insert, TX 1

Begin, TX 2

Update, TX 1

Insert, TX 2

Commit, TX 2

Begin, TX 3

Insert, TX 3

Begin, TX 4

Commit, TX 3

Begin, TX 2

Insert, TX 2

Commit, TX 2

Begin, TX 3

Insert, TX 3

Commit, TX 3

Begin, TX 2

Insert, TX 2

Commit, TX 2

Start of Oldest Open (Uncommitted)Transaction

Delete, TX 4Current Read

Position

CaptureCheckpoint

CurrentWrite

Position

CurrentRead

Position

PumpCheckpoint

CurrentWrite

Position

CurrentRead

Position

DeliveryCheckpoint

Page 32: Oracle Golden Gate

<Insert Picture Here>

Agenda

Introduction to Oracle GoldenGateTechnology OverviewArchitecture Deep Dive: Differentiators

Component ArchitecturePerformance & ScalabilityTransaction Integrity & ReliabilityHeterogeneity

Other Key FeaturesInstantiationSQL InterfaceEvent Marker InfrastructureETL Integration

32

Page 33: Oracle Golden Gate

Differentiator: Heterogeneity

Core InfrastructureCore product components are utilized for all databases

Canonical trail file format

Canonical metadata definitions

Automatic mapping of common datatypes

Capture MethodsLog scraping (direct file access)

Database built-in log interface (transaction log API)

Intercepts/exits

Vendor-provided access modules

Delivery utilizes native database interfaces

33

Page 34: Oracle Golden Gate

Differentiator: HeterogeneityOracle Capture

Support for Oracle RAC

Support for ASM

Support for index-organized tables(IOTs) with overflow

Support for clustered tables

Support for object tables

Support for object types (UDTs)

Support for DDL operations

Archived log only (ALO) mode

Off-platform capture(LOGSOURCE)

Multi-threaded capture

34

Capture

CaptureCommit Ordered

Trail

Archived Log Online Log

OCI/Oracle Net

Page 35: Oracle Golden Gate

Capture

CaptureCommit Ordered

Trail

Backups Transaction Log

Differentiator: HeterogeneityMicrosoft SQL Server Capture

Ability to capture from nativebackups

Coexistence with SQL ServerReplication

SQL Server Replicationcomponents are not required

Support tables with no unique key(not supported by SQL ServerReplication)

Support for computed columns

Support for identity columnsODBC

35

Page 36: Oracle Golden Gate

Differentiator: HeterogeneityDB2 LUW Capture

Support for Multi DimensionalClustered Tables (MDC)

Support for Materialized Query

Capture

CaptureCommit Ordered

Trail

Archived Log Online Log

DB2 CLI

36

Tables (MQT)

Support for data compression(tablespace)

DB2READLOG

Page 37: Oracle Golden Gate

Differentiator: HeterogeneityDB2 z/OS Capture

Runs under Unix System Services(USS)

Support for data sharingenvironments

Automatic EBCDIC/ASCIItranslation

Support for EBCDIC, ASCII, andUnicode encoded tables

Support for data compression(tablespace)

Capture

CaptureCommit Ordered

Trail

Archived Log Online Log

DB2 CLI

Unix System Services (USS)

37

IFI IFCID 0306

Page 38: Oracle Golden Gate

Differentiator: HeterogeneityHP NonStop Capture (Enscribe and SQL/MP)

Logger used for non-TMF (non-audited) enabled applications

ARLIB2 interface utilized byAUDSERV process

HP Blades Support

Support for TCP/IP and EXPANDnetworks

Fast block-based unload

Support for network distributedtransactions

Support primary key updates fromopen systems

38

Capture

CaptureCommit Ordered

Trail

TMF Audit Log

ARLIB2

TMF Audit Dump

AUDSERV

Logger

Intercept

Embedded SQL

Page 39: Oracle Golden Gate

Differentiator: HeterogeneityHP NonStop Capture (SQL/MX)

Runs under Open SystemsServices (OSS)

ARLIB2 interface utilized by

Capture

CaptureCommit Ordered

Trail

TMF Audit Dump TMF Audit Log

Embedded SQL

Open Systems Services (OSS)

39

VAMSERV process

Based on open systems coreinfrastructure

ARLIB2

VAMSERV

Page 40: Oracle Golden Gate

Differentiator: HeterogeneityTeradata Capture

Teradata-provided access module(TAM)

TAM is a shared library dynamicallylinked at runtime

CDC runs on Relay ServicesGateway (RSG) vprocs

Max protection mode and maxperformance mode

Full Unicode support for Windowsand Linux

Support for DDL operations

Support for LOB and UDTdatatypes

Support for identity datatypes

40

Replication Group

RSG

vproc

CDC

Capture

RSG

vproc

CDC

Capture

TAM

Unsorted TrailSort/Pump

Commit OrderedTrail

ODBC

Maximum Protection Mode

Page 41: Oracle Golden Gate

Differentiator: HeterogeneityDelivery

Native APIs

Flat file integration for datawarehousing appliances (Netezza

and Greenplum)

41

Delivery

Target DatabaseDeliveryCommit Ordered

Trail

Transaction grouping

Transaction splitting (if necessary)

Array operations

Integration with load utilities

Native Interface

Page 42: Oracle Golden Gate

<Insert Picture Here>

Agenda

Introduction to Oracle GoldenGateTechnology OverviewArchitecture Deep Dive: Differentiators

Performance & ScalabilityTransaction IntegrityReliabilityHeterogeneity

Other Key FeaturesInstantiationSQL InterfaceEvent Marker InfrastructureETL Integration

42

Page 43: Oracle Golden Gate

GoldenGate Instantiation

Start change data capture on Source DatabaseCurrent source Commit Sequence Number (CSN) is 222

43

Capture PumpCommit Ordered

Source Trail

Commit OrderedTarget Trail

SourceDatabase

TargetDatabase

Current CSN is222 CSNs 222

through …

Page 44: Oracle Golden Gate

44

Capture PumpCommit Ordered

Source Trail

Commit OrderedTarget Trail

SourceDatabase

TargetDatabase

Take Backupas of CSN

245

Apply Backupas of CSN

245

CSNs 222through …

GoldenGate Instantiation

Wait for any open transactions to close

Use a backup (or export/import) to copy source to target as of a consistency pointCurrent source Commit Sequence Number (CSN) is 245

Consistent asof CSN 245Current CSN is

245

Page 45: Oracle Golden Gate

45

Capture DeliveryPumpCommit Ordered

Source Trail

Commit OrderedTarget Trail

SourceDatabase

TargetDatabase

CSNs 222through 356

Delivertransactions

after CSN 245

Current CSN is356

GoldenGate Instantiation

Start delivery at or after given backup CSN (245 in this case)Current source Commit Sequence Number (CSN) is 356

Once Delivery is current the source and target are in sync

Consistent asof CSN 356

In Sync!

Take Backupas of CSN

245

Apply Backupas of CSN

245

Page 46: Oracle Golden Gate

<Insert Picture Here>

Agenda

Introduction to Oracle GoldenGateTechnology OverviewArchitecture Deep Dive: Differentiators

Performance & ScalabilityTransaction IntegrityReliabilityHeterogeneity

Other Key FeaturesInstantiationSQL InterfaceEvent Marker InfrastructureETL Integration

46

Page 47: Oracle Golden Gate

Other Key FeaturesSQL Interface

Standalone executionAdd parameter to the root level of a parameter file

Executes independently of a table or map statement

Execution order is based on the order it appears in the parameter file

Execute onceSQLEXEC “call prc_job_count ()”

SQLEXEC “truncate table scott.target_table”

SQLEXEC “SET TRIGGERS OFF”

Execute at user-defined intervalSQLEXEC “call prc_job_count ()” EVERY 30 SECONDS

Execute on application exitSQLEXEC “call prc_job_count ()” ONEXIT

SQLEXEC “SET TRIGGERS ON”

47

Page 48: Oracle Golden Gate

Other Key FeaturesSQL Interface

Inline executionAdd a clause to the table/map statement in the parameter file

Executes for records that meet the map condition

The procedure or query can accept input parameters and returnoutput parameters

Executed within the target database transaction context

Execute once (always execute by default)MAP sales.cust, TARGET sales.cust_extended, &

SQLEXEC (SPNAME lookup, PARAMS &

(long_name = birth_state),EXEC ONCE), &

COLMAP (custid = custid, birth_state_long = lookup.long_name);

Execute once per transactionMAP sales.cust, TARGET sales.cust_extended, &

SQLEXEC (SPNAME lookup, PARAMS &

(long_name = birth_state), EXEC TRANSACTION), &

COLMAP (custid = custid, birth_state_long = lookup.long_name);

48

Page 49: Oracle Golden Gate

<Insert Picture Here>

Agenda

Introduction to Oracle GoldenGateTechnology OverviewArchitecture Deep Dive: Differentiators

Performance & ScalabilityTransaction IntegrityReliabilityHeterogeneity

Other Key FeaturesInstantiationSQL InterfaceEvent Marker InfrastructureETL Integration

49

Page 50: Oracle Golden Gate

Capture DeliveryPumpSource Trail Target Trail

SourceDatabase

TargetDatabase

Other Key FeaturesEvent Marker Infrastructure

INSERT/UPDATE/DELETE Values(…) in “EVENT TABLE”

INSERT/UPDATE/DELETE Values(…) in “DATA TABLE”

50

EVENTPROCESSING

ReportsEvent

Log CheckpointDiscard

File

EVENTPROCESSING

ReportsEvent

Log CheckpointDiscard

File

Page 51: Oracle Golden Gate

Other Key FeaturesEvent Marker Infrastructure

Currently supported events…STOP – Graceful stop.

ABORT – Immediate exit.

FORCESTOP – Graceful stop or abort.

IGNORE – Ignore record or transaction.

DISCARD – Write record to discard file.

LOG – Log a message to the report, error and systems event files.

REPORT – Generate a report file.

ROLLOVER – Roll the capture trail file.

SHELL - Execute a shell command.

TRACE– Send trace info to file.

CHECKPOINT – Cause a checkpoint operation

51

Page 52: Oracle Golden Gate

<Insert Picture Here>

Agenda

Introduction to Oracle GoldenGateTechnology OverviewArchitecture Deep Dive: Differentiators

Performance & ScalabilityTransaction IntegrityReliabilityHeterogeneity

Other Key FeaturesInstantiationSQL InterfaceEvent Marker InfrastructureETL Integration

52

Page 53: Oracle Golden Gate

datafiles

Other Key FeaturesETL Integration

Integration via:Staging tablesFlat filesMessaging

ETL

datadata

filesfiles

Capture Trail File

Integration via Staging Tables

Delivery

Integration via Files

Delivery

ETL

OLTPIntegration via Messaging

Delivery

ETL

JMS / MoMQueue or

Topic

53

Page 54: Oracle Golden Gate

JMS

XML

XML

Capture

tx

txlogstxlogs

logs

Other Key FeaturesDelivery to JMS (Java Message System)

GoldenGate captures new transactions from source systems andpublishes to:

JMS Queue – point-to-pointJMS Topic – publish/subscribe

Writes as:Transactions (with guaranteed integrity)Individual DB Operations (insert, delete…)

Trail

DataPump

JMSUE

sourcedefs

(metadata)

XML

Queue or Topic

XMLThird Party

SystemsPartners

CustomersApplications

etc

54

Page 55: Oracle Golden Gate

Other Key FeaturesDelivery to Flat File

Delimited/fixed format data file and control file

55

Time/size-based rollover

One file, or one tableper file

Page 56: Oracle Golden Gate
Page 57: Oracle Golden Gate

Sun/Oracle Information

http://tinyurl.com/sunorcl

or

oracle.com

Page 58: Oracle Golden Gate

Oracle GoldenGateOther Oracle Products..

©2009 Oracle Corporation

HighAvailability

GoldenGate is Oracle’s strategicreplication solution

Oracle GoldenGate

Streams continues to be asupported Oracle Database feature

Combine both technologies fortotal data protection and

information distribution

58

Oracle Streams

Active Data Guard

Page 59: Oracle Golden Gate

Oracle GoldenGateOther Oracle Products..

59

Oracle DataIntegrator EE

Real-TimeDataIntegration

Bulk Data Movementand Transformation

• Fastest E-LT Solution• Optimized SET-based transformation

for high volume transformations• Data lineage for improved

manageability• Integrates to Data Quality

Oracle GoldenGate

• Requires ELT/ETL for complextransformationCombine both technologies for

comprehensive data integration

©2009 Oracle Corporation

Real-Time Data Integrationand Replication

• Fastest real-time solution• Sub-second latency for real-time feeds• Guaranteed delivery eliminates data

loss• Eliminates down-time for migration and

upgrades• Least intrusive to source systems

Page 60: Oracle Golden Gate

GoldenGate Information

http://oracle.com/goldengate

Page 61: Oracle Golden Gate

Customer CaseStudies

Page 62: Oracle Golden Gate

Oracle GoldenGate PROVIDES• Real-time data integration from Siebel

CRM on Oracle to central TeradataWarehouse

• 1,500 service agents log 600,000customer calls p/day

• GoldenGate moves 150-200 millionrecords per day with 1.5 second latency.

RESULTS• Significantly reduced churn by 25%• All business units have access to real-

time business data.

COMPANY OVERVIEWDIRECTV is a $17 billion provider ofsatellite-based television services.DIRECTV’s 7,500 employees operate thecompany’s broadcast centers, monitorsatellites, and deliver service to about 17million U.S. and over 5 million LatinAmerican customers.

CHALLENGES / OPPORTUNITIES

• Maintain high quality customerservice in competitive market –reduce churn!

• Centralize customer information for asingle view to support sales,marketing, support & field service

• Significantly reduce data latency incentral data warehouse for allqueries & reports – edict for < 15minutes!

Customer Case StudyReal-time Data for Better BI and Reduce Customer Churn

Page 63: Oracle Golden Gate

Oracle GoldenGate PROVIDES• Support for high availability & disaster

tolerance across Oracle production sites• Zero-downtime system migration and

upgrade• Enable active data warehouse roll-out in

90 days with real-time data feeds• Complements Oracle Data Integrator for

data transforms on target

RESULTS• Customer analysis now done in minutes,

rather than days• Dashboard reports using real-time data

for P&L & customer profitability• Google Adwords adjusted based on real-

time data reports• Ranked #4 in customer service by

National Retail Federation

COMPANY OVERVIEWOverstock.com is an online “closeout”retailer offering high-quality, brand-namemerchandise, including bed-and-bathgoods, home décor, kitchenware,watches, jewelry, electronics andcomputers, sporting goods, apparel anddesigner accessories among otherproducts at discount prices

CHALLENGES / OPPORTUNITIES

• Better understand customerpurchasing behavior

• Provide timely information to supportmarketing, merchandising andoperational decisions

• Improve shopping databasereliability and uptime

Customer Case StudyReal-time Data Integration for Improved Intelligence

Page 64: Oracle Golden Gate

COMPANY OVERVIEW

A world leader in the travel marketplace,Sabre Holdings merchandises and retailstravel products and provides distributionand technology solutions for the travelindustry

CHALLENGES / OPPORTUNITIES

• Optimize OLTP system performance –offload all query activity

• Reduce TCO via platform changes andsegment “lookers” from “bookers”

• Handle growing data volumes andsupport heterogeneous systems overlife-cycle of Air Travel ShoppingEngine (ATSE)

• Maintain data integrity across allsystems

Customer Case StudyQuery Offloading Provides Continuous Availability and Saves Millions $

Oracle GoldenGate PROVIDES• Supports 1.6TB of data movement per

day to read-only servers• Source– Oracle 10g | Target – MySQL• Current plans to migrate to Oracle 11g on

both source and target.

RESULTS• 80% TCO Reduction – Millions $$ saved

“Bookers vs Lookers”

Page 65: Oracle Golden Gate

Customer Case StudyHigh Availability of Manufacturing Application Meets SLAs

COMPANY OVERVIEW

Research In Motion (RIM) is a leadingdesigner, manufacturer and marketer ofinnovative wireless solutions for theworldwide mobile communicationsmarket.

CHALLENGES / OPPORTUNITIES

• Experiencing exponential growth andstringent carrier SLA’s to meet growingdemand for Blackberry devices

• Maintain continuous availably of criticaldata across all global data centers (4)for manufacturing plants

• All plants see same data and can movedevices based on regional demand

Oracle GoldenGate PROVIDES• 5 way Active-Active configuration provides

same data across worldwide plants• Improved system performance & response

times• Zero downtime DB migration to new version

using phased approach• Real-time data integration for new Exadata

data warehouse for up-to-minute reports

RESULTS• All of manufacturing from VP to engineer

on plant floor can access most up todate info.

Page 66: Oracle Golden Gate

Continuous Availability Use Case

24x7 Fraud Detection & Payment Processing for Blue-Chip Retailers

COMPANY OVERVIEW

Retail Decisions (ReD) is a payment cardissuer and a world leader in card fraudprevention and payment processing. Aspecialist supplier to the paymentsindustry worldwide. Its blue-chip

CHALLENGES / OPPORTUNITIES

Typical Service Level Agreementsdictate 99.95% availability & aggressivesub-second average response times

Must ensure quick, massive scalability

High cost of downtime -- ReD’s clientslose millions of dollars per hour

Global clients; data centers on 4continents

Oracle PROVIDES:Fraud Detection (ReDShield) using Oracle 9i

and 10g databasesU.S. Payment Processing system, using SQL

Server databases – also supports dataaccess for Web apps and Reporting

international clients come from theglobal telecommunications, retail, travel,petroleum, banking and the broader e-commerce sectors

RESULTS “Lightning Fast” implementation Time to recover: ZERO minutes Reduced database license &

infrastructure costs

"We needed a mega-scalable architecturecapable of handling increasing e-commercetraffic, while meeting our customers'stringent SLAs.” - Chris Uriarte, CTO

66

Page 67: Oracle Golden Gate

Continuous Availability Use Case

Siebel Application Upgrade & Database Migration

COMPANY OVERVIEW

HSN is an interactive lifestyle networkand retail destination, offering a curatedassortment of exclusive productscombined with top brand names. HSNincorporates experts, entertainment,inspiration, solutions, tips and ideas toprovide an entirely unique shoppingexperience for its customers.

CHALLENGES / OPPORTUNITIES

Eliminate downtime during major Siebelupgrade from version 6.2 to 8.0

Additionally, upgrade Oracle database 8ito 10g with no downtime

Conduct a phased migration approachto allow time for training & testing

Minimal business disruption

Oracle PROVIDES:Continuous availability during major

migration project.Active-Active configuration provided data

synchronized across old & new systemsProvided upgrade & downgrade logic

between old and new Siebel versions

RESULTS Enabled migration of 1500+ users to new

system Reduced risk with live parallel running of

both old and new Zero downtime No disruption to the business &

continuous order processing on missioncritical system

67

Page 68: Oracle Golden Gate
Page 69: Oracle Golden Gate