Barry Hodges Senior Solution Architect, Sales Consulting, Oracle NZ The Best of Oracle Open World 2008.

Barry HodgesBarry HodgesSenior Solution Architect, Senior Solution Architect, Sales Consulting, Oracle NZSales Consulting, Oracle NZ

The Best of Oracle Open World 2008

A Different Perspective

• Just being there …

• Opportunity to liaise with subject matter experts and product managers

• Input into the road map

• Pre-arranged agenda adapted as new opportunities presented themselves

Setting the scene …

Data Warehouses Growing RapidlyTripling In Size Every Two Years

Source: Winter TopTen Survey, Winter Corporation, Waltham MA, 2008.

200

400

600

800

1000

1998 2000 2002 2004 2006 2008 2010 2012

Actual

Projected

Ter

abyt

es o

f D

ata

Size of the Largest Data Warehouses

Data Warehouses Start Slowdown at 1TB

Table Scan Time

Table Size1TB 10 TB 100TB

1 Hour

10 Hours

5 Hours Typical NAS

Typical Mid-Range

Array

Typical High-End

Array

The Performance ChallengeStorage Data Bandwidth Bottleneck

• Current warehouse deployments often have bottlenecks limiting the movement of data from disks to servers

• Pipes between disks and servers are 10x to 100x too slow for data size

• Ship less data through the pipes • Add more pipes• Make the pipes wider

Solutions To Data Bandwidth Bottleneck

• “Brainy Software” approach - use smart database software to minimize the need for hardware– Smart Scan, OLAP, Bitmap Indexing, Join indexing,

Materialized Views, Result Caches, Range Partitioning, etc.

• “Brawny Hardware” approach - use powerful hardware to perform brute-force scans and joins– Brawny hardware approach only works if the rate of

scanning data scales with size of data

Solution Approaches

What We Announced …

HP Exadata Storage Server HardwareThe Core Building Block

• Exadata Ships Less Data Through Pipes– Query processing is moved into storage

to dramatically reduce data sent to servers while offloading server CPUs

• Exadata has More Pipes– Modular storage “cell” building blocks

organized into Massively Parallel Grid

– Bandwidth scales with capacity

• Exadata has Bigger Pipes– InfiniBand interconnect transfers data 5x

faster than Fibre ChannelExadata Moves a Lot

Less Data a Lot Faster

HP Exadata Cell Building Block Details

• Storage Server (Cell) is building block of Exadata Storage Grid

• Cells ship with all hardware and software components pre-installed

• Runs Exadata Storage Software, Oracle Infiniband protocol, Oracle Enterprise Linux 5.1, and HP hardware management software

• Hewlett Packard is exclusive hardware provider• Absolutely no custom hardware - all parts off the shelf high-

volume

8 GB DRAM

Redundant 110/220V Power

Supplies

2 Intel 2.66 Ghz Xeon Quad-core Processors

Infiniband DDR dual port card

Lights Out 100c – Management Card

12 x 3.5” Disk Drives - 7200 RPM 1000GB SATA - 15000 RPM 450GB SAS

Cell Hardware Details – HP DL180G5

P400 Smart Array Disk Controller card - 512M battery backed cache

SAS or SATA Disks in Exadata Servers• Choice of either

– 300 GB 15,000 RPM Serial Attached SCSI (SAS) disks

– 1 TB 7,200 RPM Serial Advanced Technology Attachment (SATA) disks

SAS Advantages SAS SATA Advantage

Throughput (MB/s) 1,000 750 1.33X

Average Seek Time (ms) 3.5 7.4 2.11X

Disk level read errors (per year) 6.3 63 10.00X

Years to disk failure 15.2 11.4 1.33X

• Choose SATA Based Servers for High Capacity

SATA Advantages SAS SATA Advantage

Capacity (TB RAW) 3.6 12 3.33X

Capacity (TB Uncompressed User Data)* 1.0 3.3 3.33X

• Choose SAS Based Servers for High Performance

* Computed after mirroring, log files, indexes, undo and temp tablespaces

SUPERCEDED

SAS or SATA Disks in Exadata Servers• Choice of either

– 450 GB 15,000 RPM Serial Attached SCSI (SAS) disks

– 1 TB 7,200 RPM Serial Advanced Technology Attachment (SATA) disks

SAS Advantages SAS SATA Advantage

Throughput (MB/s) 1,000 750 1.33X

Average Seek Time (ms) 3.5 7.4 2.11X

Disk level read errors (per year) 6.3 63 10.00X

Years to disk failure 15.2 11.4 1.33X

• Choose SATA Based Servers for High Capacity

SATA Advantages SAS SATA Advantage

Capacity (TB RAW) 5.4 12 2.22X

Capacity (TB Uncompressed User Data)* 1.5 3.3 2.22X

• Choose SAS Based Servers for High Performance

* Computed after mirroring, log files, indexes, undo and temp tablespaces

Traditional Scan Processing

What Were Yesterday’s

Sales?

SUM

Oracle Database Grid

Storage Array

Retrieve Entire Sales

Table

Select sum(sales)

where Date= ’20-Oct’ …

Exadata Smart Scan ProcessingOracle

Database GridWhat Were Yesterday’s

Sales?

Exadata Storage Grid

SUM

Select sum(sales)

where Date= ’20-Oct’ …

Retrieve Sales Amounts from

Oct 20

Smart Scan Functionality• Join filtering

– Star join filtering is performed within Exadata storage cells– Dimension table predicates are transformed into filters that are

applied to scan of fact table

• Backups– I/O for incremental backups is much more efficient since only

changed blocks are returned

• Create Tablespace (file creation)– Formatting of tablespace extents eliminates the I/O associated with

the creation and writing of tablespace blocks

• Smart scans are transparent to the application– No application or SQL changes required– Returned data is fully consistent and transactional

• Graph shows throughput achieved in real-world deployments– Infiniband is held back by PCIe 1.0 x8 bus on typical host systems

0

200

400

600

800

1000

1200

1400

Gigabit Ethernet 4Gb Fibre 20Gb Infiniband

MB/sec

12x slower

3x slower

Single Connection Throughput

InfiniBand Throughput

Massively Parallel Storage Grid

• Scalable– Scales to hundreds of storage servers

– Data automatically distributed across storage servers by ASM

– Transparently redistributed when storage servers are added or removed

– Data bandwidth scales linearly with capacity

• Available– Data is mirrored across storage servers

– Failure of disk or storage server transparently tolerated

• Simple– Works transparently - no application changes

Exadata bandwidth scales linearly with capacity

4 GB/sec

8 GB/sec

16 GB/sec

…

• 8 HP ProLiant DL360 Oracle Database servers

– 2 quad-core Intel Xeon, 32GB RAM– Oracle Enterprise Linux

• 14 Exadata Storage Cells (SAS or SATA) – Up to 21 TB uncompressed user data (SAS) *– Up to 46 TB uncompressed user data (SATA) *

• 4 InfiniBand switches, 1 Gigabit Ethernet switch

• Pre-installed, pre-configured

Add more racks for unlimited scalability

HP Oracle Database MachinePre-Configured High Performance Data Warehouse

* Computed after mirroring, log files, indexes, undo and temp tablespaces

Software Components • Required Software

– Oracle Database 11g Enterprise Edition– Oracle Exadata Storage Server Software– RAC– Partitioning Option

• Recommended Software– Advanced Compression Option– Enterprise Manager Packs: Diagnostics, Provisioning, Tuning– OLAP Option– Data Mining Option– Advanced Security Option– Real Application Testing– Oracle Business Intelligence Enterprise Edition Plus

Build your own DB Machine

InfiniBand Switch/Network

RACSingle Instance

* Currently certifying x86 OEL running Oracle 11.1.0.7

Exadata Performance Scales

Table Scan Time

Table Size1TB 10 TB 100TB

1 Hour

10 Hour

5 Hour

Typical Warehouse

Exadata

M-Tel Exadata Speedup 10X to 72X Performance Improvement

0 10 20 30 40 50 60 70 80

CDR Full Table Scan

Warehouse Inventory Report

CRM Service Order Report

CRM Customer Discount Report

Handset to Customer Mapping Report

Index Creation

Tablespace Creation

28xAverageSpeedup

Giant Eagle Exadata Speedup 3X to 20X Performance Improvement

- 5.0 10.0 15.0 20.0 25.0 30.0 35.0 40.0 45.0 50.0

Recall Query

Gift Card Activations

Sales and Customer Counts

Prompt04 Clone for ACL audit

Date to Date MovementComparison - 53 weeks

Materialized Views Rebuild

Merchandising Level 1 Detail byWeek

Supply Chain Vendor - Year - ItemMovement

Merchandising Level 1 Detail:Current - 52 weeks

Merchandising Level 1 Detail:Period Ago

16xAverageSpeedup

Database Machine Comparison

HP Oracle

Database

Machine

Netezza

10100

Teradata

2550

Footprint 1 rack 1 rack 1 rack

User data 21 TB 12.5 TB 12.6 TB

Disks 168 x 450GB disks 108 x 400GB disks 144 x 300GB disks

Database cores 64 DB Cores 4 DB Cores (?) 32 DB Cores

Storage cores 112 Storage Cores 108 Storage Cores* 0 Storage Cores

Total cores 176 Cores 112 Cores* 32 Cores

Interconnect 20Gb/sec Infiniband 1Gb/sec Ethernet 1 Gb/sec BYNET

Memory 368 GB 108 GB 128 GB

HW Architecture Open Proprietary Proprietary**

* Netezza 10100 uses PowerPC CPU’s (less powerful than Intel Xeon cores)** Teradata BYNET Interconnect is proprietary

Data Protection Solutions• All single points of failure eliminated by the architecture

• Hardware Assisted Resilient Data (HARD) built into storage– Prevent data corruption before it happens

• Data Guard provides disaster protection & data corruption protection – Automatically maintained second copy of database

• Flashback provides human error protection– Snapshot-like capabilities to rewind database to before error

• Recovery Manager (RMAN) provides backup to disk– Archiving and corruption protection– Can be used with Oracle Secure Backup (OSB) or third party tape backup

software

• These work just as they do for traditional non-Exadata storage– Users and database administrator use familiar tools

Exadata Co-Existence and Migration

• Databases can be concurrently deployed on Exadata and traditional storage– Smart Scan capability only works if the

whole tablespace is located on Exadata storage

• Online migration if currently using ASM and ASM redundancy

• Migration can be done using RMAN or Data Guard

Exadata Non-Exadata

DatabaseServer

Online Migration

US$24,000 / HP Oracle Exadata Storage Server

US$120,000 / Oracle Exadata Storage Server Software (US$10,000 / disk)

US$24,000 / HP Oracle Exadata Storage Server

US$120,000 / Oracle Exadata Storage Server Software (US$10,000 / disk)

* North America Prices. NOT inclusive of shipping, local taxes, etc

US$650,000 / HP Oracle Database Machine

US$1,680,000 for Oracle Exadata Storage Server Software (US$120,000 / Storage Server)

* Database 11g Enterprise Edition, RAC and Partitioning Option are required and must be licensed in addition to that above.

US$650,000 / HP Oracle Database Machine

US$1,680,000 for Oracle Exadata Storage Server Software (US$120,000 / Storage Server)

* Database 11g Enterprise Edition, RAC and Partitioning Option are required and must be licensed in addition to that above.

The HP Oracle Database MachineHow Much?

The HP Oracle Database MachineSales / Support Model

– System Delivery– Hardware Service

– System Sales– System Support

Oracle Technology Sales Manager is the single point for sales

Oracle is single point for Support

• NZ TBC

– Singapore already– Sydney, Australia scheduled– NZ to be confirmed

A queue has already formed!

The HP Oracle Database MachineWhere Can You Try It?

• Oracle Technology Sales Manager coordinates with Oracle data warehouse specialist Sales Consultants

• We are looking for:– Well-known companies or organisations who will be

references– Oracle knowledgeable staff– Performance challenges likely due to unbalanced hardware– Budget and clear business need– Query profile will benefit from Oracle Exadata Storage

Server Software – Interest in full HP Oracle Database Machine configuration

The HP Oracle Database MachineHow Is Oracle Prioritising Interest?

Exadata Benefits

• Extreme Performance

–10X 10X and more speedup for data warehousing

• Database Aware Storage– Smart Scans

• Massively Parallel Architecture– Dynamically Scalable to hundreds of cells– Linear Scaling of Data Bandwidth– Transaction/Job level Quality of Service

• Mission Critical Availability and Protection– Disaster recovery, backup, point-in-time recovery, data validation,

encryption

CustomCustom

• Complete Flexibility

• Any OS, any platform

• Easy fit into a company’s IT standards

• Documented best-practice configurations for data warehousing

Optimized WarehouseOptimized Warehouse

• Scalable systems pre-installed and pre-configured: ready to run out-of-the-box

• Highest performance

• Pre-installed and pre-configured

• Sold by Oracle

Reference ConfigurationsReference

ConfigurationsHP OracleDatabaseMachine

HP OracleDatabaseMachine

The HP Oracle Database MachineThe next step in DW Hardware Solutions

• Oracle.com:http://www.oracle.com/exadata

• Oracle Exadata Technology Portal on OTN: http://www.oracle.com/technology/products/bi/db/exadata

• Oracle Exadata white papers: http://www.oracle.com/technology/products/bi/db/exadata/pdf/exadata-technical-whitepaper.pdf

http://www.oracle.com/technology/products/bi/db/exadata/pdf/migration-to-exadata-whitepaper.pdf

Resources