Top Banner
March 5, 2013 © 2013 IBM Corporation 101: IBM® PureDataSystem for Analytics N2001 Overview IBM CONFIDENTIAL
21
Welcome message from author
This document is posted to help you gain knowledge. Please leave a comment to let me know what you think about it! Share it to your friends and learn new things together.
Transcript
Page 1: Striper N2001

March 5, 2013 © 2013 IBM Corporation

101: IBM® PureData™ System for AnalyticsN2001 Overview

IBM CONFIDENTIAL

Page 2: Striper N2001

3 © 2013 IBM Corporation

Integration byDesignDeeply integrating andtuning hardware andsoftware – in a ready-to-go workload optimizedsystem

Built-in ExpertiseCapturing and

automating whatexperts do – from

the infrastructurepatterns to the

application patterns

Simplified Experience

Making every part of the IT lifecycle easier - withintegrated management of the entire system and a

broad open ecosystem of optimized solutions

Systems with integrated expertise and built for cloud

TM

IBM CONFIDENTIAL

Page 3: Striper N2001

4 © 2013 IBM Corporation

New announcements for the PureSystems family that change theeconomics and experience of IT and accelerate time to value

Infrastructure

Delivering Infrastructure Services

Application Platform

Delivering Platform Services

Data Platform

Delivering Data ServicesIBM CONFIDENTIAL

Page 4: Striper N2001

5 © 2013 IBM Corporation

For apps like E-commerce…Database cluster services optimized fortransactional throughput and scalability

For apps like Customer Analysis…Data warehouse services optimized forhigh-speed, peta-scale analytics and simplicity

For apps like Real-time Fraud Detection…Operational data warehouse services optimized tobalance high performance analytics and real-timeoperational throughput

Powered by Netezzatechnology

Meeting Big Data Challenges – Fast and Easy!

IBM PureData System

System for Transactions

System for Analytics

System for Operational AnalyticsIBM CONFIDENTIAL

Page 5: Striper N2001

6 © 2013 IBM Corporation

Announcing a New Model!PureData System for Analytics N2001 (“Striper”)

January 22Internal Announce

February 1Generally Available

February 5Public Announce

The new N2001 model addresses these key challenges Increased performance Better density Data center efficiency

PureData for Analytics now has TWO models N1001 – economical, high performance and scalability N2001 – highest performance appliance to-date

PureData for Analytics continues to provide Fastest Time to Value on the market today Optimized Big Data analytics performance Simple administration for fast and agile deployment Accelerate analytic performance using large library of

analytic functions

IBM CONFIDENTIAL

Page 6: Striper N2001

7 © 2013 IBM Corporation

1 Based on a comparison of the IBM PureData System for Analytics N2001 to the IBM PureData System for Analytics N1001. The performance speed refers to the query times on both macro-analytic and mixedworkload tests as conducted in IBM engineering lab benchmarks. The N2001 query times were an average of 3x faster than those of the N1001. Individual results may vary.2 128 GB/sec scan rate assuming an average of 4x compression across the system. Individual results may vary.3 Capacity of IBM PureData System for Analytics N2001 compared to previous generation IBM PureData System for Analytics N1001.4-Each N2001 rack contains 34 hot spare drives and 240 active drives for a ratio of 1 spare per 7 drives. Each N1001 rack contains 4 hot spare drives and 92 active drives for a ratio of 1 spare per 23 drives. The N2001has 3.3x more spares per active drive. Frequency of disk related service calls expected to decrease by 70% assuming the same drive failure rates.

Accelerate Performanceof Analytic Queries

Accelerate Performanceof Analytic Queries

Increase Efficiencyof your Data Center

Increase Efficiencyof your Data Center

Simplicity andEase of Administration

Simplicity andEase of Administration

3X faster performance1

for Big Data analytics

128 GB/sec effective scan rate per rack2

to tackle Big Data faster

Improved system management and resilienceto spend less time managing and more timedelivering value

70% FEWER service callswith more spare drives and faster disk regeneration4

50% greater data capacity per rack3

helps optimize data center efficiency

More capacity and less power per rackthan both Oracle and Teradata

Benefits of the IBM PureData System for AnalyticsThe Fastest Performance of Netezza Technology to Date!

IBM CONFIDENTIAL

Page 7: Striper N2001

8 © 2013 IBM Corporation

Balanced PerformanceBalanced Performance

How We Did it, Conceptually

FPGA Core CPU Core

500MB/sec

800MB/sec +

1 drive @120 MB/sec

More Drives withFaster Scan Rates

Leading toFaster Performance

Faster FPGA Cores,Driving Higher Performance

2.5 drives @130 MB/sec

each

1000MB/sec

1000MB/sec +

CPU Core

• Analyze

FPGA Core

• Decompress• Project• FilterIBM CONFIDENTIAL

Page 8: Striper N2001

9 © 2013 IBM Corporation

PureData System for Analytics Hardware Overview: Model N2001

User Data Capacity: 192 TB* Data Scan Speed: 478 TB/hr* Load Speed (per system): 5+ TB/hr

Power Requirements: 7.5 kW Cooling Requirements: 27,000 BTU/hr

* Assuming 4X compression

Scales from½ Rack to 4

Racks

2 Hosts (Active-Passive) 2 6-Core Intel 3.46 GHz CPUs 7x300 GB SAS Drives Red Hat Linux 6 64-bit

7 PureData for Analytics S-Blades™ 2 Intel 8 Core 2+ GHz CPUs 2 8-Engine Xilinx Virtex-6 FPGAs 128 GB RAM + 8 GB slice buffer Linux 64-bit Kernel

12 Disk Enclosures 288 600 GB SAS2 Drives

• 240 for User Data• 14 for S-Blades• 34 Spare

RAID 1 Mirroring

IBM CONFIDENTIAL

Page 9: Striper N2001

10 © 2013 IBM Corporation

Accelerate Analytic PerformanceWith the Fastest Out of the Box Scan Rates

2 Based on a scan rate of 100GB/sec for flash cache operations from Oracle X3-2 datasheet versus IBM PureData System for Analytics N2001 scan rate of 32 GB/sec raw scan rate, 128 GB/sec effective scan rate.1128 GB/sec scan rate assuming an average of 4X compression across the system. Individual results may vary. Based on per rack and out of the box configurations.3 128 GB/sec scan rate assuming an average of 4X compression across the system. Individual results may vary.

Scan Rate limits how quickly data can be readand processed Big Data complex analytics requires fast

access to big volumes of data Storage bottlenecks limit efficiency and mean

long wait times Faster performance drives revenue for data

driven businesses

PureData System for Analytics Increased parallelism Offloads decompression, filtering, and

processing to FPGA for blazing fastperformance!

Industry leading out of the box effective scanrate of 128 GB/sec3 for ALL the data

Limited to what can fit inflash cache. Disk

bandwidth only 25 GB/sec!

Limited to what can fit inflash cache. Disk

bandwidth only 25 GB/sec!

Accelerate Performanceof Analytic Queries

Accelerate Performanceof Analytic Queries

1 Based on a scan rate of 38 GB/sec per rack for Teradata 2690 from http://www.teradata.com/News-Releases/2011/Fifth-Generation-Teradata-Data-Warehouse-Appliance-Delivers-Double-the-Performance-and-Triple-the-Data-Capacity/ versus IBM PureData System for Analytics N2001 scan rate of32 GB/sec raw scan rate per rack, 128 GB/sec effective scan rate per rack. 1128 GB/sec scan rate per rack assuming an average of 4X compressionacross the system. Individual results may vary. Scan rates per rack are based on out of the box configurations.

Approved Claim in US only

IBM CONFIDENTIAL

Page 10: Striper N2001

11 © 2013 IBM Corporation

Spend Less on PureData thanOracle Exadata for Faster Performance!

Comparing dollars perGB per second…

Oracle will cost youmore than 500% more toscan the same gigabyteof data!1

1 IBM PureData System for Analytics N2001 = $2,637,300 list price/128 GB per sec. = $20,603.91/GB/sec. 128 GB/sec scan rate assumes an average of 4x out of the box compression across the system. Oracle X3-2 =$11,384,280 list price /100 GB/ per sec. = $113,842.80/GB/sec. Oracle scan rate from Oracle X3 datasheet at http://www.oracle.com/us/products/database/exadata-db-machine-x3-2-1851253.pdf and pricingdocuments at http://www.oracle.com/us/corporate/pricing/exadata-pricelist-070598.pdf and http://www.oracle.com/us/corporate/pricing/technology-price-list-070617.pdf. Individual results may vary. This comparison isbased on out of box configurations for both systems

553%553%moremore

Accelerate Performanceof Analytic Queries

Accelerate Performanceof Analytic Queries

Approved Claim in US only

IBM CONFIDENTIAL

Page 11: Striper N2001

12 © 2013 IBM Corporation

Increase Data Center EfficiencyWith Faster, More Efficient Systems

1 Teradata 2690 data sheet claims 8.8kW power per rack. IBM PureData System for Analytics N2001 is 7.5kW power per rack.2 Oracle high performance drives provide 45TB per rack before compression per Oracle X3-2 datasheet. IBM PureData System for Analytics N2001 pre-compression capacity is 48 TB per rack.Claims are based

on out of the box configurations.3 300 GB drive capacity for Teradata 2690 is 18.2 TB before compression per http://www.teradata.com/News-Releases/2011/Fifth-Generation-Teradata-Data-Warehouse-Appliance-Delivers-Double-the

Performance-and-Triple-the-Data-Capacity/. IBM PureData System for Analytics N2001 pre-compression capacity is 48 TB per rack. Claims are based per rack and on out of the box configurations.See Slide 9 for scan rate footer

PureData System for Analytics Offers more than 160% greater capacity than Teradata 2690 Has more than a 200% faster scan rate than Teradata! Nearly 30% faster scan rate than Oracle X3-2 Uses 40% less power than Oracle X3-2

Increase Efficiencyof your Data Center

Increase Efficiencyof your Data Center

Less floor space Less power per data center tile Less cooling per data center tile

PureData usesLess Power

than other systems1

PureData hasMore Capacity

than other systems 2,3

PureData has“Out of the box“ Faster Scan Rates

than other systems

Approved Claim in US only

IBM CONFIDENTIAL

Page 12: Striper N2001

13 © 2013 IBM Corporation

Spend Less Time Managing and More Time Innovating Simplicity andEase of

Administration

Simplicity andEase of

Administration

No dbspace/tablespace sizing and configuration

No redo/physical/Logical log sizing and configuration

No page/block sizing and configuration for tables

No extent sizing and configuration for tables

No Temp space allocation and monitoring

No RAID level decisions for dbspaces

No logical volume creations of files

No integration of OS kernel recommendations

No maintenance of OS recommended patch levels

No JAD sessions to configure host/network/storage

No dbspace/tablespace sizing and configuration

No redo/physical/Logical log sizing and configuration

No page/block sizing and configuration for tables

No extent sizing and configuration for tables

No Temp space allocation and monitoring

No RAID level decisions for dbspaces

No logical volume creations of files

No integration of OS kernel recommendations

No maintenance of OS recommended patch levels

No JAD sessions to configure host/network/storage

Data Experts, notDatabase Experts

Easy Administration Portal

No software installation

No indexes and tuning

No storage administration

IBM CONFIDENTIAL

Page 13: Striper N2001

14 © 2013 IBM Corporation

Simplicity andEase of

Administration

Simplicity andEase of

Administration

• Monitor System Resources

• Perform System Administration

• Understand & Predict Capacity

NzPortal 2.0Consolidating WebAdmin and Portal for Simple Admin

Simple web user interface– Part of the PureData System for Analytics

New functional and usabilityenhancements

– Administrative Functions• Hardware view & alerts• Database objects administration• User & Group management• View active sessions• Workload Management• View Events• Table skew/storage search• Capacity Planning

– Monitor enhancements• Usability improvements – allow to resize

monitors and mark not-monitored periods

– Customer requested improvements• Show locksIBM CONFIDENTIAL

Page 14: Striper N2001

15 © 2013 IBM Corporation

IBM DB2 Analytics AcceleratorNow even faster with N2001

The PureData System forAnalytics N2001 is also thenext generation DB2 AnalyticsAccelerator

Providing the sameimprovements to our DB2 forzOS customers

IBM CONFIDENTIAL

Page 15: Striper N2001

20 © 2013 IBM Corporation

Built-In Expertise Makes This as Simple as an Appliance

Dedicated device

Optimized for purpose

Complete solution

Fast installation

Very easy operation

Standard interfaces

Low cost

IBM CONFIDENTIAL

Page 16: Striper N2001

21 © 2013 IBM Corporation

SimplifyMove analytics into the Data Warehouse

Integrate the server,storage and databaseinto one optimizedpackage

Move complexanalytics into thedatabase

Integrated, highperformance analyticswithin the datawarehouse

ServerServer

StorageStorage

DatabaseDatabase

AnalyticsAnalytics

IBM CONFIDENTIAL

Page 17: Striper N2001

22 © 2013 IBM Corporation

BI Reporting andAd-Hoc Analysis

What happened? When and where? How much?

PredictiveAnalytics

What will happen? What will the impact be?

Optimization

What is the bestchoice?

© 2012 IBM Corporation22

PureData System for Analytics Takes Analytics Beyond Reporting

IBM CONFIDENTIAL

Page 18: Striper N2001

23 © 2013 IBM Corporation

IBM Netezza Analytics: Built-In Features and Capabilities

BI Tools

VisualizationTools

PureData for Analytics AMPP Platform

Software

Development

Kit

IBMIn-Database

Analytics

3rd PartyIn-Database

Analytics

IBMInfoSphere

Streams

Tanay GPUAppliance byFuzzy Logix

IBMInfoSphereBigInsights

Cloudera

Apache Hadoop

IBM SPSS

SAS

RevolutionAnalytics

Eclipse

Esri

IBM CONFIDENTIAL

Page 19: Striper N2001

29 © 2013 IBM Corporation

System for Analytics

Delivering data servicesfor analytics

IBM PureData System for AnalyticsOptimized exclusively for analytic data workloads

Speed 10-100x faster than traditional custom systems1

Patented, hardware accelerated MPP(Massively Parallel Processing)

Simplicity Data load ready in hours No database indexes No tuning No storage administration

Scalability Peta-scale data capacity2

Smart Designed to runs complex analytics in minutes,

not hours

Richest set of in-database analytics

1 Based on IBM customers' reported results. "Traditional custom systems" refers to systems that are not professionally pre-built, pre-tested and optimized. Individualresults may vary.

2 Peta Scale capacity offered in the N1001 model

IBM CONFIDENTIAL

Page 20: Striper N2001

30 © 2013 IBM Corporation

Part of the IBM Big Data PlatformWorkload Optimized Solutions for All Your Analytic Needs

Analytics & Decision Management

Solutions

Big Data Infrastructure

IBM Big Data Platform

Accelerators

Information Integration & Governance

Visualization& Discovery

ApplicationDevelopment

SystemsManagement

StreamComputing

HadoopSystem

DataWarehouse

PureDataSystem for Analytics

IBM CONFIDENTIAL

Page 21: Striper N2001

35 © 2013 IBM Corporation

© International Business Machines Corporation 2012International Business Machines Corporation New Orchard Road Armonk, NY 10504IBM, the IBM logo, PureSystems, PureFlex, PureApplication, PureData and ibm.com are trademarks of International Business Machines Corporation,registered in many jurisdictions worldwide.A current list of IBM trademarks is available on the Web at www.ibm.com/legal/copytrade.shtmlAll rights reserved. WAP12421-USEN-00

IBM CONFIDENTIAL