Top Banner
Copyright © 2010 SAS Institute Inc. All rights reserved. June 2011 SAS and
18

SAS and Netezza Enzee universe presentation_20_june2011

Nov 07, 2014

Download

Business

Pavel Zhivulin

This is SAS presentation at Enzee Universe
Welcome message from author
This document is posted to help you gain knowledge. Please leave a comment to let me know what you think about it! Share it to your friends and learn new things together.
Transcript
Page 1: SAS and Netezza Enzee universe presentation_20_june2011

Copyright © 2010 SAS Institute Inc. All rights reserved.

June 2011

SAS and

Page 2: SAS and Netezza Enzee universe presentation_20_june2011

2

Copyright © 2010, SAS Institute Inc. All rights reserved.

Who is SAS: The Leader in Enterprise Analytics SoftwareBasic company statistics:• Founded 1976: 11,000+ employees in 400+ offices• 600+ global alliances• Revenues have increased every year• 2010 worldwide revenue $2.43 B• 24% of revenues reinvested in R&D• Ranked in Leader’s Quadrant for Gartner’s 3 key areas for

Analytics: Data Integration, Analytics and Reporting• IDC: SAS is leader in Analytics with a 34.5% market share

Customers:• 4.5 million users worldwide • 50,000+ sites in 114 countries• 92 of the Top 100 Fortune Global 500• 9 of 10 Leading Media Agencies • Over 1,000 Universities• Over 90% of US Federal Agencies• All 50 US State Governments

Services11%

Financial Services42%

Retail4%Other

2%

Manufacturing6%

Healthcare & Life Sciences

8%

Government14% Energy & Utilities

2%

Education3%

Communications 8%

Page 3: SAS and Netezza Enzee universe presentation_20_june2011

3

Copyright © 2010, SAS Institute Inc. All rights reserved.

SAS and Netezza Partnership

R&D SAS In-database partner Several Netezza TwinFin’s at SAS SAS Software at Netezza Mutual resource investments

Marketing Joint sponsors of annual conferences – Enzee and SAS Global

Forum/M2010

Sales 250+ mutual accounts 60+ SAS Access to Netezza customers SAS Scoring Accelerator for Netezza now in production

Page 4: SAS and Netezza Enzee universe presentation_20_june2011

4

Copyright © 2010, SAS Institute Inc. All rights reserved.

SAS Specific Products for Netezza

SAS® Access to Netezza Provides optimized read/write connectivity for Netezza data

appliances Allows fast connection to NZ for loading and extracting data to

and from SAS tools & platform, and solutions - connect to Oracle, DB2, SQL server, and more

SAS® In-Database SAS® Scoring Accelerator for Netezza

» Allows the SAS analytic models to execute inside the Netezza appliance

» Deploys models quickly, reduces data movement, and leverages the power of the Netezza appliance

Page 5: SAS and Netezza Enzee universe presentation_20_june2011

5

Copyright © 2010, SAS Institute Inc. All rights reserved.

Joint Business Value Proposition and IT Value Proposition

Business Value PropositionBusiness Value Proposition IT Value PropositionIT Value Proposition• Increase Analysts‘ Productivity (not just a fast

report)

• Fast – find answers quickly through improved integration

• Flexible – update business processes and analysis without requiring IT support

• Simple – focus on exploring the business issue - not connectivity and data movement

• Reduced time-to-model implementation

• Leverage existing SAS knowledge and Netezza high-performance

• Improved governance and data compliance through centralized data

• Reduced data movement and latency

• Reduced costs for development and validation

• Improved scalability and performance

• Lower TCO - greater leverage of existing investment

• Supercharge SAS with Netezza’s high performance, scalable scoring

• Effective resource utilization via automatic code generation

• Reduced end-to-end processing time

• Simplified infrastructure to maintain and administer

• SAS Enterprise Miner model development process is simple and easy to manage

• Score Database more frequently for better results

Page 6: SAS and Netezza Enzee universe presentation_20_june2011

6

Copyright © 2010, SAS Institute Inc. All rights reserved.

SAS and Netezza:Integration and In-Database Processing

IntegrationIntegration In-DatabaseIn-Database

SAS Applications are integrated toleverage standard database

features.

SAS Applications are integrated toleverage standard database

features.

The ability to embed and use SAS functions, framework,

processes and applications inside the database.

The ability to embed and use SAS functions, framework,

processes and applications inside the database.

Examples•Database Specific SQL

•SQL functions•Stored Procedures

Examples•Database Specific SQL

•SQL functions•Stored Procedures

Examples•SAS Format function

•SAS Scoring functions•Predictive Modeling Functions

•Model Development

Examples•SAS Format function

•SAS Scoring functions•Predictive Modeling Functions

•Model Development

Page 7: SAS and Netezza Enzee universe presentation_20_june2011

7

Copyright © 2010, SAS Institute Inc. All rights reserved.

SAS and Netezza: Integration SAS ® Access to Netezza

Allows SAS to Read/Write Netezza tables directly Implicit SQL support which generates Netezza specific SQL Supports Explicit SQL support and Pass-Through which

enables more SQL functions to run in-database Communicates with Netezza and leverages its utility

capabilities for optimized extracts and loads. Some In-Database processing by supporting publishing SAS

Formats into Netezza

Page 8: SAS and Netezza Enzee universe presentation_20_june2011

8

Copyright © 2010, SAS Institute Inc. All rights reserved.

SAS and Netezza: In-DatabaseSAS ® Scoring Accelerator for Netezza

SAS ® Scoring Accelerator: combines the statistical transformation and modeling methods available in SAS Enterprise

Miner with the scalability and processing speed offered through the database system takes the complete scoring model code, the associated property file that contains model

inputs and outputs and a catalog of user-defined formats, and deploys (or publishes) them within the data warehouse database

Reduces Overall Costs: By moving the scoring function to the database, the common security, auditing and administration capabilities offered by the database are honored and leveraged Achieve higher model-scoring performance and faster time to results Increases Analysts’ productivity Improve accuracy and effectiveness of analytic models Reduce data movement and latency Eliminate model score code rewrite and model re-validation efforts (i.e. labor costs and error

prone) Consolidate data to improve regulatory compliance Better manage, provision and govern data

Bottom-line: Takes a SAS Enterprise Miner model and publishes it as a native database function (in your case a Netezza native function)

Page 9: SAS and Netezza Enzee universe presentation_20_june2011

9

Copyright © 2010, SAS Institute Inc. All rights reserved.

SAS ® Enterprise Miner – What does it do?

Increase Revenue and/or Reduce Costs = More Profitable

Three things necessary in order to effectively perform data mining Good historical data Strong modeling tool A Statistician

FYI: SAS ® Rapid Predictive Modeler available in: SAS ® Enterprise Guide SAS Add-in to Microsoft Office (Excel only)

Bottom-line: modeling tends to be used in order to better understand customers and as a result be able to be more profitable

Page 10: SAS and Netezza Enzee universe presentation_20_june2011

10

Copyright © 2010, SAS Institute Inc. All rights reserved.

SAS Support on Netezza for Analytics Processing

Page 11: SAS and Netezza Enzee universe presentation_20_june2011

11

Copyright © 2010, SAS Institute Inc. All rights reserved.

Netezza Enabled with SAS Software

Page 11

Database Connector In-Database Analytics

Recoded Scoring Processes

Scoring

Algorithms & Transforms

Pulled

from

Analyst

DW Developer

Scoring Algorithms & Transforms

Published to Database as Scoring Processes

Pushed down

Analyst

Page 12: SAS and Netezza Enzee universe presentation_20_june2011

12

Copyright © 2010, SAS Institute Inc. All rights reserved.

Netezza and SAS Connected

Database Connector In-Database Analytics

Analytics Server

Data Warehouse

Data Extraction

FAST

• Base SAS – Proc SQL

• SQL Pass-Thru Option

• SAS/Access to Netezza

Data Extraction• SAS/Access to Netezza

• Netezza Database

Data Extraction

FASTER

• SAS Enterprise Miner

• SAS Scoring Accelerator for Netezza

Data Extraction• SAS Scoring Accelerator for Netezza

• Netezza Database

• In-Database Analytics

Page 13: SAS and Netezza Enzee universe presentation_20_june2011

13

Copyright © 2010, SAS Institute Inc. All rights reserved.

Why use SAS and Netezza? SAS for Analytic Insight/Solutions

The Leader in Analytics Software SAS provides more analysis options/models with greater functionality

than any other vendor

Netezza appliances architecturally integrate database, server and storage into a single, easy to manage system that requires minimal set-up and ongoing administration. Netezza is know for its data warehouse appliance that delivers high

performance out of the box.

When you combine SAS and Netezza you get both the leader in analytics and the leader in warehouse appliances working together to provide the most efficient infrastructure for the customer to solve business problems

Bottom Line: Working together SAS and Netezza help to accelerate your business processes

Page 14: SAS and Netezza Enzee universe presentation_20_june2011

14

Copyright © 2010, SAS Institute Inc. All rights reserved.

Past ApproachModeling data created in

Warehouse

In-Database ApproachModeling data created in

Warehouse

Modeling performed in SAS Enterprise Miner

Modeling performed in SAS Enterprise Miner

Scoring data created and aggregated in Warehouse

Scoring data created and aggregated in Warehouse

Enterprise Miner Model converted to STAT code –

REGRESSIONS ONLY

Enterprise Miner Model PUBLISHED into RDBMS

for use – Scoring Algorithms available:

•REGRESSION•DECISION TREE

•NEURAL NETWORK•GRADIENT BOOST

•PARTIAL LEAST SQUARES•SUPPORT VECTOR MACHINE

Data extracted from Warehouse

Data scored in SAS and remains in Warehouse

Data scored in SAS

Data imported back into Warehouse

Customer Success Story – Marketing AgencyProviding Flexibility in Data Mining

SAS Enterprise Miner

ABT

Scoring ABT

Scored Data

SAS Scoring

Accelerator

Scoring in

Warehouse

Page 15: SAS and Netezza Enzee universe presentation_20_june2011

15

Copyright © 2010, SAS Institute Inc. All rights reserved.

OpSys1Flat file extract

SQL Server

CustomerSelectionSAS

OpSys1

EDW

SAS Scoring

Accelerator

Past Approach• Daily process begins with flat file creation at

6:30am – SLA delivered at ~9:30am.

In-Database Approach• Daily process begins

at 4:00am with EDW load.

• File transferred to SQL Server, limited to ~350K

customer records based on specific criteria.

• All operational data loaded directly to EDW. No

flat file or intermediate processing is needed.

• 300 step process to support data mining life

cycle.

30 MINUTES TO SCORE ~350k customers

• 10 step process• Scoring and customer

selection done in-database against ALL customer rows

4 MINUTES TO SCORE ~40M customers

Runs in ~ 3 HOURS Runs in 12 MINUTES

Customer Success Story – Propensity to PayProviding Performance gains by Refactoring

Page 16: SAS and Netezza Enzee universe presentation_20_june2011

16

Copyright © 2010, SAS Institute Inc. All rights reserved.

Contacts & LinksSAS AllianceKevin Go

[email protected](919) 531-0680 - office

Tracye [email protected]

Netezza, an IBM CompanyTim McCarthy

[email protected](802) 291-0457

Bernard [email protected]

Links• Netezza homepage

• SAS homepage

• Netezza partner page for SAS

• SAS Access to Netezza

• SAS In-Database

• SAS Scoring Accelerator for Netezza

• SAS Scoring Accelerator for Netezza Documentation

• SAS In-Database Technology

• BASE SAS Procedures with In-Database processing

SAS and Netezza Brochure

Page 17: SAS and Netezza Enzee universe presentation_20_june2011

17

Copyright © 2010, SAS Institute Inc. All rights reserved.

Q/AMore information

About SAS on Netezza website:http://www.netezza.com/partners/comp-tech-detail.aspx?CTpid=1043

SAS to deliver in-database analytic scoring for Netezza platform (press release):http://www.sas.com/news/preleases/SASScoringAcceleratorForNetezza.html

Catalina Marketing gains unparalleled brand traction with SAS® and Netezza (press release): http://www.sas.com/news/preleases/CatalinaNetezza.html

Catalina Marketing helps predict customer behavior with SAS® Enterprise Minerhttp://www.sas.com/success/catalina.html

Foxwoods Plays a strong hand with SAS and Netezzahttp://www.netezza.com/releases/2008/release120808.htm

Page 18: SAS and Netezza Enzee universe presentation_20_june2011

Company Confidential - For Internal Use OnlyCopyright © 2010, SAS Institute Inc. All rights reserved.

Thank You