Top Banner
Smarter Computing Understand the likely impact of Stream Computing and Big Data on your Business and Data Center How to control costs, improve performance, and mitigate risk throughout the data lifecycle
15

Smarter Computing Big Data

Sep 13, 2014

Download

Documents

Understand the likely impact of Stream Computing and Big Data on your business and data center.
Welcome message from author
This document is posted to help you gain knowledge. Please leave a comment to let me know what you think about it! Share it to your friends and learn new things together.
Transcript
Page 1: Smarter Computing Big Data

Smarter Computing

Understand the likely impact of Stream Computing and Big Data on your Business and Data CenterHow to control costs, improve performance, and mitigate risk throughout the data lifecycle

Page 2: Smarter Computing Big Data

1

Efficient &Innovative

Innovative

but …

Fueled sprawl & increased TCO

Efficient

but …

Limited access & flexibility

• Insatiable Demand

• Unsustainable Economics

• New Technologies

Entering New Era of Computing Driven by…

CentralizedComputing

DistributedComputing

SmarterComputing

IT needs to reinvent itself in order to enter this new era of computing

Page 3: Smarter Computing Big Data

2

AnalyzeIntegrate

Transactional & Collaborative Applications

Manage

Business Analytics Applications

External Information Sources

Cubes

Streams

Big Data Master

Data

Content

Data

StreamingInformation Govern

Quality Security & PrivacyLifecycle

Data Warehouses

Standards

The information supply chain

Content Analytics

2

Page 4: Smarter Computing Big Data

3

10xGrowth in digital data every 5 years

5%New Information that is structured

4 Billion# of cell phone users worldwide

2 Billion# of Internet users worldwide

When physical assets such as cell phones, traffic sensors, cameras, PCs, RFID tags etc. become elements of an information system with ability to capture, compute and communicate

information themselves on a massive sensor scale using common TCP/IP protocol.

-- Internet of Things by McKinsey Global Institute, 2010 “

The Industrial Revolution of Data.

-- Dr. Joe Hellerstein, UC Berkeley

What is ‘BIG’ Data

Page 5: Smarter Computing Big Data

4

Stock market• Impact of weather on

securities prices• Analyze market data at

ultra-low latencies

Fraud prevention• Detecting multi-party fraud• Real time fraud prevention

e-Science• Space weather prediction• Detection of transient events• Synchrotron atomic research

Transportation• Intelligent traffic

management

Manufacturing• Process control for

microchip fabrication

Natural Systems• Wildfire management• Water management

Telephony• CDR processing• Social analysis• Churn prediction• Geomapping

Other• Smart Grid• Text Analysis• Who’s Talking to Whom?• ERP for Commodities• FPGA Acceleration

• Real-time multimodal surveillance• Situational awareness• Cyber security detection

Law Enforcement, Defense & Cyber Security

Health & Life Sciences• Neonatal ICU monitoring• Epidemic early warning

system• Remote healthcare

monitoring

The opportunity for real-time analytic processing is everywhere …

Page 6: Smarter Computing Big Data

6

Operational Databases

Reporting and human analysis on historical data

Data at rest

1968Hierarchical database

1970 Relational database

OLTPOnline Transaction Processing

Data in Motion

Real Time Analytic Processing (RTAP) to improve business response

Stream Computing

2003

RTAP‘Real-Time’ Analytical Processing

Analysis of historic data to improve business transactions

Data Warehousing

1983 DB2 v1

OLAPOnline Analytical Processing

Evolution of technology frontiers

Page 7: Smarter Computing Big Data

7

• Manage and benefit from massive and growing amounts of data• Handle uncertainty around format variability and velocity of data• Handle unstructured data• Exploit BIG Data in a timely and cost effective fashion

Collect Manage

Integrate Analyze

COLLECT MANAGE

INTEGRATE ANALYZE

The Big Data Challenge

Page 8: Smarter Computing Big Data

9

Persistent Data

In-Motion Data

TraditionalData

Non-TraditionalData

Streams reuses InfoSphere

Warehouse or SPSS Analytic

models

Streams filters incoming data

BigInsights

WAREHOUSE

IBM offers a comprehensive and integrated set of solutions for many types of BIG Data processing needs

Page 9: Smarter Computing Big Data

10

Data Sources

BigInsights

Data can flow into one or more of the environments (even simultaneously)

User results

WAREHOUSE

The Big Data ecosystem: Interoperability is key

Page 10: Smarter Computing Big Data

11

Non-

Traditional /

Non-

Relational Data Sources

In-MotionAnalytics

Traditional / Relational Data

Sources

DatabaseAt-Rest DataAnalytics

Results

TraditionalAnalytics

StreamAnalytics

Ultra LowLatency Results

OLAP / OLTP

RTAP

IBM InfoSphere Streams

Page 11: Smarter Computing Big Data

12

• Deal with Gigabytes of data each second

• Work with application, sensor and internet data, video/audio

• Deliver insight in microseconds to analytical applications

• Support complex scenarios using C++ or Java code

• Integrate with existing analytics & data warehousing investments

Millions of events per

secondMicrosecond

Latency

Traditional / Non-traditional data sources

Real-time delivery

PowerfulAnalytics

AlgoTrading

Telco churnpredict

SmartGrid

CyberSecurity Government /

Law enforcement

ICUMonitoring

EnvironmentMonitoring

InfoSphere Streams for companies who need to …

Page 12: Smarter Computing Big Data

15

Now

Real-timeAnalytics

Real-time Window

Custom Visualizations

Real-time Data (Traffic Capture, Alerts, Logs, …)

IBM Commercially SensitiveAggregated Past

Aggregated TRAFFIC + DNS + Secondary Information

Retain Aggregate + Results

PCAP/Netflow

PCAP/ Netflow

Alerts etc.Alerts

Data-at-restAnalytics

Data-At-Rest Window

BigInsights

Cyber security example – Detecting botnets

Page 13: Smarter Computing Big Data

17

Integrate Automate Secure

• Scale to petabytes and thousands of users

• Deep integration with Cognos and SPSS

• Integrated analysis and analytic model consistency

IBM is uniquely positioned to help organizations handle their “BIG Data” analysis and management challenges

Page 14: Smarter Computing Big Data

19

Thank You! ibm.com/smartercomputing

Automate

Integrate SecureEfficient and Innovative IT for Improved Economics

Page 15: Smarter Computing Big Data

20

Intel, Intel logo, Intel Inside, Intel Inside logo, Intel Centrino, Intel Centrino logo, Celeron, Intel Xeon, Intel SpeedStep, Itanium, and Pentium are trademarks or registered trademarks of Intel Corporation or its subsidiaries in the United States and other countries./ Linux is a registered trademark of Linus Torvalds in the United States, other countries, or both. Microsoft, Windows, Windows NT, and the Windows logo are trademarks of Microsoft Corporation in the United States, other countries, or both. IT Infrastructure Library is a registered trademark of the Central Computer and Telecommunications Agency which is now part of the Office of Government Commerce. ITIL is a registered trademark, and a registered community trademark of the Office of Government Commerce, and is registered in the U.S. Patent and Trademark Office. UNIX is a registered trademark of The Open Group in the United States and other countries. Java and all Java-based trademarks and logos are trademarks or registered trademarks of Oracle and/or its affiliates. Other company, product, or service names may be trademarks or service marks of others. Information is provided "AS IS" without warranty of any kind.

The customer examples described are presented as illustrations of how those customers have used IBM products and the results they may have achieved. Actual environmental costs and performance characteristics may vary by customer.

Information concerning non-IBM products was obtained from a supplier of these products, published announcement material, or other publicly available sources and does not constitute an endorsement of such products by IBM. Sources for non-IBM list prices and performance numbers are taken from publicly available information, including vendor announcements and vendor worldwide homepages. IBM has not tested these products and cannot confirm the accuracy of performance, capability, or any other claims related to non-IBM products. Questions on the capability of non-IBM products should be addressed to the supplier of those products.

All statements regarding IBM future direction and intent are subject to change or withdrawal without notice, and represent goals and objectives only.

Some information addresses anticipated future capabilities. Such information is not intended as a definitive statement of a commitment to specific levels of performance, function or delivery schedules with respect to any future products. Such commitments are only made in IBM product announcements. The information is presented here to communicate IBM's current investment and development activities as a good faith effort to help with our customers' future planning.

Performance is based on measurements and projections using standard IBM benchmarks in a controlled environment. The actual throughput or performance that any user will experience will vary depending upon considerations such as the amount of multiprogramming in the user's job stream, the I/O configuration, the storage configuration, and the workload processed. Therefore, no assurance can be given that an individual user will achieve throughput or performance improvements equivalent to the ratios stated here.

Prices are suggested U.S. list prices and are subject to change without notice. Starting price may not include a hard drive, operating system or other features. Contact your IBM representative or Business Partner for the most current pricing in your geography.

Photographs shown may be engineering prototypes. Changes may be incorporated in production models.

© IBM Corporation 2011. All rights reserved.References in this document to IBM products or services do not imply that IBM intends to make them available in every country.

Trademarks of International Business Machines Corporation in the United States, other countries, or both can be found on the World Wide Web at http://www.ibm.com/legal/copytrade.shtml.

Trademarks and disclaimers

ZSP03491-USEN-00