Ov big data

The Next Frontier for Innovation, Competition and Productivity

• ‘Big Data’ is similar to ‘small data’, but bigger

•…but having data bigger it requires different approaches:• Techniques, tools and architecture

•…with an aim to solve new problems•…or old problems in a better way

Big data is like teenage sex: everyone talks about it, nobody really knows how to do it, everyone thinks everyone else is doing it, so everyone claims they are doing it..

Dan ArielyProfessor of psychologie

Duke University – NC - USA

Every 2 Days We Create As Much Information As We Did Up To 2003

Eric SchmidtCEO Google

4 V‘s of Big Data

Volume• Data

quantity

Velocity• Data

Speed

Variety• Data

Types

Veracity• Messine

ss

Gartner (2001) IBM (2012)

VOLUME

4,4 Zettabytes of data

4,4 Trillion of Gigabytesin 2013 there is as much data

as known stars in the whole universe

44 Zettabytes of data

44 Trillion of Gigabytes62 times the number of all

sands in all beaches on earth

VELOCITY

1 TB OF INFORMATIONCaptured by NYSE

in every trading session

18,9 BILLIONNetwork connections by

20162,5 Network connections

per person on earth

VARIETY

30 BILLIONPIECES OF CONTENT

shared each month on facebook

400 MILLION TWEETS

Are sent every day by 200 million

active users per month

VERACITY

3,1 TRILLION A YEARUS$ what poor quality data

costs The US economy

1 OF 3 BUSINESS LEADERS

Don’t trust the information the use

to make decisions

Where have you been 15 days ago at 17:38

Google collects all our numeric transactions:

Our trajectory …Our clicks ..

Our choices ..Our comments …Our purchases …

Our search queries …

Why Big Data

• Key enablers of appearance and growth of Big Data are

–Increase of storage capacities

–Increase of processing power

–Availability of data

–Every day we create 2.5 quintillion bytes of data; 90% of the data in the world today has been created in the last two years alone

Big Data Analytics

• Examining large amount of data

• Appropriate information

• Identification of hidden patterns, unknown correlations

• Competitive advantage

• Better business decisions: strategic and operational

• Effective marketing, customer satisfaction, increased revenue

Applications for Big Data Analytics

Homeland Security

Finance Smarter HealthcareMulti-channel

sales

Telecom

Manufacturing

Traffic Control

Trading Analytics

Fraud and Risk

Log Analysis

Search Quality

Retail: Churn, NBO

Healthcare

• 80% of medical data is unstructured and is clinically relevant

•Data resides in multiple places like individual EMRs, lab and imaging systems, physician notes, medical correspondence, claims etc

• Leveraging Big Data• Build sustainable healthcare systems• Collaborate to improve care and outcomes• Increase access to healthcare

Market Size

Source: Wikibon Taming Big Data

By 2015 4.4 million IT jobs in Big Data ; 1.9 million is in US itself

Market for Big Data

•Gaining attraction

•Huge market opportunities for IT services (82.9% of revenues) and analytics firms (17.1 % )

• Current market size is $200 million. By 2015 $1 billion

• The opportunity for service providers lies in offering services around Big Data implementation and analytics for global multinationals

Future of Big Data

• $15 billion on software firms only specializing in data management and analytics. This industry on its own is worth more than $100 billion and growing at almost 10% a year which is roughly twice as fast as the software business as a whole.• In February 2012, the open source analyst firm Wikibon released the first market forecast for Big Data , listing $5.1B revenue in 2012 with growth to $53.4B in 2017• The McKinsey Global Institute estimates that data volume is growing 40% per year, and will grow 44x between 2009 and 2020.

Big Data Analytics TechnologiesNoSQL : non-relational or at least non-SQL database solutions such as HBase (also a part of the Hadoop ecosystem), Cassandra, MongoDB, Riak, CouchDB, and many others.

Hadoop: It is an ecosystem of software packages, including MapReduce, HDFS, and a whole host of other software packages

Thank you Hassen [email protected]