1 Data Base and Data Mining Group of Politecnico di Torino D B M G Big Data: Hype or Hallelujah? Elena Baralis Politecnico di Torino 2 D B M G Big data hype? 3 D B M G Google Flu trends February 2010 detected flu outbreak two weeks ahead of CDC data Nowcasting Discontinued! 4 D B M G On the Internet… http://www.internetlivestats.com/ 5 D B M G Many different definitions “Data whose scale, diversity and complexity require new architectures, techniques, algorithms and analytics to manage it and extract value and hidden knowledge from it” What is big data? 6 D B M G Many different definitions “Data whose scale, diversity and complexity require new architectures, techniques, algorithms and analytics to manage it and extract value and hidden knowledge from it” What is big data?
This document is posted to help you gain knowledge. Please leave a comment to let me know what you think about it! Share it to your friends and learn new things together.
Transcript
1
Data Base and Data Mining Group of Politecnico di Torino
DBMG
Big Data: Hype or Hallelujah?
Elena BaralisPolitecnico di Torino
2DBMG
Big data hype?
3DBMG
Google Flu trends
February 2010 detected flu outbreak two
weeks ahead of CDC data
Nowcasting
Discontinued!
4DBMG
On the Internet…
http://www.internetlivestats.com/
5DBMG
Many different definitions“Data whose scale, diversity and complexity
require new architectures, techniques, algorithms and analytics to manage it and
extract value and hidden knowledge from it”
What is big data?
6DBMG
Many different definitions“Data whose scale, diversity and complexity
require new architectures, techniques, algorithms and analytics to manage it and
extract value and hidden knowledge from it”
What is big data?
2
7DBMG
Many different definitions“Data whose scale, diversity and complexity
require new architectures, techniques, algorithms and analytics to manage it and
extract value and hidden knowledge from it”
What is big data?
8DBMG
Many different definitions“Data whose scale, diversity and complexity
require new architectures, techniques, algorithms and analytics to manage it and
extract value and hidden knowledge from it”
What is big data?
9DBMG
The 3Vs of big data Volume: scale of data Variety: different forms of data Velocity: analysis of streaming data
… but also Veracity: uncertainty of data Value: exploit information provided by data
The Vs of big data
10DBMG
Volume Data volume increases exponentially over time 44x increase from 2009 to 2020
Digital data 35 ZB in 2020
The Vs of big data
11DBMG
Variety Various formats, types and structures
Numerical data, image data, audio, video, text, time series
A single application may generate many different formats
The Vs of big data
12DBMG
Velocity Fast data generation rate
Streaming data Very fast data processing to ensure timeliness