datavisualizationespinosa-oviedo.com/big-data-visualization-2016-bsc/wp-content/upl… · data “Tweets” Get data 1 Visualize 2 Evaluate 3 big data => small data self, peer, external

at Twitterdata visualization

at Twitterdata

“Tweets”

#eventsWorld Cup ElectionOscars

TV Shows New Year

Breaking news

EarthquakeSuper Bowl

Protest

…

What could we learn from the Tweets?

#curiositySleep patternHuman behaviorLanguage …

visat Twitterdata

“Tweets”

Get data

1

• Too much data

• Want only relevant Tweets

• hashtag: #BRA

• keywords: “goal”

• Need to aggregate & reduce size

• Long processing time (hours)

Challenges

Hadoop ClusterVertica

Pig / Scalding (slow) SQL

Data Storage

Tool

Workflow

Hadoop ClusterVertica

Pig / Scalding (slow) SQL

Data Storage

Tool

Workflow

Hadoop ClusterVertica

Pig / Scalding (slow) SQL

Data Storage

Tool

Smaller datasetYour laptop

Workflow

Hadoop ClusterVertica

Pig / Scalding (slow) SQL

Data Storage

Tool

Final dataset

Tool node.js / python / excel (fast)

Your laptop

Workflow

Smaller dataset

visat Twitterdata

“Tweets”

Get data

1

Visualize

2

• Peek into data

• Check data & test ideas

• Decide how to visualize

• Guided by data type

• Choose tools

• Start building

Visualize

Tableau Yeoman

d3R

What?

Where? When?

GEO TIME

TEXT

Visualize Data

What?

Where? When?

GEO TIME

TEXT

Visualize Data

Time Tweets/second + Annotation

http://www.flickr.com/photos/twitteroffice/5681263084/

What?

Where? When?

GEO TIME

TEXT

Visualize Data

GeoSan Francisco

flickr.com/photos/twitteroffice/8798020541

Low density

High density

What?

Where? When?

GEO TIME

TEXT

Visualize Data

Text WordTree [Wattenberg & Viégas 2008]www.jasondavies.com/wordtree

www.jasondavies.com/wordtree

What?

Where? When?

GEO TIME

TEXT

Visualize Data

Time + Geo Tweet pattern [Rios & Lin 2012]

Night

Late night

Daytime

Night

Late night

Daytime

What?

Where? When?

GEO TIME

TEXT

Visualize Data

Gmail was down Jan 24, 2014

Geo + Text Real-time Tweet map

What?

Where? When?

GEO TIME

TEXT

Visualize Data

+ players

Time + Text UEFA Champions League

What?

Where? When?

GEO TIME

TEXT

Visualize Data

Time + Text + Geo World Cup 2014

visat Twitterdata

“Tweets”

Get data

1

Visualize

2

Evaluate

3

big data => small data self, peer, external

What? Where? When?Who? …• users

• followers graph • logs • etc.

@kristw / https://interactive.twitter.com

(with deadline)

+ visualizations by @philogb, @miguelrios & @trebor