at Twitter data visualization
Welcome message from author
This document is posted to help you gain knowledge. Please leave a comment to let me know what you think about it! Share it to your friends and learn new things together.
Transcript
at Twitterdata visualization
at Twitterdata
“Tweets”
#eventsWorld Cup ElectionOscars
TV Shows New Year
Breaking news
EarthquakeSuper Bowl
Protest
…
What could we learn from the Tweets?
#curiositySleep patternHuman behaviorLanguage …
visat Twitterdata
“Tweets”
Get data
1
• Too much data
• Want only relevant Tweets
• hashtag: #BRA
• keywords: “goal”
• Need to aggregate & reduce size
• Long processing time (hours)
Challenges
Hadoop ClusterVertica
Pig / Scalding (slow) SQL
Data Storage
Tool
Workflow
Hadoop ClusterVertica
Pig / Scalding (slow) SQL
Data Storage
Tool
Workflow
Hadoop ClusterVertica
Pig / Scalding (slow) SQL
Data Storage
Tool
Smaller datasetYour laptop
Workflow
Hadoop ClusterVertica
Pig / Scalding (slow) SQL
Data Storage
Tool
Final dataset
Tool node.js / python / excel (fast)
Your laptop
Workflow
Smaller dataset
visat Twitterdata
“Tweets”
Get data
1
Visualize
2
• Peek into data
• Check data & test ideas
• Decide how to visualize
• Guided by data type
• Choose tools
• Start building
Visualize
Tableau Yeoman
d3R
What?
Where? When?
GEO TIME
TEXT
Visualize Data
What?
Where? When?
GEO TIME
TEXT
Visualize Data
Time Tweets/second + Annotation
http://www.flickr.com/photos/twitteroffice/5681263084/
What?
Where? When?
GEO TIME
TEXT
Visualize Data
GeoSan Francisco
flickr.com/photos/twitteroffice/8798020541
Low density
High density
What?
Where? When?
GEO TIME
TEXT
Visualize Data
Text WordTree [Wattenberg & Viégas 2008]www.jasondavies.com/wordtree
www.jasondavies.com/wordtree
What?
Where? When?
GEO TIME
TEXT
Visualize Data
Time + Geo Tweet pattern [Rios & Lin 2012]
Night
Late night
Daytime
Night
Late night
Daytime
What?
Where? When?
GEO TIME
TEXT
Visualize Data
Gmail was down Jan 24, 2014
Geo + Text Real-time Tweet map
What?
Where? When?
GEO TIME
TEXT
Visualize Data
+ players
Time + Text UEFA Champions League
What?
Where? When?
GEO TIME
TEXT
Visualize Data
Time + Text + Geo World Cup 2014
visat Twitterdata
“Tweets”
Get data
1
Visualize
2
Evaluate
3
big data => small data self, peer, external
What? Where? When?Who? …• users
• followers graph • logs • etc.
@kristw / https://interactive.twitter.com
(with deadline)
+ visualizations by @philogb, @miguelrios & @trebor
Related Documents
