Taming Social Media

Taming Social Media for Scalable Analytics

Innovations

HumanGeo Group LLC, Proprietary and Confidential

2

Overview

• Introduction• Social Media• Scale• Tweets in Australia• Demo

3

Introduction

• Currently working with HumanGeo

• Building Visualization and Analysis tools

• 7 years of software engineering experience in the federal space

4

Social Media

• Wealth of information

• Widespread use

• Ever increasing adoption

5

Vertical

Advantages• Ease of Administration• Traditional

Development

Horizontal

Advantages• Unlimited• Commodity Hardware• Grow as you go

Scale

6

Tweets in Australia

Collecting tweets over Australia

7

Tweet Collection

Python script• TweetStream to pull tweets from

the twitter API• Pymongo to store them in

MongoDB

8

Visualization Tool

Built on Bottle micro framework• MongoDB with Geospatial index• jQuery, Leaflet, and Dust client-

side

9

Demo

Bottled Tweets

10

Questions?

Danny [email protected]