Big Data Adventure Time with an ecologist

@cjlortie

Ecology is about connecting the dots.

one of the goals: interaction webs

Ecology can help use understand & manage big data.

Untangle, sort, link threads, & best of all knit together.

Big Data are not static.

Datasets so large/complex that it becomes difficult to process using traditional data processing applications.

775,000,000 results (0.26 seconds) 

V is for Vampire, and Big Data are all about V (and vampires).

Volume

Variety

Velocity

Veracity & Variability

doi:10.1038/sdata.2014.6

remote sensing & microclimate

abundance & distributions with citizen scientists

doi:10.1890/11-2177.1

Challenges: capture, curation, context, & complexity-analytics

Big Data Adventure Time

data are evidence

Useful Big Data illuminate context, connections or interactions

personal solutions

Context: even a single point in a big dataset is informative

personal solutions

Interactions: focus on schema, archive & aggregate datasets

personal solutions

Synthesis: find & use metrics that allow you to connect datasets.

150 interactions per day3 billion people

Correlation almost always implies causation.

Correlation does not imply causation.

data = evidencewe need to use synthesis tools

only 1 min watching www.worldometers.info

context, interactions, & synthesis procedurally and literally provides the

tools we need to solve global challenges

ecology Big Data