Big Data Streaming Analytics for Engineers

BIG DATA STREAMING ANALYTICS

Naunidh Singh Chadha

Agenda

• Overview of the space• Components• Business Cases• Technologies• What can you do!

BIG FAST FUSION PERISHABLE

Images source: Guavus Inc.

Data Collection

Storage and Aggregation

Data Science/M

achine Learning

Visualization

DATA

PERSIST

EXPERTISE

CONTEXT

Where is the money !

Platform• Storm

(Twitter)• Spark

(Berkley)• Apache

Hadoop/YARN

• Splunk

Message Q• Kafka

(LinkedIN)• Rabid MQ• Zero MQ

Databases• Spark

Caching• HBASE• Cassandra• MongoDB• InfiniDB• Membase

Analysis• Apache Drill• Apache

Mahout• MATLAB• R• OpenCV• Shark• Hive

Visualization• MicroStrategy• Visualization• R• D3S• JqPlot

What Powers Big Data Streaming Analytics?

What can you do !