The New Tech Stack for Device Data

The New Tech Stack for Devices and Their Apps

Ryan Tabora Senior Data Engineer

February 2014

CONFIDENTIAL |

What is Device Data?

!2

Customers Home Base

Parser

Parser

Parser

System of

RecordETL Data Access

CONFIDENTIAL | !3

Reference Architecture

CONFIDENTIAL | !4

Ingestion Technologies

Storm

kinesis

Log Aggregation Streaming Bulk Import/ETL

CONFIDENTIAL |

Data Stores

!5

redshift

Core Storage Classic NoSQL Search Oriented MPPs

dynamodb

CONFIDENTIAL |

Data Transformation Technologies

!6

Pig

Batch Faster-than-batch

CONFIDENTIAL |

Come Say Hi!!!

!7

! [email protected] ! http://thinkbiganalytics.com ! @ryantabora