Barsha Shrestha Insight Data Engineering
EatSleepTweetRepeat_BarshaShrestha
Aug 18, 2015
Welcome message from author
This document is posted to help you gain knowledge. Please leave a comment to let me know what you think about it! Share it to your friends and learn new things together.
Transcript
Barsha ShresthaInsight Data Engineering
Motivation:
APIs:
>300GB
DATA INGESTION FILE SYSTEM/
FRONT-END
BATCH PROCESSING
DATABASE
DATA INGESTION FILE SYSTEM/
BATCH PROCESSING
DATABASE
FRONT-END
PRODUCER
PRODUCER
CONSUMER
DATA INGESTION FILE SYSTEM/
BATCH PROCESSING
DATABASE
FRONT-END
TMDB
DATA INGESTION FILE SYSTEM/
FRONT-END
BATCH PROCESSING
DATABASE
Challenges1. Learning new technologies!2. Next steps
About me:
Barsha Shrestha
Chemistry and Computer Science Movies, Soccer, Science Jokes, Bad puns
