Barsha ShresthaInsight Data Engineering

Motivation:

APIs:

>300GB

DATA INGESTION FILE SYSTEM/

FRONT-END

BATCH PROCESSING

DATABASE

DATA INGESTION FILE SYSTEM/

BATCH PROCESSING

DATABASE

FRONT-END

PRODUCER

PRODUCER

CONSUMER

DATA INGESTION FILE SYSTEM/

BATCH PROCESSING

DATABASE

FRONT-END

TMDB

DATA INGESTION FILE SYSTEM/

FRONT-END

BATCH PROCESSING

DATABASE

Challenges1. Learning new technologies!2. Next steps

About me:

Barsha Shrestha

Chemistry and Computer Science Movies, Soccer, Science Jokes, Bad puns