Top Banner
From MapReduce to Apache Spark: An Ecosystem Evolves Doug Cutting (@cutting) Chief Architect / Apache Hadoop Co-founder
5

From MapReduce to Apache Spark

Jan 23, 2018

Download

Data & Analytics

Jen Aman
Welcome message from author
This document is posted to help you gain knowledge. Please leave a comment to let me know what you think about it! Share it to your friends and learn new things together.
Transcript
Page 1: From MapReduce to Apache Spark

1©Cloudera,Inc.Allrightsreserved.

FromMapReduce toApacheSpark:AnEcosystemEvolvesDougCutting(@cutting)ChiefArchitect/ApacheHadoopCo-founder

Page 2: From MapReduce to Apache Spark

2©Cloudera,Inc.Allrightsreserved.

TheMergingEcosystems

Page 3: From MapReduce to Apache Spark

3©Cloudera,Inc.Allrightsreserved.

Genomics(Broad Institute)

Physics(CERN)

Healthcare Delivery(CHOA)

TheNewUseCasesareAmazing

Page 4: From MapReduce to Apache Spark

4©Cloudera,Inc.Allrightsreserved.

BringYourQuestions AboutLivytotheClouderaBooth

Livy.io

• ForsubmittingSparkjobsfromanyweb/mobileapp,withnoSparkclientinstall — enablingnewarchitecturesandusecases

• Providesmulti-tenancyandfaulttolerancetosupportmultipleusersreliably

• Works instandalonemode,withYARN,orwithMesos

• Nocodechangesneeded

• ApacheLicense.Initialcontributors includeemployeesofCloudera,Intel, andMicrosoft+morewanted!

NewContribution:Livy,anOpenSourceRESTServiceforSpark(Alpha)

Page 5: From MapReduce to Apache Spark

5©Cloudera,Inc.Allrightsreserved.

Thankyou@cutting

cloudera.com/spark