Demystifying Big Data with Scala and Akka

Post on 17-Oct-2014

4260 Views

Category:

Technology

1 Downloads

Preview:

Click to see full reader

DESCRIPTION

Big Data with Scala Presentation at National Big Data summit 2013

Transcript

Big Data Computation Technology And Analysis With Scala

Vikas Hazrati, Knoldus Software LLP

Big Data Innovation Conference (c)

About Me

CTO at Knoldus Software

Writing a book titled “Building performant and concurrent systems

with Scala and Akka”

Working with Scala and Big Data for the last 3 years

Big Data Innovation Conference (c)

what?

Add content

Big Data Innovation Conference (c)

2011 - 1.8 zettabytes (1.8 trillion gigabytes)

big-data market is expected to grow from US$3.2 billion in 2010 to US$16.9 billion in 2015

Big Data Innovation Conference (c)

Lot of data

Lot of compute

Long time to compute it

so what?

About Me

Big Data Innovation Conference (c)

hadoop

Big Data Innovation Conference (c)

Batch processing, non interactive

X real time

alternates

Big Data Innovation Conference (c)

Lucene

CEP

NoSQL

Combinationof

parallel processing

to build it :-{

Difficult!

Domain + Language + Performance

Big Data Innovation Conference (c)

to build it :-{

Domain Expertise

Language Expertise

Performance Expertise

Big Data Innovation Conference (c)

to build it :-{

Domain Expertise

Language Expertise

Performance Expertise

Big Data Innovation Conference (c)

scala

Add content

Big Data Innovation Conference (c)

scala

Big Data Innovation Conference (c)

Big Data Innovation Conference (c)

Akka

Big Data Innovation Conference (c)

actor message passing

Add content

Big Data Innovation Conference (c)

actor message passing

Add content

Big Data Innovation Conference (c)

tooling?

Big Data Innovation Conference (c)

Spark

Big Data Innovation Conference (c)

Spark

Big Data Innovation Conference (c)

Spark

Big Data Innovation Conference (c)

Spark

Big Data Innovation Conference (c)

Delite

DSL for Heterogenous Parallel Architectures

Big Data Innovation Conference (c)

Delite

Big Data Innovation Conference (c)

Delite

Big Data Innovation Conference (c)

decooda liquid data platform

Big Data Innovation Conference (c)

Real time parallel execution

Big Data Innovation Conference (c)

Big Data Innovation Conference (c)

Big Data Innovation Conference (c)

conclusions

Big Data Innovation Conference (c)

Multiple real time alternativesbeyond Hadoop

Scala and Akka facilitatinggrowth

vikas@knoldus.comwww.knoldus.com@knolspeakfb - KnoldusSoftware

Big Data Innovation Conference (c)

top related