Top Banner
a d v i s o r mwd helping you create business improvement from IT inves Navigating the Big Data landscape Craig Wentworth Principal Analyst
10

Navigating the big data landscape

Nov 22, 2014

Download

Technology

MWD Advisors

 
Welcome message from author
This document is posted to help you gain knowledge. Please leave a comment to let me know what you think about it! Share it to your friends and learn new things together.
Transcript
Page 1: Navigating the big data landscape

a d v i s o r smwd

helping you create business improvement from IT investment

Navigating the Big Data landscape

Craig WentworthPrincipal Analyst

Page 2: Navigating the big data landscape

Big Data’s moonshot program

© MWD Advisors 2014 www.mwdadvisors.com 2

Growth of Google, Facebook, etc

Cost of memory, hardware, etc

TimePb

Amount of data

Time to value

$

$bn Number of users

ms

Page 3: Navigating the big data landscape

How Hadoop’s march has dominated Big Data market development

© MWD Advisors 2014 www.mwdadvisors.com 3

2004Google’s MapReduce research paper

2005Yahoo! develops Hadoop

2013Hadoop 2 goes GA

2007Hadoop goes open source at Apache

2011Hadoop 1 goes GA

Page 4: Navigating the big data landscape

Hadoop

NoSQL

StreamingData warehouse

Specialist sources

Big Data’s open source army is about much more than Hadoop, in fact

© MWD Advisors 2014 www.mwdadvisors.com 4

PostgreSQLMySQL

Drill SparkStorm

Samza

Accumulo

HBaseCassandra

CouchbaseMongoDB

Redis

Page 5: Navigating the big data landscape

Different use cases have dramatically different requirements

© MWD Advisors 2014 www.mwdadvisors.com 5Ex

trem

e Sc

ale

Extreme Speed

“Everything else”

National security, Fraud detection

Transport, Utilities management

Customer analytics for

next best action

Predictive maintenance

Speed

Scal

e

Page 6: Navigating the big data landscape

Different capability clusters are most suited to different use cases

© MWD Advisors 2014 www.mwdadvisors.com 6

CEP, Real-time, Streaming databases

Hadoop 1 (MapReduce)

EDW, Data Marts

NoSQLWide

Column

Key- Value

Document

Graph

Specialised sources

Hadoop 2and OSS

ecosystem

Extr

eme

Scal

e

Extreme Speed

“Everything else”

Speed

Scal

e

Page 7: Navigating the big data landscape

Four aspects of delivery models you need to consider

© MWD Advisors 2014 www.mwdadvisors.com 7

Licensing model Physical data storage model

Operational model

Analytics architecture

Page 8: Navigating the big data landscape

Things you need to do

© MWD Advisors 2014 www.mwdadvisors.com 8

Watch Hadoop Be aware of the shifting boundaries

Make sure you can hold it all together

Page 9: Navigating the big data landscape

a d v i s o r smwd

helping you create business improvement from IT investment

Thank youAny questions?

Craig [email protected]@craigwentworth

Check out our free reports:Big Data for analytics: Vendor landscapehttp://goo.gl/CJ2YRVHadoop: A driving force in the Big Data technology landscapehttp://goo.gl/nf0lY1Big Data: What is it and why should I care?http://goo.gl/Sckh2v

Neil [email protected]@neilwd

Page 10: Navigating the big data landscape

Hadoop logo (Slides 3, 8) – Intel Free Press (http://commons.wikimedia.org/wiki/File:Apache_Hadoop_Elephant.jpg) CC-BY-SA-2.0

Apache Software Foundation logo (Slide 7) – José Carlos Gallego (http://commons.wikimedia.org/wiki/File:The_Apache_Software_Foundation.jpg) CC-BY-SA-3.0

Locker metal security closed steel key hold (Slide 7) – Nemo (http://pixabay.com/en/locker-metal-security-closed-steel-310533/) CC0

Intel SS4000-E Entry Storage Systems, excerpt (Slide 7) – Axel Schwenke (https://www.flickr.com/photos/schwenke/1016958982/) CC-BY-SA-2.0

Clouds (Slide 7) – Clue (http://openclipart.org/detail/4112/simple-clouds-by-clue) PD

Plus disks (Slide 7) – Open storage pod (http://www.flickr.com/photos/openstoragepod/4392476653/) CC-BY-2.0

RAM-Not22233 (Slide 7) – mateusz (http://de.wikipedia.org/wiki/Arbeitsspeicher#mediaviewer/Datei:Ram-not22233.jpg) CC-BY-SA-3.0

Database symbol (Slide 7) – rg1024 (http://openclipart.org/image/300px/svg_to_png/94723/db.png) PD

Signpost (Slide 8) – Succo (http://pixabay.com/en/directory-signposts-shield-note-230724/) CC0

Piecing it together (Slide 8) – Hans (http://pixabay.com/en/puzzle-play-share-piecing-together-318110/) CC0

Photo credits

© MWD Advisors 2014 (Except images, where indicated)

www.mwdadvisors.com 10