(APP203) How Sumo Logic and Anki Build Highly Resilient Services on AWS to Manage Massive Usage Spikes | AWS re:Invent 2014

Post on 01-Jul-2015

341 Views

Category:

Technology

0 Downloads

Preview:

Click to see full reader

DESCRIPTION

In just two years, Sumo Logic's multitenant log analytics service has scaled to query over 10 trillion more logs each day. Christian, Sumo Logic's cofounder and CTO shares the three most important lessons he has learned in building such a massive service on AWS. Ben Whaley is an AWS Community Hero who works for Anki as an AWS cloud architect. Ben uses hundreds of millions of logs to troubleshoot and improve Anki Drive, the coolest battle robot racing game on the planet. This is an ideal session for cloud architects constantly looking to improve scalability and application performance on AWS. Sponsored by Sumo Logic.

Transcript

November 12, 2014 | Las Vegas, NV

APP203

Ben Whaley, Anki

Christian Beedgen, Sumo Logic

Introductions

Chasing Infinity

Obvious Versus Hard

Co-Founder & CTO Chief Architect

Applications

Internet of ThingsNetwork

Mobile

Search

Visualize

Predict

0

200,000

400,000

600,000

800,000

1,000,000

1,200,000

0

2,000

4,000

6,000

8,000

10,000

12,000

14,000

16,000

Ma

y-1

2

Jun-1

2

Jul-1

2

Aug-1

2

Sep-1

2

Oct-

12

No

v-1

2

De

c-1

2

Jan-1

3

Feb

-13

Ma

r-1

3

Apr-

13

Ma

y-1

3

Jun-1

3

Jul-1

3

Aug-1

3

Sep-1

3

Oct-

13

No

v-1

3

De

c-1

3

Jan-1

4

Feb

-14

Ma

r-1

4

Apr-

14

Ma

y-1

4

Jun-1

4

Jul-1

4

Aug-1

4

Sep-1

4

Oct-

14

GB per Day

Searches

AWS Infrastructure Lead Cloud Architect

In 2010, we knew that

success will look

something like this…

In 2010, we knew that

success will look

something like this…

Just one typical Sumo Logic customer - 8x Variance!

Just one typical Sumo Logic customer - 8x Variance!

Datacenter As An API!!!

A++++++++++++!! Will Buy Again

$ bin/receiver prod.service-registry.sumologic.com

Here We Are

In 2014

Deployment wide services

Ingest

Search

Internal tools

receiverhornetq-

forgeforge

cqsplitter

search

cloud collector

service

api

con-cierge

stream

katta

glass, ganglia

bill

mix

meta

configzoo-

keeperappvault org

rawhornetq-inbound

cocoa

bloom filter

analyticscsi

cqmerger

rework

view

autoview

depman

hornetq-internal

hornetq-metadata

nrt

Embrace Change Or Die

Index

Index

Index

Index

Index

Index

Index

Index

Index

Index

Index

Index

Index

Index

Index

Index

Index

Index

Index

Index

Index

Index

Index

Index

Index

Index

Index

Index

Index

Index

Index

Index

Index

Index

Index

Index

Index

Index

Index

Index

Index

Index

Index

Index

Index

Index

Index

Index

Index

Index

1 1 1 1 1

1 1 1 1 1

1 1 1 1 1

1 1 1 1 1

1 1 1 1 1

Index

Index

Index

Index

Index

Index

Index

Index

Index

Index

Index

Index

Index

Index

Index

Index

Index

Index

Index

Index

Index

Index

Index

Index

Index

1 2 1 2 1 2 1 2 1 2

1 2 1 2 1 2 1 2 1 2

1 2 1 2 1 2 1 2 1 2

1 2 1 2 1 2 1 2 1 2

1 2 1 2 1 2 1 2 1 2

Index

Index

Index

Index

Index

Index

Index

Index

Index

Index

Index

Index

Index

Index

Index

Index

Index

Index

Index

Index

Index

Index

Index

Index

Index

1 2 3 4

5 6 7 8

1 2 3 4

5 6 7 8

1 2 3 4

5 6 7 8

1 2 3 4

5 6 7 8

1 2 3 4

5 6 7 8

1 2 3 4

5 6 7 8

1 2 3 4

5 6 7 8

1 2 3 4

5 6 7 8

1 2 3 4

5 6 7 8

1 2 3 4

5 6 7 8

1 2 3 4

5 6 7 8

1 2 3 4

5 6 7 8

1 2 3 4

5 6 7 8

1 2 3 4

5 6 7 8

1 2 3 4

5 6 7 8

1 2 3 4

5 6 7 8

1 2 3 4

5 6 7 8

1 2 3 4

5 6 7 8

1 2 3 4

5 6 7 8

1 2 3 4

5 6 7 8

1 2 3 4

5 6 7 8

1 2 3 4

5 6 7 8

1 2 3 4

5 6 7 8

1 2 3 4

5 6 7 8

1 2 3 4

5 6 7 8

Index

Index

Index

Index

Index

Index

Index

Index

Index

Index

Index

Index

Index

Index

Index

Index

Index

Index

Index

Index

Index

Index

Index

Index

Index

1 1

1 1

Index

Index

Index

Index

Index

Index

Index

Index

Index

Index

Index

Index

Index

Index

Index

Index

Index

Index

Index

Index

Index

Index

Index

Index

Index

1 1 2 2 2

1 1 2 2 2

Index

Index

Index

Index

Index

Index

Index

Index

Index

Index

Index

Index

Index

Index

Index

Index

Index

Index

Index

Index

Index

Index

Index

Index

Index

1 3 4 1 3 4 2 3 5 2 3 5 2 3 6

7 7 5 8 5 8

1 3 4 1 3 4 2 3 5 2 3 5 2 3 6

7 7 5 8 5 8

7 7 5 8 5 8

5 8

5 8

5 8

6

6

6

Set[Customer], Set[Instance] Map[Instance, Set[Customer]]

http://bit.ly/awsevals

top related