Docker, the Future of Distributed Applications | Docker Tour de France 2014

The Future of Distributed Applications

A 10-min overview of Docker, by Julien Barbier, Jérôme Petazzoni & Victor Coisne, at Zenika, Paris, France

~2000 2014

Long lived Development is iterative and constant

Monolithic and built on a single stack Built from loosely coupled components

Deployed to a single server Deployed to a multitude of servers

Apps Have Fundamentally Changed

Static website

Web frontend

User DB

Queue Analytics DB

Background workers

API endpoint

nginx 1.5 + modsecurity + openssl + bootstrap 2

postgresql + pgv8 + v8

hadoop + hive + thrift + OpenJDK

Ruby + Rails + sass + Unicorn

Redis + redis-sentinel

Python 3.0 + celery + pyredis + libcurl + ffmpeg + libopencv + nodejs

+ phantomjs

Python 2.7 + Flask + pyredis + celery + psycopg + postgresql-client

Development VM

QA server

Public Cloud

Disaster recovery

Contributor’s laptop

Production Servers

The Problem in 2014: Distributed Applications

Mu

ltip

licit

y o

f St

acks

Mu

ltip

licit

y o

f h

ard

war

e

en

viro

nm

en

ts

Production Cluster

Customer Data Center

Do

service

s and

ap

ps in

teract

app

rop

riately?

Can

I migrate

sm

oo

thly an

d

qu

ickly?

Mu

ltip

licit

y o

f G

oo

ds

Mu

ltip

ilici

tyo

f m

eth

od

s fo

r tr

ansp

ort

ing

/sto

rin

g

Do

I wo

rry abo

ut

ho

w go

od

s inte

ract (e

.g. coffe

e b

ean

s n

ext to sp

ices)

Can

I transp

ort

qu

ickly and

smo

oth

ly(e

.g. from

bo

at to

train to

truck)

Cargo Transport Pre-1960

Mu

ltip

licit

y o

f G

oo

ds

Mu

ltip

licit

y o

f m

eth

od

s fo

r tr

ansp

ort

ing

/sto

rin

g

Do

I wo

rry abo

ut

ho

w go

od

s interact

(e.g. co

ffee

be

ans

next to

spices)

Can

I transp

ort

qu

ickly and

sm

oo

thly

(e.g. from

bo

at to

train to

truck)

Solution: Intermodal Shipping Container

…in between, can be loaded and

unloaded, stacked, transported

efficiently over long distances,

and transferred from one mode

of transport to another

A standard container that is

loaded with virtually any

goods, and stays sealed until

it reaches final delivery.

This spawned an Intermodal Shipping Container Ecosystem

• 90% of all cargo now shipped in a standard container• Order of magnitude reduction in cost and time to load and unload ships• Massive reduction in losses due to theft or damage• Huge reduction in freight cost as percent of final goods (from >25% to <3%)massive globalization• 5000 ships deliver 200M containers per year

Static website Web frontend User DB Queue Analytics DB

Development VMQA server Public Cloud

Contributor’s laptop

Docker: intermodal container + ecosystem for distributedapplications

Mu

ltip

licit

y o

f St

acks

Mu

ltip

licit

y o

f h

ard

war

e en

viro

nm

ents

Production ClusterCustomer Data Center

Do

service

s and

ap

ps in

teract ap

pro

priate

ly?

Can

I migrate

smo

oth

ly and

q

uickly

…that can be manipulated using

standard operations and run

consistently on virtually any hardware platform

An engine that enables any

payload to be encapsulated

as a lightweight, portable,

self-sufficient container…

Docker Containers + Ecosystem: Impact

• Massive reduction of application development lifecycle• Week / month -> Days / hours

• Drastic cost reduction (applications and servers)• Application development is faster

• From dev to deploy: much faster

• Docker containers use 2 to 30 times less resources than traditional VMs*

• More freedom• Docker containers can be moved from one cloud to another with

consistancy -> no more lock-in

• More transparency• Docker is open-source

*Independant IBM study: http://domino.research.ibm.com/library/cyberdig.nsf/papers/0929052195DD819C85257D2300681E7B/%24File/rc25482.pdf

Who is using Docker?

E-Commerce Media

IT SaaS IaaS

Life Sciences

PaaS

…and thousands of others!

Vertical Search

Case Study: New Relic

At-A-Glance

• Application performance monitoring service

• ~90,000 customers

• Tracks 1+ trillion events / month

• Just filed for their IPO

Challenges

• 50% more servers in 3 months

• Doubling developer count every year

• Increasing heterogeneity:

4 versions of Ruby

3 different JVMs

5 data stores…

Before Docker

• 7 monolithic apps

• Devs doing own deploys

• One-off custom deploy tools

• Everyone had access to BD secrets

• From dev-to-deploy: weeks

After Docker

• 30+ microservices

• Separation of build from deploy

• Single standardized deploy tool

• Improved security

• From dev-to-deploy: hours

Why are we here?

• Docker Tour de France 2014• Paris, Lyon, Lille, Bordeaux, Nice, Monaco

• There are more Docker Meetup groups in Europe than anywhere else

• Meet the Docker community

• Meet French schools, incubators & accelerators

• Meet French companies• Understand their needs

• Understand the specificity of the French market and the European market

• Today there are ~50 companies in the room

Thank you!

Learn about docker

• Contact us:• Julien Barbier: [email protected] | Twitter: @julienbarbier42

• Jerome Petazzoni: [email protected] | Twitter: @jpetazzo

• Victor Coisne: [email protected] | Twitter: @vcoisne

• Docker project: www.docker.com/

• Docker Partner Program: https://www.docker.com/partners/program/

• Use Cases: https://docker.com/resources/usecases/

• Sign up for a DockerHub account: https://hub.docker.com/

• Follow Docker on Twitter: twitter.com/docker

• Take the Docker interactive tutorial: https://docker.com/tryit/

• Go to the Docker repository on GitHub: github.com/docker/docker/

• Go to a Meetup: https://www.docker.com/community/meetups/