Is DC/OS a better way to run Docker on AWS? Chien Huey | DevOps Engineer
Is DC/OS a better way to run Docker on AWS? Chien Huey | DevOps Engineer
© 2016 XO GROUP INC. ALL RIGHTS RESERVED.
Goals
XO loves Docker
© 2016 XO GROUP INC. ALL RIGHTS RESERVED.
Goals
XO loves Docker Pick 2
© 2016 XO GROUP INC. ALL RIGHTS RESERVED.
Goals
XO loves Docker Pick 2 DC/OS 👍👎
© 2016 XO GROUP INC. ALL RIGHTS RESERVED.
Goals
XO loves Docker Pick 2 DC/OS 👍👎 The way forward
© 2016 XO GROUP INC. ALL RIGHTS RESERVED.
Disclaimer
© 2016 XO GROUP INC. ALL RIGHTS RESERVED.
About XO Group
theKnot.com
© 2016 XO GROUP INC. ALL RIGHTS RESERVED.
About XO Group
theKnot.com Rails, nodeJS
© 2016 XO GROUP INC. ALL RIGHTS RESERVED.
About XO Group
theKnot.com Rails, nodeJS ~11M visitors/month
© 2016 XO GROUP INC. ALL RIGHTS RESERVED.
About XO Group
theKnot.com Rails, nodeJS ~11M visitors/month [email protected]
© 2016 XO GROUP INC. ALL RIGHTS RESERVED.
Squad Squad Squad Smaller, autonomous squads
© 2016 XO GROUP INC. ALL RIGHTS RESERVED.
DevOps 1.0: XO Toolbox
© 2016 XO GROUP INC. ALL RIGHTS RESERVED.
Engineering Productivity
Squad Squad Squad With some DevOps on top
© 2016 XO GROUP INC. ALL RIGHTS RESERVED.
The Good
© 2016 XO GROUP INC. ALL RIGHTS RESERVED.
Docker on Beanstalk 🙂
Consistent, repeatable deployment
© 2016 XO GROUP INC. ALL RIGHTS RESERVED.
Docker on Beanstalk 🙂
Consistent, repeatable deployment End to end solution
© 2016 XO GROUP INC. ALL RIGHTS RESERVED.
Docker on Beanstalk 🙂
Consistent, repeatable deployment End to end solution HA across AZs
© 2016 XO GROUP INC. ALL RIGHTS RESERVED.
Docker on Beanstalk 🙂
Consistent, repeatable deployment End to end solution HA across AZs User-friendly interface
© 2016 XO GROUP INC. ALL RIGHTS RESERVED.
The Bad
© 2016 XO GROUP INC. ALL RIGHTS RESERVED.
Docker on Beanstalk 🙁
One container per instance
© 2016 XO GROUP INC. ALL RIGHTS RESERVED.
Docker on Beanstalk 🙁
One container per instance Resizing instances not easy
© 2016 XO GROUP INC. ALL RIGHTS RESERVED.
© 2016 XO GROUP INC. ALL RIGHTS RESERVED.
Docker on Beanstalk 🙁
One container per instance Resizing instances not easy No cross-region HA
© 2016 XO GROUP INC. ALL RIGHTS RESERVED.
Docker on Beanstalk 🙁
One container per instance Resizing instances not easy No cross-region HA AWS-specific
© 2016 XO GROUP INC. ALL RIGHTS RESERVED.
Docker on Beanstalk 🙁
One container per instance Resizing instances not easy No cross-region HA AWS-specific Expensive
© 2016 XO GROUP INC. ALL RIGHTS RESERVED.
The Ugly
© 2016 XO GROUP INC. ALL RIGHTS RESERVED.
Underutilization
CPU > 10%
© 2016 XO GROUP INC. ALL RIGHTS RESERVED.
Underutilization
CPU > 10% - 25%
© 2016 XO GROUP INC. ALL RIGHTS RESERVED.
Underutilization
CPU > 10% - 25% 50%
© 2016 XO GROUP INC. ALL RIGHTS RESERVED.
Underutilization
CPU > 10% - 25% 50% 60%
© 2016 XO GROUP INC. ALL RIGHTS RESERVED.
Underutilization
CPU > 10% - 25% 50% 60%
72%
© 2016 XO GROUP INC. ALL RIGHTS RESERVED.
Not cool
© 2016 XO GROUP INC. ALL RIGHTS RESERVED.
😟
© 2016 XO GROUP INC. ALL RIGHTS RESERVED.
😠
© 2016 XO GROUP INC. ALL RIGHTS RESERVED.
User friendly
EB replacement criteria
© 2016 XO GROUP INC. ALL RIGHTS RESERVED.
User friendly Many containers, one instance
EB replacement criteria
© 2016 XO GROUP INC. ALL RIGHTS RESERVED.
© 2016 XO GROUP INC. ALL RIGHTS RESERVED.
© 2016 XO GROUP INC. ALL RIGHTS RESERVED.
User friendly Many containers, one instance Vendor-agnostic
EB replacement criteria
© 2016 XO GROUP INC. ALL RIGHTS RESERVED.
User friendly Many containers, one instance Vendor-agnostic HA across failure zones
EB replacement criteria
© 2016 XO GROUP INC. ALL RIGHTS RESERVED.
Why DC/OS?
© 2016 XO GROUP INC. ALL RIGHTS RESERVED.
© 2016 XO GROUP INC. ALL RIGHTS RESERVED.
Installing
© 2016 XO GROUP INC. ALL RIGHTS RESERVED.
DC/OS Installation
CF template
© 2016 XO GROUP INC. ALL RIGHTS RESERVED.
DC/OS Installation
CF template CLI/Advanced installer
© 2016 XO GROUP INC. ALL RIGHTS RESERVED.
© 2016 XO GROUP INC. ALL RIGHTS RESERVED.
DC/OS Installation
CF template CLI/Advanced installer Demo
© 2016 XO GROUP INC. ALL RIGHTS RESERVED.
© 2016 XO GROUP INC. ALL RIGHTS RESERVED.
The Good
© 2016 XO GROUP INC. ALL RIGHTS RESERVED.
DC/OS Evaluation 🙂 Easy cluster creation
© 2016 XO GROUP INC. ALL RIGHTS RESERVED.
DC/OS Evaluation 🙂 Easy cluster creation One-button package installs
© 2016 XO GROUP INC. ALL RIGHTS RESERVED.
© 2016 XO GROUP INC. ALL RIGHTS RESERVED.
DC/OS Evaluation 🙂 Easy cluster creation One-button package installs Vertically scaling beyond instance size
© 2016 XO GROUP INC. ALL RIGHTS RESERVED.
DC/OS Evaluation 🙂 Easy cluster creation One-button package installs Vertically scaling beyond instance size Turn key for homogenous workload
© 2016 XO GROUP INC. ALL RIGHTS RESERVED.
The Bad
© 2016 XO GROUP INC. ALL RIGHTS RESERVED.
DC/OS Evaluation 🙁 Private Docker registries
© 2016 XO GROUP INC. ALL RIGHTS RESERVED.
Demo
Renewing private registry authentication
© 2016 XO GROUP INC. ALL RIGHTS RESERVED.
DC/OS Evaluation 🙁 Private Docker registries Unable to autoscale cluster
© 2016 XO GROUP INC. ALL RIGHTS RESERVED.
DC/OS Evaluation 🙁 Private Docker registries Unable to autoscale cluster https://dcos.io/docs/1.7/usage/faq/
© 2016 XO GROUP INC. ALL RIGHTS RESERVED.
© 2016 XO GROUP INC. ALL RIGHTS RESERVED.
🤔
© 2016 XO GROUP INC. ALL RIGHTS RESERVED.
© 2016 XO GROUP INC. ALL RIGHTS RESERVED.
© 2016 XO GROUP INC. ALL RIGHTS RESERVED.
DC/OS Evaluation 🙁 Private Docker registries Unable to autoscale cluster https://dcos.io/docs/1.7/usage/faq/ Expensive
© 2016 XO GROUP INC. ALL RIGHTS RESERVED.
Cost analysis
8:1 replacement ratio
© 2016 XO GROUP INC. ALL RIGHTS RESERVED.
Cost analysis
8:1 replacement ratio Cost of masters & LB 1.5 agents
© 2016 XO GROUP INC. ALL RIGHTS RESERVED.
Cost analysis
8:1 replacement ratio Cost of masters & LB 1.5 agents OSS version only
© 2016 XO GROUP INC. ALL RIGHTS RESERVED.
DC/OS Evaluation 🙁 Private Docker registries Unable to autoscale cluster http://mesos.apache.org/documentation/
latest/monitoring/ Expensive Incomplete
© 2016 XO GROUP INC. ALL RIGHTS RESERVED.
The Verdict
© 2016 XO GROUP INC. ALL RIGHTS RESERVED.
Next steps for XO
Mesos 👍
© 2016 XO GROUP INC. ALL RIGHTS RESERVED.
Next steps for XO
Mesos 👍 Swarm (on Mesos?)
© 2016 XO GROUP INC. ALL RIGHTS RESERVED.
Next steps for XO
Mesos 👍 Swarm (on Mesos?) Staying aware of DC/OS
© 2016 XO GROUP INC. ALL RIGHTS RESERVED.
References
http://sched.co/6jtW - Huawei http://sched.co/6lLy - Allegro http://bit.ly/1Xg0T6R - Tendril marathon
autoscaler
74
© 2015 XO GROUP INC. ALL RIGHTS RESERVED.
Yours truly
Chien Huey [email protected]
@chspinning
xogroupinc.com