OpenSlava Infrastructure Automation Patterns

Organizers Top Media Partner Media Partner Supporter

Antons Kranga DevOps:Cloud Automation October 11, 2013

Presenter

- Technology Architect at Accenture

- 10+ years experience in Enterprise Development

- Projects: - Accenture Foundation Platform for Java - Accenture Cloud Platform

- ALPJ - Monsoon

www.sli.do/openslavaAsk questions online

http://www.sli.do/openslava

Copyright © 2013 Accenture All rights reserved.

Cloud

This is cloud


Definition of Cloud Computing


Cloud Computing


Accenture Cloud Platform

Testing as Service Monsoon ALPJ etc

Cloud Broker API


Challenges of Cloud (What IaaS Offers)

Web Tier

Application Tier

Database


Challenges of Cloud (What Users Want)

Web Tier

Application Tier

Database

Infrastructure services and patterns

example

include_recipe “java“ package "tomcat6“ artifact_deploy "tomcat6“ do version "latest“ artifact_location "foo.war" deploy_to node[:tomcat][:work_dir] end service "tomcat6" do action [:enable, :start] end

OS Type: RedHat OS Version: 6.2

Tomcat Home: /etc/tomcatTomcat Port: 8080

MySQL IP: 10.10.0.1 MySQL Root Password: password

RecipeAttributes

OS Specific Instructions


Chef Workstation Virtualized Infrastructure



Chef Server

...Roles

Cookbooks

REST

CMDB



Chef Server

...Roles

Cookbooks

REST

CMDB



Chef Server

knife

...Roles

Cookbooks

REST

CMDB

Uses SSH tobootstraps Chef

client



Chef Server

knife

...Roles

Cookbooks

REST

CMDB

chef client

tomcat6


Chef Server

knife

...Roles

Cookbooks

REST

CMDB

chef client

tomcat6

HTTP call signed with certificate


Chef Server

knife

...Roles

Cookbooks

REST

CMDB

chef client

tomcat6



Chef Server

knife

...Roles

Cookbooks

REST

CMDB

chef client

tomcat6

tomca

t6

java

iptab

les

Cookbooks



Chef Server

knife

...Roles

Cookbooks

REST

CMDB

chef client

tomcat6

tomca

t6

java

iptab

les

Cookbooks

upload facts

ohai

Service discovery

Node 1 Node 2 Node 3 Node N


Database

Register RegisterRegisterRegister


Database


Discover nodes


Database


Discover nodes

Load balancing


LB


LBSingle point of

failure


LB LB2Heartbeat


LB LB2Heartbeat

Shared virtual IP

Dealing with sticky sessions

Tomcat 1 Tomcat 2 Tomcat 3 Tomcat N

LB LB2Heartbeat

Shared virtual IP


LB LB2Heartbeat

Shared virtual IP

Memcached 1 Memcached 2 Memcached 3 Memcached N

Save session Save session Save session Save session

Same ServerSame ServerSame ServerSame Server


LB LB2Heartbeat

Shared virtual IP




Repl Repl Repl


LB LB2Heartbeat

Shared virtual IP




Repl Repl Repl

If session repl not hitting netw capacity


LB LB2Heartbeat

Shared virtual IP

Memcached

save session

Large RAM VM

Elasticity


LB LB2Heartbeat

Shared virtual IP




Repl Repl Repl


LB LB2Heartbeat

Shared virtual IP




Repl Repl Repl

Auto scaling group

Dealing with sticky sessions


Database


Discover nodes


Message Broker

publish facts publish facts publish facts publish facts


Message Broker

publish facts publish facts publish facts publish factssubscribe events subscribe events subscribe events subscribe events


Message Broker

publish facts publish facts publish facts publish factssubscribe events subscribe events subscribe events subscribe events

heartbeat heartbeatheartbeatheartbeat

Virtualized Infrastructure

Chef Server

Message BrokerCMDB

Infra Management: 1. Provisioning 2. Service Discovery

Operating Scenarios: Operations


Chef Server

mCollectiveCMDB

Server Orchestration: 1. Cluster Orchestration 2. Scalability 3. Deployment Orchestration

Infra Management: 1. Provisioning 2. Patching

Multi zone example

Distributed logging


Auto scaling group


Cloud storage

Auto scaling group


Log collector

Cloud storage

Auto scaling group

Log agent Log agent Log agent Log agent

Phoenix Server



Want to apply change/patch

Node 1 Node 2 Node 3 Node N Node M


Migrate data

All changes included


Shared data

Cloud storage

Test and learn


Chef Server

CMDB


Chef Server

CMDB

Chaos Monkey

Cookbook development

Stop forking, really!!!

community cookbook

wrapper cookbook

wrapper cookbook adds new functionality to community version of the cookbook instead of changing it directly

community cookbook

wrapper cookbook

include_recipe “tomcat“ chef_gem "chef-rewind“ rewind "template[catalina.xml]“ do # add your custom staff end


• Food Critic: Cookbook style analysis tool

• URL: http://acrmp.github.com/foodcritic/

• Integration: Travis CI

• Cookbook Style Guide: https://github.com/ampledata/cookbook-style-guide

Cookbook Quality

http://acrmp.github.com/foodcritic/

https://github.com/ampledata/cookbook-style-guide

Takeaways

- Accenture Cloud Platform

- Monsoon

- Accenture Lightweight Platform for Java

- Accenture Foundation Platform for Java

- Opscode Chef

Discussion

www.sli.do/openslava

http://www.sli.do/openslava