Infrastructure as Code with Chef

Nathen Harvey | VP, Community Development | [email protected] �

Nathen Harvey

•  VP, Community Development at Chef•  Co-host of the Food Fight Show Podcast

•  Occasional farmer – http://ei.chef.io•  Love eggs – http://eggs.chef.io•  Part-time detective - http://bit.ly/detectivedecker

•  @nathenharvey•  [email protected]

EVERY business is a software business

We’re going to be a software company with airplanes.

– CIO, Alaska Airlines

Quality and innovation, historically a tradeoffQ

UALIT

Y/CO

MPL

IAN

CE

RATE OF INNOVATION

Challenges

Manual processesWeeks to setup new systems or software

Legacy systems and toolsInflexible, hard-to-change hardware and software

Organizational silosUnwieldy divisions of responsibility

Infrequent, large releasesFear of deployment due to risk to SLAs

Regulatory burdensCompliance bottleneck at the end of a project

Idea Value

æ

S

ƴ

Ä

ǋ






AutomationNew systems and software updates deployed in minutes

Solutions to the challenges

Idea Value

æ

S

ƴ

Ä

ǋ






Dynamic infrastructureEasy migration to on-demand, cloud-based infrastructure and management of heterogeneous networks



Idea Value

æ

S

ƴ

Ä

ǋ






Increased cooperation and trustTeams are aligned towards common goals




Idea Value

æ

S

ƴ

Ä

ǋ










Continuous delivery of infrastructure and applicationsSafe, rapid delivery of incremental value

Idea Value

æ

S

ƴ

Ä

ǋ






Compliance at velocity Integration of compliance into the workflow using automated tests




Continuous delivery of infrastructure and applicationsSafe, rapid delivery of incremental value


The game changer: rapid time to value

Innovation

Quality/Compliance

DynamicInfrastructure

Dynamic infrastructureMigrate applications to the cloud and support hybrid and multi-cloud environments. Automate the management of heterogeneous networks, including legacy systems.

•  Provisioning and setting up environments •  Dynamic scaling of compute resources•  Migrating legacy workloads to the cloud•  Multi cloud and hybrid cloud deployment•  Support for heterogeneous environments


Innovation

Quality/Compliance


Infrastructure as CodeAutomate the Stack

+

Infrastructure as Code

•  Programmatically provision and configure components



•  Treat like any other code base



•  Treat like any other code base•  Reconstruct business from code repository, data

backup, and compute resources

AutomationTurn infrastructure into code—infrastructure as code is versionable, testable and repeatable. Manual processes become a thing of the past.

•  Automated, full-stack application policies•  Package and service installation•  Versionable, testable, repeatable workflow•  Scalable application policies•  Management of interdependencies across nodes

Chef Server

Policy

State

State queries

Servers, VMs, cloud instances, etc.

running the Chef client

•  The Chef server stores policy and configuration data•  The Chef client periodically runs on each node in the network•  Chef clients poll the server for the latest policies •  Chef clients notify the server of their states and can query for the states of other nodes

Describe Infrastructure as Codehttpd_service 'customers' do mpm 'prefork' action [:create, :start] end httpd_config 'customers' do instance 'customers' source 'customers.conf.erb' notifies :restart, 'httpd_service[customers]' end directory '/var/www/customers/public_html' do recursive true end

Test the Codedescribe 'apache::default' do context 'When all attributes are default, on an unspecified platform' do

let(:chef_run) do runner = ChefSpec::ServerRunner.new runner.converge(described_recipe) end

it 'converges successfully' do expect { chef_run }.to_not raise_error end

it 'installs apache' do expect(chef_run).to install_package 'apache2' end end end

Version the Code & the Artifact

name 'cmgw' maintainer 'Chef Software, Inc.'

maintainer_email '[email protected]' license 'apache2'

description 'Installs/Configures cmgw' long_description 'Installs/Configures cmgw'

version '0.1.0'


Innovation

Quality/Compliance


Infrastructure as CodeAutomate the Stack

DevOps �

+ +

DEVOPS

A cultural and professional movement, focused on how we build and operate high velocity organizations, born from the experiences of its practitioners.

PEOPLE

PRODUCTS

COMPANIES

WE ARE LEAN

•  Eliminate non-value-added action (Waste/Muda) •  Pull over Push •  Kaizen (Continuous Improvement) •  Kaikaku (Disruptive Change) •  Small Batch + Experimentation

UBIQUITOUS WORKFLOW

AUTOMATION

DIVERSITY

DevOps workflow & cultureEliminate silos and lower the overhead of IT operations and service management by supporting DevOps culture. Build communities.

•  Unified workflow for application and infrastructure•  Integration with version control for dev and ops•  Support for automated testing of infrastructure and applications

•  Integration of security and compliance into product development

•  Advanced, high-velocity workflow

The rewards?*

*source: Dr. Nicole Forsgren research on DevOps

More deployments��Ship faster��Faster MTTR after issues� �More profits, market share, and productivity��Market cap goes up

Continuous delivery of infrastructure & appsImplement a high-velocity software delivery pipeline that integrates application and infrastructure. Eliminate the risks incurred with large, infrequent releases.

•  Rapid provisioning of dev and test environments •  Ensure consistency and repeatability of environments•  Unified pipeline for infrastructure, runtime

environments and applications•  Support for large teams with multiple projects•  Advanced, high-velocity workflow

MANAGE RISK

•  Small batches, near term hypothesis •  Validation comes from customers •  Introduce near-term volatility to gain decreased

long-term risk

CONTINUOUS INTEGRATION

•  Always integrate branches to master •  They should be short lived, iterative branches •  Fix the build when it goes red

THE FOUR-EYE RULE

WRITE TESTS

•  Unit test (a single function) •  Integration tests (multiple classes/units) •  Functional tests (user-oriented, high-level, full

stack) •  Smoke tests (quickly determine if the system is

“working”)

ONE PATH FOR CHANGE

•  The way change moves through your organization is fixed

•  Designed to re-enforce your principles and aid flow

•  Flexible at the level of execution

CODE GOES THROUGH THE SAME WORKFLOW

Applications are code Infrastructure is code

Security and compliance at velocityRegulatory compliance and security concerns are facts of life for every enterprise. At the same time, competitive pressures are increasing. Embed requirements into the software delivery pipeline. Code makes compliance at velocity possible.

•  Embed compliance into the software delivery pipeline•  Automated checking of compliance criteria with

analytics•  Structured review process during development•  Discovery and analysis•  Patch management and remediation

Chef Provides a Proven Approach to DevOps

...

...

...

Targets/Workloads

Collaborative Dev Production

Chef Server

Chef Server

Chef Supermarket

Assessment

Chef Compliance

� Search

^ Audit

Ǘ Discover

Deploy

Chef Delivery!

Local Dev

ê Model

ƨ Build

¿ Test

Chef DK

Chef Client & Cookbooks


...

...

...

Targets/Workloads

Assessment

Chef Compliance

� Search

^ Audit

Ǘ Discover


...

...

...

Targets/Workloads

Assessment

Chef Compliance

� Search

^ Audit

Ǘ Discover

Local Dev

ê Model

ƨ Build

¿ Test

Chef DK



...

...

...

Targets/Workloads

Collaborative DevAssessment

Chef Compliance

� Search

^ Audit

Ǘ Discover

Deploy

Chef Delivery!

Local Dev

ê Model

ƨ Build

¿ Test

Chef DK


Unified Pipeline Shape

The stages are fixed, and each stage has a fixed set of phases!

APPROVE DELIVER

SubmitChange



APPROVE DELIVER

LintSyntaxUnit

SubmitChange



APPROVE DELIVER

LintSyntaxUnit

SubmitChange

Does thiscode changelook good?



APPROVE DELIVER

LintSyntaxUnit

SecurityQualityPublish

LintSyntaxUnit

SubmitChange




APPROVE DELIVER

LintSyntaxUnit


LintSyntaxUnit

ProvisionDeploySmoke

Functional

SubmitChange




APPROVE DELIVER

LintSyntaxUnit


LintSyntaxUnit


Functional

SubmitChange


Do we wantto ship this?



APPROVE DELIVER

LintSyntaxUnit


LintSyntaxUnit


Functional


Functional

SubmitChange





APPROVE DELIVER

LintSyntaxUnit


LintSyntaxUnit


Functional


Functional


Functional

SubmitChange





APPROVE DELIVER

LintSyntaxUnit


LintSyntaxUnit


Functional


Functional


Functional


Functional

SubmitChange



Shared Workflow

Delivery’s pipeline is shared across projects and teams


...

...

...

Targets/Workloads

Collaborative Dev Production

Chef Server

Chef Server

Chef Supermarket

Assessment

Chef Compliance

� Search

^ Audit

Ǘ Discover

Deploy

Chef Delivery!

Local Dev

ê Model

ƨ Build

¿ Test

Chef DK


Austin, TX | July 11-13

Early Bird Pricing Through April 17th

«  Workshops & Chef Training !

«  Community Summit !

«  Chef Partner Summit !

«  Welcome Reception!

«  Keynotes!

«  Technical Sessions!

«  Happy Hour!

«  Keynotes!

«  Technical Sessions!

«  Awesome Chef Awards!

«  Community Celebration!

ChefConf.com

ChefConf.com | Closes Feb 29

Suggested Topics

  Compliant Chefs  Let’s Get Technical  Grab Bag

  Welcome to Chef  Transformation  Continuously Chef

What questions can I answer for you?

Nathen Harvey

•  VP, Community Development at Chef•  Co-host of the Food Fight Show Podcast

•  Occasional farmer – http://ei.chef.io•  Love eggs – http://eggs.chef.io•  Part-time detective - http://bit.ly/detectivedecker

•  @nathenharvey•  [email protected]

Infrastructure as Code with Chef

Business