Optimizing DevOps strategy in a large enterprise

Optimizing DevOps StrategyIn a large enterprise

DevOps Days TLV 2014

Eyal Edri, Supervisor, RHEV & oVirt CI, Red HatOded Ramraz, Supervisor, Global CI, Red Hat

2 Eyal Edri | Oded Ramraz

Agenda

● The Challenge – Decisions, Decisions, Decisions– The DevOps “Jungle”

– Enterprises & DevOps – Clutter & Politics

– Red Hat & DevOps Today

– Open Discussion – What do YOU choose?

● The Solution – Global CI (“DevOps as a service”)

– Challenges

– Useful Links

3 Eyal Edri | Oded Ramraz

The projects

upstream

downstream

4 Eyal Edri | Oded Ramraz

The People

network security virtualization

Sysadmin Developer DevOps Manager

● RHEV CI Team at Red Hat and maintainer in the oVirt project.● Dive Control Specialist, with affection for shark diving.

Eyal Edri – R&D Engineering

5 Eyal Edri | Oded Ramraz

The People

– QE Operations team

– Responsible for the implementation and maintenance of a shared, cloud-based CI infrastructure for all Red Hat product lines.

–

Oded Ramraz – Quality Assurance Engineering

6

The ChallengeVIRTUALIZATION CONFIGURATION MANAGEMENT

PROVISIONINGCONTINUOUS INTEGRATION

7

8

DevOps “Jungle”

9

DevOps in EnterprisesChallenges

KNOWLEDGE SHARE STABILTY vs

INNOVATIVION

REDUCE RISKBEST TEAMS

COLLABORATION

10

DevOps Wars a CM example

Stable Knowledge Community

NewCool

Simple  (?)

VS

11

Clutter & Politics

How Many DevOps teams exists in your organization ?

12

DevOps Teams In Red Hat

13

Cherry-PickingBest PracticesScale: >

1000 slaves

Distributed ownership

New and fast moving

stableproduction

puppet

production

Foreman

Jenkins Job

builder

fabricZuul

brew

14

DE-Clutterization

“Out of clutter, find simplicity.”

― Albert Einstein.

Which CM system are you using?

Which virtualization solution do you have?

What kind of CI tool you're using?

15

The SolutionIntroducing Red Hat Global CI

a.k.a “devops as a service”

● Data collection process● Common work-flows● Conflicts between teams● Global CI Infra Diagram● GEO locations challenges

16

Data Collection

Team CI tools Triggers Provisioning CM Code Coverage

Monitor

Team A Jenkins Gerrit Beaker Puppet JaCoCo Nagios

Team B Team City

Gerrit OpenstackNova

Ansible Cobertura Icinga

Team C Jenkins Brew Foreman Puppet Sonar Zabbix

Team D Jenkins Email Satellite Chef Emma Nagios

Team E Jenkins Brew Cobbler Ansible Sonar Cacti

Conclusion Jenkins BrewGerrit

BeakerForeman

PuppetAnsible

Sonar Zabbix

17

Common RHEV CI Work-flow

18

Common OpenStack Work-flow

19

Conflicts between teams

● Examples:–TeamCity/Jenkins–Puppet/Ansible–Foreman/Beaker

● Conflict management –Standardization vs Flexibility–Stability vs Innovation–Comparison matrices–Phasing approach

20

CI infrastructure vision

21

Provisioner architecture

-22-

GEO locations challenges

23

What's next?

● What's next?– CloudForms integration

– Openshift integration (Containers)

– Satellite 6 integration

– Cloud Bursting

– Pre-defined Installation profiles (e.g glance images)

– Data Analysis and Reporting

24

Links ● Openstack (RDO) - http://openstack.redhat.com

● Gluster - http://www.gluster.org/

● Ovirt – http://www.ovirt.org

● Foreman - http://theforeman.org/

● Beaker - https://beaker-project.org/

● Pulp - http://www.pulpproject.org/

● Ansible - http://www.ansible.com/home

● DevOps Blog - https://developerblog.redhat.com/tag/devops/

● JBOSS - http://www.jboss.org/

● Manage IQ - http://manageiq.org/

● CEPH - http://ceph.com/

Questions?

[email protected]@redhat.com