©2013 CloudBees, Inc. All Rights Reserved 1 Next Step in Automation: Elastic Build Environment Kohsuke Kawaguchi / CloudBees, Inc. [email protected] / @kohsukekawa.

©2013 CloudBees, Inc. All Rights Reserved 1©2013 CloudBees, Inc. All Rights Reserved

Next Step in Automation:Elastic Build EnvironmentKohsuke Kawaguchi / CloudBees, [email protected] / @kohsukekawa

Jesse Glick / CloudBees, [email protected] / @tyvole

©2013 CloudBees, Inc. All Rights Reserved 2

Have You Met Jenkins? http://jenkins-ci.org/

http://jenkins-ci.org/


32%


18%



My Jenkins around 2006




Workload

http://www.flickr.com/photos/gbyrnes/912576883/


If only we had more computers…

• Just building & testing them all…• Running tests more frequently• Testing individual commits


What you don’t wanthttp://www.flickr.com/photos/drocpsu/8546730021/


Just enough computersjust in time

Elasticity


My Jenkins around 2007




©2013 CloudBees, Inc. All Rights Reserved 17http://www.flickr.com/photos/drocpsu/8546730021/


18

But not this, either


Just enough computersof the right kind

just in time

Elasticity!

©2013 CloudBees, Inc. All Rights Reserved 20http://www.flickr.com/photos/82219206@N00/7003641975/


Correct answer

• Test assumes a fixture running on port 8080– Doesn’t check if it’s already being used

• If another test runs at the same time…?



Correct answer

• Because of “pkill -f -9 tomcat” cleanup


Isolation

http://www.flickr.com/photos/jumilla/8667648797/


Isolation

• At odds with large multi-core systems

• x86 virtual machines• User isolation• Kernel containers


!



Correct answer

• Same Maven ID, two different jars

• Different projects designate different ones

• Local cache gets cleaned up periodically

• Whichever first runs after cache cleanup “wins”



Correct answer

• Test script leaves background daemon process behind

• Over time it’ll slowly choke slaves



Throw away & create new

Elasticity!



Ladder to Cloud

Single

MultipleElastic


Solid OSS Elasticity Plugins

• EC2 plugin• Jclouds plugin– OpenStack, CloudStack

• Launch and tear down slaves on demand


VMWare auto-scaling plugin

• Snapshot• Power on-off management• Hypervisor-aware scheduling• Folder based pooling• VMWare tools integration• One-time use support


Host that runs Docker

Docker plugin


Mansion

Slave Slave

Slave Slave

CloudBees DEV@cloud


Maven

Git

Ant

Mercurial

Gradle

Subversion

Linux Kernel

Hardware

Linux Container = zero cost virtualization


For OS X

Maven

Git

XCode

Git

XCode

Subversion

OS X OS X OS X

QEMU QEMU QEMU

Linux Kernel

Apple Hardware


Kernel Same-page Merging

OS X OS X OS X



Mansion

Slave

Slave

Slave

Workspace 1

Workspace 2

Workspace 3

Workspace 4


Slave

Slave

Workspace

Workspace’’

Workspace’


Slave

Slave

~/.m2/repository

~/.m2/repository

~/.m2/repository


Parallel Testing

Test Group #1 Test Group #2 Test Group #3


Parallel Testing

foo #10 Test Group #1

foo #11 Test Group #2

foo #12 Test Goup #3


Validated Merge

upstreamrepo

gate repo


Workflow


Workflow System

• Alternative to “freestyle” projects• Scripted control flow• Resumable execution across restarts• All-in-one build/test/deploy pipelines• Under active development


Workflow with Elastic Slaves

• One-line provisioning from cloud• Language-level parallelism• Run commands, archive files, test

results• Now integrates with parallel test plugin


Demo


Conclusion: Elasticity Benefits

• Just-in-time capacity• Diversity without overhead• Isolation• Productivity gain– parallel testing– validated merge– workflow


©2013 CloudBees, Inc. All Rights Reserved 1 Next Step in Automation: Elastic Build Environment Kohsuke Kawaguchi / CloudBees, Inc. [email protected] / @kohsukekawa.

Documents