Continuous Delivery and MarkLogic

Con$nuousDeliveryandMarkLogic

StephenMcKearneyBBC

“FindthemostpopularshortcomedyclipfeaturingMr.BeanthatIcanwatchonmyAndroidtablet”

Architecture

MarkLogicCluster

•  6hostspercluster

•  120requests/second

•  300ms/request

•  Unitoffailure

DevelopmentProcess

Step1:Measure$meinqueues

ImproveTes$ng•  Ntestrunners•  Target:20minutes

•  Mul$pleMarkLogicinstances•  Run1/Ntests

•  Typesoftests•  Unittests•  Integra$ontests•  SanityChecks

•  Mockingforspeed•  xdmp:set

Step2:ImprovedTes$ng

Tes$ngatScale

•  Performancetest– Realis$crequestload– Replayrequests

•  Tes$ngingest– Realis$cloadpaPerns

•  AsLive/Stageenvironment– 2ndMaster– 1Slave

Step3:AsLiveEnvironment

AsLiveinLive

DeploymentIssues

•  Deployingcodetooslow•  Performancespikes•  Lotsofmonitoring

•  Versionallcode&configura$on•  Useappserverroot

•  Allcodeinlivebeforebeingac$ve•  Supportstes$ng

Step4:VersionedDeployment

Step5:Con$nuousDeployment

Step6:Doweneedatester?

CurrentPipeline

NextTarget

•  Fasterlivedeployments– 40-60minutedelaythroughbuildsystem

•  1x1Flow– Singlefeature

•  ApplyapproachtoProductManagement– Howwepriori$sework– Clientsshouldpullwork