© Sauce Labs, Inc. What is DevOps & What Does it Mean for QA? Presented by Chris Riley ( @HoardingInfo ), DevOps Analyst July 14, 2015
© Sauce Labs, Inc.
What is DevOps &What Does it Mean for QA?
Presented by Chris Riley ( @HoardingInfo ), DevOps AnalystJuly 14, 2015
© Sauce Labs, Inc.© Sauce Labs, Inc.
Presenter
Chris Riley – technologist, research analyst, O’Reilly author and subject matter expert on DevOps. @hoardinginfo
© Sauce Labs, Inc.
Outline
• Introduction• Definitions• Nope … not really new• New Challenges• The Intersection of DevOps & QA• A QA Strategy for DevOps• Future of _______
© Sauce Labs, Inc.
The Two Faces
The Movement: People, Process, Tools
The Function: Infrastructure automation and oversight
© Sauce Labs, Inc.
Data?
© Sauce Labs, Inc.
Why the movement?
© Sauce Labs, Inc.
A moving Target
• Confusion!“DevOp
s” Functio
n
“DevOps” Movement
“DevOps”
“DevOps”
“DevOps”
“DevOps”
Developer
QA
IT Ops
“DevOps”
Vendor
Executive
Observer / SI
© Sauce Labs, Inc.
Enterprise SMB Startup
Developer Eh.. But LOB? Cool Done!
QA No Time Need the $$ What QA
Executive Nah. I want to keep my job Do that thing I’ll script it
IT Ops Done it for years, leave me alone
My budget, My thing
What’s IT?
Vendor They are doing it They are doing it Did it
Observer/SI
$ You got this -
© Sauce Labs, Inc.
False Comparison
X
© Sauce Labs, Inc.
So Basically No One Knows
Trough of disillusionment
© Sauce Labs, Inc.
What we do know:
• People then Process then Tools• The processes are concrete
• Plan• Dev• Integrate• QA• System Test• Release • Monitor• Measure
• “Culture” != Debug Ninja | Rockstar | Slide in the Lobby
• It is evolving
© Sauce Labs, Inc.
But Really It Is Very Easy
Faster releases at a higher quality
© Sauce Labs, Inc.
Faster releases at a higher quality
© Sauce Labs, Inc.
© Sauce Labs, Inc.
Uh oh - Problem
Current and Looming Challenges of DevOps
• We went too fast, crashed - sustainability• We release a whole bunch, but no clue what is going on• The more bugs, the more bugs, the more bugs, the
more• Chef is so three years ago – change• Oh yeah the person who did that, they left• Heartbleed v2.0
© Sauce Labs, Inc.
Why Should QA Care?
© Sauce Labs, Inc.
Who Cares?
• Get a budget
• Play with new and cool tools
• Be Prepared for Change
• Greater Opportunity
© Sauce Labs, Inc.
Happen to it, don’t let it happen to you
What can QA do?
• Deliver wins• Deliver data• Find your spot• Continuous Documentation• Make your developers champions• Suggest improvements to the pipeline• Realize and leverage your unique position• Automate something, then automate something else
© Sauce Labs, Inc.
Real-world
• Acorns
• WellsFargo
• Constant Contact
© Sauce Labs, Inc.
The Future of ______
Where is it going?
• A mobile focus• Containers not code• Developers are more accountable• User driven test case development• QA -> QE: Test Strategy, Quality Evangelist
© Sauce Labs, Inc.
QA
Resources• Test Automation KPIs -
http://sauceio.com/index.php/2015/06/test-automation-kpis/
• It Worked on My Machine - http://sauceio.com/index.php/2015/07/it-worked-on-my-machine-communication-trap/
• Sign up for a free trial of Saucehttps://saucelabs.com/signup/trial