Continuous Testing in the Agile Age Testing as part of the Continuous Delivery process 785 Castro Street, Mountain View, CA 94041 | 1.855.445.2285 | [email protected]BlazeMeter ITAY MENDEL Devop MICHAEL REDMAN Customer Success ANDREY POKHILKO Chief Scientist ALON GIRMONSKY Founder & CEO R
This document is posted to help you gain knowledge. Please leave a comment to let me know what you think about it! Share it to your friends and learn new things together.
Transcript
Continuous Testing in the Agile AgeTesting as part of the Continuous Delivery process
2015 CURRENT STATE OF AFFAIRSMoving from Waterfall to Agile
“Continuous Delivery (CD) is rapidly emerging as the ‘new normal’ in software development, with approximately 80% of SaaS companies and 51% of non-SaaS companies adopting this practice”
Perforce Software Study
QA wasn’t invited to the party
THE TESTING BOTTLENECK
TESTING IS COMPLICATED!Why?
Developers• Unit
• Troubleshooting
CI/DevOps QA Operations• API
• Functionality
• Performance
• Regression
• Load
• Soak
• Regression
• Acceptance
• Load
• Monitoring
• Discrete VS continuous
• Frequent code commits
• Domain expertise required
• Multiple test points
ON THE VERGE OF CONTINUOUS DELIVERYTesting is a Challenge
TIM
E TO
REL
EASE
RELEASE NUMBER / TIME
20 40 60 80 100 120 140 160 180 200 220 240
2wks
1wks
3wks
4wks
5wks
THE OUTCOMEAny Agile Process is Most Likely to Fail
Test Early
Test Often
Test Everywhere
Automate it
CONTINUOUS TESTING PROCESS
Test Early
Test Often
Test Everywhere
Automate it(and get everyone on the same toolset)
CONTINUOUS TESTING PROCESS
CONTINUOUS TESTING
REDUCED TIME-TO-TEST
INCREASED # OF ITERATIONS
AUTOMATION
TIME-TO-RELEASE QUALITY
TIM
E TO
REL
EASE
RELEASE NUMBER / TIME
20 40 60 80 100 120 140 160 180 200 220 240
2wks
1wks
3wks
4wks
5wks
Before
After
CONTINUOUS TESTING FACILITATES AGILE
Developer
Devops
QA
OPs
OPs
Commit Code +
Test Representation
Configure
Test
Acceptance Test
Configure
Version Control Repository
Comprehensive Testing
Post-Production Monitoring
Continuous Deployment
Continuous Integration
PEOPLE
Red Arrow = Test Failed Green Arrow = Test Succeeded Blue Arrow = Sent to Testing
SYSTEMS TESTING ALERT
CONTINUOUS TESTING FACILITATES AGILE
Leve
rage
Pre
vio
us
Test
Rep
rese
nta
tio
n
Co
nti
nu
ou
s T
es
tin
g
IS POST-PROD MONITORING A PART OF TESTING?
Developers CI/DevOps QA Operations• GitHub
• JSON tests
• Jenkins
• JSON tests
• + JMeter tests
• + New Relic
• JSON tests
• JMeter tests
• New Relic
• Load & Soak
• Deploy
• Test
• Monitor
CD STACKWhat Toolset Will We Use?
Demo?We suggest you watch this 7 minute movie to see BlazeMeter in action: https://www.youtube.com/watch?v=6Oih-v-LICE