Are you embarking on a large-scale, globally distributed, multi-team scrum project? Have you already identified the potential testing challenges that lie ahead? Or have you belatedly encountered them and are now working on them in real-time? Five years and more than 200 projects into its agile journey, Dell Enterprise Solutions (ESG) has empirically determined that once a project extends beyond three scrum teams, interesting testing challenges arise—inconsistent “done” criteria, integration testing underscored by epic/story interdependencies across teams, test automation inconsistency, and uncoordinated regression testing. Worse yet, the more teams involved, the less likely it is that a single scrum team has the visibility to validate the overall product from a customer usage perspective as the product evolves through sprints. Geoff Meyer serves up some lessons learned from within the Dell ESG Validation organization as it evolved its agile testing and automation strategies from a waterfall-based environment to one that fully embraced agile Scrum across its entire software product portfolio.
This document is posted to help you gain knowledge. Please leave a comment to let me know what you think about it! Share it to your friends and learn new things together.
Transcript
W16
Agile Testing
5/7/2014 3:00:00 PM
Meet Big Agile: Testing on
Large-Scale Projects
Presented by:
Geoff Meyer
Dell, Inc.
Brought to you by:
340 Corporate Way, Suite 300, Orange Park, FL 32073
A test architect in the Dell Enterprise Solutions Group, Geoff Meyer has more than twenty-eight years of experience as a software developer, manager, business analyst and test architect. Geoff helps serve the software development practices of more than 800 development, test, and UX engineers across four Global Design Centers. Geoff is an active member in and contributor to the Agile Austin community.
• B.S. Computer Science, San Diego State University
• Masters Engineering Management - NTU
3
4
Agenda
• The Dell Context and
• Early Agile Testing Challenges
• In Search of… Solutions for Scale
• Adaptations for Testing at Scale
• Automating in an Agile world
• Lessons of Large
Agile @
4/26/2014
3
5
The Context at Dell ESG
http://amazngwallpapers.blogspot.com
Dell Enterprise Solutions GroupGlobal Design and Development using Agile Scrum
6
Noida Design
Center
Bangalore
Design Center
Austin
Design Center
Silicon Valley
Design Center
4/26/2014
4
Dell Enterprise SolutionsSoftware Products
• Server Systems Management
• Converged Infrastructure Systems Management
• Private Cloud Systems Management
• Console Plug-ins (i.e. for SCCM, vCenter…)
7
Common Product Characteristics:
• Embedded Software
• Large hardware support test matrix
• Software is installed in the Data Center
• Enterprise update cycles ~6 months
• Products must function even as underlying HW, FW,
BIOS, and Drivers are upgraded - SUSTAINING
Storage
Network
Compute
The Early Challenges
8
?
http://cleaneatingchelsey.com/
4/26/2014
5
Culture Transition
• Early commitment on Requirements
• Insufficient Detail in Requirements
• Development vs. Test
• A different “School” of Test1
• Fail Early, Inspect & Adapt
91 – Scott Barber “Approaches to Software Testing: An Introduction “
“ “Everybody, every team, every platform, every division, every component is there not for individual competitive profit or recognition, but for contribution to the system as a whole”
W. Edwards Deming
Signs of Trouble• Thursday’s Build
• Planning more stories into sprint than team’s velocity
• High % of carry-overs
• Inability to Automate Acceptance Tests within Sprint