Top Banner
W16 Agile Testing 10/15/2014 3:00:00 PM Your Teams Not Agile If Youre Not Doing Agile Testing Presented by: Jeanne Schmidt Rural Sourcing, Inc. Brought to you by: 340 Corporate Way, Suite 300, Orange Park, FL 32073 888-268-8770 ∙ 904-278-0524 ∙ [email protected] www.sqe.com
41
Welcome message from author
This document is posted to help you gain knowledge. Please leave a comment to let me know what you think about it! Share it to your friends and learn new things together.
Transcript
Page 1: Your Team’s Not Agile If You’re Not Doing Agile Testing

W16

Agile Testing

10/15/2014 3:00:00 PM

Your Team’s Not Agile If You’re

Not Doing Agile Testing

Presented by:

Jeanne Schmidt

Rural Sourcing, Inc.

Brought to you by:

340 Corporate Way, Suite 300, Orange Park, FL 32073 888-268-8770 ∙ 904-278-0524 ∙ [email protected] ∙ www.sqe.com

Page 2: Your Team’s Not Agile If You’re Not Doing Agile Testing

Jeanne Schmidt

Rural Sourcing, Inc. With more than thirty years of experience working with software development, Jeanne Schmidt has held roles of tester, QA manager, business systems analyst, product manager, and technical trainer. For many years, Jeanne managed the PeopleTools QA team for PeopleSoft. Currently the QA tech lead for the Quality Assurance Practice at Rural Sourcing, Inc., Jeanne leads a team of software testers who help customers deliver quality software and advises customers on test strategies. Rural Sourcing, Inc., is the leader in domestic sourcing and a cost-effective, onshore alternative to the traditional model for IT outsourcing.

Page 3: Your Team’s Not Agile If You’re Not Doing Agile Testing

Click to edit Master title style

10/1/2014 1 Changing the IT Outsourcing Experience

Your Team’s Not Agile If You’re Not Doing Agile Testing

Page 4: Your Team’s Not Agile If You’re Not Doing Agile Testing

Rural Sourcing Inc. Confidential & Proprietary. Reproduction by any method or unauthorized circulation is prohibited without prior approval. Copyright ©. All rights reserved.

Jeanne Reynolds Schmidt QA Tech Lead, Rural Sourcing Inc.

Augusta, GA

QA Experience:

• Rural Sourcing, Inc. • PeopleSoft,

PeopleTools Development

Other Roles:

• Business Analyst • Product Manager • Technical Writer • Technical Trainer • Account

Manager

Industries Served:

• Pharmaceutical • Nonprofit • Higher Education • Software

Development • Financial Services • Consumer Packaged

Goods

Introduction

10/1/2014 2

Page 5: Your Team’s Not Agile If You’re Not Doing Agile Testing

Rural Sourcing Inc. Confidential & Proprietary. Reproduction by any method or unauthorized circulation is prohibited without prior approval. Copyright ©. All rights reserved.

About

Differentiators Impact

Domestic Outsourcing pioneer in the areas of:

• Application Management • Custom Application Development • Testing • Business Intelligence

Three US-Based Development Centers:

• Augusta, Georgia • Jonesboro, Arkansas • Mobile, Alabama

Serving clients in various Industries:

• CPG • Health Care • Hi-Tech • Life Sciences

Alternative Onshore source for cost-effective IT services

We improve the experience through:

• Ease of communications • Ease of collaboration • Time zone compatibility • Responsiveness • Reduced risk

• Changing the IT Outsourcing Experience

• Helping IT Leaders think domestically

• Creating Jobs

Who We Are

10/1/2014 3

Page 6: Your Team’s Not Agile If You’re Not Doing Agile Testing

Rural Sourcing Inc. Confidential & Proprietary. Reproduction by any method or unauthorized circulation is prohibited without prior approval. Copyright ©. All rights reserved.

• Java

• .NET

• Industry

specific

home-grown

applications

• Web

development

• Mobile

• Cloud-Based

Applications

• Level 1, 2 & 3

Support

• Database & OS

Support

• Functional

support

• Enterprise and

home-grown

applications

• SAP

• Oracle

• CAS

• LIMS

• Web Services/

Interfaces

• Quality

Systems

RSI Practice Areas

Application

Support

Enterprise

Applications

Custom

Development

Business

Intelligence

Quality

Assurance

• Business

Intelligence

• Data

Warehousing

• Reporting and

Analytics

• Dashboards

• ETL

• Functional

Testing

• Mobile Testing

• Test

Automation

• FDA Validation

• Agile,

Exploratory,

Content-driven

Testing

• Test Strategy

Project Management

Business Analysis

Testing, Validation and Quality Assurance Services

10/1/2014 4

Page 7: Your Team’s Not Agile If You’re Not Doing Agile Testing

Rural Sourcing Inc. Confidential & Proprietary. Reproduction by any method or unauthorized circulation is prohibited without prior approval. Copyright ©. All rights reserved.

Sample Clients

10/1/2014 5

Page 8: Your Team’s Not Agile If You’re Not Doing Agile Testing

Rural Sourcing Inc. Confidential & Proprietary. Reproduction by any method or unauthorized circulation is prohibited without prior approval. Copyright ©. All rights reserved.

The Challenge

10/1/2014 6

What we often hear:

“We aspire to be

agile.”

Page 9: Your Team’s Not Agile If You’re Not Doing Agile Testing

Rural Sourcing Inc. Confidential & Proprietary. Reproduction by any method or unauthorized circulation is prohibited without prior approval. Copyright ©. All rights reserved.

A Tale of Two Projects

10/1/2014 7

It was the best of

times, it was the

worst of times.

Page 10: Your Team’s Not Agile If You’re Not Doing Agile Testing

Rural Sourcing Inc. Confidential & Proprietary. Reproduction by any method or unauthorized circulation is prohibited without prior approval. Copyright ©. All rights reserved.

The Challenge

10/1/2014 8

Page 11: Your Team’s Not Agile If You’re Not Doing Agile Testing

Rural Sourcing Inc. Confidential & Proprietary. Reproduction by any method or unauthorized circulation is prohibited without prior approval. Copyright ©. All rights reserved.

What they mean is:

10/1/2014 9

Our release cycles are called sprints. We have a project manager called a scrum master. Our status meetings are called standups. We have testers who test code when we are done coding.

Page 12: Your Team’s Not Agile If You’re Not Doing Agile Testing

Rural Sourcing Inc. Confidential & Proprietary. Reproduction by any method or unauthorized circulation is prohibited without prior approval. Copyright ©. All rights reserved.

Throwing code over the wall

10/1/2014 10

Page 13: Your Team’s Not Agile If You’re Not Doing Agile Testing

Rural Sourcing Inc. Confidential & Proprietary. Reproduction by any method or unauthorized circulation is prohibited without prior approval. Copyright ©. All rights reserved.

The result is:

10/1/2014 11

Mini-waterfall release cycles. Testing seen as a separate team, phase, body of work. Work is not “done” at end of sprint.

Page 14: Your Team’s Not Agile If You’re Not Doing Agile Testing

Rural Sourcing Inc. Confidential & Proprietary. Reproduction by any method or unauthorized circulation is prohibited without prior approval. Copyright ©. All rights reserved.

QA Can Lead You to Agile

10/1/2014 12

Your Team’s Not Agile

If You’re Not Doing

Agile Testing

Page 15: Your Team’s Not Agile If You’re Not Doing Agile Testing

Rural Sourcing Inc. Confidential & Proprietary. Reproduction by any method or unauthorized circulation is prohibited without prior approval. Copyright ©. All rights reserved.

What do I mean by Agile?

Manifesto for Agile Development

Individuals and interactions over processes

and tools

Working software over comprehensive

documentation

Customer collaboration over contract

negotiation

Responding to change over following a plan

Page 16: Your Team’s Not Agile If You’re Not Doing Agile Testing

Rural Sourcing Inc. Confidential & Proprietary. Reproduction by any method or unauthorized circulation is prohibited without prior approval. Copyright ©. All rights reserved.

What do I mean by agile testing?

• Entire team responsible for quality

• Testing drives development

• Testers involved early and always

• Working software over comprehensive

documentation

• Early automation

• Responding to change over following a plan

• Exploratory testing vs. “checking”

• Roles merge

Page 17: Your Team’s Not Agile If You’re Not Doing Agile Testing

Rural Sourcing Inc. Confidential & Proprietary. Reproduction by any method or unauthorized circulation is prohibited without prior approval. Copyright ©. All rights reserved.

QA Can Lead the Way

Page 18: Your Team’s Not Agile If You’re Not Doing Agile Testing

Rural Sourcing Inc. Confidential & Proprietary. Reproduction by any method or unauthorized circulation is prohibited without prior approval. Copyright ©. All rights reserved.

How Agile Testing Can Help

Get to

“done”

Bridge the Gap

Prevent Bugs

Clarify Requirements

Page 19: Your Team’s Not Agile If You’re Not Doing Agile Testing

• Sprint Zero

• Choose Tools

• Determine Standards, Styles,

• Define Build Processes

• Integrations

• Regressions

• Communications Expectations

Page 20: Your Team’s Not Agile If You’re Not Doing Agile Testing

• Talk About QA Estimates

• Test Data

• Test Environments

• Define Positive & Negative Acceptance Criteria

• What is your definition of done?

Page 21: Your Team’s Not Agile If You’re Not Doing Agile Testing

Rural Sourcing Inc. Confidential & Proprietary. Reproduction by any method or unauthorized circulation is prohibited without prior approval. Copyright ©. All rights reserved.

What is your Definition?

10/1/2014 19

Page 22: Your Team’s Not Agile If You’re Not Doing Agile Testing

Rural Sourcing Inc. Confidential & Proprietary. Reproduction by any method or unauthorized circulation is prohibited without prior approval. Copyright ©. All rights reserved.

During Each Sprint

10/1/2014 20

• Running Tested Features

• Test Data

• Test Alongside Developers

• Test Positive & Negative Acceptance Criteria

• Build Regression Tests

• Constant Communication

Page 23: Your Team’s Not Agile If You’re Not Doing Agile Testing

Rural Sourcing Inc. Confidential & Proprietary. Reproduction by any method or unauthorized circulation is prohibited without prior approval. Copyright ©. All rights reserved.

Test Driven Development

10/1/2014 21

BDD TDD

ATDD

Page 24: Your Team’s Not Agile If You’re Not Doing Agile Testing

Rural Sourcing Inc. Confidential & Proprietary. Reproduction by any method or unauthorized circulation is prohibited without prior approval. Copyright ©. All rights reserved.

Test Driven Development

10/1/2014 22

Given

When

Then

Cucumber cukes.info

Page 25: Your Team’s Not Agile If You’re Not Doing Agile Testing

Rural Sourcing Inc. Confidential & Proprietary. Reproduction by any method or unauthorized circulation is prohibited without prior approval. Copyright ©. All rights reserved.

Entire team responsible for quality

Page 26: Your Team’s Not Agile If You’re Not Doing Agile Testing

Rural Sourcing Inc. Confidential & Proprietary. Reproduction by any method or unauthorized circulation is prohibited without prior approval. Copyright ©. All rights reserved.

Exploratory Testing

Learning

Test Design Test Execution

Page 27: Your Team’s Not Agile If You’re Not Doing Agile Testing

Rural Sourcing Inc. Confidential & Proprietary. Reproduction by any method or unauthorized circulation is prohibited without prior approval. Copyright ©. All rights reserved.

10/1/2014 25

Test Data Requirements

Testability Test Cases

Usability Environments

Early Automation Question

Risks Integrations

Limits Acceptance Tests

What Does an Agile Tester Do?

Page 28: Your Team’s Not Agile If You’re Not Doing Agile Testing

Rural Sourcing Inc. Confidential & Proprietary. Reproduction by any method or unauthorized circulation is prohibited without prior approval. Copyright ©. All rights reserved.

What Tools Will You Use?

Page 29: Your Team’s Not Agile If You’re Not Doing Agile Testing

Rural Sourcing Inc. Confidential & Proprietary. Reproduction by any method or unauthorized circulation is prohibited without prior approval. Copyright ©. All rights reserved.

What Tools Will You Use?

• Avoid excel

• Team visibility

• Dashboards

• Don’t substitute tools for communication

Page 30: Your Team’s Not Agile If You’re Not Doing Agile Testing

Rural Sourcing Inc. Confidential & Proprietary. Reproduction by any method or unauthorized circulation is prohibited without prior approval. Copyright ©. All rights reserved.

Reporting Test Results

Working software over comprehensive

documentation

Page 31: Your Team’s Not Agile If You’re Not Doing Agile Testing

Rural Sourcing Inc. Confidential & Proprietary. Reproduction by any method or unauthorized circulation is prohibited without prior approval. Copyright ©. All rights reserved.

Reporting Test Results

http://blogs.atlassian.com/2013/11/7-steps-to-a-beautiful-and-useful-agile-dashboard/

Page 32: Your Team’s Not Agile If You’re Not Doing Agile Testing

Rural Sourcing Inc. Confidential & Proprietary. Reproduction by any method or unauthorized circulation is prohibited without prior approval. Copyright ©. All rights reserved.

Reporting Test Results

• Where will you track bugs?

• Will you track all bugs?

• How do you log all testing?

• Do you log all testing?

Page 33: Your Team’s Not Agile If You’re Not Doing Agile Testing

Rural Sourcing Inc. Confidential & Proprietary. Reproduction by any method or unauthorized circulation is prohibited without prior approval. Copyright ©. All rights reserved.

Developers QA Client Consultant

Scrum Master

Team Communication

Page 34: Your Team’s Not Agile If You’re Not Doing Agile Testing

Rural Sourcing Inc. Confidential & Proprietary. Reproduction by any method or unauthorized circulation is prohibited without prior approval. Copyright ©. All rights reserved.

Team Communication

Page 35: Your Team’s Not Agile If You’re Not Doing Agile Testing

• QA Runs Demo

• Practice Demo Day Before

• Retrospectives

• Were Estimates realistic

• Were you done?

• What will you do if you were not done

Page 36: Your Team’s Not Agile If You’re Not Doing Agile Testing

Rural Sourcing Inc. Confidential & Proprietary. Reproduction by any method or unauthorized circulation is prohibited without prior approval. Copyright ©. All rights reserved.

Which Metrics

Customer Satisfaction Velocity

Issues Found in Field Test Cases

# of Features Delivered Value Delivered

Running Tested Features Earned Value Management

Page 37: Your Team’s Not Agile If You’re Not Doing Agile Testing

Rural Sourcing Inc. Confidential & Proprietary. Reproduction by any method or unauthorized circulation is prohibited without prior approval. Copyright ©. All rights reserved.

Old Metrics

Earned Value Management

• Number of test cases

• Number of bugs

• Number of bugs fixed

Page 38: Your Team’s Not Agile If You’re Not Doing Agile Testing

Rural Sourcing Inc. Confidential & Proprietary. Reproduction by any method or unauthorized circulation is prohibited without prior approval. Copyright ©. All rights reserved.

How do you start?

Define Done

Training

Tools

Processes

Page 39: Your Team’s Not Agile If You’re Not Doing Agile Testing

Rural Sourcing Inc. Confidential & Proprietary. Reproduction by any method or unauthorized circulation is prohibited without prior approval. Copyright ©. All rights reserved.

Agile Testing Can Get You to Done

If your code has not fully met

requirements, has not been unit tested,

regression tested by the end of the

sprint,

you are not done!

Page 40: Your Team’s Not Agile If You’re Not Doing Agile Testing

Rural Sourcing Inc. Confidential & Proprietary. Reproduction by any method or unauthorized circulation is prohibited without prior approval. Copyright ©. All rights reserved.

References

Crispin, Lisa, & Gregory, Janet (2009). Agile Testing. Addison-Wesley Professional. Hendrickson, Elisabeth (2013). Explore It! Reduce Risk and Increase Confidence with Exploratory Testing. The Pragmatic Programmers, LLC. Hanselman, S., & Schwaber, K. (2008, May 6). What is Done? - A Conversation with Scrum Co-Creator Ken Schwaber The Hanselminutes Podcast. Podcast retrieved from http://www.hanselminutes.com/119/what-is-done-a-conversation-with-scrum-co-creator-ken-schwaber

Page 41: Your Team’s Not Agile If You’re Not Doing Agile Testing

Click to edit Master title style

10/1/2014 39 Changing the IT Outsourcing Experience

Thank You

[email protected] www.linkedin.com/in/jeanneschmidt @Jeanne_Schmidt