W10 Agile Testing 5/1/2013 1:45:00 PM Exploratory Testing on Agile Projects: Combining SBTM and TBTM Presented by: Christin Wiedemann Professional Quality Assurance, Ltd. Brought to you by: 340 Corporate Way, Suite 300, Orange Park, FL 32073 888-268-8770 ∙ 904-278-0524 ∙ [email protected] ∙ www.sqe.com
Exploratory Testing on Agile Projects: Combining SBTM and TBTM
Jun 22, 2015
Exploratory testing provides both flexibility and speed—characteristics that are vitally important with the quick pace of short agile iterations. With session-based test management (SBTM), exploratory testing is structured and documented in pre-defined sessions. A newer approach, thread-based test management (TBTM), organizes test efforts by threads of activities rather than sessions. So, how do you retain the traceability of SBTM without losing the creativity offered by TBTM? The answer is xBTM—a combination of SBTM and TBTM. After introducing SBTM and TBTM, Christin shows how she uses xBTM on projects to obtain maximum efficiency—only creating test documentation that actually adds value. Using a mock example, Christin describes the xBTM workflow on an agile project, covering all the steps from test planning and performing the tests through reporting. Her focus is on sharing practical examples and providing a range of flexible tools that you can immediately apply on almost any project.
Welcome message from author
This document is posted to help you gain knowledge. Please leave a comment to let me know what you think about it! Share it to your friends and learn new things together.
Transcript
W10 Agile Testing
5/1/2013 1:45:00 PM
Exploratory Testing on Agile Projects:
Combining SBTM and TBTM
Presented by:
Christin Wiedemann
Professional Quality Assurance, Ltd.
Brought to you by:
340 Corporate Way, Suite 300, Orange Park, FL 32073
888-268-8770 ∙ 904-278-0524 ∙ [email protected] ∙ www.sqe.com
Christin Wiedemann
After eleven years as an astroparticle physicist, Christin Wiedemann brings her logical and analytical problem-solving skills to the world of testing. Five years into her new career, Christin is still eager to learn, looking for new ways to test more efficiently, constantly trying new approaches, and keen to share her experiences. In her roles as tester, test lead, trainer, and speaker, she uses her scientific background and pedagogic abilities to continually develop her own skills and those of others. Co-creator of the exploratory testing approach xBTM, Christin lives in Vancouver, where she has joined Professional Quality Assurance Ltd. Follow Christin on Twitter @c_wiedemann or visit her blog christintesting.wordpress.com.
4/16/2013
©2011 Professional Quality Assurance (PQA) Ltd. -- http://www.pqa.ca 1
test smarter...
STAREAST, Orlando, FL, May 1st, 2013
Exploratory Testing on Agile Projects:
Combining SBTM and TBTM
Christin Wiedemann, PQA Ltd.
2
Outline
� Why test?
� Agile testing
� Exploratory testing
� SBTM, TBTM, xBTM
� What’s in it for me?
©2012 Professional Quality Assurance Ltd. (PQA) -- http://www.pqatesting.com
4/16/2013
©2011 Professional Quality Assurance (PQA) Ltd. -- http://www.pqa.ca 2
3
Why Do We Test?
©2012 Professional Quality Assurance Ltd. (PQA) -- http://www.pqatesting.com
4
The Objective of Testing
©2012 Professional Quality Assurance Ltd. (PQA) -- http://www.pqatesting.com
4/16/2013
©2011 Professional Quality Assurance (PQA) Ltd. -- http://www.pqa.ca 3
5
Testing on Agile Projects
http://gardenofeaden.blogspot.ca
©2012 Professional Quality Assurance Ltd. (PQA) -- http://www.pqatesting.com
6
Exploratory Testing
Explorer Kazimierz Nowak
©2012 Professional Quality Assurance Ltd. (PQA) -- http://www.pqatesting.com
4/16/2013
©2011 Professional Quality Assurance (PQA) Ltd. -- http://www.pqa.ca 4
Pair-Testing
7©2012 Professional Quality Assurance Ltd. (PQA) -- http://www.pqatesting.com
8
Testing Spectrum
Manual ScriptedFreestyle
ExploratorySBTM TBTM
Exploratory Testing
xBTM
Figure adapted from original by Jon Bach
©2012 Professional Quality Assurance Ltd. (PQA) -- http://www.pqatesting.com
4/16/2013
©2011 Professional Quality Assurance (PQA) Ltd. -- http://www.pqa.ca 5
9
Session-Based Test Management
©2012 Professional Quality Assurance Ltd. (PQA) -- http://www.pqatesting.com
10
Session-Based Test Management
� Test Charter
‣ Risk
‣ Coverage
‣ Time frame
Test Charter
Credit: Michael D. Kelly
©2012 Professional Quality Assurance Ltd. (PQA) -- http://www.pqatesting.com
4/16/2013
©2011 Professional Quality Assurance (PQA) Ltd. -- http://www.pqa.ca 6
11
Session-Based Test Management
� Session Report
‣ When?
‣ Who?
‣ What?
‣ How?
‣ Bugs?
Time break-down
Design
Execu on
Repor ng
Other
©2012 Professional Quality Assurance Ltd. (PQA) -- http://www.pqatesting.com
12
Session-Based Test Management
0
2
4
6
8
10
12
14
16
User Account Shopping Cart Payment
Test Charters
©2012 Professional Quality Assurance Ltd. (PQA) -- http://www.pqatesting.com
4/16/2013
©2011 Professional Quality Assurance (PQA) Ltd. -- http://www.pqa.ca 7
13
Session-Based Test Management
� Debriefing
‣ P – Past
‣ R – Result
‣ O – Obstacles
‣ O – Outlook
‣ F – Feelings
©2012 Professional Quality Assurance Ltd. (PQA) -- http://www.pqatesting.com
14
Thread-Based Test Management
©2012 Professional Quality Assurance Ltd. (PQA) -- http://www.pqatesting.com
4/16/2013
©2011 Professional Quality Assurance (PQA) Ltd. -- http://www.pqa.ca 8
Threads – Example
15©2012 Professional Quality Assurance Ltd. (PQA) -- http://www.pqatesting.com
Threads – Example
16©2012 Professional Quality Assurance Ltd. (PQA) -- http://www.pqatesting.com
4/16/2013
©2011 Professional Quality Assurance (PQA) Ltd. -- http://www.pqa.ca 9
17
Thread-Based Test Management
� The essence of TBTM:
‣ Activities change over time
‣ “For me ‘test’ is a verb. Testing is something that I do, not so much
something that I create.”*
‣ Focus on “doing” and not “getting done”
* James Bach, http://www.satisfice.com/blog/archives/503
©2012 Professional Quality Assurance Ltd. (PQA) -- http://www.pqatesting.com
18
Thread-Based Test Management
� How do you do it?
Function area
Test technique
Thread
©2012 Professional Quality Assurance Ltd. (PQA) -- http://www.pqatesting.com
4/16/2013
©2011 Professional Quality Assurance (PQA) Ltd. -- http://www.pqa.ca 10
19
xBTM
©2012 Professional Quality Assurance Ltd. (PQA) -- http://www.pqatesting.com
20
xBTM – Demo
©2012 Professional Quality Assurance Ltd. (PQA) -- http://www.pqatesting.com
4/16/2013
©2011 Professional Quality Assurance (PQA) Ltd. -- http://www.pqa.ca 11
21
xBTM – Demo
©2012 Professional Quality Assurance Ltd. (PQA) -- http://www.pqatesting.com
22
xBTM – Demo
©2012 Professional Quality Assurance Ltd. (PQA) -- http://www.pqatesting.com
4/16/2013
©2011 Professional Quality Assurance (PQA) Ltd. -- http://www.pqa.ca 12
23
xBTM – Demo
©2012 Professional Quality Assurance Ltd. (PQA) -- http://www.pqatesting.com
24
xBTM – Demo
©2012 Professional Quality Assurance Ltd. (PQA) -- http://www.pqatesting.com
4/16/2013
©2011 Professional Quality Assurance (PQA) Ltd. -- http://www.pqa.ca 13
Traditional Workflow
25
Planning Design Execution Reporting
� Waterfall
‣ Consecutive phases
� Agile
‣ All phases repeated in every iteration
©2012 Professional Quality Assurance Ltd. (PQA) -- http://www.pqatesting.com
xBTM Workflow
26
� Planning
‣ Threads in mind map
‣ Function areas and/or test techniques
‣ Group threads into sessions (optional)
‣ Estimate number of charters needed (optional)
Planning Design Execution Reporting
©2012 Professional Quality Assurance Ltd. (PQA) -- http://www.pqatesting.com
4/16/2013
©2011 Professional Quality Assurance (PQA) Ltd. -- http://www.pqa.ca 14
xBTM Workflow
27
� Design, Execution, Reporting
‣ Update mind map
‣ Session reports (optional)
‣ Update test charters (optional)
‣ Add threads
‣ Create additional test charters (optional)
Planning Design Execution Reporting
©2012 Professional Quality Assurance Ltd. (PQA) -- http://www.pqatesting.com
Summary and Conclusion
‣ Exploratory testing can be very structured
‣ Exploratory testing can be thoroughly documented
‣ Mind maps are great for visualization and collaboration
‣ Use SBTM when possible
‣ Use TBTM when environment is too hectic
‣ Adapt the method to your needs
28©2012 Professional Quality Assurance Ltd. (PQA) -- http://www.pqatesting.com
4/16/2013
©2011 Professional Quality Assurance (PQA) Ltd. -- http://www.pqa.ca 15
Links – Mind Mapping
29
� XMind: Powerful tool with a lot of nice features, used in examples
‣ http://www.xmind.net
� mindmeister: Collaborative tool.
‣ http://www.mindmeister.com
� FreeMind: The simpler of the mind mapping tools, but still very useful.
‣ http://freemind.sourceforge.net/wiki/index.php/Main_Page
©2012 Professional Quality Assurance Ltd. (PQA) -- http://www.pqatesting.com
Links – SBTM Tools
30
� Rapid Reporter: A note taking tool for exploratory testing sessions.
‣ http://testing.gershon.info/reporter/
� Session Tester: A tool for recording and managing exploratory testing
session.
‣ http://sessiontester.openqa.org
� SBTExecute: A tool that produces summary reports and calculates
metrics from an Excel session report template.
‣ http://www.addq.se/utforskande-testmetodik-xbtm/ (scroll down to
bottom of page for English)
©2012 Professional Quality Assurance Ltd. (PQA) -- http://www.pqatesting.com
Related Documents
