1 Explore the Unknown Remigiusz Dudek Test Warez 2014 29 September 2014
Remigiusz dudek exploratorytests_testwarez2014
Jan 24, 2015
We’ve got used to thinking about Agile testing as mainly automated testing. This aspect is really important as it enables a short feedback loop and through this feedback loop it enables safe refactoring which is one of the core aspects of Agile development. Nevertheless we tend to forget about manual testing at all. This presentation will cover one of the pillars of Agile testing that is not possible to automate. I’d like to talk about exploratory tests. I will show how we can use exploratory tests to test non-functional areas of our product – like design or domain model.
Exploratory testing is difficult. It requires a great deal of knowledge and what is even more difficult a great deal of a gut feeling that develops in the guts of an experienced tester. During my talk I will present techniques that can be used to make exploratory testing efficient and not get lost in the meanders of the product. I will show concrete heuristics that can be used to find so called hidden variables that are crucial to identify in order to go beyond the obvious. I will tell how to recognize so called trusted zones of the software and how we can leverage the area outside of a trusted zone to put a pressure on the software we’re testing.
Furthermore I will explain how exploratory testing can be used to enhance the design of the software, how we as testers can play a crucial role in defining a business domain model that is used in our software, what we need to pay attention to in order not to loose these aspects out of sight.
I will also cover an aspect of a Confirmation bias – a psychological phenomenon that used to be our best adviser in the stone-age times but right now prevents us from being a good exploratory tester or even a good tester at all. In order to fight with it we need to recognized its existence.
Finally I will give few hints on how to organize the testing process in the Agile environment as a whole, so we actually have time to explore, so we do not waste the time on finding the obvious.
Exploratory testing is difficult. It requires a great deal of knowledge and what is even more difficult a great deal of a gut feeling that develops in the guts of an experienced tester. During my talk I will present techniques that can be used to make exploratory testing efficient and not get lost in the meanders of the product. I will show concrete heuristics that can be used to find so called hidden variables that are crucial to identify in order to go beyond the obvious. I will tell how to recognize so called trusted zones of the software and how we can leverage the area outside of a trusted zone to put a pressure on the software we’re testing.
Furthermore I will explain how exploratory testing can be used to enhance the design of the software, how we as testers can play a crucial role in defining a business domain model that is used in our software, what we need to pay attention to in order not to loose these aspects out of sight.
I will also cover an aspect of a Confirmation bias – a psychological phenomenon that used to be our best adviser in the stone-age times but right now prevents us from being a good exploratory tester or even a good tester at all. In order to fight with it we need to recognized its existence.
Finally I will give few hints on how to organize the testing process in the Agile environment as a whole, so we actually have time to explore, so we do not waste the time on finding the obvious.
Welcome message from author
This document is posted to help you gain knowledge. Please leave a comment to let me know what you think about it! Share it to your friends and learn new things together.
Transcript
1
Explore the Unknown
Remigiusz Dudek
Test Warez 2014
29 September 2014
2
§ Unit testing § AAT§ Exploratory tests§ Non-functional tests
14-10-4
Four Pillars of Agile Testing
3 14-10-4
Exploratory tests - Induction
4 14-10-4
§ Concept/Model
§ Code maintainability
§ Business border/corner cases
Purpose
§ You get the architectural knowledge of SUT
Side effect
§ Get lost in the meanders of the project
Pitfalls
Exploratory tests
5 14-10-4
§ Explore … what … [module, feature, circumstances]
§ With … tools … [certain testing techniques]
§ To discover … information
Define charters
Preparation
§ What are you affraid of?
§ What terrifies you?
§ What are your hidden fears?
Headlines game
6 14-10-4
§ Define trusted boundaries
§ Create models
Learn about eco-system
Recognizing exteriors
§ Start small
§ Involve others
§ Share what you have
§ Model has to be just about right („All models are wrong, some are useful”)
Useful hints
7 14-10-4
§ Obviousness
§ Temptation
§ Confirmation bias
§ Confirmation bias origin
On the course
8 14-10-4
Every card that has a vowel on one side has an even number on the other side.
Confirmation bias
A B 1 2
7 8 Y Z
1. Only vowels2. Only consonants3. Only even4. Only odd5. Vowels and even6. Vowels and odd7. Consonants and even8. Consonants and odd9. All
9 14-10-4
§ Obvious
§ Subtle
§ Hidden
Variable types
Recognizing interiors
§ Counting/Size
§ Relation/Interaction
§ Geographics
§ Depth
§ Time
How to look for hidden variables
10 14-10-4
When to stop
§ You ran out of time
§ No charters left
§ The information that you learn won't bring much value
11
§ UT / AAT
§ Exploration
§ „-ilities”
Four pillars
Fit exploration in the process
§ Frequency
§ Size
§ Frienship
Hints
12
Your QR Code
Drag picture to placeholder or click icon to add
Thank you
29 September 2014
Remigiusz Dudek
13
§ http://newtraderu.com/wp-content/uploads/2013/09/4-Pillars.jpg
§ http://wp.patheos.com.s3.amazonaws.com/blogs/daylightatheism/files/2013/07/SocialSafetyNet.jpg
§ https://encrypted-tbn1.gstatic.com/images?q=tbn:ANd9GcQwneLySGHaDZgF4g8egIgX_nsybKxqf12a5KG4ZIkUeF-2Mt3V9A
§ http://www.sunshinedaydream.biz/Moe--Dr-Stans-Prescription-Vol-2-2-CDs_p_3122.html
§ http://georgecouros.ca/blog/archives/4228
§ http://blog.northpointechurch.ca/what-if/
§ http://www.sunshinedaydream.biz/assets/images/cds/moe-dr-stans-prescription-volume-1-cd.jpg
§ http://www.tapeta-park-wiosna.na-telefon.org/tapety/park-wiosna.jpeg
§ http://www.alleywatch.com/2013/06/learn-the-laws-of-the-jungle-for-startups/
§ http://landarchs.com/wp-content/uploads/2012/10/antoni-gaudi-s-park-pubicly-opened-in-1922-barcelona-spain%2B1152_12915988526-tpfil02aw-22538.jpg
§ http://igabrys.w.interia.pl/gaudi_lizard.jpg
§ http://www.thecrewcoach.com/images/finding-the-right-fit-for-your-team.jpg
§ http://www.th.all.biz/img/th/catalog/36123.jpeg
§ http://us.123rf.com/400wm/400/400/Irochka/Irochka0812/Irochka081200206/4020698-close-up-view-of-gears-from-old-mechanism.jpg
§ http://www.buzzle.com/images/geography/landforms/meander.jpg
§14-10-4
Pictures references
Related Documents
