Exploratory Testing on Agile Projects: Combining SBTM and TBTM
-
Upload
techwellpresentations -
Category
Technology
-
view
388 -
download
0
description
Transcript of Exploratory Testing on Agile Projects: Combining SBTM and TBTM
![Page 1: Exploratory Testing on Agile Projects: Combining SBTM and TBTM](https://reader034.fdocuments.net/reader034/viewer/2022050808/558770a8d8b42aec3e8b467b/html5/thumbnails/1.jpg)
W10 Agile Testing
5/1/2013 1:45:00 PM
Exploratory Testing on Agile Projects:
Combining SBTM and TBTM
Presented by:
Christin Wiedemann
Professional Quality Assurance, Ltd.
Brought to you by:
340 Corporate Way, Suite 300, Orange Park, FL 32073
888-268-8770 ∙ 904-278-0524 ∙ [email protected] ∙ www.sqe.com
![Page 2: Exploratory Testing on Agile Projects: Combining SBTM and TBTM](https://reader034.fdocuments.net/reader034/viewer/2022050808/558770a8d8b42aec3e8b467b/html5/thumbnails/2.jpg)
Christin Wiedemann
After eleven years as an astroparticle physicist, Christin Wiedemann brings her logical and analytical problem-solving skills to the world of testing. Five years into her new career, Christin is still eager to learn, looking for new ways to test more efficiently, constantly trying new approaches, and keen to share her experiences. In her roles as tester, test lead, trainer, and speaker, she uses her scientific background and pedagogic abilities to continually develop her own skills and those of others. Co-creator of the exploratory testing approach xBTM, Christin lives in Vancouver, where she has joined Professional Quality Assurance Ltd. Follow Christin on Twitter @c_wiedemann or visit her blog christintesting.wordpress.com.
![Page 3: Exploratory Testing on Agile Projects: Combining SBTM and TBTM](https://reader034.fdocuments.net/reader034/viewer/2022050808/558770a8d8b42aec3e8b467b/html5/thumbnails/3.jpg)
4/16/2013
©2011 Professional Quality Assurance (PQA) Ltd. -- http://www.pqa.ca 1
test smarter...
STAREAST, Orlando, FL, May 1st, 2013
Exploratory Testing on Agile Projects:
Combining SBTM and TBTM
Christin Wiedemann, PQA Ltd.
2
Outline
� Why test?
� Agile testing
� Exploratory testing
� SBTM, TBTM, xBTM
� What’s in it for me?
©2012 Professional Quality Assurance Ltd. (PQA) -- http://www.pqatesting.com
![Page 4: Exploratory Testing on Agile Projects: Combining SBTM and TBTM](https://reader034.fdocuments.net/reader034/viewer/2022050808/558770a8d8b42aec3e8b467b/html5/thumbnails/4.jpg)
4/16/2013
©2011 Professional Quality Assurance (PQA) Ltd. -- http://www.pqa.ca 2
3
Why Do We Test?
©2012 Professional Quality Assurance Ltd. (PQA) -- http://www.pqatesting.com
4
The Objective of Testing
©2012 Professional Quality Assurance Ltd. (PQA) -- http://www.pqatesting.com
![Page 5: Exploratory Testing on Agile Projects: Combining SBTM and TBTM](https://reader034.fdocuments.net/reader034/viewer/2022050808/558770a8d8b42aec3e8b467b/html5/thumbnails/5.jpg)
4/16/2013
©2011 Professional Quality Assurance (PQA) Ltd. -- http://www.pqa.ca 3
5
Testing on Agile Projects
http://gardenofeaden.blogspot.ca
©2012 Professional Quality Assurance Ltd. (PQA) -- http://www.pqatesting.com
6
Exploratory Testing
Explorer Kazimierz Nowak
©2012 Professional Quality Assurance Ltd. (PQA) -- http://www.pqatesting.com
![Page 6: Exploratory Testing on Agile Projects: Combining SBTM and TBTM](https://reader034.fdocuments.net/reader034/viewer/2022050808/558770a8d8b42aec3e8b467b/html5/thumbnails/6.jpg)
4/16/2013
©2011 Professional Quality Assurance (PQA) Ltd. -- http://www.pqa.ca 4
Pair-Testing
7©2012 Professional Quality Assurance Ltd. (PQA) -- http://www.pqatesting.com
8
Testing Spectrum
Manual ScriptedFreestyle
ExploratorySBTM TBTM
Exploratory Testing
xBTM
Figure adapted from original by Jon Bach
©2012 Professional Quality Assurance Ltd. (PQA) -- http://www.pqatesting.com
![Page 7: Exploratory Testing on Agile Projects: Combining SBTM and TBTM](https://reader034.fdocuments.net/reader034/viewer/2022050808/558770a8d8b42aec3e8b467b/html5/thumbnails/7.jpg)
4/16/2013
©2011 Professional Quality Assurance (PQA) Ltd. -- http://www.pqa.ca 5
9
Session-Based Test Management
©2012 Professional Quality Assurance Ltd. (PQA) -- http://www.pqatesting.com
10
Session-Based Test Management
� Test Charter
‣ Risk
‣ Coverage
‣ Time frame
Test Charter
Credit: Michael D. Kelly
©2012 Professional Quality Assurance Ltd. (PQA) -- http://www.pqatesting.com
![Page 8: Exploratory Testing on Agile Projects: Combining SBTM and TBTM](https://reader034.fdocuments.net/reader034/viewer/2022050808/558770a8d8b42aec3e8b467b/html5/thumbnails/8.jpg)
4/16/2013
©2011 Professional Quality Assurance (PQA) Ltd. -- http://www.pqa.ca 6
11
Session-Based Test Management
� Session Report
‣ When?
‣ Who?
‣ What?
‣ How?
‣ Bugs?
Time break-down
Design
Execu on
Repor ng
Other
©2012 Professional Quality Assurance Ltd. (PQA) -- http://www.pqatesting.com
12
Session-Based Test Management
0
2
4
6
8
10
12
14
16
User Account Shopping Cart Payment
Test Charters
©2012 Professional Quality Assurance Ltd. (PQA) -- http://www.pqatesting.com
![Page 9: Exploratory Testing on Agile Projects: Combining SBTM and TBTM](https://reader034.fdocuments.net/reader034/viewer/2022050808/558770a8d8b42aec3e8b467b/html5/thumbnails/9.jpg)
4/16/2013
©2011 Professional Quality Assurance (PQA) Ltd. -- http://www.pqa.ca 7
13
Session-Based Test Management
� Debriefing
‣ P – Past
‣ R – Result
‣ O – Obstacles
‣ O – Outlook
‣ F – Feelings
©2012 Professional Quality Assurance Ltd. (PQA) -- http://www.pqatesting.com
14
Thread-Based Test Management
©2012 Professional Quality Assurance Ltd. (PQA) -- http://www.pqatesting.com
![Page 10: Exploratory Testing on Agile Projects: Combining SBTM and TBTM](https://reader034.fdocuments.net/reader034/viewer/2022050808/558770a8d8b42aec3e8b467b/html5/thumbnails/10.jpg)
4/16/2013
©2011 Professional Quality Assurance (PQA) Ltd. -- http://www.pqa.ca 8
Threads – Example
15©2012 Professional Quality Assurance Ltd. (PQA) -- http://www.pqatesting.com
Threads – Example
16©2012 Professional Quality Assurance Ltd. (PQA) -- http://www.pqatesting.com
![Page 11: Exploratory Testing on Agile Projects: Combining SBTM and TBTM](https://reader034.fdocuments.net/reader034/viewer/2022050808/558770a8d8b42aec3e8b467b/html5/thumbnails/11.jpg)
4/16/2013
©2011 Professional Quality Assurance (PQA) Ltd. -- http://www.pqa.ca 9
17
Thread-Based Test Management
� The essence of TBTM:
‣ Activities change over time
‣ “For me ‘test’ is a verb. Testing is something that I do, not so much
something that I create.”*
‣ Focus on “doing” and not “getting done”
* James Bach, http://www.satisfice.com/blog/archives/503
©2012 Professional Quality Assurance Ltd. (PQA) -- http://www.pqatesting.com
18
Thread-Based Test Management
� How do you do it?
Function area
Test technique
Thread
©2012 Professional Quality Assurance Ltd. (PQA) -- http://www.pqatesting.com
![Page 12: Exploratory Testing on Agile Projects: Combining SBTM and TBTM](https://reader034.fdocuments.net/reader034/viewer/2022050808/558770a8d8b42aec3e8b467b/html5/thumbnails/12.jpg)
4/16/2013
©2011 Professional Quality Assurance (PQA) Ltd. -- http://www.pqa.ca 10
19
xBTM
©2012 Professional Quality Assurance Ltd. (PQA) -- http://www.pqatesting.com
20
xBTM – Demo
©2012 Professional Quality Assurance Ltd. (PQA) -- http://www.pqatesting.com
![Page 13: Exploratory Testing on Agile Projects: Combining SBTM and TBTM](https://reader034.fdocuments.net/reader034/viewer/2022050808/558770a8d8b42aec3e8b467b/html5/thumbnails/13.jpg)
4/16/2013
©2011 Professional Quality Assurance (PQA) Ltd. -- http://www.pqa.ca 11
21
xBTM – Demo
©2012 Professional Quality Assurance Ltd. (PQA) -- http://www.pqatesting.com
22
xBTM – Demo
©2012 Professional Quality Assurance Ltd. (PQA) -- http://www.pqatesting.com
![Page 14: Exploratory Testing on Agile Projects: Combining SBTM and TBTM](https://reader034.fdocuments.net/reader034/viewer/2022050808/558770a8d8b42aec3e8b467b/html5/thumbnails/14.jpg)
4/16/2013
©2011 Professional Quality Assurance (PQA) Ltd. -- http://www.pqa.ca 12
23
xBTM – Demo
©2012 Professional Quality Assurance Ltd. (PQA) -- http://www.pqatesting.com
24
xBTM – Demo
©2012 Professional Quality Assurance Ltd. (PQA) -- http://www.pqatesting.com
![Page 15: Exploratory Testing on Agile Projects: Combining SBTM and TBTM](https://reader034.fdocuments.net/reader034/viewer/2022050808/558770a8d8b42aec3e8b467b/html5/thumbnails/15.jpg)
4/16/2013
©2011 Professional Quality Assurance (PQA) Ltd. -- http://www.pqa.ca 13
Traditional Workflow
25
Planning Design Execution Reporting
� Waterfall
‣ Consecutive phases
� Agile
‣ All phases repeated in every iteration
©2012 Professional Quality Assurance Ltd. (PQA) -- http://www.pqatesting.com
xBTM Workflow
26
� Planning
‣ Threads in mind map
‣ Function areas and/or test techniques
‣ Group threads into sessions (optional)
‣ Estimate number of charters needed (optional)
Planning Design Execution Reporting
©2012 Professional Quality Assurance Ltd. (PQA) -- http://www.pqatesting.com
![Page 16: Exploratory Testing on Agile Projects: Combining SBTM and TBTM](https://reader034.fdocuments.net/reader034/viewer/2022050808/558770a8d8b42aec3e8b467b/html5/thumbnails/16.jpg)
4/16/2013
©2011 Professional Quality Assurance (PQA) Ltd. -- http://www.pqa.ca 14
xBTM Workflow
27
� Design, Execution, Reporting
‣ Update mind map
‣ Session reports (optional)
‣ Update test charters (optional)
‣ Add threads
‣ Create additional test charters (optional)
Planning Design Execution Reporting
©2012 Professional Quality Assurance Ltd. (PQA) -- http://www.pqatesting.com
Summary and Conclusion
‣ Exploratory testing can be very structured
‣ Exploratory testing can be thoroughly documented
‣ Mind maps are great for visualization and collaboration
‣ Use SBTM when possible
‣ Use TBTM when environment is too hectic
‣ Adapt the method to your needs
28©2012 Professional Quality Assurance Ltd. (PQA) -- http://www.pqatesting.com
![Page 17: Exploratory Testing on Agile Projects: Combining SBTM and TBTM](https://reader034.fdocuments.net/reader034/viewer/2022050808/558770a8d8b42aec3e8b467b/html5/thumbnails/17.jpg)
4/16/2013
©2011 Professional Quality Assurance (PQA) Ltd. -- http://www.pqa.ca 15
Links – Mind Mapping
29
� XMind: Powerful tool with a lot of nice features, used in examples
‣ http://www.xmind.net
� mindmeister: Collaborative tool.
‣ http://www.mindmeister.com
� FreeMind: The simpler of the mind mapping tools, but still very useful.
‣ http://freemind.sourceforge.net/wiki/index.php/Main_Page
©2012 Professional Quality Assurance Ltd. (PQA) -- http://www.pqatesting.com
Links – SBTM Tools
30
� Rapid Reporter: A note taking tool for exploratory testing sessions.
‣ http://testing.gershon.info/reporter/
� Session Tester: A tool for recording and managing exploratory testing
session.
‣ http://sessiontester.openqa.org
� SBTExecute: A tool that produces summary reports and calculates
metrics from an Excel session report template.
‣ http://www.addq.se/utforskande-testmetodik-xbtm/ (scroll down to
bottom of page for English)
©2012 Professional Quality Assurance Ltd. (PQA) -- http://www.pqatesting.com