Post on 10-Jul-2020
Commercial in Confidence | Assurity Consulting Limited 2013
Sharing testing with non-testers in an agile team
Nordic Testing Days 2015
Katrina Clokie @katrina_tester
Commercial in Confidence | Assurity Consulting Limited 2013
Sharing testing with non-testers in an agile team
Katrina Clokie @katrina_tester
Introduction Visualising
Strategy
Visual
Modelling
Session Based
Test
Management
Commercial in Confidence | Assurity Consulting Limited 2013
Context
• Test consultant embedded in a scrum team for three days a week
• Create cross-skilled resources by training the existing team of
developers, business analysts and subject matter experts in testing
• Specialist financial domain
• Team was University educated
> Economics & Finance
> Mathematics
> Computer Science
Commercial in Confidence | Assurity Consulting Limited 2013
100% Automation
Commercial in Confidence | Assurity Consulting Limited 2013
Testing 101 Workshop
Commercial in Confidence | Assurity Consulting Limited 2013
Introduction Visualising
Strategy
Visual
Modelling
Session Based
Test
Management
Sharing testing with non-testers in an agile team
Katrina Clokie @katrina_tester
Commercial in Confidence | Assurity Consulting Limited 2013
Testing 101 Workshop
Commercial in Confidence | Assurity Consulting Limited 2013
IDEA PRODUCTION
Commercial in Confidence | Assurity Consulting Limited 2013
In our test strategy and we’re doing it
In our test strategy and we’re not doing it
Not in our test strategy, but should be
Commercial in Confidence | Assurity Consulting Limited 2013
Disaster
Recovery Unit
Testing
Exploratory
Testing
Component
Testing
Integration
Testing
System
Testing
Automated
Testing
Regression
Testing
Specification
Workshops
SME
Interaction
SpecFlow
Testing
Manual
Testing
Mind Maps
Package
Testing
End-to-End
Testing
Acceptance
Testing
Manual
Testing
Security
Testing
Availability
Operations
Performance
Testing
Usability
Release
Testing
Parallel
Testing
In our test strategy and we’re doing it
In our test strategy and we’re not doing it
Not in our test strategy, but should be Read more: http://tiny.cc/teststrategyretro
Commercial in Confidence | Assurity Consulting Limited 2013
Disaster
Recovery Unit
Testing
Exploratory
Testing
Component
Testing
Integration
Testing
System
Testing
Automated
Testing
Regression
Testing
Specification
Workshops
SME
Interaction
SpecFlow
Testing
Manual
Testing
Mind Maps
Package
Testing
End-to-End
Testing
Acceptance
Testing
Manual
Testing
Security
Testing
Availability
Operations
Performance
Testing
Usability
Release
Testing
Parallel
Testing
In our test strategy and we’re doing it
In our test strategy and we’re not doing it
Not in our test strategy, but should be Read more: http://tiny.cc/teststrategyretro
Commercial in Confidence | Assurity Consulting Limited 2013
Disaster
Recovery Unit
Testing
Exploratory
Testing
Component
Testing
Integration
Testing
System
Testing
Automated
Testing
Regression
Testing
Specification
Workshops
SME
Interaction
SpecFlow
Testing
Manual
Testing
Mind Maps
Package
Testing
End-to-End
Testing
Acceptance
Testing
Manual
Testing
Security
Testing
Availability
Operations
Performance
Testing
Usability
Release
Testing
Parallel
Testing
In our test strategy and we’re doing it
In our test strategy and we’re not doing it
Not in our test strategy, but should be Read more: http://tiny.cc/teststrategyretro
Commercial in Confidence | Assurity Consulting Limited 2013
Disaster
Recovery Unit
Testing
Exploratory
Testing
Component
Testing
Integration
Testing
System
Testing
Automated
Testing
Regression
Testing
Specification
Workshops
SME
Interaction
SpecFlow
Testing
Manual
Testing
Mind Maps
Package
Testing
End-to-End
Testing
Acceptance
Testing
Manual
Testing
Security
Testing
Availability
Operations
Performance
Testing
Usability
Release
Testing
Parallel
Testing
In our test strategy and we’re doing it
In our test strategy and we’re not doing it
Not in our test strategy, but should be Read more: http://tiny.cc/teststrategyretro
Commercial in Confidence | Assurity Consulting Limited 2013
Disaster
Recovery Unit
Testing
Exploratory
Testing
Component
Testing
Integration
Testing
System
Testing
Automated
Testing
Regression
Testing
Specification
Workshops
SME
Interaction
SpecFlow
Testing
Manual
Testing
Mind Maps
Package
Testing
End-to-End
Testing
Acceptance
Testing
Manual
Testing
Security
Testing
Availability
Operations
Performance
Testing
Usability
Release
Testing
Parallel
Testing
In our test strategy and we’re doing it
In our test strategy and we’re not doing it
Not in our test strategy, but should be Read more: http://tiny.cc/teststrategyretro
Commercial in Confidence | Assurity Consulting Limited 2013
Commercial in Confidence | Assurity Consulting Limited 2013
Commercial in Confidence | Assurity Consulting Limited 2013
Commercial in Confidence | Assurity Consulting Limited 2013
Starting Together
Commercial in Confidence | Assurity Consulting Limited 2013
Introduction Visualising
Strategy
Visual
Modelling
Session Based
Test
Management
Sharing testing with non-testers in an agile team
Katrina Clokie @katrina_tester
Commercial in Confidence | Assurity Consulting Limited 2013
Think Talk Act
Commercial in Confidence | Assurity Consulting Limited 2013
What do you think this does?
Commercial in Confidence | Assurity Consulting Limited 2013
Does everyone agree that’s all?
Commercial in Confidence | Assurity Consulting Limited 2013
How are you going to test this?
Commercial in Confidence | Assurity Consulting Limited 2013
Are you happy that this testing will mean the story is done?
Commercial in Confidence | Assurity Consulting Limited 2013
Test Ideas
• That the acceptance criteria are met
• That each function does what it is supposed to do (positive testing)
• The problems that each function could have (negative testing)
• Input data for typical, boundary and invalid cases
• Output data for typical, boundary and invalid cases
• A flow through the system, with functions in different orders
Reference: Bach, James (2013). Heuristic Test Strategy Model
Commercial in Confidence | Assurity Consulting Limited 2013
Commercial in Confidence | Assurity Consulting Limited 2013
What should we automate?
• What matters most?
• Are there any problems with high impact?
• Are there any problems with high probability?
Reference: Marick, Brian (1998). When should a test be automated?
Commercial in Confidence | Assurity Consulting Limited 2013
Commercial in Confidence | Assurity Consulting Limited 2013
The greatest enemy of knowledge is not ignorance, but the illusion of knowledge
Stephen Hawking
Commercial in Confidence | Assurity Consulting Limited 2013
Introduction Visualising
Strategy
Visual
Modelling
Session Based
Test
Management
Sharing testing with non-testers in an agile team
Katrina Clokie @katrina_tester
Commercial in Confidence | Assurity Consulting Limited 2013
Manual Testing Tasks
Commercial in Confidence | Assurity Consulting Limited 2013
Session Based Test Management
Commercial in Confidence | Assurity Consulting Limited 2013
Commercial in Confidence | Assurity Consulting Limited 2013
Peer Review
Commercial in Confidence | Assurity Consulting Limited 2013
What happened?
• Multiple manual testing tasks for a story
• Focused investigation with consistent reporting
• Review improved testing by creating competition
• Increased SME confidence in testing by the team
• Reduced duplication
Commercial in Confidence | Assurity Consulting Limited 2013
Conclusion
Commercial in Confidence | Assurity Consulting Limited 2013
Disaster
Recovery Unit
Testing
Exploratory
Testing
Component
Testing
Integration
Testing
System
Testing
Automated
Testing
Regression
Testing
Specification
Workshops
SME
Interaction
SpecFlow
Testing
Manual
Testing
Mind Maps
Package
Testing
End-to-End
Testing
Acceptance
Testing
Manual
Testing
Security
Testing
Availability
Operations
Performance
Testing
Usability
Release
Testing
Parallel
Testing
In our test strategy and we’re doing it
In our test strategy and we’re not doing it
Not in our test strategy, but should be Read more: http://tiny.cc/teststrategyretro
Commercial in Confidence | Assurity Consulting Limited 2013
Commercial in Confidence | Assurity Consulting Limited 2013
Session Based Test Management
Commercial in Confidence | Assurity Consulting Limited 2013
Sharing testing with non-testers in an agile team
Nordic Testing Days 2015
Katrina Clokie @katrina_tester