Polychrome Testing: Ideas & Practices to Improve Software Testing | QASymphony Webinar
-
Upload
qasymphony -
Category
Business
-
view
342 -
download
1
Transcript of Polychrome Testing: Ideas & Practices to Improve Software Testing | QASymphony Webinar
![Page 1: Polychrome Testing: Ideas & Practices to Improve Software Testing | QASymphony Webinar](https://reader030.fdocuments.net/reader030/viewer/2022021419/587e47481a28abeb1a8b45a7/html5/thumbnails/1.jpg)
Polychrome Testing
19th July 2016
Julian Harty – Commercetest Limited
Ideas and practices to help improve how we test software
![Page 2: Polychrome Testing: Ideas & Practices to Improve Software Testing | QASymphony Webinar](https://reader030.fdocuments.net/reader030/viewer/2022021419/587e47481a28abeb1a8b45a7/html5/thumbnails/2.jpg)
HOW TO WATCH THIS WEBINAR
• Audio for this webinar is delivered through your computer. Make sure your speakers are turned up or use a set of headphones.
• If your audio quality is choppy, it could be your internet connection.
• You can customize your webinar viewing experience by increasing, decreasing or minimizing the size of the widgets on your screen.
• If you have questions, enter them in the widget on the left.
![Page 3: Polychrome Testing: Ideas & Practices to Improve Software Testing | QASymphony Webinar](https://reader030.fdocuments.net/reader030/viewer/2022021419/587e47481a28abeb1a8b45a7/html5/thumbnails/3.jpg)
Robust test management platform purpose-built to help agile teams centralize, organize and accelerate software testing
ABOUT QASYMPHONY
![Page 4: Polychrome Testing: Ideas & Practices to Improve Software Testing | QASymphony Webinar](https://reader030.fdocuments.net/reader030/viewer/2022021419/587e47481a28abeb1a8b45a7/html5/thumbnails/4.jpg)
Title: QASymphony & TestPlant: Bringing Together Best-in-Class Test Management and Test Automation
Date: July 21st
Guest Speakers: Antony Edwards, CTO and Board Member of TestPlant & Kevin Dunne, VP of Strategy and Business Development at QASymphony
UPCOMING WEBINARS
Title: Modern Software Testing: Thinking Beyond Quality Center ALM
Date: July 26st
Guest Speakers: Kevin Dunne, & VP of Strategy and Business Development at QASymphony
Antony Edwards
Kevin Dunne
Kevin Dunne
![Page 5: Polychrome Testing: Ideas & Practices to Improve Software Testing | QASymphony Webinar](https://reader030.fdocuments.net/reader030/viewer/2022021419/587e47481a28abeb1a8b45a7/html5/thumbnails/5.jpg)
• Julian has been involved in finding ways to engineer, maintain, and keep complex systems working reliably at a global scale for several decades and included periods working for Google, eBay, Salesforce, and many other interesting companies and projects.
• He’s been a respected leader in the software testing community for about 15 years and given keynotes worldwide on software quality, mobile apps, education, etc. He also contributed to open source projects including Selenium and other test automation frameworks, and has written books on related topics.
• Currently he consults for companies, is studying part-time for a Ph.D on using mobile analytics to improve development & testing practices and the resulting apps, and contributes to finding practical approaches to improve education internationally using low-cost low-power mobile technology.
OUR PRESENTER
Guest SpeakerJulian Harty
![Page 6: Polychrome Testing: Ideas & Practices to Improve Software Testing | QASymphony Webinar](https://reader030.fdocuments.net/reader030/viewer/2022021419/587e47481a28abeb1a8b45a7/html5/thumbnails/6.jpg)
• This webinar will be recorded and available on-demand tomorrow. You will get an email when it is available.
• Use the Q&A widgets to ask questions during the webinar.
• At the end of the webinar, you will be asked to take a short survey.
HOUSEKEEPING
![Page 7: Polychrome Testing: Ideas & Practices to Improve Software Testing | QASymphony Webinar](https://reader030.fdocuments.net/reader030/viewer/2022021419/587e47481a28abeb1a8b45a7/html5/thumbnails/7.jpg)
Imagine if our testing was as beautiful as this
![Page 8: Polychrome Testing: Ideas & Practices to Improve Software Testing | QASymphony Webinar](https://reader030.fdocuments.net/reader030/viewer/2022021419/587e47481a28abeb1a8b45a7/html5/thumbnails/8.jpg)
However much testing is monochrome
![Page 9: Polychrome Testing: Ideas & Practices to Improve Software Testing | QASymphony Webinar](https://reader030.fdocuments.net/reader030/viewer/2022021419/587e47481a28abeb1a8b45a7/html5/thumbnails/9.jpg)
9
The status quo?
•Limiting ideas•Poor communication•Pre-set roles and responsibilities
• Insanity: doing the same thing over and over again and expecting different results
• Albert Einstein (attributed)
?
![Page 10: Polychrome Testing: Ideas & Practices to Improve Software Testing | QASymphony Webinar](https://reader030.fdocuments.net/reader030/viewer/2022021419/587e47481a28abeb1a8b45a7/html5/thumbnails/10.jpg)
Hmmm… What problem am I trying to solve?
10
![Page 11: Polychrome Testing: Ideas & Practices to Improve Software Testing | QASymphony Webinar](https://reader030.fdocuments.net/reader030/viewer/2022021419/587e47481a28abeb1a8b45a7/html5/thumbnails/11.jpg)
What data do I have? What data do I need?
11
Wisdom
![Page 12: Polychrome Testing: Ideas & Practices to Improve Software Testing | QASymphony Webinar](https://reader030.fdocuments.net/reader030/viewer/2022021419/587e47481a28abeb1a8b45a7/html5/thumbnails/12.jpg)
Feelings: passions, intuitions and fears
12
![Page 13: Polychrome Testing: Ideas & Practices to Improve Software Testing | QASymphony Webinar](https://reader030.fdocuments.net/reader030/viewer/2022021419/587e47481a28abeb1a8b45a7/html5/thumbnails/13.jpg)
Why am I doing this? What do I want to achieve?
13
![Page 14: Polychrome Testing: Ideas & Practices to Improve Software Testing | QASymphony Webinar](https://reader030.fdocuments.net/reader030/viewer/2022021419/587e47481a28abeb1a8b45a7/html5/thumbnails/14.jpg)
14
Risks, flaws and problems in the Quest?
![Page 15: Polychrome Testing: Ideas & Practices to Improve Software Testing | QASymphony Webinar](https://reader030.fdocuments.net/reader030/viewer/2022021419/587e47481a28abeb1a8b45a7/html5/thumbnails/15.jpg)
15
How do I achieve and solve stuff?
![Page 16: Polychrome Testing: Ideas & Practices to Improve Software Testing | QASymphony Webinar](https://reader030.fdocuments.net/reader030/viewer/2022021419/587e47481a28abeb1a8b45a7/html5/thumbnails/16.jpg)
16
Decision Time? What next?
?
![Page 17: Polychrome Testing: Ideas & Practices to Improve Software Testing | QASymphony Webinar](https://reader030.fdocuments.net/reader030/viewer/2022021419/587e47481a28abeb1a8b45a7/html5/thumbnails/17.jpg)
Six Thinking HatsTo the rescue!
![Page 18: Polychrome Testing: Ideas & Practices to Improve Software Testing | QASymphony Webinar](https://reader030.fdocuments.net/reader030/viewer/2022021419/587e47481a28abeb1a8b45a7/html5/thumbnails/18.jpg)
18
The Blue Hat
• Blue sky thinking• Helps to provide an overview
• Thinking about our thinking
• Controls the use of the other hats
• Gathers the outcome at the end
• Set out the next steps
![Page 19: Polychrome Testing: Ideas & Practices to Improve Software Testing | QASymphony Webinar](https://reader030.fdocuments.net/reader030/viewer/2022021419/587e47481a28abeb1a8b45a7/html5/thumbnails/19.jpg)
19
The White Hat
• Information, Facts• Neutral
• Report what we find, as we find it
• Ask questions to establish facts• What information do we have?• What information do we need?• What’s missing?• Qualify ‘facts’: are they opinions?
![Page 20: Polychrome Testing: Ideas & Practices to Improve Software Testing | QASymphony Webinar](https://reader030.fdocuments.net/reader030/viewer/2022021419/587e47481a28abeb1a8b45a7/html5/thumbnails/20.jpg)
20
The Yellow Hat
• Sunshine, Optimism• Seeking the best possible outcome
• Positive • Looking for benefits
![Page 21: Polychrome Testing: Ideas & Practices to Improve Software Testing | QASymphony Webinar](https://reader030.fdocuments.net/reader030/viewer/2022021419/587e47481a28abeb1a8b45a7/html5/thumbnails/21.jpg)
21
The Red Hat
• PASSION!!! FEELINGS!!! • A safe environment to vent feelings
• Negative• Positive
• Includes: hunches and intuitions
• No need to justify your contributions
![Page 22: Polychrome Testing: Ideas & Practices to Improve Software Testing | QASymphony Webinar](https://reader030.fdocuments.net/reader030/viewer/2022021419/587e47481a28abeb1a8b45a7/html5/thumbnails/22.jpg)
22
The Black Hat
• Represents DARKNESS• Helps us to be cautious• Look for what could go wrong• Look for what might be wrong• Taps into our fears• Not the same as being negative…
• Particularly useful for software testing
![Page 23: Polychrome Testing: Ideas & Practices to Improve Software Testing | QASymphony Webinar](https://reader030.fdocuments.net/reader030/viewer/2022021419/587e47481a28abeb1a8b45a7/html5/thumbnails/23.jpg)
23
The Green Hat
•Creativity• Seek new ideas, alternatives
• Brainstorming
• Use ‘po’ - provocative thinking
• Helps escape from ruts
![Page 24: Polychrome Testing: Ideas & Practices to Improve Software Testing | QASymphony Webinar](https://reader030.fdocuments.net/reader030/viewer/2022021419/587e47481a28abeb1a8b45a7/html5/thumbnails/24.jpg)
24
Six Thinking Hats
How do we use them?• One hat at a time
• Groups use the same color at once
• Start and finish with the blue hat
• By practicing
![Page 25: Polychrome Testing: Ideas & Practices to Improve Software Testing | QASymphony Webinar](https://reader030.fdocuments.net/reader030/viewer/2022021419/587e47481a28abeb1a8b45a7/html5/thumbnails/25.jpg)
Let’s apply the hats to our story
![Page 26: Polychrome Testing: Ideas & Practices to Improve Software Testing | QASymphony Webinar](https://reader030.fdocuments.net/reader030/viewer/2022021419/587e47481a28abeb1a8b45a7/html5/thumbnails/26.jpg)
![Page 27: Polychrome Testing: Ideas & Practices to Improve Software Testing | QASymphony Webinar](https://reader030.fdocuments.net/reader030/viewer/2022021419/587e47481a28abeb1a8b45a7/html5/thumbnails/27.jpg)
![Page 28: Polychrome Testing: Ideas & Practices to Improve Software Testing | QASymphony Webinar](https://reader030.fdocuments.net/reader030/viewer/2022021419/587e47481a28abeb1a8b45a7/html5/thumbnails/28.jpg)
![Page 29: Polychrome Testing: Ideas & Practices to Improve Software Testing | QASymphony Webinar](https://reader030.fdocuments.net/reader030/viewer/2022021419/587e47481a28abeb1a8b45a7/html5/thumbnails/29.jpg)
![Page 30: Polychrome Testing: Ideas & Practices to Improve Software Testing | QASymphony Webinar](https://reader030.fdocuments.net/reader030/viewer/2022021419/587e47481a28abeb1a8b45a7/html5/thumbnails/30.jpg)
![Page 31: Polychrome Testing: Ideas & Practices to Improve Software Testing | QASymphony Webinar](https://reader030.fdocuments.net/reader030/viewer/2022021419/587e47481a28abeb1a8b45a7/html5/thumbnails/31.jpg)
![Page 32: Polychrome Testing: Ideas & Practices to Improve Software Testing | QASymphony Webinar](https://reader030.fdocuments.net/reader030/viewer/2022021419/587e47481a28abeb1a8b45a7/html5/thumbnails/32.jpg)
![Page 33: Polychrome Testing: Ideas & Practices to Improve Software Testing | QASymphony Webinar](https://reader030.fdocuments.net/reader030/viewer/2022021419/587e47481a28abeb1a8b45a7/html5/thumbnails/33.jpg)
We could use these colours to help us
Blue: direction
White: facts
Red: feelings
Black: concerns
Yellow: best case
Green: creativity
![Page 34: Polychrome Testing: Ideas & Practices to Improve Software Testing | QASymphony Webinar](https://reader030.fdocuments.net/reader030/viewer/2022021419/587e47481a28abeb1a8b45a7/html5/thumbnails/34.jpg)
34
What can we use the hats for?•Improving our working relationships
• Reduces adversarial relationships and in-fighting
•Reviewing artefacts• Documents, designs, code, test plans, test results, etc.
•Designing test cases• Helps us to ask questions from 6 distinct viewpoints
•Planning the testing
![Page 35: Polychrome Testing: Ideas & Practices to Improve Software Testing | QASymphony Webinar](https://reader030.fdocuments.net/reader030/viewer/2022021419/587e47481a28abeb1a8b45a7/html5/thumbnails/35.jpg)
35
Using hats for software testing• Some ideas• In reviews• To design test cases• To assess a product• Code reviews• At release meetings• While testing
![Page 36: Polychrome Testing: Ideas & Practices to Improve Software Testing | QASymphony Webinar](https://reader030.fdocuments.net/reader030/viewer/2022021419/587e47481a28abeb1a8b45a7/html5/thumbnails/36.jpg)
36
Examples of test case design questionsQuestions HatWhat data do I need to design this test case? WhiteWhat advantages do we obtain from designing (or skipping) this test case?
Yellow
What would annoy the users or the customers if it didn’t work properly?
Red
What sort of problems could go wrong with the test? What might we get wrong, or misinterpret?
Black
Seek alternatives that might improve the results, timescales, costs, etc. of our testing?
Green
What are we trying to achieve with our tests? Blue
![Page 37: Polychrome Testing: Ideas & Practices to Improve Software Testing | QASymphony Webinar](https://reader030.fdocuments.net/reader030/viewer/2022021419/587e47481a28abeb1a8b45a7/html5/thumbnails/37.jpg)
Rough notes (on non-functional testing)
Blue: Objectives White: data
Yellow: benefits
Green: ideas
Black: Hurdles
Red: My impressions
![Page 38: Polychrome Testing: Ideas & Practices to Improve Software Testing | QASymphony Webinar](https://reader030.fdocuments.net/reader030/viewer/2022021419/587e47481a28abeb1a8b45a7/html5/thumbnails/38.jpg)
38
Sample mind map of testing questions
![Page 39: Polychrome Testing: Ideas & Practices to Improve Software Testing | QASymphony Webinar](https://reader030.fdocuments.net/reader030/viewer/2022021419/587e47481a28abeb1a8b45a7/html5/thumbnails/39.jpg)
39
Example order of the Thinking Hats
Focus
Data
Feelings
Benefits
Problems
Ideas Actions
![Page 40: Polychrome Testing: Ideas & Practices to Improve Software Testing | QASymphony Webinar](https://reader030.fdocuments.net/reader030/viewer/2022021419/587e47481a28abeb1a8b45a7/html5/thumbnails/40.jpg)
40
Common mistakes when using the hats
Mistake Ways to deal with the mistake
Opinions being presented as facts Check the facts, as for the degree of confidence
Confusing one hat with another With help people improve over time, encourage people to note ideas under the relevant hat
Blue hat not getting sufficient attention
Use the blue hat to start and end each session
People do not obey the ‘rules’ Encourage and demonstrate good practices
People do not get involved The facilitator encourages each person to present their ideas
![Page 41: Polychrome Testing: Ideas & Practices to Improve Software Testing | QASymphony Webinar](https://reader030.fdocuments.net/reader030/viewer/2022021419/587e47481a28abeb1a8b45a7/html5/thumbnails/41.jpg)
I am not a color, I am a free man1
• Hats are not labels or roles they help us escape our comfort zone and provide a shared understanding
• We use them to think in parallel
• We are not limited by de Bono’s choices
1 http://en.wikipedia.org/wiki/The_Prisoner
![Page 42: Polychrome Testing: Ideas & Practices to Improve Software Testing | QASymphony Webinar](https://reader030.fdocuments.net/reader030/viewer/2022021419/587e47481a28abeb1a8b45a7/html5/thumbnails/42.jpg)
Colorful ThinkingAlfred Hitchcock
Blue Script: factsGreen Script: emotions
Coloured by your thinking?
•Red: Anger, rage•Green: envy•Yellow: fear•Blue: sorrow•Black: depressed
![Page 43: Polychrome Testing: Ideas & Practices to Improve Software Testing | QASymphony Webinar](https://reader030.fdocuments.net/reader030/viewer/2022021419/587e47481a28abeb1a8b45a7/html5/thumbnails/43.jpg)
http:
//fla
gsto
ries.
co/
Colours mean different things to different people
![Page 44: Polychrome Testing: Ideas & Practices to Improve Software Testing | QASymphony Webinar](https://reader030.fdocuments.net/reader030/viewer/2022021419/587e47481a28abeb1a8b45a7/html5/thumbnails/44.jpg)
Use emotions in testing to help deliver a great UX
Head
Heart
Gut
SoulSlide courtesy of Isabel Evans, used with permission
![Page 45: Polychrome Testing: Ideas & Practices to Improve Software Testing | QASymphony Webinar](https://reader030.fdocuments.net/reader030/viewer/2022021419/587e47481a28abeb1a8b45a7/html5/thumbnails/45.jpg)
45
Customer Experience (CX)
https://experiencematters.wordpress.com/2016/04/01/cx-metrics-immature-but-improving-infographic/
![Page 46: Polychrome Testing: Ideas & Practices to Improve Software Testing | QASymphony Webinar](https://reader030.fdocuments.net/reader030/viewer/2022021419/587e47481a28abeb1a8b45a7/html5/thumbnails/46.jpg)
46
Directional thinking
•1-Dimensional thinking leads to 1-Dimensional results
•6 Thinking Hats provides 6-Dimensional thinking and better results
![Page 47: Polychrome Testing: Ideas & Practices to Improve Software Testing | QASymphony Webinar](https://reader030.fdocuments.net/reader030/viewer/2022021419/587e47481a28abeb1a8b45a7/html5/thumbnails/47.jpg)
47
Parting advice• Try the six thinking hats• Start simple: paper and a pen• When you have an idea for a ‘dormant’ hat:
record it then return to ‘active’ hat
• For Groups:• Consider software e.g. WebNote
http://www.aypwip.org/webnote/ • Use sets of baseball caps ($10 per set)
![Page 48: Polychrome Testing: Ideas & Practices to Improve Software Testing | QASymphony Webinar](https://reader030.fdocuments.net/reader030/viewer/2022021419/587e47481a28abeb1a8b45a7/html5/thumbnails/48.jpg)
48
What next?
• Review the session: by using the six thinking hats • Use the concepts for one of your next tasks e.g.
• A meeting with your testing team• A meeting with your project team• Reviewing a document, or a piece of source code• Creating your next set of test cases
• Please let me know how you get on • Remember we can learn from failures as well as success!
![Page 49: Polychrome Testing: Ideas & Practices to Improve Software Testing | QASymphony Webinar](https://reader030.fdocuments.net/reader030/viewer/2022021419/587e47481a28abeb1a8b45a7/html5/thumbnails/49.jpg)
49
How will you use the six thinking hats this week?
![Page 50: Polychrome Testing: Ideas & Practices to Improve Software Testing | QASymphony Webinar](https://reader030.fdocuments.net/reader030/viewer/2022021419/587e47481a28abeb1a8b45a7/html5/thumbnails/50.jpg)
Q&A
Questions?
![Page 51: Polychrome Testing: Ideas & Practices to Improve Software Testing | QASymphony Webinar](https://reader030.fdocuments.net/reader030/viewer/2022021419/587e47481a28abeb1a8b45a7/html5/thumbnails/51.jpg)
Thank you
![Page 52: Polychrome Testing: Ideas & Practices to Improve Software Testing | QASymphony Webinar](https://reader030.fdocuments.net/reader030/viewer/2022021419/587e47481a28abeb1a8b45a7/html5/thumbnails/52.jpg)
Links, references, further materials
• 2008 edition of this topic at StarWest Conference: https://www.youtube.com/watch?v=DasTbFUcmtI
• Source image for Amiens Cathedral https://en.wikipedia.org/wiki/Polychrome#/media/File:Amiens_iluminacion_fachada_catedral.JPG
• Six thinking hats by Edward de Bono • Lateral thinking also by Edward de Bono - includes ‘po’ provocative thinking• Predictably Irrational by Dan Airely• Bruce Temkin and team https://experiencematters.wordpress.com/ • Stories: Realising their potential and power in projects by Isabel Evans @21st July
https://huddle.eurostarsoftwaretesting.com/webinar-schedule/
My current research• The Mobile Analytics Playbook http://www.themobileanalyticsplaybook.com/