WHO OWNS QUALITY?uploads.pnsqc.org/2017/slides/Who-Owns-Quality-in-Agile-Katy...•Automation,...
Transcript of WHO OWNS QUALITY?uploads.pnsqc.org/2017/slides/Who-Owns-Quality-in-Agile-Katy...•Automation,...
![Page 1: WHO OWNS QUALITY?uploads.pnsqc.org/2017/slides/Who-Owns-Quality-in-Agile-Katy...•Automation, technical transformation, DevOps •Frequent delivery, flexible roadmaps, feedback ...](https://reader031.fdocuments.net/reader031/viewer/2022022506/5ac298467f8b9aa0518b579d/html5/thumbnails/1.jpg)
WHO OWNS QUALITY IN AGILE?
Katy Sherman
@PNSQC@katy_sherman
#PNSQC
![Page 2: WHO OWNS QUALITY?uploads.pnsqc.org/2017/slides/Who-Owns-Quality-in-Agile-Katy...•Automation, technical transformation, DevOps •Frequent delivery, flexible roadmaps, feedback ...](https://reader031.fdocuments.net/reader031/viewer/2022022506/5ac298467f8b9aa0518b579d/html5/thumbnails/2.jpg)
My Journey With Agile
![Page 3: WHO OWNS QUALITY?uploads.pnsqc.org/2017/slides/Who-Owns-Quality-in-Agile-Katy...•Automation, technical transformation, DevOps •Frequent delivery, flexible roadmaps, feedback ...](https://reader031.fdocuments.net/reader031/viewer/2022022506/5ac298467f8b9aa0518b579d/html5/thumbnails/3.jpg)
•From Development to Engineering•Different flavors of Agile•Premier: successful transformation to agility• Teamwork, Scrum, Kanban• Automation, technical transformation, DevOps• Frequent delivery, flexible roadmaps, feedback from customers
•But…
![Page 4: WHO OWNS QUALITY?uploads.pnsqc.org/2017/slides/Who-Owns-Quality-in-Agile-Katy...•Automation, technical transformation, DevOps •Frequent delivery, flexible roadmaps, feedback ...](https://reader031.fdocuments.net/reader031/viewer/2022022506/5ac298467f8b9aa0518b579d/html5/thumbnails/4.jpg)
I need more time to test!!!
PROBLEM #1THE SPRINT IS TOO SHORT
![Page 5: WHO OWNS QUALITY?uploads.pnsqc.org/2017/slides/Who-Owns-Quality-in-Agile-Katy...•Automation, technical transformation, DevOps •Frequent delivery, flexible roadmaps, feedback ...](https://reader031.fdocuments.net/reader031/viewer/2022022506/5ac298467f8b9aa0518b579d/html5/thumbnails/5.jpg)
QA• Deadlines• Stress• Pressure• Low quality
Dev• Out of sync • Can do more• Let’s pull more stories into sprint
![Page 6: WHO OWNS QUALITY?uploads.pnsqc.org/2017/slides/Who-Owns-Quality-in-Agile-Katy...•Automation, technical transformation, DevOps •Frequent delivery, flexible roadmaps, feedback ...](https://reader031.fdocuments.net/reader031/viewer/2022022506/5ac298467f8b9aa0518b579d/html5/thumbnails/6.jpg)
PROBLEM #2THE DEFINITION OF QUALITY
What is quality?
![Page 7: WHO OWNS QUALITY?uploads.pnsqc.org/2017/slides/Who-Owns-Quality-in-Agile-Katy...•Automation, technical transformation, DevOps •Frequent delivery, flexible roadmaps, feedback ...](https://reader031.fdocuments.net/reader031/viewer/2022022506/5ac298467f8b9aa0518b579d/html5/thumbnails/7.jpg)
Phased Development Cycle:
• Phased approach:• Not “product testing” but “requirements testing”• Hierarchy of silos: Dev on top, Test in the bottom (downstream)
REQU
IREM
ENTS
Code
Quality Control
Traceability
![Page 8: WHO OWNS QUALITY?uploads.pnsqc.org/2017/slides/Who-Owns-Quality-in-Agile-Katy...•Automation, technical transformation, DevOps •Frequent delivery, flexible roadmaps, feedback ...](https://reader031.fdocuments.net/reader031/viewer/2022022506/5ac298467f8b9aa0518b579d/html5/thumbnails/8.jpg)
“Quality is to requirements and is measured in the number of rejects from customers”
“Quality is the totality of characteristics of an entity that bear on its ability to satisfy need“
![Page 9: WHO OWNS QUALITY?uploads.pnsqc.org/2017/slides/Who-Owns-Quality-in-Agile-Katy...•Automation, technical transformation, DevOps •Frequent delivery, flexible roadmaps, feedback ...](https://reader031.fdocuments.net/reader031/viewer/2022022506/5ac298467f8b9aa0518b579d/html5/thumbnails/9.jpg)
IMPLIED NEED?
![Page 10: WHO OWNS QUALITY?uploads.pnsqc.org/2017/slides/Who-Owns-Quality-in-Agile-Katy...•Automation, technical transformation, DevOps •Frequent delivery, flexible roadmaps, feedback ...](https://reader031.fdocuments.net/reader031/viewer/2022022506/5ac298467f8b9aa0518b579d/html5/thumbnails/10.jpg)
QUAL
ITY
Cannot be achieved through testing (Quality Control) alone!
![Page 11: WHO OWNS QUALITY?uploads.pnsqc.org/2017/slides/Who-Owns-Quality-in-Agile-Katy...•Automation, technical transformation, DevOps •Frequent delivery, flexible roadmaps, feedback ...](https://reader031.fdocuments.net/reader031/viewer/2022022506/5ac298467f8b9aa0518b579d/html5/thumbnails/11.jpg)
PROBLEM #3 : SILOS!!! I am not a tester!
![Page 12: WHO OWNS QUALITY?uploads.pnsqc.org/2017/slides/Who-Owns-Quality-in-Agile-Katy...•Automation, technical transformation, DevOps •Frequent delivery, flexible roadmaps, feedback ...](https://reader031.fdocuments.net/reader031/viewer/2022022506/5ac298467f8b9aa0518b579d/html5/thumbnails/12.jpg)
THE HIERARCHY OF SILOS:WHO MAKES DECISIONS?WHO IS SMARTER?WHO HAS MORE EDUCATION?WHO MAKES MORE MONEY?
![Page 13: WHO OWNS QUALITY?uploads.pnsqc.org/2017/slides/Who-Owns-Quality-in-Agile-Katy...•Automation, technical transformation, DevOps •Frequent delivery, flexible roadmaps, feedback ...](https://reader031.fdocuments.net/reader031/viewer/2022022506/5ac298467f8b9aa0518b579d/html5/thumbnails/13.jpg)
• In the silos we can only do Dev and Test (Quality control)
• To achieve real quality () we have to
break the silos
![Page 14: WHO OWNS QUALITY?uploads.pnsqc.org/2017/slides/Who-Owns-Quality-in-Agile-Katy...•Automation, technical transformation, DevOps •Frequent delivery, flexible roadmaps, feedback ...](https://reader031.fdocuments.net/reader031/viewer/2022022506/5ac298467f8b9aa0518b579d/html5/thumbnails/14.jpg)
Things to be aware of:• silos: companies must restructure Engineering to make it cross-functional• silos: “I am not a tester”“T he developer tells me what to test”
![Page 15: WHO OWNS QUALITY?uploads.pnsqc.org/2017/slides/Who-Owns-Quality-in-Agile-Katy...•Automation, technical transformation, DevOps •Frequent delivery, flexible roadmaps, feedback ...](https://reader031.fdocuments.net/reader031/viewer/2022022506/5ac298467f8b9aa0518b579d/html5/thumbnails/15.jpg)
PROBLEM #4QA VS DEV,THE CONFLICTOF INTERESTS
Where is QA manager?
![Page 16: WHO OWNS QUALITY?uploads.pnsqc.org/2017/slides/Who-Owns-Quality-in-Agile-Katy...•Automation, technical transformation, DevOps •Frequent delivery, flexible roadmaps, feedback ...](https://reader031.fdocuments.net/reader031/viewer/2022022506/5ac298467f8b9aa0518b579d/html5/thumbnails/16.jpg)
INSTEAD OF QA SILO: • Build community of Quality professionals and enthusiasts• Let the leaders emerge• Share experience• Establish consistent Quality process across the Org
![Page 17: WHO OWNS QUALITY?uploads.pnsqc.org/2017/slides/Who-Owns-Quality-in-Agile-Katy...•Automation, technical transformation, DevOps •Frequent delivery, flexible roadmaps, feedback ...](https://reader031.fdocuments.net/reader031/viewer/2022022506/5ac298467f8b9aa0518b579d/html5/thumbnails/17.jpg)
BREAKING SILOS:• Merge the roles: we are all Software Engineers• Use the same tools, share access• Cross-train• Automate
![Page 18: WHO OWNS QUALITY?uploads.pnsqc.org/2017/slides/Who-Owns-Quality-in-Agile-Katy...•Automation, technical transformation, DevOps •Frequent delivery, flexible roadmaps, feedback ...](https://reader031.fdocuments.net/reader031/viewer/2022022506/5ac298467f8b9aa0518b579d/html5/thumbnails/18.jpg)
PROBLEM #5LET’S AUTOMATE EVERYTHING!
Do I still have my job?
![Page 19: WHO OWNS QUALITY?uploads.pnsqc.org/2017/slides/Who-Owns-Quality-in-Agile-Katy...•Automation, technical transformation, DevOps •Frequent delivery, flexible roadmaps, feedback ...](https://reader031.fdocuments.net/reader031/viewer/2022022506/5ac298467f8b9aa0518b579d/html5/thumbnails/19.jpg)
•Primitive•Write test cases without understanding the application•Execute test cases written by someone else•Cross-test
•Advanced•Understand user’s need• Know how the system is hosted & operated•Explore and learn
•Extreme• Stress the system until it breaks• Find flaws• Hack
![Page 20: WHO OWNS QUALITY?uploads.pnsqc.org/2017/slides/Who-Owns-Quality-in-Agile-Katy...•Automation, technical transformation, DevOps •Frequent delivery, flexible roadmaps, feedback ...](https://reader031.fdocuments.net/reader031/viewer/2022022506/5ac298467f8b9aa0518b579d/html5/thumbnails/20.jpg)
Some tests will never be automated:• User experience• Ad-hoc testing (unscripted)• Security• Exploratory (learning)
![Page 21: WHO OWNS QUALITY?uploads.pnsqc.org/2017/slides/Who-Owns-Quality-in-Agile-Katy...•Automation, technical transformation, DevOps •Frequent delivery, flexible roadmaps, feedback ...](https://reader031.fdocuments.net/reader031/viewer/2022022506/5ac298467f8b9aa0518b579d/html5/thumbnails/21.jpg)
PROBLEM #6MANAGING DATASETS
How do I maintain and reuse my data?
![Page 22: WHO OWNS QUALITY?uploads.pnsqc.org/2017/slides/Who-Owns-Quality-in-Agile-Katy...•Automation, technical transformation, DevOps •Frequent delivery, flexible roadmaps, feedback ...](https://reader031.fdocuments.net/reader031/viewer/2022022506/5ac298467f8b9aa0518b579d/html5/thumbnails/22.jpg)
Creating and maintaining test data sets:• Identify as pre-condition • Use test automation tools!• Make reusable
![Page 23: WHO OWNS QUALITY?uploads.pnsqc.org/2017/slides/Who-Owns-Quality-in-Agile-Katy...•Automation, technical transformation, DevOps •Frequent delivery, flexible roadmaps, feedback ...](https://reader031.fdocuments.net/reader031/viewer/2022022506/5ac298467f8b9aa0518b579d/html5/thumbnails/23.jpg)
PROBLEM #7LOOKING FOR NEW QA!
I am in charge
![Page 24: WHO OWNS QUALITY?uploads.pnsqc.org/2017/slides/Who-Owns-Quality-in-Agile-Katy...•Automation, technical transformation, DevOps •Frequent delivery, flexible roadmaps, feedback ...](https://reader031.fdocuments.net/reader031/viewer/2022022506/5ac298467f8b9aa0518b579d/html5/thumbnails/24.jpg)
Looking for “new” Quality Engineers:•Passionate about quality•Have deep knowledge of the Business domain•Understand how the system is hosted and operated•Extremely technical, can write scripts and write/read code•Strong and empowered•Can orchestrate the entire development cycle
![Page 25: WHO OWNS QUALITY?uploads.pnsqc.org/2017/slides/Who-Owns-Quality-in-Agile-Katy...•Automation, technical transformation, DevOps •Frequent delivery, flexible roadmaps, feedback ...](https://reader031.fdocuments.net/reader031/viewer/2022022506/5ac298467f8b9aa0518b579d/html5/thumbnails/25.jpg)
Merge of Dev and QA• Everybody owns quality• Engineers who like to build things and engineers who like to break them•
•
![Page 26: WHO OWNS QUALITY?uploads.pnsqc.org/2017/slides/Who-Owns-Quality-in-Agile-Katy...•Automation, technical transformation, DevOps •Frequent delivery, flexible roadmaps, feedback ...](https://reader031.fdocuments.net/reader031/viewer/2022022506/5ac298467f8b9aa0518b579d/html5/thumbnails/26.jpg)
PROBLEM #8DEVELOPMENT QUALITY ENGINEERING
![Page 27: WHO OWNS QUALITY?uploads.pnsqc.org/2017/slides/Who-Owns-Quality-in-Agile-Katy...•Automation, technical transformation, DevOps •Frequent delivery, flexible roadmaps, feedback ...](https://reader031.fdocuments.net/reader031/viewer/2022022506/5ac298467f8b9aa0518b579d/html5/thumbnails/27.jpg)
<--------SHIFT LEFT<---------, the entire Engineering
team owns quality• Quality-related work starts
early in the cycle (before coding) and goes across all steps
• The cycle is centered on a user story
REQU
IREM
ENTS
Code
Quality Engineering
Code
DEFI
NTION
OF
DONE
![Page 28: WHO OWNS QUALITY?uploads.pnsqc.org/2017/slides/Who-Owns-Quality-in-Agile-Katy...•Automation, technical transformation, DevOps •Frequent delivery, flexible roadmaps, feedback ...](https://reader031.fdocuments.net/reader031/viewer/2022022506/5ac298467f8b9aa0518b579d/html5/thumbnails/28.jpg)
Dev & QACollaborate on test strategy for each user story (combined effort, but QA has to be driving!)• Positive and negative use cases: better code quality, awareness• Performance, Security, Integration• Data set for testing: use existing or create new?• Dependencies• Exploratory testing• Impact on Test automation• Impact on Regression Has to be started before coding and be done in parallel
![Page 29: WHO OWNS QUALITY?uploads.pnsqc.org/2017/slides/Who-Owns-Quality-in-Agile-Katy...•Automation, technical transformation, DevOps •Frequent delivery, flexible roadmaps, feedback ...](https://reader031.fdocuments.net/reader031/viewer/2022022506/5ac298467f8b9aa0518b579d/html5/thumbnails/29.jpg)
QUALITY HEROESOWNERS
![Page 30: WHO OWNS QUALITY?uploads.pnsqc.org/2017/slides/Who-Owns-Quality-in-Agile-Katy...•Automation, technical transformation, DevOps •Frequent delivery, flexible roadmaps, feedback ...](https://reader031.fdocuments.net/reader031/viewer/2022022506/5ac298467f8b9aa0518b579d/html5/thumbnails/30.jpg)
Things to remember after you forgot my presentation, my slides
and my name…
![Page 31: WHO OWNS QUALITY?uploads.pnsqc.org/2017/slides/Who-Owns-Quality-in-Agile-Katy...•Automation, technical transformation, DevOps •Frequent delivery, flexible roadmaps, feedback ...](https://reader031.fdocuments.net/reader031/viewer/2022022506/5ac298467f8b9aa0518b579d/html5/thumbnails/31.jpg)
1. Break the silos2. Shift left3. Everybody owns Quality, but QA
orchestrates it
![Page 32: WHO OWNS QUALITY?uploads.pnsqc.org/2017/slides/Who-Owns-Quality-in-Agile-Katy...•Automation, technical transformation, DevOps •Frequent delivery, flexible roadmaps, feedback ...](https://reader031.fdocuments.net/reader031/viewer/2022022506/5ac298467f8b9aa0518b579d/html5/thumbnails/32.jpg)
THANK YOU!Connect and stay in
touch:https://www.linkedin.com/in/katy-sherman-practical-agile/
@katy_sherman Nov 30th
Charlotte NC