Syncing Up Testing - TriAgiletriagile.com › ... › 06 › Syncing-Up-Testing-TriAgile.pdf ·...

26
www.beaufortfairmont.com 984.244.2313 Syncing Up Agile Testing From the Inside Out PAUL MERRILL PRINCIPAL SOFTWARE ENGINEER IN TEST & FOUNDER @dpaulmerrill

Transcript of Syncing Up Testing - TriAgiletriagile.com › ... › 06 › Syncing-Up-Testing-TriAgile.pdf ·...

Page 1: Syncing Up Testing - TriAgiletriagile.com › ... › 06 › Syncing-Up-Testing-TriAgile.pdf · 984.244.2313 Paul Merrill 2002 - First Agile Team Numbers: 16+ years, 20+ teams, 35+

www.beaufortfairmont.com 984.244.2313

Syncing Up Agile Testing From the Inside Out

PAUL MERRILL PRINCIPAL SOFTWARE ENGINEER IN TEST &

FOUNDER@dpaulmerrill

Page 2: Syncing Up Testing - TriAgiletriagile.com › ... › 06 › Syncing-Up-Testing-TriAgile.pdf · 984.244.2313 Paul Merrill 2002 - First Agile Team Numbers: 16+ years, 20+ teams, 35+

www.beaufortfairmont.com 984.244.2313

Paul Merrill2002 - First Agile Team Numbers:

16+ years, 20+ teams, 35+ codebases

Roles: ScrumMaster, Manager, Project Manager, Software Engineer, Tester

Industries: Banking, Reinsurance, Healthcare, InfoSec, Advertising, Logistics

Page 3: Syncing Up Testing - TriAgiletriagile.com › ... › 06 › Syncing-Up-Testing-TriAgile.pdf · 984.244.2313 Paul Merrill 2002 - First Agile Team Numbers: 16+ years, 20+ teams, 35+

www.beaufortfairmont.com 984.244.2313

OverviewYou might have a problem if… From the inside out Are things are getting better?

Page 4: Syncing Up Testing - TriAgiletriagile.com › ... › 06 › Syncing-Up-Testing-TriAgile.pdf · 984.244.2313 Paul Merrill 2002 - First Agile Team Numbers: 16+ years, 20+ teams, 35+

www.beaufortfairmont.com 984.244.2313

Page 5: Syncing Up Testing - TriAgiletriagile.com › ... › 06 › Syncing-Up-Testing-TriAgile.pdf · 984.244.2313 Paul Merrill 2002 - First Agile Team Numbers: 16+ years, 20+ teams, 35+

www.beaufortfairmont.com 984.244.2313

Page 6: Syncing Up Testing - TriAgiletriagile.com › ... › 06 › Syncing-Up-Testing-TriAgile.pdf · 984.244.2313 Paul Merrill 2002 - First Agile Team Numbers: 16+ years, 20+ teams, 35+

www.beaufortfairmont.com 984.244.2313

Assumptions

We want to deliver working code.

Working code depends on testing.

Page 7: Syncing Up Testing - TriAgiletriagile.com › ... › 06 › Syncing-Up-Testing-TriAgile.pdf · 984.244.2313 Paul Merrill 2002 - First Agile Team Numbers: 16+ years, 20+ teams, 35+

www.beaufortfairmont.com 984.244.2313

You might have a problem if…

Page 8: Syncing Up Testing - TriAgiletriagile.com › ... › 06 › Syncing-Up-Testing-TriAgile.pdf · 984.244.2313 Paul Merrill 2002 - First Agile Team Numbers: 16+ years, 20+ teams, 35+

www.beaufortfairmont.com 984.244.2313

You might have a problem if…Add-on, Testing Iterations

Work Items Don’t Work

Demoing Docs and Slides

Testers “Can’t Keep Up”

Page 9: Syncing Up Testing - TriAgiletriagile.com › ... › 06 › Syncing-Up-Testing-TriAgile.pdf · 984.244.2313 Paul Merrill 2002 - First Agile Team Numbers: 16+ years, 20+ teams, 35+

www.beaufortfairmont.com 984.244.2313

How do we get working code?

Page 10: Syncing Up Testing - TriAgiletriagile.com › ... › 06 › Syncing-Up-Testing-TriAgile.pdf · 984.244.2313 Paul Merrill 2002 - First Agile Team Numbers: 16+ years, 20+ teams, 35+

www.beaufortfairmont.com 984.244.2313

From the Inside Out

Page 11: Syncing Up Testing - TriAgiletriagile.com › ... › 06 › Syncing-Up-Testing-TriAgile.pdf · 984.244.2313 Paul Merrill 2002 - First Agile Team Numbers: 16+ years, 20+ teams, 35+

www.beaufortfairmont.com 984.244.2313

But first, let’s start with

something familiar

Page 12: Syncing Up Testing - TriAgiletriagile.com › ... › 06 › Syncing-Up-Testing-TriAgile.pdf · 984.244.2313 Paul Merrill 2002 - First Agile Team Numbers: 16+ years, 20+ teams, 35+

www.beaufortfairmont.com 984.244.2313

User Interface Controllers

Business Logic

Data Model

Outside In

Page 13: Syncing Up Testing - TriAgiletriagile.com › ... › 06 › Syncing-Up-Testing-TriAgile.pdf · 984.244.2313 Paul Merrill 2002 - First Agile Team Numbers: 16+ years, 20+ teams, 35+

www.beaufortfairmont.com 984.244.2313

User Interface Controllers

Business Logic

Data Model

Inside Out

Page 14: Syncing Up Testing - TriAgiletriagile.com › ... › 06 › Syncing-Up-Testing-TriAgile.pdf · 984.244.2313 Paul Merrill 2002 - First Agile Team Numbers: 16+ years, 20+ teams, 35+

www.beaufortfairmont.com 984.244.2313

User Interface Controllers

Business Logic

Data Model

Or…

Page 15: Syncing Up Testing - TriAgiletriagile.com › ... › 06 › Syncing-Up-Testing-TriAgile.pdf · 984.244.2313 Paul Merrill 2002 - First Agile Team Numbers: 16+ years, 20+ teams, 35+

www.beaufortfairmont.com 984.244.2313

Use a Test Driver

Page 16: Syncing Up Testing - TriAgiletriagile.com › ... › 06 › Syncing-Up-Testing-TriAgile.pdf · 984.244.2313 Paul Merrill 2002 - First Agile Team Numbers: 16+ years, 20+ teams, 35+

www.beaufortfairmont.com 984.244.2313

Popular Test Drivers

Cucumber

RobotFramework

Gauge

Page 17: Syncing Up Testing - TriAgiletriagile.com › ... › 06 › Syncing-Up-Testing-TriAgile.pdf · 984.244.2313 Paul Merrill 2002 - First Agile Team Numbers: 16+ years, 20+ teams, 35+

www.beaufortfairmont.com 984.244.2313

How Do We Use a Test Driver?

Page 18: Syncing Up Testing - TriAgiletriagile.com › ... › 06 › Syncing-Up-Testing-TriAgile.pdf · 984.244.2313 Paul Merrill 2002 - First Agile Team Numbers: 16+ years, 20+ teams, 35+

www.beaufortfairmont.com 984.244.2313

User Interface

Controllers Business Logic

Data Model

Test Driver

Page 19: Syncing Up Testing - TriAgiletriagile.com › ... › 06 › Syncing-Up-Testing-TriAgile.pdf · 984.244.2313 Paul Merrill 2002 - First Agile Team Numbers: 16+ years, 20+ teams, 35+

www.beaufortfairmont.com 984.244.2313

User Interface

Controllers Business Logic

Data Model

Test Driver

Page 20: Syncing Up Testing - TriAgiletriagile.com › ... › 06 › Syncing-Up-Testing-TriAgile.pdf · 984.244.2313 Paul Merrill 2002 - First Agile Team Numbers: 16+ years, 20+ teams, 35+

www.beaufortfairmont.com 984.244.2313

User Interface

Controllers Business Logic

Data Model

Test Driver

Page 21: Syncing Up Testing - TriAgiletriagile.com › ... › 06 › Syncing-Up-Testing-TriAgile.pdf · 984.244.2313 Paul Merrill 2002 - First Agile Team Numbers: 16+ years, 20+ teams, 35+

www.beaufortfairmont.com 984.244.2313

User Interface

Controllers Business Logic

Data Model

Tester or Test Driver

Page 22: Syncing Up Testing - TriAgiletriagile.com › ... › 06 › Syncing-Up-Testing-TriAgile.pdf · 984.244.2313 Paul Merrill 2002 - First Agile Team Numbers: 16+ years, 20+ teams, 35+

www.beaufortfairmont.com 984.244.2313

BenefitsEmpowered Testers Testing at Any Level No Waiting for UI Simplified Troubleshooting Persisted Test Cases Test Case Reusability

Test Case Repeatability Audit Log Automated Reporting Earlier Feedback & Acceptance Faster Tests

Page 23: Syncing Up Testing - TriAgiletriagile.com › ... › 06 › Syncing-Up-Testing-TriAgile.pdf · 984.244.2313 Paul Merrill 2002 - First Agile Team Numbers: 16+ years, 20+ teams, 35+

www.beaufortfairmont.com 984.244.2313

Are Things Getting Better?

Page 24: Syncing Up Testing - TriAgiletriagile.com › ... › 06 › Syncing-Up-Testing-TriAgile.pdf · 984.244.2313 Paul Merrill 2002 - First Agile Team Numbers: 16+ years, 20+ teams, 35+

www.beaufortfairmont.com 984.244.2313

Are Things Getting Better?Earlier and more frequent defects and collaboration Less “work” gets done Estimates get bigger Initial rough edges between testers and dev

– More friction can smooth those edges over time – Remember, iron sharpens iron

New awareness in retro New types of questions, more dialog in grooming and planning sessions Chunks of work start getting smaller Demos have WORKING code!

Page 25: Syncing Up Testing - TriAgiletriagile.com › ... › 06 › Syncing-Up-Testing-TriAgile.pdf · 984.244.2313 Paul Merrill 2002 - First Agile Team Numbers: 16+ years, 20+ teams, 35+

www.beaufortfairmont.com 984.244.2313

References“Agile Manifesto”, Kent Beck, et. al.

http://www.agilemanifesto.org/ “Outside in vs Inside Out - Comparing TDD Approaches”, Matt Wynne

http://blog.mattwynne.net/2010/08/31/outside-in-vs-inside-out-comparing-tdd-approaches/

“Mocks aren’t stubs”, Martin Fowler http://martinfowler.com/articles/mocksArentStubs.html

“How to Fit Testing Into the Iteration”, Rally http://www.slideshare.net/rallysoftware/how-to-fit-testing-in-the-iteration-2009-09-11

Page 26: Syncing Up Testing - TriAgiletriagile.com › ... › 06 › Syncing-Up-Testing-TriAgile.pdf · 984.244.2313 Paul Merrill 2002 - First Agile Team Numbers: 16+ years, 20+ teams, 35+

www.beaufortfairmont.com 984.244.2313

Paul Merrill Principal Software Engineer in Test, Founder

My Podcast About Software & Entrepreneurship: Reflection As A Service

Writing: beaufortfairmont.com/blog

Web: beaufortfairmont.com Email: [email protected]

Phone: 984.244.2313 Twitter: @dpaulmerrill Like us on Facebook!

Call us today - free consultation Get Testing Synced-up!

984.244.2313