Startup Growth Academy #5: Do-it-yourself usability testing for startups
Testing and beyond at startups
-
Upload
mona-soni -
Category
Technology
-
view
553 -
download
0
Transcript of Testing and beyond at startups
![Page 1: Testing and beyond at startups](https://reader030.fdocuments.net/reader030/viewer/2022032422/55a9a6be1a28abba518b489d/html5/thumbnails/1.jpg)
PROPRIETARY
Testing at StartupsMona SoniQA Engineer
Dec 5, 2012
![Page 2: Testing and beyond at startups](https://reader030.fdocuments.net/reader030/viewer/2022032422/55a9a6be1a28abba518b489d/html5/thumbnails/2.jpg)
PROPRIETARY
![Page 3: Testing and beyond at startups](https://reader030.fdocuments.net/reader030/viewer/2022032422/55a9a6be1a28abba518b489d/html5/thumbnails/3.jpg)
PROPRIETARY
What happens when you discover an issue in production?
......Quickfix!
![Page 4: Testing and beyond at startups](https://reader030.fdocuments.net/reader030/viewer/2022032422/55a9a6be1a28abba518b489d/html5/thumbnails/4.jpg)
PROPRIETARY
![Page 5: Testing and beyond at startups](https://reader030.fdocuments.net/reader030/viewer/2022032422/55a9a6be1a28abba518b489d/html5/thumbnails/5.jpg)
PROPRIETARY
End Product!!!
![Page 6: Testing and beyond at startups](https://reader030.fdocuments.net/reader030/viewer/2022032422/55a9a6be1a28abba518b489d/html5/thumbnails/6.jpg)
PROPRIETARY
why startups don’t test??
![Page 7: Testing and beyond at startups](https://reader030.fdocuments.net/reader030/viewer/2022032422/55a9a6be1a28abba518b489d/html5/thumbnails/7.jpg)
PROPRIETARY
didn't have enough time to write unit tests for my code
Cost of hiring a tester
cost of setting up a test environment
pressure to get project up and running
time to market
![Page 8: Testing and beyond at startups](https://reader030.fdocuments.net/reader030/viewer/2022032422/55a9a6be1a28abba518b489d/html5/thumbnails/8.jpg)
PROPRIETARY
Drawbacks of this approach?
![Page 9: Testing and beyond at startups](https://reader030.fdocuments.net/reader030/viewer/2022032422/55a9a6be1a28abba518b489d/html5/thumbnails/9.jpg)
PROPRIETARY
Hiring
training and on boarding
Higher risk Growth
![Page 10: Testing and beyond at startups](https://reader030.fdocuments.net/reader030/viewer/2022032422/55a9a6be1a28abba518b489d/html5/thumbnails/10.jpg)
PROPRIETARY
How do we roll at Intent Media........?
![Page 11: Testing and beyond at startups](https://reader030.fdocuments.net/reader030/viewer/2022032422/55a9a6be1a28abba518b489d/html5/thumbnails/11.jpg)
PROPRIETARY
![Page 12: Testing and beyond at startups](https://reader030.fdocuments.net/reader030/viewer/2022032422/55a9a6be1a28abba518b489d/html5/thumbnails/12.jpg)
PROPRIETARY
What do we use to make this effective
![Page 13: Testing and beyond at startups](https://reader030.fdocuments.net/reader030/viewer/2022032422/55a9a6be1a28abba518b489d/html5/thumbnails/13.jpg)
PROPRIETARY
BDD
![Page 14: Testing and beyond at startups](https://reader030.fdocuments.net/reader030/viewer/2022032422/55a9a6be1a28abba518b489d/html5/thumbnails/14.jpg)
PROPRIETARY
![Page 15: Testing and beyond at startups](https://reader030.fdocuments.net/reader030/viewer/2022032422/55a9a6be1a28abba518b489d/html5/thumbnails/15.jpg)
PROPRIETARY
Junit tests: 4278
Rspec tests: 3871
Cucumber tests: 631
Test Coverage
![Page 16: Testing and beyond at startups](https://reader030.fdocuments.net/reader030/viewer/2022032422/55a9a6be1a28abba518b489d/html5/thumbnails/16.jpg)
PROPRIETARY
Intent Media Ads
![Page 17: Testing and beyond at startups](https://reader030.fdocuments.net/reader030/viewer/2022032422/55a9a6be1a28abba518b489d/html5/thumbnails/17.jpg)
PROPRIETARY
Cross Browser Testing
![Page 18: Testing and beyond at startups](https://reader030.fdocuments.net/reader030/viewer/2022032422/55a9a6be1a28abba518b489d/html5/thumbnails/18.jpg)
PROPRIETARY
Our code network graph
![Page 19: Testing and beyond at startups](https://reader030.fdocuments.net/reader030/viewer/2022032422/55a9a6be1a28abba518b489d/html5/thumbnails/19.jpg)
PROPRIETARY
Capybara
Celerity
Capybara-webkit
WebDriver
Automation suite
![Page 20: Testing and beyond at startups](https://reader030.fdocuments.net/reader030/viewer/2022032422/55a9a6be1a28abba518b489d/html5/thumbnails/20.jpg)
PROPRIETARY
![Page 21: Testing and beyond at startups](https://reader030.fdocuments.net/reader030/viewer/2022032422/55a9a6be1a28abba518b489d/html5/thumbnails/21.jpg)
PROPRIETARY
Does BDD really work???
![Page 22: Testing and beyond at startups](https://reader030.fdocuments.net/reader030/viewer/2022032422/55a9a6be1a28abba518b489d/html5/thumbnails/22.jpg)
PROPRIETARY
Conventional project team
BDD project team
Only testers write the automation tests
developers and testers (sometimes product managers)
together own the tests
need to document test cases separately
BDD features are the test documentation
updating test cases and requirements with ever changing
scope is a huge task
BDD features serve the purpose of requirements as tests are written in business language
hiring and on boarding is difficulthelps both developers and testers in understanding
functionality
![Page 23: Testing and beyond at startups](https://reader030.fdocuments.net/reader030/viewer/2022032422/55a9a6be1a28abba518b489d/html5/thumbnails/23.jpg)
PROPRIETARY
we don’t have time to write code without tests
less issues in production
we use developer machines for testing
we have been writing tests since day one and thats our strength
we do daily releases
![Page 24: Testing and beyond at startups](https://reader030.fdocuments.net/reader030/viewer/2022032422/55a9a6be1a28abba518b489d/html5/thumbnails/24.jpg)
PROPRIETARY
challenges
HiringBuild flakiness
UI tests
![Page 25: Testing and beyond at startups](https://reader030.fdocuments.net/reader030/viewer/2022032422/55a9a6be1a28abba518b489d/html5/thumbnails/25.jpg)
PROPRIETARY