Performance test - YaJUG Octobre 2012
-
Upload
claude-falguiere -
Category
Technology
-
view
2.525 -
download
0
description
Transcript of Performance test - YaJUG Octobre 2012
![Page 1: Performance test - YaJUG Octobre 2012](https://reader033.fdocuments.net/reader033/viewer/2022060112/55700b21d8b42ac0178b48d5/html5/thumbnails/1.jpg)
YAJUG - Octobre 2012Claude Falguière @cfalguiere goo.gl/4mmJQ
DES TESTS DE PERFORMANCES ...MAIS POURQUOI ?
DES TESTS DE PERFORMANCES ...MAIS POURQUOI ?
mercredi 7 novembre 12
![Page 2: Performance test - YaJUG Octobre 2012](https://reader033.fdocuments.net/reader033/viewer/2022060112/55700b21d8b42ac0178b48d5/html5/thumbnails/2.jpg)
CLAUDE FALGUIERE
@cfalguiere
Technical architect
http://cfalguiere.wordpress.com
Duchess France JUG Leader
+Claude Falguiere
mercredi 7 novembre 12
![Page 3: Performance test - YaJUG Octobre 2012](https://reader033.fdocuments.net/reader033/viewer/2022060112/55700b21d8b42ac0178b48d5/html5/thumbnails/3.jpg)
performance
how to persuade your boss
design relevant tests
be aware of bias
prepare for the go live
mercredi 7 novembre 12
![Page 4: Performance test - YaJUG Octobre 2012](https://reader033.fdocuments.net/reader033/viewer/2022060112/55700b21d8b42ac0178b48d5/html5/thumbnails/4.jpg)
marathon
Performance ?
sprintou
mercredi 7 novembre 12
![Page 5: Performance test - YaJUG Octobre 2012](https://reader033.fdocuments.net/reader033/viewer/2022060112/55700b21d8b42ac0178b48d5/html5/thumbnails/5.jpg)
speedcapacity
volumeor
or
mercredi 7 novembre 12
![Page 6: Performance test - YaJUG Octobre 2012](https://reader033.fdocuments.net/reader033/viewer/2022060112/55700b21d8b42ac0178b48d5/html5/thumbnails/6.jpg)
and availability
mercredi 7 novembre 12
![Page 7: Performance test - YaJUG Octobre 2012](https://reader033.fdocuments.net/reader033/viewer/2022060112/55700b21d8b42ac0178b48d5/html5/thumbnails/7.jpg)
and efficiency
mercredi 7 novembre 12
![Page 8: Performance test - YaJUG Octobre 2012](https://reader033.fdocuments.net/reader033/viewer/2022060112/55700b21d8b42ac0178b48d5/html5/thumbnails/8.jpg)
2 s 6 s 8 sattente constaté
distance between happy and unhappy
It can be measured ...
mercredi 7 novembre 12
![Page 9: Performance test - YaJUG Octobre 2012](https://reader033.fdocuments.net/reader033/viewer/2022060112/55700b21d8b42ac0178b48d5/html5/thumbnails/9.jpg)
assumed complexity
rendering order
performance stability
... and it depends on users
mercredi 7 novembre 12
![Page 10: Performance test - YaJUG Octobre 2012](https://reader033.fdocuments.net/reader033/viewer/2022060112/55700b21d8b42ac0178b48d5/html5/thumbnails/10.jpg)
We use the most performing frameworks !
Let’s upgrade the CPU
Let’s go to the Cloud
1
2
3
mercredi 7 novembre 12
![Page 11: Performance test - YaJUG Octobre 2012](https://reader033.fdocuments.net/reader033/viewer/2022060112/55700b21d8b42ac0178b48d5/html5/thumbnails/11.jpg)
Performance enhancement
costsrevenues
Faster
Amazon :+100 ms -1% sales
Google : +500 ms –20% pages seen
mercredi 7 novembre 12
![Page 12: Performance test - YaJUG Octobre 2012](https://reader033.fdocuments.net/reader033/viewer/2022060112/55700b21d8b42ac0178b48d5/html5/thumbnails/12.jpg)
Less calls to the call centerLess customers in the office
savings
Performanceenhancement
costs
mercredi 7 novembre 12
![Page 13: Performance test - YaJUG Octobre 2012](https://reader033.fdocuments.net/reader033/viewer/2022060112/55700b21d8b42ac0178b48d5/html5/thumbnails/13.jpg)
savings
Less resources
Performance enhancement
costs
mercredi 7 novembre 12
![Page 14: Performance test - YaJUG Octobre 2012](https://reader033.fdocuments.net/reader033/viewer/2022060112/55700b21d8b42ac0178b48d5/html5/thumbnails/14.jpg)
Performance enhancement
temps
costs
revenues
More turnover
Less costs
mercredi 7 novembre 12
![Page 15: Performance test - YaJUG Octobre 2012](https://reader033.fdocuments.net/reader033/viewer/2022060112/55700b21d8b42ac0178b48d5/html5/thumbnails/15.jpg)
An endless struggle
mercredi 7 novembre 12
![Page 16: Performance test - YaJUG Octobre 2012](https://reader033.fdocuments.net/reader033/viewer/2022060112/55700b21d8b42ac0178b48d5/html5/thumbnails/16.jpg)
Individual Group Crowd
Behavior under stress
mercredi 7 novembre 12
![Page 17: Performance test - YaJUG Octobre 2012](https://reader033.fdocuments.net/reader033/viewer/2022060112/55700b21d8b42ac0178b48d5/html5/thumbnails/17.jpg)
Crowd
«unit» Test
breakdown
Individual Group
Slowness
Iterations
Volume
Wait and timeouts
mercredi 7 novembre 12
![Page 18: Performance test - YaJUG Octobre 2012](https://reader033.fdocuments.net/reader033/viewer/2022060112/55700b21d8b42ac0178b48d5/html5/thumbnails/18.jpg)
YSlow Page Speed
HTTP Proxy
mercredi 7 novembre 12
![Page 19: Performance test - YaJUG Octobre 2012](https://reader033.fdocuments.net/reader033/viewer/2022060112/55700b21d8b42ac0178b48d5/html5/thumbnails/19.jpg)
mercredi 7 novembre 12
![Page 20: Performance test - YaJUG Octobre 2012](https://reader033.fdocuments.net/reader033/viewer/2022060112/55700b21d8b42ac0178b48d5/html5/thumbnails/20.jpg)
Crowd
mimic a few concurrent users
Individual Grouprace conditioncontentionlive/dead locks
mercredi 7 novembre 12
![Page 21: Performance test - YaJUG Octobre 2012](https://reader033.fdocuments.net/reader033/viewer/2022060112/55700b21d8b42ac0178b48d5/html5/thumbnails/21.jpg)
Foule
Load test Peak stress test
Individu GroupeCapacity bounds
Overloading Leaks
Aging test Failure simulation
iso-prod
mercredi 7 novembre 12
![Page 22: Performance test - YaJUG Octobre 2012](https://reader033.fdocuments.net/reader033/viewer/2022060112/55700b21d8b42ac0178b48d5/html5/thumbnails/22.jpg)
Sizing according to the capacity
mercredi 7 novembre 12
![Page 23: Performance test - YaJUG Octobre 2012](https://reader033.fdocuments.net/reader033/viewer/2022060112/55700b21d8b42ac0178b48d5/html5/thumbnails/23.jpg)
REQ-1234 : High performance is required
mercredi 7 novembre 12
![Page 24: Performance test - YaJUG Octobre 2012](https://reader033.fdocuments.net/reader033/viewer/2022060112/55700b21d8b42ac0178b48d5/html5/thumbnails/24.jpg)
Who ?
What ?
Where ?
When ?
How ?
Why ?
mercredi 7 novembre 12
![Page 25: Performance test - YaJUG Octobre 2012](https://reader033.fdocuments.net/reader033/viewer/2022060112/55700b21d8b42ac0178b48d5/html5/thumbnails/25.jpg)
Essential
Frequent
High-Risk
FrequentFrequent
FrequentWhat are they doing ?
mercredi 7 novembre 12
![Page 26: Performance test - YaJUG Octobre 2012](https://reader033.fdocuments.net/reader033/viewer/2022060112/55700b21d8b42ac0178b48d5/html5/thumbnails/26.jpg)
mercredi 7 novembre 12
![Page 27: Performance test - YaJUG Octobre 2012](https://reader033.fdocuments.net/reader033/viewer/2022060112/55700b21d8b42ac0178b48d5/html5/thumbnails/27.jpg)
mercredi 7 novembre 12
![Page 28: Performance test - YaJUG Octobre 2012](https://reader033.fdocuments.net/reader033/viewer/2022060112/55700b21d8b42ac0178b48d5/html5/thumbnails/28.jpg)
REQ-5678 : Landpage should show up in less than 600 ms
mercredi 7 novembre 12
![Page 29: Performance test - YaJUG Octobre 2012](https://reader033.fdocuments.net/reader033/viewer/2022060112/55700b21d8b42ac0178b48d5/html5/thumbnails/29.jpg)
Time Serie
and distribution
mercredi 7 novembre 12
![Page 30: Performance test - YaJUG Octobre 2012](https://reader033.fdocuments.net/reader033/viewer/2022060112/55700b21d8b42ac0178b48d5/html5/thumbnails/30.jpg)
Moyenne 1,2s 90% des relevés sont < 3,5s
Unaware of
StrikingRare
Quantile 90% = 3,5s
mercredi 7 novembre 12
![Page 31: Performance test - YaJUG Octobre 2012](https://reader033.fdocuments.net/reader033/viewer/2022060112/55700b21d8b42ac0178b48d5/html5/thumbnails/31.jpg)
Some bad response time
Unstable response time
Bimodal !? ...
mercredi 7 novembre 12
![Page 32: Performance test - YaJUG Octobre 2012](https://reader033.fdocuments.net/reader033/viewer/2022060112/55700b21d8b42ac0178b48d5/html5/thumbnails/32.jpg)
Goals and drivers
Indicators
Scenarios
Volumes
Datasets
Types of test and duration
Target platform
mercredi 7 novembre 12
![Page 33: Performance test - YaJUG Octobre 2012](https://reader033.fdocuments.net/reader033/viewer/2022060112/55700b21d8b42ac0178b48d5/html5/thumbnails/33.jpg)
Garbage in - Garbage outrepresentativeness
mercredi 7 novembre 12
![Page 34: Performance test - YaJUG Octobre 2012](https://reader033.fdocuments.net/reader033/viewer/2022060112/55700b21d8b42ac0178b48d5/html5/thumbnails/34.jpg)
bias
mercredi 7 novembre 12
![Page 35: Performance test - YaJUG Octobre 2012](https://reader033.fdocuments.net/reader033/viewer/2022060112/55700b21d8b42ac0178b48d5/html5/thumbnails/35.jpg)
Find biases to improve the result
Find biases to degrade the result
mercredi 7 novembre 12
![Page 36: Performance test - YaJUG Octobre 2012](https://reader033.fdocuments.net/reader033/viewer/2022060112/55700b21d8b42ac0178b48d5/html5/thumbnails/36.jpg)
volumesscenario, data, search phrases
cachestest duration and rate
ignore errorsignore uncommon use cases
SimplifyArrange
mercredi 7 novembre 12
![Page 37: Performance test - YaJUG Octobre 2012](https://reader033.fdocuments.net/reader033/viewer/2022060112/55700b21d8b42ac0178b48d5/html5/thumbnails/37.jpg)
Which show better results ?
A B
mercredi 7 novembre 12
![Page 38: Performance test - YaJUG Octobre 2012](https://reader033.fdocuments.net/reader033/viewer/2022060112/55700b21d8b42ac0178b48d5/html5/thumbnails/38.jpg)
Which shows more errors ?
A B
mercredi 7 novembre 12
![Page 39: Performance test - YaJUG Octobre 2012](https://reader033.fdocuments.net/reader033/viewer/2022060112/55700b21d8b42ac0178b48d5/html5/thumbnails/39.jpg)
Iso-prod not required
algorithmscontentionsrobustnessscalability
agingfailure simulation
Anticipate
Iso-prod
load test (capacity)response time
reliability on load
mercredi 7 novembre 12
![Page 40: Performance test - YaJUG Octobre 2012](https://reader033.fdocuments.net/reader033/viewer/2022060112/55700b21d8b42ac0178b48d5/html5/thumbnails/40.jpg)
Design for failure
mercredi 7 novembre 12
![Page 41: Performance test - YaJUG Octobre 2012](https://reader033.fdocuments.net/reader033/viewer/2022060112/55700b21d8b42ac0178b48d5/html5/thumbnails/41.jpg)
Test to learn
mercredi 7 novembre 12
![Page 42: Performance test - YaJUG Octobre 2012](https://reader033.fdocuments.net/reader033/viewer/2022060112/55700b21d8b42ac0178b48d5/html5/thumbnails/42.jpg)
Prepare monitoring
mercredi 7 novembre 12
![Page 43: Performance test - YaJUG Octobre 2012](https://reader033.fdocuments.net/reader033/viewer/2022060112/55700b21d8b42ac0178b48d5/html5/thumbnails/43.jpg)
Claude Falguiè[email protected]/4mmJQ
Thank you
"Reality is merely an illusion, albeit a very persistent one. "- Albert Einstein
mercredi 7 novembre 12