An Approach to Automated Application Tuning
29
An Approach to Automated Application Tuning Mike Huang, Sr. Performance Architect Performance and Reliability Engineering
-
Upload
mike-huang -
Category
Software
-
view
109 -
download
2
Transcript of An Approach to Automated Application Tuning
An Approach toAutomated Application Tuning
Mike Huang, Sr. Performance ArchitectPerformance and Reliability Engineering
UNNECESSARY EXPOSITION
Prologue.
Copy What Someone
Else Is Doing
Tweak Until Things “Work”
Forget About It
Something Changes
Something Breaks
Tuning. Ugh.
Why?●Insufficient defaults●One-size-fits-all myth●Unfamiliar technology●Complex interactions●Time
Nirvana
●Optimal●Adaptive●Automatic
Construct a Model1. Frame the problem2. Understand interactions3. Define success4. Narrow focus5. Validate data and behavior6. Refine
ORIGIN STORY
Sceneone.
Spilled Milk
GoalImprove resiliency to downstream failures
UNLOCKING MYSTERIES
Scenetwo.
Dependency Framework
TimeoutsFallbacksRejectionsShort-circuits
TimeoutsRetriesPoolingBlacklists
Understanding Interactions
Hystrix
Service B
EVCache
EVC Client
Ribbon
Ribbon
/all/the/moviesService A
Hystrix
EVC Client
/moar/movies
Hystrix
Hystrix
Hystrix
Understanding Interactions
Hystrix
Service B
EVCache
EVC Client
Ribbon
Ribbon
/all/the/moviesService A
Hystrix
EVC Client
/moar/movies
Hystrix Workflow
Define SuccessUnder normal operations:●Expire only the most egregious requests●No concurrency constraint●No premature fallback
Under duress:●Fail fast!
Assumptions●Spectrum of desirable behavior●You can’t win them all● It’s okay to fail
Key Tunables
●Timeout●Error Threshold●Isolation Strategy
●Thread Pool Size●Queue Size●Batch Size
THE TWIST
Scenethree.
True Lies●Recommendations are
only as good as the data
●Data is only good if you understand it
Things Are Not Always As They Seem
Pick a Number, Any Number
How Low Can You Go?
THE FINAL ACT
Scenefour.
Automation? Piece of Cake
Evaluate
RecommendApply
The Cake Is a Lie!
GO HOME – THERE ARE NO STINGERS HERE
Credits.
Acknowldgements (Please Don’t Sue Me)
Slide: 4 – Parks and Recreation (Season 2, Episode 4) 5 – http://www.musiclipse.com/wp-content/uploads/2013/09/nirvana-hd-photo-band-members.jpg 6 (C) – https://rtfitch.files.wordpress.com/2014/08/bojack-horseman.jpg 6 (BoJack) – http://www.serieslyawesome.tv/wp-content/uploads/2015/05/BoJack-Horseman-Season-2.jpg 9 (Drew Barrymore) – The Wedding Singer 9 (Angel of Grief) –
https://en.wikipedia.org/wiki/Angel_of_Grief#/media/File:Emelyn_Story_Tomba_(Cimitero_Acattolico_Roma).jpg 9 (Angry Cat) – http://theeconomiccollapseblog.com/wp-content/uploads/2011/01/Angry-Cat.jpg 12 (Ribbon logo) – http://3.bp.blogspot.com/-
8OQzOCw1rXY/VdE2mxvnybI/AAAAAAAABoE/ARq3Pa4v9yI/s1600/ribbon.png 12, 18 (Hystrix logo) – https://raw.githubusercontent.com/wiki/Netflix/Hystrix/images/hystrix-logo-tagline-640.png 15 – https://github.com/Netflix/Hystrix/wiki/How-it-Works/images/hystrix-flow-chart-original.png 20 – https://fanart.tv/fanart/movies/36955/moviebackground/true-lies-51036cf5a0251.jpg 25 – http://www.fmvmagazine.com/wp-content/uploads/2012/07/Portal-cake.jpg 26 – http://theportalwiki.com/wiki/File:The_bots.png 28 – Mike Huang
