SRE @ Dropbox - LCA2016 - Tammy Butow

27
SITE RELIABILITY ENGINEERING AT DROPBOX @tammybutow, SRE MANAGER

Transcript of SRE @ Dropbox - LCA2016 - Tammy Butow

Page 1: SRE @ Dropbox - LCA2016 - Tammy Butow

SITE RELIABILITY ENGINEERING AT DROPBOX@tammybutow, SRE MANAGER

Page 2: SRE @ Dropbox - LCA2016 - Tammy Butow
Page 3: SRE @ Dropbox - LCA2016 - Tammy Butow

TODAY

Page 4: SRE @ Dropbox - LCA2016 - Tammy Butow

LET’S INVENT A BETTER FUTURE.

Page 5: SRE @ Dropbox - LCA2016 - Tammy Butow
Page 6: SRE @ Dropbox - LCA2016 - Tammy Butow

400M

Page 7: SRE @ Dropbox - LCA2016 - Tammy Butow

SITE RELIABILITY ENGINEERS

Page 8: SRE @ Dropbox - LCA2016 - Tammy Butow

SWEAT THE DETAILS

Page 9: SRE @ Dropbox - LCA2016 - Tammy Butow

AUTOMATION

Page 10: SRE @ Dropbox - LCA2016 - Tammy Butow

PYGERDUTY REDUCE PAGES BY 10x

Page 11: SRE @ Dropbox - LCA2016 - Tammy Butow

MONITORING & ALERTINGIT’S OK TO SNOOZE

Page 12: SRE @ Dropbox - LCA2016 - Tammy Butow

SCRIPTING & AUTO-REMEDIATIONSELF-HEALING SYSTEMS

Page 13: SRE @ Dropbox - LCA2016 - Tammy Butow

TOOLS

Page 14: SRE @ Dropbox - LCA2016 - Tammy Butow

HERMESQUESTS & LABORS

Page 15: SRE @ Dropbox - LCA2016 - Tammy Butow

DBMANAGERAUTOMATING DATABASE OPERATIONS

Page 16: SRE @ Dropbox - LCA2016 - Tammy Butow

SLACKBOTSWE MAKE CHAT BOTS IN GO & PYTHON

Page 17: SRE @ Dropbox - LCA2016 - Tammy Butow

AIM HIGHER

Page 18: SRE @ Dropbox - LCA2016 - Tammy Butow

ROADMAPDECIDE ON WHERE TO GO, BUT STAY FLEXIBLE

Page 19: SRE @ Dropbox - LCA2016 - Tammy Butow

DISTRIBUTED TEAMSFOLLOW THE SUN

Person with sun

Page 20: SRE @ Dropbox - LCA2016 - Tammy Butow

KTLORELIABILITY & AVAILABILITY

Page 21: SRE @ Dropbox - LCA2016 - Tammy Butow

CAPTAIN’S LOGPOST MORTEM FOR EVERY PAGE

Page 22: SRE @ Dropbox - LCA2016 - Tammy Butow

DISASTER RECOVERY TESTINGFREQUENT & CROSS-TEAM

Page 23: SRE @ Dropbox - LCA2016 - Tammy Butow

FAULT INJECTIONWHAT ARE THE UNKNOWN UNKNOWNS?

Skull with person

Page 24: SRE @ Dropbox - LCA2016 - Tammy Butow

WE NOT ICELEBRATE ACHIEVEMETS

Page 25: SRE @ Dropbox - LCA2016 - Tammy Butow

AIM HIGHER. SWEAT THE DETAILS. REDUCE PAGES. INVENT TOOLS. AUTOMATE. SCRIPT. AUTO-REMEDIATE. TRIGGER FAULTS. MONITOR. ALERT. SNOOZE.

CREATE TIME TO BUILD. PLAN. ROADMAP. TRACK. CELEBRATE.

Page 26: SRE @ Dropbox - LCA2016 - Tammy Butow

HACKALWAYS BE CODING

Page 27: SRE @ Dropbox - LCA2016 - Tammy Butow

Q&A