(ENT209) Netflix Cloud Migration, DevOps and Distributed Systems | AWS re:Invent 2014

51

description

Netflix's migration to the cloud as our primary streaming control plane was paralleled by our move from traditional IT and centralized operations to a more decentralized DevOps organizational model. In this session, we explore the relationship between technical infrastructure and organization and how to find the right balance of centralized and decentralized operations. We also cover the rationale, goals, strategies, and technologies applied to accomplish this daunting task. We reflect on where we stand today and how we've realized many of our goals.

Transcript of (ENT209) Netflix Cloud Migration, DevOps and Distributed Systems | AWS re:Invent 2014

Page 1: (ENT209) Netflix Cloud Migration, DevOps and Distributed Systems | AWS re:Invent 2014
Page 2: (ENT209) Netflix Cloud Migration, DevOps and Distributed Systems | AWS re:Invent 2014
Page 3: (ENT209) Netflix Cloud Migration, DevOps and Distributed Systems | AWS re:Invent 2014
Page 4: (ENT209) Netflix Cloud Migration, DevOps and Distributed Systems | AWS re:Invent 2014

Single points of failure:

Expensive robust hardware

Blade

Webserver

Non-scalable load

Monolithic app

Embedded PL/SQL

business logic

Potential Problems:

Oracle on

High Perf

Disc Array

Multi-proc

DB Server

Page 5: (ENT209) Netflix Cloud Migration, DevOps and Distributed Systems | AWS re:Invent 2014
Page 6: (ENT209) Netflix Cloud Migration, DevOps and Distributed Systems | AWS re:Invent 2014
Page 7: (ENT209) Netflix Cloud Migration, DevOps and Distributed Systems | AWS re:Invent 2014
Page 8: (ENT209) Netflix Cloud Migration, DevOps and Distributed Systems | AWS re:Invent 2014
Page 9: (ENT209) Netflix Cloud Migration, DevOps and Distributed Systems | AWS re:Invent 2014
Page 10: (ENT209) Netflix Cloud Migration, DevOps and Distributed Systems | AWS re:Invent 2014
Page 11: (ENT209) Netflix Cloud Migration, DevOps and Distributed Systems | AWS re:Invent 2014

1999 2007 2008 2009 2010 2011 2012 2013 2014 2015

Page 12: (ENT209) Netflix Cloud Migration, DevOps and Distributed Systems | AWS re:Invent 2014
Page 13: (ENT209) Netflix Cloud Migration, DevOps and Distributed Systems | AWS re:Invent 2014

Oracle on

High Perf

Disc Array

Multi-proc

DB Server

Blade

Webserver

Amazon

EC2

Webserver

Middle Tier

Apps

Amazon

EC2

API server

Amazon

SimpleDB

Page 14: (ENT209) Netflix Cloud Migration, DevOps and Distributed Systems | AWS re:Invent 2014

Oracle on

High Perf

Disc Array

Multi-proc

DB Server

Blade

Webserver

Amazon

EC2

Webserver

Middle Tier

Apps

Amazon

EC2

API server

Amazon

SimpleDB

Page 15: (ENT209) Netflix Cloud Migration, DevOps and Distributed Systems | AWS re:Invent 2014

Oracle on

High Perf

Disc Array

Multi-proc

DB Server

Blade

Webserver

Amazon

EC2

Webserver

Middle Tier

Apps

Amazon

EC2

API server

Amazon

SimpleDB

Page 16: (ENT209) Netflix Cloud Migration, DevOps and Distributed Systems | AWS re:Invent 2014
Page 17: (ENT209) Netflix Cloud Migration, DevOps and Distributed Systems | AWS re:Invent 2014
Page 18: (ENT209) Netflix Cloud Migration, DevOps and Distributed Systems | AWS re:Invent 2014
Page 19: (ENT209) Netflix Cloud Migration, DevOps and Distributed Systems | AWS re:Invent 2014
Page 20: (ENT209) Netflix Cloud Migration, DevOps and Distributed Systems | AWS re:Invent 2014
Page 21: (ENT209) Netflix Cloud Migration, DevOps and Distributed Systems | AWS re:Invent 2014
Page 22: (ENT209) Netflix Cloud Migration, DevOps and Distributed Systems | AWS re:Invent 2014

Amazon

SimpleDBcassandra

Amazon

DynamoDB

Page 23: (ENT209) Netflix Cloud Migration, DevOps and Distributed Systems | AWS re:Invent 2014
Page 24: (ENT209) Netflix Cloud Migration, DevOps and Distributed Systems | AWS re:Invent 2014
Page 25: (ENT209) Netflix Cloud Migration, DevOps and Distributed Systems | AWS re:Invent 2014
Page 26: (ENT209) Netflix Cloud Migration, DevOps and Distributed Systems | AWS re:Invent 2014
Page 27: (ENT209) Netflix Cloud Migration, DevOps and Distributed Systems | AWS re:Invent 2014
Page 28: (ENT209) Netflix Cloud Migration, DevOps and Distributed Systems | AWS re:Invent 2014
Page 29: (ENT209) Netflix Cloud Migration, DevOps and Distributed Systems | AWS re:Invent 2014
Page 30: (ENT209) Netflix Cloud Migration, DevOps and Distributed Systems | AWS re:Invent 2014

1 10 100 1000

99.999%

99.99%

99.9%

99%

Rate of Change

Availa

bili

ty

Frontier of

availability/change

Page 31: (ENT209) Netflix Cloud Migration, DevOps and Distributed Systems | AWS re:Invent 2014

1 10 100 1000

99.999%

99.99%

99.9%

99%

Rate of Change

Availa

bili

ty

Frontier of

availability/change

Page 32: (ENT209) Netflix Cloud Migration, DevOps and Distributed Systems | AWS re:Invent 2014

1 10 100 1000

99.999%

99.99%

99.9%

99%

Rate of Change

Availa

bili

ty

Page 33: (ENT209) Netflix Cloud Migration, DevOps and Distributed Systems | AWS re:Invent 2014

never

Page 34: (ENT209) Netflix Cloud Migration, DevOps and Distributed Systems | AWS re:Invent 2014
Page 35: (ENT209) Netflix Cloud Migration, DevOps and Distributed Systems | AWS re:Invent 2014
Page 36: (ENT209) Netflix Cloud Migration, DevOps and Distributed Systems | AWS re:Invent 2014
Page 37: (ENT209) Netflix Cloud Migration, DevOps and Distributed Systems | AWS re:Invent 2014
Page 38: (ENT209) Netflix Cloud Migration, DevOps and Distributed Systems | AWS re:Invent 2014
Page 39: (ENT209) Netflix Cloud Migration, DevOps and Distributed Systems | AWS re:Invent 2014
Page 40: (ENT209) Netflix Cloud Migration, DevOps and Distributed Systems | AWS re:Invent 2014
Page 41: (ENT209) Netflix Cloud Migration, DevOps and Distributed Systems | AWS re:Invent 2014
Page 42: (ENT209) Netflix Cloud Migration, DevOps and Distributed Systems | AWS re:Invent 2014

• Performance

• Scale

• Availability (redundancy, dependencies,

configurations, etc.)

• Security

• Privacy

• Retiring tech-debt

If it matters, don’t delegate it!

Page 43: (ENT209) Netflix Cloud Migration, DevOps and Distributed Systems | AWS re:Invent 2014

by the line manager responsible for the –ility debts

Features,

Testing

Availability

Scalability

Performance

Tech-debt

…tradeoff…

Page 44: (ENT209) Netflix Cloud Migration, DevOps and Distributed Systems | AWS re:Invent 2014
Page 45: (ENT209) Netflix Cloud Migration, DevOps and Distributed Systems | AWS re:Invent 2014
Page 46: (ENT209) Netflix Cloud Migration, DevOps and Distributed Systems | AWS re:Invent 2014
Page 47: (ENT209) Netflix Cloud Migration, DevOps and Distributed Systems | AWS re:Invent 2014
Page 48: (ENT209) Netflix Cloud Migration, DevOps and Distributed Systems | AWS re:Invent 2014
Page 49: (ENT209) Netflix Cloud Migration, DevOps and Distributed Systems | AWS re:Invent 2014
Page 50: (ENT209) Netflix Cloud Migration, DevOps and Distributed Systems | AWS re:Invent 2014

Talk Time Title

Page 51: (ENT209) Netflix Cloud Migration, DevOps and Distributed Systems | AWS re:Invent 2014

Please give us your feedback on this session.

Complete session evaluations and earn re:Invent swag.

http://bit.ly/awsevals