Austin agile conf 2012 infrastructure automation-gmiranda
-
Upload
george-miranda -
Category
Technology
-
view
107 -
download
0
description
Transcript of Austin agile conf 2012 infrastructure automation-gmiranda
![Page 1: Austin agile conf 2012 infrastructure automation-gmiranda](https://reader034.fdocuments.net/reader034/viewer/2022051515/54c718404a7959532d8b456d/html5/thumbnails/1.jpg)
Agility Through Infrastructure Automation
George [email protected]
Austin Agile Conference 2012November 16, 2012
Friday, November 16, 12
![Page 2: Austin agile conf 2012 infrastructure automation-gmiranda](https://reader034.fdocuments.net/reader034/viewer/2022051515/54c718404a7959532d8b456d/html5/thumbnails/2.jpg)
Introductions# finger $(whoami)Login: gmiranda! ! ! ! ! ! ! Name: George MirandaDirectory: /home/gmiranda! ! ! Shell: /bin/bashOn since Mon 14 Apr 1997 18:01 (GMT) on tty1 from :0No mail on [email protected]:
twitter:! gmiranda23github:!! gmiranda23irc:!! ! gmiranda23! (irc.freenode.net - #chef)community:!gmiranda23! (community.opscode.com)role:! ! consultant, evangelist, trainer, *:*
Friday, November 16, 12
![Page 3: Austin agile conf 2012 infrastructure automation-gmiranda](https://reader034.fdocuments.net/reader034/viewer/2022051515/54c718404a7959532d8b456d/html5/thumbnails/3.jpg)
Scope
Friday, November 16, 12
![Page 4: Austin agile conf 2012 infrastructure automation-gmiranda](https://reader034.fdocuments.net/reader034/viewer/2022051515/54c718404a7959532d8b456d/html5/thumbnails/4.jpg)
ScopeAutomation + Culture = Agility
Friday, November 16, 12
![Page 5: Austin agile conf 2012 infrastructure automation-gmiranda](https://reader034.fdocuments.net/reader034/viewer/2022051515/54c718404a7959532d8b456d/html5/thumbnails/5.jpg)
ScopeAutomation + Culture = Agility
• Infrastructure Automation Approaches
Friday, November 16, 12
![Page 6: Austin agile conf 2012 infrastructure automation-gmiranda](https://reader034.fdocuments.net/reader034/viewer/2022051515/54c718404a7959532d8b456d/html5/thumbnails/6.jpg)
ScopeAutomation + Culture = Agility
• Infrastructure Automation Approaches
• Infrastructure & Automation Best Practices
Friday, November 16, 12
![Page 7: Austin agile conf 2012 infrastructure automation-gmiranda](https://reader034.fdocuments.net/reader034/viewer/2022051515/54c718404a7959532d8b456d/html5/thumbnails/7.jpg)
ScopeAutomation + Culture = Agility
• Infrastructure Automation Approaches
• Infrastructure & Automation Best Practices
• Cultural Pitfalls
Friday, November 16, 12
![Page 8: Austin agile conf 2012 infrastructure automation-gmiranda](https://reader034.fdocuments.net/reader034/viewer/2022051515/54c718404a7959532d8b456d/html5/thumbnails/8.jpg)
ScopeAutomation + Culture = Agility
• Infrastructure Automation Approaches
• Infrastructure & Automation Best Practices
• Cultural Pitfalls
• Making more awesome
Friday, November 16, 12
![Page 9: Austin agile conf 2012 infrastructure automation-gmiranda](https://reader034.fdocuments.net/reader034/viewer/2022051515/54c718404a7959532d8b456d/html5/thumbnails/9.jpg)
ScopeAutomation + Culture = Agility
• Infrastructure Automation Approaches
• Infrastructure & Automation Best Practices
• Cultural Pitfalls
• Making more awesome
What this talk is not
• Chef vs. Puppet
• Cloud All The Things!!!
• How to structure your Organization
• Which Development Model to adopt
Friday, November 16, 12
![Page 10: Austin agile conf 2012 infrastructure automation-gmiranda](https://reader034.fdocuments.net/reader034/viewer/2022051515/54c718404a7959532d8b456d/html5/thumbnails/10.jpg)
System Build Approaches
http://www.flickr.com/photos/dancedaoc/3083836988/sizes/z/in/photostream/
Friday, November 16, 12
![Page 11: Austin agile conf 2012 infrastructure automation-gmiranda](https://reader034.fdocuments.net/reader034/viewer/2022051515/54c718404a7959532d8b456d/html5/thumbnails/11.jpg)
Complications
• “That one host” you know you can’t rebuild
• Untracked configuration change
• Collections of Bash, PERL, Python, ???
• Rebuild from: wiki, cheatsheets, folklore
http://www.flickr.com/photos/humblog/4996661110/sizes/l/in/photostream/
Friday, November 16, 12
![Page 12: Austin agile conf 2012 infrastructure automation-gmiranda](https://reader034.fdocuments.net/reader034/viewer/2022051515/54c718404a7959532d8b456d/html5/thumbnails/12.jpg)
Unprecedented Growth
1990 1991 1992 1993 1994 1995 1996 1997 1998 1999 2000 2001 2002 2003 2004 2005 2006 2007 2008 2009 2010 2011 2012 2013 2014 2015 1980 1981 1982 1983 1984 1985 1986 1987 1988 1989
Virtual Nodes
Physical Hardware
1980 1981 1982 1983 1984 1985 1986 1987 1988 1989 1990 1991 1992 1993 1994 1995 1996 1997 1998 1999 2000 2001 2002 2003 2004 2005 2006 2007 2008 2009 2010 2011 2012 2013 2014 2015
Friday, November 16, 12
![Page 13: Austin agile conf 2012 infrastructure automation-gmiranda](https://reader034.fdocuments.net/reader034/viewer/2022051515/54c718404a7959532d8b456d/html5/thumbnails/13.jpg)
Unprecedented Growth
1990 1991 1992 1993 1994 1995 1996 1997 1998 1999 2000 2001 2002 2003 2004 2005 2006 2007 2008 2009 2010 2011 2012 2013 2014 2015 1980 1981 1982 1983 1984 1985 1986 1987 1988 1989
Virtual Nodes
Physical Hardware
1980Mainframe
1980 1981 1982 1983 1984 1985 1986 1987 1988 1989 1990 1991 1992 1993 1994 1995 1996 1997 1998 1999 2000 2001 2002 2003 2004 2005 2006 2007 2008 2009 2010 2011 2012 2013 2014 2015
Friday, November 16, 12
![Page 14: Austin agile conf 2012 infrastructure automation-gmiranda](https://reader034.fdocuments.net/reader034/viewer/2022051515/54c718404a7959532d8b456d/html5/thumbnails/14.jpg)
Unprecedented Growth
1990 1991 1992 1993 1994 1995 1996 1997 1998 1999 2000 2001 2002 2003 2004 2005 2006 2007 2008 2009 2010 2011 2012 2013 2014 2015 1980 1981 1982 1983 1984 1985 1986 1987 1988 1989
Virtual Nodes
Physical Hardware
1980Mainframe
1990Client/Server
1980 1981 1982 1983 1984 1985 1986 1987 1988 1989 1990 1991 1992 1993 1994 1995 1996 1997 1998 1999 2000 2001 2002 2003 2004 2005 2006 2007 2008 2009 2010 2011 2012 2013 2014 2015
Friday, November 16, 12
![Page 15: Austin agile conf 2012 infrastructure automation-gmiranda](https://reader034.fdocuments.net/reader034/viewer/2022051515/54c718404a7959532d8b456d/html5/thumbnails/15.jpg)
Unprecedented Growth
1990 1991 1992 1993 1994 1995 1996 1997 1998 1999 2000 2001 2002 2003 2004 2005 2006 2007 2008 2009 2010 2011 2012 2013 2014 2015 1980 1981 1982 1983 1984 1985 1986 1987 1988 1989
Virtual Nodes
Physical Hardware
1980Mainframe
1990Client/Server
2000Datacenter
1980 1981 1982 1983 1984 1985 1986 1987 1988 1989 1990 1991 1992 1993 1994 1995 1996 1997 1998 1999 2000 2001 2002 2003 2004 2005 2006 2007 2008 2009 2010 2011 2012 2013 2014 2015
Friday, November 16, 12
![Page 16: Austin agile conf 2012 infrastructure automation-gmiranda](https://reader034.fdocuments.net/reader034/viewer/2022051515/54c718404a7959532d8b456d/html5/thumbnails/16.jpg)
Unprecedented Growth
1990 1991 1992 1993 1994 1995 1996 1997 1998 1999 2000 2001 2002 2003 2004 2005 2006 2007 2008 2009 2010 2011 2012 2013 2014 2015 1980 1981 1982 1983 1984 1985 1986 1987 1988 1989
Virtual Nodes
Physical Hardware
1980Mainframe
1990Client/Server
2000Datacenter
2010+Cloud
1980 1981 1982 1983 1984 1985 1986 1987 1988 1989 1990 1991 1992 1993 1994 1995 1996 1997 1998 1999 2000 2001 2002 2003 2004 2005 2006 2007 2008 2009 2010 2011 2012 2013 2014 2015
Friday, November 16, 12
![Page 17: Austin agile conf 2012 infrastructure automation-gmiranda](https://reader034.fdocuments.net/reader034/viewer/2022051515/54c718404a7959532d8b456d/html5/thumbnails/17.jpg)
Unprecedented Growth
1990 1991 1992 1993 1994 1995 1996 1997 1998 1999 2000 2001 2002 2003 2004 2005 2006 2007 2008 2009 2010 2011 2012 2013 2014 2015 1980 1981 1982 1983 1984 1985 1986 1987 1988 1989
Virtual Nodes
Physical Hardware
1980Mainframe
1990Client/Server
2000Datacenter
2010+Cloud
The things that got us here…
…must change to get us here!
1980 1981 1982 1983 1984 1985 1986 1987 1988 1989 1990 1991 1992 1993 1994 1995 1996 1997 1998 1999 2000 2001 2002 2003 2004 2005 2006 2007 2008 2009 2010 2011 2012 2013 2014 2015
Friday, November 16, 12
![Page 18: Austin agile conf 2012 infrastructure automation-gmiranda](https://reader034.fdocuments.net/reader034/viewer/2022051515/54c718404a7959532d8b456d/html5/thumbnails/18.jpg)
The Rise of Configuration Management
http://www.flickr.com/photos/24375810@N06/6611017007
Friday, November 16, 12
![Page 19: Austin agile conf 2012 infrastructure automation-gmiranda](https://reader034.fdocuments.net/reader034/viewer/2022051515/54c718404a7959532d8b456d/html5/thumbnails/19.jpg)
We have a problem at scale
Friday, November 16, 12
![Page 20: Austin agile conf 2012 infrastructure automation-gmiranda](https://reader034.fdocuments.net/reader034/viewer/2022051515/54c718404a7959532d8b456d/html5/thumbnails/20.jpg)
Here’s a hint
Friday, November 16, 12
![Page 21: Austin agile conf 2012 infrastructure automation-gmiranda](https://reader034.fdocuments.net/reader034/viewer/2022051515/54c718404a7959532d8b456d/html5/thumbnails/21.jpg)
Cabling?
Friday, November 16, 12
![Page 22: Austin agile conf 2012 infrastructure automation-gmiranda](https://reader034.fdocuments.net/reader034/viewer/2022051515/54c718404a7959532d8b456d/html5/thumbnails/22.jpg)
Close...
Friday, November 16, 12
![Page 23: Austin agile conf 2012 infrastructure automation-gmiranda](https://reader034.fdocuments.net/reader034/viewer/2022051515/54c718404a7959532d8b456d/html5/thumbnails/23.jpg)
http://www.flickr.com/photos/michaelheiss/3090102907/
Complexity
Friday, November 16, 12
![Page 24: Austin agile conf 2012 infrastructure automation-gmiranda](https://reader034.fdocuments.net/reader034/viewer/2022051515/54c718404a7959532d8b456d/html5/thumbnails/24.jpg)
Infrastructure
Friday, November 16, 12
![Page 25: Austin agile conf 2012 infrastructure automation-gmiranda](https://reader034.fdocuments.net/reader034/viewer/2022051515/54c718404a7959532d8b456d/html5/thumbnails/25.jpg)
Items we manipulate• Routes
• Users
• Groups
• Tasks
• Packages
• Software
• Services
• Nodes
• Networking
• Files
• Directories
• Symlinks
• Mounts
• Ruby Gems
• Python Modules
• Java Artifacts
• Disks
• Volumes
• Filesystems
• Firewall Rules
Friday, November 16, 12
![Page 26: Austin agile conf 2012 infrastructure automation-gmiranda](https://reader034.fdocuments.net/reader034/viewer/2022051515/54c718404a7959532d8b456d/html5/thumbnails/26.jpg)
See Node
Application
Friday, November 16, 12
![Page 27: Austin agile conf 2012 infrastructure automation-gmiranda](https://reader034.fdocuments.net/reader034/viewer/2022051515/54c718404a7959532d8b456d/html5/thumbnails/27.jpg)
See Nodes
Application
Application Database
Friday, November 16, 12
![Page 28: Austin agile conf 2012 infrastructure automation-gmiranda](https://reader034.fdocuments.net/reader034/viewer/2022051515/54c718404a7959532d8b456d/html5/thumbnails/28.jpg)
See Nodes Grow
Application
Application Databases
Friday, November 16, 12
![Page 29: Austin agile conf 2012 infrastructure automation-gmiranda](https://reader034.fdocuments.net/reader034/viewer/2022051515/54c718404a7959532d8b456d/html5/thumbnails/29.jpg)
Grow Nodes
App Servers
Application Databases
Friday, November 16, 12
![Page 30: Austin agile conf 2012 infrastructure automation-gmiranda](https://reader034.fdocuments.net/reader034/viewer/2022051515/54c718404a7959532d8b456d/html5/thumbnails/30.jpg)
...Grow
Load Balancer
Application Databases
App Servers
Friday, November 16, 12
![Page 31: Austin agile conf 2012 infrastructure automation-gmiranda](https://reader034.fdocuments.net/reader034/viewer/2022051515/54c718404a7959532d8b456d/html5/thumbnails/31.jpg)
Grow Nodes, Grow
Load Balancers
Application Databases
App Servers
Friday, November 16, 12
![Page 32: Austin agile conf 2012 infrastructure automation-gmiranda](https://reader034.fdocuments.net/reader034/viewer/2022051515/54c718404a7959532d8b456d/html5/thumbnails/32.jpg)
Grow Nodes, Grow
Load Balancers
App DB Cache
App Servers
Application Databases
Friday, November 16, 12
![Page 33: Austin agile conf 2012 infrastructure automation-gmiranda](https://reader034.fdocuments.net/reader034/viewer/2022051515/54c718404a7959532d8b456d/html5/thumbnails/33.jpg)
Infrastructure has a Topology
Load Balancers
App DB Cache
App Servers
Application Databases
Friday, November 16, 12
![Page 34: Austin agile conf 2012 infrastructure automation-gmiranda](https://reader034.fdocuments.net/reader034/viewer/2022051515/54c718404a7959532d8b456d/html5/thumbnails/34.jpg)
Infrastructure IS a Snowflake
Load Balancers
App DB Cache
App Servers
Application Databases
Floating IP?
Friday, November 16, 12
![Page 35: Austin agile conf 2012 infrastructure automation-gmiranda](https://reader034.fdocuments.net/reader034/viewer/2022051515/54c718404a7959532d8b456d/html5/thumbnails/35.jpg)
Complexity Increases Quickly
App LBs
App Servers
NoSQL
DB slaves
Cache
DB Cache
DBs
Friday, November 16, 12
![Page 36: Austin agile conf 2012 infrastructure automation-gmiranda](https://reader034.fdocuments.net/reader034/viewer/2022051515/54c718404a7959532d8b456d/html5/thumbnails/36.jpg)
... Increases Very Quickly
DC1 DC3
DC2
Friday, November 16, 12
![Page 37: Austin agile conf 2012 infrastructure automation-gmiranda](https://reader034.fdocuments.net/reader034/viewer/2022051515/54c718404a7959532d8b456d/html5/thumbnails/37.jpg)
Configuration Management
http://www.flickr.com/photos/philliecasablanca/3354734116/
Friday, November 16, 12
![Page 38: Austin agile conf 2012 infrastructure automation-gmiranda](https://reader034.fdocuments.net/reader034/viewer/2022051515/54c718404a7959532d8b456d/html5/thumbnails/38.jpg)
Sysadmins
Friday, November 16, 12
![Page 39: Austin agile conf 2012 infrastructure automation-gmiranda](https://reader034.fdocuments.net/reader034/viewer/2022051515/54c718404a7959532d8b456d/html5/thumbnails/39.jpg)
The Past
Friday, November 16, 12
![Page 40: Austin agile conf 2012 infrastructure automation-gmiranda](https://reader034.fdocuments.net/reader034/viewer/2022051515/54c718404a7959532d8b456d/html5/thumbnails/40.jpg)
• Labor intensive
• Error prone
• Hard to reproduce
• Unsustainable
http://www.flickr.com/photos/pureimaginations/4805330106/
Manual Configuration
Friday, November 16, 12
![Page 41: Austin agile conf 2012 infrastructure automation-gmiranda](https://reader034.fdocuments.net/reader034/viewer/2022051515/54c718404a7959532d8b456d/html5/thumbnails/41.jpg)
• Typically very brittle
• Throw away, one off scripts
• grep sed awk perl
• curl | bash
http://www.flickr.com/photos/40389360@N00/2428706650/
Scripting
Friday, November 16, 12
![Page 42: Austin agile conf 2012 infrastructure automation-gmiranda](https://reader034.fdocuments.net/reader034/viewer/2022051515/54c718404a7959532d8b456d/html5/thumbnails/42.jpg)
• NFS mounts
• rdist
• scp-on-a-for-loop
• rsync on cron
http://www.flickr.com/photos/walkadog/4317655660
File Distribution
Friday, November 16, 12
![Page 43: Austin agile conf 2012 infrastructure automation-gmiranda](https://reader034.fdocuments.net/reader034/viewer/2022051515/54c718404a7959532d8b456d/html5/thumbnails/43.jpg)
for i in `cat servers.txt` ; do scp ntp.conf root@$i:/etc/ntpd.conf ; done
for i in `cat servers.txt` ; do ssh root@$i /etc/init.d/ntpd restart ; done
for i in `cat servers.txt` ; do ssh root@$i chkconfig ntpd on ; done
• ^ does not scale
http://www.flickr.com/photos/alexerde/3479006495
This used to be awesome.
Friday, November 16, 12
![Page 44: Austin agile conf 2012 infrastructure automation-gmiranda](https://reader034.fdocuments.net/reader034/viewer/2022051515/54c718404a7959532d8b456d/html5/thumbnails/44.jpg)
• Cluster SSH
• ISConf
• Golden Images
Execution Management
Friday, November 16, 12
![Page 45: Austin agile conf 2012 infrastructure automation-gmiranda](https://reader034.fdocuments.net/reader034/viewer/2022051515/54c718404a7959532d8b456d/html5/thumbnails/45.jpg)
Typical Boring Infrastructure
Jboss App
Memcache
Postgres Slaves
Postgres Master
NagiosGraphite
Friday, November 16, 12
![Page 46: Austin agile conf 2012 infrastructure automation-gmiranda](https://reader034.fdocuments.net/reader034/viewer/2022051515/54c718404a7959532d8b456d/html5/thumbnails/46.jpg)
Typical Boring Infrastructure
Jboss App
Memcache
Postgres Slaves
Postgres Master
NagiosGraphite
• Move SSH off port 22
• Lets put it on 2022
Friday, November 16, 12
![Page 47: Austin agile conf 2012 infrastructure automation-gmiranda](https://reader034.fdocuments.net/reader034/viewer/2022051515/54c718404a7959532d8b456d/html5/thumbnails/47.jpg)
Typical Boring Infrastructure
Jboss App
Memcache
Postgres Slaves
Postgres Master
NagiosGraphite
• Move SSH off port 22
• Lets put it on 2022
• edit /etc/ssh/sshd_config
Friday, November 16, 12
![Page 48: Austin agile conf 2012 infrastructure automation-gmiranda](https://reader034.fdocuments.net/reader034/viewer/2022051515/54c718404a7959532d8b456d/html5/thumbnails/48.jpg)
Typical Boring Infrastructure
Jboss App
Memcache
Postgres Slaves
Postgres Master
NagiosGraphite
• Move SSH off port 22
• Lets put it on 2022
• edit /etc/ssh/sshd_config
1 2
3
4
5
6
Friday, November 16, 12
![Page 49: Austin agile conf 2012 infrastructure automation-gmiranda](https://reader034.fdocuments.net/reader034/viewer/2022051515/54c718404a7959532d8b456d/html5/thumbnails/49.jpg)
Maintenance Window
Jboss App
Memcache
Postgres Slaves
Postgres Master
NagiosGraphite
Friday, November 16, 12
![Page 50: Austin agile conf 2012 infrastructure automation-gmiranda](https://reader034.fdocuments.net/reader034/viewer/2022051515/54c718404a7959532d8b456d/html5/thumbnails/50.jpg)
Maintenance Window
Jboss App
Memcache
Postgres Slaves
Postgres Master
NagiosGraphite 1 2
3
8
5 64 7
9
10 11
12
• Launch, Delete
• Repeat
• Typically manually
Friday, November 16, 12
![Page 51: Austin agile conf 2012 infrastructure automation-gmiranda](https://reader034.fdocuments.net/reader034/viewer/2022051515/54c718404a7959532d8b456d/html5/thumbnails/51.jpg)
Maintenance Window
Jboss App
Memcache
Postgres Slaves
Postgres Master
NagiosGraphite 1 2
3
8
5 64 7
9
10 11
12
• Launch, Delete
• Repeat
• Typically manually
• Don’t break anything!
• Bob just got fired =(
Friday, November 16, 12
![Page 52: Austin agile conf 2012 infrastructure automation-gmiranda](https://reader034.fdocuments.net/reader034/viewer/2022051515/54c718404a7959532d8b456d/html5/thumbnails/52.jpg)
Different IP Addresses?
Jboss App
Memcache
Postgres Slaves
Postgres Master
NagiosGraphite
• Invalid configs!
Friday, November 16, 12
![Page 53: Austin agile conf 2012 infrastructure automation-gmiranda](https://reader034.fdocuments.net/reader034/viewer/2022051515/54c718404a7959532d8b456d/html5/thumbnails/53.jpg)
Systems Integration
• Keep a list of current resources
• Collect vast amounts of data on those resources
• Quickly search through stacks of current resource data
• Generate your Infrastructure Topology from a current source of truth
http://www.flickr.com/photos/fotos_medem/3399096196/
Friday, November 16, 12
![Page 54: Austin agile conf 2012 infrastructure automation-gmiranda](https://reader034.fdocuments.net/reader034/viewer/2022051515/54c718404a7959532d8b456d/html5/thumbnails/54.jpg)
So when this...
Jboss App
Memcache
Postgres Slaves
Postgres Master
NagiosGraphite
Friday, November 16, 12
![Page 55: Austin agile conf 2012 infrastructure automation-gmiranda](https://reader034.fdocuments.net/reader034/viewer/2022051515/54c718404a7959532d8b456d/html5/thumbnails/55.jpg)
... becomes this...
Jboss App
Memcache
Postgres Slaves
Postgres Master
NagiosGraphite
Friday, November 16, 12
![Page 56: Austin agile conf 2012 infrastructure automation-gmiranda](https://reader034.fdocuments.net/reader034/viewer/2022051515/54c718404a7959532d8b456d/html5/thumbnails/56.jpg)
That can happen automatically
Jboss App
Memcache
Postgres Slaves
Postgres Master
NagiosGraphite
Friday, November 16, 12
![Page 57: Austin agile conf 2012 infrastructure automation-gmiranda](https://reader034.fdocuments.net/reader034/viewer/2022051515/54c718404a7959532d8b456d/html5/thumbnails/57.jpg)
Copyright © 2010 Opscode, Inc - All Rights Reserved 41Friday, November 16, 12
![Page 58: Austin agile conf 2012 infrastructure automation-gmiranda](https://reader034.fdocuments.net/reader034/viewer/2022051515/54c718404a7959532d8b456d/html5/thumbnails/58.jpg)
Copyright © 2010 Opscode, Inc - All Rights Reserved 41Friday, November 16, 12
![Page 59: Austin agile conf 2012 infrastructure automation-gmiranda](https://reader034.fdocuments.net/reader034/viewer/2022051515/54c718404a7959532d8b456d/html5/thumbnails/59.jpg)
Managing Complexity Today
Friday, November 16, 12
![Page 60: Austin agile conf 2012 infrastructure automation-gmiranda](https://reader034.fdocuments.net/reader034/viewer/2022051515/54c718404a7959532d8b456d/html5/thumbnails/60.jpg)
Managing Complexity TodayHow Do we Manage This at Cloud Scale?
• Thousands of infrastructure dependencies and configurations needed for each change.
• Huge Amounts of Time
• Increased Cost of Correction of Manual Errors
• Huge Need for Talent
• Risk of Critical Skills Shortage
Friday, November 16, 12
![Page 61: Austin agile conf 2012 infrastructure automation-gmiranda](https://reader034.fdocuments.net/reader034/viewer/2022051515/54c718404a7959532d8b456d/html5/thumbnails/61.jpg)
Google, Amazon, Microsoft, Yahoobuilt their own tools
Friday, November 16, 12
![Page 62: Austin agile conf 2012 infrastructure automation-gmiranda](https://reader034.fdocuments.net/reader034/viewer/2022051515/54c718404a7959532d8b456d/html5/thumbnails/62.jpg)
but it was “secret sauce”
Friday, November 16, 12
![Page 63: Austin agile conf 2012 infrastructure automation-gmiranda](https://reader034.fdocuments.net/reader034/viewer/2022051515/54c718404a7959532d8b456d/html5/thumbnails/63.jpg)
everyone else was here
... inexperienced & poorly equipped for the world they must now operate in.
Friday, November 16, 12
![Page 64: Austin agile conf 2012 infrastructure automation-gmiranda](https://reader034.fdocuments.net/reader034/viewer/2022051515/54c718404a7959532d8b456d/html5/thumbnails/64.jpg)
everyone else was here
... inexperienced & poorly equipped for the world they must now operate in.
Friday, November 16, 12
![Page 65: Austin agile conf 2012 infrastructure automation-gmiranda](https://reader034.fdocuments.net/reader034/viewer/2022051515/54c718404a7959532d8b456d/html5/thumbnails/65.jpg)
Infrastructure
"It is common to think in terms of individual machines rather than view an entire infrastructure as a combined whole"
“A good infrastructure, whether departmental, divisional, or enterprise-wide, is a single loosely-
coupled virtual machine, with hundreds or thousands of hard drives and CPU's.”
-- Bootstrapping an Infrastructure USENIX LISA ’98
Friday, November 16, 12
![Page 66: Austin agile conf 2012 infrastructure automation-gmiranda](https://reader034.fdocuments.net/reader034/viewer/2022051515/54c718404a7959532d8b456d/html5/thumbnails/66.jpg)
Infrastructure as Code
• Programmatically provision and configure
• Treat like any other code base
• Gives you tools to manage complexity while being flexible enough to evolve with your Infrastructure
• Reconstruct the business from code repository, data backup, and baremetal resources
Friday, November 16, 12
![Page 67: Austin agile conf 2012 infrastructure automation-gmiranda](https://reader034.fdocuments.net/reader034/viewer/2022051515/54c718404a7959532d8b456d/html5/thumbnails/67.jpg)
Declarative Syntax
• Define policy
• Say what, not how
• Abstraction between platforms
• Many positive side effects
Friday, November 16, 12
![Page 68: Austin agile conf 2012 infrastructure automation-gmiranda](https://reader034.fdocuments.net/reader034/viewer/2022051515/54c718404a7959532d8b456d/html5/thumbnails/68.jpg)
Idempotence
• You’ll hear this a lot
• Property of declarative interface
• Eliminates brittleness of scripting
• Identity function: f(x)=x
• Safe to repeat
Friday, November 16, 12
![Page 69: Austin agile conf 2012 infrastructure automation-gmiranda](https://reader034.fdocuments.net/reader034/viewer/2022051515/54c718404a7959532d8b456d/html5/thumbnails/69.jpg)
Chef is a Tool
http://www.flickr.com/photos/wessexandy/7690486884/sizes/c/in/pool-96164123@N00/
Friday, November 16, 12
![Page 70: Austin agile conf 2012 infrastructure automation-gmiranda](https://reader034.fdocuments.net/reader034/viewer/2022051515/54c718404a7959532d8b456d/html5/thumbnails/70.jpg)
Wax Philosophical
• We are artists & masters of our craft
• Everyone needs great tools
• Nobody remember’s Picasso’s paintbrush
http://www.flickr.com/photos/vgm8383/2686128924/sizes/l/
Friday, November 16, 12
![Page 71: Austin agile conf 2012 infrastructure automation-gmiranda](https://reader034.fdocuments.net/reader034/viewer/2022051515/54c718404a7959532d8b456d/html5/thumbnails/71.jpg)
The core ideas in this talk:
Automation + Culture =AGILITY!
Friday, November 16, 12
![Page 72: Austin agile conf 2012 infrastructure automation-gmiranda](https://reader034.fdocuments.net/reader034/viewer/2022051515/54c718404a7959532d8b456d/html5/thumbnails/72.jpg)
The core ideas in this talk:
Automation + Culture =AGILITY!
Friday, November 16, 12
![Page 73: Austin agile conf 2012 infrastructure automation-gmiranda](https://reader034.fdocuments.net/reader034/viewer/2022051515/54c718404a7959532d8b456d/html5/thumbnails/73.jpg)
Pitfalls
http://www.flickr.com/photos/nesposit/2787559303/sizes/o/in/photostream/
Friday, November 16, 12
![Page 74: Austin agile conf 2012 infrastructure automation-gmiranda](https://reader034.fdocuments.net/reader034/viewer/2022051515/54c718404a7959532d8b456d/html5/thumbnails/74.jpg)
This should sound familiar...
Friday, November 16, 12
![Page 75: Austin agile conf 2012 infrastructure automation-gmiranda](https://reader034.fdocuments.net/reader034/viewer/2022051515/54c718404a7959532d8b456d/html5/thumbnails/75.jpg)
Friday, November 16, 12
![Page 76: Austin agile conf 2012 infrastructure automation-gmiranda](https://reader034.fdocuments.net/reader034/viewer/2022051515/54c718404a7959532d8b456d/html5/thumbnails/76.jpg)
Friday, November 16, 12
![Page 77: Austin agile conf 2012 infrastructure automation-gmiranda](https://reader034.fdocuments.net/reader034/viewer/2022051515/54c718404a7959532d8b456d/html5/thumbnails/77.jpg)
Traditional thinking
Dev’s job is to add new featuresOps’ job is to keep the site stable and fast
http://www.flickr.com/photos/stewart/461099066/
Slide Courtesy of John Allspaw - http://www.slideshare.net/jallspaw/10-deploys-per-day-dev-and-ops-cooperation-at-flickr
Friday, November 16, 12
![Page 78: Austin agile conf 2012 infrastructure automation-gmiranda](https://reader034.fdocuments.net/reader034/viewer/2022051515/54c718404a7959532d8b456d/html5/thumbnails/78.jpg)
Ops’ job is NOT to keep the site stable and fast
Dev’s job is NOT to add new features
Friday, November 16, 12
![Page 79: Austin agile conf 2012 infrastructure automation-gmiranda](https://reader034.fdocuments.net/reader034/viewer/2022051515/54c718404a7959532d8b456d/html5/thumbnails/79.jpg)
OUR jobis to ENABLE our business
Friday, November 16, 12
![Page 80: Austin agile conf 2012 infrastructure automation-gmiranda](https://reader034.fdocuments.net/reader034/viewer/2022051515/54c718404a7959532d8b456d/html5/thumbnails/80.jpg)
Our business REQUIRES change
Friday, November 16, 12
![Page 81: Austin agile conf 2012 infrastructure automation-gmiranda](https://reader034.fdocuments.net/reader034/viewer/2022051515/54c718404a7959532d8b456d/html5/thumbnails/81.jpg)
BUT CHANGE IS THE CAUSE OF MOST OUTAGES!
Friday, November 16, 12
![Page 82: Austin agile conf 2012 infrastructure automation-gmiranda](https://reader034.fdocuments.net/reader034/viewer/2022051515/54c718404a7959532d8b456d/html5/thumbnails/82.jpg)
Choose:Discourage change in the interests of
stabilityOR
Allow change to happen as often as it needs to
Friday, November 16, 12
![Page 83: Austin agile conf 2012 infrastructure automation-gmiranda](https://reader034.fdocuments.net/reader034/viewer/2022051515/54c718404a7959532d8b456d/html5/thumbnails/83.jpg)
http://www.flickr.com/photos/gsfc/6795048198/sizes/o/in/photostream/
The Great Abyss
Friday, November 16, 12
![Page 84: Austin agile conf 2012 infrastructure automation-gmiranda](https://reader034.fdocuments.net/reader034/viewer/2022051515/54c718404a7959532d8b456d/html5/thumbnails/84.jpg)
The right culture is a requirement for survival & success at web
scale.
Friday, November 16, 12
![Page 85: Austin agile conf 2012 infrastructure automation-gmiranda](https://reader034.fdocuments.net/reader034/viewer/2022051515/54c718404a7959532d8b456d/html5/thumbnails/85.jpg)
Lessons Learned:Every Post-mortem
Friday, November 16, 12
![Page 86: Austin agile conf 2012 infrastructure automation-gmiranda](https://reader034.fdocuments.net/reader034/viewer/2022051515/54c718404a7959532d8b456d/html5/thumbnails/86.jpg)
Lessons Learned:Every Post-mortem
Ever...
Friday, November 16, 12
![Page 87: Austin agile conf 2012 infrastructure automation-gmiranda](https://reader034.fdocuments.net/reader034/viewer/2022051515/54c718404a7959532d8b456d/html5/thumbnails/87.jpg)
Friday, November 16, 12
![Page 88: Austin agile conf 2012 infrastructure automation-gmiranda](https://reader034.fdocuments.net/reader034/viewer/2022051515/54c718404a7959532d8b456d/html5/thumbnails/88.jpg)
Root Cause:“Bad Luck... it was a perfect storm of impossible events”
Friday, November 16, 12
![Page 89: Austin agile conf 2012 infrastructure automation-gmiranda](https://reader034.fdocuments.net/reader034/viewer/2022051515/54c718404a7959532d8b456d/html5/thumbnails/89.jpg)
Lesson #1“We have a bunch of manual processes which we need to
automate”
Friday, November 16, 12
![Page 90: Austin agile conf 2012 infrastructure automation-gmiranda](https://reader034.fdocuments.net/reader034/viewer/2022051515/54c718404a7959532d8b456d/html5/thumbnails/90.jpg)
Copyright © 2010 Opscode, Inc - All Rights Reserved 70Friday, November 16, 12
![Page 91: Austin agile conf 2012 infrastructure automation-gmiranda](https://reader034.fdocuments.net/reader034/viewer/2022051515/54c718404a7959532d8b456d/html5/thumbnails/91.jpg)
Lesson #2“We introduced too many changes
at once”
Friday, November 16, 12
![Page 92: Austin agile conf 2012 infrastructure automation-gmiranda](https://reader034.fdocuments.net/reader034/viewer/2022051515/54c718404a7959532d8b456d/html5/thumbnails/92.jpg)
Friday, November 16, 12
![Page 93: Austin agile conf 2012 infrastructure automation-gmiranda](https://reader034.fdocuments.net/reader034/viewer/2022051515/54c718404a7959532d8b456d/html5/thumbnails/93.jpg)
Slide Courtesy of John Allspaw - http://www.slideshare.net/jallspaw/ops-metametrics-the-currency-you-pay-for-change
Friday, November 16, 12
![Page 94: Austin agile conf 2012 infrastructure automation-gmiranda](https://reader034.fdocuments.net/reader034/viewer/2022051515/54c718404a7959532d8b456d/html5/thumbnails/94.jpg)
Image Courtesy of John Allspaw - http://www.slideshare.net/jallspaw/ops-metametrics-the-currency-you-pay-for-change
RAAAWR!!! I’m SCARY!
Friday, November 16, 12
![Page 95: Austin agile conf 2012 infrastructure automation-gmiranda](https://reader034.fdocuments.net/reader034/viewer/2022051515/54c718404a7959532d8b456d/html5/thumbnails/95.jpg)
Slide Courtesy of John Allspaw - http://www.slideshare.net/jallspaw/ops-metametrics-the-currency-you-pay-for-change
Friday, November 16, 12
![Page 96: Austin agile conf 2012 infrastructure automation-gmiranda](https://reader034.fdocuments.net/reader034/viewer/2022051515/54c718404a7959532d8b456d/html5/thumbnails/96.jpg)
Slide Courtesy of John Allspaw - http://www.slideshare.net/jallspaw/ops-metametrics-the-currency-you-pay-for-change
Friday, November 16, 12
![Page 97: Austin agile conf 2012 infrastructure automation-gmiranda](https://reader034.fdocuments.net/reader034/viewer/2022051515/54c718404a7959532d8b456d/html5/thumbnails/97.jpg)
Images Courtesy of John Allspaw - http://www.slideshare.net/jallspaw/ops-metametrics-the-currency-you-pay-for-change
I can haz cuddle?
Friday, November 16, 12
![Page 98: Austin agile conf 2012 infrastructure automation-gmiranda](https://reader034.fdocuments.net/reader034/viewer/2022051515/54c718404a7959532d8b456d/html5/thumbnails/98.jpg)
Friday, November 16, 12
![Page 99: Austin agile conf 2012 infrastructure automation-gmiranda](https://reader034.fdocuments.net/reader034/viewer/2022051515/54c718404a7959532d8b456d/html5/thumbnails/99.jpg)
MAKEMORE
AWESOME!!!
Friday, November 16, 12
![Page 100: Austin agile conf 2012 infrastructure automation-gmiranda](https://reader034.fdocuments.net/reader034/viewer/2022051515/54c718404a7959532d8b456d/html5/thumbnails/100.jpg)
Continuous Delivery
Faster Time to ValueHigher Availability
Happier TeamsMore Cool Stuff
Friday, November 16, 12
![Page 101: Austin agile conf 2012 infrastructure automation-gmiranda](https://reader034.fdocuments.net/reader034/viewer/2022051515/54c718404a7959532d8b456d/html5/thumbnails/101.jpg)
Friday, November 16, 12
![Page 102: Austin agile conf 2012 infrastructure automation-gmiranda](https://reader034.fdocuments.net/reader034/viewer/2022051515/54c718404a7959532d8b456d/html5/thumbnails/102.jpg)
Stuff Suits Care About
• Visibility & Accountability
• Reduce Risk
• Business Agility
Friday, November 16, 12
![Page 103: Austin agile conf 2012 infrastructure automation-gmiranda](https://reader034.fdocuments.net/reader034/viewer/2022051515/54c718404a7959532d8b456d/html5/thumbnails/103.jpg)
Stuff Engineers care about
• Change when we need it
• Innovate Faster
• Constant Improvements
• Application & Site Resiliency
Friday, November 16, 12
![Page 104: Austin agile conf 2012 infrastructure automation-gmiranda](https://reader034.fdocuments.net/reader034/viewer/2022051515/54c718404a7959532d8b456d/html5/thumbnails/104.jpg)
Recap
Friday, November 16, 12
![Page 105: Austin agile conf 2012 infrastructure automation-gmiranda](https://reader034.fdocuments.net/reader034/viewer/2022051515/54c718404a7959532d8b456d/html5/thumbnails/105.jpg)
Recap
•Step 1) Automate your Infrastructure
Friday, November 16, 12
![Page 106: Austin agile conf 2012 infrastructure automation-gmiranda](https://reader034.fdocuments.net/reader034/viewer/2022051515/54c718404a7959532d8b456d/html5/thumbnails/106.jpg)
Recap
•Step 1) Automate your Infrastructure
•Step 2) Bridge the Cultural Divide
Friday, November 16, 12
![Page 107: Austin agile conf 2012 infrastructure automation-gmiranda](https://reader034.fdocuments.net/reader034/viewer/2022051515/54c718404a7959532d8b456d/html5/thumbnails/107.jpg)
Recap
•Step 1) Automate your Infrastructure
•Step 2) Bridge the Cultural Divide
•Step 3) Profit!
Friday, November 16, 12
![Page 108: Austin agile conf 2012 infrastructure automation-gmiranda](https://reader034.fdocuments.net/reader034/viewer/2022051515/54c718404a7959532d8b456d/html5/thumbnails/108.jpg)
Recap
•Step 1) Automate your Infrastructure
•Step 2) Bridge the Cultural Divide
•Step 3) Profit!
•Automation + Culture = Agility
Friday, November 16, 12
![Page 109: Austin agile conf 2012 infrastructure automation-gmiranda](https://reader034.fdocuments.net/reader034/viewer/2022051515/54c718404a7959532d8b456d/html5/thumbnails/109.jpg)
Try it out!
• Hosted Chef is a SaaS product hosted by Opscode
• http://manage.opscode.com
• Our wiki: http://wiki.opscode.com
• Fast start guide:
• http://wiki.opscode.com/display/chef/Fast+Start+Guide
• Our Community site: http://community.opscode.com
• Cookbooks in our Github account: http://github.com/opscode/cookbooks
• The materials for our 3-day Chef Fundamentals class are online:
• https://github.com/opscode/chef-fundamentals
Friday, November 16, 12
![Page 110: Austin agile conf 2012 infrastructure automation-gmiranda](https://reader034.fdocuments.net/reader034/viewer/2022051515/54c718404a7959532d8b456d/html5/thumbnails/110.jpg)
Supported Platforms
• Ubuntu (10.04, 10.10, 11.04, 11.10, 12.04)
• Debian (5.x, 6.x)
• RHEL & CentOS (5.x, 6.x)
• Fedora 10+
• SUSE Enterprise (11.2)
• openSUSE (12.1)
• Solaris (5.9, 5.10, 5.11 -- x86 and SPARC)
• Mac OS X (10.4, 10.5, 10.6, 10.7)
• Windows 7
• Windows Server 2003 R2, 2008, 2008 R2
Friday, November 16, 12
![Page 111: Austin agile conf 2012 infrastructure automation-gmiranda](https://reader034.fdocuments.net/reader034/viewer/2022051515/54c718404a7959532d8b456d/html5/thumbnails/111.jpg)
Additional Resources• Opscode Youtube Channel:
• http://www.youtube.com/opscode
• Jesse Robbins, Changing Culture & Being a force for Awesome
• http://www.youtube.com/watch?v=OU8ihx3nT6I
• Matt Ray on Automating Continuous Deployment
• http://www.opscode.com/blog/2012/11/13/automating-continuous-deployment-wchef/
• Continuous Delivery by Jez Humble & David Farley
• http://continuousdelivery.com/
Friday, November 16, 12
![Page 112: Austin agile conf 2012 infrastructure automation-gmiranda](https://reader034.fdocuments.net/reader034/viewer/2022051515/54c718404a7959532d8b456d/html5/thumbnails/112.jpg)
Thanks!
• George Miranda
• @gmiranda23
Friday, November 16, 12
![Page 113: Austin agile conf 2012 infrastructure automation-gmiranda](https://reader034.fdocuments.net/reader034/viewer/2022051515/54c718404a7959532d8b456d/html5/thumbnails/113.jpg)
Questions?
• On freenode: #chef and #chef-hacking
• http://lists.opscode.com
• http://tickets.opscode.com
• http://help.opscode.com
• @opscode and @opscode_status on Twitter
Friday, November 16, 12