Prying the Cloud Open: Dell Crowbar & OpenStack · Prying the Cloud Open: Dell Crowbar & OpenStack...
Transcript of Prying the Cloud Open: Dell Crowbar & OpenStack · Prying the Cloud Open: Dell Crowbar & OpenStack...
![Page 1: Prying the Cloud Open: Dell Crowbar & OpenStack · Prying the Cloud Open: Dell Crowbar & OpenStack Rob Hirschfeld (@zehicle), Principal Cloud Architect ... CloudOps for OpenStack](https://reader030.fdocuments.net/reader030/viewer/2022040612/5edd86d0ad6a402d6668a656/html5/thumbnails/1.jpg)
Prying the Cloud Open: Dell Crowbar & OpenStack Rob Hirschfeld (@zehicle), Principal Cloud Architect
Joseph B. George (@jbgeorge), Senior Cloud Strategist
July 2011, OSCON
![Page 2: Prying the Cloud Open: Dell Crowbar & OpenStack · Prying the Cloud Open: Dell Crowbar & OpenStack Rob Hirschfeld (@zehicle), Principal Cloud Architect ... CloudOps for OpenStack](https://reader030.fdocuments.net/reader030/viewer/2022040612/5edd86d0ad6a402d6668a656/html5/thumbnails/2.jpg)
Intersection of two major technology waves:
Operational Automation (DevOps)
Open Source Cloud (OpenStack)
Together, a practical approach to cloud scale
Manages elastic resources
Embraces constant change
Productizes best practices
July 20, 2011 Dell Cloud Solutions 2
Open Cloud Operations
![Page 3: Prying the Cloud Open: Dell Crowbar & OpenStack · Prying the Cloud Open: Dell Crowbar & OpenStack Rob Hirschfeld (@zehicle), Principal Cloud Architect ... CloudOps for OpenStack](https://reader030.fdocuments.net/reader030/viewer/2022040612/5edd86d0ad6a402d6668a656/html5/thumbnails/3.jpg)
Hyper-scale (1000s of servers) forced customers to change their core assumptions.
To operate large systems, customers
Embraced scale out design (inconsistency is OK)
Eliminated hardware redundancy (too expensive)
Shunned manual steps (too slow)
Lessons from Hyper-scale
July 20, 2011 Dell Cloud Solutions 3
![Page 4: Prying the Cloud Open: Dell Crowbar & OpenStack · Prying the Cloud Open: Dell Crowbar & OpenStack Rob Hirschfeld (@zehicle), Principal Cloud Architect ... CloudOps for OpenStack](https://reader030.fdocuments.net/reader030/viewer/2022040612/5edd86d0ad6a402d6668a656/html5/thumbnails/4.jpg)
Cloud servers forced customers to change their core assumptions.
To operate remote virtualized systems, customers
Embraced scale out design (to get elastic growth)
Lived with weak SLAs (that was all that was offered)
Worked around lack of physical access (not available)
July 21, 2011 4
Lessons from Public Clouds
Dell Cloud Solutions
![Page 5: Prying the Cloud Open: Dell Crowbar & OpenStack · Prying the Cloud Open: Dell Crowbar & OpenStack Rob Hirschfeld (@zehicle), Principal Cloud Architect ... CloudOps for OpenStack](https://reader030.fdocuments.net/reader030/viewer/2022040612/5edd86d0ad6a402d6668a656/html5/thumbnails/5.jpg)
Clouds demand significant operational and process controls
Operational decisions drive hardware and software decisions
We are finding ways to productize operations into best practices
July 20, 2011 Dell Cloud Solutions 5
Clouds require an Operational Focus
HW
SW
OPS
![Page 6: Prying the Cloud Open: Dell Crowbar & OpenStack · Prying the Cloud Open: Dell Crowbar & OpenStack Rob Hirschfeld (@zehicle), Principal Cloud Architect ... CloudOps for OpenStack](https://reader030.fdocuments.net/reader030/viewer/2022040612/5edd86d0ad6a402d6668a656/html5/thumbnails/6.jpg)
DevOps is an operational approach that automates system configuration and management.
To manage cloud systems, customers
Need to manage servers as groups
Must respond to rapid infrastructure changes
Have repeatable automated deployments
July 21, 2011 6
DevOps Addresses Challenges
Dell Cloud Solutions
![Page 7: Prying the Cloud Open: Dell Crowbar & OpenStack · Prying the Cloud Open: Dell Crowbar & OpenStack Rob Hirschfeld (@zehicle), Principal Cloud Architect ... CloudOps for OpenStack](https://reader030.fdocuments.net/reader030/viewer/2022040612/5edd86d0ad6a402d6668a656/html5/thumbnails/7.jpg)
The cloud market was highly fragmented
Amazon dominated but was not public domain
VMware was building on their enterprise base
Microsoft was taking the PaaS route
Many small players but no community projects
Service Providers could not agree on APIs
July 20, 2011 Dell Cloud Solutions 7
Missing Cloud Infrastructure
![Page 8: Prying the Cloud Open: Dell Crowbar & OpenStack · Prying the Cloud Open: Dell Crowbar & OpenStack Rob Hirschfeld (@zehicle), Principal Cloud Architect ... CloudOps for OpenStack](https://reader030.fdocuments.net/reader030/viewer/2022040612/5edd86d0ad6a402d6668a656/html5/thumbnails/8.jpg)
We needed Cloud Infrastructure that
Had support from major industry players
Was collaboratively developed without a single owner
Had an API that was Service Provider license friendly
Could be demonstrated to run at scale
Was built on open source components
Had global reach and support
July 20, 2011 Dell Cloud Solutions 8
Community Cloud Infrastructure
![Page 9: Prying the Cloud Open: Dell Crowbar & OpenStack · Prying the Cloud Open: Dell Crowbar & OpenStack Rob Hirschfeld (@zehicle), Principal Cloud Architect ... CloudOps for OpenStack](https://reader030.fdocuments.net/reader030/viewer/2022040612/5edd86d0ad6a402d6668a656/html5/thumbnails/9.jpg)
July 20, 2011 Dell Cloud Solutions 9
OpenStack!
![Page 10: Prying the Cloud Open: Dell Crowbar & OpenStack · Prying the Cloud Open: Dell Crowbar & OpenStack Rob Hirschfeld (@zehicle), Principal Cloud Architect ... CloudOps for OpenStack](https://reader030.fdocuments.net/reader030/viewer/2022040612/5edd86d0ad6a402d6668a656/html5/thumbnails/10.jpg)
July 20, 2011 Dell Cloud Solutions 10
Making an OpenStack Cloud
HW
SW
OPS
? Operations
? Expertise
Resources ?
![Page 11: Prying the Cloud Open: Dell Crowbar & OpenStack · Prying the Cloud Open: Dell Crowbar & OpenStack Rob Hirschfeld (@zehicle), Principal Cloud Architect ... CloudOps for OpenStack](https://reader030.fdocuments.net/reader030/viewer/2022040612/5edd86d0ad6a402d6668a656/html5/thumbnails/11.jpg)
OPS
SW
July 20, 2011 Dell Cloud Solutions 11
Dell OpenStack Cloud Solution
HW
SW
OPS
“Crowbar”
CloudOps
Software
Services &
Consulting
Reference
Architecture
![Page 12: Prying the Cloud Open: Dell Crowbar & OpenStack · Prying the Cloud Open: Dell Crowbar & OpenStack Rob Hirschfeld (@zehicle), Principal Cloud Architect ... CloudOps for OpenStack](https://reader030.fdocuments.net/reader030/viewer/2022040612/5edd86d0ad6a402d6668a656/html5/thumbnails/12.jpg)
How DevOps is Different Images vs. Layers
TECHNICAL CONTENT AHEAD
July 20, 2011 Dell Cloud Solutions 12
$ $
![Page 13: Prying the Cloud Open: Dell Crowbar & OpenStack · Prying the Cloud Open: Dell Crowbar & OpenStack Rob Hirschfeld (@zehicle), Principal Cloud Architect ... CloudOps for OpenStack](https://reader030.fdocuments.net/reader030/viewer/2022040612/5edd86d0ad6a402d6668a656/html5/thumbnails/13.jpg)
Images vs. Layers: Overview
Images: Single Unit Layers: Stacked Pieces
July 20, 2011 Dell Cloud Solutions 13
Integrations + Applications +
Utilities + Operating System
Configuration
Operating System
Utilities
Application Bar
Application Foo
Integrations
Co
nfi
gu
rati
on
![Page 14: Prying the Cloud Open: Dell Crowbar & OpenStack · Prying the Cloud Open: Dell Crowbar & OpenStack Rob Hirschfeld (@zehicle), Principal Cloud Architect ... CloudOps for OpenStack](https://reader030.fdocuments.net/reader030/viewer/2022040612/5edd86d0ad6a402d6668a656/html5/thumbnails/14.jpg)
Images vs. Layers: Lifecycle
Images: Replacement Layers: Upgrade
July 20, 2011 Dell Cloud Solutions 14
I+A+U+O/S
Config
OS
U Bar v1
Foo I
Co
nfi
g
I+A+U+O/S
Config
I+A+U+O/S
Config
I+A+U+O/S
Config
OS
U Bar v2
Foo I
Co
nfi
g
Bar v2
![Page 15: Prying the Cloud Open: Dell Crowbar & OpenStack · Prying the Cloud Open: Dell Crowbar & OpenStack Rob Hirschfeld (@zehicle), Principal Cloud Architect ... CloudOps for OpenStack](https://reader030.fdocuments.net/reader030/viewer/2022040612/5edd86d0ad6a402d6668a656/html5/thumbnails/15.jpg)
Images vs. Layers: Details
Images
Like a Compiled Language
Early Binding
Tightly Coupled
Assembled as a package
1-Step Deployment
Big Storage Footprint
Cloned from “Golden Image”
Single Version
Layers
Like an Interpreted Language
Late Binding
Loosely Coupled
Assembled in parts
Multi-Step Deployment
Small Footprint (packages)
Setup per instance
Discrete Versions
July 20, 2011 Dell Cloud Solutions 15
![Page 16: Prying the Cloud Open: Dell Crowbar & OpenStack · Prying the Cloud Open: Dell Crowbar & OpenStack Rob Hirschfeld (@zehicle), Principal Cloud Architect ... CloudOps for OpenStack](https://reader030.fdocuments.net/reader030/viewer/2022040612/5edd86d0ad6a402d6668a656/html5/thumbnails/16.jpg)
Images vs. Layers: Mo’ Details
Images
Very Static Operations
Manual Setup
Low Entry / High Maintenance
Works well in Enterprise
Hardware Sensitive
Brittle
Typically: Windows
Layers
High Change Operations
Automated setup
High Entry / Low Maintenance
Works well in Cloud
Hardware Agnostic
Elastic
Typically: Linux
July 20, 2011 Dell Cloud Solutions 16
![Page 17: Prying the Cloud Open: Dell Crowbar & OpenStack · Prying the Cloud Open: Dell Crowbar & OpenStack Rob Hirschfeld (@zehicle), Principal Cloud Architect ... CloudOps for OpenStack](https://reader030.fdocuments.net/reader030/viewer/2022040612/5edd86d0ad6a402d6668a656/html5/thumbnails/17.jpg)
Images vs. Layers
Soup
Delicious!
Fast!
Premixed
Hard to customize
Hard to change
Hard to carry
Every batch is unique
Sandwich
Delicious!
Fast!
Flexible
Easy to customize
Configurable
Very portable
Components can be common
July 20, 2011 Dell Cloud Solutions 17
![Page 18: Prying the Cloud Open: Dell Crowbar & OpenStack · Prying the Cloud Open: Dell Crowbar & OpenStack Rob Hirschfeld (@zehicle), Principal Cloud Architect ... CloudOps for OpenStack](https://reader030.fdocuments.net/reader030/viewer/2022040612/5edd86d0ad6a402d6668a656/html5/thumbnails/18.jpg)
7/21/2011 Confidential 18
Cloud Deployments are Complex
Source: Ken Pepple
Crowbar has scripts that install the components of OpenStack Nova in a proven pattern that can be customized after the fact.
![Page 19: Prying the Cloud Open: Dell Crowbar & OpenStack · Prying the Cloud Open: Dell Crowbar & OpenStack Rob Hirschfeld (@zehicle), Principal Cloud Architect ... CloudOps for OpenStack](https://reader030.fdocuments.net/reader030/viewer/2022040612/5edd86d0ad6a402d6668a656/html5/thumbnails/19.jpg)
There are lot of pieces, but they share many elements!
July 20, 2011 Dell Cloud Solutions 19
CloudOps for OpenStack
OS
U
Nova Node
I
Co
nfi
g
OS
U
Nova API
I
Co
nfi
g
OS
U
Nova Node
I
Co
nfi
g
OS
U
Nova Node
I C
on
fig
OS
U
Nova Node
I
Co
nfi
g
OS
U
Nova Node
I
Co
nfi
g
OS
U
Nova Node
I
Co
nfi
g
OS
U
Nova DB
I
Co
nfi
g
OS
U
Nova Cntrl
I
Co
nfi
g
OS
U
Dash Board
I
Co
nfi
g
OS
U
Nagios
I
Co
nfi
g
OS
U
Crowbar Chef
I
Co
nfi
g
![Page 20: Prying the Cloud Open: Dell Crowbar & OpenStack · Prying the Cloud Open: Dell Crowbar & OpenStack Rob Hirschfeld (@zehicle), Principal Cloud Architect ... CloudOps for OpenStack](https://reader030.fdocuments.net/reader030/viewer/2022040612/5edd86d0ad6a402d6668a656/html5/thumbnails/20.jpg)
Plus interconnections are highly complex and dynamic
July 20, 2011 Dell Cloud Solutions 20
CloudOps for OpenStack
OS
U
Nova Node
I
Co
nfi
g
OS
U
Nova API
I
Co
nfi
g
OS
U
Nova Node
I
Co
nfi
g
OS
U
Nova Node
I C
on
fig
OS
U
Nova Node
I
Co
nfi
g
OS
U
Nova Node
I
Co
nfi
g
OS
U
Nova Node
I
Co
nfi
g
OS
U
Nova DB
I
Co
nfi
g
OS
U
Nova Cntrl
I
Co
nfi
g
OS
U
Dash Board
I
Co
nfi
g
OS
U
Nagios
I
Co
nfi
g
OS
U
Crowbar Chef
I
Co
nfi
g
![Page 21: Prying the Cloud Open: Dell Crowbar & OpenStack · Prying the Cloud Open: Dell Crowbar & OpenStack Rob Hirschfeld (@zehicle), Principal Cloud Architect ... CloudOps for OpenStack](https://reader030.fdocuments.net/reader030/viewer/2022040612/5edd86d0ad6a402d6668a656/html5/thumbnails/21.jpg)
7/21/2011 Confidential 21
No soup for you!
![Page 22: Prying the Cloud Open: Dell Crowbar & OpenStack · Prying the Cloud Open: Dell Crowbar & OpenStack Rob Hirschfeld (@zehicle), Principal Cloud Architect ... CloudOps for OpenStack](https://reader030.fdocuments.net/reader030/viewer/2022040612/5edd86d0ad6a402d6668a656/html5/thumbnails/22.jpg)
Crowbar Deep Dive
WARNING: TECHNICAL CONTENT AHEAD
July 20, 2011 Dell Cloud Solutions 22
$ $
![Page 23: Prying the Cloud Open: Dell Crowbar & OpenStack · Prying the Cloud Open: Dell Crowbar & OpenStack Rob Hirschfeld (@zehicle), Principal Cloud Architect ... CloudOps for OpenStack](https://reader030.fdocuments.net/reader030/viewer/2022040612/5edd86d0ad6a402d6668a656/html5/thumbnails/23.jpg)
Mission: “A Zero Touch Cloud Installer” Servers in boxes to full function cloud in under 2 hours
Fast & Flexible Bare metal install including BIOS & RAID config Users can choose how their system is configured (“barclamps”)
DevOps Embracing Ongoing Operations Model (DevOps for Clouds) Leverages & Wraps Opscode Chef
Open Not specific to OpenStack – Dell using for other Apps Not restricted to Dell hardware Apache 2 licensed
July 20, 2011 Dell Cloud Solutions 23
What is Crowbar?
![Page 24: Prying the Cloud Open: Dell Crowbar & OpenStack · Prying the Cloud Open: Dell Crowbar & OpenStack Rob Hirschfeld (@zehicle), Principal Cloud Architect ... CloudOps for OpenStack](https://reader030.fdocuments.net/reader030/viewer/2022040612/5edd86d0ad6a402d6668a656/html5/thumbnails/24.jpg)
July 20, 2011 Dell Cloud Solutions 24
Crowbar Stages of Deployment D
ell
“C
row
ba
r”
Op
s M
an
ag
em
en
t
Core Components &
Operating Systems
Cloud
Infrastructure &
Dell IP Extensions
Physical Resources
APIs, User Access,
& Ecosystem
Partners
* Crowbar has potential to service other programs beyond OpenStack
Includes all the components required to implement an entire cloud infrastructure including ecosystems partners
Pluggable components deploy cloud infrastructure.
Allow for addition of Dell IP and expansion by the community services and customers
Can integrate with Dell existing products
Delivers basic data center services and required cloud infrastructure.
Provision bare-metal servers from box to cloud WITHOUT user intervention (other than racking/cabling and some minimal configuration questions) NOT EXCLUSIVE TO DELL HARDWARE
![Page 25: Prying the Cloud Open: Dell Crowbar & OpenStack · Prying the Cloud Open: Dell Crowbar & OpenStack Rob Hirschfeld (@zehicle), Principal Cloud Architect ... CloudOps for OpenStack](https://reader030.fdocuments.net/reader030/viewer/2022040612/5edd86d0ad6a402d6668a656/html5/thumbnails/25.jpg)
July 20, 2011 Dell Cloud Solutions 25
Crowbar = Install State Machine
![Page 26: Prying the Cloud Open: Dell Crowbar & OpenStack · Prying the Cloud Open: Dell Crowbar & OpenStack Rob Hirschfeld (@zehicle), Principal Cloud Architect ... CloudOps for OpenStack](https://reader030.fdocuments.net/reader030/viewer/2022040612/5edd86d0ad6a402d6668a656/html5/thumbnails/26.jpg)
July 20, 2011 Dell Cloud Solutions 26
Modular Design: Barclamps D
ell
“C
row
ba
r”
Op
s M
an
ag
em
en
t
Core Components &
Operating Systems
Cloud
Infrastructure &
Dell IP Extensions
Physical Resources
APIs, User Access,
& Ecosystem
Partners
* Crowbar has potential to service other programs beyond OpenStack
Crowbar
Deployer
Provisioner
Network RAID
BIOS IMPI
NTP
DNS Logging
Nova Swift Glace
Nagios Ganglia Dashboard
Compellent EqualLogic
![Page 27: Prying the Cloud Open: Dell Crowbar & OpenStack · Prying the Cloud Open: Dell Crowbar & OpenStack Rob Hirschfeld (@zehicle), Principal Cloud Architect ... CloudOps for OpenStack](https://reader030.fdocuments.net/reader030/viewer/2022040612/5edd86d0ad6a402d6668a656/html5/thumbnails/27.jpg)
July 20, 2011 Dell Cloud Solutions 27
Live Demo (placeholder)
![Page 28: Prying the Cloud Open: Dell Crowbar & OpenStack · Prying the Cloud Open: Dell Crowbar & OpenStack Rob Hirschfeld (@zehicle), Principal Cloud Architect ... CloudOps for OpenStack](https://reader030.fdocuments.net/reader030/viewer/2022040612/5edd86d0ad6a402d6668a656/html5/thumbnails/28.jpg)
July 20, 2011 Dell Cloud Solutions 28
Live Demo (placeholder)
![Page 29: Prying the Cloud Open: Dell Crowbar & OpenStack · Prying the Cloud Open: Dell Crowbar & OpenStack Rob Hirschfeld (@zehicle), Principal Cloud Architect ... CloudOps for OpenStack](https://reader030.fdocuments.net/reader030/viewer/2022040612/5edd86d0ad6a402d6668a656/html5/thumbnails/29.jpg)
In Conclusion,
July 20, 2011 Dell Cloud Solutions 29
![Page 30: Prying the Cloud Open: Dell Crowbar & OpenStack · Prying the Cloud Open: Dell Crowbar & OpenStack Rob Hirschfeld (@zehicle), Principal Cloud Architect ... CloudOps for OpenStack](https://reader030.fdocuments.net/reader030/viewer/2022040612/5edd86d0ad6a402d6668a656/html5/thumbnails/30.jpg)
Intersection of two major technology waves:
Operational Automation (DevOps)
Open Source Cloud (OpenStack)
Together, a practical approach to cloud scale
Manages elastic resources
Embraces constant change
Productizes best practices
July 20, 2011 Dell Cloud Solutions 30
Open Cloud Operations
![Page 31: Prying the Cloud Open: Dell Crowbar & OpenStack · Prying the Cloud Open: Dell Crowbar & OpenStack Rob Hirschfeld (@zehicle), Principal Cloud Architect ... CloudOps for OpenStack](https://reader030.fdocuments.net/reader030/viewer/2022040612/5edd86d0ad6a402d6668a656/html5/thumbnails/31.jpg)
July 20, 2011 Dell Cloud Solutions 31
OpenStack + Crowbar =
![Page 32: Prying the Cloud Open: Dell Crowbar & OpenStack · Prying the Cloud Open: Dell Crowbar & OpenStack Rob Hirschfeld (@zehicle), Principal Cloud Architect ... CloudOps for OpenStack](https://reader030.fdocuments.net/reader030/viewer/2022040612/5edd86d0ad6a402d6668a656/html5/thumbnails/32.jpg)
Questions? More info:
• http://Dell.com/OpenStack - White Papers & More!
• http://RobHirschfeld.com – Technical & Agile
• http://JBGeorge.net – Business & Marketing