Crash Course in Open Source Cloud Computing
-
Upload
mark-hinkle -
Category
Technology
-
view
4.126 -
download
3
description
Transcript of Crash Course in Open Source Cloud Computing
![Page 1: Crash Course in Open Source Cloud Computing](https://reader035.fdocuments.net/reader035/viewer/2022062300/554fa2aeb4c9057b298b49f5/html5/thumbnails/1.jpg)
Mark R. HinkleVP of Community Cloud.comTwitter: @mrhinkleEmail: [email protected]
Crash Course in Open Source Cloud Computing
![Page 2: Crash Course in Open Source Cloud Computing](https://reader035.fdocuments.net/reader035/viewer/2022062300/554fa2aeb4c9057b298b49f5/html5/thumbnails/2.jpg)
2
%whoami• Responsible for Driving Adoption of
CloudStack Open Source Cloud Computing Software
• Former manager of Zenoss Open Source project 100,000 users, 1.5 million downloads
• Former Linux Desktop Advocate (Zealot?)
• Former LinuxWorld Magazine Editor-in-Chief
• Open Management Consortium Conspirator
• Open Desktop Consortium Instigator• Author - “Windows to Linux Business
Desktop Migration” - Thomson• NetDirector Project - Open Source
Configuration Management Project• Sometimes Author and Blogger at
SocializedSoftware.com/NetworkWorld• Start-up junkie, Glutton for
punishment
![Page 3: Crash Course in Open Source Cloud Computing](https://reader035.fdocuments.net/reader035/viewer/2022062300/554fa2aeb4c9057b298b49f5/html5/thumbnails/3.jpg)
Slides Can be Viewed and Downloaded at:
http://www.slideshare.net/socializedsoftware/
![Page 4: Crash Course in Open Source Cloud Computing](https://reader035.fdocuments.net/reader035/viewer/2022062300/554fa2aeb4c9057b298b49f5/html5/thumbnails/4.jpg)
4
Agenda
1. Cloud Computing Trends
2. Quick Cloud Computing Overview
3. Open Source Building Blocks for Cloud Computing
4. Open Source Tools for Cloud Management
5. Questions
![Page 5: Crash Course in Open Source Cloud Computing](https://reader035.fdocuments.net/reader035/viewer/2022062300/554fa2aeb4c9057b298b49f5/html5/thumbnails/5.jpg)
Cloud Computing:Cloud Computing Trends
http://www.dilbert.com/strips/comic/2011-01-07/
![Page 6: Crash Course in Open Source Cloud Computing](https://reader035.fdocuments.net/reader035/viewer/2022062300/554fa2aeb4c9057b298b49f5/html5/thumbnails/6.jpg)
6Recent Study on Cloud Computing Preferences
• 521 IT Professionals Surveyed • Cloud.com, BitNami and Zenoss User
Communities• Conducted Q2 of 2011• Publishing week of June 12th
![Page 7: Crash Course in Open Source Cloud Computing](https://reader035.fdocuments.net/reader035/viewer/2022062300/554fa2aeb4c9057b298b49f5/html5/thumbnails/7.jpg)
7Top Reasons For Cloud Computing Adoption
![Page 8: Crash Course in Open Source Cloud Computing](https://reader035.fdocuments.net/reader035/viewer/2022062300/554fa2aeb4c9057b298b49f5/html5/thumbnails/8.jpg)
8
Open Source Usage
![Page 9: Crash Course in Open Source Cloud Computing](https://reader035.fdocuments.net/reader035/viewer/2022062300/554fa2aeb4c9057b298b49f5/html5/thumbnails/9.jpg)
9
Cloud Service Model Usage
Services Models Consumed by Cloud Computing Users in 2011
![Page 10: Crash Course in Open Source Cloud Computing](https://reader035.fdocuments.net/reader035/viewer/2022062300/554fa2aeb4c9057b298b49f5/html5/thumbnails/10.jpg)
10
Why Open Source?
• Typically User-Driven to solve real problems• Larger user base, users helping users • Lower barrier to participation• Aggressive release cycles – stay current with
the state of the art• Try before you “buy”, no Brochure-ware, no
“Powerpoint software• Open data, Open standards, Open APIs
![Page 11: Crash Course in Open Source Cloud Computing](https://reader035.fdocuments.net/reader035/viewer/2022062300/554fa2aeb4c9057b298b49f5/html5/thumbnails/11.jpg)
Quick Cloud Computing Overview: Or the Obligatory “What is the Cloud?” Slides
![Page 12: Crash Course in Open Source Cloud Computing](https://reader035.fdocuments.net/reader035/viewer/2022062300/554fa2aeb4c9057b298b49f5/html5/thumbnails/12.jpg)
12
Five Characteristics of Clouds
1.On-Demand Self-Service
2.Broad Network Access
3.Resource Pooling
4.Rapid Elasticity
5.Measured Service
![Page 13: Crash Course in Open Source Cloud Computing](https://reader035.fdocuments.net/reader035/viewer/2022062300/554fa2aeb4c9057b298b49f5/html5/thumbnails/13.jpg)
13Cloud Computing Service Models
USER CLOUD a.k.a. SOFTWARE AS A SERVICE
Single application, multi-tenancy, network-based, one-to-many delivery of applications, all users have same access to features.
Examples: Salesforce.com, Google Docs, Red Hat Network/RHEL
DEVELOPMENT CLOUD a.k.a. PLATFORM-AS-A-SERVICE
Application developer model, Application deployed to an elastic service that autoscales, low administrative overhead. No concept of virtual machines or operating system. Code it and deploy it.
Examples: Google AppEngine, Windows Azure, Rackspace Site, Red Hat Makara
SYSTEMS CLOUD a.k.a INFRASTRUCTURE-AS-A-SERVICE
Servers and storage are made available in a scalable way over a network.
Examples: EC2,Rackspace CloudFiles, OpenStack, CloudStack, Eucalyptus, Ubuntu Enterprise Cloud, OpenNebula
SaaS
PaaS
IaaS
![Page 14: Crash Course in Open Source Cloud Computing](https://reader035.fdocuments.net/reader035/viewer/2022062300/554fa2aeb4c9057b298b49f5/html5/thumbnails/14.jpg)
14Deployment Models Public, Private & Hybrid Clouds
![Page 15: Crash Course in Open Source Cloud Computing](https://reader035.fdocuments.net/reader035/viewer/2022062300/554fa2aeb4c9057b298b49f5/html5/thumbnails/15.jpg)
Building Compute Cloudswith Open Source Software
![Page 16: Crash Course in Open Source Cloud Computing](https://reader035.fdocuments.net/reader035/viewer/2022062300/554fa2aeb4c9057b298b49f5/html5/thumbnails/16.jpg)
16Cloud Still Requires Architectural Design• Cloud Computing isn’t a “magical
solution”• Need to design your architecture
with the end in mind • As you build it make your
infrastructure easily replicable
![Page 17: Crash Course in Open Source Cloud Computing](https://reader035.fdocuments.net/reader035/viewer/2022062300/554fa2aeb4c9057b298b49f5/html5/thumbnails/17.jpg)
17
Open Source Hypervisors
Open Source• Xen, Xen Cloud Platform (XCP)• KVM – Kernel-based Virtualization• VirtualBox* - Oracle supported Virtualization Solutions • OpenVZ* - Container-based, Similar to Solaris Containers or BSD
Zones• LXC – User Space chrooted installs
Proprietary• VMware• Citrix Xenserver• Microsoft Hyper-V• Oracle VM
![Page 18: Crash Course in Open Source Cloud Computing](https://reader035.fdocuments.net/reader035/viewer/2022062300/554fa2aeb4c9057b298b49f5/html5/thumbnails/18.jpg)
18
Open Source Compute CloudsYear Started License Hypervisors
Supported
2010 (Development Since 2008)
GPL Xenserver, VMware, KVM, Hyper-V
2008 GPL Xen, KVM, VMware
2010 (Developed by NASA by Anso Labs peviously)
Apache Xen, KVM, Hyper-V
2009 (Karmic Koala) GPL Xen,KVM
2009 (Development 2006)
LGPL v3 VMware ESX and ESXi, Microsoft Hyper-V, Xen, KVM and Virtual Box
Ubuntu Enterprise Cloud
![Page 19: Crash Course in Open Source Cloud Computing](https://reader035.fdocuments.net/reader035/viewer/2022062300/554fa2aeb4c9057b298b49f5/html5/thumbnails/19.jpg)
19Open Source Cloud Computing Storage• GlusterFS – Scale Out NAS system aggregating
storage over Ethernet or Infiniband• CEPH – Distributed file storage system• OpenStack Object Storage (SWIFT) – Long-
term storage object storage system• Sheepdog – Distributed storage for KVM
hypervisors• NFS – Old standby, tried and true, not designed
for cloud scale or performance
![Page 20: Crash Course in Open Source Cloud Computing](https://reader035.fdocuments.net/reader035/viewer/2022062300/554fa2aeb4c9057b298b49f5/html5/thumbnails/20.jpg)
20Cloud APIs Aren’t Created EqualOpen Source Abstractions• jclouds• libcloud• deltacloud• fog
![Page 21: Crash Course in Open Source Cloud Computing](https://reader035.fdocuments.net/reader035/viewer/2022062300/554fa2aeb4c9057b298b49f5/html5/thumbnails/21.jpg)
21
Private Cloud Architecture
API Abstraction
s
![Page 22: Crash Course in Open Source Cloud Computing](https://reader035.fdocuments.net/reader035/viewer/2022062300/554fa2aeb4c9057b298b49f5/html5/thumbnails/22.jpg)
Managing Clouds with Open Source Tools
![Page 23: Crash Course in Open Source Cloud Computing](https://reader035.fdocuments.net/reader035/viewer/2022062300/554fa2aeb4c9057b298b49f5/html5/thumbnails/23.jpg)
23Automation Unlocks the Potential of the Cloud
• MeatCloud, Can’t Keep up with Cloud Computing
• Devops & Agile IT Philosophy
• Script Repetitive Tasks
• Automate, Automate, Automate
![Page 24: Crash Course in Open Source Cloud Computing](https://reader035.fdocuments.net/reader035/viewer/2022062300/554fa2aeb4c9057b298b49f5/html5/thumbnails/24.jpg)
24
Why Open Source Tools?
• Aggressively Developed, Keep Pace with State of the Art
• User-Developed and Instrumented
• Easy to Assemble into Automated Toolchains
![Page 25: Crash Course in Open Source Cloud Computing](https://reader035.fdocuments.net/reader035/viewer/2022062300/554fa2aeb4c9057b298b49f5/html5/thumbnails/25.jpg)
25
What Makes Tools Cloudy?
• Network Capable• Cloud “Aware” • Easy-to-Integrate• Adhere to Open Standards• Lend Themselves to Automation
![Page 26: Crash Course in Open Source Cloud Computing](https://reader035.fdocuments.net/reader035/viewer/2022062300/554fa2aeb4c9057b298b49f5/html5/thumbnails/26.jpg)
26
The Myth of the NinesAvailability % Downtime per
YearDowntime per Month
Downtime per Week
99.9% (three nines)
8.76 hours 43.2 minutes 10.1 minutes
99.95% 4.38 hours 21.56 minutes 5.04 minutes
99.99% (four nines)
52.6 minutes 4.32 minutes 1.01 minutes
99.999% (five nines)
5.26 minutes 25.9 seconds 6.05 seconds
99.9999% (six nines)
31.5 seconds 2.59 seconds .0605 seconds
Average polling interval for monitoring? 5 minutes? Even superhuman operations people can’t be alerted and take action in under 5 minutes.
One outage per year could drop service level to three nines or worse.
![Page 27: Crash Course in Open Source Cloud Computing](https://reader035.fdocuments.net/reader035/viewer/2022062300/554fa2aeb4c9057b298b49f5/html5/thumbnails/27.jpg)
27
4 Types of Management Tools
ProvisioningInstallation of operating systems and other software
Configuration ManagementSets the parameters for servers, can specify installation parameters
Orchestration/AutomationAutomate tasks across systems
MonitoringRecords errors and health of IT infrastructure
![Page 28: Crash Course in Open Source Cloud Computing](https://reader035.fdocuments.net/reader035/viewer/2022062300/554fa2aeb4c9057b298b49f5/html5/thumbnails/28.jpg)
28
Management Toolchains
Configuration
Patching and
Provisioning
Monitoring
Toolchain (n):
A set of tools where the output of one tool becomes the input of another tool
![Page 29: Crash Course in Open Source Cloud Computing](https://reader035.fdocuments.net/reader035/viewer/2022062300/554fa2aeb4c9057b298b49f5/html5/thumbnails/29.jpg)
29Open Source Provisioning Tools
Year Started Language License Installation Targets
Cobbler 2007 Python GPL Red Hat, OpenSUSE Fedora, Debian, Ubuntu
Kickstart ? Python GPL Most .dep and RPM based Linux distros
Spacewalk 2008 Perl, Python, Java
GPL Fedora, Centos
Crowbar 2011 Ruby Apache (Bare metal provisioning)
![Page 30: Crash Course in Open Source Cloud Computing](https://reader035.fdocuments.net/reader035/viewer/2022062300/554fa2aeb4c9057b298b49f5/html5/thumbnails/30.jpg)
30Open SourceConfiguration Management Tools Year Started Language License Client/Server
Bcfg2 2003 Python BSD Yes
Cfengine 1993 C Apache Yes
Chef 2009 Ruby Apache Chef Solo – No Chef Server - Yes
Puppet 2004 Ruby GPL yes
![Page 31: Crash Course in Open Source Cloud Computing](https://reader035.fdocuments.net/reader035/viewer/2022062300/554fa2aeb4c9057b298b49f5/html5/thumbnails/31.jpg)
31Open SourceMonitoring Tools
Year Started
License Language
Type of Monitoring
Collection Methods
Cacti 2001 GPL PHP Performance SNMP, syslog
Nagios 1999 GPL C/PHP Availability SNMP,TCP, ICMP, IPMI, syslog
OpenNMS 2000 GPL Java Availability/Performance
SNMP,
Zabbix 2001 GPL C/PHP Availability/ Performance and more
SNMP, TCP/ICMP, IPMI, Synthetic Transactions
Zenoss 2005 GPL Python Availability, Performance, Event Management
SNMP, ICMP, SSH, syslog, WMI
![Page 32: Crash Course in Open Source Cloud Computing](https://reader035.fdocuments.net/reader035/viewer/2022062300/554fa2aeb4c9057b298b49f5/html5/thumbnails/32.jpg)
32Open Source Automation/Orchestration Tools
Year Started
Language License Client/Server
Support Organization
AutomateIT
2009 Ruby GPL No None
Capistrano
2006 Ruby MIT Yes None
RunDeck 2010 Java Apache Yes DTO Solutions
Func 2007 Python GPL Yes Fedora Project
MCollective
2009 Ruby Apache Yes PuppetLabs
![Page 33: Crash Course in Open Source Cloud Computing](https://reader035.fdocuments.net/reader035/viewer/2022062300/554fa2aeb4c9057b298b49f5/html5/thumbnails/33.jpg)
33
Automated Toolchain
Cloud ImageLaunch
OS Install
System Configuration
Application Service Orchestration
CapistranoRunDeckFabricFunc
BCFG2CfengineChefPuppet
Cloud:EucalyptusOpenStackCloudStackAbiquo
OS Install:KickstartCobblerSpacewalk
Command and Control
Configuration
BootstrappingP
rovis
ion
ing
Acti
vit
y
![Page 34: Crash Course in Open Source Cloud Computing](https://reader035.fdocuments.net/reader035/viewer/2022062300/554fa2aeb4c9057b298b49f5/html5/thumbnails/34.jpg)
Questions?
![Page 35: Crash Course in Open Source Cloud Computing](https://reader035.fdocuments.net/reader035/viewer/2022062300/554fa2aeb4c9057b298b49f5/html5/thumbnails/35.jpg)
35
Contact Me
Professional: [email protected]: [email protected]
Professional: [email protected]: [email protected]
Professional: http://open.cloud.comPersonal: http://socializedsoftware.comTwitter: @mrhinkle
Mark R. HinkleVP of CommunityOpen Source Enthusiast
![Page 36: Crash Course in Open Source Cloud Computing](https://reader035.fdocuments.net/reader035/viewer/2022062300/554fa2aeb4c9057b298b49f5/html5/thumbnails/36.jpg)
Delivering Infrastructure-as-a-Service with Open Source Softwareby Mark R. Hinkle is licensed under a Creative Commons Attribution-
ShareAlike 3.0 United States License.