Cisco OpenStackonCiscoUCS.pdf

34
Cisco Confidential © 2013 Cisco and/or its affiliates. All rights reserved. 1 Yvo Wiskerke Solution Architect Dutch DC/V Team

description

Cisco OpenStackonCiscoUCS.pdf

Transcript of Cisco OpenStackonCiscoUCS.pdf

  • Cisco Confidential 2013 Cisco and/or its affiliates. All rights reserved. 1

    Yvo Wiskerke Solution Architect Dutch DC/V Team

  • 2013 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 2

    OpenStack is a cloud operating system that controls large pools of compute, storage, and

    networking resources throughout a datacenter, all managed through a dashboard that gives

    administrators control while empowering their users to provision resources through a web

    interface.

    ~10,000 Developers

    850 Organizations

  • 2013 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 3

    Ciscos Participation in OpenStack Interest

    Support customers interested in OpenStack

    Contribute to and learn from the community

    Advance the state of the art in cloud computing

    What Cisco contributes

    Networking expertise, internet experience

    Industry support

    Designs and Code

    Work to date

    OpenStack running on Cisco Unified Computing System

    Networking Service blueprint

    More to come

  • 2013 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 4 4

    RACKSPACE HOSTING | WWW.RACKSPACE.COM

    Bexar Release Feb 2011

    Cactus Release Apr 2011

    Diablo Design Summit Apr 2011

    Diablo Release Sep 2011

    Essex Design Summit Oct 2011

    Essex Release Apr 2012

    Folsom Design Summit Apr 2012

    Austin Release Oct 2010

    Grizzly Design Summit Oct 2012

    I Design Summit Nov 2013

    Folsom Release Sep 2012

    Havana Release Oct 2013

    Havana Design Summit Apr 2013

    Grizzly Release Apr 2013

    Metering (Ceilometer): Central collection for metering/monitoring data

    Example: Collect usage information for billing systems

    Orchestration (Heat): Template-based orchestration engine for OpenStack

    Example: Developers define application deployment patterns

    LBaaS: Expect to see more plugins and ecosystem activity

  • 2013 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 5

    OpenStack Community 60+ companies

  • 2013 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 6

    Control and Flexibility Open source platform and modular design which can integrate with

    legacy or third-party technologies as per business needs without vendor

    lock in.

    Scalability Ability to build massively scalable public or private clouds with petabyte

    storage range.

    Feature velocity with a growing developer base.

    Open Industry Standard Leading companies like Cisco, Citrix, Dell, Intel, Microsoft actively

    engaged and contributing.

    As an example, current hypervisor support includes ESX, Hyper-V, KVM,

    QEMU, XEN, Xenserver.

  • 2013 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 7

    X-As-A-Service !

    7

    Storage AAS

    [Object: Swift, Block: Cinder]

    Networking AAS

    [Neutron]

    Image AAS

    [Glance]

    Compute AAS

    [Nova]

    Identity AAS

    [Keystone]

    Dashboard

    [Horizon]

    RBAC, AAA,PAM

    etc

    User/Admin Portal, Rudimentary SC VM / OS Images repo,

    management, image as a

    service

    Storage, distributed file and

    object storage across DCs /

    Geos

    L2/L3 virt, multiple

    interfaces/networks , VLANs,

    Controller and plugins

    Virtual Network Infra !

    VM lifecycle mgmt.,

    schedulers, mini

    orchestration etc

  • 2013 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 8

    OpenStack Networking or Neutron (formerly Quantum ) is an OpenStack project to provide networking as a service between interface devices (e.g., vNICs) managed by other

    Openstack services (e.g., nova)

    Manages network virtualization lifecycle

    just like compute (nova) manages server virtualization

    Advocates multi-tenancy

    Technology-agnostic

    Extends and enhances Software Defined Networking

  • 2013 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 9

    Gives cloud tenants an API to build rich networking topologies, and configure advanced network policies in the cloud.

    Example: create multi-tier web application topology

    Enable innovation plugins (open and closed source) that introduce advanced network capabilities

    Example: use L2-in-L3 tunneling to avoid VLAN limits, provide end-to-end QoS guarantees, used in monitoring protocols like NetFlow and OpenFlow.

    Let anyone build virtualized network services (open and closed source) that plug into Openstack tenant networks.

    Examples: LB-aaS, VPN-aaS, firewall-aaS, IDS-aaS, data-center-interconnect-aaS.

  • 2013 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 10

    Problem Mixed P/V Network Elements, Interoperability (P/V +

    Vendor) headaches

    Solution Seamless P/V coexistence

    Standardized for interoperability

  • 2013 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 11

    Nexus 1000V

    Distributed switch

    NX-OS consistency

    VSG

    VM-level controls

    Zone-based FW

    ASA 1000V

    Edge firewall, VPN

    Protocol Inspection

    vWAAS

    WAN optimization

    Application traffic

    WAN

    Router

    Servers

    Tenant A ASA 1000V

    Cloud

    Firewall

    Nexus 1000V Physical Infrastructure

    Virtualized/Cloud Data Center

    vWAAS

    Cisco Virtual

    Security

    Gateway

    CSR 1000V (Cloud Router)

    WAN L3 gateway

    Routing and VPN

    Switches

    Ecosystem Services

    Citrix NetScaler VPX virtual ADC

    Imperva Web App. Firewall

    Cloud Network Services

    Citrix

    NetScaler

    VPX

    Imperva

    SecureSphere

    WAF Cloud

    Services

    Router 1000V

    Zone A

    Zone B

    vPath VXLAN

    Multi-Hypervisor (VMware, Microsoft, KVM, Xen*)

  • 2013 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 12

    Control Plane

    Data Plane

    Controller

    Data Plane

    Applications

    Vendor-

    specific APIs

    OpenFlow

    2a Classic SDN

    Vendor

    Specific

    (e.g. onePK)

    Controller

    Data Plane

    Applications

    Vendor-

    specific APIs

    OpenFlow

    Control Plane

    2b Hybrid SDN

    Applications

    Virtual Control Plane

    Virtual Data Plane

    Overlay

    Protocols

    (e.g. VXLAN)

    Vendor-

    specific APIs

    3 Network Virtualization/

    Virtual Overlays

    Control Plane

    Data Plane

    Vendor-

    specific APIs

    Applications

    1 Programmable APIs

    Control Plane

    Data Plane

    Vendor

    Specific

    (e.g. onePK) Vendor

    Specific

    (e.g. onePK)

    Openstack and Network Overlays Apply to All Models (Physical/Virtual) Custom Features Can Be Built

    CLI, SNMP,

  • 2013 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 13

    a

    Industrys Most Comprehensive Networking Portfolio

    Hardware + Software Physical + Virtual Network + Compute

    Network

    Platform

    APIs

    Controllers and

    Agents

    Virtual

    Overlays

    Applications

    www.cisco.com/go/one

    onePK

    SDN:

    Controller SW

    OpenFlow on C3K

    N1KV Enhancements

    for Open Clouds

  • 2013 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 14

    Complete Application Deliver platform

    Delivering Compute/Storage/Network synergies via UCS and Nexus

    Cisco Open Cloud Solution

    Auto

    mation

    Virtu

    al

    Applia

    nces

    Netw

    ork

    Serv

    ices

    Cisco SDN and Infrastructure onePK

    Scalable

    Message Bus

    Video Scalable

    Object Store

    App Metering,

    Others

    Customer

    App A

    Customer

    App B Cisco Apps -

    WebEx Cisco Apps

    Video etc.

    Cisco Apps -

    HCS

    Open Stack Distro

    Compute (Nova)

    Storage (Swift/Cinder)

    Networking (Neutron)

    OpenStack

    Plugins/Drivers OS Plugins

    Advanced S

    erv

    ices

  • 2013 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 15

    (Neutron f.k.a. Quantum)

    Neutron API

    Neutron Service

    Neutron Plug-in API

    API Extensions

    Cisco Cloud Networking Plug-In

    Cisco NaaS / other

    Cisco Infrastructure Products

    Nexus 1k/7k Unified Computing System (via UCS Manager)

    Routing portfolio (e.g. ASR, CRS)

  • 2013 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 16

    Controller Node

    Intel E5-2660, 256 Gb, 2 TB HDD

    B200 M3; C220 M3

    Compute Nodes

    Intel E5-2660, 768 Gb 1 TB RAM, 2 TB HDD

    B200 M3, B250 M2; B440 M2; C220 M3

    Storage Nodes

    Intel E5-2660, 32 Gb RAM, 24 TB HDD

    C240 M3

    01

    05

    10

    15

    20

    25

    30

    35

    40

    02

    03

    04

    06

    07

    08

    09

    11

    12

    13

    14

    16

    17

    18

    19

    21

    22

    23

    24

    26

    27

    28

    29

    31

    32

    33

    34

    36

    37

    38

    39

    41

    42

    01

    05

    10

    15

    20

    25

    30

    35

    40

    02

    03

    04

    06

    07

    08

    09

    11

    12

    13

    14

    16

    17

    18

    19

    21

    22

    23

    24

    26

    27

    28

    29

    31

    32

    33

    34

    36

    37

    38

    39

    41

    42

    CONSOLE

    Cisco UCS 6120XP

    1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20L1 L2 MGMT0 MGMT1

    SL

    OT

    2

    PS2 PS1

    CONSOLE

    Cisco UCS 6120XP

    1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20L1 L2 MGMT0 MGMT1

    SL

    OT

    2

    PS2 PS1

    Storage Cinder (Block storage)

    Swift ( Object storage)

    Compute Nodes Mission critical

    Enterprise Class

    Build Server

    Controllers

    Network Access

    Unified Fabric

    PW

    R

    SY

    S

    PW

    R

    SY

    S

    PW

    R

    SY

    S

    PW

    R

    SY

    S

    PW

    R

    SY

    S

    PW

    R

    SY

    S

    PW

    R

    SY

    S

    PW

    R

    SY

    S

    PW

    R

    SY

    S

    PW

    R

    SY

    S

    PW

    R

    SY

    S

    PW

    R

    SY

    S

    PW

    R

    SY

    S

    PW

    R

    SY

    S

    PW

    R

    SY

    S

    PW

    R

    SY

    S

    PW

    R

    SY

    S

    PW

    R

    SY

    S

    PW

    R

    SY

    S

    PW

    R

    SY

    S

    PW

    R

    SY

    S

    PW

    R

    SY

    S

    PW

    R

    SY

    S

    PW

    R

    SY

    S

    PW

    R

    SY

    S

    CO

    NS

    OL

    E

    UCS

    C240 M3

    !

    PW

    R

    SY

    S

    PW

    R

    SY

    S

    PW

    R

    SY

    S

    PW

    R

    SY

    S

    PW

    R

    SY

    S

    PW

    R

    SY

    S

    PW

    R

    SY

    S

    PW

    R

    SY

    S

    PW

    R

    SY

    S

    PW

    R

    SY

    S

    PW

    R

    SY

    S

    PW

    R

    SY

    S

    PW

    R

    SY

    S

    PW

    R

    SY

    S

    PW

    R

    SY

    S

    PW

    R

    SY

    S

    PW

    R

    SY

    S

    PW

    R

    SY

    S

    PW

    R

    SY

    S

    PW

    R

    SY

    S

    PW

    R

    SY

    S

    PW

    R

    SY

    S

    PW

    R

    SY

    S

    PW

    R

    SY

    S

    PW

    R

    SY

    S

    CO

    NS

    OL

    E

    UCS

    C240 M3

    !

    PW

    R

    SY

    S

    PW

    R

    SY

    S

    PW

    R

    SY

    S

    PW

    R

    SY

    S

    PW

    R

    SY

    S

    PW

    R

    SY

    S

    PW

    R

    SY

    S

    PW

    R

    SY

    S

    PW

    R

    SY

    S

    PW

    R

    SY

    S

    PW

    R

    SY

    S

    PW

    R

    SY

    S

    PW

    R

    SY

    S

    PW

    R

    SY

    S

    PW

    R

    SY

    S

    PW

    R

    SY

    S

    PW

    R

    SY

    S

    PW

    R

    SY

    S

    PW

    R

    SY

    S

    PW

    R

    SY

    S

    PW

    R

    SY

    S

    PW

    R

    SY

    S

    PW

    R

    SY

    S

    PW

    R

    SY

    S

    PW

    R

    SY

    S

    CO

    NS

    OL

    E

    UCS

    C240 M3

    !

  • 2013 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 17

    Server Health Monitoring

    Multi-Chassis Server Identity Manager

    Servers 1-8

    Servers 17-24

    1 Logical Chassis

    Servers 9-16

    Servers 25-32

    Servers 33-40

    Servers 49-56

    Servers 65-72

    Servers 81-88

    Servers 97-104

    Servers 113-120

    Servers 129-136

    Servers 145-152 Servers 153-160

    Servers 41-48

    Servers 57-64

    Servers 73-80

    Servers 89-96

    Servers 105-112

    Servers 121-128

    Servers 137-144

    Ethernet Ethernet

    Fiber Channel Fiber Channel

    Server Health Monitoring

    Multi-chassis Server Identity Manager

    Blade & Chassis Management

    Fabric Interconnect A Fabric Interconnect B

    Legacy Blade Architecture

    Enet Switch Enet Switch

    FC Switch FC Switch

    CMC/OA CMC/OA

    Enclosure 1: Servers 1-16

    Enet Switch Enet Switch

    FC Switch FC Switch

    CMC/OA CMC/OA

    Enclosure 2: Servers 17-32

    Enet Switch Enet Switch

    FC Switch FC Switch

    CMC/OA CMC/OA

    Enclosure 3: Servers 33-48

    Enet Switch Enet Switch

    FC Switch FC Switch

    CMC/OA CMC/OA

    Enclosure 4: Servers 49-64

    Enet Switch Enet Switch

    FC Switch FC Switch

    CMC/OA CMC/OA

    Enclosure 6: Servers 1-16

    Enet Switch Enet Switch

    FC Switch FC Switch

    CMC/OA CMC/OA

    Enclosure 5: Servers 65-80

    Enet Switch Enet Switch

    FC Switch FC Switch

    CMC/OA CMC/OA

    Enclosure 7: Servers 97-112

    Enet Switch Enet Switch

    FC Switch FC Switch

    CMC/OA CMC/OA

    Enclosure 8: Servers 113-138

    Enet Switch Enet Switch

    FC Switch FC Switch

    CMC/OA CMC/OA

    Enclosure 9: Servers 139-154

    Enet Switch Enet Switch

    FC Switch FC Switch

    CMC/OA CMC/OA

    Enclosure 10: Servers 154-160

    Cisco UCS

  • 2013 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 18

    Stateless Computing Configuration Mobility

    SIM CARD* Personality for a Phone

    Personalitiy for a Server SERVICE PROFILE

    * plus AppleID

  • 2013 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 19

    Horizon Nova

    Keystone

    Neutron Glance

    Swift

    Compute

    Node

    Compute

    Node

    Compute

    Node

    Compute

    Node

    Compute

    Node

    Compute

    Node

    Storage

    Node

    Storage

    Node

    Storage

    Node

    Storage

    Node

    Storage

    Node

    Storage

    Node

    CPU and RAM Heavy Disk and I/O Heavy

    Compute Cluster Storage Cluster

    Controller

  • 2013 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 20

    Grizzly release using Puppet and a variety of other tools to automate the OpenStack deployment tasks

    http://docwiki.cisco.com/wiki/OpenStack:Grizzly-Multinode

    The current reference deployment supports:

    Single control server

    Multiple compute nodes

    (Optional) Three or more Swift storage nodes and a Swift proxy node.

    (Optional) One or more Ceph Mon nodes and one or more Ceph OSD nodes.

    Quantum / Neutron managed network

    20

  • 2013 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 21

    Integration script configures UCS Manager with required policies so that it automatically discovers chassis, servers and creates and associates service- profiles with the servers.

    Dynamic Server Pools can be created to classify servers.

    Puppet apply as part of the script so that on SP association, the servers can PXE boot the OS

    UCS

    auto_config

    ucs_conf_template

    Build Server

    XML API

    UCSM

  • 2013 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 22

    Chassis/Server Discovery Service Profile Association PXE boot devices deployed

    Cobbler database update

    Register Nodes Provision UCS Servers

    Updates the newly added node info in puppet Puppet apply Add hosts/system in OpenStack

    Event Listener

    PXE boot for initial OS install RHEL 6.4 installation on bare-metal servers Sync all the plugins from Puppet Master

    Host OS Install

    Inventory of nova nodes on controller VM Provisioning OpenStack Services Deployment

    OpenStack Handover

    Hostname / IP address Logical credentials Resource allocation preferences Only Point of User Touch

    Pre-configure UCS

  • 2013 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 23

    4. PXE Boot 5. Puppet sync

    1. Read conf file

    2. Apply policies

    3. Update Puppet/Cobbler DB

    Build Node

    Control

    Node

    Compute Nodes (nova-compute, libvirtd)

    (glance, scheduler,

    API-deamons)

  • 2013 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 24

  • 2013 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 25

    The Openstack Cisco edition adds -

    Puppet Automated deployment of Openstack services

    Service Assurance

    High Availability

    Cisco Neutron Plugin http://docwiki.cisco.com/wiki/OpenStack:Neutron

    Ciscos developer site wiki for install instructions etc: http://docwiki.cisco.com/wiki/OpenStack

    Multi-compute node version: http://docwiki.cisco.com/wiki/OpenStack:Grizzly-Multinode

  • 2013 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 26

    OpenStack easy install with puppet labs

    Rapid, fault free installation

    UBUNTU image, add openSSH server package.

    RabbitMQ service box must be able to do full DN resolution of itself!

    apt.puppetlabs.com downloads latest and greatest version

    Sudo vim site.pp

    Puppetlabs module for OpenStack installation

    Edit class openstack:all for parameters.

  • 2013 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 27

    Presentation (user access)

    App Middleware servers

    Management & DB servers

    Virtual Memory Streaming

    Virtualization

    Cloud OS

    Unified Computing

    Network

    Storage

  • 2013 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 28

    Cisco Designs on specific releases in beachhead accounts

    Start simple, build from there Focus on automation and HA

    Evangelization of what Cisco is doing - Thought Leadership Help customers know What, When, Where & How

    Engineering

    Customers/Partners

    Community

    Cisco Product Integration

    Nexus Plugins Neutron

    UCS

    CIAC

    Many other integration efforts

    Neutron Network Service

    Horizon Dashboard

    Keystone Identity

    Swift Object Storage

    Automation PuppetLabs

    HA Design

    OpenStack Board/PTL

  • 2013 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 29

    One of the largest public clouds for business applications for collaboration, hosting 1.8 billion meeting minutes each month and 6.4 million registered users/companies.

    As we examined the various initiatives wed have underway in our cloud, which would include the intermingling of physical and virtual loads as well as complex network configurations, we knew that the flexibility inherent in OpenStack would prove powerful enough to support our objectives. With OpenStack we have the ability to customize the platform and maintain significant control over our destiny.

    REINHARDT QUELLE, OPERATIONS ARCHITECT, CISCO WEBEX

    http://www.openstack.org/user-stories/cisco-webex/a-collaborative-cloud/

  • Thank you.

  • 2013 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 31

    Pool of MAC IDs FI-A

    Create vNIC

    Template FI-B

    Create vNIC

    Template FI-A

    Create vHBA

    Template FI-A

    Create vHBA

    Template FI-B

    Pool of MAC IDs FI-B

    Pool of WWPN IDs FI-A

    Pool of WWPN IDs FI-B

    VLANs

    VSANs Network Control Policy

    Pin Group Policy

    QoS Policy

    Pools Templates Policies

    1

  • 2013 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 32

    Pool of MAC IDs FI-A

    Create vNIC

    Template FI-B

    Create vNIC

    Template FI-A

    Create vHBA

    Template FI-A

    Create vHBA

    Template FI-B

    Create Service Profile

    Template tenant A

    Server Pool

    UUID Pool

    Power Control Policy

    WWNN Pool

    Pool of MAC IDs FI-B

    Pool of WWPN IDs FI-A

    Pool of WWPN IDs FI-B

    VLANs

    VSANs Network Control Policy

    Pin Group Policy

    QoS Policy

    Pools Templates Policies

    1

    2

    Boot Policy

    Firmware Policy

    BIOS Policy

    Adapter Policy

  • 2013 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 33

    Pool of MAC IDs FI-A

    Create vNIC

    Template FI-B

    Create vNIC

    Template FI-A

    Create vHBA

    Template FI-A

    Create vHBA

    Template FI-B

    Create Service Profile

    Template tenant A

    Server Pool

    UUID Pool

    Power Control Policy

    WWNN Pool

    Pool of MAC IDs FI-B

    Pool of WWPN IDs FI-A

    Pool of WWPN IDs FI-B

    VLANs

    VSANs Network Control Policy

    Pin Group Policy

    QoS Policy

    Pools Templates Policies

    1

    2

    Boot Policy

    Firmware Policy

    BIOS Policy

    Adapter Policy

    n * Service Profiles

  • 2013 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 34

    UCS XML API layer

    UCS Manager Software