1

Building Multi-Tenant Virtual Data Centers

with Quantum

Lew Tucker

VP/CTO Cloud Computing

Cisco Systems, Inc.

Twitter: @lewtucker

OpenStack Design Summit and Conference – San Francisco 2012

2

Individuals Business

World of Many Clouds

Healthcare

Media

Government

Others

PUBLIC PRIVATE

HYBRID

3

Cloud ComputingOn-demand resources through automation, multi-tenancy, and APIs

Simple, Easy, Powerful

Cloud ProviderMy

Startup

VM

VM

VM

VM

VM

VM

VM

VMVM

This is Great!

Public IP AddressPrivate IP Address

Internet

4

But maybe something is missing….

Cloud ProviderMy

Startup

VM

VM

VM

VM

VM

VM

VM

VMVM

Uh, which is MY cloud?

Internet

5

Virtual networking can isolate and group resources and more…

Pepsi

Acme

Cloud ProviderShazam!

My Startup

Internet

Coke

6

Amazon’s Virtual Private Cloud (VPD) for Extending the Data Center

7

Carrier

Evolve to a Cloud Across Multiple Providers

My Startup

ProviderA

ProviderB

Shazam!(west)

Shazam!(east)

8

Carrier

Including your own private cloud

My Data Center

ProviderA

ProviderB

Shazam!(west)

Shazam!(east)

Shazam!

9

Data Center in the Cloud – Really?

10

Real Data Centers• Physical Plant• Power• Cooling• Isolation• Lot’s of Servers• Lot’s of Storage• Lot’s of Cables, Networks• Lot’s of complexity

11

Internet

Partners

CRS-176006500

Nexus 7000Nexus 7000(w/ Cat 6500as Services

Chassis)

Nexus 5000w/ Nexus 2000Fabric Extender

UCS, MCS 7800 (or Generic

Rack or Blade Servers)

Nexus 1000v MDS 9000 +Consolidated

Storage Arrays (EMC, etc.)

ApplicationSoftware

VirtualMachine VSwitch Access Aggregation Core Peering IP NGN

Backbone

VMWareXen

Hyper-VKVM

CRS-1ASR 9000ASR 1000

7600

Storage and SAN Compute

Applications

IP NGN

Application Control (SLB+)

Service Control

Global Site Selection

Intrusion Detection

Firewall Services

Virtual Device Contexts

Fibre Channel Forwarding

Fabric Extension

Fabric-Hosted Storage

Virtualization

Storage Media Encryption

Virtual Contexts for FW and SLB

Port Profiles and VN-Link

Port Profiles and VN-Link

Line-Rate NetFlow

Virtual Device Contexts

Secure Domain Routing

Service Profiles

Virtual Machine

Optimization

Technologies Used in the Data Center

10G Ethernet10G FCoE4G FC1G EthernetVM to vSwitchvSwitch to HWApp to HW / VM

App

OS

App

OS

App

OS

App

OS

App

OS

App

OS

App

OS

App

OS

App

OS

App

OS

App

OS

App

OS

App

OS

App

OS

App

OS

App

OS

App

OS

App

OS

App

OS

App

OS

App

OS

App

OS

App

OS

App

OS

App

OS

App

OS

App

OS

App

OS

App

OS

App

OS

12

The Question is……• What do we really want in a Virtual Data Center

• Can we achieve the benefits without the complexity?

• What are the important abstractions?

• What is exposed to application developers, what is hidden?• Specialized processor capabilities, e.g. GPUs?

• Networks, subnets, routing?

• VM Placement, Geographic location, region?

• Access to physical network services (load balancers, firewalls, etc.)?

• How can we plan for future innovation in infrastructure?

13

Applications may start simple

14

Quickly become more involved

15

Objective: create what the application developer wants

App

OS

VM

DataBase

OS

VM

App

OS

VM

Web Svr

OS

VM

Web Svr

OS

VM

Web Svr

OS

VM

App Svr

OS

VM

App Svr

OS

VM

MemCach

OS

VM

MemCach

OS

VM

DataBase

OS

VM

DataBase

OS

VM

Application “A”Application “B”

DataBase

OS

VM

App

OS

VM

Application “C”

Internet Access, Management Network and Multi-tenant ServicesInternet

Gateway

VPNServiceService Provider Network

10.0.1.0/24

10.0.0.0/24

10.0.1.0/24

16

Internet

Partners

App

App

Subscriber “A”Application 1

Subscriber “B”Application 1

Subscriber “A”Application 2

Subscriber “B”Application 2

App 1

App 1

App 2

App 2

7600Nexus 7000(w/ Cat 6500as Services

Chassis)

Nexus 5000w/ Nexus 2000Fabric Extender

Generic Rack or

Blade Servers

Nexus 1000V 3rd Party SAN +Consolidated

Storage Arrays

ApplicationSoftware

VirtualMachine

Virtual Access Access Aggregation

and Core Peering IP NGNBackbone

CRS-1ASR 9000ASR 1000

7600

Storage and SAN Compute

Cisco and Third-PartyApplications

ServicesCore

ACE

SSL

FW

IP NGN

A lot may actually need to be done when you are ready to deploy

10G Ethernet10G FCoE4G FC1G EthernetVM to vSwitchvSwitch to HWApp to HW / VM

App

OS

App

OS

App

OS

App

OS

App

OS

App

OS

App

OS

App

OS

App

OS

App

OS

App

OS

App

OS

App

OS

App

OS

App

OS

App

OS

App

OS

App

OS

App

OS

App

OS

App

OS

App

OS

App

OS

App

OS

App

OS

App

OS

App

OS

App

OS

App

OS

App

OS

VMWareXen

Hyper-VKVM

17

OpenStack Design Summit April 2011

• Compute service (EC2): virtual machines• Specify vCPU, Memory, Disk

• Launch instance (image, mem_size, disk)

• Suspend, clone, migrate

• Storage service (S3, EBS): virtual disks• Specify storage amount, access rights

• Store object

• Create/attach block

• What to do about networks?

App Svr

OS

VM

??

18

2011 Design Summit - community-driven merger of proposals

NetworkServicePOCNTT/Midokura

NetworkContainersCisco

NetworkServiceCitrix/Rackspace/Nicira

NaaS Core DesignIntel

… more

Quantum

19

Quantum Network ServiceResource abstractions and service interfaces

• Compute service (EC2): virtual machines• Launch instance (image, mem_size, disk)

• Suspend, clone, migrate

• Storage service (S3, EBS): virtual disks• Store object

• Create/attach block

• Network service (Quantum): virtual networks• Create/delete private network

• Attach VM to network resource

• Maintain compatibility with Nova networking model

• Work with different networking environments

• Address in next release (Folsom)• Routing

• IP address management

• Service attachment

App Svr

OS

VM

App Svr

OS

VM

App Svr

OS

VM

20

Quantum architecture designed to easily support different networking infrastructure

Quantum Service API

• API for creating and managing virtual networks and services

• Called by “tenants” and other OpenStack services

Quantum Plug-in Framework

API Extensions

Vendor/User Plug-In• Maps abstraction to implementation on physical network• Makes all decisions about *how* a network is implemented

21

Many users of Quantum in OpenStack

Compute Service(Nova)

Network Service

(Quantum)

Data CenterNetwork

ComputeNode(s)

(vSwitch)

NetworkServices

User API

Sys API Sys API SystemAdmin

Plug-In

Data Center Mgmt

User Application

User API

22

Network Service becomes a first class citizen in cloud computing

Cloud Platform - Developer API

Compute(Nova)

Servers

Storage(Swift)

Disks

Network(Quantum)

Networks

Identity(Keystone)

Portal(Horizon)

Images(Glance)

Applications OtherServices

Folsom Release

23

Driving innovation in cloud computing

Innovation in the design of cloud-based applications

Compute, Storage and Networking Infrastructure

Cloud Platform – API Interface – Resource Abstractions

Auto-scaling appsPaaS XaaSIaaS

“Innovation above and below the line”

24

Virtualization, and Massive Scale driving changes throughout the infrastructure

Massive Scale Applications

Unified computing, virtual switches, overlay networks, and software

defined networking

Cloud Platform – API Interface – Resource Abstractions

KVM, Xen, ESXi, N1Kv, Open vSwitch, LISP, VXLAN, STT, OpenFlow

25

Software API’s for enabling a conversation between the application and infrastructure

Application, “I would like certain resources (of type …)certain virtual topologies, specific services”

Lower levels provision physical or virtual resources, setup configuration, and provide information back

OpenStack Quantum Service

• Span multiple data centers?• Network security, policies?• Notion of a network container?

• Best placement of VMs?• Quality of service?• SLA guarantees?

Network Service is very new – still lots to be done – and keep it simple

26

OpenStack + Quantum: beginnings of a virtual data center• Advantages of cloud computing

• On-demand virtualized resources, self-service, lower cost

• Resources managed by others

• Ability to create your own isolated private networks

• Extensible

• Challenge!!• Easy-to-use

• Minus the complexity of the traditional data center

• Work work with different networking infrastructure

QuantumNetwork Service

27

Quantum: status and the road ahead

• Incubation during this past period (Essex)

• Voted to go into core with Folsom release

• Publicly available implementations (plugins): • Open vSwitch, Linux Bridge, Cisco UCS/Nexus, Nicira NVP, Ryu OpenFlow

• Still quite basic – but evolving quickly• L3 IP address management, subnets, routing, services

• Extensions mechanism for exposing new capabilities

• Stay for the following talks on Quantum• OpenStack Quantum for Cloud Operators• Panel on OpenStack Networking

• http://wiki.openstack.org/Quantum

Thank You