CompatibleOne OSCi workshop March 2012

33
When Interoperability Matters For the engagement of workload over heterogeneous cloud service providers

description

This presentation shows the latest status of CompatibleOne, the Open Source Broker

Transcript of CompatibleOne OSCi workshop March 2012

Page 1: CompatibleOne OSCi workshop March 2012

When Interoperability MattersFor the engagement of workload over heterogeneous cloud service providers

Page 2: CompatibleOne OSCi workshop March 2012

4 3rd CompatibleOne OSCi WORKSHOP

IN A NUTSHELL

Support for interoperability, portability and reversibility

Open Source and Open Standards

OpenStack, OpenNebula, ...

OCCI, Internet technologies, …

Blue Print for DevOps

Models and documents to be shared by developers and operators, customers and vendors

The 1st Open Source Cloud Broker

As defined by Gartner Cloud Service Intermediation Aggregation Cloud Service Arbitrage

Compliant with NIST Reference Architecture

Page 3: CompatibleOne OSCi workshop March 2012

5 3rd CompatibleOne OSCi WORKSHOP

ECOSYSTEM

Page 4: CompatibleOne OSCi workshop March 2012

6 3rd CompatibleOne OSCi WORKSHOP

Is HTTP the only existing

open standard for cloud

computing?

Page 5: CompatibleOne OSCi workshop March 2012

7 3rd CompatibleOne OSCi WORKSHOP

STATE OF THE ART

Interoperability between cloud services: to be constructed

Portability between cloud services: much more difficult SaaS, IaaS, PaaS, BPaaS, etc. have very different APIs

Significant gaps on SLA and Security

“De facto” standards vs. open standards No incentive for cloud service providers to let their customers go away:

why should they participate to open standards?

Consumer's pressure may influence their decision

No mature standards for cloud computing (except HTTP)

DMTF OVF / CIMI, OGF OCCI, SNIA CDMI, ... have not (yet) been adopted by cloud providers

Some standards are OK for IaaS but not for other layers (cf. OASIS TOSCA)

Meanwhile interoperability and portability can be constructed and maintained by Cloud Service Brokers

Gartner: “Cloud Interoperability Can be Brokered” by Daryl C. Plummer

Page 6: CompatibleOne OSCi workshop March 2012

8 3rd CompatibleOne OSCi WORKSHOP

Actually today's cloud computing model is not compliant with the original « utility » model

Electricity system or telephone system “Public and private clouds offer their end consumers a "pay as you go" model - a powerful

shift for computing, towards a utility model like the electricity system, the telephone system, or more recently the Internet. However, unlike those utilities, clouds cannot yet federate and interoperate.”  IEEE 2011 Annual SRII Global Conference

Interoperability in « silos » Specific ecosystems of Cloud Service Providers and Vendors to

address targeted markets, aggregated by specific contracts, patents, IPR, etc.

Limited possibilities to interoperate with other silos (except for B2B)

Extension of the « vendor lock in » concept

RISKS

Page 7: CompatibleOne OSCi workshop March 2012

9 3rd CompatibleOne OSCi WORKSHOP

OPEN CLOUD

OCCI is a trademark of the Open Grid Forum

Page 8: CompatibleOne OSCi workshop March 2012

10 3rd CompatibleOne OSCi WORKSHOP

CompatibleOne provides an open source cloudware* allowing creation, deployment and management of private, public and hybrid cloud platforms

CORDS CompatibleOne Resource Description Schema

ACCORDS Advanced Capabilities for CompatibleOne Resources Distribution Services

EZVM Virtual Machine Interoperability

PaaS4DEV Runtime OSGI

UNIDATA Data Interoperability

KEY COMPONENTS

* cloud computing middleware

Page 9: CompatibleOne OSCi workshop March 2012

11 3rd CompatibleOne OSCi WORKSHOP

ACCORDS

&

CORDS

Page 10: CompatibleOne OSCi workshop March 2012

12 3rd CompatibleOne OSCi WORKSHOP

ACCORDS V2.10

Comons

HTTP/REST/OCCI HTTP/REST/OCCI

1

2 3

4

Arbitrage

Value Added

COOBAS

COEES

UniData PaaS

4Dev

EZVM

CONETS

COES

BROKER

COSS

Publisher

CORDS

Integrators

Providers

ProActiveProcci

PaaSProcci

OpenStackProcci

AmazonProcci

OpenNebulaProcci

AzureProcci

XaaSProcci

PROCCI

MANIFEST

PLAN

CONTRACT

SERVICE

PARSER

SLAM

SLAP

Page 11: CompatibleOne OSCi workshop March 2012

13 3rd CompatibleOne OSCi WORKSHOP

Manifest

Entity

Resource Link

Network

Infrastructure

NODE

NetworkConfiguration

Monitoring

Configuration

NetworkLink

Core

Infrastructure

CORDS

Mixin

SystemImage

Package

Storage StorageLink

Requirement

Constraint

Action

Account PlanUser

Provider

ProviderType

Compute

OCCI

CompatibleOne Ressource Description Schema

Open Cloud Computing Interface

DESCRIPTION MODELLogical View

Page 12: CompatibleOne OSCi workshop March 2012

14 3rd CompatibleOne OSCi WORKSHOP

Plan Service Contract

NODEManifest

Profile

Provider

Tarification

CORDSCompatibleOne Ressource Description Schema

DESCRIPTION MODELVirtual Instance View

Entity

Resource Link

Core

Mixin

OCCIOpen Cloud Computing Interface

0 to N 1 to N

Instruction

Page 13: CompatibleOne OSCi workshop March 2012

15 3rd CompatibleOne OSCi WORKSHOP

ACCORDSOpenStack Nova Provisioning

OpenStack Procci

REST OCCI

HTTP SNMP

Accords Instance ActionCloud Provider Announcement

Accords Procci

User

Accords Broker Cloud Provider

Enquiries

REST OCCI

Accords Publisher

REST OCCI

REST OCCIREST OCCI

REST OCCI

Cloud Provider Provisioning

Service Contracts

1 2 4 0

53

Page 14: CompatibleOne OSCi workshop March 2012

16 3rd CompatibleOne OSCi WORKSHOP

OpenNebula Procci

REST OCCI

HTTP SNMP

Accords Instance ActionCloud Provider Announcement

Accords Procci

User

Accords Broker Cloud Provider

Enquiries

REST OCCI

Accords Publisher

REST OCCI

REST OCCIREST OCCI

REST OCCI

Cloud Provider Provisioning

Service Contracts

1 2 4 0

53

ACCORDSOpenNebula Provisioning

Page 15: CompatibleOne OSCi workshop March 2012

17 3rd CompatibleOne OSCi WORKSHOP

ezVM

PARSER

Provider Platform

BROKER

PROCCI

PROVIDERPROCCI

ezVM

ImageProduction

Service

Image Production Interface

Image Preparation Interface

Image Delivery Interface Ressource Provisioning Interface

Page 16: CompatibleOne OSCi workshop March 2012

18 3rd CompatibleOne OSCi WORKSHOP

CORDS Version 2

MANIFEST NODE

INFRASTRUCTURE

IMAGE

Manifest

Manifest

STORAGE

PACKAGE

SYSTEM

NETWORK

COMPUTE

NODE MANIFEST NODE

Page 17: CompatibleOne OSCi workshop March 2012

19 3rd CompatibleOne OSCi WORKSHOP

ACCORDS PaaS

PUBLISHER

PARSER BROKER PROCCI

MANIFEST 1

MANIFEST 2

MANIFEST 3

PaaSPROCCI

PaaS

Page 18: CompatibleOne OSCi workshop March 2012

20 3rd CompatibleOne OSCi WORKSHOP

POC XWiki

Page 19: CompatibleOne OSCi workshop March 2012

21 3rd CompatibleOne OSCi WORKSHOP

POC XWiki

Provide a proof of concept for automatic provisioning

Leverage CompatibleOne Platform and use of its current features.

Interoperability between different Providers

Image production

System configuration

XWiki as a use case Deployment of a web application

Separated Application Server and Storage

Application Configuration

Page 20: CompatibleOne OSCi workshop March 2012

22 3rd CompatibleOne OSCi WORKSHOP

V1 (what we did)

Declarative definition of service deployments via monolithic manifests

Usage of pre-built images

Workaround for metadata management

Page 21: CompatibleOne OSCi workshop March 2012

23 3rd CompatibleOne OSCi WORKSHOP

V2

Declarative definition of reusable (high-level) services

Automated image production System components installation and configuration

Provider-independent metadata management

Service configuration at deployment

Composable manifests Building complex system deployments by assembling

available service descriptions

Page 22: CompatibleOne OSCi workshop March 2012

24 3rd CompatibleOne OSCi WORKSHOP

V2: XWiki Use Case

Definition of high level services for relational storage

Definition composite manifest for the application

Image production automation

Application configuration and deployment

Support for multiple providers

Goal: automate the previous POC version and remove dependencies on functionalities available on specific providers.

Page 23: CompatibleOne OSCi workshop March 2012

25 3rd CompatibleOne OSCi WORKSHOP

DEMO

Page 24: CompatibleOne OSCi workshop March 2012

26 3rd CompatibleOne OSCi WORKSHOP

Next Steps

Integration of Subsequent Components / Modules Monitoring

Security

Accountancy

Intelligent Provisioning

Integration of PaaS Services

Page 25: CompatibleOne OSCi workshop March 2012

27 3rd CompatibleOne OSCi WORKSHOP

ezVM

Page 26: CompatibleOne OSCi workshop March 2012

28 3rd CompatibleOne OSCi WORKSHOP

ezVM

Goal: Virtual machine interoperability

Provides:

Virtual machine description using OCCI Package

System

Image

Vm

Virtual machine registry Virtual machine storage Virtual machine provider

Page 27: CompatibleOne OSCi workshop March 2012

29 3rd CompatibleOne OSCi WORKSHOP

ezVM

Page 28: CompatibleOne OSCi workshop March 2012

30 3rd CompatibleOne OSCi WORKSHOP

PaaS4Dev

Page 29: CompatibleOne OSCi workshop March 2012

31 3rd CompatibleOne OSCi WORKSHOP

PaaS4dev functional architecture

Page 30: CompatibleOne OSCi workshop March 2012

32 3rd CompatibleOne OSCi WORKSHOP

PaaS4dev technical architecture

Application manager

Applications

Environmentmanager

IaaS manager [EZVM/Manifest

C1]

VMconfigurator

[Chef]

Router manager[jk API]

ContainerManager

[JOnAS API]

Loggermanager

Tenant manager

JPaaS REST API

Procci PaaS4Dev

Tenants

Environments

Usage records

Statistics

Logs

Statistics

Probemanager

[JASMINe API]

Statisticsmanager

Metering manager

Process Engine

Rules EngineScaleDown

Scaling FailOver

ScaleUpProvisioning

Enabler APIs

[XaaS]

Monitoring service

Catalog IaaS manager [Sirocco]

Constraints Engine

Placementsolver

Console

Data AccessLayer

ACCORDS

Page 31: CompatibleOne OSCi workshop March 2012

33 3rd CompatibleOne OSCi WORKSHOP

VM JPaaS Engine

JPaaS Manager

ConsoleRESTAPI

JPaaS Controller

VM Container

JPaaS Agent

VM Router

JPaaS Agent

REST

RESTREST

REST

VM JPaaS Data

Data

JDBCAppmgr

EnvMgr

IaaSMgr

VMConf

RouterMgr

Cont.Mgr

Usermgr

Data.Access

Chef client Chef client

Chefmgr

Chefserver

PaaS4dev deployment

Page 32: CompatibleOne OSCi workshop March 2012

34 3rd CompatibleOne OSCi WORKSHOP

Useful Resources

CompatibleOne web

www.compatibleone.org

For the latest components version

http://gitorious.ow2.org/ow2-compatibleone/accords-platform?page=1

For packages ready to install

https://build.opensuse.org/package/show?package=accords&project=Virtualization%3ACloud%3ACompatibleOne

Developers Mailing list

[email protected]

In Progress

CompatibleOne platform to test your manifests

Openstack and Opennebula to connect to your CompatibleOne platform

Page 33: CompatibleOne OSCi workshop March 2012

35 3rd CompatibleOne OSCi WORKSHOP

Promoting freedom in the cloud

http://compatibleone.org/

➢Contribute➢Share➢Spread the word

Let's Work Together!