Cloud Service Metering, Accounting and Billing - IAAS · Cloud Service Metering, Accounting and...

20
© 2009 IBM Corporation Cloud Service Metering, Accounting and Billing Jürgen Schneider – IBM Distinguished Engineer [email protected] Universität Stuttgart, 10.03.2010

Transcript of Cloud Service Metering, Accounting and Billing - IAAS · Cloud Service Metering, Accounting and...

Page 1: Cloud Service Metering, Accounting and Billing - IAAS · Cloud Service Metering, Accounting and Billing ... Cloud Types and Service Metering, Accounting and Billing Consideration

© 2009 IBM Corporation

Cloud Service Metering, Accounting and Billing

Jürgen Schneider – IBM Distinguished [email protected]

Universität Stuttgart, 10.03.2010

Page 2: Cloud Service Metering, Accounting and Billing - IAAS · Cloud Service Metering, Accounting and Billing ... Cloud Types and Service Metering, Accounting and Billing Consideration

© 2009 IBM Corporation2

Cloud Computing, Service Metering, Report & Analytics

Agenda

1. Introduction§ Definition and Problem Space

2. Metering, Accounting and Billing Use Cases§ Finance Management in the Cloud Lifecycle§ Roles and Major Building Blocks

3. Architecture and Implementations4. TSAM and TUAM Example

5. Summary

1. Introduction§ Definition and Problem Space

2. Metering, Accounting and Billing Use Cases§ Finance Management in the Cloud Lifecycle§ Roles and Major Building Blocks

3. Architecture and Implementations4. TSAM and TUAM Example

5. Summary

Page 3: Cloud Service Metering, Accounting and Billing - IAAS · Cloud Service Metering, Accounting and Billing ... Cloud Types and Service Metering, Accounting and Billing Consideration

© 2009 IBM Corporation3

Cloud Computing, Service Metering, Report & Analytics

....service oriented and service managed

Attributes

Cloud Computing …

VISIBILITY CONTROL AUTOMATION

“Cloud” is an emerging consumption and delivery model for many IT-based services, in which the user sees only the service, and has no need to know anything about the technology or implementation

Metering & Billing

Rapid provisioning

Flexible pricing Elastic

scaling

Advanced virtualization

Standardized, consumable

web-delivered services Service

Catalog Ordering

Page 4: Cloud Service Metering, Accounting and Billing - IAAS · Cloud Service Metering, Accounting and Billing ... Cloud Types and Service Metering, Accounting and Billing Consideration

© 2009 IBM Corporation4

Cloud Computing, Service Metering, Report & Analytics

Enterprise

IBM Cloud Delivery Models (IBM as Service Provider)

EnterpriseData Center

Private Cloud

EnterpriseData Center

IBM Operated

Managed Private Cloud

Hosting CenterHosting Center

Hosted Private Cloud

Enterprise A

Shared Private Cloud

Cloud

Enterprise owned and operated

Enterprise owned and operated

Enterprise owned IBM operated

Enterprise owned IBM operated

Customer/IBM owned and IBM operated

(single tenant)

Customer/IBM owned and IBM operated

(single tenant)

IBM owned and operated

(multi-tenant)

IBM owned and operated

(multi-tenant)

Enterprise B

Enterprise C

1 2 3 4

Public Cloud

Cloud

IBM owned and operated

(multi-tenant)

IBM owned and operated

(multi-tenant)5

User A

User B

User C

User D

User …

Private Cloud Shared Private Cloud Public Cloud

Cloud Services delivered publicly toend users / secure, enterprise-class

Cloud Servicesdelivered privately toEnterprises / virtualseparation of tenants

Customer owns and pays for infrastructureand has unlimited exclusive access

IBM owns infrastructure and customer has shared access and pays by usage

Private ManagedPrivate Hosted

IBM Smart Business Services - Standardized Services on the IBM CloudIBM Smart Business Services – Private Cloud Services, behind your firewall

Page 5: Cloud Service Metering, Accounting and Billing - IAAS · Cloud Service Metering, Accounting and Billing ... Cloud Types and Service Metering, Accounting and Billing Consideration

© 2009 IBM Corporation5

Cloud Computing, Service Metering, Report & Analytics

Cloud Types and Service Metering, Accounting and Billing Consideration

Service Usage and Consumption, Contracting and Billing (the talk today)

Public Cloud

Service Usage and Consumption, Contracting and Billing (the talk today)

Shared Private Cloud

Service Provider Contract, dedicated HW (single tenant)… Internal chargeback (cost recovery)

Hosted Private Cloud

Service Provider Contract, dedicated HW (single tenant)… Internal chargeback (cost recovery)

Managed Private Cloud

Understand the costs, usage based chargeback to departments, Internal IT cost center (cost recovery)

Private Cloud

Page 6: Cloud Service Metering, Accounting and Billing - IAAS · Cloud Service Metering, Accounting and Billing ... Cloud Types and Service Metering, Accounting and Billing Consideration

© 2009 IBM Corporation6

Cloud Computing, Service Metering, Report & Analytics

Finance Management for Cloud Services

Defin

ition

Offe

ring

Subscription &

InstantiationProduction

Termination

Finance Planner

Requestor (e.g. Line of Business)

Cloud Provider Administrator

Cloud Service Definition

• define SLA, KPIs and Finance/Cost/Price and account models (Finance planning)

Cloud Offering Creation & Registration

• Offer Service based on QoS, and Price

Service Offering Manager

Cloud Service Request and Request Approval•See Price for advertised services•Select cloud service and start metering

CloudServiceCloud

Service

Cloud Service Instance Operation§ meter IT resource consumption • consider capacity changes• Build Reports and Invoice

Service Management Platform

Process Engine ü Middleware Virtualized and Standardized Resources ü Physical Assets

Cloud Service Termination•Remove from catalog•Build final reports

Cloud Service Instance Termination•Stop metering•correlate usage data •Receive Invoice

Requestor (e.g. Line of Business)

Service Offering Manager

Page 7: Cloud Service Metering, Accounting and Billing - IAAS · Cloud Service Metering, Accounting and Billing ... Cloud Types and Service Metering, Accounting and Billing Consideration

© 2008 IBM Corporation7

Cloud Computing Roles – Overview

Cloud Service Consumer Cloud Service Provider Cloud Service Developer

Consumer Business Manager

§ Business / financial (e.g. approval) responsibility for consumed services

§ Accounted for used services instances

§ Uses service instances provided by service provider

§ Requests service instances and changes of service instances (typically on behalf of Consumer Business Manager )

§ Provides access to services for service users

Consumer End User

Consumer Administrator

ServiceOperations Manager

ServiceBusiness Manager

§ Manages technical infrastructure required for providing cloud services

§ Offers all types of services (SPI) developed by service developer

§ Accounts services consumers for services potentially offered by service provider themselves and services offered on behalf of service developer

§ Designs, implements, and maintains service templates (technical aspect)

Service Providers offer services based on a management infrastructure. They may also develop services.

Service Providers can build their services by(optionally) consuming services provided by other service providers.

Service Providers can host services developed by other service developers (on top of their own services)

may includemay act as a

ServiceTransition Manager

§ Responsible for enabling a consumer to use the cloud service, incl. boarding, integration, and process adoption

ServiceSecurity Manager

§ Responsible for ensuring that the Service Provider appropriately manages risks associated with development, delivery, support and use of services

Interlock with Cloud Standards

team:Role + Use Case

Definitions leveraged for DMTF Cloud

Incubator

Note: One person can play several roles.

Page 8: Cloud Service Metering, Accounting and Billing - IAAS · Cloud Service Metering, Accounting and Billing ... Cloud Types and Service Metering, Accounting and Billing Consideration

© 2008 IBM Corporation8

Terminology - Dimensions

Resource

Usage Resource Consumption

Allocated Capacity

Reserved Capacity

Dedicated to one

Service

Shared between Services

Completed Service Requests

Page 9: Cloud Service Metering, Accounting and Billing - IAAS · Cloud Service Metering, Accounting and Billing ... Cloud Types and Service Metering, Accounting and Billing Consideration

© 2009 IBM Corporation9

Cloud Computing, Service Metering, Report & Analytics

Metering Reporting & Analytics: Data Flow –

Instrumented ServiceHosting System

Metered Usage Data Correlation

Metered Usage and Consumption, IT Resource, Labor

Qualified Usage Accounting Records

Provider’s Reporting & Analytics of Usage Accounting Records

Usage Reports Usage Analytics Cost/Price Analytics

Billing Record Generation

Rated Usage Reports

Instrumented ServiceManagement System

Manages

Metered Usage Data Generation

Local context

Qualified Usage Accounting Records Generation

Correlated Usage Records

Billing Records

Service context

Business“context

Tax Rules

Billing Terms

Adjustment

Accounting Structures

Rates /Prices

Contracts & Agreements

Data Correlation & Aggregation Rules (Source)

Metrics Definition

Correlation & AggregationRules (Service)

Usage Data Qualification Rules

Runtime Data Flows

Design Time Data

SLACredits

SLAManagement

Page 10: Cloud Service Metering, Accounting and Billing - IAAS · Cloud Service Metering, Accounting and Billing ... Cloud Types and Service Metering, Accounting and Billing Consideration

© 2009 IBM Corporation10

Cloud Computing, Service Metering, Report & Analytics

Metering Reporting & Analytics: BSS – OSS Mapping

Instrumented ServiceHosting System

Metered Usage Data Correlation

Metered Usage and Consumption, IT Resource, Labor

Qualified Usage Accounting Records

Provider’s Reporting & Analytics of Usage Accounting Records

Usage Reports Usage Analytics Cost/Price Analytics

Billing Record Generation

Rated Usage Reports

Instrumented ServiceManagement System

Manages

Metered Usage Data Generation

Local context

Qualified Usage Accounting Records Generation

Correlated Usage Records

Billing Records

Service context

Business context

Tax Rules

Billing Terms

Adjustment

Accounting Structures

Rates /Prices

Contracts & Agreements

Data Correlation & Aggregation Rules (each source)

Metrics Definition

Correlation & AggregationRules (Service)

Usage Data Qualification Rules

BSS

OSS

Page 11: Cloud Service Metering, Accounting and Billing - IAAS · Cloud Service Metering, Accounting and Billing ... Cloud Types and Service Metering, Accounting and Billing Consideration

© 2008 IBM Corporation11

Infrastructure Layer

Finance Management for Clouds: Taxonomy

VMWareVirtual Center

VMControlx,p,z

Application and Middleware artifacts

Xen, KVM, p, zWAS Cloudburst

Monitoring andActionLayer

Virtualized Infrastructure & HypervisorsServer, Storage, Network

Discover Deploy Monitor Change

Data Layer

ServiceLayer

Cloud Requestor Cloud Service Approver

Meter Resource Usage

Meter Labor Cost

Service Topologies, Service Instances

Service Users and OrgFulfillment Org and Labor

Usage and MeteringFinance (Price/Cost Models

Accounts

Offer Service PriceMeter Service Usage

and Cost

Define Service PriceCollect Service Usage and Cost

Define Service

Offer Service Fulfill Service

Manage Service

Cloud Service Offering Mgr Cloud Service Administrator

Meter Resource Consumption

Service and Finance Planner

TSAM TUAM

Page 12: Cloud Service Metering, Accounting and Billing - IAAS · Cloud Service Metering, Accounting and Billing ... Cloud Types and Service Metering, Accounting and Billing Consideration

© 2009 IBM Corporation12

Cloud Computing, Service Metering, Report & Analytics

TSAM and TUAM Architecture

Service Offeringand

Planning

ServicePublishing

Tools

ServiceFulfillment &Configuration

ToolsUI, Fulfillment, Data, MetaData

ServiceMonitoring

ToolsKPIs

ServicePlanning

Infrastructure & Virtualization VM

Tivoli Process Automation Engine

TPAE

TopologiesMgmt Plans

Assets, CIsIntegration

DCMReservations

Solution Content

(good practices)

Solution Runtime

Cloud Service Requester/ Approver

Cloud Service Provider Admin

Offering Mgmt

Pricing

IT Service (Infrastructure & Application) Provider

BSS

Billing System Models)

Service Mgmt Provisioning

Accounting Reports

eTUAM

Data collection

Service Metering

eTUAM

Account/Price Mgmtl

eTUAM

Billing

eTUAM

Reporting

People, OrgLabor

Price/Acct Models

Usage Data

Base Service

Templates

WAS Service

Templates

WAS Cloudburst

Template

eTUAM Hypervisor CSR

R

E

S

T

W

E

B

´Metering

Page 13: Cloud Service Metering, Accounting and Billing - IAAS · Cloud Service Metering, Accounting and Billing ... Cloud Types and Service Metering, Accounting and Billing Consideration

© 2008 IBM Corporation13

Cloud Management and eTUAM Converged Architecture –Interactions – Definition

ServiceDefinition and

Planning

ServicePublishing

Tools

ServiceFulfillment &Configuration

ToolsUI, Fulfillment, Data, MetaData

ServiceMonitoring

ToolsKPIs

ServicePlanning

Infrastructure & Virtualization VM

Cloud ServiceCreator/Planner

Tivoli Process Automation Engine

TPAE

TopologiesMgmt Plans

Assets, CIsIntegration

DCMReservations

Solution Content

Solution Runtime

Cloud Service Requester

Cloud Admin Offering Mgmt

Pricing

Cloud Service RequestorIT Service (Infrastructure & Application) Provider

BSS

Billing System Models)

Accounting Reports

eTUAM

Data collection

eTUAM

Account/Price Mgmt

eTUAM

Billing/DB Load

eTUAM

Reporting

People, OrgLabor

Price/Acct Models

Usage Data

Base Service

Templates

WAS Service

Templates

WAS Cloudburst

Template

eTUAM Hypervisor CSRs

R

E

S

T

W

E

B

Define

§ Account Structure

§ Metering and Price Models

´Metering

Service Mgmt ProvisioningService MeteringOffering Mgmt Service Mgmt ProvisioningService Metering

Page 14: Cloud Service Metering, Accounting and Billing - IAAS · Cloud Service Metering, Accounting and Billing ... Cloud Types and Service Metering, Accounting and Billing Consideration

© 2008 IBM Corporation14

Cloud Management and eTUAM Converged Architecture –Interactions - Offering

ServiceDefinition and

Planning

ServicePublishing

Tools

ServiceFulfillment &Configuration

ToolsUI, Fulfillment, Data, MetaData

ServiceMonitoring

ToolsKPIs

ServicePlanning

Infrastructure & Virtualization VM

Cloud ServiceCreator/Planner

Tivoli Process Automation Engine

TPAE

TopologiesMgmt Plans

Assets, CIsIntegration

DCMReservations

Solution Content

Solution Runtime

Cloud Service Requester

Cloud Admin

Pricing

Cloud Service RequestorIT Service (Infrastructure & Application) Provider

BSS

Billing System Models)

Accounting Reports

eTUAM

Data collection

eTUAM

Account/Price Mgmtl

eTUAM

Billing DBLoad

eTUAM

Reporting

People, OrgLabor

Price/Acct Models

Usage Data

Base Service

Templates

WAS Service

Templates

WAS Cloudburst

Template

eTUAM Hypervisor CSRs

R

E

S

T

W

E

B

Publish Service§ Service Definition including Price

Offering Mgmt Service Mgmt ProvisioningService Metering

´Metering

Offering Mgmt Service Mgmt ProvisioningService Metering

Page 15: Cloud Service Metering, Accounting and Billing - IAAS · Cloud Service Metering, Accounting and Billing ... Cloud Types and Service Metering, Accounting and Billing Consideration

© 2008 IBM Corporation15

Cloud Management and eTUAM Converged Architecture –Interactions - Subscription

ServiceDefinition and

Planning

ServicePublishing

Tools

ServiceFulfillment &Configuration

ToolsUI, Fulfillment, Data, MetaData

ServiceMonitoring

ToolsKPIs

ServicePlanning

Infrastructure & Virtualization VM

Cloud ServiceCreator/Planner

Tivoli Process Automation Engine

TPAE

TopologiesMgmt Plans

Assets, CIsIntegration

DCMReservations

Solution Content

Solution Runtime

Cloud Service Requester

Cloud Admin

Pricing

Cloud Service RequestorIT Service (Infrastructure & Application) Provider

BSS

Billing System Models)

Accounting Reports

eTUAM

Data collection

eTUAM

Account/Price Mgmtl

eTUAM

Billing DBLoad

eTUAM

Reporting

People, OrgLabor

Price/Acct Models

Usage Data

Base Service

Templates

WAS Service

Templates

WAS Cloudburst

Template

eTUAM Hypervisor CSRs

R

E

S

T

W

E

B

Consider Price§Capacity per hour

§Service per hour

of selected Service

Offering Mgmt Service Mgmt ProvisioningService Metering

´Metering

Offering Mgmt Service Mgmt ProvisioningService Metering

Page 16: Cloud Service Metering, Accounting and Billing - IAAS · Cloud Service Metering, Accounting and Billing ... Cloud Types and Service Metering, Accounting and Billing Consideration

© 2008 IBM Corporation16

Cloud Management and eTUAM Converged Architecture –Interactions – Instantiation

ServiceDefinition and

Planning

ServicePublishing

Tools

ServiceFulfillment &Configuration

ToolsUI, Fulfillment, Data, MetaData

ServiceMonitoring

ToolsKPIs

ServicePlanning

Infrastructure & Virtualization VM

Cloud ServiceCreator/Planner

Tivoli Process Automation Engine

TPAE

TopologiesMgmt Plans

Assets, CIsIntegration

DCMReservations

Solution Content

Solution Runtime

Cloud Service Requester

Cloud Admin

Pricing

Cloud Service RequestorIT Service (Infrastructure & Application) Provider

BSS

Billing System Models)

Accounting Reports

eTUAM

Data collection

eTUAM

Account/Price Mgmt

eTUAM

Billing/DBLoad

eTUAM

Reporting

People, OrgLabor

Price/Acct Models

Usage Data

Base Service

Templates

WAS Service

Templates

WAS Cloudburst

Template

eTUAM Hypervisor CSRs

R

E

S

T

W

E

B

Request Service§ Start Service Usage Metering

§ Enable Resource Consumption metering

Service Mgmt ProvisioningService MeteringOffering Mgmt

´Metering

Offering Mgmt Service Mgmt ProvisioningService Metering

Page 17: Cloud Service Metering, Accounting and Billing - IAAS · Cloud Service Metering, Accounting and Billing ... Cloud Types and Service Metering, Accounting and Billing Consideration

© 2008 IBM Corporation17

Cloud Management and eTUAM Converged Architecture Architecture – Interactions – Operations

ServiceDefinition and

Planning

ServicePublishing

Tools

ServiceFulfillment &Configuration

ToolsUI, Fulfillment, Data, MetaData

ServiceMonitoring

ToolsKPIs

ServicePlanning

Infrastructure & Virtualization VM

Cloud ServiceCreator/Planner

Tivoli Process Automation Engine

TPAE

TopologiesMgmt Plans

Assets, CIsIntegration

DCMReservations

Solution Content

Solution Runtime

Cloud Service Requester

Cloud Admin

Pricing

Cloud Service RequestorIT Service (Infrastructure & Application) Provider

BSS

Billing System Models)

Accounting Reports

eTUAM

Data collection

eTUAM

Account/Price Mgmt

eTUAM

Billing/DBLoad

eTUAM

Reporting

People, OrgLabor

Price/Acct Models

Usage Data

Base Service

Templates

WAS Service

Templates

WAS Cloudburst

Template

eTUAM Hypervisor CSRs

R

E

S

T

W

E

BMaintain Metering System § Observes logs/alerts

§ managing authorizationOffering Mgmt Service Mgmt ProvisioningService Metering

´Metering

Offering Mgmt Service Mgmt ProvisioningService Metering

Page 18: Cloud Service Metering, Accounting and Billing - IAAS · Cloud Service Metering, Accounting and Billing ... Cloud Types and Service Metering, Accounting and Billing Consideration

© 2008 IBM Corporation18

Cloud Management and eTUAM Converged Architecture Architecture – Interactions – Service ended

ServiceDefinition and

Planning

ServicePublishing

Tools

ServiceFulfillment &Configuration

ToolsUI, Fulfillment, Data, MetaData

ServiceMonitoring

ToolsKPIs

ServicePlanning

Infrastructure & Virtualization VM

Cloud ServiceCreator/Planner

Tivoli Process Automation Engine

TPAE

TopologiesMgmt Plans

Assets, CIsIntegration

DCMReservations

Solution Content

Solution Runtime

Cloud Service Requester

Cloud Admin

Pricing

Cloud Service RequestorIT Service (Infrastructure & Application) Provider

BSS

Billing System Models)

TSAM Mgmt Plans

Accounting Reports

eTUAM

Data collection

eTUAM

Account/Price Mgmt

eTUAM

Billing/DBload

eTUAM

Reporting

People, OrgLabor

Price/Acct Models

Usage Data

Base Service

Templates

WAS Service

Templates

WAS Cloudburst

Template

eTUAM Hypervisor CSRs

R

E

S

T

W

E

B

Receive Reports

TSAM Service MeteringOffering Mgmt

´Metering

Offering Mgmt Service Mgmt ProvisioningService Metering

Page 19: Cloud Service Metering, Accounting and Billing - IAAS · Cloud Service Metering, Accounting and Billing ... Cloud Types and Service Metering, Accounting and Billing Consideration

© 2008 IBM Corporation19

Cloud Management and eTUAM Converged Architecture Architecture – Interactions – BSS Interactions (draft)

ServiceDefinition and

Planning

ServicePublishing

Tools

ServiceFulfillment &Configuration

ToolsUI, Fulfillment, Data, MetaData

ServiceMonitoring

ToolsKPIs

ServicePlanning

Infrastructure & Virtualization VM

Cloud ServiceCreator/Planner

Tivoli Process Automation Engine

TPAE

TopologiesMgmt Plans

Assets, CIsIntegration

DCMReservations

Solution Content

Solution Runtime

Cloud Service Requester

Cloud Admin

Pricing

Cloud Service RequestorIT Service (Infrastructure & Application) Provider

BSS

Billing System Models)

TSAM Mgmt Plans TPM Automation

Accounting Reports

eTUAM

Data collection

eTUAM

Account/Price Mgmt

eTUAM

Billing DBLoad

eTUAM

Reporting

People, OrgLabor

Price/Acct Models

Usage Data

Base Service

Templates

WAS Service

Templates

WAS Cloudburst

Template

eTUAM Hypervisor CSRs

R

E

S

T

W

E

B

Apply/Receive Price Models

Receive Reports

Receive Usage Data

TSAM Service MeteringOffering Mgmt

´Metering

Offering Mgmt Service Mgmt ProvisioningService Metering

Page 20: Cloud Service Metering, Accounting and Billing - IAAS · Cloud Service Metering, Accounting and Billing ... Cloud Types and Service Metering, Accounting and Billing Consideration

© 2009 IBM Corporation20

Cloud Computing, Service Metering, Report & Analytics

For more information, please visit:ibm.com/cloud

Or contact me at:[email protected]