Designing a Private Cloud Infrastructure for Microsoft SQL Server: Financial Services Case StudyRoss Mistry Principal Enterprise ArchitectMicrosoft Corporation: MTC – Silicon Valley

Manjnath AjjampurLead Datacenter Strategist, Northern CaliforniaMicrosoft Corporation

DBI318

RossMistry @RossMistry

http://RossMistry.com

Principal Enterprise Architect, Author and former SQL Server MVP

Microsoft Technology Centers – Silicon Valley

Manjnath Ajjampur @InADatacenter

Lead Datacenter Strategist, Northern CaliforniaMicrosoft Corporation

Agenda

IntroductionPrivate Cloud OverviewPlanningDesignOptimization

Part 1

Private Cloud Overview

Pooled Resources Self-Service

Usage-basedElastic

Microsoft Private Cloud Defined“A private cloud is a new model for IT delivery. It turns a datacenter’s infrastructure resources into a single compute “cloud” and enables the key benefits of cloud computing:

Agility Economics Innovation

Cloud Drivers

Part 2

Private Cloud Customer Planning

Existing Environment

Hundreds of Instances of SQL Server running on physical servers

OS memory range: 4GB-48GBApproximately 2000 DatabasesMajority of the servers were running Windows Server 2008 or Windows Server 2008 R2Leveraging some System Center within other groups2U rack mounted servers – underutilizedSAN based storageSeparation of duties - DBA and Server Platform Engineering

10%

30%

15%

45% SQL Server 2000SQL Server 2005SQL Server 2008SQL Server 2008 R2

Customer Goals and Requirements

Business drivenVirtualize Tier 2 and 3 data platform environments. Increase manageability by standardizing on single data platform and OS.Reduce TCO and increase hardware utilization.Implement self service capabilities .Dynamically support projected growth of 30% per year.Allow DBA and Server teams to be proactive and focus on strategy.Adhere to green initiatives.

Technology drivenPool key resources (compute, storage and networking) into logical units.Dynamically provision and scale database applications.Provide high availability and disaster recovery for mission critical databases.

Planning – Resource Pooling

Used the MAP Toolkit to identify SQL Server sprawl.Leveraged the data from MAP for Private Cloud capacity planningUsed the Upgrade Advisor to analyze SQL Server instances and identify upgrade blockersCaptured the following performance metrics

ProcessorMemory Disk Space and I/OTempDB usage

MAP Toolkit

Upgrade advisor

Key Findings from MAP & Metrics Collected

Systems were running with <10% CPU utilization on 4 to 8 core machinesMemory Usage per instance was approximately 2 to 64 GB Total storage required was approximately 5 TBIOPs ranged from 30 -10,000

Reviewing a Sample MAP Report

Part 3

Private Cloud Customer Design Decisions

Design Decisions - Overall

Virtualize Tier 2 and 3 databases - 100 Instances on Hyper-VStandardize on SQL Server 2008 R2 on Windows Server 2008 R2 SP1Private Could based on Windows Server 2008 R2 (Server Core) and Systems Center 2012Database Migration for existing workloads6 Nodes in Hyper-V ClusterHA at a VM level, not instance level1 SQL Server instance per VMManagement infrastructure not part of this clusterSegregation between Hyper-V platform owners and DBAs

Design Decisions - Processor

Total cores required –300 – this will be based on how many instances we go afterCurrent utilization – <10% of the CPU on an 8 core machine.Rationalization

2 socket servers with 8 cores per socketConservative 8:1 overcommit ratio of vCPU:CPU provided by Hyper-V100 instances with 1 core dedicated to each will require 100 cores

Best PracticesSelecting the maximum number of cores per processor available and choosing the fastest clock speed available.

Design Decisions - Memory

Assuming a 4GB per VM average, and a no oversubscription, that is ~130GB per node. Each node has 384 GB RAMDynamic Memory Utilized for all workloadsBest Practices

recommended to purchase the maximum amount of RAMRespect NUMA architecture

Design Decisions - Storage

Use Pass-through disks for maximum performanceUse Storage Classification to adhere to business SLAOS will boot from SAN8GB Fibre ChannelBest Practices

Each storage OEM has their own design recommendations for Hyper-V optimizationRespect SQL server LUN best practice

Design Decisions - Network

Follow Hyper-V best practice1 network for Management traffic1 network for Live Migration1 network for Cluster interconnect1-5 networks for SQL Server VM traffic

SQL Server VM traffic is over highly available and redundant NICs (802.3 ad)Hardware based QOS

Part 4

Optimizing SQL Server in a Private Cloud

High Availability and Disaster Recovery

1 SQL Server instance per VMHA at the VM level using Live MigrationDR via SAN replication

Alternatives

SQL Server High Availability

SQL Server HA Alternatives in Private CloudLive Migration

No Loss of ServiceAvailability with Lower ComplexityEasier Management with VMMManage Loads on VMs Across

Physical Machines 1 2

VM

Shared Storage

iSCSI, SAS, Fiber

Host cluste

r

LiveMigratio

n

SQL Server HA Alternatives in Private CloudGuest ClusteringCreate failover cluster in

Hyper-V environment

Cluster service runs inside Hyper-V guest

Application Mobility: Enable patching of guest OS without downtime

Support mixed clustering (host and guest)

Shared StorageiSCSI

Guest Cluster

Guest Cluster

1 2

Redundant Paths to storage

SQL Server HA Alternatives in Private CloudAvailability GroupsGuest Clustering

not RequiredAchieve HA and DRNo 3rd Party Solutions

Required 1 2

VMs

2

A A

AA

Self-Service

3 x SQL Server Service Templates for ProvisioningSmall – 1 vCPU, 4GB RAM, 100 GB, >1000 IOPS Medium – 2 VPs, 8 GB RAM, 200 GB, >1000 IOPS Large – 4 VPs, 16 GB RAM, 400 GB, >5000 IOPS

SQL Server Service Templates

Track Resources

@sqlserver@ms_teched

mvaMicrosoft Virtual Academy

SQL Server 2012 Eval Copy

Get Certified!

Hands-On Labs

Resources

Connect. Share. Discuss.

http://northamerica.msteched.com

Learning

Microsoft Certification & Training Resources

www.microsoft.com/learning

TechNet

Resources for IT Professionals

http://microsoft.com/technet

Resources for Developers

http://microsoft.com/msdn

Complete an evaluation on CommNet and enter to win!

MS Tag

Scan the Tagto evaluate thissession now onmyTechEd Mobile

© 2012 Microsoft Corporation. All rights reserved. Microsoft, Windows, Windows Vista and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries.The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to

be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS

PRESENTATION.