Designing Azure compute and storage infrastructure

20
William Lee Understanding Azure Compute and Storage

Transcript of Designing Azure compute and storage infrastructure

Page 1: Designing Azure compute and storage infrastructure

William Lee

Understanding Azure Compute and Storage

Page 2: Designing Azure compute and storage infrastructure

About me

- 10+ Years supporting Infrastructure

- Broad industry experience- Time & Process- Loves Puzzles

Page 3: Designing Azure compute and storage infrastructure

Agenda

VM Families

Storage

Management

Page 4: Designing Azure compute and storage infrastructure

Management

Page 5: Designing Azure compute and storage infrastructure

Key conceptsHierarchy

SubscriptionCloud service (200)

Virtual machine (50x200)Virtual network (100)

Storage account (100)Storage container

Storage blob (40x100)

Object Limit LockingSubscription 120 create/add

operations in 5 minute window

N/A

Cloud service 200 per subscription ~3 minutes per updateVirtual machine 50 per cloud service

2,048 per virtual network

None

Virtual network 100 per subscription Single modification APIStorage account 100 per subscription NoneStorage container No limit NoneStorage blob 40 per storage account One blob per container

per storage account at a time

Limits and locking

http://azure.microsoft.com/en-us/documentation/articles/azure-subscription-service-limits/

Page 6: Designing Azure compute and storage infrastructure

Large deployment guidanceLimit use of Get* APIs during deploymentLimits possibility of throttlingBack-off if any 503-ServiceUnavailable or 429-TooManyRequests errors are received

Use virtual network for connectivityCustom image managementIf using a custom OS image then place up to 40 OS disks in a storage account

Page 7: Designing Azure compute and storage infrastructure

Resource groupsContainer for multiple resourcesManage resources as a single unitResources exist in one* resource groupResource groups can span regionsResource groups can span services

Role Based Access and Control (RBAC) on groups or resourcesBilling integrated tagging on groups or resources

RESOURCE GROUPS

Page 8: Designing Azure compute and storage infrastructure

VM Families

Page 9: Designing Azure compute and storage infrastructure

Most memory,fastest CPUs

SSD storage,faster CPUs

HIGHEST VALUE LARGEST SCALE-UP

Highest value GPU Intensive

Azure VM families

N

Page 10: Designing Azure compute and storage infrastructure

Azure VM pricing tiers

A0-A7 - Standard

A0-A4 - Basic

A8-A11 - Standard

D1-4 / D11-14

D1-5_v2 / D11-14_v2

G1-G7

GS1-GS4

COST

CPU / Memory / Disk

DS1-4 / DS11-14

Page 11: Designing Azure compute and storage infrastructure

Azure scale unit (Gotcha’s)- Each cloud service is boundto a single scale unit- Each affinity group with one or more VM is bound to a single scale unit

Impact of resize-VMs can only be resized to a size supported on scale unit where the VM is deployed- Sometimes can cause a migration rather then a move

1 2Scale unit

Scale unit

Author
Good to have a graphic on this.A compute unit is like a rack of servers in the datacenter. If I ask to make a VM that is of a certain family (like an A4) my request will be routed to a compute unit that can handle that scale unit request. If I want to grow that VM to a A6 – I should have resources within the compute unit to handle this. If I want to change it from the A to a D – my compute unit will not handle it and I would need to re-deploy that VM instead of resizing it so that it gets assigned to a new compute unit that can handle that scale unit.
Page 12: Designing Azure compute and storage infrastructure

Storage

Page 13: Designing Azure compute and storage infrastructure

Azure storage typesBlock blobs, page blobs and disks, tables and queues, and files

Locally Redundant Storage (LRS)

Zone Redundant Storage (ZRS)

Geographically Redundant Storage (GRS)

Read-Access Geographically Redundant Storage (RA-GRS)

How it works Makes multiple synchronous copies of your data within a single datacenter

Stores three copies of data across multiple datacenters within or across regions. For block blobs only

Same as LRS, plus multiple asynchronous copies to a second datacenter hundreds of miles away

Same as GRS, plus read access to the secondary datacenter

Total copies 3 3 6 6

Why use it For economical local storage or data governance compliance

An economical, higher durability option for block blob storage

For protection against a major datacenter outage or disaster

Provides read access to data during an outage, for maximum data availability and durability

Availability SLA 99.9% read/write 99.9% read/write 99.9% read/write 99.9% write 99.99% read https://azure.microsoft.com/en-us/pricing/details/storage/

Page 14: Designing Azure compute and storage infrastructure

Premium storageUp to 64 TB of storage per VM80,000 IOPS per VM5,000 IOPS per disk~5 ms read/write (no cache)Less than 1 ms read latency (cache)

Azure virtual machineC:\OS disk

E:\,F:\, etc.data disks

D:\temporary disk

Azure blob

Page 15: Designing Azure compute and storage infrastructure

How many storage accounts?It depends…what is the limiting factor (disk or VM)?

EXAMPLE: 5 VMs on P30 storage disk (5,000 IOPS max). ORA single VM with 5 P30 disks striped = 25,000 IOPSSo, in both cases 2 storage accounts are required to achieve 25,000 IOPS

EXAMPLE:VMs capable of achieving 12,000 IOPS/disk. Assuming they do…(3 x 12,000=36,000)\20,000 = 2 storage accounts

EXAMPLE:Maximum allowable disk capacity for premium storage accounts is 35 TBTo accommodate the 64 1 TB disks allowed for a G5 VM, you would need 2 storage accounts

OR

12,000 IOPS/disk

=

Maximum: 35 TB

=

Page 16: Designing Azure compute and storage infrastructure

Temporary drive guidanceNever place critical unreplicated data on temp drive!Use for SQL TempDB and Buffer Pool http://blogs.technet.com/b/dataplatforminsider/archive/2014/09/25/using-ssds-in-azure-vms-to-store-sql-server-tempdb-and-buffer-pool-extensions.aspx

Use scheduled tasks to configure temporary disk

Azure virtual machineC:\OS disk

E:\,F:\, etc.data disks

D:\temporary disk

Azure blob

Page 17: Designing Azure compute and storage infrastructure

IometerAn I/O subsystem measurement

and characterization tool for single and clustered systemsUsed as a benchmark and troubleshooting tool Easily configured to replicate the behavior of many popular applications One commonly quoted measurement provided by the tool is IOPS

Page 18: Designing Azure compute and storage infrastructure

Demo

Page 19: Designing Azure compute and storage infrastructure
Page 20: Designing Azure compute and storage infrastructure

ResourcesWatch the Channel 9 Show, “Your Premises or Mine”Get the latest On-Premises and In-Cloud technologies.

aka.ms/YourPremises

Try Azure for free.Sign up for a free one-month trial.

aka.ms/TryAzureForMonth

Register for an IT Innovation Series eventTopics include Cloud Infrastructure, Window Server 2016, Windows 10 and more.

aka.ms/ITInnovation