Azure and Data

meinrad.weiss@microsoft.com

4

Highly durable and scalable

Multiple copies of your data

Financially backed SLAs

Storage for objects, tables, drives

Supports REST APIs

Store your data in one or two regions

Data in Azure

West DCEast DC > 400 miles

Windows Azure StorageDefend against regional disasters.

Geo replication

Store your data in one or two regions (2)

8

Azure Data Lake

Action

People

Automated Systems

Apps

Web

Mobile

Bots

Intelligence

Dashboards &

Visualizations

Cortana

Bot

Framework

Cognitive

Services

Power BI

Information

Management

Event Hubs

Data Catalog

Data Factory

Machine Learning

and Analytics

HDInsight

(Hadoop and

Spark)

Stream Analytics

Intelligence

Data Lake

Analytics

Machine

Learning

Big Data Stores

SQL Data

Warehouse

Data Lake Store

Data Sources

Apps

Sensors and devices

Data

Azure Data Lake

Serverless processing

Identity Management &

Authentication

Access Control & Authorization

Auditing

Data Protection & Encryption

Separation ofCompute and Storage

11

Compute

Control

Remote

Storage

Compute

Control

Remote

Storage

Compute

Control

Remote

Storage

Co

mp

ute

Rem

ote

Sto

rag

e

Data

Log

Co

ntr

ol

Cores Memory

SSD TempDB

Cores Memory

SSD TempDB

Cores Memory

SSD TempDB

Cores Memory

SSD TempDB

Hadoop – Hive vs Azure and SQL Data WarehouseThe basic idea is the same, but Azure SQL Data Warehouse has the following advantages:

• Closer to regular SQL Server• SQL Server Data Tools to develop your solution• More data types• SQL is a subset of T-SQL • Transactions

• Simpler to manage, e.g. dynamic scaling without the need of data redistribution

• Much less latency in command execution

• Data can be stored (default) in column store structures• Minimal storage usage• Best performance

begin transaction

delete from airport;

select * from airport;

rollback

select * from airport;

17

SQL Data platform continuumHybrid cloud

On-premises

Sharedlower cost

Dedicated higher cost

Higher administration Lower administration

Off-premises

Azure SQL Database vs. VMs

Best for…

TCO benefits

SQL Server in a VM Azure SQL Database

Scalability

Resources

Not only a DBand scalability

• SQL Server (relational DB)• Distributed Transactions• Service Broker• .NET assemblies• Windows authentication

• Integration Services• Analysis Services

• Tabular• Multidimensional

• Reporting Services• Master Data Services• Data Quality Services

Feat

ure

s

“Monolithic” Size

Scale up Scale out + across

SQL ServerUp to 150TB compressed

Azure SQL DWMultiple PB

Azure HDInsightMultiple PB

Azure Data Lake (Store)Multiple PB

Analytics Platform SystemUp to 4PB compressed

Azure SQL DatabaseUp to 4TB compressed (per DB)

On

-pre

mis

es

Clo

ud

(Sometimes) Size matters

SQL Server IaaS

Up to 150TB compressed

Azure SQL Database Managed Instance

Up to 4/8TB+ compressed

IaaS: Automate management tasks on Azure Virtual Machines with the SQL Server Agent Extension

Administration feature Description

SQL Automated Backup Automates the scheduling of backups for all databases for the default instance of SQL Server in the VM. For more information, see Automated backup for SQL Server in Azure Virtual Machines (Resource Manager).

SQL Automated Patching Configures a maintenance window during which updates to your VM can take place, so you can avoid updates during peak times for your workload. For more information, see Automated patching for SQL Server in Azure Virtual Machines (Resource Manager).

Azure SQL Database: Offer Positioning

• New apps, ‘one database

per app’ pattern

▪ Lift-and-shift rich SQL apps

to PaaS

▪ ISV / Enterprise developing

cloud-born SaaS

▪ ISV / Enterprise starting

cloud modernization

▪ DB-centric programming

model

▪ Tenant isolation / resource

guaranteed at the DB level

• Rich, instance-centric

programming model

• Resource guaranteed/SLA at

Instance-level

▪ ISV / Enterprise developing

cloud-born SaaS

▪ New apps, ‘one database per

app’ pattern

▪ New multi-tenant SaaS apps

or modernized existing apps

to SaaS

▪ Higher utilization efficiency

with a shared resource model

▪ Resource guaranteed/SLA at

the pool level

Database Transaction Unit – DTU

epresents the relative power (resources) assigned to the database

Blended measure of CPU, memory, and read-write rates

C

Bounding box

Monitoring database workload utilization within bounding box

CPU

Wri

tes R

ead

s

Memory

30%

75%

50%

60%

Utilization

SQL Database service tiers (single DB model)

*The 99.99% availability SLA does not apply to the existing Web and Business editions, which will continue to be supported at 99.9% availability.

Built For

Available SLA

Database Max Size

Business Continuity

Security

Performance Objectives

Database Transaction Units (DTUs)

Available Tiers ($/Month) and GA Price

Point-in-time Restore (“oops” Recovery)

BASIC PREMIUMSTANDARD

P1S0

Light transactional workloads

Medium transactional workloads

Heavy Transactional Workloads

99.99%*

2 GB 250 GB 500 GB

Any point within 7 days

Any point within 35 days

Active geo-replication, up to four readable secondary backups

Auditing, row-level security, dynamic data masking

Transactions per hour Transactions per minute Transactions per second

5

$4.99

S1 S2 S3 P2 P4 P6 P11

10 20 50 100

$15 $30 $75 $150

125 250 500 1,000 1,750

$465 $930 $1,860 $3,720 $7,001

P15

4 TB

4,000

$16,003

PREMIUM RS (Preview)

S0 S1 S2 S3

125 250 500

$116 $233 $465

1000

$930

500 GB

IO-intensive Workloads

< 99.99%

Predictable workloadsSingle databases or partitioned data across multiple

databases; scale between service tiers and

performance levels as capacity needs fluctuate.

Scal

e d

atab

ases

u

p a

s n

eed

ed

Scale out/in the pool

…

Single database or

partitioned databases

Customer1

Customer2

Customer3 Customer

#N…

Unpredictable workloadsFor large numbers of databases with unpredictable

performance demands; pool resources to be shared

between these databases.

Elastic Database Pool

Dat

abas

es c

on

sum

e re

sou

rces

as

nee

ded

Managing large numbers of databases

• Threat and Anomaly

detection

• Machine Learning Algorithms

• Self-tuning performance and

Actionable recommendations

• Database Advisor

• A virtual DBA

• Built-in admin and data protection

SQL DatabaseLearns and adapts with your application

IaaS + OMS

What is SQL Database Managed Instance?

Easy lift and shift

• Fully-fledged SQL

instance with nearly

100% compat with

on-prem

Fully managed PaaS

• Built on the same

PaaS service

infrastructure

• All PaaS features

Full isolation and security

• Native VNET

implementation

• Private IP addresses

A flavor of SQL DB designed to enable easy migration to fully managed PaaS,

for almost any application!

SQL Database (PaaS)

Elastic Pool

Managed Instance

Singleton

New business model

• Competitive

• Transparent

• Frictionless

Easy migration: nearly 100% like SQL Server

Note: features will be added in stages until General Availability of Managed Instance

Security

• TDE• SQL Audit

• Row level security• Always Encrypted

Microsoft Azure

DashboardSQL DB Managed Instance

* Instance name

.private.database.windows.net

TestCL

* Subscription

Workload Insight dev/test subsc... ▼

* Location

North Europe ▼

Andreycl ▼

Create new Use existing

* Resource group i

(new) My_Group-VNet* VNet

SQL Auth* Security

General purpose, 24 vCores* Pricing tier i

Collations, port... ... * Instance level variables i

Create Automation options

Pin to dashboard

Pricing

Apply

Business critical

8 / 16 / 32 vCores

32 GB – 1 TB capacity

high speed bandwidth

General purpose

8 / 16 / 32 vCores

32 GB – 35 TB capacity

high speed bandwidth

vCore What happened to DTUs? ⧄

248

16

YES NO

License ❶

Already have SQL Server license?

I confirm I have a SQL Server license with Software Assurance to apply this Data Hybrid Use Benefit

3,000 READ IOPS 30 MB/S LOG THOROUGHPUT

Storage ❶

5 TB

5 TB 10 TB1 TB256 GB 512 GB32 GB 20 TB 35 TB

Days of backup retention ❶

30 days

60301 90

Purchase summary

16 vCores x 116 USD per vCore

1856 USD

1024 GB x 0.2 USD per GB

205 USD

General purpose

If you are a general, this pricing model perfectly suits

your purpose. Otherwise, look at other pricing models or

became a general.

DHUB discount

-620 USD

COST PER MONTH 720.5 USD

TOTAL 1441 USD

Public preview discount of 50% -720.5 USD

Free during public preview

0 USD

This is the Public Preview

Feedback

SQL Cloud OfferingsWhen to position what

▪ New apps, ‘one database

per app’ pattern

▪ Lift-and-shift rich SQL apps to

PaaS without any code

changes

▪ Mass migration of existing

apps to the cloud▪ Leverage existing SQL Licenses

(DHuB)

▪ ISV / Enterprise developing

cloud-born SaaS

▪ ISV / Enterprise starting

cloud modernization

▪ DB-centric programming

model

▪ Tenant isolation / resource

guaranteed at the DB level

• Rich, instance-centric

programming model

• Fully-fledged SQL instance

with nearly 100%

compatibility

• Resource guaranteed/SLA at

Instance-level

• Azure VNet isolation

▪ ISV / Enterprise developing

cloud-born SaaS

▪ New multi-tenant SaaS

apps or modernized

existing apps to SaaS

▪ Higher utilization efficiency

with a shared resource

model

▪ Resource guaranteed/SLA

at the pool level

Intelligent database

Self-tuning and intelligent

▪ Lift-and-shift rich SQL apps , 3rd

party DB (Oracle, MYSQL) to

IaaS, Dev & Test scenarios

▪ Migration of single/fewer apps

to the cloud

▪ Bring your own license and

license embedded SQL images

▪ ISV / Enterprise starting cloud

modernization

• 100% SQL Server compatibility • Full control on the OS and - or

SQL Server level• VNet isolation• SLA at VM level

Reduced OPEX and CAPEX

Dynamic scale

Advanced security

Full Control, Compatability

Security and HA

License Mobility

https://aka.ms/liftandshiftsql

Information Protection

• Discover, classify and protect your sensitive data

• Protect the data, not just the database

• Gain visibility to sensitive data located in servers, databases and table columns

• Promote compliance and adherence to GDPR

• Enable persistent labeling with metadata that flows with data outside the database boundaries

• Classify sensitive data through multiple approaches: manual, recommended, automatic classification, E2E with MIP

• Audit access to sensitive data

• https://docs.microsoft.com/en-us/azure/sql-database/sql-database-security-overview

35

Powering global solutions

Globally-distributed mission-critical apps

IoT

Accommodate bursts

of traffic and deliver

low-latency multiplayer

experiences

Retail ande-commerce

Gaming

Guarantee uptime to

users worldwide with

high-availability and

low-latency

Scale instantly for

uncertain IoT workloads

without sacrificing

performance

Support queries over

product catalogs,

traffic spikes, and rapidly

changing inventory

A globally distributed, massively scalable, multi-model database service

Column-familyDocument

Graph

Turnkey global distribution

Elastic scale out

of storage & throughput

Guaranteed low latency at the 99th percentile

Comprehensive SLAs

Five well-defined consistency models

Table API

Key-value

Azure Cosmos DB

MongoDB API

A globally distributed, massively scalable, multi-model database service

Azure Cosmos DB

Latency @ 99th

percentile SLA

Throughput SLA

Consistency SLA

Availability SLA

2

4

3

1

Industry-Leading, Comprehensive SLAs

40