The Big Deal About Big Data: The Microsoft Big Data Strategy and Platform

Alex CyrMicrosoft Canada

MICROSOFT CONFIDENTIAL – INTERNAL ONLY

What is Big Data & What’s the Big Deal?

What is Microsoft’s approach to Big Data?

Customer Scenarios

Summary

Agenda

What is Big Data?

MICROSOFT CONFIDENTIAL – INTERNAL ONLY

MICROSOFT CONFIDENTIAL – INTERNAL ONLY

The Large Hadron Collider produces 1 PB/sec

MICROSOFT CONFIDENTIAL – INTERNAL ONLY

Big Data is … Data that you think is valuable, but processing and storing it may not have been traditionally practical or affordable

Data that you need to ask questions to learn what questions to ask

Data that is produced at “fire hose” rate

MICROSOFT CONFIDENTIAL – INTERNAL ONLY

But my customer doesn’t have a large hadron collider …

But do you have…• Sensors• Clicks• Logs• Transactional records• Call centers• Medical transcriptions• Images• Documents• Signals from social media• Simulations

MICROSOFT CONFIDENTIAL – INTERNAL ONLY

The World of Data is Changing

By 2015, organizations that build a modern information management system will outperform their peers financially by 20 percent.

– Gartner, Mark Beyer, “Information Management in the 21st Century”

10x increase every five years

85% from new

data types

Dataexplosion

VolumeVelocityVariety

Easy Accessibility of External Data

Hadoop

Cloud

Cheap, Distributed Storage &

Processing

Common Big Data Customer ScenariosIndustry/Vertical Scenarios

Financial Services

Modeling True Risk Threat Analysis Fraud Detection Trade Surveillance Credit scoring and analysis

Web & E-Tailing

Recommendation Engines Ad Targeting Search Quality Abuse and click fraud detection

Retail Point of Sales Transaction Analysis Customer Churn Analysis Sentiment Analysis

Telecommunications

Customer Churn Prevention Network Performance optimization Call Detail Record (CDR) Analysis Analyzing Network to Predict Failure

Government Fraud Detection and Cyber Security

General (Cross Vertical) ETL & Processing Engine

MICROSOFT CONFIDENTIAL – INTERNAL ONLY

The Microsoft Big Data Strategy

Microsoft and Big Data

Volume

Variety

Velocity

Relational Data

Connecting to the Worlds Data with

Azure Marketplace

Insights for Everyone with Microsoft BI

Enterprise Ready with Hadoop on Windows &

Azure

Interpreting Big Data will lead tonew markets, products, and services

MICROSOFT CONFIDENTIAL – INTERNAL ONLY

Keep paces with the Formula One demands

Faster split-second decisions Faster adjustment to new car

conditions Lower TCO on operations

12 Terabyte of data used to simulate 90 race and test runs

Loading data extremely fast into the PDW

Comparing race track situations over the years in seconds

Needed very fast adoption to new race track situations

Required fastest data load capabilities

Over 100 sensors produce 4 MB per sensor/second data

McLaren Electronic analyses 400 billion records in less than 13 seconds with SQL Server Parallel Data Warehouse

“The SQL Server Parallel Data Warehouse technology allows for new kinds of historical and specific analysis of huge data sets in real time at affordable price.”

Peter van Manen, Managing Director, McLaren Electronic Systems

Big Data: How is it Different?Big Data Often Operates On Raw Sources To Deliver Value More Quickly

Brian Hopkins and Boris Evelson. (September 2011)

MICROSOFT CONFIDENTIAL – INTERNAL ONLY

The Hadoop Ecosystem (simplified)

ETL Tools BI Reporting RDBMS

MICROSOFT CONFIDENTIAL – INTERNAL ONLY

End-to-End Data Warehousing and Big Data PlatformDriving Analytics on any Data

NON RELATIONAL

100111

DATA MANAGEMENT

SHAREAND GOVERN

DISCOVERAND RECOMMEND

TRANSFORMAND CLEAN

ANALYTICS

DATA ENRICHMENT

OPERATIONAL

SELF-SERVICE MOBILE

PREDICTIVE

REAL-TIME

COLLABORATIVE

MA

RK

ETPLA

CE

Exte

rnal

Data

and

Serv

ices

RELATIONAL MULTIDIMENSIONAL STREAMING

MICROSOFT CONFIDENTIAL – INTERNAL ONLY

Big Data: Enterprise-ReadyIntegrated with Leading DW Performance and Scale

KEY FEATURES

BENEFITS

MICROSOFT CONFIDENTIAL – INTERNAL ONLY

Big Data: Connected to the World’s DataCombines Internal and External Data and Services

KEY FEATURES

BENEFITS

MICROSOFT CONFIDENTIAL – INTERNAL ONLY

Big Data: Insights for EveryoneAnalytics to All Users Through Familiar Tools

KEY FEATURES

BENEFITS

INSIGHTS FOR ALL USERS THROUGH FAMILIAR TOOLS

Advanced Analytics from Microsoft and 3rd parties

Self Service Analysis with PowerPivot & Power View

Interactivity & exploration with Hadoop data in Excel

PB TB GB

BI Professionals Business AnalystsData Scientists

MICROSOFT CONFIDENTIAL – INTERNAL ONLY

Big Data: Open and FlexibleDevelop Once, Deploy On-Premises or in the Cloud

KEY FEATURES

BENEFITS

© 2012 Microsoft Corporation. All rights reserved. Microsoft, Windows, and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries.The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.