Sofia Event Center 21-22 ноември 2013 г. Маги Наумова/ Боряна...

47
Sofia Event Center 21-22 ноември 2013 г. Faster Insights from Any Data Маги Наумова/ Боряна Петрова

Transcript of Sofia Event Center 21-22 ноември 2013 г. Маги Наумова/ Боряна...

Page 1: Sofia Event Center 21-22 ноември 2013 г. Маги Наумова/ Боряна Петрова.

Sofia Event Center

21-22 ноември 2013 г.

Маги Наумова/ Боряна Петрова

Page 2: Sofia Event Center 21-22 ноември 2013 г. Маги Наумова/ Боряна Петрова.

About me

• Certificates• MVP – Excel• MCT• MCTIP• MOS – Master

• Focuses on education and mentoring• Contacts

[email protected]@borianapetrova

Page 3: Sofia Event Center 21-22 ноември 2013 г. Маги Наумова/ Боряна Петрова.

Faster Insights from Any Data

Easy access to data, big & smallSearch, access, and shape internal and external data, and combine with unstructured data

Powerful insights with familiar toolsSpeed up analysis and time to insight with the familiarity of Excel in Office and Office 365 and access via mobile devices

Complete BI platformScale your BI models and enrich and secure your data with a complete platform spanning cloud and on-premises

Page 4: Sofia Event Center 21-22 ноември 2013 г. Маги Наумова/ Боряна Петрова.

Easy Access to Data, Big and SmallSimplify access to public and corporate data

Easily preview, shape, and format your data

Combine and refine data across multiple sources

Gain insight across relational, unstructured, and semi-structured data

Common management of structured and unstructured data

Query across relational DB and Hadoop with single T-SQL Query

Project code name “Data Explorer”

Windows Azure Marketplace

Windows Azure HDInsight Service & Microsoft HDInsight Server (preview)

100% Apache

Parallel Data Warehouse with Polybase

Page 5: Sofia Event Center 21-22 ноември 2013 г. Маги Наумова/ Боряна Петрова.

Microsoft Power BI for Excel and Office 365Self-service BI with the familiarity of Office and the power of the cloud

Collaborate in Office 3651 in 4 enterprise customers on Office 365

Insights in Excel1 Billion Office Users

Analyze Visualize Share Find

Q&A

MobileDiscover

Scalable | Manageable | Trusted

Page 6: Sofia Event Center 21-22 ноември 2013 г. Маги Наумова/ Боряна Петрова.

Get Data

ExploreAnaly

zeInsights

Personalize

Tell a Story

Information Worker

Decision Maker

Authors the visual data environment

Consumes the data visually to create her own insight & tell her story

Target Audiences

Page 7: Sofia Event Center 21-22 ноември 2013 г. Маги Наумова/ Боряна Петрова.

Power Query

Page 8: Sofia Event Center 21-22 ноември 2013 г. Маги Наумова/ Боряна Петрова.

Power Query

Page 9: Sofia Event Center 21-22 ноември 2013 г. Маги Наумова/ Боряна Петрова.

Powerful Self-Service BI with Excel 2013 Search and access internal &

external data

Clean, transform, and shape data

Merge and combine data from multiple sourcesLightning fast analytics with in-memory technology

Model relationships, custom measures, hierarchies, and KPI’s

Bring your data to life with interactive visualization

Explore data in new ways to discover hidden insights

Page 10: Sofia Event Center 21-22 ноември 2013 г. Маги Наумова/ Боряна Петрова.

Power QueryEnable self-service data discovery, query, transformation and mashup experiences for Information Workers, via Excel and PowerPivot

Discovery and connectivity to a wide range of data sources, spanning volume as well as variety of data.

Highly interactive and intuitive experience for rapidly and iteratively building queries over any data source, any size.

Consistency of experience, and parity of query capabilities over all data sources.

Joins across different data sources; ability to create custom views over data that can then be shared with team/department.

Page 11: Sofia Event Center 21-22 ноември 2013 г. Маги Наумова/ Боряна Петрова.

Power Query

• Excel add-in to enhance self-service BI

• Identify and import external data:• Relational dB• Excel• Text• XML• Odata• Web pages• Hadoop HDFS

• Discover relevant data by using search

• Combine and transform multiple data sources

Discover, combine, and refine Big Data, small data, and any data with Data Explorer for Excel.

Page 12: Sofia Event Center 21-22 ноември 2013 г. Маги Наумова/ Боряна Петрова.

S

Data Sources

Windows Azure Marketplace

Windows Active Directory

Azure SQL Database

Azure HDInsight

Page 13: Sofia Event Center 21-22 ноември 2013 г. Маги Наумова/ Боряна Петрова.

PowerPivot

Page 14: Sofia Event Center 21-22 ноември 2013 г. Маги Наумова/ Боряна Петрова.

PowerPivot

Page 15: Sofia Event Center 21-22 ноември 2013 г. Маги Наумова/ Боряна Петрова.

Powerful Self-Service BI with Excel 2013 Search and find internal &

external data

Clean, transform, and shape data

Merge and combine data from multiple sourcesLightning fast analytics with in-memory technology

Model relationships, custom measures, hierarchies, and KPI’s

Bring your data to life with interactive visualization

Explore data in new ways to discover hidden insights

Page 16: Sofia Event Center 21-22 ноември 2013 г. Маги Наумова/ Боряна Петрова.

Power Map

Page 17: Sofia Event Center 21-22 ноември 2013 г. Маги Наумова/ Боряна Петрова.

Power Map

Page 18: Sofia Event Center 21-22 ноември 2013 г. Маги Наумова/ Боряна Петрова.

Powerful Self-Service BI with Excel 2013 Search and find internal &

external data

Clean, transform, and shape data

Merge and combine data from multiple sourcesLightning fast analytics with xVelocity in-memory technology

Model relationships, custom measures, hierarchies, and KPI’s

Bring your data to life with interactive visualization

Explore data in new ways to discover hidden insights

Page 19: Sofia Event Center 21-22 ноември 2013 г. Маги Наумова/ Боряна Петрова.

Power Map for Microsoft Excel enables information workers to discover and share new insights from geographical and temporal data through three-dimensional storytelling.

What Is Power Map?

Page 20: Sofia Event Center 21-22 ноември 2013 г. Маги Наумова/ Боряна Петрова.

Map Data• Data in Excel• Geo-Code• 3D and 3

Visuals

Discover Insights• Play over Time• Annotate points• Capture scenes

Share Stories• Cinematic

Effects• Interactive Tours• Share Workbook

Power Map: Steps to 3D insights

Page 21: Sofia Event Center 21-22 ноември 2013 г. Маги Наумова/ Боряна Петрова.

Map Data

• Geospatial and temporal data in Excel• Calculated Fields and Hidden Columns

• Geo-code and Themed maps with Bing

• Visualize multiple layers at once

• 3D Columns, Bubble/Pies, Heat Maps• Regions for geopolitical boundaries

Page 22: Sofia Event Center 21-22 ноември 2013 г. Маги Наумова/ Боряна Петрова.

Discover Insights

• Play your data over time

• Make direct comparisons in 2D charts• Flat 2D map for comparison of 3D columns

• Annotate insights with metadata• Can add images to annotations.

• Capture “Scenes” like slides in a show

Page 23: Sofia Event Center 21-22 ноември 2013 г. Маги Наумова/ Боряна Петрова.

Share Stories

• Weave scenes with cinematic effects

• Interact and resume during presentation

• Share broadly within the workbook• Export to Video for Viral!

Page 24: Sofia Event Center 21-22 ноември 2013 г. Маги Наумова/ Боряна Петрова.

Power MapExcel Add-in to Enhance Data Visualization

Map data, discover insight, and share stories

Page 25: Sofia Event Center 21-22 ноември 2013 г. Маги Наумова/ Боряна Петрова.

Power BI Site

Page 26: Sofia Event Center 21-22 ноември 2013 г. Маги Наумова/ Боряна Петрова.

Power BI Site

Page 27: Sofia Event Center 21-22 ноември 2013 г. Маги Наумова/ Боряна Петрова.

Collaborate and Stay Connected with Office 365Easily setup powerful BI sites

Share live reports with data refresh from on-prem sources

Manage and share data sets and monitor usageAsk questions in the natural language speech bubble

Get back answers as the system generates data visualizations

View Power View reports on any device with HTML5 support

Discover and explore all your favorite reports with the mobile BI app

Q&A

Page 28: Sofia Event Center 21-22 ноември 2013 г. Маги Наумова/ Боряна Петрова.

Power View

Page 29: Sofia Event Center 21-22 ноември 2013 г. Маги Наумова/ Боряна Петрова.

Power View

Page 30: Sofia Event Center 21-22 ноември 2013 г. Маги Наумова/ Боряна Петрова.

Powerful Self-Service BI with Excel 2013 Search and find internal &

external data

Clean, transform, and shape data

Merge and combine data from multiple sourcesLightning fast analytics with xVelocity in-memory technology

Model relationships, custom measures, hierarchies, and KPI’s

Bring your data to life with interactive visualization

Explore data in new ways to uncover hidden insights

Page 31: Sofia Event Center 21-22 ноември 2013 г. Маги Наумова/ Боряна Петрова.

Introducing Power View

• Power View is an interactive data exploration, visualization, and presentation experience• Highly visual design experience• Rich meta-driven interactivity• Presentation-ready at all times

• It delivers intuitive ad-hoc reporting for business users• Reports can be based on tabular data models, including

PowerPivot data models• It is now also available in Excel 2013, and with new

features:• Maps• Pie charts• Hierarchies• KPIs

• Drill down/Drill up• Report styles,

themes and text resizing

• Backgrounds with images

• Hyperlinks• Printing

Page 32: Sofia Event Center 21-22 ноември 2013 г. Маги Наумова/ Боряна Петрова.

Power View for Multidimensional Models• Power View on Analysis Services via BISM

• Native support for DAX in Analysis Services• Better flexibility: Choice of DAX on Tabular or Multidimensional (cubes)

Page 33: Sofia Event Center 21-22 ноември 2013 г. Маги Наумова/ Боряна Петрова.

BI Semantic Model

Data model

Business logic

Data access

BI Semantic Model: Architecture

ROLAP MOLAP VertiPaq DirectQuery

MDX DAX

Multidimensional

Tabular

Third-partyapplications

Reporting Services

(Power View)Excel PowerPivot

Databases LOB Applications Files OData Feeds Cloud Services

SharePointInsights

Queries MDX/DAX MDX/DAX

Page 34: Sofia Event Center 21-22 ноември 2013 г. Маги Наумова/ Боряна Петрова.

Hands on Lab

Page 35: Sofia Event Center 21-22 ноември 2013 г. Маги Наумова/ Боряна Петрова.

1. Plug the network cable

2. Set a static IP : 10.10.10.10

3. Set subnet mask: 255.0.0.0

4. Lunch remote desktop and connect to server: 10.10.10.1

5. Login as Contoso\LabUser, pass@word1

Connection Instructions

Page 36: Sofia Event Center 21-22 ноември 2013 г. Маги Наумова/ Боряна Петрова.

HDInsight

Page 37: Sofia Event Center 21-22 ноември 2013 г. Маги Наумова/ Боряна Петрова.

HDInsight

Page 38: Sofia Event Center 21-22 ноември 2013 г. Маги Наумова/ Боряна Петрова.

Cheap Storage

$100 gets you 3million times

more storage in 30 years)

Inexpensive Computing

1980 10 MIPS/$ 2005 10M MIPS/$

Device Explosion

>5.5 billion (70+% of global population)

Key Trends

Social Networks

>2 Billionusers

Ubiquitous Connection

Web traffic2010 130 Exabyte (10 E18)

2015 1.6 ZettaByte (10 E21)

Sensor Networks

>10 Billion

Page 39: Sofia Event Center 21-22 ноември 2013 г. Маги Наумова/ Боряна Петрова.

Operational Data

Modern Data Warehousing

Raw Data“Store it All” Cluster

Raw Data“Store it All” Cluster

New user registry

New purchase

New product

Data Warehouse

Logs

Logs

How much do views for certain products increase when our TV ads run?

Page 40: Sofia Event Center 21-22 ноември 2013 г. Маги Наумова/ Боряна Петрова.

Reference: http://en.wikipedia.org/wiki/File:Hadoop_1.png

MapReduce Layer

HDFS Layer

Hadoop Distributed Architecture

Page 41: Sofia Event Center 21-22 ноември 2013 г. Маги Наумова/ Боряна Петрова.

Server

ServerServer

MapReduce: Move Code to the Data

Files

Server

Page 42: Sofia Event Center 21-22 ноември 2013 г. Маги Наумова/ Боряна Петрова.

Second, take the processing to the data

So How Does It Work?

// Map Reduce function in JavaScript

var map = function (key, value, context) {var words = value.split(/[^a-zA-Z]/);for (var i = 0; i < words.length; i++) {

if (words[i] !== "")context.write(words[i].toLowerCase(),1);}}};

var reduce = function (key, values, context) {var sum = 0;while (values.hasNext()) {sum += parseInt(values.next());

}context.write(key, sum);};

ServerServer

ServerServer

Runtime

Code

Page 43: Sofia Event Center 21-22 ноември 2013 г. Маги Наумова/ Боряна Петрова.

Distributed Storage(HDFS)

Query(Hive)

Distributed Processing

(MapReduce)

Scripting(Pig)

NoSQ

L Data

base

(HB

ase

)

Metadata(HCatalog)

Data

Inte

gra

tion

( OD

BC

/ SQ

OO

P/ REST)

Rela

tiona

l(S

QL

Serve

r)

Machine Learning(Mahout)

Graph(Pegasus)

Stats processin

g(RHadoo

p)

Eve

nt Pip

elin

e(Flu

me)

Active Directory (Security)

Monitoring & Deployment

(System Center)

C#, F#, .NET

JavaScript

Pipelin

e / w

orkflo

w(O

ozie

)

Azure Storage Vault (ASV)

PD

W Po

lybase

Busin

ess

Inte

lligence

(E

xcel, Po

wer

Vie

w, S

SA

S)

World's Data (Azure Data Marketplace)

Eve

nt

Drive

n

Proce

ssing

LegendRed = Core HadoopBlue = Data processingGray= Microsoft integration points and value addsOrange = Data MovementGreen = Packages

HDInsight and Hadoop Ecosystem

Page 44: Sofia Event Center 21-22 ноември 2013 г. Маги Наумова/ Боряна Петрова.

Contributions proposed back to community distribution

Microsoft Hadoop VisionInsights to all users by activating new types of data

Integrate with Microsoft business intelligence

Choice of deployment on Windows Server + Windows Azure

Integrate with Windows components (Active Directory, Microsoft System Center)Easy installation and configuration of Hadoop on Windows

Simplified programming with Microsoft .NET and JavaScript integration

Integrate with SQL Server Data Warehousing

Diff

ere

nti

ati

on

Page 45: Sofia Event Center 21-22 ноември 2013 г. Маги Наумова/ Боряна Петрова.

Data Insights

Page 46: Sofia Event Center 21-22 ноември 2013 г. Маги Наумова/ Боряна Петрова.

Complete and Consistent Data Platform

1CONSISTENTPLATFORM

SQL Server 2014Mission-critical performance

Faster insights from any data

Platform for hybrid cloud

Page 47: Sofia Event Center 21-22 ноември 2013 г. Маги Наумова/ Боряна Петрова.

Споделете вашата обратна връзка за тази сесия и за цялостната организация на конференцията

http://aka.ms/inchargeи участвайте в томболата за HTC 8S и други

награди!