Insight Platforms Accelerate Digital Transformation

67
© 2016 MapR Technologies © 2016 MapR Technologies Insight Platforms Accelerate Digital Transformation

Transcript of Insight Platforms Accelerate Digital Transformation

Page 1: Insight Platforms Accelerate Digital Transformation

© 2016 MapR Technologies © 2016 MapR Technologies

Insight Platforms Accelerate Digital Transformation

Page 2: Insight Platforms Accelerate Digital Transformation

© 2016 MapR Technologies

Today’s Presenters

Jack Norris

SVP – Data Applications

@Norrisjack

Brian Hopkins

VP, Principal Analyst

@practicingEA

Page 3: Insight Platforms Accelerate Digital Transformation

Insight Platforms Accelerate Digital

Transformation Brian Hopkins, Vice President, Principal Analyst

Page 4: Insight Platforms Accelerate Digital Transformation

© 2016 Forrester Research, Inc. Reproduction Prohibited 4

Source: Forrester’s “Big Data Fabrics Drive Innovation And Growth” report

Messy, large datasets are still a problem

Page 5: Insight Platforms Accelerate Digital Transformation

© 2016 Forrester Research, Inc. Reproduction Prohibited 5

Firms are building data science platforms

Web UI – insights on demand

Insights fabric server (Domino Server)

Docker to isolate and manage jobs and code

Python script library becomes their ETL on demand

MongoDB Hadoop SQL Server MySQL

External reporting tools (e.g., Tableau)

Source: ”Transform Your Customer Experience With Systems Of Insight” Forrester report

Data Sources

Page 6: Insight Platforms Accelerate Digital Transformation

© 2016 Forrester Research, Inc. Reproduction Prohibited 6

Firms are building data science platforms

Web UI – insights on demand

Insights fabric server (Domino Server)

Docker to isolate and manage jobs and code

Python script library becomes their ETL on demand

MongoDB Hadoop SQL Server MySQL

External reporting tools (e.g., Tableau)

Data scientists Engineers

Firmware team

Pipe-line Data

Engineers

Insights team manages insights-to execution

Source: ”Transform Your Customer Experience With Systems Of Insight” Forrester report

Data Sources

Page 7: Insight Platforms Accelerate Digital Transformation

© 2016 Forrester Research, Inc. Reproduction Prohibited 7

Firms are building data science platforms

Web UI – insights on demand

Insights fabric server (Domino Server)

Docker to isolate and manage jobs and code

Python script library becomes their ETL on demand

MongoDB Hadoop SQL Server MySQL

External reporting tools (e.g., Tableau)

Data scientists Engineers

Firmware team

Pipe-line Data

Engineers

Insights team manages insights-to execution

Source: ”Transform Your Customer Experience With Systems Of Insight” Forrester report

Change driving

experience

Data Sources

Page 8: Insight Platforms Accelerate Digital Transformation

© 2016 Forrester Research, Inc. Reproduction Prohibited 8

Firms are building data science platforms

Web UI – insights on demand

Insights fabric server (Domino Server)

Docker to isolate and manage jobs and code

Python script library becomes their ETL on demand

MongoDB Hadoop SQL Server MySQL

External reporting tools (e.g., Tableau)

Data scientists Engineers

Firmware team

Pipe-line Data

Engineers

Insights team manages insights-to execution

Source: ”Transform Your Customer Experience With Systems Of Insight” Forrester report

Change driving

experience

Data Sources

Page 9: Insight Platforms Accelerate Digital Transformation

9 © 2016 Forrester Research, Inc. Reproduction Prohibited

The business discipline and

technology to harness insights and

consistently turn data into action

But we call what they do a “system of insight”

Page 10: Insight Platforms Accelerate Digital Transformation

10 © 2016 Forrester Research, Inc. Reproduction Prohibited

A system of insight is an operating model: people, process, & technology working together

Source: April 27, 2015, “Digital Insights Are The New Currency Of Business” Forrester report

All Data Possible

Actions

Digital insights

architecture

Right

data

Effective

actions

Page 11: Insight Platforms Accelerate Digital Transformation

11 © 2016 Forrester Research, Inc. Reproduction Prohibited

A system of insight is an operating model: people, process, & technology working together

Source: April 27, 2015, “Digital Insights Are The New Currency Of Business” Forrester report

All Data Possible

Actions Insights-to-execution

process

Insights team

Digital insights

architecture

Right

data

Effective

actions

Page 12: Insight Platforms Accelerate Digital Transformation

12 © 2016 Forrester Research, Inc. Reproduction Prohibited

Systems of insight should run on a platform built for big data

Source: “Insight Platforms Accelerate Digital Transformation” Forrester report.

Page 13: Insight Platforms Accelerate Digital Transformation

13 © 2016 Forrester Research, Inc. Reproduction Prohibited

Insight platforms unify the

technologies to manage and

analyze data, test and integrate the

derived insights into business

action, and capture feedback for

continuous improvement.

Insight platforms fit that need

Source: “Insight Platforms Accelerate Digital Transformation” Forrester report.

Page 14: Insight Platforms Accelerate Digital Transformation

14 © 2016 Forrester Research, Inc. Reproduction Prohibited

Insight platforms have struck a chord with architects

0%10%20%30%40%50%60%70%80%90%

100%

How Firms Are Tracking And Investing In Emerging Technology

Our firm is starting to invest We are researching and selecting

We are tracking how it evolves No interest today

Page 15: Insight Platforms Accelerate Digital Transformation

© 2016 Forrester Research, Inc. Reproduction Prohibited 15

Source: Forrester’s “Vendor Landscape: Insight Platforms, Q3 2016 report

Vendors offer insight platforms already

Page 16: Insight Platforms Accelerate Digital Transformation

16 © 2016 Forrester Research, Inc. Reproduction Prohibited

Page 17: Insight Platforms Accelerate Digital Transformation

© 2016 Forrester Research, Inc. Reproduction Prohibited 17

Source: Insight Platform Vendor Landscape, Q3 2016

Five classes of insights platforms

Page 18: Insight Platforms Accelerate Digital Transformation

18 © 2016 Forrester Research, Inc. Reproduction Prohibited

Insight platforms unify the

technologies to manage and

analyze data, test and integrate the

derived insights into business

action, and capture feedback for

continuous improvement.

Big Data Fabrics provide a foundation for insight platforms

Source: “Insight Platforms Accelerate Digital Transformation” Forrester report.

Page 19: Insight Platforms Accelerate Digital Transformation

© 2016 Forrester Research, Inc. Reproduction Prohibited 19

What a big data fabric looks like

Page 20: Insight Platforms Accelerate Digital Transformation

20 © 2016 Forrester Research, Inc. Reproduction Prohibited

Big data fabrics are turning data science tools into insight platforms

• Data exploration and prep

• Collaboration

• Model development, tuning, management

• Model execution

Predictive Analytics

• EDW

• Cloud

• SaaS

• RDBMA

Data Sources

Page 21: Insight Platforms Accelerate Digital Transformation

21 © 2016 Forrester Research, Inc. Reproduction Prohibited

Big data fabrics are turning data science tools into insight platforms

• Data exploration and prep

• Collaboration

• Model development, tuning, management

• Model execution

Predictive Analytics

• Data ingestion

• Data operations

• Data exploration

• Security, governance, metadata

Big Data Fabric

• EDW

• Cloud

• SaaS

• RDBMA

Data Sources

Page 22: Insight Platforms Accelerate Digital Transformation

22 © 2016 Forrester Research, Inc. Reproduction Prohibited

Why is this important? Because your scope is much broader now.

Page 23: Insight Platforms Accelerate Digital Transformation

23 © 2016 Forrester Research, Inc. Reproduction Prohibited

How vendors are approaching big data fabrics F

abrics Converged

Federated

As-a-service

Components run on a converged

infrastructure in an integrated way

Components run on different

infrastructures, connected by

orchestration components

(e.g microservices)

Componentry is abstracted from

functionality which is exposed as a

platform

Simplicity

Organizational

flexibility

Solution

agility

Page 24: Insight Platforms Accelerate Digital Transformation

24 © 2016 Forrester Research, Inc. Reproduction Prohibited

Build towards an information fabric

Predictive Analytics

Big Data Fabric Information Fabric

Data Sources

Customer Analytics

Business Analytics

Page 25: Insight Platforms Accelerate Digital Transformation

25 © 2016 Forrester Research, Inc. Reproduction Prohibited

Connect platforms through your fabric

Source: “Insight Platforms Accelerate Digital

Transformation” Forrester report

Page 26: Insight Platforms Accelerate Digital Transformation

Thank you

forrester.com

Brian Hopkins

[email protected]

Twitter: @practicingea

Page 27: Insight Platforms Accelerate Digital Transformation

© 2016 MapR Technologies 27 © 2016 MapR Technologies 27 © 2016 MapR Technologies

The Key to Digital Transformation

Jack Norris, SVP Data & Applications

Page 28: Insight Platforms Accelerate Digital Transformation

© 2016 MapR Technologies 28 © 2016 MapR Technologies 28

A Once-in-30-Year Re-Platforming of the Enterprise

• Critical infrastructure for next-gen applications

• Data platform enabler for required Speed, Scale, & Reliability

New Applications Existing Applications

Open Source Analytic Innovations Legacy

Disruptive Data Platform

On Premise Private Cloud Public Cloud

Heterogeneous Hardware

Page 29: Insight Platforms Accelerate Digital Transformation

© 2016 MapR Technologies 29 © 2016 MapR Technologies 29

Legacy Business Platforms Are Two Islands

• IT must integrate all the products

• Inability to operationalize the insight rapidly

• Can’t deal with high speed data ingestion and processing

• Scale up architecture leads to high cost

Message

Bus

Specialized Storage

Operational Applications

J2EE

AppServer

Relational

Database

Specialized Storage

Analytical Applications

Analytic Database ETL Tool BI Tool

Page 30: Insight Platforms Accelerate Digital Transformation

© 2016 MapR Technologies 30 © 2016 MapR Technologies 30

The Secret is to Bring Analytics & Operations Together

Converged Applications

Complete Access to Real-time and

Historical Data in One Platform

Historical Immediate

Page 31: Insight Platforms Accelerate Digital Transformation

© 2016 MapR Technologies 31 © 2016 MapR Technologies 31

$ $

$

Page 32: Insight Platforms Accelerate Digital Transformation

© 2016 MapR Technologies 32 © 2016 MapR Technologies 32

Page 33: Insight Platforms Accelerate Digital Transformation

© 2016 MapR Technologies 33 © 2016 MapR Technologies 33

Page 34: Insight Platforms Accelerate Digital Transformation

© 2016 MapR Technologies 34 © 2016 MapR Technologies 34

Page 35: Insight Platforms Accelerate Digital Transformation

© 2016 MapR Technologies 35 © 2016 MapR Technologies 35 MapR Confidential

Data Warehouse Offload: Cost per Terabyte Comparisons

Augmenting legacy

infrastructure can save over

$1.5K or 79% in annual op ex

per TB and slash the cap ex

per TB by $4.8K or 95%

Legacy: Typical net Exadata

pricing with rack, storage

server, and DB bundle

software

Assumes 100% use of available

storage

$0.00

$0.25

$0.50

$0.75

$1.00

$1.25

$1.50

$1.75

$2.00

Legacy MapR

Annual Op Ex per TB ($000)

Hardware HW Maintenance Licenses License Support MapR Technology

$0.00

$0.65

$1.30

$1.95

$2.60

$3.25

$3.90

$4.55

$5.20

Legacy MapR

Cap Ex per TB ($000)

Page 36: Insight Platforms Accelerate Digital Transformation

© 2016 MapR Technologies 36 © 2016 MapR Technologies 36

$ $

$

Page 37: Insight Platforms Accelerate Digital Transformation

© 2016 MapR Technologies 37 © 2016 MapR Technologies 37

Page 38: Insight Platforms Accelerate Digital Transformation

© 2016 MapR Technologies 38 © 2016 MapR Technologies 38

Page 39: Insight Platforms Accelerate Digital Transformation

© 2016 MapR Technologies 39 © 2016 MapR Technologies 39

Largest Biometric Database in the World

PEOPLE

Page 40: Insight Platforms Accelerate Digital Transformation

© 2016 MapR Technologies 40 © 2016 MapR Technologies 40

Driving Business Value

$19.4 Million

Per interviewed organization, average

discounted benefits over three years

Page 41: Insight Platforms Accelerate Digital Transformation

© 2016 MapR Technologies 41 © 2016 MapR Technologies 41

Scale, Speed, Reliability Tradeoffs

• Many different security models

• Unique administration model

• Expensive

• Time consuming with latencies

• Data availability, protection issues

The Growing Complexity of Big Data Environments

Search

server

Hadoop &

Spark

cluster

Cassandra for

event or content

logging

Document

JSON DB

Classic data

warehouse

Message

middlewa

re

Application

server

Page 42: Insight Platforms Accelerate Digital Transformation

© 2016 MapR Technologies 42 © 2016 MapR Technologies 42

Complexity vs. Converged Simplicity

Simultaneous Scale,

Speed and Reliability

• Vast scale - Trillions of files

• Self healing resiliency

• Low latency architecture

• Global, cross-datacenter failover

Transformational Apps

Data

Web-Scale Storage MapR-FS MapR-DB

Real Time Unified Security Multi-tenancy Disaster Recovery Global Namespace High Availability

MapR Streams Event Streaming Database

Enterprise Grade Platform

Page 43: Insight Platforms Accelerate Digital Transformation

© 2016 MapR Technologies 43 © 2016 MapR Technologies 43

Data Platform Requirements

Integrated Analytics

Enterprise Grade

Scale

Legacy Support

Transformational Applications

Real Time

Page 44: Insight Platforms Accelerate Digital Transformation

© 2016 MapR Technologies 44 © 2016 MapR Technologies 44

Comparing Data Platforms

S T O R A G E

D A T A

Page 45: Insight Platforms Accelerate Digital Transformation

© 2016 MapR Technologies 45 © 2016 MapR Technologies 45

H A D O O P

Comparing Data Platforms

D T A

C O M P U T E

D A T A

Page 46: Insight Platforms Accelerate Digital Transformation

© 2016 MapR Technologies 46 © 2016 MapR Technologies 46

Comparing Data Platforms

C O M P U T E

S P A R K

Page 47: Insight Platforms Accelerate Digital Transformation

© 2016 MapR Technologies 47 © 2016 MapR Technologies 47

Comparing Data Platforms

Issues: Enterprise Grade, Legacy Support,

Integrated Analytics

C A S S A N D R A

D T A

C O M P U T E

D A T A

Page 48: Insight Platforms Accelerate Digital Transformation

© 2016 MapR Technologies 48 © 2016 MapR Technologies 48

Comparing Data Platforms

Issues: Enterprise Grade, Legacy Support,

Integrated Analytics

C O M P U T E

D T A D A T A

Write In:

–– –– –– –

O T H E R

Page 49: Insight Platforms Accelerate Digital Transformation

© 2016 MapR Technologies 49 © 2016 MapR Technologies 49

C O N V E R G E D D A T A P L A T F O R M

Comparing Data Platforms

Data in Motion Data at Rest

C O M P U T E

D T A D A T A

Page 50: Insight Platforms Accelerate Digital Transformation

© 2016 MapR Technologies 50 © 2016 MapR Technologies 50

Yield Management Optimization Global

Semi-conductor

Company

Page 51: Insight Platforms Accelerate Digital Transformation

© 2016 MapR Technologies 51 © 2016 MapR Technologies 51

Managing Risk/Fraud American Express

Fraud protection on $1 trillion

Decisions made in less than 2 milliseconds

Page 52: Insight Platforms Accelerate Digital Transformation

© 2016 MapR Technologies 52 © 2016 MapR Technologies 52

Big Data is Generated One Event at a Time

“time” : “6:01.103”,

“event” : “RETWEET”,

“location” :

“lat” : 40.712784,

“lon” : -74.005941

“time: “5:04.120”,

“severity” : “CRITICAL”,

“msg” : “Service down”

“card_num” : 1234,

“merchant” : ”Apple”,

“amount” : 50

Page 53: Insight Platforms Accelerate Digital Transformation

© 2016 MapR Technologies 53 © 2016 MapR Technologies 53

Event-based Data Flows

web events etc…

machine sensors

Biometrics

Mobile events

Page 54: Insight Platforms Accelerate Digital Transformation

© 2016 MapR Technologies 54 © 2016 MapR Technologies 54

Streams Enable Real-Time Applications

Failure

Alerts Real-time application &

network monitoring

Trending now

Web Personalized

Offers

Real-time Fraud Detection

Ad optimization

Supply Chain Optimization

Page 55: Insight Platforms Accelerate Digital Transformation

© 2016 MapR Technologies 55 © 2016 MapR Technologies 55

Streams Enable Event-based Microservices

Clicks Sessions Conversions

Sessionizer Converted?

Page 56: Insight Platforms Accelerate Digital Transformation

© 2016 MapR Technologies 56 © 2016 MapR Technologies 56

Microservices Overview

• Microservices is an approach to application

development in which a large application is built

as a suite of modular services.

• Each module supports a specific business goal

and uses a simple, well-defined interface to

communicate with other modules.

Page 57: Insight Platforms Accelerate Digital Transformation

© 2016 MapR Technologies 57 © 2016 MapR Technologies 57

Event-Driven Microservices

Microservices combined with Streams

and a Converged Platform provides:

• Application development across file, database,

document and streaming services

• Ultra scale, utility grade performance

• Greater efficiency and simplicity than alternative

architectures

• Integrated data-in-motion and data-at-rest and

continuous and low latency processing

Page 58: Insight Platforms Accelerate Digital Transformation

© 2016 MapR Technologies 58 © 2016 MapR Technologies 58

Page 59: Insight Platforms Accelerate Digital Transformation

© 2016 MapR Technologies 59 © 2016 MapR Technologies 59

Page 60: Insight Platforms Accelerate Digital Transformation

© 2016 MapR Technologies 60 © 2016 MapR Technologies 60

Microservices Architecture

Message Broker

Processing

Platform

Processing

Platform

Streaming Data

Platform

Page 61: Insight Platforms Accelerate Digital Transformation

© 2016 MapR Technologies 61 © 2016 MapR Technologies 61

Converged Microservices Architecture

MapR Converged Data Platform

Converged

Message and

Processing

Services

Page 62: Insight Platforms Accelerate Digital Transformation

© 2016 MapR Technologies 62 © 2016 MapR Technologies 62

Converged Platform Appeal for Developers: Agility

Flexibility

Agility

Simplicity

Real Time

Page 63: Insight Platforms Accelerate Digital Transformation

© 2016 MapR Technologies 63 © 2016 MapR Technologies 63

Appeal for Architects and Administrators

• Simplifies administration

• Avoids cluster sprawl

• Unifies security, data protection, disaster recovery

Page 64: Insight Platforms Accelerate Digital Transformation

© 2016 MapR Technologies 64 © 2016 MapR Technologies 64

Existing Environments – Complex Silos

While logically separate

A single platform can be

used to offload and

consolidate data

Page 65: Insight Platforms Accelerate Digital Transformation

© 2016 MapR Technologies 65 © 2016 MapR Technologies 65

A P P

D A T A

D A T A

A P P

A P P

A P P

D A T A

Road to Digital Transformation

Page 66: Insight Platforms Accelerate Digital Transformation

© 2016 MapR Technologies 66 © 2016 MapR Technologies 66

The Keys to Digital Transformation

1. Data Convergence

2. Stream Processing

3. Application Agility