Insight Platforms Accelerate Digital Transformation
-
Upload
mapr-technologies -
Category
Data & Analytics
-
view
103 -
download
0
Transcript of Insight Platforms Accelerate Digital Transformation
© 2016 MapR Technologies © 2016 MapR Technologies
Insight Platforms Accelerate Digital Transformation
© 2016 MapR Technologies
Today’s Presenters
Jack Norris
SVP – Data Applications
@Norrisjack
Brian Hopkins
VP, Principal Analyst
@practicingEA
Insight Platforms Accelerate Digital
Transformation Brian Hopkins, Vice President, Principal Analyst
© 2016 Forrester Research, Inc. Reproduction Prohibited 4
Source: Forrester’s “Big Data Fabrics Drive Innovation And Growth” report
Messy, large datasets are still a problem
© 2016 Forrester Research, Inc. Reproduction Prohibited 5
Firms are building data science platforms
Web UI – insights on demand
Insights fabric server (Domino Server)
Docker to isolate and manage jobs and code
Python script library becomes their ETL on demand
MongoDB Hadoop SQL Server MySQL
External reporting tools (e.g., Tableau)
Source: ”Transform Your Customer Experience With Systems Of Insight” Forrester report
Data Sources
© 2016 Forrester Research, Inc. Reproduction Prohibited 6
Firms are building data science platforms
Web UI – insights on demand
Insights fabric server (Domino Server)
Docker to isolate and manage jobs and code
Python script library becomes their ETL on demand
MongoDB Hadoop SQL Server MySQL
External reporting tools (e.g., Tableau)
Data scientists Engineers
Firmware team
Pipe-line Data
Engineers
Insights team manages insights-to execution
Source: ”Transform Your Customer Experience With Systems Of Insight” Forrester report
Data Sources
© 2016 Forrester Research, Inc. Reproduction Prohibited 7
Firms are building data science platforms
Web UI – insights on demand
Insights fabric server (Domino Server)
Docker to isolate and manage jobs and code
Python script library becomes their ETL on demand
MongoDB Hadoop SQL Server MySQL
External reporting tools (e.g., Tableau)
Data scientists Engineers
Firmware team
Pipe-line Data
Engineers
Insights team manages insights-to execution
Source: ”Transform Your Customer Experience With Systems Of Insight” Forrester report
Change driving
experience
Data Sources
© 2016 Forrester Research, Inc. Reproduction Prohibited 8
Firms are building data science platforms
Web UI – insights on demand
Insights fabric server (Domino Server)
Docker to isolate and manage jobs and code
Python script library becomes their ETL on demand
MongoDB Hadoop SQL Server MySQL
External reporting tools (e.g., Tableau)
Data scientists Engineers
Firmware team
Pipe-line Data
Engineers
Insights team manages insights-to execution
Source: ”Transform Your Customer Experience With Systems Of Insight” Forrester report
Change driving
experience
Data Sources
9 © 2016 Forrester Research, Inc. Reproduction Prohibited
The business discipline and
technology to harness insights and
consistently turn data into action
But we call what they do a “system of insight”
10 © 2016 Forrester Research, Inc. Reproduction Prohibited
A system of insight is an operating model: people, process, & technology working together
Source: April 27, 2015, “Digital Insights Are The New Currency Of Business” Forrester report
All Data Possible
Actions
Digital insights
architecture
Right
data
Effective
actions
11 © 2016 Forrester Research, Inc. Reproduction Prohibited
A system of insight is an operating model: people, process, & technology working together
Source: April 27, 2015, “Digital Insights Are The New Currency Of Business” Forrester report
All Data Possible
Actions Insights-to-execution
process
Insights team
Digital insights
architecture
Right
data
Effective
actions
12 © 2016 Forrester Research, Inc. Reproduction Prohibited
Systems of insight should run on a platform built for big data
Source: “Insight Platforms Accelerate Digital Transformation” Forrester report.
13 © 2016 Forrester Research, Inc. Reproduction Prohibited
Insight platforms unify the
technologies to manage and
analyze data, test and integrate the
derived insights into business
action, and capture feedback for
continuous improvement.
Insight platforms fit that need
Source: “Insight Platforms Accelerate Digital Transformation” Forrester report.
14 © 2016 Forrester Research, Inc. Reproduction Prohibited
Insight platforms have struck a chord with architects
0%10%20%30%40%50%60%70%80%90%
100%
How Firms Are Tracking And Investing In Emerging Technology
Our firm is starting to invest We are researching and selecting
We are tracking how it evolves No interest today
© 2016 Forrester Research, Inc. Reproduction Prohibited 15
Source: Forrester’s “Vendor Landscape: Insight Platforms, Q3 2016 report
Vendors offer insight platforms already
16 © 2016 Forrester Research, Inc. Reproduction Prohibited
© 2016 Forrester Research, Inc. Reproduction Prohibited 17
Source: Insight Platform Vendor Landscape, Q3 2016
Five classes of insights platforms
18 © 2016 Forrester Research, Inc. Reproduction Prohibited
Insight platforms unify the
technologies to manage and
analyze data, test and integrate the
derived insights into business
action, and capture feedback for
continuous improvement.
Big Data Fabrics provide a foundation for insight platforms
Source: “Insight Platforms Accelerate Digital Transformation” Forrester report.
© 2016 Forrester Research, Inc. Reproduction Prohibited 19
What a big data fabric looks like
20 © 2016 Forrester Research, Inc. Reproduction Prohibited
Big data fabrics are turning data science tools into insight platforms
• Data exploration and prep
• Collaboration
• Model development, tuning, management
• Model execution
Predictive Analytics
• EDW
• Cloud
• SaaS
• RDBMA
Data Sources
21 © 2016 Forrester Research, Inc. Reproduction Prohibited
Big data fabrics are turning data science tools into insight platforms
• Data exploration and prep
• Collaboration
• Model development, tuning, management
• Model execution
Predictive Analytics
• Data ingestion
• Data operations
• Data exploration
• Security, governance, metadata
Big Data Fabric
• EDW
• Cloud
• SaaS
• RDBMA
Data Sources
22 © 2016 Forrester Research, Inc. Reproduction Prohibited
Why is this important? Because your scope is much broader now.
23 © 2016 Forrester Research, Inc. Reproduction Prohibited
How vendors are approaching big data fabrics F
abrics Converged
Federated
As-a-service
Components run on a converged
infrastructure in an integrated way
Components run on different
infrastructures, connected by
orchestration components
(e.g microservices)
Componentry is abstracted from
functionality which is exposed as a
platform
Simplicity
Organizational
flexibility
Solution
agility
24 © 2016 Forrester Research, Inc. Reproduction Prohibited
Build towards an information fabric
Predictive Analytics
Big Data Fabric Information Fabric
Data Sources
Customer Analytics
Business Analytics
25 © 2016 Forrester Research, Inc. Reproduction Prohibited
Connect platforms through your fabric
Source: “Insight Platforms Accelerate Digital
Transformation” Forrester report
Thank you
forrester.com
Brian Hopkins
Twitter: @practicingea
© 2016 MapR Technologies 27 © 2016 MapR Technologies 27 © 2016 MapR Technologies
The Key to Digital Transformation
Jack Norris, SVP Data & Applications
© 2016 MapR Technologies 28 © 2016 MapR Technologies 28
A Once-in-30-Year Re-Platforming of the Enterprise
• Critical infrastructure for next-gen applications
• Data platform enabler for required Speed, Scale, & Reliability
New Applications Existing Applications
Open Source Analytic Innovations Legacy
Disruptive Data Platform
On Premise Private Cloud Public Cloud
Heterogeneous Hardware
© 2016 MapR Technologies 29 © 2016 MapR Technologies 29
Legacy Business Platforms Are Two Islands
• IT must integrate all the products
• Inability to operationalize the insight rapidly
• Can’t deal with high speed data ingestion and processing
• Scale up architecture leads to high cost
Message
Bus
Specialized Storage
Operational Applications
J2EE
AppServer
Relational
Database
Specialized Storage
Analytical Applications
Analytic Database ETL Tool BI Tool
© 2016 MapR Technologies 30 © 2016 MapR Technologies 30
The Secret is to Bring Analytics & Operations Together
Converged Applications
Complete Access to Real-time and
Historical Data in One Platform
Historical Immediate
© 2016 MapR Technologies 31 © 2016 MapR Technologies 31
$ $
$
© 2016 MapR Technologies 32 © 2016 MapR Technologies 32
© 2016 MapR Technologies 33 © 2016 MapR Technologies 33
© 2016 MapR Technologies 34 © 2016 MapR Technologies 34
© 2016 MapR Technologies 35 © 2016 MapR Technologies 35 MapR Confidential
Data Warehouse Offload: Cost per Terabyte Comparisons
Augmenting legacy
infrastructure can save over
$1.5K or 79% in annual op ex
per TB and slash the cap ex
per TB by $4.8K or 95%
Legacy: Typical net Exadata
pricing with rack, storage
server, and DB bundle
software
Assumes 100% use of available
storage
$0.00
$0.25
$0.50
$0.75
$1.00
$1.25
$1.50
$1.75
$2.00
Legacy MapR
Annual Op Ex per TB ($000)
Hardware HW Maintenance Licenses License Support MapR Technology
$0.00
$0.65
$1.30
$1.95
$2.60
$3.25
$3.90
$4.55
$5.20
Legacy MapR
Cap Ex per TB ($000)
© 2016 MapR Technologies 36 © 2016 MapR Technologies 36
$ $
$
© 2016 MapR Technologies 37 © 2016 MapR Technologies 37
© 2016 MapR Technologies 38 © 2016 MapR Technologies 38
© 2016 MapR Technologies 39 © 2016 MapR Technologies 39
Largest Biometric Database in the World
PEOPLE
© 2016 MapR Technologies 40 © 2016 MapR Technologies 40
Driving Business Value
$19.4 Million
Per interviewed organization, average
discounted benefits over three years
© 2016 MapR Technologies 41 © 2016 MapR Technologies 41
Scale, Speed, Reliability Tradeoffs
• Many different security models
• Unique administration model
• Expensive
• Time consuming with latencies
• Data availability, protection issues
The Growing Complexity of Big Data Environments
Search
server
Hadoop &
Spark
cluster
Cassandra for
event or content
logging
Document
JSON DB
Classic data
warehouse
Message
middlewa
re
Application
server
© 2016 MapR Technologies 42 © 2016 MapR Technologies 42
Complexity vs. Converged Simplicity
Simultaneous Scale,
Speed and Reliability
• Vast scale - Trillions of files
• Self healing resiliency
• Low latency architecture
• Global, cross-datacenter failover
Transformational Apps
Data
Web-Scale Storage MapR-FS MapR-DB
Real Time Unified Security Multi-tenancy Disaster Recovery Global Namespace High Availability
MapR Streams Event Streaming Database
Enterprise Grade Platform
© 2016 MapR Technologies 43 © 2016 MapR Technologies 43
Data Platform Requirements
Integrated Analytics
Enterprise Grade
Scale
Legacy Support
Transformational Applications
Real Time
© 2016 MapR Technologies 44 © 2016 MapR Technologies 44
Comparing Data Platforms
S T O R A G E
D A T A
© 2016 MapR Technologies 45 © 2016 MapR Technologies 45
H A D O O P
Comparing Data Platforms
D T A
C O M P U T E
D A T A
© 2016 MapR Technologies 46 © 2016 MapR Technologies 46
Comparing Data Platforms
C O M P U T E
S P A R K
© 2016 MapR Technologies 47 © 2016 MapR Technologies 47
Comparing Data Platforms
Issues: Enterprise Grade, Legacy Support,
Integrated Analytics
C A S S A N D R A
D T A
C O M P U T E
D A T A
© 2016 MapR Technologies 48 © 2016 MapR Technologies 48
Comparing Data Platforms
Issues: Enterprise Grade, Legacy Support,
Integrated Analytics
C O M P U T E
D T A D A T A
Write In:
–– –– –– –
O T H E R
© 2016 MapR Technologies 49 © 2016 MapR Technologies 49
C O N V E R G E D D A T A P L A T F O R M
Comparing Data Platforms
Data in Motion Data at Rest
C O M P U T E
D T A D A T A
© 2016 MapR Technologies 50 © 2016 MapR Technologies 50
Yield Management Optimization Global
Semi-conductor
Company
© 2016 MapR Technologies 51 © 2016 MapR Technologies 51
Managing Risk/Fraud American Express
Fraud protection on $1 trillion
Decisions made in less than 2 milliseconds
© 2016 MapR Technologies 52 © 2016 MapR Technologies 52
Big Data is Generated One Event at a Time
“time” : “6:01.103”,
“event” : “RETWEET”,
“location” :
“lat” : 40.712784,
“lon” : -74.005941
“time: “5:04.120”,
“severity” : “CRITICAL”,
“msg” : “Service down”
“card_num” : 1234,
“merchant” : ”Apple”,
“amount” : 50
© 2016 MapR Technologies 53 © 2016 MapR Technologies 53
Event-based Data Flows
web events etc…
machine sensors
Biometrics
Mobile events
© 2016 MapR Technologies 54 © 2016 MapR Technologies 54
Streams Enable Real-Time Applications
Failure
Alerts Real-time application &
network monitoring
Trending now
Web Personalized
Offers
Real-time Fraud Detection
Ad optimization
Supply Chain Optimization
© 2016 MapR Technologies 55 © 2016 MapR Technologies 55
Streams Enable Event-based Microservices
Clicks Sessions Conversions
Sessionizer Converted?
© 2016 MapR Technologies 56 © 2016 MapR Technologies 56
Microservices Overview
• Microservices is an approach to application
development in which a large application is built
as a suite of modular services.
• Each module supports a specific business goal
and uses a simple, well-defined interface to
communicate with other modules.
© 2016 MapR Technologies 57 © 2016 MapR Technologies 57
Event-Driven Microservices
Microservices combined with Streams
and a Converged Platform provides:
• Application development across file, database,
document and streaming services
• Ultra scale, utility grade performance
• Greater efficiency and simplicity than alternative
architectures
• Integrated data-in-motion and data-at-rest and
continuous and low latency processing
© 2016 MapR Technologies 58 © 2016 MapR Technologies 58
© 2016 MapR Technologies 59 © 2016 MapR Technologies 59
© 2016 MapR Technologies 60 © 2016 MapR Technologies 60
Microservices Architecture
Message Broker
Processing
Platform
Processing
Platform
Streaming Data
Platform
© 2016 MapR Technologies 61 © 2016 MapR Technologies 61
Converged Microservices Architecture
MapR Converged Data Platform
Converged
Message and
Processing
Services
© 2016 MapR Technologies 62 © 2016 MapR Technologies 62
Converged Platform Appeal for Developers: Agility
Flexibility
Agility
Simplicity
Real Time
© 2016 MapR Technologies 63 © 2016 MapR Technologies 63
Appeal for Architects and Administrators
• Simplifies administration
• Avoids cluster sprawl
• Unifies security, data protection, disaster recovery
© 2016 MapR Technologies 64 © 2016 MapR Technologies 64
Existing Environments – Complex Silos
While logically separate
A single platform can be
used to offload and
consolidate data
© 2016 MapR Technologies 65 © 2016 MapR Technologies 65
A P P
D A T A
D A T A
A P P
A P P
A P P
D A T A
Road to Digital Transformation
© 2016 MapR Technologies 66 © 2016 MapR Technologies 66
The Keys to Digital Transformation
1. Data Convergence
2. Stream Processing
3. Application Agility
© 2016 MapR Technologies
Q & A Engage with us!
Forrester Whitepaper: Insight Platforms Accelerating Digital
Transformation http://mapr.com/digital-transformation
eBook: Architects Guide to
Implementing a Digital Transformation https://www.mapr.com/architect-guide-to-digital-transformation