The Real-Time CDO and the Cloud-Forward Path to Predictive Analytics
-
Upload
memsql -
Category
Technology
-
view
133 -
download
1
Transcript of The Real-Time CDO and the Cloud-Forward Path to Predictive Analytics
![Page 1: The Real-Time CDO and the Cloud-Forward Path to Predictive Analytics](https://reader036.fdocuments.net/reader036/viewer/2022062823/58cea9c81a28abb26e8b6be3/html5/thumbnails/1.jpg)
Nikita Shamgunov, CTO and Co-founder of MemSQL
Gartner Data and Analytics Summit, March 2017
The Real-Time Chief Data Officer and theCloud-Forward Path to Predictive Analytics
![Page 2: The Real-Time CDO and the Cloud-Forward Path to Predictive Analytics](https://reader036.fdocuments.net/reader036/viewer/2022062823/58cea9c81a28abb26e8b6be3/html5/thumbnails/2.jpg)
Today’s TalkThe Real-Time Chief Data Officer
Introduction to MemSQLCustomer Use Cases
Demonstration: Historical, Real-Time, Predictive Analytics
Path to the Cloud
![Page 3: The Real-Time CDO and the Cloud-Forward Path to Predictive Analytics](https://reader036.fdocuments.net/reader036/viewer/2022062823/58cea9c81a28abb26e8b6be3/html5/thumbnails/3.jpg)
Real-time Chief Data Officer Objectives▪360 view of the Business
• No silos
▪Real-time access to ALL data• Current and historical in one system
▪Flexible and Strategic Deployment Model• Built for the Cloud: Public, Private, As-A-Service
▪Modern Data Architecture• Scalable, Elastic
![Page 4: The Real-Time CDO and the Cloud-Forward Path to Predictive Analytics](https://reader036.fdocuments.net/reader036/viewer/2022062823/58cea9c81a28abb26e8b6be3/html5/thumbnails/4.jpg)
Introduction to MemSQL
![Page 5: The Real-Time CDO and the Cloud-Forward Path to Predictive Analytics](https://reader036.fdocuments.net/reader036/viewer/2022062823/58cea9c81a28abb26e8b6be3/html5/thumbnails/5.jpg)
The Real-Time Data WarehouseFor the front lines of your business
![Page 6: The Real-Time CDO and the Cloud-Forward Path to Predictive Analytics](https://reader036.fdocuments.net/reader036/viewer/2022062823/58cea9c81a28abb26e8b6be3/html5/thumbnails/6.jpg)
Real-Time Scalable Multi-Cloud• Fast Ingest, Low Latency
Queries, High Concurrency• Operational and Ad-Hoc
Analytics• Powerful applications
• Petabyte scale• Elastic• Commodity hardware• Low TCO
• Cloud Managed Service• On-premises• Multi-cloud deployments• Enterprise-grade Security
A Modern Data Warehouse for the Enterprise Frontlines
![Page 7: The Real-Time CDO and the Cloud-Forward Path to Predictive Analytics](https://reader036.fdocuments.net/reader036/viewer/2022062823/58cea9c81a28abb26e8b6be3/html5/thumbnails/7.jpg)
Real-Time Data
Messaging andTransforms
Historical Data
Bare Metal, Virtual Machines, Containers On-Premises, Cloud, As a Service
Business Intelligence Dashboards
Real-Time ApplicationAnalyticsReal-Time Data
Warehouse
Live DataMemory Optimized
Tables
Historical DataDisk Optimized
Tables
Streaming IngestReal-Time
Data Pipelines
![Page 8: The Real-Time CDO and the Cloud-Forward Path to Predictive Analytics](https://reader036.fdocuments.net/reader036/viewer/2022062823/58cea9c81a28abb26e8b6be3/html5/thumbnails/8.jpg)
MemSQL Confidential8
Product or Services Scores for Operational Data Warehouse
Critical Capabilities for Data Warehouse and Data Management Solutions for Analytics
Gartner, July 2016
![Page 9: The Real-Time CDO and the Cloud-Forward Path to Predictive Analytics](https://reader036.fdocuments.net/reader036/viewer/2022062823/58cea9c81a28abb26e8b6be3/html5/thumbnails/9.jpg)
How Did We Get Here
![Page 10: The Real-Time CDO and the Cloud-Forward Path to Predictive Analytics](https://reader036.fdocuments.net/reader036/viewer/2022062823/58cea9c81a28abb26e8b6be3/html5/thumbnails/10.jpg)
![Page 11: The Real-Time CDO and the Cloud-Forward Path to Predictive Analytics](https://reader036.fdocuments.net/reader036/viewer/2022062823/58cea9c81a28abb26e8b6be3/html5/thumbnails/11.jpg)
Trying to build scale-out for
a traditional product
![Page 12: The Real-Time CDO and the Cloud-Forward Path to Predictive Analytics](https://reader036.fdocuments.net/reader036/viewer/2022062823/58cea9c81a28abb26e8b6be3/html5/thumbnails/12.jpg)
![Page 13: The Real-Time CDO and the Cloud-Forward Path to Predictive Analytics](https://reader036.fdocuments.net/reader036/viewer/2022062823/58cea9c81a28abb26e8b6be3/html5/thumbnails/13.jpg)
Scale-out
![Page 14: The Real-Time CDO and the Cloud-Forward Path to Predictive Analytics](https://reader036.fdocuments.net/reader036/viewer/2022062823/58cea9c81a28abb26e8b6be3/html5/thumbnails/14.jpg)
▪Every piece of technology is scalable▪Analyzing data from hundreds of thousands of
machines▪Delivering immense value in real-time
• Real-time code deployment• Detecting anomalies• A/B testing results
▪Fundamentally making the business faster by providing data at your fingertips
An Insider’s View at Facebook
![Page 15: The Real-Time CDO and the Cloud-Forward Path to Predictive Analytics](https://reader036.fdocuments.net/reader036/viewer/2022062823/58cea9c81a28abb26e8b6be3/html5/thumbnails/15.jpg)
Imagine scaling a database on industry standard hardware.
Need 2x the performance? Add 2x the nodes.
![Page 16: The Real-Time CDO and the Cloud-Forward Path to Predictive Analytics](https://reader036.fdocuments.net/reader036/viewer/2022062823/58cea9c81a28abb26e8b6be3/html5/thumbnails/16.jpg)
Customer Use Cases
![Page 17: The Real-Time CDO and the Cloud-Forward Path to Predictive Analytics](https://reader036.fdocuments.net/reader036/viewer/2022062823/58cea9c81a28abb26e8b6be3/html5/thumbnails/17.jpg)
Real-time analytics transformed profitability analysis of customer logistics from weekly to daily, and reduced latency from days to minutes
+
17
![Page 18: The Real-Time CDO and the Cloud-Forward Path to Predictive Analytics](https://reader036.fdocuments.net/reader036/viewer/2022062823/58cea9c81a28abb26e8b6be3/html5/thumbnails/18.jpg)
18
BUSINESS BENEFITS▪New increased profitability customer logistics analysis from weekly to daily▪Reduce Latency from days to minutes
TECHNICAL BENEFITS▪Reduced 22 hour ETL to minutes▪Increased query response time by 80x
![Page 19: The Real-Time CDO and the Cloud-Forward Path to Predictive Analytics](https://reader036.fdocuments.net/reader036/viewer/2022062823/58cea9c81a28abb26e8b6be3/html5/thumbnails/19.jpg)
THE KELLOGG’S REAL-TIME ARCHITECTURE
19
22 hours to minutes
80x faster
![Page 20: The Real-Time CDO and the Cloud-Forward Path to Predictive Analytics](https://reader036.fdocuments.net/reader036/viewer/2022062823/58cea9c81a28abb26e8b6be3/html5/thumbnails/20.jpg)
Reducing delay in “freshness of data” from two hours to 10 minutes
+
![Page 21: The Real-Time CDO and the Cloud-Forward Path to Predictive Analytics](https://reader036.fdocuments.net/reader036/viewer/2022062823/58cea9c81a28abb26e8b6be3/html5/thumbnails/21.jpg)
BUSINESS BENEFITS▪Reach over 1.5 billion users across 100s of thousands of mobile apps▪Real-time optimization of advertising campaigns with improved post-install
engagements▪Net new personalized campaign performance reports for greater visibility
TECHNICAL BENEFITS▪10x faster data refresh, from hours to minutes▪Ad-hoc queries on raw log-level data in seconds▪Real-time deduplication▪1 TB/day ingest
![Page 22: The Real-Time CDO and the Cloud-Forward Path to Predictive Analytics](https://reader036.fdocuments.net/reader036/viewer/2022062823/58cea9c81a28abb26e8b6be3/html5/thumbnails/22.jpg)
THE MANAGE REAL-TIME ARCHITECTURE
22
REAL-TIMEANALYTICS
Real-Time inputs
http://www.enterprisetech.com/2016/12/09/managing-30b-bid-requests/
![Page 23: The Real-Time CDO and the Cloud-Forward Path to Predictive Analytics](https://reader036.fdocuments.net/reader036/viewer/2022062823/58cea9c81a28abb26e8b6be3/html5/thumbnails/23.jpg)
DellEMC Adopts MemSQL for Customer Acquisition Lifecycle Management
+
![Page 24: The Real-Time CDO and the Cloud-Forward Path to Predictive Analytics](https://reader036.fdocuments.net/reader036/viewer/2022062823/58cea9c81a28abb26e8b6be3/html5/thumbnails/24.jpg)
24
BUSINESS BENEFITS• Deliver real-time customer updates to DellEMC Sales Department• Scale customer analytics to increase sales productivity• Execute joins across multiple distributed data set• Drive real-time personalization for operational efficiency
TECHNICAL BENEFITS• Data loading• Concurrency• Sub-second response• Distributed joins
Tables: Customer, Inventory and Contracts
![Page 25: The Real-Time CDO and the Cloud-Forward Path to Predictive Analytics](https://reader036.fdocuments.net/reader036/viewer/2022062823/58cea9c81a28abb26e8b6be3/html5/thumbnails/25.jpg)
DELLEMC REAL-TIME ARCHITECTURE
REAL-TIMEANALYTICS
![Page 26: The Real-Time CDO and the Cloud-Forward Path to Predictive Analytics](https://reader036.fdocuments.net/reader036/viewer/2022062823/58cea9c81a28abb26e8b6be3/html5/thumbnails/26.jpg)
SECURE DATA LAKE ARCHITECTURE
26 http://itblog.emc.com/2016/05/03/simplifying-lives-emc-myservice360/
![Page 27: The Real-Time CDO and the Cloud-Forward Path to Predictive Analytics](https://reader036.fdocuments.net/reader036/viewer/2022062823/58cea9c81a28abb26e8b6be3/html5/thumbnails/27.jpg)
27
The global leader in Content Delivery Network services, has deployed MemSQL to enhance billing speed and efficiency for thousands of customers around the world
+
![Page 28: The Real-Time CDO and the Cloud-Forward Path to Predictive Analytics](https://reader036.fdocuments.net/reader036/viewer/2022062823/58cea9c81a28abb26e8b6be3/html5/thumbnails/28.jpg)
28
BUSINESS BENEFITS▪Analyze Historical Against Live Data▪30% Increased Forecast Accuracy▪Tighter Financial Reporting to Street
TECHNICAL BENEFITS▪Analyze Millions of rows / second▪Massive Concurrency▪8 Million UPSERTS per second▪Process 1PB Data Per Day
![Page 29: The Real-Time CDO and the Cloud-Forward Path to Predictive Analytics](https://reader036.fdocuments.net/reader036/viewer/2022062823/58cea9c81a28abb26e8b6be3/html5/thumbnails/29.jpg)
THE AKAMAI REAL-TIME ARCHITECTURE
29
REAL-TIMEANALYTICS
Customer traffic
statistics
![Page 30: The Real-Time CDO and the Cloud-Forward Path to Predictive Analytics](https://reader036.fdocuments.net/reader036/viewer/2022062823/58cea9c81a28abb26e8b6be3/html5/thumbnails/30.jpg)
Demonstration
![Page 31: The Real-Time CDO and the Cloud-Forward Path to Predictive Analytics](https://reader036.fdocuments.net/reader036/viewer/2022062823/58cea9c81a28abb26e8b6be3/html5/thumbnails/31.jpg)
The Path to Real-Time Analytics
Real-Time Data Predictive AnalyticsHistorical Data
![Page 32: The Real-Time CDO and the Cloud-Forward Path to Predictive Analytics](https://reader036.fdocuments.net/reader036/viewer/2022062823/58cea9c81a28abb26e8b6be3/html5/thumbnails/32.jpg)
MemSQL Springs and Golf Resorts
![Page 33: The Real-Time CDO and the Cloud-Forward Path to Predictive Analytics](https://reader036.fdocuments.net/reader036/viewer/2022062823/58cea9c81a28abb26e8b6be3/html5/thumbnails/33.jpg)
Demo Details1.Showcase fast queries on historical data with Tableau2. Incorporate real-time data with MemSQL Pipelines
and exactly-once ingest from Kafka3.Add predictive analytics with Sentiment Analysis
Historical Data
CREATE PIPELINE
Real-TimeData
Sentiment Analysis
![Page 34: The Real-Time CDO and the Cloud-Forward Path to Predictive Analytics](https://reader036.fdocuments.net/reader036/viewer/2022062823/58cea9c81a28abb26e8b6be3/html5/thumbnails/34.jpg)
![Page 35: The Real-Time CDO and the Cloud-Forward Path to Predictive Analytics](https://reader036.fdocuments.net/reader036/viewer/2022062823/58cea9c81a28abb26e8b6be3/html5/thumbnails/35.jpg)
CDO Strategiesfor Hybrid Cloud
![Page 36: The Real-Time CDO and the Cloud-Forward Path to Predictive Analytics](https://reader036.fdocuments.net/reader036/viewer/2022062823/58cea9c81a28abb26e8b6be3/html5/thumbnails/36.jpg)
Gartner Hybrid DBMS Cloud Scenarios
36
Dev Test
Disasterrecovery
Architecture Spanning Use Case Specific Multicloud
Prod
Source: Gartner (April 2016)
![Page 37: The Real-Time CDO and the Cloud-Forward Path to Predictive Analytics](https://reader036.fdocuments.net/reader036/viewer/2022062823/58cea9c81a28abb26e8b6be3/html5/thumbnails/37.jpg)
A Comprehensive Hybrid Cloud Approach▪On-Premises deployments
•Any hardware, NUMA optimizations, vectorized processing•Any Linux, VMs, Containers•Robust security including Role-based Access Control (RBAC)•Perfect for retiring legacy appliances
▪Any Cloud•Any cloud service IaaS•Simple `replicate database`•Also available as a MemSQL Managed Service
![Page 38: The Real-Time CDO and the Cloud-Forward Path to Predictive Analytics](https://reader036.fdocuments.net/reader036/viewer/2022062823/58cea9c81a28abb26e8b6be3/html5/thumbnails/38.jpg)
Strategic Approach to Global Analytics▪ Develop a center of excellence for real-time
infrastructure• Include both real-time AND historical data
▪Identify complements and replacements for traditional technologies
• Data warehouse appliances, rigid systems
▪Choose a straightforward path• Faster historical insights, real-time data, predictive analytics
![Page 39: The Real-Time CDO and the Cloud-Forward Path to Predictive Analytics](https://reader036.fdocuments.net/reader036/viewer/2022062823/58cea9c81a28abb26e8b6be3/html5/thumbnails/39.jpg)
Please visit at the MemSQL booth
![Page 40: The Real-Time CDO and the Cloud-Forward Path to Predictive Analytics](https://reader036.fdocuments.net/reader036/viewer/2022062823/58cea9c81a28abb26e8b6be3/html5/thumbnails/40.jpg)
Q&A
![Page 41: The Real-Time CDO and the Cloud-Forward Path to Predictive Analytics](https://reader036.fdocuments.net/reader036/viewer/2022062823/58cea9c81a28abb26e8b6be3/html5/thumbnails/41.jpg)
www.memsql.com
Thank You