Turning Big Data Insights into Action through Advanced Analytics
Big Data:Turning Data Into Insights
description
Transcript of Big Data:Turning Data Into Insights
1 #SmarterBiz
Th
e Deal
Turning Data Into Insights…
and Insights Into Revenue
About
Andrew ManbyDirector, Marketing Big Data & Analytics, IBM Software
2 #SmarterBiz
The Cost of Curiosity Has Been Lowered
2
“IBM gave us an opportunity to turn our plans into something that was very tangible right from the beginning. IBM had experts within data mining, Big Data, and Apache Hadoop and it was clear to use from the beginning we wanted to improve our business, not only today, but also prepare for the challenges we will face in three to five years, we had to go with IBM.” – Lars Christian Christensen VP Plant Siting & Forecasting
3 #SmarterBiz
Paradigm Shifts Enabled by Big DataLeverage more of the data being captured
Traditional Approach Big Data Approach
Analyze small subsets of data
Analyze all data
Analyzedinformation
All available information
All available informationanalyzed
4 #SmarterBiz
Paradigm Shifts Enabled by Big DataReduce effort required to leverage data
TRADITIONAL APPROACH BIG DATA APPROACH
Govern Data to the Highest Standard, Store it, then use it for multiple purposes
Understand data and usage, govern to the appropriate level,
use it, and iterate
RepositoryGovern to
PerfectionUseData
Data Understand
Govern Appropriately
Use
5 #SmarterBiz
Paradigm Shifts Enabled By Big DataData leads the way—and sometimes correlations are good enough
Start with hypothesis and test against selected data
Explore all data andidentify correlations
Hypothesis Question
DataAnswer
Exploration
CorrelationInsight
Traditional Approach Big Data Approach
Data
6 #SmarterBiz
Paradigm Shifts Enabled By Big DataLeverage data as it is captured
Analyze data after it’s been processed and landed in a
warehouse or mart
Analyze data in motion as it’s generated, in real-
time
Data
Insight
AnalysisRepositor
y InsightAnalysisData
Traditional Approach Big Data Approach
7 #SmarterBiz
Big Data ExplorationFind, visualize, and understand all big data for improved decision making
Enhanced 360o Viewof the CustomerView all internal and external information sources to know everything about your customers
Operations AnalysisAnalyze a variety of machine data for improved business results
Data Warehouse ModernizationModernize the data warehouse with new technology: in-memory, stream computing, Hadoop, appliances, while building confidence in all data
Security Intelligence ExtensionLower risk, detect fraud and monitor cyber security in real-time
Key Uses for Big Data
8 #SmarterBiz
Integrate and Govern all Data Sources
Integration, Data Quality, Security, ILM, MDM
A Big Data and Analytics Platform Manifesto
Manage Streaming Data Stream Computing
Understand and Navigate Federated Big Data Sources
Discovery and NavigationPlanning/Forecasting
Manage and Store Huge Volume of any Data
Hadoop File SystemMapReduce
Content Management
Analyze Unstructured Data Text Analytics EngineContent Analytics
In-Memory AnalyticsData Warehousing
Structure and Control Data
IBM WATSON
FOUNDATIONS
© 2013 IBM Corporation9
• Depart faster – finish slower• Backtracking• Higher cost• End up somewhere else
• Direct• Faster • Cheaper
Because you had a plan
InfoSphere Guardium
InfoSphere Optim
10 #SmarterBiz
Complete Integration of Data Privacy and Security
De-indentify sensitive data on
demand
Deploy centralized controls for real-time monitoring
Encrypt data with negligible
performance impact
Remove sensitive data from
documents
Automate detection of
sensitive data
Mask with pre-build functions or customize
Mask consistently across systems
Policy-based controls to detect unauthorized activity
Vulnerability assessment & change auditing
Encrypt files and structured data
Unify policy and key management for central administration
Increase efficiency via automation and reduce cost of manual redaction
Control the data viewed by each user
Classify sensitive data types
Discovery hidden data relationships
Optim Discovery & Guardium
Optim Data Masking & Data Privacy for Hadoop
Guardium Activity Monitoring
Guardium Data Encryption
Guardium Data Redaction
Discover & classify sensitive data
Mask structured & unstructured data
Monitor database & hadoop activity to assess
vulnerabilities
Encrypt structured and unstructured data
Redact data in documents & forms
© 2014 IBM Corporation
11
Multimedia
Data Warehouse
Web Logs
Social Data
Sensor data:images
RFID
Internal AppData
TransactionData
MainframeData
OLTP System Data
Traditional Sources
ERP Data
StructuredRepeatable
Linear
UnstructuredExploratory
Dynamic
Text Data:emails
Hadoop andStreams
NewSources
InfoSphere Information Server and MDM Server
What Differentiates IBM’s Hadoop Offering?
BigInsights(Blue Suit Hadoop)
Pure Open Source Code
+Optional Enterprise
Class Closed IP Extensions
IBM Support
+=
Analysis– Native SQL interface– Native R interface– Text analysis toolkit– Social analysis toolkit– Spreadsheet style analysis GUI
Development lifecycle– Cluster aware Eclipse plug-ins– App Store for Hadoop
Data Exploration– Indexing and faceted search– Search-based applications
Management– Enterprise file system
• Advanced replication• Multi-temp storage• POSIX controls
– Grid management• Mature resource manager• Multi-tenant workload support
Baked-in security– LDAP– Role-based authorization– Perimeter security with reverse-proxy
BigSQL
BigInsights is More than Hadoop
Full Application Platform
BigSheets
HA
GP
FS
-FP
O
Ad
ap
tiv
e M
R
SECURE
DataClick
Match
of recordsMillions
BigMatch
BigInsights is More than Hadoop
2 Click Data
Access
15
16 #SmarterBiz
Simplify: Turnkey Analytics
Integrate the server, storage and database into one optimized package
Move complex analytics into the database
Integrated, high performance analytics within the data warehouse ServerServer
StorageStorage
DatabaseDatabase
AnalyticsAnalytics
001101010010010010011010010101001110010100111100100010010001001000100010010101011001100011101001001001001110001001010010010110010010100110010010100100101010001001001100100101001001010100010010110001001010010010110010010100110010010100100101010001001001100100101001001010100010010
Opp
ortu
nity
Cos
t Sta
rts
Her
e
01100100101001001010100010010011001001010010010101000100101100010010100100101100100101001100100101001001010100010010011001001010010010101000100100110010010100100101010001001001100100101001001010100010010011001001010010010101000100101100010010100100101100100101001100100101001001010100010010011001001010010010101000100100110010010100100101010001001011000100101001001011001001010
AdaptiveAnalytics
Model
BootstrapEnrich
Data Ingest
IBM delivers a governable, consumable Big Data platform that’s steeped in
analytics for data in-motion and data at-rest.
19 #SmarterBiz
90%Increased
Transaction Capacity
90%Increased
Transaction Capacity
$1BSavings from accurately
predicting ice flows
$1BSavings from accurately
predicting ice flows
98%Decrease timeto analyze data
98%Cut in StorageRequirements
98%Cut in StorageRequirements
$1M Estimated Cash
Savings
$1M Estimated Cash
Savings
72%Reduction in
Fraudulent Claims
72%Reduction in
Fraudulent Claims 60XFaster Query Performance
The Opportunities from Big Data & Analytics are Infinite
40X Analysis
Performance Gain
40X Analysis
Performance Gain
© 2014 IBM Corporation20
Got Questions?
Stop by the Social Café
Visit: – IBM Big Data & Analytics – ibm.com/bigdata&analytics
– IBM Big Data Hub - ibmbigdatahub.com
Andrew ManbyDirector, Marketing Big Data & Analytics, IBM [email protected]@andrewmanby