Future of Data - Big Data
-
Upload
shankarradhakrishnan -
Category
Technology
-
view
2.837 -
download
0
Transcript of Future of Data - Big Data
Future of Data : Future of Data : Big Big DataData
Shankar RadhakrishnanCognizant
TopicsTopics
How did we get here ? Data Explosion Big Data Big Data in an Enterprise Big Data Platform - Hadoop Big Data Adoption Q & A
How did we get here?How did we get here?Familiar World
EDW Datamarts Familiar Problems
New World Newer type of data to integrate Increase in volume Newer analytical requirements
Data warehouse
Data warehouse
Data Integration ProblemsData Integration Problems
Data Processing ProblemsData Processing Problems
Storage ManagementStorage Management
Performance ProblemsPerformance Problems
Limitations out of ComplexityLimitations out of Complexity
Data ExplosionData Explosion
Newer InterestsNewer Interests Social Intelligence
DBIM, Sentiment Analysis, Social Customer Care
Predictive Analytics
Propensity, Price Elasticity, Anti-Fraud Analytics
Segmentation Insights
Funnel Analysis, Behavioral Patterns, Cohort Analysis
Mobile Analytics
Ad-Targeting, Geo-spatial Analytics
CategoriesCategories Structured Data
Enterprise Data (CRM, ERP, Data Stores, Reference Data)
Semi-structured Data
Machine Generated Data (Sensor Data, RFIDs)
Unstructured Data
Social Data (Comments, Tweets), Blog posts
Big DataBig Data
“Big Data” refers to high volume, velocity, variety and complex information assets that demand cost-effective, innovative forms of information processing for enhanced insightand decision making
Big Data PlatformsBig Data Platforms• Data Integration
o Informatica, Infosphereo talenD, Pentaho, Karmasphere, Apache Sqoop, Apache Flume
• Database Frameworko Hadoop (Distributions: Cloudera, Hortonworks, MapR)o Hbaseo Hive
• NoSQL Databaseso MongoDB, CouchDB
• Machine Data Processingo Splunk, Mahout
• Text Analyticso Clarabridge, Lexanalytics
Big Data in an Big Data in an EnterpriseEnterprise
Data warehouse
Data warehouse
Data Source
s
Data Source
sETLETL
Big Data
Sources
Big Data
Sources
ETLETL Big Data PlatformBig Data Platform
ETLETLDatamartsDatamarts
DatamartsDatamarts
DatamartsDatamarts
Analytical Application
s
Analytical Application
s
Hadoop - EcosystemHadoop - Ecosystem
Big Data : Adoption Big Data : Adoption DriversDrivers
Big Data – Adoption Big Data – Adoption ScenariosScenarios
Replatforming to Big Data (Hadoop, MapR) Archival Solution (Hadoop) Offloading Data warehouse, EDW (Hadoop, Hive) Social Media Integration Machine Data Analysis (Splunk, Mahout) Complex Analytical Requirements (Hbase)
Q & A