Future of Data : Future of Data : Big Big DataData

Shankar RadhakrishnanCognizant

TopicsTopics

How did we get here ? Data Explosion Big Data Big Data in an Enterprise Big Data Platform - Hadoop Big Data Adoption Q & A

How did we get here?How did we get here?Familiar World

EDW Datamarts Familiar Problems

New World Newer type of data to integrate Increase in volume Newer analytical requirements

Data warehouse

Data warehouse

Data Integration ProblemsData Integration Problems

Data Processing ProblemsData Processing Problems

Storage ManagementStorage Management

Performance ProblemsPerformance Problems

Limitations out of ComplexityLimitations out of Complexity

Data ExplosionData Explosion

Newer InterestsNewer Interests Social Intelligence

DBIM, Sentiment Analysis, Social Customer Care

Predictive Analytics

Propensity, Price Elasticity, Anti-Fraud Analytics

Segmentation Insights

Funnel Analysis, Behavioral Patterns, Cohort Analysis

Mobile Analytics

Ad-Targeting, Geo-spatial Analytics

CategoriesCategories Structured Data

Enterprise Data (CRM, ERP, Data Stores, Reference Data)

Semi-structured Data

Machine Generated Data (Sensor Data, RFIDs)

Unstructured Data

Social Data (Comments, Tweets), Blog posts

Big DataBig Data

“Big Data” refers to high volume, velocity, variety and complex information assets that demand cost-effective, innovative forms of information processing for enhanced insightand decision making

Big Data PlatformsBig Data Platforms• Data Integration

o Informatica, Infosphereo talenD, Pentaho, Karmasphere, Apache Sqoop, Apache Flume

• Database Frameworko Hadoop (Distributions: Cloudera, Hortonworks, MapR)o Hbaseo Hive

• NoSQL Databaseso MongoDB, CouchDB

• Machine Data Processingo Splunk, Mahout

• Text Analyticso Clarabridge, Lexanalytics

Big Data in an Big Data in an EnterpriseEnterprise

Data warehouse

Data warehouse

Data Source

s

Data Source

sETLETL

Big Data

Sources

Big Data

Sources

ETLETL Big Data PlatformBig Data Platform

ETLETLDatamartsDatamarts

DatamartsDatamarts

DatamartsDatamarts

Analytical Application

s

Analytical Application

s

Hadoop - EcosystemHadoop - Ecosystem

Big Data : Adoption Big Data : Adoption DriversDrivers

Big Data – Adoption Big Data – Adoption ScenariosScenarios

Replatforming to Big Data (Hadoop, MapR) Archival Solution (Hadoop) Offloading Data warehouse, EDW (Hadoop, Hive) Social Media Integration Machine Data Analysis (Splunk, Mahout) Complex Analytical Requirements (Hbase)

Q & A