Matthew Johnston - Big Data Futures Outlook BCM

24
1 10/31/2013 Software Big Data overview & future considerations for the BCM Professional Matthew Johnston Managing Director, South Asia Dell | Software

description

BCM Conference 2013

Transcript of Matthew Johnston - Big Data Futures Outlook BCM

Page 1: Matthew Johnston - Big Data Futures Outlook BCM

1 10/31/2013 Software

Big Data overview & future

considerations for the BCM Professional

Matthew Johnston Managing Director, South Asia Dell | Software

Page 2: Matthew Johnston - Big Data Futures Outlook BCM

2 10/31/2013 Software

Agenda

Big Data defined

Big Data use cases BCM + Big Data Why Dell Software?

Page 3: Matthew Johnston - Big Data Futures Outlook BCM

3 10/31/2013 Software

Big Data defined

Page 4: Matthew Johnston - Big Data Futures Outlook BCM

4 10/31/2013 Software

increase every five years

from new data types

connected devices per adult

use social media

10X

85%

4.3

By 2015, organizations that build a modern information management system will outperform their peers financially by 20 percent. Gartner, “Information Management in the 21st Century“

27%

The world of data is changing

Page 5: Matthew Johnston - Big Data Futures Outlook BCM

5 10/31/2013 Software

Data is created and consumed at a rapid pace…

$600 billion dollars in waste annually for bad data or poor quality data.

70% of data is created by consumers. But enterprises are responsible for storing and managing 80% of it.

1.8 Zettabytes of business data in use in 2011, up 30% from 2010.

$232 billion dollars will be spent on Big Data through 2016

4.4 million IT jobs globally will be created to support big data. Only 1/3 will be filled.

37.5% of large organizations said that analyzing big data is their biggest challenge.

247 billion emails are sent every day. 80% are spam.

48 hours of video are uploaded to YouTube every minute, resulting in 8 yeas of content daily.

200 million photos are uploaded to Facebook every day. That’s 6 billion pictures every month.

Page 6: Matthew Johnston - Big Data Futures Outlook BCM

6 10/31/2013 Software

…generating new sets of questions

6

Why is our product more popular with teenagers?

How will my social media campaign impact my product launch?

How do I capture, analyze, and manage all of this data?

Will monsoons impact my sales in Indonesia and parts availability from my suppliers next quarter?

How do I make the connections?

How do I turn this data into operational intelligence?

Advanced Analytics Social and Web Analytics Live Data Feeds

Page 7: Matthew Johnston - Big Data Futures Outlook BCM

7 10/31/2013 Software

What is Big Data?

capture

manage

analyze

Results in datasets too large or complex for typical database or data management tools to…

7

Volume A large amount of data, growing at rapid rates

Information of increasing…

Velocity Data that must be processed at high speed to facilitate

rapid decisions

Variety Wide range of data types and structure

Page 8: Matthew Johnston - Big Data Futures Outlook BCM

8 10/31/2013 Software

Big Data versus traditional database

1. Reads are fast 2. Standards and governance

1. Loads are fast 2. Flexibility and agility

Pros

Traditional Database “Schema-on-Write”

Big Data (Hadoop) “Schema-on-Read”

• Schema must be created before any data can be loaded

• An explicit load operation has to take place in order to transform data to the DB internal structure

• New columns must be added explicitly before new data for those columns can be loaded into the database

• Data is simply copied to the file store (HDFS), no transformation is needed

• As data is being read into HDFS, the required columns are extracted during the process

• New data can start flowing at any time since the schema is created as part of the process

Page 9: Matthew Johnston - Big Data Futures Outlook BCM

9 10/31/2013 Software

HPC Enabling exascale computing on massive data sets

Cloud Helping enterprises build open interoperable clouds

Open Source Contributing code and fostering ecosystem

Forces driving Big Data advancement

9

Page 10: Matthew Johnston - Big Data Futures Outlook BCM

10 10/31/2013 Software

Think Big Data when…

Relevant data exists across multiple data sources and various formats

Streams of data are being generated, but capturing, storing and processing presents challenges

Cost to scale is prohibitively high

Large volumes of useful archived data resides on tapes (unrecoverable after a certain period of time)

Most of the data needs to be analyzed rather than just a small subset of the data

Impossible / impractical to perform data analysis with existing technology stack

Page 11: Matthew Johnston - Big Data Futures Outlook BCM

11 10/31/2013 Software

Big Data use cases

Page 12: Matthew Johnston - Big Data Futures Outlook BCM

12 10/31/2013 Software

Big Data in action: Mobile subscriber QoS

Replicate thin to save • Measure, compare and understand what factors influence the number of people visiting a location at any time

• Use analysis to improve subscriber quality of service

Page 13: Matthew Johnston - Big Data Futures Outlook BCM

13 10/31/2013 Software

Big Data in action: IP TV subscriber recommendation engine

13

• Collect subscriber clickstreams and viewing history

• Add subscriber metadata from web-based movie database

• Provide viewing recommendations to subscribers

Clickstreams

EPG

VoD

Page 14: Matthew Johnston - Big Data Futures Outlook BCM

14 10/31/2013 Software

Big Data in action: Financial services

Overcome increasingly cumbersome data volumes scaling into petabytes that hinder analysis Gain operational efficiency by moving jobs to technology designed to process multiple data types Empower business users to ask different questions to improve decision making

Page 15: Matthew Johnston - Big Data Futures Outlook BCM

15 10/31/2013 Software

BCM + Big Data Usage Trends

Page 16: Matthew Johnston - Big Data Futures Outlook BCM

16 10/31/2013 Software

What is BCM and why Big Data?

Business Continuity Management (BCM)

Big Data

Is a holistic management process which helps to assess, plan and strengthen the resilience of your value chain. Business Continuity National Focal Point - http://www.bcm.org.sg/

Enables the assessment & analysis of large disparate data sets.

Page 17: Matthew Johnston - Big Data Futures Outlook BCM

17 10/31/2013 Software

Use cases for Big Data (Hadoop)

Operational Data Processing (data pain points)

EDW Augmentation

ETL Offload Batch Processing Data Reservoir Log Processing

Customer 360 View

Content Optimization

Recommendation Engine

Network Analytics Fraud Detection

Predictive Analytics (bigger questions)

Page 18: Matthew Johnston - Big Data Futures Outlook BCM

18 10/31/2013 Software

Use cases relevant to BCM

Operational Data Processing (data pain points)

EDW Augmentation

ETL Offload Batch Processing Data Reservoir Log Processing

Customer 360 View

Content Optimization

Recommendation Engine

Network Analytics Fraud Detection

Predictive Analytics (bigger questions)

Page 19: Matthew Johnston - Big Data Futures Outlook BCM

19 10/31/2013 Software

Why Dell Software?

Page 20: Matthew Johnston - Big Data Futures Outlook BCM

20 10/31/2013 Software

Information Management

Database management

Application & data integration

Business intelligence and Big data analytics

Integrate data disparate data stores, cloud and on-prem

Discover trends and make informed decisions with

analysis based on all data

Manage data and databases across

structured and non-structured data

sources - cloud or on-premise

Page 21: Matthew Johnston - Big Data Futures Outlook BCM

21 10/31/2013 Software

Information Management

Database management

Application & data integration

Business intelligence and Big data analytics

One Vendor – Complete Tool Chain - All Data

Data location agnostic

Data type

agnostic

Vendor agnostic

Page 22: Matthew Johnston - Big Data Futures Outlook BCM

22 10/31/2013 Software

Data center & cloud management

Client management

Performance management

Virtualization & cloud mgmt

Windows server mgmt

Mobile device mgmt

Desktop virtualization

Application/data access

Secure remote access

Information management

Database management

Application & data integration

Business intelligence/analytics

Dell Software Solutions

Mobile workforce management

Identity & access management

Network security

Endpoint security

Email security

Security Data protection

Enterprise backup & recovery

Virtual protection

Application protection

Disaster recovery

Page 23: Matthew Johnston - Big Data Futures Outlook BCM

23 10/31/2013 Software

Summary

• BCM is about risk mitigation

• Big Data is about understanding data

• BCM + Big Data = Better understanding & analysis of the risk

Page 24: Matthew Johnston - Big Data Futures Outlook BCM

Thank you