The Challenges of Big Data How Data Capable is your Business?

Christine Andrews – DQM Group

2

I’ll Cover

• What’s all the fuss about? • The challenges of Big Data • Who’s doing Big Data well• How can you tell how well you’re doing• How to make your organisation more “data capable”• Beware the EU

3

What exactly is Big Data?

4

IBM and Sas Definitions

Variability and Complexity

5

What can you do that you couldn’t do before?

• Recalculate entire risk portfolios• Mine customer data for new insights• Quickly (and I mean quickly) identify the customers

who matter most • Send tailored communication to mobile devices at

exactly the right time• Analyse data from new social media

6

Whole new set of challenges

7

Sas and Economist Survey

Aware of power of data but not exploiting data collected

Need for defined data strategy

Talent matters as much as the technology

Growth in web tracking and Social media data

8

Big Data in Action

9

You don’t know what you don’t know

10

The Data Maturity Curve

AwareHave issues but doing little about them

ReactiveCan fix some issues as they arise but can’t fix/identify root cause.

ProactiveCan address root cause and stop issues before they occur. Conducts ongoing monitoring.

ManagedHas a mature set of practices. Identifies and fixes issues but also defines strategy in a manner focussed on information development.

Optimal

Centre of excellence. Information development is a core competency across strategy, people, process, organisation & technology

Based on the MIKE2.0 Methodology

1

2

3

4

5

11

How to Measure

12

People, Process, Policy, Technology, Measurement, Compliance

Output

13

Technology – Example

Data Analysis Extent to which data analysis technologies are appropriately deployed

Data Quality Metrics Considers the inclusion of automated data quality metrics

14

People

AuditsBenchmarking

Common Data Services

Communication Plan

Dashboard (Tracking / Trending)

Data Analysis

Data Capture

Data Ownership

Data Quality MetricsData Quality Strategy

Data Standardisation

Data Validation

Executive Sponsorship

Functional Requirements

Master Data Management

Privacy

Security

0.0

5.0

15

Map your data flows and touch points

Data Assets

Source Systems/

Data

Customer Data

Integration

Enterprise Application

s

Surveys & Competiti

ons

Email

Analytics

SaaS

Staff

Consultants

Branches

Backup

Call Centres

Point of Sale

Online Collection

Telephone Collection

Warranty Cards

3rd Party Data

Printers & Mailing Houses

Data Bureaux

Marketing Agencies

Customers Others?

16

Data Strategyand

compliance

Data Team

Solving data quality at source

3rd Parties

Roadmap

17

18

Impact of EU Legislation

19

20

Compliance

Audits

Metadata Management

Data Quality Metrics

Data Analysis

Security

Issue Identification

Service Level Agreements

Data Subject Area Coverage

0.0

5.0

21

Summary

• Big Data offers significant opportunities but presents challenges

• Think carefully about your current data capabilities before embarking on new ones

• Consider the people you need and the processes you follow as well as the IT

• Don’t forget compliance and any future EU legislation

22

Thanks for Listening

Christine.andrews@dqmgroup.com

Register free for DataIQ

www.dqmgroup.com/dataiq