IT AIN’T WHAT YOU DO TO DATA… IT’S WHAT YOU DO WITH IT Edd Dumbill @edd [email protected]...

33
IT AIN’T WHAT YOU DO TO DATA… IT’S WHAT YOU DO WITH IT Edd Dumbill • @edd [email protected]svds.com/StrataUK2015

Transcript of IT AIN’T WHAT YOU DO TO DATA… IT’S WHAT YOU DO WITH IT Edd Dumbill @edd [email protected]...

Page 1: IT AIN’T WHAT YOU DO TO DATA… IT’S WHAT YOU DO WITH IT Edd Dumbill @edd edd@svds.com svds.com/StrataUK2015.

IT AIN’T WHAT YOU DO TO DATA… IT’S WHAT YOU DO WITH IT

Edd Dumbill • @edd

 [email protected] • svds.com/StrataUK2015

Page 2: IT AIN’T WHAT YOU DO TO DATA… IT’S WHAT YOU DO WITH IT Edd Dumbill @edd edd@svds.com svds.com/StrataUK2015.

2 © 2014 SILICON VALLEY DATA SCIENCE LLC. ALL RIGHTS RESERVED.

Edd DumbillVP Strategy

Page 3: IT AIN’T WHAT YOU DO TO DATA… IT’S WHAT YOU DO WITH IT Edd Dumbill @edd edd@svds.com svds.com/StrataUK2015.

33 © 2014 SILICON VALLEY DATA SCIENCE LLC. ALL RIGHTS RESERVED.

• Prioritize for highest business value when using emerging technology

• Design with outcomes in mind

• Be agile: deliver initial results quickly, then adapt and iterate

• Collaborate constantly with our customers and partners

OUR PHILOSOPHY

Page 4: IT AIN’T WHAT YOU DO TO DATA… IT’S WHAT YOU DO WITH IT Edd Dumbill @edd edd@svds.com svds.com/StrataUK2015.

44 © 2014 SILICON VALLEY DATA SCIENCE LLC. ALL RIGHTS RESERVED.

• How we used to think about data

• Why big data is a big deal

• Data strategy

• New platforms have new characteristics

• Data value chain

• Building for experiments

OVERVIEW

Page 5: IT AIN’T WHAT YOU DO TO DATA… IT’S WHAT YOU DO WITH IT Edd Dumbill @edd edd@svds.com svds.com/StrataUK2015.

5

“Data strategy is not for the faint of heart”

1 Creating an Enterprise Data Strategy; Wayne Eckerson - http://www.slideshare.net/Dataversity/creating-an-enterprise-data-strategy

Page 6: IT AIN’T WHAT YOU DO TO DATA… IT’S WHAT YOU DO WITH IT Edd Dumbill @edd edd@svds.com svds.com/StrataUK2015.

6 © 2015 SILICON VALLEY DATA SCIENCE LLC. ALL RIGHTS RESERVED.

IS THERE AN ALTERNATIVE?

In today’s competitive environment, data must serve the strategic imperatives of a business—the key aspirations that define the future vision for an organization.

A modern data strategy is a roadmap to enable data-driven decision-making and applications that helps an enterprise achieve its strategic imperatives.

An effective data strategy helps an enterprise make technology choices, grounded in business priorities, to get the most value from their data.

Page 7: IT AIN’T WHAT YOU DO TO DATA… IT’S WHAT YOU DO WITH IT Edd Dumbill @edd edd@svds.com svds.com/StrataUK2015.

7 © 2015 SILICON VALLEY DATA SCIENCE LLC. ALL RIGHTS RESERVED.

CONNECTING TECHNOLOGY AND BUSINESS VALUEIf you find that you can’t articulate how the cost of your data systems relates to the benefits to your business, or if you can’t articulate how your technology philosophy enables your business aspirations, then your organization would almost certainly benefit from data strategy.

Page 8: IT AIN’T WHAT YOU DO TO DATA… IT’S WHAT YOU DO WITH IT Edd Dumbill @edd edd@svds.com svds.com/StrataUK2015.

8 © 2014 SILICON VALLEY DATA SCIENCE LLC. ALL RIGHTS RESERVED.

POP QUIZ• Do you feel like the

technology leadership in your organization prioritizes investments to meet the ambitions of the business?

• Can your organization clearly articulate the business impact of the data and technology investments it makes?

ARTICULATING THE BUSINESS IMPACT OF DATA & TECHNOLOGY

Page 9: IT AIN’T WHAT YOU DO TO DATA… IT’S WHAT YOU DO WITH IT Edd Dumbill @edd edd@svds.com svds.com/StrataUK2015.

9 © 2014 SILICON VALLEY DATA SCIENCE LLC. ALL RIGHTS RESERVED.

DIGITAL NERVOUS SYSTEM

Page 10: IT AIN’T WHAT YOU DO TO DATA… IT’S WHAT YOU DO WITH IT Edd Dumbill @edd edd@svds.com svds.com/StrataUK2015.

10 © 2014 SILICON VALLEY DATA SCIENCE LLC. ALL RIGHTS RESERVED.

SILICON VALLEY’S DATA MACHINE

Page 11: IT AIN’T WHAT YOU DO TO DATA… IT’S WHAT YOU DO WITH IT Edd Dumbill @edd edd@svds.com svds.com/StrataUK2015.

11

It’s time to redefine what “data strategy” means

Page 12: IT AIN’T WHAT YOU DO TO DATA… IT’S WHAT YOU DO WITH IT Edd Dumbill @edd edd@svds.com svds.com/StrataUK2015.

12 © 2014 SILICON VALLEY DATA SCIENCE LLC. ALL RIGHTS RESERVED.

CLEAN VALIDATE CONTROL PROTECT

CONVENTIONAL DATA STRATEGY“WHAT YOU DO TO DATA”

Page 13: IT AIN’T WHAT YOU DO TO DATA… IT’S WHAT YOU DO WITH IT Edd Dumbill @edd edd@svds.com svds.com/StrataUK2015.

13 © 2015 SILICON VALLEY DATA SCIENCE LLC. ALL RIGHTS RESERVED.

Conventional Wisdom: 10 THINGS A DATA STRATEGY SHOULD INCLUDE2

1. What data should be collected?

2. How long should data be kept?

3. Where should the data be stored?

4. How will data privacy and security be managed?

5. From where can data be accessed?

6. What data can be displayed?

7. What level of detail should be retained?

8. Who is responsible for the data (governance)?

9. How is data integrated?

10. How will data be distributed? (virtualization?)

2 10 Key Elements of your Data Strategy; Mike Schiff – http://www.tdwi.org/Articles/2012/01/17/10-Elements-Data-Strategy.aspx?Page=1

Page 14: IT AIN’T WHAT YOU DO TO DATA… IT’S WHAT YOU DO WITH IT Edd Dumbill @edd edd@svds.com svds.com/StrataUK2015.

14 © 2014 SILICON VALLEY DATA SCIENCE LLC. ALL RIGHTS RESERVED.

MODERN DATA STRATEGY“WHAT YOU DO WITH DATA”

TARGET VIP CUSTOMERS ATTRACT NEW CUSTOMERS

AUTOMATE

Page 15: IT AIN’T WHAT YOU DO TO DATA… IT’S WHAT YOU DO WITH IT Edd Dumbill @edd edd@svds.com svds.com/StrataUK2015.

15 © 2015 SILICON VALLEY DATA SCIENCE LLC. ALL RIGHTS RESERVED.

1. How does data generate value?

2. What are our critical data assets?

3. What is our data ecosystem?

4. How do we govern data?

NEW ORTHODOXY

3 The 4 Principles of a Successful Data Strategy; Paul Barth - http://www.cioupdate.com/insights/article.php/11049_3936706_2/The-4-Principles-of-a-Successful-Data-Strategy.htm

4 PRINCIPLES OF A SUCCESSFUL DATA STRATEGY3

Page 16: IT AIN’T WHAT YOU DO TO DATA… IT’S WHAT YOU DO WITH IT Edd Dumbill @edd edd@svds.com svds.com/StrataUK2015.

16 © 2015 SILICON VALLEY DATA SCIENCE LLC. ALL RIGHTS RESERVED.

BEGIN WITH THE BUSINESS• First understand what drives your business

• Then make the leap from strategy to tactics

• @Technologists: This can’t be done without the business people in the room

• @BusinessLeaders: This can’t be done without the technologists in the room

Page 17: IT AIN’T WHAT YOU DO TO DATA… IT’S WHAT YOU DO WITH IT Edd Dumbill @edd edd@svds.com svds.com/StrataUK2015.

17

We have different aims, and different capabilities

Page 18: IT AIN’T WHAT YOU DO TO DATA… IT’S WHAT YOU DO WITH IT Edd Dumbill @edd edd@svds.com svds.com/StrataUK2015.

18 © 2014 SILICON VALLEY DATA SCIENCE LLC. ALL RIGHTS RESERVED.

Page 19: IT AIN’T WHAT YOU DO TO DATA… IT’S WHAT YOU DO WITH IT Edd Dumbill @edd edd@svds.com svds.com/StrataUK2015.

19 © 2014 SILICON VALLEY DATA SCIENCE LLC. ALL RIGHTS RESERVED.

UP vs OUT

Different use cases put different demands on the data infrastructure.

Increasing cost per unit of capability from scale-up architectures causes rationing of resources. Only the most valuable use cases are pursued.

US D

olla

rs

Data Resource Usage

Scale-up cost

Scale-out cost

UC1

UC2

UC3

UC4

UC5

Page 20: IT AIN’T WHAT YOU DO TO DATA… IT’S WHAT YOU DO WITH IT Edd Dumbill @edd edd@svds.com svds.com/StrataUK2015.

20 © 2014 SILICON VALLEY DATA SCIENCE LLC. ALL RIGHTS RESERVED.

DELAYING DECISIONS…

• The Art of Abstractionsvds.com/abstraction

• Schema on read

Page 21: IT AIN’T WHAT YOU DO TO DATA… IT’S WHAT YOU DO WITH IT Edd Dumbill @edd edd@svds.com svds.com/StrataUK2015.

21 © 2014 SILICON VALLEY DATA SCIENCE LLC. ALL RIGHTS RESERVED.

A scalable, accessible repository of data

(in its natural or processed state)

THE DATA LAKE

Page 22: IT AIN’T WHAT YOU DO TO DATA… IT’S WHAT YOU DO WITH IT Edd Dumbill @edd edd@svds.com svds.com/StrataUK2015.

22 © 2014 SILICON VALLEY DATA SCIENCE LLC. ALL RIGHTS RESERVED.

THE DATA VALUE CHAINDRAW VALUE FROM YOUR STRATEGIC DATA ASSETS

Discover Ingest Process Persist Integrate Analyze Expose

Page 23: IT AIN’T WHAT YOU DO TO DATA… IT’S WHAT YOU DO WITH IT Edd Dumbill @edd edd@svds.com svds.com/StrataUK2015.

23

How do you think about building with data?

Page 24: IT AIN’T WHAT YOU DO TO DATA… IT’S WHAT YOU DO WITH IT Edd Dumbill @edd edd@svds.com svds.com/StrataUK2015.

24 © 2014 SILICON VALLEY DATA SCIENCE LLC. ALL RIGHTS RESERVED.

PROJECT ACTION PLAN & ROADMAP

OUR METHOD FOR DATA STRATEGY

IDENTIFY STRATEGIC IMPERATIVES

DEFINE BUSINESS OBJECTIVES

DEFINE DATA REQUIREMENTS

IDENTIFY GAPS IN CURRENT SYSTEMS & TECHNOLOGY

MAP OBJECTIVES AND REQUIREMENTS TO USE CASES

RATIONALIZE USE CASES INTO WORKLOADS

Page 25: IT AIN’T WHAT YOU DO TO DATA… IT’S WHAT YOU DO WITH IT Edd Dumbill @edd edd@svds.com svds.com/StrataUK2015.

25 © 2015 SILICON VALLEY DATA SCIENCE LLC. ALL RIGHTS RESERVED.

illustrative DATA CONSTRAINTS

Page 26: IT AIN’T WHAT YOU DO TO DATA… IT’S WHAT YOU DO WITH IT Edd Dumbill @edd edd@svds.com svds.com/StrataUK2015.

26 © 2015 SILICON VALLEY DATA SCIENCE LLC. ALL RIGHTS RESERVED.

illustrative Development Horizons

Page 27: IT AIN’T WHAT YOU DO TO DATA… IT’S WHAT YOU DO WITH IT Edd Dumbill @edd edd@svds.com svds.com/StrataUK2015.

© 2014 SILICON VALLEY DATA SCIENCE LLC. ALL RIGHTS RESERVED.27

DATA STRATEGY AND THE CDO

Julie Steele & Scott Kurth

• Thursday 13:45Blenheim Room

Page 28: IT AIN’T WHAT YOU DO TO DATA… IT’S WHAT YOU DO WITH IT Edd Dumbill @edd edd@svds.com svds.com/StrataUK2015.

28 © 2014 SILICON VALLEY DATA SCIENCE LLC. ALL RIGHTS RESERVED.

CDO Report

svds.com/cdoreport

Page 29: IT AIN’T WHAT YOU DO TO DATA… IT’S WHAT YOU DO WITH IT Edd Dumbill @edd edd@svds.com svds.com/StrataUK2015.

29

We need a different organizational mindset

Page 30: IT AIN’T WHAT YOU DO TO DATA… IT’S WHAT YOU DO WITH IT Edd Dumbill @edd edd@svds.com svds.com/StrataUK2015.

3030 © 2014 SILICON VALLEY DATA SCIENCE LLC. ALL RIGHTS RESERVED.

• Make it cheap

• Failure as a feature

• Ask good questions

• Make it quick

• Both learning and adaptation

• Enable the feedback loop

• Don’t break things

• Make operations a platform for innovation

• APIs, platforms, simulation

BUILD FOR EXPERIMENTS

Page 31: IT AIN’T WHAT YOU DO TO DATA… IT’S WHAT YOU DO WITH IT Edd Dumbill @edd edd@svds.com svds.com/StrataUK2015.

31 © 2014 SILICON VALLEY DATA SCIENCE LLC. ALL RIGHTS RESERVED.

THE EXPERIMENTAL ENTERPRISE

We need to both support investigative work and build a solid layer for

production.

Data science allows us to observe our experiments and respond to the

changing environment.

The foundation of the experimental enterprise focuses on making

infrastructure readily accessible.

Page 32: IT AIN’T WHAT YOU DO TO DATA… IT’S WHAT YOU DO WITH IT Edd Dumbill @edd edd@svds.com svds.com/StrataUK2015.

32 © 2014 SILICON VALLEY DATA SCIENCE LLC. ALL RIGHTS RESERVED.

BECOME DATA NATIVE• Can only win with situational awareness

• New architectures offer new opportunities

• Creation of data-driven value requires new approach

• Business must lead, and understand the potential of the technology

Page 33: IT AIN’T WHAT YOU DO TO DATA… IT’S WHAT YOU DO WITH IT Edd Dumbill @edd edd@svds.com svds.com/StrataUK2015.

33

Edd Dumbill

[email protected]

@edd

@SVDataScienceYes, we’re hiring!

[email protected]

Want these slides? Go to:

svds.com/StrataUK2015