Give me 1M · How to Measure anything in Cybersecurity Risk Douglas W. Hubbard & Richard Siersen....

41

Transcript of Give me 1M · How to Measure anything in Cybersecurity Risk Douglas W. Hubbard & Richard Siersen....

Page 1: Give me 1M · How to Measure anything in Cybersecurity Risk Douglas W. Hubbard & Richard Siersen. Measuring and Managing Information Risk Jack Freund & Jack Jones fairinstitute.org.
Page 2: Give me 1M · How to Measure anything in Cybersecurity Risk Douglas W. Hubbard & Richard Siersen. Measuring and Managing Information Risk Jack Freund & Jack Jones fairinstitute.org.
Page 3: Give me 1M · How to Measure anything in Cybersecurity Risk Douglas W. Hubbard & Richard Siersen. Measuring and Managing Information Risk Jack Freund & Jack Jones fairinstitute.org.

Give me$1M

Page 4: Give me 1M · How to Measure anything in Cybersecurity Risk Douglas W. Hubbard & Richard Siersen. Measuring and Managing Information Risk Jack Freund & Jack Jones fairinstitute.org.
Page 5: Give me 1M · How to Measure anything in Cybersecurity Risk Douglas W. Hubbard & Richard Siersen. Measuring and Managing Information Risk Jack Freund & Jack Jones fairinstitute.org.

Give me$1M

Page 6: Give me 1M · How to Measure anything in Cybersecurity Risk Douglas W. Hubbard & Richard Siersen. Measuring and Managing Information Risk Jack Freund & Jack Jones fairinstitute.org.

-$10M

-$3M

Page 7: Give me 1M · How to Measure anything in Cybersecurity Risk Douglas W. Hubbard & Richard Siersen. Measuring and Managing Information Risk Jack Freund & Jack Jones fairinstitute.org.

Quantifying RiskQCon SF 2019

Markus De Shon ([email protected])

Page 8: Give me 1M · How to Measure anything in Cybersecurity Risk Douglas W. Hubbard & Richard Siersen. Measuring and Managing Information Risk Jack Freund & Jack Jones fairinstitute.org.

How to Measure anything in Cybersecurity Risk

Douglas W. Hubbard & Richard Siersen

Page 9: Give me 1M · How to Measure anything in Cybersecurity Risk Douglas W. Hubbard & Richard Siersen. Measuring and Managing Information Risk Jack Freund & Jack Jones fairinstitute.org.

Measuring and Managing Information Risk

Jack Freund & Jack Jones

fairinstitute.org

Page 10: Give me 1M · How to Measure anything in Cybersecurity Risk Douglas W. Hubbard & Richard Siersen. Measuring and Managing Information Risk Jack Freund & Jack Jones fairinstitute.org.

Frequency⨉

Magnitude ($)(of Loss)

Page 11: Give me 1M · How to Measure anything in Cybersecurity Risk Douglas W. Hubbard & Richard Siersen. Measuring and Managing Information Risk Jack Freund & Jack Jones fairinstitute.org.

What is a loss?

Page 12: Give me 1M · How to Measure anything in Cybersecurity Risk Douglas W. Hubbard & Richard Siersen. Measuring and Managing Information Risk Jack Freund & Jack Jones fairinstitute.org.

First steps of a risk analysis● Assets● Architecture● Control architecture● Loss scenarios

Page 13: Give me 1M · How to Measure anything in Cybersecurity Risk Douglas W. Hubbard & Richard Siersen. Measuring and Managing Information Risk Jack Freund & Jack Jones fairinstitute.org.
Page 14: Give me 1M · How to Measure anything in Cybersecurity Risk Douglas W. Hubbard & Richard Siersen. Measuring and Managing Information Risk Jack Freund & Jack Jones fairinstitute.org.

Meet Sam the Sponge

Page 15: Give me 1M · How to Measure anything in Cybersecurity Risk Douglas W. Hubbard & Richard Siersen. Measuring and Managing Information Risk Jack Freund & Jack Jones fairinstitute.org.

His best friend Peter

Page 16: Give me 1M · How to Measure anything in Cybersecurity Risk Douglas W. Hubbard & Richard Siersen. Measuring and Managing Information Risk Jack Freund & Jack Jones fairinstitute.org.

His boss Mr. Prawn

Page 17: Give me 1M · How to Measure anything in Cybersecurity Risk Douglas W. Hubbard & Richard Siersen. Measuring and Managing Information Risk Jack Freund & Jack Jones fairinstitute.org.

The Prawn Patty

Page 18: Give me 1M · How to Measure anything in Cybersecurity Risk Douglas W. Hubbard & Richard Siersen. Measuring and Managing Information Risk Jack Freund & Jack Jones fairinstitute.org.

The secret recipe

Page 19: Give me 1M · How to Measure anything in Cybersecurity Risk Douglas W. Hubbard & Richard Siersen. Measuring and Managing Information Risk Jack Freund & Jack Jones fairinstitute.org.

Controls Architecture● Only one copy● Not memorized● Kept in safe● Trusted handlers

Page 20: Give me 1M · How to Measure anything in Cybersecurity Risk Douglas W. Hubbard & Richard Siersen. Measuring and Managing Information Risk Jack Freund & Jack Jones fairinstitute.org.

● Confidentiality○ Competitor○ Public

● Integrity○ crUD

● Availability○ Unavailable

Recipe loss scenarios

Page 21: Give me 1M · How to Measure anything in Cybersecurity Risk Douglas W. Hubbard & Richard Siersen. Measuring and Managing Information Risk Jack Freund & Jack Jones fairinstitute.org.
Page 22: Give me 1M · How to Measure anything in Cybersecurity Risk Douglas W. Hubbard & Richard Siersen. Measuring and Managing Information Risk Jack Freund & Jack Jones fairinstitute.org.

Threat

Page 23: Give me 1M · How to Measure anything in Cybersecurity Risk Douglas W. Hubbard & Richard Siersen. Measuring and Managing Information Risk Jack Freund & Jack Jones fairinstitute.org.

Hazard

Page 24: Give me 1M · How to Measure anything in Cybersecurity Risk Douglas W. Hubbard & Richard Siersen. Measuring and Managing Information Risk Jack Freund & Jack Jones fairinstitute.org.

Tardigrade

Page 25: Give me 1M · How to Measure anything in Cybersecurity Risk Douglas W. Hubbard & Richard Siersen. Measuring and Managing Information Risk Jack Freund & Jack Jones fairinstitute.org.
Page 26: Give me 1M · How to Measure anything in Cybersecurity Risk Douglas W. Hubbard & Richard Siersen. Measuring and Managing Information Risk Jack Freund & Jack Jones fairinstitute.org.

Estimate frequencySecurity Engineers

Range

0 ——— ∞

Page 27: Give me 1M · How to Measure anything in Cybersecurity Risk Douglas W. Hubbard & Richard Siersen. Measuring and Managing Information Risk Jack Freund & Jack Jones fairinstitute.org.

Calibration 0.1 0.01 0.001

Page 28: Give me 1M · How to Measure anything in Cybersecurity Risk Douglas W. Hubbard & Richard Siersen. Measuring and Managing Information Risk Jack Freund & Jack Jones fairinstitute.org.

Tardigrade steals recipe

0.01

Page 29: Give me 1M · How to Measure anything in Cybersecurity Risk Douglas W. Hubbard & Richard Siersen. Measuring and Managing Information Risk Jack Freund & Jack Jones fairinstitute.org.

steals recipe

0.1

Page 30: Give me 1M · How to Measure anything in Cybersecurity Risk Douglas W. Hubbard & Richard Siersen. Measuring and Managing Information Risk Jack Freund & Jack Jones fairinstitute.org.

Estimate magnitude

● Asset owner● Decompose● Low → High (90% CI)● US$

Page 31: Give me 1M · How to Measure anything in Cybersecurity Risk Douglas W. Hubbard & Richard Siersen. Measuring and Managing Information Risk Jack Freund & Jack Jones fairinstitute.org.

Model magnitude with lognormal

Low loss

90% CI

High loss

Page 32: Give me 1M · How to Measure anything in Cybersecurity Risk Douglas W. Hubbard & Richard Siersen. Measuring and Managing Information Risk Jack Freund & Jack Jones fairinstitute.org.
Page 33: Give me 1M · How to Measure anything in Cybersecurity Risk Douglas W. Hubbard & Richard Siersen. Measuring and Managing Information Risk Jack Freund & Jack Jones fairinstitute.org.

Why Money?● Composable (A+B)● Comparable (A>B) ● Interpretable by business

What about:● Priceless? → Implicit valuation● Intangible? → Inverse of ROI on

existing investments

Page 34: Give me 1M · How to Measure anything in Cybersecurity Risk Douglas W. Hubbard & Richard Siersen. Measuring and Managing Information Risk Jack Freund & Jack Jones fairinstitute.org.

● Recipe unavailable → sales stop (primary)○ 1 day @ $10K → $10K○ 100 days → $1M

● Knockoffs at Tardigrade’s. Lose customers (primary)○ 10 @ $100 → $1K○ 1,000 → $100K

● Total:○ Low: $11,000○ High: $1,100,000

Magnitude: Tardigrade

Expected Loss:$2,930

Page 35: Give me 1M · How to Measure anything in Cybersecurity Risk Douglas W. Hubbard & Richard Siersen. Measuring and Managing Information Risk Jack Freund & Jack Jones fairinstitute.org.

Magnitude: Patty PirateRecipe unavailable → lost sales (Primary loss)

○ 10 days @ $10K → $100K○ 100 days → $1M

No Prawn Patties anywhere → immediate collapse, fires. dystopia. (Secondary, external)

○ 10 days @ $1M → $10M○ 100 days → $100M

Totals:

○ Low: $10,100,000○ High: $101,000,000

Expected Loss:$4,080,000

Page 36: Give me 1M · How to Measure anything in Cybersecurity Risk Douglas W. Hubbard & Richard Siersen. Measuring and Managing Information Risk Jack Freund & Jack Jones fairinstitute.org.
Page 37: Give me 1M · How to Measure anything in Cybersecurity Risk Douglas W. Hubbard & Richard Siersen. Measuring and Managing Information Risk Jack Freund & Jack Jones fairinstitute.org.

Engineering a Safer World

Nancy G. Leveson

Page 38: Give me 1M · How to Measure anything in Cybersecurity Risk Douglas W. Hubbard & Richard Siersen. Measuring and Managing Information Risk Jack Freund & Jack Jones fairinstitute.org.

Controller and process

Page 39: Give me 1M · How to Measure anything in Cybersecurity Risk Douglas W. Hubbard & Richard Siersen. Measuring and Managing Information Risk Jack Freund & Jack Jones fairinstitute.org.

(Incomplete) Control architecture

Internal Application

SystemAdmin App

User

System Admin

Corporation

Government Customers

Directives &Culture

PurchaseDecisions

Laws &Regulations

Critical Data

Page 40: Give me 1M · How to Measure anything in Cybersecurity Risk Douglas W. Hubbard & Richard Siersen. Measuring and Managing Information Risk Jack Freund & Jack Jones fairinstitute.org.

Markus De [email protected]

● Identify Assets● Study Architecture● Define Control architecture● Identify loss scenarios● Estimate frequency● Estimate low/high magnitude● Calculate expected loss

Page 41: Give me 1M · How to Measure anything in Cybersecurity Risk Douglas W. Hubbard & Richard Siersen. Measuring and Managing Information Risk Jack Freund & Jack Jones fairinstitute.org.

import mathimport numpy as npfrom scipy.stats import lognorm, norm

def get_magnitude(lo, hi): # Calculate the mean mu in log space mu = (math.log(lo) + math.log(hi)) / 2. factor = -0.5 / norm.ppf(0.05) sigma = factor * (math.log(hi) - math.log(lo)) distribution = lognorm(sigma, scale=math.exp(mu)) return distribution

0.01 * get_magnitude(11000, 1100000).mean()