Continuous-time multi-state models for cost …...Continuous-time multi-state models for cost-e...

27
Continuous-time multi-state models for cost-effectiveness analysis in health economics Chris Jackson MRC Biostatistics Unit University of Cambridge, U.K. R in CEA Workshop, UCL, July 2018 Chris Jackson Continuous-time multi-state models 1/ 15

Transcript of Continuous-time multi-state models for cost …...Continuous-time multi-state models for cost-e...

Page 1: Continuous-time multi-state models for cost …...Continuous-time multi-state models for cost-e ectiveness analysis in health economics Chris Jackson MRC Biostatistics Unit University

Continuous-time multi-state modelsfor cost-effectiveness analysis in health economics

Chris JacksonMRC Biostatistics Unit

University of Cambridge, U.K.

R in CEA Workshop, UCL, July 2018

Chris Jackson Continuous-time multi-state models 1/ 15

Page 2: Continuous-time multi-state models for cost …...Continuous-time multi-state models for cost-e ectiveness analysis in health economics Chris Jackson MRC Biostatistics Unit University

“Modelling”: two cultures

Statistical modellingI Start with a dataset

I Fit models to the dataExpertise:

I learning from data,expressing uncertainty /variation quantitatively

Health economic modelling

I Start with model of thedisease/intervention

I “Populate” it with data

Expertise:

I economic, clinical,epidemiological

obtain relevant data, answer relevant questionrepresent quantitative evidence faithfullyinform decision making

R facilitates better statistical models

Chris Jackson Continuous-time multi-state models 2/ 15

Page 3: Continuous-time multi-state models for cost …...Continuous-time multi-state models for cost-e ectiveness analysis in health economics Chris Jackson MRC Biostatistics Unit University

“Modelling”: two cultures

Statistical modellingI Start with a dataset

I Fit models to the dataExpertise:

I learning from data,expressing uncertainty /variation quantitatively

Health economic modelling

I Start with model of thedisease/intervention

I “Populate” it with data

Expertise:

I economic, clinical,epidemiological

obtain relevant data, answer relevant questionrepresent quantitative evidence faithfullyinform decision making

R facilitates better statistical models

Chris Jackson Continuous-time multi-state models 2/ 15

Page 4: Continuous-time multi-state models for cost …...Continuous-time multi-state models for cost-e ectiveness analysis in health economics Chris Jackson MRC Biostatistics Unit University

“Modelling”: two cultures

Statistical modellingI Start with a dataset

I Fit models to the dataExpertise:

I learning from data,expressing uncertainty /variation quantitatively

Health economic modelling

I Start with model of thedisease/intervention

I “Populate” it with data

Expertise:

I economic, clinical,epidemiological

obtain relevant data, answer relevant questionrepresent quantitative evidence faithfullyinform decision making

R facilitates better statistical models

Chris Jackson Continuous-time multi-state models 2/ 15

Page 5: Continuous-time multi-state models for cost …...Continuous-time multi-state models for cost-e ectiveness analysis in health economics Chris Jackson MRC Biostatistics Unit University

“Modelling”: two cultures

Statistical modellingI Start with a dataset

I Fit models to the dataExpertise:

I learning from data,expressing uncertainty /variation quantitatively

Health economic modelling

I Start with model of thedisease/intervention

I “Populate” it with data

Expertise:

I economic, clinical,epidemiological

obtain relevant data, answer relevant questionrepresent quantitative evidence faithfullyinform decision making

obtain relevant data, answer relevant questionrepresent quantitative evidence faithfullyinform decision making

R facilitates better statistical models

Chris Jackson Continuous-time multi-state models 2/ 15

Page 6: Continuous-time multi-state models for cost …...Continuous-time multi-state models for cost-e ectiveness analysis in health economics Chris Jackson MRC Biostatistics Unit University

Survival analysis and beyond, in a health economic context

Survival analysis

I Individual data on timesto events / censoring

I Kaplan-Meier, Coxregression, parametricmodelling . . .

→ expected survival over hori-zon

Decision-analytic modelling

I State transitionmodelling, discrete-timetransition probabilities

I Multiple sources ofdata. . .

→ expected QALYs and costsover a horizon

I What if individual-level data on more than one kind of event:e.g. times of disease progression events?

I Can model these data with a continuous-time, multi-statemodel

Chris Jackson Continuous-time multi-state models 3/ 15

Page 7: Continuous-time multi-state models for cost …...Continuous-time multi-state models for cost-e ectiveness analysis in health economics Chris Jackson MRC Biostatistics Unit University

Survival analysis and beyond, in a health economic context

Survival analysis

I Individual data on timesto events / censoring

I Kaplan-Meier, Coxregression, parametricmodelling . . .

→ expected survival over hori-zon

Decision-analytic modelling

I State transitionmodelling, discrete-timetransition probabilities

I Multiple sources ofdata. . .

→ expected QALYs and costsover a horizon

I What if individual-level data on more than one kind of event:e.g. times of disease progression events?

I Can model these data with a continuous-time, multi-statemodel

Chris Jackson Continuous-time multi-state models 3/ 15

Page 8: Continuous-time multi-state models for cost …...Continuous-time multi-state models for cost-e ectiveness analysis in health economics Chris Jackson MRC Biostatistics Unit University

Survival analysis and beyond, in a health economic context

Survival analysis

I Individual data on timesto events / censoring

I Kaplan-Meier, Coxregression, parametricmodelling . . .

→ expected survival over hori-zon

Decision-analytic modelling

I State transitionmodelling, discrete-timetransition probabilities

I Multiple sources ofdata. . .

→ expected QALYs and costsover a horizon

I What if individual-level data on more than one kind of event:e.g. times of disease progression events?

I Can model these data with a continuous-time, multi-statemodel

Chris Jackson Continuous-time multi-state models 3/ 15

Page 9: Continuous-time multi-state models for cost …...Continuous-time multi-state models for cost-e ectiveness analysis in health economics Chris Jackson MRC Biostatistics Unit University

Examples of multi-state processes

Survival model

1 = Alive 2 = Dead

y

y

Competing risks model

1 = Alive

2 = Dead (heart disease)

3 = Dead (other cause)

yy

Staged disease progression model

1. Well 2. Mild disease 3. Severe disease

3. Death

Any state structure feasible with current tools

Chris Jackson Continuous-time multi-state models 4/ 15

Page 10: Continuous-time multi-state models for cost …...Continuous-time multi-state models for cost-e ectiveness analysis in health economics Chris Jackson MRC Biostatistics Unit University

Examples of multi-state processes

Survival model

1 = Alive 2 = Dead

y

y

Competing risks model

1 = Alive

2 = Dead (heart disease)

3 = Dead (other cause)

yy

Staged disease progression model

1. Well 2. Mild disease 3. Severe disease

3. Death

Any state structure feasible with current tools

Chris Jackson Continuous-time multi-state models 4/ 15

Page 11: Continuous-time multi-state models for cost …...Continuous-time multi-state models for cost-e ectiveness analysis in health economics Chris Jackson MRC Biostatistics Unit University

Examples of multi-state processes

Survival model

1 = Alive 2 = Dead

y y

Competing risks model

1 = Alive

2 = Dead (heart disease)

3 = Dead (other cause)y

yStaged disease progression model

1. Well 2. Mild disease 3. Severe disease

3. Death

Any state structure feasible with current tools

Chris Jackson Continuous-time multi-state models 4/ 15

Page 12: Continuous-time multi-state models for cost …...Continuous-time multi-state models for cost-e ectiveness analysis in health economics Chris Jackson MRC Biostatistics Unit University

Examples of multi-state processes

Survival model

1 = Alive 2 = Dead

y y

Competing risks model

1 = Alive

2 = Dead (heart disease)

3 = Dead (other cause)

y

y

Staged disease progression model

1. Well 2. Mild disease 3. Severe disease

3. Death

Any state structure feasible with current tools

Chris Jackson Continuous-time multi-state models 4/ 15

Page 13: Continuous-time multi-state models for cost …...Continuous-time multi-state models for cost-e ectiveness analysis in health economics Chris Jackson MRC Biostatistics Unit University

Examples of multi-state processes

Survival model

1 = Alive 2 = Dead

y y

Competing risks model

1 = Alive

2 = Dead (heart disease)

3 = Dead (other cause)

yy

Staged disease progression model

1. Well 2. Mild disease 3. Severe disease

3. Death

Any state structure feasible with current tools

Chris Jackson Continuous-time multi-state models 4/ 15

Page 14: Continuous-time multi-state models for cost …...Continuous-time multi-state models for cost-e ectiveness analysis in health economics Chris Jackson MRC Biostatistics Unit University

Transition rates for a continuous time multi-state model

Want to estimate the rates of transition between each pair of states

I Expected number of events given some time at risk

I Rates are not probabilities. Can be > 1

I Equivalent of hazard in survival analysis — instantaneous riskthat the transition will happen

Continuous-time analogue of transition probabilities

I Prob (in state s at time t + 1) given state r at time t

I Given rates, can compute probabilities of transition over anydiscrete time interval or cycle

Chris Jackson Continuous-time multi-state models 5/ 15

Page 15: Continuous-time multi-state models for cost …...Continuous-time multi-state models for cost-e ectiveness analysis in health economics Chris Jackson MRC Biostatistics Unit University

Alternative forms of data for multi-state modelling

Continuous observation: know state at all times

Years since became at risk of disease

Well

Mild

Severe

Death

0 2 4 6 8 10

Continuously−observed process

Panel data: know state at finite number of observations, transitiontimes unknown

Years since became at risk of disease

Well

Mild

Severe

Death

0.0 1.5 3.5 5.0 9.0

Underlying processObservation times

May be variants of either, e.g. death times commonly knownexactly

Chris Jackson Continuous-time multi-state models 6/ 15

Page 16: Continuous-time multi-state models for cost …...Continuous-time multi-state models for cost-e ectiveness analysis in health economics Chris Jackson MRC Biostatistics Unit University

Alternative forms of data for multi-state modelling

Continuous observation: know state at all times

Years since became at risk of disease

Well

Mild

Severe

Death

0 2 4 6 8 10

Continuously−observed process

Panel data: know state at finite number of observations, transitiontimes unknown

Years since became at risk of disease

Well

Mild

Severe

Death

0.0 1.5 3.5 5.0 9.0

Underlying processObservation times

May be variants of either, e.g. death times commonly knownexactlyChris Jackson Continuous-time multi-state models 6/ 15

Page 17: Continuous-time multi-state models for cost …...Continuous-time multi-state models for cost-e ectiveness analysis in health economics Chris Jackson MRC Biostatistics Unit University

Continuously-observed data for multi-state modelling

Event timesPerson Time Event State

1 0 Start of process 11 45 Alive without illness 1

2 0 Start of process 12 65 Illness onset 22 85 Death 3

3 0 Start of process 13 25 Death without illness 3

1. Well 2. Illness

3. Death

q12(t)

q23(t)q13(t)

I Estimate hazard function q() for each of three transitionsI Can simply implement three time-to-event modelsI Rearrange data to time-to-event format. . .

Data arranged with one row per potential transition. . .Person Start time Stop time Transition Status

1 0 45 1–2 Censored1 0 45 1–3 Censored

2 0 65 1–2 Observed2 0 65 1–3 Censored2 65 85 2–3 Observed

3 0 25 1–2 Censored3 0 25 1–3 Observed

Start time: time whenbecome at risk of thetransition event

Each row informs model for time to event of interestTimes to competing events treated as censoring

Chris Jackson Continuous-time multi-state models 7/ 15

Page 18: Continuous-time multi-state models for cost …...Continuous-time multi-state models for cost-e ectiveness analysis in health economics Chris Jackson MRC Biostatistics Unit University

Continuously-observed data for multi-state modelling

Event timesPerson Time Event State

1 0 Start of process 11 45 Alive without illness 1

2 0 Start of process 12 65 Illness onset 22 85 Death 3

3 0 Start of process 13 25 Death without illness 3

1. Well 2. Illness

3. Death

q12(t)

q23(t)q13(t)

Data arranged with one row per potential transition. . .Person Start time Stop time Transition Status

1 0 45 1–2 Censored1 0 45 1–3 Censored

2 0 65 1–2 Observed2 0 65 1–3 Censored2 65 85 2–3 Observed

3 0 25 1–2 Censored3 0 25 1–3 Observed

Start time: time whenbecome at risk of thetransition event

Each row informs model for time to event of interestTimes to competing events treated as censoring

Chris Jackson Continuous-time multi-state models 7/ 15

Page 19: Continuous-time multi-state models for cost …...Continuous-time multi-state models for cost-e ectiveness analysis in health economics Chris Jackson MRC Biostatistics Unit University

Multi-state models for continuous observation: software

Standard survival modelling software to estimate hazard of eachtransition, its dependence on time and other covariates

I coxph() fuction in survival package (Cox regression,semiparametric)

I flexsurvreg() or flexsurvspline() function in flexsurv

package (fully parametric models)

I survreg() function in survival package

Specialised software then needed to deduce quantities needed fordecision modelling: transition probabilities, expected total timespent in some state over some horizon. . .

I mstate (uses coxph() fit, can’t extrapolate beyond data)

I flexsurv (fully-parametric, can extrapolate)

I Claire Williams’ code (see following talk. . .)

I multistate in Stata (Crowther & Lambert)

Chris Jackson Continuous-time multi-state models 8/ 15

Page 20: Continuous-time multi-state models for cost …...Continuous-time multi-state models for cost-e ectiveness analysis in health economics Chris Jackson MRC Biostatistics Unit University

Multi-state models for continuous observation: software

Standard survival modelling software to estimate hazard of eachtransition, its dependence on time and other covariates

I coxph() fuction in survival package (Cox regression,semiparametric)

I flexsurvreg() or flexsurvspline() function in flexsurv

package (fully parametric models)

I survreg() function in survival package

Specialised software then needed to deduce quantities needed fordecision modelling: transition probabilities, expected total timespent in some state over some horizon. . .

I mstate (uses coxph() fit, can’t extrapolate beyond data)

I flexsurv (fully-parametric, can extrapolate)

I Claire Williams’ code (see following talk. . .)

I multistate in Stata (Crowther & Lambert)

Chris Jackson Continuous-time multi-state models 8/ 15

Page 21: Continuous-time multi-state models for cost …...Continuous-time multi-state models for cost-e ectiveness analysis in health economics Chris Jackson MRC Biostatistics Unit University

Multi-state models for continuous observation: resources

I de Wreede, L. C., Fiocco, M., & Putter, H. (2011). mstate: an Rpackage for the analysis of competing risks and multi-state models.Journal of Statistical Software, 38(7), 1-30.

I Jackson, C. H. (2016). flexsurv: a platform for parametricsurvival modeling in R. Journal of Statistical Software, 70.

I Williams, Claire, et al. ”Cost-effectiveness analysis in R using amulti-state modeling survival analysis framework: a tutorial.”Medical Decision Making 37.4 (2017): 340-352.

I Stata ssc install multistate

Chris Jackson Continuous-time multi-state models 9/ 15

Page 22: Continuous-time multi-state models for cost …...Continuous-time multi-state models for cost-e ectiveness analysis in health economics Chris Jackson MRC Biostatistics Unit University

Multi-state models for intermittently-observed data

Panel data: know state at finite number of observations

Years since became at risk of disease

Well

Mild

Severe

Death

0.0 1.5 3.5 5.0 9.0

Underlying processObservation times

I Exact event times unknown → semiparametric or flexibleparametric time-to-event models are infeasible

I Continuous-time Markov models with piecewise-constanttransition rates can be easily fitted instead

I Can deduce transition probabilities over any discrete timeinterval, expected total time spent in a state over a horizon. . .

Chris Jackson Continuous-time multi-state models 10/ 15

Page 23: Continuous-time multi-state models for cost …...Continuous-time multi-state models for cost-e ectiveness analysis in health economics Chris Jackson MRC Biostatistics Unit University

Multi-state models for intermittently-observed data:software and resources

msm package in R

I any state-transition structure, proportional-hazards models forcovariates, piecewise-constant hazards over time. . .

I Jackson, C. H. (2011). Multi-state models for panel data: the msm

package for R. Journal of Statistical Software, 38(8), 1-29.

Recommended textbook

I Van Den Hout, A. (2016). Multi-state survival models forinterval-censored data. Chapman and Hall/CRC.

Chris Jackson Continuous-time multi-state models 11/ 15

Page 24: Continuous-time multi-state models for cost …...Continuous-time multi-state models for cost-e ectiveness analysis in health economics Chris Jackson MRC Biostatistics Unit University

Using multi-state model results in cost-effectivenessanalysis

Any of these multi-state models can giveI transition probabilities: Pr(S(t + u) = s|S(t) = r) between

states S(t) for any discrete time interval uI could use to inform a state-transition decision-analytic model

I expected time Tr (t) spent in each state r between now andsome horizon t.

I Define cost and utility for occupying stateI → expected cost and QALY attributable to periods in that

stateI → sum over states to get total cost, QALY.I multi-state model is itself the (continuous-time) decision model

Chris Jackson Continuous-time multi-state models 12/ 15

Page 25: Continuous-time multi-state models for cost …...Continuous-time multi-state models for cost-e ectiveness analysis in health economics Chris Jackson MRC Biostatistics Unit University

Partitioned survival analysis

Common in cancer HTAs

I Estimates progressed state occupancy from difference betweenprogression-free, overall survival curves

I Less flexible than multi-state models (assumes independentendpoints, progression-only transition structures)

Discussion and critique

I http://nicedsu.org.uk/technical-support-documents/

partitioned-survival-analysis-tsd/

I Williams, C., Lewsey, J. D., Mackay, D. F., & Briggs, A. H. (2017).Estimation of survival probabilities for use in cost-effectiveness analyses:a comparison of a multi-state modeling survival analysis approach withpartitioned survival and Markov decision-analytic modeling. MedicalDecision Making, 37(4), 427-439.

Chris Jackson Continuous-time multi-state models 13/ 15

Page 26: Continuous-time multi-state models for cost …...Continuous-time multi-state models for cost-e ectiveness analysis in health economics Chris Jackson MRC Biostatistics Unit University

“Modelling”: two cultures

Statistical modellingI Start with a dataset

I Fit models to the dataExpertise:

I learning from data,expressing uncertainty /variation quantitatively

Health economic modelling

I Start with model of thedisease/intervention

I “Populate” it with data

Expertise:

I economic, clinical,epidemiological

obtain relevant data, answer relevant questionrepresent quantitative evidence faithfullyinform decision making

obtain relevant data, answer relevant questionrepresent quantitative evidence faithfullyinform decision making

R facilitates better statistical models

Chris Jackson Continuous-time multi-state models 14/ 15

Page 27: Continuous-time multi-state models for cost …...Continuous-time multi-state models for cost-e ectiveness analysis in health economics Chris Jackson MRC Biostatistics Unit University

Summary: continuous-time multi-state models

I With richer data comes need for richer modelsI Continuous-time, individual-level multi-state data

I deserve continuous-time multi-state models!

I Models with appropriate software and documentationI enable using available evidence more expressivelyI → models, decisions that reflect reality

Chris Jackson Continuous-time multi-state models 15/ 15