Assessment of methodological quality and outcomes of clinical trials Christian Gluud Copenhagen...
-
Upload
ronald-ferguson -
Category
Documents
-
view
216 -
download
0
Transcript of Assessment of methodological quality and outcomes of clinical trials Christian Gluud Copenhagen...
![Page 1: Assessment of methodological quality and outcomes of clinical trials Christian Gluud Copenhagen Trial Unit Centre for Clinical Intervention Research Rigshospitalet.](https://reader036.fdocuments.net/reader036/viewer/2022062517/56649e7a5503460f94b7b091/html5/thumbnails/1.jpg)
Assessment of methodological quality and outcomes of clinical trials
Christian Gluud
Copenhagen Trial Unit Centre for Clinical Intervention Research
RigshospitaletCopenhagen University Hospital
![Page 2: Assessment of methodological quality and outcomes of clinical trials Christian Gluud Copenhagen Trial Unit Centre for Clinical Intervention Research Rigshospitalet.](https://reader036.fdocuments.net/reader036/viewer/2022062517/56649e7a5503460f94b7b091/html5/thumbnails/2.jpg)
Evidence-basedclinical practice
• The patient’s values (concerns, expectations, preferences)
• The best clinical research evidence
![Page 3: Assessment of methodological quality and outcomes of clinical trials Christian Gluud Copenhagen Trial Unit Centre for Clinical Intervention Research Rigshospitalet.](https://reader036.fdocuments.net/reader036/viewer/2022062517/56649e7a5503460f94b7b091/html5/thumbnails/3.jpg)
Levels of evidence
![Page 4: Assessment of methodological quality and outcomes of clinical trials Christian Gluud Copenhagen Trial Unit Centre for Clinical Intervention Research Rigshospitalet.](https://reader036.fdocuments.net/reader036/viewer/2022062517/56649e7a5503460f94b7b091/html5/thumbnails/4.jpg)
Important aspects of clinical research
- all levels of the hierachy
• Systematic errors (domains)
• Systematic errors (design)
• Random errors (play of chance)
![Page 5: Assessment of methodological quality and outcomes of clinical trials Christian Gluud Copenhagen Trial Unit Centre for Clinical Intervention Research Rigshospitalet.](https://reader036.fdocuments.net/reader036/viewer/2022062517/56649e7a5503460f94b7b091/html5/thumbnails/5.jpg)
Levels of evidence
• Risk of systematic
errors (domain)
• Risk of systematic
errors (design)
• Risk of random
errors
![Page 6: Assessment of methodological quality and outcomes of clinical trials Christian Gluud Copenhagen Trial Unit Centre for Clinical Intervention Research Rigshospitalet.](https://reader036.fdocuments.net/reader036/viewer/2022062517/56649e7a5503460f94b7b091/html5/thumbnails/6.jpg)
Important aspects of randomised clinical trials
and meta-analyses
• Systematic errors (domains)
• Systematic errors (design)
• Random errors (play of chance)
![Page 7: Assessment of methodological quality and outcomes of clinical trials Christian Gluud Copenhagen Trial Unit Centre for Clinical Intervention Research Rigshospitalet.](https://reader036.fdocuments.net/reader036/viewer/2022062517/56649e7a5503460f94b7b091/html5/thumbnails/7.jpg)
Domains associated with bias risk
• Generation of the allocation sequence
• Allocation concealment
• Blinding
• Incomplete outcome data (intention-to-treat)
• Outcome reporting bias
• Industry bias
• Other components associated with bias
![Page 8: Assessment of methodological quality and outcomes of clinical trials Christian Gluud Copenhagen Trial Unit Centre for Clinical Intervention Research Rigshospitalet.](https://reader036.fdocuments.net/reader036/viewer/2022062517/56649e7a5503460f94b7b091/html5/thumbnails/8.jpg)
Meta-analysis of several trials
Low risk of bias
High risk of bias
Overall
![Page 9: Assessment of methodological quality and outcomes of clinical trials Christian Gluud Copenhagen Trial Unit Centre for Clinical Intervention Research Rigshospitalet.](https://reader036.fdocuments.net/reader036/viewer/2022062517/56649e7a5503460f94b7b091/html5/thumbnails/9.jpg)
Ratio of odds ratios (ROR)Ratio of odds ratios (ROR)
Odds ratio of trials with unclear or inadequateOdds ratio of trials with unclear or inadequate
component (high risk of bias)component (high risk of bias)
divided bydivided by
odds ratio of trials with adequate odds ratio of trials with adequate
component (low risk of bias)component (low risk of bias)
![Page 10: Assessment of methodological quality and outcomes of clinical trials Christian Gluud Copenhagen Trial Unit Centre for Clinical Intervention Research Rigshospitalet.](https://reader036.fdocuments.net/reader036/viewer/2022062517/56649e7a5503460f94b7b091/html5/thumbnails/10.jpg)
Control of selection bias
Generation of the allocation sequence
• Low risk of bias Computer system, table of random numbers, or similar
• High risk of bias Not described or quasi-randomised (excluded)
![Page 11: Assessment of methodological quality and outcomes of clinical trials Christian Gluud Copenhagen Trial Unit Centre for Clinical Intervention Research Rigshospitalet.](https://reader036.fdocuments.net/reader036/viewer/2022062517/56649e7a5503460f94b7b091/html5/thumbnails/11.jpg)
BRANDO Sequence generation
• 112 meta-analyses with
• 944 randomised clinical trials
• 696 (73.7%) with high risk of bias
• ROR 0.89 (95% CI 0.82 to 0.96)
![Page 12: Assessment of methodological quality and outcomes of clinical trials Christian Gluud Copenhagen Trial Unit Centre for Clinical Intervention Research Rigshospitalet.](https://reader036.fdocuments.net/reader036/viewer/2022062517/56649e7a5503460f94b7b091/html5/thumbnails/12.jpg)
Control of selection bias
Allocation concealment
• Low risk of bias Central independent unit, sealed envelopes (only if perfect placebo)
• High risk of bias Not described or open table of random numbers
![Page 13: Assessment of methodological quality and outcomes of clinical trials Christian Gluud Copenhagen Trial Unit Centre for Clinical Intervention Research Rigshospitalet.](https://reader036.fdocuments.net/reader036/viewer/2022062517/56649e7a5503460f94b7b091/html5/thumbnails/13.jpg)
BRANDO Allocation concealment
• 146 meta-analyses with
• 1292 randomised clinical trials
• 916 (70.9%) with high risk of bias
• ROR 0.93 (95% CI 0.87 to 0.99)
![Page 14: Assessment of methodological quality and outcomes of clinical trials Christian Gluud Copenhagen Trial Unit Centre for Clinical Intervention Research Rigshospitalet.](https://reader036.fdocuments.net/reader036/viewer/2022062517/56649e7a5503460f94b7b091/html5/thumbnails/14.jpg)
Control of detection bias(reporting bias and observer bias)
Blinding
• Low risk of bias Identical placebo or comparator
• High risk of bias Not described or not blinded
![Page 15: Assessment of methodological quality and outcomes of clinical trials Christian Gluud Copenhagen Trial Unit Centre for Clinical Intervention Research Rigshospitalet.](https://reader036.fdocuments.net/reader036/viewer/2022062517/56649e7a5503460f94b7b091/html5/thumbnails/15.jpg)
BRANDO Blinding
• 104 meta-analyses with
• 1057 randomised clinical trials
• 467 (44.2%) with high risk of bias
• ROR 0.87 (95% CI 0.79 to 0.96)
![Page 16: Assessment of methodological quality and outcomes of clinical trials Christian Gluud Copenhagen Trial Unit Centre for Clinical Intervention Research Rigshospitalet.](https://reader036.fdocuments.net/reader036/viewer/2022062517/56649e7a5503460f94b7b091/html5/thumbnails/16.jpg)
Industry sponsorship and research outcome
• Lundh et al, The Cochrane Library 2012
• Cross-sectional studies, cohort studies, systematic reviews and meta-analyses that quantitatively compared primary research studies of drugs or medical devices sponsored by industry with studies with other sources of sponsorship
![Page 17: Assessment of methodological quality and outcomes of clinical trials Christian Gluud Copenhagen Trial Unit Centre for Clinical Intervention Research Rigshospitalet.](https://reader036.fdocuments.net/reader036/viewer/2022062517/56649e7a5503460f94b7b091/html5/thumbnails/17.jpg)
Favourable beneficial results
![Page 18: Assessment of methodological quality and outcomes of clinical trials Christian Gluud Copenhagen Trial Unit Centre for Clinical Intervention Research Rigshospitalet.](https://reader036.fdocuments.net/reader036/viewer/2022062517/56649e7a5503460f94b7b091/html5/thumbnails/18.jpg)
Favourable harms results
![Page 19: Assessment of methodological quality and outcomes of clinical trials Christian Gluud Copenhagen Trial Unit Centre for Clinical Intervention Research Rigshospitalet.](https://reader036.fdocuments.net/reader036/viewer/2022062517/56649e7a5503460f94b7b091/html5/thumbnails/19.jpg)
Favourable conclusions
![Page 20: Assessment of methodological quality and outcomes of clinical trials Christian Gluud Copenhagen Trial Unit Centre for Clinical Intervention Research Rigshospitalet.](https://reader036.fdocuments.net/reader036/viewer/2022062517/56649e7a5503460f94b7b091/html5/thumbnails/20.jpg)
Important aspects of randomised clinical trials
and meta-analyses
• Systematic errors (domains)
• Systematic errors (design)
• Random errors (play of chance)
![Page 21: Assessment of methodological quality and outcomes of clinical trials Christian Gluud Copenhagen Trial Unit Centre for Clinical Intervention Research Rigshospitalet.](https://reader036.fdocuments.net/reader036/viewer/2022062517/56649e7a5503460f94b7b091/html5/thumbnails/21.jpg)
Design errors affecting external validity of randomised trials include
‘wrong’: • Centres
• Participants
• Experimental intervention
• Control intervention
• Goal - explanatory or pragmatic
• Trial structure - parallel group, crossover, etc.
• Objective - superiority, equivalence, non-inferiority
• Outcome
• Unit of analysis
![Page 22: Assessment of methodological quality and outcomes of clinical trials Christian Gluud Copenhagen Trial Unit Centre for Clinical Intervention Research Rigshospitalet.](https://reader036.fdocuments.net/reader036/viewer/2022062517/56649e7a5503460f94b7b091/html5/thumbnails/22.jpg)
Important aspects of randomised clinical trials
and meta-analyses
• Systematic errors (domains)
• Systematic errors (design)
• Random errors (play of chance)
![Page 23: Assessment of methodological quality and outcomes of clinical trials Christian Gluud Copenhagen Trial Unit Centre for Clinical Intervention Research Rigshospitalet.](https://reader036.fdocuments.net/reader036/viewer/2022062517/56649e7a5503460f94b7b091/html5/thumbnails/23.jpg)
Mean number of patients per intervention arm (SEM) in 383 randomised trials
published in Gastroenterology from 1964-2000 (Kjærgard et al. 2002)
![Page 24: Assessment of methodological quality and outcomes of clinical trials Christian Gluud Copenhagen Trial Unit Centre for Clinical Intervention Research Rigshospitalet.](https://reader036.fdocuments.net/reader036/viewer/2022062517/56649e7a5503460f94b7b091/html5/thumbnails/24.jpg)
TA(C)E for hepatocellular carcinoma – trial sequential
analysis
![Page 25: Assessment of methodological quality and outcomes of clinical trials Christian Gluud Copenhagen Trial Unit Centre for Clinical Intervention Research Rigshospitalet.](https://reader036.fdocuments.net/reader036/viewer/2022062517/56649e7a5503460f94b7b091/html5/thumbnails/25.jpg)
The pernicious yin-yang interplay between
random errors and systematic error
PUBLICATION BIASPUBLICATION BIAS
![Page 26: Assessment of methodological quality and outcomes of clinical trials Christian Gluud Copenhagen Trial Unit Centre for Clinical Intervention Research Rigshospitalet.](https://reader036.fdocuments.net/reader036/viewer/2022062517/56649e7a5503460f94b7b091/html5/thumbnails/26.jpg)
![Page 27: Assessment of methodological quality and outcomes of clinical trials Christian Gluud Copenhagen Trial Unit Centre for Clinical Intervention Research Rigshospitalet.](https://reader036.fdocuments.net/reader036/viewer/2022062517/56649e7a5503460f94b7b091/html5/thumbnails/27.jpg)
![Page 28: Assessment of methodological quality and outcomes of clinical trials Christian Gluud Copenhagen Trial Unit Centre for Clinical Intervention Research Rigshospitalet.](https://reader036.fdocuments.net/reader036/viewer/2022062517/56649e7a5503460f94b7b091/html5/thumbnails/28.jpg)
![Page 29: Assessment of methodological quality and outcomes of clinical trials Christian Gluud Copenhagen Trial Unit Centre for Clinical Intervention Research Rigshospitalet.](https://reader036.fdocuments.net/reader036/viewer/2022062517/56649e7a5503460f94b7b091/html5/thumbnails/29.jpg)
Number of patients with serum HBV DNA at end of treatment
![Page 30: Assessment of methodological quality and outcomes of clinical trials Christian Gluud Copenhagen Trial Unit Centre for Clinical Intervention Research Rigshospitalet.](https://reader036.fdocuments.net/reader036/viewer/2022062517/56649e7a5503460f94b7b091/html5/thumbnails/30.jpg)
Trial sequential analysis of serum HBV DNA
DARIS 4620 pts. Pc 54%, RRR 20%, alpha=5%, beta=20%, diversity=85%
Trial sequential analysis of serum HBV DNA at end of treatment
![Page 31: Assessment of methodological quality and outcomes of clinical trials Christian Gluud Copenhagen Trial Unit Centre for Clinical Intervention Research Rigshospitalet.](https://reader036.fdocuments.net/reader036/viewer/2022062517/56649e7a5503460f94b7b091/html5/thumbnails/31.jpg)
Number of pts without seroconversion from HBeAg to anti-HBe
![Page 32: Assessment of methodological quality and outcomes of clinical trials Christian Gluud Copenhagen Trial Unit Centre for Clinical Intervention Research Rigshospitalet.](https://reader036.fdocuments.net/reader036/viewer/2022062517/56649e7a5503460f94b7b091/html5/thumbnails/32.jpg)
DARIS 891 pts. Pc 86%, RRR 20%, alpha=5%, beta=20%, diversity 79%
Trial sequential analysis of seroconversion from HBeAg to anti-HBe
![Page 33: Assessment of methodological quality and outcomes of clinical trials Christian Gluud Copenhagen Trial Unit Centre for Clinical Intervention Research Rigshospitalet.](https://reader036.fdocuments.net/reader036/viewer/2022062517/56649e7a5503460f94b7b091/html5/thumbnails/33.jpg)
Trial variable Global Chinese
Trial registration Often insufficient Often insufficient
Sample size estimation 50% Less than 25%
Bias risks 95% More than 95%
Comparators Often ill chosen Often ill chosen
Outcomes Putative sourrogates Putative sourrogates
Results Mostly unreliable Mostly unreliable
Depesonolised data in register
Always insufficient Always insufficient
![Page 34: Assessment of methodological quality and outcomes of clinical trials Christian Gluud Copenhagen Trial Unit Centre for Clinical Intervention Research Rigshospitalet.](https://reader036.fdocuments.net/reader036/viewer/2022062517/56649e7a5503460f94b7b091/html5/thumbnails/34.jpg)
Experimental intervention- systematic errors (domains)- systematic errors (design)- PUBLICATION bias
Control intervention
Randomised clinical trials – most often false due to the people behind!
“…why most research findings are false!” JP Ioannidis
![Page 35: Assessment of methodological quality and outcomes of clinical trials Christian Gluud Copenhagen Trial Unit Centre for Clinical Intervention Research Rigshospitalet.](https://reader036.fdocuments.net/reader036/viewer/2022062517/56649e7a5503460f94b7b091/html5/thumbnails/35.jpg)
THANK YOU !THANK YOU !
![Page 36: Assessment of methodological quality and outcomes of clinical trials Christian Gluud Copenhagen Trial Unit Centre for Clinical Intervention Research Rigshospitalet.](https://reader036.fdocuments.net/reader036/viewer/2022062517/56649e7a5503460f94b7b091/html5/thumbnails/36.jpg)
The Cochrane
CollaborationAn international network of professionals,
preparing , maintaining, and disseminating systematic reviews of the effects of health care
![Page 37: Assessment of methodological quality and outcomes of clinical trials Christian Gluud Copenhagen Trial Unit Centre for Clinical Intervention Research Rigshospitalet.](https://reader036.fdocuments.net/reader036/viewer/2022062517/56649e7a5503460f94b7b091/html5/thumbnails/37.jpg)
Archie Cochrane (1979)
”It is surely a great criticism of our profession that we have not organised a critical summary, by speciality and subspeciality, adapted periodically, of all relevant randomised trials”
![Page 38: Assessment of methodological quality and outcomes of clinical trials Christian Gluud Copenhagen Trial Unit Centre for Clinical Intervention Research Rigshospitalet.](https://reader036.fdocuments.net/reader036/viewer/2022062517/56649e7a5503460f94b7b091/html5/thumbnails/38.jpg)
The Cochrane Collaboration
• www.cochrane.org
• 670 000 randomised trials
• Now 5000 systematic reviews
• 500 new reviews per year
• 500 updated reviews per year
• JIF 6.2
![Page 39: Assessment of methodological quality and outcomes of clinical trials Christian Gluud Copenhagen Trial Unit Centre for Clinical Intervention Research Rigshospitalet.](https://reader036.fdocuments.net/reader036/viewer/2022062517/56649e7a5503460f94b7b091/html5/thumbnails/39.jpg)
Answer to the question:
When is it acceptable to make therapeutic decisions based on patient series, patient-control studies, and cohort studies?
![Page 40: Assessment of methodological quality and outcomes of clinical trials Christian Gluud Copenhagen Trial Unit Centre for Clinical Intervention Research Rigshospitalet.](https://reader036.fdocuments.net/reader036/viewer/2022062517/56649e7a5503460f94b7b091/html5/thumbnails/40.jpg)
Answer to the question:
When is it acceptable to make therapeutic decisions based on patient series, patient-control studies, and cohort studies?
Only if you have exophtalmus producing intervention effects!
![Page 41: Assessment of methodological quality and outcomes of clinical trials Christian Gluud Copenhagen Trial Unit Centre for Clinical Intervention Research Rigshospitalet.](https://reader036.fdocuments.net/reader036/viewer/2022062517/56649e7a5503460f94b7b091/html5/thumbnails/41.jpg)
Answer to the question:
When is it acceptable to make therapeutic decisions based on patient
series, patient-control studies, and cohort studies?
As we do not know the intervention effect a priory – and medical research is a
forward moving process – one should always test interventions in randomised clinical trials!
![Page 42: Assessment of methodological quality and outcomes of clinical trials Christian Gluud Copenhagen Trial Unit Centre for Clinical Intervention Research Rigshospitalet.](https://reader036.fdocuments.net/reader036/viewer/2022062517/56649e7a5503460f94b7b091/html5/thumbnails/42.jpg)
Thomas C Chalmers
• More than 500 publications
• More than 25 000 citations
• H index above 77
• Always randomize the first patient!
The New England Journal of Medicine 1977;296(2):107
![Page 43: Assessment of methodological quality and outcomes of clinical trials Christian Gluud Copenhagen Trial Unit Centre for Clinical Intervention Research Rigshospitalet.](https://reader036.fdocuments.net/reader036/viewer/2022062517/56649e7a5503460f94b7b091/html5/thumbnails/43.jpg)
Rare diseases and randomised trials
• With 7,000,000,000 (7 billion!) individuals in the world the disease has to be extremily rare – say less than 1/10,000,000 – before it becomes difficult to conduct randomised clinical trials!
• International patient registries
• Infrastructures like ECRIN
![Page 44: Assessment of methodological quality and outcomes of clinical trials Christian Gluud Copenhagen Trial Unit Centre for Clinical Intervention Research Rigshospitalet.](https://reader036.fdocuments.net/reader036/viewer/2022062517/56649e7a5503460f94b7b091/html5/thumbnails/44.jpg)
James Lind 1747
![Page 45: Assessment of methodological quality and outcomes of clinical trials Christian Gluud Copenhagen Trial Unit Centre for Clinical Intervention Research Rigshospitalet.](https://reader036.fdocuments.net/reader036/viewer/2022062517/56649e7a5503460f94b7b091/html5/thumbnails/45.jpg)
James Lind 1716-1794
![Page 46: Assessment of methodological quality and outcomes of clinical trials Christian Gluud Copenhagen Trial Unit Centre for Clinical Intervention Research Rigshospitalet.](https://reader036.fdocuments.net/reader036/viewer/2022062517/56649e7a5503460f94b7b091/html5/thumbnails/46.jpg)
James Lind allocated
Two oranges and lemons
Two cider
Two vinegar
Two elixir vitriol
Two spices and garlic
Two sea water
![Page 47: Assessment of methodological quality and outcomes of clinical trials Christian Gluud Copenhagen Trial Unit Centre for Clinical Intervention Research Rigshospitalet.](https://reader036.fdocuments.net/reader036/viewer/2022062517/56649e7a5503460f94b7b091/html5/thumbnails/47.jpg)
75 498 979 1647 31188823
16155
26322
45020
67522
99373
121584
131223
0
20000
40000
60000
80000
100000
120000
140000
1900 to 1946
1947 to 1951
1952 to 1956
1957 to 1961
1962 to 1966
1967 to 1971
1972 to 1976
1977 to 1981
1982 to 1986
1987 to 1991
1992 to 1996
1997 to 2001
2002 to 2007
Year period
Periodic growth of publications on randomised and controlled clinical trials
![Page 48: Assessment of methodological quality and outcomes of clinical trials Christian Gluud Copenhagen Trial Unit Centre for Clinical Intervention Research Rigshospitalet.](https://reader036.fdocuments.net/reader036/viewer/2022062517/56649e7a5503460f94b7b091/html5/thumbnails/48.jpg)
1127
1014945
881
713666
632594 587 559
438 430 426355 349
254 250199 188 175
0
200
400
600
800
1000
1200
Number of publications on randomised and controlled clinical trials published per million inhabitants
![Page 49: Assessment of methodological quality and outcomes of clinical trials Christian Gluud Copenhagen Trial Unit Centre for Clinical Intervention Research Rigshospitalet.](https://reader036.fdocuments.net/reader036/viewer/2022062517/56649e7a5503460f94b7b091/html5/thumbnails/49.jpg)
James Lind observed
The two on oranges and lemons
regained health in a few days
and could care for the remainder,
that stayed ill
![Page 50: Assessment of methodological quality and outcomes of clinical trials Christian Gluud Copenhagen Trial Unit Centre for Clinical Intervention Research Rigshospitalet.](https://reader036.fdocuments.net/reader036/viewer/2022062517/56649e7a5503460f94b7b091/html5/thumbnails/50.jpg)
James Lind 1753
![Page 51: Assessment of methodological quality and outcomes of clinical trials Christian Gluud Copenhagen Trial Unit Centre for Clinical Intervention Research Rigshospitalet.](https://reader036.fdocuments.net/reader036/viewer/2022062517/56649e7a5503460f94b7b091/html5/thumbnails/51.jpg)
James Lind 1747
Yearly ‘International Clinical Trials’ Day’ !!!!!Yearly ‘International Clinical Trials’ Day’ !!!!!
![Page 52: Assessment of methodological quality and outcomes of clinical trials Christian Gluud Copenhagen Trial Unit Centre for Clinical Intervention Research Rigshospitalet.](https://reader036.fdocuments.net/reader036/viewer/2022062517/56649e7a5503460f94b7b091/html5/thumbnails/52.jpg)
George Löhner and…... 1835
![Page 53: Assessment of methodological quality and outcomes of clinical trials Christian Gluud Copenhagen Trial Unit Centre for Clinical Intervention Research Rigshospitalet.](https://reader036.fdocuments.net/reader036/viewer/2022062517/56649e7a5503460f94b7b091/html5/thumbnails/53.jpg)
George Löhner and his team of truth loving men
• Clear protocol, published before launch
• Large number of participants (n = 50)
• Perfect randomisation
• Placebo controlled (melted ice)
• Blinded for all parties
• Account for drop outs
• Statistical comparison
![Page 54: Assessment of methodological quality and outcomes of clinical trials Christian Gluud Copenhagen Trial Unit Centre for Clinical Intervention Research Rigshospitalet.](https://reader036.fdocuments.net/reader036/viewer/2022062517/56649e7a5503460f94b7b091/html5/thumbnails/54.jpg)
Downgrade the evidence in case of risks of errors
I More evidence needed!!!!!!!!!!!!!
IIa Systematic review of randomised clinical
trials with risk of systematic errors
(bias) or of random errors (play of chance) IIb Single randomised clinical trial with risk of systematic errors (bias) or of random errors (play of chance) III Cohort studyIV Case-control studyV Case series
![Page 55: Assessment of methodological quality and outcomes of clinical trials Christian Gluud Copenhagen Trial Unit Centre for Clinical Intervention Research Rigshospitalet.](https://reader036.fdocuments.net/reader036/viewer/2022062517/56649e7a5503460f94b7b091/html5/thumbnails/55.jpg)
Upgrade the evidence in case of ‘exophthalmus’ producing effects
I Case-control studiesII Case series
Ex: - parachute for plane passengers
- insulin for diabetic coma
- blood transfusion for severe haemorrhage
- defibrillation for ventricular fibrillation
- ether to induce anaesthesia
![Page 56: Assessment of methodological quality and outcomes of clinical trials Christian Gluud Copenhagen Trial Unit Centre for Clinical Intervention Research Rigshospitalet.](https://reader036.fdocuments.net/reader036/viewer/2022062517/56649e7a5503460f94b7b091/html5/thumbnails/56.jpg)
Povl Heiberg 1897
Heiberg knew the solutions
- large numbers - large numbers !!
- randomisation - randomisation !!
- blinding - blinding !!
- independent research - independent research !!
![Page 57: Assessment of methodological quality and outcomes of clinical trials Christian Gluud Copenhagen Trial Unit Centre for Clinical Intervention Research Rigshospitalet.](https://reader036.fdocuments.net/reader036/viewer/2022062517/56649e7a5503460f94b7b091/html5/thumbnails/57.jpg)
The hierarchy of evidence
Ia Systematic review of randomised clinical
trials with low risk of systematic errors
(bias) and of random errors (play of chance)
Ib Single randomised clinical trial with low risk of
systematic errors (bias) and of random errors
(play of chance)
II Cohort study
III Case-control study
IV Case series
![Page 58: Assessment of methodological quality and outcomes of clinical trials Christian Gluud Copenhagen Trial Unit Centre for Clinical Intervention Research Rigshospitalet.](https://reader036.fdocuments.net/reader036/viewer/2022062517/56649e7a5503460f94b7b091/html5/thumbnails/58.jpg)
Low risk of systematic errors
High risk of systematic errors
Low risk of random errors
High risk of random errors
![Page 59: Assessment of methodological quality and outcomes of clinical trials Christian Gluud Copenhagen Trial Unit Centre for Clinical Intervention Research Rigshospitalet.](https://reader036.fdocuments.net/reader036/viewer/2022062517/56649e7a5503460f94b7b091/html5/thumbnails/59.jpg)
![Page 60: Assessment of methodological quality and outcomes of clinical trials Christian Gluud Copenhagen Trial Unit Centre for Clinical Intervention Research Rigshospitalet.](https://reader036.fdocuments.net/reader036/viewer/2022062517/56649e7a5503460f94b7b091/html5/thumbnails/60.jpg)
Random errors in small trials• False positive results
(type I error)
• False negative results
(type II error)
![Page 61: Assessment of methodological quality and outcomes of clinical trials Christian Gluud Copenhagen Trial Unit Centre for Clinical Intervention Research Rigshospitalet.](https://reader036.fdocuments.net/reader036/viewer/2022062517/56649e7a5503460f94b7b091/html5/thumbnails/61.jpg)
![Page 62: Assessment of methodological quality and outcomes of clinical trials Christian Gluud Copenhagen Trial Unit Centre for Clinical Intervention Research Rigshospitalet.](https://reader036.fdocuments.net/reader036/viewer/2022062517/56649e7a5503460f94b7b091/html5/thumbnails/62.jpg)
Components associated with bias risk
• Generation of the allocation sequence
• Allocation concealment
• Blinding
• Incomplete outcome data (intention-to-treat)
• Outcome measure reporting bias
• Other components associated with bias (vested
interest bias)
![Page 63: Assessment of methodological quality and outcomes of clinical trials Christian Gluud Copenhagen Trial Unit Centre for Clinical Intervention Research Rigshospitalet.](https://reader036.fdocuments.net/reader036/viewer/2022062517/56649e7a5503460f94b7b091/html5/thumbnails/63.jpg)
TA(C)E for hepatocellular carcinoma – systematic review
![Page 64: Assessment of methodological quality and outcomes of clinical trials Christian Gluud Copenhagen Trial Unit Centre for Clinical Intervention Research Rigshospitalet.](https://reader036.fdocuments.net/reader036/viewer/2022062517/56649e7a5503460f94b7b091/html5/thumbnails/64.jpg)
Important aspects of randomised clinical trials
and meta-analyses
• Systematic errors (bias)
• Random errors (play of chance)
• Design errors
![Page 65: Assessment of methodological quality and outcomes of clinical trials Christian Gluud Copenhagen Trial Unit Centre for Clinical Intervention Research Rigshospitalet.](https://reader036.fdocuments.net/reader036/viewer/2022062517/56649e7a5503460f94b7b091/html5/thumbnails/65.jpg)
The hierarchy of evidence
Ia Systematic review of randomised clinical
trials with low risk of systematic errors
and low risk of random errors
Ib Single randomised clinical trial with low risk of
systematic errors and low risk of random
errors
!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!
II Cohort study
III Case-control study
IV Case series
![Page 66: Assessment of methodological quality and outcomes of clinical trials Christian Gluud Copenhagen Trial Unit Centre for Clinical Intervention Research Rigshospitalet.](https://reader036.fdocuments.net/reader036/viewer/2022062517/56649e7a5503460f94b7b091/html5/thumbnails/66.jpg)
Dangers in non-randomised studies
• Confounding by indication and unmeasured confounding
• Biological mechanisms - Limited time of diseases - Cyclical progression of diseases - When do we see patients?
• Psychological mechanism - We see what we want to see (BIAS)! - We believe what we want to believe (astrology)!
![Page 67: Assessment of methodological quality and outcomes of clinical trials Christian Gluud Copenhagen Trial Unit Centre for Clinical Intervention Research Rigshospitalet.](https://reader036.fdocuments.net/reader036/viewer/2022062517/56649e7a5503460f94b7b091/html5/thumbnails/67.jpg)
Deeks et al (2003) and the International Stroke Trial
• 19,435 patients with ischaemic stroke
• 467 clinical sites
• Randomised to aspirin versus placebo
• Dead or dependent at 6 months
• OR 0.95; 95% CI 0.89 to 1.01
![Page 68: Assessment of methodological quality and outcomes of clinical trials Christian Gluud Copenhagen Trial Unit Centre for Clinical Intervention Research Rigshospitalet.](https://reader036.fdocuments.net/reader036/viewer/2022062517/56649e7a5503460f94b7b091/html5/thumbnails/68.jpg)
Deeks et al (2003) and the International Stroke Trial
Deeks et al. resample 100 pts/group making
- Small randomised trials (n=14,000) from
randomised groups within centres
- Small controlled cohort studies (n=14,000)
from two centres
![Page 69: Assessment of methodological quality and outcomes of clinical trials Christian Gluud Copenhagen Trial Unit Centre for Clinical Intervention Research Rigshospitalet.](https://reader036.fdocuments.net/reader036/viewer/2022062517/56649e7a5503460f94b7b091/html5/thumbnails/69.jpg)
Deeks et al. 2003
Randomised clinical trials
![Page 70: Assessment of methodological quality and outcomes of clinical trials Christian Gluud Copenhagen Trial Unit Centre for Clinical Intervention Research Rigshospitalet.](https://reader036.fdocuments.net/reader036/viewer/2022062517/56649e7a5503460f94b7b091/html5/thumbnails/70.jpg)
Deeks et al. 2003
Controlled cohort studies
![Page 71: Assessment of methodological quality and outcomes of clinical trials Christian Gluud Copenhagen Trial Unit Centre for Clinical Intervention Research Rigshospitalet.](https://reader036.fdocuments.net/reader036/viewer/2022062517/56649e7a5503460f94b7b091/html5/thumbnails/71.jpg)
Deeks et al. 2003
Controlled cohort studies
Logistic regression
![Page 72: Assessment of methodological quality and outcomes of clinical trials Christian Gluud Copenhagen Trial Unit Centre for Clinical Intervention Research Rigshospitalet.](https://reader036.fdocuments.net/reader036/viewer/2022062517/56649e7a5503460f94b7b091/html5/thumbnails/72.jpg)
Deeks et al. 2003
Controlled cohort studies
Propensityscores
![Page 73: Assessment of methodological quality and outcomes of clinical trials Christian Gluud Copenhagen Trial Unit Centre for Clinical Intervention Research Rigshospitalet.](https://reader036.fdocuments.net/reader036/viewer/2022062517/56649e7a5503460f94b7b091/html5/thumbnails/73.jpg)
Meta-analysis of several trials
Low risk of bias
High risk of bias
Overall
![Page 74: Assessment of methodological quality and outcomes of clinical trials Christian Gluud Copenhagen Trial Unit Centre for Clinical Intervention Research Rigshospitalet.](https://reader036.fdocuments.net/reader036/viewer/2022062517/56649e7a5503460f94b7b091/html5/thumbnails/74.jpg)
Ratio of odds ratios (ROR)Ratio of odds ratios (ROR)
Odds ratio of trials with unclear or inadequateOdds ratio of trials with unclear or inadequate
component (high risk of bias)component (high risk of bias)
divided bydivided by
odds ratio of trials with adequate odds ratio of trials with adequate
component (low risk of bias)component (low risk of bias)
![Page 75: Assessment of methodological quality and outcomes of clinical trials Christian Gluud Copenhagen Trial Unit Centre for Clinical Intervention Research Rigshospitalet.](https://reader036.fdocuments.net/reader036/viewer/2022062517/56649e7a5503460f94b7b091/html5/thumbnails/75.jpg)
Control of selection bias
Generation of the allocation sequence
• Low risk of bias Computer system, table of random numbers, or similar
• High risk of bias Not described or quasi-randomised (excluded)
![Page 76: Assessment of methodological quality and outcomes of clinical trials Christian Gluud Copenhagen Trial Unit Centre for Clinical Intervention Research Rigshospitalet.](https://reader036.fdocuments.net/reader036/viewer/2022062517/56649e7a5503460f94b7b091/html5/thumbnails/76.jpg)
BRANDO Sequence generation
• 112 meta-analyses with
• 944 randomised clinical trials
• 696 (73.7%) with high risk of bias
• ROR 0.89 (95% CI 0.82 to 0.96)
![Page 77: Assessment of methodological quality and outcomes of clinical trials Christian Gluud Copenhagen Trial Unit Centre for Clinical Intervention Research Rigshospitalet.](https://reader036.fdocuments.net/reader036/viewer/2022062517/56649e7a5503460f94b7b091/html5/thumbnails/77.jpg)
Control of selection bias
Allocation concealment
• Low risk of bias Central independent unit, sealed envelopes (only if perfect placebo)
• High risk of bias Not described or open table of random numbers
![Page 78: Assessment of methodological quality and outcomes of clinical trials Christian Gluud Copenhagen Trial Unit Centre for Clinical Intervention Research Rigshospitalet.](https://reader036.fdocuments.net/reader036/viewer/2022062517/56649e7a5503460f94b7b091/html5/thumbnails/78.jpg)
BRANDO Allocation concealment
• 146 meta-analyses with
• 1292 randomised clinical trials
• 916 (70.9%) with high risk of bias
• ROR 0.93 (95% CI 0.87 to 0.99)
![Page 79: Assessment of methodological quality and outcomes of clinical trials Christian Gluud Copenhagen Trial Unit Centre for Clinical Intervention Research Rigshospitalet.](https://reader036.fdocuments.net/reader036/viewer/2022062517/56649e7a5503460f94b7b091/html5/thumbnails/79.jpg)
Control of detection bias(reporting bias and observer bias)
Blinding
• Low risk of bias Identical placebo or comparator
• High risk of bias Not described or not blinded
![Page 80: Assessment of methodological quality and outcomes of clinical trials Christian Gluud Copenhagen Trial Unit Centre for Clinical Intervention Research Rigshospitalet.](https://reader036.fdocuments.net/reader036/viewer/2022062517/56649e7a5503460f94b7b091/html5/thumbnails/80.jpg)
BRANDO Blinding
• 104 meta-analyses with
• 1057 randomised clinical trials
• 467 (44.2%) with high risk of bias
• ROR 0.87 (95% CI 0.79 to 0.96)