116 (27%) 185 (43%) 49 (11%) How to critically appraise a systematic review Igho J. Onakpoya MD MSc...
-
Upload
doreen-austin -
Category
Documents
-
view
216 -
download
0
Transcript of 116 (27%) 185 (43%) 49 (11%) How to critically appraise a systematic review Igho J. Onakpoya MD MSc...
![Page 1: 116 (27%) 185 (43%) 49 (11%) How to critically appraise a systematic review Igho J. Onakpoya MD MSc University of Oxford Centre for Evidence-Based Medicine.](https://reader035.fdocuments.net/reader035/viewer/2022062519/5697c0061a28abf838cc56cc/html5/thumbnails/1.jpg)
116 (27%)185 (43%)
49 (11%)
How to critically appraise a systematic review
Igho J. Onakpoya MD MScUniversity of Oxford
Centre for Evidence-Based MedicineNuffield Department of Primary Care Health Sciences
![Page 2: 116 (27%) 185 (43%) 49 (11%) How to critically appraise a systematic review Igho J. Onakpoya MD MSc University of Oxford Centre for Evidence-Based Medicine.](https://reader035.fdocuments.net/reader035/viewer/2022062519/5697c0061a28abf838cc56cc/html5/thumbnails/2.jpg)
![Page 3: 116 (27%) 185 (43%) 49 (11%) How to critically appraise a systematic review Igho J. Onakpoya MD MSc University of Oxford Centre for Evidence-Based Medicine.](https://reader035.fdocuments.net/reader035/viewer/2022062519/5697c0061a28abf838cc56cc/html5/thumbnails/3.jpg)
![Page 4: 116 (27%) 185 (43%) 49 (11%) How to critically appraise a systematic review Igho J. Onakpoya MD MSc University of Oxford Centre for Evidence-Based Medicine.](https://reader035.fdocuments.net/reader035/viewer/2022062519/5697c0061a28abf838cc56cc/html5/thumbnails/4.jpg)
![Page 5: 116 (27%) 185 (43%) 49 (11%) How to critically appraise a systematic review Igho J. Onakpoya MD MSc University of Oxford Centre for Evidence-Based Medicine.](https://reader035.fdocuments.net/reader035/viewer/2022062519/5697c0061a28abf838cc56cc/html5/thumbnails/5.jpg)
Learning outcomes
Principles of critical appraisal of SRs
How to undertake critical appraisal of SRs
How to appraise published SRs
Assessing the relevance of published SRs
2 sessions Part I - Teaching (90 mins)
Part II - Class activity (90 mins)
1 short break in session 1 (5 mins)
15 minute break between sessions 1 and 2
![Page 6: 116 (27%) 185 (43%) 49 (11%) How to critically appraise a systematic review Igho J. Onakpoya MD MSc University of Oxford Centre for Evidence-Based Medicine.](https://reader035.fdocuments.net/reader035/viewer/2022062519/5697c0061a28abf838cc56cc/html5/thumbnails/6.jpg)
Opening scenarioMs X is a 35 year old banker with five children. She lost her dad who was hypertensive three years ago due to a heart attack. She is worried about her risk of having high blood pressure but does not want to take any conventional medicines because “they have lots of side effects”. Her close friend has told her to take green tea but she is not sure whether “it works”. She therefore wants your opinion on whether this a good idea.
![Page 7: 116 (27%) 185 (43%) 49 (11%) How to critically appraise a systematic review Igho J. Onakpoya MD MSc University of Oxford Centre for Evidence-Based Medicine.](https://reader035.fdocuments.net/reader035/viewer/2022062519/5697c0061a28abf838cc56cc/html5/thumbnails/7.jpg)
Get on the internet
![Page 8: 116 (27%) 185 (43%) 49 (11%) How to critically appraise a systematic review Igho J. Onakpoya MD MSc University of Oxford Centre for Evidence-Based Medicine.](https://reader035.fdocuments.net/reader035/viewer/2022062519/5697c0061a28abf838cc56cc/html5/thumbnails/8.jpg)
Let’s see PubMed Clinical Queries!
![Page 9: 116 (27%) 185 (43%) 49 (11%) How to critically appraise a systematic review Igho J. Onakpoya MD MSc University of Oxford Centre for Evidence-Based Medicine.](https://reader035.fdocuments.net/reader035/viewer/2022062519/5697c0061a28abf838cc56cc/html5/thumbnails/9.jpg)
Decide on which review/reviews meet your need .
![Page 10: 116 (27%) 185 (43%) 49 (11%) How to critically appraise a systematic review Igho J. Onakpoya MD MSc University of Oxford Centre for Evidence-Based Medicine.](https://reader035.fdocuments.net/reader035/viewer/2022062519/5697c0061a28abf838cc56cc/html5/thumbnails/10.jpg)
Actually, we have done ours too!
![Page 11: 116 (27%) 185 (43%) 49 (11%) How to critically appraise a systematic review Igho J. Onakpoya MD MSc University of Oxford Centre for Evidence-Based Medicine.](https://reader035.fdocuments.net/reader035/viewer/2022062519/5697c0061a28abf838cc56cc/html5/thumbnails/11.jpg)
What is a systematic review?
Systematic identification, appraisal and synthesis of the evidence from studies addressing the same research question.
![Page 12: 116 (27%) 185 (43%) 49 (11%) How to critically appraise a systematic review Igho J. Onakpoya MD MSc University of Oxford Centre for Evidence-Based Medicine.](https://reader035.fdocuments.net/reader035/viewer/2022062519/5697c0061a28abf838cc56cc/html5/thumbnails/12.jpg)
Why systematic reviews?In
crea
sing
stre
ngth
of e
vide
nce
Traditional (narrative) reviews
![Page 13: 116 (27%) 185 (43%) 49 (11%) How to critically appraise a systematic review Igho J. Onakpoya MD MSc University of Oxford Centre for Evidence-Based Medicine.](https://reader035.fdocuments.net/reader035/viewer/2022062519/5697c0061a28abf838cc56cc/html5/thumbnails/13.jpg)
Don’t accept the conclusions of every
systematic review hook, line and sinker!
![Page 14: 116 (27%) 185 (43%) 49 (11%) How to critically appraise a systematic review Igho J. Onakpoya MD MSc University of Oxford Centre for Evidence-Based Medicine.](https://reader035.fdocuments.net/reader035/viewer/2022062519/5697c0061a28abf838cc56cc/html5/thumbnails/14.jpg)
How to read a systematic review
Start with the title!
![Page 15: 116 (27%) 185 (43%) 49 (11%) How to critically appraise a systematic review Igho J. Onakpoya MD MSc University of Oxford Centre for Evidence-Based Medicine.](https://reader035.fdocuments.net/reader035/viewer/2022062519/5697c0061a28abf838cc56cc/html5/thumbnails/15.jpg)
Next step: Useful pneumonic
Q: Was there a clear research question?
F: Did they find all relevant studies?
A: Was study quality assessed?
S: Were the results adequately summarized?
![Page 16: 116 (27%) 185 (43%) 49 (11%) How to critically appraise a systematic review Igho J. Onakpoya MD MSc University of Oxford Centre for Evidence-Based Medicine.](https://reader035.fdocuments.net/reader035/viewer/2022062519/5697c0061a28abf838cc56cc/html5/thumbnails/16.jpg)
Step 1: Is there a clear and focussed research Question?
![Page 17: 116 (27%) 185 (43%) 49 (11%) How to critically appraise a systematic review Igho J. Onakpoya MD MSc University of Oxford Centre for Evidence-Based Medicine.](https://reader035.fdocuments.net/reader035/viewer/2022062519/5697c0061a28abf838cc56cc/html5/thumbnails/17.jpg)
Be sure of what you are looking for.
![Page 18: 116 (27%) 185 (43%) 49 (11%) How to critically appraise a systematic review Igho J. Onakpoya MD MSc University of Oxford Centre for Evidence-Based Medicine.](https://reader035.fdocuments.net/reader035/viewer/2022062519/5697c0061a28abf838cc56cc/html5/thumbnails/18.jpg)
Clear Question?
Participants
Intervention
Comparator
Outcome
![Page 19: 116 (27%) 185 (43%) 49 (11%) How to critically appraise a systematic review Igho J. Onakpoya MD MSc University of Oxford Centre for Evidence-Based Medicine.](https://reader035.fdocuments.net/reader035/viewer/2022062519/5697c0061a28abf838cc56cc/html5/thumbnails/19.jpg)
![Page 20: 116 (27%) 185 (43%) 49 (11%) How to critically appraise a systematic review Igho J. Onakpoya MD MSc University of Oxford Centre for Evidence-Based Medicine.](https://reader035.fdocuments.net/reader035/viewer/2022062519/5697c0061a28abf838cc56cc/html5/thumbnails/20.jpg)
Based on the paper Onakpoya et al.
Q: What is the PICO?
![Page 21: 116 (27%) 185 (43%) 49 (11%) How to critically appraise a systematic review Igho J. Onakpoya MD MSc University of Oxford Centre for Evidence-Based Medicine.](https://reader035.fdocuments.net/reader035/viewer/2022062519/5697c0061a28abf838cc56cc/html5/thumbnails/21.jpg)
P: Normotensive or hypertensive adults I: Green tea C: Placebo/identical controlsO: Blood pressure
![Page 22: 116 (27%) 185 (43%) 49 (11%) How to critically appraise a systematic review Igho J. Onakpoya MD MSc University of Oxford Centre for Evidence-Based Medicine.](https://reader035.fdocuments.net/reader035/viewer/2022062519/5697c0061a28abf838cc56cc/html5/thumbnails/22.jpg)
Step 2: How did they Find the studies?
1. Which databases were searched, how many?
2. Was the search period specified?
3. Was grey literature searched?
4. Did they contact study authors?
5. Did they search bibliography?
![Page 23: 116 (27%) 185 (43%) 49 (11%) How to critically appraise a systematic review Igho J. Onakpoya MD MSc University of Oxford Centre for Evidence-Based Medicine.](https://reader035.fdocuments.net/reader035/viewer/2022062519/5697c0061a28abf838cc56cc/html5/thumbnails/23.jpg)
F: How were studies included?
Independent determination of study eligibility
How many were eligible?
How many were excluded?
Were the reasons for exclusion reported?
Is there a list of excluded studies?
Resolution of disagreements
![Page 24: 116 (27%) 185 (43%) 49 (11%) How to critically appraise a systematic review Igho J. Onakpoya MD MSc University of Oxford Centre for Evidence-Based Medicine.](https://reader035.fdocuments.net/reader035/viewer/2022062519/5697c0061a28abf838cc56cc/html5/thumbnails/24.jpg)
Flow charts could be helpful
![Page 25: 116 (27%) 185 (43%) 49 (11%) How to critically appraise a systematic review Igho J. Onakpoya MD MSc University of Oxford Centre for Evidence-Based Medicine.](https://reader035.fdocuments.net/reader035/viewer/2022062519/5697c0061a28abf838cc56cc/html5/thumbnails/25.jpg)
QF
![Page 26: 116 (27%) 185 (43%) 49 (11%) How to critically appraise a systematic review Igho J. Onakpoya MD MSc University of Oxford Centre for Evidence-Based Medicine.](https://reader035.fdocuments.net/reader035/viewer/2022062519/5697c0061a28abf838cc56cc/html5/thumbnails/26.jpg)
Step 3: Did they Assess study quality?
Many quality assessment checklists available:
Cochrane
Jadad
CONSORT
STROBE
GRACE
![Page 27: 116 (27%) 185 (43%) 49 (11%) How to critically appraise a systematic review Igho J. Onakpoya MD MSc University of Oxford Centre for Evidence-Based Medicine.](https://reader035.fdocuments.net/reader035/viewer/2022062519/5697c0061a28abf838cc56cc/html5/thumbnails/27.jpg)
Quality rating can be subjective
![Page 28: 116 (27%) 185 (43%) 49 (11%) How to critically appraise a systematic review Igho J. Onakpoya MD MSc University of Oxford Centre for Evidence-Based Medicine.](https://reader035.fdocuments.net/reader035/viewer/2022062519/5697c0061a28abf838cc56cc/html5/thumbnails/28.jpg)
Onakpoya et al. The effect of cactus pear (Opuntia ficus-indica) on body weight and cardiovascular risk factors: a systematic review and meta-analysis of randomized clinical trials. Nutrition. 2015 May;31(5):640-6
Cochrane Assessing the risk of bias
![Page 29: 116 (27%) 185 (43%) 49 (11%) How to critically appraise a systematic review Igho J. Onakpoya MD MSc University of Oxford Centre for Evidence-Based Medicine.](https://reader035.fdocuments.net/reader035/viewer/2022062519/5697c0061a28abf838cc56cc/html5/thumbnails/29.jpg)
Step 4: Did they Summarize the evidence?
1. Did they extract results data from included studies?
2. Did they statistically combine the data?
3. Did it make sense to combine the data?
![Page 30: 116 (27%) 185 (43%) 49 (11%) How to critically appraise a systematic review Igho J. Onakpoya MD MSc University of Oxford Centre for Evidence-Based Medicine.](https://reader035.fdocuments.net/reader035/viewer/2022062519/5697c0061a28abf838cc56cc/html5/thumbnails/30.jpg)
Statistical data combination
http://www.cochrane.org/
![Page 31: 116 (27%) 185 (43%) 49 (11%) How to critically appraise a systematic review Igho J. Onakpoya MD MSc University of Oxford Centre for Evidence-Based Medicine.](https://reader035.fdocuments.net/reader035/viewer/2022062519/5697c0061a28abf838cc56cc/html5/thumbnails/31.jpg)
Basics of meta-analysis
Statistically combines data from individual studies: forest plot
Uses fixed or random effects model Can test for variations in trial designs and participants:
heterogeneity
Can test for publication bias: funnel plot
![Page 32: 116 (27%) 185 (43%) 49 (11%) How to critically appraise a systematic review Igho J. Onakpoya MD MSc University of Oxford Centre for Evidence-Based Medicine.](https://reader035.fdocuments.net/reader035/viewer/2022062519/5697c0061a28abf838cc56cc/html5/thumbnails/32.jpg)
What is a meta-analysis?
• A way to calculate an average
• Estimates an ‘average’ or ‘common’ effect
• Improves the precision of an estimate by using all available data
![Page 33: 116 (27%) 185 (43%) 49 (11%) How to critically appraise a systematic review Igho J. Onakpoya MD MSc University of Oxford Centre for Evidence-Based Medicine.](https://reader035.fdocuments.net/reader035/viewer/2022062519/5697c0061a28abf838cc56cc/html5/thumbnails/33.jpg)
What is a meta-analysis?
Optional part of a systematic review
Systematic reviews
Meta-analyses
![Page 34: 116 (27%) 185 (43%) 49 (11%) How to critically appraise a systematic review Igho J. Onakpoya MD MSc University of Oxford Centre for Evidence-Based Medicine.](https://reader035.fdocuments.net/reader035/viewer/2022062519/5697c0061a28abf838cc56cc/html5/thumbnails/34.jpg)
![Page 35: 116 (27%) 185 (43%) 49 (11%) How to critically appraise a systematic review Igho J. Onakpoya MD MSc University of Oxford Centre for Evidence-Based Medicine.](https://reader035.fdocuments.net/reader035/viewer/2022062519/5697c0061a28abf838cc56cc/html5/thumbnails/35.jpg)
At the bottom there’sa horizontal line. This is the scale measuringthe treatment effect.
![Page 36: 116 (27%) 185 (43%) 49 (11%) How to critically appraise a systematic review Igho J. Onakpoya MD MSc University of Oxford Centre for Evidence-Based Medicine.](https://reader035.fdocuments.net/reader035/viewer/2022062519/5697c0061a28abf838cc56cc/html5/thumbnails/36.jpg)
The vertical line in themiddle is where thetreatment and control have the same effect – there is no differencebetween the two
![Page 37: 116 (27%) 185 (43%) 49 (11%) How to critically appraise a systematic review Igho J. Onakpoya MD MSc University of Oxford Centre for Evidence-Based Medicine.](https://reader035.fdocuments.net/reader035/viewer/2022062519/5697c0061a28abf838cc56cc/html5/thumbnails/37.jpg)
For each study there is an id
The data foreach trial are here, divided into the experimental and control groups
This is the % weightgiven to thisstudy in the pooled analysis
![Page 38: 116 (27%) 185 (43%) 49 (11%) How to critically appraise a systematic review Igho J. Onakpoya MD MSc University of Oxford Centre for Evidence-Based Medicine.](https://reader035.fdocuments.net/reader035/viewer/2022062519/5697c0061a28abf838cc56cc/html5/thumbnails/38.jpg)
The label above the graph tells you what statistic has been used
The data shown in the graph are also given numerically
![Page 39: 116 (27%) 185 (43%) 49 (11%) How to critically appraise a systematic review Igho J. Onakpoya MD MSc University of Oxford Centre for Evidence-Based Medicine.](https://reader035.fdocuments.net/reader035/viewer/2022062519/5697c0061a28abf838cc56cc/html5/thumbnails/39.jpg)
The pooled analysis is given a diamond shapewhere the widest bit in the middle is located at the calculated best guess (point estimate), and the horizontal width is the confidence interval
Note on interpretation
If the confidence interval crosses the line of no effect, this is equivalent to saying that we have found no statistically significant difference in the effects of the two interventions
![Page 40: 116 (27%) 185 (43%) 49 (11%) How to critically appraise a systematic review Igho J. Onakpoya MD MSc University of Oxford Centre for Evidence-Based Medicine.](https://reader035.fdocuments.net/reader035/viewer/2022062519/5697c0061a28abf838cc56cc/html5/thumbnails/40.jpg)
trials
Confidence interval
Line of no effect
Overall effect
![Page 41: 116 (27%) 185 (43%) 49 (11%) How to critically appraise a systematic review Igho J. Onakpoya MD MSc University of Oxford Centre for Evidence-Based Medicine.](https://reader035.fdocuments.net/reader035/viewer/2022062519/5697c0061a28abf838cc56cc/html5/thumbnails/41.jpg)
Effect of green tea supplementation on systolic blood pressure (mmHg).
![Page 42: 116 (27%) 185 (43%) 49 (11%) How to critically appraise a systematic review Igho J. Onakpoya MD MSc University of Oxford Centre for Evidence-Based Medicine.](https://reader035.fdocuments.net/reader035/viewer/2022062519/5697c0061a28abf838cc56cc/html5/thumbnails/42.jpg)
Did the authors interpret the results correctly?
![Page 43: 116 (27%) 185 (43%) 49 (11%) How to critically appraise a systematic review Igho J. Onakpoya MD MSc University of Oxford Centre for Evidence-Based Medicine.](https://reader035.fdocuments.net/reader035/viewer/2022062519/5697c0061a28abf838cc56cc/html5/thumbnails/43.jpg)
![Page 44: 116 (27%) 185 (43%) 49 (11%) How to critically appraise a systematic review Igho J. Onakpoya MD MSc University of Oxford Centre for Evidence-Based Medicine.](https://reader035.fdocuments.net/reader035/viewer/2022062519/5697c0061a28abf838cc56cc/html5/thumbnails/44.jpg)
Beware of missing data!
![Page 45: 116 (27%) 185 (43%) 49 (11%) How to critically appraise a systematic review Igho J. Onakpoya MD MSc University of Oxford Centre for Evidence-Based Medicine.](https://reader035.fdocuments.net/reader035/viewer/2022062519/5697c0061a28abf838cc56cc/html5/thumbnails/45.jpg)
Appendix 1a: Funnel plot of mean differences plotted against sample size. The vertical line represents the mean difference for all trials.
![Page 46: 116 (27%) 185 (43%) 49 (11%) How to critically appraise a systematic review Igho J. Onakpoya MD MSc University of Oxford Centre for Evidence-Based Medicine.](https://reader035.fdocuments.net/reader035/viewer/2022062519/5697c0061a28abf838cc56cc/html5/thumbnails/46.jpg)
Based on the review findings what advice would you give Ms X?
And why?
![Page 47: 116 (27%) 185 (43%) 49 (11%) How to critically appraise a systematic review Igho J. Onakpoya MD MSc University of Oxford Centre for Evidence-Based Medicine.](https://reader035.fdocuments.net/reader035/viewer/2022062519/5697c0061a28abf838cc56cc/html5/thumbnails/47.jpg)
Questions to ponder on
Do the results appear valid and reliable?
How widely applicable are the study findings?
Are the results relevant to my local population?
Do the results apply to this patient/individual?
![Page 48: 116 (27%) 185 (43%) 49 (11%) How to critically appraise a systematic review Igho J. Onakpoya MD MSc University of Oxford Centre for Evidence-Based Medicine.](https://reader035.fdocuments.net/reader035/viewer/2022062519/5697c0061a28abf838cc56cc/html5/thumbnails/48.jpg)
Useful pneumonic
Q: Was there a clear research question?
F: Did they find all relevant studies?
A: Was study quality assessed?
S: Were the results adequately summarized?
![Page 49: 116 (27%) 185 (43%) 49 (11%) How to critically appraise a systematic review Igho J. Onakpoya MD MSc University of Oxford Centre for Evidence-Based Medicine.](https://reader035.fdocuments.net/reader035/viewer/2022062519/5697c0061a28abf838cc56cc/html5/thumbnails/49.jpg)
![Page 50: 116 (27%) 185 (43%) 49 (11%) How to critically appraise a systematic review Igho J. Onakpoya MD MSc University of Oxford Centre for Evidence-Based Medicine.](https://reader035.fdocuments.net/reader035/viewer/2022062519/5697c0061a28abf838cc56cc/html5/thumbnails/50.jpg)
Part II: Class activity
Critically appraise the systematic review: 45 minutes
2 groups will look at chlorogenic acids
2 groups will look at steviol glycosides
Nominate someone to present for your group
We re-group at 4:30 pm
5 minute presentation summary of your review
![Page 51: 116 (27%) 185 (43%) 49 (11%) How to critically appraise a systematic review Igho J. Onakpoya MD MSc University of Oxford Centre for Evidence-Based Medicine.](https://reader035.fdocuments.net/reader035/viewer/2022062519/5697c0061a28abf838cc56cc/html5/thumbnails/51.jpg)
Class activity
![Page 52: 116 (27%) 185 (43%) 49 (11%) How to critically appraise a systematic review Igho J. Onakpoya MD MSc University of Oxford Centre for Evidence-Based Medicine.](https://reader035.fdocuments.net/reader035/viewer/2022062519/5697c0061a28abf838cc56cc/html5/thumbnails/52.jpg)
Any Questions?
![Page 53: 116 (27%) 185 (43%) 49 (11%) How to critically appraise a systematic review Igho J. Onakpoya MD MSc University of Oxford Centre for Evidence-Based Medicine.](https://reader035.fdocuments.net/reader035/viewer/2022062519/5697c0061a28abf838cc56cc/html5/thumbnails/53.jpg)
Useful resources
Cochrane Handbook of Systematic Reviews of
Interventions [updated March 2011].
http://handbook.cochrane.org/
Gough D, Oliver S, Thomas J. An Introduction to
Systematic Reviews. SAGE Publications Ltd. 2012
PRISMA. Transparent Reporting of Systematic Reviews
and Meta-Analyses. http://
www.prisma-statement.org/index.htm
![Page 54: 116 (27%) 185 (43%) 49 (11%) How to critically appraise a systematic review Igho J. Onakpoya MD MSc University of Oxford Centre for Evidence-Based Medicine.](https://reader035.fdocuments.net/reader035/viewer/2022062519/5697c0061a28abf838cc56cc/html5/thumbnails/54.jpg)