CRITICAL APPRAISAL OF DIAGNOSTIC ARTICLE

64
10/5/2009 1 CRITICAL APPRAISAL OF DIAGNOSTIC ARTICLE

description

JOURNAL CLUB. CRITICAL APPRAISAL OF DIAGNOSTIC ARTICLE. ALI A. ALBALUSHI EMERGENCY MEDICINE R- 4. Does End Tidal CO2 Monitoring During Emergency Department Procedural Sedation and Analgesia With Propofol Decrease the Incidence of Hypoxic Events?. Randomized, Controlled Trial. - PowerPoint PPT Presentation

Transcript of CRITICAL APPRAISAL OF DIAGNOSTIC ARTICLE

Page 1: CRITICAL APPRAISAL OF DIAGNOSTIC ARTICLE

10/5/2009 1

CRITICAL APPRAISAL OF DIAGNOSTIC

ARTICLE

Page 2: CRITICAL APPRAISAL OF DIAGNOSTIC ARTICLE

10/5/2009 2

Does End Tidal CO2 Monitoring During Emergency Department

Procedural Sedation and Analgesia With Propofol Decrease the

Incidence of Hypoxic Events?

Annals of Emergency Medicine

Article in Press, 2009

Randomized, Controlled Trial

Page 3: CRITICAL APPRAISAL OF DIAGNOSTIC ARTICLE

310/5/2009

Learning Objectives

Introduction Discussion of the article Critical appraisal of the article Important calculations Overview on LR

Page 4: CRITICAL APPRAISAL OF DIAGNOSTIC ARTICLE

410/5/2009

Introduction

Procedural sedation & analgesia for management of acute procedural pain & anxiety in the (ED) is part of core competency in emergency medicine.

A.C.E.P & A.S.A recommend continuous monitoring of PR & rhythm, RR, BP, & pulse oximetry during moderate and deep sedation

Page 5: CRITICAL APPRAISAL OF DIAGNOSTIC ARTICLE

510/5/2009

Introduction

Use of real-time capnography as adjunct to current procedural sedation safety and monitoring practice is under increasing scrutiny.

Capnography noninvasively measures the partial pressure of CO2 in exhaled breath & is tightly correlated with arterial CO2 in patients with normal lung function

Page 6: CRITICAL APPRAISAL OF DIAGNOSTIC ARTICLE

610/5/2009

Introduction

Minute ventilation is depressed by sedatives by reducing respiratory rate or tidal volume.

Respiratory depression may produce hypercapnia (RR > VT ) or hypocapnia (VT > RR )

Page 7: CRITICAL APPRAISAL OF DIAGNOSTIC ARTICLE

710/5/2009

Introduction

There is now compelling evidence that capnography identifies respiratory depression well before the onset of hypoxia.

This modality should allow physicians to intervene to improve ventilatory status.

Page 8: CRITICAL APPRAISAL OF DIAGNOSTIC ARTICLE

810/5/2009

Importance

Although pulse oximetry, PR, and BP monitoring are considered routine practice during ED procedural sedation & analgesia, capnography is not.

If the addition of capnography helps physicians reduces hypoxia, then perhaps it should also be routine.

Page 9: CRITICAL APPRAISAL OF DIAGNOSTIC ARTICLE

910/5/2009

Goal of Study

determine whether physician use of real-time capnography is associated with a 15% decrease in the incidence of hypoxia compared with standard monitoring alone during ED procedural sedation with propofol

Page 10: CRITICAL APPRAISAL OF DIAGNOSTIC ARTICLE

10/5/2009 10

Materials & Methods

Page 11: CRITICAL APPRAISAL OF DIAGNOSTIC ARTICLE

1110/5/2009

Study Design

prospective, randomized controlled trial conducted from November 2006 to February 2008.

Page 12: CRITICAL APPRAISAL OF DIAGNOSTIC ARTICLE

1210/5/2009

Setting & Selection of Participants

Study was conducted at Albert Einstein Medical Center, a 600-bed teaching hospital located in Philadelphia, with an annual ED census of 75,000 patients.

Enrolled consecutive (24 hours a day, 7 days a week) adults >18 years & selected for propofol sedation in accordance with their usual practice

Page 13: CRITICAL APPRAISAL OF DIAGNOSTIC ARTICLE

1310/5/2009

Setting & Selection of Participants

Exclusion critiria:* severe chronic obstructive pulmonary disease; * chronic oxygen requirements;* hemodynamic instability;* respiratory distress;* pregnancy; *Inability to provide informed consent; * allergy to propofol, morphine, or fentanyl (or other components of its formulation); * or if, in judgment of the attending emergency physician, procedural sedation could compromise patient safety. Informed consent was obtained from each subject.

Page 14: CRITICAL APPRAISAL OF DIAGNOSTIC ARTICLE

1410/5/2009

Setting & Selection of Participants

Pts randomly assigned to study group (standard monitoring and capnography) or control group (standard monitoring and blinded capnography) by research associates using computer-generated randomization list.

Research associates & treating physicians were blinded to the randomization choice until after enrollment.

Page 15: CRITICAL APPRAISAL OF DIAGNOSTIC ARTICLE

1510/5/2009

Setting & Selection of Participants

Inaddition to standard electronic monitoring, they attached a Capnostream 20 monitor, using a nasal-oral CO2 cannula capable of delivering compressed gasses, with an oral sampling port to accommodate mouth breathers

Page 16: CRITICAL APPRAISAL OF DIAGNOSTIC ARTICLE

1610/5/2009

Setting & Selection of Participants

Capnostream 20 monitor displays oximetry and CO2 waveform and calculates ETCO2.

All patients had capnography; for the blinded (control) group, the monitor

screen was adjusted to permit visualization only by the research associate.

Page 17: CRITICAL APPRAISAL OF DIAGNOSTIC ARTICLE

1710/5/2009

Setting & Selection of Participants

All patients received supplemental oxygen at 3 L/minute by nasal cannula.

If the treating physician wished to deliver additional oxygen during the sedation, a nonrebreather mask connected to wall oxygen at 15 L/minute was placed over the cannula.

All patients received 0.5 g/kg of fentanyl or 0.05 mg/kg of morphine for analgesia no fewer than 30 minutes before administration of propofol for sedation.

Page 18: CRITICAL APPRAISAL OF DIAGNOSTIC ARTICLE

1810/5/2009

Setting & Selection of Participants

They started with propofol 1 mg/kg, administering additional boluses of 0.5 mg/kg until desired level of sedation was achieved.

Patients closely monitored from the initiation of sedation until they were back to their baseline alertness and ready for discharge.

Page 19: CRITICAL APPRAISAL OF DIAGNOSTIC ARTICLE

1910/5/2009

Data Collection and Processing

Data were collected by trained research associates, physicians who had participated in previous sedation studies & had no duties other than patient enrollment and data recording.

They were trained in procedural sedation & analgesia, study protocol and its definitions, all monitoring devices, and signs of respiratory depression.

Page 20: CRITICAL APPRAISAL OF DIAGNOSTIC ARTICLE

2010/5/2009

Data Collection and Processing

They recorded age, sex, medical history, Rx, allergies, types of procedures performed, vital signs, & sedation and procedure times on a standardized data collection instrument.

The patient’s level of alertness was assessed at baseline, 90 s after preprocedure drug administration, & before discharge, using a modified Ramsay scale

Page 21: CRITICAL APPRAISAL OF DIAGNOSTIC ARTICLE

2110/5/2009

Data Collection and Processing

Before the study, physicians & nurses trained in identification of respiratory depression with capnography

Treating physicians were instructed to perform procedural sedation and analgesia according to standard protocol

Any intervention for an adverse event should be based on their judgment and clinical expertise with or without capnography, depending on randomization arm.

Page 22: CRITICAL APPRAISAL OF DIAGNOSTIC ARTICLE

2210/5/2009

Data Collection and Processing

Capnostream 20 records data electronically every 5 seconds during course of each sedation,

Research associates used electronic marking and time stamping to record specific events such as drug administration, beginning and end of procedure, and point of readiness for discharge

Page 23: CRITICAL APPRAISAL OF DIAGNOSTIC ARTICLE

2310/5/2009

Data Collection and Processing

They noted time and nature of any intervention for respiratory depression or hypoxia, such as verbal or physical stimulation, airway realignment, use of additional oxygen, and the use of airway adjuncts, assisted ventilation, or intubation.

Research associates manually recorded other sedation-associated adverse events, including hypotension, bradycardia, arrhythmia, vomiting, prolonged ED stay, or admission

Page 24: CRITICAL APPRAISAL OF DIAGNOSTIC ARTICLE

2410/5/2009

Outcome Measures

Electronic data from each sedation were downloaded from the monitor into a Microsoft Excel 2000 database & were checked for any discrepancies, with handwritten notations taken by the research associates.

printed time evaluation graph of the patient’s sedation was then produced

Page 25: CRITICAL APPRAISAL OF DIAGNOSTIC ARTICLE

2510/5/2009

Outcome Measures

Page 26: CRITICAL APPRAISAL OF DIAGNOSTIC ARTICLE

2610/5/2009

Outcome Measures

Before study blinding was broken, 3 investigators evaluated each graph to code the presence or absence of hypoxia & respiratory depression.

Hypoxia was defined a priori as an SpO2 level of less than 93% for 15 seconds or greater.

Respiratory depression was defined a priori as an ETCO2 level of 50 mm Hg or greater, an absolute increase or decrease from baseline of 10% or greater, or a loss of waveform for 15 seconds or greater

Page 27: CRITICAL APPRAISAL OF DIAGNOSTIC ARTICLE

2710/5/2009

Outcome Measures

Grafs disqualified if they had greater than 35% data loss, unless all 3 evaluators agreed that there was unequivocal evidence of hypoxia or respiratory depression.

Lost data were typically due to patient movement (ie, dislodgement of the cannula) or blood pressure cuff insufflation.

Page 28: CRITICAL APPRAISAL OF DIAGNOSTIC ARTICLE

2810/5/2009

Primary Data Analysis

Data analyzed descriptively & using χ2, with P<.05 considered significant. All analyses were with SPSS version 10.

Previous research has reported rates of hypoxia during ED propofol sedation ranging from 15% to 30%.

To identify a 15% decrease in hypoxia from a 20% presumed baseline, they calculated that they would need 72 pts in each arm (assuming a 1-tailed analysis, a power of 80%, and an α of 5%).

Page 29: CRITICAL APPRAISAL OF DIAGNOSTIC ARTICLE

10/5/2009 29

RESULTS

Page 30: CRITICAL APPRAISAL OF DIAGNOSTIC ARTICLE

3010/5/2009

Characteristics of Study Subjects

Page 31: CRITICAL APPRAISAL OF DIAGNOSTIC ARTICLE

3110/5/2009

Characteristics of Study Subjects

Page 32: CRITICAL APPRAISAL OF DIAGNOSTIC ARTICLE

3210/5/2009

Main Results

Page 33: CRITICAL APPRAISAL OF DIAGNOSTIC ARTICLE

3310/5/2009

Main Results

majority of patients who developed respiratory depression had an ETCO2 change greater than 10% from baseline

loss of waveform was most likely to lead to hypoxia.

Page 34: CRITICAL APPRAISAL OF DIAGNOSTIC ARTICLE

3410/5/2009

Main Results

• With capnography there were more physician interventions to improve respiratory status, 24 of 68 (35%) versus 14 of 64 (22%; difference 13%; 95% CI –2% to 27%)

Page 35: CRITICAL APPRAISAL OF DIAGNOSTIC ARTICLE

3510/5/2009

Limitations

They had a higher-than-expected disqualification rate, leaving slightly less than calculated 72 patients per group for analysis.

However, they found a significant difference in their main outcome, and thus the study was not underpowered

Page 36: CRITICAL APPRAISAL OF DIAGNOSTIC ARTICLE

3610/5/2009

Limitations

The observed rate of hypoxia (32.5%) was higher than that observed in most other studies of propofol for ED procedural sedation.

A rate of hypoxia more consistent with previous studies may have produced a smaller, nonsignificant difference between groups

Page 37: CRITICAL APPRAISAL OF DIAGNOSTIC ARTICLE

3710/5/2009

Limitations

possibly that the continuous electronic data collection using the Capnostream 20 influenced the rate of hypoxia because it would detect episodes that might otherwise be missed through recording only at spaced intervals or through human inattention or error.

Page 38: CRITICAL APPRAISAL OF DIAGNOSTIC ARTICLE

3810/5/2009

Limitations

unlikely that any device error contributed to the higher-than-expected rates of hypoxia and respiratory depression

It is possible that, if the clinicians had used greater amounts of supplemental oxygen, there would have been less overall hypoxia

Page 39: CRITICAL APPRAISAL OF DIAGNOSTIC ARTICLE

3910/5/2009

Limitations

They chose a priori an SpO2 of 93% as baseline level for hypoxia because they believe that most physicians will pay close attention and potentially intervene at this level.

A lower threshold would have resulted in less overall hypoxia.

Page 40: CRITICAL APPRAISAL OF DIAGNOSTIC ARTICLE

4010/5/2009

Discussion

Rate of hypoxic events decreased by using capnography in conjunction with standard monitoring. (17%)

Capnographic respiratory depression occurred before the onset of hypoxia and was temporally linked to subsequent hypoxic events.

Page 41: CRITICAL APPRAISAL OF DIAGNOSTIC ARTICLE

4110/5/2009

Discussion

every patient who developed hypoxia had a corresponding ETCO2 change.

the increased sensitivity of the near-continuous electronic data capture with the Capnostream 20 allowed to measure this effect.

Page 42: CRITICAL APPRAISAL OF DIAGNOSTIC ARTICLE

4210/5/2009

Discussion

Capnography can provide early warning of ventilatory abnormalities, alerting physicians to respiratory depression before the onset of a hypoxic event.

Using capnography in this study, emergency physicians improved pt safety by decreasing rate of hypoxic events ass. with procedural sedation & analgesia

Page 43: CRITICAL APPRAISAL OF DIAGNOSTIC ARTICLE

4310/5/2009

Discussion

a number of patients had respiratory depression & hypoxia & treating physician did not intervene, with the episodes resolving spontaneously.

If every incidence of respiratory depression had led to an intervention, it is possible that there would have been less hypoxia

Page 44: CRITICAL APPRAISAL OF DIAGNOSTIC ARTICLE

4410/5/2009

Page 45: CRITICAL APPRAISAL OF DIAGNOSTIC ARTICLE

10/5/2009 45

1. Are the results in the study valid ?

Page 46: CRITICAL APPRAISAL OF DIAGNOSTIC ARTICLE

4610/5/2009

Primary Guide

Was there an independent, blind comparison with a reference standard ?

Did the pt sample include an appropriate spectrum of pts to whom the diagnostic test will be applied in the clinical practice ?

Page 47: CRITICAL APPRAISAL OF DIAGNOSTIC ARTICLE

4710/5/2009

Secondary guide

Did the results of the test being evaluated influence the decision to perform the reference standard ?

Were the methods for performing the test described in sufficient detail to permit replication ?

Page 48: CRITICAL APPRAISAL OF DIAGNOSTIC ARTICLE

10/5/2009 48

What are the results?

Are LR for the test results presented or data neccessery for their calculation provided ?

Page 49: CRITICAL APPRAISAL OF DIAGNOSTIC ARTICLE

4910/5/2009

Hypoxia

+

Hypoxia

-

totals

R.D

+

17

a

22

b

39

a+b

R.D

-

0

c

29

d

29

c+d

totals 17

a+c

51

b+d

68

a+b+c+d

Page 50: CRITICAL APPRAISAL OF DIAGNOSTIC ARTICLE

5010/5/2009

Results Sensitivity = a /a+c

(TP among diseased)

= 17 / 17 = 1 = 100%

Specificity = d /b+d

(TN among non diseased)

= 29 / 51 = 0.57 = 57%

Page 51: CRITICAL APPRAISAL OF DIAGNOSTIC ARTICLE

5110/5/2009

Results PPV = a /a+b (TP among all Positives) = 17 / 39 = 0.44 = 44% NPV= d /c+d (TN among all Negatives) = 29 / 29 = 1 = 100% LH+ = (sens) / (1 - spec ) = 100 / 43 = 2.3 LR- = (1-sens) / (spec) = 0

Page 52: CRITICAL APPRAISAL OF DIAGNOSTIC ARTICLE

5210/5/2009

Results Prevalence = (a+c) / (a+b+c+d)

= 17 / 68 = 25 % Pre-test odds = prevalence / (1-prevalence)

= 25 / 75 = 0.33

Post-test odds = pre-test odds * LR

for (+) = 0.33 X 2.3 = 0.79

for (-) = 0.0.33 X 0 = 0 Post-test Probability = post-test odds / (post-test odds

+ 1) = 0.43 = 44 %

Page 53: CRITICAL APPRAISAL OF DIAGNOSTIC ARTICLE

5310/5/2009

Page 54: CRITICAL APPRAISAL OF DIAGNOSTIC ARTICLE

5410/5/2009

Page 55: CRITICAL APPRAISAL OF DIAGNOSTIC ARTICLE

10/5/2009 55

Will the results help me in caring for my patients ?

Page 56: CRITICAL APPRAISAL OF DIAGNOSTIC ARTICLE

5610/5/2009

Will the reproducibility of the test results & its interpretation be satisfactory in my setting ?

Are the results applicable to my patients ?

Will the results change my management ?

Will patients be better off as a result of the test ?

Page 57: CRITICAL APPRAISAL OF DIAGNOSTIC ARTICLE

5710/5/2009

Page 58: CRITICAL APPRAISAL OF DIAGNOSTIC ARTICLE

5810/5/2009

Definition

(LR) is the likelihood that a given test result would be expected in a patient with the target disorder compared to the likelihood that that same result would be expected in a patient without the target disorder

Page 59: CRITICAL APPRAISAL OF DIAGNOSTIC ARTICLE

5910/5/2009

LH ratio for a positive result (LR+) tells you how much the odds of the disease increase when a test is positive.

LH ratio for a negative result (LR-) tells you how much the odds of the disease decrease when a test is negative.

Page 60: CRITICAL APPRAISAL OF DIAGNOSTIC ARTICLE

6010/5/2009

Depending on article or source, a single LR might be presented without reference to “positive” or “negative”

Page 61: CRITICAL APPRAISAL OF DIAGNOSTIC ARTICLE

6110/5/2009

LR = 1 means the post-test probability is exactly the same as the pre-test probability

LR > 1 increases the probability that the target disorder is present

LR < 1 decreases the probability that the target disorder is present

Page 62: CRITICAL APPRAISAL OF DIAGNOSTIC ARTICLE

6210/5/2009

Page 63: CRITICAL APPRAISAL OF DIAGNOSTIC ARTICLE

6310/5/2009

Applications LR is used to assess how good a diagnostic test

is and to help in selecting an appropriate diagnostic test(s) or sequence of tests.

They have advantages over sensitivity and specificity because:

they are less likely to change with the prevalence of the disorder,

they can be calculated for several levels of the symptom/sign or test,

they can be used to combine the results of multiple diagnostic test

can be used to calculate post-test probability for a target disorder

Page 64: CRITICAL APPRAISAL OF DIAGNOSTIC ARTICLE