Outcomes considered most important by emergency … ·  · 2017-08-23Outcomes considered most...

26
ORIGINAL RESEARCH ARTICLE Outcomes considered most important by emergency physicians when determining disposition of patients with pulmonary embolism Christopher Kabrhel & Weston Sacco & Shan Liu & Praveen Hariharan Received: 18 March 2010 / Accepted: 13 June 2010 / Published online: 19 October 2010 # The Author(s) 2010. This article is published with open access at Springerlink.com Abstract Purpose Clinical decision rules for the disposition of patients with pulmonary embolism (PE) are typically validated against an outcome of 30-day mortality or disease recurrence. There is little justification for this time frame, nor is it clear whether this outcome reflects emergency department (ED) decision making. Aims To determine which outcomes emergency physicians (EP) consider most relevant to disposition decisions. Methods Survey of attending EPs in geographically diverse US states using acute PE as the diagnostic framework. Responses required single-answer multiple choice, a nu- merical percentage, rank-ordered responses, or a five-point Likert scale. We distributed the survey via e-mail to 608 EPs. Results We received responses from 292 (48%) EPs: 88% board certified, 91% trained in emergency medicine, and 70% work in academics. Respondents reported discharging 1% of patients with PE from the ED, but 21% reported being asked to do so by an admitting service. EPs were more interested in knowing 5-day (in hospital) outcomes [192/265, 72% (95% exact CI=66%78%)] than 30-day outcomes [39/261, 15% (95% exact CI=11%20%)] or 90-day outcomes [29/263, 11% (95% exact CI=8%15%)]. On a Likert scale, 212/241 (88%, 95% exact CI=83%92%) agreed or strongly agreed that they considered 5-day (in hospital) clinical deterioration when making a decision to admit or discharge a patient from the ED compared to 184/242 (76%, 95% exact CI=70%81%) and 73/242 (30%, 95% exact CI=24%36%) for 30 and 90 days, respectively. A wide variety of clinical outcomes beyond death or recurrent PE were considered indicative of clinical deterioration. Conclusions Five-day (in hospital) outcomes that incorporate a variety of clinical deterioration events are of interest to EPs when determining the disposition of ED patients with PE. Researchers should consider this when developing and validating clinical decision rules. Keywords Clinical decision rule . Outcomes . Emergency department . Pulmonary embolism . Venous thromboembolism Introduction With every patient encounter, emergency physicians (EPs) must decide on an appropriate disposition. In some cases, disposition decisions are obviousclinically unstable patients must be admitted and patients with minor problems may be safely discharged from the Emergency Department (ED). However, for a large number of conditions, determining which patients are safe for outpatient treatment is more complex. Prospectively validated decision rules are available to help clinicians determine which patients with pneumonia, syncope, transient neurological attacks, pulmonary embolism The views expressed in this paper are those of the author(s) and not those of the editors, editorial board or publisher. C. Kabrhel (*) : S. Liu Department of Emergency Medicine, Massachusetts General Hospital, Harvard Medical School, Zero Emerson Place, Suite 3B, Boston, MA 02114, USA e-mail: [email protected] W. Sacco Davidson College, Davidson, NC, USA P. Hariharan Internal Medicine Residency Program, Boston University Medical Center, Boston, MA, USA Int J Emerg Med (2010) 3:239264 DOI 10.1007/s12245-010-0206-8

Transcript of Outcomes considered most important by emergency … ·  · 2017-08-23Outcomes considered most...

Page 1: Outcomes considered most important by emergency … ·  · 2017-08-23Outcomes considered most important by emergency physicians when determining disposition of patients ... (CI),

ORIGINAL RESEARCH ARTICLE

Outcomes considered most important by emergencyphysicians when determining disposition of patientswith pulmonary embolism

Christopher Kabrhel & Weston Sacco & Shan Liu &

Praveen Hariharan

Received: 18 March 2010 /Accepted: 13 June 2010 /Published online: 19 October 2010# The Author(s) 2010. This article is published with open access at Springerlink.com

AbstractPurpose Clinical decision rules for the disposition of patientswith pulmonary embolism (PE) are typically validated againstan outcome of 30-daymortality or disease recurrence. There islittle justification for this time frame, nor is it clear whetherthis outcome reflects emergency department (ED) decisionmaking.Aims To determine which outcomes emergency physicians(EP) consider most relevant to disposition decisions.Methods Survey of attending EPs in geographically diverseUS states using acute PE as the diagnostic framework.Responses required single-answer multiple choice, a nu-merical percentage, rank-ordered responses, or a five-pointLikert scale. We distributed the survey via e-mail to 608EPs.Results We received responses from 292 (48%) EPs: 88%board certified, 91% trained in emergency medicine, and70% work in academics. Respondents reported discharging1% of patients with PE from the ED, but 21% reportedbeing asked to do so by an admitting service. EPs weremore interested in knowing 5-day (in hospital) outcomes

[192/265, 72% (95% exact CI=66%–78%)] than 30-dayoutcomes [39/261, 15% (95% exact CI=11%–20%)] or90-day outcomes [29/263, 11% (95% exact CI=8%–15%)].On a Likert scale, 212/241 (88%, 95% exact CI=83%–92%) agreed or strongly agreed that they considered 5-day(in hospital) clinical deterioration when making a decisionto admit or discharge a patient from the ED compared to184/242 (76%, 95% exact CI=70%–81%) and 73/242(30%, 95% exact CI=24%–36%) for 30 and 90 days,respectively. A wide variety of clinical outcomes beyonddeath or recurrent PE were considered indicative of clinicaldeterioration.Conclusions Five-day (in hospital) outcomes that incorporatea variety of clinical deterioration events are of interest to EPswhen determining the disposition of ED patients with PE.Researchers should consider this when developing andvalidating clinical decision rules.

Keywords Clinical decision rule . Outcomes .

Emergency department . Pulmonary embolism .

Venous thromboembolism

Introduction

With every patient encounter, emergency physicians (EPs)must decide on an appropriate disposition. In some cases,disposition decisions are obvious—clinically unstablepatients must be admitted and patients with minor problemsmay be safely discharged from the Emergency Department(ED). However, for a large number of conditions, determiningwhich patients are safe for outpatient treatment is morecomplex.

Prospectively validated decision rules are available tohelp clinicians determine which patients with pneumonia,syncope, transient neurological attacks, pulmonary embolism

The views expressed in this paper are those of the author(s) and notthose of the editors, editorial board or publisher.

C. Kabrhel (*) : S. LiuDepartment of Emergency Medicine,Massachusetts General Hospital, Harvard Medical School,Zero Emerson Place, Suite 3B,Boston, MA 02114, USAe-mail: [email protected]

W. SaccoDavidson College,Davidson, NC, USA

P. HariharanInternal Medicine Residency Program,Boston University Medical Center,Boston, MA, USA

Int J Emerg Med (2010) 3:239–264DOI 10.1007/s12245-010-0206-8

Page 2: Outcomes considered most important by emergency … ·  · 2017-08-23Outcomes considered most important by emergency physicians when determining disposition of patients ... (CI),

(PE), and other conditions should be admitted to the hospitaland which patients are safe for discharge [1–7]. It is commonfor these rules to be validated against outcomes such as30-day mortality or disease recurrence. However, there islittle justification for this in the literature. Since few patientsare hospitalized for 30 days, it is not clear how thistime frame informs the decision to admit or discharge apatient. Narrowly defined outcomes such as death anddisease recurrence may not reflect the complexity of thedisposition decision either. Moreover, statistical models thatpredict all-cause mortality may unduly reflect factors with ahigh fatality rate (e.g., cancer), whether or not they areassociated with the diagnosis in question. Given these issues,it is not surprising that physicians tend not to be familiarwith clinical decision rules and use them infrequently inpractice [8].

We sought to determine which of three time frames EPsconsidered most relevant to the disposition of patients withPE. We also sought to determine whether different outcomes(including cardiopulmonary arrest, hypotension, hypoxia,need for respiratory support, need for thrombolysis, develop-ment of a cardiac dysrhythmia, and bleeding) were consideredmore relevant to disposition decisions than others. A betterunderstanding of the clinical decision making of EPs mayimprove our ability to develop decision rules that are useful topracticing clinicians.

Methods

We developed a survey to determine how different out-comes influence an EP’s decision to admit or dischargepatients from the ED. The survey was developed by two ofthe authors (Weston Sacco and Christopher Kabrhel). Thesurvey was designed to be anonymous, with respondentsbeing asked to create a coded unique identifier. Substantivequestions required: single-answer multiple choice; yes/no;input of a numerical percentage (0-100%); rank ordering of aseries of six responses (from most important to leastimportant); or completion of a five-point Likert scale.Distribution of the survey was approved by the InstitutionalReview Board of Partners Healthcare Inc.

Demographic information gathered included respondentage, training, and practice setting. We chose to use adiagnosis of PE as the diagnostic framework, and respond-ents were asked to consider a patient with a diagnosis ofacute PE when determining whether an event wouldrepresent clinical deterioration. The main goals of thesurvey were to determine: (1) which of three time frames(5, 30, and 90 days) EPs consider most relevant todetermining ED disposition; (2) which outcomes representclinical deterioration and (3) the degree to which theseoutcomes are considered relevant to disposition decisions.

For questions regarding the most appropriate time frame,respondents were provided the general instruction: “We aretrying to determine the most appropriate time frame forconsidering risk.” For questions assessing clinical deterio-ration, respondents were provided the general instruction:“We are trying to determine what events or interventionsdefine ‘clinical deterioration.’” In addition, for questionsassessing specific clinical events, and whether they repre-sent clinical deterioration, respondents were provided withthe following clinical scenario: “You have diagnosed anEmergency Department patient with Pulmonary Embolism(PE). The patient is currently stable, and you are decidingwhether to admit the patient or to discharge him/her fromthe Emergency Department” and the general instruction“We would like you to consider ‘clinical deterioration’events that would, if predictable, impact the ED dispositionof a patient with PE.” Respondents were then asked tocomplete the sentence: “I would consider a patient to havehad a clinical deterioration if….”

We inquired about outcomes occurring within threespecific time frames: 5 days, 30 days, and 90 days. Wechose 5 days to reflect an average length hospitalization fora patient with PE [9–11]. We chose 30 and 90 days becausethese time frames have been used to validate the pulmonaryembolism severity index in prior studies [7, 12–14].

During development, the survey was piloted serially onsix board-certified EPs using an iterative process to assessquestion clarity and completeness. Physicians in the pilotgroup were asked to identify any question that was unclearor vague, and to suggest improvements. Suggested changeswere incorporated until the physician felt each question wasclear and addressed the goal of the survey. Pilot physicianstook the survey, with revisions incorporated, two to threetimes each. The final survey was then uploaded to acommercially available online survey site (www.surveymonkey.com).

The survey was distributed to 608 attending EPs at 16institutions, including a mix of academic and communitypractices, located in 13 geographically diverse US states.Potential respondents were contacted three times in orderencourage completion of the survey. Informed consent wasimplied with completion of the survey.

Demographics are presented as simple means andproportions. Comparative analysis was performed bycomparing binomial proportions and exact 95% confidenceintervals (CI), with non-overlapping CIs considered signif-icantly different. In order to assess generalizability acrossacademic and community practice settings, we performed asensitivity analysis, limiting our analysis to respondents(n=86) who described their practice setting as a “communitymedical center” or “combined academic/community.” Allstatistical analyses were performed using SAS version 9.1(SAS Institute, Cary, NC).

240 Int J Emerg Med (2010) 3:239–264

Page 3: Outcomes considered most important by emergency … ·  · 2017-08-23Outcomes considered most important by emergency physicians when determining disposition of patients ... (CI),

Results

We received survey responses from 292 EPs, or 48% ofthose contacted. Demographic data describing respondentsare provided in Table 1. The vast majority of respondentsdid residency training in Emergency Medicine and wereboard certified. The majority of respondents worked inacademic medical centers, though a sizable percentageworked in combined academic/ community settings.

Respondents reported substantial experience diagnosingPE. Only 3/281 (1%) respondents had not diagnosed a PEwithin the last year, whereas 71 (25%) had diagnosed 1–5PEs, 100 (36%) had diagnosed 6–10 PEs, 45 (16%) haddiagnosed 11–15 PEs, 36 (13%) had diagnosed 15–20 PEs,and 26 (9%) had diagnosed more than 20 PEs in the pastyear. Respondents reported discharging a mean of 1% ofpatients with PE from the ED after diagnosis. Of the 83/281(30%) respondents who reported that they do sometimesdischarge patients with PE from the ED, only 9 (11%) said

they use a scoring system to decide which patients with PEare safe for discharge. When asked whether an admittingservice had ever suggested discharging a patient with PEfrom the ED, 59/282 (21%) said “Yes.”

When asked to rank order 5-, 30- and 90-day outcomes,192/265 (72%, 95% exact CI=66%–78%) ranked 5-day (inhospital) outcomes “most important,” whereas 39/261(15%, 95% exact CI=11%–20%) said 30 days, and 29/263 (11%, 95% exact CI=8%–15%) said 90 days (Fig. 1).Similarly, on a five-point Likert scale, 212/241 (88%, 95%exact CI=83%–92%) agreed/strongly agreed that theyconsidered 5-day (in hospital) clinical deterioration whenmaking a decision to admit or discharge a patient from theED compared to 184/242 (76%, 95% exact CI=70%–81%)who agreed/strongly agreed that they considered 30-dayclinical deterioration, and 73/242 (30%, 95% exact CI=24%–36%) who agreed/strongly agreed that they consid-ered 90-day clinical deterioration. When respondents wereasked to consider a patient who had no clinical deterioration

Descriptor Number responding (%) Characteristic (%)

Age 290 99.3%

<30 years 11 3.8%

30–39 years 141 48.6%

40–49 years 80 27.6%

50–59 years 39 13.4%

60–69 years 18 6.2%

≥70 years 1 0.3%

Board status 288 98.6%

Board certified 252 87.5%

Board eligible 36 12.5%

Residency training 283 96.9%

Emergency medicine 257 90.8%

General surgery or surgical specialty 4 1.4%

Internal medicine or medical specialty 18 6.4%

Pediatrics or pediatric specialty 4 1.4%

Other 11 3.9%

Clinical workload 289 99.0%

Full time 115 39.8%

75%–99% of full time 45 15.6%

50%–74% of full time 77 26.6%

25%–49% of full time 42 14.5%

<25% of full time 10 3.5%

Practice setting 287 98.3%

Academic medical center 201 70.0%

Community medical center 7 2.4%

Combination academic and community 79 27.5%

Emergency department observation unit 289 99.0%

Yes 194 67.1%

No 95 32.9%

Table 1 Demographiccharacteristics of respondents

Int J Emerg Med (2010) 3:239–264 241

Page 4: Outcomes considered most important by emergency … ·  · 2017-08-23Outcomes considered most important by emergency physicians when determining disposition of patients ... (CI),

throughout their hospitalization, but subsequently deterio-rated after discharge, 148/241 (61%, 95% exact CI=55%–68%) agreed/strongly agreed that the hospitalization wasjustified. Only 29/244 (12%, 95% exact CI=8%–17%) ofrespondents agreed/strongly agreed that clinical deteriorationwas “only important if it required treatment,” while 192/244 (79%, 95% exact CI=73%–84%) disagreed/stronglydisagreed with that statement.

We asked respondents which clinical events are indica-tive of clinical deterioration that would influence thedisposition decision for a patient with PE. All respondents[242/242, 100% (95% exact CI=98%–100%)] said thatcardiopulmonary arrest within 5 days represented clinicaldeterioration, though fewer said so if cardiopulmonaryarrest occurred within 30 days [210/241, 87% (95% exactCI=82%–91%)] or 90 days [127/238, 53% (95% exact CI=47%–60%)]. Hypotension was considered clinical deterio-ration by 237/237 (100%, 95% exact CI=98%–100%) if itrequired vasopressor therapy, 232/237 (98%, 95% exactCI=95%–99%) if it required volume resuscitation, and by168/232 (72%, 95% exact CI=66%–77%) if no treatmentwas required. The greatest number of respondents said thatif a patient’s room air oxygen saturation became less than90%, they would consider the patient to have had a clinicaldeterioration (Fig. 2a). Most respondents said that if asubject required any supplemental oxygen to maintain theSaO2, either at rest or with exercise, it represented clinicaldeterioration (Fig. 2b). Treatment with thrombolysis wasconsidered clinical deterioration by 214/242 (88%, 95%exact CI=84%–92%). Bleeding (intracranial, gastrointestinal,retroperitoneal, other major bleeding, or minor bleeding) wasconsidered clinical deterioration by >80% of respondents,regardless of type or whether treatment was required, with theexception of minor bleeding not requiring treatment [46/203,23% (95% exact CI=17%–28%)]. Similarly, all cardiac

dysrhythmias (bradycardia requiring treatment, reentrantsupraventricular tachycardia requiring treatment, atrialfibrillation/flutter, ventricular tachycardia) were consideredclinical deterioration by more than 90% of respondents, withthe exception of reentrant supraventricular tachycardia notrequiring treatment [158/207, 77% (95% exact CI=71%–82%)] and bradycardia not requiring treatment [80/204, 38%(95% exact CI=32%–45%)].

Finally, we asked respondents about factors that, whilenot indicative of clinical deterioration, might influencedisposition. On a five-point Likert scale, respondents saidthey were more/much more likely to admit patients>70 years old [200/240, 83% (95% exact CI=78%–88%)]and 50–69 years old [179/241, 74% (95% exact CI=68%–80%)], but not patients 30–49 years old [60/240, 25% (95%exact CI=19%–31%)] or <30 years old [42/241, 17% (95%exact CI=13%–23%)]. Other factors that made admissionmore/much more likely were: lack of family/friend supportat home [213/241, 88% (95% exact CI=84%–92%)];inability to return to hospital if further problems arise[232/241, 96% (95% exact CI=93%–98%)]; pregnancy[202/241, 84% (95% exact CI=79%–88%)]; recent surgery[182/239, 76% (95% exact CI=70%–81%)]; non-Englishspeaking [138/239, 58% (95% exact CI=51%–64%)]. Lackof insurance was less influential, with most respondents[131/241, 54% (95% exact CI=48%–61%)] being neutralon the question.

Sensitivity analysis

When we limited our analysis to the 86 respondents whodescribed their practice setting as either a communitymedical center or a combined academic/community setting,results were similar. When asked to rank order 5-, 30- and90-day outcomes, 65/83 (78%, 95% exact CI=68%–87%)ranked 5 day (in hospital) outcomes “most important,”while fewer [4/73, 5% (95% exact CI=2%–13%)] said30 days, and 2/69 (3%, 95% exact CI=0%–10%) said90 days. The results of all other analyses were similar toresponses overall (data not shown).

Discussion

In our survey, when determining the most appropriatedisposition of patients with PE, EPs were more interested inknowing 5-day (in hospital) clinical outcomes than 30- or90-day outcomes. This sentiment was apparent when thequestion was asked directly—with 5-day outcomes morethan four times more likely to be considered “mostimportant” than 30-day outcomes. It was also apparentwhen the question was asked indirectly—with only 61%

83

17 12

109

22 17

0

50

100

150

200

250

5 Day 30 Day 90 Day

n.

Death Death or Clinical Deterioration

192 (72%)

39 (15%) 29 (11%)

Fig. 1 Outcome time frame considered “most important” byrespondents. *While 273/292 respondents ranked at least one timeframe (i.e., 5, 30, or 90 days), 13 did not list any of the time frames at“most important,” leaving 260 responses available for this analysis

242 Int J Emerg Med (2010) 3:239–264

Page 5: Outcomes considered most important by emergency … ·  · 2017-08-23Outcomes considered most important by emergency physicians when determining disposition of patients ... (CI),

answering that hospitalization was justified if a patientremained stable while hospitalized but deteriorated afterdischarge. The importance of 5-day (in hospital) outcomeswas also apparent in the responses to questions aboutspecific clinical deterioration events. For example, thepercentage of EPs who responded that the risk ofcardiopulmonary arrest would influence the dispositiondecision declined from 100% when considering 5-day riskto 87% when considering 30-day risk and 53% whenconsidering 90-day risk. Our results suggest that while30- and 90-day outcomes have value, EPs find time framesthat reflect the length of a typical hospitalization morerelevant to their decision making.

Although the importance of in-hospital outcomes isintuitive and apparent from our survey, the use of suchshort-term clinical outcomes in the medical literature is rare[3, 4, 15]. Studies demonstrating that clinical factors andbiomarkers are associated short-term (10-15 day) adverseclinical events after PE have been published [16, 17],though to the authors’ knowledge, there are no outcomestudies in the PE literature that use a time frame reflectiveof a typical hospitalization. Our data suggest that EPs

would consider studies of outcomes occurring during anaverage length hospitalization highly relevant to theirdisposition decisions.

We also found that EPs consider a broad range of clinicalevents to be indicative of clinical deterioration and thatthese events inform the disposition decision. It is ourfeeling that studies that limit their outcomes to death ordisease recurrence oversimplify the disposition decisionmade by EPs every day. Our results suggest that in additionto outcomes that clearly represent clinical instability (e.g.,cardiopulmonary arrest), when determining the best dispo-sition of a patient with PE, EPs consider the need forrespiratory support, the risk of developing a dysrhythmia,hypoxia, hypotension, and, bleeding, even if those eventsdo not require treatment. In contrast, 12% of respondentsdid not consider treatment with thrombolysis indicative ofclinical deterioration. We did not ask respondents to explainthe rationale for their responses, so the reason for thisremains unclear. One possibility is that treatment withthrombolysis was felt to reflect a clinical decision ratherthan a measure of patient status. This finding warrantsfurther exploration.

0%

5%

10%

15%

20%

25%

30%

35%

40%

45%

50%

100% 98% 96% 94% 92% 90% 88% 86% 84% 82% 80%

Oxygen Saturation

% o

f Res

po

nd

ents

*At Rest With Exercise

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

2L 4L 6L 8L 10L NRB PPV

Supplemental Oxygen

% o

f R

esp

on

den

ts*

At Rest, to Maintain SaO2** At Rest, for Comfort***

With Exercise, to Maintain SaO2** With Exercise, for Comfort***

Fig. 2 a Oxygen saturation(SaO2) considered indicativeof clinical deterioration.b Supplemental oxygenconsidered indicative of clinicaldeterioration. Abbreviations:L = liters, NRB = non-rebreathermask, PPV = positive pressureventilation. *Results arestandardized according topercentage of respondentsanswering question. In a, 266and 240 respondents providedoxygen saturations indicative ofclinical deterioration at rest andwith exercise, respectively. Inb, between 198 and 241respondents stated whether agiven level of supplementaloxygen constituted clinicaldeterioration. **Supplementaloxygen required to maintain theoxygen saturation (SaO2) namedby the respondent as indicativeof clinical deterioration (seeFig. 1). ***Supplementaloxygen required to make thepatient “subjectively morecomfortable” even though notrequired to maintain oxygensaturation (SaO2)

Int J Emerg Med (2010) 3:239–264 243

Page 6: Outcomes considered most important by emergency … ·  · 2017-08-23Outcomes considered most important by emergency physicians when determining disposition of patients ... (CI),

We felt that questions related to clinical deterioration wouldbe difficult to answer unless physicians were provided with adiagnostic framework within which to consider their decision.We chose to use a patient with PE as the diagnostic framework.PE is a common diagnosis and is an entity with which mostEPs are familiar [18, 19]. PE is usually treated in the hospital,though outpatient treatment has gained traction in Europe andCanada, and patients with deep vein thromboses arecommonly treated as outpatients in the US [7, 13, 20–23].The fact that our respondents reported discharging a mean of1% of patients with PE from the ED supports this andshows that while ED discharge after PE remains rare, somepatients may be considered appropriate for discharge.

Understanding the factors that impact emergency depart-ment decision making, especially with regards to patientdisposition, is relevant for several reasons. Systemsdesigned to aid clinical decision making, improve patientcare, and increase cost-effectiveness are only useful if theyare adopted by practitioners. However, studies includingours have shown that clinical decision instruments areinfrequently applied to practice [8]. While clinical rules areundoubtedly difficult to use for a variety of reasons, webelieve that a clinical rule that poorly or partially reflectsthe concerns of the physician making the decision isunlikely to be adopted. The need for new outcomes specificto the practice of emergency medicine was highlighted atthe Future of Emergency Medicine Research Conferencemore than a decade ago [24, 25]. Despite this, we believethat our survey is the first to document the importance of abroad range of clinical outcomes, occurring in a clinicallyrelevant time frame, to EP decision making.

Limitations

There are several limitations of this study methodology thatdeserve mention. First, the recipients of this survey werechosen because they work in institutions that have a historyof working relationships with study investigators. There isdisproportionate representation towards academic centers inthe eastern portion of the United States. This may limit thegeneralizability of our results as survey responses may notreflect the opinions of community EPs. However, when welimited our analysis to respondents practicing in communityor combined academic/community settings, results weresimilar. Our response rate was moderate at 48%, but weacknowledge that our results may be biased towards thosephysicians inclined to complete surveys or otherwiseparticipate in research. We acknowledge that the relevanceof our data is particular to the question of disposition ofpatients with PE and does not necessarily inform disposi-tion decisions for patients with other diagnoses. Also, forclinical decision rules that address different concerns thandisposition, such as the likelihood of diagnosis, different

outcomes may be relevant. We only compared 5-, 30-, and90-day outcomes, so it is possible that there is a thresholdtime frame that would be more important to clinicians than5 days. It is also possible emergency physicians simplychose the time frame that was temporally closest to theirevaluation. However, we chose our time periods to reflect atypical hospitalization for PE (5 days) and time frames (30and 90 days) used previously in the medical literature tovalidate clinical decision rules. Each time respondents wereasked about a 5-day outcome, it was made clear that thisreflected an in-hospital outcome. Thus, we feel that ourresults reflect physicians’ impressions of outcomes occur-ring during a typical hospitalization versus those occurringafter discharge. While the vast majority of responses to ourquestions yielded consistent answers, we did find 34respondents who gave inconsistent responses on questionsabout the time frame they would most like to know (e.g.,choosing 5 days as the “most important” time frame, butstrongly disagreeing with the idea of considering a patient’srisk of clinical deterioration while in the hospital). It islikely the labeling of the ordinal system was misinterpretedby some respondents. To assess the impact of this, weperformed a sensitivity analysis excluding such inconsistentresponses, and again, a greater percentage chose 5-dayoutcomes as “most important” (data not shown). We alsosought to assess the importance of certain clinical outcomesspecific to PE. Most of these were amenable to discretecategorization. However, when piloting the survey wefound that respiratory parameters were particularly inter-twined with other factors (e.g., need for respiratory supportis determined by oxygen saturation, which is influenced byexercise and patient comfort). We therefore chose to divideour questions about respiratory parameters into severalquestions, but acknowledge that the lack of a singledescriptor of respiratory clinical deterioration is complex.

Conclusions

Five-day (in hospital) outcomes are of more interest to EPswhen determining the disposition of ED patients with PE thanlonger time frames. EPs also consider a wide variety of eventsindicative of clinical deterioration. Researchers should consid-er this when developing and validating clinical decision rules.

Conflicts of interest None.

Funding Source None

Open Access This article is distributed under the terms of theCreative Commons Attribution Noncommercial License which per-mits any noncommercial use, distribution, and reproduction in anymedium, provided the original author(s) and source are credited.

244 Int J Emerg Med (2010) 3:239–264

Page 7: Outcomes considered most important by emergency … ·  · 2017-08-23Outcomes considered most important by emergency physicians when determining disposition of patients ... (CI),

AppendixAppendix

Int J Emerg Med (2010) 3:239–264 245

Page 8: Outcomes considered most important by emergency … ·  · 2017-08-23Outcomes considered most important by emergency physicians when determining disposition of patients ... (CI),

246 Int J Emerg Med (2010) 3:239–264

Page 9: Outcomes considered most important by emergency … ·  · 2017-08-23Outcomes considered most important by emergency physicians when determining disposition of patients ... (CI),

Int J Emerg Med (2010) 3:239–264 247

Page 10: Outcomes considered most important by emergency … ·  · 2017-08-23Outcomes considered most important by emergency physicians when determining disposition of patients ... (CI),

248 Int J Emerg Med (2010) 3:239–264

Page 11: Outcomes considered most important by emergency … ·  · 2017-08-23Outcomes considered most important by emergency physicians when determining disposition of patients ... (CI),

Int J Emerg Med (2010) 3:239–264 249

Page 12: Outcomes considered most important by emergency … ·  · 2017-08-23Outcomes considered most important by emergency physicians when determining disposition of patients ... (CI),

250 Int J Emerg Med (2010) 3:239–264

Page 13: Outcomes considered most important by emergency … ·  · 2017-08-23Outcomes considered most important by emergency physicians when determining disposition of patients ... (CI),

Int J Emerg Med (2010) 3:239–264 251

Page 14: Outcomes considered most important by emergency … ·  · 2017-08-23Outcomes considered most important by emergency physicians when determining disposition of patients ... (CI),

252 Int J Emerg Med (2010) 3:239–264

Page 15: Outcomes considered most important by emergency … ·  · 2017-08-23Outcomes considered most important by emergency physicians when determining disposition of patients ... (CI),

Int J Emerg Med (2010) 3:239–264 253

Page 16: Outcomes considered most important by emergency … ·  · 2017-08-23Outcomes considered most important by emergency physicians when determining disposition of patients ... (CI),

254 Int J Emerg Med (2010) 3:239–264

Page 17: Outcomes considered most important by emergency … ·  · 2017-08-23Outcomes considered most important by emergency physicians when determining disposition of patients ... (CI),

Int J Emerg Med (2010) 3:239–264 255

Page 18: Outcomes considered most important by emergency … ·  · 2017-08-23Outcomes considered most important by emergency physicians when determining disposition of patients ... (CI),

256 Int J Emerg Med (2010) 3:239–264

Page 19: Outcomes considered most important by emergency … ·  · 2017-08-23Outcomes considered most important by emergency physicians when determining disposition of patients ... (CI),

Int J Emerg Med (2010) 3:239–264 257

Page 20: Outcomes considered most important by emergency … ·  · 2017-08-23Outcomes considered most important by emergency physicians when determining disposition of patients ... (CI),

258 Int J Emerg Med (2010) 3:239–264

Page 21: Outcomes considered most important by emergency … ·  · 2017-08-23Outcomes considered most important by emergency physicians when determining disposition of patients ... (CI),

Int J Emerg Med (2010) 3:239–264 259

Page 22: Outcomes considered most important by emergency … ·  · 2017-08-23Outcomes considered most important by emergency physicians when determining disposition of patients ... (CI),

260 Int J Emerg Med (2010) 3:239–264

Page 23: Outcomes considered most important by emergency … ·  · 2017-08-23Outcomes considered most important by emergency physicians when determining disposition of patients ... (CI),

Int J Emerg Med (2010) 3:239–264 261

Page 24: Outcomes considered most important by emergency … ·  · 2017-08-23Outcomes considered most important by emergency physicians when determining disposition of patients ... (CI),

262 Int J Emerg Med (2010) 3:239–264

Page 25: Outcomes considered most important by emergency … ·  · 2017-08-23Outcomes considered most important by emergency physicians when determining disposition of patients ... (CI),

Int J Emerg Med (2010) 3:239–264 263

Page 26: Outcomes considered most important by emergency … ·  · 2017-08-23Outcomes considered most important by emergency physicians when determining disposition of patients ... (CI),

References

1. Fine MJ et al (1997) A prediction rule to identify low-risk patientswith community-acquired pneumonia. N Engl J Med 336(4):243–250

2. Quinn J et al (2006) Prospective validation of the San FranciscoSyncope Rule to predict patients with serious outcomes. AnnEmerg Med 47(5):448–454

3. Quinn JV et al (2004) Derivation of the San Francisco SyncopeRule to predict patients with short-term serious outcomes. AnnEmerg Med 43(2):224–232

4. Rothwell PM et al (2005) A simple score (ABCD) to identifyindividuals at high early risk of stroke after transient ischaemicattack. Lancet 366(9479):29–36

5. Tsivgoulis G et al (2006) Validation of the ABCD score inidentifying individuals at high early risk of stroke after a transientischemic attack: a hospital-based case series study. Stroke 37(12):2892–2897

6. Aujesky D et al (2005) Derivation and validation of a prognosticmodel for pulmonary embolism. Am J Respir Crit Care Med 172(8):1041–1046

7. Aujesky D et al (2006) A prediction rule to identify low-risk patientswith pulmonary embolism. Arch Intern Med 166(2):169–175

8. Runyon MS, Richman PB, Kline JA (2007) Emergency medicinepractitioner knowledge and use of decision rules for the evaluationof patients with suspected pulmonary embolism: variations bypractice setting and training level. Acad Emerg Med 14(1):53–57

9. Hyers TM et al (2001) Antithrombotic therapy for venousthromboembolic disease. Chest 119(1 Suppl):176S–193S

10. Aujesky D et al (2008) Length of hospital stay and postdischargemortality in patients with pulmonary embolism: a statewideperspective. Arch Intern Med 168(7):706–712

11. Park B et al (2009) Recent trends in clinical outcomes and resourceutilization for pulmonary embolism in the United States: findingsfrom the nationwide inpatient sample. Chest 136(4):983–990

12. Jimenez D et al (2007) Prognostic models for selecting patientswith acute pulmonary embolism for initial outpatient therapy.Chest 132(1):24–30

13. Aujesky D et al (2007) Validation of a clinical prognostic modelto identify low-risk patients with pulmonary embolism. J InternMed 261(6):597–604

14. Nendaz MR et al (2004) Validation of a risk score identifyingpatients with acute pulmonary embolism, who are at low risk ofclinical adverse outcome. Thromb Haemost 91(6):1232–1236

15. Sun BC et al (2007) External validation of the San FranciscoSyncope Rule. Ann Emerg Med 49(4):420–427, 427 e1-4

16. Agterof MJ et al (2009) Risk stratification of patients withpulmonary embolism based on pulse rate and D-dimer concentration.Thromb Haemost 102(4):683–687

17. Lobo JL et al (2009) D-dimer levels and 15-day outcome in acutepulmonary embolism. Findings from the RIETE registry. JThromb Haemost

18. Heit JA (2005) Venous thromboembolism: disease burden, outcomesand risk factors. J Thromb Haemost 3(8):1611–1617

19. Silverstein MD et al (1998) Trends in the incidence of deep veinthrombosis and pulmonary embolism: a 25-year population-basedstudy. Arch Intern Med 158(6):585–593

20. Janjua M et al (2008) Treatment of acute pulmonary embolism asoutpatients or following early discharge. A systematic review.Thromb Haemost 100(5):756–761

21. Segal JB et al (2007) Management of venous thromboembolism: asystematic review for a practice guideline. Ann Intern Med 146(3):211–222

22. Stein PD, et al (2009) Early discharge of patients with venousthromboembolism: implications regarding therapy. Clin ApplThromb Hemost

23. Yeager BF, Matheny SC (1999) Low-molecular-weight heparin inoutpatient treatment of DVT. Am Fam Physician 59(4):945–952

24. Cairns CB et al (1998) Development of new methods to assess theoutcomes of emergency care. Acad Emerg Med 5(2):157–161

25. Courtney DM et al (2009) Unique characteristics of emergencycare research: scope, populations, and infrastructure. Acad EmergMed 16(10):990–994

Dr. Kabrhel is a graduate of the Johns Hopkins University School ofMedicine and the Harvard School of Public Health. He completedresidency training in Emergency Medicine at the Harvard AffiliatedEmergency Medicine Residency Program. The focus of Dr. Kabrhel’sresearch is the Emergency Department diagnosis and treatment ofacute pulmonary embolism (PE). He has received research fundingfrom the US National Institutes of Health and private foundations, andis a founding member of the Pulmonary Embolism ResearchConsortium. Dr. Kabrhel also collaborates with researchers at theChanning Laboratory to study the epidemiology of venous thromboticdisease in the Nurses’ Health Study and Health Professionals Follow-Up Study cohorts. He has published numerous research articles andbook chapters on the diagnosis and risk stratification of PE, the impactand appropriate use of diagnostic tests, and the influence of riskfactors on the development of PE.

264 Int J Emerg Med (2010) 3:239–264