This article has Open Peer Review reports available.
Risk stratification by abbMEDS and CURB-65 in relation to treatment and clinical disposition of the septic patient at the emergency department: a cohort study
© Roest et al. 2015
Received: 4 March 2015
Accepted: 5 October 2015
Published: 13 October 2015
Sepsis leads to high mortality, therefore risk stratification is important. The abbMEDS (abbreviated Mortality Emergency Department Sepsis) score assesses sepsis severity and predicts mortality. In community-acquired pneumonia, the CURB-65 (Confusion, Urea, Respiration, Blood pressure, Age) also provides support in clinical decisions regarding antibiotic treatment and clinical disposition.
We investigated the predictive value and feasibility of the abbMEDS and CURB-65 in sepsis patients at the ED and the relationship between the scores and antibiotic treatment and clinical disposition (i.e. admission and type of ward).
In this retrospective cohort study, we included 725 sepsis patients at the ED. We investigated the value in predicting 28-day mortality and feasibility of both scores. We calibrated the abbMEDS. We further assessed the relationship between the three risk categories per score and antibiotic treatment (i.e. oral and intravenous narrow or broad-spectrum) and clinical disposition.
Both abbMEDS and CURB-65 were good predictors of 28-day mortality (13.0 %) (AUC 0.77 [95 % CI 0.72 – 0.83] and 0.73 [95 % CI 0.67 - 0.78], respectively) and feasible (complete score 92.7 and 93.9 %, respectively). In the high risk category of the abbMEDS, all patients were admitted and treated with intravenous broad-spectrum antibiotics. In the high risk category of the CURB-65, 2.5 % were not admitted and 4.4 % received no antibiotics.
Both abbMEDS and CURB-65 are good predictors of 28-day mortality in septic ED patients. The abbMEDS is well calibrated and matches current clinical decisions concerning antibiotic treatment and clinical disposition, while this is less so for the CURB-65. In the future, use of the abbMEDS at the ED may improve sepsis care when its value as a decision support tool can be confirmed.
Sepsis, which is defined as a systemic inflammatory response syndrome (SIRS) to an infection, is a broad clinical entity and a deadly disease [1, 2]. Sepsis can be classified as sepsis, severe sepsis or septic shock, which are associated with an increasing in-hospital mortality of16 % (sepsis) to 46 % (septic shock) [1–3]. Therefore, sepsis is an important cause of death and puts significant strain on healthcare budgets .
Risk stratification tools aim to assess severity of illness. In patients with community-acquired pneumonia (CAP), the CURB-65 score (Confusion, Urea, Respiration, Blood pressure, Age > 65 years) stratifies patients into three risk categories (low, intermediate, high) that predict 28-day mortality well . When applied to patients with suspected infection from all foci (including CAP), the CURB-65 had good discriminatory value with regard to 28-day in-hospital mortality . Besides prediction of mortality for patients with CAP, the CURB-65 provides decision support for the physician, as it advises on two management decisions, namely choice of antibiotics (e.g. small or broad-spectrum) and clinical disposition (i.e. whether a patient should be admitted to the hospital and to what type of ward) [7, 8]. The CURB-65 can therefore (in patients with CAP) be used as a decision support tool in addition to the use as an estimator of mortality risk. For patients with sepsis, the abbMEDS (Abbreviated Mortality in Emergency Department Sepsis) score, derived from the MEDS (Mortality in Emergency Department Sepsis) score has good predictive value concerning 28-day mortality [9, 10]. It would be ideal, however, if the abbMEDS could provide the same clinical guidance for sepsis as the CURB-65 does for CAP. Since there is an overlap between sepsis and CAP, we hypothesize that both the abbMEDS and CURB-65 risk categories can be related to decisions concerning management in sepsis patients.
The aim of our study was to investigate the predictive value and feasibility of the abbMEDS and CURB-65 in internal medicine patients presenting with sepsis at the ED. In addition, we aimed to assess the relationship between the three risk categories defined by both scores and two clinical decisions, i.e. empirical antibiotic treatment and clinical disposition.
Study design and setting
We performed a retrospective study of a cohort of patients. The Maastricht University Medical Centre (MUMC+) is a secondary and tertiary care university hospital in The Netherlands with a capacity of 715 beds. There are 30,235 ED visits per year; approximately 5000 patients are assessed by an internist. Most patients are referred by a general practitioner before visiting the ED . This study was approved by the Medical Ethics Committee of MUMC+, and informed consent was deemed not to be necessary.
Selection of participants
We reviewed the ED charts of all patients who visited the ED between 1 April 2011 and 1 August 2012 and who were assessed by an internist. Part of these patients (n = 704; 81.2 %) have been included in another study in which we investigated which sepsis patients were transported by ambulance . We included patients above 18 years of age, who had two or more SIRS criteria and either suspected or proven infection (i.e. who fulfilled the criteria for sepsis, severe sepsis or septic shock) [1, 3]. Patients were excluded if the current admission was a re-admission within the study period (n = 108, 12.5 %), or when data on 28-day mortality could not be retrieved (n = 21, 2.4 %), despite contacting the general practitioner. Furthermore, patients were excluded when the ED chart was not complete (n = 7, 0.8 %) or when the patient died at the ED before the chart was completed (n = 1, 0.1 %).
Methods and measurements
All data were retrieved from the ED charts and the hospital’s electronic database by the use of standardized forms and by two independent researchers. We recorded date of birth, sex, comorbidity, vital signs, laboratory results, suspected focus of infection, items of the abbMEDS and CURB-65 score (Additional file 1: Table S1), antibiotic treatment, results of microbiology cultures, clinical disposition (admission and type of ward), length of hospital stay and 28-day mortality.
Since the respiratory rate and Glasgow Coma Scale were not always exactly documented in the ED charts, we derived these items from other information in the chart in the same way as others did . Items of the abbMEDS and CURB-65 were derived from patient charts. The abbMEDS and CURB-65 score were calculated and patients were assigned to the three defined risk categories (low, intermediate, high) of each score (Additional file 1: Table S1) [5, 9]. To assess the discriminatory value of both scores in the daily practice of a busy ED, only complete scores were included in our analysis with the exception of the missing abbMEDS item ‘nursing home resident’, which we imputed. This item could not always be scored (n = 113, 15.6 %) and we therefore made the assumption that all patients under 65 years of age (n = 68, 9.4 %) were not nursing home residents, unless stated otherwise. Suspected focus of infection was determined by the treating physician at the ED.
Antibiotic treatment was categorized into four groups: no antibiotics, oral antibiotics, intravenous (IV) narrow-spectrum, or IV broad-spectrum (Additional file 2: Table S2). When a patient received two narrow-spectrum antibiotics, which covered both gram positive and gram negative bacteria, we classified this as IV broad-spectrum antibiotics. Results of microbiological cultures were recorded per site (blood, urine, skin/wound and sputum). To minimize the chance of confusing infections present at the ED with nosocomial infections, we only recorded results of cultures taken at the day of presentation and two subsequent days [13, 14].
With regard to the adequacy of current empirical antibiotic treatment, we classified the choice of antibiotics started at the ED as adequate when the identified microorganisms were susceptible for the antibiotics in vitro. If a patient had a positive culture, but received no antibiotics, treatment was considered inadequate. When multiple micro-organisms were cultured, all had to be susceptible for the administered antibiotics. As coagulase-negative staphylococci in blood cultures can result from contamination, discharge letters were checked to retrieve whether the treating physician(s) regarded the culture as relevant or as contamination.
Regarding clinical disposition, all patients were stratified into three groups: no admission, admission to regular ward and medium/intensive care unit (MCU/ICU).
To assess the discriminatory value of the abbMEDS and CURB-65 in predicting 28-day mortality, we plotted Receiver Operation Characteristic (ROC) curves and calculated the Area Under the Curve (AUC) with 95 % confidence intervals (CI). To calibrate the abbMEDS, we compared the observed data on 28-day mortality per risk category with those found in the derivation study of Vorwerk et al. . Since the CURB-65 has only been derived in CAP patients, we did not calibrate the CURB-65 in our sepsis cohort. To assess the feasibility of the abbMEDS and CURB-65, we calculated the total number and proportion of complete scores in our study population.
We investigated two clinical decisions, i.e. the choice regarding empirical antibiotic treatment and the choice regarding clinical disposition in relation to the three abbMEDS and CURB-65 risk categories. As current empirical antibiotic treatment and clinical disposition might not be optimal, we assessed 28-day mortality for each of the groups to check for differences in mortality. To further evaluate antibiotic treatment, we investigated its adequacy in the subset of patients with positive cultures. Again, mortality was calculated for the groups with adequate and inadequate treatment.
We performed all statistical analyses with SPSS v.20.0 (IBM SPSS Statistics, Chicago, Illinois, USA, 2011) and MedCalc v13.3 (MedCalc Software bvba, Ostend, Belgium, 2014). Continuous data were reported as means and standard deviations or medians with interquartile ranges, categorical data as absolute counts and percentages. All percentages were valid percentages. We used the DeLong test to compare AUC values . Chi-square or Fisher’s exact tests were used to test for differences in proportions. The Mann–Whitney-U test was used to compare medians, one way ANOVA was used to analyze trends. We analyzed mortality between the different groups of antibiotic treatment and clinical disposition with Kaplan-Meier survival analysis and the Log rank test. Associations or differences were considered statistically significant if p < 0.05.
Patient characteristics and management
n (%) or median (IQR)
n = 725
n = 631 (87.0)
n = 94 (13.0)
Suspected focus of infection
Lower respiratory tract
Upper respiratory tract
Antibiotics at ED
Length of hospital stay, days
Complete risk scores could be calculated in 672 (92.7 %) patients for the abbMEDS, and in 681 (93.9 %) for the CURB-65 (p = 0.40). The abbMEDS was incomplete due to missing information concerning the item “nursing home resident” (n = 45, 6.2 % (>65 years)) or missing thrombocytes (n = 8, 1.1 %). The CURB-65 score was incomplete mostly due to missing urea values (n = 42, 5.8 %). The survival of those with complete and incomplete scores was not different (p = 0.42).
Mortality within 28 days per abbMEDS risk category compared to the derivation study (10)
28-day mortality, n (%)
Derivation study (10)
Antibiotic treatment in relation to risk categories
Antibiotic treatment and 28-day mortality per risk category of the abbMEDS and CURB-65
Adequacy of empirical antibiotic treatment in relation to risk categories
Adequacy of antibiotic treatment and 28-day mortality per risk category of the abbMEDS and CURB-65
Clinical disposition in relation to risk categories
Clinical disposition and 28-day mortality per risk category of the abbMEDS and CURB-65
This study investigated the value of abbMEDS and CURB-65 in internal medicine patients presenting with sepsis at the ED. We found a moderate predictive value regarding 28-day mortality of both the abbMEDS (AUC 0.77) and CURB-65 (AUC 0.73). In addition, both scores were feasible at our ED with complete scores in 92.7 and 93.9 %, respectively. New findings are that the abbMEDS categorizes patients well with respect to two important clinical decisions, namely empirical antibiotic treatment (e.g. narrow or broad-spectrum) and clinical disposition (i.e. whether a patient is admitted to the hospital and to what level of care), and that the abbMEDS performs better than the CURB-65.
With regard to the discriminatory value of the AbbMEDS, we found a slightly lower AUC than in the derivation study (AUC 0.77 vs. 0.82) by Vorwerk et al. , which may result from a difference in patient selection. The abbMEDS was well calibrated in our population, but compared to the derivation study, we found a higher mortality in the low risk category (3.6 vs. 1.6 %). An explanation for this finding may be that, due to the prominent role of the general practitioner in the Netherlands, the patients who are referred to the hospital and then assigned to the low risk category are sicker than patients in other countries [11, 16]. The CURB-65 was developed for patients with CAP . Later, the CURB-65 was validated in an ED population with an infection . In that study, a higher AUC (0.79) was found than in ours (0.73), which might be explained by the higher mortality in our study population (13.0 vs. 3.9 %). The mortality in our study was higher because we selected patients with sepsis instead of patients with infection.
The first new finding of our study is that the abbMEDS matches two current clinical decisions in the management of sepsis patients, namely empirical antibiotic treatment and clinical disposition. This is less the case for the CURB-65. In the low risk categories of both scores, roughly 30 % did not receive antibiotics or were treated with oral antibiotics (i.e. treatment that would not require admission to the hospital). The most severely ill patients in the high risk categories received almost exclusively IV broad-spectrum antibiotics. This is where the abbMEDS matches current clinical decisions better than the CURB-65, for all high risk abbMEDS patients were treated with IV broad-spectrum antibiotics, in contrast to 9.4 % of the high risk CURB-65 patients who were treated with no or oral antibiotics. We did not find significant differences in mortality between these different treatment groups. However, our mortality figures are too small to draw conclusions on this matter. We additionally analyzed adequacy of our empirical treatment (antibiotics started at the ED) based on in vitro susceptibility. We found that adequacy was related to the abbMEDS risk categories. With increasing risk category of the abbMEDS, more patients were treated with adequate antibiotics. However, this was not the case for CURB-65, as 15.9 % of the patients in the high risk category received inadequate treatment. The need for high adequacy is most urgent in the high risk category with the most severely ill patients . For the less severely ill patients, a lower adequacy can be accepted, as confining microbial resistance to antibiotics is more important in this large group of patients.
The second new finding regarding clinical decisions was that the abbMEDS matches current management regarding clinical disposition. Again, the CURB-65 did this less well. With increasing risk category of the abbMEDS, more patients were admitted to the MCU/ICU, while the fraction of patients who were not admitted to the hospital decreased. In contrast, in the high risk category of the CURB-65, 4 (2.5 %) patients were not admitted.
To our knowledge, we showed for the first time that the abbMEDS matches current clinical decisions regarding empirical antibiotic treatment and clinical disposition of sepsis patients at the ED. In patients with CAP, the CURB-65 is already used to provide clinical decision support. This resulted in more standardized care and reduced the use of broad-spectrum antibiotics, while patient safety was maintained [18, 19]. We think that the abbMEDS has the potential to provide clinical decision support in patients presenting with sepsis. However, future studies are needed and these should confirm that the abbMEDS can indeed appropriately and safely be used to provide this support on clinical decisions. The abbMEDS could then develop from a risk stratification score into a clinical decision support tool with the potential to increase the standard of care in sepsis patients. Hopefully, this will yield improved survival, reduced use of broad-spectrum antibiotics and reduced healthcare costs in sepsis patients.
This study has some limitations. First, we cannot exclude the risk of misclassification of measurements or data. However, we used standardized extraction forms and the main factors studied (laboratory values, antibiotic treatment, clinical disposition and mortality) are less likely to be subject of misclassification. Second, our study was limited to one hospital, but we included over 700 patients in a 15-month study period. Third, current clinical decisions might not be optimal as they are physician-dependent. However, our study reflects clinical practice and it is improbable that our management is less optimal than in other hospitals. A way to examine adequate management in a better way is to ask a panel of experts whether they agree with the management decisions based on the calculated score in selected cases. Considering the limitations, our study must be seen as an exploratory one. To our opinion, the results justify a prospective study that implements such a panel.
Both the abbMEDS and CURB-65 are good predictors of 28-day mortality in sepsis patients and are very feasible at the ED. The abbMEDS is well calibrated. A new finding is that the abbMEDS matches current clinical decisions in sepsis patients concerning antibiotic treatment and clinical disposition well, while this is less the case for the CURB-65. To improve the standard of care of sepsis, further research on the ability of the abbMEDS to provide support in clinical decisions in sepsis patients at the ED must be performed.
G. Vandergraesen, staff supporter of the emergency department MUMC+ for managing the ICT system of the emergency department and making the data easily accessible.
Open AccessThis article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.
- Bone RC, Sibbald WJ, Sprung CL. The ACCP-SCCM consensus conference on sepsis and organ failure. Chest. 1992;101:1481–3.View ArticlePubMedGoogle Scholar
- Rangel-Frausto MS, Pittet D, Costigan M, Hwang T, Davis CS, Wenzel RP. The natural history of the systemic inflammatory response syndrome (SIRS). A prospective study. JAMA. 1995;273:117–23.View ArticlePubMedGoogle Scholar
- Levy MM, Fink MP, Marshall JC, Abraham E, Angus D, Cook D, et al. 2001 SCCM/ESICM/ACCP/ATS/SIS International Sepsis Definitions Conference. Crit Care Med. 2003;31:1250–6.View ArticlePubMedGoogle Scholar
- Bakker J, Levi M, van Hout BA, van Gestel A. Sepsis, a complicated syndrome with major medical and social consequences. Ned Tijdschr Geneeskd. 2004;148:975–8.PubMedGoogle Scholar
- Lim WS, van der Eerden MM, Laing R, Boersma WG, Karalus N, Town GI, et al. Defining community acquired pneumonia severity on presentation to hospital: an international derivation and validation study. Thorax. 2003;58:377–82.View ArticlePubMedPubMed CentralGoogle Scholar
- Howell MD, Donnino MW, Talmor D, Clardy P, Ngo L, Shapiro NI. Performance of severity of illness scoring systems in emergency department patients with infection. Acad Emerg Med. 2007;14:709–14.View ArticlePubMedGoogle Scholar
- Harris M, Clark J, Coote N, Fletcher P, Harnden A, McKean M, et al. British Thoracic Society guidelines for the management of community acquired pneumonia in children: update 2011. Thorax. 2011;66(Suppl):1–23.Google Scholar
- Wiersinga WJ, Bonten MJ, Boersma WG, Jonkers RE, Aleva RM, Kullberg BJ, et al. SWAB/NVALT (Dutch Working Party on Antibiotic Policy and Dutch Association of Chest Physicians) guidelines on the management of community-acquired pneumonia in adults. Neth J Med. 2012;70:90–101.PubMedGoogle Scholar
- Vorwerk C, Loryman B, Coats TJ, Stephenson JA, Gray LD, Reddy G, et al. Prediction of mortality in adult emergency department patients with sepsis. Emerg Med J. 2009;26:254–8.View ArticlePubMedGoogle Scholar
- Shapiro NI, Wolfe RE, Moore RB, Smith E, Burdick E, Bates DW. Mortality in Emergency Department Sepsis (MEDS) score: a prospectively derived and validated clinical prediction rule. Crit Care Med. 2003;31:670–5.View ArticlePubMedGoogle Scholar
- Thijssen WA, Giesen PH, Wensing M. Emergency departments in The Netherlands. Emerg Med J. 2012;29:6–9.View ArticlePubMedGoogle Scholar
- Groenewoudt M, Roest AA, Leijten FM, Stassen PM. Septic patients arriving with emergency medical services: a seriously ill population. Eur J Emerg Med. 2014;21(5):330–5.View ArticlePubMedGoogle Scholar
- Artero A, Zaragoza R, Camarena JJ, Sancho S, Gonzalez R, Nogueira JM. Prognostic factors of mortality in patients with community-acquired bloodstream infection with severe sepsis and septic shock. J Crit Care. 2010;25:276–81.View ArticlePubMedGoogle Scholar
- Grozdanovski K, Milenkovic Z, Demiri I, Spasovska K. Prediction of outcome from community-acquired severe sepsis and septic shock in tertiary-care university hospital in a developing country. Crit Care Res Pract. 2012;2012:182324.PubMedPubMed CentralGoogle Scholar
- DeLong ER, DeLong DM, Clarke-Pearson DL. Comparing the areas under two or more correlated receiver operating characteristic curves: a nonparametric approach. Biometrics. 1988;44:837–45.View ArticlePubMedGoogle Scholar
- Hermans MA, Leffers P, Jansen LM, Keulemans YC, Stassen PM. The value of the Mortality in Emergency Department Sepsis (MEDS) score, C reactive protein and lactate in predicting 28-day mortality of sepsis in a Dutch emergency department. Emerg Med J. 2012;29:295–300.View ArticlePubMedGoogle Scholar
- Chen HC, Lin WL, Lin CC, Hsieh WH, Hsieh CH, Wu MH, et al. Outcome of inadequate empirical antibiotic therapy in emergency department patients with community-onset bloodstream infections. J Antimicrob Chemother. 2013;68:947–53.View ArticlePubMedGoogle Scholar
- Chalmers JD, Singanayagam A, Akram AR, Choudhury G, Mandal P, Hill AT. Safety and efficacy of CURB65-guided antibiotic therapy in community-acquired pneumonia. J Antimicrob Chemother. 2011;66:416–23.View ArticlePubMedGoogle Scholar
- Singanayagam A, Chalmers JD. Severity assessment scores to guide empirical use of antibiotics in community acquired pneumonia. Lancet Respir Med. 2013;1:653–62.View ArticlePubMedGoogle Scholar