Development of diagnostic prediction tools for bacteraemia caused by third-generation cephalosporin-resistant enterobacteria in suspected bacterial infections: a nested case–control study
Open accessPublished version of a preprint
Abstract
Objectives Current guidelines for the empirical antibiotic treatment predict the presence of third-generation cephalosporin-resistant enterobacterial bacteraemia (3GCR-E-Bac) in case of infection only poorly, thereby increasing unnecessary carbapenem use. We aimed to develop diagnostic scoring systems which can better predict the presence of 3GCR-E-Bac.Methods A retrospective nested case-control study was performed that included patients ≥18 years of age from eight Dutch hospitals in whom blood cultures were obtained and intravenous antibiotics were initiated. Each patient with 3GCR-E-Bac was matched to four control infection episodes within the same hospital, based on blood-culture date and onset location (community or hospital). Starting from 32 commonly described clinical risk factors at infection onset, selection strategies were used to derive scoring systems for the probability of community- and hospital-onset 3GCR-E-Bac.Results 3GCR-E-Bac occurred in 90 of 22 506 (0.4%) community-onset infections and in 82 of 8110 (1.0%) hospital-onset infections, and these cases were matched to 360 community-onset and 328 hospital-onset control episodes. The derived community-onset and hospital-onset scoring systems consisted of six and nine predictors, respectively. With selected score cut-offs, the models identified 3GCR-E-Bac with sensitivity equal to existing guidelines (community-onset: 54.3%; hospital-onset: 81.5%). However, they reduced the proportion of patients classified as at risk for 3GCR-E-Bac (i.e. eligible for empirical carbapenem therapy) with 40% (95%CI 21-56%) and 49% (95%CI 39-58%) in, respectively, community-onset and hospital-onset infections.Conclusions These prediction scores for 3GCR-E-Bac, specifically geared towards the initiation of empirical antibiotic treatment, may improve the balance between inappropriate antibiotics and carbapenem overuse.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Factors guiding double gram-negative coverage include proven infection or colonisation with resistant organisms in the prior year, local prevalence, hospital-acquired/healthcare-associated infection, broad-spectrum antibiotics in prior 90 days, concurrent SDD, travel to a highly endemic country in prior 90 days, and hospitalisation abroad in prior 90 days.
“Factors to guide this decision include: proven infection or colonisation with antibiotic-resistant organisms within the preceding year, local prevalence of antibiotic-resistant organisms, hospital-acquired/healthcare associated (versus community-acquired infection), broad-spectrum antibiotic use within the preceding 90 days”
From Surviving sepsis campaign: international guidelines for management of sepsis and septic shock 2021 (2021) · cites this paper as [164]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
Charlson, M. E., Pompei, P., Ales, K. L., & MacKenzie, C. R. (1987) · Journal of Chronic Diseases · doi:10.1016/0021-9681(87)90171-8 · Cited by 49,742 · see citing works
<b>mice</b>: Multivariate Imputation by Chained Equations in<i>R</i>
Buuren, S. V., & Groothuis-Oudshoorn, K. (2011) · Journal of Statistical Software · doi:10.18637/jss.v045.i03 · Cited by 13,870 · see citing works
pROC: an open-source package for R and S+ to analyze and compare ROC curves
Robin, X., Turck, N., Hainard, A., Tiberti, N., Lisacek, F., Sanchez, J.-C., & Müller, M. (2011) · BMC Bioinformatics · doi:10.1186/1471-2105-12-77 · Cited by 13,697 · see citing works
Multiple imputation using chained equations: Issues and guidance for practice
White, I. R., Royston, P., & Wood, A. M. (2011) · Statistics in Medicine · doi:10.1002/sim.4067 · Cited by 9,792 · see citing works
Harrell (2015) · Springer Series in Statistics · doi:10.1007/978-3-319-19425-7 · Cited by 6,878 · see citing works
Horan, T. C., Andrus, M., & Dudeck, M. A. (2008) · American Journal of Infection Control · doi:10.1016/j.ajic.2008.03.002 · Cited by 6,646 · see citing works
Moons, K. G. M., Altman, D. G., Reitsma, J. B., Ioannidis, J. P. A., Macaskill, P., Steyerberg, E. W., Vickers, A. J., Ransohoff, D. F., & Collins, G. S. (2015) · Annals of Internal Medicine · doi:10.7326/m14-0698 · Cited by 5,147 · see citing works
Clinical Prediction Models: A Practical Approach to Development, Validation, and Updating
Steyerberg, E. W. (2019) · Statistics for Biology and Health · doi:10.1007/978-3-030-16399-0 · Cited by 3,281 · see citing works
Collins, G. S., Reitsma, J. B., Altman, D. G., & Moons, K. G. M. (2015) · Annals of Internal Medicine · doi:10.7326/m14-0697 · Cited by 3,267 · see citing works
2001 SCCM/ESICM/ACCP/ATS/SIS International Sepsis Definitions Conference
Conference, F. T. I. S. D., Levy, M. M., Fink, M. P., Marshall, J. C., Abraham, E. H., Angus, D. C., Cook, D., Cohen, J., Opal, S. M., Vincent, J., et al. (2003) · Intensive Care Medicine · doi:10.1007/s00134-003-1662-x · Cited by 2,877 · see citing works
Friedman, N. D., Kaye, K. S., Stout, J. E., McGarry, S. A., Trivette, S. L., Briggs, J. P., Lamm, W., Clark, C., MacFarquhar, J., Walton, A. L., et al. (2002) · Annals of Internal Medicine · doi:10.7326/0003-4819-137-10-200211190-00007 · Cited by 1,664 · see citing works
Clinical Prediction Models: A Practical Approach to Development, Validation and Updating
Mann, C. J. H. (2009) · Kybernetes · doi:10.1108/k.2009.06738fae.002 · Cited by 794 · see citing works
Paul, M., Shani, V., Muchtar, E., Kariv, G., Robenshtok, E., & Leibovici, L. (2010) · Antimicrobial Agents and Chemotherapy · doi:10.1128/aac.00627-10 · Cited by 721 · see citing works
Rothman, K. J., Greenland, S., & Lash, T. L. (2008) · Encyclopedia of Quantitative Risk Analysis and Assessment · doi:10.1002/9780470061596.risk0599 · Cited by 706 · see citing works
How to develop a more accurate risk prediction model when there are few events
Pavlou, M., Ambler, G., Seaman, S. R., Guttmann, O. P., Elliot, P. M., King, M., & Omar, R. (2015) · BMJ · doi:10.1136/bmj.h3868 · Cited by 668 · see citing works
Community-Acquired Pneumonia Due to Gram-Negative Bacteria and Pseudomonas aeruginosa
Arancibia, F., Bauer, T. T., Ewig, S., Mensa, J., González, J., Niederman, M. S., & Torres, A. (2002) · Archives of Internal Medicine · doi:10.1001/archinte.162.16.1849 · Cited by 398 · see citing works
Antibiotic Treatment Strategies for Community-Acquired Pneumonia in Adults
Postma, D. F., van Werkhoven, C. H., van Elden, L. J. R., Thijsen, S. F. T., Hoepelman, A. I. M., Kluytmans, J. A. J. W., Boersma, W. G., Compaijen, C. J., van der Wall, E., Prins, J. M., et al. (2015) · New England Journal of Medicine · doi:10.1056/nejmoa1406330 · Cited by 375 · see citing works
Self-citationControlling Antimicrobial Resistance in Hospitals: Infection Control and Use of Antibiotics
Weinstein, R. A. (2001) · Emerging infectious diseases · doi:10.3201/eid0702.010206 · Cited by 263 · see citing works
Predicting Bacteremia in Patients with Sepsis Syndrome
Bates, D. W., Sands, K., Miller, E., Lanken, P. N., Hibberd, P. L., GRAMAN, P. S., Schwartz, J. S., Kahn, K. L., Snydman, D. R., Parsonnet, J., et al. (1997) · The Journal of Infectious Diseases · doi:10.1086/514153 · Cited by 211 · see citing works
Goodman, K. E., Lessler, J., Cosgrove, S. E., Harris, A. D., Lautenbach, E., Han, J., Milstone, A. M., Massey, C. J., & Tamma, P. D. (2016) · Clinical Infectious Diseases · doi:10.1093/cid/ciw425 · Cited by 177 · see citing works
Harris, A. D., Samore, M. H., Lipsitch, M., Kaye, K. S., Perencevich, E. N., & Carmeli, Y. (2002) · Clinical Infectious Diseases · doi:10.1086/340533 · Cited by 171 · see citing works
Tumbarello, M., Trecarichi, E. M., Bassetti, M., Rosa, F. G. D., Spanu, T., Meco, E. D., Losito, A. R., Parisini, A., Pagani, N., & Cauda, R. (2011) · Antimicrobial Agents and Chemotherapy · doi:10.1128/aac.00009-11 · Cited by 159 · see citing works
Linking laboratory and medication data: new opportunities for pharmacoepidemiological research
ten Berg, M. J., Huisman, A., van den Bemt, P. M. L. A., Schobben, A. F. A. M., Egberts, A. C. G., & van Solinge, W. W. (2007) · Clinical Chemical Laboratory Medicine · doi:10.1515/cclm.2007.009 · Cited by 156 · see citing works
Appropriate antimicrobial therapy in the era of multidrug-resistant human pathogens
Pogue, J. M., Kaye, K. S., Cohen, D. A., & Marchaim, D. (2015) · Clinical Microbiology and Infection · doi:10.1016/j.cmi.2014.12.025 · Cited by 150 · see citing works
Wiersinga, W. J., Bonten, M. J. M., Boersma, W. G., Jonkers, R. E., Aleva, R. M., Kullberg, B. J., Schouten, J. A., Degener, J. E., van de Garde, E. M. W., Verheij, T. J., et al. (2018) · PubMed · Cited by 87 · see citing works
Self-citationAugustine, M. R., Testerman, T. L., Justo, J. A., Bookstaver, P. B., Kohn, J. E., Albrecht, H., & Al‐Hasan, M. N. (2016) · Infection Control and Hospital Epidemiology · doi:10.1017/ice.2016.292 · Cited by 75 · see citing works
Johnson, S. W., Anderson, D. J., May, D. B., & Drew, R. H. (2013) · Infection Control and Hospital Epidemiology · doi:10.1086/669858 · Cited by 69 · see citing works
Trecarichi, E. M., Cauda, R., & Tumbarello, M. (2012) · Future Microbiology · doi:10.2217/fmb.12.100 · Cited by 64 · see citing works
The TREAT project: decision support and prediction using causal probabilistic networks
Leibovici, L., Paul, M., Nielsen, A. D., Tacconelli, E., & Andreassen, S. (2007) · International Journal of Antimicrobial Agents · doi:10.1016/j.ijantimicag.2007.06.035 · Cited by 62 · see citing works
Rottier, W. C., Bamberg, Y. R. P., Dorigo-Zetsma, J. W., van der Linden, P. D., Ammerlaan, H. S. M., & Bonten, M. J. M. (2015) · Clinical Infectious Diseases · doi:10.1093/cid/civ121 · Cited by 61 · see citing works
Self-citationGharbi, M., Moore, L. S. P., Gilchrist, M. J., Thomas, C. P., Bamford, K. B., Brannigan, E., & Holmes, A. H. (2015) · International Journal of Antimicrobial Agents · doi:10.1016/j.ijantimicag.2015.03.005 · Cited by 54 · see citing works
Platteel, T. N., Hall, M. A. L., Stuart, J. W. C., Thijsen, S. F. T., Mascini, E. M., van Hees, B. C., Scharringa, J., Fluit, A. C., & Bonten, M. J. M. (2014) · Clinical Microbiology and Infection · doi:10.1016/j.cmi.2014.09.014 · Cited by 50 · see citing works
Self-citationRuppé, É., Pitsch, A., Tubach, F., LASTOURS, V. D., Chau, F., Pasquet, B., Lucet, J. C., Andremont, A., & Fantin, B. (2011) · European Journal of Clinical Microbiology & Infectious Diseases · doi:10.1007/s10096-011-1313-z · Cited by 46 · see citing works
Huang, Y., & PEPE, M. S. (2010) · Statistics in Medicine · doi:10.1002/sim.3876 · Cited by 44 · see citing works
Pasricha, J., Koessler, T., Harbarth, S., Schrenzel, J., Camus, V., Cohen, G., Perrier, A., Pittet, D., & Iten, A. (2013) · Antimicrobial Resistance and Infection Control · doi:10.1186/2047-2994-2-20 · Cited by 39 · see citing works
Paul, M., Nielsen, A. D., Goldberg, E., Andreassen, S., Tacconelli, E., Almanasreh, N., Frank, U., Cauda, R., & Leibovici, L. (2007) · Journal of Antimicrobial Chemotherapy · doi:10.1093/jac/dkm107 · Cited by 33 · see citing works
Shitrit, P., Reisfeld, S., Paitan, Y., Gottesman, B. S., Katzir, M., Paul, M., & Chowers, M. (2013) · Journal of Hospital Infection · doi:10.1016/j.jhin.2013.07.014 · Cited by 30 · see citing works
Martin, E. T., Tansek, R., Collins, V., Hayakawa, K., Abreu-Lanfranco, O., Chopra, T., Lephart, P., Pogue, J. M., Kaye, K. S., & Marchaim, D. (2012) · American Journal of Infection Control · doi:10.1016/j.ajic.2012.02.036 · Cited by 28 · see citing works
Leibman, V., Martin, E. T., Tal-Jasper, R., Grin, L., Hayakawa, K., Shefler, C., Azouri, T., Kaplansky, T., Maskit, M., Lazarovitch, T., et al. (2015) · Annals of Clinical Microbiology and Antimicrobials · doi:10.1186/s12941-015-0088-y · Cited by 22 · see citing works
Should we take into account ESBLs in empirical antibiotic treatment?
Matteo, B., & Rodríguez‐Baño, J. (2016) · Intensive Care Medicine · doi:10.1007/s00134-016-4599-6 · Cited by 9 · see citing works
Slekovec, C., Bertrand, X., Leroy, J., Faller, J.-P., Talon, D. R., & Hocquet, D. (2012) · Antimicrobial Agents and Chemotherapy · doi:10.1128/aac.06376-11 · Cited by 6 · see citing works
Dangers and opportunities of guidelines in the data-free zone
Bonten, M. J. M. (2015) · The Lancet Respiratory Medicine · doi:10.1016/s2213-2600(15)00249-0 · Cited by 3 · see citing works
Self-citationReddy, P., Malczynski, M., Obias, A. A., Reiner, S., Jin, N., Huang, J., Noskin, G. A., & Zembower, T. (2008) · Clinical Infectious Diseases · doi:10.1086/526350 · Cited by 2 · see citing works
Flagged first, then by citations
1 of the 44 references couldn’t be matched to a known paper.
Cited by
Sorted by citations
Surviving Sepsis Campaign: International Guidelines for Management of Sepsis and Septic Shock 2021.
Evans, L., Rhodes, A., Alhazzani, W., Antonelli, M., Coopersmith, C. M., French, C., Machado, F. R., Mcintyre, L., Ostermann, M., Prescott, H. C., et al. (2021) · Critical Care Medicine · doi:10.1097/ccm.0000000000005337 · Cited by 2,935 · see citing works
Luyt, C. E., Hékimian, G., Koulenti, D., & Chastre, J. E. (2018) · Current Opinion in Critical Care · doi:10.1097/mcc.0000000000000526 · Cited by 142 · see citing works
Surviving sepsis campaign: international guidelines for management of sepsis and septic shock 2021
Evans, L., Rhodes, A., Alhazzani, W., Antonelli, M., Coopersmith, C. M., French, C., Machado, F. R., Mcintyre, L., Ostermann, M., Prescott, H. C., et al. (2021) · Intensive Care Medicine · doi:10.1007/s00134-021-06506-y · Cited by 5,082 · see citing works
Aminoglycosides for the Treatment of Severe Infection Due to Resistant Gram-Negative Pathogens
Thy, M., Timsit, J., & de Montmollin, É. (2023) · Antibiotics · doi:10.3390/antibiotics12050860 · Cited by 117 · see citing works
Goodman, K. E., Lessler, J., Harris, A. D., Milstone, A. M., & Tamma, P. D. (2019) · Infection Control and Hospital Epidemiology · doi:10.1017/ice.2019.17 · Cited by 44 · see citing works
Sieswerda, E., Bax, H. I., Hoogerwerf, J. J., de Boer, M. G. J., Boermeester, M. A., Bonten, M. J. M., Dekker, D., van Wijk, R. G., Juffermans, N. P., Kuindersma, M., et al. (2022) · BMC Infectious Diseases · doi:10.1186/s12879-022-07653-3 · Cited by 30 · see citing works
Self-citationHuizinga, P., den Bergh, M. K.-V., Rossen, J. W. A., Willemsen, I., Verhulst, C., Savelkoul, P. H. M., Friedrich, A. W., García-Cobos, S., & Kluytmans, J. A. J. W. (2019) · PLoS ONE · doi:10.1371/journal.pone.0226828 · Cited by 31 · see citing works
Self-citationLiu, X., Liu, X., Jin, C., Luo, Y., Yang, L., Ning, X., Zhuo, C., & Xiao, F. (2024) · Clinical Microbiology and Infection · doi:10.1016/j.cmi.2024.07.005 · Cited by 20 · see citing works
Fröding, I., Valik, J. K., Bolinder, L., Nauclér, P., & Giske, C. G. (2019) · International Journal of Antimicrobial Agents · doi:10.1016/j.ijantimicag.2019.02.008 · Cited by 12 · see citing works
Kim, H., Oh, D. K., Lim, S. Y., Cho, Y., Park, S., Suh, G. Y., Lim, C., & Lee, Y. J. (2023) · Journal of Korean Medical Science · doi:10.3346/jkms.2023.38.e75 · Cited by 12 · see citing works
Lambregts, M. M. C., Hendriks, B. J. C., Visser, L. G., Bernards, S. T., & de Boer, M. G. J. (2019) · Antimicrobial Resistance and Infection Control · doi:10.1186/s13756-019-0465-y · Cited by 9 · see citing works
Cheng, J., Liu, Y., Li, S., Pu, K., Lin, Y., & Tan, L. (2024) · Infection and Drug Resistance · doi:10.2147/idr.s449731 · Cited by 4 · see citing works
Deelen, J. W. T., Rottier, W. C., Girón-Ortega, J. A., Rodríguez‐Baño, J., Harbarth, S., Tacconelli, E., Jacobsson, G., Zahar, J., van Werkhoven, C. H., Bonten, M. J. M., et al. (2020) · Clinical Infectious Diseases · doi:10.1093/cid/ciaa950 · Cited by 4 · see citing works
Self-citationHolmgren, A., Ljung, A., & Bremell, D. (2019) · Scandinavian Journal of Infectious Diseases · doi:10.1080/23744235.2019.1705389 · Cited by 4 · see citing works
Bezerra, C. L. P. A. M., dos Santos, E. L., de Oliveira, M. S., Dias, M. B. S., Levin, A. S., Freire, M. P., Boszczowski, Í., & Salomão, M. C. (2023) · Clinical Infectious Diseases · doi:10.1093/cid/ciad272 · Cited by 2 · see citing works
Rottier, W. C., Deelen, J. W. T., van Werkhoven, C. H., & Bonten, M. J. M. (2018) · Clinical Microbiology and Infection · doi:10.1016/j.cmi.2018.09.003 · Cited by 1 · see citing works
Self-citationLambregts, M. M. C., Bernards, A. T., Visser, L. G., & de Boer, M. G. J. (2018) · Clinical Microbiology and Infection · doi:10.1016/j.cmi.2018.07.019 · Cited by 1 · see citing works
Antibiotics, Antivirals, and Antifungals in Critical Care
Shamshirsaz, A. A., & Vaught, A. “. J. (2024) · Wiley eBooks · doi:10.1002/9781119820260.ch19 · Cited by 1 · see citing works
Epidemiology of antimicrobial-resistant bacteria in food and humans
Huizinga, P. (2021) · doi:10.33540/959
Gram-negative infections – Burden, Antibiotic Resistance and Empiric Treatment
Deelen, J. W. T. (2021) · doi:10.33540/484
Alwashaish, M. M., & Abbas, A. A. (2025) · Access Microbiology · doi:10.1099/acmi.0.001094.v3
Fiori, C., Piana, A., Manfredi, M., & Amparore, D. (2026) · Springer eBooks · doi:10.1007/978-3-031-52619-0_7
- Authors
- Rottier, W. C., van Werkhoven, C. H., Bamberg, Y. R. P., Dorigo-Zetsma, J. W., van de Garde, E. M., van Hees, B. C., Kluytmans, J. A. J. W., Kuck, E. M., van der Linden, P. D., Prins, J. M., Thijsen, S. F. T., Verbon, A., Vlaminckx, B. J. M., Ammerlaan, H. S. M., & Bonten, M. J. M.
- Affiliations
- University Medical Center Utrecht (NL)
- Tergooi (NL)
- Diakonessenhuis hospital (NL)
- Amsterdam UMC Location University of Amsterdam (NL)
- Erasmus MC (NL)
- St. Antonius Ziekenhuis (NL)
- Corresponding author
- Rottier, W.C.
- ORCID
- Venue
- Clinical Microbiology and Infection
- Publisher
- Elsevier BV
- Published
- 2018-12
- Volume
- 24
- Issue
- 12
- Pages
- 1315-1321
- ISSN
- 1198-743X (ISSN-L)
- OpenAlex
- W2887873765
- Cited by
- 22
- References
- 44
- Citations by year
- 2026: 1 · 2025: 1 · 2024: 3 · 2023: 3 · 2022: 1 · 2021: 4 · 2020: 1 · 2019: 5 · 2018: 3
- FWCI
- 1.23
- Type
- journal article
- Language
- en
- Open access
- bronze
- doi.org
- Licence
- Locations
- Clinical Microbiology and Infection (publishedVersion)
- bioRxiv (Cold Spring Harbor Laboratory) (acceptedVersion, cc-by-nc)
- PubMed (publishedVersion)
- EUR Research Repository (Erasmus University Rotterdam) (submittedVersion, other-oa)
- Data Archiving and Networked Services (DANS) (submittedVersion)
- EUR Research Repository (Erasmus University Rotterdam) (submittedVersion)
- Utrecht University Repository (Utrecht University) (submittedVersion, other-oa)
- Pure Amsterdam UMC (submittedVersion)
- Funders
- The Netherlands Organization for Health Research and Development (205200007)
- Topics
- Life Sciences › Biochemistry, Genetics and Molecular Biology › Molecular Medicine › Antibiotic Resistance in Bacteria
- Life Sciences › Immunology and Microbiology › Applied Microbiology and Biotechnology › Antibiotic Use and Resistance
- Life Sciences › Biochemistry, Genetics and Molecular Biology › Clinical Biochemistry › Bacterial Identification and Susceptibility Testing
- Keywords
- bacteremia, third-generation cephalosporin resistance, Enterobacteriaceae, empirical antibiotic therapy, community-onset infection, hospital-onset infection, clinical risk factors, blood culture, inappropriate antibiotic use
- MeSH terms
- Aged, Anti-Bacterial Agents, Cephalosporins, Cross Infection, Enterobacteriaceae, Enterobacteriaceae Infections, Female, Humans, Male, Microbial Sensitivity Tests, Middle Aged, Retrospective Studies, Risk Factors, Case-Control Studies, Bacteremia
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review