Rapid detection of health-care-associated bloodstream infection in critical care using multipathogen real-time polymerase chain reaction technology: a diagnostic accuracy study and systematic review
Open accessThe DOI matches its Crossref record; 12 of the 12 references it cites were found in a registry or an index.
Abstract
Background: There is growing interest in the potential utility of real-time polymerase chain reaction (PCR) in diagnosing bloodstream infection by detecting pathogen deoxyribonucleic acid (DNA) in blood samples within a few hours. SeptiFast (Roche Diagnostics GmBH, Mannheim, Germany) is a multipathogen probe-based system targeting ribosomal DNA sequences of bacteria and fungi. It detects and identifies the commonest pathogens causing bloodstream infection. As background to this study, we report a systematic review of Phase III diagnostic accuracy studies of SeptiFast, which reveals uncertainty about its likely clinical utility based on widespread evidence of deficiencies in study design and reporting with a high risk of bias. Objective: Determine the accuracy of SeptiFast real-time PCR for the detection of health-care-associated bloodstream infection, against standard microbiological culture. Design: Prospective multicentre Phase III clinical diagnostic accuracy study using the standards for the reporting of diagnostic accuracy studies criteria. Setting: Critical care departments within NHS hospitals in the north-west of England. Participants: Adult patients requiring blood culture (BC) when developing new signs of systemic inflammation. Main outcome measures: SeptiFast real-time PCR results at species/genus level compared with microbiological culture in association with independent adjudication of infection. Metrics of diagnostic accuracy were derived including sensitivity, specificity, likelihood ratios and predictive values, with their 95% confidence intervals (CIs). Latent class analysis was used to explore the diagnostic performance of culture as a reference standard. Results: Of 1006 new patient episodes of systemic inflammation in 853 patients, 922 (92%) met the inclusion criteria and provided sufficient information for analysis. Index test assay failure occurred on 69 (7%) occasions. Adult patients had been exposed to a median of 8 days (interquartile range 4–16 days) of hospital care, had high levels of organ support activities and recent antibiotic exposure. SeptiFast real-time PCR, when compared with culture-proven bloodstream infection at species/genus level, had better specificity (85.8%, 95% CI 83.3% to 88.1%) than sensitivity (50%, 95% CI 39.1% to 60.8%). When compared with pooled diagnostic metrics derived from our systematic review, our clinical study revealed lower test accuracy of SeptiFast real-time PCR, mainly as a result of low diagnostic sensitivity. There was a low prevalence of BC-proven pathogens in these patients (9.2%, 95% CI 7.4% to 11.2%) such that the post-test probabilities of both a positive (26.3%, 95% CI 19.8% to 33.7%) and a negative SeptiFast test (5.6%, 95% CI 4.1% to 7.4%) indicate the potential limitations of this technology in the diagnosis of bloodstream infection. However, latent class analysis indicates that BC has a low sensitivity, questioning its relevance as a reference test in this setting. Using this analysis approach, the sensitivity of the SeptiFast test was low but also appeared significantly better than BC. Blood samples identified as positive by either culture or SeptiFast real-time PCR were associated with a high probability (> 95%) of infection, indicating higher diagnostic rule-in utility than was apparent using conventional analyses of diagnostic accuracy. Conclusion: SeptiFast real-time PCR on blood samples may have rapid rule-in utility for the diagnosis of health-care-associated bloodstream infection but the lack of sensitivity is a significant limiting factor. Innovations aimed at improved diagnostic sensitivity of real-time PCR in this setting are urgently required. Future work recommendations include technology developments to improve the efficiency of pathogen DNA extraction and the capacity to detect a much broader range of pathogens and drug resistance genes and the application of new statistical approaches able to more reliably assess test performance in situation where the reference standard (e.g. blood culture in the setting of high antimicrobial use) is prone to error. Study registration: The systematic review is registered as PROSPERO CRD42011001289. Funding: The National Institute for Health Research Health Technology Assessment programme. Professor Daniel McAuley and Professor Gavin D Perkins contributed to the systematic review through their funded roles as codirectors of the Intensive Care Foundation (UK).
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Kumar, A., Roberts, D., Wood, K. E., Light, B., Parrillo, J. E., Sharma, S., Suppes, R., Feinstein, D., Zanotti, S., Taiberg, L., et al. (2006) · Critical Care Medicine · doi:10.1097/01.ccm.0000217961.75225.e9 · Cited by 6,109 · cited 1×
“Internationally recognised guidelines for the early management of sepsis advocate that antibiotics are administered within 1 hour of the initial clinical suspicion of infection and current evidence indicates that the correct initial choice of antibiotic saves more lives than virtually any other intervention in patient…”
BackgroundWhiting, P., Rutjes, A. W., Reitsma, J. B., Bossuyt, P. M., & Kleijnen, J. (2003) · BMC Medical Research Methodology · doi:10.1186/1471-2288-3-25 · Cited by 3,592
Reitsma, J. B., Glas, A. S., Rutjes, A. W. S., Scholten, R. J. P. M., Bossuyt, P. M., & Zwinderman, A. H. (2005) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2005.02.022 · Cited by 3,369
Towards complete and accurate reporting of studies of diagnostic accuracy: The STARD Initiative.
Bossuyt, P. M., Reitsma, J. B., Bruns, D. E., Gatsonis, C. A., Glasziou, P. P., Irwig, L. M., Lijmer, J. G., Moher, D., Rennie, D., de Vet, H. C. W., et al. (2003) · Annals of Internal Medicine · doi:10.7326/0003-4819-138-1-200301070-00010 · Cited by 3,219
Towards complete and accurate reporting of studies of diagnostic accuracy: the STARD initiative
Bossuyt, P. M., Reitsma, J. B., Bruns, D. E., Gatsonis, C. A., Glasziou, P. P., Irwig, L. M., Lijmer, J. G., Moher, D., Rennie, D., & de Vet, H. C. W. (2003) · BMJ · doi:10.1136/bmj.326.7379.41 · Cited by 3,215
Towards Complete and Accurate Reporting of Studies of Diagnostic Accuracy: The STARD Initiative
Bossuyt, P. M., Reitsma, J. B., Bruns, D. E., Gatsonis, C. A., Glasziou, P. P., Irwig, L. M., Lijmer, J. G., Moher, D., Rennie, D., & de Vet, H. C. W. (2003) · Radiology · doi:10.1148/radiol.2261021292 · Cited by 3,215
The immunopathogenesis of sepsis
Cohen, J. (2002) · Nature · doi:10.1038/nature01326 · Cited by 2,742 · cited 1×
“Sepsis is a clinical syndrome resulting from a patient’s systemic inflammatory response to infection and is a major cause of mortality and increased health-care costs globally.(10,11) Sepsis can be difficult to diagnose and to differentiate from other common non-infectious causes of systemic inflammation.”
BackgroundInadequate Antimicrobial Treatment of Infections
Kollef, M. H., Sherman, G., Ward, S., & Fraser, V. J. (1999) · Chest · doi:10.1378/chest.115.2.462 · Cited by 1,805 · cited 1×
“Internationally recognised guidelines for the early management of sepsis advocate that antibiotics are administered within 1 hour of the initial clinical suspicion of infection and current evidence indicates that the correct initial choice of antibiotic saves more lives than virtually any other intervention in patient…”
BackgroundEstimating the Error Rates of Diagnostic Tests
Hui, S. L., & Walter, S. D. (1980) · Biometrics · doi:10.2307/2530508 · Cited by 780
Chang, S.-S., Hsieh, W.-H., Liu, T.-S., Lee, S.-H., Wang, C.-H., Chou, H.-C., Yeo, Y. H., Tseng, C.-P., & Lee, C.-C. (2013) · PLoS ONE · doi:10.1371/journal.pone.0062323 · Cited by 224 · cited 4×
“Chang and colleagues used a basic keyword search strategy for journal papers only, risking publication bias, and they included a number of studies that were judged not to warrant inclusion in our own review on the basis of our inclusion criterion of ‘suspected sepsis’.(88) It appears that Chang reported pooled estimat…”
BackgroundResultInfluential
Cited by
Sleep disturbance and psychiatric disorders
Freeman, D., Sheaves, B., Waite, F., Harvey, A. G., & Harrison, P. J. (2020) · The Lancet Psychiatry · doi:10.1016/s2215-0366(20)30136-x · Cited by 843
Freeman, D., Sheaves, B., Goodwin, G. M., Yu, L.-M., Nickless, A., Harrison, P. J., Emsley, R., Luik, A. I., Foster, R. G., Wadekar, V., et al. (2017) · The Lancet Psychiatry · doi:10.1016/s2215-0366(17)30328-0 · Cited by 652
The Lancet Psychiatry Commission on psychological treatments research in tomorrow's science
Holmes, E. A., Ghaderi, A., Harmer, C. J., Ramchandani, P. G., Cuijpers, P., Morrison, A. P., Roiser, J. P., Bockting, C. L. H., O'Connor, R. C., Shafran, R., et al. (2018) · The Lancet Psychiatry · doi:10.1016/s2215-0366(17)30513-8 · Cited by 624
Innovative and rapid antimicrobial susceptibility testing systems
van Belkum, A., Burnham, C.-A. D., Rossen, J. W. A., Mallard, F., Rochas, O., & Dunne, W. M. (2020) · Nature Reviews Microbiology · doi:10.1038/s41579-020-0327-x · Cited by 355
Synthesising quantitative evidence in systematic reviews of complex health interventions
Higgins, J. P. T., López-López, J. A., Becker, B. J., Davies, S. R., Dawson, S., Grimshaw, J. M., McGuinness, L. A., Moore, T. H. M., Rehfuess, E. A., Thomas, J., et al. (2019) · BMJ Global Health · doi:10.1136/bmjgh-2018-000858 · Cited by 322
Metadata
- Authors
- Warhurst, G., Dunn, G., Chadwick, P., Blackwood, B., McAuley, D., Perkins, G. D., McMullan, R., Gates, S., Bentley, A., Young, D., Carlson, G. L., & Dark, P.
- Venue
- Health Technology Assessment
- Published
- 2015-05
- Volume
- 19
- Issue
- 35
- Pages
- 1-142
- ISSN
- 1366-5278 (ISSN-L)
- 2046-4924
- OpenAlex
- W1964039557
- Cited by
- 90
- References
- 12
- FWCI
- 1.37
- Type
- journal article
- Language
- en
- Open access
- diamond
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Rapid detection of health-care-associated bloodstream infection in critical care using multipathogen real-time polymerase chain reaction technology: a diagnostic accuracy study and systematic review. https://app.cochat.ai/papers/10.3310/hta19350
- The paper
- Warhurst, G., Dunn, G., Chadwick, P., Blackwood, B., McAuley, D., Perkins, G. D., McMullan, R., Gates, S., Bentley, A., Young, D., Carlson, G. L., & Dark, P. (2015). Rapid detection of health-care-associated bloodstream infection in critical care using multipathogen real-time polymerase chain reaction technology: a diagnostic accuracy study and systematic review. Health Technology Assessment. https://doi.org/10.3310/hta19350
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.