A Review of the True Methodological Quality of Nutritional Support Trials Conducted in the Critically Ill: Time for Improvement
The DOI matches its Crossref record; 13 of the 13 references it cites were found in a registry or an index.
Abstract
In Brief In this review we sought to appraise the true methodological quality of nutritional support studies conducted in critically ill patients and to compare these findings to the methodological quality of sepsis trials. An extensive literature search revealed 111 randomized controlled trials conducted in critically ill patients evaluating the impact of nutritional support interventions on clinically meaningful outcomes. Compared with sepsis trials, nutritional support studies were significantly less likely to use blinding (32 of 40 versus 35 of 111, P < 0.001) or present an intention-to-treat analysis (37 of 40 versus 64 of 111, P < 0.001). There was a trend toward the less frequent use of randomization methods that are known to maintain allocation concealment (12 of 40 versus 19 of 111, P = 0.10). Although nutritional support studies demonstrated a significant increase in the use of blinding after the publication of the CONSORT statement in 1996 (9 of 47 versus 26 of 64 post-CONSORT, P = 0.023), there were no improvements in other key areas. Previous publications have described the overall methodological quality of sepsis trials as “poor.” Nutritional support studies were significantly worse than sepsis trials in all aspects of methodological quality, and there were few improvements noted over time. To detect important differences in clinically meaningful outcomes in critical care, the methodological quality of future studies must be improved. IMPLICATIONS: The true methodological quality of feeding studies conducted in critically ill patients was assessed. The quality of feeding studies was consistently rated worse than sepsis trials, which have previously been described as “poor.” To reliably detect differences in clinically meaningful outcomes, the quality of future feeding studies must be improved.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Assessing the quality of controlled clinical trials
Jüni, P., Altman, D. G., & Egger, M. (2001) · BMJ · doi:10.1136/bmj.323.7303.42 · Cited by 3,309 · cited 2×
“Indeed, the appropriate use of blinding may decrease overoptimistic estimates of treatment effect by up to 26% (39).”
BackgroundImproving the Quality of Reporting of Randomized Controlled Trials: The CONSORT Statement
Begg, C. (1996) · JAMA · doi:10.1001/jama.1996.03540080059030 · Cited by 3,127
Moher, D., Schulz, K. F., & Altman, D. G. (2001) · BMC Medical Research Methodology · doi:10.1186/1471-2288-1-2 · Cited by 2,755
What is meant by intention to treat analysis? Survey of published randomised controlled trials
Hollis, S., & Campbell, F. (1999) · BMJ · doi:10.1136/bmj.319.7211.670 · Cited by 2,160
Surrogate endpoints in clinical trials: Definition and operational criteria
Prentice, R. L. (1989) · Statistics in Medicine · doi:10.1002/sim.4780080407 · Cited by 2,057
Moher, D., Jadad, A. R., Nichol, G., Penman, M., Tugwell, P., & Walsh, S. (1995) · Controlled Clinical Trials · doi:10.1016/0197-2456(94)00031-w · Cited by 1,308 · cited 1×
“With one exception, the scales are uniformly weak in how they were developed” (26).”
BackgroundEgger, M., Jüni, P., Bartlett, C., Holenstein, F., & Sterne, J. (2003) · Health Technology Assessment · doi:10.3310/hta7010 · Cited by 1,181 · cited 2×
“(9), 2) the presentation of results from all randomized”
BackgroundMoher, D., Jones, A., Lepage, L., & for the CONSORT Group (2001) · JAMA · doi:10.1001/jama.285.15.1992 · Cited by 1,027 · cited 2×
“Indeed, an informal comparison to other multidisciplinary trials suggests that there is much room for improvement in sepsis trials (15).”
BackgroundResultAllocation concealment in randomised trials: defending against deciphering
Schulz, K. F., & Grimes, D. A. (2002) · The Lancet · doi:10.1016/s0140-6736(02)07750-4 · Cited by 923 · cited 2×
“Likewise, a centrally controlled randomization process, whereby a randomization center is contacted by phone, fax, e-mail, or via the web after a patient is recruited into the trial, is also an excellent way to maintain allocation concealment (33).”
BackgroundDirection and impact of language bias in meta-analyses of controlled trials: empirical study
Jüni, P., Holenstein, F., Sterne, J., Bartlett, C., & Egger, M. (2002) · International Journal of Epidemiology · doi:10.1093/ije/31.1.115 · Cited by 892
Statistical Considerations in the Intent-to-Treat Principle
Lachin, J. M. (2000) · Controlled Clinical Trials · doi:10.1016/s0197-2456(00)00046-5 · Cited by 652 · cited 2×
“Simulation studies conducted under reasonable assumptions have demonstrated that with as little as 10% loss to follow-up in each arm, the chance of obtaining a false positive result can easily double (40).”
BackgroundMethodThe double-blind, randomized, placebo-controlled trial
Kaptchuk, T. J. (2001) · Journal of Clinical Epidemiology · doi:10.1016/s0895-4356(00)00347-4 · Cited by 595 · cited 1×
“Although there may be disagreement over the relative importance of many items included in composite scales, extensive reviews of the methodological literature consistently agree on the importance of three criteria: 1) the maintenance of allocation concealment (9), 2) the presentation of results from all randomized pat…”
BackgroundQuality of Reporting of Randomized Trials as a Measure of Methodologic Quality
Huwiler-Müntener, K. (2002) · JAMA · doi:10.1001/jama.287.21.2801 · Cited by 397 · cited 1×
“(7), it has been recommended that an assessment of”
Background
Cited by
Plint, A. C., Moher, D., Morrison, A., Schulz, K., Altman, D. G., Hill, C., & Gaboury, I. (2006) · Medical Journal of Australia · doi:10.5694/j.1326-5377.2006.tb00557.x · Cited by 872
Randomization and allocation concealment: a practical guide for researchers
Doig, G. S., & Simpson, F. (2005) · Journal of Critical Care · doi:10.1016/j.jcrc.2005.04.005 · Cited by 656
Self-citationDoig, G. S., Heighes, P. T., Simpson, F., Sweetman, E. A., & Davies, A. R. (2009) · Intensive Care Medicine · doi:10.1007/s00134-009-1664-4 · Cited by 464
Self-citationSimpson, F., & Doig, G. S. (2005) · Intensive Care Medicine · doi:10.1007/s00134-004-2511-2 · Cited by 441
Self-citationAndrews, P. J. D., Avenell, A., Noble, D. W., Campbell, M. K., Croal, B. L., Simpson, W. G., Vale, L. D., Battison, C. G., Jenkinson, D. J., Cook, J. A., et al. (2011) · BMJ · doi:10.1136/bmj.d1542 · Cited by 379
Metadata
- Authors
- Doig, G. S., Simpson, F., & Delaney, A.
- Venue
- Anesthesia & Analgesia
- Published
- 2005-02
- Volume
- 100
- Issue
- 2
- Pages
- 527-533
- ISSN
- 0003-2999 (ISSN-L)
- OpenAlex
- W2063202673
- Cited by
- 79
- References
- 13
- FWCI
- 5.53
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.