Can large language models approximate the results of meta-analyses in critical care? A meta-research study
The DOI matches its Crossref record; 14 of the 14 references it cites were found in a registry or an index.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“One study found that OpenAI’s o3 DeepResearch model achieved 83% concordance with meta-analyses and no hallucinations (27)”
From Hallucination Rate of Peer-Reviewed Citations Generated by Large Language Models in Neurocritical Care (2026) · cites this paper as [27]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Survey of Hallucination in Natural Language Generation
Ji, Z., Lee, N., Frieske, R., Yu, T., Su, D., Xu, Y., Ishii, E., Bang, Y. J., Madotto, A., & Fung, P. (2023) · ACM Computing Surveys · doi:10.1145/3571730 · Cited by 5,025
Limitations of meta-analyses of studies with high heterogeneity
Imrey, P. B. (2020) · JAMA Network Open · doi:10.1001/jamanetworkopen.2019.19325 · Cited by 319
Automated Paper Screening for Clinical Reviews Using Large Language Models
Guo, E., Gupta, M., Deng, J., Park, Y.-J., Paget, M., & Naugler, C. (2023) · arXiv · doi:10.48550/arxiv.2305.00844 · Cited by 230
Lansbury, L. E., Rodrigo, C., Leonardi-Bee, J., Nguyen-Van-Tam, J., & Shen Lim, W. (2020) · Critical Care Medicine · doi:10.1097/ccm.0000000000004093 · Cited by 207
Automated paper screening for clinical reviews using large language models: Data analysis study
Guo, E., Gupta, M., Deng, J., Park, Y.-J., Paget, M., & Naugler, C. (2024) · Journal of Medical Internet Research · doi:10.2196/48996 · Cited by 205
Data extraction for evidence synthesis using a large language model: A proof-of-concept study
Gartlehner, G., Kahwati, L., Hilscher, R., Thomas, I., Kugley, S., Crotty, K., Viswanathan, M., Nussbaumer‐Streit, B., Booth, G., Erskine, N., et al. (2024) · Research Synthesis Methods · doi:10.1002/jrsm.1710 · Cited by 164
Scherbakov, D., Hubig, N., Jansari, V., Bakumenko, A., & Lenert, L. A. (2024) · arXiv · doi:10.48550/arxiv.2409.04600 · Cited by 156
Scherbakov, D., Hubig, N., Jansari, V., Bakumenko, A., & Lenert, L. A. (2025) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocaf063 · Cited by 154
Tsou, A. Y., Treadwell, J. R., Erinoff, E., & Schoelles, K. (2020) · Systematic Reviews · doi:10.1186/s13643-020-01324-7 · Cited by 122
Assessing the Risk of Bias in Randomized Clinical Trials With Large Language Models
Lai, H., Ge, L., Sun, M., Pan, B., Huang, J., Hou, L., Yang, Q., Liu, J., Liu, J., Ye, Z., et al. (2024) · JAMA Network Open · doi:10.1001/jamanetworkopen.2024.12687 · Cited by 103
Duncan, S., McAuley, D. F., Walshe, M., McGaughey, J., Anand, R., Fallis, R., & Blackwood, B. (2020) · Intensive Care Medicine · doi:10.1007/s00134-020-06126-y · Cited by 91
Transforming literature screening: The emerging role of large language models in systematic reviews
Delgado-Chaves, F. M., Jennings, M. J., Atalaia, A., Wolff, J., Horvath, R., Mamdouh, Z. M., Baumbach, J., & Baumbach, L. (2025) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.2411962122 · Cited by 86
Collaborative Large Language Models for Automated Data Extraction in Living Systematic Reviews
Khan, M. A., Ayub, U., Naqvi, S. A. A., Khakwani, K. Z. R., Sipra, Z. B. R., Raina, A., Zou, S., He, H., Hossein, S. A., Hasan, B., et al. (2024) · doi:10.1101/2024.09.20.24314108 · Cited by 54
Lower vs Higher Fluid Volumes in Adult Patients With Sepsis
Sivapalan, P., Ellekjaer, K. L., Jessen, M. K., Meyhoff, T. S., Cronhjort, M., Hjortrup, P. B., Wetterslev, J., Granholm, A., Møller, M. H., & Perner, A. (2023) · CHEST · doi:10.1016/j.chest.2023.04.036 · Cited by 45
Research works printed but not linked: 45
- Møller, 2018, Are systematic reviews and meta-analyses still useful research? We are not sure, Intensive Care Med, 44, 518, 10.1007/s00134-017-5039-y · DOI
- Tobias, 2023, A primer on systematic review and meta-analysis in diabetes research, Diabetes Care, 46, 1882, 10.2337/dci23-0031 · DOI
- Esteva, 2019, A guide to deep learning in healthcare, Nat Med, 25, 24, 10.1038/s41591-018-0316-z · DOI · Paper page
- Issaiy, 2024, Methodological insights into ChatGPT’s screening performance in systematic reviews, BMC Med Res Methodol, 24, 78, 10.1186/s12874-024-02203-8 · DOI · Paper page
- Thirunavukarasu, 2023, Large language models in medicine, Nat Med, 29, 1930, 10.1038/s41591-023-02448-8 · DOI · Paper page
- Wei, 2022, Chain-of-thought prompting elicits reasoning in large language models, Adv Neural Inf Process Syst, 35, 24824
- Ortiz-Reyes, 2023, The efficacy of glutamine supplementation in severe adult burn patients: a systematic review with trial sequential meta-analysis, Crit Care Med, 51, 1086, 10.1097/CCM.0000000000005887 · DOI
- Villemure-Poliquin, 2023, Impact of early tracheostomy versus late or no tracheostomy in non-neurologically injured adult patients: a systematic review and meta-analysis, Crit Care Med, 51, 310, 10.1097/CCM.0000000000005699 · DOI
- Papazian, 2022, Effect of prone positioning on survival in adult patients receiving veno-venous extracorporeal membrane oxygenation for acute respiratory distress syndrome: a systematic review and meta-analysis, Intensive Care Med, 48, 270, 10.1007/s00134-021-06604-x · DOI
- Heymann, 2023, The effect of CytoSorb on inflammatory markers in critically ill patients: a systematic review and meta-analysis of randomized controlled trials, Crit Care Med, 51, 1659, 10.1097/CCM.0000000000006007 · DOI
- Waldauf, 2020, Effects of rehabilitation interventions on clinical outcomes in critically ill patients: a systematic review and meta-analysis of randomized controlled trials, Crit Care Med, 48, 1055, 10.1097/CCM.0000000000004382 · DOI
- Hadley-Brown, 2025, Prophylactic antibiotics in adults with acute brain injury who are invasively ventilated in the ICU: a systematic review and meta-analysis, Chest, 167, 1079, 10.1016/j.chest.2024.10.031 · DOI
- Turbil, 2020, Positive end-expiratory pressure-induced recruited lung volume measured by volume-pressure curves in acute respiratory distress syndrome: a physiologic systematic review and meta-analysis, Intensive Care Med, 46, 2212, 10.1007/s00134-020-06226-9 · DOI
- Li, 2022, Awake prone positioning for non-intubated patients with COVID-19-related acute hypoxaemic respiratory failure: a systematic review and meta-analysis, Lancet Respir Med, 10, 573, 10.1016/S2213-2600(22)00043-1 · DOI · Paper page
- Low, 2023, Extracorporeal cardiopulmonary resuscitation versus conventional cardiopulmonary resuscitation in adults with cardiac arrest: a comparative meta-analysis and trial sequential analysis, Lancet Respir Med, 11, 883, 10.1016/S2213-2600(23)00137-6 · DOI
- Greer, 2025, Ketamine versus etomidate for rapid sequence intubation: a systematic review and meta-analysis of randomized trials, Crit Care Med, 53, e374, 10.1097/CCM.0000000000006515 · DOI
- Pitre, 2025, Corticosteroids for adult patients hospitalised with non-viral community-acquired pneumonia: a systematic review and meta-analysis, Intensive Care Med, 51, 917, 10.1007/s00134-025-07912-2 · DOI
- Pettenuzzo, 2025, Prone positioning during veno-venous extracorporeal membrane oxygenation: a systematic review and meta-analysis, Intensive Care Med, 51, 930, 10.1007/s00134-025-07877-2 · DOI
- Blot, 2025, Liberal vs. restrictive transfusion strategies for acute brain injury: a systematic review and frequentist-Bayesian meta-analysis, Intensive Care Med, 51, 353, 10.1007/s00134-025-07807-2 · DOI
- Zawadka, 2023, Real-time ultrasound guidance as compared with landmark technique for subclavian central venous cannulation: a systematic review and meta-analysis with trial sequential analysis, Crit Care Med, 51, 642, 10.1097/CCM.0000000000005819 · DOI
- Lewis, 2022, Dexmedetomidine vs other sedatives in critically ill mechanically ventilated adults: a systematic review and meta-analysis of randomized trials, Intensive Care Med, 48, 811, 10.1007/s00134-022-06712-2 · DOI · Paper page
- Nakanishi, 2023, Effect of neuromuscular electrical stimulation in patients with critical illness: an updated systematic review and meta-analysis of randomized controlled trials, Crit Care Med, 51, 1386, 10.1097/CCM.0000000000005941 · DOI
- Sato, 2025, Mortality in patients with sepsis treated with esmolol or landiolol: a systematic review and meta-analysis of randomized controlled trials with trial sequential analysis, Chest, 167, 121, 10.1016/j.chest.2024.08.020 · DOI
- Snow, 2021, Tocilizumab in COVID-19: a meta-analysis, trial sequential analysis, and meta-regression of randomized controlled trials, Intensive Care Med, 47, 641, 10.1007/s00134-021-06416-z · DOI
- Granton, 2020, High-flow nasal cannula compared with conventional oxygen therapy or noninvasive ventilation immediately postextubation: a systematic review and meta-analysis, Crit Care Med, 48, e1129, 10.1097/CCM.0000000000004576 · DOI
- D’amico, 2024, Low versus high blood pressure targets in critically ill and surgical patients: a systematic review and meta-analysis of randomized controlled trials, Crit Care Med, 52, 1427, 10.1097/CCM.0000000000006314 · DOI
- Meyhoff, 2020, Lower vs higher fluid volumes during initial management of sepsis: a systematic review with meta-analysis and trial sequential analysis, Chest, 157, 1478, 10.1016/j.chest.2019.11.050 · DOI · Paper page
- Paton, 2024, Association of active mobilisation variables with adverse events and mortality in patients requiring mechanical ventilation in the intensive care unit: a systematic review and meta-analysis, Lancet Respir Med, 12, 386, 10.1016/S2213-2600(24)00011-0 · DOI
- Zampieri, 2024, Balanced crystalloids versus saline for critically ill patients (BEST-living): a systematic review and individual patient data meta-analysis, Lancet Respir Med, 12, 237, 10.1016/S2213-2600(23)00417-4 · DOI · Paper page
- Saleem, 2023, Effect of corticosteroids on mortality and clinical cure in community-acquired pneumonia: a systematic review, meta-analysis, and meta-regression of randomized control trials, Chest, 163, 484, 10.1016/j.chest.2022.08.2229 · DOI
- Chaudhuri, 2021, Corticosteroids in COVID-19 and non-COVID-19 ARDS: a systematic review and meta-analysis, Intensive Care Med, 47, 521, 10.1007/s00134-021-06394-2 · DOI · Paper page
- Al Lawati, 2021, Efficacy and safety of tranexamic acid in acute traumatic brain injury: a systematic review and meta-analysis of randomized-controlled trials, Intensive Care Med, 47, 14, 10.1007/s00134-020-06279-w · DOI
- McChesney, 2025, Impact of short-acting beta-blockers on the outcomes of patients with septic shock: a systematic review and meta-analysis, Crit Care Med, 53, e1125, 10.1097/CCM.0000000000006604 · DOI
- Larcipretti, 2025, Transfusion practices in traumatic brain injury: a systematic review and meta-analysis of randomized controlled trials, Crit Care Med, 53, e963, 10.1097/CCM.0000000000006585 · DOI
- Kilcommons, 2025, Adjunctive midodrine therapy for vasopressor-dependent shock in the ICU: a systematic review and meta-analysis, Crit Care Med, 53, e384, 10.1097/CCM.0000000000006519 · DOI
- Maertens, 2022, Effectiveness of continuous cuff pressure control in preventing ventilator-associated pneumonia: a systematic review and meta-analysis of randomized controlled trials, Crit Care Med, 50, 1430, 10.1097/CCM.0000000000005630 · DOI
- Carayannopoulos, 2024, Antipsychotics in the treatment of delirium in critically ill patients: a systematic review and meta-analysis of randomized controlled trials, Crit Care Med, 52, 1087, 10.1097/CCM.0000000000006251 · DOI
- Sharif, 2022, Probiotics in critical illness: a systematic review and meta-analysis of randomized controlled trials, Crit Care Med, 50, 1175, 10.1097/CCM.0000000000005580 · DOI
- Hasan, 2024, Integrating large language models in systematic reviews: a framework and case study using ROBINS-I for risk of bias assessment, BMJ Evid Based Med, 29, 394, 10.1136/bmjebm-2023-112597 · DOI · Paper page
- Purewal, 2025, Human versus artificial intelligence: evaluating ChatGPT’s performance in conducting published systematic reviews with meta-analysis in chronic pain research, Reg Anesth Pain Med, 10.1136/rapm-2024-106358 · DOI
- Mascarenhas, 2020, Concordance between systematic reviews of randomized controlled trials in assisted reproduction: an overview, Hum Reprod Open, 2020, 10.1093/hropen/hoaa058 · DOI
- Song, 2016, Laparoscopic cholecystectomy for acute cholecystitis: early or delayed? Evidence from a systematic review of discordant meta-analyses, Medicine (Baltimore), 95, 10.1097/MD.0000000000003835 · DOI
- Bolland, 2014, A case study of discordant overlapping meta-analyses: vitamin D supplements and fracture, PloS One, 9, 10.1371/journal.pone.0115934 · DOI · Paper page
- Lucenteforte, 2015, Discordances originated by multiple meta-analyses on interventions for myocardial infarction: a systematic review, J Clin Epidemiol, 68, 246, 10.1016/j.jclinepi.2014.11.004 · DOI
- Osnabrugge, 2015, A systematic review and critical assessment of 11 discordant meta-analyses on reduced-function CYP2C19 genotype and risk of adverse clinical outcomes in clopidogrel users, Genet Med, 17, 3, 10.1038/gim.2014.76 · DOI
Cited by
Seifi, A., & Seyfi, A. (2026) · Critical Care Explorations · doi:10.1097/cce.0000000000001474 · Cited by 1
Metadata
- Authors
- Pratte, M., Thirukumar, S., Zhang, C., Slessarev, M., Basmaji, J., & Prager, R.
- Venue
- Journal of Critical Care
- Publisher
- Elsevier BV
- Published
- 2026-04
- Volume
- 92
- Pages
- 155358
- ISSN
- 0883-9441
- Cited by
- 7
- References
- 14
- Language
- en
- Licence
- www.elsevier.com/tdm/userlicense/1.0/ (tdm)
- www.elsevier.com/legal/tdmrep-license (tdm)
- doi.org/10.15223/policy-017 (stm-asf)
- doi.org/10.15223/policy-037 (stm-asf)
- doi.org/10.15223/policy-012 (stm-asf)
- doi.org/10.15223/policy-029 (stm-asf)
- doi.org/10.15223/policy-004 (stm-asf)
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.