Implementation approaches and barriers for rule-based and machine learning-based sepsis risk prediction tools: a qualitative study
Open accessThe DOI matches its Crossref record; 41 of the 41 references it cites were found in a registry or an index.
Abstract
Objective: Many options are currently available for sepsis surveillance clinical decision support (CDS) from electronic medical record (EMR) vendors, third party, and homegrown models drawing on rule-based (RB) and machine learning (ML) algorithms. This study explores sepsis CDS implementation from the perspective of implementation leads by describing the motivations, tool choices, and implementation experiences of a diverse group of implementers. Materials and Methods: Semi-structured interviews were conducted with and a questionnaire was administered to 21 hospital leaders overseeing CDS implementation at 15 US medical centers. Participants were recruited via convenience sampling. Responses were coded by 2 coders with consensus approach and inductively analyzed for themes. Results: Use of sepsis CDS is motivated in part by quality metrics for sepsis patients. Choice of tool is driven by ease of integration, customization capability, and perceived predictive potential. Implementation processes for these CDS tools are complex, time-consuming, interdisciplinary undertakings resulting in heterogeneous choice of tools and workflow integration. To improve clinician acceptance, implementers addressed both optimization of the alerts as well as clinician understanding and buy in. More distrust and confusion was reported for ML models, as compared to RB models. Respondents described a variety of approaches to overcome implementation barriers; these approaches related to alert firing, content, integration, and buy-in. Discussion: While there are shared socio-technical challenges of implementing CDS for both RB and ML models, attention to user education, support, expectation management, and dissemination of effective practices may improve feasibility and effectiveness of ML models in quality improvement efforts. Conclusion: Further implementation science research is needed to determine real world efficacy of these tools. Clinician acceptance is a significant barrier to sepsis CDS implementation. Successful implementation of less clinically intuitive ML models may require additional attention to user confusion and distrust.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Limitations relate to the small number of empirical studies of deployed sepsis-prediction algorithms, under-reporting of post-implementation performance metrics, focus on adult hospital settings, and potential publication bias from under-reporting of other sepsis MLA implementation studies.18”
From Deployment of machine learning algorithms to predict sepsis: systematic review and application of the SALIENT clinical AI implementation framework (2023) · cites this paper as [18]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Implementation barriers for sepsis AI cluster around trust and interpretability, workflow integration, technical readiness and generalizability, governance and safety, leadership alignment, and the resources required for sustainment (Table 4) [10,33,34,46,48,77,78].”
From Artificial Intelligence to Facilitate SEP-1 Measure Compliance and Fluid Management in Sepsis (2026) · cites this paper as [77]
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“Other studies have examined implementation issues when integrating machine learning models into clinical practice and reported numerous socio-technical factors such as the unfamiliarity of AI among clinicians and lack of AI education, trust in the accuracy and utility of predictive models, and IT support among other issues that affected this process (Joshi et al., 2022;Sandhu et al., 2020).”
From The application and use of artificial intelligence in cancer nursing: A systematic review (2024) · cites this paper as Joshi et al., 2022
The cited source says what the claim attributes to it.
In the citing paper
“Their study found that implementation was complex and resource-intensive, with major barriers including alert optimization, workflow integration, and especially clinician acceptance. There were greater distrust, confusion, and interpretability challenges for machine learning models, highlighting the need for improved user education, transparency, and implementation strategies.”
From Artificial Intelligence to Facilitate SEP-1 Measure Compliance and Fluid Management in Sepsis (2026) · cites this paper as [77]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
S., N. L. (2017) · doi:10.1177/1609406917733847 · Cited by 14,051
Advances in Neural Information Processing Systems 29
Teymur, O., Zygalakis, K., & Calderhead, B. (2016) · Cited by 13,887
Saturation in qualitative research: exploring its conceptualization and operationalization
Saunders, B., Sim, J., Kingstone, T., Baker, S., Waterfield, J., Bartlam, B., Burroughs, H., & Jinks, C. (2018) · Quality & Quantity · doi:10.1007/s11135-017-0574-8 · Cited by 12,033
Seymour, C. W., Liu, V. X., Iwashyna, T. J., Brunkhorst, F. M., Rea, T. D., Scherag, A., Rubenfeld, G., Kahn, J. M., Shankar-Hari, M., Singer, M., et al. (2016) · JAMA · doi:10.1001/jama.2016.0288 · Cited by 3,939 · cited 1×
“Some prospective studies have shown significant reduction in time to blood culture and antibiotics without significant reductions in mortality.(9,12,16) While others have largely been negative, including 2 randomized controlled trials.”
BackgroundExplainable machine-learning predictions for the prevention of hypoxaemia during surgery
Lundberg, S. M., Nair, B., Vavilala, M. S., Horibe, M., Eisses, M. J., Adams, T., Liston, D. E., Low, D. K.-W., Newman, S.-F., Kim, J., et al. (2018) · Nature Biomedical Engineering · doi:10.1038/s41551-018-0304-0 · Cited by 1,967
Incidence and trends of sepsis in US hospitals using clinical vs claims data, 2009-2014.
Rhee, C., Dantes, R., Epstein, L., Murphy, D. J., Seymour, C. W., Iwashyna, T. J., Kadri, S. S., Angus, D. C., Danner, R. L., Fiore, A. E., et al. (2017) · JAMA · doi:10.1001/jama.2017.13836 · Cited by 1,884
Wong, A., Otles, E., Donnelly, J. P., Krumm, A., McCullough, J., DeTroyer-Cooley, O., Pestrue, J., Phillips, M., Konye, J., Penoza, C., et al. (2021) · JAMA Internal Medicine · doi:10.1001/jamainternmed.2021.2626 · Cited by 995 · cited 1×
“Furthermore, a recent large validation cohort study focusing on characterizing alert fatigue around the Epic sepsis detection algorithm reported low sensitivity and many missed cases of sepsis despite generation of a large number of alerts.(32) However, the argument can be made that further evaluation is needed and th…”
BackgroundFleuren, L. M., Klausch, T. L. T., Zwager, C. L., Schoonmade, L. J., Guo, T., Roggeveen, L. F., Swart, E. L., Girbes, A. R. J., Thoral, P., Ercole, A., et al. (2020) · Intensive Care Medicine · doi:10.1007/s00134-019-05872-y · Cited by 755 · cited 1×
“This approach was chosen as qualitative methods can provide “rich descriptions of complex phenomena” typical of healthcare organization and IT implementation.(20) A convenience sample was developed of hospital leaders from various hospitals nationwide with criteria intended to include implementors of CDS tools from 3…”
MethodIntroducing artificial intelligence training in medical education
Paranjape, K., Schinkel, M., Nannan Panday, R., Car, J., & Nanayakkara, P. (2019) · JMIR Medical Education · doi:10.2196/16048 · Cited by 634
Desautels, T., Calvert, J., Hoffman, J., Jay, M., Kerem, Y., Shieh, L., Shimabukuro, D., Chettipally, U., Feldman, M. D., Barton, C., et al. (2016) · JMIR Medical Informatics · doi:10.2196/medinform.5909 · Cited by 509
Cited by
Hogg, H. D. J., Al-Zubaidy, M., Technology Enhanced Macular Services Study Reference Group, Talks, J., Denniston, A. K., Kelly, C. J., Malawana, J., Papoutsi, C., Teare, M. D., Keane, P. A., et al. (2023) · Journal of Medical Internet Research · doi:10.2196/39742 · Cited by 163
Rahimi, A. K., Pienaar, O., Ghadimi, M., Canfell, O. J., Pole, J. D., Shrapnel, S., van der Vegt, A. H., & Sullivan, C. M. (2024) · Journal of Medical Internet Research · doi:10.2196/49655 · Cited by 164
“%) originated from the United States [20,32,33,36,37,39,43-45, Radiology was the clinical setting in 46% (12/26) of the studies [33,34,36,37,39-41, 43-45”
InfluentialTrust in and Acceptance of Artificial Intelligence Applications in Medicine: Mixed Methods Study
Shevtsova, D., Ahmed, A., Boot, I. W. A., Sanges, C., Hudecek, M., Jacobs, J. J. L., Hort, S., & Vrijhoef, H. J. M. (2024) · JMIR Human Factors · doi:10.2196/47031 · Cited by 124
“Therefore, it can be argued that acceptance of an AI application depends on trust people have toward this technology [11,15,16].”
BackgroundImplementation frameworks for end-to-end clinical AI: derivation of the SALIENT framework
van der Vegt, A. H., Scott, I. A., Dermawan, K., Schnetler, R. J., Kalke, V. R., & Lane, P. J. (2023) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocad088 · Cited by 109
“Themes: (1) Regulatory challenges; (2) Oversight and regulation; (3) Safety and efficacy surveillance; (4) Accountability; (5) Liability; (6) Equity and inclusion; (7) Transparency; (8) Education; (9) Patient engagement; (10) Cybersecurity and privacy; (11) Ethics and fairness; (12) Financial incentives.”
Finkelstein, J., Gabriel, A. S., Schmer, S., Truong, T., & Dunn, A. S. (2024) · Journal of Medical Systems · doi:10.1007/s10916-024-02104-9 · Cited by 93
“Previous studies utilized qualitative interviews for assessing challenges to AI implementation in healthcare without aligning their analyses with existing implementation science frameworks [55–57].”
Methodvan der Vegt, A. H., Scott, I. A., Dermawan, K., Schnetler, R. J., Kalke, V. R., & Lane, P. J. (2023) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocad075 · Cited by 72
“Limitations relate to the small number of empirical studies of deployed sepsis-prediction algorithms, underreporting of post-implementation performance metrics, focus on adult hospital settings, and potential publication bias from underreporting of other sepsis MLA implementation studies.(18) Although risk of bias for…”
BackgroundGiddings, R., Joseph, A., Callender, T., Janes, S. M., van der Schaar, M., Sheringham, J., & Navani, N. (2024) · The Lancet Digital Health · doi:10.1016/s2589-7500(23)00241-8 · Cited by 80
“…29,48,63 (ie, desensitisation to risk prediction alerts) as a barrier to success; however, one article reported this issue was lower with ML models, 48 whereas models with appropriate alerts had “I think that the visual aid would be really great for families to understand, to completely…”
BackgroundMethodResultInfluentialPreti, L. M., Ardito, V., Compagni, A., Petracca, F., & Cappellaro, G. (2024) · Journal of Medical Internet Research · doi:10.2196/55897 · Cited by 62
“Implementation teams were observed as well in the form of quality improvement teams [34], AI governance committees [40,46,63], or interdisciplinary teams of HCPs, software engineers, developers, IT specialists, and other figures [46,51,55,64].”
InfluentialHealth Care Professionals’ Experience of Using AI: Systematic Review With Narrative Synthesis
Ayorinde, A., Mensah, D. O., Walsh, J., Ghosh, I., Ibrahim, S. A., Hogg, J., Peek, N., & Griffiths, F. (2024) · Journal of Medical Internet Research · doi:10.2196/55766 · Cited by 55
Kuo, R. Y. L., Freethy, A., Smith, J. H., Hill, R., Joanna, C., Jerome, D., Harriss, E., Collins, G. S., Tutton, E., & Furniss, D. (2024) · EClinicalMedicine · doi:10.1016/j.eclinm.2024.102555 · Cited by 59
“31,34,37,45,47,56 Conversely, clinicians described the in fl uence of other stakeholder groups; patients, politicians, and employing institutions as the driving force behind AI adoption.”
BackgroundInfluentialThe application and use of artificial intelligence in cancer nursing: A systematic review
O'Connor, S., Vercell, A., Wong, D., Yorke, J., Fallatah, F. A., Cave, L., & Anny Chen, L.-Y. (2024) · European Journal of Oncology Nursing · doi:10.1016/j.ejon.2024.102510 · Cited by 51
Draeger, L., Fleischmann-Struzek, C., Gehrke-Beck, S., Heintze, C., Thomas-Rüddel, D. O., & Schmidt, K. F. R. (2025) · BMC Health Services Research · doi:10.1186/s12913-025-12777-8 · Cited by 26
“Disagreement prevailed as to whether clinical decision support has the predictive potential to provide clinically relevant specificity [36].”
Kasun, M., Ryan, K., Paik, J., Lane-McKinley, K., Dunn, L. B., Roberts, L. W., & Kim, J. P. (2023) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocad238 · Cited by 22
Kim, J. P., Ryan, K., Kasun, M., Hogg, J., Dunn, L. B., & Roberts, L. W. (2023) · JMIR AI · doi:10.2196/47449 · Cited by 20
“…end-users’ perceptions of algorithms’ utility, the potential for overreliance on algorithms when performing clinical tasks, users’ lack of knowledge of the rules governing algorithms, and disruptions of existing clinical infrastructure, workflows, and configurations of care teams [15,16,23,26].”
BackgroundArtificial Intelligence for Cardiovascular Care in Action
Biswas, D., Thangaraj, P., Pedroso, A. F., Ogunniyi, M. O., Maddox, T. M., Ahmad, F. S., & Khera, R. (2025) · JACC Advances · doi:10.1016/j.jacadv.2025.102307 · Cited by 20
Wainstein, M., Flanagan, E., Johnson, D. W., & Shrapnel, S. (2023) · Frontiers in Nephrology · doi:10.3389/fneph.2023.1220214 · Cited by 16
“This includes information on how often a model should be re-validated, potentially re-trained and fine-tuned as well as how it should be integrated into clinical workflows (18, 19).”
BackgroundLazzarino, R., Borek, A., Honeyford, K., Welch, J., Brent, A., Kinderlerer, A. R., Cooke, G., Patil, S., Gordon, A. C., Glampson, B., et al. (2024) · JMIR Human Factors · doi:10.2196/56949 · Cited by 17
“For this same reason, another work involving hospital leaders found that participant tended to distrust more machine learning than rule-based sepsis CCDSSs [55].”
BackgroundResultNguyen, K. A., Wilson, D. L., Diiulio, J., Hall, B., Militello, L. G., Gellad, W. F., Harle, C. A., Lewis, M. O., Schmidt, S. O., Rosenberg, E. I., et al. (2024) · Bioelectronic Medicine · doi:10.1186/s42234-024-00156-3 · Cited by 18
“…in decision-making processes such as psychological resilience of women undergoing treatment for breast cancer (Cm et al. 2023), severe sepsis and septic shock (Gian-nini et al. 2019; Joshi et al. 2022; Adams et al. 2022), and epilepsy surgical candidate identification (Kanbar et al. 2022).”
BackgroundBonakdeh, E. S., Sohal, A. S., Rajabkhah, K., Prajogo, D. I., Melder, A., Nguyen, D. Q., Bingham, G., & Tong, E. (2024) · Industrial Management & Data Systems · doi:10.1108/imds-08-2022-0484 · Cited by 17
Safiya Parvin, A., & Saleena, B. (2023) · ICT Express · doi:10.1016/j.icte.2023.07.007 · Cited by 12
Sepsis in silico: definition, development and application of an electronic phenotype for sepsis
Al-Sultani, Z., Inglis, T. J. J., McFadden, B. R., Thomas, E., & Reynolds, M. A. (2025) · Journal of Medical Microbiology · doi:10.1099/jmm.0.001986 · Cited by 10
“However, it is important to note that rule-based definitions have limits, as they cannot fully capture the complexity of sepsis and may require periodic updates as new evidence emerges [42].”
Usability and adoption in a randomized trial of GutGPT a GenAI tool for gastrointestinal bleeding
Chung, S., Giuffrè, M., Rajashekar, N., Pu, Y., Shin, Y. E., Kresevic, S., Chan, C., Nakamura-Sakai, S., You, K., Saarinen, T., et al. (2025) · npj Digital Medicine · doi:10.1038/s41746-025-01896-5 · Cited by 10
“Mostsimulationteamsincluded2or3participants, withonlyonegroupof5andafewgroupsof4,limitingthefeasibilityof meaningfulsubgroupanalysisbyteamsize.”
A review of risk concepts and models for predicting the risk of primary stroke
Hunter, E., & Kelleher, J. D. (2022) · Frontiers in Neuroinformatics · doi:10.3389/fninf.2022.883762 · Cited by 9
“While explainable and interpretable AI have been a recent focus within the machine learning field, there is still evidence to show that clinicians and patients distrust in machine learning methods prevents greater uptake (Elish, 2018; Mpanya et al., 2021; Joshi et al., 2022).”
BackgroundCan we predict the future of respiratory failure prediction?
Pearce, A. K., Nemati, S., Goligher, E. C., Hough, C. L., Holder, A. L., Wardi, G., Yang, P., Boussina, A. E., Lyons, P. G., Sahetya, S. K., et al. (2025) · Critical Care · doi:10.1186/s13054-025-05484-7 · Cited by 11
“Barriers to implementation include challenges in analytic platform integration into the electronic health record (EHR) [50], costs to the health system [51], clinician acceptance [52], and model maintenance over time and among different patient populations and clinical practice variations [53].”
García-García, R. E. (2025) · Revista Cientifica de Sistemas e Informatica · doi:10.51252/rcsi.v5i2.928 · Cited by 11
Raszke, P., Giebel, G. D., Abels, C., Wasem, J., Adamzik, M., Nowak, H., Palmowski, L., Heinz, P., Mreyen, S., Timmesfeld, N., et al. (2024) · JMIR Research Protocols · doi:10.2196/62704 · Cited by 7
“These criteria include ease of implementation, predictive capability, and costs [39].”
Jafarpour, H., Wu, G., Cheligeer, C., Yan, J., Xu, Y., Southern, D. A., Eastwood, C. A., Zeng, Y., & Quan, H. (2025) · Artificial Intelligence in Medicine · doi:10.1016/j.artmed.2025.103281 · Cited by 7
Farzanegan, F., Sepehri, M. M., Samani, M. R. G., & Barati, L. (2025) · Engineering Applications of Artificial Intelligence · doi:10.1016/j.engappai.2025.111363 · Cited by 5
Raszke, P., Giebel, G. D., Wasem, J., Adamzik, M., Nowak, H., Palmowski, L., Heinz, P., Timmesfeld, N., Tokic, M. C., Brunkhorst, F. M., et al. (2026) · Journal of Medical Internet Research · doi:10.2196/76772 · Cited by 5
“For instance, low acceptance may be mitigated by involving health care providers directly in the design and development of CDSS [66-68], while targeted training and educational programs could address knowledge gaps among service providers and enhance trust in this technology [37,67].”
InfluentialBowles, K. H., Stawnychy, M. A., O’Connor, M. L., Mikkelsen, M. E., Hodgson, N. A., Sang, E., You, S. B., Pitcher, K. S., Song, J., Oh, S., et al. (2025) · Frontiers in Medicine · doi:10.3389/fmed.2025.1632083 · Cited by 4
Levin, S., Sarani, N., Hinson, J. S., Naiman, M., Cannon, C. M., Smith, A., Steinhart, B., Debraine, A., Kehoe, S. M., Immhoff, B., et al. (2025) · Critical Care Explorations · doi:10.1097/cce.0000000000001194 · Cited by 4
From Innovation to Implementation
Lu, Y., & Nasir, K. (2025) · Journal of the American College of Cardiology · doi:10.1016/j.jacc.2025.05.031 · Cited by 4
Antweiler, D., & Fuchs, G. (2025) · Computers & Graphics · doi:10.1016/j.cag.2025.104212 · Cited by 3
“Underlying the trust in the model performance itself is trust in the underlying ground truth in terms of data quality [50,53,78] and provenance [49,79].”
InfluentialBias and Fairness Across the Healthcare AI Lifecycle: A Clinician-Oriented Review
Koçak, B., Ponsiglione, A., Dang, V. N., Dietzel, M., Lekadir, K., & Cuocolo, R. (2026) · Balkan Medical Journal · doi:10.4274/balkanmedj.galenos.2026.2026-6-3 · Cited by 2
“97,98 In addition, model performance is not static over time; concept drift can erode fairness as clinical guidelines, disease epidemiology, or population characteristics evolve.”
Vandana, V., & Chhikara, R. R. (2024) · Indian Journal of Science and Technology · doi:10.17485/ijst/v17i41.1925 · Cited by 2
Shaima, S. N., Genisca, A. E., Faruk, M. T., Uddin, M. F., Saha, A., Sultana, N., Kadakia, N., Gainey, M., Kim, E., Shaw, K., et al. (2025) · JMIR Formative Research · doi:10.2196/73451 · Cited by 1
Artificial Intelligence to Facilitate SEP-1 Measure Compliance and Fluid Management in Sepsis
Nguyen, H. B., Krishtopaytis, E., Lopez, E., Farnoudi, N., Van, T., Kharalampova, V., & Coz Yataco, A. (2026) · Journal of Clinical Medicine · doi:10.3390/jcm15093477
“Implementation barriers for sepsis AI cluster around trust and interpretability, work-flow integration, technical readiness and generalizability, governance and safety, leadership alignment, and the resources required for sustainment (Table 4) [10,33,34,46,48,77,78].”
Vandana, & Hari, P. B. (2023) · International Conference on Inventive Research in Computing Applications (ICIRCA) · doi:10.1109/icirca57980.2023.10220741 · Cited by 1
“As compared to Rule Based Systems (RBS), ML based prediction methods can reduce death rate by a huge difference [11], [33].”
BackgroundZhang, Z., Liu, Z., Liu, Y., Gu, D., Zhang, C., Wang, Y., & Bian, Y. (2025) · Hospitals · doi:10.3390/hospitals2010006
“Team-Based Division of Labor and Collaboration [31]—”
Reviews in Frontiers in Nephrology
(2025) · Frontiers research topics · doi:10.3389/978-2-8325-6101-0
Kunz-Lomelin, A., Mauldin, R. L., & Valente, T. W. (2025) · INQUIRY The Journal of Health Care Organization Provision and Financing · doi:10.1177/00469580251370512
Oad Fält, T. (2025) · DiVA (Linnaeus University)
Sauro, K. M., Bajgain, B. B., van Rassel, C. R., Har, B., Welsh, R. C., & Lee, J. (2026) · JMIR Cardio · doi:10.2196/81303
Suwanaratana, R., Amphansap, T., Lawanprasert, A., Wuthikraikun, C., & Chanalithichai, N. (2026) · Research Square · doi:10.21203/rs.3.rs-8758035/v1
Sneha, S., Awofisayo, R. M., Nino, V., Rischie, I., & Kumah, L. I. (2026) · JMIR AI · doi:10.2196/preprints.98274
Tabios, M. A., & Merced, J. J. D. (2026) · International Journal of Nursing Healthcare and Hospital Administration · doi:10.66206/eduheart.ijnhha.78
Bogner, E., Thomas, A., Bajgain, B. B., van Rassel, C. R., Sauro, K. M., & Lee, J. (2026) · JMIR Medical Informatics · doi:10.2196/89834
“Several studies included in this review underlined the importance of properly integrating new systems into existing clinical practice without disrupting workflows [10,13,14, 17].”
InfluentialScott, I. A., van der Vegt, A. H., Campbell, V. K., Lane, P. J., Rice, M., & Venkatesh, B. (2026) · Journal of Evaluation in Clinical Practice · doi:10.1111/jep.70557
Zhu, X., Cao, X., Wang, S., Zhu, X., & Yin, L. (2026) · Research Square · doi:10.21203/rs.3.rs-10746657/v1
AI in Long-Term Care: A Closed-Loop Sociotechnical Reliability Framework
Min, K., & Min, J. (2026) · Journal of Medical Internet Research · doi:10.2196/105161
Moser, C. H., Harmon, S. C., & Delate, V. R. (2026) · Clinics in Perioperative Nursing Care · doi:10.1016/j.pernc.2026.08.011
Wainstein, M., Flanagan, E., Johnson, D. W., & Shrapnel, S. (2023) · doi:10.3389/fneph.2023.1220214.s002
Metadata
- Authors
- Joshi, M., Mecklai, K., Rozenblum, R., & Samal, L.
- Affiliations
- Stanford Medicine (US)
- Harvard University (US)
- Brigham and Women's Hospital (US)
- Corresponding author
- Joshi, Mugdha
- Venue
- JAMIA Open
- Publisher
- Oxford University Press (OUP)
- Published
- 2022-04-06
- Volume
- 5
- Issue
- 2
- Pages
- ooac022-ooac022
- ISSN
- 2574-2531 (ISSN-L)
- PMC
- PMC9030109
- OpenAlex
- W4223913070
- Cited by
- 46
- References
- 40
- Citations by year
- 2026: 9 · 2025: 17 · 2024: 12 · 2023: 7 · 2022: 1
- FWCI
- 6.93
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- Locations
- JAMIA Open (publishedVersion, cc-by-nc)
- PubMed Central (publishedVersion, cc-by-nc)
- PubMed (publishedVersion)
- Funders
- National Institutes of Health
- Topics
- Health Sciences › Health Professions › Health Information Management › Electronic Health Records Systems
- Health Sciences › Medicine › Critical Care and Intensive Care Medicine › Sepsis Diagnosis and Treatment
- Physical Sciences › Computer Science › Artificial Intelligence › Machine Learning in Healthcare
- Keywords
- sepsis risk prediction, clinical decision support, rule-based models, machine learning models, implementation barriers, clinician acceptance, electronic health records, sepsis surveillance, trust in AI, quality improvement, socio-technical challenges
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.