Guidelines for clinical trial protocols for interventions involving artificial intelligence: the SPIRIT-AI extension
Open accessThe DOI matches its Crossref record; 53 of the 53 references it cites were found in a registry or an index; 19 of the 34 sources its claims cite were checked for support.
Abstract
The SPIRIT 2013 statement aims to improve the completeness of clinical trial protocol reporting by providing evidence-based recommendations for the minimum set of items to be addressed. This guidance has been instrumental in promoting transparent evaluation of new interventions. More recently, there has been a growing recognition that interventions involving artificial intelligence (AI) need to undergo rigorous, prospective evaluation to demonstrate their impact on health outcomes. The SPIRIT-AI (Standard Protocol Items: Recommendations for Interventional Trials–Artificial Intelligence) extension is a new reporting guideline for clinical trial protocols evaluating interventions with an AI component. It was developed in parallel with its companion statement for trial reports: CONSORT-AI (Consolidated Standards of Reporting Trials–Artificial Intelligence). Both guidelines were developed through a staged consensus process involving literature review and expert consultation to generate 26 candidate items, which were consulted upon by an international multi-stakeholder group in a two-stage Delphi survey (103 stakeholders), agreed upon in a consensus meeting (31 stakeholders) and refined through a checklist pilot (34 participants). The SPIRIT-AI extension includes 15 new items that were considered sufficiently important for clinical trial protocols of AI interventions. These new items should be routinely reported in addition to the core SPIRIT 2013 items. SPIRIT-AI recommends that investigators provide clear descriptions of the AI intervention, including instructions and skills required for use, the setting in which the AI intervention will be integrated, considerations for the handling of input and output data, the human–AI interaction and analysis of error cases. SPIRIT-AI will help promote transparency and completeness for clinical trial protocols for AI interventions. Its use will assist editors and peer reviewers, as well as the general readership, to understand, interpret and critically appraise the design and risk of bias for a planned clinical trial.
Overview
CoChat Summary
TL;DR
The SPIRIT-AI extension provides consensus-based reporting guidance for clinical trial protocols evaluating interventions with an artificial intelligence component. It adds 15 AI-specific items—12 extensions and 3 elaborations—to the SPIRIT 2013 checklist, covering intervention description, input/output data, setting, human–AI interaction, and performance-error analysis.
Key findings
- SPIRIT-AI recommends 15 new items for AI trial protocols: 12 extensions and 3 elaborations, all of which passed the pre-specified 80% consensus threshold.
- The extension was developed alongside CONSORT-AI through literature review, a two-stage Delphi survey with 103 first-round respondents and 91 second-round respondents (88% of round one), a 31-stakeholder consensus meeting, and a 34-participant checklist pilot.
- SPIRIT-AI 11a (iii), on assessing and handling poor-quality or unavailable input data, initially received 73% support, then passed after rewording with 97% support.
- The guidance emphasizes clear descriptions of the AI intervention, required user instructions and skills, integration setting, input and output data handling, human–AI interaction, and plans to identify and analyze performance errors.
Methods
- Guideline development followed the EQUATOR Network methodological framework and was conducted in parallel with CONSORT-AI, overseen by a 15-member international Steering Group.
- Candidate items were generated from a 13 May 2019 ClinicalTrials.gov search using “artificial intelligence,” “machine learning,” and “deep learning,” which identified 316 registered trials, 62 completed trials, and 7 with published results; after consultation with 19 additional experts, 29 candidate items were generated, 26 relevant to both SPIRIT-AI and CONSORT-AI and 3 relevant only to CONSORT-AI.
- Consensus used two online Delphi surveys, a two-day consensus meeting with anonymous electronic voting and an 80% inclusion threshold, and a pilot of the penultimate checklists with 34 participants.
Limitations
- The paper states that at the time of SPIRIT-AI development there were only seven published AI trials and no published AI trial protocols, so decisions were not always supported by existing real-world examples.
- The paper states that the literature search used “artificial intelligence,” “machine learning,” and “deep learning” but not terms such as “clinical decision support systems” and “expert systems,” so those older AI-related technologies were not actively discussed.
- The paper states that the initial candidate item list was generated by a relatively small group of experts, although additional items from the wider Delphi group were considered and no new items were suggested during the consensus meeting or post-meeting evaluation.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Figures

Verification
Claims the paper makes
14 Valid · 3 Not valid · 5 Not checked · 41 Own results and interpretations
Every source the paper cites for this claim was checked and supports it.
In the paper
“Despite their importance, the quality and completeness of published trial protocols are variable1,2.”
§ Guidelines for clinical trial protocols for interventions involving artificial intelligence: the SPIRIT-AI extension > Main
What the sources say
- Supportedcites [1] Chan, A.-W. et al. SPIRIT 2013 statement: defining standard protocol items for clinical trials. Ann. Intern. Med. 158, 200–207 (2013). source
The Abstract (p. 1) of SPIRIT 2013 first establishes the importance of protocols ('the protocol of a clinical trial plays a key role in study planning, conduct, interpretation, oversight, and external review'), then states that despite this central role 'an opportunity exists to improve the quality of protocols' and lists item-by-item inadequacy rates (primary outcomes 25%; allocation 54–79%; blinding 9–34%; adverse event reporting 41%; sample size components 4–40%; data analysis plans 20–77%; sponsor/investigator roles 89–100%), i.e. highly variable quality and completeness. A later Abstract passage refers to 'these gaps in protocol content' and to the aim of improving 'the completeness of trial protocols'. The cited evidence in our copy concerns randomized trial protocols generally (many of which are not publicly available), so the 'published' modifier in the citing sentence is looser wording than the source's scope, but the substance attributed to this source is stated in it. (LLM, conf=0.85)
- Supportedcites [2] Chan, A.-W. et al. SPIRIT 2013 explanation and elaboration: guidance for protocols of clinical trials. Br. Med. J. 346, e7586 (2013). source
The Abstract (page unavailable) says protocols often lack information on important aspects of study design and dissemination, supporting the claim about variable completeness. The discussion of reproducible research (page unavailable) also refers to high-quality protocols, consistent with variation in quality. (LLM, conf=0.89)
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Supported
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“of randomized controlled trials seeking to evaluate the clinical efficacy of newer interventions based on, or including, an AI component (called ‘AI interventions’ here)15,18–23 has similarly been met with concerns about design and reporting17,24–26.”
§ Guidelines for clinical trial protocols for interventions involving artificial intelligence: the SPIRIT-AI extension > Main
What the sources say
- Not checked — no full text of the sourcecites [17] Liu, X. et al. A comparison of deep learning performance against health-care professionals in detecting diseases from medical imaging: a systematic review and meta-analysis. Lancet Digit. Health 1, e271–e297 (2019). source
- Not checked — no full text of the sourcecites [24] Collins, G. S. & Moons, K. G. M. Reporting of artificial intelligence prediction models. Lancet 393, 1577–1579 (2019). source
- Not checked — no full text of the sourcecites [25] Gregory, J., Welliver, S. & Chong, J. Top 10 reviewer critiques of radiology artificial intelligence (AI) articles: qualitative thematic analysis of reviewer critiques of machine learning/deep learning manuscripts submitted to JMRI. J. Magn. Reson. Imaging 52, 248–254 (2020). source
- Partly supportedcites [26] Nagendran, M. et al. Artificial intelligence versus clinicians: systematic review of design, reporting standards, and claims of deep learning studies. Br. Med. J. 368, m689 (2020). sourceExperimental — accuracy not yet measured
The Results (Randomised clinical trials) identify a design concern: lack of blinding in a completed trial. But the Abstract (Results) says the two published randomised trials had low risk of bias apart from blinding and high adherence to reporting standards. The paper therefore does not support a general concern about the reporting of these trials, and its review is limited to deep-learning studies of diagnostic medical imaging. (LLM, conf=0.88)
plainstates an association- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
Every source the paper cites for this claim was checked and supports it.
In the paper
“There are limitations to the generalizability of AI algorithms, one of which is when they are used outside of their development environment37,38.”
§ Guidelines for clinical trial protocols for interventions involving artificial intelligence: the SPIRIT-AI extension > Participants, interventions and outcomes > SPIRIT-AI 9 Extension: Describe the onsite and offsite requirements needed to integrate the AI intervention into the trial setting
What the sources say
- Supportedcites [37] Kelly, C. J., Karthikesalingam, A., Suleyman, M., Corrado, G. & King, D. Key challenges for delivering clinical impact with artificial intelligence. BMC Med. 17, 195 (2019). source
The ‘Challenges related to machine learning science’ section says AI algorithms may be inapplicable outside their training domain. The ‘Challenges in generalisation to new populations and settings’ section explains that differences between sites can make generalisation difficult. These passages support the claim about use outside the development environment. (LLM, conf=0.94)
- Supportedcites [38] Pooch, E. H. P., Ballester, P. L. & Barros, R. C. Can we trust deep learning models diagnosis? The impact of domain shift in chest radiograph classification. arXiv http://arxiv.org/abs/1909.01940 (2019) source
The Discussion and Conclusion (p. 8) reports that a chest-radiograph deep learning model had a large performance drop outside its source dataset and failed to generalize to unseen datasets with different distributions. The Introduction (p. 1) explains that differences between training and deployment settings can produce domain shift and poor results. This supports the cited generalizability limitation, specifically for the models and settings studied. (LLM, conf=0.93)
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Supported
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“For example, changes to medical imaging that are invisible, or appear random, to the human eye may change the likelihood of the resultant diagnostic output entirely47,48.”
§ Guidelines for clinical trial protocols for interventions involving artificial intelligence: the SPIRIT-AI extension > Discussion
What the sources say
- Partly supportedcites [47] Zech, J. R. et al. Confounding variables can degrade generalization performance of radiological deep learning models. arXiv http://arxiv.org/abs/1807.00431 (2018). sourceExperimental — accuracy not yet measured
The Discussion (p. 12) says CNNs may rely on subtle differences in image acquisition, processing, or compression rather than pathology, affecting their predictions. It does not show that changes invisible or random-looking to a human eye can entirely change an individual image’s diagnostic output. (LLM, conf=0.84)
- Supportedcites [48] Finlayson, S. G. et al. Adversarial attacks on medical machine learning. Science 363, 1287–1289 (2019). source
In “Deep Vulnerabilities,” the paper describes a medical image perturbation that appears to be random noise but is carefully calculated and visually imperceptible. It changes a classifier’s output for a benign mole from benign with over 99% confidence to malignant with 100% confidence. The paper expressly notes that the noise only appears random; it is not random. (LLM, conf=0.94)
hedgedstates a possible cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Partly supported
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“There were 316 registered trials, of which 62 were completed and 7 had published results22,30–35.”
§ Guidelines for clinical trial protocols for interventions involving artificial intelligence: the SPIRIT-AI extension > Literature review and candidate item generation
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
8 more claims
Create a free account to see all 63 claims and to verify the 2 references still open.
- Probably not a substantial claim. 46
- It may state two separate claims as one. 15
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“To facilitate transparency and reproducibility of the developmental process, the used computational architecture, high-performance techniques, software packages, and versioning (data, model, configurations and training scripts) should be reported13,14,16,50,64–66.”
From Guidelines and quality criteria for artificial intelligence-based prediction models in healthcare: a scoping review (2022) · cites this paper as [65]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“The literature advises to clearly define the intended use and intended users in the preparation of both the feasibility and impact study12,19,64,65.”
From Guidelines and quality criteria for artificial intelligence-based prediction models in healthcare: a scoping review (2022) · cites this paper as [65]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Indeed, the analysis of error cases is a minimum reporting requirement of the SPIRIT-AI (Standard Protocol Items: Recommendations for Interventional Trials-Artificial Intelligence) and CONSORT-AI (Consolidated Standards of Reporting Trials-Artificial Intelligence) guidelines for clinical trial protocols and reports of artificial intelligence interventions.7,8”
From The medical algorithmic audit (2022) · cites this paper as [8]
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“These features align with emerging trial protocol guidance (SPIRIT-AI; SPIRIT 2025).15,16”
The cited source says what the claim attributes to it.
In the citing paper
“This study protocol has been developed in accordance with the SPIRIT-AI guidelines to ensure transparency and rigor [20].”
From Protocol for an EHR-embedded pragmatic randomized control trial of Ambient AI to Reduce Nursing Staff Documentation Time (2026) · cites this paper as [20]
7 more claims about this paper
Create a free account to see every claim other papers make about this one.
Citations
Cites
Dermatologist-level classification of skin cancer with deep neural networks
Esteva, A., Kuprel, B., Novoa, R. A., Ko, J., Swetter, S. M., Blau, H. M., & Thrun, S. (2017) · Nature · doi:10.1038/nature21056 · Cited by 14,362
Self-citationSPIRIT 2013 Statement: Defining Standard Protocol Items for Clinical Trials
Chan, A.-W., Tetzlaff, J. M., Altman, D. G., Laupacis, A., Gøtzsche, P. C., Krleža-Jerić, K., Hróbjartsson, A., Mann, H., Dickersin, K., Berlin, J. A., et al. (2013) · Annals of Internal Medicine · doi:10.7326/0003-4819-158-3-201302050-00583 · Cited by 7,363
Self-citationSPIRIT 2013 explanation and elaboration: guidance for protocols of clinical trials
Chan, A.-W., Tetzlaff, J. M., Gotzsche, P. C., Altman, D. G., Mann, H., Berlin, J. A., Dickersin, K., Hrobjartsson, A., Schulz, K. F., Parulekar, W. R., et al. (2013) · BMJ · doi:10.1136/bmj.e7586 · Cited by 6,251
Self-citationSPIRIT 2013 Statement: defining standard protocol items for clinical trials.
Chan, A., Tetzlaff, J., Altman, D. G., Laupacis, A., Gøtzsche, P. C., A-Jerić, K. K., Hrobjartsson, A., Mann, H., Dickersin, K., Berlin, J. A., et al. (2015) · PubMed · Cited by 4,986
Self-citationInternational evaluation of an AI system for breast cancer screening
McKinney, S. M., Sieniek, M., Godbole, V., Godwin, J., Antropova, N., Ashrafian, H., Back, T., Chesus, M., Corrado, G. S., Darzi, A., et al. (2020) · Nature · doi:10.1038/s41586-019-1799-6 · Cited by 3,287
Self-citationKey challenges for delivering clinical impact with artificial intelligence
Kelly, C. J., Karthikesalingam, A., Suleyman, M., Corrado, G., & King, D. (2019) · BMC Medicine · doi:10.1186/s12916-019-1426-2 · Cited by 3,136 · cited 1×
“There are limitations to the generalizability of AI algorithms, one of which is when they are used outside of their development environment 37,38 .”
Self-citationAn overview of clinical decision support systems: Benefits, risks, and strategies for success
Sutton, R. T., Pincock, D., Baumgart, D. C., Sadowski, D. C., Fedorak, R. N., & Kroeker, K. I. (2020) · npj Digital Medicine · doi:10.1038/s41746-020-0221-y · Cited by 3,019 · cited 1×
“…such as ‘artificial intelligence’, ‘machine learning’ and ‘deep learning’, but not terms such as ‘clinical decision support systems’ and ‘expert systems’, which were more commonly used in the 1990s for technologies underpinned by AI systems and share risks similar to those of recent examples 50 .”
Clinically applicable deep learning for diagnosis and referral in retinal disease
De Fauw, J., Ledsam, J. R., Romera-Paredes, B., Nikolov, S., Tomasev, N., Blackwell, S., Askham, H., Glorot, X., O’Donoghue, B., Visentin, D., et al. (2018) · Nature Medicine · doi:10.1038/s41591-018-0107-6 · Cited by 2,639
Self-citationThe practical implementation of artificial intelligence technologies in medicine
He, J., Baxter, S. L., Xu, J., Xu, J., Zhou, X., & Zhang, K. (2019) · Nature Medicine · doi:10.1038/s41591-018-0307-0 · Cited by 2,246
Liu, X., Faes, L., Kale, A. U., Wagner, S. K., Fu, D. J., Bruynseels, A., Mahendiran, T., Moraes, G., Shamdas, M., Kern, C., et al. (2019) · The Lancet Digital Health · doi:10.1016/s2589-7500(19)30123-2 · Cited by 1,883 · cited 2×
“The candidate items were also informed by findings from a previous systematic review that evaluated the diagnostic accuracy of deep-learning systems for medical imaging 17 .”
Self-citation
Cited by
Rajpurkar, P., Chen, E., Banerjee, O., & Topol, E. J. (2022) · Nature Medicine · doi:10.1038/s41591-021-01614-0 · Cited by 3,212
Deep learning-enabled medical computer vision
Esteva, A., Chou, K., Yeung, S., Naik, N., Madani, A., Mottaghi, A., Liu, Y., Topol, E., Dean, J., & Socher, R. (2021) · npj Digital Medicine · doi:10.1038/s41746-020-00376-2 · Cited by 1,406
Self-citationDiagnostic accuracy of deep learning in medical imaging: a systematic review and meta-analysis
Aggarwal, R., Sounderajah, V., Martin, G., Ting, D. S. W., Karthikesalingam, A., King, D., Ashrafian, H., & Darzi, A. (2021) · npj Digital Medicine · doi:10.1038/s41746-021-00438-z · Cited by 946
Self-citationVasey, B., Nagendran, M., Campbell, B., Clifton, D. A., Collins, G. S., Denaxas, S., Denniston, A. K., Faes, L., Geerts, B., Ibrahim, M., et al. (2022) · Nature Medicine · doi:10.1038/s41591-022-01772-9 · Cited by 1,039
Self-citationArtificial intelligence for multimodal data integration in oncology
Lipkova, J., Chen, R. J., Chen, B., Lu, M. Y., Barbieri, M., Shao, D., Vaidya, A. J., Chen, C., Zhuang, L., Williamson, D. F. K., et al. (2022) · Cancer Cell · doi:10.1016/j.ccell.2022.09.012 · Cited by 777
Metadata
- Authors
- Cruz Rivera, S., Liu, X., Chan, A.-W., Denniston, A. K., Calvert, M. J., The SPIRIT-AI and CONSORT-AI Working Group, SPIRIT-AI and CONSORT-AI Steering Group, Darzi, A., Holmes, C., Yau, C., Moher, D., Ashrafian, H., Deeks, J. J., Ferrante di Ruffano, L., Faes, L., Keane, P. A., Vollmer, S. J., SPIRIT-AI and CONSORT-AI Consensus Group, Lee, A. Y., Jonas, A., Esteva, A., Beam, A. L., Panico, M. B., Lee, C. S., Haug, C., Kelly, C. J., Yau, C., Mulrow, C., Espinoza, C., Fletcher, J., Moher, D., Paltoo, D., Manna, E., Price, G., Collins, G. S., Harvey, H., Matcham, J., Monteiro, J., ElZarrad, M. K., Ferrante di Ruffano, L., Oakden-Rayner, L., McCradden, M., Keane, P. A., Savage, R., Golub, R., Sarkar, R., & Rowley, S.
- Affiliations
- University Hospitals Birmingham NHS Foundation Trust (GB)
- University of Toronto (CA)
- Imperial College London (GB)
- The Alan Turing Institute (GB)
- University of Oxford (GB)
- Luzerner Kantonsspital (CH)
- National Institute for Health and Care Excellence (GB)
- Salesforce (United States) (US)
- Harvard University (US)
- University of Washington (US)
- Google (United Kingdom) (GB)
- Ottawa Hospital Research Institute (CA)
- National Institutes of Health (US)
- BMJ Group (United Kingdom) (GB)
- AstraZeneca (United Kingdom) (GB)
- United States Food and Drug Administration (US)
- American Medical Association (US)
- Medical Research Council (GB)
- Corresponding author
- Denniston, Alastair K.
- ORCID
- Liu, Xiaoxuan
- Chan, An-Wen
- Denniston, Alastair K.
- Calvert, Melanie J.
- Darzi, Ara
- Ashrafian, Hutan
- Deeks, Jonathan J.
- Faes, Livia
- Vollmer, Sebastian J.
- Lee, Aaron Y.
- Esteva, Andre
- Beam, Andrew L.
- Lee, Cecilia S.
- Haug, Charlotte
- Mulrow, Cynthia
- Fletcher, John
- Harvey, Hugh
- ElZarrad, M. Khair
- McCradden, Melissa
- Savage, Richard
- Sarkar, Rupa
- Rowley, Samuel
- Venue
- Nature Medicine
- Published
- 2020-09
- Volume
- 26
- Issue
- 9
- Pages
- 1351-1363
- ISSN
- 1078-8956 (ISSN-L)
- 1546-170X
- PMC
- PMC7598944
- OpenAlex
- W3136960503
- Cited by
- 933
- References
- 49
- Citations by year
- 2026: 393 · 2025: 129 · 2024: 87 · 2023: 94 · 2022: 111 · 2021: 105 · 2020: 14
- FWCI
- 12.16
- Type
- journal article
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- cc-by
- creativecommons.org/licenses/by/4.0 (tdm)
- creativecommons.org/licenses/by/4.0 (vor, 8 d)
- Locations
- Nature Medicine (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- University of Birmingham Research Portal (University of Birmingham) (publishedVersion, cc-by)
- Oxford University Research Archive (ORA) (University of Oxford) (submittedVersion, cc-by)
- University of Birmingham Research Portal (University of Birmingham) (submittedVersion, cc-by)
- Spiral (Imperial College London) (submittedVersion, cc-by)
- Funders
- Wellcome Trust
- Alan Turing Institute
- Topics
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Health Sciences › Medicine › Health Informatics › Artificial Intelligence in Healthcare and Education
- Health Sciences › Medicine › Public Health, Environmental and Occupational Health › Clinical practice guidelines implementation
- Keywords
- reporting guidelines, artificial intelligence interventions, human-AI interaction, risk of bias, trial design, CONSORT-AI
- MeSH terms
- Artificial Intelligence, Clinical Trials as Topic, Humans, Research Design
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
The claim verdicts this report counts are experimental: their accuracy is not yet measured.
A language model drew the claims from the paper on 2026-10-15, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-10-15 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Cited sources are checked with a language model’s help (qwen3.8-omni-flash and gpt-6-sol).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Guidelines for clinical trial protocols for interventions involving artificial intelligence: the SPIRIT-AI extension. https://app.cochat.ai/papers/10.1038/s41591-020-1037-7
- The paper
- Cruz Rivera, S., Liu, X., Chan, A.-W., Denniston, A. K., Calvert, M. J., The SPIRIT-AI and CONSORT-AI Working Group, SPIRIT-AI and CONSORT-AI Steering Group, Darzi, A., Holmes, C., Yau, C., Moher, D., Ashrafian, H., Deeks, J. J., Ferrante di Ruffano, L., Faes, L., Keane, P. A., Vollmer, S. J., SPIRIT-AI and CONSORT-AI Consensus Group, Lee, A. Y., . . . Rowley, S. (2020). Guidelines for clinical trial protocols for interventions involving artificial intelligence: the SPIRIT-AI extension. Nature Medicine. https://doi.org/10.1038/s41591-020-1037-7
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.