CoChat

Advancing methodological development of artificial intelligence in patient-centered comparative clinical effectiveness research: Patient-Centered Outcomes Research Institute’s unique contribution to research done differently

Open access
Ou, Jinghua, Holve, Erin · 2025 · JAMIA Open

The DOI matches its Crossref record; 15 of the 15 references it cites were found in a registry or an index; 11 of the 39 sources its claims cite were checked for support.

Abstract

Background: Recent advancements of Artificial Intelligence (AI) are rapidly transforming clinical research. While this technology offers exciting opportunities, it amplifies existing concerns regarding the need for transparent methodology that fosters patient engagement, and introduces new challenges. PCORI's Improving Methods portfolio has invested in methodological research to enhance rigor and transparency via patient-centered approaches in AI. Objective: This commentary outlines PCORI's approach to funding and promoting a portfolio of methodological research that aims to improve the conduct of patient-centered comparative clinical effectiveness research (CER), with a focus on AI methods. The paper highlights a growing portfolio of over 40 AI related projects, including a recent cohort leveraging large language models to augment research processes in CER. Discussion: PCORI's current portfolio of methods projects in AI illustrate timely opportunities for the clinical research informatics community to develop and assess AI applications that will further advance a robust, interoperable and ethical infrastructure for patient-centered CER. PCORI's requirement for ongoing, meaningful engagement of patients throughout the research lifecycle provides a blueprint for patient-centered AI by developing and applying models and methods designed to create value for patients and other healthcare partners.

Overview

CoChat Summary

TL;DR

PCORI’s commentary argues that patient-centered, transparent AI methods are essential for comparative clinical effectiveness research (CER) and describes how its methods portfolio is funding this work. As of spring 2025, PCORI reports funding more than 40 AI/ML methods projects, including 6 led by informaticians, plus 15 supplements funded in spring 2024 focused on AI and large language models (LLMs).

Key findings

  • PCORI says its methods portfolio includes more than 40 AI/ML research projects as of spring 2025, including 6 projects led by informaticians.
  • In spring 2024, PCORI funded supplements to fifteen projects aimed at advancing methodological research using AI, with emphasis on LLMs in patient-centered CER.
  • The paper identifies several methodological applications already being funded: extracting information from unstructured data, developing computable phenotypes, identifying covariates, disease activity, mental health outcomes, non-medical drivers of health, and household/family relationships.
  • The commentary highlights examples of rigorous evaluation in funded work, including assessment of bias, prediction errors, hallucinations, and alignment with human/expert responses.

Methods

  • Commentary/perspective paper describing PCORI’s approach to funding and promoting methods research for patient-centered CER, with a focus on AI and LLMs.
  • Uses examples from PCORI-funded projects and portfolio summaries; no primary study sample or dataset is reported.
  • Main analysis is a narrative synthesis of PCORI’s portfolio, the methodological challenges of patient-centered AI, and areas for future exploration.

Limitations

  • The paper does not report a primary empirical study, so no original effect estimates, sample sizes, or comparative outcomes are provided.
  • The text itself makes evident that the discussion is portfolio-based and descriptive, not a systematic review or formal evaluation of the funded projects’ results.
  • The paper notes that comprehensive evaluations employing a patient-centered approach remain limited in the broader literature.

Model-written summary. Check it against the paper before relying on it.

Integrity signals

Registry

Crossref · 10.1093/jamiaopen/ooaf081

Cites

15 of 15 references verified0 citation errors · 0 not checkable

Statistics

Nothing to recompute.

Figures

Figure 1. Key stages in research process utilizing AI/ML methods in CER, with focus areas addressed by Methodological projects funded by PCORI. This figure outlines 5 key stages in the research process where AI/ML methods are applied: data processing/information extraction, research consent, predictive modelling, model evaluation, and model interpretability.
Figure 1. Key stages in research process utilizing AI/ML methods in CER, with focus areas addressed by Methodological projects funded by PCORI. This figure outlines 5 key stages in the research process where AI/ML methods are applied: data processing/information extraction, research consent, predictive modelling, model evaluation, and model interpretability.CC BY-NC · PubMed Central

Verification

Claims the paper makes

7 Valid · 4 Not valid · 11 Not checked · 9 Own results and interpretations

7 more claims

Create a free account to see all 31 claims and to verify the 1 reference still open.

See all claims — free account
  • Probably not a substantial claim. 12
  • It may state two separate claims as one. 9

Create a free account to see these claims.

Citations

Cites

Metadata

Authors
Ou, J., & Holve, E.
Affiliations
Patient-Centered Outcomes Research Institute (US)
Corresponding author
Ou, Jinghua
Venue
JAMIA Open
Published
2025-07-03
Volume
8
Issue
4
Pages
ooaf081-ooaf081
ISSN
2574-2531 (ISSN-L)
OpenAlex
W4412660375
Cited by
1
References
14
Citations by year
2026: 1
FWCI
0.06
Type
journal article
Language
en
Open access
Locations
  • JAMIA Open (publishedVersion, cc-by-nc)
  • PubMed (publishedVersion)
Topics
  • Health Sciences › Medicine › Health Informatics › Artificial Intelligence in Healthcare and Education
  • Health Sciences › Health Professions › General Health Professions › Mental Health and Patient Involvement
  • Health Sciences › Health Professions › Health Information Management › Artificial Intelligence in Healthcare
Keywords
artificial intelligence in clinical research, patient-centered outcomes research, large language models, research methodology development, patient engagement, research transparency, research informatics, AI ethics, interoperability

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

The claim verdicts this report counts are experimental: their accuracy is not yet measured.

A language model drew the claims from the paper on 2026-10-11, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).

A second model labelled each claim on 2026-10-11 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).

Cited sources are checked with a language model’s help (gpt-6-sol).

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.