Student or educator? Sign up with your school email and get 6 months of Pro free.
CoChat

The DOI matches its Crossref record; 195 of the 197 references it cites were found in a registry or an index.

Evidence appraisal: a scoping review, conceptual framework, and research agenda

Open access
Goldstein, Andrew, Venker, Eric, Weng, Chunhua · 2017 · Journal of the American Medical Informatics Association

Abstract

Objective: Critical appraisal of clinical evidence promises to help prevent, detect, and address flaws related to study importance, ethics, validity, applicability, and reporting. These research issues are of growing concern. The purpose of this scoping review is to survey the current literature on evidence appraisal to develop a conceptual framework and an informatics research agenda. Methods: We conducted an iterative literature search of Medline for discussion or research on the critical appraisal of clinical evidence. After title and abstract review, 121 articles were included in the analysis. We performed qualitative thematic analysis to describe the evidence appraisal architecture and its issues and opportunities. From this analysis, we derived a conceptual framework and an informatics research agenda. Results: We identified 68 themes in 10 categories. This analysis revealed that the practice of evidence appraisal is quite common but is rarely subjected to documentation, organization, validation, integration, or uptake. This is related to underdeveloped tools, scant incentives, and insufficient acquisition of appraisal data and transformation of the data into usable knowledge. Discussion: The gaps in acquiring appraisal data, transforming the data into actionable information and knowledge, and ensuring its dissemination and adoption can be addressed with proven informatics approaches. Conclusions: Evidence appraisal faces several challenges, but implementing an informatics research agenda would likely help realize the potential of evidence appraisal for improving the rigor and value of clinical evidence.

Overview

Integrity signals

Registry

Crossref · 10.1093/jamia/ocx050

Cites

195 of 195 references verified0 citation errors · 0 not checkable

Statistics

Recomputing p-values needs the paper’s full text.

Verification

Claims the paper makes

We couldn’t retrieve this paper’s full text, so its claims and self-check weren’t run. The registry and citation checks still apply.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Citations

Cites

Show all 197 references

Research works printed but not linked: 1

  1. Cortese, 2007, The Learning Healthcare System: Workshop Summary

Cited by

See all 30

Metadata

Authors
Goldstein, A., Venker, E., & Weng, C.
Affiliations
Columbia University (US)
Corresponding author
Goldstein, Andrew
Venue
Journal of the American Medical Informatics Association
Published
2017-05-24
Volume
24
Issue
6
Pages
1192-1203
ISSN
  • 1067-5027 (ISSN-L)
  • 1527-974X
OpenAlex
W2620100062
Cited by
30
References
197
Citations by year
2026: 1 · 2025: 2 · 2024: 5 · 2023: 8 · 2022: 3 · 2021: 2 · 2020: 2 · 2019: 4 · 2018: 3
FWCI
0.61
Type
journal article
Language
en
Open access
Licence
other-oa
Locations
  • Journal of the American Medical Informatics Association (publishedVersion, other-oa)
  • Europe PMC (PubMed Central) (publishedVersion)
  • PubMed Central (publishedVersion)
  • PubMed (publishedVersion)
Funders
U.S. National Library of Medicine (R01LM009886)
Topics
  • Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
  • Health Sciences › Health Professions › General Health Professions › Health Sciences Research and Education
  • Health Sciences › Medicine › Public Health, Environmental and Occupational Health › Clinical practice guidelines implementation
Keywords
evidence appraisal, critical appraisal, clinical evidence, conceptual framework, research validity, research utilization, knowledge translation, assessment instruments
MeSH terms
Medical Informatics, Periodicals as Topic, Publishing, Peer Review, Research, Evidence-Based Medicine, Translational Research, Biomedical

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: Evidence appraisal: a scoping review, conceptual framework, and research agenda. https://app.cochat.ai/papers/10.1093/jamia/ocx050
The paper
Goldstein, A., Venker, E., & Weng, C. (2017). Evidence appraisal: a scoping review, conceptual framework, and research agenda. Journal of the American Medical Informatics Association. https://doi.org/10.1093/jamia/ocx050

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.