Clinical Prediction Rules<subtitle>A Review and Suggested Modifications of Methodological Standards</subtitle>
The DOI matches its Crossref record; 4 of the 4 references it cites were found in a registry or an index.
Abstract
Background. —Clinical prediction rules are decision-making tools for clinicians, containing variables from the history, physical examination, or simple diagnostic tests. Objective. —To review the quality of recently published clinical prediction rules and to suggest methodological standards for their development and evaluation. Data Sources. —Four general medical journals were manually searched for clinical prediction rules published from 1991 through 1994. Study Selection. —Four hundred sixty potentially eligible reports were identified, of which 30 were clinical prediction rules eligible for study. Most methodological standards could only be evaluated in 29 studies. Data Abstraction. —Two investigators independently evaluated the quality of each report using a standard data sheet. Disagreements were resolved by consensus. Data Synthesis. —The mathematical technique was used to develop the rule, and the results of the rule were described in 100% (29/29) of the reports. All the rules but 1 (97% [28/29]) were felt to be clinically sensible. The outcomes and predictive variables were clearly defined in 83% (24/29) and 59% (17/29) of the reports, respectively. Blind assessment of outcomes and predictive variables occurred in 41% (12/29) and 79% (23/29) of the reports, respectively, and the rules were prospectively validated in 79% (11/14). Reproducibility of predictive variables was assessed in only 3% (1/29) of the reports, and the effect of the rule on clinical use was prospectively measured in only 3% (1/30). Forty-one percent (12/29) of the rules were felt to be easy to use. Conclusions. —Although clinical prediction rules comply with some methodological criteria, for other criteria, better compliance is needed.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“However, the overwhelming evidence shows that the quality of reporting of prediction model studies is poor.”
From Transparent Reporting of a multivariable prediction model for Individual Prognosis Or Diagnosis (TRIPOD): The TRIPOD Statement (2015) · cites this paper as [26]
In the citing paper
“Many reviews have showed that the quality of reporting in published articles describing the development or validation of multivariable prediction models in medicine is poor [23–27,29].”
From Transparent reporting of a multivariable prediction model for individual prognosis or diagnosis (TRIPOD): the TRIPOD Statement (2015) · cites this paper as [27]
In the citing paper
“Various reports have indicated that in prediction modelling research there is an unfortunate practice of developing new models instead of externally validating or updating existing models [8]–[10],[15],[29],[36],[48].”
From Reporting and Methods in Clinical Prediction Research: A Systematic Review (2012) · cites this paper as [15]
In the citing paper
“Good reporting of how candidate predictors were pre-selected in our review compares favourably with other reviews [15],[20],[21],[29],[33],[35],[36],[48].”
From Reporting and Methods in Clinical Prediction Research: A Systematic Review (2012) · cites this paper as [15]
In the citing paper
“However, the overwhelming evidence shows that the quality of reporting of prediction model studies is poor.”
From Transparent Reporting of a Multivariable Prediction Model for Individual Prognosis or Diagnosis (TRIPOD): The TRIPOD Statement (2015) · cites this paper as [27]
1 more claim about this paper
Create a free account to see every claim other papers make about this one.
Citations
Cites
The publisher hasn’t deposited this paper’s reference list.
Cited by
Moons, K. G. M., Altman, D. G., Reitsma, J. B., Ioannidis, J. P. A., Macaskill, P., Steyerberg, E. W., Vickers, A. J., Ransohoff, D. F., & Collins, G. S. (2015) · Annals of Internal Medicine · doi:10.7326/m14-0698 · Cited by 5,147
Collins, G. S., Reitsma, J. B., Altman, D. G., & Moons, K. G. M. (2015) · BMJ · doi:10.1136/bmj.g7594 · Cited by 4,388
“These and other reviews provide a clear picture that, across different disease areas and different journals, there is a generally poor level of reporting of prediction model studies [6,2-27,29].”
InfluentialCollins, G. S., Reitsma, J. B., Altman, D. G., & Moons, K. G. M. (2015) · British Journal of Cancer · doi:10.1038/bjc.2014.639 · Cited by 3,293
Collins, G. S., Reitsma, J. B., Altman, D. G., & Moons, K. G. M. (2015) · Annals of Internal Medicine · doi:10.7326/m14-0697 · Cited by 3,267
D'Amico, G., Garcia-Tsao, G., & Pagliaro, L. (2006) · Journal of Hepatology · doi:10.1016/j.jhep.2005.10.013 · Cited by 2,687
Metadata
- Authors
- Laupacis, A.
- Corresponding author
- Laupacis, Andreas
- ORCID
- Laupacis, Andreas
- Venue
- JAMA: The Journal of the American Medical Association
- Publisher
- American Medical Association (AMA)
- Published
- 1997-02-12
- Volume
- 277
- Issue
- 6
- Pages
- 488
- ISSN
- 0002-9955 (ISSN-L)
- 0098-7484
- OpenAlex
- W4321428130
- Cited by
- 793
- References
- 0
- Citations by year
- 2026: 7 · 2025: 13 · 2024: 23 · 2023: 17 · 2022: 20 · 2021: 40 · 2020: 20 · 2019: 23 · 2018: 28 · 2017: 26 · 2016: 35 · 2015: 47 · 2014: 41 · 2013: 39 · 2012: 55
- FWCI
- 21.29
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- JAMA (publishedVersion)
- Topics
- Health Sciences › Medicine › Family Practice › Clinical Reasoning and Diagnostic Skills
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods in Epidemiology
- Health Sciences › Medicine › Public Health, Environmental and Occupational Health › Clinical practice guidelines implementation
- Keywords
- clinical prediction rules, methodological standards, quality assessment, rule development, rule validation, reproducibility, clinical utility, reporting quality
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Clinical Prediction Rules<subtitle>A Review and Suggested Modifications of Methodological Standards</subtitle>. https://app.cochat.ai/papers/10.1001/jama.1997.03540300056034
- The paper
- Laupacis, A. (1997). Clinical Prediction Rules<subtitle>A Review and Suggested Modifications of Methodological Standards</subtitle>. JAMA: The Journal of the American Medical Association. https://doi.org/10.1001/jama.1997.03540300056034
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.