The DOI matches its Crossref record; 44 of the 45 references it cites were found in a registry or an index.
Search Filters for Finding Prognostic and Diagnostic Prediction Studies in Medline to Enhance Systematic Reviews
Open accessAbstract
BACKGROUND: The interest in prognostic reviews is increasing, but to properly review existing evidence an accurate search filer for finding prediction research is needed. The aim of this paper was to validate and update two previously introduced search filters for finding prediction research in Medline: the Ingui filter and the Haynes Broad filter. METHODOLOGY/PRINCIPAL FINDINGS: Based on a hand search of 6 general journals in 2008 we constructed two sets of papers. Set 1 consisted of prediction research papers (n = 71), and set 2 consisted of the remaining papers (n = 1133). Both search filters were validated in two ways, using diagnostic accuracy measures as performance measures. First, we compared studies in set 1 (reference) with studies retrieved by the search strategies as applied in Medline. Second, we compared studies from 4 published systematic reviews (reference) with studies retrieved by the search filter as applied in Medline. Next--using word frequency methods--we constructed an additional search string for finding prediction research. Both search filters were good in identifying clinical prediction models: sensitivity ranged from 0.94 to 1.0 using our hand search as reference, and 0.78 to 0.89 using the systematic reviews as reference. This latter performance measure even increased to around 0.95 (range 0.90 to 0.97) when either search filter was combined with the additional string that we developed. Retrieval rate of explorative prediction research was poor, both using our hand search or our systematic review as reference, and even combined with our additional search string: sensitivity ranged from 0.44 to 0.85. CONCLUSIONS/SIGNIFICANCE: Explorative prediction research is difficult to find in Medline, using any of the currently available search filters. Yet, application of either the Ingui filter or the Haynes broad filter results in a very low number missed clinical prediction model studies.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Previous guidance for systematic reviews of prediction model studies mainly addressed formulation of the review aim, searching,12 critical appraisal (CHARMS)13 and data extraction of relevant studies. There is, however, little guidance on how to quantitatively synthesize the results of external validation studies.”
From A framework for meta-analysis of prediction model studies with binary and time-to-event outcomes (2019) · cites this paper as [12]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Clinical Prediction Models: A Practical Approach to Development, Validation, and Updating
Steyerberg, E. W. (2019) · Statistics for Biology and Health · doi:10.1007/978-3-030-16399-0 · Cited by 3,281
Users' Guides to the Medical Literature
Guyatt, G. H. (1993) · JAMA · doi:10.1001/jama.270.17.2096 · Cited by 3,083
Systematic Reviews: Identifying relevant studies for systematic reviews
Dickersin, K., Scherer, R. W., & Lefebvre, C. (1994) · BMJ · doi:10.1136/bmj.309.6964.1286 · Cited by 2,255
Evaluation of the Quality of Prognosis Studies in Systematic Reviews
Hayden, J. A., Côté, P., & Bombardier, C. (2006) · Annals of Internal Medicine · doi:10.7326/0003-4819-144-6-200603210-00010 · Cited by 1,452
Clinical Prediction Rules: Applications and Methodological Standards
Wasson, J. H., Sox, H. C., Neff, R. K., & Goldman, L. (1985) · New England Journal of Medicine · doi:10.1056/nejm198509263131306 · Cited by 1,357
Prognosis and prognostic research: what, why, and how?
Moons, K. G. M., Royston, P., Vergouwe, Y., Grobbee, D. E., & Altman, D. G. (2009) · BMJ · doi:10.1136/bmj.b375 · Cited by 1,337
Self-citationPrognosis and prognostic research: Developing a prognostic model
Royston, P., Moons, K. G. M., Altman, D. G., & Vergouwe, Y. (2009) · BMJ · doi:10.1136/bmj.b604 · Cited by 1,172
Self-citationCriteria for Evaluation of Novel Markers of Cardiovascular Risk
Hlatky, M. A., Greenland, P., Arnett, D. K., Ballantyne, C. M., Criqui, M. H., Elkind, M. S. V., Go, A. S., Harrell, F. E., Hong, Y., Howard, B. V., et al. (2009) · Circulation · doi:10.1161/circulationaha.109.192278 · Cited by 1,146
Users' Guides to the Medical Literature
McGinn, T. G., Guyatt, G., Wyer, P. C., Naylor, C. D., Stiell, I. G., Richardson, W. S., & for the Evidence-Based Medicine Working Group (2000) · JAMA · doi:10.1001/jama.284.1.79 · Cited by 1,009
Prognosis and prognostic research: application and impact of prognostic models in clinical practice
Moons, K. G. M., Altman, D. G., Vergouwe, Y., & Royston, P. (2009) · BMJ · doi:10.1136/bmj.b606 · Cited by 934
Self-citation
Flagged first, then by citations
1 of the 45 references couldn’t be matched to a known paper.
Cited by
Sorted by citations
Items 301–350 of 350
Challenges Faced by Health Professionals at the Beginning of Research in Pakistan
Khan, M. I., Yazdani, S., & Yaseen, A. (2021) · Medical Journal Of South Punjab · doi:10.61581/mjsp.vol02/02/03
White, N. M., Parsons, R., Borg, D. N., Collins, P. G. S., & Barnett, A. G. (2023) · doi:10.31219/osf.io/nh9sx
Prediction models for personalized
Tohidinezhad, F. (2024) · doi:10.26481/dis.20250122ft
Haq, M. U., Pritchard, D. M., Myint, A. S., Javed, M. A., Duckworth, C. A., Than, N. W., Bonnett, L. J., & Hughes, D. M. (2025) · Cancer Medicine · doi:10.1002/cam4.70697
You, J., Zhang, J., Cai, H., Wang, H., Xi, J., Mu, D., Li, Z., Chen, Q., Peng, B., & Cai, Y. (2025) · Current Problems in Surgery · doi:10.1016/j.cpsurg.2025.101821
Prognostic modeling in head and neck cancer: deep learning or handcrafted radiomics?
Gouthamchand, V., Fonseca, L. D. A. F., Hoebers, F. J. P., Fijten, R., Dekker, A. L. A. J., Wee, L., & Thomas, H. M. T. (2025) · BJR|Artificial Intelligence · doi:10.1093/bjrai/ubaf008 · Cited by 2
Levy, C., Dalton, E. J., Ferris, J. K., Campbell, B. C. V., Brodtmann, A. G., Brauer, S., Churilov, L. P., & Hayward, K. S. (2026) · Clinical Rehabilitation · doi:10.1177/02692155261467649
Bodagh, N., Sim, I., Ghahfarokhi, M. H., Tun, K. S., Kotadia, I., Kliś, M., Vigneswaran, V., Solís-Lemus, J. A., Whitaker, J., Gharaviri, A., et al. (2025) · BMC Medical Informatics and Decision Making · doi:10.1186/s12911-025-03200-7
Aifuobhokhan, J., Ogunjinmi, A., Agbarakwe, C. A., Oduguwa, D. O., Essiet, A. P., Osunkiyesi, T., & Modesire, A. (2025) · Research Square · doi:10.21203/rs.3.rs-7973881/v1
Homelessness prediction models in high-income countries: a scoping review
Stängl, L. A., Baniunaite, E., Fürstenau, D., Schreiter, S., Koh, K. A., Ito, C., & Marbin, D. (2025) · BMC Public Health · doi:10.1186/s12889-025-24855-x
Smith, C. A., Taylor, K., Jones, N. R., Roth, D., Magona, A., Roberts, N. W., Taylor, C. J., Hobbs, R. F., & Vazquez-Montes, M. (2025) · Diagnostic and Prognostic Research · doi:10.1186/s41512-025-00210-x
Multimorbidity measurement strategies for predicting hospital visits
Neves, B. D., Moreira, J. M., Gonçalves, S., Cerejo, J., Mota, I., Silva, N. A., Leite, F., & Silva, M. J. (2025) · BMC Health Services Research · doi:10.1186/s12913-025-13817-z
Lijing Lin, A., Sperrin, M., Jenkins, D. A., Martin, G. P., & Peek, N. B. (2021) · Figshare · doi:10.6084/m9.figshare.13710814
Abdulaziz, K. E., Perry, J. J., Yadav, K., Dowlatshahi, D., Stiell, I. G., Wells, G. A., & Taljaard, M. (2022) · Figshare · doi:10.6084/m9.figshare.19793204
Vazquez-Montes, M. D. L. A., Debray, T. P. A., Taylor, K., Speich, B., Jones, N. R., Collins, G., Hobbs, F. D. R. R., Magriplis, E., Maruri-Aguilar, H., Moons, K. G. M., et al. (2020) · Figshare · doi:10.6084/m9.figshare.12864836
Self-citationStallings, E., Gil, A. G., Alvarez-Diaz, N., Solà, I., López‐Alcalde, J., Molano, D., & Zamora, J. (2022) · Figshare · doi:10.6084/m9.figshare.19581774
Additional file 1 of Evidence of questionable research practices in clinical prediction models
White, N. M., Parsons, R., Collins, G., & Barnett, A. G. (2024) · Figshare · doi:10.6084/m9.figshare.26615050
Additional file 6 of Evidence of questionable research practices in clinical prediction models
White, N. M., Parsons, R., Collins, G., & Barnett, A. G. (2024) · Figshare · doi:10.6084/m9.figshare.26615065
Additional file 4 of Evidence of questionable research practices in clinical prediction models
White, N. M., Parsons, R., Collins, G., & Barnett, A. G. (2024) · Figshare · doi:10.6084/m9.figshare.26615059
Grootven, B. V., & van Achterberg, T. (2022) · Figshare · doi:10.6084/m9.figshare.19930437
Additional file 7 of Evidence of questionable research practices in clinical prediction models
White, N. M., Parsons, R., Collins, G., & Barnett, A. G. (2024) · Figshare · doi:10.6084/m9.figshare.26615068
Milton-Cole, R., Ayis, S., Lambe, K., O’Connell, M. D. L., Sackley, C., & Sheehan, K. J. (2021) · Figshare · doi:10.6084/m9.figshare.16779628
Stallings, E., Gil, A. G., Alvarez-Diaz, N., Solà, I., López‐Alcalde, J., Molano, D., & Zamora, J. (2022) · Figshare · doi:10.6084/m9.figshare.19581771
Karageorgou, M., Hughes, D. M., Myint, A. S., Pritchard, D. M., & Bonnett, L. J. (2022) · Figshare · doi:10.6084/m9.figshare.21285867
Vazquez-Montes, M. D. L. A., Debray, T. P. A., Taylor, K., Speich, B., Jones, N. R., Collins, G., Hobbs, F. D. R. R., Magriplis, E., Maruri-Aguilar, H., Moons, K. G. M., et al. (2020) · Figshare · doi:10.6084/m9.figshare.12864839
Self-citationAbdulaziz, K. E., Perry, J. J., Yadav, K., Dowlatshahi, D., Stiell, I. G., Wells, G. A., & Taljaard, M. (2022) · Figshare · doi:10.6084/m9.figshare.19793198
Additional file 2 of Evidence of questionable research practices in clinical prediction models
White, N. M., Parsons, R., Collins, G., & Barnett, A. G. (2024) · Figshare · doi:10.6084/m9.figshare.26615053
Wang, X., Zhou, S., Ye, N., Li, Y., Pengjun, Z., Chen, G., & Hu, H. (2024) · Figshare · doi:10.6084/m9.figshare.26066110
Grandbois van Ravenhorst, C., Schluep, M., Endeman, H., Stolker, R.-J., & Hoeks, S. E. (2024) · Figshare · doi:10.6084/m9.figshare.26563072
Additional file 3 of Evidence of questionable research practices in clinical prediction models
White, N. M., Parsons, R., Collins, G., & Barnett, A. G. (2024) · Figshare · doi:10.6084/m9.figshare.26615056
Karageorgou, M., Hughes, D. M., Myint, A. S., Pritchard, D. M., & Bonnett, L. J. (2022) · Figshare · doi:10.6084/m9.figshare.21285870
Additional file 5 of Evidence of questionable research practices in clinical prediction models
White, N. M., Parsons, R., Collins, G., & Barnett, A. G. (2024) · Figshare · doi:10.6084/m9.figshare.26615062
Abdulaziz, K. E., Perry, J. J., Yadav, K., Dowlatshahi, D., Stiell, I. G., Wells, G. A., & Taljaard, M. (2022) · Figshare · doi:10.6084/m9.figshare.19793201
Stallings, E., Gil, A. G., Alvarez-Diaz, N., Solà, I., López‐Alcalde, J., Molano, D., & Zamora, J. (2022) · Figshare · doi:10.6084/m9.figshare.19581768
Abdulaziz, K. E., Perry, J. J., Yadav, K., Dowlatshahi, D., Stiell, I. G., Wells, G. A., & Taljaard, M. (2022) · Figshare · doi:10.6084/m9.figshare.19793207
Milton-Cole, R., Ayis, S., Lambe, K., O’Connell, M. D. L., Sackley, C., & Sheehan, K. J. (2021) · Figshare · doi:10.6084/m9.figshare.16779631
Li, L., Lan, X., Zeng, W., Xu, Y., & Chen, Q. (2026) · BMC Infectious Diseases · doi:10.1186/s12879-026-12687-y
A Systematic Review of Multivariate Models for Predicting Fall‐Related Injuries in Older Adults
Cai, Y., Zhu, W., Zhang, X., Wang, C., Liu, S., & Jiang, Y. (2026) · Journal of Nursing Management · doi:10.1155/jonm/1740588
Wilson, J. P., Chowdhury, F. U. H., Hassan, S., Harriss, E., Alves, F. P., Musa, A. M., Dahal, P., Stepniewska, K., & Guerin, P. J. (2026) · BMJ Public Health · doi:10.1136/bmjph-2024-001196
Chen, J., Liang, X., Ma, W., Guo, Y., Li, K., & Deng, Q. (2026) · Journal of Gastrointestinal Cancer · doi:10.1007/s12029-026-01430-0
Yimer, N. B., Belsti, Y., Seifu, B. L., Goldstein, R., Teede, H. J., & Enticott, J. (2026) · Diagnostic and Prognostic Research · doi:10.1186/s41512-026-00229-8
Meidinger, P., Naye, F., Gérard, T., Saueressig, T., Gagnon, M., Tousignant‐Laflamme, Y., & Roy, J.-S. (2026) · JOSPT Methods · doi:10.2519/josptmethods.2026.0023
Ruszkowski, J., Ramakrishnan, S., Strzelec, J., Roztkowska, W., Dębska-Ślizień, A. M., & Lichodziejewska–Niemierko, M. (2026) · JBI Evidence Synthesis · doi:10.11124/jbies-25-00478
Vieira, A. G. D. S., Pinto, A. C. P. N., Garcia, A. A. A., Nawa, R. K., Mól, C. G., Duenas, J. D., Atallah, Á. N., Shrestha, G. S., Schultz, M. J., Saconato, H., et al. (2026) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd016115
Aifuobhokhan, J., Ogunjinmi, A., Agbarakwe, C. A., Oduguwa, D. O., Essiet, A. P., Osunkiyesi, T., & Modesire, A. (2026) · BMC Medical Informatics and Decision Making · doi:10.1186/s12911-026-03716-6
Predicting postoperative infections: prediction models and their evaluation
de Mul, N., Scheffer-Wesdorp, K. M., Verlaan, D., Mondelli, G., Schellekens, W. M., Bonten, M. J. M., Derde, L. P. G., Cremer, O. L., & Vernooij, L. M. (2026) · European Journal of Anaesthesiology · doi:10.1097/eja.0000000000002470
Shi, C., Harvey, J., Ud‐Din, S., Hamoodi, Z., Rafiq, S., Zhan, X., & Dumville, J. C. (2026) · Wound Repair and Regeneration · doi:10.1111/wrr.70197
Jasenecova, M., Harker, G., Adas, M. A., Qureshi, S., Duquenne, L. M., Wilson, M., Hensor, E. M. A., Emery, P., Mankia, K. S., Bechman, K., et al. (2026) · EULAR Rheumatology Open · doi:10.1016/j.ero.2026.100228
Imaging‑based models for predicting cerebrovascular complications of carotid stenosis
Li, B., Du, X., Liu, Y., Zhang, H., Liu, S., Wang, S., Zhao, X., Sheng, F., Lu, M., & Cai, J. (2026) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd016391
Zhang, M., Xia, Y., Mo, H., Zhu, Y., Fang, L., Xiang, Q., Shen, J., Wang, L., & Lou, J. (2026) · Epidemiologic Reviews · doi:10.1093/epirev/mxag013
Metadata
- Authors
- Geersing, G.-J., Bouwmeester, W., Zuithoff, P., Spijker, R., Leeflang, M., & Moons, K.
- Affiliations
- University Medical Center Utrecht (NL)
- Amsterdam UMC Location University of Amsterdam (NL)
- Corresponding author
- Geersing, Geert-Jan
- Venue
- PLoS ONE
- Publisher
- Public Library of Science (PLoS)
- Published
- 2012-02-29
- Volume
- 7
- Issue
- 2
- Pages
- e32844
- ISSN
- 1932-6203 (ISSN-L)
- PMC
- PMC3290602
- OpenAlex
- W2019982728
- Cited by
- 350
- References
- 45
- Citations by year
- 2026: 20 · 2025: 26 · 2024: 39 · 2023: 39 · 2022: 47 · 2021: 47 · 2020: 32 · 2019: 23 · 2018: 24 · 2017: 16 · 2016: 14 · 2015: 11 · 2014: 10 · 2013: 2
- FWCI
- 2.03
- Type
- journal article
- Language
- en
- Update notices
- correction (2012-07-10)
- Open access
- gold
- doi.org
- Locations
- PLoS ONE (publishedVersion, cc-by)
- Europe PMC (PubMed Central) (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- Pure Amsterdam UMC (publishedVersion)
- Data Archiving and Networked Services (DANS) (submittedVersion)
- RePEc: Research Papers in Economics (submittedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Funders
- Nederlandse Organisatie voor Wetenschappelijk Onderzoek
- Topics
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods in Epidemiology
- Health Sciences › Health Professions › General Health Professions › Health Sciences Research and Education
- Keywords
- search filters, MEDLINE, prognostic research, diagnostic research, clinical prediction model, systematic reviews, search strategy validation
- MeSH terms
- Algorithms, Computers, Humans, Prognosis, ROC Curve, Software, Reproducibility of Results, Multivariate Analysis, Databases, Factual, MEDLINE, Computational Biology, Biomedical Research
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
