The DOI matches its Crossref record; 11 of the 11 references it cites were found in a registry or an index.
Systematic reviews of evaluations of prognostic variables
Open accessAbstract
This is the last in a series of four articles Prognostic studies include clinical studies of variables predictive of future events as well as epidemiological studies of aetiological risk factors. As multiple similar studies accumulate it becomes increasingly important to identify and evaluate all of the relevant studies to develop a more reliable overall assessment. For prognostic studies this is not straightforward. Box 1 summarises the clinical importance of information on prognostic factors. Many of the issues discussed are also relevant to aetiological studies, especially cohort ones. Some features of prognostic studies lead to particular difficulties for the systematic reviewer. Firstly, in most clinical prognostic studies the outcome of primary interest is the time to an event, often death. Meta-analysis of such studies is rather more difficult than that for binary data or continuous measurements. Secondly, in many contexts the prognostic variable of interest is often one of several prognostic variables. When examining a variable of interest researchers should consider other prognostic variables with which it might be correlated. Thirdly, many prognostic factors are continuous variables, for which researchers use a wide variety of methods of analysis. #### Summary points Systematic reviews are applicable to all types of research design, and studies of prognostic variables are an important additional area where appropriate methodology should be applied Prognostic variables should be evaluated in a representative sample of patients assembled at a common point in the course of their disease—ideally they should all have received the same medical treatment or been in a randomised trial When examined critically, a high proportion of prognostic studies are found to be methodologically poor Meta-analysis of published data is hampered by difficulties in extraction of data and variation in the characteristics of the study and patients The poor quality of the published literature is a strong argument in favour …
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Moher, D., Schulz, K. F., & Altman, D. G. (2001) · The Lancet · doi:10.1016/s0140-6736(00)04337-3 · Cited by 5,373
Self-citationMoher, D., Cook, D. J., Eastwood, S., Olkin, I., Rennie, D., & Stroup, D. F. (1999) · The Lancet · doi:10.1016/s0140-6736(99)04149-5 · Cited by 4,826
Assessing the quality of controlled clinical trials
Jüni, P., Altman, D. G., & Egger, M. (2001) · BMJ · doi:10.1136/bmj.323.7303.42 · Cited by 3,309
Self-citationImproving the Quality of Reporting of Randomized Controlled Trials: The CONSORT Statement
Begg, C. (1996) · JAMA · doi:10.1001/jama.1996.03540080059030 · Cited by 3,127
Publication bias in clinical research
Easterbrook, P. J., Gopalan, R., Berlin, J. A., & Matthews, D. R. (1991) · The Lancet · doi:10.1016/0140-6736(91)90201-y · Cited by 3,109
Moher, D., Schulz, K. F., & Altman, D. G. (2001) · BMC Medical Research Methodology · doi:10.1186/1471-2288-1-2 · Cited by 2,755
Self-citationDeeks, J. J., Altman, D. G., & Bradburn, M. J. (2001) · Systematic Reviews in Health Care · doi:10.1002/9780470693926.ch15 · Cited by 2,163
Self-citationEmpirical evidence of design-related bias in studies of diagnostic tests.
Lijmer, J. G. (1999) · JAMA · doi:10.1001/jama.282.11.1061 · Cited by 1,861
Dangers of Using "Optimal" Cutpoints in the Evaluation of Prognostic Factors
Altman, D. G., Lausen, B., Sauerbrei, W., & Schumacher, M. (1994) · JNCI Journal of the National Cancer Institute · doi:10.1093/jnci/86.11.829 · Cited by 1,143
Self-citationKey, T. J., Fraser, G. E., Thorogood, M., Appleby, P. N., Beral, V., Reeves, G., Burr, M. L., Chang-Claude, J., Frentzel-Beyme, R., Kuzma, J. W., et al. (1999) · The American Journal of Clinical Nutrition · doi:10.1093/ajcn/70.3.516s · Cited by 484
Research works printed but not linked: 28
- Altman DG .Systematic reviews of evaluations of prognostic variables. In: Egger M Davey Smith G Altman DG eds.Systematic reviews in health care. Meta-analysis in context 2nd ed. London: BMJ Books, 2001:228–247. · DOI
- 10.1053/gast.2000.9302 · DOI · Paper page
- Moher, 1999, Assessing the quality of reports of randomised trials: implications for the conduct of meta-analyses., Health Technol Assess, 3, 1, 10.3310/hta3120 · DOI · Paper page
- Shea B Dubé C Moher D .Assessing the quality of reports of systematic reviews: the QUOROM statement compared to other tools. In: Egger M Davey Smith G Altman DG eds.Systematic reviews in health care: meta-analysis in context 2nd ed. London: BMJ Books, 2001:122–139. · DOI
- Kernan, 1991, A methodological appraisal of research on prognosis after transient ischemic attacks., Stroke, 22, 1108, 10.1161/01.STR.22.9.1108 · DOI
- Levine, 1991, When is a prognostic factor useful?: a guide for the perplexed., J Clin Oncol, 9, 348, 10.1200/JCO.1991.9.2.348 · doi:10.1200/jco.1991.9.2.348
- 10.1001/jama.1994.03520030076032 · DOI · Paper page
- 10.1016/S0003-9993(96)90300-7 · DOI
- Marx, 1997, Prognosis of idiopathic membranous nephropathy: a methodologic meta-analysis., Kidney Int, 51, 873, 10.1038/ki.1997.123 · DOI
- Low, 1998, Can we predict the prognosis of HIV infection? How to use the findings of a prospective study., Sex Transm Infect, 74, 149, 10.1136/sti.74.2.149 · doi:10.1136/sti.74.2.149
- 10.1002/(SICI)1097-0258(20000229)19:4<425::AID-SIM347>3.0.CO;2-J · doi:10.1002/(sici)1097-0258(20000229)19:4<425::aid-sim347>3.0.co;2-j
- 10.1038/bjc.1994.192 · DOI · Paper page
- 10.1111/j.1471-0528.1998.tb10227.x · DOI · Paper page
- 10.1001/jama.284.11.1417 · DOI · Paper page
- Cohen, 1983, The cost of dichotomization., Appl Psychol Meas, 7, 249, 10.1177/014662168300700301 · DOI · Paper page
- 10.2307/2289060 · DOI
- 10.1093/ije/28.1.1 · DOI · Paper page
- Stephenson, 1998, Systematic review of hormonal contraception and risk of HIV transmission: when to resist meta-analysis., AIDS, 12, 545, 10.1097/00002030-199806000-00002 · doi:10.1097/00002030-199806000-00002
- Wang, 1999, Risk of HIV infection in oral contraceptive pill users: a meta-analysis., J Acquir Immune Defic Syndr, 21, 51, 10.1097/00126334-199905010-00007 · DOI
- 10.1016/S0895-4356(97)00155-8 · DOI
- 10.1002/(SICI)1097-0258(19981230)17:24<2815::AID-SIM110>3.0.CO;2-8 · DOI
- Hunink, 1994, Meta-analysis of failure-time data with adjustment for covariates., Med Decis Making, 14, 59, 10.1177/0272989X9401400108 · DOI
- 10.2307/2533438 · DOI
- 10.1007/BF00666180 · DOI
- 10.1001/archinte.158.19.2101 · DOI · Paper page
- 10.1016/S0140-6736(96)90806-5 · DOI · Paper page
- 10.1001/jama.279.7.535 · DOI · Paper page
- 10.1016/S0304-3959(98)00058-X · DOI · Paper page
Cited by
Preferred Reporting Items for Systematic Reviews and Meta-Analyses: the PRISMA statement
Moher, D., Liberati, A., Tetzlaff, J., Altman, D. G., & for the PRISMA Group (2009) · BMJ · doi:10.1136/bmj.b2535 · Cited by 83,823
Self-citationPreferred Reporting Items for Systematic Reviews and Meta-Analyses: The PRISMA Statement
Moher, D., Liberati, A., Tetzlaff, J., Altman, D. G., & The PRISMA Group (2009) · PLoS Medicine · doi:10.1371/journal.pmed.1000097 · Cited by 64,042
Self-citationPreferred reporting items for systematic reviews and meta-analyses: the PRISMA Statement.
(2009) · PubMed Central · Cited by 44,859
Preferred reporting items for systematic reviews and meta-analyses: The PRISMA statement
Moher, D., Liberati, A., Tetzlaff, J., Altman, D. G., & the PRISMA Group* (2009) · Annals of Internal Medicine · doi:10.7326/0003-4819-151-4-200908180-00135 · Cited by 37,554
Self-citationPreferred Reporting Items for Systematic Reviews and Meta-Analyses: The PRISMA Statement
Moher, D., Liberati, A., Tetzlaff, J., & Altman, D. G. (2009) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2009.06.005 · Cited by 19,575
Self-citationPreferred reporting items for systematic reviews and meta-analyses: The PRISMA statement
Moher, D., Liberati, A., Tetzlaff, J., & Altman, D. G. (2010) · International Journal of Surgery · doi:10.1016/j.ijsu.2010.02.007 · Cited by 12,156
Self-citationReprint—Preferred Reporting Items for Systematic Reviews and Meta-Analyses: The PRISMA Statement
Moher, D., Liberati, A., Tetzlaff, J., Altman, D. G., & and the PRISMA Group (2009) · Physical Therapy · doi:10.1093/ptj/89.9.873 · Cited by 2,486
Self-citationReporting Recommendations for Tumor Marker Prognostic Studies (REMARK)
McShane, L. M., Altman, D. G., Sauerbrei, W., Taube, S. E., Gion, M., & Clark, G. M. (2005) · JNCI: Journal of the National Cancer Institute · doi:10.1093/jnci/dji237 · Cited by 2,162
Self-citationMoons, K. G. M., de Groot, J. A. H., Bouwmeester, W., Vergouwe, Y., Mallett, S., Altman, D. G., Reitsma, J. B., & Collins, G. S. (2014) · PLoS Medicine · doi:10.1371/journal.pmed.1001744 · Cited by 2,018
“Different definitions and measurement methods of candidate predictors are a potential source of heterogeneity and thus risk of bias, and the use of different measurement methods may affect the strength of predictors and influence whether the predictors ultimately are included in the prediction model [42,61].”
Self-citationGRADE guidelines: 5. Rating the quality of evidence—publication bias
Guyatt, G. H., Oxman, A. D., Montori, V., Vist, G., Kunz, R., Brozek, J., Alonso-Coello, P., Djulbegovic, B., Atkins, D., Falck-Ytter, Y., et al. (2011) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2011.01.011 · Cited by 1,819
Evaluation of the Quality of Prognosis Studies in Systematic Reviews
Hayden, J. A., Côté, P., & Bombardier, C. (2006) · Annals of Internal Medicine · doi:10.7326/0003-4819-144-6-200603210-00010 · Cited by 1,452
REporting recommendations for tumour MARKer prognostic studies (REMARK).
for the Statistics Subcommittee of the NCI-EORTC Working Group on Cancer Diagnostics, McShane, L. M., Altman, D. G., Sauerbrei, W., Taube, S. E., Gion, M., & Clark, G. M. (2005) · British Journal of Cancer · doi:10.1038/sj.bjc.6602678 · Cited by 1,394
Self-citationPrincipais itens para relatar Revisões sistemáticas e Meta-análises: A recomendação PRISMA
(2015) · Epidemiologia e Serviços de Saúde · doi:10.5123/s1679-49742015000200017 · Cited by 1,238
Wagner, A. D., Grothe, W., Haerting, J., Kleber, G., Grothey, A., & Fleig, W. E. (2006) · Journal of Clinical Oncology · doi:10.1200/jco.2005.05.0245 · Cited by 1,171
Moher, D. (2009) · Journal of Chinese Integrative Medicine · doi:10.3736/jcim20090918 · Cited by 909
Prognosis Research Strategy (PROGRESS) 2: Prognostic Factor Research
Riley, R. D., Hayden, J. A., Steyerberg, E. W., Moons, K. G. M., Abrams, K., Kyzas, P. A., Malats, N., Briggs, A., Schroter, S., Altman, D. G., et al. (2013) · PLoS Medicine · doi:10.1371/journal.pmed.1001380 · Cited by 823
Self-citationAnemia and Mortality in Heart Failure Patients
Groenveld, H. F., Januzzi, J. L., Damman, K., van Wijngaarden, J., Hillege, H. L., van Veldhuisen, D. J., & van der Meer, P. (2008) · Journal of the American College of Cardiology · doi:10.1016/j.jacc.2008.04.061 · Cited by 764
Parsons, A., Daley, A., Begh, R., & Aveyard, P. (2010) · BMJ · doi:10.1136/bmj.b5569 · Cited by 696
Risk factors for pelvic organ prolapse and its recurrence: a systematic review
Vergeldt, T. F. M., Weemhoff, M., IntHout, J., & Kluivers, K. B. (2015) · International Urogynecology Journal · doi:10.1007/s00192-015-2695-8 · Cited by 572
Huguet, A., Hayden, J. A., Stinson, J., McGrath, P. J., Chambers, C. T., Tougas, M. E., & Wozney, L. (2013) · Systematic Reviews · doi:10.1186/2046-4053-2-71 · Cited by 531
Weight gain in smokers after quitting cigarettes: meta-analysis
Aubin, H.-J., Farley, A., Lycett, D., Lahmek, P., & Aveyard, P. (2012) · BMJ · doi:10.1136/bmj.e4439 · Cited by 510
Meta-analysis: Subclinical Thyroid Dysfunction and the Risk for Coronary Heart Disease and Mortality
Ochs, N., Auer, R., Bauer, D. C., Nanchen, D., Gussekloo, J., Cornuz, J., & Rodondi, N. (2008) · Annals of Internal Medicine · doi:10.7326/0003-4819-148-11-200806030-00225 · Cited by 477
De Croon, E., Sluiter, J., Kuijer, P. P., & Frings-Dresen, M. (2005) · Ergonomics · doi:10.1080/00140130512331319409 · Cited by 450
Prognosis for patients with chronic low back pain: Inception cohort study
Costa, L. D. C. M., Maher, C. G., McAuley, J. H., Hancock, M. J., Herbert, R. D., Refshauge, K. M., & Henschke, N. (2009) · BMJ · doi:10.1136/bmj.b3829 · Cited by 430
Prentice, P., & Viner, R. M. (2013) · International Journal of Obesity · doi:10.1038/ijo.2012.177 · Cited by 418
Yang, M. M. H., Hartley, R. L., Leung, A. A., Ronksley, P. E., Jetté, N., Casha, S., & Riva-Cambrin, J. (2019) · BMJ Open · doi:10.1136/bmjopen-2018-025091 · Cited by 414
Anxiety as a Predictor for Cognitive Decline and Dementia: A Systematic Review and Meta-Analysis
Gulpers, B., Ramakers, I., Hamel, R., Köhler, S., Oude Voshaar, R., & Verhey, F. (2016) · The American Journal of Geriatric Psychiatry · doi:10.1016/j.jagp.2016.05.015 · Cited by 409
Yakubovich, A. R., Stöckl, H., Murray, J., Melendez-Torres, G. J., Steinert, J. I., Glavin, C. E. Y., & Humphreys, D. K. (2018) · American Journal of Public Health · doi:10.2105/ajph.2018.304428 · Cited by 349
Geersing, G.-J., Bouwmeester, W., Zuithoff, P., Spijker, R., Leeflang, M., & Moons, K. (2012) · PLoS ONE · doi:10.1371/journal.pone.0032844 · Cited by 350
Subclinical Thyroid Dysfunction and Fracture Risk: A Meta-analysis
Blum, M. R., Bauer, D. C., Collet, T.-H., Fink, H. A., Cappola, A. R., da Costa, B. R., Wirth, C. D., Peeters, R. P., Åsvold, B. O., den Elzen, W. P. J., et al. (2015) · JAMA · doi:10.1001/jama.2015.5161 · Cited by 343
Ward, A. M., Takahashi, O., Stevens, R., & Heneghan, C. (2012) · Journal of Hypertension · doi:10.1097/hjh.0b013e32834e4aed · Cited by 296
Murray, J., Farrington, D. P., & Eisner, M. P. (2009) · Journal of Experimental Criminology · doi:10.1007/s11292-008-9066-0 · Cited by 280
Risk of recurrence after venous thromboembolism in men and women: patient level meta-analysis
Douketis, J., Tosetto, A., Marcucci, M., Baglin, T., Cosmi, B., Cushman, M., Kyrle, P., Poli, D., Tait, R. C., & Iorio, A. (2011) · BMJ · doi:10.1136/bmj.d813 · Cited by 278
Mental capacity in psychiatric patients: Systematic review
Okai, D., Owen, G., McGuire, H., Singh, S., Churchill, R., & Hotopf, M. (2007) · British Journal of Psychiatry · doi:10.1192/bjp.bp.106.035162 · Cited by 262
Hartman, O. (2009) · doi:10.1016/j.jpsychores.2008.09.018 · Cited by 261
Wong, W. C., Cheung, C. S., & Hart, G. J. (2008) · Emerging Themes in Epidemiology · doi:10.1186/1742-7622-5-23 · Cited by 257
The efficacy of recommended treatments for veterans with PTSD: A metaregression analysis
Haagen, J. F. G., Smid, G. E., Knipscheer, J. W., & Kleber, R. J. (2015) · Clinical Psychology Review · doi:10.1016/j.cpr.2015.06.008 · Cited by 246
Risk factors for the onset of non-specific neck pain: a systematic review
McLean, S. M., May, S., Klaber-Moffett, J., Sharp, D. M., & Gardiner, E. (2010) · Journal of Epidemiology and Community Health · doi:10.1136/jech.2009.090720 · Cited by 222
“These reviews support the existence of associations between a range of physical and psychosocial factors and neck disorders. However the majority of primary studies were cross-sectional and do not demonstrate a temporal relationship between the factor and the outcome. Therefore causality is difficult to establish.”
Risk factors for prolapse recurrence: systematic review and meta-analysis
Friedman, T., Eslick, G. D., & Dietz, H. P. (2018) · International Urogynecology Journal · doi:10.1007/s00192-017-3475-4 · Cited by 222
Douketis, J., Tosetto, A., Marcucci, M., Baglin, T., Cushman, M., Eichinger, S., Palareti, G., Poli, D., Tait, R. C., & Iorio, A. (2010) · Annals of Internal Medicine · doi:10.7326/0003-4819-153-8-201010190-00009 · Cited by 175
Egger, M., Ebrahim, S., & Smith, G. D. (2002) · International Journal of Epidemiology · doi:10.1093/ije/31.1.1 · Cited by 160
Predictive value of APOE- 4 allele for progression from MCI to AD-type dementia: a meta-analysis
Elias-Sonnenschein, L. S., Viechtbauer, W., Ramakers, I. H. G. B., Verhey, F. R. J., & Visser, P. J. (2011) · Journal of Neurology, Neurosurgery & Psychiatry · doi:10.1136/jnnp.2010.231555 · Cited by 154
The Outcome of Complex Regional Pain Syndrome Type 1: A Systematic Review
Bean, D. J., Johnson, M. H., & Kydd, R. R. (2014) · The Journal of Pain · doi:10.1016/j.jpain.2014.01.500 · Cited by 137
Zhang, J., Fu, L., Shi, J., Chen, X., Li, Y., Ma, B., & Zhang, Y. (2013) · PLoS ONE · doi:10.1371/journal.pone.0078151 · Cited by 81
A systematic review of modifiable risk factors in the progression of multiple sclerosis
Hempel, S., Graham, G. D., Fu, N., Estrada, E., Chen, A. Y., Miake-Lye, I., Miles, J. N. V., Shanman, R., Shekelle, P. G., Beroes, J. M., et al. (2017) · Multiple Sclerosis Journal · doi:10.1177/1352458517690270 · Cited by 77
Atrial flutter and thromboembolic risk: a systematic review
Vadmann, H., Nielsen, P. B., Hjortshøj, S. P., Riahi, S., Rasmussen, L. H., Lip, G. Y. H., & Larsen, T. B. (2015) · Heart · doi:10.1136/heartjnl-2015-307550 · Cited by 72
Meta-analysis in medical research: Potentials and limitations
Zwahlen, M., Renehan, A., & Egger, M. (2008) · Urologic Oncology: Seminars and Original Investigations · doi:10.1016/j.urolonc.2006.12.001 · Cited by 70
Peters, S., Johnston, V., Hines, S., Ross, M., & Coppieters, M. (2016) · JBI Database of Systematic Reviews and Implementation Reports · doi:10.11124/jbisrir-2016-003099 · Cited by 49
Taylor, K. S., Heneghan, C. J., Stevens, R. J., Adams, E. C., Nunan, D., & Ward, A. (2015) · PLOS ONE · doi:10.1371/journal.pone.0126375 · Cited by 48
Chapter 12: Systematic Review of Prognostic Tests
Rector, T. S., Taylor, B. C., & Wilt, T. J. (2012) · Journal of General Internal Medicine · doi:10.1007/s11606-011-1899-y · Cited by 37
First Episode Psychosis, Substance Abuse and Prognosis: A Systematic Review
Archie, S., & Gyomorey, K. (2009) · Current Psychiatry Reviews · doi:10.2174/157340009788971074 · Cited by 20
Kok, G. D., Bockting, C. L. H., Burger, H., Hannig, W., Pijnenborg, G. H. M., Cuijpers, P., & Hollon, S. D. (2013) · PLoS ONE · doi:10.1371/journal.pone.0057510 · Cited by 18
Metadata
- Authors
- Altman, D. G.
- Venue
- BMJ
- Publisher
- BMJ
- Published
- 2001-07-28
- Volume
- 323
- Issue
- 7306
- Pages
- 224-228
- ISSN
- 0007-1447 (ISSN-L)
- 0959-8138
- 1468-5833
- OpenAlex
- W1853602163
- Cited by
- 756
- References
- 11
- FWCI
- 4.94
- Type
- journal article
- Language
- en
- Open access
- green
- Licence
- www.bmj.com/company/legal-information/terms-conditions/legal-information/tdm-licencepolicy (tdm)
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.
