Reporting Recommendations for Tumor Marker Prognostic Studies (REMARK)
Abstract
Despite years of research and hundreds of reports on tumor markers in oncology, the number of markers that have emerged as clinically useful is pitifully small. Often, initially reported studies of a marker show great promise, but subsequent studies on the same or related markers yield inconsistent conclusions or stand in direct contradiction to the promising results. It is imperative that we attempt to understand the reasons that multiple studies of the same marker lead to differing conclusions. A variety of methodologic problems have been cited to explain these discrepancies. Unfortunately, many tumor marker studies have not been reported in a rigorous fashion, and published articles often lack sufficient information to allow adequate assessment of the quality of the study or the generalizability of study results. The development of guidelines for the reporting of tumor marker studies was a major recommendation of the National Cancer Institute-European Organisation for Research and Treatment of Cancer (NCI-EORTC) First International Meeting on Cancer Diagnostics in 2000. As for the successful CONSORT initiative for randomized trials and for the STARD statement for diagnostic studies, we suggest guidelines to provide relevant information about the study design, preplanned hypotheses, patient and specimen characteristics, assay methods, and statistical analysis methods. In addition, the guidelines suggest helpful presentations of data and important elements to include in discussions. The goal of these guidelines is to encourage transparent and complete reporting so that the relevant information will be available to others to help them to judge the usefulness of the data and understand the context in which the conclusions apply.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
While making revisions, conscious efforts were made to harmonize recommendations with other reporting guidelines, and where possible the same or similar wording for items was chosen.
“While making revisions, conscious efforts were made to harmonize our recommendations with other reporting guidelines, and where possible we chose the same or similar wording for items [37,39,41,45,46].”
From Transparent reporting of a multivariable prediction model for individual prognosis or diagnosis (TRIPOD): the TRIPOD Statement (2015) · cites this paper as [37]
These basic items have been identified as important in several well-known guidelines for reporting of clinical research.
“These items have been identified as important in several well-known guidelines for reporting of clinical research [4],[38]–[41].”
From Reporting and Methods in Clinical Prediction Research: A Systematic Review (2012) · cites this paper as [4]
Most guidelines advise investigators to report both unadjusted and adjusted results.
“Most guidelines, such as the STROBE guidelines for the reporting of observational studies or the REMARK guidelines for tumour marker prognostic studies, specifically advise investigators to report both unadjusted results (i.e., from univariable analysis, yielding the association of each candidate predictor with the outcome) and adjusted results (i.e., from a multivariable analysis) [4],[38],[63].”
From Reporting and Methods in Clinical Prediction Research: A Systematic Review (2012) · cites this paper as [4]
None of the existing reporting guidelines for observational, tumor marker, diagnostic accuracy, and genetic risk prediction studies are entirely appropriate for prediction model studies.
“However, none of these guidelines are entirely appropriate for prediction model studies.”
From Transparent Reporting of a Multivariable Prediction Model for Individual Prognosis or Diagnosis (TRIPOD): The TRIPOD Statement (2015) · cites this paper as [37]
The focus of the REMARK checklist is primarily on prognostic factors and not prediction models.
“However, the focus of the REMARK checklist is primarily on prognostic factors and not prediction models, whereas the GRIPS statement is aimed at risk prediction using genetic risk factors and the specific methodological issues around handling large numbers of genetic variants.”
From Transparent Reporting of a Multivariable Prediction Model for Individual Prognosis or Diagnosis (TRIPOD): The TRIPOD Statement (2015) · cites this paper as [37]
Cites
Stroup, D. F. (2000) · JAMA · doi:10.1001/jama.283.15.2008 · Cited by 20,623 · see citing works
Moher, D., Schulz, K. F., & Altman, D. G. (2001) · The Lancet · doi:10.1016/s0140-6736(00)04337-3 · Cited by 5,373 · see citing works
Self-citationMoher, D., Cook, D. J., Eastwood, S., Olkin, I., Rennie, D., & Stroup, D. F. (1999) · The Lancet · doi:10.1016/s0140-6736(99)04149-5 · Cited by 4,826 · see citing works
The Revised CONSORT Statement for Reporting Randomized Trials: Explanation and Elaboration
Altman, D. G., Schulz, K. F., Moher, D., Egger, M., Davidoff, F., Elbourne, D., Gøtzsche, P. C., Lang, T., & for the CONSORT Group (2001) · Annals of Internal Medicine · doi:10.7326/0003-4819-134-8-200104170-00012 · Cited by 3,835 · see citing works
Self-citationTowards complete and accurate reporting of studies of diagnostic accuracy: the STARD initiative
Bossuyt, P. M., Reitsma, J. B., Bruns, D. E., Gatsonis, C. A., Glasziou, P. P., Irwig, L. M., Lijmer, J. G., Moher, D., Rennie, D., & de Vet, H. C. W. (2003) · BMJ · doi:10.1136/bmj.326.7379.41 · Cited by 3,215
Towards Complete and Accurate Reporting of Studies of Diagnostic Accuracy: The STARD Initiative
Bossuyt, P. M., Reitsma, J. B., Bruns, D. E., Gatsonis, C. A., Glasziou, P., Irwig, L., Lijmer, J. G., Moher, D., Rennie, D., de Vet, H. C. W., et al. (2003) · Clinical Biochemistry · doi:10.1016/s0009-9120(02)00443-5 · Cited by 3,182 · see citing works
Moher, D. (2001) · JAMA · doi:10.1001/jama.285.15.1987 · Cited by 2,545 · see citing works
Systematic Reviews in Health Care : Meta-Analysis in Context
Egger, M., Smith, G. D., & Altman, D. G. (2000) · Cited by 2,312 · see citing works
Self-citationDangers of Using "Optimal" Cutpoints in the Evaluation of Prognostic Factors
Altman, D. G., Lausen, B., Sauerbrei, W., & Schumacher, M. (1994) · JNCI Journal of the National Cancer Institute · doi:10.1093/jnci/86.11.829 · Cited by 1,143 · see citing works
Self-citationThe STARD Statement for Reporting Studies of Diagnostic Accuracy: Explanation and Elaboration
Bossuyt, P. M., Reitsma, J. B., Bruns, D. E., Gatsonis, C. A., Glasziou, P., Irwig, L., Moher, D., Rennie, D., de Vet, H. C. W., & Lijmer, J. G. (2003) · Clinical Chemistry · doi:10.1373/49.1.7 · Cited by 1,124 · see citing works
The Risk of Determining Risk with Multivariable Models
Concato, J., Feinstein, A. R., & Holford, T. R. (1993) · Annals of Internal Medicine · doi:10.7326/0003-4819-118-3-199302010-00009 · Cited by 1,119 · see citing works
Bast, R. C., Ravdin, P. M., Hayes, D. F., Bates, S., Fritsche, H. A., Jessup, J. M., Kemeny, N. E., Locker, G. Y., Mennel, R. G., & Somerfield, M. R. (2001) · Journal of Clinical Oncology · doi:10.1200/jco.2001.19.6.1865 · Cited by 877 · see citing works
Bossuyt, P. M., Reitsma, J. B., Bruns, D. E., Gatsonis, C., Glasziou, P., Irwig, L., Lijmer, J. G., Moher, D., Rennie, D., & de Vet, H. C. W. (2003) · PubMed · doi:10.1373/49.1.1 · Cited by 861 · see citing works
Systematic reviews of evaluations of prognostic variables
Altman, D. G. (2001) · BMJ · doi:10.1136/bmj.323.7306.224 · Cited by 751 · see citing works
Self-citationTumor Marker Utility Grading System: a Framework to Evaluate Clinical Utility of Tumor Markers
Hayes, D. F., Bast, R. C., Desch, C. E., Fritsche, H. A., Kemeny, N. E., Jessup, J. M., Locker, G. Y., Macdonald, J. S., Mennel, R. G., Norton, L., et al. (1996) · JNCI Journal of the National Cancer Institute · doi:10.1093/jnci/88.20.1456 · Cited by 746 · see citing works
Self-citationStatistical aspects of prognostic factor studies in oncology
Simon, R. M., & Altman, D. (1994) · British Journal of Cancer · doi:10.1038/bjc.1994.192 · Cited by 589 · see citing works
Self-citationPrognostic Factors in Non-small Cell Lung Cancer
Brundage, M., Davies, D. L., & Mackillop, W. J. (2002) · CHEST Journal · doi:10.1378/chest.122.3.1037 · Cited by 572 · see citing works
Paik, S., Bryant, J., Tan-Chiu, E., Romond, E. H., Hiller, W., Park, K., Brown, A., Yothers, G., Anderson, S., Smith, R. P., et al. (2002) · JNCI Journal of the National Cancer Institute · doi:10.1093/jnci/94.11.852 · Cited by 484 · see citing works
Popat, S., Matakidou, A., & Houlston, R. S. (2004) · Journal of Clinical Oncology · doi:10.1200/jco.2004.05.064 · Cited by 449 · see citing works
Review of survival analyses published in cancer journals
Altman, D., De Stavola, B., Love, S., & Stepniewska, K. (1995) · British Journal of Cancer · doi:10.1038/bjc.1995.364 · Cited by 438 · see citing works
Self-citationConcordance Between Local and Central Laboratory HER2 Testing in the Breast Intergroup Trial N9831
Roche, P. C., Suman, V. J., Jenkins, R. B., Davidson, N. E., Martino, S., Kaufman, P. A., ADDO, F. E. K., Murphy, B., Ingle, J. N., & Perez, E. A. (2002) · JNCI Journal of the National Cancer Institute · doi:10.1093/jnci/94.11.855 · Cited by 390 · see citing works
Breast Cancer Prognostic Factors: Evaluation Guidelines
McGuire, W. L. (1991) · JNCI Journal of the National Cancer Institute · doi:10.1093/jnci/83.3.154 · Cited by 298 · see citing works
Mirza, A. N., Mirza, N., Vlastos, G., & Singletary, S. (2002) · Annals of Surgery · doi:10.1097/00000658-200201000-00003 · Cited by 271 · see citing works
Methodological challenges in the evaluation of prognostic factors in breast cancer.
Altman, D. G., & Lyman, G. H. (1998) · Breast Cancer Research and Treatment · doi:10.1023/a:1006193704132 · Cited by 271 · see citing works
Self-citationGasparini, G., Pozza, F., & Harris, A. L. (1993) · JNCI Journal of the National Cancer Institute · doi:10.1093/jnci/85.15.1206 · Cited by 244 · see citing works
Bossuyt, P. M., Reitsma, J. B., Bruns, D. E., Gatsonis, C. A., Glasziou, P., Irwig, L., Lijmer, J. G., Moher, D., Rennie, D., & de Vet, H. C. W. (2003) · PubMed · Cited by 242 · see citing works
Burton, A., & Altman, D. G. (2004) · British Journal of Cancer · doi:10.1038/sj.bjc.6601907 · Cited by 219 · see citing works
A Systematic Review of Molecular and Biological Tumor Markers in Neuroblastoma
Riley, R. D., Heney, D., Jones, D. R., Sutton, A. J., Lambert, P. C., Abrams, K. R., Young, B., Wailoo, A., & Burchill, S. A. (2004) · Clinical Cancer Research · doi:10.1158/1078-0432.ccr-1051-2 · Cited by 201 · see citing works
The future of prognostic factors in outcome prediction for patients with cancer
FIELDING, L. P., Fenoglio‐Preiser, C. M., & Freedman, L. S. (1992) · Cancer · doi:10.1002/1097-0142(19921101)70:9 · Cited by 166 · see citing works
Riley, R. D., Abrams, K. R., Sutton, A. J., Lambert, P. C., Jones, D. R., Heney, D., & Burchill, S. A. (2003) · British Journal of Cancer · doi:10.1038/sj.bjc.6600886 · Cited by 165 · see citing works
Why do so many prognostic factors fail to pan out?
Hilsenbeck, S. G., Clark, G. M., & McGuire, W. L. (1992) · Breast Cancer Research and Treatment · doi:10.1007/bf01840833 · Cited by 138 · see citing works
Self-citationThor, A. D., Liu, S., Moore, D. H., & Edgerton, S. M. (1999) · Journal of Clinical Oncology · doi:10.1200/jco.1999.17.2.470 · Cited by 137 · see citing works
Systematic Reviews of Evaluations of Prognostic Variables
Altman, D. G. (2001) · Wiley eBooks · doi:10.1002/9780470693926.ch13 · Cited by 123 · see citing works
Self-citationSensitivity of HER-2/neu Antibodies in Archival Tissue Samples of Invasive Breast Carcinomas
Gancberg, D., Lespagnard, L., Rouas, G., Paesmans, M., Piccart, M. J., Leo, A. D., Nogaret, J., Hertens, D., Verhest, A. P., & Larsimont, D. (2000) · American Journal of Clinical Pathology · doi:10.1309/0f58-0grx-fk4r-a6va · Cited by 91 · see citing works
McShane, L., Aamodt, R. M., Cordon‐Cardo, C., Cote, R., Faraggi, D., Fradet, Y., Hb, G., Peng, A., Se, T., & Waldman, F. (2000) · PubMed · Cited by 80 · see citing works
Self-citationPredicting the future: a critical appraisal of cancer prognosis studies
Hall, ., & Going, J. J. (1999) · Histopathology · doi:10.1046/j.1365-2559.1999.00862.x · Cited by 77 · see citing works
Potential for Selection Bias with Tumor Tissue Retrieval in Molecular Epidemiology Studies
Hoppin, J. A. (2002) · Annals of Epidemiology · doi:10.1016/s1047-2797(01)00250-2 · Cited by 65 · see citing works
Hammond, M. E., & Taube, S. E. (2002) · Seminars in Oncology · doi:10.1053/sonc.2002.32896 · Cited by 65 · see citing works
Self-citationSchumacher, M. C., Holländer, N., Schwarzer, G., Binder, H., & Sauerbrei, W. (2012) · Chapman & Hall/CRC eBooks · doi:10.1201/b11800-30 · Cited by 57 · see citing works
Self-citationA systematic review of molecular and biological markers in tumours of the Ewing's sarcoma family
Riley, R. D., Burchill, S. A., Abrams, K. R., Heney, D., Sutton, A. J., Jones, D. R., Lambert, P. C., Young, B., Wailoo, A., & Lewis, I. J. (2002) · European Journal of Cancer · doi:10.1016/s0959-8049(02)00500-2 · Cited by 54 · see citing works
Introduction: Tumor markers as clinical cancer tests—are we there yet?
Schilsky, R. L., & Taube, S. E. (2002) · Seminars in Oncology · doi:10.1053/sonc.2002.32890 · Cited by 41 · see citing works
Self-citationPrognostic variables in node-negative and node-positive breast cancer - editorial
Gasparini, G. (1998) · Breast Cancer Research and Treatment · doi:10.1023/a:1006102021879 · Cited by 27 · see citing works
Evaluating Prognostic Factor Studies
Simon, R. M. (2003) · TNM Online · doi:10.1002/0471463736.tnmp04 · Cited by 26 · see citing works
Gion, M., Boracchi, P., Biganzoli, E. M., & Daidone, M. G. (1999) · The International Journal of Biological Markers · doi:10.1177/172460089901400301 · Cited by 19 · see citing works
Self-citationBiostatistics and Tumor Marker Studies in Breast Cancer: Design, Analysis and Interpretation Issues
Biganzoli, E. M., Boracchi, P., & Marubini, E. (2003) · The International Journal of Biological Markers · doi:10.5301/jbm.2008.3652 · Cited by 13 · see citing works
Statistical Methods for the Analysis of Prognostic Factor Studies
McShane, L. M., & Simon, R. M. (2003) · TNM Online · doi:10.1002/0471463736.tnmp03 · Cited by 12 · see citing works
Self-citation
Flagged first, then by citations
Cited by
Sorted by citations
Guidelines for the use and interpretation of assays for monitoring autophagy (3rd edition).
Klionsky, D. J., Abdelmohsen, K., Abe, A., Abedin, M. J., Abeliovich, H., Acevedo Arozena, A., Adachi, H., Adams, C. M., Adams, P. D., Adeli, K., et al. (2016) · Autophagy · doi:10.1080/15548627.2015.1100356 · Cited by 5,894 · see citing works
Moons, K. G. M., Altman, D. G., Reitsma, J. B., Ioannidis, J. P. A., Macaskill, P., Steyerberg, E. W., Vickers, A. J., Ransohoff, D. F., & Collins, G. S. (2015) · Annals of Internal Medicine · doi:10.7326/m14-0698 · Cited by 5,147 · see citing works
Self-citationGuidelines for the use and interpretation of assays for monitoring autophagy
Klionsky, D. J., Abdalla, F. C., Abeliovich, H., Abraham, R. T., Acevedo-Arozena, A., Adeli, K., Agholme, L., Agnello, M., Agostinis, P., Aguirre-Ghiso, J. A., et al. (2012) · Autophagy · doi:10.4161/auto.19496 · Cited by 3,996 · see citing works
Collins, P. G. S., Reitsma, J. B., Altman, D. G., & Moons, K. G. M. (2015) · British Journal of Cancer · doi:10.1038/bjc.2014.639 · Cited by 3,312 · see citing works
Self-citationCollins, G. S., Reitsma, J. B., Altman, D. G., & Moons, K. G. M. (2015) · Annals of Internal Medicine · doi:10.7326/m14-0697 · Cited by 3,267 · see citing works
Self-citationKlionsky, D. J., Abdel-Aziz, A. K., Abdelfatah, S., Abdellatif, M., Abdoli, A., Abel, S., Abeliovich, H., Abildgaard, M. H., Abudu, Y. P., Acevedo-Arozena, A., et al. (2021) · Autophagy · doi:10.1080/15548627.2020.1797280 · Cited by 2,622 · see citing works
Denkert, C., von Minckwitz, G., Darb-Esfahani, S., Lederer, B., Heppner, B. I., Weber, K. E., Budczies, J., Huober, J., Klauschen, F., Furlanetto, J., et al. (2018) · The Lancet Oncology · doi:10.1016/s1470-2045(17)30904-x · Cited by 2,157 · see citing works
Collins, G. S., Reitsma, J. B., Altman, D. G., & Moons, K. (2015) · BMC Medicine · doi:10.1186/s12916-014-0241-z · Cited by 1,927 · see citing works
Self-citationLoi, S., Sirtaine, N., Piette, F., Salgado, R., Viale, G., Eenoo, F. V., Rouas, G., Francis, P. A., Crown, J. P., Hitre, E., et al. (2013) · Journal of Clinical Oncology · doi:10.1200/jco.2011.41.0902 · Cited by 1,626 · see citing works
Fukuoka, M., Wu, Y.-L., Thongprasert, S., Sunpaweravong, P., Leong, S.-S., Sriuranpong, V., Chao, T.-Y., Nakagawa, K., Chu, D.-T., Saijo, N., et al. (2011) · Journal of Clinical Oncology · doi:10.1200/jco.2010.33.4235 · Cited by 1,581 · see citing works
Reducing waste from incomplete or unusable reports of biomedical research
Glasziou, P., Altman, D. G., Bossuyt, P., Boutron, I., Clarke, M., Julious, S., Michie, S., Moher, D., & Wager, E. (2014) · The Lancet · doi:10.1016/s0140-6736(13)62228-x · Cited by 1,319 · see citing works
Self-citationLoi, S., Michiels, S., Salgado, R., Sirtaine, N., José, V., Fumagalli, D., Kellokumpu‐Lehtinen, P., Bono, P., Kataja, V. V., Desmedt, C., et al. (2014) · Annals of Oncology · doi:10.1093/annonc/mdu112 · Cited by 1,257 · see citing works
Liver Cancer Cell of Origin, Molecular Class, and Effects on Patient Prognosis
Sia, D., Villanueva, A., Friedman, S., & Llovet, J. (2016) · Gastroenterology · doi:10.1053/j.gastro.2016.11.048 · Cited by 1,051 · see citing works
Imaging biomarker roadmap for cancer studies
O'Connor, J. P. B., Aboagye, E. O., Adams, J. E., Aerts, H. J. W. L., Barrington, S. F., Beer, A. J., Boellaard, R., Bohndiek, S. E., Brady, M., Brown, G., et al. (2017) · Nature Reviews Clinical Oncology · doi:10.1038/nrclinonc.2016.162 · Cited by 1,091 · see citing works
Self-citationUse of Archived Specimens in Evaluation of Prognostic and Predictive Biomarkers
Simon, R. M., Paik, S., & Hayes, D. F. (2009) · JNCI Journal of the National Cancer Institute · doi:10.1093/jnci/djp335 · Cited by 1,040 · see citing works
Denkert, C., von Minckwitz, G., Brase, J. C., Sinn, B. V., Gade, S., Kronenwett, R., Pfitzner, B. M., Salat, C., Loi, S., Schmitt, W., et al. (2014) · Journal of Clinical Oncology · doi:10.1200/jco.2014.58.1967 · Cited by 1,026 · see citing works
Reporting Recommendations for Tumor Marker Prognostic Studies (REMARK): Explanation and Elaboration
Altman, D. G., McShane, L. M., Sauerbrei, W., & Taube, S. E. (2012) · PLoS Medicine · doi:10.1371/journal.pmed.1001216 · Cited by 1,019 · see citing works
Self-citationJohnson, N. A., Slack, G. W., Savage, K. J. J., Connors, J. M., Ben‐Neriah, S., Rogić, S., Scott, D. W., Tan, K. L., Steidl, C., Sehn, L. H., et al. (2012) · Journal of Clinical Oncology · doi:10.1200/jco.2011.41.0985 · Cited by 975 · see citing works
Sharing Detailed Research Data Is Associated with Increased Citation Rate
Piwowar, H. A., Day, R. S., & Fridsma, D. B. (2007) · PLoS ONE · doi:10.1371/journal.pone.0000308 · Cited by 881 · see citing works
Collins, G. S., Reitsma, J. B., Altman, D. G., & Moons, K. G. M. (2015) · British Journal of Surgery · doi:10.1002/bjs.9736 · Cited by 889 · see citing works
Self-citationOvarian Carcinoma Subtypes Are Different Diseases: Implications for Biomarker Studies
Köbel, M., Kalloger, S. E., Boyd, N., McKinney, S., Mehl, E., Palmer, C., Leung, S., Bowen, N. J., Ionescu, D. N., Rajput, A., et al. (2008) · PLoS Medicine · doi:10.1371/journal.pmed.0050232 · Cited by 814 · see citing works
Nielsen, T. O., Parker, J. S., Leung, S. C. Y., Voduc, D. K., Ebbert, M., Vickery, T. L., Davies, S. R., Snider, J., Stijleman, I. J., Reed, J. P., et al. (2010) · Clinical Cancer Research · doi:10.1158/1078-0432.ccr-10-1282 · Cited by 801 · see citing works
Driver mutations in TP53 are ubiquitous in high grade serous carcinoma of the ovary
Ahmed, A. A., Etemadmoghadam, D., Temple, J., Lynch, A. G., Riad, M., Sharma, R. N., Stewart, C. J. R., Fereday, S., Caldas, C., DeFazio, A., et al. (2010) · The Journal of Pathology · doi:10.1002/path.2696 · Cited by 786 · see citing works
Collins, G. S., Reitsma, J. B., Altman, D. G., & Moons, K. G. M. (2015) · Circulation · doi:10.1161/circulationaha.114.014508 · Cited by 793 · see citing works
Self-citationAssociation between CD8+ T-cell infiltration and breast cancer survival in 12 439 patients
Ali, H. R., Provenzano, E., Dawson, S., Blows, F. M., Liu, B., Shah, M., Earl, H. M., Poole, C. J., Hiller, L., Dunn, J., et al. (2014) · Annals of Oncology · doi:10.1093/annonc/mdu191 · Cited by 773 · see citing works
Identification of metastasis-related microRNAs in hepatocellular carcinoma
Budhu, A., Jia, H., Forgues, M., Liu, C., Goldstein, D., Lam, A., Zanetti, K. A., Ye, Q., Qin, L., Croce, C. M., et al. (2008) · Hepatology · doi:10.1002/hep.22160 · Cited by 697 · see citing works
Exosomal miR-1290 and miR-375 as Prognostic Markers in Castration-resistant Prostate Cancer
Huang, X., Yuan, T., Liang, M., Du, M., Xia, S., Dittmar, R. L., Wang, D., See, W. A., Costello, B. A., Quevedo, F., et al. (2014) · European Urology · doi:10.1016/j.eururo.2014.07.035 · Cited by 681 · see citing works
Clinical validation of the detection of KRAS and BRAF mutations from circulating tumor DNA
Thierry, A. R., Mouliere, F. C., Messaoudi, S. E., Mollévi, C., Lopez‐Crapez, E., Rolet, F., Gillet, B., Gongora, C., Dechelotte, P., Robert, B., et al. (2014) · Nature Medicine · doi:10.1038/nm.3511 · Cited by 681 · see citing works
Prognosis research strategy (PROGRESS) 1: A framework for researching clinical outcomes
Hemingway, H., Croft, P. R., Perel, P., Hayden, J. A., Abrams, K. R., Timmis, A., Briggs, A. H., Udumyan, R., Moons, K. G. M., Steyerberg, E. W., et al. (2013) · BMJ · doi:10.1136/bmj.e5595 · Cited by 662 · see citing works
Self-citationDiagnostic and prognostic implications of microRNA profiling in prostate carcinoma
Fendler, A., Jung, M., Mollenkopf, H., Wagner, I., Stephan, C., Jentzmik, F., Miller, K., Lein, M., Kristiansen, G., & Jung, K. (2009) · International Journal of Cancer · doi:10.1002/ijc.24827 · Cited by 611 · see citing works
Salgado, R., Denkert, C., Campbell, C., Savas, P. S., Nuciforo, P. G., Aura, C. M., de Azambuja, E., Eidtmann, H., Ellis, C. E., Baselga, J. M., et al. (2015) · JAMA Oncology · doi:10.1001/jamaoncol.2015.0830 · Cited by 605 · see citing works
Reporting and Methods in Clinical Prediction Research: A Systematic Review
Bouwmeester, W., Zuithoff, N. P. A., Mallett, S., Geerlings, M. I., Vergouwe, Y., Steyerberg, E. W., Altman, D. G., & Moons, K. G. M. (2012) · PLoS Medicine · doi:10.1371/journal.pmed.1001221 · Cited by 600 · see citing works
Self-citationRecent developments in meta‐analysis
Sutton, A. J., & Higgins, J. P. T. (2007) · Statistics in Medicine · doi:10.1002/sim.2934 · Cited by 583 · see citing works
Biomarkers of response and resistance to antiangiogenic therapy
Jain, R. K., Duda, D. G., Willett, C. G., Sahani, D. V., Zhu, A. X., Loeffler, J. S., Batchelor, T. T., & Sorensen, A. G. (2009) · Nature Reviews Clinical Oncology · doi:10.1038/nrclinonc.2009.63 · Cited by 572 · see citing works
Biosensors for cancer markers diagnosis
Tothill, I. E. (2009) · Seminars in Cell and Developmental Biology · doi:10.1016/j.semcdb.2009.01.015 · Cited by 558 · see citing works
Biomarker development in the precision medicine era: lung cancer as a case study
Vargas, A. J., & Harris, C. C. (2016) · Nature reviews. Cancer · doi:10.1038/nrc.2016.56 · Cited by 553 · see citing works
Denkert, C., Seither, F., Schneeweiß, A., Link, T., Blohmer, J., Just, M., Wimberger, P., Forberger, A., Tesch, H., Jackisch, C., et al. (2021) · The Lancet Oncology · doi:10.1016/s1470-2045(21)00301-6 · Cited by 562 · see citing works
Ogino, S., Chan, A. T., Fuchs, C. S., & Giovannucci, E. L. (2010) · Gut · doi:10.1136/gut.2010.217182 · Cited by 521 · see citing works
Duffy, M. J., van Dalen, A., Haglund, C. H., Hansson, L., Holinski‐Feder, E., Klapdor, R., Lamerz, R., Peltomäki, P., Sturgeon, C., & Topolčan, O. (2007) · European Journal of Cancer · doi:10.1016/j.ejca.2007.03.021 · Cited by 505 · see citing works
Sauerbrei, W., Taube, S. E., McShane, L. M., Cavenagh, M. M., & Altman, D. G. (2018) · JNCI Journal of the National Cancer Institute · doi:10.1093/jnci/djy088 · Cited by 489 · see citing works
Self-citationBeyond PSA: The Next Generation of Prostate Cancer Biomarkers
Prensner, J. R., Rubin, M. A., Wei, J. T., & Chinnaiyan, A. M. (2012) · Science Translational Medicine · doi:10.1126/scitranslmed.3003180 · Cited by 470 · see citing works
Sotiriou, C. P., & Piccart, M. J. (2007) · Nature reviews. Cancer · doi:10.1038/nrc2173 · Cited by 461 · see citing works
Yamamura, K., Baba, Y., Nakagawa, S., Mima, K., Miyake, K., Nakamura, K., Sawayama, H., Kinoshita, K., Ishimoto, T., Iwatsuki, M., et al. (2016) · Clinical Cancer Research · doi:10.1158/1078-0432.ccr-16-1786 · Cited by 457 · see citing works
Collins, G. S., Reitsma, J. B., Altman, D. G., & Moons, K. G. M. (2015) · European Urology · doi:10.1016/j.eururo.2014.11.025 · Cited by 439 · see citing works
Self-citationVillanueva, A., Hoshida, Y., Battiston, C., Tovar, V., Sia, D., Alsinet, C., Cornellà, H., Liberzon, A., Kobayashi, M., Kumada, H., et al. (2011) · Gastroenterology · doi:10.1053/j.gastro.2011.02.006 · Cited by 448 · see citing works
Rizzardi, A. E., Johnson, A. T., Vogel, R. I., Pambuccian, S. E., Henriksen, J. C., Skubitz, A. P. N., Metzger, G. J., & Schmechel, S. C. (2012) · Diagnostic Pathology · doi:10.1186/1746-1596-7-42 · Cited by 440 · see citing works
Clinical impact of programmed cell death ligand 1 expression in colorectal cancer
Droeser, R. A., Hirt, C., Viehl, C. T., Frey, D. M., Nebiker, C. A., Huber, X., Zlobec, I., Eppenberger‐Castori, S., Tzankov, A., Rosso, R., et al. (2013) · European Journal of Cancer · doi:10.1016/j.ejca.2013.02.015 · Cited by 428 · see citing works
DNA methylation‐based prognosis and epidrivers in hepatocellular carcinoma
Villanueva, A., Portela, A., Sayols, S., Battiston, C., Hoshida, Y., Méndez‐González, J., Imbeaud, S., Letouzé, É., Hernández–Gea, V., Cornellà, H., et al. (2015) · Hepatology · doi:10.1002/hep.27732 · Cited by 430 · see citing works
Mitsuhashi, K., Nosho, K., Sukawa, Y., Matsunaga, Y., Ito, M., Kurihara, H., Kanno, S., Igarashi, H., Naito, T., Adachi, Y., et al. (2015) · Oncotarget · doi:10.18632/oncotarget.3109 · Cited by 404 · see citing works
Okadome, K., Baba, Y., Yagi, T., Kiyozumi, Y., Ishimoto, T., Iwatsuki, M., Miyamoto, Y., Yoshida, N., Watanabe, M., & Baba, H. (2018) · Annals of Surgery · doi:10.1097/sla.0000000000002985 · Cited by 392 · see citing works
Collins, G. S., Reitsma, J. B., Altman, D. G., & Moons, K. G. M. (2015) · Annals of Internal Medicine · doi:10.7326/l15-5093-2 · Cited by 493 · see citing works
Self-citationReporting recommendations for tumor marker prognostic studies (REMARK): explanation and elaboration
Altman, D. G., McShane, L. M., Sauerbrei, W., & Taube, S. E. (2012) · BMC Medicine · doi:10.1186/1741-7015-10-51 · Cited by 374 · see citing works
Self-citationFoekens, J. A., Sieuwerts, A. M., Smid, M., Look, M. P., de Weerd, V., Boersma, A. W. M., Klijn, J. G. M., Wiemer, E. A. C., & Martens, J. W. M. (2008) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0803304105 · Cited by 370 · see citing works
Pierga, J., Bidard, F., Mathiot, C., Brain, E. G. C., Delaloge, S., Giachetti, S., de Crémoux, P., Salmon, R. J., Vincent‐Salomon, A., & Marty, M. E. (2008) · Clinical Cancer Research · doi:10.1158/1078-0432.ccr-08-0030 · Cited by 369 · see citing works
Pooled Analysis of the Prognostic Relevance of Circulating Tumor Cells in Primary Breast Cancer
Janni, W., Rack, B. K., Terstappen, L. W. M. M., Pierga, J., Taran, F., Fehm, T. N., Hall, C. S., de Groot, M. R., Bidard, F., Friedl, T. W. P., et al. (2016) · Clinical Cancer Research · doi:10.1158/1078-0432.ccr-15-1603 · Cited by 363 · see citing works
Evolution of Translational Omics: Lessons Learned and the Path Forward
Micheel, C., Nass, S. J., & Omenn, G. S. (2013) · Cited by 365 · see citing works
Tan, I. B., Ivanova, T., Lim, K. H., Ong, C. W., Deng, N., Lee, J., Tan, S. H., Wu, J., Lee, M. H., Ooi, C.-H., et al. (2011) · Gastroenterology · doi:10.1053/j.gastro.2011.04.042 · Cited by 357 · see citing works
Fehm, T. N., Müller, V., Aktas, B., Janni, W., Schneeweiß, A., Stickeler, E., Lattrich, C., Löhberg, C. R., Solomayer, E. F., Rack, B. K., et al. (2010) · Breast Cancer Research and Treatment · doi:10.1007/s10549-010-1163-x · Cited by 354 · see citing works
Johnson, P. J., Pirrie, S. J., Cox, T. F., Berhane, S., Teng, M. J., Palmer, D. H., Morse, J., Hull, D., Patman, G., Kagebayashi, C., et al. (2013) · Cancer Epidemiology Biomarkers & Prevention · doi:10.1158/1055-9965.epi-13-0870 · Cited by 360 · see citing works
Prognostic versus predictive value of biomarkers in oncology
Oldenhuis, C. N. A. M., Oosting, S. F., Gietema, J. A., & de Vries, E. G. E. (2008) · European Journal of Cancer · doi:10.1016/j.ejca.2008.03.006 · Cited by 349 · see citing works
Cell-free DNA in the blood as a solid tumor biomarker–a critical appraisal of the literature
Jung, K., Fleischhacker, M., & Rabien, A. (2010) · Clinica Chimica Acta · doi:10.1016/j.cca.2010.07.032 · Cited by 337 · see citing works
Biospecimen Reporting for Improved Study Quality (BRISQ)
Moore, H. M., Kelly, A. B., Jewell, S. D., McShane, L. M., Clark, D. P., Greenspan, R., Hayes, D. F., Hainaut, P. L., Kim, P., Mansfield, E. A., et al. (2011) · Journal of Proteome Research · doi:10.1021/pr200021n · Cited by 339 · see citing works
Self-citationIntestinal Microbiota and Relapse After Hematopoietic-Cell Transplantation
Peled, J. U., Devlin, S. M., Staffas, A., Lumish, M., Khanin, R., Littmann, E. R., Ling, L., Kosuri, S., Maloy, M., Slingerland, J. B., et al. (2017) · Journal of Clinical Oncology · doi:10.1200/jco.2016.70.3348 · Cited by 325 · see citing works
Clinical impact of small TP53 mutated subclones in chronic lymphocytic leukemia
Rossi, D., Khiabanian, H., Spina, V., Ciardullo, C., Bruscaggin, A., Famà, R., Rasi, S., Monti, S. M., Deambrogi, C., Paoli, L. D., et al. (2014) · Blood · doi:10.1182/blood-2013-11-539726 · Cited by 338 · see citing works
A Hepatocellular Carcinoma 5-Gene Score Associated With Survival of Patients After Liver Resection
Nault, J., de Reyniès, A., Villanueva, A., Caldéraro, J., Rebouissou, S., Couchy, G., Decaens, T., Franco, D., Imbeaud, S., Rousseau, F., et al. (2013) · Gastroenterology · doi:10.1053/j.gastro.2013.03.051 · Cited by 336 · see citing works
Pancreatic Cancer hENT1 Expression and Survival From Gemcitabine in Patients From the ESPAC-3 Trial
Greenhalf, W., Ghaneh, P., Neoptolemos, J. P., Palmer, D. H., Cox, T. F., Lamb, R. F., Garner, E., Campbell, F., Mackey, J. R., Costello, E., et al. (2013) · JNCI Journal of the National Cancer Institute · doi:10.1093/jnci/djt347 · Cited by 336 · see citing works
Muenst, S. E., Soysal, S. D., Gao, F., Obermann, E. C., Oertli, D., & Gillanders, W. E. (2013) · Breast Cancer Research and Treatment · doi:10.1007/s10549-013-2581-3 · Cited by 332 · see citing works
Prognostic Significance of POLE Proofreading Mutations in Endometrial Cancer
Church, D. N., Stelloo, E., Nout, R. A., Valtcheva, N., Depreeuw, J., ter Haar, N. T., Noske, A., Amant, F. C., Tomlinson, I. P. M., Wild, P. J., et al. (2014) · JNCI Journal of the National Cancer Institute · doi:10.1093/jnci/dju402 · Cited by 334 · see citing works
Hernandez, S. F., López‐Knowles, E., Lloreta, J., Kogevinas, M., Amorós, À., Tardón, A., Carrato, A., Serra, C., Malats, N., & Real, F. X. (2006) · Journal of Clinical Oncology · doi:10.1200/jco.2005.05.1771 · Cited by 334 · see citing works
Collins, P. G. S., Reitsma, J. B., Altman, D. G., & Moons, K. G. M. (2015) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2014.11.010 · Cited by 333 · see citing works
Self-citationTsao, M., Aviel‐Ronen, S., Ding, K., Lau, D., Liu, G., Sakurada, A., Whitehead, M., Zhu, C., Livingston, R. B., Johnson, D. H., et al. (2007) · Journal of Clinical Oncology · doi:10.1200/jco.2007.12.6953 · Cited by 326 · see citing works
Considerations in the development of circulating tumor cell technology for clinical use
Parkinson, D. R., Dracopoli, N. C., Petty, B. G., Compton, C. C., Cristofanilli, M., Deisseroth, A., Hayes, D. F., Kapke, G. F., Kumar, P. K. M., Lee, J. S. H., et al. (2012) · Journal of Translational Medicine · doi:10.1186/1479-5876-10-138 · Cited by 323 · see citing works
Portrait of the PI3K/AKT pathway in colorectal cancer
Danielsen, S. A., Eide, P. W., Nesbakken, A., Guren, T. K., Leithe, E., & Lothe, R. A. (2014) · Biochimica et Biophysica Acta (BBA) - Reviews on Cancer · doi:10.1016/j.bbcan.2014.09.008 · Cited by 326 · see citing works
Luporsi, É., André, F., Spyratos, F., Martin, P., Jacquemier, J. D., Penault-Llorca, F. M., Tubiana-Mathieu, N., Sigal‐Zafrani, B., Arnould, L., Gompel, A., et al. (2011) · Breast Cancer Research and Treatment · doi:10.1007/s10549-011-1837-z · Cited by 320 · see citing works
Dawson, S.-J., Makretsov, N. A., Blows, F. M., Driver, K. E., Provenzano, E., Quesne, J. P. C. L., Baglietto, L., Severi, G., Giles, G. G., McLean, C., et al. (2010) · British Journal of Cancer · doi:10.1038/sj.bjc.6605736 · Cited by 317 · see citing works
Biomarkers and surrogate end points—the challenge of statistical validation
Buyse, M. E., Sargent, D. J., Grothey, A. F., Matheson, A., & de Gramont, A. (2010) · Nature Reviews Clinical Oncology · doi:10.1038/nrclinonc.2010.43 · Cited by 316 · see citing works
Domingo, E., Freeman-Mills, L., Rayner, E., Glaire, M., Briggs, S., Vermeulen, L., Fessler, E., Medema, J. P., Boot, A., Morreau, H., et al. (2016) · The Lancet Gastroenterology & Hepatology · doi:10.1016/s2468-1253(16)30014-0 · Cited by 308 · see citing works
Stromal CD8+ T-cell Density—A Promising Supplement to TNM Staging in Non–Small Cell Lung Cancer
Dønnem, T., Hald, S. M., Paulsen, E., Richardsen, E. H., Al‐Saad, S., Kilvaer, T. K., Brustugun, O. T., Helland, Å., Lund‐Iversen, M., Poehl, M., et al. (2015) · Clinical Cancer Research · doi:10.1158/1078-0432.ccr-14-1905 · Cited by 308 · see citing works
Baggerly, K., & Coombes, K. R. (2009) · The Annals of Applied Statistics · doi:10.1214/09-aoas291 · Cited by 311 · see citing works
Molecular Classification and Novel Targets in Hepatocellular Carcinoma: Recent Advancements
Hoshida, Y., Toffanin, S., Lachenmayer, A., Villanueva, A., Mínguez, B., & Llovet, J. M. (2010) · Seminars in Liver Disease · doi:10.1055/s-0030-1247131 · Cited by 311 · see citing works
Dieci, M. V., Mathieu, M. C., Guarneri, V., Conte, P., Delaloge, S., André, F., & Goubar, A. (2015) · Annals of Oncology · doi:10.1093/annonc/mdv239 · Cited by 310 · see citing works
Cullen, J., Rosner, I. L., Brand, T. C., Zhang, N., Tsiatis, A. C., Moncur, J., Ali, A., Chen, Y., Knezevic, D., Maddala, T., et al. (2015) · European Urology · doi:10.1016/j.eururo.2014.11.030 · Cited by 278 · see citing works
Pan-cancer analysis of intratumor heterogeneity as a prognostic determinant of survival
Morris, L. G. T., Riaz, N., Desrichard, A., Şenbabaoğlu, Y., Hakimi, A. A., Makarov, V., Reis-Filho, J. S., & Chan, T. A.-T. (2016) · Oncotarget · doi:10.18632/oncotarget.7067 · Cited by 297 · see citing works
Parkinson, C., Gale, D. G., Piskorz, A., Biggs, H., Hodgkin, C., Addley, H. C., Freeman, S., Moyle, P., Sala, E., Sayal, K., et al. (2016) · PLoS Medicine · doi:10.1371/journal.pmed.1002198 · Cited by 299 · see citing works
Buteau, J. P., Martin, A. J., Emmett, L., Iravani, A., Sandhu, S., Joshua, A. M., Francis, R. J., Zhang, A. Y., Scott, A. M., Lee, S.-T., et al. (2022) · The Lancet Oncology · doi:10.1016/s1470-2045(22)00605-2 · Cited by 296 · see citing works
Cancer immunology—analysis of host and tumor factors for personalized medicine
Ogino, S., Galon, J., Fuchs, C. S., & Dranoff, G. (2011) · Nature Reviews Clinical Oncology · doi:10.1038/nrclinonc.2011.122 · Cited by 284 · see citing works
Park, J. E., Kim, D., Kim, H., Park, S., Kim, J. Y., Cho, S. J., Shin, J. H., & Kim, J. H. (2019) · European Radiology · doi:10.1007/s00330-019-06360-z · Cited by 261 · see citing works
Prognostic and predictive factors in colorectal cancer
Zlobec, I., & Lugli, A. K. (2008) · Postgraduate Medical Journal · doi:10.1136/jcp.2007.054858 · Cited by 280 · see citing works
Assessment of Claims of Improved Prediction Beyond the Framingham Risk Score
Tzoulaki, I. (2009) · JAMA · doi:10.1001/jama.2009.1757 · Cited by 276 · see citing works
Shrotriya, S., Walsh, D., Bennani-Baiti, N., Thomas, S., & Lorton, C. M. (2015) · PLoS ONE · doi:10.1371/journal.pone.0143080 · Cited by 277 · see citing works
Wolff, A. C., Lazar, A. A., Bondarenko, I., Garin, A. M., Brincat, S., Chow, L. W. C., Sun, Y. P., Nešković‐Konstantinović, Z., Guimarães, R. C., Fumoleau, P., et al. (2012) · Journal of Clinical Oncology · doi:10.1200/jco.2011.38.3331 · Cited by 272 · see citing works
Bairi, K. E., Haynes, H. R., Blackley, E. F., Fineberg, S., Shear, J., Turner, S., de Freitas, J. R., Sur, D. G., Amendola, L. C., Gharib, M., et al. (2021) · npj Breast Cancer · doi:10.1038/s41523-021-00346-1 · Cited by 271 · see citing works
Field, N. M., Cohen, T., Struelens, M. J., Palm, D., Cookson, B., Glynn, J. R., Gallo, V., Ramsay, M. E., Sonnenberg, P., MacCannell, D., et al. (2014) · The Lancet Infectious Diseases · doi:10.1016/s1473-3099(13)70324-4 · Cited by 261 · see citing works
Dancey, J. E., Dobbin, K. K., Groshen, S. G., Jessup, J. M., Hruszkewycz, A. H., Koehler, M. T., Parchment, R. E., Ratain, M. J., Shankar, L. K., Stadler, W. M., et al. (2010) · Clinical Cancer Research · doi:10.1158/1078-0432.ccr-09-2167 · Cited by 259 · see citing works
Loibl, S., von Minckwitz, G., Schneeweiß, A., Paepke, S., Lehmann, A., Rezai, M., Zahm, D. M., Sinn, H., Khandan, F., Eidtmann, H., et al. (2014) · Journal of Clinical Oncology · doi:10.1200/jco.2014.55.7876 · Cited by 258 · see citing works
NCCN Task Force Report: Evaluating the Clinical Utility of Tumor Markers in Oncology
Febbo, P. G., Ladanyi, M., Aldape, K., Marzo, A. M. D., Hammond, M. E. H., Hayes, D. F., Iafrate, A. J., Kelley, R. K., Marcucci, G., Ogino, S., et al. (2011) · Journal of the National Comprehensive Cancer Network · doi:10.6004/jnccn.2011.0137 · Cited by 256 · see citing works
Cancer Therapy–Induced Cardiac Toxicity in Early Breast Cancer
Khouri, M. G., Douglas, P. S., Mackey, J. R., Martín, M., Scott, J. M., Scherrer‐Crosbie, M., & Jones, L. W. (2012) · Circulation · doi:10.1161/circulationaha.112.100560 · Cited by 255 · see citing works
Hepatocellular Carcinoma: Novel Molecular Approaches for Diagnosis, Prognosis, and Therapy
Villanueva, A., Mínguez, B., Forner, A., Reig, M., & Llovet, J. M. (2010) · Annual Review of Medicine · doi:10.1146/annurev.med.080608.100623 · Cited by 254 · see citing works
Non-coding RNAs participate in the regulatory network of CLDN4 via ceRNA mediated miRNA evasion
Song, Y., Sun, J., Zhao, J., Yang, Y., Shi, J., Wu, Z., Chen, X., Gao, P., Miao, Z., & Wang, Z.-N. (2017) · Nature Communications · doi:10.1038/s41467-017-00304-1 · Cited by 252 · see citing works
Panwalkar, P., Clark, J. R., Ramaswamy, V., Hawes, D., Yang, F., Dunham, C. P., Yip, S. S. F., Hukin, J., Sun, Y., Schipper, M. J., et al. (2017) · Acta Neuropathologica · doi:10.1007/s00401-017-1752-4 · Cited by 250 · see citing works
- Authors
- McShane, L. M., Altman, D. G., Sauerbrei, W., Taube, S. E., Gion, M., & Clark, G. M.
- Affiliations
- National Institutes of Health (US)
- Corresponding author
- McShane, Lisa M.
- Venue
- JNCI: Journal of the National Cancer Institute
- Publisher
- Oxford University Press (OUP)
- Published
- 2005-08-17
- Volume
- 97
- Issue
- 16
- Pages
- 1180-1184
- ISSN
- 0027-8874 (ISSN-L)
- 1460-2105
- OpenAlex
- W2096910745
- Cited by
- 2,162
- References
- 46
- Citations by year
- 2026: 112 · 2025: 38 · 2024: 44 · 2023: 42 · 2022: 39 · 2021: 93 · 2020: 100 · 2019: 126 · 2018: 116 · 2017: 127 · 2016: 163 · 2015: 192 · 2014: 167 · 2013: 150 · 2012: 173
- FWCI
- 56.89
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- JNCI Journal of the National Cancer Institute (publishedVersion)
- PubMed (publishedVersion)
- Funders
- Yale University
- Yale Cancer Center
- Cancer Research UK
- Translational Cancer Research Network
- National Cancer Institute (MD 20892, 20892)
- Topics
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods in Epidemiology
- Health Sciences › Medicine › Oncology › Cancer Diagnosis and Treatment
- Keywords
- tumor markers, prognostic factors, reporting guidelines, remarks, reporting quality, methodological discrepancies, research design, assay method, statistical analysis methods, cancer diagnosis, research transparency
- MeSH terms
- Humans, Neoplasms, Research Design, Biomarkers, Tumor, Information Dissemination, Biomedical Research
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
