The DOI matches its Crossref record; 27 of the 27 references it cites were found in a registry or an index.
Thousands of samples are needed to generate a robust gene list for predicting outcome in cancer
Abstract
Predicting at the time of discovery the prognosis and metastatic potential of cancer is a major challenge in current clinical research. Numerous recent studies searched for gene expression signatures that outperform traditionally used clinical parameters in outcome prediction. Finding such a signature will free many patients of the suffering and toxicity associated with adjuvant chemotherapy given to them under current protocols, even though they do not need such treatment. A reliable set of predictive genes also will contribute to a better understanding of the biological mechanism of metastasis. Several groups have published lists of predictive genes and reported good predictive performance based on them. However, the gene lists obtained for the same clinical types of patients by different groups differed widely and had only very few genes in common. This lack of agreement raised doubts about the reliability and robustness of the reported predictive gene lists, and the main source of the problem was shown to be the small number of samples that were used to generate the gene lists. Here, we introduce a previously undescribed mathematical method, probably approximately correct (PAC) sorting, for evaluating the robustness of such lists. We calculate for several published data sets the number of samples that are needed to achieve any desired level of reproducibility. For example, to achieve a typical overlap of 50% between two predictive lists of genes, breast cancer studies would need the expression profiles of several thousand early discovery patients.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Sørlie, T., Perou, C. M., Tibshirani, R., Aas, T., Geisler, S., Johnsen, H., Hastie, T., Eisen, M. B., van de Rijn, M., Jeffrey, S. S., et al. (2001) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.191367098 · Cited by 10,938
Gene expression profiling predicts clinical outcome of breast cancer
van 't Veer, L. J., Dai, H., van de Vijver, M. J., He, Y. D., Hart, A. A. M., Mao, M., Peterse, H. L., van der Kooy, K., Marton, M. J., Witteveen, A. T., et al. (2002) · Nature · doi:10.1038/415530a · Cited by 9,536
A Gene-Expression Signature as a Predictor of Survival in Breast Cancer
van de Vijver, M. J., He, Y. D., van 't Veer, L. J., Dai, H., Hart, A. A. M., Voskuil, D. W., Schreiber, G. J., Peterse, J. L., Roberts, C., Marton, M. J., et al. (2002) · New England Journal of Medicine · doi:10.1056/nejmoa021967 · Cited by 6,488
Rosenwald, A., Wright, G., Chan, W. C., Connors, J. M., Campo, E., Fisher, R. I., Gascoyne, R. D., Muller-Hermelink, H. K., Smeland, E. B., Giltnane, J. M., et al. (2002) · New England Journal of Medicine · doi:10.1056/nejmoa012914 · Cited by 3,829
Valiant, L. G. (1984) · Communications of the ACM · doi:10.1145/1968.1972 · Cited by 3,279
Gene-expression profiles to predict distant metastasis of lymph-node-negative primary breast cancer
Wang, Y., Klijn, J. G., Zhang, Y., Sieuwerts, A. M., Look, M. P., Yang, F., Talantov, D., Timmermans, M., Meijer-van Gelder, M. E., Yu, J., et al. (2005) · The Lancet · doi:10.1016/s0140-6736(05)17947-1 · Cited by 2,846
Khan, J., Wei, J. S., Ringnér, M., Saal, L. H., Ladanyi, M., Westermann, F., Berthold, F., Schwab, M., Antonescu, C. R., Peterson, C., et al. (2001) · Nature Medicine · doi:10.1038/89044 · Cited by 2,644
Bhattacharjee, A., Richards, W. G., Staunton, J., Li, C., Monti, S., Vasa, P., Ladd, C., Beheshti, J., Bueno, R., Gillette, M., et al. (2001) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.191502998 · Cited by 2,576
A molecular signature of metastasis in primary solid tumors
Ramaswamy, S., Ross, K. N., Lander, E. S., & Golub, T. R. (2003) · Nature Genetics · doi:10.1038/ng1060 · Cited by 2,449
Breast cancer metastasis: markers and models
Weigelt, B., Peterse, J. L., & van't Veer, L. J. (2005) · Nature Reviews Cancer · doi:10.1038/nrc1670 · Cited by 2,232
Focan, C., Steinberg, S. M., Blichert-Toft, M., Forbes, J., Collins, R. D., Anderson, S., Margreiter, R., Harwood, C. S., Andersen, K., Beighton, G., et al. (1998) · PubMed · Cited by 2,146
Polychemotherapy for early breast cancer: an overview of the randomised trials
(1998) · The Lancet · doi:10.1016/s0140-6736(98)03301-7 · Cited by 2,042
Gene-expression profiles predict survival of patients with lung adenocarcinoma
Beer, D. G., Kardia, S. L. R., Huang, C.-C., Giordano, T. J., Levin, A. M., Misek, D. E., Lin, L., Chen, G., Gharib, T. G., Thomas, D. G., et al. (2002) · Nature Medicine · doi:10.1038/nm733 · Cited by 2,025
Yeoh, E.-J., Ross, M. E., Shurtleff, S. A., Williams, W. K., Patel, D., Mahfouz, R., Behm, F. G., Raimondi, S. C., Relling, M. V., Patel, A., et al. (2002) · Cancer Cell · doi:10.1016/s1535-6108(02)00032-6 · Cited by 1,917
FISHER, R. A. (1915) · Biometrika · doi:10.1093/biomet/10.4.507 · Cited by 1,574
Asymptotic Expansions of Integrals
Bleistein, N., & Handelsman, R. A. (1975) · CERN Document Server (European Organization for Nuclear Research) · Cited by 1,340
Predicting the clinical status of human breast cancer by using gene expression profiles
West, M., Blanchette, C., Dressman, H., Huang, E., Ishida, S., Spang, R., Zuzan, H., Olson, J. A., Marks, J. R., & Nevins, J. R. (2001) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.201162998 · Cited by 1,318
Prediction of cancer outcome with microarrays: a multiple random validation strategy
Michiels, S., Koscielny, S., & Hill, C. (2005) · The Lancet · doi:10.1016/s0140-6736(05)17866-0 · Cited by 1,025
Molecular Classification and Molecular Forecasting of Breast Cancer: Ready for Clinical Application?
Brenton, J. D., Carey, L. A., Ahmed, A. A., & Caldas, C. (2005) · Journal of Clinical Oncology · doi:10.1200/jco.2005.03.3845 · Cited by 953
Outcome signature genes in breast cancer: is there a unique set?
Ein-Dor, L., Kela, I., Getz, G., Givol, D., & Domany, E. (2005) · Bioinformatics · doi:10.1093/bioinformatics/bth469 · Cited by 802
Self-citationSemi-Supervised Methods to Predict Patient Survival from Gene Expression Data
Bair, E., & Tibshirani, R. (2004) · PLoS Biology · doi:10.1371/journal.pbio.0020108 · Cited by 754
Iizuka, N., Oka, M., Yamada-Okabe, H., Nishida, M., Maeda, Y., Mori, N., Takao, T., Tamesa, T., Tangoku, A., Tabuchi, H., et al. (2003) · The Lancet · doi:10.1016/s0140-6736(03)12775-4 · Cited by 511
Microarrays and molecular research: noise discovery?
Ioannidis, J. P. (2005) · The Lancet · doi:10.1016/s0140-6736(05)17878-7 · Cited by 287
On the optimal number of features in the classification of multivariate Gaussian data
Jain, A. K., & Waller, W. G. (1978) · Pattern Recognition · doi:10.1016/0031-3203(78)90008-0 · Cited by 119
Genomics in breast cancer—therapeutic implications
Lønning, P. E., Sørlie, T., & Børresen‐Dale, A. (2005) · Nature Clinical Practice Oncology · doi:10.1038/ncponc0072 · Cited by 59
Microarrays and breast cancer clinical studies: forgetting what we have not yet learnt
Ahmed, A. A., & Brenton, J. D. (2005) · Breast Cancer Research · doi:10.1186/bcr1017 · Cited by 29
Valiant, L. G. (2026) · Foundations of Computation and Machine Learning · doi:10.1145/3749740.3749746
Cited by
Machine Learning Applications in Cancer Prognosis and Prediction
Kourou, K., Exarchos, T. P., Exarchos, K. P., Karamouzis, M. V., & Fotiadis, D. I. (2015) · Computational and Structural Biotechnology Journal · doi:10.1016/j.csbj.2014.11.005 · Cited by 3,338
“…of lack of agreement between the predictive gene lists discovered by different groups,theneed of thousands of samples inorder toachievethe desired outcomes, the lack of biological interpretation of predictive signatures and the dangers of information leak recorded in published studies [15 – 18].”
BackgroundThe prognostic landscape of genes and infiltrating immune cells across human cancers
Gentles, A. J., Newman, A. M., Liu, C. L., Bratman, S. V., Feng, W., Kim, D., Nair, V. S., Xu, Y., Khuong, A., Hoang, C. D., et al. (2015) · Nature Medicine · doi:10.1038/nm.3909 · Cited by 3,118
MAQC Consortium, Shi, L., Shi, L., Reid, L. H., Jones, W. D., Shippy, R., Warrington, J. A., Baker, S. C., Collins, P. J., de Longueville, F., et al. (2006) · Nature Biotechnology · doi:10.1038/nbt1239 · Cited by 2,126
“…to appear in peer-reviewed journals 9,10 , raising doubts about the repeatability, reproducibility and comparability of microarray technology 11–13 , several studies have also been recently published showing increased reproducibility of microarray data generated at different test sites and/or…”
BackgroundNetwork‐based classification of breast cancer metastasis
Chuang, H., Lee, E., Liu, Y., Lee, D., & Ideker, T. (2007) · Molecular Systems Biology · doi:10.1038/msb4100180 · Cited by 1,431
Imaging biomarker roadmap for cancer studies
O'Connor, J. P. B., Aboagye, E. O., Adams, J. E., Aerts, H. J. W. L., Barrington, S. F., Beer, A. J., Boellaard, R., Bohndiek, S. E., Brady, M., Brown, G., et al. (2017) · Nature Reviews Clinical Oncology · doi:10.1038/nrclinonc.2016.162 · Cited by 1,091
Metadata
- Authors
- Ein-Dor, L., Zuk, O., & Domany, E.
- Venue
- Proceedings of the National Academy of Sciences
- Published
- 2006-04-11
- Volume
- 103
- Issue
- 15
- Pages
- 5923-5928
- ISSN
- 0027-8424 (ISSN-L)
- 1091-6490
- OpenAlex
- W2097554668
- Cited by
- 689
- References
- 27
- FWCI
- 20.63
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.