The DOI matches its Crossref record; 23 of the 23 references it cites were found in a registry or an index.
Deriving chemosensitivity from cell lines: Forensic bioinformatics and reproducible research in high-throughput biology
Open accessAbstract
High-throughput biological assays such as microarrays let us ask very detailed questions about how diseases operate, and promise to let us personalize therapy. Data processing, however, is often not described well enough to allow for exact reproduction of the results, leading to exercises in “forensic bioinformatics” where aspects of raw data and reported results are used to infer what methods must have been employed. Unfortunately, poor documentation can shift from an inconvenience to an active danger when it obscures not just methods but errors. In this report we examine several related papers purporting to use microarray-based signatures of drug sensitivity derived from cell lines to predict patient response. Patients in clinical trials are currently being allocated to treatment arms on the basis of these results. However, we show in five case studies that the results incorporate several simple errors that may be putting patients at risk. One theme that emerges is that the most common errors are simple (e.g., row or column offsets); conversely, it is our experience that the most simple errors are common. We then discuss steps we are taking to avoid such errors in our own investigations.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
5 retracted
Genomic signatures to guide the use of chemotherapeutics
Potti, A., Dressman, H. K., Bild, A., Riedel, R. F., Chan, G., Sayer, R., Cragun, J., Cottrill, H., Kelley, M. J., Petersen, R., et al. (2006) · Nature Medicine · doi:10.1038/nm1491 · Cited by 593
RetractedBonnefoi, H., Potti, A., Delorenzi, M., Mauriac, L., Campone, M., Tubiana-Hulin, M., Petit, T., Rouanet, P., Jassem, J., Blot, E., et al. (2007) · The Lancet Oncology · doi:10.1016/s1470-2045(07)70345-5 · Cited by 212
RetractedHsu, D. S., Balakumaran, B. S., Acharya, C. R., Vlahovic, V., Walters, K. S., Garman, K. S., Anders, C. K., Riedel, R. F., Lancaster, J. M., Harpole, D. H., et al. (2007) · Journal of Clinical Oncology · doi:10.1200/jco.2007.11.0593 · Cited by 105
RetractedAn Integrated Approach to the Prediction of Chemotherapeutic Response in Patients with Breast Cancer
Salter, K. H., Acharya, C. R., Walters, K. S., Redman, R. C., Anguiano, A., Garman, K. S., Anders, C. K., Mukherjee, S., Dressman, H. K., Barry, W. T., et al. (2008) · PLoS ONE · doi:10.1371/journal.pone.0001908 · Cited by 89
RetractedA genomic approach to identify molecular pathways associated with chemotherapy resistance
Riedel, R. F., Porrello, A., Pontzer, E., Chenette, E. J., Hsu, D. S., Balakumaran, B. S., Potti, A., Nevins, J. R., & Febbo, P. G. (2008) · Molecular Cancer Therapeutics · doi:10.1158/1535-7163.mct-08-0642 · Cited by 72
RetractedReporting Recommendations for Tumor Marker Prognostic Studies (REMARK)
McShane, L. M., Altman, D. G., Sauerbrei, W., Taube, S. E., Gion, M., & Clark, G. M. (2005) · JNCI: Journal of the National Cancer Institute · doi:10.1093/jnci/dji237 · Cited by 2,162
Chang, J. C., Wooten, E. C., Tsimelzon, A., Hilsenbeck, S. G., Gutierrez, M. C., Elledge, R., Mohsin, S., Osborne, C. K., Chamness, G. C., Allred, D. C., et al. (2003) · The Lancet · doi:10.1016/s0140-6736(03)14023-8 · Cited by 875
Holleman, A., Cheok, M. H., den Boer, M. L., Yang, W., Veerman, A. J. P., Kazemier, K. M., Pei, D., Cheng, C., Pui, C.-H., Relling, M. V., et al. (2004) · New England Journal of Medicine · doi:10.1056/nejmoa033513 · Cited by 633
Baggerly, K. A., Morris, J. S., & Coombes, K. R. (2004) · Bioinformatics · doi:10.1093/bioinformatics/btg484 · Cited by 621
Self-citationRepeatability of published microarray gene expression analyses
Ioannidis, J. P. A., Allison, D. B., Ball, C. A., Coulibaly, I., Cui, X., Culhane, A. C., Falchi, M., Furlanello, C., Game, L., Jurman, G., et al. (2009) · Nature Genetics · doi:10.1038/ng.295 · Cited by 551
Sweave: Dynamic Generation of Statistical Reports Using Literate Data Analysis
Leisch, F. (2002) · Compstat · doi:10.1007/978-3-642-57489-4_89 · Cited by 422
Statistical Analyses and Reproducible Research
Gentleman, R., & Temple Lang, D. (2007) · Journal of Computational and Graphical Statistics · doi:10.1198/106186007x178663 · Cited by 348
Signal in Noise: Evaluating Reported Reproducibility of Serum Proteomic Tests for Ovarian Cancer
Baggerly, K. A., Morris, J. S., Edmonson, S. R., & Coombes, K. R. (2005) · JNCI Journal of the National Cancer Institute · doi:10.1093/jnci/dji008 · Cited by 294
Self-citationHigh-resolution serum proteomic features for ovarian cancer detection.
Conrads, T. P., Fusaro, V. A., Ross, S., Johann, D., Rajapakse, V, Hitt, B. A., Steinberg, S. M., Kohn, E. C., Fishman, D. A., Whitely, G., et al. (2004) · Endocrine-related cancer · doi:10.1677/erc.0.0110163 · Cited by 260
Lugthart, S., Cheok, M. H., den Boer, M. L., Yang, W., Holleman, A., Cheng, C., Pui, C.-H., Relling, M. V., Janka-Schaub, G. E., Pieters, R., et al. (2005) · Cancer Cell · doi:10.1016/j.ccr.2005.03.002 · Cited by 160
Győrffy, B., Surowiak, P., Kiesslich, O., Denkert, C., Schäfer, R., Dietel, M., & Lage, H. (2005) · International Journal of Cancer · doi:10.1002/ijc.21570 · Cited by 156
Coombes, K. R., Wang, J., & Baggerly, K. (2007) · Nature Medicine · doi:10.1038/nm1107-1276b · Cited by 143
Self-citationReproducible Research: A Bioinformatics Case Study
Gentleman, R. C. (2005) · Statistical Applications in Genetics and Molecular Biology · doi:10.2202/1544-6115.1034 · Cited by 137
A Compendium to Ensure Computational Reproducibility in High-Dimensional Classification Tasks
Ruschhaupt, M., Huber, W. K., Poustka, A., & Mansmann, U. (2004) · Statistical Applications in Genetics and Molecular Biology · doi:10.2202/1544-6115.1078 · Cited by 104
Genomic and Molecular Profiling Predicts Response to Temozolomide in Melanoma
Augustine, C. K., Yoo, J. S., Potti, A., Yoshimoto, Y., Zipfel, P. A., Friedman, H. S., Nevins, J. R., Ali‐Osman, F., & Tyler, D. S. (2009) · Clinical Cancer Research · doi:10.1158/1078-0432.ccr-08-1916 · Cited by 98
Run Batch Effects Potentially Compromise the Usefulness of Genomic Signatures for Ovarian Cancer
Baggerly, K., Coombes, K. R., & Neeley, E. S. (2008) · Journal of Clinical Oncology · doi:10.1200/jco.2007.15.1951 · Cited by 72
Self-citationAutomating dChip: toward reproducible sharing of microarray data analysis
Li, C. (2008) · BMC Bioinformatics · doi:10.1186/1471-2105-9-231 · Cited by 67
High-resolution serum proteomic patterns for ovarian cancer detection
Baggerly, K., Edmonson, S. R., Morris, J. S., & Coombes, K. R. (2004) · Endocrine Related Cancer · doi:10.1677/erc.1.00868 · Cited by 64
Self-citation
Research works printed but not linked: 8
- Potti, A. and Nevins, J. (2007). Reply to Microarrays: Retracing steps. Nat. Med. 13 1277–1278. · doi:10.1038/nm1107-1277
- Potti, A., Dressman, H. K., Bild, A., Riedel, R. F., Chan, G., Sayer, R., Cragun, J., Cottrill, H., Kelley, M. J., Petersen, R., Harpole, D., Marks, J., Berchuck, A., Ginsburg, G. S., Febbo, P., Lancaster, J. and Nevins, J. (2008). Corrigendum to “Genomics signatures to guide the use of chemotherapeutics.” Nat. Med. 14 889. · doi:10.1038/nm0808-889
- Baggerly, K. A. and Coombes, K. R. (2009a). Supplement 1, “Examining doxorubicin in detail,” to “Deriving chemosensitivity from cell lines: Forensic bioinformatics and reproducible research in high-throughput biology.” DOI: 10.1214/09-AOAS291SUPPA. · doi:10.1214/09-aoas291suppa
- Baggerly, K. A. and Coombes, K. R. (2009b). Supplement 2, “Cisplatin and pemetrexed,” to “Deriving chemosensitivity from cell lines: Forensic bioinformatics and reproducible research in high-throughput biology.” DOI: 10.1214/09-AOAS291SUPPB. · doi:10.1214/09-aoas291suppb
- Baggerly, K. A. and Coombes, K. R. (2009c). Supplement 3, “Examining combination therapy,” to “Deriving chemosensitivity from cell lines: Forensic bioinformatics and reproducible research in high-throughput biology.” DOI: 10.1214/09-AOAS291SUPPC. · doi:10.1214/09-aoas291suppc
- Baggerly, K. A. and Coombes, K. R. (2009d). Supplement 4, “Surveying cell lines,” to “Deriving chemosensitivity from cell lines: Forensic bioinformatics and reproducible research in high-throughput biology.” DOI: 10.1214/09-AOAS291SUPPD. · doi:10.1214/09-aoas291suppd
- Baggerly, K. A. and Coombes, K. R. (2009e). Supplement 5, “Examining docetaxel in detail,” to “Deriving chemosensitivity from cell lines: Forensic bioinformatics and reproducible research in high-throughput biology.” DOI: 10.1214/09-AOAS291SUPPE. · doi:10.1214/09-aoas291suppe
- Stivers, D. N., Wang, J., Rosner, G. L. and Coombes, K. R. (2003). Organ-specific differences in gene expression and UniGene annotations describing source material. In Methods of Microarray Data Analysis III (K. Johnson and S. Lin, eds.) 59–72. Kluwer Academic, Boston. · doi:10.1007/0-306-48354-8_5
Cited by
Reproducibility in Science: Improving the Standard for Basic and Preclinical Research
Begley, C. G., & Ioannidis, J. P. A. (2015) · Circulation Research · doi:10.1161/circresaha.114.303819 · Cited by 1,035
Gene expression profiling in breast cancer: classification, prognostication, and prediction
Reis-Filho, J. S., & Pusztai, L. (2011) · The Lancet · doi:10.1016/s0140-6736(11)61539-0 · Cited by 729
Good practices for quantitative bias analysis
Lash, T. L., Fox, M. P., MacLehose, R. F., Maldonado, G., McCandless, L. C., & Greenland, S. (2014) · International Journal of Epidemiology · doi:10.1093/ije/dyu149 · Cited by 646
Gastric cancer: Classification, histology and application of molecular pathology.
Hu, B., Elhajj, N., Sittler, S. Y., Lammert, N., Barnes, R., & Meloni‐Ehrig, A. (2012) · PubMed · doi:10.3978/j.issn.2078-6891.2012.021 · Cited by 490
Di Leo, G., & Sardanelli, F. (2020) · European Radiology Experimental · doi:10.1186/s41747-020-0145-y · Cited by 455
Metadata
- Authors
- Baggerly, K. A., & Coombes, K. R.
- Venue
- The Annals of Applied Statistics
- Publisher
- Institute of Mathematical Statistics
- Published
- 2009-12-01
- Volume
- 3
- Issue
- 4
- Pages
- 1309-1334
- ISSN
- 1932-6157 (ISSN-L)
- OpenAlex
- W1979916898
- Cited by
- 312
- References
- 23
- FWCI
- 9.00
- Type
- journal article
- Language
- en
- Open access
- bronze
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.