The DOI matches its Crossref record; 63 of the 63 references it cites were found in a registry or an index.
The MicroArray Quality Control (MAQC)-II study of common practices for the development and validation of microarray-based predictive models
Open accessAbstract
Gene expression data from microarrays are being applied to predict preclinical and clinical endpoints, but the reliability of these predictions has not been established. In the MAQC-II project, 36 independent teams analyzed six microarray data sets to generate predictive models for classifying a sample with respect to one of 13 endpoints indicative of lung or liver toxicity in rodents, or of breast cancer, multiple myeloma or neuroblastoma in humans. In total, >30,000 models were built using many combinations of analytical methods. The teams generated predictive models without knowing the biological meaning of some of the endpoints and, to mimic clinical reality, tested the models on data that had not been used for training. We found that model performance depended largely on the endpoint and team proficiency and that different approaches generated models of similar performance. The conclusions and recommendations from MAQC-II should be useful for regulatory agencies, study committees and independent investigators that evaluate methods for global gene expression analysis.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Using the common intra-site DEGs to validate the called inter-site DEGs, the MCC41, 42 showed that PEER also yields a higher accuracy than the original limmavoom method (Supplementary Fig. 22d,e), indicating that global data normalization analysis methods such as PEER can also be used to improve RNA-seq data across both Illumina and the PGM platforms.”
From Detecting and correcting systematic variation in large-scale RNA sequencing data (2014) · cites this paper as [42]
In the citing paper
“for instance, the Food and Drug Administration (FDA) agency of the USA employed the MCC as the main evaluation measure in the MicroArray II / Sequencing Quality Control (MAQC/SEQC) projects [41, 42].”
From The advantages of the Matthews correlation coefficient (MCC) over F1 score and accuracy in binary classification evaluation (2020) · cites this paper as [41]
In the citing paper
“Within the MicroArray Quality Control (MAQC)-II study [7], we observed, however, that the performance of gene expression models in predicting clinical outcome was limited and largely dependent on the respective clinical endpoint.”
From Comparison of RNA-seq and microarray-based models for clinical endpoint prediction (2015) · cites this paper as [7]
In the citing paper
“Within the MicroArray Quality Control (MAQC)-II study [7], we observed, however, that the performance of gene expression models in predicting clinical outcome was limited and largely dependent on the respective clinical endpoint.”
From Comparison of RNA-seq and microarray-based models for clinical endpoint prediction (2015) · cites this paper as [7]
In the citing paper
“Considering the fact that the nature of the clinical endpoint strongly affects a classifier’s performance [7, 18], we included endpoints that are known to cover a broad range of predictive difficulties (low difficulty, SEX, and CLASS LABEL; intermediate difficulty, EFS ALL, and OS ALL; high difficulty, EFS HR, and OS HR).”
From Comparison of RNA-seq and microarray-based models for clinical endpoint prediction (2015) · cites this paper as [7]
In the citing paper
“Evaluation of the prediction performances in the validation set revealed that the endpoint represents the most relevant factor affecting model performances, which is well in line with the findings of the MAQC-II study [7].”
From Comparison of RNA-seq and microarray-based models for clinical endpoint prediction (2015) · cites this paper as [7]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Gene expression profiling predicts clinical outcome of breast cancer
van 't Veer, L. J., Dai, H., van de Vijver, M. J., He, Y. D., Hart, A. A. M., Mao, M., Peterse, H. L., van der Kooy, K., Marton, M. J., Witteveen, A. T., et al. (2002) · Nature · doi:10.1038/415530a · Cited by 9,536
Unbiased Recursive Partitioning: A Conditional Inference Framework
Hothorn, T., Hornik, K., & Zeileis, A. (2006) · Journal of Computational and Graphical Statistics · doi:10.1198/106186006x133933 · Cited by 4,021
Comparison of Discrimination Methods for the Classification of Tumors Using Gene Expression Data
Dudoit, S., Fridlyand, J., & Speed, T. P. (2002) · Journal of the American Statistical Association · doi:10.1198/016214502753479248 · Cited by 2,671 · cited 1×
“Although previous studies have compared and benchmarked individual steps in the model development proces”
ResultMAQC Consortium, Shi, L., Shi, L., Reid, L. H., Jones, W. D., Shippy, R., Warrington, J. A., Baker, S. C., Collins, P. J., de Longueville, F., et al. (2006) · Nature Biotechnology · doi:10.1038/nbt1239 · Cited by 2,126
Self-citationThat BLUP is a Good Thing: The Estimation of Random Effects
Robinson, G. K. (1991) · Statistical Science · doi:10.1214/ss/1177011926 · Cited by 1,694
Selection bias in gene extraction on the basis of microarray gene-expression data
Ambroise, C., & McLachlan, G. J. (2002) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.102102699 · Cited by 1,537 · cited 1×
“, poor data quality and/or insufficient cross-validation of all model development step”
BackgroundDavé, S. S., Wright, G. W., Tan, B. K., Rosenwald, A., Gascoyne, R. D., Chan, W. C., Fisher, R. I., Braziel, R. M., Rimsza, L. M., Grogan, T. M., et al. (2004) · New England Journal of Medicine · doi:10.1056/nejmoa041869 · Cited by 1,417 · cited 1×
“Previously, reanalysis of a widely cited single stud”
BackgroundMicroarray data analysis: from disarray to consolidation and consensus
Allison, D. B., Cui, X., Page, G. P., & Sabripour, M. (2006) · Nature Reviews Genetics · doi:10.1038/nrg1749 · Cited by 1,339
Buyse, M. E., Loi, S., Veer, L. V., Viale, G., Delorenzi, M., Glas, A. M., Saghatchian, M., Bergh, J. C. S., Lidereau, R., Ellis, P., et al. (2006) · JNCI Journal of the National Cancer Institute · doi:10.1093/jnci/djj329 · Cited by 1,238
Shedden, K., Taylor, J. M. G., Misek, D. E., Chang, A. C., Hanash, S., Kuick, R. D., Beer, D. G., Enkemann, S. A., Yeatman, T. J., Eschrich, S. A., et al. (2008) · Nature Medicine · doi:10.1038/nm.1790 · Cited by 1,176
Flagged first, then by citations
Cited by
Sorted by citations
Items 101–200 of 894
Oshi, M., Asaoka, M., Tokumaru, Y., Angarita, F. A., Yan, L., Matsuyama, R., Zsíros, E., Ishikawa, T., Endo, I., & Takabe, K. (2020) · Cancers · doi:10.3390/cancers12103038 · Cited by 107
Yang, L., Wang, K., Chen, J., Jegga, A. G., Luo, H., Shi, L. M., Wan, C., Guo, X., Qin, S., He, G., et al. (2011) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1002016 · Cited by 107
A Blood Gene Expression Marker of Early Alzheimer's Disease
Lunnon, K., Sattlecker, M., Furney, S. J., Coppola, G., Simmons, A., Proitsi, P., Lupton, M. K., Lourdusamy, A., Johnston, C., Soininen, H. S., et al. (2013) · Journal of Alzheimer s Disease · doi:10.3233/jad-2012-121363 · Cited by 104
Architectures and accuracy of artificial neural network for disease classification from omics data
Yu, H., Samuels, D. C., Zhao, Y., & Guo, Y. P. (2019) · BMC Genomics · doi:10.1186/s12864-019-5546-z · Cited by 105
Oberthuer, A., Juraeva, D., Hero, B., Volland, R., Sterz, C., Schmidt, R., Faldum, A., Kahlert, Y., Engesser, A., Asgharzadeh, S., et al. (2014) · Clinical Cancer Research · doi:10.1158/1078-0432.ccr-14-0817 · Cited by 105
Balaji, K., Vijayaraghavan, S., Diao, L., Tong, P., Fan, Y.-H., Carey, J. P. W., Bui, T. N., Warner, S. L., Heymach, J. V., Hunt, K. K., et al. (2016) · Molecular Cancer Research · doi:10.1158/1541-7786.mcr-16-0157 · Cited by 98
He, L., Fan, Y., Zhang, Y., Tu, T.-T., Zhang, Q., Yuan, F., & Cheng, C. (2022) · Journal of Pineal Research · doi:10.1111/jpi.12803 · Cited by 98
Overcoming bias and systematic errors in next generation sequencing data
Taub, M. A., Bravo, H. C., & Irizarry, R. A. (2010) · Genome Medicine · doi:10.1186/gm208 · Cited by 104
“Some of this work was done under the auspices of the Food and Drug Administration (FDA), most notably the Microarray Quality Control (MAQC) studies, which were developed specifically in order to determine the utility of microarray technologies in a clinical setting [5, 6 ].”
MethodOptimally discriminative subnetwork markers predict response to chemotherapy
Dao, P., Wang, K., Collins, C. C., Ester, M., Lapuk, A. V., & Şahinalp, S. C. (2011) · Bioinformatics · doi:10.1093/bioinformatics/btr245 · Cited by 98
“We have chosen MCC over area under ROC curve (AUC) to facilitate comparison to competing models from the MAQC-II study (Shi, 2010).”
BackgroundMethodFusco, R., Grassi, R., Granata, V., Setola, S. V., Grassi, F., Cozzi, D., Pecori, B., Izzo, F., & Petrillo, A. (2021) · Journal of Personalized Medicine · doi:10.3390/jpm11100993 · Cited by 97
Jacob, L., Gagnon-Bartsch, J. A., & Speed, T. P. (2015) · Biostatistics · doi:10.1093/biostatistics/kxv026 · Cited by 99
“Fixing Xβ = 0 and optimizing over α in this case yields the naive RUV-2 algorithm of GagnonBartsch and Speed (2012). However it still makes sense to optimize the joint likelihood of (Xβ,α) by a similar iterative scheme.”
Methodβ-Adrenergic-stimulated macrophages: Comprehensive localization in the M1-M2 spectrum
Lamkin, D. M., Ho, H.-Y., Ong, T. H., Kawanishi, C. K., Stoffers, V. L., Ahlawat, N., Ma, J. C. Y., Arevalo, J. M. G., Cole, S. W., & Sloan, E. K. (2016) · Brain Behavior and Immunity · doi:10.1016/j.bbi.2016.07.162 · Cited by 94
Liu, Q., Sung, A. H., Chen, Z., Liu, J., Huang, X., & Deng, Y. (2009) · PLoS ONE · doi:10.1371/journal.pone.0008250 · Cited by 93
Protocol Dependence of Sequencing-Based Gene Expression Measurements
Raz, T., Kapranov, P., Lipson, D., Letovsky, S., Milos, P. M., & Thompson, J. F. (2011) · PLoS ONE · doi:10.1371/journal.pone.0019287 · Cited by 91
R-ODAF: Omics data analysis framework for regulatory application
Verheijen, M. C. T., Meier, M. J., Asensio, J. O., Gant, T. W., Tong, W., Yauk, C. L., & Caiment, F. (2022) · Regulatory Toxicology and Pharmacology · doi:10.1016/j.yrtph.2022.105143 · Cited by 96
Bukowski, R., Sadovsky, Y., Goodarzi, H., Zhang, H., Biggio, J., Varner, M. W., Parry, S. I., Xiao, F., Esplin, S. M., Andrews, W. J., et al. (2017) · PeerJ · doi:10.7717/peerj.3685 · Cited by 91
“Both elements of the analytic approach used in this study, the shrinkage in centroid analysis and 10 times 10-fold cross-validation, were shown to minimize overfitting and thus to improve generalizability of the findings (Shi et al., 2010; Steyerberg et al., 2001).”
BackgroundMethodAssessing affymetrix GeneChip microarray quality
McCall, M. N., Murakami, P. N., Lukk, M., Huber, W. K., & Irizarry, R. A. (2011) · BMC Bioinformatics · doi:10.1186/1471-2105-12-137 · Cited by 88
“To assess this, we considered predicting a clinical parameter, pathologic complete response (0 if residual disease; 1 otherwise), based on microarray data provided by MD Anderson to the MAQC-II project [ 3 ,20].”
Clinical Value of Prognosis Gene Expression Signatures in Colorectal Cancer: A Systematic Review
Pamplona, R. S., Berenguer, A., Cordero, D., Riccadonna, S., Solé, X., Crous‐Bou, M., Guinó, E., Sanjuán, X., Biondo, S., Soriano, A., et al. (2012) · PLoS ONE · doi:10.1371/journal.pone.0048877 · Cited by 88
Oshi, M., Newman, S., Tokumaru, Y., Yan, L., Matsuyama, R., Endo, I., Nagahashi, M., & Takabe, K. (2020) · International Journal of Molecular Sciences · doi:10.3390/ijms21186708 · Cited by 89
Validation of miRNAs as Breast Cancer Biomarkers with a Machine Learning Approach
Rehman, O., Zhuang, H., Ali, A. M., Ibrahim, A. K., & Li, Z. (2019) · Cancers · doi:10.3390/cancers11030431 · Cited by 85
“We chose to only utilize cross-validation and neglect the other steps outlined by the Data Analysis Protocol (DAP), which is outlined by the US-FDA MAQC-II initiative [21].”
MethodRole of Infrared Spectroscopy and Imaging in Cancer Diagnosis
Kumar, S., Srinivasan, A., & Nikolajeff, F. (2017) · Current Medicinal Chemistry · doi:10.2174/0929867324666170523121314 · Cited by 84
LIQA: long-read isoform quantification and analysis
Hu, Y., Li, F., Chen, X., Zhong, J. F., Li, M., & Wang, K. (2021) · Genome biology · doi:10.1186/s13059-021-02399-8 · Cited by 80
Limitations of alignment-free tools in total RNA-seq quantification
Wu, D. C., Yao, J., Ho, K. S., Lambowitz, A. M., & Wilke, C. O. (2018) · BMC Genomics · doi:10.1186/s12864-018-4869-5 · Cited by 83
Kumar, M., Rath, N. K., Swain, A., & Rath, S. K. (2015) · Procedia Computer Science · doi:10.1016/j.procs.2015.06.035 · Cited by 84
Gene expression analysis in RA: towards personalized medicine
Burska, A. N., Roget, K., Blits, M., Gómez, L. S., van de Loo, F., Hazelwood, L. D., Verweij, C. L., Rowe, A., Goulielmos, G. N., van Baarsen, L. G. M., et al. (2014) · The Pharmacogenomics Journal · doi:10.1038/tpj.2013.48 · Cited by 85
Guo, N. L., Wan, Y., Denvir, J., Porter, D. W., Pacurari, M., Wolfarth, M. G., Castranova, V., & Qian, Y. R. (2012) · Journal of Toxicology and Environmental Health · doi:10.1080/15287394.2012.699852 · Cited by 81
“It has become increasingly important to use gene expression signatures identified with bioinformatics methods for toxicity predication ( Shi et al. 2010 ), risk assessment, and screening ( Afshari et al.”
MethodRyu, D., Kim, S. J., Hong, Y., Jo, A., Kim, N., Kim, H., Lee, H., Kım, K., & Park, W. (2019) · Clinical Cancer Research · doi:10.1158/1078-0432.ccr-19-0694 · Cited by 80
Cao, K. L., Rohart, F., McHugh, L. C., Korn, O., & Wells, C. A. (2014) · Genomics · doi:10.1016/j.ygeno.2014.03.001 · Cited by 81
(2008) · Wiley eBooks · doi:10.1002/9783527622818 · Cited by 84
Batch Effect Confounding Leads to Strong Bias in Performance Estimates Obtained by Cross-Validation
Soneson, C., Gerster, S., & Delorenzi, M. (2014) · PLoS ONE · doi:10.1371/journal.pone.0100335 · Cited by 84
Pant, S., WEINER, R. S., & Marton, M. J. (2014) · Frontiers in Oncology · doi:10.3389/fonc.2014.00078 · Cited by 78
Biomarkers in solid organ transplantation: establishing personalized transplantation medicine
Roedder, S., Vitalone, M. J., Khatri, P., & Sarwal, M. (2011) · Genome Medicine · doi:10.1186/gm253 · Cited by 78
“For this purpose, the microarray quality control (MAQC) studies [16,17] were initiated.”
MethodHaque, M. N., Noman, N., Berretta, R. E., & Moscato, P. (2016) · PLoS ONE · doi:10.1371/journal.pone.0146116 · Cited by 77
Revisiting inconsistency in large pharmacogenomic studies
Safikhani, Z., Freeman, M., Smirnov, P., El-Hachem, N., She, A., Quevedo, R., Goldenberg, A., Birkbak, N. J., Hatzis, C., Shi, L. M., et al. (2016) · F1000Research · doi:10.12688/f1000research.9611.3 · Cited by 106
Progress in toxicogenomics to protect human health
Meier, M. J., Harrill, J., Johnson, K. J., Thomas, R. S., Tong, W., Rager, J. E., & Yauk, C. L. (2024) · Nature Reviews Genetics · doi:10.1038/s41576-024-00767-1 · Cited by 84
“To establish best practices for predictive toxicogenomic models, the FDA led a MicroArray Quality Control (MAQC-II) project that systematically assessed a wide range of machine learning methods for toxicological predictions and disease diagnoses 157 .”
Kinaret, P., Serra, A., Federico, A., Kohonen, P. J., Nymark, P. E. H., Liampa, I., Ha, M. K., Choi, J., Jagiełło, K., Sanabria, N. M., et al. (2020) · Nanomaterials · doi:10.3390/nano10040750 · Cited by 79
Machine learning methods to predict child posttraumatic stress: a proof of concept study
Saxe, G., Ma, S., Ren, J., & Aliferis, C. (2017) · BMC Psychiatry · doi:10.1186/s12888-017-1384-1 · Cited by 78
The Gene Expression Barcode 3.0: improved data processing and mining tools
McCall, M. N., Jaffee, H. A., Zelisko, S., Sinha, N., Hooiveld, G. J. E. J., Irizarry, R. A., & Zilliox, M. J. (2013) · Nucleic Acids Research · doi:10.1093/nar/gkt1204 · Cited by 70
Nueda, M. J., Ferrer, A., & Conesa, A. (2012) · Biostatistics · doi:10.1093/biostatistics/kxr042 · Cited by 72
Non-volatile disinfection byproducts are far more toxic to mammalian cells than volatile byproducts
Wu, Q.-Y., Liang, Z.-F., Wang, W., Du, Y., Hu, H., Yang, L.-L., & Huang, W.-C. (2020) · Water Research · doi:10.1016/j.watres.2020.116080 · Cited by 69
Integrative Network Fusion: A Multi-Omics Approach in Molecular Profiling
Chierici, M., Bussola, N., Marcolini, A., Francescatto, M., Zandonà, A., Trastulla, L., Agostinelli, C., Jurman, G., & Furlanello, C. (2020) · Frontiers in Oncology · doi:10.3389/fonc.2020.01065 · Cited by 82
Wilson, C. M., Rodríguez, M., Johnson, C. M., Martin, S., Chu, T., Wolfinger, R. D., Hauser, L., Land, M., Klingeman, D. M., Syed, M. H., et al. (2013) · Biotechnology for Biofuels · doi:10.1186/1754-6834-6-179 · Cited by 75
Molecular markers and mechanisms of stroke: RNA studies of blood in animals and humans
Sharp, F. R., Jickling, G. C., Stamova, B. S., Tian, Y., Zhan, X., Liu, D., Kuczynski, B., Cox, C. D., & Ander, B. P. (2011) · Journal of Cerebral Blood Flow & Metabolism · doi:10.1038/jcbfm.2011.45 · Cited by 71
“…revolve around the choice of cutoffs, which include everything from a very strict Bonferroni (correction for total number of comparisons) to a less stringent Benjamini–Hochberg falsediscovery rate (Benjamini et al, 2001; Hsueh et al, 2003; Reiner et al, 2003; Shi et al, 2010; Tan et al, 2006).”
BackgroundMethodInfluentialDerivation of a New ADAS-cog Composite Using Tree-based Multivariate Analysis
Llano, D. A., Laforet, G. A., & Devanarayan, V. (2010) · Alzheimer Disease & Associated Disorders · doi:10.1097/wad.0b013e3181f5b8d8 · Cited by 70
Genomic assays for Epstein–Barr virus-positive gastric adenocarcinoma
Gulley, M. L. (2015) · Experimental & Molecular Medicine · doi:10.1038/emm.2014.93 · Cited by 70
Wu, L., Huang, R., Tetko, I. V., Xia, Z., Xu, J., & Tong, W. (2021) · Chemical Research in Toxicology · doi:10.1021/acs.chemrestox.0c00373 · Cited by 73
Llano, D. A., Devanarayan, V., & Simon, A. J. (2012) · Alzheimer Disease & Associated Disorders · doi:10.1097/wad.0b013e31826d597a · Cited by 71
Westfall, P. H., Troendle, J. F., & Pennello, G. A. (2010) · Biometrics · doi:10.1111/j.1541-0420.2010.01408.x · Cited by 69
CrossNorm: a novel normalization strategy for microarray data in cancers
Cheng, L., Lo, L.-Y., Tang, N. L. S., Wang, D., & Leung, K. (2016) · Scientific Reports · doi:10.1038/srep18898 · Cited by 67
Bo, W., Qin, D., Zheng, X., Wang, Y., Ding, B., Li, Y., & Liang, G. (2022) · Food Research International · doi:10.1016/j.foodres.2022.110974 · Cited by 66
Pacurari, M., Qian, Y., Porter, D. W., Wolfarth, M. G., Wan, Y., Luo, D., Ding, M., Castranova, V., & Guo, N. L. (2011) · Toxicology and Applied Pharmacology · doi:10.1016/j.taap.2011.05.012 · Cited by 70
“It has become increasingly important to use gene expression signatures identified with bioinformatics methods for toxicity predication (Shi et al., 2010), risk assessment, and screening (Afshari et al., 2011).”
MethodGenomics and transcriptomics in drug discovery
Dopazo, J. (2013) · Drug Discovery Today · doi:10.1016/j.drudis.2013.06.003 · Cited by 69
Fan, X., Lobenhofer, E. K., Chen, M., Shi, W., Huang, J., Luo, J., Zhang, J. H., Walker, S. J., Chu, T.-M., Li, L., et al. (2010) · The Pharmacogenomics Journal · doi:10.1038/tpj.2010.34 · Cited by 66
Oberthuer, A., Juraeva, D., Li, L., Kahlert, Y., Westermann, F., Eils, R., Berthold, F., Shi, L. M., Wolfinger, R. D., Fischer, M., et al. (2010) · The Pharmacogenomics Journal · doi:10.1038/tpj.2010.53 · Cited by 67
Díaz-Gimeno, P., Ruíz-Alonso, M., Sebastián-León, P., Pellicer, A., Valbuena, D., & Simón, C. (2017) · Fertility and Sterility · doi:10.1016/j.fertnstert.2017.07.007 · Cited by 70
Gusenleitner, D., Auerbach, S. S., Melia, T., Gómez, H. F., Sherr, D. H., & Monti, S. (2014) · PLoS ONE · doi:10.1371/journal.pone.0102579 · Cited by 67
Criscitiello, C., Bayar, M. A., Curigliano, G., Symmans, W. F., Desmedt, C., Bonnefoi, H. R., Sinn, B. V., Pruneri, G., Vicier, C., Pierga, J., et al. (2017) · Annals of Oncology · doi:10.1093/annonc/mdx691 · Cited by 66
Comparison of Microarrays and RNA-Seq for Gene Expression Analyses of Dose-Response Experiments
Black, M. B., Parks, B., Pluta, L., Chu, T., Allen, B. C., Wolfinger, R. D., & Thomas, R. S. (2013) · Toxicological Sciences · doi:10.1093/toxsci/kft249 · Cited by 64
Tan, G. W., Khoo, A. S. B., & Tan, L. P. (2015) · Scientific Reports · doi:10.1038/srep09430 · Cited by 64
Fehlbaum, P., on behalf of the EHTAD/002 study group, Sol, O., Désiré, L., Touchon, J., DANTOINE, T. F., Vercelletto, M., Gabelle, A., Jarrige, A.-C., Haddad, R., et al. (2012) · Journal of Alzheimer s Disease · doi:10.3233/jad-2012-120637 · Cited by 64
Transcriptomics of the human endometrium
Díaz-Gimeno, P., Ruíz-Alonso, M., Blesa, D., & Simón, C. (2014) · The International Journal of Developmental Biology · doi:10.1387/ijdb.130340pd · Cited by 67
Liew, W. S., Tang, T. B., Lin, C.-H. D., & Lu, C. (2021) · Computer Methods and Programs in Biomedicine · doi:10.1016/j.cmpb.2021.106114 · Cited by 62
Personalized medicine: Present and future of breast cancer management
Sabatier, R., Gonçalvès, A., & Bertucci, F. (2014) · Critical Reviews in Oncology/Hematology · doi:10.1016/j.critrevonc.2014.03.002 · Cited by 65
Qing, T., Mahmood, M., Zheng, Y., Biris, A. S., Shi, L. M., & Casciano, D. A. (2017) · Journal of Applied Toxicology · doi:10.1002/jat.3528 · Cited by 65
Gene signatures related to B ‐cell proliferation predict influenza vaccine‐induced antibody response
Tan, Y. Q., Tamayo, P., Nakaya, H. I., Pulendran, B., Mesirov, J. P., & Haining, W. N. (2013) · European Journal of Immunology · doi:10.1002/eji.201343657 · Cited by 62
Oshi, M., Newman, S., Tokumaru, Y., Yan, L., Matsuyama, R., Endo, I., & Takabe, K. (2020) · Journal of Immunology Research · doi:10.1155/2020/5618786 · Cited by 61
Classification of microarray using MapReduce based proximal support vector machine classifier
Kumar, M., & Rath, S. K. (2015) · Knowledge-Based Systems · doi:10.1016/j.knosys.2015.09.005 · Cited by 59
The application of next-generation sequencing technologies to drug discovery and development
Woollard, P. M., Mehta, N., Vamathevan, J. J., Horn, S. V., Bonde, B. K., & Dow, D. J. (2011) · Drug Discovery Today · doi:10.1016/j.drudis.2011.03.006 · Cited by 60
Lu, J., Kerns, R. T., Peddada, S. D., & Bushel, P. R. (2011) · Nucleic Acids Research · doi:10.1093/nar/gkr241 · Cited by 58
Cohen, H., Ben‐Hamo, R., Gidoni, M., Yitzhaki, I., Kozol, R., Zilberberg, A., & Efroni, S. (2014) · Breast Cancer Research · doi:10.1186/s13058-014-0464-0 · Cited by 60
“In an effort to characterize molecular mechanisms associated with distinct breast cancer subtypes, we analyzed gene expression patterns in four publicly available cohorts of several hundred patients [26-29,33,34].”
BackgroundMethodAn Ensemble Learning Approach for Enhanced Classification of Patients With Hepatitis and Cirrhosis
Chicco, D., & Jurman, G. (2021) · IEEE Access · doi:10.1109/access.2021.3057196 · Cited by 68
Falgreen, S., Dybkær, K., Young, K. H., Xu-Monette, Z. Y., El‐Galaly, T. C., Laursen, M. B., Bødker, J. S., Kjeldsen, M. K., Schmitz, A., Nyegaard, M., et al. (2015) · BMC Cancer · doi:10.1186/s12885-015-1237-6 · Cited by 59
Zheng, S., Zou, Y., Xie, X., Liang, J., Yang, A., Yu, K., Wang, J., Tang, H., & Xie, X. (2020) · International Journal of Cancer · doi:10.1002/ijc.33009 · Cited by 59
Plasma pTau217 predicts continuous brain amyloid levels in preclinical and early Alzheimer's disease
Devanarayan, V., Doherty, T., Charil, A., Sachdev, P., Ye, Y., Murali, L. K., Llano, D. A., Zhou, J., Reyderman, L., Hampel, H. J., et al. (2024) · Alzheimer s & Dementia · doi:10.1002/alz.14073 · Cited by 61
“52 Subsequently, themodelswereevaluatedinthetwovalidationcohorts,VC-1andVC-2.”
Systems biological approaches to measure and understand vaccine immunity in humans
Li, S., Nakaya, H. I., Kazmin, D. A., Oh, J. Z., & Pulendran, B. (2013) · Seminars in Immunology · doi:10.1016/j.smim.2013.05.003 · Cited by 61
High dimensional biological data retrieval optimization with NoSQL technology
Wang, S., Pandis, I., Wu, C., He, S., Johnson, D., Emam, I., Guitton, F., & Guo, Y. (2014) · BMC Genomics · doi:10.1186/1471-2164-15-s8-s3 · Cited by 59
“In our experiment we took a database dump of the DEAPP schema that tranSMART uses to store patient microarray data and extracted a public Multiple Myeloma (MULTMYEL) [20,21] dataset [GEO:GSE24080] [22].”
MethodEvaluating reproducibility of AI algorithms in digital pathology with DAPPER
Bizzego, A., Bussola, N., Chierici, M., Maggio, V., Francescatto, M., Cima, L., Cristoforetti, M., Jurman, G., & Furlanello, C. (2019) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1006269 · Cited by 60
Circulating microRNAs: Challenges with their use as liquid biopsy biomarkers
Takizawa, S., Matsuzaki, J., & Ochiya, T. (2022) · Cancer Biomarkers · doi:10.3233/cbm-210223 · Cited by 58
Zhang, M., Chen, M., & Tong, W. (2011) · Chemical Research in Toxicology · doi:10.1021/tx200320e · Cited by 60
Building Multivariate Systems Biology Models
Kirwan, G. M., Johansson, E., Kleemann, R., Verheij, E. R., Wheelock, Å. M., Goto, S., Trygg, J., & Wheelock, C. E. (2012) · Analytical Chemistry · doi:10.1021/ac301269r · Cited by 57
Zhou, W.-X., Bose, K., B, J. F. A., & Liu, H. (2018) · The Annals of Statistics · doi:10.1214/17-aos1606 · Cited by 57
Microarray analysis in pulmonary hypertension
Hoffmann, J., Wilhelm, J., Olschewski, A., & Kwapiszewska, G. (2016) · European Respiratory Journal · doi:10.1183/13993003.02030-2015 · Cited by 57
A generic Transcriptomics Reporting Framework (TRF) for ‘omics data processing and analysis
Gant, T. W., Sauer, U. G., Zhang, S., Chorley, B. N., Hackermüller, J., Perdichizzi, S., Tollefsen, K. E., van Ravenzwaay, B., Yauk, C. L., Tong, W., et al. (2017) · Regulatory Toxicology and Pharmacology · doi:10.1016/j.yrtph.2017.11.001 · Cited by 58
“The quality control (QC) of the generation of gene expression data has been dealt with previously by the U.S. Food and Drug Administration (FDA)-led MicroArray Quality Control (MAQC) consortium (MAQC Consortium et al., 2006; Shi et al., 2005, 2008, 2010; Xu et al., 2016).”
MethodAdvantages of orthogonal inspection in chemometrics
Pinto, R. C., Trygg, J., & Gottfries, J. (2012) · Journal of Chemometrics · doi:10.1002/cem.2441 · Cited by 55
Bai, H., Zhu, H., Yan, Q., Shen, X., Lu, X., Wang, J., Li, J., & Chen, L. (2018) · Cell Communication and Signaling · doi:10.1186/s12964-018-0280-8 · Cited by 54
Difficulties and challenges in the development of precision medicine
Liu, X., Luo, X., Jiang, C., & Zhao, H. (2019) · Clinical Genetics · doi:10.1111/cge.13511 · Cited by 58
“standards will help to promote large-scale biological data collection that is standardized for precision medicine.(29) At present, the current technologies that can be applied to preci-”
BackgroundZhou, W., Bose, K., B, J. F. A., & Liu, H. (2018) · eScholarship (California Digital Library) · Cited by 55
Jones, W. D., Gong, B., Novoradovskaya, N., Li, D., Kusko, R. L., Richmond, T., Johann, D. J., Bişğin, H., Sahraeian, S. M. E., Bushel, P. R., et al. (2021) · Genome biology · doi:10.1186/s13059-021-02316-z · Cited by 54
Liu, Q., Hu, Y., Stucky, A., Li, F., Zhong, J. F., & Wang, K. (2020) · BMC Genomics · doi:10.1186/s12864-020-07207-4 · Cited by 56
Nakaya, H. I., & Pulendran, B. (2011) · Current Opinion in HIV and AIDS · doi:10.1097/coh.0b013e32834dc37b · Cited by 53
Utilizing toxicogenomic data to understand chemical mechanism of action in risk assessment
Wilson, V. S., Keshava, N., Hester, S., Segal, D., Chiu, W. A., Thompson, C. M., & Euling, S. Y. (2011) · Toxicology and Applied Pharmacology · doi:10.1016/j.taap.2011.01.017 · Cited by 57
Boja, E. S., Fehniger, T. E., Baker, M. S., Marko‐Varga, G., & Rodriguez, H. (2014) · Journal of Proteome Research · doi:10.1021/pr500753r · Cited by 53
Modeling risk stratification in human cancer
Reme, T. X., Hose, D., Theillet, C. G., & Klein, B. (2013) · Bioinformatics · doi:10.1093/bioinformatics/btt124 · Cited by 54
Multiple Myeloma DREAM Challenge reveals epigenetic regulator PHF19 as marker of aggressive disease
Mason, M. J., Schinke, C., Eng, C. L. P., Towfic, F., Gruber, F., Dervan, A., White, B. S., Pratapa, A., Guan, Y., Chen, H., et al. (2020) · Leukemia · doi:10.1038/s41375-020-0742-z · Cited by 52
Tokumaru, Y., Oshi, M., Katsuta, E., Yan, L., Huang, J. L., Nagahashi, M., Matsuhashi, N., Futamura, M., Yoshida, K., & Takabe, K. (2020) · International Journal of Molecular Sciences · doi:10.3390/ijms21165744 · Cited by 53
“We analyzed three independent neoadjuvant chemotherapy (NAC) cohorts that underwent different chemotherapy regimens; GSE25066 (n = 508; taxane and anthracycline) [44], GSE32646 (n = 115; 5-FU, epirubicin, cyclophosphamide, and paclitaxel) [45], and GSE20194 (n = 278; paclitaxel, 5-FU, cyclophosphamide and doxorubicin)…”
MethodЛи, Б., Shin, H., Gulbekyan, G., Pustovalova, O., Nikolsky, Y., Hope, A. J., Bessarabova, M., Schu, M. C., Kolpakova-Hart, E., Merberg, D., et al. (2015) · PLoS ONE · doi:10.1371/journal.pone.0130700 · Cited by 53
Applied metabolomics in drug discovery
Cuperlovic-Culf, M., & Culf, A. S. (2016) · Expert Opinion on Drug Discovery · doi:10.1080/17460441.2016.1195365 · Cited by 54
Radpour, R., Barekati, Z., Kohler, C., Schumacher, M. M., Grussenmeyer, T., Jenoe, P., Hartmann, N., Moes, S., Letzkus, M., Bitzer, J., et al. (2011) · PLoS ONE · doi:10.1371/journal.pone.0027355 · Cited by 52
Botta, C., Martino, M. T. D., Ciliberto, D., Cucè, M., Correale, P., Rossi, M., Tagliaferri, P., & Tassone, P. (2016) · Blood Cancer Journal · doi:10.1038/bcj.2016.118 · Cited by 54
Oshi, M., Tokumaru, Y., Angarita, F. A., Lee, L., Yan, L., Matsuyama, R., Endo, I., & Takabe, K. (2021) · Scientific Reports · doi:10.1038/s41598-021-91897-7 · Cited by 52
Metadata
- Authors
- MAQC Consortium
- Venue
- Nature Biotechnology
- Published
- 2010-07-30
- Volume
- 28
- Issue
- 8
- Pages
- 827-838
- ISSN
- 0733-222X (ISSN-L)
- 1087-0156
- 1546-1696
- PMC
- PMC3315840
- OpenAlex
- W2021560851
- Cited by
- 889
- References
- 63
- Citations by year
- 2026: 13 · 2025: 33 · 2024: 39 · 2023: 35 · 2022: 40 · 2021: 58 · 2020: 61 · 2019: 58 · 2018: 46 · 2017: 35 · 2016: 57 · 2015: 54 · 2014: 87 · 2013: 85 · 2012: 79
- FWCI
- 34.94
- Type
- journal article
- Language
- en
- Open access
- green
- www.ncbi.nlm.nih.gov
- Locations
- Nature Biotechnology (publishedVersion)
- PubMed (publishedVersion)
- Europe PMC (PubMed Central) (acceptedVersion)
- PubMed Central (acceptedVersion)
- Dépôt institutionnel de l'Université libre de Bruxelles (Université Libre de Bruxelles) (submittedVersion)
- Infoscience (Ecole Polytechnique Fédérale de Lausanne) (submittedVersion)
- Infoscience (Ecole Polytechnique Fédérale de Lausanne) (submittedVersion, cc-by-nc-nd)
- Institute of Process Engineering, CAS Institutional Repository (submittedVersion, cc-by-nc-sa)
- IRIS (submittedVersion)
- Repository of Futwangen University of Applied Sciences (Furtwangen University) (submittedVersion)
- SERVAL (Université de Lausanne) (submittedVersion)
- Funders
- National Institutes of Health (Z99 LM999999, Z99 HL999999, Z99 MH999999, Z99CL999999)
- National Cancer Institute (CA97513-01, CA55819-01A1, R00CA126184, P01CA055819, R33CA097513)
- National Institute of General Medical Sciences (T32GM074906, R01GM083084, R01GM083226, R01GM072611)
- National Center for Research Resources (R01RR021967)
- Topics
- Life Sciences › Biochemistry, Genetics and Molecular Biology › Molecular Biology › Gene expression and cancer classification
- Life Sciences › Biochemistry, Genetics and Molecular Biology › Cancer Research › Breast Cancer Treatment Studies
- Life Sciences › Pharmacology, Toxicology and Pharmaceutics › Drug Discovery › Computational Drug Discovery Methods
- Keywords
- microarray quality control, gene expression profiling, prediction model, genomic classifier, model validation, pulmonary toxicity, hepatotoxicity, breast cancer, multiple myeloma, neuroblastoma, rodent toxicity, method comparison, reproducibility
- MeSH terms
- Animals, Breast Neoplasms, Disease Models, Animal, Female, Humans, Liver Diseases, Lung Diseases, Multiple Myeloma, Neoplasms, Neuroblastoma, Predictive Value of Tests, Quality Control, Survival Analysis, Guidelines as Topic, Oligonucleotide Array Sequence Analysis, Gene Expression Profiling, Rats
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review