The MicroArray Quality Control (MAQC) project shows inter- and intraplatform reproducibility of gene expression measurements
Open accessThe DOI matches its Crossref record; 43 of the 43 references it cites were found in a registry or an index.
Abstract
Over the last decade, the introduction of microarray technology has had a profound impact on gene expression research. The publication of studies with dissimilar or altogether contradictory results, obtained using different microarray platforms to analyze identical RNA samples, has raised concerns about the reliability of this technology. The MicroArray Quality Control (MAQC) project was initiated to address these concerns, as well as other performance and data analysis issues. Expression data on four titration pools from two distinct reference RNA samples were generated at multiple test sites using a variety of microarray-based and alternative technology platforms. Here we describe the experimental design and probe mapping efforts behind the MAQC project. We show intraplatform consistency across test sites as well as a high level of interplatform concordance in terms of genes identified as differentially expressed. This study provides a resource that represents an important first step toward establishing a framework for the use of microarrays in clinical and regulatory settings.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Next, we applied the |log 2 fold-change|>1 filter advocated in the MAQC study on microarrays, 10 and for microarrays observed a reduction in the eFDR to below 1.5%, save for one outlier site (Figs 3c,d).”
From A comprehensive assessment of RNA-seq accuracy, reproducibility and information content by the Sequencing Quality Control Consortium (2014) · cites this paper as [10]
In the citing paper
“Studies on microarrays have shown that results of typical statistical differential expression tests thresholded by p -value need to be filtered and sorted by effect strength (fold-change) in order to attain robust comparisons across platforms and sites. 10”
From A comprehensive assessment of RNA-seq accuracy, reproducibility and information content by the Sequencing Quality Control Consortium (2014) · cites this paper as [10]
In the citing paper
“The Microarray Quality Control (MAQC) Consortium landmark study10 examined the degree of variance within and across many different microarray platforms and found similar coefficients of variation between platforms.”
From Multi-platform assessment of transcriptome profiling using RNA-seq in the ABRF next-generation sequencing study (2014) · cites this paper as [10]
In the citing paper
“prior work comparing microarray platforms and methods showed high levels of inter-platform concordance for the ability to detect differentially expressed genes.”
From Multi-platform assessment of transcriptome profiling using RNA-seq in the ABRF next-generation sequencing study (2014) · cites this paper as [10]
Citations
Cites
In silico prediction of protein-protein interactions in human macrophages
Souiai, O., Guerfali, F., Ben Miled, S., Brun, C., & Benkahla, A. (2014) · BMC Research Notes · doi:10.1186/1756-0500-7-157 · Cited by 10,803
Significance analysis of microarrays applied to the ionizing radiation response
Tusher, V. G., Tibshirani, R., & Chu, G. (2001) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.091062498 · Cited by 10,568
Pruitt, K. D., Tatusova, T., & Maglott, D. R. (2007) · Nucleic Acids Research · doi:10.1093/nar/gkl842 · Cited by 4,481 · cited 1×
“We mapped the probes (see Supplementary Methods online and Supplementary Notes online) to the RefSeq human mRNA databas”
Method"Stemness": Transcriptional Profiling of Embryonic and Adult Stem Cells
Ramalho-Santos, M., Yoon, S., Matsuzaki, Y., Mulligan, R. C., & Melton, D. A. (2002) · Science · doi:10.1126/science.1072530 · Cited by 1,709
Pruitt, K. D. (2004) · Nucleic Acids Research · doi:10.1093/nar/gki025 · Cited by 1,660 · cited 1×
“We mapped the probes (see Supplementary Methods online and Supplementary Notes online) to the RefSeq human mRNA database 31 (http://www.ncbi.nlm.nih.gov/RefSeq) and to the AceView database 32 (http://www.ncbi.nlm.nih.gov/IEB/Research/Acembly), a less curated but more comprehensive database, which…”
MethodA Stem Cell Molecular Signature
Ivanova, N. B., Dimos, J. T., Schaniel, C., Hackney, J. A., Moore, K. A., & Lemischka, I. R. (2002) · Science · doi:10.1126/science.1073823 · Cited by 1,542
Prediction of cancer outcome with microarrays: a multiple random validation strategy
Michiels, S., Koscielny, S., & Hill, C. (2005) · The Lancet · doi:10.1016/s0140-6736(05)17866-0 · Cited by 1,025 · cited 1×
“, raising doubts about the repeatability, reproducibility and comparability of microarray technolog”
BackgroundMultiple-laboratory comparison of microarray platforms
Irizarry, R. A., Warren, D., Spencer, F., Kim, I. F., Biswal, S., Frank, B. C., Gabrielson, E., Garcia, J. G. N., Geoghegan, J., Germino, G., et al. (2005) · Nature Methods · doi:10.1038/nmeth756 · Cited by 862
Self-citationEvaluation of gene expression measurements from commercial microarray platforms
Tan, P. K. (2003) · Nucleic Acids Research · doi:10.1093/nar/gkg763 · Cited by 706
Thousands of samples are needed to generate a robust gene list for predicting outcome in cancer
Ein-Dor, L., Zuk, O., & Domany, E. (2006) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0601231103 · Cited by 689 · cited 1×
“…to appear in peer-reviewed journals 9,10 , raising doubts about the repeatability, reproducibility and comparability of microarray technology 11–13 , several studies have also been recently published showing increased reproducibility of microarray data generated at different test sites and/or…”
Background
Research works printed but not linked: 1
- Reid, L.H. The value of a proficiency testing program to monitor performance in microarray laboratories. Pharm. Discov. 5, 20–25 (2005).
Cited by
Items 601–700 of 1,004
Microarray-Based Gene Expression Studies in Ovarian Cancer
Chon, H. S., & Lancaster, J. M. (2011) · Cancer Control · doi:10.1177/107327481101800102 · Cited by 47
Gene expression prediction using low-rank matrix completion
Kapur, A., Marwah, K., & Alterovitz, G. (2016) · BMC Bioinformatics · doi:10.1186/s12859-016-1106-6 · Cited by 47
Schuierer, S., & Roma, G. (2016) · Nucleic Acids Research · doi:10.1093/nar/gkw538 · Cited by 43
“…based on the UHRR and HBR samples: (i) these two samples have been extensively profiled and analyzed in the MicroArray and the RNA SEQC initiatives (36); (ii) RNA-seq data for these samples were previously used for comparison in the publication of different RNA-seq quantification tools (14) as…”
MethodImpact of RNA degradation on fusion detection by RNA-seq
Davila, J. I., Fadra, N., Wang, X., McDonald, A. M., Nair, A., Barbara, R. C., Wu, X., Blommel, J. H., Jen, J., Rumilla, K. M., et al. (2016) · BMC Genomics · doi:10.1186/s12864-016-3161-9 · Cited by 42
“To do this we utilized RNA isolated from the KU812 tumor cell line [21] and the Universal Human Reference (UHR) RNA tumor samples [22] and experimentally degraded the RNA in these samples to different RNA Integrity Number (RIN) [23] values.”
BackgroundMethodPrahm, K. P., Høgdall, C. K., Karlsen, M. A., Christensen, I. J., Novotny, G. W., & Høgdall, E. V. S. (2018) · PLoS ONE · doi:10.1371/journal.pone.0207319 · Cited by 47
“And the FDA has developed the MicroArray Quality Control (MAQC) to establish standards and quality measures for microarray and next-generation sequences technologies to ensure successful and reliable methods that can be used in clinical practice, and regulatory decision-making [62].”
MethodShambhala: a platform-agnostic data harmonizer for gene expression data
Borisov, N. M., Shabalina, I., Tkachev, V., Sorokin, M., Garazha, A., Pulin, A. A., Eremin, I. I., & Buzdin, A. A. (2019) · BMC Bioinformatics · doi:10.1186/s12859-019-2641-8 · Cited by 46
“ence definitive dataset, and the MAQC [26] and SEQC [27] datasets for validation of Shambhala algorithm.”
BackgroundMethodInfluentialEvidence that human blastomere cleavage is under unique cell cycle control
Kiessling, A. A., Bletsa, R., Desmarais, B., Mara, C., Kallianidis, K., & Loutradis, D. (2009) · Journal of Assisted Reproduction and Genetics · doi:10.1007/s10815-009-9306-x · Cited by 45
“RTPCR verification revealed complete agreement with the microarrays, in keeping with results reported by the MicroArray Quality Control (MAQC) Project [11].”
ResultAccounting for non-genetic factors by low-rank representation and sparse regression for eQTL mapping
Yang, C., Wang, L., Zhang, S., & Zhao, H. (2013) · Bioinformatics · doi:10.1093/bioinformatics/btt075 · Cited by 42
“Gagnon-Bartsch and Speed (2012) reported that a substantial within-batch effect exists in the Microarray Quality Control study (Shi et al., 2006).”
BackgroundMonsurrò, V., Beghelli, S., Wang, R., Barbi, S., Coin, S., Pasquale, G. D., Bersani, S., Castellucci, M., Sorio, C., Eleuteri, S., et al. (2010) · Journal of Translational Medicine · doi:10.1186/1479-5876-8-10 · Cited by 47
“This low threshold of significance was selected to include all genes of potential relevance for pathways analysis [25,26].”
BackgroundSystems biology of facial development: contributions of ectoderm and mesenchyme
Hooper, J. E., Feng, W., Li, H., Leach, S. M., Phang, T., Siska, C., Jones, K. L., Spritz, R. A., Hunter, L., & Williams, T. (2017) · Developmental Biology · doi:10.1016/j.ydbio.2017.03.025 · Cited by 43
Genomic Biomarkers for Personalized Medicine: Development and Validation in Clinical Studies
Matsui, S. (2013) · Computational and Mathematical Methods in Medicine · doi:10.1155/2013/865980 · Cited by 49
Stansberg, C. T., Vik‐Mo, A. O., Holdhus, R., Breilid, H., Srebro, B., Petersen, K., Jørgensen, H. A., Jonassen, I., & Steen, V. M. (2007) · BMC Genomics · doi:10.1186/1471-2164-8-94 · Cited by 42
Kim, S., Lin, C., & Tseng, G. C. (2016) · Bioinformatics · doi:10.1093/bioinformatics/btw115 · Cited by 41
Trück, J., Eugster, A., Barennes, P., Tipton, C. M., Prak, E. T. L., Bagnara, D., Soto, C. S., Sherkow, J. S., Payne, A. S., Lefranc, M., et al. (2021) · eLife · doi:10.7554/elife.66274 · Cited by 41
RSEM: Accurate Transcript Quantification from RNA-Seq Data With or Without a Reference Genome
Li, B., & Dewey, C. N. (2014) · Apple Academic Press eBooks · doi:10.1201/b16589-5 · Cited by 58
Yu, Y., Hou, W., Liu, Y., Wang, H., Dong, L., Mai, Y., Chen, Q., Li, Z., Sun, S., Yang, J., et al. (2023) · Nature Biotechnology · doi:10.1038/s41587-023-01867-9 · Cited by 48
“The MicroArray/Sequencing Quality Control (MAQC/SEQC) consortia previously established two publicly available transcriptome-wide RNA reference materials that are derived from 10 cancer cell lines and brain tissues of 23 donors 15 .”
BackgroundMethodResultInfluentialSelf-citationOzaki, N., Matheis, K. A., Gamber, M., Feidl, T., Nolte, T., Kalkuhl, A., & Deschl, U. (2009) · Experimental and Toxicologic Pathology · doi:10.1016/j.etp.2009.07.004 · Cited by 41
“This approach using a combination of a p-value cut-off with a fold change cut-off was chosen based on the results of the Micro Array Quality Control Consortium (Shi et al., 2006).”
MethodJennen, D. G. J., Gaj, S., Giesbertz, P., van Delft, J. H. M., Evelo, C. T., & Kleinjans, J. C. S. (2010) · Drug Discovery Today · doi:10.1016/j.drudis.2010.08.002 · Cited by 41
Making a new technology work: the standardization and regulation of microarrays.
Rogers, S. E., & Cambrosio, A. (2007) · PubMed Central · Cited by 41
IGF-1 signaling reduces neuro-inflammatory response and sensitivity of neurons to MPTP
Nadjar, A., Berton, O., Guo, S., Leneuve, P., Doveró, S., Diguet, E., Tison, F., Zhao, B., Holzenberger, M., & Bézard, E. (2008) · Neurobiology of Aging · doi:10.1016/j.neurobiolaging.2008.02.009 · Cited by 41
The path to routine use of genomic biomarkers in the cancer clinic
Boutros, P. C. (2015) · Genome Research · doi:10.1101/gr.191114.115 · Cited by 40
“For example, several studies of microarray processing techniques have yielded discordant results (Shedden et al. 2005; Shi et al. 2005, 2006, 2010; Canales et al. 2006; Zhu et al. 2010).”
Goetz, A. K., Singh, B., Battalora, M., Breier, J. M., Bailey, J. P., Chukwudebe, A. C., & Janus, E. R. (2011) · Regulatory Toxicology and Pharmacology · doi:10.1016/j.yrtph.2011.07.012 · Cited by 41
Currie, R. A., Peffer, R. C., Goetz, A. K., Omiecinski, C. J., & Goodman, J. I. (2014) · Toxicology · doi:10.1016/j.tox.2014.03.003 · Cited by 40
McDonough, A., Noor, S., Lee, R. V., Dodge, R. E., Strosnider, J. S., Shen, J., Davidson, S., Möller, T., Garden, G. A., & Weinstein, J. R. (2019) · Glia · doi:10.1002/glia.23701 · Cited by 43
“We selected genes based on an unadjusted p .05 as well as a 1.5-fold difference in expression based on the recommendations of theMAQC consortium (Shi et al., 2006) and carried out bioinformatic analysis using ingenuity pathway analysis (IPA), a web-based application for data analysis in pathway…”
MethodInfluentialAlameer, A., & Chicco, D. (2021) · Bioinformatics · doi:10.1093/bioinformatics/btab852 · Cited by 43
Lintner, R. E., Mishra, P. K., Srivastava, P., Martínez-Vaz, B. M., Khodursky, A. B., & Blumenthal, R. (2008) · BMC Microbiology · doi:10.1186/1471-2180-8-60 · Cited by 40
Ray, M., Dharmarajan, S., Freudenberg, J., Zhang, W., & Patterson, G. A. (2007) · American Journal of Transplantation · doi:10.1111/j.1600-6143.2007.01918.x · Cited by 40
“As suggested by the recent articles in Nature Biotechnology by the MicroArray Quality Control (MAQC) project (33), it s better to focus on pathways and broad functional relationships, rather than on indi vidual genes.”
BackgroundGene selection with multiple ordering criteria
Chen, J. J., Tsai, C., Tzeng, S., & Chen, C. (2007) · BMC Bioinformatics · doi:10.1186/1471-2105-8-74 · Cited by 44
Self-citationThe incredible shrinking world of DNA microarrays
Wheelan, S. J., Murillo, F., & Boeke, J. D. (2008) · Molecular BioSystems · doi:10.1039/b706237k · Cited by 46
Pradeep, C.-R., Zeisel, A., Köstler, W. J., Lauriola, M., Jacob‐Hirsch, J., Haibe‐Kains, B., Amariglio, N., Ben‐Chetrit, N., Emde, A., Solomonov, I., et al. (2011) · Oncogene · doi:10.1038/onc.2011.547 · Cited by 40
“Hybridization probes were mapped to Entrez GeneID as described (Shi et al., 2006).”
Zhu, Q., Miecznikowski, J. C., & Halfon, M. S. (2010) · BMC Bioinformatics · doi:10.1186/1471-2105-11-285 · Cited by 42
Fiebig, H., Schüler, J. B., Bausch, N., Hofmann, M., Metz, T. M., & Korrat, A. (2007) · PubMed · Cited by 39
Laßmann, S., Kreutz, C., Schöpflin, A., Hopt, U. T., Timmer, J., & Werner, M. (2008) · Journal of Molecular Medicine · doi:10.1007/s00109-008-0419-y · Cited by 43
“With technical diversity and associated methodological advances, standardization of microarray analysis has become a pre-requisite for integrating this technique into a clinical setting [2–5].”
BackgroundMethodLiterature-based priors for gene regulatory networks
Steele, E., Tucker, A., Hoen, P. A. C. ’., & Schuemie, M. J. (2009) · Bioinformatics · doi:10.1093/bioinformatics/btp277 · Cited by 47
Guan, Q., Yan, H., Chen, Y., Zheng, B., Cai, H., He, J., Song, K., Guo, Y., Ao, L., Liu, H., et al. (2018) · BMC Genomics · doi:10.1186/s12864-018-4446-y · Cited by 42
“As reported by the MicroArray Quality Control (MAQC) project [24], for the high-throughput microarray platforms, the median values of coefficient of variation (CV) of gene expression levels in replicate samples measured by the same platforms ranged from 5 to 15% within the same test sites and became 10 to 20% for repl…”
InfluentialHDAC2-dependent Antipsychotic-like Effects of Chronic Treatment with the HDAC Inhibitor SAHA in Mice
Revenga, M. D. L. F., Ibi, D., Saunders, J. M., Cuddy, T., Ijaz, M. K., Toneatti, R., Kurita, M., Holloway, T. D., Shen, L., Seto, J., et al. (2018) · Neuroscience · doi:10.1016/j.neuroscience.2018.07.010 · Cited by 44
Beger, R. D. (2018) · Metabolomics · doi:10.1007/s11306-018-1453-6 · Cited by 39
Palomares, M.-A., Dalmasso, C., Bonnet, É., Derbois, C., Brohard, S., Ambroise, C., Battail, C., Deleuze, J., & Olaso, R. (2019) · Scientific Reports · doi:10.1038/s41598-019-43983-0 · Cited by 40
Pariset, L., Chillemi, G., Bongiorni, S., Spica, V. R., & Valentini, A. (2009) · New Biotechnology · doi:10.1016/j.nbt.2009.03.013 · Cited by 41
Upregulated expression of S100A6 in human gastric cancer
Yang, Y., ZHANG, L. J., Dong, H., JIANG, C. L., Zhu, Z., Jian Xin, W. U., Wu, Y., Han, J., Xiao, H., Heng Jun, G. A. O., et al. (2007) · Journal of Digestive Diseases · doi:10.1111/j.1751-2980.2007.00311.x · Cited by 39
Self-citationAdvances of genomic science and systems biology in renal transplantation: a review
Perkins, D. L., Verma, M., & Park, K. J. (2011) · Seminars in Immunopathology · doi:10.1007/s00281-011-0243-2 · Cited by 42
“The MicroArray Quality Control project evaluated multiple test sites and alternative technology platforms [14].”
MethodS100A proteins in the pathogenesis of experimental corneal neovascularization.
Li, C., Zhang, F., & Wang, Y. (2010) · PubMed Central · Cited by 39
Self-citationRen, S., Zhang, F., Li, C., Jia, C., Li, S., Xi, H., Zhang, H., Yang, L., & Wang, Y. (2010) · PubMed Central · Cited by 39
Self-citationFrom biomarker strategies to biomarker activities and back
van Gool, A. J., Henry, B., & Sprengers, E. D. (2009) · Drug Discovery Today · doi:10.1016/j.drudis.2009.11.004 · Cited by 42
PhyloOncology: Understanding cancer through phylogenetic analysis
Somarelli, J. A., Ware, K. E., Kostadinov, R. L., Robinson, J. M., Amri, H., Abu-Asab, M. S., Fourie, N. H., Diogo, R., Swofford, D. L., & Townsend, J. P. (2016) · Biochimica et Biophysica Acta (BBA) - Reviews on Cancer · doi:10.1016/j.bbcan.2016.10.006 · Cited by 40
Expression Profiling Using Affymetrix GeneChip Microarrays
Auer, H., Newsom, D. L., & Kornacker, K. (2009) · Methods in molecular biology · doi:10.1007/978-1-59745-372-1_3 · Cited by 39
Kochzius, M. (2009) · Springer eBooks · doi:10.1007/978-1-4020-9210-7_24 · Cited by 41
“However, the different microarray platforms are still error prone and quantification is difficult (Shi et al. 2006).”
BackgroundReference Materials for Improving Reliability of Multiomics Profiling
Ren, L., Shi, L. M., & Zheng, Y. (2024) · Phenomics · doi:10.1007/s43657-023-00153-7 · Cited by 40
Self-citationLopez, F., Textoris, J., Bergon, A., Didier, G., Rémy, É., Granjeaud, S., Imbert, J., Nguyen, C., & Puthier, D. (2008) · PLoS ONE · doi:10.1371/journal.pone.0004001 · Cited by 38
“The current release of the database already contains data obtained using other commercial (e.g. Agilent, Illumina Inc., GE Healthcare, Applied Biosystems, Panomics, CapitalBio Corporation, TeleChem ArrayIt, Mergen-LTD, Eppendorf Array Technologies) and non commercial platforms (e.g. National Cancer Institute, Vanderbi…”
BackgroundHu, Y., Liu, Y., Mao, X., Cheng, J., Ferguson, J. F., Xue, C., Reilly, M. P., Li, H., & Li, M. (2013) · Nucleic Acids Research · doi:10.1093/nar/gkt1304 · Cited by 41
“To evaluate the performance of PennSeq in real studies, we analyzed the Human Brain Reference (HBR) and the Universal Human Reference (UHR) RNA-Seq data sets from the MicroArray Quality Control (MAQC) project (28).”
MethodSelf-citationNovel Insights into Adipogenesis from Omics Data
Prokesch, A., Hackl, H., Hakim-Weber, R., Bornstein, S. R., & Trajanoski, Z. (2009) · Current Medicinal Chemistry · doi:10.2174/092986709788803132 · Cited by 41
“An exhaustive analysis and comparison of commonly used microarray platforms by a multicenter consortium (MAQC) showed - contrary to earlier reports [37,38] - acceptable concordance between the platforms [39]; however, there is a necessity for careful control of biological samples and close adherence to standard protoc…”
Analysis of the transcriptome in molecular epidemiology studies
McHale, C. M., Zhang, L., Thomas, R., & Smith, M. T. (2013) · Environmental and Molecular Mutagenesis · doi:10.1002/em.21798 · Cited by 43
“…control practices designed to overcome biases and experimental variability and to validate the technology and data analysis in risk assessment have been developed by the MicroArray Quality Control (MAQC) Consortium and have been widely accepted by the scientific community [Shi et al., 2006, 2010].”
MethodSelf-citationInternational Standards for Genomes, Transcriptomes, and Metagenomes
Mason, C. E., Afshinnekoo, E., Tighe, S. W., Wu, S., & Levy, S. (2017) · Journal of Biomolecular Techniques JBT · doi:10.7171/jbt.17-2801-006 · Cited by 41
Self-citationBayesian multistudy factor analysis for high-throughput biological data
Vito, R. D., Bellio, R., Trippa, L., & Parmigiani, G. (2021) · The Annals of Applied Statistics · doi:10.1214/21-aoas1456 · Cited by 62
“In gene expression, for example, large systematic differences arising from different laboratories or technological platforms have been long recognized (Irizarry et al., 2003, Shi et al., 2006, Kerr, 2007).”
BackgroundIndependent component analysis recovers consistent regulatory signals from disparate datasets
Sastry, A. V., Hu, A., Heckmann, D., Poudel, S., Kavvas, E. S., & Palsson, B. Ø. (2021) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1008647 · Cited by 44
Gong, B., Li, D., Kusko, R. L., Novoradovskaya, N., Zhang, Y., Wang, S., Pabón-Peña, C., Zhang, Z., Lai, K., Cai, W., et al. (2021) · Genome biology · doi:10.1186/s13059-021-02315-0 · Cited by 42
Self-citationNault, R., Fader, K. A., & Zacharewski, T. R. (2015) · BMC Genomics · doi:10.1186/s12864-015-1527-z · Cited by 40
“As regulatory agencies and researchers struggle to incorporate omic data into decision-making and research applications, the technology continues to evolve requiring the verification of reproducibility, reliability, and continuity [16,25].”
BackgroundMethodCastro‐Ferreira, M. P., de Boer, T. E., Colbourne, J. K., Vooijs, R., van Gestel, C. A. M., van Straalen, N. M., Soares, A. M. V. M., Amorim, M. J. B., & Roelofs, D. (2014) · BMC Genomics · doi:10.1186/1471-2164-15-302 · Cited by 38
“However, more recently, the microarray quality control consortium provided such standardization and cross-validation data specifically for microarray platforms [41,42].”
BackgroundUnraveling the Role of FOXQ1 in Colorectal Cancer Metastasis
Abba, M. L., Patil, N., Rasheed, S. A. K., Nelson, L. D., Mudduluru, G., Leupold, J. H., & Allgayer, H. (2013) · Molecular Cancer Research · doi:10.1158/1541-7786.mcr-13-0024 · Cited by 38
“The MAQC project generated a data set which compared the consistency of microarray data between laboratories and across platforms (28), and which supports our findings in patients with colorectal cancer.”
ResultHori, H., Sasayama, D., Teraishi, T., Yamamoto, N., Nakamura, S., Ota, M., Hattori, K., Kim, Y., Higuchi, T., & Kunugi, H. (2016) · Scientific Reports · doi:10.1038/srep18776 · Cited by 41
CCCTC-Binding Factor Confines the Distal Action of Estrogen Receptor
Chan, C. S., & Song, J. S. (2008) · Cancer Research · doi:10.1158/0008-5472.can-08-2632 · Cited by 37
“In contrast, ranking genes by fold change has been shown to correlate well with results from quantitative PCR validations and to yield a robust framework for comparing different experimental studies (15).”
BackgroundResultAffinity‐based microarrays for proteomic analysis of cancer tissues
Hoheisel, J. D., Alhamdani, M. S. S., & Schröder, C. (2012) · PROTEOMICS - CLINICAL APPLICATIONS · doi:10.1002/prca.201200114 · Cited by 37
“Established assay processes [11, 19, 20] produce antibody microarrays of intra- and inter-array variation that are similar or even superior to the quality reported for commercial DNA-microarray platforms that have been approved for clinical applications [21].”
BackgroundMathijs, K., Brauers, K. J. J., Jennen, D. G. J., Lizárraga, D., Kleinjans, J. C. S., & van Delft, J. H. M. (2010) · Mutagenesis · doi:10.1093/mutage/geq040 · Cited by 37
de Crémoux, P., Valet, F., Gentien, D., Lehmann‐Che, J., Scott, V., Tran‐Perennou, C., Barbaroux, C., Servant, N., Vacher, S., Sigal‐Zafrani, B., et al. (2011) · BMC Cancer · doi:10.1186/1471-2407-11-215 · Cited by 37
“Experimental replicates (MAQC A sample, Universal Human Reference RNA, Stratagene, 740000-41) were included from the first step in each batch of target preparation to evaluate the reproducibility and batch effect of the whole RNA processing procedure [5].”
MethodGómez‐Carballa, A., Cebey‐López, M., Pardo‐Seco, J., Barral‐Arca, R., Calle, I. R., Pischedda, S., Currás-Tuala, M. J., Rial, J. G., Barros, F., Martinón‐Torres, F., et al. (2019) · Scientific Reports · doi:10.1038/s41598-019-48162-9 · Cited by 41
Wargodsky, R., Cruz, P. D., Lafleur, J., Yamane, D. P., Kim, J. S., Benjenk, I., Heinz, E. R., Irondi, O. O., Farrar, K., Toma, I., et al. (2022) · PLoS ONE · doi:10.1371/journal.pone.0261679 · Cited by 41
“This approach has been shown to be accurate in identifying spiked ‘true’ DEGs in prior studies [13].”
ResultHockley, S. L., Mathijs, K., Staal, Y. C. M., Brewer, D. S., Giddings, I., van Delft, J. H. M., & Phillips, D. H. (2009) · OMICS A Journal of Integrative Biology · doi:10.1089/omi.2008.0060 · Cited by 37
“More recently, results have been published from the comprehensive Mi-croArray Quality Control (MAQC) project (Guo et al., 2006; Shi et al., 2006).”
A Bayesian Model for Cross-Study Differential Gene Expression
Scharpf, R. B., Tjelmeland, H., Parmigiani, G., & Nobel, A. B. (2009) · Journal of the American Statistical Association · doi:10.1198/jasa.2009.ap07611 · Cited by 44
Wang, R., Biales, A. D., Bencic, D. C., Lattier, D. L., Kostich, M. S., Villeneuve, D. L., Ankley, G. T., Lazorchak, J., & Toth, G. P. (2007) · Environmental Toxicology and Chemistry · doi:10.1897/07-191.1 · Cited by 37
Ribas, L., Crespo, B., Sánchez-Baizán, N., Xavier, D., Kuhl, H., Rodríguez, J. M., Díaz, N., Boltaña, S., MacKenzie, S. A., Morán, F., et al. (2019) · Marine Biotechnology · doi:10.1007/s10126-019-09886-x · Cited by 39
ArrayWiki: an enabling technology for sharing public microarray data repositories and meta-analyses
Stokes, T. H., Torrance, J., Li, H., & Wang, M. D. (2008) · BMC Bioinformatics · doi:10.1186/1471-2105-9-s6-s18 · Cited by 39
“The United States Food and Drug Administration (FDA) recently completed a large-scale evaluation of microarray data quality [5].”
BackgroundRobinson, J. F., Theunissen, P. T., van Dartel, D. A. M., Pennings, J. L. A., Faustman, E. M., & Piersma, A. H. (2011) · Reproductive Toxicology · doi:10.1016/j.reprotox.2011.05.011 · Cited by 40
Marinković, M., de Leeuw, W. C., de Jong, M., Kraak, M. H. S., Admiraal, W. A., Breit, T. M., & Jonker, M. J. (2012) · PLoS ONE · doi:10.1371/journal.pone.0048096 · Cited by 36
Boone, D. R., Micci, M., Taglialatela, I. G., Hellmich, J. L., Weisz, H. A., Bi, M., Prough, D. S., DeWitt, D. S., & Hellmich, H. L. (2015) · PLoS ONE · doi:10.1371/journal.pone.0127287 · Cited by 38
Graphene field-effect transistors: the road to bioelectronics
Donnelly, M. J., Mao, D., Park, J., & Xu, G. (2018) · Journal of Physics D Applied Physics · doi:10.1088/1361-6463/aadcca · Cited by 38
Rai, M. F., Tycksen, E., Cai, L., Yu, J., Wright, R. W., & Brophy, R. H. (2019) · Osteoarthritis and Cartilage · doi:10.1016/j.joca.2019.02.792 · Cited by 38
Ying, L., & Sarwal, M. (2008) · Pediatric Nephrology · doi:10.1007/s00467-008-0808-z · Cited by 36
The Cell Wall-Targeting Antibiotic Stimulon of Enterococcus faecalis
Abranches, J., Tijerina, P., Avilés-Reyes, A., Gaca, A. O., Kajfasz, J. K., & Lemos, J. A. C. (2013) · PLoS ONE · doi:10.1371/journal.pone.0064875 · Cited by 36
“The benefits of the use of a reference RNA as a normalization tool in microarray studies is detailed elsewhere [54].”
MethodSaito, S., Ojima, H., Ichikawa, H., Hirohashi, S., & Kondo, T. (2008) · Cancer Science · doi:10.1111/j.1349-7006.2008.00973.x · Cited by 38
Enkhbaatar, P., Nelson, C., Salsbury, J. R., Carmical, J. R., Torres, K. E. O., Herndon, D. N., Prough, D. S., Luan, L., & Sherwood, E. R. (2015) · PLoS ONE · doi:10.1371/journal.pone.0144345 · Cited by 40
“The p-value and stringency were chosen based on recommendations from the MAQC study [22, 23].”
MethodPearson, R. D. (2008) · BMC Bioinformatics · doi:10.1186/1471-2105-9-164 · Cited by 36
“More recently, the MicroArray Quality Control (MAQC) study [ 3 ] has developed a large number of reference data sets.”
BackgroundGene expression variation increase in trisomy 21 tissues
Chou, C., Liu, L.-Y. D., Chen, C., Tsai, C. H., Hwa, H., Chang, L. Y., Lin, Y. S., & Hsieh, F. J. (2008) · Mammalian Genome · doi:10.1007/s00335-008-9121-1 · Cited by 38
“Saran et al. (2003) performed principal-components analysis on 12 microarray chips (3 Down syndrome mouse with duplicates and 3 euploid mouse with duplicates).”
BackgroundMethodExon level integration of proteomics and microarray data
Bitton, D. A., Okoniewski, M. J., Connolly, Y., & Miller, C. J. (2008) · BMC Bioinformatics · doi:10.1186/1471-2105-9-118 · Cited by 36
“These have highlighted the importance of filtering to remove data with poor signal to noise ratio, and the need to restrict comparisons to those pairs of reporters that target the same transcript location [5-7].”
BackgroundA merged lung cancer transcriptome dataset for clinical predictive modeling
Lim, S. B., Tan, S. J., Lim, W., & Lim, C. T. (2018) · Scientific Data · doi:10.1038/sdata.2018.136 · Cited by 36
Mieczkowski, J., Tyburczy, M. E., Dąbrowski, M., & Pokarowski, P. (2010) · BMC Bioinformatics · doi:10.1186/1471-2105-11-104 · Cited by 35
“For the NerdErd [22], Strain [23], AgeWT [12], and Maqc_CD [26] data sets, we analyzed only one contrast selected from the original multifactorial data.”
MethodInfluentialA note on oligonucleotide expression values not being normally distributed
Hardin, J., & Wilson, J. (2009) · Biostatistics · doi:10.1093/biostatistics/kxp003 · Cited by 35
“The report concludes that, “the variations seen in Figure 2 and Table 1 can also result from differences ... [in] levels of noise in each measurement” (MAQC Consortium, 2006b).”
BackgroundAtanasova, L., Gruber, S. G., Lichius, A., Radebner, T., Abendstein, L., Münsterkötter, M., Stralis‐Pavese, N., Łabaj, P. P., Kreil, D. P., & Zeilinger, S. (2018) · Scientific Reports · doi:10.1038/s41598-018-30500-y · Cited by 38
Transcriptomic Harmonization as the Way for Suppressing Cross-Platform Bias and Batch Effect
Borisov, N. M., & Buzdin, A. A. (2022) · Biomedicines · doi:10.3390/biomedicines10092318 · Cited by 35
High-Throughput Approaches for MicroRNA Expression Analysis
Dedeoğlu, B. G. (2013) · Methods in molecular biology · doi:10.1007/978-1-62703-748-8_6 · Cited by 38
Xiang, G., Pan, L., Xing, W., Zhang, L., Huang, L., Yu, J., Zhang, R., Wu, J., Cheng, J., & Zhou, Y. (2007) · Journal of Cellular Physiology · doi:10.1002/jcp.21008 · Cited by 38
“…phenomena, including induction of synaptic plasticity (Pike et al., 1999), selective communication between neurons (Izhikevich et al., 2003), dysfunctional states such as epileptic seizures (McCormick and Contreras, 2001), and even for sensory information transmission (Krahe and Gabbiani, 2004).”
BackgroundSelf-citationAmbroise, J., Bearzatto, B., Robert, A. R., Govaerts, B. B., Macq, B. M. M., & Gala, J. (2011) · BMC Bioinformatics · doi:10.1186/1471-2105-12-413 · Cited by 35
“These two successive preprocessing steps were assessed on datasets generated with two spotted microarray platforms (Duachip from Eppendorf and Codelink from GE Healthcare) as well as with a quantitative PCR platform (Taqman) from the MicroArray Quality Control (MAQC) project [19].”
MethodPradervand, S., Paillusson, A., Thomas, J., Weber, J., Wirapati, P., Hagenbüchle, O., & Harshman, K. (2008) · BioTechniques · doi:10.2144/000112751 · Cited by 35
Statistics in the World of Medical Devices: The Contrast with Pharmaceuticals
Campbell, G. (2007) · Journal of Biopharmaceutical Statistics · doi:10.1080/10543400701668225 · Cited by 38
“The results of the first phase of this project have been published (Shi et al., 2006) and concern the repeatability and reproducibility of the signals from microarray experiments.”
BackgroundOncogenic KRAS activates an embryonic stem cell-like program in human colon cancer initiation
Rolle, A.-F. L., Chiu, T. K., Zeng, Z., Shia, J., Weiser, M. R., Paty, P. B., & Chiu, V. K. (2016) · Oncotarget · doi:10.18632/oncotarget.6818 · Cited by 36
“We compared coherent transcriptional changes at the signature-level to identify specific patterns that were otherwise too variable to discern when considering expression profiles of individual genes [17].”
Painter, H. J., Altenhofen, L. M., Kafsack, B. F. C., & Llinás, M. (2012) · Methods in molecular biology · doi:10.1007/978-1-62703-026-7_14 · Cited by 35
Sreenivasulu, N., Sunkar, R., Wobus, U., & Marc Strickert, A. (2010) · Methods in molecular biology · doi:10.1007/978-1-60761-702-0_5 · Cited by 36
Shridhar, S., Klanert, G., Auer, N., Hernandez-Lopez, I., Kańduła, M. M., Hackl, M., Grillari, J., Stralis‐Pavese, N., Kreil, D. P., & Borth, N. (2017) · Journal of Biotechnology · doi:10.1016/j.jbiotec.2017.03.012 · Cited by 38
Expression profiling of human glial precursors
Campanelli, J. T., Sandrock, R. W., Wheatley, W., Xue, H., Zheng, J., Liang, F., Chesnut, J. D., Zhan, M., Rao, M. S., & Liu, Y. M. (2008) · BMC Developmental Biology · doi:10.1186/1471-213x-8-102 · Cited by 34
“We chose the Illumina array platform because it has been proven to be reliable, highly sensitive and cost effective [22,24,29].”
Self-citationWang, Y., Li, Y., Fan, X., Zhang, Y., Wu, J., & Zhao, Z. (2010) · Archives of Oral Biology · doi:10.1016/j.archoralbio.2010.09.009 · Cited by 35
Self-citationSaito, S., Onuma, Y., Ito, Y., Tateno, H., Toyoda, M., Akutsu, H., Nishino, K., Chikazawa, E., Fukawatase, Y., Miyagawa, Y., et al. (2011) · BMC Systems Biology · doi:10.1186/1752-0509-5-s1-s17 · Cited by 34
Metadata
- Authors
- MAQC Consortium, Shi, L., Shi, L., Reid, L. H., Jones, W. D., Shippy, R., Warrington, J. A., Baker, S. C., Collins, P. J., de Longueville, F., Kawasaki, E. S., Lee, K. Y., Luo, Y., Sun, Y. A., Willey, J. C., Setterquist, R. A., Fischer, G. M., Tong, W., Dragan, Y. P., Dix, D. J., Frueh, F. W., Goodsaid, F. M., Herman, D., Jensen, R. V., Johnson, C. D., Lobenhofer, E. K., Puri, R. K., Scherf, U., Thierry-Mieg, J., Wang, C., Wilson, M., Wolber, P. K., Zhang, L., Amur, S., Bao, W., Barbacioru, C. C., Lucas, A. B., Bertholet, V., Boysen, C., Bromley, B., Brown, D., Brunner, A., Canales, R., Cao, X. M., Cebula, T. A., Chen, J. J., Cheng, J., Chu, T.-M., Chudin, E., Corson, J., Corton, J. C., Croner, L. J., Davies, C., Davison, T. S., Delenstarr, G., Deng, X., Dorris, D., Eklund, A. C., Fan, X.-H., Fang, H., Fulmer-Smentek, S., Fuscoe, J. C., Gallagher, K., Ge, W., Guo, L., Guo, X., Hager, J., Haje, P. K., Han, J., Han, T., Harbottle, H. C., Harris, S. C., Hatchwell, E., Hauser, C. A., Hester, S., Hong, H., Hurban, P., Jackson, S. A., Ji, H., Knight, C. R., Kuo, W. P., LeClerc, J. E., Levy, S., Li, Q.-Z., Liu, C., Liu, Y., Lombardi, M. J., Ma, Y., Magnuson, S. R., Maqsodi, B., McDaniel, T., Mei, N., Myklebost, O., Ning, B., Novoradovskaya, N., Orr, M. S., Osborn, T. W., Papallo, A., Patterson, T. A., Perkins, R. G., Peters, E. H., Peterson, R., Philips, K. L., Pine, P. S., Pusztai, L., Qian, F., Ren, H., Rosen, M., Rosenzweig, B. A., Samaha, R. R., Schena, M., Schroth, G. P., Shchegrova, S., Smith, D. D., Staedtler, F., Su, Z., Sun, H., Szallasi, Z., Tezak, Z., Thierry-Mieg, D., Thompson, K. L., Tikhonova, I., Turpaz, Y., Vallanat, B., Van, C., Walker, S. J., Wang, S. J., Wang, Y., Wolfinger, R., Wong, A., Wu, J., Xiao, C., Xie, Q., Xu, J., Yang, W., Zhang, L., Zhong, S., Zong, Y., & Slikker, W.
- Affiliations
- Affymetrix (United States) (US)
- Illumina (United States) (US)
- Agilent Technologies (United States) (US)
- National Cancer Institute (US)
- National Center for Toxicological Research (US)
- Environmental Protection Agency (US)
- United States Food and Drug Administration (US)
- National Institutes of Health (US)
- University of Massachusetts Boston (US)
- Asuragen (United States) (US)
- Center for Biologics Evaluation and Research (US)
- Cedars-Sinai Medical Center (US)
- SAS Institute (United States) (US)
- Center for Food Safety and Applied Nutrition (US)
- Biogen (United States) (US)
- Yale University (US)
- Center for Veterinary Medicine (US)
- Cold Spring Harbor Laboratory (US)
- Sanford Burnham Prebys Medical Discovery Institute (US)
- Stanford Medicine (US)
- Harvard University (US)
- Vanderbilt University (US)
- The University of Texas Southwestern Medical Center (US)
- The University of Texas at Dallas (US)
- GenUs BioSystems (United States) (US)
- Oslo University Hospital (NO)
- The University of Texas MD Anderson Cancer Center (US)
- Luminex (United States) (US)
- Wake Forest University Health Sciences (US)
- University of Illinois Urbana-Champaign (US)
- ORCID
- Jones, Wendell D
- Collins, Patrick J
- Luo, Yuling
- Sun, Yongming Andrew
- Willey, James C
- Tong, Weida
- Frueh, Felix W
- Goodsaid, Federico M
- Johnson, Charles D
- Puri, Raj K
- Scherf, Uwe
- Wang, Charles
- Bao, Wenjun
- Brown, Donna
- Chen, James J
- Cheng, Jing
- Corton, J Christopher
- Croner, Lisa J
- Deng, Xutao
- Eklund, Aron C
- Fang, Hong
- Guo, Lei
- Guo, Xu
- Han, Jing
- Han, Tao
- Harbottle, Heather C
- Harris, Stephen C
- Hatchwell, Eli
- Hester, Susan
- Hong, Huixiao
- Jackson, Scott A
- Ji, Hanlee
- Levy, Shawn
- Li, Quan-Zhen
- Liu, Chunmei
- Liu, Ying
- Ma, Yunqing
- Mei, Nan
- Myklebost, Ola
- Ning, Baitang
- Patterson, Tucker A
- Pusztai, Lajos
- Qian, Feng
- Schroth, Gary P
- Su, Zhenqiang
- Sun, Hongmei
- Tikhonova, Irina
- Turpaz, Yaron
- Walker, Stephen J
- Wang, Sue Jane
- Wang, Yonghong
- Wong, Alex
- Wu, Jie
- Xiao, Chunlin
- Xie, Qian
- Xu, Jun
- Yang, Wen
- Zhang, Liang
- Zhong, Sheng
- Slikker, William
- Venue
- Nature Biotechnology
- Published
- 2006-09-01
- Volume
- 24
- Issue
- 9
- Pages
- 1151-1161
- ISSN
- 0733-222X (ISSN-L)
- 1087-0156
- 1546-1696
- PMC
- PMC3272078
- OpenAlex
- W2010637767
- Cited by
- 2,126
- References
- 43
- Citations by year
- 2026: 21 · 2025: 25 · 2024: 23 · 2023: 39 · 2022: 37 · 2021: 60 · 2020: 43 · 2019: 59 · 2018: 68 · 2017: 87 · 2016: 87 · 2015: 98 · 2014: 122 · 2013: 155 · 2012: 160
- FWCI
- 87.96
- Type
- journal article
- Language
- en
- Open access
- green
- www.ncbi.nlm.nih.gov
- Licence
- www.springer.com/tdm (tdm)
- www.springer.com/tdm (vor)
- Locations
- Nature Biotechnology (publishedVersion)
- PubMed (publishedVersion)
- Europe PMC (PubMed Central) (acceptedVersion)
- PubMed Central (acceptedVersion)
- Digital Access to Libraries (Université catholique de Louvain (UCL), l'Université de Namur (UNamur) and the Université Saint-Louis (USL-B)) (submittedVersion)
- Funders
- U.S. Environmental Protection Agency
- National Institutes of Health (Z99 LM999999, Z99 HL999999, Z99 MH999999, Z99CL999999)
- Topics
- Life Sciences › Biochemistry, Genetics and Molecular Biology › Molecular Biology › Gene expression and cancer classification
- Life Sciences › Biochemistry, Genetics and Molecular Biology › Molecular Biology › Molecular Biology Techniques and Applications
- Life Sciences › Biochemistry, Genetics and Molecular Biology › Molecular Biology › Genomics and Phylogenetic Studies
- Keywords
- probe mapping, differentially expressed genes, microarray data analysis
- MeSH terms
- Equipment Design, Quality Assurance, Health Care, Quality Control, Sensitivity and Specificity, United States, Reproducibility of Results, Equipment Failure Analysis, Oligonucleotide Array Sequence Analysis, Gene Expression Profiling
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.