The MicroArray Quality Control (MAQC) project shows inter- and intraplatform reproducibility of gene expression measurements
Open accessThe DOI matches its Crossref record; 43 of the 43 references it cites were found in a registry or an index.
Abstract
Over the last decade, the introduction of microarray technology has had a profound impact on gene expression research. The publication of studies with dissimilar or altogether contradictory results, obtained using different microarray platforms to analyze identical RNA samples, has raised concerns about the reliability of this technology. The MicroArray Quality Control (MAQC) project was initiated to address these concerns, as well as other performance and data analysis issues. Expression data on four titration pools from two distinct reference RNA samples were generated at multiple test sites using a variety of microarray-based and alternative technology platforms. Here we describe the experimental design and probe mapping efforts behind the MAQC project. We show intraplatform consistency across test sites as well as a high level of interplatform concordance in terms of genes identified as differentially expressed. This study provides a resource that represents an important first step toward establishing a framework for the use of microarrays in clinical and regulatory settings.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Next, we applied the |log 2 fold-change|>1 filter advocated in the MAQC study on microarrays, 10 and for microarrays observed a reduction in the eFDR to below 1.5%, save for one outlier site (Figs 3c,d).”
From A comprehensive assessment of RNA-seq accuracy, reproducibility and information content by the Sequencing Quality Control Consortium (2014) · cites this paper as [10]
In the citing paper
“Studies on microarrays have shown that results of typical statistical differential expression tests thresholded by p -value need to be filtered and sorted by effect strength (fold-change) in order to attain robust comparisons across platforms and sites. 10”
From A comprehensive assessment of RNA-seq accuracy, reproducibility and information content by the Sequencing Quality Control Consortium (2014) · cites this paper as [10]
In the citing paper
“The Microarray Quality Control (MAQC) Consortium landmark study10 examined the degree of variance within and across many different microarray platforms and found similar coefficients of variation between platforms.”
From Multi-platform assessment of transcriptome profiling using RNA-seq in the ABRF next-generation sequencing study (2014) · cites this paper as [10]
In the citing paper
“prior work comparing microarray platforms and methods showed high levels of inter-platform concordance for the ability to detect differentially expressed genes.”
From Multi-platform assessment of transcriptome profiling using RNA-seq in the ABRF next-generation sequencing study (2014) · cites this paper as [10]
Citations
Cites
In silico prediction of protein-protein interactions in human macrophages
Souiai, O., Guerfali, F., Ben Miled, S., Brun, C., & Benkahla, A. (2014) · BMC Research Notes · doi:10.1186/1756-0500-7-157 · Cited by 10,803
Significance analysis of microarrays applied to the ionizing radiation response
Tusher, V. G., Tibshirani, R., & Chu, G. (2001) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.091062498 · Cited by 10,568
Pruitt, K. D., Tatusova, T., & Maglott, D. R. (2007) · Nucleic Acids Research · doi:10.1093/nar/gkl842 · Cited by 4,481 · cited 1×
“We mapped the probes (see Supplementary Methods online and Supplementary Notes online) to the RefSeq human mRNA databas”
Method"Stemness": Transcriptional Profiling of Embryonic and Adult Stem Cells
Ramalho-Santos, M., Yoon, S., Matsuzaki, Y., Mulligan, R. C., & Melton, D. A. (2002) · Science · doi:10.1126/science.1072530 · Cited by 1,709
Pruitt, K. D. (2004) · Nucleic Acids Research · doi:10.1093/nar/gki025 · Cited by 1,660 · cited 1×
“We mapped the probes (see Supplementary Methods online and Supplementary Notes online) to the RefSeq human mRNA database 31 (http://www.ncbi.nlm.nih.gov/RefSeq) and to the AceView database 32 (http://www.ncbi.nlm.nih.gov/IEB/Research/Acembly), a less curated but more comprehensive database, which…”
MethodA Stem Cell Molecular Signature
Ivanova, N. B., Dimos, J. T., Schaniel, C., Hackney, J. A., Moore, K. A., & Lemischka, I. R. (2002) · Science · doi:10.1126/science.1073823 · Cited by 1,542
Prediction of cancer outcome with microarrays: a multiple random validation strategy
Michiels, S., Koscielny, S., & Hill, C. (2005) · The Lancet · doi:10.1016/s0140-6736(05)17866-0 · Cited by 1,025 · cited 1×
“, raising doubts about the repeatability, reproducibility and comparability of microarray technolog”
BackgroundMultiple-laboratory comparison of microarray platforms
Irizarry, R. A., Warren, D., Spencer, F., Kim, I. F., Biswal, S., Frank, B. C., Gabrielson, E., Garcia, J. G. N., Geoghegan, J., Germino, G., et al. (2005) · Nature Methods · doi:10.1038/nmeth756 · Cited by 862
Self-citationEvaluation of gene expression measurements from commercial microarray platforms
Tan, P. K. (2003) · Nucleic Acids Research · doi:10.1093/nar/gkg763 · Cited by 706
Thousands of samples are needed to generate a robust gene list for predicting outcome in cancer
Ein-Dor, L., Zuk, O., & Domany, E. (2006) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0601231103 · Cited by 689 · cited 1×
“…to appear in peer-reviewed journals 9,10 , raising doubts about the repeatability, reproducibility and comparability of microarray technology 11–13 , several studies have also been recently published showing increased reproducibility of microarray data generated at different test sites and/or…”
Background
Research works printed but not linked: 1
- Reid, L.H. The value of a proficiency testing program to monitor performance in microarray laboratories. Pharm. Discov. 5, 20–25 (2005).
Cited by
Items 501–600 of 1,004
Zhu, L., Jiang, G., Wang, S., Wang, C., Li, Q., Yu, H., Zhou, Y., Zhao, B. T., Huang, H., Xing, W., et al. (2010) · Journal of Clinical Microbiology · doi:10.1128/jcm.00158-10 · Cited by 52
Self-citationTurnbull, A., Kitchen, R. R., Larionov, A. A., Renshaw, L., Dixon, J. M., & Sims, A. H. (2012) · BMC Medical Genomics · doi:10.1186/1755-8794-5-35 · Cited by 53
“Cross-platform analysis of microarray data has previously been shown to be possible and worthwhile, although this has normally been performed using transformed relative values [19], analogous to those from two-colour microarrays and have been shown to result in fold change compression [18].”
BackgroundMethodInfluentialExploration of PPAR functions by microarray technology—A paradigm for nutrigenomics
Bünger, M., Hooiveld, G. J. E. J., Kersten, S., & Müller, M. M. (2007) · Biochimica et Biophysica Acta (BBA) - Molecular and Cell Biology of Lipids · doi:10.1016/j.bbalip.2007.05.004 · Cited by 60
Xu, J., Gong, B., Wu, L., Thakkar, S., Hong, H., & Tong, W. (2016) · Pharmaceutics · doi:10.3390/pharmaceutics8010008 · Cited by 55
“As successfully applied in the MAQC-I project, titration study has proven to be a promising way to assess platform reproducibility and reliability [12].”
MethodSelf-citationHekking, P.-P. W., Loza, M. J., Pavlidis, S. P., Meulder, B. D., Lefaudeux, D., Baribaud, F., Auffray, C., Wagener, A. H., Brinkman, P., Lutter, R., et al. (2017) · European Respiratory Journal · doi:10.1183/13993003.02298-2016 · Cited by 56
Traumatic brain injury induces long-lasting changes in immune and regenerative signaling
Boone, D. R., Weisz, H. A., Willey, H. E., Torres, K. E. O., Falduto, M. T., Sinha, M., Spratt, H., Bolding, I. J., Johnson, K. M., Parsley, M. A., et al. (2019) · PLOS ONE · doi:10.1371/journal.pone.0214741 · Cited by 50
Integrating Global Gene Expression Analysis and Genetics
Farber, C. R., & Lusis, A. J. (2008) · Advances in genetics · doi:10.1016/s0065-2660(07)00420-8 · Cited by 55
“Recently, these platforms have been compared as part of the MicroArray Quality Control Project (Shi et al., 2006).”
BackgroundDebacq‐Chainiaux, F., Pascal, T. G., Boilan, E., Bastin, C., Bauwens, É., & Toussaint, O. (2008) · Free Radical Biology and Medicine · doi:10.1016/j.freeradbiomed.2008.02.001 · Cited by 57
Gene expression predictors in breast cancer: Current status, limitations and perspectives
Desmedt, C., Ruíz‐García, E., & André, F. (2008) · European Journal of Cancer · doi:10.1016/j.ejca.2008.09.011 · Cited by 52
RNA pre-amplification enables large-scale RT-qPCR gene-expression studies on limiting sample amounts
Vermeulen, J., Derveaux, S., Lefever, S., Smet, E. D., Preter, K. D., Yigit, N., Paepe, A. D., Pattyn, F., Speleman, F., & Vandesompele, J. (2009) · BMC Research Notes · doi:10.1186/1756-0500-2-235 · Cited by 59
“Two commercial RNA samples were mixed (Universal Human Reference RNA (UHRR) from Stratagene and Human Brain Reference RNA (HBRR) from Ambion) to generate the four MAQC (MicroArray Quality Control) reference samples [20].”
Environmental enrichment during adolescence regulates gene expression in the striatum of mice
Thiriet, N., Amar, L., Toussay, X., Lardeux, V., Ladenheim, B., Becker, K. G., Cadet, J. L., Solinas, M., & Jaber, M. (2008) · Brain Research · doi:10.1016/j.brainres.2008.05.030 · Cited by 51
Large Datasets in Biomedicine: A Discussion of Salient Analytic Issues
Sinha, A., Hripcsak, G. M., & Markatou, M. (2009) · Journal of the American Medical Informatics Association · doi:10.1197/jamia.m2780 · Cited by 56
Multicenter assessment of shotgun metagenomics for pathogen detection
Liu, D., Zhou, H., Xu, T., Yang, Q., Mo, X., Shi, D., Ai, J., Zhang, J., Tao, Y., Wen, D., et al. (2021) · EBioMedicine · doi:10.1016/j.ebiom.2021.103649 · Cited by 58
Self-citationKey Aspects of Analyzing Microarray Gene-Expression Data
Chen, J. J. (2007) · Pharmacogenomics · doi:10.2217/14622416.8.5.473 · Cited by 56
Self-citationLobenhofer, E. K., Auman, J. T., Blackshear, P. E., Boorman, G. A., Bushel, P. R., Cunningham, M. L., Fostel, J. M., Gerrish, K., Heinloth, A. N., Irwin, R. D., et al. (2008) · Genome biology · doi:10.1186/gb-2008-9-6-r100 · Cited by 51
Self-citationEuling, S. Y., White, L. D., Kim, A. S., Sen, B., Wilson, V. S., Keshava, C., Keshava, N., Hester, S., Ovacik, M., Ierapetritou, M., et al. (2011) · Toxicology and Applied Pharmacology · doi:10.1016/j.taap.2011.06.014 · Cited by 52
Self-citationSárvári, M., Kalló, I., Hrabovszky, E., Solymosi, N., Tóth, K., Likó, I., Molnar, B. A., Tihanyi, K., & Liposits, Z. (2010) · Endocrinology · doi:10.1210/en.2010-0375 · Cited by 54
From direct to indirect lithium targets: a comprehensive review of omics data
Roux-Rouquié, M., & Dosseto, A. (2017) · Metallomics · doi:10.1039/c7mt00203c · Cited by 53
PCB congener specific oxidative stress response by microarray analysis using human liver cell line
De, S., Ghosh, S., Chatterjee, R., Chen, Y.-Q., Moses, L., Kesari, A., Hoffman, E. P., & Dutta, S. K. (2010) · Environment International · doi:10.1016/j.envint.2010.05.011 · Cited by 53
“In fact, recently microarray quality control consortium has concluded that if the quality control steps are all maintained strictly the microarray data is as good as (and may be less noisier) than the real time PCR data (Canales et al., 2006; Shi et al., 2006).”
BackgroundKitchen, R. R., Sabine, V. S., Simen, A. A., Dixon, J. M., Bartlett, J. M. S., & Sims, A. H. (2011) · BMC Genomics · doi:10.1186/1471-2164-12-589 · Cited by 50
Leveraging transcriptomics for precision diagnosis: Lessons learned from cancer and sepsis
Tsakiroglou, M., Evans, A. G., & Pirmohamed, M. (2023) · Frontiers in Genetics · doi:10.3389/fgene.2023.1100352 · Cited by 55
“They were recognised as a key tool in advancing personalised medicine (Shi et al., 2006), but despite 25+ years of development, their clinical utility remains limited (Piccart et al.”
Straightforward and sensitive RT-qPCR based gene expression analysis of FFPE samples
Zeka, F., Vanderheyden, K., Smet, E. D., Cuvelier, C. A., Mestdagh, P., & Vandesompele, J. (2016) · Scientific Reports · doi:10.1038/srep21418 · Cited by 49
Alternative Polyadenylation of Mammalian Transcripts Is Generally Deleterious, Not Adaptive
Xu, C., & Zhang, J. (2018) · Cell Systems · doi:10.1016/j.cels.2018.05.007 · Cited by 55
“The last four samples were from a MicroArray Quality Control (MAQC) study, where MAQC-Brain1 and MAQC-Brain2 are replicates of a human brain reference RNA from Ambion (Shi et al., 2006), whereas MAQC-UHR1 and MAQC-UHR2 are replicates of a universal human reference RNA from Stratagene.”
RNAflow: An Effective and Simple RNA-Seq Differential Gene Expression Pipeline Using Nextflow
Lataretu, M., & Hölzer, M. (2020) · Genes · doi:10.3390/genes11121487 · Cited by 53
“qRT-PCR data are available under Gene Expression Omnibus (GEO) accession GSE5350, platform GPL4097, sample accessions: GSM129638-GSM129641 (UHR), and GSM129642-GSM129645 (Brain) [42].”
MethodLiu, S., Kam, W. R., Ding, J., Hatton, M. P., & Sullivan, D. A. (2013) · Investigative Ophthalmology & Visual Science · doi:10.1167/iovs.12-11221 · Cited by 50
Bienkowska, J. R., Dalgin, G. S., Batliwalla, F., Allaire, N., Roubenoff, R., Gregersen, P. K., & Carulli, J. P. (2009) · Genomics · doi:10.1016/j.ygeno.2009.08.008 · Cited by 52
Molecular profiles and clinical outcome of stage UICC II colon cancer patients
Gröne, J., Lenze, D., Jurinović, V., Hummel, M., Seidel, H., Leder, G., Beckmann, G., Sommer, A., Grützmann, R., Pilarsky, C. P., et al. (2011) · International Journal of Colorectal Disease · doi:10.1007/s00384-011-1176-x · Cited by 49
“In consequence, although gene expression data can be regarded as very reliable [39], their interpretation and general application to independent case collections and/or individual patients are not yet established.”
BackgroundChen, B., Yu, S., Singh, S., Kao, L., Tsai, Z., Yang, P., Chen, B., & Li, S. S. (2010) · Cell Biology International · doi:10.1042/cbi20090081 · Cited by 52
Data quality in genomics and microarrays
Ji, H. P., & Davis, R. W. (2006) · Nature Biotechnology · doi:10.1038/nbt0906-1112 · Cited by 49
Self-citationAssessment of kidney organ quality and prediction of outcome at time of transplantation
Mueller, T., Solez, K., & Mas, V. R. (2011) · Seminars in Immunopathology · doi:10.1007/s00281-011-0248-x · Cited by 48
“The implementation in routine clinical standard of care is becoming reality [4, 32, 158, 169, 178, 206].”
BackgroundA novel method for cross-species gene expression analysis
Kristiansson, E., Österlund, T., Gunnarsson, L. M., Arne, G., Larsson, D. G. J., & Nerman, O. (2013) · BMC Bioinformatics · doi:10.1186/1471-2105-14-70 · Cited by 55
Tarca, A. L., Romero, R. J., Xu, Z., Gomez‐Lopez, N., Erez, O., Hsu, C., Hassan, S. S., & Carey, V. J. (2019) · Scientific Reports · doi:10.1038/s41598-018-36649-w · Cited by 51
The proteogenomic path towards biomarker discovery
Sigdel, T. K., & Sarwal, M. (2008) · Pediatric Transplantation · doi:10.1111/j.1399-3046.2008.01018.x · Cited by 49
“For the microarray, the issue of platforms has been discussed extensively (55, 56).”
Statistical Challenges in Preprocessing in Microarray Experiments in Cancer
Owzar, K., Barry, W. T., Jung, S., Sohn, I., & George, S. L. (2008) · Clinical Cancer Research · doi:10.1158/1078-0432.ccr-07-4532 · Cited by 48
Bacterial population genomics and infectious disease diagnostics
Joseph, S. J., & Read, T. D. (2010) · Trends in biotechnology · doi:10.1016/j.tibtech.2010.09.001 · Cited by 56
Devonshire, A. S., Elaswarapu, R., & Foy, C. A. (2010) · BMC Genomics · doi:10.1186/1471-2164-11-662 · Cited by 44
“Comparison of microarray and RT-qPCR results revealed good consistency between the two technologies for fold change detection (Figure 6B) and also confirmed that the Agilent platform does not cause compression of fold change measurements [29].”
InfluentialStatistical methods and microarray data
Klebanov, L. B., Qiu, X., Welle, S. L., & Yakovlev, A. (2007) · Nature Biotechnology · doi:10.1038/nbt0107-25 · Cited by 48
Lee, P. K. H., Warnecke, F., Brodie, E., Macbeth, T. W., Conrad, M. E., Andersen, G. L., & Alvarez‐Cohen, L. (2011) · Environmental Science & Technology · doi:10.1021/es203005k · Cited by 47
RNA-Seq Mapping and Detection of Gene Fusions with a Suffix Array Algorithm
Sakarya, O., Breu, H., Radovich, M., Chen, Y., Wang, Y., Bárbácioru, C., Utiramerur, S., Whitley, P., Brockman, J. P., Vatta, P., et al. (2012) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1002464 · Cited by 49
“To assess the performance of mapping quality values generated with the system, we compared fold-change ratio (Log2 [UHR/ HBR]) of gene RPKM values with gene expression assays from the MicroArray Quality Control (MAQC) project [48,49].”
MethodSelf-citationThree methods for optimization of cross-laboratory and cross-platform microarray expression data
Stafford, P., & Brun, M. (2007) · Nucleic Acids Research · doi:10.1093/nar/gkl1133 · Cited by 47
“Reports have found both poor (5–10) and good (6,11–22) crossplatform correlation, but the MAQC consortium have generally found that proper sample preparation is sufficient to dramatically enhance multi-lab and multiplatform correlations (16,23,24).”
BackgroundThe Vasculome of the Mouse Brain
Guo, S., Zhou, Y., Xing, C., Lok, J. M., Som, A. T., Ning, M., Ji, X., & Lo, E. H. (2012) · PLoS ONE · doi:10.1371/journal.pone.0052665 · Cited by 48
“The combination of p value and fold change threshold serves to eliminate most false positives, as validated by a large microarray study led by FDA [208].”
BackgroundJennen, D. G. J., Ruiz‐Aracama, A., Magkoufopoulou, C., Peijnenburg, A., Lommen, A., van Delft, J. H. M., & Kleinjans, J. C. S. (2011) · BMC Systems Biology · doi:10.1186/1752-0509-5-139 · Cited by 49
RNA-seq mixology: designing realistic control experiments to compare protocols and analysis methods
Holik, A. Z., Law, C. W., Liu, R., Wang, Z., Wang, W., Ahn, J., Asselin-Labat, M.-L., Smyth, G. K., & Ritchie, M. E. (2016) · Nucleic Acids Research · doi:10.1093/nar/gkw1063 · Cited by 51
“This de-sign was also used in the MAQC (9) and SEQC projects (10).”
MethodInfluentialRioux, G., Ridha, Z., Simard, M., Turgeon, F., Guérin, S. L., & Pouliot, R. (2020) · Genes · doi:10.3390/genes11101155 · Cited by 50
Effect of various normalization methods on Applied Biosystems expression array system data
Bárbácioru, C., Wang, Y., Canales, R. D., Sun, Y. A., Keys, D. N., Chan, F., Poulter, K., & Samaha, R. R. (2006) · BMC Bioinformatics · doi:10.1186/1471-2105-7-533 · Cited by 51
“This result is, however, sensitive to the cut-offs used in determining the gene lists and can affect the degree of overlap observed [9].”
MethodInfluentialSelf-citationSequence-Dependent Fluorescence of Cyanine Dyes on Microarrays
Agbavwe, C., & Somoza, M. M. (2011) · PLoS ONE · doi:10.1371/journal.pone.0022177 · Cited by 47
“and biases in microarray experiments focus primarily on experimental design, data analysis and interplatform reproducibility [1,2,3], gene-specific dye biases have also been extensively discussed [4,5,6,7,8,9], and even traced to the nucleobase proportion in the mRNA and oligonucleotide probes [10].”
Background2,3,7,8-Tetrachlorodibenzo- p -dioxin Upregulates FoxQ1b in Zebrafish Jaw Primordium
Planchart, A., & Mattingly, C. J. (2010) · Chemical Research in Toxicology · doi:10.1021/tx9003165 · Cited by 55
Development of novel tools for thein vitroinvestigation of drug-induced liver injury
Jiang, J., Wolters, J. E. J., van Breda, S. G., Kleinjans, J. C. S., & de Kok, T. M. C. M. (2015) · Expert Opinion on Drug Metabolism & Toxicology · doi:10.1517/17425255.2015.1065814 · Cited by 47
Impact of Ischemia and Procurement Conditions on Gene Expression in Renal Cell Carcinoma
Liu, N. W., Sanford, T. H., Srinivasan, R., Liu, J. L., Khurana, K. K., Aprelikova, O. N., Valero, V., Bechert, C. J., Worrell, R., Pinto, P. A., et al. (2012) · Clinical Cancer Research · doi:10.1158/1078-0432.ccr-12-2606 · Cited by 46
“Gene expression microarray data is well-known to be subject to inter-platform variation, laboratory processing variation, and variation from statistical analysis (3-4).”
MethodThe ancestral levels of transcription and the evolution of sexual phenotypes in filamentous fungi
Trail, F., Wang, Z., Stefanko, K., Cubba, C., & Townsend, J. P. (2017) · PLoS Genetics · doi:10.1371/journal.pgen.1006867 · Cited by 47
Impact of RNA-seq data analysis algorithms on gene expression estimation and downstream prediction
Li, T., Wu, P.-Y., Phan, J. H., Hassazadeh, H., Jones, W. D., Shi, L. M., Fischer, M., Mason, C. E., Li, S., Xu, J., et al. (2020) · Scientific Reports · doi:10.1038/s41598-020-74567-y · Cited by 51
Self-citationQuality Assurance of RNA Expression Profiling in Clinical Laboratories
Tang, W., Hu, Z., Muallem, H., & Gulley, M. L. (2011) · Journal of Molecular Diagnostics · doi:10.1016/j.jmoldx.2011.09.003 · Cited by 47
Do DNA microarrays have their future behind them?
Coppée, J. (2008) · Microbes and Infection · doi:10.1016/j.micinf.2008.07.003 · Cited by 56
Field, L. A., Jordan, R. M., Hadix, J. A., Dunn, M. A., Shriver, C. D., Ellsworth, R. E., & Ellsworth, D. L. (2007) · Clinical Biochemistry · doi:10.1016/j.clinbiochem.2007.01.004 · Cited by 46
Mellon, S. H., Wolkowitz, O. M., Schonemann, M. D., Epel, E. S., Rosser, R., Burke, H. B., Mahan, L., Reus, V. I., Stamatiou, D., Liew, C. C., et al. (2016) · Translational Psychiatry · doi:10.1038/tp.2016.79 · Cited by 46
Introduction to miRNA Profiling Technologies and Cross-Platform Comparison
Aldridge, S., & Hadfield, J. (2011) · Methods in molecular biology · doi:10.1007/978-1-61779-427-8_2 · Cited by 47
Qing, T., Yu, Y., Du, T., & Shi, L. (2013) · Science China Life Sciences · doi:10.1007/s11427-013-4437-9 · Cited by 42
Self-citationGuo, L., Mei, N., Liao, W., Chan, P.-C., & Fu, P. P. (2010) · OMICS: A Journal of Integrative Biology · doi:10.1089/omi.2009.0115 · Cited by 45
“We had reported that a straightforward approach of fold change selection plus a nonstringent P cutoff is useful in identifying reproducible gene lists (Guo et al., 2006; Shi et al., 2006).”
Self-citationIntegrating multiple omics to unravel mechanisms of Cyclosporin A induced hepatotoxicity in vitro
den Hof, W. F. P. M. V., Ruiz‐Aracama, A., Summeren, A. V., Jennen, D. G. J., Gaj, S., Coonen, M. L. J., Brauers, K. J. J., Wodzig, W. K. W. H., van Delft, J. H. M., & Kleinjans, J. C. S. (2015) · Toxicology in Vitro · doi:10.1016/j.tiv.2014.12.016 · Cited by 47
A novel method to quantify gene set functional association based on gene ontology
Lv, S., Li, Y., Wang, Q., Ning, S., Huang, T., Wang, P., Sun, J., Zheng, Y., Liu, W., Ai, J., et al. (2011) · Journal of The Royal Society Interface · doi:10.1098/rsif.2011.0551 · Cited by 46
Müller, S., Baldin, C., Groth, M., Guthke, R., Kniemeyer, O., Brakhage, A. A., & Valiante, V. (2012) · BMC Genomics · doi:10.1186/1471-2164-13-519 · Cited by 42
“Low consistency of microarray gene expression data can have multiple reasons, such as platform effects [24], different media, RNA extraction protocols, or biological variability.”
BackgroundKusko, R., Dreymann, J., Ross, J., Cha, Y., Escalante-Chong, R., Garcia-Miralles, M., Tan, L. J., Burczynski, M. E., Zeskind, B., Laifenfeld, D., et al. (2018) · Molecular Neurodegeneration · doi:10.1186/s13024-018-0259-3 · Cited by 44
“In order to further filter before pathway analysis, we employ a strict version of what is recommended by MAQC, combining a fold change cutoff with an adjusted pvalue cutoff [28].”
Methodvan den Berg, N., Mahomed, W., Olivier, N. A., Swart, V., & Crampton, B. G. (2018) · PLoS ONE · doi:10.1371/journal.pone.0205705 · Cited by 45
Hu, Z., Gao, S., Lindberg, D. M., Panja, D., Wakabayashi, Y., Li, K., Kleinman, J. E., Zhu, J., & Li, Z. (2019) · Translational Psychiatry · doi:10.1038/s41398-019-0538-y · Cited by 49
Eom, H.-J., Roca, C. P., Roh, J., Chatterjee, N., Jeong, J., Shim, I., Kim, H.-M., Kim, P., Choi, K., Giralt, F., et al. (2015) · Chemico-Biological Interactions · doi:10.1016/j.cbi.2015.06.031 · Cited by 45
Tsuchiya, M., Piras, V., Choi, S., Akira, S., Tomita, M., Giuliani, A., & Selvarajoo, K. (2009) · PLoS ONE · doi:10.1371/journal.pone.0004905 · Cited by 45
“High correlation between genotypes may suggest that technical noise of our microarray dataset is rather low [18,19].”
BackgroundKuhn, A., Luthi-Carter, R., & Delorenzi, M. (2008) · BMC Bioinformatics · doi:10.1186/1471-2105-9-26 · Cited by 46
“As shown in a recent study, different microarray technologies can reliably and concordantly measure gene expression profiles [1].”
BackgroundRamalingam, N., Liu, H.-B., Dai, C., Jiang, Y. S., Wang, H., Wang, Q., Hui, K. M., & Gong, H. (2009) · Biomedical Microdevices · doi:10.1007/s10544-009-9318-4 · Cited by 45
Banerjee, A., Luong, J. A., Ho, A., Saib, A. O., & Ploski, J. E. (2016) · Molecular Autism · doi:10.1186/s13229-016-0077-9 · Cited by 43
“The MAQC Consortium has reported that this approach can be successful in identifying reproducible gene lists [66].”
BackgroundApplication of omics data in regulatory toxicology: report of an international BfR expert workshop
Marx‐Stoelting, P., Braeuning, A., Buhrke, T., Lampen, A., Niemann, L., Oelgeschläger, M., Rieke, S., Schmidt, F., Heise, T., Pfeil, R., et al. (2015) · Archives of Toxicology · doi:10.1007/s00204-015-1602-x · Cited by 44
Tahara, H., Sato, M., Thurin, M., Wang, E., Butterfield, L. H., Disis, M. L., Fox, B. A., Lee, P. P., Khleif, S. N., Wigginton, J. M., et al. (2009) · Journal of Translational Medicine · doi:10.1186/1479-5876-7-45 · Cited by 47
Cross-platform analysis of global microRNA expression technologies
Yauk, C. L., Rowan‐Carroll, A., Stead, J. D. H., & Williams, A. (2010) · BMC Genomics · doi:10.1186/1471-2164-11-330 · Cited by 45
“All analyses were based on the log ratios of these two distinct samples as recommended in prior cross-platform microarray publications [14,18,20,21].”
Piltti, K. M., Funes, G. M., Avakian, S. N., Salibian, A. A., Huang, K. I., Carta, K., Kamei, N., Flanagan, L. A., Monuki, E. S., Uchida, N., et al. (2017) · Stem Cell Reports · doi:10.1016/j.stemcr.2017.04.009 · Cited by 45
Scarr, E., Udawela, M., & Dean, B. (2018) · Schizophrenia · doi:10.1038/s41537-018-0044-x · Cited by 50
Cyclin D1 overexpression induces global transcriptional downregulation in lymphoid neoplasms
Alberó, R., Enjuanes, A., Demajo, S., Castellano, G., Pinyol, M., García, N., Capdevila, C., Clot, G., Suárez-Cisneros, H., Shimada, M., et al. (2018) · Journal of Clinical Investigation · doi:10.1172/jci96520 · Cited by 46
“We hybridized a commercial pre-defined panel containing 48 genes derived from the Microarray Quality Control Study (MAQC) (31) with cell extracts from three different amounts of cells corresponding to the cyclin D1 overexpression model (JVM13 and JVM13-cD1 T286A ).”
MethodKynurenic Acid Protects against Thioacetamide-Induced Liver Injury in Rats
Marciniak, S., Wnorowski, A., Smolińska, K., Walczyna, B., Turski, W. A., Kocki, T., Paluszkiewicz, P., & Parada-Turska, J. (2018) · Analytical Cellular Pathology · doi:10.1155/2018/1270483 · Cited by 46
“In rats, administration of TAA results in hepatic dysfunction, abnormal liver biochemical markers, and encephalopathy; all these features are hallmarks of ALF [26, 27].”
BackgroundThe promise of graphene-based transistors for democratizing multiomics studies
Lu, H., Kane, A. A., Parkinson, J., Gao, Y., Hajian, R., Heltzen, M., Goldsmith, B. R., & Aran, K. (2021) · Biosensors and Bioelectronics · doi:10.1016/j.bios.2021.113605 · Cited by 45
MicroRNA signatures in hereditary breast cancer
Estal, R. M., Suela, S. P., Jiménez, I. D. J., Egoavil, C. M., García‐Casado, Z., Juan-Fita, M. J., Sánchez‐Heras, A. B., Huerta, Á. S., Chirivella, I., Sánchez-Izquierdo, D., et al. (2013) · Breast Cancer Research and Treatment · doi:10.1007/s10549-013-2723-7 · Cited by 48
Tian, S., Zhan, D., Yu, Y., Wang, Y., Liu, M., Tan, S., Li, Y., Song, L., Qin, Z., Li, X., et al. (2023) · Genome Biology · doi:10.1186/s13059-023-03048-y · Cited by 43
Self-citationWu, L., Wáng, Y., Nie, J., Fan, X., & Cheng, Y. (2013) · Evidence-based Complementary and Alternative Medicine · doi:10.1155/2013/915343 · Cited by 44
Self-citationKadota, K., & Shimizu, K. (2011) · BMC Bioinformatics · doi:10.1186/1471-2105-12-227 · Cited by 48
Current status and future prospects of toxicogenomics in drug discovery
Khan, S. R., Baghdasarian, A., Fahlman, R. P., Michail, K., & Siraki, A. G. (2013) · Drug Discovery Today · doi:10.1016/j.drudis.2013.11.001 · Cited by 43
“29 Consortium, M. et al. (2006) The MicroArray Quality Control (MAQC) project”
Thermodynamics of DNA hybridization on surfaces
Schmitt, T. J., & Knotts, T. A. (2011) · The Journal of Chemical Physics · doi:10.1063/1.3592557 · Cited by 43
Molecular methods for the detection and characterization of foodborne pathogens
Shi, X., Long, F. X., & Suo, B. (2010) · Pure and Applied Chemistry · doi:10.1351/pac-con-09-02-07 · Cited by 45
Benchmarking RNA-Seq quantification tools
Chandramohan, R., Wu, P.-Y., Phan, J. H., & Wang, M. D. (2013) · Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC) · doi:10.1109/embc.2013.6609583 · Cited by 50
“These datasets were used in the MAQC (MicroArray Quality Control) project[10] and were Benchmarking RNA-Seq Quantification Tools”
Smith, S. L., Plant, D., Eyre, S., & Barton, A. C. (2013) · Annals of the Rheumatic Diseases · doi:10.1136/annrheumdis-2012-202743 · Cited by 47
A Multi-Cohort and Multi-Omics Meta-Analysis Framework to Identify Network-Based Gene Signatures
Shafi, A., Nguyen, T., Peyvandipour, A., Nguyen, H., & Drăghici, S. (2019) · Frontiers in Genetics · doi:10.3389/fgene.2019.00159 · Cited by 47
“Therefore, they are unable to account for the heterogeneity that may arise due to the biological and technical variabilities present in independent studies of a given disease (Drăghici et al., 2006; MAQC Consortium, 2006).”
BackgroundLi, H., Sharma, A., Luo, K., Qin, Z. S., Sun, X. S., & Liu, H. (2020) · Frontiers in Genetics · doi:10.3389/fgene.2020.00392 · Cited by 44
How many markers are needed to robustly determine a cell's type?
Fischer, S., & Gillis, J. (2021) · iScience · doi:10.1016/j.isci.2021.103292 · Cited by 55
“Previous experiments in microarray and bulk RNAseq data by the MAQC (Shi et al., 2006) and SEQC (Consortium et al.”
BackgroundMethodIntegrated approaches to uncovering transcription regulatory networks in mammalian cells
Tan, K., Tegner, J., & Ravasi, T. (2008) · Genomics · doi:10.1016/j.ygeno.2007.11.005 · Cited by 44
Perspectives of DNA microarray and next-generation DNA sequencing technologies
Teng, X., & Xiao, H. (2009) · Science in China Series C Life Sciences · doi:10.1007/s11427-009-0012-9 · Cited by 43
Klebanov, L., & Yakovlev, A. (2007) · The Annals of Applied Statistics · doi:10.1214/07-aoas120 · Cited by 49
Applying genomics to organ transplantation medicine in both discovery and validation of biomarkers
Kurian, S. M., Grigoryev, Y. A., Head, S. R., Campbell, D., Mondala, T. S., & Salomon, D. R. (2007) · International Immunopharmacology · doi:10.1016/j.intimp.2007.07.017 · Cited by 43
Gene expression profiling in lymphoma diagnosis and management
Iqbal, J., Liu, Z., Deffenbacher, K. E., & Chan, W. C. (2009) · Best Practice & Research Clinical Haematology · doi:10.1016/j.beha.2009.05.001 · Cited by 43
“nology, especially with commercial microarrays, carefully performed studies with strictly controlled experimental procedures are highly reproducible using the same array platform [12].”
BackgroundMethodGlobal gene expression profiling of ischemic preconditioning in the rat retina.
Kamphuis, W., Dijk, F., van Soest, S., & Bergen, A. A. B. (2007) · PubMed Central · Cited by 47
Identification of microRNAs regulated by activin A in human embryonic stem cells
Tsai, Z., Singh, S., Yu, S., Kao, L., Chen, B., Ho, B., Yang, P., & Li, S. S. (2009) · Journal of Cellular Biochemistry · doi:10.1002/jcb.22385 · Cited by 48
“…quantitative comparison, since the correlation between Affymetrix GeneChip results and TagMan RTqPCR results was shown in a good linearity of R2¼ 0.95 by the MicroArray Quality Control Study, a collaborative effort of 137 scientists led by the US-FDA [Canales et al., 2006; Shi et al., 2006].”
MethodInfluentialLahti, L., Elo, L. L., Aittokallio, T., & Kaski, S. (2011) · IEEE/ACM Transactions on Computational Biology and Bioinformatics · doi:10.1109/tcbb.2009.38 · Cited by 42
“Various laboratory- and experiment-specific effects are also known to add experimental noise in microarray studies [12], [13].”
BackgroundWeber, M., Lambeck, S., Ding, N., Henken, S., Kohl, M., Deigner, H. P., Enot, D. P., Igwe, E. I., Frappart, L., Kiehntopf, M., et al. (2012) · The FASEB Journal · doi:10.1096/fj.11-191957 · Cited by 42
“Determination of DEGs was performed according to the suggestions from the MicroArray Quality Control study (37) by a combination of two criteria: |log2 fold change at any condition opposed to sham| 1 and false discovery rate adjusted value of P 0.”
MethodHaramizu, S., Mori, T., Yano, M., Ota, N., Hashizume, K., Otsuka, A., Hase, T., & Shimotoyodome, A. (2014) · SpringerPlus · doi:10.1186/2193-1801-3-339 · Cited by 44
Shaw, J. R., Hampton, T. H., King, B. L., Whitehead, A., Gálvez-Montosa, F., Gross, R., Keith, N., Notch, E. G., Jung, D., Glaholt, S., et al. (2014) · Molecular Biology and Evolution · doi:10.1093/molbev/msu241 · Cited by 47
“Normalized log2 expression values were analyzed using linear models implemented in R (Team 2008) that included two variables, main effects of arsenic and time spent in seawater (salinity 1 h and salinity 24 h), and interactions between arsenic and salinity 1 h, or salinity 24 h. Differential expression of probes respo…”
MethodInfluential
Metadata
- Authors
- MAQC Consortium, Shi, L., Shi, L., Reid, L. H., Jones, W. D., Shippy, R., Warrington, J. A., Baker, S. C., Collins, P. J., de Longueville, F., Kawasaki, E. S., Lee, K. Y., Luo, Y., Sun, Y. A., Willey, J. C., Setterquist, R. A., Fischer, G. M., Tong, W., Dragan, Y. P., Dix, D. J., Frueh, F. W., Goodsaid, F. M., Herman, D., Jensen, R. V., Johnson, C. D., Lobenhofer, E. K., Puri, R. K., Scherf, U., Thierry-Mieg, J., Wang, C., Wilson, M., Wolber, P. K., Zhang, L., Amur, S., Bao, W., Barbacioru, C. C., Lucas, A. B., Bertholet, V., Boysen, C., Bromley, B., Brown, D., Brunner, A., Canales, R., Cao, X. M., Cebula, T. A., Chen, J. J., Cheng, J., Chu, T.-M., Chudin, E., Corson, J., Corton, J. C., Croner, L. J., Davies, C., Davison, T. S., Delenstarr, G., Deng, X., Dorris, D., Eklund, A. C., Fan, X.-H., Fang, H., Fulmer-Smentek, S., Fuscoe, J. C., Gallagher, K., Ge, W., Guo, L., Guo, X., Hager, J., Haje, P. K., Han, J., Han, T., Harbottle, H. C., Harris, S. C., Hatchwell, E., Hauser, C. A., Hester, S., Hong, H., Hurban, P., Jackson, S. A., Ji, H., Knight, C. R., Kuo, W. P., LeClerc, J. E., Levy, S., Li, Q.-Z., Liu, C., Liu, Y., Lombardi, M. J., Ma, Y., Magnuson, S. R., Maqsodi, B., McDaniel, T., Mei, N., Myklebost, O., Ning, B., Novoradovskaya, N., Orr, M. S., Osborn, T. W., Papallo, A., Patterson, T. A., Perkins, R. G., Peters, E. H., Peterson, R., Philips, K. L., Pine, P. S., Pusztai, L., Qian, F., Ren, H., Rosen, M., Rosenzweig, B. A., Samaha, R. R., Schena, M., Schroth, G. P., Shchegrova, S., Smith, D. D., Staedtler, F., Su, Z., Sun, H., Szallasi, Z., Tezak, Z., Thierry-Mieg, D., Thompson, K. L., Tikhonova, I., Turpaz, Y., Vallanat, B., Van, C., Walker, S. J., Wang, S. J., Wang, Y., Wolfinger, R., Wong, A., Wu, J., Xiao, C., Xie, Q., Xu, J., Yang, W., Zhang, L., Zhong, S., Zong, Y., & Slikker, W.
- Affiliations
- Affymetrix (United States) (US)
- Illumina (United States) (US)
- Agilent Technologies (United States) (US)
- National Cancer Institute (US)
- National Center for Toxicological Research (US)
- Environmental Protection Agency (US)
- United States Food and Drug Administration (US)
- National Institutes of Health (US)
- University of Massachusetts Boston (US)
- Asuragen (United States) (US)
- Center for Biologics Evaluation and Research (US)
- Cedars-Sinai Medical Center (US)
- SAS Institute (United States) (US)
- Center for Food Safety and Applied Nutrition (US)
- Biogen (United States) (US)
- Yale University (US)
- Center for Veterinary Medicine (US)
- Cold Spring Harbor Laboratory (US)
- Sanford Burnham Prebys Medical Discovery Institute (US)
- Stanford Medicine (US)
- Harvard University (US)
- Vanderbilt University (US)
- The University of Texas Southwestern Medical Center (US)
- The University of Texas at Dallas (US)
- GenUs BioSystems (United States) (US)
- Oslo University Hospital (NO)
- The University of Texas MD Anderson Cancer Center (US)
- Luminex (United States) (US)
- Wake Forest University Health Sciences (US)
- University of Illinois Urbana-Champaign (US)
- ORCID
- Jones, Wendell D
- Collins, Patrick J
- Luo, Yuling
- Sun, Yongming Andrew
- Willey, James C
- Tong, Weida
- Frueh, Felix W
- Goodsaid, Federico M
- Johnson, Charles D
- Puri, Raj K
- Scherf, Uwe
- Wang, Charles
- Bao, Wenjun
- Brown, Donna
- Chen, James J
- Cheng, Jing
- Corton, J Christopher
- Croner, Lisa J
- Deng, Xutao
- Eklund, Aron C
- Fang, Hong
- Guo, Lei
- Guo, Xu
- Han, Jing
- Han, Tao
- Harbottle, Heather C
- Harris, Stephen C
- Hatchwell, Eli
- Hester, Susan
- Hong, Huixiao
- Jackson, Scott A
- Ji, Hanlee
- Levy, Shawn
- Li, Quan-Zhen
- Liu, Chunmei
- Liu, Ying
- Ma, Yunqing
- Mei, Nan
- Myklebost, Ola
- Ning, Baitang
- Patterson, Tucker A
- Pusztai, Lajos
- Qian, Feng
- Schroth, Gary P
- Su, Zhenqiang
- Sun, Hongmei
- Tikhonova, Irina
- Turpaz, Yaron
- Walker, Stephen J
- Wang, Sue Jane
- Wang, Yonghong
- Wong, Alex
- Wu, Jie
- Xiao, Chunlin
- Xie, Qian
- Xu, Jun
- Yang, Wen
- Zhang, Liang
- Zhong, Sheng
- Slikker, William
- Venue
- Nature Biotechnology
- Published
- 2006-09-01
- Volume
- 24
- Issue
- 9
- Pages
- 1151-1161
- ISSN
- 0733-222X (ISSN-L)
- 1087-0156
- 1546-1696
- PMC
- PMC3272078
- OpenAlex
- W2010637767
- Cited by
- 2,126
- References
- 43
- Citations by year
- 2026: 21 · 2025: 25 · 2024: 23 · 2023: 39 · 2022: 37 · 2021: 60 · 2020: 43 · 2019: 59 · 2018: 68 · 2017: 87 · 2016: 87 · 2015: 98 · 2014: 122 · 2013: 155 · 2012: 160
- FWCI
- 87.96
- Type
- journal article
- Language
- en
- Open access
- green
- www.ncbi.nlm.nih.gov
- Licence
- www.springer.com/tdm (tdm)
- www.springer.com/tdm (vor)
- Locations
- Nature Biotechnology (publishedVersion)
- PubMed (publishedVersion)
- Europe PMC (PubMed Central) (acceptedVersion)
- PubMed Central (acceptedVersion)
- Digital Access to Libraries (Université catholique de Louvain (UCL), l'Université de Namur (UNamur) and the Université Saint-Louis (USL-B)) (submittedVersion)
- Funders
- U.S. Environmental Protection Agency
- National Institutes of Health (Z99 LM999999, Z99 HL999999, Z99 MH999999, Z99CL999999)
- Topics
- Life Sciences › Biochemistry, Genetics and Molecular Biology › Molecular Biology › Gene expression and cancer classification
- Life Sciences › Biochemistry, Genetics and Molecular Biology › Molecular Biology › Molecular Biology Techniques and Applications
- Life Sciences › Biochemistry, Genetics and Molecular Biology › Molecular Biology › Genomics and Phylogenetic Studies
- Keywords
- probe mapping, differentially expressed genes, microarray data analysis
- MeSH terms
- Equipment Design, Quality Assurance, Health Care, Quality Control, Sensitivity and Specificity, United States, Reproducibility of Results, Equipment Failure Analysis, Oligonucleotide Array Sequence Analysis, Gene Expression Profiling
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.