The MicroArray Quality Control (MAQC) project shows inter- and intraplatform reproducibility of gene expression measurements
Open accessThe DOI matches its Crossref record; 43 of the 43 references it cites were found in a registry or an index.
Abstract
Over the last decade, the introduction of microarray technology has had a profound impact on gene expression research. The publication of studies with dissimilar or altogether contradictory results, obtained using different microarray platforms to analyze identical RNA samples, has raised concerns about the reliability of this technology. The MicroArray Quality Control (MAQC) project was initiated to address these concerns, as well as other performance and data analysis issues. Expression data on four titration pools from two distinct reference RNA samples were generated at multiple test sites using a variety of microarray-based and alternative technology platforms. Here we describe the experimental design and probe mapping efforts behind the MAQC project. We show intraplatform consistency across test sites as well as a high level of interplatform concordance in terms of genes identified as differentially expressed. This study provides a resource that represents an important first step toward establishing a framework for the use of microarrays in clinical and regulatory settings.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Next, we applied the |log 2 fold-change|>1 filter advocated in the MAQC study on microarrays, 10 and for microarrays observed a reduction in the eFDR to below 1.5%, save for one outlier site (Figs 3c,d).”
From A comprehensive assessment of RNA-seq accuracy, reproducibility and information content by the Sequencing Quality Control Consortium (2014) · cites this paper as [10]
In the citing paper
“Studies on microarrays have shown that results of typical statistical differential expression tests thresholded by p -value need to be filtered and sorted by effect strength (fold-change) in order to attain robust comparisons across platforms and sites. 10”
From A comprehensive assessment of RNA-seq accuracy, reproducibility and information content by the Sequencing Quality Control Consortium (2014) · cites this paper as [10]
In the citing paper
“The Microarray Quality Control (MAQC) Consortium landmark study10 examined the degree of variance within and across many different microarray platforms and found similar coefficients of variation between platforms.”
From Multi-platform assessment of transcriptome profiling using RNA-seq in the ABRF next-generation sequencing study (2014) · cites this paper as [10]
In the citing paper
“prior work comparing microarray platforms and methods showed high levels of inter-platform concordance for the ability to detect differentially expressed genes.”
From Multi-platform assessment of transcriptome profiling using RNA-seq in the ABRF next-generation sequencing study (2014) · cites this paper as [10]
Citations
Cites
In silico prediction of protein-protein interactions in human macrophages
Souiai, O., Guerfali, F., Ben Miled, S., Brun, C., & Benkahla, A. (2014) · BMC Research Notes · doi:10.1186/1756-0500-7-157 · Cited by 10,803
Significance analysis of microarrays applied to the ionizing radiation response
Tusher, V. G., Tibshirani, R., & Chu, G. (2001) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.091062498 · Cited by 10,568
Pruitt, K. D., Tatusova, T., & Maglott, D. R. (2007) · Nucleic Acids Research · doi:10.1093/nar/gkl842 · Cited by 4,481 · cited 1×
“We mapped the probes (see Supplementary Methods online and Supplementary Notes online) to the RefSeq human mRNA databas”
Method"Stemness": Transcriptional Profiling of Embryonic and Adult Stem Cells
Ramalho-Santos, M., Yoon, S., Matsuzaki, Y., Mulligan, R. C., & Melton, D. A. (2002) · Science · doi:10.1126/science.1072530 · Cited by 1,709
Pruitt, K. D. (2004) · Nucleic Acids Research · doi:10.1093/nar/gki025 · Cited by 1,660 · cited 1×
“We mapped the probes (see Supplementary Methods online and Supplementary Notes online) to the RefSeq human mRNA database 31 (http://www.ncbi.nlm.nih.gov/RefSeq) and to the AceView database 32 (http://www.ncbi.nlm.nih.gov/IEB/Research/Acembly), a less curated but more comprehensive database, which…”
MethodA Stem Cell Molecular Signature
Ivanova, N. B., Dimos, J. T., Schaniel, C., Hackney, J. A., Moore, K. A., & Lemischka, I. R. (2002) · Science · doi:10.1126/science.1073823 · Cited by 1,542
Prediction of cancer outcome with microarrays: a multiple random validation strategy
Michiels, S., Koscielny, S., & Hill, C. (2005) · The Lancet · doi:10.1016/s0140-6736(05)17866-0 · Cited by 1,025 · cited 1×
“, raising doubts about the repeatability, reproducibility and comparability of microarray technolog”
BackgroundMultiple-laboratory comparison of microarray platforms
Irizarry, R. A., Warren, D., Spencer, F., Kim, I. F., Biswal, S., Frank, B. C., Gabrielson, E., Garcia, J. G. N., Geoghegan, J., Germino, G., et al. (2005) · Nature Methods · doi:10.1038/nmeth756 · Cited by 862
Self-citationEvaluation of gene expression measurements from commercial microarray platforms
Tan, P. K. (2003) · Nucleic Acids Research · doi:10.1093/nar/gkg763 · Cited by 706
Thousands of samples are needed to generate a robust gene list for predicting outcome in cancer
Ein-Dor, L., Zuk, O., & Domany, E. (2006) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0601231103 · Cited by 689 · cited 1×
“…to appear in peer-reviewed journals 9,10 , raising doubts about the repeatability, reproducibility and comparability of microarray technology 11–13 , several studies have also been recently published showing increased reproducibility of microarray data generated at different test sites and/or…”
Background
Research works printed but not linked: 1
- Reid, L.H. The value of a proficiency testing program to monitor performance in microarray laboratories. Pharm. Discov. 5, 20–25 (2005).
Cited by
Items 701–800 of 1,004
Kitchen, R. R., Sabine, V. S., Sims, A. H., Macaskill, E. J., Renshaw, L., Thomas, J. S., van Hemert, J. I., Dixon, J. M., & Bartlett, J. M. (2010) · BMC Genomics · doi:10.1186/1471-2164-11-134 · Cited by 31
“Shi L, Reid LH, Jones WD, Shippy R, Warrington JA, Baker SC, Collins PJ, de Longueville F, Kawasaki ES, Lee KY, et al: The MicroArray Quality Control (MAQC) project shows inter- and intraplatform reproducibility of gene expression measurements.”
BackgroundResultInfluentialGain-of-function miRNA signature by mutant p53 associates with poor cancer outcome
Zhang, Y., Hu, Y., Fang, J., & Xu, J. (2016) · Oncotarget · doi:10.18632/oncotarget.7090 · Cited by 34
Self-citationA Designed Peptide Targets Two Types of Modifications of p53 with Anti-cancer Activity
Liang, L., Wang, H., Shi, H., Li, Z., Yao, H., Bu, Z., Song, N., Li, C., Xiang, D., Zhang, Y., et al. (2018) · Cell chemical biology · doi:10.1016/j.chembiol.2018.03.010 · Cited by 35
Self-citationLiu, Z., Wang, T., Yang, X., Zhou, Q., Zhu, S., Zeng, J., Chen, H., Sun, J., Li, L., Xu, J., et al. (2022) · Clinical and Translational Medicine · doi:10.1002/ctm2.987 · Cited by 35
Self-citationKomatsu, N., Matsueda, S., Tashiro, K., Ioji, T., Shichijo, S., Noguchi, M., Yamada, A., Doi, A., Suekane, S., Moriya, F., et al. (2011) · Cancer · doi:10.1002/cncr.26636 · Cited by 38
“To assess the differential gene expression between the long-term and short-term survivors, we used the fold-change ranking, together with the P values, using the Linear Models for Microarray Data (Limma) Bioconductor package.(29) To determine the fold-change in the gene expression of the samples from the long-term sur…”
MethodHebels, D. G. A. J., Sveje, K. M., de Kok, M. C., van Herwijnen, M. H. M., Kuhnle, G., Engels, L. G. J. B., Vleugels-Simon, C. B. E. M., Mares, W. G. N., Pierik, M. J., Masclee, A., et al. (2011) · Cancer Letters · doi:10.1016/j.canlet.2011.05.007 · Cited by 35
Stokes, T. H., Moffitt, A. B., Phan, J. H., & Wang, M. D. (2007) · Annals of Biomedical Engineering · doi:10.1007/s10439-007-9313-y · Cited by 34
A robust method for estimating gene expression states using Affymetrix microarray probe level data
Ohtaki, M., Otani, K., Hiyama, K., Kamei, N., Satoh, K., & Hiyama, E. (2010) · BMC Bioinformatics · doi:10.1186/1471-2105-11-183 · Cited by 35
“Recent completion of the MicroArray Quality Control (MAQC) project ensures intra-platform consistency across test sites as well as a high level of interplatform concordance [1].”
BackgroundGodehardt, A. W., Costa, M. R., & Tönjes, R. R. (2015) · Xenotransplantation · doi:10.1111/xen.12154 · Cited by 36
Ji, R., de Silva, H., Jin, Y., Bruccoleri, R. E., Cao, J., He, A., Huang, W., Kayne, P. S., Neuhaus, I. M., Ott, K., et al. (2009) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1000512 · Cited by 35
“In contrast, transcription profiling experiments are typically performed using replicate treatments at one dose, and effects are identified by analysis of variance [2].”
MethodBiomarkers of Nutrient Bioactivity and Efficacy: A Route Toward Personalized Nutrition
Rubio‐Aliaga, I., Kochhar, S., & Silva‐Zolezzi, I. (2012) · Journal of Clinical Gastroenterology · doi:10.1097/mcg.0b013e3182548df2 · Cited by 40
Microarray analysis of gene expression during early development: a cautionary overview
Robert, C. (2010) · Reproduction · doi:10.1530/rep-10-0191 · Cited by 34
“The use of spikes for microarray data normalization has been proposed (Baker et al. 2005, Shi et al. 2006) and could represent one method of normalization for across-stage comparisons.”
MethodChain, B., Bowen, H. C., Hammond, J. P., Posch, W., Rasaiyaah, J., Tsang, J., & Noursadeghi, M. (2010) · BMC Bioinformatics · doi:10.1186/1471-2105-11-344 · Cited by 35
“The reproducibility and compa-rability of several different platforms has been rigorously examined in the MAQC project, and overall the different platforms give reassuringly similar results, with similar accuracy and sensitivities [1].”
ResultLee, C., Sunkin, S. M., Kuan, C. L., Thompson, C. L., Pathak, D. S., Ng, L., Lau, C., Fischer, S. R., Mortrud, M. T., Slaughterbeck, C., et al. (2008) · Genome biology · doi:10.1186/gb-2008-9-1-r23 · Cited by 38
“GNF and Teragenomics microarray data sets Several studies to date have investigated the relative internal consistency of microarray platforms under a variety of experimental conditions [28-33,54-56], and high degrees of within platform consistency have been reported for Affymetrix oligonucleotide microarrays [28,39,41…”
BackgroundÇolak, D., Chishti, M. A., AlBakheet, A., Al-Qahtani, A. A., Shoukri, M. M., Goyns, M. H., Ozand, P. T., Quackenbush, J. F., Park, B. H., & Kaya, N. (2010) · Molecular Cancer · doi:10.1186/1476-4598-9-146 · Cited by 36
“, in which gene lists ranked by fold change and filtered with non-stringent statistically significant tests were more reproducible across platforms than those generated through other analytical procedures [43,44].”
MethodIdentifying siRNA-Induced Off-Targets by Microarray Analysis
Anderson, E. M., Boese, Q., Khvorova, A., & Karpilow, J. M. (2008) · Methods in molecular biology · doi:10.1007/978-1-59745-191-8_4 · Cited by 34
Ning, B., Dial, S. L., Sun, Y., Wang, J., Yang, J., & Guo, L. (2008) · SLAS DISCOVERY · doi:10.1177/1087057108315513 · Cited by 38
“We also assessed the technical performance and reproducibility of the PCR Array by comparing our data to the TaqMan data generated from the MicroArray Quality Control study (MAQC).(8,9)”
MethodSelf-citationGenomic expression during human myelopoiesis
Ferrari, F., Bortoluzzi, S., Coppe, A., Basso, D., Bicciato, S., Zini, R., Gemelli, C., Danieli, G. A., & Ferrari, S. (2007) · BMC Genomics · doi:10.1186/1471-2164-8-264 · Cited by 33
“HG-U133A, thus exploiting the high reliability and reproducibility of Affymetrix chips [59,60] and avoiding possible biases due to platform comparisons.”
BackgroundKerkhoven, R. M., Sie, D., Nieuwland, M., Heimerikx, M., de Ronde, J., Brugman, W., & Velds, A. (2008) · PLoS ONE · doi:10.1371/journal.pone.0001980 · Cited by 33
Promiscuity of enhancer, coding and non-coding transcription functions in ultraconserved elements
Licastro, D., Gennarino, V. A., Petrera, F., Sanges, R., Banfi, S., & Stupka, E. (2010) · BMC Genomics · doi:10.1186/1471-2164-11-151 · Cited by 33
“A cut off after the adjustment of P-values to control the false discovery rate (FDR) [23] was set to p 24 ].”
MethodCheng, W., Tsai, M., Chang, C.-W., Huang, C.-L., Chen, C.-R., Shu, W., Lee, Y., Wang, T., Hong, J., Li, C., et al. (2010) · BMC Bioinformatics · doi:10.1186/1471-2105-11-421 · Cited by 33
Kamyshna, I. I., Korda, M. M., Krynytska, І., & Kamyshnyi, O. (2020) · Endocrine Regulations · doi:10.2478/enr-2020-0013 · Cited by 35
“The Microarray Quality Control (MAQC) published results indicating that a ranked list of genes based on fold-change and such a p-value calculation was sufficient to demonstrate reproducible results across multiple microarrays and PCR Arrays including the RT2 Profiler PCR Arrays (Shi et al. 2006).”
MethodZhang, J., Zhang, Y., Xia, Y., & Sun, J. (2021) · Gut Microbes · doi:10.1080/19490976.2021.1957408 · Cited by 36
“The log2 foldchanges were reported as the effect sizes in comparisons between groups.(100) The statistical analyses for microbiome and metabolomic data were performed using R,(101) R packages of ampvis2, microbiome, phyloseq and vegan,(41) as well as ggplot2(102) and ggpubr packages.”
MethodRao, M. R., Halfhill, M. D., Abercrombie, L. L., Ranjan, P., Abercrombie, J. M., Gouffon, J. S., Saxton, A. M., & Stewart, C. N. (2009) · Functional & Integrative Genomics · doi:10.1007/s10142-009-0125-z · Cited by 36
“However, there are also studies showing reproducibility among platforms (Larkin et al. 2005; Petersen et al. 2005; Shi et al. 2006).”
BackgroundExploring the mechanisms of DNA hybridization on a surface
Schmitt, T. J., Rogers, J. B., & Knotts, T. A. (2013) · The Journal of Chemical Physics · doi:10.1063/1.4775480 · Cited by 33
Detection call algorithms for high-throughput gene expression microarray data
Archer, K. J., & Reese, S. E. (2009) · Briefings in Bioinformatics · doi:10.1093/bib/bbp055 · Cited by 39
“dimension reduction or filtering [5–11].”
Ponzielli, R., Boutros, P. C., Katz, S., Stojanova, A., Hanley, A. P., Khosravi, F., Bros, C., Jurišica, I., & Penn, L. Z. (2008) · Nucleic Acids Research · doi:10.1093/nar/gkn735 · Cited by 35
“Many previous studies of microarray reproducibility have employed spike-in or mixture designs (23,31,33,35), but it is unclear if spike-in or mixture experiments reproduce the underlying complexity of real biological samples.”
BackgroundSensitivity, specificity, and reproducibility of RNA-Seq differential expression calls
Łabaj, P. P., & Kreil, D. P. (2016) · Biology Direct · doi:10.1186/s13062-016-0169-7 · Cited by 39
“• (introduction) would be good to explain more why " considering subtle signals " is important Author response: We have extended the text accordingly: " This pair of samples has the smallest average effect strength ('signal') amongst the different possible pair-wise comparisons of the MAQC/SEQC A, B, C, and D, allowin…”
InfluentialGenomic and Metabolomic Advances in the Identification of Disease and Adverse Event Biomarkers
Mendrick, D. L., & Schnackenberg, L. K. (2009) · Biomarkers in Medicine · doi:10.2217/bmm.09.43 · Cited by 33
Biomarkers for Alzheimer Disease in Cerebrospinal Fluid, Urine, and Blood
Lönneborg, A. (2008) · Molecular Diagnosis & Therapy · doi:10.1007/bf03256296 · Cited by 36
Wang, L., & Janes, K. A. (2013) · Nature Protocols · doi:10.1038/nprot.2012.158 · Cited by 32
Network information improves cancer outcome prediction
Roy, J., Winter, C., Işık, Z., & Schroeder, M. (2012) · Briefings in Bioinformatics · doi:10.1093/bib/bbs083 · Cited by 32
“On the other hand, a large study of over 50 groups came to the conclusion that technical noise in microarrays is low [7].”
BackgroundIdentification of early liver toxicity gene biomarkers using comparative supervised machine learning
Smith, B., Auvil, L., Welge, M., Bushell, C. B., Bhargava, R., Elango, N., Johnson, K., & Madak-Erdoğan, Z. (2020) · Scientific Reports · doi:10.1038/s41598-020-76129-8 · Cited by 24
Impact of gene annotation choice on the quantification of RNA-seq data
Chisanga, D., Liao, Y., & Shi, W. (2022) · BMC Bioinformatics · doi:10.1186/s12859-022-04644-8 · Cited by 39
“The TaqMan RT-PCR dataset generated in the MAQC study [14, 15] was used to validate the gene-level quantification results from the RNA-seq dataset.”
MethodInfluentialOn the Reproducibility of TCGA Ovarian Cancer MicroRNA Profiles
Wan, Y., Mach, C. M., Allen, G. I., Anderson, M. L., & Liu, Z. (2014) · PLoS ONE · doi:10.1371/journal.pone.0087782 · Cited by 33
Array of hope: expression profiling identifies disease biomarkers and mechanism
Bhattacharya, S., & Mariani, T. J. (2009) · Biochemical Society Transactions · doi:10.1042/bst0370855 · Cited by 33
Ryan, J. C., Wu, Q., & Shoemaker, R. C. (2015) · BMC Medical Genomics · doi:10.1186/s12920-015-0089-x · Cited by 32
Baban, D. F., & Davies, K. E. (2008) · Neuromuscular Disorders · doi:10.1016/j.nmd.2007.11.011 · Cited by 38
A new approach to bias correction in RNA-Seq
Jones, D. C., Ruzzo, W. L., Peng, X., & Katze, M. G. (2012) · Bioinformatics · doi:10.1093/bioinformatics/bts055 · Cited by 35
Gene-expression profiling in pancreatic cancer
Lopez-Casas, P. P., & López-Fernández, L. A. (2010) · Expert Review of Molecular Diagnostics · doi:10.1586/erm.10.43 · Cited by 32
Molecular Subtyping of Pancreatic Cancer: Translating Genomics and Transcriptomics into the Clinic
Du, Y., Zhao, B., Liu, Z., Ren, X., Zhao, W., Li, Z., You, L., & Zhao, Y. (2017) · Journal of Cancer · doi:10.7150/jca.17622 · Cited by 32
A cross-laboratory comparison of expression profiling data from normal human postmortem brain
Mistry, M., & Pavlidis, P. (2010) · Neuroscience · doi:10.1016/j.neuroscience.2010.01.016 · Cited by 34
Increasing the Robustness and Validity of RNAi Screens
Haney, S. A. (2007) · Pharmacogenomics · doi:10.2217/14622416.8.8.1037 · Cited by 35
Clinical Impact of High-Throughput Gene Expression Studies in Lung Cancer
Beane, J., Spira, A. E., & Lenburg, M. E. (2009) · Journal of Thoracic Oncology · doi:10.1097/jto.0b013e31819151f8 · Cited by 33
Currie, R. A. (2012) · Mutation Research/Genetic Toxicology and Environmental Mutagenesis · doi:10.1016/j.mrgentox.2012.03.002 · Cited by 31
Critical comments for roles of biomarkers in the diagnosis and treatment of cancer
Saijo, N. (2011) · Cancer Treatment Reviews · doi:10.1016/j.ctrv.2011.02.004 · Cited by 35
Highly sensitive amplicon-based transcript quantification by semiconductor sequencing
Zhang, J. D., Schindler, T., Küng, E., Ebeling, M., & Certa, U. (2014) · BMC Genomics · doi:10.1186/1471-2164-15-565 · Cited by 32
“The observed inter-sample variation is in the range of established RNA profiling technologies such as qPCR (1% ~ 15%; [16,17]) microarray (5% ~ 15%; [18]) or quantitative RNA sequencing (10% ~ 15%; [19]).”
BackgroundSinha, R., Ahsan, H., Blaser, M. J., Caporaso, J. G., Carmical, J. R., Chan, A. T., Fodor, A. A., Gail, M. H., Harris, C. C., Helzlsouer, K. J., et al. (2018) · Microbiome · doi:10.1186/s40168-018-0596-z · Cited by 34
Assessment of pharmacogenomic agreement
Safikhani, Z., El-Hachem, N., Quevedo, R., Smirnov, P., Goldenberg, A., Birkbak, N. J., Mason, C. E., Hatzis, C., Shi, L. M., Aerts, H. J. W. L., et al. (2016) · F1000Research · doi:10.12688/f1000research.8705.1 · Cited by 33
Self-citationYu, K., Jiang, Y., Hao, S., & Shao, Z.-M. (2015) · BMC Medicine · doi:10.1186/s12916-015-0496-z · Cited by 36
“[21].”
Transcriptomics: a Sword to Cut the Gordian knot of Traditional Chinese Medicine
Liu, Y., Ai, N., Liao, J., & Fan, X. (2015) · Biomarkers in Medicine · doi:10.2217/bmm.15.91 · Cited by 31
Self-citationAbnormal gene expression in cerebellum of Npc1−/− mice during postnatal development
Liao, G., Wen, Z., Irizarry, K. J. L., Huang, Y. S., Mitsouras, K., Darmani, M., Leon, T. L., Shi, L. M., & Bi, X. (2010) · Brain Research · doi:10.1016/j.brainres.2010.02.019 · Cited by 32
“Intensity data were then adjusted to set the minimum intensity of an array equal to 1; this converts every data point into a positive value and allows for logarithmic transformation of the data before statistical analysis (Shi et al., 2006).”
MethodSelf-citationCawthorn, T. R., Amir, E., Broom, R. J., Freedman, O., Gianfelice, D., Barth, D. S., Wang, D., Holen, I., Done, S. J., & Clemons, M. J. (2009) · Clinical & Experimental Metastasis · doi:10.1007/s10585-009-9284-5 · Cited by 31
“The normalized intensity values from the two platforms were adjusted using previously described techniques [21].”
MethodWright, C. M., Francis, S. M. S., Tan, M. E., Martins, M. U., Winterford, C. M., Davidson, M. R., Duhig, E., Clarke, B. E., Hayward, N. K., Yang, I. A., et al. (2012) · PLoS ONE · doi:10.1371/journal.pone.0034943 · Cited by 32
“Despite the fact that the Illumina platform has been shown to be highly correlated with Taqman technology [14], only two of the top six differentially expressed genes selected on p-value and magnitude of expression difference (MS4A1 and CARD18) were verified by the independent method of qRT-PCR.”
MethodGene expression profiling and prediction of clinical outcome in ovarian cancer
Sabatier, R., Finetti, P., Cervera, N., Birnbaum, D., & Bertucci, F. (2009) · Critical Reviews in Oncology/Hematology · doi:10.1016/j.critrevonc.2009.01.007 · Cited by 32
Caboche, S., Audebert, C., & Hot, D. (2014) · Pathogens · doi:10.3390/pathogens3020258 · Cited by 31
“In order to take into account the caveats in reliability and reproducibility of the data generated by microarray experiments, the Food and Drug Administration (FDA) decided, in 2005, to launch the MicroArray Quality Control (MAQC) project [3].”
BackgroundLu, L., Wei, L., Peirce, J. L., Wang, X., Zhou, J., Homayouni, R., Williams, R. W., & Airey, D. C. (2008) · BMC Genomics · doi:10.1186/1471-2164-9-444 · Cited by 32
On hyperbolic transformations to normality
Tsai, A. C.-H., Liou, M., Simak, M., & Cheng, P. E. (2017) · Computational Statistics & Data Analysis · doi:10.1016/j.csda.2017.06.001 · Cited by 37
The international MAQC Society launches to enhance reproducibility of high-throughput technologies
Shi, L. M., Kusko, R. L., Wolfinger, R. D., Haibe‐Kains, B., Fischer, M., Sansone, S., Mason, C. E., Furlanello, C., Jones, W. D., Ning, B., et al. (2017) · Nature Biotechnology · doi:10.1038/nbt.4029 · Cited by 31
Self-citationHigh-throughput antibody microarrays for quantitative proteomic analysis
Lv, L., & Liu, B. (2007) · Expert Review of Proteomics · doi:10.1586/14789450.4.4.505 · Cited by 31
Transcriptomic profiling of rat liver samples in a comprehensive study design by RNA-Seq
Gong, B., Wang, C., Su, Z., Hong, H., Thierry‐Mieg, J., Thierry‐Mieg, D., Shi, L. M., Auerbach, S. S., Tong, W., & Xu, J. (2014) · Scientific Data · doi:10.1038/sdata.2014.21 · Cited by 32
Self-citationBi, Y., & Davuluri, R. V. (2013) · BMC Bioinformatics · doi:10.1186/1471-2105-14-262 · Cited by 30
“We first applied NPEBSeq on the MicroArray quality control (MAQC) dataset [40,41] and compared with DESeq, baySeq, and edgeR.”
MethodGong, X., Su, L., Huang, J., Liu, J., Wang, Q., Luo, X., Yang, G., & Chi, H. (2024) · Frontiers in Immunology · doi:10.3389/fimmu.2024.1381272 · Cited by 37
Lonardi, E., Balog, C. I. A., Deelder, A. M., & Wuhrer, M. (2010) · Expert Review of Proteomics · doi:10.1586/epr.10.41 · Cited by 30
Elo, L. L., Hiissa, J., Tuimala, J., Kallio, A., Korpelainen, E., & Aittokallio, T. (2009) · Briefings in Bioinformatics · doi:10.1093/bib/bbp033 · Cited by 30
“…the original study showed, by means of standardized protocols on human RNA samples, that reproducible gene lists can be obtained by using the simple fold-change as the primary ranking statistic, while the statistical significance of the findings was considered as a less important criterion [15].”
Variation-preserving normalization unveils blind spots in gene expression profiling
Roca, C. P., Gomes, S. I. L., Amorim, M. J. B., & Scott-Fordsmand, J. J. (2017) · Scientific Reports · doi:10.1038/srep42460 · Cited by 32
“Furthermore, results obtained with other technologies, particularly qRT-PCR, suggest that it may not be valid (Shi et al., 2006; Bullard et al., 2010).”
Normalization strategies for mRNA expression data in cartilage research
Fundel, K., Haag, J., Gebhard, P. M., Zimmer, R., & Aigner, T. G. (2008) · Osteoarthritis and Cartilage · doi:10.1016/j.joca.2007.12.007 · Cited by 30
Armstrong, T. A., Chen, H., Ziegler, T. E., Iyadurai, K. R., Gao, A.-G., Wang, Y., Song, Z., Tian, Q., Zhang, Q., Ward, J., et al. (2013) · Journal of Agricultural and Food Chemistry · doi:10.1021/jf4031458 · Cited by 34
Self-citationKarli, P., Martlé, V., Bossens, K., Summerfield, A., Doherr, M. G., Turner, P., Vandevelde, M., Forterre, F., & Henke, D. (2014) · The Spine Journal · doi:10.1016/j.spinee.2014.05.021 · Cited by 31
Gene Expression Correlates of Postinfective Fatigue Syndrome after Infectious Mononucleosis
Cameron, B., Galbraith, S., Zhang, Y., Davenport, T. A., Vollmer-Conna, U. S., Wakefield, D., Hickie, I. B., Dunsmuir, W. T. M., Whistler, T., Vernon, S. D., et al. (2007) · The Journal of Infectious Diseases · doi:10.1086/518614 · Cited by 30
“Gene Expression in Postinfective Fatigue • JID 2007:196 (1 July) • 65 consistency across test sites as well as a high level of interplatform concordance in terms of genes identified as being differentially expressed [ 31 ].”
BackgroundGalbraith, S., Cameron, B., Li, H., Lau, D., Vollmer-Conna, U. S., & Lloyd, A. R. (2011) · The Journal of Infectious Diseases · doi:10.1093/infdis/jir612 · Cited by 33
“The former relates to issues such as variations in the timing of blood sample collection linked to circadian influences on gene expression [42]; appropriate ex vivo handling of the peripheral blood samples to minimize the possibility of endotoxin contamination and leukocyte activation [43]; and run-to-run variation in…”
BackgroundAntigen Microarrays for the Study of Autoimmune Diseases
Yeste, A., & Quintana, F. J. (2013) · Clinical Chemistry · doi:10.1373/clinchem.2012.194423 · Cited by 33
Begemann, M., Sargin, D., Rossner, M. J., Bartels, C., Theis, F. J., Wickert, S. P., Stender, N., Fischer, B., Sperling, S., Stawicki, S., et al. (2008) · Molecular Medicine · doi:10.2119/2008-00053.begemann · Cited by 30
“0 (Affymetrix, Santa Clara, CA, USA) (8) according to the published protocols (9).”
BackgroundDeconvoluting the ‘omics’ for organ transplantation
Sarwal, M. (2009) · Current Opinion in Organ Transplantation · doi:10.1097/mot.0b013e32833068fb · Cited by 30
Liu, F., Zou, X., Sadovova, N., Zhang, X., Shi, L., Guo, L., Qian, F., Wen, Z., Patterson, T. A., Hanig, J. P., et al. (2010) · International Journal of Developmental Neuroscience · doi:10.1016/j.ijdevneu.2010.07.234 · Cited by 35
Self-citationUnsupervised feature selection under perturbations: meeting the challenges of biological data
Varshavsky, R., Gottlieb, A., Horn, D., & Linial, M. (2007) · Bioinformatics · doi:10.1093/bioinformatics/btm528 · Cited by 30
“Similar qualitative results have been obtained by ( Scheel, et al., 2005 ) in a supervised selection task.”
BackgroundMethodResultInfluentialWierinckx, A., Raverot, G., Nazaret, N., Jouanneau, E., Auger, C., Lachuer, J., & Trouillas, J. (2010) · Molecular and Cellular Endocrinology · doi:10.1016/j.mce.2010.02.043 · Cited by 29
Breast Cancer Prognostic Biomarker Using Attractor Metagenes and the FGD3–SUSD3 Metagene
Yang, T.-H. O., Cheng, W., Zheng, T., Maurer, M., & Anastassiou, D. (2014) · Cancer Epidemiology Biomarkers & Prevention · doi:10.1158/1055-9965.epi-14-0399 · Cited by 29
“cordance in terms of genes identified as differentially expressed was demonstrated (22) by comparing three RT-PCR platforms and seven microarrays, including”
RNA sequencing of blood in coronary artery disease: involvement of regulatory T cell imbalance
McCaffrey, T. A., Toma, I., Yang, Z., Katz, R. J., Reiner, J. S., Mazhari, R., Shah, P. M., Tackett, M., Jones, D. R., Jepson, T., et al. (2021) · BMC Medical Genomics · doi:10.1186/s12920-021-01062-2 · Cited by 31
Gene expression microarray data analysis demystified
Roberts, P. C. (2008) · Biotechnology annual review · doi:10.1016/s1387-2656(08)00002-1 · Cited by 32
Budczies, J., Kosztyla, D., von Törne, C., Stenzinger, A., Drab-Esfahani, S., Dietel, M., & Denkert, C. (2014) · Journal of Statistical Software · doi:10.18637/jss.v059.i01 · Cited by 29
Microarray Technology: A Promising Tool in Nutrigenomics
Masotti, A., Sacco, L. D., Bottazzo, G. F., & Alisi, A. (2010) · Critical Reviews in Food Science and Nutrition · doi:10.1080/10408390903044156 · Cited by 34
Simultaneous Profiling of 194 Distinct Receptor Transcripts in Human Cells
Kang, B. H., Jensen, K., Hatch, J. A., & Janes, K. A. (2013) · Science Signaling · doi:10.1126/scisignal.2003624 · Cited by 29
Klopfleisch, R., & Gruber, A. (2012) · TheScientificWorldJournal · doi:10.1100/2012/254962 · Cited by 24
“Each of the detected spots on the acrylamide gel theoretically consists of one protein species, and each cell or condition of a cell is theoretically associated with a specific pattern of these spots on the gel.”
BackgroundMethodEvolutionary medicine: A meaningful connection between omics, disease, and treatment
Abu-Asab, M. S., Chaouchi, M., & Amri, H. (2008) · PROTEOMICS - CLINICAL APPLICATIONS · doi:10.1002/prca.200780047 · Cited by 29
Consistent annotation of gene expression arrays
Ballester, B., Johnson, N., Proctor, G., & Flicek, P. (2010) · BMC Genomics · doi:10.1186/1471-2164-11-294 · Cited by 29
DNA microarray-based gene expression profiling of estrogenic chemicals
Kiyama, R., & Zhu, Y. (2014) · Cellular and Molecular Life Sciences · doi:10.1007/s00018-013-1544-5 · Cited by 30
Gene expression profiling of non-small-cell lung cancer
Lacroix, L., Commo, F., & Soria, J. (2008) · Expert Review of Molecular Diagnostics · doi:10.1586/14737159.8.2.167 · Cited by 29
Biomarkers Downstream of RAS: A Search for Robust Transcriptional Targets
Győrffy, B., & Schäfer, R. (2010) · Current Cancer Drug Targets · doi:10.2174/156800910793357916 · Cited by 31
Niesen, C. E., Xu, J., Fan, X., Li, X., Wheeler, C. J., Mamelak, A. N., & Wang, C. (2013) · PLoS ONE · doi:10.1371/journal.pone.0056077 · Cited by 30
Self-citationStagg, N. J., LeBaron, M. J., Eisenbrandt, D. L., Gollapudi, B. B., & Klaunig, J. E. (2012) · Toxicological Sciences · doi:10.1093/toxsci/kfs157 · Cited by 29
The MAP Kinase Phosphatase-1 MKP-1/DUSP1 Is a Regulator of Human Liver Response to Transplantation
Boutros, T., Nantel, A., Emadali, A., Tzimas, G. N., Conzen, S. D., Chevet, É., & Metrakos, P. P. (2008) · American Journal of Transplantation · doi:10.1111/j.1600-6143.2008.02420.x · Cited by 29
“The genes with the lower fold increase were not listed (6); and (v) although our study and the Conti and the Defamie studies use microarray chips from different sources, this may not account for difference in results (21,22).”
ResultDabney, A. R., & Storey, J. D. (2007) · Genome biology · doi:10.1186/gb-2007-8-3-r44 · Cited by 29
“Microarray Quality Control project example Our second example comes from the Microarray Quality Control (MAQC) project [15].”
MethodSystems biology approaches to finding novel pain mediators
Antunes‐Martins, A., Perkins, J. R., Lees, J., Hildebrandt, T., Orengo, C. A., & Bennett, D. (2012) · WIREs Systems Biology and Medicine · doi:10.1002/wsbm.1192 · Cited by 30
“Studies by the Microarray Quality Control (MAQC) project have established the robustness and reproducibility across popular microarray platforms, 160,161 as well as between microarrays and RNA-seq.”
BackgroundLi, Z., Su, Z., Wen, Z., Shi, L. M., & Chen, T. (2009) · BMC Bioinformatics · doi:10.1186/1471-2105-10-s11-s12 · Cited by 29
“To answer the questions, the MicroArray Quality Control (MAQC) project compared gene expression data generated from different microarray platforms for a set of common samples and found certain consistencies among the different platforms for the differentially expressed genes (DEG) [5, 6 ].”
Self-citationRNA Stabilization of Peripheral Blood and Profiling by Bead Chip Analysis
Debey‐Pascher, S., Eggle, D., & Schultze, J. L. (2009) · Methods in molecular biology · doi:10.1007/978-1-59745-553-4_13 · Cited by 29
A real-world multi-center RNA-seq benchmarking study using the Quartet and MAQC reference materials
Wang, D., Liu, Y., Zhang, Y., Chen, Q., Han, Y., Hou, W., Liu, C., Yu, Y., Li, Z., Li, Z., et al. (2024) · Nature Communications · doi:10.1038/s41467-024-50420-y · Cited by 34
“This may be attributed to the increased genome complexity of the MAQC samples A and B, which were prepared by mixing total RNA samples from ten different cancer cell lines and from the brain of 23 donors, respectively 12 .”
InfluentialSelf-citationChallenges in Defining Predictive Markers for Response to Endocrine Therapy in Breast Cancer
Larionov, A. A., & Miller, W. R. (2009) · Future Oncology · doi:10.2217/fon.09.113 · Cited by 32
Zhang, L., Zhang, J., Yang, G., Wu, D., Jiang, L., Wen, Z., & Li, M. (2013) · BMC Bioinformatics · doi:10.1186/1471-2105-14-143 · Cited by 28
“The microarray quality control (MAQC) project launched by US Food and Drug Administration (FDA) elucidated that the lists of DEGs generated by intra- and inter-platform comparisons reached a high level of concordance, which largely depended on the statistical criteria used for ranking and selecting DEGs [3,4].”
BackgroundMethodInfluentialSelf-citationHe, F., Yoo, S., Wang, D., Kumari, S., Gerstein, M., Ware, D., & Maslov, S. (2016) · The Plant Journal · doi:10.1111/tpj.13175 · Cited by 32
Metadata
- Authors
- MAQC Consortium, Shi, L., Shi, L., Reid, L. H., Jones, W. D., Shippy, R., Warrington, J. A., Baker, S. C., Collins, P. J., de Longueville, F., Kawasaki, E. S., Lee, K. Y., Luo, Y., Sun, Y. A., Willey, J. C., Setterquist, R. A., Fischer, G. M., Tong, W., Dragan, Y. P., Dix, D. J., Frueh, F. W., Goodsaid, F. M., Herman, D., Jensen, R. V., Johnson, C. D., Lobenhofer, E. K., Puri, R. K., Scherf, U., Thierry-Mieg, J., Wang, C., Wilson, M., Wolber, P. K., Zhang, L., Amur, S., Bao, W., Barbacioru, C. C., Lucas, A. B., Bertholet, V., Boysen, C., Bromley, B., Brown, D., Brunner, A., Canales, R., Cao, X. M., Cebula, T. A., Chen, J. J., Cheng, J., Chu, T.-M., Chudin, E., Corson, J., Corton, J. C., Croner, L. J., Davies, C., Davison, T. S., Delenstarr, G., Deng, X., Dorris, D., Eklund, A. C., Fan, X.-H., Fang, H., Fulmer-Smentek, S., Fuscoe, J. C., Gallagher, K., Ge, W., Guo, L., Guo, X., Hager, J., Haje, P. K., Han, J., Han, T., Harbottle, H. C., Harris, S. C., Hatchwell, E., Hauser, C. A., Hester, S., Hong, H., Hurban, P., Jackson, S. A., Ji, H., Knight, C. R., Kuo, W. P., LeClerc, J. E., Levy, S., Li, Q.-Z., Liu, C., Liu, Y., Lombardi, M. J., Ma, Y., Magnuson, S. R., Maqsodi, B., McDaniel, T., Mei, N., Myklebost, O., Ning, B., Novoradovskaya, N., Orr, M. S., Osborn, T. W., Papallo, A., Patterson, T. A., Perkins, R. G., Peters, E. H., Peterson, R., Philips, K. L., Pine, P. S., Pusztai, L., Qian, F., Ren, H., Rosen, M., Rosenzweig, B. A., Samaha, R. R., Schena, M., Schroth, G. P., Shchegrova, S., Smith, D. D., Staedtler, F., Su, Z., Sun, H., Szallasi, Z., Tezak, Z., Thierry-Mieg, D., Thompson, K. L., Tikhonova, I., Turpaz, Y., Vallanat, B., Van, C., Walker, S. J., Wang, S. J., Wang, Y., Wolfinger, R., Wong, A., Wu, J., Xiao, C., Xie, Q., Xu, J., Yang, W., Zhang, L., Zhong, S., Zong, Y., & Slikker, W.
- Affiliations
- Affymetrix (United States) (US)
- Illumina (United States) (US)
- Agilent Technologies (United States) (US)
- National Cancer Institute (US)
- National Center for Toxicological Research (US)
- Environmental Protection Agency (US)
- United States Food and Drug Administration (US)
- National Institutes of Health (US)
- University of Massachusetts Boston (US)
- Asuragen (United States) (US)
- Center for Biologics Evaluation and Research (US)
- Cedars-Sinai Medical Center (US)
- SAS Institute (United States) (US)
- Center for Food Safety and Applied Nutrition (US)
- Biogen (United States) (US)
- Yale University (US)
- Center for Veterinary Medicine (US)
- Cold Spring Harbor Laboratory (US)
- Sanford Burnham Prebys Medical Discovery Institute (US)
- Stanford Medicine (US)
- Harvard University (US)
- Vanderbilt University (US)
- The University of Texas Southwestern Medical Center (US)
- The University of Texas at Dallas (US)
- GenUs BioSystems (United States) (US)
- Oslo University Hospital (NO)
- The University of Texas MD Anderson Cancer Center (US)
- Luminex (United States) (US)
- Wake Forest University Health Sciences (US)
- University of Illinois Urbana-Champaign (US)
- ORCID
- Jones, Wendell D
- Collins, Patrick J
- Luo, Yuling
- Sun, Yongming Andrew
- Willey, James C
- Tong, Weida
- Frueh, Felix W
- Goodsaid, Federico M
- Johnson, Charles D
- Puri, Raj K
- Scherf, Uwe
- Wang, Charles
- Bao, Wenjun
- Brown, Donna
- Chen, James J
- Cheng, Jing
- Corton, J Christopher
- Croner, Lisa J
- Deng, Xutao
- Eklund, Aron C
- Fang, Hong
- Guo, Lei
- Guo, Xu
- Han, Jing
- Han, Tao
- Harbottle, Heather C
- Harris, Stephen C
- Hatchwell, Eli
- Hester, Susan
- Hong, Huixiao
- Jackson, Scott A
- Ji, Hanlee
- Levy, Shawn
- Li, Quan-Zhen
- Liu, Chunmei
- Liu, Ying
- Ma, Yunqing
- Mei, Nan
- Myklebost, Ola
- Ning, Baitang
- Patterson, Tucker A
- Pusztai, Lajos
- Qian, Feng
- Schroth, Gary P
- Su, Zhenqiang
- Sun, Hongmei
- Tikhonova, Irina
- Turpaz, Yaron
- Walker, Stephen J
- Wang, Sue Jane
- Wang, Yonghong
- Wong, Alex
- Wu, Jie
- Xiao, Chunlin
- Xie, Qian
- Xu, Jun
- Yang, Wen
- Zhang, Liang
- Zhong, Sheng
- Slikker, William
- Venue
- Nature Biotechnology
- Published
- 2006-09-01
- Volume
- 24
- Issue
- 9
- Pages
- 1151-1161
- ISSN
- 0733-222X (ISSN-L)
- 1087-0156
- 1546-1696
- PMC
- PMC3272078
- OpenAlex
- W2010637767
- Cited by
- 2,126
- References
- 43
- Citations by year
- 2026: 21 · 2025: 25 · 2024: 23 · 2023: 39 · 2022: 37 · 2021: 60 · 2020: 43 · 2019: 59 · 2018: 68 · 2017: 87 · 2016: 87 · 2015: 98 · 2014: 122 · 2013: 155 · 2012: 160
- FWCI
- 87.96
- Type
- journal article
- Language
- en
- Open access
- green
- www.ncbi.nlm.nih.gov
- Licence
- www.springer.com/tdm (tdm)
- www.springer.com/tdm (vor)
- Locations
- Nature Biotechnology (publishedVersion)
- PubMed (publishedVersion)
- Europe PMC (PubMed Central) (acceptedVersion)
- PubMed Central (acceptedVersion)
- Digital Access to Libraries (Université catholique de Louvain (UCL), l'Université de Namur (UNamur) and the Université Saint-Louis (USL-B)) (submittedVersion)
- Funders
- U.S. Environmental Protection Agency
- National Institutes of Health (Z99 LM999999, Z99 HL999999, Z99 MH999999, Z99CL999999)
- Topics
- Life Sciences › Biochemistry, Genetics and Molecular Biology › Molecular Biology › Gene expression and cancer classification
- Life Sciences › Biochemistry, Genetics and Molecular Biology › Molecular Biology › Molecular Biology Techniques and Applications
- Life Sciences › Biochemistry, Genetics and Molecular Biology › Molecular Biology › Genomics and Phylogenetic Studies
- Keywords
- probe mapping, differentially expressed genes, microarray data analysis
- MeSH terms
- Equipment Design, Quality Assurance, Health Care, Quality Control, Sensitivity and Specificity, United States, Reproducibility of Results, Equipment Failure Analysis, Oligonucleotide Array Sequence Analysis, Gene Expression Profiling
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.