The MicroArray Quality Control (MAQC) project shows inter- and intraplatform reproducibility of gene expression measurements
Open accessThe DOI matches its Crossref record; 43 of the 43 references it cites were found in a registry or an index.
Abstract
Over the last decade, the introduction of microarray technology has had a profound impact on gene expression research. The publication of studies with dissimilar or altogether contradictory results, obtained using different microarray platforms to analyze identical RNA samples, has raised concerns about the reliability of this technology. The MicroArray Quality Control (MAQC) project was initiated to address these concerns, as well as other performance and data analysis issues. Expression data on four titration pools from two distinct reference RNA samples were generated at multiple test sites using a variety of microarray-based and alternative technology platforms. Here we describe the experimental design and probe mapping efforts behind the MAQC project. We show intraplatform consistency across test sites as well as a high level of interplatform concordance in terms of genes identified as differentially expressed. This study provides a resource that represents an important first step toward establishing a framework for the use of microarrays in clinical and regulatory settings.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Next, we applied the |log 2 fold-change|>1 filter advocated in the MAQC study on microarrays, 10 and for microarrays observed a reduction in the eFDR to below 1.5%, save for one outlier site (Figs 3c,d).”
From A comprehensive assessment of RNA-seq accuracy, reproducibility and information content by the Sequencing Quality Control Consortium (2014) · cites this paper as [10]
In the citing paper
“Studies on microarrays have shown that results of typical statistical differential expression tests thresholded by p -value need to be filtered and sorted by effect strength (fold-change) in order to attain robust comparisons across platforms and sites. 10”
From A comprehensive assessment of RNA-seq accuracy, reproducibility and information content by the Sequencing Quality Control Consortium (2014) · cites this paper as [10]
In the citing paper
“The Microarray Quality Control (MAQC) Consortium landmark study10 examined the degree of variance within and across many different microarray platforms and found similar coefficients of variation between platforms.”
From Multi-platform assessment of transcriptome profiling using RNA-seq in the ABRF next-generation sequencing study (2014) · cites this paper as [10]
In the citing paper
“prior work comparing microarray platforms and methods showed high levels of inter-platform concordance for the ability to detect differentially expressed genes.”
From Multi-platform assessment of transcriptome profiling using RNA-seq in the ABRF next-generation sequencing study (2014) · cites this paper as [10]
Citations
Cites
In silico prediction of protein-protein interactions in human macrophages
Souiai, O., Guerfali, F., Ben Miled, S., Brun, C., & Benkahla, A. (2014) · BMC Research Notes · doi:10.1186/1756-0500-7-157 · Cited by 10,803
Significance analysis of microarrays applied to the ionizing radiation response
Tusher, V. G., Tibshirani, R., & Chu, G. (2001) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.091062498 · Cited by 10,568
Pruitt, K. D., Tatusova, T., & Maglott, D. R. (2007) · Nucleic Acids Research · doi:10.1093/nar/gkl842 · Cited by 4,481 · cited 1×
“We mapped the probes (see Supplementary Methods online and Supplementary Notes online) to the RefSeq human mRNA databas”
Method"Stemness": Transcriptional Profiling of Embryonic and Adult Stem Cells
Ramalho-Santos, M., Yoon, S., Matsuzaki, Y., Mulligan, R. C., & Melton, D. A. (2002) · Science · doi:10.1126/science.1072530 · Cited by 1,709
Pruitt, K. D. (2004) · Nucleic Acids Research · doi:10.1093/nar/gki025 · Cited by 1,660 · cited 1×
“We mapped the probes (see Supplementary Methods online and Supplementary Notes online) to the RefSeq human mRNA database 31 (http://www.ncbi.nlm.nih.gov/RefSeq) and to the AceView database 32 (http://www.ncbi.nlm.nih.gov/IEB/Research/Acembly), a less curated but more comprehensive database, which…”
MethodA Stem Cell Molecular Signature
Ivanova, N. B., Dimos, J. T., Schaniel, C., Hackney, J. A., Moore, K. A., & Lemischka, I. R. (2002) · Science · doi:10.1126/science.1073823 · Cited by 1,542
Prediction of cancer outcome with microarrays: a multiple random validation strategy
Michiels, S., Koscielny, S., & Hill, C. (2005) · The Lancet · doi:10.1016/s0140-6736(05)17866-0 · Cited by 1,025 · cited 1×
“, raising doubts about the repeatability, reproducibility and comparability of microarray technolog”
BackgroundMultiple-laboratory comparison of microarray platforms
Irizarry, R. A., Warren, D., Spencer, F., Kim, I. F., Biswal, S., Frank, B. C., Gabrielson, E., Garcia, J. G. N., Geoghegan, J., Germino, G., et al. (2005) · Nature Methods · doi:10.1038/nmeth756 · Cited by 862
Self-citationEvaluation of gene expression measurements from commercial microarray platforms
Tan, P. K. (2003) · Nucleic Acids Research · doi:10.1093/nar/gkg763 · Cited by 706
Thousands of samples are needed to generate a robust gene list for predicting outcome in cancer
Ein-Dor, L., Zuk, O., & Domany, E. (2006) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0601231103 · Cited by 689 · cited 1×
“…to appear in peer-reviewed journals 9,10 , raising doubts about the repeatability, reproducibility and comparability of microarray technology 11–13 , several studies have also been recently published showing increased reproducibility of microarray data generated at different test sites and/or…”
Background
Research works printed but not linked: 1
- Reid, L.H. The value of a proficiency testing program to monitor performance in microarray laboratories. Pharm. Discov. 5, 20–25 (2005).
Cited by
Items 801–900 of 1,004
Knight, J. M., Rizzo, J. D., Wang, T., He, N., Logan, B. R., Spellman, S. R., Lee, S. J., Verneris, M. R., Arevalo, J. M. G., & Cole, S. W. (2019) · JNCI Cancer Spectrum · doi:10.1093/jncics/pkz073 · Cited by 32
Moro, H., Hattori, N., Nakamura, Y., Kimura, K., Imai, T., Maeda, M., Yashiro, M., & Ushijima, T. (2019) · Gastric Cancer · doi:10.1007/s10120-019-01010-1 · Cited by 28
Harreither, E., Hackl, M., Pichler, J., Shridhar, S., Auer, N., Łabaj, P. P., Scheideler, M., Karbiener, M., Grillari, J., Kreil, D. P., et al. (2015) · Biotechnology Journal · doi:10.1002/biot.201400857 · Cited by 34
“While the actual threshold is arbitrary some filtering of small changes is necessary for robust results in view of the technical variation observed across laboratories, whether expression profiling uses microarrays [28] or RNA-Seq by next-generation sequencing [29].”
BackgroundTsai, C., Ranjan, P., DiFazio, S. P., Tuskan, G. A., & Johnson, V. (2011) · Science Publishers eBooks · doi:10.1201/b10819-6 · Cited by 28
Wen, Z., Wang, C., Shi, Q., Huang, Y. S., Su, Z., Hong, H., Tong, W., & Shi, L. M. (2010) · BMC Bioinformatics · doi:10.1186/1471-2105-11-s6-s10 · Cited by 28
“However, several studies showed poor overlaps of DEGs across different platforms or different laboratories using the same sets of RNA samples [4-8], raising concerns on the reliability of microarray technology [9-13] and leading to the launch of the MicroArray Quality Control (MAQC) project [14,15].”
BackgroundMethodResultInfluentialSelf-citationHuang, L., Zuo, Z., Zhang, Y., & Wang, C. (2014) · Aquatic Toxicology · doi:10.1016/j.aquatox.2014.10.024 · Cited by 28
Self-citationImproving Pathological Assessment of Breast Cancer by Employing Array-Based Transcriptome Analysis
Mihály, Z., & Győrffy, B. (2013) · Microarrays · doi:10.3390/microarrays2030228 · Cited by 33
“microarrays and RT-PCR [12] and the correlation between different microarray platforms [13] has been documented previously.”
Toxicogenomic Biomarkers for Liver Toxicity
Kiyosawa, N., Ando, Y., Manabe, S., & Yamoto, T. (2009) · Journal of Toxicologic Pathology · doi:10.1293/tox.22.35 · Cited by 28
Jia, C., Zhu, W., Ren, S., Xi, H., Li, S., & Wang, Y. (2011) · PubMed Central · Cited by 28
Self-citationChen, Z., Liu, Z., Li, W., Qu, K., Deng, X., Varma, M. G., Fichera, A., Pigazzi, A., & García‐Aguilar, J. (2011) · Genes Chromosomes and Cancer · doi:10.1002/gcc.20891 · Cited by 34
“Predictive biomarkers for pCR were derived using a combination of methods, including feature (candidate biomarker) selection, classification model-fitting, and cross validation, as described previously (Shi et al., 2006; Deng and Campagne, Genes, Chromosomes & Cancer DOI 10.1002/gcc 2010).”
MethodInfluentialSelf-citationABSSeq: a new RNA-Seq analysis method based on modelling absolute expression differences
Yang, W., Rosenstiel, P. C., & Schulenburg, H. (2016) · BMC Genomics · doi:10.1186/s12864-016-2848-2 · Cited by 32
“It is based on replicated RNA samples of the human whole body (UHR) and brain (BHR) [44, 45].”
Self-citationDifferential expression analyses for single‐cell RNA‐Seq: old questions on new data
Miao, Z., & Zhang, X. (2016) · Quantitative Biology · doi:10.1007/s40484-016-0089-7 · Cited by 29
Lambert, C. B., Spire, C., Renaud, M. P., Claude, N., & Guillouzo, A. (2008) · Toxicology in Vitro · doi:10.1016/j.tiv.2008.12.018 · Cited by 28
Kassahn, K. S. (2008) · Journal of Fish Biology · doi:10.1111/j.1095-8649.2008.01890.x · Cited by 32
Current status of gene expression profiling in the diagnosis and management of acute leukaemia
Bacher, U., Kohlmann, A., & Haferlach, T. (2009) · British Journal of Haematology · doi:10.1111/j.1365-2141.2009.07656.x · Cited by 28
Transcriptional profiles of progestogen effects in the postmenopausal breast
Wood, C. E., Register, T. C., & Cline, J. M. (2008) · Breast Cancer Research and Treatment · doi:10.1007/s10549-008-0003-8 · Cited by 28
“Microarrays were run at the Vanderbilt Microarray Shared Resource (VMSR) laboratory (Nashville, TN) using the Applied Biosystems (ABI) Human Genome Survey Microarray (ABI, Foster City, CA), which contains *32,878 probe sets representing *29,098 different transcripts and employs 60-mer oligomer probes designed against…”
MethodChips to Bedside: Incorporation of Microarray Data into Clinical Practice
Pusztai, L. (2006) · Clinical Cancer Research · doi:10.1158/1078-0432.ccr-06-2649 · Cited by 28
Self-citationA rapid and inexpensive labeling method for microarray gene expression analysis
Ouellet, M., Adams, P. D., Keasling, J. D., & Mukhopadhyay, A. (2009) · BMC Biotechnology · doi:10.1186/1472-6750-9-97 · Cited by 28
Significance Analysis of Prognostic Signatures
Beck, A. H., Knoblauch, N., Hefti, M. M., Kaplan, J., Schnitt, S. J., Culhane, A. C., Schröder, M., Risch, T., Quackenbush, J. F., & Haibe‐Kains, B. (2013) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1002875 · Cited by 29
“[23] using RefSeq and Entrez whenever possible; otherwise mapping was performed using IDconverter (http://idconverter.”
MethodChen, G., Wang, C., Shi, L. M., Qu, X., Chen, J., Yang, J., Shi, C., Chen, L., Zhou, P., Ning, B., et al. (2013) · RNA · doi:10.1261/rna.037473.112 · Cited by 28
“…by the fact that diverse computational approaches/pipelines with the distinct algorithms can result in different predictions for identifying the genes harbored in a genome (Pennisi 2003; Stanke and Waack 2003; Shi et al. 2006; Guttman et al. 2010; Trapnell et al. 2010; Garber et al. 2011).”
BackgroundSelf-citationLiu, Y., Jing, R., Xu, J., Liu, K., Xue, J., Wen, Z., & Li, M. (2015) · Biomarkers in Medicine · doi:10.2217/bmm.15.97 · Cited by 27
Self-citationEpigenomic Reprogramming of Adult Cardiomyocyte-Derived Cardiac Progenitor Cells
Zhang, Y., Zhong, J. F., Qiu, H., MacLellan, W. R., Marbán, E., & Wang, C. (2015) · Scientific Reports · doi:10.1038/srep17686 · Cited by 30
Self-citationGoodale, B. C., Hampton, T. H., Ford, E. N., Jackson, C. E., Shaw, J. R., Stanton, B. A., & King, B. L. (2018) · Aquatic Toxicology · doi:10.1016/j.aquatox.2018.11.009 · Cited by 30
Tuerk, A., Wiktorin, G., & Güler, S. (2017) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1005515 · Cited by 30
Li, X., Zhang, P., Wang, H., & Yu, Y. (2022) · BMC Genomics · doi:10.1186/s12864-022-08785-1 · Cited by 30
“Genes are defined as DEGs if their levels exhibit a log2 (fold-change) with an absolute value > 1 [23, 24].”
BackgroundZeisel, A., Amir, A., Köstler, W. J., & Domany, E. (2010) · BMC Bioinformatics · doi:10.1186/1471-2105-11-400 · Cited by 30
DACH1: Its Role as a Classifier of Long Term Good Prognosis in Luminal Breast Cancer
Powe, D. G., Dhondalay, G. K., Lemetre, C., Allen, T. J., Habashy, H. O., Ellis, I. O., Rees, R. C., & Ball, G. (2014) · PLoS ONE · doi:10.1371/journal.pone.0084428 · Cited by 27
“Breast cancer microarray dataset To identify genes associated with ER status in breast cancer a cDNA microarray dataset, E-GEOD-20194 [29], was selected from the public repository ArrayExpress [30], submitted by Micro Array Quality Control consortium.”
New technologies around biomarkers and their interplay with drug development
Dieterle, F., & Marrer, E. (2007) · Analytical and Bioanalytical Chemistry · doi:10.1007/s00216-007-1688-y · Cited by 27
Autocorrelation analysis reveals widespread spatial biases in microarray experiments
Koren, A., Tirosh, I., & Barkai, N. (2007) · BMC Genomics · doi:10.1186/1471-2164-8-164 · Cited by 30
Molecular Biomarkers: A US FDA Effort
Hong, H., Goodsaid, F. M., Shi, L. M., & Tong, W. (2010) · Biomarkers in Medicine · doi:10.2217/bmm.09.81 · Cited by 32
Self-citationDifferential gene expression analysis using coexpression and RNA-Seq data
Yang, E.-W., Girke, T., & Jiang, T. (2013) · Bioinformatics · doi:10.1093/bioinformatics/btt363 · Cited by 32
Orlov, Y. L., Zhou, J., Lipovich, L., Shahab, A., & Kuznetsov, V. A. (2007) · PubMed · Cited by 27
Influence of sex on gene expression in human corneal epithelial cells.
Suzuki, T., Richards, S. M., Liu, S., Jensen, R. V., & Sullivan, D. A. (2009) · PubMed Central · Cited by 35
Self-citationMcMullen, P. D., Pendse, S. N., Black, M. B., Mansouri, K., Haider, S., Andersen, M. E., & Clewell, R. A. (2019) · Toxicology in Vitro · doi:10.1016/j.tiv.2019.02.014 · Cited by 28
Zahoor, J., & Zafar, K. (2020) · Genes · doi:10.3390/genes11070819 · Cited by 30
Altered endothelial gene expression associated with hereditary haemorrhagic telangiectasia
Thomas, B., Eyries, M., Montagne, K., Martín, S., Agrapart, M., Simerman‐François, R., Letarte, M., & Soubrier, F. (2007) · European Journal of Clinical Investigation · doi:10.1111/j.1365-2362.2007.01824.x · Cited by 28
Brinkhof, B., van Tol, H. T., Groot Koerkamp, M. J., Riemers, F. M., IJzer, S. G., Mashayekhi, K., Haagsman, H. P., & Roelen, B. A. (2015) · BMC Genomics · doi:10.1186/s12864-015-1448-x · Cited by 26
“In cases of multiple probes per gene, the values from the most 3′ probe were used [27,28].”
Li, T., Chen, X., & Tong, W. (2024) · npj Digital Medicine · doi:10.1038/s41746-024-01317-z · Cited by 28
“The 65 and is largely dependent on chemical treatment and transcript abundance 66 .”
Self-citationThe Utility of Gene Expression in Blood Cells for Diagnosing Neuropsychiatric Disorders
Woelk, C. H., Singhania, A., Pérez‐Santiago, J., Glatt, S. J., & Tsuang, M. T. (2011) · International review of neurobiology · doi:10.1016/b978-0-12-387718-5.00003-1 · Cited by 29
Rienzo, A. D., Richards, W. G., Yeap, B. Y., Coleman, M. H., Sugarbaker, P. E., Chirieac, L. R., Wang, Y. E., Quackenbush, J. F., Jensen, R. V., & Bueno, R. (2013) · Clinical Cancer Research · doi:10.1158/1078-0432.ccr-12-2117 · Cited by 26
“For quality control across platforms, 2 MicroArray Quality Control (MAQC) samples (MAQCa and MAQCb) were included in the analysis (16).”
Self-citationEffect assessment of engineered nanoparticles in solid media – Current insight and the way forward
Amorim, M. J. B., Roca, C. P., & Scott-Fordsmand, J. J. (2015) · Environmental Pollution · doi:10.1016/j.envpol.2015.08.048 · Cited by 27
Oerton, E., & Bender, A. (2017) · BMC Neurology · doi:10.1186/s12883-017-0838-x · Cited by 26
“Notably, although the cross-platform reproducibility of results from the same biological replicates may be high [16, 17], an early study of a mouse model of PD found very little concordance between Affymetrix and CodeLink platforms [18].”
BackgroundBNP-Seq: Bayesian Nonparametric Differential Expression Analysis of Sequencing Count Data
Dadaneh, S. Z., Qian, X., & Zhou, M. (2018) · Journal of the American Statistical Association · doi:10.1080/01621459.2017.1328358 · Cited by 30
“…2014], the same RNA samples for a comprehensive group of control genes are analyzed based on quantitative Reverse Transcription Polymerase Chain Reaction (qRT-PCR) using TaqMan assays [Joyce, 2002], which is referred as the TaqMan benchmark data [Shi et al., 2006, MAQC Consortium, 2010].”
MethodExcess Lipin enzyme activity contributes to TOR1A recessive disease and DYT-TOR1A dystonia
Cascalho, A. C. C., Foroozandeh, J., Hennebel, L., Swerts, J., Klein, C., Rous, S., Gonzalez, B. D., Pisani, A., Meringolo, M., Gallego, S. F., et al. (2020) · Brain · doi:10.1093/brain/awaa139 · Cited by 27
Demers‐Mathieu, V. (2023) · Biomedicines · doi:10.3390/biomedicines11030864 · Cited by 26
Soltani, Z., Moghadam, A. A., Tahmasebi, A., & Niazi, A. (2023) · PLoS ONE · doi:10.1371/journal.pone.0281470 · Cited by 28
Dynamic association rules for gene expression data analysis
Chen, S., Tsai, T.-H., Chung, C.-H., & Li, W. (2015) · BMC Genomics · doi:10.1186/s12864-015-1970-x · Cited by 26
“Microarray Quality Control (MAQC) data sets [52] In 2006, MicroArray Quality Control (MAQC) consortium launched a series of analyses across different platforms of microarrays [52].”
MethodThe role of gene expression profiling in drug discovery
Bates, S. (2011) · Current Opinion in Pharmacology · doi:10.1016/j.coph.2011.06.009 · Cited by 26
Molecular diagnosis in breast cancer
Marchiò, C., & Reis-Filho, J. S. (2008) · Diagnostic histopathology · doi:10.1016/j.mpdhp.2008.03.002 · Cited by 26
Marstrand, T. T., Borup, R., Willer, A., Borregaard, N., Sandelin, A., Porse, B. T., & Theilgaard‐Mönch, K. (2010) · Leukemia · doi:10.1038/leu.2010.95 · Cited by 28
“Moreover, our study showed the feasibility of integrating micorarray data from different studies, which is in agreement with the recent MicroArray Quality Control project reporting a high intra-platform consistency among various laboratories”
ResultRao, A. N., Rodesch, C. K., & Grainger, D. W. (2012) · Analytical Chemistry · doi:10.1021/ac302165h · Cited by 26
Hebels, D. G. A. J., Jennen, D. G. J., van Herwijnen, M. H. M., Moonen, E. J. C., Pedersen, M., Knudsen, L. E., Kleinjans, J. C. S., & de Kok, T. M. C. M. (2011) · Mutagenesis · doi:10.1093/mutage/ger043 · Cited by 26
SWISS MADE: Standardized WithIn Class Sum of Squares to Evaluate Methodologies and Dataset Elements
Cabanski, C. R., Qi, Y., Yin, X., Bair, E., Hayward, M. C., Fan, C., Li, J., Wilkerson, M. D., Marron, J. S., Perou, C. M., et al. (2010) · PLoS ONE · doi:10.1371/journal.pone.0009905 · Cited by 26
“For example, Shi et al [23] draw their conclusion that Affymetrix has the best intersite reproducibility by comparing”
BackgroundMethodInfluential"Hook"-calibration of GeneChip-microarrays: Chip characteristics and expression measures
Binder, H., Krohn, K., & Preibisch, S. (2008) · Algorithms for Molecular Biology · doi:10.1186/1748-7188-3-11 · Cited by 26
GFS: fuzzy preprocessing for effective gene expression analysis
Belorkar, A., & Wong, L. (2016) · BMC Bioinformatics · doi:10.1186/s12859-016-1327-8 · Cited by 26
“However, in practice, unless an effective normalization technique is applied to preprocess the expression data, a number of factors may lead to the violation of this assumption [1, 2].”
BackgroundMethodGenomic medicine in non‐small cell lung cancer: Paving the path to personalized care
Sriram, K. B., Larsen, J. E., Yang, I. A., Bowman, R., & Fong, K. M. (2010) · Respirology · doi:10.1111/j.1440-1843.2010.01892.x · Cited by 26
Gene-resolution analysis of DNA copy number variation using oligonucleotide expression microarrays
Auer, H., Newsom, D. L., Nowak, N. J., McHugh, K. M., Singh, S., Yu, C. Y., Yang, Y., Wenger, G. D., Gastier, J. M., & Kornacker, K. (2007) · BMC Genomics · doi:10.1186/1471-2164-8-111 · Cited by 26
“The Microarray Quality Control Consortium (MAQC) study highlighted once again that in-house microarrays generate a much higher coefficient of variation for expression signals compared to commercial products [6].”
COLOMBOS: Access Port for Cross-Platform Bacterial Expression Compendia
Engelen, K., Fu, Q., Meysman, P., Sánchez‐Rodríguez, A., Smet, R. D., Lemmens, K., Fierro, A. C., & Marchal, K. (2011) · PLoS ONE · doi:10.1371/journal.pone.0020938 · Cited by 32
“between two conditions measured for the same microarray experiment and platform) negates much of the platform and experiment specific variation that makes it impossible to reliably compare the absolute quantities reported in different experiments [15].”
BackgroundResultThe FDA’s Experience with Emerging Genomics Technologies—Past, Present, and Future
Xu, J., Thakkar, S., Gong, B., & Tong, W. (2016) · The AAPS Journal · doi:10.1208/s12248-016-9917-y · Cited by 25
“The entire project published a total of 28 peer-reviewed articles (http://www.fda.gov/ScienceResearch/BioinformaticsTools/ MicroarrayQualityControlProject/), and 11 of them were published in Nature Biotechnology (4, 16-24).”
BackgroundSelf-citationHaile, S., Corbett, R., Bilobram, S., Mungall, K. L., Grande, B. M., Kirk, H., Pandoh, P. K., MacLeod, T., McDonald, H., Bala, M., et al. (2019) · PLoS ONE · doi:10.1371/journal.pone.0224578 · Cited by 25
“UHR transcript expression levels of 1,000 genes were previously quantified using TaqMan qPCR assays [23].”
MethodInfluentialFejzo, M. S., Chen, H., Anderson, L. A., McDermott, M. S. J., Karlan, B. Y., Konecny, G. E., & Slamon, D. J. (2020) · Gynecologic Oncology · doi:10.1016/j.ygyno.2020.11.008 · Cited by 26
Lull, M. E., Erwin, M. S., Morgan, D., Roberts, D. C. S., Vrana, K. E., & Freeman, W. M. (2009) · PROTEOMICS - CLINICAL APPLICATIONS · doi:10.1002/prca.200800055 · Cited by 25
“This approach of a statistical and fold change cut-off is adapted from the microarray field to reduce the number of false-positives, without overly conservative multiple testing corrections [22].”
MethodIntra- and Inter-Individual Variance of Gene Expression in Clinical Studies
Cheng, W., Shu, W., Li, C., Tsai, M., Chang, C.-W., Chen, C.-R., Cheng, H.-T., Wang, T., & Hsu, I. C. (2012) · PLoS ONE · doi:10.1371/journal.pone.0038650 · Cited by 26
“Numerous investigations have been conducted to evaluate the influence of multiple factors, such as batch effects [7], dye effects [8], different platforms [9–13], various experiment designs [14–16], and statistical approaches [17,18], regarding microarray results.”
Prognostic Value of Gene Signatures and Proliferation in Lymph-Node-Negative Breast Cancer
Jónsdóttir, K., Aßmus, J., Slewa, A., Gudlaugsson, E. G., Skaland, I., Baak, J. P. A., & Janssen, E. A. M. (2014) · PLoS ONE · doi:10.1371/journal.pone.0090642 · Cited by 25
“Differences in the platforms used could influence the results; however, one study has shown that the Illumina and Affimetrix platforms are highly comparable [47].”
ResultBoulware, D. R., Meya, D. B., Bergemann, T. L., Williams, D. A., Louis, I. V.-S., Rhein, J., Staddon, J. H., Kambugu, A., Janoff, E. N., & Bohjanen, P. R. (2010) · JAIDS Journal of Acquired Immune Deficiency Syndromes · doi:10.1097/qai.0b013e3181ef4963 · Cited by 27
Pathway analysis software: Annotation errors and solutions
MacLennan, N. K., Papp, J. C., Talbot, C. C., McCabe, E. R. B., & Presson, A. P. (2010) · Molecular Genetics and Metabolism · doi:10.1016/j.ymgme.2010.06.005 · Cited by 25
Cheng, C., Shen, K., Song, C., Luo, J., & Tseng, G. C. (2009) · Bioinformatics · doi:10.1093/bioinformatics/btp292 · Cited by 25
“In the literature, most reproducibility analyses either compared and validated the detected biomarkers independently found in each study (Mitchell et al., 2004; Shi et al., 2006; Tan et al., 2003) or evaluated inter-lab or inter-platform concordance by correlation (Parmigiani et al., 2004).”
WemIQ: an accurate and robust isoform quantification method for RNA-seq data
Zhang, J., Kuo, C. ‐. J., & Chen, L. (2014) · Bioinformatics · doi:10.1093/bioinformatics/btu757 · Cited by 26
“‘ML’ or ‘MS’ represents that the missing isoform is similar to the long or the short isoform but with an alternative splice site.”
BackgroundGoodale, B. C., Rayack, E. J., & Stanton, B. A. (2017) · Toxicology and Applied Pharmacology · doi:10.1016/j.taap.2017.06.010 · Cited by 25
Using the circulating proteome to assess type I interferon activity in systemic lupus erythematosus
Smith, M. A., Chiang, C.-C., Zerrouki, K., Rahman, S., White, W. I., Streicher, K. L., Rees, W. A., Schiffenbauer, A. I., Rider, L. G., Miller, F. W., et al. (2020) · Scientific Reports · doi:10.1038/s41598-020-60563-9 · Cited by 25
Importance of collection in gene set enrichment analysis of drug response in cancer cell lines
Bateman, A. R., El-Hachem, N., Beck, A. H., Aerts, H. J. W. L., & Haibe‐Kains, B. (2014) · Scientific Reports · doi:10.1038/srep04092 · Cited by 25
Dozmorov, M. G., Kyker, K. D., Hauser, P. J., Saban, R., Buethe, D. D., Dozmorov, I. M., Centola, M. B., Culkin, D. J., & Hurst, R. E. (2008) · BMC Bioinformatics · doi:10.1186/1471-2105-9-s9-s4 · Cited by 25
“Since their initial appearance microarrays developed into very dependable tools with good inter- and intra-platform reproducibility [1,2].”
BackgroundMartin, E. M., Messenger, K. M., Sheats, M. K., & Jones, S. L. (2017) · Frontiers in Veterinary Science · doi:10.3389/fvets.2017.00160 · Cited by 25
“Invitrogen identifies the NCBI target sequence used to design the primers and probes, the 25 base pair region of probe binding, and predicted amplicon size (36, 37).”
MethodPublic Consortium Efforts in Toxicogenomics
Mattes, W. B. (2008) · Methods in molecular biology · doi:10.1007/978-1-60327-048-9_11 · Cited by 25
Deep Sequencing Whole Transcriptome Exploration of the σE Regulon in Neisseria meningitidis
Veld, R. H. I. ’., Willemsen, A. M., van Kampen, A. H. C., Bradley, E. J., Baas, F., Pannekoek, Y., & ENDE, A. V. D. (2011) · PLoS ONE · doi:10.1371/journal.pone.0029002 · Cited by 28
Lung Cancer Transcriptomes Refined with Laser Capture Microdissection
Lin, J., Marquardt, G., Mullapudi, N., Wang, T., Han, W., Shi, M. K., Keller, S. M., Zhu, C., Locker, J. D., & Spivack, S. D. (2014) · American Journal Of Pathology · doi:10.1016/j.ajpath.2014.06.028 · Cited by 26
Edmonds, R. D., Vodovotz, Y., Lagoa, C., Dutta‐Moscato, J., Yang, Y.-C., Fink, M. P., Levy, R. M., Prince, J. M., Kaczorowski, D. J., Tseng, G. C., et al. (2011) · Physiological Genomics · doi:10.1152/physiolgenomics.00020.2011 · Cited by 26
Şahin, A., Liu, Y., Kam, W. R., Darabad, R. R., & Sullivan, D. A. (2020) · The Ocular Surface · doi:10.1016/j.jtos.2020.02.006 · Cited by 25
Self-citationBiomarker adaptive designs in clinical trials
Chen, J. J., Lu, T., Chen, D., & Wang, S.-J. (2014) · Translational Cancer Research · doi:10.21037/2551 · Cited by 31
Self-citationRenal Epithelial Neoplasms: Diagnostic Applications of Gene Expression Profiling
Young, A. N., Master, V. A., Paner, G. P., Wang, M. D., & Amin, M. B. (2008) · Advances in Anatomic Pathology · doi:10.1097/pap.0b013e3181594720 · Cited by 24
“Despite the fact that different studies may use distinct microarray platforms and protocols, recent work has shown that current protocols achieve strong interlaboratory and interplatform concordance.(73) Finally, to fully verify microarray data for tumor classification, the differential expression of selected genes is…”
BackgroundChoudhary, R. K., Li, R. W., Evock-Clover, C. M., & Capuco, A. V. (2013) · Frontiers in Oncology · doi:10.3389/fonc.2013.00021 · Cited by 26
“Group-wise comparisons were performed in accordance with recommendations of the Microarray Quality Control project (Shi et al., 2006, 2008) based on t -test (P 0.05) followed by fold change (twofold as a cutoff) to determine significance.”
MethodInfluentialHa, K., Coulombe‐Huntington, J., & Majewski, J. (2009) · BMC Genomics · doi:10.1186/1471-2164-10-519 · Cited by 24
An Immunological Fingerprint Differentiates Muscular Lymphatics from Arteries and Veins
Bridenbaugh, E. A., Wang, W., Srimushnam, M., Cromer, W. E., Zawieja, S. D., Schmidt, S. E., Jupiter, D. C., Huang, H.-C., Buren, V. V., & Zawieja, D. C. (2013) · Lymphatic Research and Biology · doi:10.1089/lrb.2013.0023 · Cited by 26
Li, J., Fan, Y., Chen, J., Yao, K., & Huang, Z. (2009) · Cancer Genetics and Cytogenetics · doi:10.1016/j.cancergencyto.2009.08.004 · Cited by 24
Self-citationToxicogenomic Approaches in Developmental Toxicology Testing
Robinson, J. F., & Piersma, A. H. (2012) · Methods in molecular biology · doi:10.1007/978-1-62703-131-8_31 · Cited by 28
Lymph Node Fine-Needle Cytology: Beyond Flow Cytometry
Peluso, A. L., Ieni, A., Mignogna, C., & Zeppa, P. (2016) · Acta Cytologica · doi:10.1159/000447734 · Cited by 25
Takashima, S., Oka, Y., Fujiki, F., Morimoto, S., Nakajima, H., Nakae, Y., Nakata, J., Nishida, S., Hosen, N., Tatsumi, N., et al. (2016) · Future Science OA · doi:10.4155/fsoa-2015-0008 · Cited by 25
Kim, H., Jeong, J., Chatterjee, N., Roca, C. P., Yoon, D., Kim, S., Kim, Y., & Choi, J. (2017) · Scientific Reports · doi:10.1038/s41598-017-17495-8 · Cited by 26
Sex Effects on Gene Expression in Lacrimal Glands of Mouse Models of Sjögren Syndrome
Tellefsen, S., Morthen, M. K., Richards, S. M., Lieberman, S. M., Darabad, R. R., Kam, W. R., & Sullivan, D. A. (2018) · Investigative Ophthalmology & Visual Science · doi:10.1167/iovs.18-25772 · Cited by 25
Towards the development of an omics data analysis framework
Verheijen, M. C. T., Tong, W., Shi, L. M., Gant, T. W., Seligman, B., & Caiment, F. (2020) · Regulatory Toxicology and Pharmacology · doi:10.1016/j.yrtph.2020.104621 · Cited by 24
Self-citationKong, X., Mas, V. R., & Archer, K. J. (2008) · BMC Genomics · doi:10.1186/1471-2164-9-98 · Cited by 24
Kohlmann, A., Haschke‐Becher, E., Wimmer, B., Huber-Wechselberger, A., Meyer‐Monard, S., Huxol, H., Siegler, U., Rossier, M. F., Matthes, T., Rebsamen, M. C., et al. (2008) · Clinical Chemistry · doi:10.1373/clinchem.2008.108506 · Cited by 24
Nault, R., Kim, S., & Zacharewski, T. R. (2012) · Toxicology and Applied Pharmacology · doi:10.1016/j.taap.2012.11.028 · Cited by 25
Wang, R.-L., Bencic, D. C., García‐Reyero, N., Perkins, E. J., Villeneuve, D. L., Ankley, G. T., & Biales, A. D. (2014) · PLoS ONE · doi:10.1371/journal.pone.0114178 · Cited by 23
Identification of dysregulated genes in rheumatoid arthritis based on bioinformatics analysis
Hao, R., Du, H., Guo, L., Tian, F., An, N., Yang, T., Wang, C., Wang, B., & Zhou, Z. (2017) · PeerJ · doi:10.7717/peerj.3078 · Cited by 23
“The raw expression datasets were downloaded and preprocessed by log2 transformation in R language (Shi et al., 2006).”
MethodSelf-citationWolff, A., Bayerlová, M., Gaedcke, J., Kube, D., & Beißbarth, T. (2018) · PLoS ONE · doi:10.1371/journal.pone.0197162 · Cited by 30
Lusk, R., Stene, E., Banaei‐Kashani, F., Tabakoff, B., Kechris, K. J., & Saba, L. M. (2021) · Nature Communications · doi:10.1038/s41467-021-21894-x · Cited by 27
Designing, Performing, and Interpreting a Microarray-Based Gene Expression Study
Coppola, G. (2011) · Methods in molecular biology · doi:10.1007/978-1-61779-328-8_28 · Cited by 24
Chiche, L., Jourde‐Chiche, N., Pascual, V., & Chaussabel, D. (2013) · Arthritis & Rheumatism · doi:10.1002/art.37909 · Cited by 23
Analysis of blood-based gene expression signature in first-episode psychosis
Lee, J., Goh, L.-K., Chen, G., Verma, S. K., Tan, C., & Lee, T.-S. W. (2012) · Psychiatry Research · doi:10.1016/j.psychres.2012.03.021 · Cited by 23
Metadata
- Authors
- MAQC Consortium, Shi, L., Shi, L., Reid, L. H., Jones, W. D., Shippy, R., Warrington, J. A., Baker, S. C., Collins, P. J., de Longueville, F., Kawasaki, E. S., Lee, K. Y., Luo, Y., Sun, Y. A., Willey, J. C., Setterquist, R. A., Fischer, G. M., Tong, W., Dragan, Y. P., Dix, D. J., Frueh, F. W., Goodsaid, F. M., Herman, D., Jensen, R. V., Johnson, C. D., Lobenhofer, E. K., Puri, R. K., Scherf, U., Thierry-Mieg, J., Wang, C., Wilson, M., Wolber, P. K., Zhang, L., Amur, S., Bao, W., Barbacioru, C. C., Lucas, A. B., Bertholet, V., Boysen, C., Bromley, B., Brown, D., Brunner, A., Canales, R., Cao, X. M., Cebula, T. A., Chen, J. J., Cheng, J., Chu, T.-M., Chudin, E., Corson, J., Corton, J. C., Croner, L. J., Davies, C., Davison, T. S., Delenstarr, G., Deng, X., Dorris, D., Eklund, A. C., Fan, X.-H., Fang, H., Fulmer-Smentek, S., Fuscoe, J. C., Gallagher, K., Ge, W., Guo, L., Guo, X., Hager, J., Haje, P. K., Han, J., Han, T., Harbottle, H. C., Harris, S. C., Hatchwell, E., Hauser, C. A., Hester, S., Hong, H., Hurban, P., Jackson, S. A., Ji, H., Knight, C. R., Kuo, W. P., LeClerc, J. E., Levy, S., Li, Q.-Z., Liu, C., Liu, Y., Lombardi, M. J., Ma, Y., Magnuson, S. R., Maqsodi, B., McDaniel, T., Mei, N., Myklebost, O., Ning, B., Novoradovskaya, N., Orr, M. S., Osborn, T. W., Papallo, A., Patterson, T. A., Perkins, R. G., Peters, E. H., Peterson, R., Philips, K. L., Pine, P. S., Pusztai, L., Qian, F., Ren, H., Rosen, M., Rosenzweig, B. A., Samaha, R. R., Schena, M., Schroth, G. P., Shchegrova, S., Smith, D. D., Staedtler, F., Su, Z., Sun, H., Szallasi, Z., Tezak, Z., Thierry-Mieg, D., Thompson, K. L., Tikhonova, I., Turpaz, Y., Vallanat, B., Van, C., Walker, S. J., Wang, S. J., Wang, Y., Wolfinger, R., Wong, A., Wu, J., Xiao, C., Xie, Q., Xu, J., Yang, W., Zhang, L., Zhong, S., Zong, Y., & Slikker, W.
- Affiliations
- Affymetrix (United States) (US)
- Illumina (United States) (US)
- Agilent Technologies (United States) (US)
- National Cancer Institute (US)
- National Center for Toxicological Research (US)
- Environmental Protection Agency (US)
- United States Food and Drug Administration (US)
- National Institutes of Health (US)
- University of Massachusetts Boston (US)
- Asuragen (United States) (US)
- Center for Biologics Evaluation and Research (US)
- Cedars-Sinai Medical Center (US)
- SAS Institute (United States) (US)
- Center for Food Safety and Applied Nutrition (US)
- Biogen (United States) (US)
- Yale University (US)
- Center for Veterinary Medicine (US)
- Cold Spring Harbor Laboratory (US)
- Sanford Burnham Prebys Medical Discovery Institute (US)
- Stanford Medicine (US)
- Harvard University (US)
- Vanderbilt University (US)
- The University of Texas Southwestern Medical Center (US)
- The University of Texas at Dallas (US)
- GenUs BioSystems (United States) (US)
- Oslo University Hospital (NO)
- The University of Texas MD Anderson Cancer Center (US)
- Luminex (United States) (US)
- Wake Forest University Health Sciences (US)
- University of Illinois Urbana-Champaign (US)
- ORCID
- Jones, Wendell D
- Collins, Patrick J
- Luo, Yuling
- Sun, Yongming Andrew
- Willey, James C
- Tong, Weida
- Frueh, Felix W
- Goodsaid, Federico M
- Johnson, Charles D
- Puri, Raj K
- Scherf, Uwe
- Wang, Charles
- Bao, Wenjun
- Brown, Donna
- Chen, James J
- Cheng, Jing
- Corton, J Christopher
- Croner, Lisa J
- Deng, Xutao
- Eklund, Aron C
- Fang, Hong
- Guo, Lei
- Guo, Xu
- Han, Jing
- Han, Tao
- Harbottle, Heather C
- Harris, Stephen C
- Hatchwell, Eli
- Hester, Susan
- Hong, Huixiao
- Jackson, Scott A
- Ji, Hanlee
- Levy, Shawn
- Li, Quan-Zhen
- Liu, Chunmei
- Liu, Ying
- Ma, Yunqing
- Mei, Nan
- Myklebost, Ola
- Ning, Baitang
- Patterson, Tucker A
- Pusztai, Lajos
- Qian, Feng
- Schroth, Gary P
- Su, Zhenqiang
- Sun, Hongmei
- Tikhonova, Irina
- Turpaz, Yaron
- Walker, Stephen J
- Wang, Sue Jane
- Wang, Yonghong
- Wong, Alex
- Wu, Jie
- Xiao, Chunlin
- Xie, Qian
- Xu, Jun
- Yang, Wen
- Zhang, Liang
- Zhong, Sheng
- Slikker, William
- Venue
- Nature Biotechnology
- Published
- 2006-09-01
- Volume
- 24
- Issue
- 9
- Pages
- 1151-1161
- ISSN
- 0733-222X (ISSN-L)
- 1087-0156
- 1546-1696
- PMC
- PMC3272078
- OpenAlex
- W2010637767
- Cited by
- 2,126
- References
- 43
- Citations by year
- 2026: 21 · 2025: 25 · 2024: 23 · 2023: 39 · 2022: 37 · 2021: 60 · 2020: 43 · 2019: 59 · 2018: 68 · 2017: 87 · 2016: 87 · 2015: 98 · 2014: 122 · 2013: 155 · 2012: 160
- FWCI
- 87.96
- Type
- journal article
- Language
- en
- Open access
- green
- www.ncbi.nlm.nih.gov
- Licence
- www.springer.com/tdm (tdm)
- www.springer.com/tdm (vor)
- Locations
- Nature Biotechnology (publishedVersion)
- PubMed (publishedVersion)
- Europe PMC (PubMed Central) (acceptedVersion)
- PubMed Central (acceptedVersion)
- Digital Access to Libraries (Université catholique de Louvain (UCL), l'Université de Namur (UNamur) and the Université Saint-Louis (USL-B)) (submittedVersion)
- Funders
- U.S. Environmental Protection Agency
- National Institutes of Health (Z99 LM999999, Z99 HL999999, Z99 MH999999, Z99CL999999)
- Topics
- Life Sciences › Biochemistry, Genetics and Molecular Biology › Molecular Biology › Gene expression and cancer classification
- Life Sciences › Biochemistry, Genetics and Molecular Biology › Molecular Biology › Molecular Biology Techniques and Applications
- Life Sciences › Biochemistry, Genetics and Molecular Biology › Molecular Biology › Genomics and Phylogenetic Studies
- Keywords
- probe mapping, differentially expressed genes, microarray data analysis
- MeSH terms
- Equipment Design, Quality Assurance, Health Care, Quality Control, Sensitivity and Specificity, United States, Reproducibility of Results, Equipment Failure Analysis, Oligonucleotide Array Sequence Analysis, Gene Expression Profiling
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.