Using RNA sample titrations to assess microarray platform performance and normalization techniques
Open accessThe DOI matches its Crossref record; 29 of the 29 references it cites were found in a registry or an index.
Abstract
We have assessed the utility of RNA titration samples for evaluating microarray platform performance and the impact of different normalization methods on the results obtained. As part of the MicroArray Quality Control project, we investigated the performance of five commercial microarray platforms using two independent RNA samples and two titration mixtures of these samples. Focusing on 12,091 genes common across all platforms, we determined the ability of each platform to detect the correct titration response across the samples. Global deviations from the response predicted by the titration ratios were observed. These differences could be explained by variations in relative amounts of messenger RNA as a fraction of total RNA between the two independent samples. Overall, both the qualitative and quantitative correspondence across platforms was high. In summary, titration samples may be regarded as a valuable tool, not only for assessing microarray platform performance and different analysis methods, but also for determining some underlying biological features of the samples.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“This implies inherent limitations for the read out of absolute expression level estimates and absolute quantification.”
From A comprehensive assessment of RNA-seq accuracy, reproducibility and information content by the Sequencing Quality Control Consortium (2014) · cites this paper as [26]
In the citing paper
“As the vendor-prepared libraries gave very uniform results across sites (Fig. 4d), the observed variations likely arose in library construction, and may partially be explained by platform-specific differences in kit chemistry and varying degrees of sample poly-adenylation”
From A comprehensive assessment of RNA-seq accuracy, reproducibility and information content by the Sequencing Quality Control Consortium (2014) · cites this paper as [26]
Citations
Cites
Exploration, normalization, and summaries of high density oligonucleotide array probe level data
Irizarry, R. A. (2003) · Biostatistics · doi:10.1093/biostatistics/4.2.249 · Cited by 10,603
Bolstad, B. M., Irizarry, R. A., Åstrand, M., & Speed, T. P. (2003) · Bioinformatics · doi:10.1093/bioinformatics/19.2.185 · Cited by 8,266
Summaries of Affymetrix GeneChip probe level data
Irizarry, R. A. (2003) · Nucleic Acids Research · doi:10.1093/nar/gng015 · Cited by 4,887
MAQC Consortium, Shi, L., Shi, L., Reid, L. H., Jones, W. D., Shippy, R., Warrington, J. A., Baker, S. C., Collins, P. J., de Longueville, F., et al. (2006) · Nature Biotechnology · doi:10.1038/nbt1239 · Cited by 2,126
Self-citationA Model-Based Background Adjustment for Oligonucleotide Expression Arrays
Wu, Z., Irizarry, R. A., Gentleman, R., Martinez-Murillo, F., & Spencer, F. (2004) · Journal of the American Statistical Association · doi:10.1198/016214504000000683 · Cited by 1,716
Expression profiling using microarrays fabricated by an ink-jet oligonucleotide synthesizer
Hughes, T. R., Mao, M., Jones, A. R., Burchard, J., Marton, M. J., Shannon, K. W., Lefkowitz, S. M., Ziman, M., Schelter, J. M., Meyer, M. R., et al. (2001) · Nature Biotechnology · doi:10.1038/86730 · Cited by 1,298
Multiple-laboratory comparison of microarray platforms
Irizarry, R. A., Warren, D., Spencer, F., Kim, I. F., Biswal, S., Frank, B. C., Gabrielson, E., Garcia, J. G. N., Geoghegan, J., Germino, G., et al. (2005) · Nature Methods · doi:10.1038/nmeth756 · Cited by 862
Self-citationAccuracy and calibration of commercial oligonucleotide and custom cDNA microarrays
Yuen, T. (2002) · Nucleic Acids Research · doi:10.1093/nar/30.10.e48 · Cited by 520
Independence and reproducibility across microarray platforms
Larkin, J. E., Frank, B. C., Gavras, H., Sultana, R., & Quackenbush, J. (2005) · Nature Methods · doi:10.1038/nmeth757 · Cited by 421
Comparison of Affymetrix GeneChip expression measures
Irizarry, R. A., Wu, Z., & Jaffee, H. A. (2006) · Bioinformatics · doi:10.1093/bioinformatics/btk046 · Cited by 312
Cited by
Items 101–173 of 173
Momose, H., Imai, J., Hamaguchi, I., Kawamura, M., Mizukami, T., Naito, S., Masumi, A., Maeyama, J., Takizawa, K., Kuramitsu, M., et al. (2010) · Japanese Journal of Infectious Diseases · doi:10.7883/yoken.63.25 · Cited by 10
Differential expression of genes in retinoblastoma
Saxena, P., & Kaur, J. (2010) · Clinica Chimica Acta · doi:10.1016/j.cca.2010.10.009 · Cited by 10
Cauerhff, A., Martinez, Y. N., Islan, G. A., & Castro, G. R. (2013) · Nanomedicine and nanotoxicology · doi:10.1007/978-1-4614-8993-1_3 · Cited by 11
Hu, Y., & Kasabov, N. K. (2008) · Lecture notes in computer science · doi:10.1007/978-3-540-69162-4_88 · Cited by 9
Brain changes in iron loading disorders
Milward, E. A., Acikyol, B., Bassett, B., Williams, E. J., Graham, R. M., Delima, R. D., Trinder, D., Olynyk, J. K., & Johnstone, D. M. (2012) · Springer eBooks · doi:10.1007/978-3-7091-1001-0_2 · Cited by 13
Cross-platform comparison of microarray data using order restricted inference
Klinglmueller, F., Tuechler, T., & Posch, M. (2011) · Bioinformatics · doi:10.1093/bioinformatics/btr066 · Cited by 9
Thompson, K. L., & Pine, P. S. (2008) · Toxicology Letters · doi:10.1016/j.toxlet.2008.08.018 · Cited by 9
Self-citationMicroarray Normalization Revisited for Reproducible Breast Cancer Biomarkers
Kenn, M., Castillo‐Tong, D. C., Singer, C. F., Cibena, M., KÖLBL, H., & Schreiner, W. (2020) · BioMed Research International · doi:10.1155/2020/1363827 · Cited by 9
Application of a correlation correction factor in a microarray cross-platform reproducibility study
Archer, K. J., Dumur, C. I., Taylor, G. S., Chaplin, M. D., Guiseppi‐Elie, A., Grant, G. M., Ferreira‐Gonzalez, A., & Garrett, C. T. (2007) · BMC Bioinformatics · doi:10.1186/1471-2105-8-447 · Cited by 8
Gene Network for Identifying the Entropy Changes of Different Modules in Pediatric Sepsis
Yang, H. J., Zhang, P., & Wang, L. (2016) · Cellular Physiology and Biochemistry · doi:10.1159/000453169 · Cited by 8
Shimohira, T., Niimi, H., Ohsugi, Y., Tsuchiya, Y., Morita, K., Yoshida, S., Hatasa, M., Shiba, T., Kadokura, H., Yokose, S., et al. (2021) · Photobiomodulation Photomedicine and Laser Surgery · doi:10.1089/photob.2020.4958 · Cited by 7
Heinicke, F., Zhong, X., Zucknick, M., Breidenbach, J., Sundaram, A. Y. M., Flåm, S. T., Leithaug, M., Dalland, M., Rayner, S., Lie, B. A., et al. (2020) · RNA Biology · doi:10.1080/15476286.2020.1761081 · Cited by 7
Ôhara, A., Yamada, F., Fukuda, T., Suzuki, N., & Sumida, K. (2018) · Journal of Applied Toxicology · doi:10.1002/jat.3693 · Cited by 7
Summarizing performance for genome scale measurement of miRNA: reference samples and metrics
Pine, P. S., Lund, S. P., Parsons, J., Vang, L., Mahabal, A. A., Cinquini, L., Kelly, S. C., Kincaid, H., Crichton, D. J., Spira, A. E., et al. (2018) · BMC Genomics · doi:10.1186/s12864-018-4496-1 · Cited by 6
Self-citationSato, N., Sudo, K., Mori, M., Imai, C., Muramatsu, M., & Sugimoto, M. (2017) · Scientific Reports · doi:10.1038/s41598-017-10380-4 · Cited by 7
Shintani, M., Mitsunaga, F., Shimabukuro, S., & Nakamura, S. (2015) · Food and Nutrition Sciences · doi:10.4236/fns.2015.612116 · Cited by 6
Ball, N. S., Rasoulpour, R. J., Zablotny, C. L., Ellis‐Hutchings, R. G., Andrus, A. K., & Carney, E. W. (2014) · Reproductive Toxicology · doi:10.1016/j.reprotox.2014.07.075 · Cited by 6
Eggle, D., Debey‐Pascher, S., Beyer, M., & Schultze, J. L. (2009) · BMC Bioinformatics · doi:10.1186/1471-2105-10-186 · Cited by 6
Kim, C., Choi, J., Park, H., Park, Y., Park, J., Park, T., Cho, K., Yang, Y. D., & Yoon, S. (2010) · Bioinformatics · doi:10.1093/bioinformatics/btq279 · Cited by 6
Multiplex cDNA quantification method that facilitates the standardization of gene expression data
Gotoh, O., Murakami, Y., & Suyama, A. (2011) · Nucleic Acids Research · doi:10.1093/nar/gkr138 · Cited by 6
Chae, S., Mitsunaga, F., Jung, S., Ha, K.-C., Sin, H., Jang, S., & Nakamura, S. (2014) · Food and Nutrition Sciences · doi:10.4236/fns.2014.522235 · Cited by 6
Bruning, O., Yuan, X., Rodenburg, W., Bruins, W., van Oostrom, C. T., Rauwerda, H., Wittink, F. R. A., Jonker, M. J., de Vries, A., & Breit, T. M. (2010) · Transcription · doi:10.4161/trns.1.3.13487 · Cited by 5
Chae, S., Mitsunaga, F., Jung, S., Ha, K.-C., Sin, H., Jang, S., & Nakamura, S. (2015) · Food and Nutrition Sciences · doi:10.4236/fns.2015.62029 · Cited by 6
Kasabov, N. K., Song, Q., Beňušková, Ľ., Gottgtroy, P. C. M., Jain, V. K., Verma, A., Havukkala, I., Rush, E. C., Pears, R., Tjahjana, A., et al. (2009) · Studies in computational intelligence · doi:10.1007/978-3-540-70778-3_4 · Cited by 5
Ose, K., Yamada, F., Ôhara, A., Suzuki, N., Fukuda, T., Miyamoto, M., & Sumida, K. (2019) · Journal of Applied Toxicology · doi:10.1002/jat.3791 · Cited by 5
Microarray Technology: Unresolved Issues and Future Challenges from a Regulatory Perspective
Shi, L. M., Goodsaid, F. M., Frueh, F. W., & Tong, W. (2008) · Springer series on fluorescence · doi:10.1007/4243_2008_035 · Cited by 4
Self-citationThe cost of reducing starting RNA quantity for Illumina BeadArrays: A bead-level dilution experiment
Lynch, A. G., Hadfield, J., Dunning, M., Osborne, M., Thorne, N., & Tavaré, S. (2010) · BMC Genomics · doi:10.1186/1471-2164-11-540 · Cited by 4
Normalization and Technical Variation in Gene Expression Measurements
Liggett, W. (2006) · Journal of Research of the National Institute of Standards and Technology · doi:10.6028/jres.111.026 · Cited by 6
Systematic assessment of commercially available low-input miRNA library preparation kitsPreprint
Heinicke, F., Zhong, X., Zucknick, M., Breidenbach, J., Sundaram, A. Y. M., Flåm, S. T., Leithaug, M., Dalland, M., Farmer, A. A., Henderson, J. M., et al. (2019) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/702456 · Cited by 3
Reply to MAQC papers over the cracks
(2007) · Nature Biotechnology · doi:10.1038/nbt0107-28 · Cited by 3
LTR: Linear Cross-Platform Integration of Microarray Data
Boutros, P. C. (2010) · Cancer Informatics · doi:10.4137/cin.s5756 · Cited by 2
Virus Scan System Based on Hardware-Acceleration
Zhang, B., Wang, J., & Pan, X. (2007) · International Multi-Symposiums on Computer and Computational Sciences · doi:10.1109/imsccs.2007.21 · Cited by 2
Transcriptomic Dose–Response Analysis for Mode of Action and Risk Assessment
Thomas, R. S., & Waters, M. D. (2016) · Royal Society of Chemistry eBooks · doi:10.1039/9781782624059-00154 · Cited by 3
Keep it simple: microarray cross-platform comparison without statistics
Herman, D. (2008) · Birkhäuser Basel eBooks · doi:10.1007/978-3-7643-8334-3_15 · Cited by 1
Self-citationAnalysis of Transcriptomic Dose–Response Data for Toxicology and Risk Assessment
Thomas, R. S., Yang, L., M.A., H. J. C. I., & Andersen, M. E. (2011) · Wiley eBooks · doi:10.1002/9781118001042.ch11 · Cited by 1
Toxicogenomics in Risk Assessment
Makris, S. L., & Euling, S. Y. (2009) · Wiley eBooks · doi:10.1002/9780470744307.gat121 · Cited by 1
Variation-preserving normalization unveils blind spots in gene expression profilingPreprint
Roca, C. P., Gomes, S. I. L., Amorim, M. J. B., & Scott-Fordsmand, J. J. (2015) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/021212 · Cited by 2
Heinicke, F., Zhong, X., Zucknick, M., Breidenbach, J., Sundaram, A. Y. M., Flåm, S. T., Leithaug, M., Dalland, M., Rayner, S., Lie, B. A., et al. (2020) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2020.01.25.919431 · Cited by 1
Plasma titration provides a physical ruler for cross-platform proteomicsPreprint
Liu, Y., Wang, H., Zhang, Y., Lu, R., Xu, W., Hou, W., Zhu, Y., Li, X., Chen, Q., Gao, Y., et al. (2026) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.64898/2026.08.09.740864 · Cited by 1
Self-citationMicroarrays in molecular profiling of cancer - focus on head and neck squamous cell carcinoma
Järvinen, A. (2008) · Työväentutkimus Vuosikirja
Brown, E. J. H. (2008) · St Andrews Research Repository (St Andrews Research Repository)
Microarray-based expression signatures: potential application for individualized cancer treatment
Starmans, M. H. W. (2011) · Research Publications (Maastricht University) · doi:10.26481/dis.20111125ms
Molecular Profiling for Early Detection and Prediction of Response in Lung Cancer
Kaufman, J. M., & Carbone, D. P. (2008) · Lung Cancer · doi:10.1002/9780470696330.ch10
Expression profiling in pediatric acute leukemias
Jennings, L. J., & Huang, C. (2011) · Cambridge University Press eBooks · doi:10.1017/cbo9780511781292.012
Integrating bioinformatics and physiology to describe genetic effects in complex polygenic diseases
Parikh, H. M. (2009) · Lund University Publications (Lund University) · Cited by 1
Semiparametric RMA Background-Correction for Oligonucleotide Arrays
Bebu, I., Seillier‐Moiseiwitsch, F., & Liu, H. (2007) · IEEE International Conference on Bioinformatics and Bioengineering (BIBE) · doi:10.1109/bibe.2007.4375756
A simulation-based approach for evaluating microarray analyses
Blades, N. J., Grimshaw, S. D., & Pendleton, C. R. (2010) · Biostatistics · doi:10.1093/biostatistics/kxq010
ArrayWiki: Liberating Microarray Data from Non-collaborativePublic Repositories
Stokes, T. H., Torrance, T. J., Goasduff, N. L., Li, H., & Wang, M. D. (2007) · International Multi-Symposiums on Computer and Computational Sciences · doi:10.1109/imsccs.2007.88
Insights from reconstructing cellular networks in transcription, stress, and cancer
Ke, E. (2012) · eScholarship (California Digital Library)
Bioinformatics and Systems Biology
Ke, E., Cavenee, W., & Hoffmann, A. (2012)
Normalizzazione per dati di microarray a singolo canale
Rotolo, F. (2009)
implementation of the RMA method for
Wagner, F. (2016)
What are the most influencing factors in reconstructing a reliable transcriptome assembly?Preprint
Ghaffari, N., Abante, J., Singh, R., Blood, P. D., Pipes, L., Mason, C. E., & Johnson, C. D. (2017) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/220269
Self-citationChao, J., Chaban, G., Cheng, C., Piarar, S., Liew, C., & Chao, S. T. (2018) · Journal of Clinical & Experimental Pathology · doi:10.4172/2161-0681.1000333
Adachi, S., Aoki, H., Ueda, Y., Sudo, T., Nozawa, A., Koga, S., Suzuki, H., Shibayama, S., Noda, N., Fujii, S., et al. (2019) · Analytical Biochemistry · doi:10.1016/j.ab.2019.113360 · Cited by 1
Chow, S.-C. (2011) · Chapman & Hall/CRC biostatistics series · doi:10.1201/b10987-29
Page, G. P., & Cui, X. (2014) · Wiley eBooks · doi:10.1002/9781118445112.stat06930
Page, G. P., & Cui, X. (2014) · Wiley eBooks · doi:10.1002/9781118596333.ch23
Byers, L. A. (2014) · Wiley eBooks · doi:10.1002/9781118468791.ch3
Page, G. P., & Cui, X. (2008) · Wiley eBooks · doi:10.1002/9780471462422.eoct526
Tong, W., & Mendrick, D. L. (2010) · Biomarkers · doi:10.1002/9780470918562.ch2
Xiaokun, T., & 肖华胜 (2008) · Science in China Series C-Life Sciences (in Chinese) · doi:10.1360/zc2008-38-10-891 · Cited by 1
Sho, C., KAWANO, K., Hou, D., Yoshimoto, M., & Okuno, H. (2022) · Journal of Bioscience and Bioengineering · doi:10.1016/j.jbiosc.2022.10.004
Lynch, A. G., Hadfield, J., Dunning, M. J., Osborne, M., Thorne, N. P., & Tavaré, S. (2021) · Figshare · doi:10.6084/m9.figshare.14437658
Lynch, A. G., Hadfield, J., Dunning, M. J., Osborne, M., Thorne, N. P., & Tavaré, S. (2021) · Figshare · doi:10.6084/m9.figshare.14437655
Lynch, A. G., Hadfield, J., Dunning, M. J., Osborne, M., Thorne, N. P., & Tavaré, S. (2021) · Figshare · doi:10.6084/m9.figshare.14437661
Lynch, A. G., Hadfield, J., Dunning, M. J., Osborne, M., Thorne, N. P., & Tavaré, S. (2021) · Figshare · doi:10.6084/m9.figshare.14437652
Lynch, A. G., Hadfield, J., Dunning, M. J., Osborne, M., Thorne, N. P., & Tavaré, S. (2021) · Figshare · doi:10.6084/m9.figshare.14437667
Lynch, A. G., Hadfield, J., Dunning, M. J., Osborne, M., Thorne, N. P., & Tavaré, S. (2021) · Figshare · doi:10.6084/m9.figshare.14437664
Analysis of toxicity using bio-digital contents
Kang, J. S. (2010) · Journal of Digital Contents Society
Décrypter les données omiques : importance du contrôle qualité. Application au cancer de l'ovaire
Sambourg, L. (2013) · theses.fr (ABES) · doi:10.70675/1d91eb8bzbee9z49b6zbccfzeffd6c25336e · Cited by 2
Metadata
- Authors
- Shippy, R., Fulmer-Smentek, S., Jensen, R. V., Jones, W. D., Wolber, P. K., Johnson, C. D., Pine, P. S., Boysen, C., Guo, X., Chudin, E., Sun, Y. A., Willey, J. C., Thierry-Mieg, J., Thierry-Mieg, D., Setterquist, R. A., Wilson, M., Lucas, A. B., Novoradovskaya, N., Papallo, A., Turpaz, Y., Baker, S. C., Warrington, J. A., Shi, L., & Herman, D.
- Affiliations
- Agilent Technologies (United States) (US)
- University of Massachusetts Boston (US)
- Asuragen (United States) (US)
- United States Food and Drug Administration (US)
- Affymetrix (United States) (US)
- Illumina (United States) (US)
- University of Toledo (US)
- National Center for Toxicological Research (US)
- National Center for Biotechnology Information (US)
- Corresponding author
- Shippy, Richard
- ORCID
- Venue
- Nature Biotechnology
- Published
- 2006-09-01
- Volume
- 24
- Issue
- 9
- Pages
- 1123-1131
- ISSN
- 0733-222X (ISSN-L)
- 1087-0156
- 1546-1696
- PMC
- PMC3272080
- OpenAlex
- W2010305827
- Cited by
- 173
- References
- 29
- Citations by year
- 2026: 1 · 2024: 1 · 2022: 1 · 2021: 7 · 2020: 10 · 2019: 5 · 2018: 9 · 2017: 6 · 2016: 8 · 2015: 7 · 2014: 9 · 2013: 4 · 2012: 10
- FWCI
- 9.25
- Type
- journal article
- Language
- en
- Open access
- green
- www.ncbi.nlm.nih.gov
- Licence
- www.springer.com/tdm (tdm)
- www.springer.com/tdm (vor)
- Locations
- Nature Biotechnology (publishedVersion)
- PubMed (publishedVersion)
- Europe PMC (PubMed Central) (acceptedVersion)
- PubMed Central (acceptedVersion)
- Funders
- National Institutes of Health (Z99 LM999999, Z99 HL999999, Z99 MH999999, Z99CL999999)
- Topics
- Life Sciences › Biochemistry, Genetics and Molecular Biology › Molecular Biology › Gene expression and cancer classification
- Life Sciences › Biochemistry, Genetics and Molecular Biology › Molecular Biology › Genomics and Phylogenetic Studies
- Life Sciences › Biochemistry, Genetics and Molecular Biology › Molecular Biology › Molecular Biology Techniques and Applications
- Keywords
- normalization methods, microarray quality control, gene expression profiling, quality control
- MeSH terms
- Algorithms, Reference Values, RNA, Sensitivity and Specificity, United States, Reproducibility of Results, Equipment Failure Analysis, Oligonucleotide Array Sequence Analysis, Gene Expression Profiling
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.