Using RNA sample titrations to assess microarray platform performance and normalization techniques
Open accessThe DOI matches its Crossref record; 29 of the 29 references it cites were found in a registry or an index.
Abstract
We have assessed the utility of RNA titration samples for evaluating microarray platform performance and the impact of different normalization methods on the results obtained. As part of the MicroArray Quality Control project, we investigated the performance of five commercial microarray platforms using two independent RNA samples and two titration mixtures of these samples. Focusing on 12,091 genes common across all platforms, we determined the ability of each platform to detect the correct titration response across the samples. Global deviations from the response predicted by the titration ratios were observed. These differences could be explained by variations in relative amounts of messenger RNA as a fraction of total RNA between the two independent samples. Overall, both the qualitative and quantitative correspondence across platforms was high. In summary, titration samples may be regarded as a valuable tool, not only for assessing microarray platform performance and different analysis methods, but also for determining some underlying biological features of the samples.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“This implies inherent limitations for the read out of absolute expression level estimates and absolute quantification.”
From A comprehensive assessment of RNA-seq accuracy, reproducibility and information content by the Sequencing Quality Control Consortium (2014) · cites this paper as [26]
In the citing paper
“As the vendor-prepared libraries gave very uniform results across sites (Fig. 4d), the observed variations likely arose in library construction, and may partially be explained by platform-specific differences in kit chemistry and varying degrees of sample poly-adenylation”
From A comprehensive assessment of RNA-seq accuracy, reproducibility and information content by the Sequencing Quality Control Consortium (2014) · cites this paper as [26]
Citations
Cites
Exploration, normalization, and summaries of high density oligonucleotide array probe level data
Irizarry, R. A. (2003) · Biostatistics · doi:10.1093/biostatistics/4.2.249 · Cited by 10,603
Bolstad, B. M., Irizarry, R. A., Åstrand, M., & Speed, T. P. (2003) · Bioinformatics · doi:10.1093/bioinformatics/19.2.185 · Cited by 8,266
Summaries of Affymetrix GeneChip probe level data
Irizarry, R. A. (2003) · Nucleic Acids Research · doi:10.1093/nar/gng015 · Cited by 4,887
MAQC Consortium, Shi, L., Shi, L., Reid, L. H., Jones, W. D., Shippy, R., Warrington, J. A., Baker, S. C., Collins, P. J., de Longueville, F., et al. (2006) · Nature Biotechnology · doi:10.1038/nbt1239 · Cited by 2,126
Self-citationA Model-Based Background Adjustment for Oligonucleotide Expression Arrays
Wu, Z., Irizarry, R. A., Gentleman, R., Martinez-Murillo, F., & Spencer, F. (2004) · Journal of the American Statistical Association · doi:10.1198/016214504000000683 · Cited by 1,716
Expression profiling using microarrays fabricated by an ink-jet oligonucleotide synthesizer
Hughes, T. R., Mao, M., Jones, A. R., Burchard, J., Marton, M. J., Shannon, K. W., Lefkowitz, S. M., Ziman, M., Schelter, J. M., Meyer, M. R., et al. (2001) · Nature Biotechnology · doi:10.1038/86730 · Cited by 1,298
Multiple-laboratory comparison of microarray platforms
Irizarry, R. A., Warren, D., Spencer, F., Kim, I. F., Biswal, S., Frank, B. C., Gabrielson, E., Garcia, J. G. N., Geoghegan, J., Germino, G., et al. (2005) · Nature Methods · doi:10.1038/nmeth756 · Cited by 862
Self-citationAccuracy and calibration of commercial oligonucleotide and custom cDNA microarrays
Yuen, T. (2002) · Nucleic Acids Research · doi:10.1093/nar/30.10.e48 · Cited by 520
Independence and reproducibility across microarray platforms
Larkin, J. E., Frank, B. C., Gavras, H., Sultana, R., & Quackenbush, J. (2005) · Nature Methods · doi:10.1038/nmeth757 · Cited by 421
Comparison of Affymetrix GeneChip expression measures
Irizarry, R. A., Wu, Z., & Jaffee, H. A. (2006) · Bioinformatics · doi:10.1093/bioinformatics/btk046 · Cited by 312
A benchmark for Affymetrix GeneChip expression measures
Cope, L. M., Irizarry, R. A., Jaffee, H. A., Wu, Z., & Speed, T. P. (2004) · Bioinformatics · doi:10.1093/bioinformatics/btg410 · Cited by 282
Stochastic Models Inspired by Hybridization Theory for Short Oligonucleotide Arrays
Wu, Z., & Irizarry, R. A. (2005) · Journal of Computational Biology · doi:10.1089/cmb.2005.12.882 · Cited by 265
Barnes, M. (2005) · Nucleic Acids Research · doi:10.1093/nar/gki890 · Cited by 255
Shi, L., Tong, W., Fang, H., Scherf, U., Han, J., Puri, R. K., Frueh, F. W., Goodsaid, F. M., Guo, L., Su, Z., et al. (2005) · BMC Bioinformatics · doi:10.1186/1471-2105-6-s2-s12 · Cited by 201
Self-citationDobbin, K. K., Beer, D. G., Meyerson, M., Yeatman, T. J., Gerald, W. L., Jacobson, J. W., Conley, B., Buetow, K. H., Heiskanen, M., Simon, R. M., et al. (2005) · Clinical Cancer Research · doi:10.1158/1078-0432.565.11.2 · Cited by 179
Spotted Long Oligonucleotide Arrays for Human Gene Expression Analysis
Barczak, A., Rodriguez, M. W., Hanspers, K., Koth, L. L., Tai, Y. C., Bolstad, B. M., Speed, T. P., & Erle, D. J. (2003) · Genome Research · doi:10.1101/gr.1048803 · Cited by 179
An interactive power analysis tool for microarray hypothesis testing and generation
Seo, J., Gordish-Dressman, H., & Hoffman, E. P. (2006) · Bioinformatics · doi:10.1093/bioinformatics/btk052 · Cited by 150
Shippy, R., Sendera, T. J., Lockner, R., Palaniappan, C., Kaysser-Kranich, T., Watts, G., & Alsobrook, J. (2004) · BMC Genomics · doi:10.1186/1471-2164-5-61 · Cited by 147
Self-citationDetermination of minimum sample size and discriminatory expression patterns in microarray data
Hwang, D., Schmitt, W. A., Stephanopoulos, G., & Stephanopoulos, G. (2002) · Bioinformatics · doi:10.1093/bioinformatics/18.9.1184 · Cited by 128
Differential Gene Expression Patterns Revealed by Oligonucleotide Versus Long cDNA Arrays
Li, J. (2002) · Toxicological Sciences · doi:10.1093/toxsci/69.2.383 · Cited by 121
A simple method for assessing sample sizes in microarray experiments
Tibshirani, R. (2006) · BMC Bioinformatics · doi:10.1186/1471-2105-7-106 · Cited by 116
Evaluation of external RNA controls for the assessment of microarray performance
Tong, W., Lucas, A. B., Shippy, R., Fan, X., Fang, H., Hong, H., Orr, M. S., Chu, T., Guo, X., Collins, P. J., et al. (2006) · Nature Biotechnology · doi:10.1038/nbt1237 · Cited by 109
Self-citationChudin, E., Walker, R., Kosaka, A. H., Wu, S. X., Rabert, D. K., Chang, T. K., & Kreder, D. E. (2001) · Genome biology · doi:10.1186/gb-2001-3-1-research0005 · Cited by 102
Self-citationEffect of Normalization on Significance Testing for Oligonucleotide Microarrays
Parrish, R. S., & Spencer, H. J. (2004) · Journal of Biopharmaceutical Statistics · doi:10.1081/bip-200025650 · Cited by 81
The PowerAtlas: a power and sample size atlas for microarray experimental design and research
Page, G. P., Edwards, J. W., Gadbury, G. L., Yelisetti, P., Wang, J., Trivedi, P., & Allison, D. B. (2006) · BMC Bioinformatics · doi:10.1186/1471-2105-7-84 · Cited by 73
Dorris, D. R., Nguyen, A., Gieser, L. M., Lockner, R., Lublinsky, A., Patterson, M., Touma, E., Sendera, T. J., Elghanian, R., & Mazumder, A. (2003) · BMC Biotechnology · doi:10.1186/1472-6750-3-6 · Cited by 58
Naef, F., Socci, N. D., & Magnasco, M. O. (2003) · Bioinformatics · doi:10.1093/bioinformatics/19.2.178 · Cited by 49
Use of a mixed tissue RNA design for performance assessments on multiple microarray formats
Thompson, K. L. (2005) · Nucleic Acids Research · doi:10.1093/nar/gni186 · Cited by 35
Expression Profiling with Oligonucleotide Arrays: Technologies and Applications for Neurobiology
Sendera, T. J., Dorris, D. R., Ramakrishnan, R., Nguyen, A., Trakas, D., & Mazumder, A. (2002) · Neurochemical Research · doi:10.1023/a:1020948603490 · Cited by 10
Cited by
MAQC Consortium, Shi, L., Shi, L., Reid, L. H., Jones, W. D., Shippy, R., Warrington, J. A., Baker, S. C., Collins, P. J., de Longueville, F., et al. (2006) · Nature Biotechnology · doi:10.1038/nbt1239 · Cited by 2,126
“The relative accuracy of the microarray platforms can be assessed using either the titrated mixtures of the RNA samples 23 or gene abundance measurements collected with alternative technologies 22 .”
MethodResultInfluentialSelf-citationSEQC/MAQC-III Consortium (2014) · Nature Biotechnology · doi:10.1038/nbt.2957 · Cited by 983
Self-citationMAQC Consortium (2010) · Nature Biotechnology · doi:10.1038/nbt.1665 · Cited by 889
Self-citationEvaluation of quantitative miRNA expression platforms in the microRNA quality control (miRQC) study
Mestdagh, P., Hartmann, N., Baeriswyl, L., Andreasen, D., Bernard, N., Chen, C., Cheo, D., D'Andrade, P., DeMayo, M., Dennis, L., et al. (2014) · Nature Methods · doi:10.1038/nmeth.3014 · Cited by 660
Self-citationEvaluation of DNA microarray results with quantitative gene expression platforms
Canales, R. D., Luo, Y., Willey, J. C., Austermiller, B., Barbacioru, C. C., Boysen, C., Hunkapiller, K., Jensen, R. V., Knight, C. R., Lee, K. Y., et al. (2006) · Nature Biotechnology · doi:10.1038/nbt1236 · Cited by 615
Self-citation
Metadata
- Authors
- Shippy, R., Fulmer-Smentek, S., Jensen, R. V., Jones, W. D., Wolber, P. K., Johnson, C. D., Pine, P. S., Boysen, C., Guo, X., Chudin, E., Sun, Y. A., Willey, J. C., Thierry-Mieg, J., Thierry-Mieg, D., Setterquist, R. A., Wilson, M., Lucas, A. B., Novoradovskaya, N., Papallo, A., Turpaz, Y., Baker, S. C., Warrington, J. A., Shi, L., & Herman, D.
- Affiliations
- Agilent Technologies (United States) (US)
- University of Massachusetts Boston (US)
- Asuragen (United States) (US)
- United States Food and Drug Administration (US)
- Affymetrix (United States) (US)
- Illumina (United States) (US)
- University of Toledo (US)
- National Center for Toxicological Research (US)
- National Center for Biotechnology Information (US)
- Corresponding author
- Shippy, Richard
- ORCID
- Venue
- Nature Biotechnology
- Published
- 2006-09-01
- Volume
- 24
- Issue
- 9
- Pages
- 1123-1131
- ISSN
- 0733-222X (ISSN-L)
- 1087-0156
- 1546-1696
- PMC
- PMC3272080
- OpenAlex
- W2010305827
- Cited by
- 173
- References
- 29
- Citations by year
- 2026: 1 · 2024: 1 · 2022: 1 · 2021: 7 · 2020: 10 · 2019: 5 · 2018: 9 · 2017: 6 · 2016: 8 · 2015: 7 · 2014: 9 · 2013: 4 · 2012: 10
- FWCI
- 9.25
- Type
- journal article
- Language
- en
- Open access
- green
- www.ncbi.nlm.nih.gov
- Licence
- www.springer.com/tdm (tdm)
- www.springer.com/tdm (vor)
- Locations
- Nature Biotechnology (publishedVersion)
- PubMed (publishedVersion)
- Europe PMC (PubMed Central) (acceptedVersion)
- PubMed Central (acceptedVersion)
- Funders
- National Institutes of Health (Z99 LM999999, Z99 HL999999, Z99 MH999999, Z99CL999999)
- Topics
- Life Sciences › Biochemistry, Genetics and Molecular Biology › Molecular Biology › Gene expression and cancer classification
- Life Sciences › Biochemistry, Genetics and Molecular Biology › Molecular Biology › Genomics and Phylogenetic Studies
- Life Sciences › Biochemistry, Genetics and Molecular Biology › Molecular Biology › Molecular Biology Techniques and Applications
- Keywords
- normalization methods, microarray quality control, gene expression profiling, quality control
- MeSH terms
- Algorithms, Reference Values, RNA, Sensitivity and Specificity, United States, Reproducibility of Results, Equipment Failure Analysis, Oligonucleotide Array Sequence Analysis, Gene Expression Profiling
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.