Controlling false-negative errors in microarray differential expression analysis: a PRIM approach
The DOI matches its Crossref record; 5 of the 5 references it cites were found in a registry or an index.
Abstract
Motivation: Theoretical considerations suggest that current microarray screening algorithms may fail to detect many true differences in gene expression (Type II analytic errors). We assessed ‘false negative’ error rates in differential expression analyses by conventional linear statistical models (e.g. t-test), microarray-adapted variants (e.g. SAM, Cyber-T), and a novel strategy based on hold-out cross-validation. The latter approach employs the machine-learning algorithm Patient Rule Induction Method (PRIM) to infer minimum thresholds for reliable change in gene expression from Boolean conjunctions of fold-induction and raw fluorescence measurements. Results: Monte Carlo analyses based on four empirical data sets show that conventional statistical models and their microarray-adapted variants overlook more than 50% of genes showing significant up-regulation. Conjoint PRIM prediction rules recover approximately twice as many differentially expressed transcripts while maintaining strong control over false-positive (Type I) errors. As a result, experimental replication rates increase and total analytic error rates decline. RT-PCR studies confirm that gene inductions detected by PRIM but overlooked by other methods represent true changes in mRNA levels. PRIM-based conjoint inference rules thus represent an improved strategy for high-sensitivity screening of DNA microarrays. Availability: Freestanding JAVA application at http://microarray.crump.ucla.edu/focus
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Tversky, A. (1977) · Psychological Review · doi:10.1037/0033-295x.84.4.327 · Cited by 7,414
Model-based analysis of oligonucleotide arrays: Expression index computation and outlier detection.
Li, C., & Wong, W. H. (2001) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.98.1.31 · Cited by 3,133
Transcriptional Regulatory Networks in Saccharomyces cerevisiae
Lee, T. I., Rinaldi, N. J., Robert, F., Odom, D. T., Bar-Joseph, Z., Gerber, G. K., Hannett, N. M., Harbison, C. T., Thompson, C. M., Simon, I., et al. (2002) · Science · doi:10.1126/science.1075090 · Cited by 2,956
Hakak, Y., Walker, J. R., Li, C., Wong, W. H., Davis, K. L., Buxbaum, J. D., Haroutunian, V., & Fienberg, A. A. (2001) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.081071198 · Cited by 1,192
Accuracy and calibration of commercial oligonucleotide and custom cDNA microarrays
Yuen, T. (2002) · Nucleic Acids Research · doi:10.1093/nar/30.10.e48 · Cited by 520 · cited 1×
“References below) ( Winer, 1971 ). In microarray screening, this problem is aggravated by increasing stringency to control for thousands of parallel hypothesis tests.”
Background
Cited by
Sleep Deprivation and Activation of Morning Levels of Cellular and Genomic Markers of Inflammation
Irwin, M. R. (2006) · Archives of Internal Medicine · doi:10.1001/archinte.166.16.1756 · Cited by 850
“PSD, we performed standard paired comparison analyses using GCOS, with default analysis parameters, which is known to be conservative in declaring differential gene expression.(21) Differences between an individual baseline sample and a PSD sample were declared significant at a P value of less than .”
MethodMiller, G. E., Chen, E., Fok, A. K., Walker, H., Lim, A., Nicholls, E. F., Cole, S., & Kobor, M. S. (2009) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0902971106 · Cited by 822
Self-citationSocial regulation of gene expression in human leukocytes
Cole, S. W., Hawkley, L. C., Arevalo, J. M., Sung, C. Y., Rose, R. M., & Cacioppo, J. T. (2007) · Genome Biology · doi:10.1186/gb-2007-8-9-r189 · Cited by 745
“DNA Microarray Core as previously described [41,59].”
MethodSelf-citationBarad, O., Meiri, E., Avniel, A., Aharonov, R., Barzilai, A., Bentwich, I., Einav, U., Gilad, S., Hurban, P., Karov, Y., et al. (2004) · Genome Research · doi:10.1101/gr.2845604 · Cited by 582
“In general, the microarray platform is prone to infrequent false-negative and false-positive data-points (e.g., Cole et al. 2003 ).”
BackgroundMiller, G. E., Chen, E., Sze, J., Marin, T., Arevalo, J. M. G., Doll, R., Ma, R., & Cole, S. W. (2008) · Biological Psychiatry · doi:10.1016/j.biopsych.2008.03.017 · Cited by 552
Self-citationFouse, S. D., Shen, Y., Pellegrini, M., Cole, S., Meissner, A., Van Neste, L., Jaenisch, R., & Fan, G. (2008) · Cell Stem Cell · doi:10.1016/j.stem.2007.12.011 · Cited by 452
Self-citationChen, E., Miller, G. E., Kobor, M. S., & Cole, S. W. (2011) · Molecular Psychiatry · doi:10.1038/mp.2010.53 · Cited by 340
Self-citationGlatt, S. J., Everall, I. P., Kremen, W. S., Corbeil, J., Šášik, R., Khanlou, N., Han, M., Liew, C.-C., & Tsuang, M. T. (2005) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0507666102 · Cited by 322
Cole, S. W., Hawkley, L. C., Arevalo, J. M. G., & Cacioppo, J. T. (2011) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1014218108 · Cited by 306
Self-citationCognitive-Behavioral Stress Management Reverses Anxiety-Related Leukocyte Transcriptional Dynamics
Antoni, M. H., Lutgendorf, S. K., Blomberg, B., Carver, C. S., Lechner, S., Diaz, A., Stagl, J., Arevalo, J. M. G., & Cole, S. W. (2012) · Biological Psychiatry · doi:10.1016/j.biopsych.2011.10.007 · Cited by 251
Self-citationIrwin, M. R., Olmstead, R., Breen, E. C., Witarama, T., Carrillo, C., Sadeghi, N., Arevalo, J. M. G., Ma, J., Nicassio, P., Bootzin, R., et al. (2015) · Biological Psychiatry · doi:10.1016/j.biopsych.2015.01.010 · Cited by 227
Self-citationDepression, social support, and beta-adrenergic transcription control in human ovarian cancer
Lutgendorf, S. K., DeGeest, K., Sung, C. Y., Arevalo, J. M., Penedo, F., Lucci, J., Goodheart, M., Lubaroff, D., Farley, D. M., Sood, A. K., et al. (2009) · Brain, Behavior, and Immunity · doi:10.1016/j.bbi.2008.04.155 · Cited by 215
Self-citationCohen, L., Cole, S. W., Sood, A. K., Prinsloo, S., Kirschbaum, C., Arevalo, J. M. G., Jennings, N. B., Scott, S., Vence, L., Wei, Q., et al. (2012) · PLoS ONE · doi:10.1371/journal.pone.0042324 · Cited by 197
“thresholds yield more replicable results than do p-value-based thresholds [35,36,37,38,39,40].”
BackgroundSelf-citationExpression-based monitoring of transcription factor activity: the TELiS database
Cole, S. W., Yan, W., Galic, Z., Arevalo, J., & Zack, J. A. (2005) · Bioinformatics · doi:10.1093/bioinformatics/bti038 · Cited by 185
“This problem is compounded by the fact that current analyses can severely underestimate the number of genes showing true differential expression (Cole et al., 2003).”
BackgroundMethodSelf-citationMiller, G. E., Murphy, M. L. M., Cashman, R., Ma, R., Ma, J., Arevalo, J. M. G., Kobor, M. S., & Cole, S. W. (2014) · Brain Behavior and Immunity · doi:10.1016/j.bbi.2014.05.016 · Cited by 166
“Transcriptional activity was analyzed with methods employed and validated in our previous research (Cole et al., 2003, 2005, 2011; Fredrickson et al., 2013; Miller et al., 2008).”
Self-citationElevating the perspective on human stress genomics
Cole, S. W. (2010) · Psychoneuroendocrinology · doi:10.1016/j.psyneuen.2010.06.008 · Cited by 123
Self-citationGenome-wide transcriptional profiling linked to social class in asthma
Chen, E., Miller, G. E., Walker, H. A., Arevalo, J. M., Sung, C. Y., & Cole, S. W. (2008) · Thorax · doi:10.1136/thx.2007.095091 · Cited by 118
Self-citationComplexity in Transcription Control at the Activation Domain–Mediator Interface
Balamotis, M. A., Pennella, M. A., Stevens, J. L., Wasylyk, B., Belmont, A. S., & Berk, A. J. (2009) · Science Signaling · doi:10.1126/scisignal.1164302 · Cited by 84
“Total RNAs from serum-deprived and +40-min cells were analyzed with Affymetrix microarrays and Focus software (55).”
Mehta, D., Raison, C. L., Woolwine, B. J., Haroon, E., Binder, E. B., Miller, A. H., & Felger, J. C. (2013) · Brain, Behavior, and Immunity · doi:10.1016/j.bbi.2013.04.004 · Cited by 74
“…expressed in responders compared to non-responders were defined as having a P20% difference (1.2-fold change) corresponding to a <10% FDR (Cole et al., 2003; Miller et al., 2008; Torres et al., 2013) and cut-off of p 6 0.01 (Haider et al., 2008), and were therefore highly predictive…”
BackgroundInfluentialA small molecule CRTH2 antagonist inhibits FITC-induced allergic cutaneous inflammation
Boehme, S. A., Franz-Bacon, K., Chen, E. P., Sasik, R., Sprague, L. J., Ly, T. W., Hardiman, G., & Bacon, K. B. (2009) · International Immunology · doi:10.1093/intimm/dxn127 · Cited by 60
“In designing the interest statistic, we borrow ideas from Cole et al. ( 21 ) and their software package Focus.”
MethodMcDade, T. W., M. Ross, K., L. Fried, R., Arevalo, J. M. G., Ma, J., Miller, G. E., & Cole, S. W. (2016) · Biodemography and Social Biology · doi:10.1080/19485565.2016.1185600 · Cited by 55
“No gene-specific statistical testing or False Discovery Rate analyses were performed because previous research has found these procedures to yield less replicable results than does mapping differentially expressed genes based on point-estimates of fold-difference (Cole et al. 2003; Shi et al. 2008; Witten & Tibshirani…”
Self-citation
Metadata
- Authors
- Cole, S. W., Galic, Z., & Zack, J. A.
- Venue
- Bioinformatics
- Publisher
- Oxford University Press (OUP)
- Published
- 2003-09-22
- Volume
- 19
- Issue
- 14
- Pages
- 1808-1816
- ISSN
- 1367-4803 (ISSN-L)
- 1367-4811
- OpenAlex
- W2172244951
- Cited by
- 107
- References
- 5
- FWCI
- 1.82
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.