Face up to false positives
Open accessThe DOI matches its Crossref record; 10 of the 10 references it cites were found in a registry or an index.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“False positives, on the other hand, are notoriously difficult for peer reviewers to assess [75,76].”
From The natural selection of bad science (2016) · cites this paper as [75]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
2 retracted
Genetic Signatures of Exceptional Longevity in Humans
Sebastiani, P., Solovieff, N., Puca, A., Hartley, S. W., Melista, E., Andersen, S., Dworkis, D. A., Wilk, J. B., Myers, R. H., Steinberg, M. H., et al. (2010) · Science · doi:10.1126/science.1190532 · Cited by 141
RetractedPaola Sebastiani, B., Solovieff, N., Puca, A. A., Hartley, S. W., Melista, E., Andersen, S. L., Dworkis, D. A., Wilk, J. B., Myers, R. H., Steinberg, M. H., et al. (2011) · Science · doi:10.1126/science.333.6041.404-a · Cited by 42
RetractedGenetic signatures of exceptional longevity in humans
Sebastiani, P., Solovieff, N., DeWan, A. T., Walsh, K. M., Puca, A., Hartley, S. W., Melista, E., Andersen, S., Dworkis, D. A., Wilk, J. B., et al. (2012) · PLoS ONE · doi:10.1371/journal.pone.0029848 · Cited by 464
Widespread RNA and DNA Sequence Differences in the Human Transcriptome
Li, M., Wang, I. X., Li, Y., Bruzel, A., Richards, A. L., Toung, J. M., & Cheung, V. G. (2011) · Science · doi:10.1126/science.1207018 · Cited by 463
Comment on “Widespread RNA and DNA Sequence Differences in the Human Transcriptome”
Pickrell, J. K., Gilad, Y., & Pritchard, J. K. (2012) · Science · doi:10.1126/science.1210484 · Cited by 167
Functionally defective germline variants of sialic acid acetylesterase in autoimmunity
Surolia, I., Pirnie, S. P., Chellappa, V., Taylor, K. N., Cariappa, A., Moya, J., Liu, H., Bell, D. W., Driscoll, D. R., Diederichs, S., et al. (2010) · Nature · doi:10.1038/nature09115 · Cited by 161
Comment on “Widespread RNA and DNA Sequence Differences in the Human Transcriptome”
Lin, W., Piskol, R., Tan, M. H., & Li, J. B. (2012) · Science · doi:10.1126/science.1210624 · Cited by 153
Comment on “Widespread RNA and DNA Sequence Differences in the Human Transcriptome”
Kleinman, C. L., & Majewski, J. (2012) · Science · doi:10.1126/science.1209658 · Cited by 148
Invasives: A Major Conservation Threat
Lambertini, M., Leape, J., Marton-Lefèvre, J., Mittermeier, R. A., Rose, M., Robinson, J. G., Stuart, S. N., Waldman, B., & Genovesi, P. (2011) · Science · doi:10.1126/science.333.6041.404-b · Cited by 141
Type 1 Diabetes Genetics Consortium, Hunt, K. A., UK Inflammatory Bowel Disease (IBD) Genetics Consortium, Wellcome Trust Case Control Consortium, Smyth, D. J., Balschun, T., Ban, M., Mistry, V., Ahmad, T., Anand, V., et al. (2012) · Nature Genetics · doi:10.1038/ng.1037 · Cited by 45
Cited by
Genome-Wide Detection of Single-Nucleotide and Copy-Number Variations of a Single Human Cell
Zong, C., Lu, S., Chapman, A. R., & Xie, X. S. (2012) · Science · doi:10.1126/science.1229164 · Cited by 1,154
The natural selection of bad science
Smaldino, P. E., & McElreath, R. (2016) · Royal Society Open Science · doi:10.1098/rsos.160384 · Cited by 860
“False positives, on the other hand, are notoriously difficult for peer reviewers to assess (MacArthur, 2012; Eyre-Walker & Stoletzki, 2013).”
BackgroundSingle-Cell Whole-Genome Amplification and Sequencing: Methodology and Applications
Huang, L., Ma, F., Chapman, A., Lu, S., & Xie, X. S. (2015) · Annual Review of Genomics and Human Genetics · doi:10.1146/annurev-genom-090413-025352 · Cited by 423
“Measurement of Spontaneous Whole-Genome Mutation Rate In calling SNVs from a single cell by WGA (24, 68, 73), one challenge is high false negative rates caused by allele dropout, and another is false positives associated with amplification and sequencing errors (either random or systematic) (42).”
BackgroundTranscriptomics in the RNA-seq era
McGettigan, P. A. (2013) · Current Opinion in Chemical Biology · doi:10.1016/j.cbpa.2012.12.008 · Cited by 358
“This category of problem has even resulted in the coining of a new ‘law’ viz MacArthur’s Law: ‘interesting results are more likely to be artifacts — even after accounting for MacArthur’s Law’, named after the researcher who has been the most prominent in publicizing this problem [55].”
BackgroundGuidelines for Genome-Scale Analysis of Biological Rhythms
Hughes, M. E., Abruzzi, K. C., Allada, R., Anafi, R., Arpat, A. B., Asher, G., Baldi, P., de Bekker, C., Bell-Pedersen, D., Blau, J., et al. (2017) · Journal of Biological Rhythms · doi:10.1177/0748730417728663 · Cited by 279
“The false-discovery rate (FDR) should be presented whenever discussing the number of rhythmic time series within any large data set (Hochberg and Benjamini, 1990; Macarthur, 2012; Storey et al., 2005).”
A purely confirmatory replication study of structural brain-behavior correlations
Boekel, W., Wagenmakers, E.-J., Belay, L., Verhagen, J., Brown, S., & Forstmann, B. U. (2015) · Cortex · doi:10.1016/j.cortex.2014.11.019 · Cited by 172
“This realization has brought about a crisis of confidence in the replicability and reliability of published research findings (Ioannidis, 2012; MacArthur, 2012; Pashler & Wagenmakers, 2012).”
Ternès, N., Rotolo, F., & Michiels, S. (2016) · Statistics in Medicine · doi:10.1002/sim.6927 · Cited by 134
Sources of error in the retracted scientific literature
Casadevall, A., Steen, R. G., & Fang, F. C. (2014) · The FASEB Journal · doi:10.1096/fj.14-256735 · Cited by 89
“Although it may be too early to identify the causes for this trend, it is possible that studies that generate large amounts of numerical data make data manipulation errors more likely (40).”
BackgroundGenetic Mapping Populations for Conducting High-Resolution Trait Mapping in Plants
Cockram, J., & Mackay, I. (2018) · Advances in biochemical engineering, biotechnology · doi:10.1007/10_2017_48 · Cited by 102
Magnetic field-dependent molecular and chemical processes in biochemistry, genetics and medicine
Buchachenko, A. L. (2014) · Russian Chemical Reviews · doi:10.1070/rc2014v083n01abeh004335 · Cited by 101
Colocalization analyses of genomic elements: approaches, recommendations and challenges
Kanduri, C., Bock, C., Gundersen, S., Hovig, E. J., & Sandve, G. K. (2018) · Bioinformatics · doi:10.1093/bioinformatics/bty835 · Cited by 66
“One of the major harms of false-positive findings in colocalization analysis (or in any genomic analysis) is the triggering of futile follow-up projects (MacArthur, 2012).”
BackgroundConsiderations for RNA-seq Analysis of Circadian Rhythms
Li, J., Grant, G. R., Hogenesch, J. B., & Hughes, M. E. (2014) · Methods in enzymology on CD-ROM/Methods in enzymology · doi:10.1016/bs.mie.2014.10.020 · Cited by 54
“Accurately estimating the rate of false discoveries is a well-recognized problem in any high-throughput analysis (Macarthur, 2012).”
BackgroundFachal, L., Mosquera‐Miguel, A., Pástor, P., Ortega‐Cubero, S., Lorenzo, E., Durán, A. O., Toriello, M., Quintáns, B., Camiña-Tato, M., Sesar, Á., et al. (2014) · American Journal of Medical Genetics Part B Neuropsychiatric Genetics · doi:10.1002/ajmg.b.32276 · Cited by 44
“False positives are not exclusive of mtDNA studies [Ioannidis, 2005; Macarthur, 2012].”
BackgroundClinical Research Informatics for Big Data and Precision Medicine
Kahn, M. G., & Weng, C. (2016) · Yearbook of Medical Informatics · doi:10.15265/iy-2016-019 · Cited by 48
“Evidence of the profound negative consequences of not doing this well is beginning to appear as publications of false positives in genomic discoveries or chilling anecdotes in the misuse of genetic risk information [11-13, 119-122].”
BackgroundCone, A. C., Ambrosi, C., Scemes, E., Martone, M. E., & Sosinsky, G. E. (2013) · Frontiers in Pharmacology · doi:10.3389/fphar.2013.00006 · Cited by 39
“…this knowledge to 4http://neuinfo.org 5http://antibodyregistry.org Frontiers in Pharmacology | Pharmacology of Ion Channels and Channelopathies February 2013 | Volume 4 | Article 6 | 16 percolate to the wider community (MacArthur, 2012), leading to continued use of faulty reagents during this time.”
BackgroundMethodInfluentialThe fall and rise of pharmacology – (Re-)defining the discipline?
Winquist, R. J., Mullane, K., & Williams, M. J. (2013) · Biochemical Pharmacology · doi:10.1016/j.bcp.2013.09.011 · Cited by 44
“important results’’ [287] that can obscure ‘‘true driver events’’ [288] and (b) intratumor heterogeneity where sequencing/profil-”
Circadian Regulation of Cardiac Arrhythmias and Electrophysiology
Delisle, B. P., Prabhat, A., Burgess, D. E., Ono, M., Esser, K. A., & Schroder, E. A. (2024) · Circulation Research · doi:10.1161/circresaha.123.323513 · Cited by 42
Epigenetic processes in the male germline
O’Doherty, A., & McGettigan, P. (2014) · Reproduction Fertility and Development · doi:10.1071/rd14167 · Cited by 37
“Some of these controversies are inevitable as researchers wrestle with the poorly understood complexities and inherent biases of the new technology and assays (MacArthur 2012).”
BackgroundBrower, A. V. Z. (2012) · Proceedings of the Royal Society B Biological Sciences · doi:10.1098/rspb.2012.2302 · Cited by 39
Advances in genomic characterization of circulating tumor cells
Magbanua, M. J. M., & Park, J. W. (2014) · Cancer and Metastasis Reviews · doi:10.1007/s10555-014-9503-7 · Cited by 26
Standards and Their Problems: From Technical Specifications to World-Making
Busch, L. (2017) · Emerald Group Publishing Limited eBooks · doi:10.1108/s1057-192220170000024005 · Cited by 25
Brommage, R., Powell, D. R., & Vogel, P. (2019) · Disease Models & Mechanisms · doi:10.1242/dmm.038224 · Cited by 23
“it has never been easier to generate high-impact false positives than in the genomic era’ (MacArthur, 2012).”
BackgroundProteins interacting with cloning scars: a source of false positive protein-protein interactions
Banks, C. A. S., Boanca, G., Lee, Z. T., Florens, L. A., & Washburn, M. P. (2015) · Scientific Reports · doi:10.1038/srep08530 · Cited by 24
Statistical Methods for Plant Breeding
Mackay, I., Piepho, H., & Garcia, A. A. F. (2019) · Wiley eBooks · doi:10.1002/9781119487845.ch17 · Cited by 26
Research ethics in the post‐genomic era
Vähäkangas, K. (2013) · Environmental and Molecular Mutagenesis · doi:10.1002/em.21804 · Cited by 21
“Several authors stress the need for a change in the way modern biomedical science is done [Fanelli, 2010; MacArthur, 2012; Witten and Tibshirani, 2013].”
BackgroundMethodCurbing false discovery rates in interpretation of genome-wide expression profiles
Ycart, B., Pont, F., & Fournié, J. (2013) · Journal of Biomedical Informatics · doi:10.1016/j.jbi.2013.09.004 · Cited by 15
Trends of genetic changes uncovered by Env- and Eigen-GWAS in wheat and barley
Sharma, R. K., Cockram, J., Gardner, K. A., Russell, J., Ramsay, L., Thomas, W. T. B., O’Sullivan, D. M., Powell, W., & Mackay, I. (2021) · Theoretical and Applied Genetics · doi:10.1007/s00122-021-03991-z · Cited by 12
“studies with relatively low numbers of lines (5, 6).”
BackgroundAssessing the validity and reproducibility of genome-scale predictions
Sugden, L. A., Tackett, M., Savva, Y. A., Thompson, W. A., & Lawrence, C. E. (2013) · Bioinformatics · doi:10.1093/bioinformatics/btt508 · Cited by 11
“…2011) and attempted replicates, whether successful or not (Editorial, 2012a), and a system-wide committed effort toward generating work that is reproducible (MacArthur, 2012), placing at least as much emphasis on reproducibility as is currently placed on novelty (Editorial, 2012b; Russell, 2013).”
BackgroundPromises and Pitfalls of High-Throughput Biological Assays
Finak, G., & Gottardo, R. (2016) · Methods in molecular biology · doi:10.1007/978-1-4939-3572-7_12 · Cited by 12
Hill, N. B., Riha, S. J., & Walter, M. T. (2018) · Journal of Hydrology Regional Studies · doi:10.1016/j.ejrh.2018.09.006 · Cited by 10
Obesity, Nutrition, and Prostate Cancer: Insights and Issues
Holmberg, L. (2013) · European Urology · doi:10.1016/j.eururo.2013.01.033 · Cited by 9
Valuable lessons-learned in transcriptomics experimentation
Bruning, O., Rauwerda, H., Dekker, R. J., de Leeuw, W. C., Wackers, P. F. K., Ensink, W. A., Jonker, M. J., & Breit, T. M. (2015) · Transcription · doi:10.1080/21541264.2015.1064195 · Cited by 6
“Even though the reasons, such as expensive experimentation, or pressure to finish a PhD study in time, can be very persuasive, bioinformatics analysis of poor data invariably turns out to be an extremely time-consuming effort that rarely has a satisfying or scientifically sound outcome.(3,4) Data analysis is still the…”
BackgroundSolving FDR-Controlled Sparse Regression Problems with Five Million Variables on a Laptop
Scheidt, F., Machkour, J., & Muma, M. (2023) · IEEE International Workshop on Computational Advances in Multi-Sensor Adaptive Processing · doi:10.1109/camsap58249.2023.10403478 · Cited by 7
“Applying methods without appropriate statistical guarantees may result in spending valuable time and resources on researching false positives [8]–[11].”
MethodMora, A. R., & Forstmeier, W. (2014) · Ethology · doi:10.1111/eth.12263 · Cited by 7
Handling False Positives in the Genomic Era
Moyer, A. M. (2012) · Clinical Chemistry · doi:10.1373/clinchem.2012.194621 · Cited by 3
Bootstrapped Permutation Test for Multiresponse Inference on Brain Behavior Associations
Ng, B., Poline, J., Thirion, B., Greicius, M. D., & IMAGEN Consortium (2015) · Lecture notes in computer science · doi:10.1007/978-3-319-19992-4_9 · Cited by 4
“The growing feature dimensionality of today’s problems warrants caution in controlling for false positives [6].”
BackgroundFuchs, T., Püellmann, K., Wang, C., Han, J., Beham, A. W., Neumaier, M., & Kaminski, W. E. (2021) · Genomics Proteomics & Bioinformatics · doi:10.1016/j.gpb.2019.02.004 · Cited by 3
Morrison, D. A. (2012) · Systematic Biology · doi:10.1093/sysbio/sys089 · Cited by 3
Phosphate transporters, candidate genes, and the prosecutor’s fallacy
Böckenhauer, D., & Konrad, M. (2025) · Pediatric Nephrology · doi:10.1007/s00467-025-06660-1 · Cited by 2
Emmert‐Streib, F., Dehmer, M., & Yli-Harja, O. P. (2019) · Frontiers in Cell and Developmental Biology · doi:10.3389/fcell.2019.00349 · Cited by 2
“In MacArthur (2012) it is argued that “Flawed papers cause harm beyond their authors: they trigger futile projects, stalling the careers of graduate students and postdocs, and they degrade the reputation of genomic research.””
BackgroundNext generation sequencing and phylogenetic networks
Morrison, D. A. (2014) · EMBnet journal · doi:10.14806/ej.20.0.760 · Cited by 1
“This has been a cause of concern expressed in the literature (e.g., Check Hayden, 2012; Editorial, 2012a, 2012b; MacArthur, 2012), especially in light of the currently poor documentation and archiving of bioinformatics programs (Cuticchia and Silk, 2004).”
BackgroundMédecine génomique et Maladies infectieuses
Fellay, J. (2014) · Praxis · doi:10.1024/1661-8157/a001658 · Cited by 1
“En conséquence, la littérature génétique est truffée de résultats «faux positifs» qu'il est grand temps d'ignorer [5].”
Curb temptation to skip quality control
Tse, H. (2012) · Nature · doi:10.1038/488591a · Cited by 1
Sand, P. G. (2012) · Genetics and Molecular Research · doi:10.4238/2012.september.25.14 · Cited by 1
“The abundance of artefacts and arbitrary calculations rationalize the growing concerns over false-positive association claims (Macarthur, 2012).”
BackgroundReproducible Protein NMR Data Analysis
Fenwick, M. (2014) · OpenCommons - UConn (University of Connecticut)
Measurement, Summary, and Methodological Variation in RNA-sequencing
Frazee, A. C., Torres, L. C., Jaffe, A. E., Langmead, B., & Leek, J. T. (2014) · Springer eBooks · doi:10.1007/978-3-319-07212-8_6
WRESTLING WITH REPRODUCIBILITY IN RESEARCH
Dove, P. M. (2014)
Lushington, G. H., & Chaguturu, R. (2016) · Elsevier eBooks · doi:10.1016/b978-0-12-801814-9.00016-7
Metadata
- Authors
- MacArthur, D.
- Affiliations
- Harvard University (US)
- Corresponding author
- MacArthur, Daniel
- ORCID
- MacArthur, Daniel
- Venue
- Nature
- Published
- 2012-07-25
- Volume
- 487
- Issue
- 7408
- Pages
- 427-428
- ISSN
- 0028-0836 (ISSN-L)
- 1476-4687
- OpenAlex
- W2033503569
- Cited by
- 49
- References
- 10
- Citations by year
- 2025: 1 · 2024: 1 · 2023: 1 · 2021: 2 · 2019: 3 · 2018: 3 · 2017: 2 · 2016: 6 · 2015: 5 · 2014: 12 · 2013: 7 · 2012: 6
- FWCI
- 5.79
- Type
- journal article
- Language
- en
- Open access
- bronze
- doi.org
- Licence
- www.springernature.com/gp/researchers/text-and-data-mining (tdm)
- www.springernature.com/gp/researchers/text-and-data-mining (vor)
- Locations
- Nature (publishedVersion)
- PubMed (publishedVersion)
- RePEc: Research Papers in Economics (submittedVersion)
- Topics
- Life Sciences › Biochemistry, Genetics and Molecular Biology › Genetics › Genomics and Rare Diseases
- Life Sciences › Biochemistry, Genetics and Molecular Biology › Molecular Biology › Genomics and Phylogenetic Studies
- Life Sciences › Biochemistry, Genetics and Molecular Biology › Genetics › Genetic Associations and Epidemiology
- Keywords
- false positives, scholarly publishing, research integrity
- MeSH terms
- Aged, 80 and over, False Positive Reactions, Humans, Longevity, Quality Control, Research Design, Reproducibility of Results, Artifacts, Genomics
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.