Ten common statistical mistakes to watch out for when writing or reviewing a manuscript
Open accessAbstract
Inspired by broader efforts to make the conclusions of scientific research more robust, we have compiled a list of some of the most common statistical mistakes that appear in the scientific literature. The mistakes have their origins in ineffective experimental designs, inappropriate analyses and/or flawed reasoning. We provide advice on how authors, reviewers and readers can identify and resolve these mistakes and, we hope, avoid them in the future.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Pseudoreplication has been addressed repeatedly in ecology, agriculture, psychology, and neuroscience and acknowledged as one of the most common statistical mistakes in scientific literature.
“Pseudoreplication has been addressed repeatedly in ecology, agriculture, psychology, and neuroscience and acknowledged as one of the most common statistical mistakes in scientific literature4–9.”
From A practical solution to pseudoreplication bias in single-cell studies (2021) · cites this paper as [9]
The Abstract (page not specified) calls the paper’s ten topics common statistical mistakes, and “Inflating the units of analysis—The problem” describes the error underlying pseudoreplication: treating observations within subjects as independent experimental units. The paper does not establish that pseudoreplication has been addressed repeatedly in each of ecology, agriculture, psychology, and neuroscience. (LLM, conf=0.86)
Experimental — accuracy not yet measuredApplying statistical inference to replicates that are not statistically independent without properly accounting for their correlation structure will inflate type 1 error rates and lead to spurious results.
“Here we hope to address pseudoreplication in single-cell analyses by demonstrating what a large and long-standing body of statistical literature already confirms: applying statistical inference to replicates that are not statistically independent without properly accounting for their correlation structure will inflate type 1 error rates and lead to spurious results4–6,9,25–28.”
From A practical solution to pseudoreplication bias in single-cell studies (2021) · cites this paper as [9]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
Lakens, D. (2013) · Frontiers in Psychology · doi:10.3389/fpsyg.2013.00863 · Cited by 10,303 · see citing works
Estimating the reproducibility of psychological science
Open Science Collaboration (2015) · Science · doi:10.1126/science.aac4716 · Cited by 8,515 · see citing works
Power failure: why small sample size undermines the reliability of neuroscience
Button, K. S., Ioannidis, J. P. A., Mokrysz, C., Nosek, B. A., Flint, J., Robinson, E. S. J., & Munafò, M. R. (2013) · Nature Reviews Neuroscience · doi:10.1038/nrn3475 · Cited by 7,641 · see citing works
Simmons, J. P., Nelson, L. D., & Simonsohn, U. (2011) · Psychological Science · doi:10.1177/0956797611417632 · Cited by 6,567 · see citing works
Using Effect Size—or Why the P Value Is Not Enough
Sullivan, G. M., & Feinn, R. (2012) · Journal of Graduate Medical Education · doi:10.4300/jgme-d-12-00156.1 · Cited by 5,553 · see citing works
Normality Tests for Statistical Analysis: A Guide for Non-Statisticians
Ghasemi, A., & Zahediasl, S. (2012) · International Journal of Endocrinology and Metabolism · doi:10.5812/ijem.3505 · Cited by 4,368 · cited 1× · see citing works
“Another problem related to small sample size is that the distribution of the sample is more likely to deviate from normality, and the limited sample size makes it often impossible to rigorously test the assumption of normality (Ghasemi and Zahediasl, 2012).”
1,500 scientists lift the lid on reproducibility
Baker, M. (2016) · Nature · doi:10.1038/533452a · Cited by 4,209 · see citing works
Cluster failure: why fMRI inferences for spatial extent have inflated false-positive rates
Eklund, A., Nichols, T. E., & Knutsson, H. (2016) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1602413113 · Cited by 3,487 · see citing works
A manifesto for reproducible science
Munafò, M. R., Nosek, B. A., Bishop, D. V. M., Button, K. S., Chambers, C. D., Percie du Sert, N., Simonsohn, U., Wagenmakers, E.-J., Ware, J. J., & Ioannidis, J. P. A. (2017) · Nature Human Behaviour · doi:10.1038/s41562-016-0021 · Cited by 3,397 · see citing works
Moving to a World Beyond “ <i>p</i> < 0.05”
Wasserstein, R. L., Schirm, A. L., & Lazar, N. A. (2019) · The American Statistician · doi:10.1080/00031305.2019.1583913 · Cited by 2,976 · see citing works
Redefine statistical significance
Benjamin, D. J., Berger, J. O., Johannesson, M., Nosek, B. A., Wagenmakers, E.-J., Berk, R., Bollen, K. A., Brembs, B., Brown, L., Camerer, C., et al. (2017) · Nature Human Behaviour · doi:10.1038/s41562-017-0189-z · Cited by 2,772 · see citing works
Promoting an open research culture
Nosek, B. A., Alter, G., Banks, G. C., Borsboom, D., Bowman, S. D., Breckler, S. J., Buck, S., Chambers, C. D., Chin, G., Christensen, G., et al. (2015) · Science · doi:10.1126/science.aab2374 · Cited by 2,708 · see citing works
Circular analysis in systems neuroscience: the dangers of double dipping
Kriegeskorte, N., Simmons, W. K., Bellgowan, P. S. F., & Baker, C. I. (2009) · Nature Neuroscience · doi:10.1038/nn.2303 · Cited by 2,696 · see citing works
Causal inference in statistics: An overview
Pearl, J. (2009) · Statistics Surveys · doi:10.1214/09-ss057 · Cited by 2,336 · see citing works
Lakens, D. (2017) · Social Psychological and Personality Science · doi:10.1177/1948550617697177 · Cited by 2,161 · see citing works
Balancing Type I error and power in linear mixed models
Matuschek, H., Kliegl, R. M., Vasishth, S., Baayen, R. H., & Bates, D. M. (2017) · Journal of Memory and Language · doi:10.1016/j.jml.2017.01.001 · Cited by 2,071 · see citing works
Martineau, A. R., Jolliffe, D. A., Hooper, R. L., Greenberg, L., Aloia, J. F., Bergman, P., Dubnov-Raz, G., Esposito, S., Ganmaa, D., Ginde, A. A., et al. (2017) · BMJ · doi:10.1136/bmj.i6583 · Cited by 2,040 · see citing works
Using Bayes to get the most out of non-significant results
Dienes, Z. (2014) · Frontiers in Psychology · doi:10.3389/fpsyg.2014.00781 · Cited by 1,998 · see citing works
HARKing: Hypothesizing after the results are known
Kerr, N. L. (1998) · Personality and Social Psychology Review · doi:10.1207/s15327957pspr0203_4 · Cited by 1,989 · see citing works
Statistics notes: Absence of evidence is not evidence of absence
Altman, D. G., & Bland, J. M. (1995) · BMJ · doi:10.1136/bmj.311.7003.485 · Cited by 1,946 · see citing works
Puzzlingly High Correlations in fMRI Studies of Emotion, Personality, and Social Cognition
Vul, E., Harris, C., Winkielman, P., & Pashler, H. (2009) · Perspectives on Psychological Science · doi:10.1111/j.1745-6924.2009.01125.x · Cited by 1,475 · see citing works
Bayesian Versus Orthodox Statistics: Which Side Are You On?
Dienes, Z. (2011) · Perspectives on Psychological Science · doi:10.1177/1745691611406920 · Cited by 938 · see citing works
Erroneous analyses of interactions in neuroscience: A problem of significance
Nieuwenhuis, S., Forstmann, B. U., & Wagenmakers, E.-J. (2011) · Nature Neuroscience · doi:10.1038/nn.2886 · Cited by 864 · see citing works
An investigation of the false discovery rate and the misinterpretation of <i>p</i> -values
Colquhoun, D. (2014) · Royal Society Open Science · doi:10.1098/rsos.140216 · Cited by 792 · see citing works
How does multiple testing correction work?
Noble, W. S. (2009) · Nature Biotechnology · doi:10.1038/nbt1209-1135 · Cited by 772 · see citing works
Van Breukelen, G. J. P. (2006) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2006.02.007 · Cited by 765 · see citing works
Wicherts, J. M., Veldkamp, C. L. S., Augusteijn, H. E. M., Bakker, M., van Aert, R. C. M., & van Assen, M. A. L. M. (2016) · Frontiers in Psychology · doi:10.3389/fpsyg.2016.01832 · Cited by 754 · see citing works
Registered Reports: A Method to Increase the Credibility of Published Results
Nosek, B. A., & Lakens, D. (2014) · Social Psychology · doi:10.1027/1864-9335/a000192 · Cited by 716 · see citing works
Bayesian Assessment of Null Values Via Parameter Estimation and Model Comparison
Kruschke, J. (2011) · Perspectives on Psychological Science · doi:10.1177/1745691611406925 · Cited by 498 · see citing works
The principled control of false positives in neuroimaging
Bennett, C. M., Wolford, G. L., & Miller, M. B. (2009) · Social Cognitive and Affective Neuroscience · doi:10.1093/scan/nsp053 · Cited by 486 · see citing works
Lakens, D., Adolfi, F., Albers, C. J., Anvari, F., Apps, M. A. J., Argamon, S., Baguley, T. S., Becker, R. B., Benning, S. D., Bradford, D. E., et al. (2018) · Nature Human Behaviour · doi:10.1038/s41562-018-0311-x · Cited by 472 · see citing works
Detecting and avoiding likely false‐positive findings – a practical guide
Forstmeier, W., Wagenmakers, E., & Parker, T. H. (2017) · Biological Reviews · doi:10.1111/brv.12315 · Cited by 436 · see citing works
Hidden multiplicity in exploratory multiway ANOVA: Prevalence and remedies
Cramer, A. O. J., van Ravenzwaaij, D., Matzke, D., Steingroever, H., Wetzels, R., Grasman, R. P. P. P., Waldorp, L., & Wagenmakers, E. (2015) · Psychonomic Bulletin & Review · doi:10.3758/s13423-015-0913-5 · Cited by 416 · see citing works
On the Plurality of (Methodological) Worlds: Estimating the Analytic Flexibility of fMRI Experiments
Carp, J. (2012) · Frontiers in Neuroscience · doi:10.3389/fnins.2012.00149 · Cited by 381 · see citing works
The anova to mixed model transition
Boisgontier, M. P., & Cheval, B. (2016) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2016.05.034 · Cited by 357 · see citing works
A Bayesian Perspective on the Reproducibility Project: Psychology
Etz, A., & Vandekerckhove, J. (2016) · PLOS ONE · doi:10.1371/journal.pone.0149794 · Cited by 295 · see citing works
Publication bias and the canonization of false facts
Nissen, S. B., Magidson, T., Gross, K., & Bergstrom, C. T. (2016) · eLife · doi:10.7554/elife.21451 · Cited by 266 · see citing works
Evidence of experimental bias in the life sciences: why we need blind data recording
Holman, L., Head, M. L., Lanfear, R., & Jennions, M. D. (2015) · PLOS Biology · doi:10.1371/journal.pbio.1002190 · Cited by 263 · see citing works
COMPare: a prospective cohort study correcting and monitoring 58 misreported trials in real time
Goldacre, B., Drysdale, H., Dale, A., Milosevic, I., Slade, E., Hartley, P., Marston, C., Powell-Smith, A., Heneghan, C., & Mahtani, K. R. (2019) · Trials · doi:10.1186/s13063-019-3173-2 · Cited by 233 · see citing works
What errors do peer reviewers detect, and does training improve their ability to detect them?
Schroter, S., Black, N., Evans, S., Godlee, F., Osorio, L., & Smith, R. (2008) · Journal of the Royal Society of Medicine · doi:10.1258/jrsm.2008.080062 · Cited by 226 · see citing works
Improving standards in brain-behavior correlation analyses
Rousselet, G. A., & Pernet, C. R. (2012) · Frontiers in Human Neuroscience · doi:10.3389/fnhum.2012.00119 · Cited by 222 · see citing works
Everything You Never Wanted to Know about Circular Analysis, but Were Afraid to Ask
Kriegeskorte, N., Lindquist, M. A., Nichols, T. E., Poldrack, R. A., & Vul, E. (2010) · Journal of Cerebral Blood Flow & Metabolism · doi:10.1038/jcbfm.2010.86 · Cited by 214 · see citing works
Rein in the four horsemen of irreproducibility
Bishop, D. (2019) · Nature · doi:10.1038/d41586-019-01307-2 · Cited by 206 · see citing works
Why Is the One-Group Pretest–Posttest Design Still Used?
Knapp, T. R. (2016) · Clinical Nursing Research · doi:10.1177/1054773816666280 · Cited by 190 · see citing works
The Practical Alternative to the p Value Is the Correctly Used p Value
Lakens, D. (2021) · Perspectives on Psychological Science · doi:10.1177/1745691620958012 · Cited by 181 · see citing works
Bootrapping robust estimates of regression
Salibián‐Barrera, M., & Zamar, R. H. (2002) · The Annals of Statistics · doi:10.1214/aos/1021379865 · Cited by 172 · see citing works
The New Statistics for Better Science: Ask How Much, How Uncertain, and What Else Is Known
Calin-Jageman, R. J., & Cumming, G. (2019) · The American Statistician · doi:10.1080/00031305.2018.1518266 · Cited by 170 · see citing works
A nonparametric method to analyze interactions: The adjusted rank transform test
Leys, C., & Schumann, S. (2010) · Journal of Experimental Social Psychology · doi:10.1016/j.jesp.2010.02.007 · Cited by 164 · see citing works
Replication, statistical consistency, and publication bias.
Francis, G. (2013) · Journal of Mathematical Psychology · doi:10.1016/j.jmp.2013.02.003 · Cited by 164 · see citing works
Correlation = causation? Music training, psychology, and neuroscience
Schellenberg, E. G. (2020) · Psychology of Aesthetics, Creativity, and the Arts · doi:10.1037/aca0000263 · Cited by 113 · see citing works
The Principle of Inverse Effectiveness in Multisensory Integration: Some Statistical Considerations
Holmes, N. P. (2009) · Brain Topography · doi:10.1007/s10548-009-0097-2 · Cited by 110 · see citing works
Statistical and clinical significance, and how to use confidence intervals to help interpret both.
Fethney, J. (2010) · Australian Critical Care · doi:10.1016/j.aucc.2010.03.001 · Cited by 105 · see citing works
Comparing dependent robust correlations
Wilcox, R. R. (2016) · British Journal of Mathematical and Statistical Psychology · doi:10.1111/bmsp.12069 · Cited by 101 · see citing works
Bias in a common EEG and MEG statistical analysis and how to avoid it
Kilner, J. M. (2013) · Clinical Neurophysiology · doi:10.1016/j.clinph.2013.03.024 · Cited by 96 · see citing works
Curran‐Everett, D., & Milgrom, H. (2013) · Current Opinion in Allergy and Clinical Immunology · doi:10.1097/aci.0b013e3283609831 · Cited by 95 · see citing works
Why we need to report more than 'Data were Analyzed by t-tests or ANOVA'
Weissgerber, T. L., Garcia-Valencia, O., Garovic, V. D., Milic, N. M., & Winham, S. J. (2018) · eLife · doi:10.7554/elife.36163 · Cited by 76 · see citing works
Fricker, R. D., Burke, K., Han, X., & Woodall, W. H. (2019) · The American Statistician · doi:10.1080/00031305.2018.1537892 · Cited by 71 · see citing works
Maurage, P., Heeren, A., & Pesenti, M. (2013) · Journal of Nutrition · doi:10.3945/jn.113.174813 · Cited by 64 · see citing works
Explorations in statistics: the bootstrap
Curran-Everett, D. (2009) · Advances in Physiology Education · doi:10.1152/advan.00062.2009 · Cited by 52 · see citing works
Putting the P -Value in its Place
Krueger, J. I., & Heck, P. R. (2019) · The American Statistician · doi:10.1080/00031305.2018.1470033 · Cited by 51 · see citing works
Comparing Dependent Correlations
Wilcox, R. R., & Tian, T. (2008) · The Journal of General Psychology · doi:10.3200/genp.135.1.105-112 · Cited by 42 · see citing works
Harms of outcome switching in reports of randomised trials: CONSORT perspective
Altman, D. G., Moher, D., & Schulz, K. F. (2017) · BMJ · doi:10.1136/bmj.j396 · Cited by 40 · see citing works
Han, H., & Glenn, A. (2017) · bioRxiv · doi:10.1080/17470919.2017.1324521 · Cited by 39 · see citing works
Comparing a single case with a control sample: Refinements and extensions
Corballis, M. C. (2009) · Neuropsychologia · doi:10.1016/j.neuropsychologia.2009.04.007 · Cited by 26 · see citing works
Pandey, S., & Bright, C. L. (2008) · Social Work Research · doi:10.1093/swr/32.2.119 · Cited by 25 · see citing works
Correcting Corrupt Research: Recommendations for the Profession to Stop Misuse of p -Values
Kmetz, J. L. (2019) · The American Statistician · doi:10.1080/00031305.2018.1518271 · Cited by 21 · see citing works
Unit of analysis issues in laboratory-based research
Parsons, N., Teare, M. D., & Sitch, A. J. (2018) · eLife · doi:10.7554/elife.32486 · Cited by 19 · see citing works
de Camargo, K. R. (2012) · Social Science & Medicine · doi:10.1016/j.socscimed.2012.03.057 · Cited by 13 · see citing works
The annual cannabis holiday and fatal traffic crashes
Harper, S. B., & Palayew, A. (2019) · Injury Prevention · doi:10.1136/injuryprev-2018-043068 · Cited by 9 · see citing works
Flagged first, then by citations
Cited by
Sorted by citations
Serdar, C. C., Cihan, M., Yücel, D., & Serdar, M. A. (2020) · Biochemia Medica · doi:10.11613/bm.2021.010502 · Cited by 1,678 · see citing works
A practical solution to pseudoreplication bias in single-cell studies
Zimmerman, K. D., Espeland, M. A., & Langefeld, C. D. (2021) · Nature Communications · doi:10.1038/s41467-021-21038-1 · Cited by 362 · see citing works
Reporting and misreporting of sex differences in the biological sciences
Garcia-Sifuentes, Y., & Maney, D. L. (2021) · eLife · doi:10.7554/elife.70817 · Cited by 241 · see citing works
Country differences in the relationship between leadership and employee engagement: A meta-analysis
Li, P., Sun, J., Taris, T. W., Xing, L., & Peeters, M. C. W. (2020) · The Leadership Quarterly · doi:10.1016/j.leaqua.2020.101458 · Cited by 210 · see citing works
Human evaluation of automatically generated text: Current trends and best practice guidelines
van der Lee, C., Albert Gatt, A., van Miltenburg, E., & Krahmer, E. (2020) · Computer Speech & Language · doi:10.1016/j.csl.2020.101151 · Cited by 178 · see citing works
How Musical Training Shapes the Adult Brain: Predispositions and Neuroplasticity
Olszewska, A. M., Gaca, M., Herman, A. M., Jednoróg, K., & Marchewka, A. (2021) · Frontiers in Neuroscience · doi:10.3389/fnins.2021.630829 · Cited by 141 · see citing works
Chicco, D., Sichenze, A., & Jurman, G. (2025) · BioData Mining · doi:10.1186/s13040-025-00465-6 · Cited by 125 · see citing works
Considerations for Studying Sex as a Biological Variable in Spinal Cord Injury
Stewart, A. N., MacLean, S. M., Stromberg, A. J., Whelan, J. P., Bailey, W. M., Gensel, J. C., & Wilson, M. E. (2020) · Frontiers in Neurology · doi:10.3389/fneur.2020.00802 · Cited by 110 · see citing works
Flow states in adventure recreation: A systematic review and thematic synthesis
Boudreau, P., Mackenzie, S. H., & Hodge, K. P. (2019) · Psychology of sport and exercise · doi:10.1016/j.psychsport.2019.101611 · Cited by 98 · see citing works
Pape, M., Miyagi, M., Ritz, S. A., Boulicault, M., Richardson, S. S., & Maney, D. L. (2024) · Cell · doi:10.1016/j.cell.2024.02.008 · Cited by 101 · see citing works
Harnessing EHR data for health research
Tang, A. S., Woldemariam, S. R., Miramontes, S., Norgeot, B., Oskotsky, T. T., & Sirota, M. (2024) · Nature Medicine · doi:10.1038/s41591-024-03074-8 · Cited by 87 · see citing works
Ten simple rules to study distractor suppression
Wöstmann, M., Störmer, V. S., Obleser, J., Addleman, D. A., Andersen, . K., Gaspelin, N., Geng, J. J., Luck, S. J., Noonan, M. P., Slagter, H. A., et al. (2022) · Progress in Neurobiology · doi:10.1016/j.pneurobio.2022.102269 · Cited by 89 · see citing works
Is an artificial limb embodied as a hand? Brain decoding in prosthetic limb users
Maimon-Mor, R. O., & Makin, T. R. (2020) · PLoS Biology · doi:10.1371/journal.pbio.3000729 · Cited by 83 · see citing works
Self-citationNine quick tips for pathway enrichment analysis
Chicco, D., & Agapito, G. (2022) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1010348 · Cited by 87 · see citing works
Venn diagram analysis overestimates the extent of circadian rhythm reprogramming
Pelikan, A., Herzel, H., Kramer, A., & Ananthasubramaniam, B. (2021) · FEBS Journal · doi:10.1111/febs.16095 · Cited by 77 · see citing works
Gapsys, V., & de Groot, B. L. (2020) · eLife · doi:10.7554/elife.57589 · Cited by 67 · see citing works
Why and How to Account for Sex and Gender in Brain and Behavioral Research
Eliot, L., Beery, A. K., Jacobs, E. G., LeBlanc, H. F., Maney, D. L., & McCarthy, M. M. (2023) · Journal of Neuroscience · doi:10.1523/jneurosci.0020-23.2023 · Cited by 61 · see citing works
Postural control of arm and fingers through integration of movement commands
Albert, S. T., Hadjiosif, A. M., Jang, J., Zimnik, A. J., Soteropoulos, D. S., Baker, S. N., Churchland, M. M., Krakauer, J. W., & Shadmehr, R. (2020) · eLife · doi:10.7554/elife.52507 · Cited by 56 · see citing works
He, J. L., Oeltzschner, G., Mikkelsen, M. E., Deronda, A. C., Harris, A. D., Crocetti, D., Wodka, E. L., Mostofsky, S. H., Edden, R. A. E., & Puts, N. A. J. (2021) · Translational Psychiatry · doi:10.1038/s41398-021-01525-1 · Cited by 54 · see citing works
Sominsky, L., Walker, D. W., & Spencer, S. (2020) · Brain, behavior, and immunity · doi:10.1016/j.bbi.2020.03.016 · Cited by 40 · see citing works
Best practices to promote rigor and reproducibility in the era of sex-inclusive research
Rich-Edwards, J. W., & Maney, D. L. (2023) · eLife · doi:10.7554/elife.90623 · Cited by 50 · see citing works
A brief guide to the science and art of writing manuscripts in biomedicine
Forero, D. A., López‐León, S., & Perry, G. L. (2020) · Journal of Translational Medicine · doi:10.1186/s12967-020-02596-2 · Cited by 51 · see citing works
Esser, R. W., Korn, C. W., Ganzer, F., & Haaker, J. (2021) · eLife · doi:10.7554/elife.65280 · Cited by 47 · see citing works
Kilroy, E., Harrison, L., Butera, C. D., Jayashankar, A., Cermak, S. A., Kaplan, J., Williams, M. E., Haranin, E. C., Bookheimer, S. Y., Dapretto, M., et al. (2020) · Human Brain Mapping · doi:10.1002/hbm.25312 · Cited by 44 · see citing works
The other-race effect and holistic processing across racial groups
Wong, H. K., Estudillo, A. J., Stephen, I. D., & Keeble, D. R. T. (2021) · Scientific Reports · doi:10.1038/s41598-021-87933-1 · Cited by 40 · see citing works
Translational Block in Stroke: A Constructive and “Out-of-the-Box” Reappraisal
Lourbopoulos, A. I., Mourouzis, I. S., Xinaris, C., Zerva, N., Filippakis, K., Pavlopoulos, A., & Pantos, C. I. (2021) · Frontiers in Neuroscience · doi:10.3389/fnins.2021.652403 · Cited by 37 · see citing works
Evolution of Olfactory Receptors Tuned to Mustard Oils in Herbivorous Drosophilidae
Matsunaga, T., Reisenman, C. E., Goldman-Huertas, B., Brand, P., Miao, K., Suzuki, H. C., Verster, K. I., Ramírez, S. R., & Whiteman, N. K. (2021) · Molecular Biology and Evolution · doi:10.1093/molbev/msab362 · Cited by 37 · see citing works
Edelsbrunner, P. A., & Thurn, C. (2023) · Educational Research Review · doi:10.1016/j.edurev.2023.100590 · Cited by 44 · see citing works
Hu, Y., Pereira, A. M., Gao, X., de Campos, B. M., Derrington, E. A., Corgnet, B., Zhou, X., Cendes, F., & Dreher, J. (2020) · Journal of Neuroscience · doi:10.1523/jneurosci.1237-20.2020 · Cited by 40 · see citing works
Neuropsychological Profile of Intellectually Gifted Children: A Systematic Review
Bucaille, A., Jarry, C., Allard, J., Brochard, S., Peudenier, S., & Roy, A. (2021) · Journal of the International Neuropsychological Society · doi:10.1017/s1355617721000515 · Cited by 45 · see citing works
Theoretical models and statistical modelling of linguistic epicentres
Bernaisch, T., Gries, S. Τ., & Heller, B. (2022) · World Englishes · doi:10.1111/weng.12580 · Cited by 34 · see citing works
Phillips, B., Haschler, T. N., & Karp, N. A. (2023) · PLoS Biology · doi:10.1371/journal.pbio.3002129 · Cited by 37 · see citing works
Ferreiro, E. B., Lanzillo, M., Canhoto, D. M. M., Silva, A. C., Mota, S. I., Dias, I. S., Ferreira, I. L., Fontes, A. R., Mastrella, G., Pinheiro, P. S., et al. (2020) · Neurobiology of Aging · doi:10.1016/j.neurobiolaging.2020.04.003 · Cited by 32 · see citing works
Huh, S., Heckman, C. J., & Manuel, M. (2021) · eNeuro · doi:10.1523/eneuro.0378-20.2021 · Cited by 32 · see citing works
Wang, Y., Niemelä, J. K., & Kotze, D. J. (2022) · People and Nature · doi:10.1002/pan3.10394 · Cited by 32 · see citing works
Williams, J. S., Fattori, M. R., Honeyborne, I. R., & Ritz, S. A. (2023) · Hormones and Behavior · doi:10.1016/j.yhbeh.2023.105442 · Cited by 29 · see citing works
Expert Tool Users Show Increased Differentiation between Visual Representations of Hands and Tools
Schone, H. R., Maimon-Mor, R. O., Baker, C. I., & Makin, T. R. (2021) · Journal of Neuroscience · doi:10.1523/jneurosci.2489-20.2020 · Cited by 29 · see citing works
Self-citationRossetti, M. G., Patalay, P., Mackey, S., Allen, N. B., Batalla, A., Bellani, M., Chye, Y., Cousijn, J., Goudriaan, A. E., Hester, R., et al. (2021) · NeuroImage Clinical · doi:10.1016/j.nicl.2021.102636 · Cited by 29 · see citing works
Sex-Inclusive Biomedicine: Are New Policies Increasing Rigor and Reproducibility?
Maney, D. L., & Rich-Edwards, J. W. (2023) · Women s Health Issues · doi:10.1016/j.whi.2023.03.004 · Cited by 31 · see citing works
Is less more? A commentary on the practice of ‘metric hacking’ in animal social network analysis
Webber, Q., Schneider, D., & Wal, E. V. (2020) · Animal Behaviour · doi:10.1016/j.anbehav.2020.08.011 · Cited by 27 · see citing works
Birtalan, E., Bánhidi, A., Sanders, J. I., Balázsfi, D., & Hangya, B. (2020) · Scientific Reports · doi:10.1038/s41598-020-79290-2 · Cited by 27 · see citing works
Effects of selective attention on the C1 ERP component: A systematic review and meta‐analysis
Qin, N., Wiens, S., Rauss, K. S., & Pourtois, G. (2022) · Psychophysiology · doi:10.1111/psyp.14123 · Cited by 24 · see citing works
Soler, I., Yun, S., Reynolds, R. P., Whoolery, C. W., Tran, F. H., Kumar, P. L., Rong, Y., DeSalle, M. J., Gibson, A. D., Stowe, A. M., et al. (2021) · Frontiers in Behavioral Neuroscience · doi:10.3389/fnbeh.2021.722780 · Cited by 25 · see citing works
The (in)effectiveness of anticipatory vibrotactile cues in mitigating motion sickness
Reuten, A. J. C., Smeets, J. B. J., Rausch, J., Martens, M., Schmidt, E. A., & Bos, J. E. (2023) · Experimental Brain Research · doi:10.1007/s00221-023-06596-8 · Cited by 24 · see citing works
Terstege, D. J., & Epp, J. R. (2022) · Biology · doi:10.3390/biology12010034 · Cited by 24 · see citing works
McDougall, R. M., Tripp, T. R., Frankish, B. P., Doyle–Baker, P. K., Lun, V. M. Y., Wiley, J. P., Aboodarda, S. J., & MacInnis, M. J. (2023) · The Journal of Physiology · doi:10.1113/jp284958 · Cited by 22 · see citing works
Kiffer, F. C., Luitel, K., Tran, F. H., Patel, R., Guzman, C. S., Soler, I., Xiao, R., Shay, J. W., Yun, S., & Eisch, A. J. (2021) · Behavioural Brain Research · doi:10.1016/j.bbr.2021.113677 · Cited by 23 · see citing works
Commonly Overlooked Factors in Biocompatibility Studies of Neural Implants
Kumosa, L. S. (2023) · Advanced Science · doi:10.1002/advs.202205095 · Cited by 21 · see citing works
Teghil, A., Vita, A. D., D’Antonio, F., & Boccia, M. (2020) · Cortex · doi:10.1016/j.cortex.2020.03.021 · Cited by 21 · see citing works
Frahm, L., Cieslik, E. C., Hoffstaedter, F., Satterthwaite, T. D., Fox, P., Langner, R., & Eickhoff, S. (2022) · Human Brain Mapping · doi:10.1002/hbm.25898 · Cited by 17 · see citing works
Markström, J. L., Naili, J. E., & Häger, C. K. (2022) · Sports Health A Multidisciplinary Approach · doi:10.1177/19417381221097949 · Cited by 21 · see citing works
Ten guidelines for designing motor learning studies
Ranganathan, R., Lee, M.-H., & Krishnan, C. (2022) · Brazilian Journal of Motor Behavior · doi:10.20338/bjmb.v16i2.283 · Cited by 21 · see citing works
Ten quick tips for computational analysis of medical images
Chicco, D., & Shiradkar, R. (2023) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1010778 · Cited by 22 · see citing works
Considering Sex as a Variable at a Research University: Knowledge, Attitudes, and Practices
Maney, D. L., Karkazis, K. A., & Hagen, K. S. (2023) · Journal of Women s Health · doi:10.1089/jwh.2022.0522 · Cited by 21 · see citing works
Believing is seeing – the deceptive influence of bias in quantitative microscopy
Lee, R., Eisenman, L. R., Khuon, S., Aaron, J., & Chew, T. (2024) · Journal of Cell Science · doi:10.1242/jcs.261567 · Cited by 21 · see citing works
A template for the authoring of statistical analysis plans
Stevens, G. R., Dolley, S., Mogg, R., & Connor, J. T. (2023) · Contemporary Clinical Trials Communications · doi:10.1016/j.conctc.2023.101100 · Cited by 19 · see citing works
Sex difference analyses under scrutiny
Vorland, C. J. (2021) · eLife · doi:10.7554/elife.74135 · Cited by 19 · see citing works
Between two stools: preclinical research, reproducibility, and statistical design of experiments
Reynolds, P. S. (2022) · BMC Research Notes · doi:10.1186/s13104-022-05965-w · Cited by 20 · see citing works
Toolkit for detecting misused epidemiological methods
Soskolne, C. L., Kramer, S., Ramos-Bonilla, J. P., Mandrioli, D., Sass, J. B., Gochfeld, M., Cranor, C. F., Advani, S., & Bero, L. A. (2021) · Environmental Health · doi:10.1186/s12940-021-00771-6 · Cited by 18 · see citing works
Garrigos, D., Martínez-Morga, M., Toval, Á., Kutsenko, Y., Barreda, A., Couto, B. R. D., Navarro‐Mateu, F., & Ferrán, J. L. (2021) · Frontiers in Endocrinology · doi:10.3389/fendo.2021.638261 · Cited by 17 · see citing works
Visuo-proprioceptive recalibration and the sensorimotor map
Block, H. J., & Liu, Y. (2023) · Journal of Neurophysiology · doi:10.1152/jn.00493.2022 · Cited by 17 · see citing works
Neural electrophysiological correlates of detection and identification awareness
Wiens, S., Andersson, A., Gravenfors, J., & Eklund, R. (2023) · Cognitive Affective & Behavioral Neuroscience · doi:10.3758/s13415-023-01120-5 · Cited by 18 · see citing works
Freiburghaus, T., Svensson, J. E., Matheson, G. J., Plavén‐Sigray, P., Lundberg, J., Farde, L., & Červenka, S. (2020) · NeuroImage · doi:10.1016/j.neuroimage.2020.117523 · Cited by 17 · see citing works
Pitfalls in post hoc analyses of population receptive field data
Stoll, S., Infanti, E., de Haas, B., & Schwarzkopf, D. S. (2022) · NeuroImage · doi:10.1016/j.neuroimage.2022.119557 · Cited by 16 · see citing works
The ABC recommendations for validation of supervised machine learning results in biomedical sciences
Chicco, D., & Jurman, G. (2022) · Frontiers in Big Data · doi:10.3389/fdata.2022.979465 · Cited by 16 · see citing works
Pasin, C., Consiglio, C. R., Huisman, J. S., de Lange, A. G., Peckham, H., Vallejo‐Yagüe, E., Abela, I. A., Islander, U., Neuner-Jehle, N., Pujantell, M., et al. (2023) · Royal Society Open Science · doi:10.1098/rsos.221628 · Cited by 16 · see citing works
An AI assistant to help review and improve causal reasoning in epidemiological documents
Cox, L. A. (2023) · Global Epidemiology · doi:10.1016/j.gloepi.2023.100130 · Cited by 16 · see citing works
Express arm responses appear bilaterally on upper-limb muscles in an arm choice reaching task
Kearsley, S. L., Cecala, A. L., Kozak, R. A., & Corneil, B. D. (2022) · Journal of Neurophysiology · doi:10.1152/jn.00494.2021 · Cited by 16 · see citing works
Autosuggestion: a cognitive process that empowers your brain?
Myga, K. A., Kuehn, E., & Azañón, E. (2021) · Experimental Brain Research · doi:10.1007/s00221-021-06265-8 · Cited by 15 · see citing works
Practical notes on popular statistical tests in renal physiology
Mamenko, M., Lysikova, D. V., Spires, D. R., Tarima, S. S., & Ilatovskaya, D. V. (2022) · American Journal of Physiology-Renal Physiology · doi:10.1152/ajprenal.00427.2021 · Cited by 15 · see citing works
Cataldi, D., Bennett, J. P., Wong, M. C., Quon, B. K., Liu, Y. E., Kelly, N. N., Kelly, T. L., Schoeller, D. A., Heymsfield, S. B., & Shepherd, J. (2023) · Clinical Nutrition · doi:10.1016/j.clnu.2023.11.040 · Cited by 15 · see citing works
Electrophysiological correlates of in vivo and virtual reality exposure therapy in spider phobia
Wiens, S., Eklund, R., Szychowska, M., Miloff, A., Cosme, D., Pierzchajlo, S., & Carlbring, P. (2022) · Psychophysiology · doi:10.1111/psyp.14117 · Cited by 15 · see citing works
Lebedev, T. D., Mikheeva, A. M., Gasca, V. A., Spirin, P., & Prassolov, V. (2025) · Cells · doi:10.3390/cells14050336 · Cited by 14 · see citing works
A critical assessment of NICE guidelines for treatment of depression
Leichsenring, F., Steinert, C., Rost, F., Abbass, A. A., Heim, N., & Ioannidis, J. P. A. (2023) · World Psychiatry · doi:10.1002/wps.21039 · Cited by 14 · see citing works
The Chinese Open Science Network (COSN): Building an Open Science Community From Scratch
Jin, H., Wang, Q., Yang, Y., Zhang, H., Gao, M. M., Jin, S., Chen, Y., Xu, T., Zheng, Y.-R., Ji, C., et al. (2023) · Advances in Methods and Practices in Psychological Science · doi:10.1177/25152459221144986 · Cited by 16 · see citing works
Sleep-like changes in neural processing emerge during sleep deprivation in early auditory cortex
Marmelshtein, A., Eckerling, A., Hadad, B., Ben‐Eliyahu, S., & Nir, Y. (2023) · Current Biology · doi:10.1016/j.cub.2023.06.022 · Cited by 13 · see citing works
Uzhytchak, M., Smolková, B., Frtús, A., Stupakov, A., Lunová, M., Scollo, F., Hof, M., Jurkiewicz, P., Sullivan, G. J., Dejneka, A., et al. (2023) · Scientific Reports · doi:10.1038/s41598-023-38015-x · Cited by 13 · see citing works
Gompers, A. D., Olivier, M. T., & Maney, D. L. (2024) · Biology of Sex Differences · doi:10.1186/s13293-024-00610-6 · Cited by 13 · see citing works
Replication of null results: Absence of evidence or evidence of absence?
Pawel, S., Heyard, R., Micheloud, C., & Held, L. (2024) · eLife · doi:10.7554/elife.92311.3 · Cited by 13 · see citing works
Pacheco, M. M., de Oliveira, L. M. M., dos Santos, C. C. A., Filho, J. R. D. M. G., & Drews, R. (2023) · International Journal of Sports Science & Coaching · doi:10.1177/17479541231168930 · Cited by 19 · see citing works
Role of GPT Chat in Writing Scientific Articles: A Systematic Literature Review
Megawati, R., Listiani, H., Pranoto, N. W., Akobiarek, M., & Ruth Rize Paas Megahati, S. (2023) · Jurnal Penelitian Pendidikan IPA · doi:10.29303/jppipa.v9i11.5559 · Cited by 11 · see citing works
Eight quick tips for biologically and medically informed machine learning
Oneto, L., & Chicco, D. (2025) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1012711 · Cited by 11 · see citing works
Klappenbach, C. M., Wáng, Q., Jensen, A. L., Glodosky, N. C., & Delevich, K. M. (2023) · Hormones and Behavior · doi:10.1016/j.yhbeh.2023.105350 · Cited by 11 · see citing works
Comparing hand movement rate dependence of cerebral blood volume and BOLD responses at 7T
de Oliveira, I. A. F., van der Zwaag, W., Raimondo, L., Dumoulin, S. O., & Siero, J. C. W. (2020) · NeuroImage · doi:10.1016/j.neuroimage.2020.117623 · Cited by 11 · see citing works
Influence of data sampling methods on the representation of neural spiking activity in vivo
van der Heijden, M. E., Brown, A. M., & Sillitoe, R. V. (2022) · iScience · doi:10.1016/j.isci.2022.105429 · Cited by 11 · see citing works
Crafting statistical analysis plans: A cross‐discipline approach
Cressman, K. A., & Sharp, J. L. (2022) · Stat · doi:10.1002/sta4.528 · Cited by 10 · see citing works
Clayson, P., Carbine, K. A., Shuford, J. L., Mcdonald, J. B., & Larson, M. (2025) · Cortex; a journal devoted to the study of the nervous system and behavior · doi:10.1016/j.cortex.2025.02.008 · Cited by 8 · see citing works
Gallicano, G., Fu, J., Mahapatra, S., Sharma, M. V. R., Dillon, C., Deng, C., & Zahid, M. (2022) · Pharmaceuticals · doi:10.3390/ph15070871 · Cited by 9 · see citing works
Tsigaris, P., & da Silva, J. A. T. (2020) · Scientometrics · doi:10.1007/s11192-020-03353-4 · Cited by 10 · see citing works
A Life Cycle for Modeling Biology at Different Scales
Harline, K., Martínez‐Gómez, J., Specht, C. D., & Roeder, A. (2021) · Frontiers in Plant Science · doi:10.3389/fpls.2021.710590 · Cited by 10 · see citing works
Replication of null results: Absence of evidence or evidence of absence?
Pawel, S., Heyard, R., Micheloud, C., & Held, L. (2023) · eLife · doi:10.7554/elife.92311 · Cited by 22 · see citing works
Cataldi, D., Bennett, J. P., Quon, B. K., Leong, L. T., Kelly, T. L., Binder, A. M., Evans, W. J., Prado, C. M., Heymsfield, S. B., & Shepherd, J. (2025) · Scientific Reports · doi:10.1038/s41598-025-87918-4 · Cited by 9 · see citing works
Dissociation and false memory: the moderating role of trauma and cognitive ability
Sajjadi, S. F., Sellbom, M., Gross, J., & Hayne, H. (2021) · Memory · doi:10.1080/09658211.2021.1963778 · Cited by 10 · see citing works
Cinotti, F., & Humphries, M. D. (2021) · Journal of Neuroscience · doi:10.1523/jneurosci.1487-21.2021 · Cited by 10 · see citing works
Learning from the past to develop data analysis curricula for the future
Weissgerber, T. L. (2021) · PLoS Biology · doi:10.1371/journal.pbio.3001343 · Cited by 9 · see citing works
Bouwer, N. I., Liesting, C., Kofflard, M. J. M., Brugts, J. J., Kock, M. C. J. M., Kitzen, J. J. E. M., Levin, M., & Boersma, E. H. (2021) · Cardiovascular Ultrasound · doi:10.1186/s12947-021-00266-x · Cited by 9 · see citing works
The neurobiological markers of acute alcohol’s subjective effects in humans
Hamel, R., Demers, O., Boileau, C., Roy, M.-L., Théoret, H., Bernier, P., & Lepage, J. (2022) · Neuropsychopharmacology · doi:10.1038/s41386-022-01354-w · Cited by 7 · see citing works
Casals, M., & Daunis‐i‐Estadella, P. (2022) · International Journal of Sports Science & Coaching · doi:10.1177/17479541221099638 · Cited by 8 · see citing works
Mitigating Motion Sickness by Anticipatory Cues
Reuten, A. J. C., Bos, J. E., Martens, M., Rausch, J., & Smeets, J. B. J. (2024) · Vibration · doi:10.3390/vibration7040065 · Cited by 9 · see citing works
- Authors
- Makin, T. R., & Orban de Xivry, J.-J.
- Affiliations
- University College London (GB)
- Movement Control and Neuroplasticity Research Group, Department of Movement Sciences, KU Leuven, Leuven, Belgium
- Corresponding author
- Makin, Tamar R
- Venue
- eLife
- Publisher
- eLife Sciences Publications, Ltd
- Published
- 2019-10-09
- Volume
- 8
- ISSN
- 2050-084X (ISSN-L)
- PMC
- PMC6785265
- OpenAlex
- W2979345840
- Cited by
- 238
- References
- 69
- Citations by year
- 2026: 17 · 2025: 37 · 2024: 34 · 2023: 43 · 2022: 38 · 2021: 43 · 2020: 24 · 2019: 2
- FWCI
- 17.78
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- Locations
- eLife (publishedVersion, cc-by)
- Europe PMC (PubMed Central) (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- Lirias (KU Leuven) (submittedVersion, other-oa)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- UCL Discovery (University College London) (submittedVersion)
- Funders
- Wellcome Trust (215575/Z/19/Z)
- Topics
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods in Epidemiology
- Social Sciences › Arts and Humanities › History and Philosophy of Science › Academic Writing and Publishing
- Keywords
- statistical errors, research misconduct, manuscript review, experimental design flaws, research robustness, scientific writing
- MeSH terms
- Humans, Manuscripts, Medical as Topic, Statistics as Topic
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review