The DOI matches its Crossref record; 60 of the 60 references it cites were found in a registry or an index.
Computation of measures of effect size for neuroscience data sets
Abstract
The overwhelming majority of research in the neurosciences employs P‐values stemming from tests of statistical significance to decide on the presence or absence of an effect of some treatment variable. Although a continuous variable, the P‐value is commonly used to reach a dichotomous decision about the presence of an effect around an arbitrary criterion of 0.05. This analysis strategy is widely used, but has been heavily criticized in the past decades. To counter frequent misinterpretations of P‐values, it has been advocated to complement or replace P‐values with measures of effect size (MES). Many psychological, biological and medical journals now recommend reporting appropriate MES. One hindrance to the more frequent use of MES may be their scarcity in standard statistical software packages. Also, the arguably most widespread data analysis software in neuroscience, matlab, does not provide MES beyond correlation and receiver‐operating characteristic analysis. Here we review the most common criticisms of significance testing and provide several examples from neuroscience where use of MES conveys insights not amenable through the use of P‐values alone. We introduce an open‐access matlab toolbox providing a wide range of MES to complement the frequently used types of hypothesis tests, such as t‐tests and analysis of variance. The accompanying documentation provides calculation formulae, intuitive explanations and example calculations for each measure. The toolbox described is usable without sophisticated statistical knowledge and should be useful to neuroscientists wishing to enhance their repertoire of statistical reporting.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Statistical Power Analysis for the Behavioral Sciences
Muller, K. (1989) · Technometrics · doi:10.1080/00401706.1989.10488618 · Cited by 99,167
Faul, F., Erdfelder, E., Lang, A.-G., & Buchner, A. (2007) · Behavior Research Methods · doi:10.3758/bf03193146 · Cited by 65,971
Statistical power analysis for the behavioral sciences
(1990) · Computers, Environment and Urban Systems · doi:10.1016/0198-9715(90)90050-4 · Cited by 65,269
Distribution Theory for Glass's Estimator of Effect Size and Related Estimators
Hedges, L. V. (1981) · Journal of Educational Statistics · doi:10.2307/1164588 · Cited by 5,695
Cohen, J. (1994) · American Psychologist · doi:10.1037/0003-066x.49.12.997 · Cited by 4,003
Effect size, confidence interval and statistical significance: a practical guide for biologists
Nakagawa, S., & Cuthill, I. C. (2007) · Biological Reviews · doi:10.1111/j.1469-185x.2007.00027.x · Cited by 3,835
Belief in the law of small numbers.
Tversky, A., & Kahneman, D. (1971) · Psychological Bulletin · doi:10.1037/h0031322 · Cited by 3,246
Statistical methods in psychology journals: Guidelines and explanations.
Wilkinson, L., & Task Force on Statistical Inference (1999) · American Psychologist · doi:10.1037/0003-066x.54.8.594 · Cited by 2,791
Meta-analysis of psychotherapy outcome studies.
Smith, M. L., & Glass, G. V. (1977) · American Psychologist · doi:10.1037/0003-066x.32.9.752 · Cited by 2,154 · cited 1×
“Distilling statistical results through meta-analysis has proved immensely useful in several fields of science, such as psychology and especially medicine (e.g. Smith & Glass, 1977; Mann, 1990; Baigent et al. , 2005), and MES are central to that endeavor (Thompson, 2002).”
Method
Cited by
Gorilla in our midst: An online behavioral experiment builder
Anwyl-Irvine, A. L., Massonnié, J., Flitton, A., Kirkham, N., & Evershed, J. K. (2020) · Behavior Research Methods · doi:10.3758/s13428-019-01237-x · Cited by 1,862
The idiosyncratic brain: distortion of spontaneous connectivity patterns in autism spectrum disorder
Hahamy, A., Behrmann, M., & Malach, R. (2015) · Nature Neuroscience · doi:10.1038/nn.3919 · Cited by 416
Serotonergic neurons signal reward and punishment on multiple timescales
Cohen, J. Y., Amoroso, M. W., & Uchida, N. (2015) · eLife · doi:10.7554/elife.06346 · Cited by 388
Alekseichuk, I., Turi, Z., Amador de Lara, G., Antal, A., & Paulus, W. (2016) · Current Biology · doi:10.1016/j.cub.2016.04.035 · Cited by 376
Performance of the Emotiv Epoc headset for P300-based applications
Duvinage, M., Castermans, T., Petieau, M., Hoellinger, T., Cheron, G., & Dutoit, T. (2013) · BioMedical Engineering OnLine · doi:10.1186/1475-925x-12-56 · Cited by 322
Arousal Effects on Pupil Size, Heart Rate, and Skin Conductance in an Emotional Face Task
Wang, C.-A., Baird, T., Huang, J., Coutinho, J. D., Brien, D. C., & Munoz, D. P. (2018) · Frontiers in Neurology · doi:10.3389/fneur.2018.01029 · Cited by 303
Hippocampal sharp-wave ripples linked to visual episodic recollection in humans
Norman, Y., Yeagle, E. M., Khuvis, S., Harel, M., Mehta, A. D., & Malach, R. (2019) · Science · doi:10.1126/science.aax1030 · Cited by 270
Entropy of city street networks linked to future spatial navigation ability
Coutrot, A., Manley, E., Goodroe, S., Gahnstrom, C., Filomena, G., Yesiltepe, D., Dalton, R. C., Wiener, J. M., Hölscher, C., Hornberger, M., et al. (2022) · Nature · doi:10.1038/s41586-022-04486-7 · Cited by 243
Hippocampal volume across age: Nomograms derived from over 19,700 people in UK Biobank
Nobis, L., Manohar, S. G., Smith, S. M., Alfaro-Almagro, F., Jenkinson, M., Mackay, C. E., & Husain, M. (2019) · NeuroImage: Clinical · doi:10.1016/j.nicl.2019.101904 · Cited by 236
Representation of retrieval confidence by single neurons in the human medial temporal lobe
Rutishauser, U., Ye, S., Koroma, M., Tudusciuc, O., Ross, I. B., Chung, J. M., & Mamelak, A. N. (2015) · Nature Neuroscience · doi:10.1038/nn.4041 · Cited by 147
Nir, Y., Vyazovskiy, V. V., Cirelli, C., Banks, M. I., & Tononi, G. (2015) · Cerebral Cortex · doi:10.1093/cercor/bht328 · Cited by 132
The influence of the respiratory cycle on reaction times in sensory-cognitive paradigms
Johannknecht, M., & Kayser, C. (2022) · Scientific Reports · doi:10.1038/s41598-022-06364-8 · Cited by 101
Souman, J. L., Borra, T., de Goijer, I., Schlangen, L. J. M., Vlaskamp, B. N. S., & Lucassen, M. P. (2018) · Journal of Biological Rhythms · doi:10.1177/0748730418784041 · Cited by 96
“All analyses were done in MatLab R2014b (The MathWorks, Natick, MA).”
MethodInfluentialBoldt, A., Schiffer, A.-M., Waszak, F., & Yeung, N. (2019) · Scientific Reports · doi:10.1038/s41598-019-40681-9 · Cited by 86
Single-Neuron Correlates of Conscious Perception in the Human Medial Temporal Lobe
Reber, T. P., Faber, J., Niediek, J., Boström, J., Elger, C. E., & Mormann, F. (2017) · Current Biology · doi:10.1016/j.cub.2017.08.025 · Cited by 64
Cortical modulation of sensory flow during active touch in the rat whisker system
Chakrabarti, S., & Schwarz, C. (2018) · Nature Communications · doi:10.1038/s41467-018-06200-6 · Cited by 41
Cerebellar patients have intact feedback control that can be leveraged to improve reaching
Zimmet, A. M., Cao, D., Bastian, A. J., & Cowan, N. J. (2020) · eLife · doi:10.7554/elife.53246 · Cited by 39
Perceptual stability reflected in neuronal pattern similarities in human visual cortex
Broday-Dvir, R., Norman, Y., Harel, M., Mehta, A. D., & Malach, R. (2023) · Cell Reports · doi:10.1016/j.celrep.2023.112614 · Cited by 28
Gu, C., Liu, Z.-X., Tannock, R., & Woltering, S. (2018) · PeerJ · doi:10.7717/peerj.5601 · Cited by 18
Metadata
- Authors
- Hentschke, H., & Stüttgen, M. C.
- Venue
- European Journal of Neuroscience
- Publisher
- Wiley
- Published
- 2011-11-14
- Volume
- 34
- Issue
- 12
- Pages
- 1887-1894
- ISSN
- 0953-816X (ISSN-L)
- 1460-9568
- OpenAlex
- W1948588766
- Cited by
- 410
- References
- 60
- FWCI
- 10.47
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.