The DOI matches its Crossref record; 6 of the 6 references it cites were found in a registry or an index.
Confidence intervals in within-subject designs: A simpler solution to Loftus and Masson's method
Open accessAbstract
Within-subject ANOVAs are a powerful tool to analyze data because the variance associated to differences between the participants is removed from the analysis.Hence, small differences, when present for most of the participants, can be significant even when the participants are very different from one another.Yet, graphs showing standard error or confidence interval bars are misleading since these bars include the between-subject variability.Loftus and Masson (1994) noticed this fact and proposed an alternate method to compute the error bars.However, i) their approach requires that the ANOVA be performed first, which is paradoxical since a graph is an aid to decide whether to perform analyses or not; ii) their method provides a single error bar for all the conditions, masking information such as the heterogeneity of variances across conditions; iii) the method proposed is difficult to implement in commonly-used graphing software.Here we propose a simple alternative and sow how it can be implemented in SPSS.Consider the results shown in Figure 1 where mean results from a 2 × 5 experiment are shown.The error bars show the standard error in each condition, measured on 16 participants per point.If confidence intervals had been shown, the error bars would have been about twice their actual sizes!By looking at this figure, we have no doubt that it is only noise.Yet, have a look at the ANOVA table: the effects and the interaction are all highly significant!How can this be?The present data are simulated.However, we obtained similar results in Paradis and Cousineau (in preparation).This kind of situation was first noted by Loftus and Masson (1994).The cause of the discrepancy between the figure and the analyses is not obvious.It is not a problem with homogeneity of variances (all the variances are homogeneous and spherical, Tabachnik & Fidell, 1996,
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Tabachnick, B. G., & Fidell, L. S. (1983) · Cited by 80,032
Design and Analysis: A Researcher's Handbook
Beaton, A. E., & Keppel, G. (1975) · American Educational Research Journal · doi:10.2307/1162588 · Cited by 5,822
Using confidence intervals in within-subject designs
Loftus, G. R., & Masson, M. E. J. (1994) · Psychonomic Bulletin & Review · doi:10.3758/bf03210951 · Cited by 2,448
Design and Analysis: A Researcher's Handbook
Aaker, D. A., & Keppel, G. (1976) · Journal of Marketing Research · doi:10.2307/3150757 · Cited by 2,011
COMPARISON BETWEEN TREATMENTS IN A REPEATED‐MEASUREMENT DESIGN: ANOVA AND MULTIVARIATE METHODS
Rouanet, H., & Lépine, D. (1970) · British Journal of Mathematical and Statistical Psychology · doi:10.1111/j.2044-8317.1970.tb00440.x · Cited by 196
Some Approximate Tests for Repeated Measurement Designs
Huynh, H. (1978) · Psychometrika · doi:10.1007/bf02293860 · Cited by 192
Cited by
Confidence Intervals from Normalized Data: A correction to Cousineau (2005)
Morey, R. D. (2008) · Tutorials in Quantitative Methods for Psychology · doi:10.20982/tqmp.04.2.p061 · Cited by 1,997
Discrete fixed-resolution representations in visual working memory
Zhang, W., & Luck, S. J. (2008) · Nature · doi:10.1038/nature06860 · Cited by 1,622
Reward Changes Salience in Human Vision via the Anterior Cingulate
Hickey, C., Chelazzi, L., & Theeuwes, J. (2010) · The Journal of Neuroscience · doi:10.1523/jneurosci.1026-10.2010 · Cited by 606
“Error bars here and in all subsequent figures reflect within-participant 95% confidence intervals (Cousineau, 2005).”
BackgroundDo you believe in atheists? Distrust is central to anti-atheist prejudice.
Gervais, W. M., Shariff, A. F., & Norenzayan, A. (2011) · Journal of Personality and Social Psychology · doi:10.1037/a0025882 · Cited by 495
Local Entrainment of Alpha Oscillations by Visual Stimuli Causes Cyclic Modulation of Perception
Spaak, E., de Lange, F. P., & Jensen, O. (2014) · The Journal of Neuroscience · doi:10.1523/jneurosci.4385-13.2014 · Cited by 349
Sudden Death and Gradual Decay in Visual Working Memory
Zhang, W., & Luck, S. J. (2009) · Psychological Science · doi:10.1111/j.1467-9280.2009.02322.x · Cited by 341
Le Pelley, M. E., Pearson, D., Griffiths, O., & Beesley, T. (2015) · Journal of Experimental Psychology: General · doi:10.1037/xge0000037 · Cited by 327
Johnson, J. S., Sutterer, D. W., Acheson, D. J., Lewis-Peacock, J. A., & Postle, B. R. (2011) · Frontiers in Psychology · doi:10.3389/fpsyg.2011.00128 · Cited by 326
Rey-Mermet, A., Gade, M., & Oberauer, K. (2018) · Journal of Experimental Psychology: Learning, Memory, and Cognition · doi:10.1037/xlm0000450 · Cited by 310
Using eye movement activity as a correlate of cognitive workload
Ahlstrom, U., & Friedman-Berg, F. J. (2006) · International Journal of Industrial Ergonomics · doi:10.1016/j.ergon.2006.04.002 · Cited by 309
Raymond, J. E., & O'Brien, J. L. (2009) · Psychological Science · doi:10.1111/j.1467-9280.2009.02391.x · Cited by 268
Armbruster, D. J. N., Ueltzhöffer, K., Basten, U., & Fiebach, C. J. (2012) · Journal of Cognitive Neuroscience · doi:10.1162/jocn_a_00286 · Cited by 202
Suppressed Sensory Response to Predictable Object Stimuli throughout the Ventral Visual Stream
Richter, D., Ekman, M., & de Lange, F. P. (2018) · The Journal of Neuroscience · doi:10.1523/jneurosci.3421-17.2018 · Cited by 150
Mesolimbic confidence signals guide perceptual learning in the absence of external feedback
Guggenmos, M., Wilbertz, G., Hebart, M. N., & Sterzer, P. (2016) · eLife · doi:10.7554/elife.13388 · Cited by 164
Shape Perception Simultaneously Up- and Downregulates Neural Activity in the Primary Visual Cortex
Kok, P., & de Lange, F. P. (2014) · Current Biology · doi:10.1016/j.cub.2014.05.042 · Cited by 163
Distractor Filtering in Media Multitaskers
Cain, M. S., & Mitroff, S. R. (2011) · Perception · doi:10.1068/p7017 · Cited by 160
Distinct transfer effects of training different facets of working memory capacity.
von Bastian, C. C., & Oberauer, K. (2013) · Journal of Memory and Language · doi:10.1016/j.jml.2013.02.002 · Cited by 139
Brain Signal Variability Differentially Affects Cognitive Flexibility and Cognitive Stability
Armbruster-Genç, D. J. N., Ueltzhöffer, K., & Fiebach, C. J. (2016) · The Journal of Neuroscience · doi:10.1523/jneurosci.2517-14.2016 · Cited by 126
Cross, K. A., Torrisi, S., Reynolds Losin, E. A., & Iacoboni, M. (2013) · NeuroImage · doi:10.1016/j.neuroimage.2013.06.060 · Cited by 113
Do professional facial image comparison training courses work?
Towler, A., Kemp, R. I., Burton, A. M., Dunn, J. D., Wayne, T., Moreton, R., & White, D. (2019) · PLOS ONE · doi:10.1371/journal.pone.0211037 · Cited by 111
Interaction between value and perceptual salience in value-driven attentional capture
Wang, L., Yu, H., & Zhou, X. (2013) · Journal of Vision · doi:10.1167/13.3.5 · Cited by 106
“The between-subject variability has been excluded from the standard errors (Cousineau, 2005).”
BackgroundMemory control ability modulates intrusive memories after analogue trauma
Streb, M., Mecklinger, A., Anderson, M. C., Lass-Hennemann, J., & Michael, T. (2016) · Journal of Affective Disorders · doi:10.1016/j.jad.2015.12.032 · Cited by 98
“for within-subject designs (Cousineau, 2005; O’Brien and Cousineau, 2014).”
Reward guides attention to object categories in real-world scenes.
Hickey, C., Kaiser, D., & Peelen, M. V. (2015) · Journal of Experimental Psychology: General · doi:10.1037/a0038627 · Cited by 91
Uncertainty and predictiveness determine attention to cues during human associative learning
Beesley, T., Nguyen, K. P., Pearson, D., & Le Pelley, M. E. (2015) · Quarterly Journal of Experimental Psychology · doi:10.1080/17470218.2015.1009919 · Cited by 85
Intrinsic motivation and attentional capture from gamelike features in a visual search task
Miranda, A. T., & Palmer, E. M. (2014) · Behavior Research Methods · doi:10.3758/s13428-013-0357-7 · Cited by 86
Hickey, C., Chelazzi, L., & Theeuwes, J. (2011) · Visual Cognition · doi:10.1080/13506285.2010.503946 · Cited by 89
Conflicted between goal-directed and habitual control, an fMRI investigation
Watson, P., van Wingen, G., & de Wit, S. (2018) · eneuro · doi:10.1523/eneuro.0240-18.2018 · Cited by 84
Working memory updating and binding training: Bayesian evidence supporting the absence of transfer.
De Simoni, C., & von Bastian, C. C. (2018) · Journal of Experimental Psychology: General · doi:10.1037/xge0000453 · Cited by 84
Does working memory training have to be adaptive?
von Bastian, C. C., & Eschen, A. (2016) · Psychological Research · doi:10.1007/s00426-015-0655-z · Cited by 83
Sopp, M. R., Michael, T., Weeß, H.-G., & Mecklinger, A. (2017) · Cognitive, Affective, & Behavioral Neuroscience · doi:10.3758/s13415-017-0542-8 · Cited by 68
Münkler, P., Rothkirch, M., Dalati, Y., Schmack, K., & Sterzer, P. (2015) · PLOS ONE · doi:10.1371/journal.pone.0129863 · Cited by 67
Pearson, D., Osborn, R., Whitford, T. J., Failing, M., Theeuwes, J., & Le Pelley, M. E. (2016) · Attention, Perception, & Psychophysics · doi:10.3758/s13414-016-1135-2 · Cited by 65
Conscious access in the near absence of attention: critical extensions on the dual-task paradigm
Matthews, J., Schröder, P., Kaunitz, L., van Boxtel, J. J. A., & Tsuchiya, N. (2018) · Philosophical Transactions of the Royal Society B: Biological Sciences · doi:10.1098/rstb.2017.0352 · Cited by 64
De Paepe, A. L., Crombez, G., Spence, C., & Legrain, V. (2014) · Neuropsychologia · doi:10.1016/j.neuropsychologia.2014.01.016 · Cited by 63
Multisensory enhancement of attention depends on whether you are already paying attention
Lunn, J., Sjoblom, A., Ward, J., Soto-Faraco, S., & Forster, S. (2019) · Cognition · doi:10.1016/j.cognition.2019.02.008 · Cited by 62
Failing, M., & Theeuwes, J. (2017) · Attention, Perception, & Psychophysics · doi:10.3758/s13414-017-1376-8 · Cited by 58
Value-Driven Attentional Capture in Adolescence
Roper, Z. J. J., Vecera, S. P., & Vaidya, J. G. (2014) · Psychological Science · doi:10.1177/0956797614545654 · Cited by 57
Rewarded visual items capture attention only in heterogeneous contexts
Feldmann‐Wüstefeld, T., Brandhofer, R., & Schubö, A. (2016) · Psychophysiology · doi:10.1111/psyp.12641 · Cited by 49
To Do or Not to Do? Task Control Deficit in Obsessive-Compulsive Disorder
Kalanthroff, E., Henik, A., Simpson, H. B., Todder, D., & Anholt, G. E. (2017) · Behavior Therapy · doi:10.1016/j.beth.2017.01.004 · Cited by 43
Le Pelley, M. E., Seabrooke, T., Kennedy, B. L., Pearson, D., & Most, S. B. (2017) · Attention, Perception, & Psychophysics · doi:10.3758/s13414-017-1346-1 · Cited by 44
Expectation Suppression in Early Visual Cortex Depends on Task Set
St. John-Saaltink, E., Utzerath, C., Kok, P., Lau, H. C., & de Lange, F. P. (2015) · PLOS ONE · doi:10.1371/journal.pone.0131172 · Cited by 43
Eckart, C., Fuentemilla, L., Bauch, E. M., & Bunzeck, N. (2014) · NeuroImage · doi:10.1016/j.neuroimage.2014.03.011 · Cited by 43
“Since we calculated within-subject ANOVAs, error bars were corrected for subject-specific variance (Cousineau, 2005).”
InfluentialCausal Responsibility and Robust Causation
Grinfeld, G., Lagnado, D., Gerstenberg, T., Woodward, J. F., & Usher, M. (2020) · Frontiers in Psychology · doi:10.3389/fpsyg.2020.01069 · Cited by 41
Mind wandering increases linearly with text difficulty
Kahmann, R., Ozuer, Y., Zedelius, C. M., & Bijleveld, E. (2022) · Psychological Research · doi:10.1007/s00426-021-01483-9 · Cited by 32
The importance of internal facial features in learning new faces
Longmore, C. A., Liu, C. H., & Young, A. W. (2015) · Quarterly Journal of Experimental Psychology · doi:10.1080/17470218.2014.939666 · Cited by 30
Novel microalgae-based foods: what influences singaporean consumers’ acceptance?
Wassmann, B., Hartmann, C., & Siegrist, M. (2024) · Food Quality and Preference · doi:10.1016/j.foodqual.2023.105068 · Cited by 29
Repetition suppression to objects is modulated by stimulus-specific expectations
Utzerath, C., St. John-Saaltink, E., Buitelaar, J., & de Lange, F. P. (2017) · Scientific Reports · doi:10.1038/s41598-017-09374-z · Cited by 28
Haarsma, J., Deveci, N., Corbin, N., Callaghan, M. F., & Kok, P. (2023) · The Journal of Neuroscience · doi:10.1523/jneurosci.0998-23.2023 · Cited by 26
Learning new word meanings from story reading: the benefit of immediate testing
Hulme, R. C., & Rodd, J. M. (2021) · PeerJ · doi:10.7717/peerj.11693 · Cited by 23
Wee, N., Asplund, C. L., & Chee, M. W. L. (2013) · Sleep · doi:10.5665/sleep.2710 · Cited by 17
Spachtholz, P., Kuhbandner, C., & Pekrun, R. (2016) · Emotion · doi:10.1037/emo0000199 · Cited by 7
Yazdanpanah, A., Jung, H., Soltani, A., & Wager, T. D. (2026) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.2513856123 · Cited by 1
“Error bars represent the within - subject SEM using the Cousineau–Morey method (59, 60).”
Metadata
- Authors
- Cousineau, D.
- Venue
- Tutorials in Quantitative Methods for Psychology
- Published
- 2005-09-01
- Volume
- 1
- Issue
- 1
- Pages
- 42-45
- ISSN
- 1913-4126 (ISSN-L)
- OpenAlex
- W2171656628
- Cited by
- 1,874
- References
- 6
- FWCI
- 7.49
- Type
- journal article
- Language
- en
- Open access
- diamond
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.