The DOI matches its Crossref record; 4 of the 4 references it cites were found in a registry or an index.
Confidence Intervals from Normalized Data: A correction to Cousineau (2005)
Open accessAbstract
Presenting confidence intervals around means is a common method of expressing uncertainty in data. Loftus and Masson (1994) describe confidence intervals for means in within-subjects designs. These confidence intervals are based on the ANOVA mean squared error. Cousineau (2005) presents an alternative to the Loftus and Masson method, but his method produces confidence intervals that are smaller than those of Loftus and Masson. I show why this is the case and offer a simple correction that makes the expected size of Cousineau confidence intervals the same as that of Loftus and Masson confidence intervals. Confidence intervals (CIs) are a staple in the presentation of psychological data because they allow researchers to quickly gage the amount of uncertainty in data (Rouder & Morey, 2005). For within-subjects designs, there are several approaches to creating confidence intervals. For a given design it may not be clear which to choose. Consider a simple within-subjects design with two conditions, a pre-test and post-test. For this design, there are multiple methods of generating confidence intervals. I will discuss each in turn. Approaches to confidence intervals The standard way to build confidence intervals is to compute the standard error of the mean for each condition, and multiply it by the appropriate t-distribution quantile. In order to make this concrete, Table 1 lists hypothetical data for N = 10 participants. A paired t-test reveals a significant effect of condition (MSE = 5:19; t(9) = 3:65; p =:005;
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Using confidence intervals in within-subject designs
Loftus, G. R., & Masson, M. E. J. (1994) · Psychonomic Bulletin & Review · doi:10.3758/bf03210951 · Cited by 2,448
Confidence intervals in within-subject designs: A simpler solution to Loftus and Masson's method
Cousineau, D. (2005) · Tutorials in Quantitative Methods for Psychology · doi:10.20982/tqmp.01.1.p042 · Cited by 1,874
Using confidence intervals for graphically based data interpretation.
Masson, M. E. J., & Loftus, G. R. (2003) · Canadian Journal of Experimental Psychology / Revue canadienne de psychologie expérimentale · doi:10.1037/h0087426 · Cited by 730
Rouder, J. N., & Morey, R. D. (2005) · Psychological Science · doi:10.1111/j.0956-7976.2005.00783.x · Cited by 31
Self-citation
Cited by
Do Better ImageNet Models Transfer Better?
Kornblith, S., Shlens, J., & Le, Q. V. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00277 · Cited by 1,325
Wearing Face Masks Strongly Confuses Counterparts in Reading Emotions
Carbon, C.-C. (2020) · Frontiers in Psychology · doi:10.3389/fpsyg.2020.566886 · Cited by 443
Local Entrainment of Alpha Oscillations by Visual Stimuli Causes Cyclic Modulation of Perception
Spaak, E., de Lange, F. P., & Jensen, O. (2014) · The Journal of Neuroscience · doi:10.1523/jneurosci.4385-13.2014 · Cited by 349
Language can boost otherwise unseen objects into visual awareness
Lupyan, G., & Ward, E. J. (2013) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1303312110 · Cited by 329
Rey-Mermet, A., Gade, M., & Oberauer, K. (2018) · Journal of Experimental Psychology: Learning, Memory, and Cognition · doi:10.1037/xlm0000450 · Cited by 310
Schapiro, A. C., Turk-Browne, N. B., Norman, K. A., & Botvinick, M. M. (2016) · Hippocampus · doi:10.1002/hipo.22523 · Cited by 294
When the Brain Takes a Break: A Model-Based Analysis of Mind Wandering
Mittner, M., Boekel, W., Tucker, A. M., Turner, B. M., Heathcote, A., & Forstmann, B. U. (2014) · The Journal of Neuroscience · doi:10.1523/jneurosci.2062-14.2014 · Cited by 228
Top-down attention switches coupling between low-level and high-level areas of human visual cortex
Al-Aidroos, N., Said, C. P., & Turk-Browne, N. B. (2012) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1202095109 · Cited by 180
“Error bars in all figures are within-subject SEMs (25).”
BackgroundSuppressed Sensory Response to Predictable Object Stimuli throughout the Ventral Visual Stream
Richter, D., Ekman, M., & de Lange, F. P. (2018) · The Journal of Neuroscience · doi:10.1523/jneurosci.3421-17.2018 · Cited by 150
Homogenization Effects of Large Language Models on Human Creative Ideation
Anderson, B. R., Shah, J. H., & Kreminski, M. (2024) · Creativity and Cognition · doi:10.1145/3635636.3656204 · Cited by 188
Shape Perception Simultaneously Up- and Downregulates Neural Activity in the Primary Visual Cortex
Kok, P., & de Lange, F. P. (2014) · Current Biology · doi:10.1016/j.cub.2014.05.042 · Cited by 163
Distractor Filtering in Media Multitaskers
Cain, M. S., & Mitroff, S. R. (2011) · Perception · doi:10.1068/p7017 · Cited by 160
Conwell, C., Prince, J. S., Kay, K. N., Alvarez, G. A., & Konkle, T. (2022) · doi:10.1101/2022.03.28.485868 · Cited by 160
Distinct transfer effects of training different facets of working memory capacity.
von Bastian, C. C., & Oberauer, K. (2013) · Journal of Memory and Language · doi:10.1016/j.jml.2013.02.002 · Cited by 139
Brain Signal Variability Differentially Affects Cognitive Flexibility and Cognitive Stability
Armbruster-Genç, D. J. N., Ueltzhöffer, K., & Fiebach, C. J. (2016) · The Journal of Neuroscience · doi:10.1523/jneurosci.2517-14.2016 · Cited by 126
That Sounds Sweet: Using Cross‐Modal Correspondences to Communicate Gustatory Attributes
Knoeferle, K. M., Woods, A., Käppler, F., & Spence, C. (2015) · Psychology & Marketing · doi:10.1002/mar.20766 · Cited by 137
“Error bars indicate 95% within-subjects confidence intervals (Morey, 2008).”
BackgroundManiscalco, B., Peters, M. A. K., & Lau, H. (2016) · Attention, Perception, & Psychophysics · doi:10.3758/s13414-016-1059-x · Cited by 129
Cognitive control in media multitaskers: Two replication studies and a meta-Analysis
Wiradhany, W., & Nieuwenstein, M. R. (2017) · Attention, Perception, & Psychophysics · doi:10.3758/s13414-017-1408-4 · Cited by 121
Masia, V., Canal, P., Ricci, I., Vallauri, E. L., & Bambini, V. (2017) · Journal of Neurolinguistics · doi:10.1016/j.jneuroling.2016.11.005 · Cited by 110
Quintana, D. S., Westlye, L. T., Hope, S., Nærland, T., Elvsåshagen, T., Dørum, E., Rustan, Ø., Valstad, M., Rezvaya, L., Lishaugen, H., et al. (2017) · Translational Psychiatry · doi:10.1038/tp.2017.103 · Cited by 111
Conwell, C., Prince, J. S., Kay, K. N., Alvarez, G. A., & Konkle, T. (2024) · Nature Communications · doi:10.1038/s41467-024-53147-y · Cited by 100
Intrinsic motivation and attentional capture from gamelike features in a visual search task
Miranda, A. T., & Palmer, E. M. (2014) · Behavior Research Methods · doi:10.3758/s13428-013-0357-7 · Cited by 86
Does working memory training have to be adaptive?
von Bastian, C. C., & Eschen, A. (2016) · Psychological Research · doi:10.1007/s00426-015-0655-z · Cited by 83
Samaha, J., Boutonnet, B., Postle, B. R., & Lupyan, G. (2018) · Scientific Reports · doi:10.1038/s41598-018-25093-5 · Cited by 80
Interactions between cardiac activity and conscious somatosensory perception
Motyka, P., Grund, M., Forschack, N., Al, E., Villringer, A., & Gaebler, M. (2019) · Psychophysiology · doi:10.1111/psyp.13424 · Cited by 79
Lapate, R. C., Rokers, B., Li, T., & Davidson, R. J. (2014) · Psychological Science · doi:10.1177/0956797613503175 · Cited by 76
Community enhanced tutorials: improving tutorials with multiple demonstrations
Lafreniere, B., Grossman, T., & Fitzmaurice, G. (2013) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/2470654.2466235 · Cited by 74
Initial-state-dependent, robust, transient neural dynamics encode conscious visual perception
Baria, A. T., Maniscalco, B., & He, B. J. (2017) · PLOS Computational Biology · doi:10.1371/journal.pcbi.1005806 · Cited by 70
Stress Impairs Episodic Retrieval by Disrupting Hippocampal and Cortical Mechanisms of Remembering
Gagnon, S. A., Waskom, M. L., Brown, T. I., & Wagner, A. D. (2019) · Cerebral Cortex · doi:10.1093/cercor/bhy162 · Cited by 69
Pollard, K. A., Oiknine, A. H., Files, B. T., Sinatra, A. M., Patton, D., Ericson, M., Thomas, J., & Khooshabeh, P. (2020) · Virtual Reality · doi:10.1007/s10055-019-00411-y · Cited by 66
Multisensory enhancement of attention depends on whether you are already paying attention
Lunn, J., Sjoblom, A., Ward, J., Soto-Faraco, S., & Forster, S. (2019) · Cognition · doi:10.1016/j.cognition.2019.02.008 · Cited by 62
(2018) · Springer Series on Touch and Haptic Systems · doi:10.1007/978-3-319-58316-7 · Cited by 60
Motor simulation beyond the dyad: Automatic imitation of multiple actors.
Cracco, E., De Coster, L., Andres, M., & Brass, M. (2015) · Journal of Experimental Psychology: Human Perception and Performance · doi:10.1037/a0039737 · Cited by 58
Failing, M., & Theeuwes, J. (2017) · Attention, Perception, & Psychophysics · doi:10.3758/s13414-017-1376-8 · Cited by 58
Normative arguments from experts and peers reduce delay discounting
Senecal, N., Wang, T., Thompson, E., & Kable, J. W. (2012) · Judgment and Decision Making · doi:10.1017/s1930297500006306 · Cited by 51
Kim, M., & Maguire, E. A. (2018) · Cerebral Cortex · doi:10.1093/cercor/bhy054 · Cited by 45
Expectation Suppression in Early Visual Cortex Depends on Task Set
St. John-Saaltink, E., Utzerath, C., Kok, P., Lau, H. C., & de Lange, F. P. (2015) · PLOS ONE · doi:10.1371/journal.pone.0131172 · Cited by 43
The impact of spelling regularity on handwriting production: A coupled fMRI and kinematics study
Palmis, S., Velay, J.-L., Fabiani, E., Nazarian, B., Anton, J.-L., Habib, M., Kandel, S., & Longcamp, M. (2019) · Cortex · doi:10.1016/j.cortex.2018.11.024 · Cited by 40
“The error bars represent the within-subject SEM (Morey, 2008).”
Cracco, E., De Coster, L., Andres, M., & Brass, M. (2016) · Social Cognitive and Affective Neuroscience · doi:10.1093/scan/nsw059 · Cited by 38
Gowen, E., Bolton, E., & Poliakoff, E. (2016) · Cognition · doi:10.1016/j.cognition.2015.10.010 · Cited by 34
The importance of internal facial features in learning new faces
Longmore, C. A., Liu, C. H., & Young, A. W. (2015) · Quarterly Journal of Experimental Psychology · doi:10.1080/17470218.2014.939666 · Cited by 30
Repetition suppression to objects is modulated by stimulus-specific expectations
Utzerath, C., St. John-Saaltink, E., Buitelaar, J., & de Lange, F. P. (2017) · Scientific Reports · doi:10.1038/s41598-017-09374-z · Cited by 28
Distractors associated with reward break through the focus of attention
Munneke, J., Belopolsky, A. V., & Theeuwes, J. (2016) · Attention, Perception, & Psychophysics · doi:10.3758/s13414-016-1075-x · Cited by 28
Haarsma, J., Deveci, N., Corbin, N., Callaghan, M. F., & Kok, P. (2023) · The Journal of Neuroscience · doi:10.1523/jneurosci.0998-23.2023 · Cited by 26
“To visualize the relevant across-subject variance for the within-subject ANOVA, error bars in all figures show within-subject SEM (Cousineau, 2005; Morey, 2008).”
MethodWas that a threat? Attentional biases by signals of threat.
Preciado, D., Munneke, J., & Theeuwes, J. (2017) · Emotion · doi:10.1037/emo0000246 · Cited by 20
Avoiding the problem state bottleneck by strategic use of the environment
Borst, J. P., Buwalda, T. A., van Rijn, H., & Taatgen, N. A. (2013) · Acta Psychologica · doi:10.1016/j.actpsy.2013.07.016 · Cited by 19
Wee, N., Asplund, C. L., & Chee, M. W. L. (2013) · Sleep · doi:10.5665/sleep.2710 · Cited by 17
Christifano, D. N., Chollet-Hinton, L., Mathis, N. B., Gajewski, B. J., Carlson, S. E., Colombo, J., & Gustafson, K. M. (2022) · The Journal of Nutrition · doi:10.1093/jn/nxac178 · Cited by 10
Rubien-Thomas, E., Berrian, N., Cervera, A., Nardos, B., Cohen, A. O., Lowrey, A., Daumeyer, N. M., Camp, N. P., Hughes, B. L., Eberhardt, J. L., et al. (2021) · Cognitive, Affective, & Behavioral Neuroscience · doi:10.3758/s13415-021-00896-8 · Cited by 6
Goldenkoff, E. R., Deluisi, J. A., Brissenden, J. A., Lee, T. G., Polk, T. A., Taylor, S. F., Hampstead, B. M., & Vesia, M. (2025) · Clinical Neurophysiology · doi:10.1016/j.clinph.2025.03.003 · Cited by 3
Behavioral Experiments Online?: A Conceptual Replication of the Avatar-Simon Effect With PsyToolkit
Böffel, C., & Meinardus, R. A. (2024) · Experimental Psychology · doi:10.1027/1618-3169/a000624 · Cited by 1
Yazdanpanah, A., Jung, H., Soltani, A., & Wager, T. D. (2026) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.2513856123 · Cited by 1
“Error bars represent the within - subject SEM using the Cousineau–Morey method (59, 60).”
Metadata
- Authors
- Morey, R. D.
- Venue
- Tutorials in Quantitative Methods for Psychology
- Published
- 2008-09-01
- Volume
- 4
- Issue
- 2
- Pages
- 61-64
- ISSN
- 1913-4126 (ISSN-L)
- OpenAlex
- W2187089918
- Cited by
- 1,997
- References
- 4
- Type
- journal article
- Language
- en
- Open access
- diamond
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.