Reported Self-control is not Meaningfully Associated with Inhibition-related Executive Function: A Bayesian Analysis
Open accessThe DOI matches its Crossref record; 27 of the 27 references it cites were found in a registry or an index.
Abstract
Self-control is assessed using a remarkable array of measures. In a series of five data-sets (overall N = 2,641) and a mini meta-analysis, we explored the association between canonical operationalisations of self-control: The Self-Control Scale and two measures of inhibition-related executive functioning (the Stroop and Flanker paradigms). Overall, Bayesian correlational analyses suggested little-to-no relationship between self-reported self-control and performance on the Stroop and Flanker tasks. The Bayesian meta-analytical summary of all five data-sets further favoured a null relationship between both types of measurement. These results suggest that the field’s most widely used measure of self-reported self-control is uncorrelated with two of the most widely adopted executive functioning measures of self-control. Consequently, theoretical and practical conclusions drawn using one measure (e.g., the Self-Control Scale) cannot be generalised to findings using the other (e.g., the Stroop task). The lack of empirical correlation between measures of self-control do not invalidate either measure, but instead suggest that treatments of the construct of self-control need to pay greater attention to convergent validity among the many measures used to operationalize self-control.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Miyake, A., Friedman, N. P., Emerson, M. J., Witzki, A. H., Howerter, A., & Wager, T. D. (2000) · Cognitive Psychology · doi:10.1006/cogp.1999.0734 · Cited by 15,798
A very brief measure of the Big-Five personality domains
Gosling, S. D., Rentfrow, P. J., & Swann, W. B. (2003) · Journal of Research in Personality · doi:10.1016/s0092-6566(03)00046-1 · Cited by 8,307
Stan : A Probabilistic Programming Language
Carpenter, B., Gelman, A., Hoffman, M. D., Lee, D., Goodrich, B., Betancourt, M., Brubaker, M., Guo, J., Li, P., & Riddell, A. (2017) · Journal of Statistical Software · doi:10.18637/jss.v076.i01 · Cited by 7,754
Effects of noise letters upon the identification of a target letter in a nonsearch task
Eriksen, B. A., & Eriksen, C. W. (1974) · Perception & Psychophysics · doi:10.3758/bf03203267 · Cited by 7,230 · cited 2×
“…would most likely be negative and small.4 Studies 2 a-c The following three studies replicated the above findings using a large online sample of participants and another common test of inhibition-related executive functions, the Flanker paradigm (cf., Eriksen & Eriksen, 1974; Miyake et al., 2001).”
MethodResultGrit: perseverance and passion for long-term goals
Duckworth, A. L., Peterson, C., Matthews, M. D., & Kelly, D. R. (2007) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.92.6.1087 · Cited by 6,911 · cited 3×
“Similarly, grit is defined as perseverance and passion for long-term goals, even in the face of short-term setbacks and obstacles (Duckworth et al., 2007; Von Culin, Tsukayama, & Duckworth, 2014).”
BackgroundMethodInfluentialAn alternative "description of personality": The Big-Five factor structure.
Goldberg, L. R. (1990) · Journal of Personality and Social Psychology · doi:10.1037//0022-3514.59.6.1216 · Cited by 6,652
High self-control predicts good adjustment, less pathology, better grades, and interpersonal success
Tangney, J. P., Baumeister, R. F., & Boone, A. L. (2004) · Journal of Personality · doi:10.1111/j.0022-3506.2004.00263.x · Cited by 6,557 · cited 13×
“Similarly, the concept of inhibiting unwanted impulses was central to the development of the Self-Control Scale (Tangney et al., 2004), and many of the items in this scale assess inhibition-like content (e.”
BackgroundMethodInfluentialA gradient of childhood self-control predicts health, wealth, and public safety
Moffitt, T. E., Arseneault, L., Belsky, D., Dickson, N., Hancox, R. J., Harrington, H., Houts, R., Poulton, R., Roberts, B. W., Ross, S., et al. (2011) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1010076108 · Cited by 4,885 · cited 4×
“…of the present time” (Baumeister et al., 1994, pp. 3; see also, Mischel, Shoda, & Rodriguez, 1989), with low reported self-control predicting poorer health, finances, and wellbeing, and higher rates of mortality and criminal convictions (Moffitt et al., 2011; Tangney, Baumeister, & Boone, 2004).”
BackgroundInfluentialMiyake, A., & Friedman, N. P. (2012) · Current Directions in Psychological Science · doi:10.1177/0963721411429458 · Cited by 3,944 · cited 4×
“Furthermore, while some analyses have suggested that a common latent factor unites measures of inhibitory executive functioning (Miyake et al., 2000; Miyake & Friedman, 2012), other research indicates a lack of convergence between these measures (Egner, 2008).”
BackgroundInfluentialDelay of gratification in children.
Mischel, W., Shoda, Y., & Rodriguez, M. L. (1989) · Science · doi:10.1126/science.2658056 · Cited by 3,397
Development and validation of the short grit scale (grit-s)
Duckworth, A. L., & Quinn, P. D. (2009) · Journal of Personality Assessment · doi:10.1080/00223890802634290 · Cited by 3,376
Self-discipline outdoes IQ in predicting academic performance of adolescents.
Duckworth, A. L., & Seligman, M. E. P. (2005) · Psychological Science · doi:10.1111/j.1467-9280.2005.01641.x · Cited by 2,253
Davidson, M. C., Amso, D., Anderson, L. C., & Diamond, A. (2006) · Neuropsychologia · doi:10.1016/j.neuropsychologia.2006.02.006 · Cited by 2,226
Executive functions and self-regulation
Hofmann, W., Schmeichel, B. J., & Baddeley, A. D. (2012) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2012.01.006 · Cited by 1,965
de Ridder, D. T. D., Lensvelt-Mulders, G., Finkenauer, C., Stok, F. M., & Baumeister, R. F. (2012) · Personality and Social Psychology Review · doi:10.1177/1088868311418749 · Cited by 1,693
Bogg, T., & Roberts, B. W. (2004) · Psychological Bulletin · doi:10.1037/0033-2909.130.6.887 · Cited by 1,632 · cited 1×
“…encompasses needs for achievement, organization, restraint, and rule following (Goldberg, 1990; John, & Srivastava, 1999; Roberts, Jackson, Fayard, Edmonds, & Meints, 2009), and reliably predicts health, wealth, and well-being across the lifespan (Bogg & Roberts, 2004; Kern & Friedman, 2008).”
Evaluating amazon’s mechanical turk as a tool for experimental behavioral research
Crump, M. J. C., McDonnell, J. V., & Gureckis, T. M. (2013) · PLoS ONE · doi:10.1371/journal.pone.0057410 · Cited by 1,617
The reliability paradox: Why robust cognitive tasks do not produce reliable individual differences
Hedge, C., Powell, G., & Sumner, P. (2018) · Behavior Research Methods · doi:10.3758/s13428-017-0935-1 · Cited by 1,457 · cited 1×
“Another limitation is the previously mentioned reliability paradox (Hedge et al., 2017): Robust cognitive tasks do not produce reliable individual differences, making their use as trait-level correlational tools problematic.”
BackgroundSelf-control relies on glucose as a limited energy source: Willpower is more than a metaphor.
Gailliot, M. T., Baumeister, R. F., DeWall, C. N., Maner, J. K., Plant, E. A., Tice, D. M., Brewer, L. E., & Schmeichel, B. J. (2007) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.92.2.325 · Cited by 1,297
Self-Control and Grit: Related but Separable Determinants of Success
Duckworth, A., & Gross, J. J. (2014) · Current Directions in Psychological Science · doi:10.1177/0963721414541462 · Cited by 1,025 · cited 1×
“Although theoretical distinctions exist between grit, conscientiousness, and the Self-Control Scale (cf., Duckworth & Gross, 2014), these self-regulatory traits tend to correlate highly with each other and the Self-Control Scale (rs ~ .70–.80; Roberts et al., 2013).”
Do conscientious individuals live longer? A quantitative review.
Kern, M. L., & Friedman, H. S. (2008) · Health Psychology · doi:10.1037/0278-6133.27.5.505 · Cited by 464
Fraley, R. C., & Vazire, S. (2014) · PLoS ONE · doi:10.1371/journal.pone.0109019 · Cited by 409
A Bayesian Perspective on the Reproducibility Project: Psychology
Etz, A., & Vandekerckhove, J. (2016) · PLOS ONE · doi:10.1371/journal.pone.0149794 · Cited by 295 · cited 1×
“Bayes factors can be interpreted “as the degree to which the data sway our belief from one to the other hypothesis” (Etz & Vandekerckhove, 2016, p. 4).”
BackgroundSelf-citationGronau, Q. F., Sarafoglou, A., Matzke, D., Ly, A., Boehm, U., Marsman, M., Leslie, D. S., Forster, J. J., Wagenmakers, E.-J., & Steingroever, H. (2017) · Journal of Mathematical Psychology · doi:10.1016/j.jmp.2017.09.005 · Cited by 284
Reliability and plasticity of response inhibition and interference control
Wöstmann, N. M., Aichert, D. S., Costa, A., Rubia, K., Möller, H.-J., & Ettinger, U. (2013) · Brain and Cognition · doi:10.1016/j.bandc.2012.09.010 · Cited by 217 · cited 3×
“…were good-to-excellent for most measures (compatible mean RT, α = .95; incompatible mean RT, α = .93; compatible error rates, α = .83; incompatible error rates, α = .83), but low for the Stroop effect in mean reaction time (α = .52) and error rates (α = .46; see also Wöstmann et al., 2013).”
BackgroundResultInfluentialFleming, K. A., Heintzelman, S. J., & Bartholow, B. D. (2016) · Journal of Personality · doi:10.1111/jopy.12163 · Cited by 100
Edmonds, G. W., Bogg, T., & Roberts, B. W. (2009) · Journal of Research in Personality · doi:10.1016/j.jrp.2009.06.006 · Cited by 33
Cited by
Why Are Self-Report and Behavioral Measures Weakly Correlated?
Dang, J., King, K. M., & Inzlicht, M. (2020) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2020.01.007 · Cited by 634
“For example, the average correlation between self-report and behavioral measures of self-control [1,2], emotional intelligence [3], empathy [4], risk preference [5], and creativity [6] ranged from 0 to 0.”
BackgroundSelf-citationIntegrating Models of Self-Regulation
Inzlicht, M., Werner, K. M., Briskin, J. L., & Roberts, B. W. (2021) · Annual Review of Psychology · doi:10.1146/annurev-psych-061020-105721 · Cited by 594
Self-citationLarge-scale analysis of test–retest reliabilities of self-regulation measures
Enkavi, A. Z., Eisenberg, I. W., Bissett, P. G., Mazza, G. L., MacKinnon, D. P., Marsch, L. A., & Poldrack, R. A. (2019) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1818430116 · Cited by 489
Rethinking Executive Function and Its Development
Doebel, S. (2020) · Perspectives on Psychological Science · doi:10.1177/1745691620904771 · Cited by 517
Uncovering the structure of self-regulation through data-driven ontology discovery
Eisenberg, I. W., Bissett, P. G., Zeynep Enkavi, A., Li, J., MacKinnon, D. P., Marsch, L. A., & Poldrack, R. A. (2019) · Nature Communications · doi:10.1038/s41467-019-10301-1 · Cited by 474
Metadata
- Authors
- Saunders, B., Milyavskaya, M., Etz, A., Randles, D., & Inzlicht, M.
- Venue
- Collabra: Psychology
- Publisher
- University of California Press
- Published
- 2018-01-01
- Volume
- 4
- Issue
- 1
- ISSN
- 2474-7394 (ISSN-L)
- OpenAlex
- W2794652920
- Cited by
- 132
- References
- 27
- FWCI
- 15.46
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.