Causal processes in psychology are heterogeneous.
The DOI matches its Crossref record; 14 of the 14 references it cites were found in a registry or an index.
Abstract
All experimenters know that human and animal subjects do not respond uniformly to experimental treatments. Yet theories and findings in experimental psychology either ignore this causal effect heterogeneity or treat it as uninteresting error. This is the case even when data are available to examine effect heterogeneity directly, in within-subjects designs where experimental effects can be examined subject by subject. Using data from four repeated-measures experiments, we show that effect heterogeneity can be modeled readily, that its discovery presents exciting opportunities for theory and methods, and that allowing for it in study designs is good research practice. This evidence suggests that experimenters should work from the assumption that causal effects are heterogeneous. Such a working assumption will be of particular benefit, given the increasing diversity of subject populations in psychology. (PsycINFO Database Record (c) 2019 APA, all rights reserved).
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Data Analysis Using Regression and Multilevel/Hierarchical Models
Gelman, A., & Hill, J. (2006) · doi:10.1017/cbo9780511790942 · Cited by 13,597
Estimating causal effects of treatments in randomized and nonrandomized studies
Rubin, D. B. (1974) · Journal of Educational Psychology · doi:10.1037/h0037350 · Cited by 9,436 · cited 3×
“But if, as has been argued by Rubin and others (Imbens & Rubin, 2015; Morgan & Winship, 2014; Rubin, 1974), a single causal effect in a between-subjects experiment is equal to an average causal effect in a within-subjects experiment, then experimentalists should consider this in interpretations of between-subjects res…”
BackgroundMixed-effects modeling with crossed random effects for subjects and items
Baayen, R. H., Davidson, D. J., & Bates, D. M. (2008) · Journal of Memory and Language · doi:10.1016/j.jml.2007.12.005 · Cited by 8,540 · cited 4×
“Two areas in experimental psychology that routinely use these models are experimental linguistics (for which Baayen et al., 2008, has been a major influence) and the field known as cognitive modeling that has its roots in mathematical psychology (Busemeyer & Diederich, 2010; Lee & Wagenmakers,…”
BackgroundMethodInfluentialFisher, R. A. (1936) · BMJ · doi:10.1136/bmj.1.3923.554-a · Cited by 4,980
Causal Inference for Statistics, Social, and Biomedical Sciences: An Introduction
Imbens, G. W., & Rubin, D. B. (2015) · doi:10.1017/cbo9781139025751 · Cited by 4,210
Promotion and Prevention: Regulatory Focus as A Motivational Principle
Higgins, E. T. (1998) · Advances in Experimental Social Psychology · doi:10.1016/s0065-2601(08)60381-0 · Cited by 3,511 · cited 2×
“We will examine whether subject differences in promotion focus, a relatively stable individual tendency to eagerly pursue ideals and aspirations (Higgins, 1998), can explain some of the between-person heterogeneity we found in the trait valence causal effect.”
BackgroundMethodThe nature and function of self-esteem: Sociometer theory
Leary, M. R., & Baumeister, R. F. (2000) · Advances in Experimental Social Psychology · doi:10.1016/s0065-2601(00)80003-9 · Cited by 2,521
Molenaar, P. C. M. (2004) · Measurement: Interdisciplinary Research & Perspective · doi:10.1207/s15366359mea0204_1 · Cited by 1,943 · cited 3×
“Thus, their empirical approach is to initially treat each experimental subject as unique and determine with the help of within-subject variation the extent to which subjects can be compared and on what dimensions to do so (Molenaar, 2004; Molenaar & Campbell, 2009).”
BackgroundDefault Bayes factors for ANOVA designs
Rouder, J. N., Morey, R. D., Speckman, P. L., & Province, J. M. (2012) · Journal of Mathematical Psychology · doi:10.1016/j.jmp.2012.08.001 · Cited by 1,800
Kruschke, J. K., & Liddell, T. M. (2018) · Psychonomic Bulletin & Review · doi:10.3758/s13423-016-1221-4 · Cited by 1,288 · cited 1×
“Broader guidance on Bayesian mixed models can be found in Gelman et al., 2013; Gelman & Hill, 2007; Kruschke, 2015; Kruschke & Liddell, 2018; Lee & Wagenmakers, 2014; and McElreath, 2016.”
MethodJudd, C. M., Westfall, J., & Kenny, D. A. (2012) · Journal of Personality and Social Psychology · doi:10.1037/a0028347 · Cited by 1,236
The new person-specific paradigm in psychology
Molenaar, P. C. M., & Campbell, C. G. (2009) · Current Directions in Psychological Science · doi:10.1111/j.1467-8721.2009.01619.x · Cited by 1,088
Constraints on Generality (COG): A Proposed Addition to All Empirical Papers
Simons, D. J., Shoda, Y., & Lindsay, D. S. (2017) · Perspectives on Psychological Science · doi:10.1177/1745691617708630 · Cited by 986 · cited 2×
“, exclusion criteria) can be found on pages 119614 and 9617-8 of Sklar et al. (2012). The experiment also involved a between-subjects manipulation of presentation time (1,700 ms vs. 2,000 ms). For simplicity, we do not include presentation time in our analyses. In other words, the analysis presented here examines the…”
BackgroundTackett, J. L., Lilienfeld, S. O., Patrick, C. J., Johnson, S. L., Krueger, R. F., Miller, J. D., Oltmanns, T. F., & Shrout, P. E. (2017) · Perspectives on Psychological Science · doi:10.1177/1745691617690042 · Cited by 251 · cited 1×
“This approach, however, can be criticized for reducing the diversity of samples and limiting generalizability (Tackett et al., 2017).”
Background
Cited by
Social media use and well-being: What we know and what we need to know
Valkenburg, P. M. (2022) · Current Opinion in Psychology · doi:10.1016/j.copsyc.2021.12.006 · Cited by 373
Conformal Inference of Counterfactuals and Individual Treatment Effects
Lei, L., & Candès, E. J. (2021) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/rssb.12445 · Cited by 166
Valkenburg, P. M., Beyens, I., Pouwels, J. L., van Driel, I. I., & Keijsers, L. (2021) · Journal of Computer-Mediated Communication · doi:10.1093/jcmc/zmab015 · Cited by 123
Self‐esteem development and life events: A review and integrative process framework
Reitz, A. K. (2022) · Social and Personality Psychology Compass · doi:10.1111/spc3.12709 · Cited by 90
“Instead of treating this heterogeneity as uninteresting error, we might want to consider its potential to unravel causal processes of self-esteem change, as causal effects are heterogeneous (Bolger et al., 2019).”
BackgroundSaqr, M., López-Pernas, S., & Vogelsmeier, L. V. D. E. (2023) · Computers & Education · doi:10.1016/j.compedu.2023.104934 · Cited by 26
Metadata
- Authors
- Bolger, N., Zee, K. S., Rossignac-Milon, M., & Hassin, R. R.
- Venue
- Journal of Experimental Psychology: General
- Published
- 2019-04
- Volume
- 148
- Issue
- 4
- Pages
- 601-618
- ISSN
- 0096-3445 (ISSN-L)
- 1939-2222
- OpenAlex
- W2937361053
- Cited by
- 154
- References
- 14
- FWCI
- 13.56
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.