The DOI matches its Crossref record; 53 of the 53 references it cites were found in a registry or an index.
Survey-software implicit association tests: A methodological and empirical analysis
Open accessAbstract
The implicit association test (IAT) is widely used in psychology. Unfortunately, the IAT cannot be run within online surveys, requiring researchers who conduct online surveys to rely on third-party tools. We introduce a novel method for constructing IATs using online survey software (Qualtrics); we then empirically assess its validity. Study 1 (student n = 239) revealed good psychometric properties, expected IAT effects, and expected correlations with explicit measures for survey-software IATs. Study 2 (MTurk n = 818) showed predicted IAT effects across four survey-software IATs (ds = 0.82 [Black–White IAT] to 2.13 [insect–flower IAT]). Study 3 (MTurk n = 270) compared survey-software IATs and IATs run via Inquisit, yielding nearly identical results and intercorrelations that would be expected for identical IATs. Survey-software IATs appear to be reliable and valid, offer numerous advantages, and make IATs accessible for researchers who use survey software to conduct online research. We present all the materials, links to tutorials, and an open-source tool that rapidly automates survey-software IAT construction and analysis.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Measuring individual differences in implicit cognition: the implicit association test
Greenwald, A. G., McGhee, D. E., & Schwartz, J. L. K. (1998) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.74.6.1464 · Cited by 9,210
Understanding and using the Implicit Association Test: I. An improved scoring algorithm.
Greenwald, A. G., Nosek, B. A., & Banaji, M. R. (2003) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.85.2.197 · Cited by 5,815
Bayesian t tests for accepting and rejecting the null hypothesis
Rouder, J. N., Speckman, P. L., Sun, D., Morey, R. D., & Iverson, G. (2009) · Psychonomic Bulletin & Review · doi:10.3758/pbr.16.2.225 · Cited by 3,688
Understanding and using the Implicit Association Test: III. Meta-analysis of predictive validity.
Greenwald, A. G., Poehlman, T. A., Uhlmann, E. L., & Banaji, M. R. (2009) · Journal of Personality and Social Psychology · doi:10.1037/a0015575 · Cited by 3,257
Lakens, D. (2017) · Social Psychological and Personality Science · doi:10.1177/1948550617697177 · Cited by 2,161 · cited 1×
“Within a non-Bayesian framework, one can similarly test for equivalence via equivalence tests (Lakens, 2017), which returned similar results.”
ResultInside the Turk: Understanding Mechanical Turk as a Participant Pool
Paolacci, G., & Chandler, J. (2014) · Current Directions in Psychological Science · doi:10.1177/0963721414531598 · Cited by 2,136
Gorilla in our midst: An online behavioral experiment builder
Anwyl-Irvine, A. L., Massonnié, J., Flitton, A., Kirkham, N., & Evershed, J. K. (2020) · Behavior Research Methods · doi:10.3758/s13428-019-01237-x · Cited by 1,862
(2003) · doi:10.1146/annurev.psych.54.101601.145225 · Cited by 1,829
jsPsych: A JavaScript library for creating behavioral experiments in a Web browser
de Leeuw, J. R. (2015) · Behavior Research Methods · doi:10.3758/s13428-014-0458-y · Cited by 1,778
Hofmann, W., Gawronski, B., Gschwendner, T., Le, H., & Schmitt, M. (2005) · Personality and Social Psychology Bulletin · doi:10.1177/0146167205275613 · Cited by 1,642
Cited by
The most human bot: Female gendering increases humanness perceptions of bots and acceptance of AI
Borau, S., Otterbring, T., Laporte, S., & Fosso Wamba, S. (2021) · Psychology & Marketing · doi:10.1002/mar.21480 · Cited by 272
Pachankis, J. E., McConocha, E. M., Clark, K. A., Wang, K., Behari, K., Fetzner, B. K., Brisbin, C. D., Scheer, J. R., & Lehavot, K. (2020) · Journal of Consulting and Clinical Psychology · doi:10.1037/ccp0000508 · Cited by 227
Fietta, V., Zecchinato, F., Stasi, B. D., Polato, M., & Monaro, M. (2022) · IEEE Transactions on Human-Machine Systems · doi:10.1109/thms.2021.3125280 · Cited by 81
Kerstan, S., Bienefeld, N., & Grote, G. (2024) · Risk Analysis · doi:10.1111/risa.14216 · Cited by 55
Goedderz, A., & Hahn, A. (2022) · Journal of Experimental Social Psychology · doi:10.1016/j.jesp.2022.104374 · Cited by 15
Metadata
- Authors
- Carpenter, T. P., Pogacar, R., Pullig, C., Kouril, M., Aguilar, S., LaBouff, J., Isenberg, N., & Chakroff, A.
- Venue
- Behavior Research Methods
- Published
- 2019-09-12
- Volume
- 51
- Issue
- 5
- Pages
- 2194-2208
- ISSN
- 1554-351X (ISSN-L)
- 1554-3528
- OpenAlex
- W2889916852
- Cited by
- 310
- References
- 53
- FWCI
- 19.32
- Type
- journal article
- Language
- en
- Open access
- bronze
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Survey-software implicit association tests: A methodological and empirical analysis. https://app.cochat.ai/papers/10.3758/s13428-019-01293-3
- The paper
- Carpenter, T. P., Pogacar, R., Pullig, C., Kouril, M., Aguilar, S., LaBouff, J., Isenberg, N., & Chakroff, A. (2019). Survey-software implicit association tests: A methodological and empirical analysis. Behavior Research Methods. https://doi.org/10.3758/s13428-019-01293-3
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.