The DOI matches its Crossref record; 27 of the 27 references it cites were found in a registry or an index.
Noncompliant responding: Comparing exclusion criteria in MTurk personality research to improve data quality
Open accessOverview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source doesn’t support the claim as written.
In the citing paper
“However, compared to undergraduate research pool respondents, online study participants typically provide comparable or superior data quality and research fidelity [e.g., 90].”
From Not so terrifying after all? A set of failed replications of the mortality salience effects of Terror Management Theory (2023) · cites this paper as [90]
Checked by a reasoning model — may be wrong.
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“In crowd-sourced settings such as MTurk, respondents are often incentivized to respond as attentively, compliantly, and quickly as possible to both open higher-paying opportunities and prevent being rejected from future employment [90, 100].”
From Not so terrifying after all? A set of failed replications of the mortality salience effects of Terror Management Theory (2023) · cites this paper as [90]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Although some recent concerns about MTurk quality have emerged, data support that diverse validity and attention checks, such as those included in the present studies, adequately protect data quality [90–92].”
From Not so terrifying after all? A set of failed replications of the mortality salience effects of Terror Management Theory (2023) · cites this paper as [90]
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Identifying careless responses in survey data.
Meade, A. W., & Craig, S. B. (2012) · Psychological Methods · doi:10.1037/a0028085 · Cited by 3,865
Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems
Mark, G., Fussell, S. R., Lampe, C., Schraefel, M., Hourcade, J., Appert, C., & Wigdor, D. J. (2017) · International Conference on Human Factors in Computing Systems · doi:10.1145/3025453 · Cited by 2,222
Hauser, D. J., & Schwarz, N. (2016) · Behavior Research Methods · doi:10.3758/s13428-015-0578-z · Cited by 1,739
The HEXACO-60: A Short Measure of the Major Dimensions of Personality
Ashton, M. C., & Lee, K. (2009) · Journal of Personality Assessment · doi:10.1080/00223890902935878 · Cited by 1,709
Methods for the detection of carelessly invalid responses in survey data
Curran, P. G. (2016) · Journal of Experimental Social Psychology · doi:10.1016/j.jesp.2015.07.006 · Cited by 1,356
Chandler, J., Mueller, P., & Paolacci, G. (2014) · Behavior Research Methods · doi:10.3758/s13428-013-0365-7 · Cited by 950
An Evaluation of Amazon’s Mechanical Turk, Its Rapid Rise, and Its Effective Use
Buhrmester, M. D., Talaifar, S., & Gosling, S. D. (2018) · Perspectives on Psychological Science · doi:10.1177/1745691617706516 · Cited by 815
SOME EXPERIMENTAL RESULTS IN THE CORRELATION OF MENTAL ABILITIES 1
Brown, W. E. (1910) · British Journal of Psychology 1904-1920 · doi:10.1111/j.2044-8295.1910.tb00207.x · Cited by 733
Validity and Mechanical Turk: An assessment of exclusion methods and interactive experiments
Thomas, K. A., & Clifford, S. (2017) · Computers in Human Behavior · doi:10.1016/j.chb.2017.08.038 · Cited by 625
Psychometric Properties of the HEXACO-100
Lee, K., & Ashton, M. C. (2016) · Assessment · doi:10.1177/1073191116659134 · Cited by 580
Research works printed but not linked: 1
- Diedenhofen, 2016, cocron: A web interfae and R package for the statistical comparison of Cronbach's alpha coefficients, International Journal of Internet Science, 11, 51
Cited by
Sorted by citations
Items 101–126 of 126
Benevolent God Concepts and Past Kind Behaviors Induce Generosity Toward Outgroups
Lee, Y.-E., Payir, A., & Heiphetz, L. (2023) · Social Cognition · doi:10.1521/soco.2023.41.4.321
Are conspiracy theorists inaccurate, unmotivated to be accurate, or both?: A latent class analysis
Bowes, S. M., & Fazio, L. K. (2023) · Routledge Open Research · doi:10.12688/routledgeopenres.17928.1
Religious Experiences, Expectations of Discrimination, and Distress Among Biracial Christians
Senger, S., & Vazquez, V. E. (2024) · Journal of Psychology and Theology · doi:10.1177/00916471241231914 · Cited by 1
See the Words Through My Eyes: The Role of Personality Traits in Abusive Language DetectionPreprint
Yao, T., Binnewies, S., Foo, E., & Alavi, M. (2024) · SSRN Electronic Journal · doi:10.2139/ssrn.4880454
Kamps, J. C. C., Birk, M. V., Vriens, C., Wallner, G., & Bernhaupt, R. (2024) · Mensch und Computer (MuC) · doi:10.1145/3670653.3670675
Minimum or Living Wage? Framing Effects on Preferences and Expectations
Schaitberger, T. (2024) · British Journal of Industrial Relations · doi:10.1111/bjir.12847
MTURK: Utility in Gerontological Behavioral Health Research
Pudur, R., & Mpofu, E. (2024) · Springer eBooks · doi:10.1007/978-981-92-1288-0_135
The resource elasticity of controlPreprint
Solomyak, L., Emanuel, A., & Eldar, E. (2024) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2024.12.16.628674
The resource elasticity of controlPreprint
Solomyak, L., Emanuel, A., & Eldar, E. (2025) · eLife · doi:10.7554/elife.105507.1 · Cited by 1
The resource elasticity of controlPreprint
Solomyak, L., Emanuel, A., & Eldar, E. (2025) · eLife · doi:10.7554/elife.105507
Bursov, K., & Slioussar, N. (2025) · Discourse Processes · doi:10.1080/0163853x.2025.2478800
The resource elasticity of controlPreprint
Solomyak, L., Emanuel, A., & Eldar, E. (2025) · eLife · doi:10.7554/elife.105507.2
Fruhbauerova, M., Rogers, M. L., & Cerel, J. (2025) · Suicide and Life-Threatening Behavior · doi:10.1111/sltb.70048 · Cited by 1
The resource elasticity of controlPreprint
Solomyak, L., Emanuel, A., & Eldar, E. (2025) · eLife · doi:10.7554/elife.105507.3
Privacy over health? Understanding discontinuous disclosure in mobile health applications
Wintmölle, F., Meier, M., & Maier, C. (2025) · Information & Management · doi:10.1016/j.im.2025.104277 · Cited by 1
Self/spouse agreement, similarity, and assumed similarity in the HEXACO personality factors
Lee, K., Ashton, M. C., & de Vries, R. E. (2026) · Journal of Research in Personality · doi:10.1016/j.jrp.2026.104718
Gómez, C., Jia, M. Y., Cho, S. M., Huang, C., & Unberath, M. (2026) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3772318.3791660
Wang, B., Andrews, W., & de Vries, R. E. (2026) · European Journal of Work and Organizational Psychology · doi:10.1080/1359432x.2026.2659037
Dispositional insight: Its relations with HEXACO personality and cognitive abilityPreprint
Kock, F. S. D., de Vries, R. E., & Barends, A. J. (2021) · OSF Preprints (OSF Preprints)
Self-citationJenert, T., Gördes, J., Sureth-Sloane, C., & Sievers, S. (2026) · SSRN Electronic Journal · doi:10.2139/ssrn.7223700
Valence bias arises from both positive and negative responses to ambiguous stimuli
Pierce, J. E., Harp, N. R., Gross, J. J., & Neta, M. (2026) · Frontiers in Psychology · doi:10.3389/fpsyg.2026.1832043
Fabricius, A., Yen, J., O’Doherty, K. C., & Goldenberg, M. J. (2026) · Perspectives on Psychological Science · doi:10.1177/17456916261471511
Zhafira, N. H., Qadir, A. H. M. A., & Yusnaidi, Y. (2026) · International Journal of Productivity and Performance Management · doi:10.1108/ijppm-01-2026-0033
Kim, J. H., Ntinda, K., Mora, E., Salinas, A., Rangel, G., Lopez, J. M., Livingston, T., & Lee, D. H. (2026) · Journal of Rehabilitation Counseling · doi:10.46787/jorc.v1i1.5155
Personality and Differences in Situation SelectionPreprint
Cupri, L. (., Barends, A. J., & de Vries, R. E. (2026) · SSRN Electronic Journal · doi:10.2139/ssrn.7578302
Self-citationReply to Gillan et al.: What should be the null hypothesis in computational psychiatry?
Sarna, N., Dar, R., & Mazor, M. (2026) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.2628596123
Metadata
- Authors
- Barends, A. J., & de Vries, R. E.
- Affiliations
- Vrije Universiteit Amsterdam (NL)
- Corresponding author
- Barends, Ard J.
- Venue
- Personality and Individual Differences
- Publisher
- Elsevier BV
- Published
- 2019-06
- Volume
- 143
- Pages
- 84-89
- ISSN
- 0191-8869 (ISSN-L)
- OpenAlex
- W2915179069
- Cited by
- 124
- References
- 27
- Citations by year
- 2026: 12 · 2025: 20 · 2024: 18 · 2023: 18 · 2022: 24 · 2021: 20 · 2020: 9 · 2019: 2
- FWCI
- 14.17
- Type
- journal article
- Language
- en
- Open access
- bronze
- doi.org
- Locations
- Personality and Individual Differences (publishedVersion)
- VU Research Portal (publishedVersion, other-oa)
- University of Twente Research Information (submittedVersion, other-oa)
- Data Archiving and Networked Services (DANS) (submittedVersion, other-oa)
- Funders
- VU University
- Topics
- Physical Sciences › Computer Science › Computer Science Applications › Mobile Crowdsensing and Crowdsourcing
- Social Sciences › Decision Sciences › Management Science and Operations Research › Psychometric Methodologies and Testing
- Social Sciences › Sociology and Political Science › Survey Methodology and Nonresponse
- Keywords
- Amazon Mechanical Turk, data quality, exclusion criteria, personality assessment
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
