The DOI matches its Crossref record; 17 of the 18 references it cites were found in a registry or an index.
Reputation as a sufficient condition for data quality on Amazon Mechanical Turk
Open accessAbstract
Data quality is one of the major concerns of using crowdsourcing websites such as Amazon Mechanical Turk (MTurk) to recruit participants for online behavioral studies. We compared two methods for ensuring data quality on MTurk: attention check questions (ACQs) and restricting participation to MTurk workers with high reputation (above 95% approval ratings). In Experiment 1, we found that high-reputation workers rarely failed ACQs and provided higher-quality data than did low-reputation workers; ACQs improved data quality only for low-reputation workers, and only in some cases. Experiment 2 corroborated these findings and also showed that more productive high-reputation workers produce the highest-quality data. We concluded that sampling high-reputation workers can ensure high-quality data without having to resort to using ACQs, which may lead to selection bias if participants who fail ACQs are excluded post-hoc.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source says what the claim attributes to it.
In the citing paper
“Data obtained from MTurk has been demonstrated to be valid and reliable when appropriate selection criteria and attention checks are used (Casler, Bickel, & Hackett, 2013; Peer, Vosgerau, & Acquisti, 2014), as was the case in this study.”
From The development and evaluation of a brief form of the Normative Male Alexithymia Scale (NMAS-BF). (2019) · cites this paper as Peer, Vosgerau, & Acquisti, 2014
The cited source says what the claim attributes to it.
In the citing paper
“Most of the sites we reviewed have supervision and reputation mechanisms designed to measure the quality of submitted work, and to allow researchers to invite workers with high reputation (similar to MTurk's”
From Beyond the Turk: Alternative platforms for crowdsourcing behavioral research (2017) · cites this paper as Peer et al., 2014
In the citing paper
“Amazon Mechanical Turk is an online sample recruiting platform that, although not nationally representative, yields high data quality through the use of attention checks 44 and worker reputation scores 45 .”
From Understanding, explaining, and utilizing medical artificial intelligence (2021) · cites this paper as [45]
In the citing paper
“Following prior research, we selected participants with an approval rating above 95% on Amazon Mechanical Turk 45 .”
From Understanding, explaining, and utilizing medical artificial intelligence (2021) · cites this paper as [45]
In the citing paper
“which showed that ACQs have low diagnostic ability when data quality is already high.”
From Beyond the Turk: Alternative platforms for crowdsourcing behavioral research (2017) · cites this paper as Peer et al., (2014)
In the citing paper
“they are reliable and validated scales, and b) they have been previously used with success to measure data quality on MTurk (Peer et al., 2014).”
From Beyond the Turk: Alternative platforms for crowdsourcing behavioral research (2017) · cites this paper as Peer et al., 2014
In the citing paper
“they are reliable and validated scales, and b) they have been previously used with success to measure data quality on MTurk (Peer et al., 2014).”
From Beyond the Turk: Alternative platforms for crowdsourcing behavioral research (2017) · cites this paper as Peer et al., 2014
In the citing paper
“Using two attention-check questions (Peer et al., 2014), we checked whether participants read and paid attention to our instructions.”
From Beyond the Turk: Alternative platforms for crowdsourcing behavioral research (2017) · cites this paper as Peer et al., 2014
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Tversky, A., & Kahneman, D. (1974) · Science · doi:10.1126/science.185.4157.1124 · Cited by 28,810
Judgment under Uncertainty: Heuristics and Biases
Tversky, A., & Kahneman, D. (1975) · Utility, Probability, and Human Decision Making · doi:10.1007/978-94-010-1834-0_8 · Cited by 22,650
Amazon's Mechanical Turk: A New Source of Inexpensive, Yet High-Quality, Data?
Buhrmester, M., Kwang, T., & Gosling, S. D. (2011) · Perspectives on Psychological Science · doi:10.1177/1745691610393980 · Cited by 9,996
A very brief measure of the Big-Five personality domains
Gosling, S. D., Rentfrow, P. J., & Swann, W. B. (2003) · Journal of Research in Personality · doi:10.1016/s0092-6566(03)00046-1 · Cited by 8,307
Running experiments on Amazon Mechanical Turk
Paolacci, G., Chandler, J., & Ipeirotis, P. G. (2010) · Judgment and Decision Making · doi:10.1017/s1930297500002205 · Cited by 3,767
Instructional manipulation checks: Detecting satisficing to increase statistical power
Oppenheimer, D. M., Meyvis, T., & Davidenko, N. (2009) · Journal of Experimental Social Psychology · doi:10.1016/j.jesp.2009.03.009 · Cited by 3,493
Robins, R. W., Hendin, H. M., & Trzesniewski, K. H. (2001) · Personality and Social Psychology Bulletin · doi:10.1177/0146167201272002 · Cited by 3,041
The Efficient Assessment of Need for Cognition
Cacioppo, J. T., Petty, R. E., & Feng Kao, C. (1984) · Journal of Personality Assessment · doi:10.1207/s15327752jpa4803_13 · Cited by 2,913
Data collection in a flat world: the strengths and weaknesses of Mechanical Turk samples
Goodman, J. K., Cryder, C. E., & Cheema, A. (2013) · Journal of Behavioral Decision Making · doi:10.1002/bdm.1753 · Cited by 2,242
Rosenberg, M. (2011) · PsycTESTS Dataset · doi:10.1037/t01038-000 · Cited by 1,226
Cited by
Sorted by citations
Items 901–1,000 of 1,000
Ma, H., Miller, C. H., & Wong, N. C. H. (2020) · Health Communication · doi:10.1080/10410236.2020.1712038 · Cited by 9
Hindsight bias in metamemory: outcome knowledge influences the recollection of judgments of learning
Zimdahl, M. F., & Undorf, M. (2021) · Memory · doi:10.1080/09658211.2021.1919144 · Cited by 11
Rzeszutek, M. J., DeFulio, A., & Brown, H. D. (2021) · The Psychological Record · doi:10.1007/s40732-021-00489-4 · Cited by 9
Do pledges lead to more volunteering? An experimental study
Capra, C. M., Jiang, B., & Su, Y. (2021) · Economic Inquiry · doi:10.1111/ecin.13022 · Cited by 8
Tell Me What I Need To Know: Consumers’ Desire for Information Transparency in Self-Driving Vehicles
Huff, E. W., Grady, S. D., & Brinkley, J. (2021) · Proceedings of the Human Factors and Ergonomics Society Annual Meeting · doi:10.1177/1071181321651240 · Cited by 9
Xia, H. (2022) · Hawaii International Conference on System Sciences (HICSS) · doi:10.24251/hicss.2022.548 · Cited by 9
Harrison, V. S., Vafeiadis, M., & Bober, J. (2022) · Sustainability · doi:10.3390/su14063139 · Cited by 10
Kuo, Y.-H., Wu, P.-C., & Ahn, S. Y. (2022) · Cross Cultural & Strategic Management · doi:10.1108/ccsm-01-2022-0005 · Cited by 9
U.S. Public Support for the U.S.-NATO Alliance
Lee, K. S., & Goidel, K. (2022) · International Journal of Public Opinion Research · doi:10.1093/ijpor/edac011 · Cited by 10
Harrison, V. S., Vafeiadis, M., Diddi, P., Buckley, C., & Dardis, F. E. (2022) · Public Relations Review · doi:10.1016/j.pubrev.2022.102184 · Cited by 12
Rogers, J. M., Smith, K. E., Schriefer, D., & Epstein, D. H. (2022) · Substance Abuse Research and Treatment · doi:10.1177/11782218221123977 · Cited by 9
Social justice reasoning when students learn about social issues using multiple texts
List, A. (2023) · Discourse Processes · doi:10.1080/0163853x.2023.2197692 · Cited by 9
Dishonest individuals request more frequent mate retention from friends
Pham, M. N., Barbaro, N., Noser, A. E., Sela, Y., Shackelford, T. K., Zeigler‐Hill, V., Weege, B., & Fink, B. (2017) · Personal Relationships · doi:10.1111/pere.12170 · Cited by 9
Learning from crowds with active learning and self-healing
Shu, Z., Sheng, V. S., & Li, J. (2017) · Neural Computing and Applications · doi:10.1007/s00521-017-2878-y · Cited by 9
Retracted: Suicide Prediction in Twitter Data using Mining Techniques: A Survey
Kumar, E. R., & Rao, A. K. V. S. N. R. (2019) · International Conference on Intelligent Sustainable Systems (ICISS) · doi:10.1109/iss1.2019.8907987 · Cited by 9
RetractedAutomatically Extracting Subroutine Summary Descriptions from Unstructured Comments
Eberhart, Z., LeClair, A., & McMillan, C. (2020) · IEEE International Conference on Software Analysis, Evolution and Reengineering (SANER) · doi:10.1109/saner48275.2020.9054789 · Cited by 9
Aharoni, E., Kleider‐Offutt, H. M., Brosnan, S. F., & Fernandes, S. (2020) · PLoS ONE · doi:10.1371/journal.pone.0236764 · Cited by 9
Wamser‐Nanney, R. A., & Sager, J. C. (2020) · Journal of Trauma & Dissociation · doi:10.1080/15299732.2020.1787295 · Cited by 10
Actual versus perceived infection rates of COVID-19: Impact on distress, behavior and disability
Schmidt, N. B., Martin, A. D., Allan, N. P., Mathes, B. M., Saulnier, K. G., & March, D. S. (2021) · Journal of Psychiatric Research · doi:10.1016/j.jpsychires.2021.03.061 · Cited by 9
Abstract “why” Thoughts About Success Lead to Greater Positive Generalization in Sport Participants
Lier, J. V., Moulds, M. L., & Raes, F. (2015) · Frontiers in Psychology · doi:10.3389/fpsyg.2015.01783 · Cited by 9
How U.S. Voters Elect Prosecutors: Evidence from a Conjoint Experiment
Sung, Y.-H. (2022) · Political Research Quarterly · doi:10.1177/10659129221136852 · Cited by 8
Smith, C. W., & Kreitzer, R. (2023) · The Journal of Politics · doi:10.1086/726956 · Cited by 8
How does personalized feedback on carbon emissions impact intended climate action?
Luo, Y., Hanson-Wright, B., Dowlatabadi, H., & Zhao, J. (2023) · Environment Development and Sustainability · doi:10.1007/s10668-023-04031-0 · Cited by 8
Exploring the use of ICTs as a tool for job crafting
Handke, L., Boeck, G. D., & Parker, S. K. (2024) · Journal of Vocational Behavior · doi:10.1016/j.jvb.2024.104081 · Cited by 10
One Size Does Not Fit All: Mechanisms of Employees’ Acceptance of Robotic Lower-Level Managers
Wolf, F. D., & Stock‐Homburg, R. (2025) · Group & Organization Management · doi:10.1177/10596011251313568 · Cited by 10
Park, H., & Minton, E. A. (2025) · Psychology and Marketing · doi:10.1002/mar.70030 · Cited by 8
The Use and Usefulness of Attention Checks in Behavioral Research
Perfecto, H., & O'Donnell, M. P. (2025) · Journal of Consumer Research · doi:10.1093/jcr/ucaf058 · Cited by 8
The Cognitive Attentional Syndrome is Associated With Sleep Difficulties in a Community Sample
Fergus, T. A., & Scullin, M. K. (2016) · Behavioral Sleep Medicine · doi:10.1080/15402002.2016.1141771 · Cited by 8
Garibaldi, P. M., Abel, M. R., Snow, R. L., & Schleider, J. L. (2019) · Child & Youth Care Forum · doi:10.1007/s10566-019-09523-7 · Cited by 9
The organizational framing effect on consumer evaluations of corporate donations
Septianto, F., Northey, G., & Weaven, S. K. (2021) · European Journal of Marketing · doi:10.1108/ejm-06-2020-0465 · Cited by 8
Slogans With Negations’ Effect on Sustainable Luxury Brand
Septianto, F., Kemper, J. A., & Northey, G. (2021) · Australasian Marketing Journal (AMJ) · doi:10.1177/18393349211046633 · Cited by 8
Cohen, J. R., Krishnamoorthy, G., Peytcheva, M., & Wright, A. M. (2022) · Auditing A Journal of Practice & Theory · doi:10.2308/ajpt-19-071 · Cited by 8
Word-of-mouth effectiveness in new fan acquisition: a mediating role of resident prototypicality
Asada, A., & Ko, Y. J. (2022) · Sport Management Review · doi:10.1080/14413523.2021.2018838 · Cited by 8
Playing Drinking Games as a Typical Form of Prepartying among Young Adults
Ford, K., Zamboanga, B. L., & Ham, L. S. (2022) · Substance Use & Misuse · doi:10.1080/10826084.2022.2046095 · Cited by 8
Will-powered: Synchronic regulation is the difference maker for self-control
Irving, Z. C., Bridges, J., Glasser, A., Bermúdez, J. P., & Sripada, C. (2022) · Cognition · doi:10.1016/j.cognition.2022.105154 · Cited by 8
Chou, S. Y., & Ramser, C. (2022) · Personnel Review · doi:10.1108/pr-11-2021-0799 · Cited by 10
Nesbitt, A. E., Pila, E., Crocker, P. R. E., & Sabiston, C. M. (2023) · Self and Identity · doi:10.1080/15298868.2023.2184858 · Cited by 12
Evidence-Based Communication to Increase Melanoma Knowledge and Skin Checks
Nadratowski, A., Shoots‐Reinhard, B. L., Shafer, A., Detweiler-Bedell, J. B., Detweiler-Bedell, B. T., Leachman, S. A., & Peters, E. M. (2023) · JID Innovations · doi:10.1016/j.xjidi.2023.100253 · Cited by 8
Shaheen, R., Aljarah, A., Ibrahim, B., Hazzam, J., & Ghasemi, M. (2024) · British Food Journal · doi:10.1108/bfj-12-2023-1118 · Cited by 8
“All You Need Is Love” a Social Network Approach to Understanding Attachment Networks in Adulthood
Tian, J., & Freeman, H. (2024) · Behavioral Sciences · doi:10.3390/bs14080647 · Cited by 8
Bardeen, J. R., Gorday, J. Y., & Clauss, K. E. (2021) · Psychological Reports · doi:10.1177/00332941211025260 · Cited by 8
Hampton, K. N. (2021) · Social Networks · doi:10.1016/j.socnet.2021.04.006 · Cited by 8
Witnessed Incivility and Perceptions of Patients and Visitors in Hospitals
Vargas, E. A., Mahalingam, R., & Marshall, R. A. (2021) · Journal of Patient Experience · doi:10.1177/23743735211028092 · Cited by 8
Herrington, L. M. (2021) · Religions · doi:10.3390/rel12100829 · Cited by 8
Ali, F., Çobanoğlu, C., Liu, S., Akhtar, N., & Ryu, K. (2022) · Tourism · doi:10.37741/t.70.3.5 · Cited by 8
Rougier, M., Houwer, J. D., Richetin, J., Hughes, S., & Perugini, M. (2023) · Collabra Psychology · doi:10.1525/collabra.84560 · Cited by 11
Lee, R. S. C., Albertella, L., Christensen, E., Suo, C., Segrave, R. A., Brydevall, M., Kirkham, R., Liu, C., Fontenelle, L. F., Chamberlain, S. R., et al. (2023) · Journal of Medical Internet Research · doi:10.2196/44414 · Cited by 8
Digital Communication, Family Identity, and Markers of Emerging Adulthood
LeBouef, S., & Dworkin, J. (2023) · Journal of Media Psychology Theories Methods and Applications · doi:10.1027/1864-1105/a000391 · Cited by 8
Embellishments Revisited: Perceptions of Embellished Visualisations Through the Viewer's Lens
Alebri, M., Costanza, E., Panagiotidou, G., & Brumby, D. P. (2023) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2023.3326914 · Cited by 8
Bridging the Utilitarian-Hedonic Divide in Crowdsourcing Applications
Melenhorst, M., Novak, J., Micheel, I., Larson, M., & Böckle, M. (2015) · doi:10.1145/2810188.2810191 · Cited by 8
Nieroda, M., Keeling, K. A., & Keeling, D. I. (2015) · The Journal of Marketing Theory and Practice · doi:10.1080/10696679.2015.980174 · Cited by 8
Self-other asymmetries in the perceived validity of the Implicit Association Test.
Mendonça, C., Mata, A., & Vohs, K. D. (2019) · Journal of Experimental Psychology Applied · doi:10.1037/xap0000214 · Cited by 8
Facilitating Episodic Simulation in Anxiety: Role of Sensory Scaffolding and Scenario Modality
Ji, J., Meyer, M., & Teachman, B. (2020) · International Journal of Cognitive Therapy · doi:10.1007/s41811-020-00070-x · Cited by 7
The Importance of Perceived Body-Inclusiveness among Physically Active Women in Larger Bodies
Cunningham, G. B., & Pickett, A. C. (2020) · Sex Roles · doi:10.1007/s11199-020-01139-9 · Cited by 13
Revisiting and extending a response latency measure of inclusion of the other in the self
Zickfeld, J., & Schubert, T. W. (2016) · Comprehensive Results in Social Psychology · doi:10.1080/23743603.2017.1298356 · Cited by 10
Faith in Trump, Moral Foundations, and Social Distancing Defiance During the Coronavirus PandemicPreprint
Graham, A., Cullen, F., Pickett, J. T., Jonson, C. L., Haner, M., & Sloan, M. M. (2020) · SSRN Electronic Journal · doi:10.2139/ssrn.3586626 · Cited by 8
Holgersen, H., Jia, Z., & Svenkerud, S. (2020) · SSRN Electronic Journal · doi:10.2139/ssrn.3580674 · Cited by 8
Sirota, M., & Juanchich, M. (2018) · PsyArXiv (OSF Preprints) · doi:10.31234/osf.io/rvh3y · Cited by 8
Péer, E., Rothschild, D. M., & Gordon, A. (2023) · doi:10.31234/osf.io/buzwn · Cited by 8
Ogden, S. N., Leskinen, E. A., Sarma, E. A., Wainwright, J. V., & Rendle, K. A. S. (2021) · Cancer Prevention Research · doi:10.1158/1940-6207.capr-20-0622 · Cited by 12
What’s in a Label? Public Use and Perceptions of Labeling Alternatives in Criminology
Denver, M., Ballou, A., & DeWitt, S. E. (2024) · Justice Quarterly · doi:10.1080/07418825.2024.2332373 · Cited by 9
Lee, J., & Cheong, H. J. (2024) · KOME · doi:10.17646/kome.of.10 · Cited by 13
O’Brien, K. E., Pohlman, R., & Roach, K. N. (2024) · International Journal of Productivity and Performance Management · doi:10.1108/ijppm-03-2023-0135 · Cited by 7
Yun, J., Klaus, P., Hong, E., Lee, S., & Park, J. (2024) · International Journal of Tourism Research · doi:10.1002/jtr.2789 · Cited by 9
The Sociable and the Deviant: A Latent Profile Analysis of HEXACO and the Dark Triad
She, M. H. C., Ronay, R., & Hartog, D. N. D. (2024) · Journal of Business Ethics · doi:10.1007/s10551-024-05835-4 · Cited by 8
A path forward on online misinformation mitigation based on current user behavior
King, C., Phillips, S. C., & Carley, K. M. (2025) · Scientific Reports · doi:10.1038/s41598-025-93100-7 · Cited by 8
Andrade-Valbuena, N. A., & Santos, M. A. D. (2026) · BMC Psychology · doi:10.1186/s40359-025-03940-1 · Cited by 7
Exum, A. C., Templin, J. L., & Fazzino, T. L. (2022) · Eating Behaviors · doi:10.1016/j.eatbeh.2022.101600 · Cited by 7
Can my life get better? Examining lay theories for life satisfaction among younger and older adults
Busseri, M. A., & Samani, M. N. (2022) · The Journal of Positive Psychology · doi:10.1080/17439760.2022.2095296 · Cited by 7
Improving Performance Feedback Perceptions Through Motivating Language Use
Hanke, D., Alikaj, A., & Prity, P. (2022) · Studies in Business and Economics · doi:10.2478/sbe-2022-0029 · Cited by 7
More than “male” and “female”: the role of gender identity in white-collar offending intentions
Reed, S. M., & Rorie, M. L. (2023) · Crime Law and Social Change · doi:10.1007/s10611-023-10074-1 · Cited by 8
Does delayed gratification come at the cost of work-life conflict and burnout?
Shields, B., & Chen, C. P. (2023) · Current Psychology · doi:10.1007/s12144-023-04246-4 · Cited by 7
Jacobson, M. R., & Azzam, T. (2016) · Evaluation Review · doi:10.1177/0193841x16657728 · Cited by 8
Participant Crosstalk: Issues When Using the Mechanical Turk
Edlund, J. E., Lange, K. M., Sevene, A. M., Umansky, J., Beck, C. D., & Bell, D. J. (2017) · The Quantitative Methods for Psychology · doi:10.20982/tqmp.13.3.p174 · Cited by 7
Examining attitudes on pay for low level workers: do consumers care?
Moran, N. (2019) · Journal of Consumer Marketing · doi:10.1108/jcm-03-2018-2593 · Cited by 7
“Talking” as a Romantic Interaction: Is There Consensus?
Powell, D. N., Freedman, G., Jensen, K., & Preston, V. (2021) · Journal of Couple & Relationship Therapy · doi:10.1080/15332691.2020.1867684 · Cited by 7
Minority stress and sexual minorities of colour: the mediating role of mastery
Marshall, R. A., Vargas, E. A., & Mahalingam, R. (2021) · Psychology and Sexuality · doi:10.1080/19419899.2021.1903535 · Cited by 8
Zeev‐Wolf, M., & Mentovich, A. (2021) · Regulation & Governance · doi:10.1111/rego.12404 · Cited by 7
White, A. A., King, A., D’Addario, A. E., Brigham, K. B., Dintzis, S. M., Fay, E., Gallagher, T. H., & Mazor, K. M. (2022) · JMIR Medical Education · doi:10.2196/30988 · Cited by 7
Graham, A., Pickett, J. T., Cullen, F. T., Jonson, C. L., Haner, M., & Sloan, M. M. (2022) · Polity · doi:10.1086/722762 · Cited by 8
Lac, A. (2023) · Journal of Psychopathology and Behavioral Assessment · doi:10.1007/s10862-023-10033-z · Cited by 7
To pay or not to pay? handling crowdsourced participants who drop out from a research study
Benbunan‐Fich, R. (2023) · Ethics and Information Technology · doi:10.1007/s10676-023-09708-8 · Cited by 7
Expectations about how alcohol consumption influences gambling
Horn, T. L., Lerma, M., Pfund, R. A., & Whelan, J. P. (2023) · International Gambling Studies · doi:10.1080/14459795.2023.2224858 · Cited by 7
Testing the reciprocal relationship between depressive symptoms and insomnia
Zhou, R. J., Bailey, B., & Strunk, D. R. (2024) · Journal of Clinical Psychology · doi:10.1002/jclp.23670 · Cited by 7
Using mental computation training to improve complex mathematical performance
Liu, A. S., Kallai, A. Y., Schunn, C. D., & Fiez, J. A. (2015) · Instructional Science · doi:10.1007/s11251-015-9350-0 · Cited by 7
Hitting the Nail on the Head! Insight into Consumer Assessment of Sustainability-Related Innovations
Carvalho, S. W., Silvestre, B. O., & Cunningham, P. H. (2016) · Long Range Planning · doi:10.1016/j.lrp.2016.08.001 · Cited by 7
Understanding Crime Control Theater
Yelderman, L. A., Miller, M. K., Forsythe, S., & Sicafuse, L. L. (2018) · Criminal Justice Review · doi:10.1177/0734016817710695 · Cited by 6
Development and Validation of the Information Systems Creative-Self-Efficacy Scale
Payne, K. C., Keith, M. J., Babb, J. S., & Spruill, A. N. (2018) · Hawaii International Conference on System Sciences (HICSS) · doi:10.24251/hicss.2018.017 · Cited by 7
CEO change and the perception of enhanced product: an implicit theory perspective
Lin, C.-W. W., Rai, D., & Tran, T. P. (2019) · Journal of Consumer Marketing · doi:10.1108/jcm-10-2017-2384 · Cited by 7
Roche, S. P. (2019) · Policing An International Journal · doi:10.1108/pijpsm-12-2018-0192 · Cited by 7
Flowers, C. S., Orsten-Hooge, K. D., Jannuzi, B. G. L., & Peterson, M. A. (2020) · PLoS ONE · doi:10.1371/journal.pone.0224471 · Cited by 7
Triki, A., Arnold, V., & Sutton, S. G. (2015) · Emerald Group Publishing Limited eBooks · doi:10.1108/s1475-148820150000018001 · Cited by 7
Lac, A., & Donaldson, C. D. (2018) · Psychology of Addictive Behaviors · doi:10.1037/adb0000343 · Cited by 8
Zimbres, T. M., Bell, R. A., & Taylor, L. D. (2019) · Social Psychiatry and Psychiatric Epidemiology · doi:10.1007/s00127-019-01788-6 · Cited by 7
The Development of Job-Based Psychological Ownership
Bullock, R. B. (2015) · ProQuest Demo Repository · Cited by 7
Faith in Trump, Moral Foundations, and Social Distancing Defiance During the Coronavirus PandemicPreprint
Graham, A., Cullen, F. T., Pickett, J. T., Jonson, C. L., Haner, M., & Sloan, M. M. (2020) · doi:10.31235/osf.io/fudzq · Cited by 12
Frosch, C. A., Fagan, M. A., Middlemiss, W., Kim, J. G., & Sjolseth, S. R. (2023) · Australian Journal of Psychology · doi:10.1080/00049530.2023.2205537 · Cited by 6
Tsai, M. (2024) · International Journal of Conflict Management · doi:10.1108/ijcma-10-2023-0212 · Cited by 6
Kim, M. J., Mao, L. L., Seidler, T. L., & Barnes, J. C. (2024) · European Sport Management Quarterly · doi:10.1080/16184742.2024.2329157 · Cited by 7
Hit the Road, Cart: A Study on Affect and Online Shopping Cart Abandonment
Silva, P. A. L. D. S., Fortes, N., Bairrada, C. M., & Coelho, F. (2025) · International Journal of Consumer Studies · doi:10.1111/ijcs.70060 · Cited by 7
Metadata
- Authors
- Peer, E., Vosgerau, J., & Acquisti, A.
- Affiliations
- Tilburg University (NL)
- Carnegie Mellon University (US)
- Venue
- Behavior Research Methods
- Published
- 2013-12-20
- Volume
- 46
- Issue
- 4
- Pages
- 1023-1031
- ISSN
- 1554-351X (ISSN-L)
- 1554-3528
- OpenAlex
- W2105753174
- Cited by
- 1,618
- References
- 18
- Citations by year
- 2026: 68 · 2025: 96 · 2024: 128 · 2023: 167 · 2022: 175 · 2021: 212 · 2020: 210 · 2019: 147 · 2018: 119 · 2017: 132 · 2016: 91 · 2015: 49 · 2014: 17 · 2013: 1
- FWCI
- 79.80
- Type
- journal article
- Language
- en
- Open access
- bronze
- doi.org
- Locations
- Behavior Research Methods (publishedVersion)
- Research portal (Tilburg University) (publishedVersion)
- PubMed (publishedVersion)
- Data Archiving and Networked Services (DANS) (submittedVersion)
- SSRN Electronic Journal (submittedVersion)
- Figshare (submittedVersion, cc-by)
- Archivio istituzionale della Ricerca - Bocconi (submittedVersion)
- KiltHub Repository
- Topics
- Physical Sciences › Computer Science › Computer Science Applications › Mobile Crowdsensing and Crowdsourcing
- Social Sciences › Sociology and Political Science › Survey Methodology and Nonresponse
- Social Sciences › Decision Sciences › Management Science and Operations Research › Psychometric Methodologies and Testing
- Keywords
- data quality, Amazon Mechanical Turk, worker reputation, crowdsourcing, selection bias, labor productivity, participant recruitment
- MeSH terms
- Data Collection, Humans, Research Design, Patient Selection, Internet, Behavioral Research, Crowdsourcing
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
