The DOI matches its Crossref record; 17 of the 18 references it cites were found in a registry or an index.
Reputation as a sufficient condition for data quality on Amazon Mechanical Turk
Open accessAbstract
Data quality is one of the major concerns of using crowdsourcing websites such as Amazon Mechanical Turk (MTurk) to recruit participants for online behavioral studies. We compared two methods for ensuring data quality on MTurk: attention check questions (ACQs) and restricting participation to MTurk workers with high reputation (above 95% approval ratings). In Experiment 1, we found that high-reputation workers rarely failed ACQs and provided higher-quality data than did low-reputation workers; ACQs improved data quality only for low-reputation workers, and only in some cases. Experiment 2 corroborated these findings and also showed that more productive high-reputation workers produce the highest-quality data. We concluded that sampling high-reputation workers can ensure high-quality data without having to resort to using ACQs, which may lead to selection bias if participants who fail ACQs are excluded post-hoc.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source says what the claim attributes to it.
In the citing paper
“Data obtained from MTurk has been demonstrated to be valid and reliable when appropriate selection criteria and attention checks are used (Casler, Bickel, & Hackett, 2013; Peer, Vosgerau, & Acquisti, 2014), as was the case in this study.”
From The development and evaluation of a brief form of the Normative Male Alexithymia Scale (NMAS-BF). (2019) · cites this paper as Peer, Vosgerau, & Acquisti, 2014
In the citing paper
“Amazon Mechanical Turk is an online sample recruiting platform that, although not nationally representative, yields high data quality through the use of attention checks 44 and worker reputation scores 45 .”
From Understanding, explaining, and utilizing medical artificial intelligence (2021) · cites this paper as [45]
In the citing paper
“Following prior research, we selected participants with an approval rating above 95% on Amazon Mechanical Turk 45 .”
From Understanding, explaining, and utilizing medical artificial intelligence (2021) · cites this paper as [45]
In the citing paper
“Most of the sites we reviewed have supervision and reputation mechanisms designed to measure the quality of submitted work, and to allow researchers to invite workers with high reputation (similar to MTurk's”
From Beyond the Turk: Alternative platforms for crowdsourcing behavioral research (2017) · cites this paper as Peer et al., 2014
In the citing paper
“which showed that ACQs have low diagnostic ability when data quality is already high.”
From Beyond the Turk: Alternative platforms for crowdsourcing behavioral research (2017) · cites this paper as Peer et al., (2014)
In the citing paper
“they are reliable and validated scales, and b) they have been previously used with success to measure data quality on MTurk (Peer et al., 2014).”
From Beyond the Turk: Alternative platforms for crowdsourcing behavioral research (2017) · cites this paper as Peer et al., 2014
In the citing paper
“they are reliable and validated scales, and b) they have been previously used with success to measure data quality on MTurk (Peer et al., 2014).”
From Beyond the Turk: Alternative platforms for crowdsourcing behavioral research (2017) · cites this paper as Peer et al., 2014
In the citing paper
“Using two attention-check questions (Peer et al., 2014), we checked whether participants read and paid attention to our instructions.”
From Beyond the Turk: Alternative platforms for crowdsourcing behavioral research (2017) · cites this paper as Peer et al., 2014
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Tversky, A., & Kahneman, D. (1974) · Science · doi:10.1126/science.185.4157.1124 · Cited by 28,810
Judgment under Uncertainty: Heuristics and Biases
Tversky, A., & Kahneman, D. (1975) · Utility, Probability, and Human Decision Making · doi:10.1007/978-94-010-1834-0_8 · Cited by 22,650
Amazon's Mechanical Turk: A New Source of Inexpensive, Yet High-Quality, Data?
Buhrmester, M., Kwang, T., & Gosling, S. D. (2011) · Perspectives on Psychological Science · doi:10.1177/1745691610393980 · Cited by 9,996
A very brief measure of the Big-Five personality domains
Gosling, S. D., Rentfrow, P. J., & Swann, W. B. (2003) · Journal of Research in Personality · doi:10.1016/s0092-6566(03)00046-1 · Cited by 8,307
Running experiments on Amazon Mechanical Turk
Paolacci, G., Chandler, J., & Ipeirotis, P. G. (2010) · Judgment and Decision Making · doi:10.1017/s1930297500002205 · Cited by 3,767
Instructional manipulation checks: Detecting satisficing to increase statistical power
Oppenheimer, D. M., Meyvis, T., & Davidenko, N. (2009) · Journal of Experimental Social Psychology · doi:10.1016/j.jesp.2009.03.009 · Cited by 3,493
Robins, R. W., Hendin, H. M., & Trzesniewski, K. H. (2001) · Personality and Social Psychology Bulletin · doi:10.1177/0146167201272002 · Cited by 3,041
The Efficient Assessment of Need for Cognition
Cacioppo, J. T., Petty, R. E., & Feng Kao, C. (1984) · Journal of Personality Assessment · doi:10.1207/s15327752jpa4803_13 · Cited by 2,913
Data collection in a flat world: the strengths and weaknesses of Mechanical Turk samples
Goodman, J. K., Cryder, C. E., & Cheema, A. (2013) · Journal of Behavioral Decision Making · doi:10.1002/bdm.1753 · Cited by 2,242
Rosenberg, M. (2011) · PsycTESTS Dataset · doi:10.1037/t01038-000 · Cited by 1,226
Cited by
Sorted by citations
Items 601–700 of 1,000
Siegel, J. T., & Navarro, M. (2019) · Journal of Applied Social Psychology · doi:10.1111/jasp.12580 · Cited by 21
Trait-Level Variability in Attention Modulates Mind Wandering and Academic Achievement
Pereira, E. J., Gurguryan, L., & Ristic, J. (2020) · Frontiers in Psychology · doi:10.3389/fpsyg.2020.00909 · Cited by 21
Kimball, S. H. (2019) · Journal of Business Diversity · doi:10.33423/jbd.v19i2.2054 · Cited by 21
Stephan, E., Shidlovski, D., & Sedikides, C. (2017) · Self and Identity · doi:10.1080/15298868.2017.1314319 · Cited by 20
Who Broke Amazon Mechanical Turk?: An Analysis of Crowdsourcing Data Quality over Time
Marshall, C. C., Goguladinne, P. S. R., Maheshwari, M., Sathe, A., & Shipman, F. M. (2023) · Proceedings of the 15th ACM Web Science Conference 2023 · doi:10.1145/3578503.3583622 · Cited by 20
Associations among dimensions of political ideology and Dark Tetrad personality features
Bardeen, J. R., & Michel, J. S. (2019) · Journal of Social and Political Psychology · doi:10.5964/jspp.v7i1.1071 · Cited by 22
Self-coding: A method to assess semantic validity and bias when coding open-ended responses
Glazier, R. A., Boydstun, A. E., & Feezell, J. T. (2021) · Research & Politics · doi:10.1177/20531680211031752 · Cited by 20
Choices between money and hyper-palatable food: Choice impulsivity and eating behavior.
Fazzino, T. L., Bjorlie, K. A., Rohde, K., Smith, A. P., & Yi, R. (2022) · Health Psychology · doi:10.1037/hea0001185 · Cited by 20
Alotaibi, S., Shafieizadeh, K., & Alsumait, K. (2022) · Journal of Quality Assurance in Hospitality & Tourism · doi:10.1080/1528008x.2022.2161693 · Cited by 21
Mindfully outraged: Mindfulness increases deontic retribution for third-party injustice
Kay, A. A., Masters-Waage, T. C., Reb, J. M., & Vlachos, P. A. (2023) · Organizational Behavior and Human Decision Processes · doi:10.1016/j.obhdp.2023.104249 · Cited by 22
LMXSC Elicits Hubristic Pride and Social Undermining in Individuals with High Trait Dominance
Korman, B. A., Tröster, C., & Giessner, S. R. (2023) · Journal of Management Studies · doi:10.1111/joms.12983 · Cited by 22
Driving the Future : A Management Flight Simulator of the US Automobile Market
Keith, D. R., Naumov, S. A., & Sterman, J. D. (2017) · Simulation & Gaming · doi:10.1177/1046878117737807 · Cited by 22
Pickett, J., Hofmans, J., Debusscher, J., & Fruyt, F. D. (2019) · Journal of Happiness Studies · doi:10.1007/s10902-019-00139-1 · Cited by 20
Ortiz, S. N., Forrest, L. N., & Smith, A. R. (2020) · Journal of Clinical Psychology · doi:10.1002/jclp.23102 · Cited by 20
How Black are Lakisha and Jamal? Racial Perceptions from Names Used in Correspondence Audit StudiesPreprint
Gaddis, S. M. (2016) · doi:10.31235/osf.io/7c4wv · Cited by 20
Factor Structure and Psychometric Properties of the Digital Communication Empathy Scale (DCES)
Collins, A. M., Warburton, W., Bussey, K., & Sweller, N. (2023) · International Journal of Human-Computer Studies · doi:10.1016/j.ijhcs.2023.103183 · Cited by 21
Horn, A. (2018) · European Journal of Political Research · doi:10.1111/1475-6765.12278 · Cited by 19
Worldview-based hospitality brand support: belief in a just world theory perspectives
Legendre, T. S., Baker, M. A., Warnick, R. B., & Assaf, A. G. (2020) · International Journal of Contemporary Hospitality Management · doi:10.1108/ijchm-05-2019-0476 · Cited by 19
Rational Herding in Reward-Based Crowdfunding: An MTurk Experiment
Comeig, I., Mesa-Vázquez, E., Sendra-Pons, P., & Urbano, A. (2020) · Sustainability · doi:10.3390/su12239827 · Cited by 19
Chronemic urgency in everyday digital communication
Kalman, Y. M., Ballard, D. I., & Aguilar, A. M. (2021) · Time & Society · doi:10.1177/0961463x20987721 · Cited by 19
Anxiety sensitivity prospectively predicts pandemic-related distress
Schmidt, N. B., Morabito, D. M., Mathes, B. M., & Martin, A. D. (2021) · Journal of Affective Disorders · doi:10.1016/j.jad.2021.05.124 · Cited by 19
Augmenting the formation of esports gameplay intention: interaction effects of genre and gender
Jang, W. W., Byon, K. K., Williams, A. S., & Pedersen, P. M. (2021) · Sport Business and Management An International Journal · doi:10.1108/sbm-04-2021-0049 · Cited by 19
Brosowsky, N. P., & Egner, T. (2021) · Journal of Experimental Psychology Human Perception & Performance · doi:10.1037/xhp0000942 · Cited by 25
Wilson, N. C., & Seigfried‐Spellar, K. C. (2022) · Social Science Computer Review · doi:10.1177/08944393211065868 · Cited by 19
Leading When the Boss is Present: How Leadership Structure Schemas Affect Leadership Behavior
Wellman, N. M., Ashford, S. J., Sanchez‐Burks, J., & DeRue, D. S. (2022) · Journal of Leadership & Organizational Studies · doi:10.1177/15480518221076767 · Cited by 19
Does External Attribution Motivate Pessimistic Consumers to Purchase Organic Cosmetics?
Bharti, K., Jabeen, F., Sadiq, M., & Khan, F. M. (2022) · Australasian Marketing Journal (AMJ) · doi:10.1177/14413582221127319 · Cited by 21
Borman, T. C., Dunlop, P. D., Gagné, M., & Neale, M. (2023) · Journal of Business and Psychology · doi:10.1007/s10869-023-09876-w · Cited by 23
Yitzhak, N., Shimony, O., Oved, N., Bonne, O. B., & Nahum, M. (2023) · Comprehensive Psychiatry · doi:10.1016/j.comppsych.2023.152386 · Cited by 20
You don’t need an invoice, do you? An online experiment on collaborative tax evasion
Burgstaller, L., & Pfeil, K. (2024) · Journal of Economic Psychology · doi:10.1016/j.joep.2024.102708 · Cited by 19
Fergus, T. A., & Bardeen, J. R. (2017) · Psychological Trauma: Theory, Research, Practice, and Policy · doi:10.1037/tra0000247 · Cited by 19
Jones, A. M., & Penrod, S. (2017) · Psychology Crime and Law · doi:10.1080/1068316x.2017.1390113 · Cited by 23
Toff, B. (2018) · Research & Politics · doi:10.1177/2053168018812215 · Cited by 19
Solving dissociative group effects using construal level theory
McGowan, M., Hassan, L., & Shiu, E. (2019) · European Journal of Marketing · doi:10.1108/ejm-07-2018-0468 · Cited by 16
Are you engaged? The influence of brand schematicity on online brand engagement and brand purchase
Puligadda, S., Coyle, J. R., & Ni, J. Z. (2021) · Journal of Research in Interactive Marketing · doi:10.1108/jrim-09-2019-0149 · Cited by 21
Food delivery now or later: The match-up effect of purchase timeframe and review recency
Kim, M., Kim, E. J., & Busser, J. A. (2022) · International Journal of Hospitality Management · doi:10.1016/j.ijhm.2022.103143 · Cited by 19
Collins, M. G., Juvina, I., & Gluck, K. A. (2016) · Frontiers in Psychology · doi:10.3389/fpsyg.2016.00049 · Cited by 20
Communicating to Improve Health
Zheng, Y., & McKeever, B. W. (2016) · Nonprofit and Voluntary Sector Quarterly · doi:10.1177/0899764016649694 · Cited by 19
Holocaust knowledge and Holocaust education experiences predict citizenship values among US adults
Starratt, G. K., Fredotovic, I., Goodletty, S., & Starratt, C. (2017) · Journal of Moral Education · doi:10.1080/03057240.2017.1303465 · Cited by 19
Pereira, S., Robinson, J. O., Peoples, H. A., Gutierrez, A. M., Majumder, M. A., McGuire, A. L., & Rothstein, M. A. (2017) · PLoS ONE · doi:10.1371/journal.pone.0184525 · Cited by 19
Redmiles, E. M., Kross, S., Pradhan, A., & Mazurek, M. L. (2017) · University Libraries (University of Maryland) · doi:10.13016/m2bv8d · Cited by 19
Consumer Responses to Corporate Tax PlanningPreprint
Asay, H. S., Hoopes, J. L., Thornock, J. R., & Wilde, J. H. (2018) · SSRN Electronic Journal · doi:10.2139/ssrn.3224670 · Cited by 19
Evaluating mobile-based data collection for crowdsourcing behavioral research
Esch, D. T., Mylonopoulos, N. A., & Theoharakis, V. (2025) · Behavior Research Methods · doi:10.3758/s13428-025-02618-1 · Cited by 20
The Hidden Measurement Crisis in Criminology
Graham, A., Cullen, F. T., & Link, B. G. (2025) · Cambridge University Press eBooks · doi:10.1017/9781009558549 · Cited by 18
Assessing the Impact of Media on Blaming the Victim of Acquaintance Rape
Gravelin, C. R., Biernat, M., & Kerl, E. (2024) · Psychology of Women Quarterly · doi:10.1177/03616843231220960 · Cited by 18
Victor, G. A., Strickland, J. C., Kheibari, A., & Flaherty, C. W. (2020) · International Journal of Drug Policy · doi:10.1016/j.drugpo.2020.102973 · Cited by 18
When social class and social norms shape word of mouth about eco-friendly tourism businesses
Hwang, Y., & Moon, H. G. (2022) · Journal Of Vacation Marketing · doi:10.1177/13567667221078247 · Cited by 22
Green pride in sustainable versus premium brand decisions
Maior, C. S., Mantovani, D., Pinto, D. C., & Ferreira, M. B. (2022) · Marketing Intelligence & Planning · doi:10.1108/mip-03-2022-0117 · Cited by 19
Correlates of Dampening and Savoring in Generalized Anxiety Disorder
Malivoire, B. L., Marcotte-Beaumier, G., Sumantry, D. M., & Koerner, N. (2022) · International Journal of Cognitive Therapy · doi:10.1007/s41811-022-00145-x · Cited by 18
Monahan, L., Espinosa, J. A., Langenderfer, J., & Ortinau, D. J. (2022) · Journal of Business Research · doi:10.1016/j.jbusres.2022.08.047 · Cited by 18
Stigma Toward Consensual Non-Monogamy: Thematic Analysis and Minority Stress
Mahar, E. A., Irving, L. H., Derovanesian, A., Masterson, A., & Webster, G. D. (2022) · Personality and Social Psychology Bulletin · doi:10.1177/01461672221139086 · Cited by 30
Hays, R. D., Qureshi, N., Herman, P. M., Rodriguez, A., Kapteyn, A., & Edelen, M. O. (2023) · Journal of Medical Internet Research · doi:10.2196/46421 · Cited by 18
Communicating trust and trustworthiness through scientists’ biographies: Benevolence beliefs
Hautea, S., Besley, J. C., & Choung, H. (2024) · Public Understanding of Science · doi:10.1177/09636625241228733 · Cited by 18
Estimating utility values for vesicoureteral reflux in the general public using an online tool
Lloyd, J. C., Yen, T., Pietrobon, R. S., Wiener, J. S., Ross, S. S., Kokorowski, P. K., Nelson, C. P., & Routh, J. C. (2014) · Journal of Pediatric Urology · doi:10.1016/j.jpurol.2014.02.014 · Cited by 18
Ideas are cheap: When and why adults value labor over ideas.
Burgmer, P., Forstmann, M., & Stavrova, O. (2018) · Journal of Experimental Psychology General · doi:10.1037/xge0000473 · Cited by 20
Yelderman, L. A., West, M. P., & Miller, M. K. (2018) · Legal and Criminological Psychology · doi:10.1111/lcrp.12141 · Cited by 18
Aqlan, F., & Nwokeji, J. C. (2018) · IEEE Frontiers in Education Conference (FIE) · doi:10.1109/fie.2018.8658588 · Cited by 19
A counterfeit competence: After threat, cheating boosts one's self-image
Wakeman, S. W., Moore, C., & Francesca Gino, B. (2019) · Journal of Experimental Social Psychology · doi:10.1016/j.jesp.2019.01.009 · Cited by 19
Tsai, J., Huang, M., Rosenheck, R. A., & Wilkinson, S. T. (2020) · Psychiatric Services · doi:10.1176/appi.ps.201900448 · Cited by 18
High prevalence of food intolerances among US internet users
Jansson‐Knodell, C. L., White, M. K., Lockett, C. J., Xu, H., & Shin, A. (2020) · Public Health Nutrition · doi:10.1017/s1368980020003298 · Cited by 18
van Veen-Dirks, P. M. G., Leliveld, M. C., & Kaufmann, W. (2021) · Journal of Management Control · doi:10.1007/s00187-021-00316-5 · Cited by 18
Michel, J. S., Rotch, M. A., Carson, J. E., Bowling, N. A., & Shifrin, N. V. (2021) · Occupational Health Science · doi:10.1007/s41542-021-00087-4 · Cited by 19
Explaining Victim Impact from Cyber Abuse: An Exploratory Mixed Methods Analysis
Vakhitova, Z., Alston‐Knox, C., Reeves, E., & Mawby, R. I. (2021) · Deviant Behavior · doi:10.1080/01639625.2021.1921558 · Cited by 21
Kim, J., & Kim, M. (2025) · Marketing Intelligence & Planning · doi:10.1108/mip-04-2024-0288 · Cited by 18
Okan, Y., Stone, E. R., Parillo, J., de Bruin, W. B., & Parker, A. M. (2020) · Risk Analysis · doi:10.1111/risa.13431 · Cited by 17
Usher‐Smith, J. A., Mills, K., Riedinger, C., Saunders, C. L., Helsingen, L. M., Lytvyn, L., Buskermolen, M., Lansdorp‐Vogelaar, I., Bretthauer, M., Guyatt, G. H., et al. (2021) · PLoS ONE · doi:10.1371/journal.pone.0246991 · Cited by 17
Optimizing Handwritten Font Style to Connect With Customers
Hwang, Y., Gao, Y. L., Mattila, A. S., & Wang, P. (2022) · Cornell Hospitality Quarterly · doi:10.1177/19389655221102389 · Cited by 17
Situational Moral Evaluations: The Role of Rationalizations & Moral Identity
Herman, S., & Pogarsky, G. (2023) · Journal of Research in Crime and Delinquency · doi:10.1177/00224278231152626 · Cited by 17
Green products wrapped and delivered: consumer’s preference for sustainable e-commerce practices
V.Bharani, S. J., Roy, S. N., & Tawde, S. (2023) · The International Review of Retail Distribution and Consumer Research · doi:10.1080/09593969.2023.2263822 · Cited by 19
Busch, P. A. (2023) · Government Information Quarterly · doi:10.1016/j.giq.2023.101872 · Cited by 21
A Comparison of Six Sample Providers Regarding Online Privacy Benchmarks
Schnorf, S., Sedley, A., Ortlieb, M., & Woodruff, A. (2014) · Cited by 17
Gould, S. J. J., Cox, A. L., Brumby, D. P., & Wickersham, A. (2016) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/2858036.2858067 · Cited by 18
Leding, J. K. (2019) · Journal of Cognitive Psychology · doi:10.1080/20445911.2018.1564756 · Cited by 18
Nees, M. A., Sharma, N., & Shore, A. (2020) · Accident Analysis & Prevention · doi:10.1016/j.aap.2020.105792 · Cited by 17
Ivanov, S., Novisky, M. A., & Vogel, M. (2021) · Socius Sociological Research for a Dynamic World · doi:10.1177/23780231211005222 · Cited by 16
ELVIRA: An Explainable Agent for Value and Utility-Driven Multiuser Privacy
Mosca, F., & Such, J. M. (2021) · Adaptive Agents and Multi-Agents Systems · doi:10.65109/iqrd3616 · Cited by 17
Reiner, P. B. (2019) · Advances in neuroethics · doi:10.1007/978-3-030-10677-5_6 · Cited by 17
Bay‐Cheng, L. Y. (2016) · The Journal of Sex Research · doi:10.1080/00224499.2016.1139033 · Cited by 17
McDonald, C. C., Kennedy, E. E., Fleisher, L. G., & Zonfrillo, M. R. (2018) · The Journal of Pediatrics · doi:10.1016/j.jpeds.2018.06.003 · Cited by 17
Sahakyan, L., & Kwapil, T. R. (2019) · Journal of Abnormal Psychology · doi:10.1037/abn0000441 · Cited by 18
A network analysis of two conceptual approaches to the etiology of PTSD
Benfer, N., Bardeen, J. R., Spitzer, E. G., & Rogers, T. A. (2021) · Journal of Anxiety Disorders · doi:10.1016/j.janxdis.2021.102479 · Cited by 16
The psychology of confessions: A comparison of expert and lay opinions
Alceste, F., Luke, T. J., Redlich, A. D., Hellgren, J., Amrom, A. D., & Kassin, S. M. (2020) · Applied Cognitive Psychology · doi:10.1002/acp.3735 · Cited by 16
Truth or Dare: Understanding and Predicting How Users Lie and Provide Untruthful Data Online
Ramokapane, K. M., Misra, G., Such, J. M., & Preibusch, S. (2021) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3411764.3445625 · Cited by 18
Vance, G. S., Zeigler‐Hill, V., James, R., & Shackelford, T. K. (2021) · The Journal of Sex Research · doi:10.1080/00224499.2021.1956412 · Cited by 16
Boredom and Media Multitasking
Drody, A. C., Ralph, B. C. W., Danckert, J. A., & Smilek, D. (2022) · Frontiers in Psychology · doi:10.3389/fpsyg.2022.807667 · Cited by 19
Kim, H., & Jang, S. S. (2022) · International Journal of Contemporary Hospitality Management · doi:10.1108/ijchm-09-2021-1185 · Cited by 18
Mawby, R. I., & Vakhitova, Z. (2022) · Springer eBooks · doi:10.1007/978-3-030-91735-7_27 · Cited by 17
Emergency management through information crowdsourcing
Grassi, L., Ciranni, M., Baglietto, P., Recchiuto, C. T., Maresca, M., & Sgorbissa, A. (2023) · Information Processing & Management · doi:10.1016/j.ipm.2023.103386 · Cited by 16
Raise Their Voices: The Link Between Motivating Language and Employee Voice
Mayfield, J. R., Mayfield, M. R., & Nguyen, C. N. (2023) · International Journal of Strategic Communication · doi:10.1080/1553118x.2023.2265926 · Cited by 16
A First Look into Targeted Clickbait and its Countermeasures: The Power of Storytelling
Shrestha, A., Flood, A., Sohrawardi, S. J., Wright, M., & Al-Ameen, M. N. (2024) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3613904.3642301 · Cited by 16
How Virtual are We? Introducing the Team Perceived Virtuality Scale
Handke, L., Costa, P., & Feitosa, J. (2024) · Journal of Business and Psychology · doi:10.1007/s10869-024-09966-3 · Cited by 21
Methodological considerations for assessing trauma history via self-report.
Bardeen, J. R., & Benfer, N. (2018) · Psychological Trauma Theory Research Practice and Policy · doi:10.1037/tra0000398 · Cited by 16
Pilot randomized controlled trial of an online intervention for problem gamblers
Cunningham, J. A., Godinho, A., & Hodgins, D. C. (2019) · Addictive Behaviors Reports · doi:10.1016/j.abrep.2019.100175 · Cited by 16
Johnson, J. D., Lecci, L. B., & Dovidio, J. F. (2019) · Social Psychological and Personality Science · doi:10.1177/1948550619859316 · Cited by 17
Tratner, A. E., Sela, Y., Lopes, G. S., Shackelford, T. K., McDonald, M. M., Weekes‐Shackelford, V. A., & Abed, M. G. (2020) · Personality and Individual Differences · doi:10.1016/j.paid.2019.109802 · Cited by 16
Public attitudes towards screening for kidney cancer: an online survey
Harvey-Kelly, L. L. W., Harrison, H., Rossi, S. H., Griffin, S. J., Stewart, G. D., & Usher‐Smith, J. A. (2020) · BMC Urology · doi:10.1186/s12894-020-00724-0 · Cited by 16
Clustering Esports Gameplay Consumers via Game Experiences
Jang, W. W., Byon, K. K., Pecoraro, J., & Tsuji, Y. (2021) · Frontiers in Sports and Active Living · doi:10.3389/fspor.2021.669999 · Cited by 16
Parental Attitudes Toward Use of Ketamine in Adolescent Mood Disorders and Suicidality
Mathai, D. S., McCathern, A. G., Guzick, A. G., Schneider, S. C., Weinzimmer, S. A., Cepeda, S. L., Garcia‐Romeu, A., & Storch, E. A. (2021) · Journal of Child and Adolescent Psychopharmacology · doi:10.1089/cap.2021.0078 · Cited by 18
An explainable assistant for multiuser privacy
Mosca, F., & Such, J. M. (2022) · Autonomous Agents and Multi-Agent Systems · doi:10.1007/s10458-021-09543-5 · Cited by 19
Ismail, Q., Ahmed, T., Caine, K. E., Kapadia, A. C., & Reiter, M. K. (2017) · Proceedings on Privacy Enhancing Technologies · doi:10.1515/popets-2017-0041 · Cited by 16
Leustek, J., & Theiss, J. A. (2017) · Health Communication · doi:10.1080/10410236.2017.1384346 · Cited by 16
Metadata
- Authors
- Peer, E., Vosgerau, J., & Acquisti, A.
- Affiliations
- Tilburg University (NL)
- Carnegie Mellon University (US)
- Venue
- Behavior Research Methods
- Published
- 2013-12-20
- Volume
- 46
- Issue
- 4
- Pages
- 1023-1031
- ISSN
- 1554-351X (ISSN-L)
- 1554-3528
- OpenAlex
- W2105753174
- Cited by
- 1,618
- References
- 18
- Citations by year
- 2026: 68 · 2025: 96 · 2024: 128 · 2023: 167 · 2022: 175 · 2021: 212 · 2020: 210 · 2019: 147 · 2018: 119 · 2017: 132 · 2016: 91 · 2015: 49 · 2014: 17 · 2013: 1
- FWCI
- 79.80
- Type
- journal article
- Language
- en
- Open access
- bronze
- doi.org
- Locations
- Behavior Research Methods (publishedVersion)
- Research portal (Tilburg University) (publishedVersion)
- PubMed (publishedVersion)
- Data Archiving and Networked Services (DANS) (submittedVersion)
- SSRN Electronic Journal (submittedVersion)
- Figshare (submittedVersion, cc-by)
- Archivio istituzionale della Ricerca - Bocconi (submittedVersion)
- KiltHub Repository
- Topics
- Physical Sciences › Computer Science › Computer Science Applications › Mobile Crowdsensing and Crowdsourcing
- Social Sciences › Sociology and Political Science › Survey Methodology and Nonresponse
- Social Sciences › Decision Sciences › Management Science and Operations Research › Psychometric Methodologies and Testing
- Keywords
- data quality, Amazon Mechanical Turk, worker reputation, crowdsourcing, selection bias, labor productivity, participant recruitment
- MeSH terms
- Data Collection, Humans, Research Design, Patient Selection, Internet, Behavioral Research, Crowdsourcing
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
