Cited by 1,739Mobile Crowdsensing and CrowdsourcingSurvey Methodology and NonresponsePsychometric Methodologies and Testing

The DOI matches its Crossref record; 21 of the 23 references it cites were found in a registry or an index.

Attentive Turkers: MTurk participants perform better on online attention checks than do subject pool participants

Open access

Hauser, David J., Schwarz, Norbert·2016·Behavior Research Methods

DOI 10.3758/s13428-015-0578-z

Open this paper in CoChat — free account Open PDF

Abstract

Participant attentiveness is a concern for many researchers using Amazon's Mechanical Turk (MTurk). Although studies comparing the attentiveness of participants on MTurk versus traditional subject pool samples have provided mixed support for this concern, attention check questions and other methods of ensuring participant attention have become prolific in MTurk studies. Because MTurk is a population that learns, we hypothesized that MTurkers would be more attentive to instructions than are traditional subject pool samples. In three online studies, participants from MTurk and collegiate populations participated in a task that included a measure of attentiveness to instructions (an instructional manipulation check: IMC). In all studies, MTurkers were more attentive to the instructions than were college students, even on novel IMCs (Studies 2 and 3), and MTurkers showed larger effects in response to a minute text manipulation. These results have implications for the sustainable use of MTurk samples for social science research and for the conclusions drawn from research with MTurk and college subject pool samples.

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

Integrity signals

Registry

Crossref · 10.3758/s13428-015-0578-z

Cites

21 of 21 references verified0 citation errors · 0 not checkable

Statistics

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

G*Power 3: A flexible statistical power analysis program for the social, behavioral, and biomedical sciences
Faul, F., Erdfelder, E., Lang, A.-G., & Buchner, A. (2007) · Behavior Research Methods · doi:10.3758/bf03193146 · Cited by 65,971
Advances In Experimental Social Psychology
(2022) · Advances in experimental social psychology · doi:10.1016/s0065-2601(22)x0002-6 · Cited by 22,559
Mental Accounting and Consumer Choice
Thaler, R. (1985) · Marketing Science · doi:10.1287/mksc.4.3.199 · Cited by 4,885
Evaluating Online Labor Markets for Experimental Research: Amazon.com's Mechanical Turk
Berinsky, A. J., Huber, G. A., & Lenz, G. S. (2012) · Political Analysis · doi:10.1093/pan/mpr057 · Cited by 4,008
Running experiments on Amazon Mechanical Turk
Paolacci, G., Chandler, J., & Ipeirotis, P. G. (2010) · Judgment and Decision Making · doi:10.1017/s1930297500002205 · Cited by 3,767
Instructional manipulation checks: Detecting satisficing to increase statistical power
Oppenheimer, D. M., Meyvis, T., & Davidenko, N. (2009) · Journal of Experimental Social Psychology · doi:10.1016/j.jesp.2009.03.009 · Cited by 3,493
Mental Accounting and Consumer Choice
Thaler, R. H. (2008) · Marketing Science · doi:10.1287/mksc.1070.0330 · Cited by 3,477
Conducting behavioral research on Amazon’s Mechanical Turk
Mason, W., & Suri, S. (2012) · Behavior Research Methods · doi:10.3758/s13428-011-0124-6 · Cited by 3,172
Data collection in a flat world: the strengths and weaknesses of Mechanical Turk samples
Goodman, J. K., Cryder, C. E., & Cheema, A. (2013) · Journal of Behavioral Decision Making · doi:10.1002/bdm.1753 · Cited by 2,242
Inside the Turk: Understanding Mechanical Turk as a Participant Pool
Paolacci, G., & Chandler, J. (2014) · Current Directions in Psychological Science · doi:10.1177/0963721414531598 · Cited by 2,136

Show all 23 references

Research works printed but not linked: 1

Kapelner, A., & Chandler, D. (2010). Preventing satisficing in online surveys: A “kapcha” to ensure higher data quality. In Proceedings of CrowdConf 2010. Available at www.academia.edu/2788541/Preventing_Satisficing_in_Online_Surveys

Sorted by citations

Items 201–300 of 1,003

Social mindfulness: Prosocial the active way
Doesum, N. J. V., de Vries, R. E., BLOKLAND, A. A. J., Hill, J. M., Kuhlman, D. M., Stivers, A. W., Tybur, J. M., & Lange, P. A. M. V. (2019) · The Journal of Positive Psychology · doi:10.1080/17439760.2019.1579352 · Cited by 65
Learning more from feedback: Elaborating feedback with examples enhances concept learning
Finn, B., Thomas, R. C., & Rawson, K. A. (2017) · Learning and Instruction · doi:10.1016/j.learninstruc.2017.08.007 · Cited by 79
Consumer attitudes towards bloggers and paid blog advertisements: what’s new?
van Esch, P., Arli, D. I., Castner, J., Talukdar, N., & Northey, G. (2018) · Marketing Intelligence & Planning · doi:10.1108/mip-01-2018-0027 · Cited by 70
Authenticity and exclusivity appeals in luxury advertising: the role of promotion and prevention pride
Septianto, F., Seo, Y., Sung, B., & Fang, Z. (2020) · European Journal of Marketing · doi:10.1108/ejm-10-2018-0690 · Cited by 61
Reduced social distancing early in the COVID-19 pandemic is associated with antisocial behaviors in an online United States sample
O’Connell, K., Berluti, K., Rhoads, S. A., & Marsh, A. A. (2021) · PLoS ONE · doi:10.1371/journal.pone.0244974 · Cited by 60
Simulated nature walks improve psychological well-being along a natural to urban continuum
Brancato, G., Hedger, K. V., Berman, M. G., & Hedger, S. C. V. (2022) · Journal of Environmental Psychology · doi:10.1016/j.jenvp.2022.101779 · Cited by 62
Toward empirical process-based case conceptualization: An idionomic network examination of the process-based assessment tool
Sanford, B. T., Ciarrochi, J., Hofmann, S. G., Chin, F. T., Gates, K. M., & Hayes, S. C. (2022) · Journal of Contextual Behavioral Science · doi:10.1016/j.jcbs.2022.05.006 · Cited by 62
How to Run Behavioural Experiments Online: Best Practice Suggestions for Cognitive Psychology and Neuroscience
Gagné, N., & Franzen, L. (2023) · Swiss Psychology Open · doi:10.5334/spo.34 · Cited by 74
The effects of gamelike features and test location on cognitive test performance and participant enjoyment
Lumsden, J., Skinner, A., Woods, A. T., Lawrence, N., & Munafo, M. R. (2016) · PeerJ · doi:10.7717/peerj.2184 · Cited by 61
Behavioral complexity of British gambling advertising
Newall, P. W. S. (2017) · Addiction Research & Theory · doi:10.1080/16066359.2017.1287901 · Cited by 60
Distinction without a difference? An assessment of MTurk Worker types
Loepp, E. D., & Kelly, J. T. (2020) · Research & Politics · doi:10.1177/2053168019901185 · Cited by 60
A Note on Dropping Experimental Subjects Who Fail a Manipulation CheckPreprint
Aronow, P. M., Baron, J., & Pinson, L. E. (2015) · SSRN Electronic Journal · doi:10.2139/ssrn.2683588 · Cited by 60
Beyond Bot Detection: Combating Fraudulent Online Survey Takers✱
Zhang, Z., Zhu, S., Mink, J., Xiong, A., Song, L., & Wang, G. (2022) · International World Wide Web Conference (WWW) · doi:10.1145/3485447.3512230 · Cited by 59
When leaders ask questions: Can humility premiums buffer the effects of competence penalties?
Cojuharenco, I., & Karelaia, N. (2019) · Organizational Behavior and Human Decision Processes · doi:10.1016/j.obhdp.2019.12.001 · Cited by 60
Condoms and bananas: Shock advertising explained through congruence theory
Lee, M., Septianto, F., Frethey‐Bentham, C., & Gao, E. (2020) · Journal of Retailing and Consumer Services · doi:10.1016/j.jretconser.2020.102228 · Cited by 59
Cultural Change Over Time: Why Replicability Should Not Be the Gold Standard in Psychological Science
Greenfield, P. M. (2017) · Perspectives on Psychological Science · doi:10.1177/1745691617707314 · Cited by 60
Righting a wrong: Retaliation on a voodoo doll symbolizing an abusive supervisor restores justice
Liang, L. H., Brown, D. J., Lian, H., Hanig, S., Ferris, D. L., & Keeping, L. M. (2018) · The Leadership Quarterly · doi:10.1016/j.leaqua.2018.01.004 · Cited by 65
Do imposters threaten data quality? An examination of worker misrepresentation and downstream consequences in Amazon's Mechanical Turk workforce
Kan, I. P., & Drummey, A. B. (2018) · Computers in Human Behavior · doi:10.1016/j.chb.2018.02.005 · Cited by 62
The Difficulties in Emotion Regulation Scale–Parent Report: A Psychometric Investigation Examining Adolescents With and Without ADHD
Bunford, N., Dawson, A. E., Evans, S. W., Ray, A., Langberg, J. M., Owens, J. S., DuPaul, G. J., & Allan, D. M. (2018) · Assessment · doi:10.1177/1073191118792307 · Cited by 59
Even arbitrary norms influence moral decision-making
Pryor, C., Perfors, A., & Howe, P. D. L. (2018) · Nature Human Behaviour · doi:10.1038/s41562-018-0489-y · Cited by 65
The effects of inner packaging color on the desirability of food
van Esch, P., Heller, J., & Northey, G. (2019) · Journal of Retailing and Consumer Services · doi:10.1016/j.jretconser.2019.05.003 · Cited by 67
Development and psychometric evaluation of the Pornography Purchase Task
Mulhauser, K. R. W., Short, E. M., & Weinstock, J. (2018) · Addictive Behaviors · doi:10.1016/j.addbeh.2018.04.016 · Cited by 59
Luxury goods in online retail: How high/low positioning influences consumer processing fluency and preference
Chan, E. Y., & Northey, G. (2021) · Journal of Business Research · doi:10.1016/j.jbusres.2021.04.031 · Cited by 50
Optimizing the economic and environmental benefits of ride‐hailing and pooling
Naumov, S., & Keith, D. R. (2022) · Production and Operations Management · doi:10.1111/poms.13905 · Cited by 57
Analyze the attentive and bypass bias: mock vignette checks in survey experiments
Kane, J., Velez, Y. R., & Barabas, J. (2023) · Political Science Research and Methods · doi:10.1017/psrm.2023.3 · Cited by 57
Priming and context effects in citizen satisfaction surveys
Hjortskov, M. (2017) · Public Administration · doi:10.1111/padm.12346 · Cited by 62
The Indirect Effect of Emotion Regulation on Minority Stress and Problematic Substance Use in Lesbian, Gay, and Bisexual Individuals
Rogers, A. H., van Dyk, I. S., Haines, N., Hahn, H. A., Aldao, A., & Ahn, W. (2017) · Frontiers in Psychology · doi:10.3389/fpsyg.2017.01881 · Cited by 59
Zombies in the Loop? Humans Trust Untrustworthy AI-Advisors for Ethical Decisions
Krügel, S., Ostermaier, A., & Uhl, M. (2022) · Philosophy & Technology · doi:10.1007/s13347-022-00511-9 · Cited by 76
Amazon’s Mechanical Turk as a Viable Source for Organizational and Occupational Health Research
Michel, J. S., O’Neill, S. K., Hartman, P., & Lorys, A. (2017) · Occupational Health Science · doi:10.1007/s41542-017-0009-x · Cited by 65
The perils of self‐brand connections: Consumer response to changes in brand meaning
Gaustad, T. B., Samuelsen, B. M., Warlop, L., & Fitzsimons, G. J. (2018) · Psychology and Marketing · doi:10.1002/mar.21137 · Cited by 58
Do Individual Investors Trade on Investment-Related Internet Postings?
Ammann, M. J., & Schaub, N. (2020) · Management Science · doi:10.1287/mnsc.2020.3733 · Cited by 59
Ghosted?: Navigating strategies for reducing uncertainty and implications surrounding ambiguous loss
LeFebvre, L. E., & Fan, X. (2020) · Personal Relationships · doi:10.1111/pere.12322 · Cited by 55
Conflict and cooperation in paranoia: a large-scale behavioural experiment
Raihani, N., & Bell, V. (2017) · Psychological Medicine · doi:10.1017/s0033291717003075 · Cited by 52
Marketing video-enabled social media as part of your e-recruitment strategy: Stop trying to be trendy
van Esch, P., & Mente, M. (2018) · Journal of Retailing and Consumer Services · doi:10.1016/j.jretconser.2018.06.016 · Cited by 56
Personalized incentives for promoting sustainable travel behaviors
Zhu, X., Wang, F., Chen, C., & Reed, D. D. (2020) · Transportation Research Part C Emerging Technologies · doi:10.1016/j.trc.2019.05.015 · Cited by 53
Intergroup Contact, COVID-19 News Consumption, and the Moderating Role of Digital Media Trust on Prejudice Toward Asians in the United States: Cross-Sectional Study
Tsai, J.-Y., Phua, J., Pan, S., & Yang, C. (2020) · Journal of Medical Internet Research · doi:10.2196/22767 · Cited by 55
Paving the way for autonomous Vehicles: Understanding autonomous vehicle adoption and vehicle fuel choice under user heterogeneity
Guo, Y., Souders, D. J., Labi, S., Peeta, S., Benedyk, I. V., & Li, Y. (2021) · Transportation Research Part A Policy and Practice · doi:10.1016/j.tra.2021.10.018 · Cited by 55
Effects of performance feedback valence on perceptions of invested mental effort
Raaijmakers, S. F., Baars, M., Schaap, L., PAAS, F. G. W. C., & van Gog, T. (2016) · Learning and Instruction · doi:10.1016/j.learninstruc.2016.12.002 · Cited by 67
Comparing self‐harming intentions underlying eating disordered behaviors and NSSI: Evidence that distinctions are less clear than assumed
Fox, K. R., Wang, S. B., Boccagno, C. E., Haynos, A. F., Kleiman, E. M., & Hooley, J. M. (2019) · International Journal of Eating Disorders · doi:10.1002/eat.23041 · Cited by 64
Social courage fosters both voice and silence in the workplace
Howard, M. C., & Holmes, P. E. (2019) · Journal of Organizational Effectiveness People and Performance · doi:10.1108/joepp-04-2019-0034 · Cited by 63
Is Honesty the Best Policy? Examining the Role of Price and Production Transparency in Fashion Marketing
Kim, N. L., Kim, G., & Rothenberg, L. (2020) · Sustainability · doi:10.3390/su12176800 · Cited by 74
Can anyone be objective about Donald Trump? Assessing the personality of political figures
Nai, A., & Maier, J. (2019) · Journal of Elections Public Opinion and Parties · doi:10.1080/17457289.2019.1632318 · Cited by 56
Faking to fit in: Applicants’ response strategies to match organizational culture.
Roulin, N., & Krings, F. (2019) · Journal of Applied Psychology · doi:10.1037/apl0000431 · Cited by 53
Persona Transparency: Analyzing the Impact of Explanations on Perceptions of Data-Driven Personas
Salminen, J. O., Santos, J. M., Jung, S., Eslami, M., & Jansen, B. J. J. (2019) · International Journal of Human-Computer Interaction · doi:10.1080/10447318.2019.1688946 · Cited by 59
Crowdsourcing for Online Samples in Counseling Research
Mullen, P. R., Fox, J., Goshorn, J. R., & Warraich, L. K. (2021) · Journal of Counseling & Development · doi:10.1002/jcad.12369 · Cited by 56
Who Are Virtual Reality Headset Owners? A Survey and Comparison of Headset Owners and Non-Owners
Kelly, J. W., Cherep, L. A., Lim, A., Doty, T. A., & Gilbert, S. B. (2021) · IEEE Conference on Virtual Reality and 3D User Interfaces (VR) · doi:10.1109/vr50410.2021.00095 · Cited by 55
Helicopter parenting and adjustment outcomes in young adulthood: a consideration of the mediating roles of mastery and self-regulation
Moilanen, K. L., & Lynn Manuel, M. (2019) · Journal of Child and Family Studies · doi:10.1007/s10826-019-01433-5 · Cited by 52
Learning to recommend similar items from human judgments
Trattner, C., & Jannach, D. (2019) · User Modeling and User-Adapted Interaction · doi:10.1007/s11257-019-09245-4 · Cited by 52
The challenge of integrating “intelligent” technologies in luxury shopping contexts: The role of brand personality appeal and consumers’ status consumption orientation
Sestino, A. (2023) · Journal of Retailing and Consumer Services · doi:10.1016/j.jretconser.2023.103488 · Cited by 52
Expecting the worst: Investigating the effects of trigger warnings on reactions to ambiguously themed photos.
Bridgland, V. M. E., Green, D. M., Oulton, J. M., & Takarangi, M. K. T. (2019) · Journal of Experimental Psychology Applied · doi:10.1037/xap0000215 · Cited by 52
A systematic comparison of three sadism measures and their ability to explain workplace mistreatment over and above the dark triad
Min, H., Pavisic, I., Howald, N., Highhouse, S., & Zickar, M. J. (2019) · Journal of Research in Personality · doi:10.1016/j.jrp.2019.103862 · Cited by 57
Predicting intention to recycle on the basis of the theory of planned behaviour
Arli, D. I., Badejo, A., Carlini, J., France, C., Jebarajakirthy, C., Knox, K., Pentecost, R. D., Perkins, H., Thaichon, P., Sarker, T., et al. (2019) · International Journal of Nonprofit and Voluntary Sector Marketing · doi:10.1002/nvsm.1653 · Cited by 63
Towards Effective Differential Privacy Communication for Users’ Data Sharing Decision and Comprehension
Xiong, A., Wang, T., Li, N., & Jha, S. (2020) · IEEE Symposium on Security and Privacy (S&P) · doi:10.1109/sp40000.2020.00088 · Cited by 63
Exploring the Role of Media Sources on COVID-19–Related Discrimination Experiences and Concerns Among Asian People in the United States: Cross-Sectional Survey Study
Yu, N., Pan, S., Yang, C., & Tsai, J.-Y. (2020) · Journal of Medical Internet Research · doi:10.2196/21684 · Cited by 51
Attention checks and how to use them: Review and practical recommendations
Muszyński, M. A. (2023) · Ask Research and Methods · doi:10.18061/ask.v32i1.0001 · Cited by 68
No pain no gain? Social demographic correlates and identity consequences of interpreting experienced difficulty as importance
Aelenei, C., Lewis, N. A., & Oyserman, D. (2016) · Contemporary Educational Psychology · doi:10.1016/j.cedpsych.2016.08.004 · Cited by 48
Are any samples representative or unbiased? reply to Pickering and Blaszczynski
Russell, A. M. T., Browne, M., Hing, N., Rockloff, M., & Newall, P. W. S. (2021) · International Gambling Studies · doi:10.1080/14459795.2021.1973535 · Cited by 50
Is spirituality a component of wisdom? Study of 1,786 adults using expanded San Diego Wisdom Scale (Jeste-Thomas Wisdom Index)
Jeste, D. V., Thomas, M. L., Liu, J., Daly, R. E., Tu, X. M., Treichler, E. B. H., Palmer, B. W., & Lee, E. E. (2021) · Journal of Psychiatric Research · doi:10.1016/j.jpsychires.2020.09.033 · Cited by 50
Public attitudes toward allocating scarce resources in the COVID-19 pandemic
Buckwalter, W., & Peterson, A. H. (2020) · PLoS ONE · doi:10.1371/journal.pone.0240651 · Cited by 50
The effect of political ideology and message frame on donation intent during the COVID-19 pandemic
van Esch, P., Cui, Y. G., & Jain, S. P. (2020) · Journal of Business Research · doi:10.1016/j.jbusres.2020.12.040 · Cited by 53
The effect of power distance beliefs on the inconspicuous versus conspicuous consumption of luxury accessories in China and the USA
Jiang, L., Gao, H., & Shi, L. H. (2021) · Journal of Marketing Management · doi:10.1080/0267257x.2021.1913214 · Cited by 50
When fairness is flawed: Effects of false balance reporting and weight-of-evidence statements on beliefs and perceptions of climate change.
Imundo, M. N., & Rapp, D. N. (2021) · Journal of Applied Research in Memory and Cognition · doi:10.1016/j.jarmac.2021.10.002 · Cited by 49
Techno‐eustress creators: Conceptualization and empirical validation
Tarafdar, M., Stich, J., Maier, C., & Laumer, S. (2024) · Information Systems Journal · doi:10.1111/isj.12515 · Cited by 71
Affect toward the self and self-injury stimuli as potential risk factors for nonsuicidal self-injury
Fox, K. R., Ribeiro, J. D., Kleiman, E. M., Hooley, J. M., Nock, M. K., & Franklin, J. C. (2017) · Psychiatry Research · doi:10.1016/j.psychres.2017.11.083 · Cited by 54
Taking the time? Explaining effortful participation among low-cost online survey participants
Anson, I. G. (2018) · Research & Politics · doi:10.1177/2053168018785483 · Cited by 50
The climate change beliefs fallacy: the influence of climate change beliefs on the perceived consequences of climate change
Hoogendoorn, G., Sütterlin, B., & Siegrist, M. (2020) · Journal of Risk Research · doi:10.1080/13669877.2020.1749114 · Cited by 55
Employee accountability: development of a multidimensional scale
Han, Y., & Perry, J. L. (2019) · International Public Management Journal · doi:10.1080/10967494.2019.1690606 · Cited by 57
Traditional and Modern Convenience Samples: An Investigation of College Student, Mechanical Turk, and Mechanical Turk College Student Samples
Weigold, A., & Weigold, I. K. (2021) · Social Science Computer Review · doi:10.1177/08944393211006847 · Cited by 49
Conducting Online Behavioral Research Using Crowdsourcing Services in Japan
Majima, Y., Nishiyama, K., Nishihara, A., & Hata, R. (2017) · Frontiers in Psychology · doi:10.3389/fpsyg.2017.00378 · Cited by 51
Time in causal structure learning.
Bramley, N. R., Gerstenberg, T., Mayrhofer, R., & Lagnado, D. A. (2018) · Journal of Experimental Psychology Learning Memory and Cognition · doi:10.1037/xlm0000548 · Cited by 52
Text-to-Speech Software and Learning: Investigating the Relevancy of the Voice Effect
Craig, S. D., & Schroeder, N. L. (2018) · Journal of Educational Computing Research · doi:10.1177/0735633118802877 · Cited by 54
A smile – the key to everybody’s heart?
Pham, C., & Septianto, F. (2019) · European Journal of Marketing · doi:10.1108/ejm-01-2019-0019 · Cited by 49
Getting Less Likes on Social Media: Mindfulness Ameliorates the Detrimental Effects of Feeling Left Out Online
Poon, K., & Jiang, Y. (2020) · Mindfulness · doi:10.1007/s12671-020-01313-w · Cited by 57
The Differences Between Individuals Engaging in Nonsuicidal Self-Injury and Suicide Attempt Are Complex (vs. Complicated or Simple)
Huang, X., Ribeiro, J. D., & Franklin, J. C. (2020) · Frontiers in Psychiatry · doi:10.3389/fpsyt.2020.00239 · Cited by 54
Using Mechanical Turk to Study Parents and Children: An Examination of Data Quality and Representativeness
Jensen‐Doss, A., Patel, Z. S., Casline, E. P., Ringle, V. A. M., & Timpano, K. R. (2021) · Journal of Clinical Child & Adolescent Psychology · doi:10.1080/15374416.2020.1815205 · Cited by 50
Reciprocal relationship between workplace incivility and deviant silence—The moderating role of moral attentiveness
Khan, R., Murtaza, G., Neveu, J., & Newman, A. (2021) · Applied Psychology · doi:10.1111/apps.12316 · Cited by 53
The impact of place and legacy framing on climate action: A lifespan approach
Wickersham, R. H., Zaval, L., Pachana, N. A., & Smyer, M. A. (2020) · PLOS ONE · doi:10.1371/journal.pone.0228963 · Cited by 46
The “Reading the Mind in the Eyes” Test Shows Poor Psychometric Properties in a Large, Demographically Representative U.S. Sample
Higgins, W. C., Ross, R. M., Langdon, R. A., & Polito, V. (2022) · Assessment · doi:10.1177/10731911221124342 · Cited by 56
A sensemaking perspective on the association between social media engagement and pro-environment behavioural intention
Alsaad, A. K., Alam, M. M., & Lutfi, A. (2023) · Technology in Society · doi:10.1016/j.techsoc.2023.102201 · Cited by 59
An examination of the equivalency of self-report measures obtained from crowdsourced versus undergraduate student samples
Briones, E. M., & Benham, G. (2017) · Behavior Research Methods · doi:10.3758/s13428-016-0710-8 · Cited by 48
Disgust Associated With Culture Mixing
Cheon, B. K., Christopoulos, G. I., & Hong, Y. (2016) · Journal of Cross-Cultural Psychology · doi:10.1177/0022022116667845 · Cited by 48
Assessing the validity of inferences from scores on the cognitive reflection test
Blacksmith, N., Yang, Y., Behrend, T. S., & Ruark, G. A. (2019) · Journal of Behavioral Decision Making · doi:10.1002/bdm.2133 · Cited by 54
The contagious impact of playing violent video games on aggression: Longitudinal evidence
Greitemeyer, T. (2019) · Aggressive Behavior · doi:10.1002/ab.21857 · Cited by 50
Response invalidity in empirical research: Causes, detection, and remedies
Edwards, J. R. (2019) · Journal of Operations Management · doi:10.1016/j.jom.2018.12.002 · Cited by 50
The role of perceived high-performance HR practices and transformational leadership on employee engagement and citizenship behaviors
Hai, S., Wu, K., Park, I., Li, Y., Chang, Q., & Tang, Y. (2020) · Journal of Managerial Psychology · doi:10.1108/jmp-03-2019-0139 · Cited by 47
Self-construal on brand fan pages: the mediating effect of para-social interaction and consumer engagement on brand loyalty
Kim, E.-H., Yoo, D., & Doh, S.-J. (2021) · Journal of Brand Management · doi:10.1057/s41262-020-00211-9 · Cited by 49
You're driving me crazy! How emotions elicited by negative driver behaviors impact customer outcomes in last mile delivery
Masorgo, N., Mir, S., & Hofer, A. R. (2023) · Journal of Business Logistics · doi:10.1111/jbl.12356 · Cited by 49
The impact of overtly listing eligibility requirements on MTurk: An investigation involving organ donation, recruitment scripts, and feelings of elevation
Siegel, J. T., Navarro, M. A., & Thomson, A. L. (2015) · Social Science & Medicine · doi:10.1016/j.socscimed.2015.08.020 · Cited by 46
Investigating the mediating effect of Uber's sexual harassment case on its brand: Does it matter?
Griffith, D. A., van Esch, P., & Trittenbach, M. (2018) · Journal of Retailing and Consumer Services · doi:10.1016/j.jretconser.2018.03.007 · Cited by 49
A thousand studies for the price of one: Accelerating psychological science with Pushkin
Hartshorne, J. K., de Leeuw, J. R., Goodman, N. D., Jennings, M. V., & O’Donnell, T. J. (2019) · Behavior Research Methods · doi:10.3758/s13428-018-1155-z · Cited by 44
Refutation Texts: A New Approach to Changing Public Misconceptions About Education Policy
Aguilar, S. J., Polikoff, M. S., & Sinatra, G. M. (2019) · Educational Researcher · doi:10.3102/0013189x19849416 · Cited by 46
Examining broad intellectual abilities obtained within an mTurk internet sample
Merz, Z. C., Lace, J. W., & Eisenstein, A. M. (2020) · Current Psychology · doi:10.1007/s12144-020-00741-0 · Cited by 52
Inattentive Inference
Graeber, T. W. (2020) · Journal of the European Economic Association · doi:10.1093/jeea/jvac052 · Cited by 45
Using Mechanical Turk for research on cancer survivors
Arch, J. J., & Carr, A. L. (2016) · Psycho-Oncology · doi:10.1002/pon.4173 · Cited by 45
Go Pro Bono
Pietraszkiewicz, A., Soppe, B., & Formanowicz, M. (2017) · Social Psychology · doi:10.1027/1864-9335/a000319 · Cited by 46
Confusing the Crowd: Task Instruction Quality on Amazon Mechanical Turk
Wu, M., & Quinn, A. J. (2017) · Proceedings of the AAAI Conference on Human Computation and Crowdsourcing · doi:10.1609/hcomp.v5i1.13317 · Cited by 45
Childhood adversity and behavioural addictions: the mediating role of emotion dysregulation and depression in an adult community sample
Lim, M. S. M., Cheung, F. Y.-L., Kho, J. M., & Tang, C. S. (2019) · Addiction Research & Theory · doi:10.1080/16066359.2019.1594203 · Cited by 46
Reducing Organizational Rule Breaking Through Task Variety: How Task Design Supports Deliberative Thinking
Derfler-Rozin, R. R., Moore, C., & Staats, B. R. (2016) · Organization Science · doi:10.1287/orsc.2016.1094 · Cited by 44
Managers are Less Burned-Out at the Top: the Roles of Sense of Power and Self-Efficacy at Different Hierarchy Levels
Korman, J. V., Quaquebeke, N. V., & Tröster, C. (2021) · Journal of Business and Psychology · doi:10.1007/s10869-021-09733-8 · Cited by 56
How impressions of public employees’ warmth and competence influence trust in government
Hansen, F. G. (2021) · International Public Management Journal · doi:10.1080/10967494.2021.1963361 · Cited by 46

Authors: Hauser, D. J., & Schwarz, N.
Affiliations: University of Michigan (US)
University of Southern California (US)
Corresponding author: Hauser, David J.
ORCID: Hauser, David J.
Schwarz, Norbert
Venue: Behavior Research Methods
Publisher: Springer Science and Business Media LLC
Published: 2015-03-12
Volume: 48
Issue: 1
Pages: 400-407
ISSN: 1554-351X (ISSN-L)
1554-3528
DOI: 10.3758/s13428-015-0578-z
OpenAlex: W2076387137
Cited by: 1,739
References: 23
Citations by year: 2026: 60 · 2025: 104 · 2024: 145 · 2023: 180 · 2022: 209 · 2021: 249 · 2020: 248 · 2019: 176 · 2018: 160 · 2017: 122 · 2016: 64 · 2015: 19
FWCI: 184.66
Type: journal article
Language: en
Open access: bronze
doi.org
Licence: www.springer.com/tdm (tdm)
Locations: Behavior Research Methods (publishedVersion)
PubMed (publishedVersion)
Topics: Physical Sciences › Computer Science › Computer Science Applications › Mobile Crowdsensing and Crowdsourcing
Social Sciences › Sociology and Political Science › Survey Methodology and Nonresponse
Social Sciences › Decision Sciences › Management Science and Operations Research › Psychometric Methodologies and Testing
Keywords: Amazon Mechanical Turk, university students
MeSH terms: Attention, Data Collection, Female, Humans, Learning, Male, Surveys and Questionnaires, Social Sciences, Internet

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Attentive Turkers: MTurk participants perform better on online attention checks than do subject pool participants

Abstract

Overview

Integrity signals

Verification

Claims the paper makes

Claims other papers make about this one

Self-check

Citations

Cites

Cited by

Related

Metadata

Record

About these checks