Inattentive Responding in MTurk and Other Online Samples

Attention and Effort

Egeth, H. E., & Kahneman, D. J. (1975) · The American Journal of Psychology · doi:10.2307/1421603 · Cited by 6,976

Identifying careless responses in survey data.

Meade, A. W., & Craig, S. B. (2012) · Psychological Methods · doi:10.1037/a0028085 · Cited by 3,865

Researching Internet-Based Populations: Advantages and Disadvantages of Online Survey Research, Online Questionnaire Authoring Software Packages, and Web Survey Services

Wright, K. B. (2006) · Journal of Computer-Mediated Communication · doi:10.1111/j.1083-6101.2005.tb00259.x · Cited by 2,550

Introduction to Measurement Theory

Allen, M. J. (1979) · Cited by 2,124

Detecting and Deterring Insufficient Effort Responding to Surveys

Huang, J. L. W., Curran, P. G., Keeney, J., Poposki, E. M., & DeShon, R. P. (2011) · Journal of Business and Psychology · doi:10.1007/s10869-011-9231-8 · Cited by 1,315

An inconvenient truth: Arbitrary distinctions between organizational, mechanical Turk, and other convenience samples

Landers, R. N., & Behrend, T. S. (2015) · Industrial and Organizational Psychology · doi:10.1017/iop.2015.13 · Cited by 714

Factors Defined by Negatively Keyed Items: The Result of Careless Respondents?

Schmitt, N., & Stuits, D. M. (1985) · Applied Psychological Measurement · doi:10.1177/014662168500900405 · Cited by 536

Careless Responding to Reverse-Worded Items: Implications for Confirmatory Factor Analysis

Woods, C. M. (2006) · Journal of Psychopathology and Behavioral Assessment · doi:10.1007/s10862-005-9004-7 · Cited by 402

Evidence for response bias as a source of error variance in applied assessment.

McGrath, R. E., Mitchell, M., Kim, B. H., & Hough, L. (2010) · Psychological Bulletin · doi:10.1037/a0019216 · Cited by 282

MMPI-2 random responding indices: Validation using a self-report methodology.

Berry, D. T. R., Wetter, M. W., Baer, R. A., Larsen, L. H., Clark, C. D., & Monroe, K. (1992) · Psychological Assessment · doi:10.1037/1040-3590.4.3.340 · Cited by 177

Further validation of the Digital Communication Empathy Scale (DCES)

Collins, A. M., Warburton, W., Sweller, N., & Bussey, K. (2025) · Computers in Human Behavior Reports · doi:10.1016/j.chbr.2025.100721 · Cited by 4

Development of the Gay Male Heterophobia Scale.

Provence, M. M., Parent, M. C., Rochlen, A. B., & Chester, M. R. (2018) · Psychology of Men & Masculinity · doi:10.1037/men0000158 · Cited by 4

Robot Comedy (is) Special: A Surprising Lack of Bias for Gendered Robotic Comedians

Raghunath, N., Sanchez, C. A., & Fitter, N. T. (2022) · Lecture notes in computer science · doi:10.1007/978-3-031-24670-8_58 · Cited by 4

Empirical Methods in the Social Science for Researching Socially Interactive Agents

Pütten, A. M. R.-V. D., & Abrams, A. M. H. (2021) · ACM eBooks · doi:10.1145/3477322.3477325 · Cited by 4

Building a Fully-Automatized Active Learning Framework for the Semantic Segmentation of Geospatial 3D Point Clouds

Kölle, M., Walter, V., & Sörgel, U. (2024) · PFG – Journal of Photogrammetry Remote Sensing and Geoinformation Science · doi:10.1007/s41064-024-00281-3 · Cited by 6

Fear of Failure as Motivation: A Novel Conceptualization and Measure

Boileau, L., Gaudreau, P., & Pétrin‐Pomerleau, P. (2025) · Journal of Personality Assessment · doi:10.1080/00223891.2025.2555358 · Cited by 3

A commentary on: “Creating agile organizations through IT: The influence of IT service climate on IT service quality and IT agility”

Jia, R., Reich, B. H., & Jia, H. H. (2016) · The Journal of Strategic Information Systems · doi:10.1016/j.jsis.2016.06.001 · Cited by 3

Psychometric properties of a measure to assess beliefs about modifiable behavior and emotional distress

Zimmermann, M., Chong, A. K., Vechiu, C., & Papa, A. (2020) · Mental Health & Prevention · doi:10.1016/j.mhp.2020.200188 · Cited by 3

A multi-method approach to the detection of fabricated symptoms

Boskovic (2019) · Research Publications (Maastricht University) · doi:10.26481/dis.20190129ib · Cited by 4

Can we trust online crowdworkers? Comparing online and offline participants in a preference test of virtual agentsPreprint

Jonell, P., Kucherenko, T., Torre, I., & Beskow, J. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2009.10760 · Cited by 3

Assessing Mental Health During Covid-19 Lockdown: A Smartphone-Based Multimodal Emotion Recognition Approach

Liu, I., Zhong, Q., Liu, F., Xu, H., Chen, W., Zhu, X., Ma, Y., & Ni, S. (2022) · International Symposium of Chinese CHI (Chinese CHI) · doi:10.1145/3565698.3565795 · Cited by 3

Detecting Moral Emotions with Facial and Vocal Expressions: A Multimodal Emotion Recognition Approach

Liu, I., Li, S., Ma, D., Luan, J., Wu, X., Liu, F., Shen, Y., & Ni, S. (2024) · IEEE International Conference on Human-Machine Systems (ICHMS) · doi:10.1109/ichms59971.2024.10555674 · Cited by 2

When identification with your group matters: leader consultation in response to constructive follower voice

Nieberle, K. W., Schyns, B., Kuonath, A., & Frey, D. (2024) · European Journal of Work and Organizational Psychology · doi:10.1080/1359432x.2024.2392901 · Cited by 4

Stereotype content of players of violent and non‐violent games

Miriyagalla, U. P., Kashima, E. S., & Stukas, A. A. (2022) · Asian Journal Of Social Psychology · doi:10.1111/ajsp.12558 · Cited by 2

Individual Differences in Females’ Adherence to Public Health Measures and Psychopathology Symptoms During a Global Health Crisis: the Role of Triarchic Psychopathic Traits

Machado, G. M., Perkins, E. R., Gerodo, T. P., de Miranda, J. V. M., Sica, C., Patrick, C. J., & Carvalho, L. D. F. (2023) · The Journal of Behavioral Health Services & Research · doi:10.1007/s11414-023-09858-z · Cited by 2

Problematic personality correlations associated with gist reading, financial pressure, and rejection fears

Jones, D. N., Taylor, T. D. A., & Hanna, A. (2023) · Personality and Individual Differences · doi:10.1016/j.paid.2023.112450 · Cited by 2

Conducting Survey Research Using MTurk

Chambers, S., & Nimon, K. (2019) · IGI Global eBooks · doi:10.4018/978-1-5225-8362-2.ch022 · Cited by 2

Conducting Survey Research Using MTurk

Chambers, S., & Nimon, K. (2019) · IGI Global eBooks · doi:10.4018/978-1-5225-8182-6.ch033 · Cited by 2

The Effect of Embedded Lies on the Verbal Quality of Statements and Implications for Credibility Assessment

Verigin, B. L. (2020) · doi:10.26481/dis.20200622bv · Cited by 2

Using a foreign language does not make you think more: Null effects of using a foreign language on cognitive reflection and numeracyPreprint

Milczarski, W., Borkowska, A., Paruzel‐Czachura, M., & Białek, M. (2022) · PsyArXiv (OSF Preprints) · doi:10.31234/osf.io/wbjyc · Cited by 2

Sociosexuality is associated with disease avoidance tendencies and can decrease during a real-life disease threat

Sevi, B., & Shook, N. J. (2024) · Current Psychology · doi:10.1007/s12144-024-07139-2 · Cited by 1

Assessing Occupational Burnout in Psychiatric Professionals Using Multimodal Emotion Recognition Methods

Li, H., Luo, J., Zhong, Q., Duan, Y., & Liu, I. (2025) · IEEE International Conference on Human-Machine Systems (ICHMS) · doi:10.1109/ichms65439.2025.11154192 · Cited by 1

Interacting with Sensor Data to Understand Uncertainty in Air Quality Monitoring

Pondaven, E., Liu, Z., Eri Saikawa, B., Jacques, J. T., & Williams, K. (2025) · International Conference on ICT for Sustainability (ICT4S) · doi:10.1109/ict4s68164.2025.00029 · Cited by 1

Comparing the Convenience, Data Quality, Generalizability, and Outcomes of Student‐ and MTurk‐Generated Data in an Experimental Vignette Rape Perception Study

George, S. S., & Arhin, E. O. (2026) · Behavioral Sciences & the Law · doi:10.1002/bsl.70039 · Cited by 1

Sensemaking and AI: Unraveling individuals' reactions to the black box in a three-study investigation

Prisco, D. D., & Russo, S. D. (2026) · Technological Forecasting and Social Change · doi:10.1016/j.techfore.2025.124491 · Cited by 1

Who’s Evaluating Whom? The Public Evaluation of Public and Private Leaders’ Unethical Behaviors

Jung, J. (2020) · Cited by 1

A Study on the Relationship Between Academic Ostracism and Organizational Power Sources in Higher Education

Karadağ, E. (2021) · Journal of Higher Education and Science · doi:10.5961/jhes.2021.455 · Cited by 1

Do Proximal Risk Factors Mediate the Impact of Affect on Symptoms of Generalized Anxiety Disorder and Major Depressive Disorder? An Extension of the Hierarchical Model of Cognitive Vulnerability

Koscinski, B., & Allan, N. P. (2022) · Psychopathology · doi:10.1159/000527300 · Cited by 1

Validating the Revised Mating Effort Questionnaire

Albert, G. O., Davis, A. C., Bird, B. M., Arnocky, S. A., Hlay, J. K., Mcgee, N. D., Richardson, G. B., & Hodges‐Simeon, C. R. (2024) · Archives of Sexual Behavior · doi:10.1007/s10508-023-02793-2 · Cited by 1

How learning and legitimacy goals influence inter-firm imitation in R&D investment decisions

Mazzelli, A., & Foss, N. J. (2025) · BRQ Business Research Quarterly · doi:10.1177/23409444251320401 · Cited by 1

Recognition of a Robot’s Affective Expressions Under Conditions with Limited Visibility

Ghafurian, M., Akgun, S. A., Crowley, M., & Dautenhahn, K. (2021) · Lecture notes in computer science · doi:10.1007/978-3-030-85613-7_31 · Cited by 1

Developing an Automation Locus of Control Scale

Edwards, M. (2019) · Cited by 1

A Multi-Study Examination of the Role of Values in the Venture Legitimation Process in the Sharing Economy: A Values Work Perspective

McSweeney, J. J. (2018)

Gamification and behaviour change: Understanding the mechanism and its implications for social marketing

Mitchell, R. (2020) · Queensland University of Technology · doi:10.5204/thesis.eprints.201658

Good for the Many or Best for the Few? A Dilemma in the Design of Algorithmic AdvicePreprint

Dove, G., Balestra, M., Mann, D., & Nov, O. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2008.12147

Call for Papers for Special Issues of International Journal of Market Research: ‘Research for Development’

(2019) · International Journal of Market Research · doi:10.1177/1470785319870622

A Primer for Conducting Survey Research Using MTurk

Chambers, S., Nimon, K., & Anthony-McMann, P. E. (2019) · IGI Global eBooks · doi:10.4018/978-1-5225-8362-2.ch038

Using a foreign language does not promote more effortful thinking: evidence from null effects on numeracyPreprint

Milczarski, W., Borkowska, A., Paruzel‐Czachura, M., & Białek, M. (2022) · doi:10.31219/osf.io/n3pca

Trait-Based Segmentation for Mobile Personalization and Privacy Concerns: A Cluster Analysis Based on Need for Cognitive Closure

Quach, X. (2023) · doi:10.32920/24084885

Trait-Based Segmentation for Mobile Personalization and Privacy Concerns: A Cluster Analysis Based on Need for Cognitive Closure

Quach, X. (2023) · doi:10.32920/24084885.v1

Are customers naturally attracted to brands? A core social motives scale for measuring brand engagement

Llanos-Herrera, G. R. (2024) · Kybernetes · doi:10.1108/k-12-2023-2622

Work Orientation's Impact on Layperson Ratings of Creativity, Intelligence, Conscientiousness, and Hiring Likelihood

Zheng, M., Miroshnik, K. G., & Kaufman, J. C. (2025) · The Journal of Creative Behavior · doi:10.1002/jocb.70050

Detecting Nurse Burnout with Multi-Modal Large Language Models: A Feasibility Study

Luo, J., Duan, Y., Li, H., & Liu, I. (2025) · IEEE International Conference on Human-Machine Systems (ICHMS) · doi:10.1109/ichms65439.2025.11154274

Matching your way to Success: The Influence of Motivational Frame Matching on Interaction Outcomes and Reciprocal Matching

Sjöberg, M. P., Taylor, P. J., & Conchie, S. M. (2025) · European Journal of Social Psychology · doi:10.1002/ejsp.70039

Implied motion but real effect : how implied motion influences consumers’ attention, evaluation, and purchase-related behavior

Yu, J. (2022) · theses.fr (ABES) · doi:10.70675/4480c5d1z2c55z441dzabf5zf5f465695469

Why Gen Z cares about information sources on social media: the ways they share corporate misbehavior and good behavior

Jung, H., Kim, H., & Bae, J. (2026) · Electronic Commerce Research · doi:10.1007/s10660-026-10145-0

Physical activity awareness and its relationship with motivation among college students: development and validation of a Multidimensional Scale

Shangguan, R., Xie, J., & Hamilton, X. D. (2026) · Frontiers in Public Health · doi:10.3389/fpubh.2026.1856461

You should be angry, too! The importance of expressive arousal in response to high-arousal consumer complaints

Cummings, K. H., & Yule, J. A. (2026) · Journal of Business Research · doi:10.1016/j.jbusres.2026.116472

A Material-Relational Ontology of Data: Addressing Ethical Challenges in Psychological Research in a Data-Driven Era

Fabricius, A., Yen, J., O’Doherty, K. C., & Goldenberg, M. J. (2026) · Perspectives on Psychological Science · doi:10.1177/17456916261471511

Development and validation of a sociocultural influences on diet questionnaire

Oslund, J. L., Chui, K., Dao, M. C., Das, S. K., Messer, E., Taylor, S. F., & Roberts, S. B. (2026) · American Journal of Clinical Nutrition · doi:10.1016/j.ajcnut.2026.101549

The Future of Entrepreneurship Research Includes Online Panel Data—If Used Correctly

Pollack, J. M., Gish, J. J., Michaelis, T. L., Burnette, J. L., Scheaf, D. J., Carr, J. C., & Smith, N. A. (2026) · Entrepreneurship Theory and Practice · doi:10.1177/10422587261496321

Cognitive Effects of Inattentive Responding in an MTurk Sample

Pyo, J., & Maxfield, M. G. (2021) · Social Science Quarterly · doi:10.1111/ssqu.12954 · Cited by 23

Caution! MTurk Workers Ahead—Fines Doubled

Harms, P. D., & DeSimone, J. A. (2015) · Industrial and Organizational Psychology · doi:10.1017/iop.2015.23 · Cited by 109

Insufficient Effort Responding on Mturk Surveys: Evidence-Based Quality Control for Organizational Research

Cyr, L. (2000) · doi:10.15760/etd.6337

Data collection in a flat world: the strengths and weaknesses of Mechanical Turk samples

Goodman, J. K., Cryder, C. E., & Cheema, A. (2013) · Journal of Behavioral Decision Making · doi:10.1002/bdm.1753 · Cited by 2,242

How serious is the ‘carelessness’ problem on Mechanical Turk?

Aruguete, M. S., Huynh, H. P., Browne, B. L., Jurs, B. S., Flint, E., & McCutcheon, L. E. (2019) · International Journal of Social Research Methodology · doi:10.1080/13645579.2018.1563966 · Cited by 89