The DOI matches its Crossref record; 22 of the 22 references it cites were found in a registry or an index.
Best practice recommendations for data screening
Abstract
Survey respondents differ in their levels of attention and effort when responding to items. There are a number of methods researchers may use to identify respondents who fail to exert sufficient effort in order to increase the rigor of analysis and enhance the trustworthiness of study results. Screening techniques are organized into three general categories, which differ in impact on survey design and potential respondent awareness. Assumptions and considerations regarding appropriate use of screening techniques are discussed along with descriptions of each technique. The utility of each screening technique is a function of survey design and administration. Each technique has the potential to identify different types of insufficient effort. An example dataset is provided to illustrate these differences and familiarize readers with the computation and implementation of the screening techniques. Researchers are encouraged to consider data screening when designing a survey, select screening techniques on the basis of theoretical considerations (or empirical considerations when pilot testing is an option), and report the results of an analysis both before and after employing data screening techniques. Copyright © 2014 John Wiley & Sons, Ltd.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Coefficient Alpha and the Internal Structure of Tests
Cronbach, L. J. (1951) · Psychometrika · doi:10.1007/bf02310555 · Cited by 43,931 · cited 1×
“Also, the use of longer scales is associated with higher values for coefficient alpha (Cortina, 1993; Cronbach, 1951; Schmitt, 1996) and higher validities (Credé, Harms, Niehorster & Gaya-Valentine, 2012).”
BackgroundWhat is coefficient alpha? An examination of theory and applications
Cortina, J. M. (1993) · Journal of Applied Psychology · doi:10.1037/0021-9010.78.1.98 · Cited by 8,810 · cited 1×
“Also, the use of longer scales is associated with higher values for coefficient alpha (Cortina, 1993; Cronbach, 1951; Schmitt, 1996) and higher validities (Credé, Harms, Niehorster & Gaya-Valentine, 2012).”
BackgroundOn the generalized distance in statistics
Mahalanobis, P. C. (1936) · DOAJ (DOAJ: Directory of Open Access Journals) · Cited by 6,068
Identifying careless responses in survey data.
Meade, A. W., & Craig, S. B. (2012) · Psychological Methods · doi:10.1037/a0028085 · Cited by 3,865
Least Median of Squares Regression
Rousseeuw, P. J. (1984) · Journal of the American Statistical Association · doi:10.1080/01621459.1984.10477105 · Cited by 3,835
Self-reports: How the questions shape the answers.
Schwarz, N. (1999) · American Psychologist · doi:10.1037/0003-066x.54.2.93 · Cited by 2,846
Uses and abuses of coefficient alpha
Schmitt, N. (1996) · Psychological Assessment · doi:10.1037/1040-3590.8.4.350 · Cited by 2,588
Zinkus, P. W. (1987) · Textbook of Developmental Pediatrics · doi:10.1007/978-1-4613-1797-5_8 · Cited by 1,500
The Social Desirability Variable in Personality Assessment and Research.
Sprott, D. A., & Edwards, A. L. (1959) · Journal of the American Statistical Association · doi:10.2307/2282171 · Cited by 1,491
The Revised NEO Personality Inventory (NEO-PI-R)
Costa, P. T., & McCrae, R. R. (2008) · The SAGE Handbook of Personality Theory and Assessment: Volume 2 — Personality Measurement and Testing · doi:10.4135/9781849200479.n9 · Cited by 1,463
Cited by
Data quality of platforms and panels for online behavioral research
Peer, E., Rothschild, D., Gordon, A., Evernden, Z., & Damer, E. (2021) · Behavior Research Methods · doi:10.3758/s13428-021-01694-3 · Cited by 1,718
Methods for the detection of carelessly invalid responses in survey data
Curran, P. G. (2016) · Journal of Experimental Social Psychology · doi:10.1016/j.jesp.2015.07.006 · Cited by 1,356
Americans’ COVID-19 stress, coping, and adherence to CDC guidelines
Park, C. L., Russell, B. S., Fendrich, M., Finkelstein-Fox, L., Hutchison, M., & Becker, J. (2020) · Journal of General Internal Medicine · doi:10.1007/s11606-020-05898-9 · Cited by 728
Troise, C., Corvello, V., Ghobadian, A., & O'Regan, N. (2022) · Technological Forecasting and Social Change · doi:10.1016/j.techfore.2021.121227 · Cited by 573
A Tale of Two Sample Sources: Do Results from Online Panel Data and Conventional Data Converge?
Walter, S. L., Seibert, S. E., Goering, D., & O’Boyle, E. H. (2019) · Journal of Business and Psychology · doi:10.1007/s10869-018-9552-y · Cited by 544
Amazon mechanical Turk in organizational psychology: an evaluation and practical recommendations
Cheung, J. H., Burns, D. K., Sinclair, R. R., & Sliter, M. (2017) · Journal of Business and Psychology · doi:10.1007/s10869-016-9458-5 · Cited by 474
The vaccine hesitancy scale: Psychometric properties and validation
Shapiro, G. K., Tatar, O., Dube, E., Amsel, R., Knauper, B., Naz, A., Perez, S., & Rosberger, Z. (2018) · Vaccine · doi:10.1016/j.vaccine.2017.12.043 · Cited by 470
Are Attention Check Questions a Threat to Scale Validity?
Kung, F. Y. H., Kwok, N., & Brown, D. J. (2018) · Applied Psychology · doi:10.1111/apps.12108 · Cited by 380
Keith, M. G., Tay, L., & Harms, P. D. (2017) · Frontiers in Psychology · doi:10.3389/fpsyg.2017.01359 · Cited by 319
Self-citationMackey, J. D., Parker Ellen, B., McAllister, C. P., & Alexander, K. C. (2021) · Journal of Business Research · doi:10.1016/j.jbusres.2020.10.037 · Cited by 320
Brill, T. M., Munoz, L., & Miller, R. J. (2019) · Journal of Marketing Management · doi:10.1080/0267257x.2019.1687571 · Cited by 291
Lin, W., Shao, Y., Li, G., Guo, Y., & Zhan, X. (2021) · Journal of Applied Psychology · doi:10.1037/apl0000896 · Cited by 271
Curry, O. S., Jones Chesters, M., & Van Lissa, C. J. (2019) · Journal of Research in Personality · doi:10.1016/j.jrp.2018.10.008 · Cited by 235
Wood, D., Harms, P. D., Lowman, G. H., & DeSimone, J. A. (2017) · Social Psychological and Personality Science · doi:10.1177/1948550617703168 · Cited by 243
Self-citationCareless responding in questionnaire measures: Detection, impact, and remedies
Goldammer, P., Annen, H., Stöckli, P. L., & Jonas, K. (2020) · The Leadership Quarterly · doi:10.1016/j.leaqua.2020.101384 · Cited by 200
Kim, M., & Beehr, T. A. (2018) · Stress and Health · doi:10.1002/smi.2796 · Cited by 81
Economic stress, parenting, and adolescents’ adjustment during the COVID ‐19 pandemic
Low, N., & Mounts, N. S. (2022) · Family Relations · doi:10.1111/fare.12623 · Cited by 69
Using Attachment Theory to Conceptualize and Measure the Experiences in Human-AI Relationships
Yang, F., & Oshio, A. (2025) · Current Psychology · doi:10.1007/s12144-025-07917-6 · Cited by 63
Pay for performance, satisfaction and retention in longitudinal crowdsourced research
Auer, E. M., Behrend, T. S., Collmus, A. B., Landers, R. N., & Miles, A. F. (2021) · PLOS ONE · doi:10.1371/journal.pone.0245460 · Cited by 36
Detecting careless responding in multidimensional forced-choice questionnaires
Kupffer, R., Frick, S., & Wetzel, E. (2024) · Educational and Psychological Measurement · doi:10.1177/00131644231222420 · Cited by 17
Leader Inconsistency, Subjective Ambivalence, and Follower Outcomes
Suurd Ralph, C., & Barling, J. (2023) · Journal of Business and Psychology · doi:10.1007/s10869-022-09852-w · Cited by 16
The More You Know: Sexual Knowledge as a Predictor of Sexual Well-Being
Seifen, T., Shaw, C. M., Smith, C. V., & Johnson, L. R. (2022) · Journal of Sex & Marital Therapy · doi:10.1080/0092623x.2022.2053017 · Cited by 13
Service-learning outcomes measurement scale (S-LOMS) : the user manual
Lingnan University, LAU, K. H., SNELL, R. S., & Lingnan University (2020) · doi:10.14793/9789887522201 · Cited by 9
Metadata
- Authors
- DeSimone, J. A., Harms, P. D., & DeSimone, A. J.
- Venue
- Journal of Organizational Behavior
- Publisher
- Wiley
- Published
- 2014-10-13
- Volume
- 36
- Issue
- 2
- Pages
- 171-181
- ISSN
- 0894-3796 (ISSN-L)
- OpenAlex
- W1928031482
- Cited by
- 679
- References
- 22
- FWCI
- 65.94
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.