Detecting, Preventing, and Responding to “Fraudsters” in Internet Research: Ethics and Tradeoffs
Open accessThe DOI matches its Crossref record; 32 of the 32 references it cites were found in a registry or an index.
Abstract
Research that recruits and surveys participants online is increasing, but is subject to fraud whereby study respondents — whether eligible or ineligible — participate multiple times. Online Internet research can provide investigators with large sample sizes and is cost efficient. Internet-based research also provides distance between the researchers and participants, allowing the participant to remain confidential and/or anonymous, and thus to respond to questions freely and honestly without worrying about the stigma associated with their answers. However, increasing and recurring instances of fraudulent activity among subjects raise challenges for researchers and Institutional Review Boards (IRBs). The distance from participants, and the potential anonymity and convenience of online research allow for individuals to participate easily more than once, skewing results and the overall quality of the data.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Gosling, S. D., Vazire, S., Srivastava, S., & John, O. P. (2004) · American Psychologist · doi:10.1037/0003-066x.59.2.93 · Cited by 2,932
CAPTCHA: Using Hard AI Problems for Security
von Ahn, L., Blum, M., Hopper, N. J., & Langford, J. (2003) · Lecture Notes in Computer Science · doi:10.1007/3-540-39200-9_18 · Cited by 1,447
Social desirability bias: A neglected aspect of validity testing
King, M. F., & Bruner, G. C. (2000) · Psychology and Marketing · doi:10.1002/(sici)1520-6793(200002)17:2<79::aid-mar2>3.0.co;2-0 · Cited by 1,067
Broken Promises of Privacy: Responding to the Surprising Failure of AnonymizationPreprint
Ohm, P. (2009) · SSRN Electronic Journal · Cited by 997
Kraut, R., Olson, J., Banaji, M., Bruckman, A., Cohen, J., & Couper, M. (2004) · American Psychologist · doi:10.1037/0003-066x.59.2.105 · Cited by 924
The social desirability response bias in ethics research
Randall, D. M., & Fernandes, M. F. (1991) · Journal of Business Ethics · doi:10.1007/bf00383696 · Cited by 878
Human Research and Data Collection via the Internet
Birnbaum, M. H. (2004) · Annual Review of Psychology · doi:10.1146/annurev.psych.55.090902.141601 · Cited by 869
Standards for Internet-Based Experimenting
Reips, U. (2002) · Experimental Psychology (formerly Zeitschrift für Experimentelle Psychologie) · doi:10.1026/1618-3169.49.4.243 · Cited by 642
Web-based Questionnaires: The Future in Epidemiology?
van Gelder, M. M. H. J., Bretveld, R. W., & Roeleveld, N. (2010) · American Journal of Epidemiology · doi:10.1093/aje/kwq291 · Cited by 580
Standards for Internet-Based Experimenting
Reips, U.-D. (2002) · Experimental Psychology · doi:10.1026//1618-3169.49.4.243 · Cited by 554
Cited by
Got Bots? Practical Recommendations to Protect Online Survey Data from Bot Attacks
Storozuk, A., Ashley, M., Delage, V., & Maloney, E. A. (2020) · The Quantitative Methods for Psychology · doi:10.20982/tqmp.16.5.p472 · Cited by 324
Ensuring survey research data integrity in the era of internet bots
Griffin, M., Martino, R. J., LoSchiavo, C., Comer-Carruthers, C., Krause, K. D., Stults, C. B., & Halkitis, P. N. (2022) · Quality & Quantity · doi:10.1007/s11135-021-01252-1 · Cited by 314
Pozzar, R., Hammer, M. J., Underhill-Blazey, M., Wright, A. A., Tulsky, J. A., Hong, F., Gundersen, D. A., & Berry, D. L. (2020) · Journal of Medical Internet Research · doi:10.2196/23021 · Cited by 314
“• Use a data collection platform with fraud prevention and detection features (eg, Qualtrics) [21-23,32] • Use automated invitations to send each respondent a unique link to the data collection instrument [25] • Ask respondents to identify where they heard about the study [25] • Require respondents to pass a CAPTCHA […”
BackgroundMethodInfluentialBisdas, S., Topriceanu, C.-C., Zakrzewska, Z., Irimia, A.-V., Shakallis, L., Subhash, J., Casapu, M.-M., Leon-Rojas, J., Pinto dos Santos, D., Andrews, D. M., et al. (2021) · Frontiers in Public Health · doi:10.3389/fpubh.2021.795284 · Cited by 232
“To prevent fraudulent responses a series of security measures were implemented (17): (1) the responses were limited to one only; (2) Completely Automated Public Turing test to tell Computers and Humans Apart (CAPTCHA) script was created and implemented into the Google Form; (3) students were…”
Gordon, J. R., Baik, S. H., Schwartz, K. T. G., & Wells, K. J. (2019) · LGBT Health · doi:10.1089/lgbt.2018.0204 · Cited by 39
“Studies that rely on online surveys should consider the risks of Internet survey fraud and take steps to prevent and detect fraudulent responding (see ref.(68)).”
BackgroundInnovations in research with transgender and gender nonconforming people and their communities.
dickey, L. M., Hendricks, M. L., & Bockting, W. O. (2016) · Psychology of Sexual Orientation and Gender Diversity · doi:10.1037/sgd0000158 · Cited by 34
Self-citationPuga, F., Wang, D., Rafford, M., Poe, A., & Pickering, C. E. Z. (2023) · Aging & Mental Health · doi:10.1080/13607863.2022.2116392 · Cited by 33
“Online recruitment followed a three-step authentication process for enrollment to ensure valid and legitimate participants (Teitcher et al., 2015).”
MethodA social media intervention for cannabis use among emerging adults: randomized controlled trial
Bonar, E. E., Goldstick, J. E., Chapman, L., Bauermeister, J. A., Young, S. D., McAfee, J., & Walton, M. A. (2022) · Drug and Alcohol Dependence · doi:10.1016/j.drugalcdep.2022.109345 · Cited by 32
Self-citationUnderstanding fraudulence in online qualitative studies: From the researcher's perspective
Panicker, A., Nurain, N., Ibrahim, Z., Wang, C.-H. (., Ha, S. W., Wu, Y., Connelly, K., Siek, K. A., & Chung, C.-F. (2024) · Proceedings of the CHI Conference on Human Factors in Computing Systems · doi:10.1145/3613904.3642732 · Cited by 31
Bonar, E. E., Bauermeister, J. A., Blow, F. C., Bohnert, A. S. B., Bourque, C., Coughlin, L. N., Davis, A. K., Florimbio, A. R., Goldstick, J. E., Wisnieski, D. M., et al. (2022) · Drug and Alcohol Dependence · doi:10.1016/j.drugalcdep.2022.109532 · Cited by 23
Detecting careless responding in multidimensional forced-choice questionnaires
Kupffer, R., Frick, S., & Wetzel, E. (2024) · Educational and Psychological Measurement · doi:10.1177/00131644231222420 · Cited by 17
“The detection of such responses is described elsewhere (e.g., Dupuis et al., 2019; Teitcher et al., 2015).”
Nielsen, T. (2017) · Dreaming · doi:10.1037/drm0000051 · Cited by 10
“Although the likelihood of outright fraud in our study was minimized by an absence of financial incentives (Teitcher et al., 2015), our Website likely attracted individuals with an interest in dreams and nightmares.”
BackgroundSchuette, S. A., Andrade, F. C., Woodward, J. T., & Smoski, M. J. (2023) · Journal of Health Psychology · doi:10.1177/13591053231185549 · Cited by 7
“A final limitation is that data were collected online and online data collection is subject to unique validity concerns (Teitcher et al., 2015).”
Background
Metadata
- Authors
- Teitcher, J. E. F., Bockting, W. O., Bauermeister, J. A., Hoefer, C. J., Miner, M. H., & Klitzman, R. L.
- Venue
- Journal of Law, Medicine & Ethics
- Publisher
- Cambridge University Press (CUP)
- Published
- 2015
- Volume
- 43
- Issue
- 1
- Pages
- 116-133
- ISSN
- 1073-1105 (ISSN-L)
- 1748-720X
- OpenAlex
- W2117633598
- Cited by
- 542
- References
- 32
- FWCI
- 45.40
- Type
- journal article
- Language
- en
- Open access
- bronze
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.