Student or educator? Sign up with your school email and get 6 months of Pro free.
Cited by 324

The DOI matches its Crossref record; 40 of the 40 references it cites were found in a registry or an index.

Got Bots? Practical Recommendations to Protect Online Survey Data from Bot Attacks

Open access
Storozuk, Andie, Ashley, Marilyn, Delage, Véronic, Maloney, Erin A.·2020·The Quantitative Methods for Psychology

Abstract

The Internet has been a popular source of data amongst academic researchers for many years, and for good reason.Online data collection is fast, provides access to hard-to-reach populations, and is often less expensive than in-lab recruitment.With these benefits also come risks, such as duplicate responses or participant inattention, which can significantly reduce data quality.Very recently, researchers have become aware of another concern associated with online data collection.Bots, also known as automatic survey-takers or fraudsters, have begun infiltrating scientific surveys, largely threatening the integrity of academic research conducted online.The aim of this paper is to warn researchers of the threat posed by bots and to highlight practical strategies that can be used to detect and prevent these bots.We first discuss strategies recommended in the literature that we implemented to identify bot responses from online survey data we collected in the past six months.We then share which strategies proved to be most and least effective in detecting bots.Finally, we discuss the implications of bot-generated data for the integrity of online research and the imminent future of bots in online data collection.

Overview

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.20982/tqmp.16.5.p472

Cites

40 of 40 references verified0 citation errors · 0 not checkable

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Show all 40 references

Cited by

See all 324

Metadata

Authors
Storozuk, A., Ashley, M., Delage, V., & Maloney, E. A.
Venue
The Quantitative Methods for Psychology
Published
2020-05-01
Volume
16
Issue
5
Pages
472-481
ISSN
2292-1354 (ISSN-L)
OpenAlex
W3115100653
Cited by
324
References
40
FWCI
26.77
Type
journal article
Language
en
Open access
diamond

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: Got Bots? Practical Recommendations to Protect Online Survey Data from Bot Attacks. https://app.cochat.ai/papers/10.20982/tqmp.16.5.p472
The paper
Storozuk, A., Ashley, M., Delage, V., & Maloney, E. A. (2020). Got Bots? Practical Recommendations to Protect Online Survey Data from Bot Attacks. The Quantitative Methods for Psychology. https://doi.org/10.20982/tqmp.16.5.p472

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.