The DOI matches its Crossref record.
Mechanisms for Data Quality and Validation in Citizen Science
Abstract
Data quality is a primary concern for researchers employing a public participation in scientific research (PPSR) or "citizen science'' approach. This mode of scientific collaboration relies on contributions from a large, often unknown population of volunteers with variable expertise. In a survey of PPSR projects, we found that most projects employ multiple mechanisms to ensure data quality and appropriate levels of validation. We created a framework of 18 mechanisms commonly employed by PPSR projects for ensuring data quality, based on direct experience of the authors and a review of the survey data, noting two categories of sources of error (protocols, participants) and three potential intervention points (before, during and after participation), which can be used to guide project design.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cited by
Citizen science and the United Nations Sustainable Development Goals
Fritz, S., See, L., Carlson, T., Haklay, M., Oliver, J. L., Fraisl, D., Mondardini, R., Brocklehurst, M., Shanley, L. A., Schade, S., et al. (2019) · Nature Sustainability · doi:10.1038/s41893-019-0390-3 · Cited by 632
Statistical solutions for error and bias in global citizen science datasets
Bird, T. J., Bates, A. E., Lefcheck, J. S., Hill, N. A., Thomson, R. J., Edgar, G. J., Stuart-Smith, R. D., Wotherspoon, S., Krkosek, M., Stuart-Smith, J. F., et al. (2014) · Biological Conservation · doi:10.1016/j.biocon.2013.07.037 · Cited by 562
Citizen science in environmental and ecological sciences
Fraisl, D., Hager, G., Bedessem, B., Gold, M., Hsing, P.-Y., Danielsen, F., Hitchcock, C. B., Hulbert, J. M., Piera, J., Spiers, H., et al. (2022) · Nature Reviews Methods Primers · doi:10.1038/s43586-022-00144-4 · Cited by 475
An Analysis of Citizen Science Based Research: Usage and Publication Patterns
Follett, R., & Strezov, V. (2015) · PLOS ONE · doi:10.1371/journal.pone.0143687 · Cited by 402
The Accuracy of Citizen Science Data: A Quantitative Review
Aceves‐Bueno, E., Adeleye, A. S., Feraud, M., Huang, Y., Tao, M., Yang, Y., & Anderson, S. E. (2017) · The Bulletin of the Ecological Society of America · doi:10.1002/bes2.1336 · Cited by 338
Citizen science and wildlife biology: Synergies and challenges
Frigerio, D., Pipek, P., Kimmig, S., Winter, S., Melzheimer, J., Diblíková, L., Wachter, B., & Richter, A. (2018) · Ethology · doi:10.1111/eth.12746 · Cited by 86
Designing Ground Truth and the Social Life of Labels
Muller, M., Wolf, C. T., Andres, J., Desmond, M., Joshi, N. N., Ashktorab, Z., Sharma, A., Brimijoin, K., Pan, Q., Duesterwald, E., et al. (2021) · Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3411764.3445402 · Cited by 83
Free as in puppies: compensating for ict constraints in citizen science
Wiggins, A. (2013) · Proceedings of the 2013 conference on Computer supported cooperative work · doi:10.1145/2441776.2441942 · Cited by 44
Self-citationStudy on the Data Management of Citizen Science: From the Data Life Cycle Perspective
Shwe, K. M. (2020) · Data and Information Management · doi:10.2478/dim-2020-0019 · Cited by 7
Metadata
- Authors
- Wiggins, A., Newman, G., Stevenson, R. D., & Crowston, K.
- Venue
- 2011 IEEE Seventh International Conference on e-Science Workshops
- Publisher
- IEEE
- Published
- 2011-12
- Pages
- 14-19
- OpenAlex
- W2541120129
- Cited by
- 220
- References
- 0
- FWCI
- 5.09
- Type
- conference paper
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.