The DOI matches its Crossref record; 87 of the 87 references it cites were found in a registry or an index.
Statistical solutions for error and bias in global citizen science datasets
Open accessAbstract
Networks of citizen scientists (CS) have the potential to observe biodiversity and species distributions at global scales. Yet the adoption of such datasets in conservation science may be hindered by a perception that the data are of low quality. This perception likely stems from the propensity of data generated by CS to contain greater levels of variability (e.g., measurement error) or bias (e.g., spatio-temporal clustering) in comparison to data collected by scientists or instruments. Modern analytical approaches can account for many types of error and bias typical of CS datasets. It is possible to (1) describe how pseudo-replication in sampling influences the overall variability in response data using mixed-effects modeling, (2) integrate data to explicitly model the sampling process and account for bias using a hierarchical modeling framework, and (3) examine the relative influence of many different or related explanatory factors using machine learning tools. Information from these modeling approaches can be used to predict species distributions and to estimate biodiversity. Even so, achieving the full potential from CS projects requires meta-data describing the sampling process, reference data to allow for standardization, and insightful modeling suitable to the question of interest.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
R: A Language and Environment for Statistical Computing
R Core Team (2025) · doi:10.32614/r.manuals · Cited by 352,181
Mixed effects models and extensions in ecology with R
Zuur, A. F., Ieno, E. N., Walker, N., Saveliev, A. A., & Smith, G. M. (2009) · Statistics for Biology and Health · doi:10.1007/978-0-387-87458-6 · Cited by 17,963
Maximum entropy modeling of species geographic distributions
Phillips, S. J., Anderson, R. P., & Schapire, R. E. (2006) · Ecological Modelling · doi:10.1016/j.ecolmodel.2005.03.026 · Cited by 15,396
Novel methods improve prediction of species’ distributions from occurrence data
Elith*, J., H. Graham*, C., P. Anderson, R., Dudík, M., Ferrier, S., Guisan, A., J. Hijmans, R., Huettmann, F., R. Leathwick, J., Lehmann, A., et al. (2006) · Ecography · doi:10.1111/j.2006.0906-7590.04596.x · Cited by 9,088
Generalized linear mixed models: a practical guide for ecology and evolution
Bolker, B. M., Brooks, M. E., Clark, C. J., Geange, S. W., Poulsen, J. R., Stevens, M. H. H., & White, J.-S. S. (2009) · Trends in Ecology & Evolution · doi:10.1016/j.tree.2008.10.008 · Cited by 8,910
A protocol for data exploration to avoid common statistical problems: Data exploration
Zuur, A. F., Ieno, E. N., & Elphick, C. S. (2010) · Methods in Ecology and Evolution · doi:10.1111/j.2041-210x.2009.00001.x · Cited by 8,228
Brown, R. A., Hastie, T. J., & Tibshirani, R. J. (1991) · Biometrics · doi:10.2307/2532174 · Cited by 8,176
Koyak, R. A., Hastie, T. J., & Tibshirani, R. J. (1991) · Journal of the American Statistical Association · doi:10.2307/2290538 · Cited by 7,596
A working guide to boosted regression trees
Elith, J., Leathwick, J. R., & Hastie, T. (2008) · Journal of Animal Ecology · doi:10.1111/j.1365-2656.2008.01390.x · Cited by 6,484
Gotelli, N. J., & Colwell, R. K. (2001) · Ecology Letters · doi:10.1046/j.1461-0248.2001.00230.x · Cited by 6,420
WinBUGS - A Bayesian modelling framework: Concepts, structure, and extensibility
Lunn, D. J., Thomas, A., Best, N., & Spiegelhalter, D. (2000) · Statistics and Computing · doi:10.1023/a:1008929526011 · Cited by 5,368
Random forests for classification in ecology
Cutler, D. R., Edwards, T. C., Beard, K. H., Cutler, A., Hess, K. T., Gibson, J., & Lawler, J. J. (2007) · Ecology · doi:10.1890/07-0539.1 · Cited by 4,950
Chao, A., Gotelli, N. J., Hsieh, T. C., Sander, E. L., Ma, K. H., Colwell, R. K., & Ellison, A. M. (2014) · Ecological Monographs · doi:10.1890/13-0133.1 · Cited by 4,256
F. Dormann, C., M. McPherson, J., B. Araújo, M., Bivand, R., Bolliger, J., Carl, G., G. Davies, R., Hirzel, A., Jetz, W., Daniel Kissling, W., et al. (2007) · Ecography · doi:10.1111/j.2007.0906-7590.05171.x · Cited by 3,433
CLASSIFICATION AND REGRESSION TREES: A POWERFUL YET SIMPLE TECHNIQUE FOR ECOLOGICAL DATA ANALYSIS
De'ath, G., & Fabricius, K. E. (2000) · Ecology · doi:10.1890/0012-9658(2000)081[3178:cartap]2.0.co;2 · Cited by 3,167
Hastie, T., & Tibshirani, R. (2014) · Wiley StatsRef: Statistics Reference Online · doi:10.1002/9781118445112.stat03141 · Cited by 3,156
Phillips, S. J., Dudík, M., Elith, J., Graham, C. H., Lehmann, A., Leathwick, J., & Ferrier, S. (2009) · Ecological Applications · doi:10.1890/07-2153.1 · Cited by 2,996
Selecting pseudo‐absences for species distribution models: how, where and how many?
Barbet‐Massin, M., Jiguet, F., Albert, C. H., & Thuiller, W. (2012) · Methods in Ecology and Evolution · doi:10.1111/j.2041-210x.2011.00172.x · Cited by 2,716
Functional diversity: back to basics and looking forward
Petchey, O. L., & Gaston, K. J. (2006) · Ecology Letters · doi:10.1111/j.1461-0248.2006.00924.x · Cited by 2,571
Citizen Science: A Developing Tool for Expanding Science Knowledge and Scientific Literacy
Bonney, R., Cooper, C. B., Dickinson, J., Kelling, S., Phillips, T., Rosenberg, K. V., & Shirk, J. (2009) · BioScience · doi:10.1525/bio.2009.59.11.9 · Cited by 2,529
Zuur, A. F., Ieno, E. N., & Smith, G. M. (2007) · Statistics for Biology and Health · doi:10.1007/978-0-387-45972-1 · Cited by 2,437
Occupancy Estimation and Modeling. Inferring patterns and dynamics of species occurrence
Yoccoz, N. G. (2006) · Wildlife Biology · doi:10.2981/0909-6396(2006)12[450:oeamip]2.0.co;2 · Cited by 2,300
Coverage‐based rarefaction and extrapolation: standardizing samples by completeness rather than size
Chao, A., & Jost, L. (2012) · Ecology · doi:10.1890/11-1952.1 · Cited by 2,213
A new dawn for citizen science
Silvertown, J. (2009) · Trends in Ecology & Evolution · doi:10.1016/j.tree.2009.03.017 · Cited by 2,183
Robust variance estimation in meta‐regression with dependent effect size estimates
Hedges, L. V., Tipton, E., & Johnson, M. C. (2010) · Research Synthesis Methods · doi:10.1002/jrsm.5 · Cited by 2,086
eBird: A citizen-based bird observation network in the biological sciences
Sullivan, B. L., Wood, C. L., Iliff, M. J., Bonney, R. E., Fink, D., & Kelling, S. (2009) · Biological Conservation · doi:10.1016/j.biocon.2009.05.006 · Cited by 2,017
Advances in Neural Information Processing Systems 18
Murray, I., Mackay, D., Zoubin Ghahramani, A., & Skilling, J. (2006) · Cited by 1,927
Citizen Science as an Ecological Research Tool: Challenges and Benefits
Dickinson, J. L., Zuckerberg, B., & Bonter, D. N. (2010) · Annual Review of Ecology, Evolution, and Systematics · doi:10.1146/annurev-ecolsys-102209-144636 · Cited by 1,914
Occupancy Estimation and Modeling: Inferring Patterns and Dynamics of Species Occurrence
MacKenzie, D. I. (2005) · Cited by 1,878
Mixed Effects Models and Extensions in Ecology with R
Militino, A. F. (2010) · Journal of the Royal Statistical Society Series A: Statistics in Society · doi:10.1111/j.1467-985x.2010.00663_9.x · Cited by 1,657
Mapping Species Distributions: Spatial Inference and Prediction
Franklin, J. (2010) · doi:10.1017/cbo9780511810602 · Cited by 1,534
Standardizing catch and effort data: a review of recent approaches
Maunder, M. N., & Punt, A. E. (2004) · Fisheries Research · doi:10.1016/j.fishres.2004.08.002 · Cited by 1,336
Royle, J. A., & Dorazio, R. M. (2008) · Cited by 1,155
Distorted Views of Biodiversity: Spatial and Temporal Bias in Species Occurrence Data
Boakes, E. H., McGowan, P. J. K., Fuller, R. A., Chang-qing, D., Clark, N. E., O'Connor, K., & Mace, G. M. (2010) · PLoS Biology · doi:10.1371/journal.pbio.1000385 · Cited by 824
Machine Learning Methods Without Tears: A Primer for Ecologists
Olden, J. D., Lawler, J. J., & Poff, N. L. (2008) · The Quarterly Review of Biology · doi:10.1086/587826 · Cited by 823
Presence‐only modelling using MAXENT: when can we trust the inferences?
Yackulic, C. B., Chandler, R., Zipkin, E. F., Royle, J. A., Nichols, J. D., Campbell Grant, E. H., & Veran, S. (2013) · Methods in Ecology and Evolution · doi:10.1111/2041-210x.12004 · Cited by 752
Spatial modelling of biodiversity at the community level
FERRIER, S., & GUISAN, A. (2006) · Journal of Applied Ecology · doi:10.1111/j.1365-2664.2006.01149.x · Cited by 741
From Conservation to Crowdsourcing: A Typology of Citizen Science
Wiggins, A., & Crowston, K. (2011) · 2011 44th Hawaii International Conference on System Sciences · doi:10.1109/hicss.2011.207 · Cited by 700
The consequences of spatial structure for the design and analysis of ecological field surveys
Legendre, P., Dale, M. R. T., Fortin, M., Gurevitch, J., Hohn, M., & Myers, D. (2002) · Ecography · doi:10.1034/j.1600-0587.2002.250508.x · Cited by 675
Modelling distribution and abundance with presence‐only data
PEARCE, J. L., & BOYCE, M. S. (2006) · Journal of Applied Ecology · doi:10.1111/j.1365-2664.2005.01112.x · Cited by 625
Integrating abundance and functional traits reveals new global hotspots of fish diversity
Stuart-Smith, R. D., Bates, A. E., Lefcheck, J. S., Duffy, J. E., Baker, S. C., Thomson, R. J., Stuart-Smith, J. F., Hill, N. A., Kininmonth, S. J., Airoldi, L., et al. (2013) · Nature · doi:10.1038/nature12529 · Cited by 589
Self-citationRealising the full potential of citizen science monitoring programs
Tulloch, A. I. T., Possingham, H. P., Joseph, L. N., Szabo, J., & Martin, T. G. (2013) · Biological Conservation · doi:10.1016/j.biocon.2013.05.025 · Cited by 574
Delaney, D. G., Sperling, C. D., Adams, C. S., & Leung, B. (2008) · Biological Invasions · doi:10.1007/s10530-007-9114-0 · Cited by 534
ANALYSIS OF POPULATION TRENDS FOR FARMLAND BIRDS USING GENERALIZED ADDITIVE MODELS
Fewster, R. M., Buckland, S. T., Siriwardena, G. M., Baillie, S. R., & Wilson, J. D. (2000) · Ecology · doi:10.1890/0012-9658(2000)081[1970:aoptff]2.0.co;2 · Cited by 453
Royle, J. A., Chandler, R. B., Yackulic, C., & Nichols, J. D. (2012) · Methods in Ecology and Evolution · doi:10.1111/j.2041-210x.2011.00182.x · Cited by 448
HIERARCHICAL BAYESIAN MODELS FOR PREDICTING THE SPREAD OF ECOLOGICAL PROCESSES
Wikle, C. K. (2003) · Ecology · doi:10.1890/0012-9658(2003)084[1382:hbmfpt]2.0.co;2 · Cited by 431
Cadotte, M. W., Jonathan Davies, T., Regetz, J., Kembel, S. W., Cleland, E., & Oakley, T. H. (2010) · Ecology Letters · doi:10.1111/j.1461-0248.2009.01405.x · Cited by 420
Data-intensive science applied to broad-scale citizen science
Hochachka, W. M., Fink, D., Hutchinson, R. A., Sheldon, D., Wong, W.-K., & Kelling, S. (2012) · Trends in Ecology & Evolution · doi:10.1016/j.tree.2011.11.006 · Cited by 412
Miller, D. A., Nichols, J. D., McClintock, B. T., Grant, E. H. C., Bailey, L. L., & Weir, L. A. (2011) · Ecology · doi:10.1890/10-1396.1 · Cited by 391
Assessing citizen science data quality: an invasive species case study
Crall, A. W., Newman, G. J., Stohlgren, T. J., Holfelder, K. A., Graham, J., & Waller, D. M. (2011) · Conservation Letters · doi:10.1111/j.1755-263x.2011.00196.x · Cited by 386
Building Statistical Models To Analyze Species Distributions
Latimer, A. M., Wu, S., Gelfand, A. E., & Silander Jr., J. A. (2006) · Ecological Applications · doi:10.1890/04-0609 · Cited by 371
Consequences of spatial autocorrelation for niche‐based models
SEGURADO, P., ARAÚJO, M. B., & KUNIN, W. E. (2006) · Journal of Applied Ecology · doi:10.1111/j.1365-2664.2006.01162.x · Cited by 335
Edgar, G. J., Barrett, N. S., & Morton, A. J. (2004) · Journal of Experimental Marine Biology and Ecology · doi:10.1016/j.jembe.2004.03.004 · Cited by 299
Self-citationGeographical, environmental and intrinsic biotic controls on Phanerozoic marine diversification
ALROY, J. (2010) · Palaeontology · doi:10.1111/j.1475-4983.2010.01011.x · Cited by 290
Data validation in citizen science: a case study from Project FeederWatch
Bonter, D. N., & Cooper, C. B. (2012) · Frontiers in Ecology and the Environment · doi:10.1890/110273 · Cited by 271
RE-EM trees: a data mining approach for longitudinal and clustered data
Sela, R. J., & Simonoff, J. S. (2012) · Machine Learning · doi:10.1007/s10994-011-5258-3 · Cited by 256
Spatiotemporal exploratory models for broad‐scale survey data
Fink, D., Hochachka, W. M., Zuckerberg, B., Winkler, D. W., Shaby, B., Munson, M. A., Hooker, G., Riedewald, M., Sheldon, D., & Kelling, S. (2010) · Ecological Applications · doi:10.1890/09-1340.1 · Cited by 252
Predicting species distributions from checklist data using site‐occupancy models
Kéry, M., Gardner, B., & Monnerat, C. (2010) · Journal of Biogeography · doi:10.1111/j.1365-2699.2010.02345.x · Cited by 244
Mechanisms for Data Quality and Validation in Citizen Science
Wiggins, A., Newman, G., Stevenson, R. D., & Crowston, K. (2011) · 2011 IEEE Seventh International Conference on e-Science Workshops · doi:10.1109/esciencew.2011.27 · Cited by 220
Correcting sample selection bias in maximum entropy density estimation
Dudík, M., Phillips, S. J., & Schapire, R. E. (2005) · Cited by 197
HIERARCHICAL SPATIAL MODELS OF ABUNDANCE AND OCCURRENCE FROM IMPERFECT SURVEY DATA
Royle, J. A., Kéry, M., Gautier, R., & Schmid, H. (2007) · Ecological Monographs · doi:10.1890/06-0912.1 · Cited by 194
HABITAT: A Procedure for Modelling a Disjoint Environmental Envelope for a Plant or Animal Species
Walker, P. A., & Cocks, K. D. (1991) · Global Ecology and Biogeography Letters · doi:10.2307/2997706 · Cited by 190
On estimating probability of presence from use–availability or presence–background data
Phillips, S. J., & Elith, J. (2013) · Ecology · doi:10.1890/12-1520.1 · Cited by 172
Evaluating citizen-based presence data for bird monitoring
Snäll, T., Kindvall, O., Nilsson, J., & Pärt, T. (2011) · Biological Conservation · doi:10.1016/j.biocon.2010.11.010 · Cited by 171
KÉRY, M., ROYLE, J. A., SCHMID, H., SCHAUB, M., VOLET, B., HÄFLIGER, G., & ZBINDEN, N. (2010) · Conservation Biology · doi:10.1111/j.1523-1739.2010.01479.x · Cited by 165
Ecological effects of marine protected areas on rocky reef communities—a continental-scale analysis
Edgar, G., & Stuart-Smith, R. (2009) · Marine Ecology Progress Series · doi:10.3354/meps08149 · Cited by 165
Self-citationModelling Species Diversity Through Species Level Hierarchical Modelling
Gelfand, A. E., Schmidt, A. M., Wu, S., Silander, J. A., Latimer, A. M., & Rebelo, A. G. (2004) · Journal of the Royal Statistical Society Series C (Applied Statistics) · doi:10.1111/j.1467-9876.2005.00466.x · Cited by 161
Citizen science: public participation in environmental research
(2012) · Choice Reviews Online · doi:10.5860/choice.50-1423 · Cited by 143
Conservation and Management Applications of the Reef Volunteer Fish Monitoring Program
Pattengill‐Semmens, C. V., & Semmens, B. X. (2003) · Springer eBooks · doi:10.1007/978-94-017-0299-7_5 · Cited by 142
Comber, A., See, L., Fritz, S., van der Velde, M., Perger, C., & Foody, G. M. (2013) · International Journal of Applied Earth Observation and Geoinformation · doi:10.1016/j.jag.2012.11.002 · Cited by 141
Prediction in linear mixed models
Welham, S. J., Cullis, B. R., Gogel, B. J., Gilmour, A. R., & Thompson, R. (2004) · Australian & New Zealand Journal of Statistics · doi:10.1111/j.1467-842x.2004.00334.x · Cited by 139
Conservation and Management Applications of the Reef Volunteer Fish Monitoring Program
Pattengill‐Semmens, C. V., & Semmens, B. X. (2003) · Environmental Monitoring and Assessment · doi:10.1023/a:1021300302208 · Cited by 139
Effect of sampling effort and species detectability on volunteer based anuran monitoring programs
de Solla, S. R., Shirose, L. J., Fernie, K. J., Barrett, G. C., Brousseau, C. S., & Bishop, C. A. (2004) · Biological Conservation · doi:10.1016/j.biocon.2004.06.018 · Cited by 122
Observer effects and avian-call-count survey quality: Rare-species biases and overconfidence
Farmer, R. G., Leonard, M. L., & Horn, A. G. (2012) · The Auk · doi:10.1525/auk.2012.11129 · Cited by 112
A behavioural ecology approach to understand volunteer surveying for citizen science datasets
TULLOCH, A. I. T., & Szabo, J. K. (2012) · Emu - Austral Ornithology · doi:10.1071/mu12009 · Cited by 104
Karpievitch, Y. V., Hill, E. G., Leclerc, A. P., Dabney, A. R., & Almeida, J. S. (2009) · PLoS ONE · doi:10.1371/journal.pone.0007087 · Cited by 85
Ahrends, A., Burgess, N. D., Gereau, R. E., Marchant, R., Bulling, M. T., Lovett, J. C., Platts, P. J., Kindemba, V. W., Owen, N., Fanning, E., et al. (2011) · Diversity and Distributions · doi:10.1111/j.1472-4642.2010.00737.x · Cited by 76
Monk, J. (2014) · Fish and Fisheries · doi:10.1111/faf.12039 · Cited by 71
Mateo, R., Felicísimo, Á. M., & Muñoz, J. (2010) · Journal of Vegetation Science · doi:10.1111/j.1654-1103.2010.01198.x · Cited by 71
Mapping from heterogeneous biodiversity monitoring data sources
Sardà‐Palomera, F., Brotons, L., Villero, D., Sierdsema, H., Newson, S. E., & Jiguet, F. (2012) · Biodiversity and Conservation · doi:10.1007/s10531-012-0347-6 · Cited by 47
Arab, A., Wildhaber, M. L., Wikle, C. K., & Gentry, C. N. (2008) · North American Journal of Fisheries Management · doi:10.1577/m06-250.1 · Cited by 47
Ashcroft, M. B., Gollan, J. R., & Batley, M. (2011) · Biological Invasions · doi:10.1007/s10530-011-0092-x · Cited by 40
Sunde, P., & Jessen, L. (2013) · European Journal of Wildlife Research · doi:10.1007/s10344-013-0717-8 · Cited by 27
Brunsdon, C., & Comber, A. (2012) · GeoInformatica · doi:10.1007/s10707-012-0159-6 · Cited by 26
Amano, T., Okamura, H., Carrizo, S. F., & Sutherland, W. J. (2011) · Ecological Indicators · doi:10.1016/j.ecolind.2011.06.008 · Cited by 24
Using Data Mining to Discover Biological Patterns in Citizen Science Observations
Fink, D., & Hochachka, W. M. (2012) · Cornell University Press eBooks · doi:10.7591/cornell/9780801449116.003.0009 · Cited by 10
Parsons, B., Short, J., & Roberts, J. D. (2008) · Biological Conservation · doi:10.1016/j.biocon.2008.10.032 · Cited by 9
Cited by
Next Steps for Citizen Science
Bonney, R., Shirk, J. L., Phillips, T. B., Wiggins, A., Ballard, H. L., Miller-Rushing, A. J., & Parrish, J. K. (2014) · Science · doi:10.1126/science.1251554 · Cited by 1,253
Assessing data quality in citizen science
Kosmala, M., Wiggins, A., Swanson, A., & Simmons, B. (2016) · Frontiers in Ecology and the Environment · doi:10.1002/fee.1436 · Cited by 985
Theobald, E. J., Ettinger, A. K., Burgess, H. K., DeBey, L. B., Schmidt, N. R., Froehlich, H. E., Wagner, C., HilleRisLambers, J., Tewksbury, J., Harsch, M. A., et al. (2015) · Biological Conservation · doi:10.1016/j.biocon.2014.10.021 · Cited by 770
(2021) · doi:10.1111/ddi.13271 · Cited by 407
The science of citizen science: Exploring barriers to use as a primary research tool
Burgess, H. K., DeBey, L. B., Froehlich, H. E., Schmidt, N., Theobald, E. J., Ettinger, A. K., HilleRisLambers, J., Tewksbury, J., & Parrish, J. K. (2017) · Biological Conservation · doi:10.1016/j.biocon.2016.05.014 · Cited by 389
Metadata
- Authors
- Bird, T. J., Bates, A. E., Lefcheck, J. S., Hill, N. A., Thomson, R. J., Edgar, G. J., Stuart-Smith, R. D., Wotherspoon, S., Krkosek, M., Stuart-Smith, J. F., Pecl, G. T., Barrett, N., & Frusher, S.
- Venue
- Biological Conservation
- Publisher
- Elsevier BV
- Published
- 2014-05
- Volume
- 173
- Pages
- 144-154
- ISSN
- 0006-3207 (ISSN-L)
- OpenAlex
- W2105663391
- Cited by
- 562
- References
- 87
- FWCI
- 20.09
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.