The DOI matches its Crossref record; 33 of the 33 references it cites were found in a registry or an index.
Statistics for citizen science: extracting signals of change from noisy ecological data
Open accessAbstract
Summary: Policy‐makers increasingly demand robust measures of biodiversity change over short time periods. Long‐term monitoring schemes provide high‐quality data, often on an annual basis, but are taxonomically and geographically restricted. By contrast, opportunistic biological records are relatively unstructured but vast in quantity. Recently, these data have been applied to increasingly elaborate science and policy questions, using a range of methods. At present, we lack a firm understanding of which methods, if any, are capable of delivering unbiased trend estimates on policy‐relevant time‐scales. We identified a set of candidate methods that employ data filtering criteria and/or correction factors to deal with variation in recorder activity. We designed a computer simulation to compare the statistical properties of these methods under a suite of realistic data collection scenarios. We measured the Type I error rates of each method–scenario combination, as well as the power to detect genuine trends. We found that simple methods produce biased trend estimates, and/or had low power. Most methods are robust to variation in sampling effort, but biases in spatial coverage, sampling effort per visit, and detectability, as well as turnover in community composition, all induced some methods to fail. No method was wholly unaffected by all forms of variation in recorder activity, although some performed well enough to be useful. We warn against the use of simple methods. Sophisticated methods that model the data collection process offer the greatest potential to estimate timely trends, notably F rescalo and occupancy–detection models. The potential of these methods and the value of opportunistic data would be further enhanced by assessing the validity of model assumptions and by capturing small amounts of information about sampling intensity at the point of data collection.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Global Biodiversity: Indicators of Recent Declines
Butchart, S. H. M., Walpole, M., Collen, B., van Strien, A., Scharlemann, J. P. W., Almond, R. E. A., Baillie, J. E. M., Bomhard, B., Brown, C., Bruno, J., et al. (2010) · Science · doi:10.1126/science.1187512 · Cited by 4,892
Self-citationESTIMATING SITE OCCUPANCY RATES WHEN DETECTION PROBABILITIES ARE LESS THAN ONE
MacKenzie, D. I., Nichols, J. D., Lachman, G. B., Droege, S., Andrew Royle, J., & Langtimm, C. A. (2002) · Ecology · doi:10.1890/0012-9658(2002)083[2248:esorwd]2.0.co;2 · Cited by 4,481
Occupancy Estimation and Modeling: Inferring Patterns and Dynamics of Species Occurrence
MacKenzie, D. I. (2005) · Cited by 1,878
The distributions of a wide range of taxonomic groups are expanding polewards
HICKLING, R., ROY, D. B., HILL, J. K., FOX, R., & THOMAS, C. D. (2006) · Global Change Biology · doi:10.1111/j.1365-2486.2006.01116.x · Cited by 1,570
Self-citationThe current state of citizen science as a tool for ecological research and public engagement
Dickinson, J. L., Shirk, J., Bonter, D., Bonney, R., Crain, R. L., Martin, J., Phillips, T., & Purcell, K. (2012) · Frontiers in Ecology and the Environment · doi:10.1890/110236 · Cited by 1,372
Rapid responses of British butterflies to opposing forces of climate and habitat change
Warren, M. S., Hill, J. K., Thomas, J. A., Asher, J., Fox, R., Huntley, B., Roy, D. B., Telfer, M. G., Jeffcoate, S., Harding, P., et al. (2001) · Nature · doi:10.1038/35102054 · Cited by 1,333 · cited 2×
“Opportunistic data have delivered substantive insights into the ecological impacts of climate change (Hickling et al. 2006), invasive species (Roy et al. 2012) and habitat loss (Warren et al. 2001).”
Self-citationComparative losses of British butterflies, birds, and plants and the global extinction crisis
Thomas, J. A., Telfer, M. G., Roy, D. B., Preston, C. D., Greenwood, J. J. D., Asher, J., Fox, R., Clarke, R. T., & Lawton, J. H. (2004) · Science · doi:10.1126/science.1095046 · Cited by 955 · cited 3×
“scale changes in biodiversity (Thomas et al. 2004; Carvalheiro et al. 2013), the absence of standardized protocols presents serious challenges for estimating timely trends in the status of individual species.”
Self-citationDeveloping indicators for European birds
Gregory, R. D., van Strien, A., Vorisek, P., Gmelig Meyling, A. W., Noble, D. G., Foppen, R. P. B., & Gibbons, D. W. (2005) · Philosophical Transactions of the Royal Society B Biological Sciences · doi:10.1098/rstb.2004.1602 · Cited by 948
Assessing Extinction Threats: Toward a Reevaluation of IUCN Threatened Species Categories
MACE, G. M., & LANDE, R. (1991) · Conservation Biology · doi:10.1111/j.1523-1739.1991.tb00119.x · Cited by 888
Realising the full potential of citizen science monitoring programs
Tulloch, A. I. T., Possingham, H. P., Joseph, L. N., Szabo, J., & Martin, T. G. (2013) · Biological Conservation · doi:10.1016/j.biocon.2013.05.025 · Cited by 574
van Strien, A. J., van Swaay, C. A. M., & Termaat, T. (2013) · Journal of Applied Ecology · doi:10.1111/1365-2664.12158 · Cited by 424
Self-citationDetecting range shifts from historical species occurrences: new perspectives on old data
Tingley, M. W., & Beissinger, S. R. (2009) · Trends in Ecology & Evolution · doi:10.1016/j.tree.2009.05.009 · Cited by 414
Advantages of Volunteer‐Based Biodiversity Monitoring in Europe
SCHMELLER, D. S., HENRY, P., JULLIARD, R., GRUBER, B., CLOBERT, J., DZIOCK, F., LENGYEL, S., NOWICKI, P., DÉRI, E., BUDRYS, E., et al. (2009) · Conservation Biology · doi:10.1111/j.1523-1739.2008.01125.x · Cited by 389
Carvalheiro, L. G., Kunin, W. E., Keil, P., Aguirre‐Gutiérrez, J., Ellis, W. N., Fox, R., Groom, Q., Hennekens, S., Van Landuyt, W., Maes, D., et al. (2013) · Ecology Letters · doi:10.1111/ele.12121 · Cited by 371
The virtual ecologist approach: simulating data and observers
Zurell, D., Berger, U., Cabral, J. S., Jeltsch, F., Meynard, C. N., Münkemüller, T., Nehrbass, N., Pagel, J., Reineking, B., Schröder, B., et al. (2010) · Oikos · doi:10.1111/j.1600-0706.2009.18284.x · Cited by 361
Recent ecological responses to climate change support predictions of high extinction risk
Maclean, I. M. D., & Wilson, R. J. (2011) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1017352108 · Cited by 339
Butterfly diversity loss in Flanders (north Belgium): Europe's worst case scenario?
Maes, D., & Van Dyck, H. (2001) · Biological Conservation · doi:10.1016/s0006-3207(00)00182-8 · Cited by 309
Trend estimation in populations with imperfect detection
Kéry, M., Dorazio, R. M., Soldaat, L. L., Strien, A. J. V., Zuiderwijk, A. C. M., & Royle, J. A. (2009) · Journal of Applied Ecology · doi:10.1111/j.1365-2664.2009.01724.x · Cited by 299
Imperfect detection impacts the performance of species distribution models
Lahoz‐Monfort, J. J., Guillera‐Arroita, G., & Wintle, B. A. (2014) · Global Ecology and Biogeography · doi:10.1111/geb.12138 · Cited by 278
Invasive alien predator causes rapid declines of native European ladybirds
Roy, H. E., Adriaens, T., Isaac, N. J. B., Kenis, M., Onkelinx, T., Martin, G. S., Brown, P. M. J., Hautier, L., Poland, R., Roy, D. B., et al. (2012) · Diversity and Distributions · doi:10.1111/j.1472-4642.2012.00883.x · Cited by 277
Self-citationFox, R., Oliver, T. H., Harrower, C., Parsons, M. S., Thomas, C. D., & Roy, D. B. (2014) · Journal of Applied Ecology · doi:10.1111/1365-2664.12256 · Cited by 236
Self-citationClimate-driven changes in northeastern US butterfly communities
Breed, G. A., Stichter, S., & Crone, E. E. (2013) · Nature Climate Change · doi:10.1038/nclimate1663 · Cited by 186
Szabo, J. K., Vesk, P. A., Baxter, P. W. J., & Possingham, H. P. (2010) · Ecological Applications · doi:10.1890/09-0877.1 · Cited by 156
Rich, T. C. G., & Woodruff, E. R. (1996) · Biological Conservation · doi:10.1016/0006-3207(95)00077-1 · Cited by 146
Kuussaari, M., Heliölä, J., Pöyry, J., & Saarinen, K. (2007) · Journal of Insect Conservation · doi:10.1007/s10841-006-9052-7 · Cited by 131 · cited 2×
“Another innovation is to add the study site (or grid cell) as a random effect (Kuussaari et al. 2007; Roy et al. 2012), to control for uneven sampling in space.”
BackgroundMethodLocal frequency as a key to interpreting species occurrence data when recording effort is not known
Hill, M. O. (2011) · Methods in Ecology and Evolution · doi:10.1111/j.2041-210x.2011.00146.x · Cited by 126
A general method for measuring relative change in range size from biological atlas data
Telfer, M. G., Preston, C. D., & ROTHERY, P. (2002) · Biological Conservation · doi:10.1016/s0006-3207(02)00050-2 · Cited by 115
The effects of visual apparency on bias in butterfly recording and monitoring
Dennis, R. L. H., Shreeve, T. G., Isaac, N. J. B., Roy, D. B., Hardy, P. B., Fox, R., & Asher, J. (2005) · Biological Conservation · doi:10.1016/j.biocon.2005.10.015 · Cited by 101
Self-citationUnexpectedly high 20th century floristic losses in a rural landscape in northern France
Calster, H. V., Vandenberghe, R., Ruysen, M., Verheyen, K., Hermy, M., & Decocq, G. (2008) · Journal of Ecology · doi:10.1111/j.1365-2745.2008.01412.x · Cited by 92
Paying the extinction debt: woodland birds in the Mount Lofty Ranges, South Australia
Szabo, J. K., Vesk, P. A., Baxter, P. W. J., & Possingham, H. P. (2011) · Emu - Austral Ornithology · doi:10.1071/mu09114 · Cited by 89
Maes, D., Vanreusel, W., Jacobs, I., Berwaerts, K., & Dyck, H. V. (2012) · Biological Conservation · doi:10.1016/j.biocon.2011.11.021 · Cited by 55
Powney, G. D., Rapacciuolo, G., Preston, C. D., Purvis, A., & Roy, D. B. (2013) · Biodiversity and Conservation · doi:10.1007/s10531-013-0590-5 · Cited by 32
Self-citationBotts, E. A., Erasmus, B. F. N., & Alexander, G. J. (2011) · Biological Conservation · doi:10.1016/j.biocon.2011.10.035 · Cited by 29
Cited by
Emerging opportunities and challenges for passive acoustics in ecological assessment and monitoring
Gibb, R., Browning, E., Glover‐Kapfer, P., & Jones, K. E. (2019) · Methods in Ecology and Evolution · doi:10.1111/2041-210x.13101 · Cited by 730
Widespread losses of pollinating insects in Britain
Powney, G. D., Carvell, C., Edwards, M., Morris, R. K. A., Roy, H. E., Woodcock, B. A., & Isaac, N. J. B. (2019) · Nature Communications · doi:10.1038/s41467-019-08974-9 · Cited by 671
Self-citationImpacts of neonicotinoid use on long-term population changes in wild bees in England
Woodcock, B. A., Isaac, N. J. B., Bullock, J. M., Roy, D. B., Garthwaite, D. G., Crowe, A., & Pywell, R. F. (2016) · Nature Communications · doi:10.1038/ncomms12459 · Cited by 550
Self-citationCitizen science in environmental and ecological sciences
Fraisl, D., Hager, G., Bedessem, B., Gold, M., Hsing, P.-Y., Danielsen, F., Hitchcock, C. B., Hulbert, J. M., Piera, J., Spiers, H., et al. (2022) · Nature Reviews Methods Primers · doi:10.1038/s43586-022-00144-4 · Cited by 475
Declining resilience of ecosystem functions under biodiversity loss
Oliver, T. H., Isaac, N. J. B., August, T. A., Woodcock, B. A., Roy, D. B., & Bullock, J. M. (2015) · Nature Communications · doi:10.1038/ncomms10122 · Cited by 419
Self-citation
Metadata
- Authors
- Isaac, N. J. B., van Strien, A. J., August, T. A., de Zeeuw, M. P., & Roy, D. B.
- Venue
- Methods in Ecology and Evolution
- Publisher
- Wiley
- Published
- 2014-09-27
- Volume
- 5
- Issue
- 10
- Pages
- 1052-1060
- ISSN
- 2041-210X (ISSN-L)
- OpenAlex
- W2108255332
- Cited by
- 564
- References
- 33
- FWCI
- 21.29
- Type
- journal article
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.