The DOI matches its Crossref record; 74 of the 74 references it cites were found in a registry or an index.
Fit-for-Purpose: Species Distribution Model Performance Depends on Evaluation Criteria – Dutch Hoverflies as a Case Study
Open accessAbstract
Understanding species distributions and the factors limiting them is an important topic in ecology and conservation, including in nature reserve selection and predicting climate change impacts. While Species Distribution Models (SDM) are the main tool used for these purposes, choosing the best SDM algorithm is not straightforward as these are plentiful and can be applied in many different ways. SDM are used mainly to gain insight in 1) overall species distributions, 2) their past-present-future probability of occurrence and/or 3) to understand their ecological niche limits (also referred to as ecological niche modelling). The fact that these three aims may require different models and outputs is, however, rarely considered and has not been evaluated consistently. Here we use data from a systematically sampled set of species occurrences to specifically test the performance of Species Distribution Models across several commonly used algorithms. Species range in distribution patterns from rare to common and from local to widespread. We compare overall model fit (representing species distribution), the accuracy of the predictions at multiple spatial scales, and the consistency in selection of environmental correlations all across multiple modelling runs. As expected, the choice of modelling algorithm determines model outcome. However, model quality depends not only on the algorithm, but also on the measure of model fit used and the scale at which it is used. Although model fit was higher for the consensus approach and Maxent, Maxent and GAM models were more consistent in estimating local occurrence, while RF and GBM showed higher consistency in environmental variables selection. Model outcomes diverged more for narrowly distributed species than for widespread species. We suggest that matching study aims with modelling approach is essential in Species Distribution Models, and provide suggestions how to do this for different modelling aims and species' data characteristics (i.e. sample size, spatial distribution).
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
R: A Language and Environment for Statistical Computing
R Core Team (2025) · doi:10.32614/r.manuals · Cited by 352,181
Breiman, L. (2001) · Machine Learning · doi:10.1023/a:1010933404324 · Cited by 133,538
A Coefficient of Agreement for Nominal Scales
Cohen, J. (1960) · Educational and Psychological Measurement · doi:10.1177/001316446002000104 · Cited by 42,398
Greedy function approximation: A gradient boosting machine
Friedman, J. H. (2001) · The Annals of Statistics · doi:10.1214/aos/1013203451 · Cited by 30,731
The meaning and use of the area under a receiver operating characteristic (ROC) curve.
Hanley, J. A., & McNeil, B. J. (1982) · Radiology · doi:10.1148/radiology.143.1.7063747 · Cited by 21,856
(2005) · Statistics for Biology and Health · doi:10.1007/0-387-27255-0_9 · Cited by 20,133
Very high resolution interpolated climate surfaces for global land areas
Hijmans, R. J., Cameron, S. E., Parra, J. L., Jones, P. G., & Jarvis, A. (2005) · International Journal of Climatology · doi:10.1002/joc.1276 · Cited by 19,825
McCullagh, P., & Nelder, J. A. (1989) · doi:10.1007/978-1-4899-3242-6 · Cited by 16,836
Maximum entropy modeling of species geographic distributions
Phillips, S. J., Anderson, R. P., & Schapire, R. E. (2006) · Ecological Modelling · doi:10.1016/j.ecolmodel.2005.03.026 · Cited by 15,396
nlme : Linear and nonlinear mixed effects models
DebRoy, S. (2006) · Medical Entomology and Zoology · Cited by 10,009
Novel methods improve prediction of species’ distributions from occurrence data
Elith*, J., H. Graham*, C., P. Anderson, R., Dudík, M., Ferrier, S., Guisan, A., J. Hijmans, R., Huettmann, F., R. Leathwick, J., Lehmann, A., et al. (2006) · Ecography · doi:10.1111/j.2006.0906-7590.04596.x · Cited by 9,088
Generalized linear mixed models: a practical guide for ecology and evolution
Bolker, B. M., Brooks, M. E., Clark, C. J., Geange, S. W., Poulsen, J. R., Stevens, M. H. H., & White, J.-S. S. (2009) · Trends in Ecology & Evolution · doi:10.1016/j.tree.2008.10.008 · Cited by 8,910
Brown, R. A., Hastie, T. J., & Tibshirani, R. J. (1991) · Biometrics · doi:10.2307/2532174 · Cited by 8,176
Species Distribution Models: Ecological Explanation and Prediction Across Space and Time
Elith, J., & Leathwick, J. R. (2009) · Annual Review of Ecology, Evolution, and Systematics · doi:10.1146/annurev.ecolsys.110308.120159 · Cited by 6,707
A statistical explanation of MaxEnt for ecologists
Elith, J., Phillips, S. J., Hastie, T., Dudík, M., Chee, Y. E., & Yates, C. J. (2011) · Diversity and Distributions · doi:10.1111/j.1472-4642.2010.00725.x · Cited by 6,699
Predicting species distribution: offering more than simple habitat models
Guisan, A., & Thuiller, W. (2005) · Ecology Letters · doi:10.1111/j.1461-0248.2005.00792.x · Cited by 6,587
Pattern Recognition and Neural Networks
Ripley, B. D. (1996) · Cambridge University Press eBooks · doi:10.1017/cbo9780511812651 · Cited by 6,459
Modeling of species distributions with Maxent: new extensions and a comprehensive evaluation
Phillips, S. J., & Dudík, M. (2008) · Ecography · doi:10.1111/j.0906-7590.2008.5203.x · Cited by 5,890
Lohrli, A. (1985) · Notes and Queries · doi:10.1093/notesj/32.3.377-a · Cited by 4,352
Wiens, J. A. (1989) · Functional Ecology · doi:10.2307/2389612 · Cited by 3,689
Ensemble forecasting of species distributions
ARAUJO, M., & NEW, M. (2007) · Trends in Ecology & Evolution · doi:10.1016/j.tree.2006.09.010 · Cited by 3,640
Vive la différence: plant functional diversity matters to ecosystem processes
Dı́az, S., & Cabido, M. (2001) · Trends in Ecology & Evolution · doi:10.1016/s0169-5347(01)02283-2 · Cited by 3,306
Phillips, S. J., Dudík, M., Elith, J., Graham, C. H., Lehmann, A., Leathwick, J., & Ferrier, S. (2009) · Ecological Applications · doi:10.1890/07-2153.1 · Cited by 2,996
BIOMOD – a platform for ensemble forecasting of species distributions
Thuiller, W., Lafourcade, B., Engler, R., & Araújo, M. B. (2009) · Ecography · doi:10.1111/j.1600-0587.2008.05742.x · Cited by 2,749
Selecting pseudo‐absences for species distribution models: how, where and how many?
Barbet‐Massin, M., Jiguet, F., Albert, C. H., & Thuiller, W. (2012) · Methods in Ecology and Evolution · doi:10.1111/j.2041-210x.2011.00172.x · Cited by 2,716
Effects of sample size on the performance of species distribution models
Wisz, M. S., Hijmans, R. J., Li, J., Peterson, A. T., Graham, C. H., Guisan, A., & NCEAS Predicting Species Distributions Working Group (2008) · Diversity and Distributions · doi:10.1111/j.1472-4642.2008.00482.x · Cited by 2,514
(2001) · Cited by 1,932
Five (or so) challenges for species distribution modelling
Araújo, M. B., & Guisan, A. (2006) · Journal of Biogeography · doi:10.1111/j.1365-2699.2006.01584.x · Cited by 1,901
Barve, N., Barve, V., Jiménez-Valverde, A., Lira-Noriega, A., Maher, S. P., Peterson, A. T., Soberón, J., & Villalobos, F. (2011) · Ecological Modelling · doi:10.1016/j.ecolmodel.2011.02.011 · Cited by 1,881
(2010) · Cited by 1,762
Mapping Species Distributions: Spatial Inference and Prediction
Franklin, J. (2010) · doi:10.1017/cbo9780511810602 · Cited by 1,534
Austin, M. (2007) · Ecological Modelling · doi:10.1016/j.ecolmodel.2006.07.005 · Cited by 1,504
Evaluation of consensus methods in predictive species distribution modelling
Marmion, M., Parviainen, M., Luoto, M., Heikkinen, R. K., & Thuiller, W. (2009) · Diversity and Distributions · doi:10.1111/j.1472-4642.2008.00491.x · Cited by 1,435
Ecological niches and geographic distributions
(2012) · Choice Reviews Online · doi:10.5860/choice.49-6266 · Cited by 1,343
Niches and distributional areas: Concepts, methods, and assumptions
Soberón, J., & Nakamura, M. (2009) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0901637106 · Cited by 1,306
Elith, J., & Graham, C. H. (2009) · Ecography · doi:10.1111/j.1600-0587.2008.05505.x · Cited by 1,098
Uses and misuses of bioclimatic envelope modeling
Araújo, M. B., & Peterson, A. T. (2012) · Ecology · doi:10.1890/11-1930.1 · Cited by 1,097
Towards an assessment of multiple ecosystem processes and services via functional traits
de Bello, F., Lavorel, S., Díaz, S., Harrington, R., Cornelissen, J. H. C., Bardgett, R. D., Berg, M. P., Cipriotti, P., Feld, C. K., Hering, D., et al. (2010) · Biodiversity and Conservation · doi:10.1007/s10531-010-9850-9 · Cited by 1,038
Model‐based uncertainty in species range prediction
Pearson, R. G., Thuiller, W., Araújo, M. B., Martinez‐Meyer, E., Brotons, L., McClean, C., Miles, L., Segurado, P., Dawson, T. P., & Lees, D. C. (2006) · Journal of Biogeography · doi:10.1111/j.1365-2699.2006.01460.x · Cited by 981
DISSECTING THE SPATIAL STRUCTURE OF ECOLOGICAL DATA AT MULTIPLE SCALES
Borcard, D., Legendre, P., Avois-Jacquet, C., & Tuomisto, H. (2004) · Ecology · doi:10.1890/03-3111 · Cited by 946
Threshold criteria for conversion of probability of species presence to either–or presence–absence
Jiménez-Valverde, A., & Lobo, J. M. (2007) · Acta Oecologica · doi:10.1016/j.actao.2007.02.001 · Cited by 892
Jiménez‐Valverde, A. (2012) · Global Ecology and Biogeography · doi:10.1111/j.1466-8238.2011.00683.x · Cited by 803
Uncertainty in ensemble forecasting of species distribution
BUISSON, L., THUILLER, W., CASAJUS, N., LEK, S., & GRENOUILLET, G. (2010) · Global Change Biology · doi:10.1111/j.1365-2486.2009.02000.x · Cited by 708
Species Distribution Modeling and Ecological Niche Modeling: Getting the Concepts Right
Peterson, A. T., & Soberón, J. (2012) · Natureza & Conservação · doi:10.4322/natcon.2012.019 · Cited by 702
Ecological Neighborhoods: Scaling Environmental Patterns
Addicott, J. F., Aho, J. M., Antolin, M. F., Padilla, D. K., Richardson, J. S., & Soluk, D. A. (1987) · Oikos · doi:10.2307/3565770 · Cited by 629
Kraft, N. J. B., & Ackerly, D. D. (2010) · Ecological Monographs · doi:10.1890/09-1672.1 · Cited by 612
A null‐model for significance testing of presence‐only species distribution models
Raes, N., & ter Steege, H. (2007) · Ecography · doi:10.1111/j.2007.0906-7590.05041.x · Cited by 537
Self-citationNiches and Geographic Distributions
Peterson, A. T., Soberón, J., Pearson, R. G., Anderson, R. P., Martínez-Meyer, E., Nakamura, M., & Araújo, M. B. (2011) · Ecological Niches and Geographic Distributions (MPB-49) · doi:10.23943/princeton/9780691136868.003.0003 · Cited by 407
Evaluation of Museum Collection Data for Use in Biodiversity Assessment
Ponder, W. F., Carter, G. A., Flemons, P., & Chapman, R. R. (2001) · Conservation Biology · doi:10.1046/j.1523-1739.2001.015003648.x · Cited by 372
Visser, H., & de Nijs, T. (2006) · Environmental Modelling & Software · doi:10.1016/j.envsoft.2004.11.013 · Cited by 370
Predicting climate‐induced range shifts: model differences and model reliability
LAWLER, J. J., WHITE, D., NEILSON, R. P., & BLAUSTEIN, A. R. (2006) · Global Change Biology · doi:10.1111/j.1365-2486.2006.01191.x · Cited by 370
New trends in species distribution modelling
Zimmermann, N. E., Edwards, T. C., Graham, C. H., Pearman, P. B., & Svenning, J. (2010) · Ecography · doi:10.1111/j.1600-0587.2010.06953.x · Cited by 356
Consequences of spatial autocorrelation for niche‐based models
SEGURADO, P., ARAÚJO, M. B., & KUNIN, W. E. (2006) · Journal of Applied Ecology · doi:10.1111/j.1365-2664.2006.01162.x · Cited by 335
Veloz, S. D., Williams, J. W., Blois, J. L., He, F., Otto‐Bliesner, B., & Liu, Z. (2012) · Global Change Biology · doi:10.1111/j.1365-2486.2011.02635.x · Cited by 331
Opening the climate envelope reveals no macroscale associations with climate in European birds
Beale, C. M., Lennon, J. J., & Gimona, A. (2008) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0803506105 · Cited by 317
Effects of climate change on the distribution of Iberian tree species
Benito Garzón, M., Sánchez de Dios, R., & Sainz Ollero, H. (2008) · Applied Vegetation Science · doi:10.3170/2008-7-18348 · Cited by 310
Bean, W. T., Stafford, R., & Brashares, J. S. (2012) · Ecography · doi:10.1111/j.1600-0587.2011.06545.x · Cited by 303
Lomba, A., Pellissier, L., Randin, C., Vicente, J., Moreira, F., Honrado, J., & Guisan, A. (2010) · Biological Conservation · doi:10.1016/j.biocon.2010.07.007 · Cited by 286
openModeller: a generic approach to species’ potential distribution modelling
de Souza Muñoz, M. E., De Giovanni, R., de Siqueira, M. F., Sutton, T., Brewer, P., Pereira, R. S., Canhos, D. A. L., & Canhos, V. P. (2011) · GeoInformatica · doi:10.1007/s10707-009-0090-7 · Cited by 286
Saupe, E. E., Barve, V., Myers, C. E., Soberón, J., Barve, N., Hensz, C. M., Peterson, A. T., Owens, H. L., & Lira-Noriega, A. (2012) · Ecological Modelling · doi:10.1016/j.ecolmodel.2012.04.001 · Cited by 248
Botanical richness and endemicity patterns of Borneo derived from species distribution models
Raes, N., Roos, M. C., Slik, J. W. F., Van Loon, E. E., & Steege, H. T. (2009) · Ecography · doi:10.1111/j.1600-0587.2009.05800.x · Cited by 196
Self-citationIn defense of ‘niche modeling’
Warren, D. L. (2012) · Trends in Ecology & Evolution · doi:10.1016/j.tree.2012.03.010 · Cited by 183
Rodríguez‐Soto, C., Monroy‐Vilchis, O., Maiorano, L., Boitani, L., Faller, J. C., Briones-Salas, M. A., Núñez, R., Rosas-Rosas, O. C., Ceballos, G., & Falcucci, A. (2011) · Diversity and Distributions · doi:10.1111/j.1472-4642.2010.00740.x · Cited by 175
Mateo, R. G., Croat, T. B., Felicísimo, Á. M., & Muñoz, J. (2010) · Diversity and Distributions · doi:10.1111/j.1472-4642.2009.00617.x · Cited by 174
ModEco: an integrated software package for ecological niche modeling
Guo, Q., & Liu, Y. (2010) · Ecography · doi:10.1111/j.1600-0587.2010.06416.x · Cited by 150
Ditch the niche – is the niche a useful concept in ecology or species distribution modelling?
McInerny, G., & Etienne, R. S. (2012) · Journal of Biogeography · doi:10.1111/jbi.12033 · Cited by 120
Xue, J., & Titterington, D. M. (2008) · Neural Processing Letters · doi:10.1007/s11063-008-9088-7 · Cited by 110
Thomson, J. F. (1990) · The Journal of Philosophy · doi:10.5840/jphil199087273 · Cited by 101
An improved Fuzzy Kappa statistic that accounts for spatial autocorrelation
Hagen‐Zanker, A. (2009) · International Journal of Geographical Information Systems · doi:10.1080/13658810802570317 · Cited by 101
Empirical mapping of suitability to dengue fever in Mexico using species distribution modeling
Machado-Machado, E. A. (2011) · Applied Geography · doi:10.1016/j.apgeog.2011.06.011 · Cited by 94
Population density but not stability can be predicted from species distribution models
Oliver, T., Gillings, S., Girardello, M., Rapacciuolo, G., Brereton, T., Siriwardena, G., Roy, D., Pywell, R., & Fuller, R. (2012) · Journal of Applied Ecology · doi:10.1111/j.1365-2664.2012.02138.x · Cited by 93
Two years later: Natureza & Conservação and its impact
Loyola, R., & Diniz‐Filho, J. A. F. (2012) · Natureza & Conservação · doi:10.4322/natcon.2012.001 · Cited by 33
Species distribution models for the alien invasive Asian Harlequin ladybird (Harmonia axyridis)
Bidinger, K., Lötters, S., Rödder, D., & Veith, M. (2010) · Journal of Applied Entomology · doi:10.1111/j.1439-0418.2010.01598.x · Cited by 32
Modelling the spatial distribution of tree species with fragmented populations from abundance data
Scarnati, L., Attorre, F., Farcomeni, A., Francesconi, F., & Sanctis, M. D. (2009) · Community Ecology · doi:10.1556/comec.10.2009.2.12 · Cited by 28
Cited by
Tien Bui, D., Tuan, T. A., Klempe, H., Pradhan, B., & Revhaug, I. (2016) · Landslides · doi:10.1007/s10346-015-0557-6 · Cited by 1,253
Minimum required number of specimen records to develop accurate species distribution models
van Proosdij, A. S. J., Sosef, M. S. M., Wieringa, J. J., & Raes, N. (2016) · Ecography · doi:10.1111/ecog.01509 · Cited by 791
Self-citationPrediction of the landslide susceptibility: Which algorithm, which precision?
Pourghasemi, H. R., & Rahmati, O. (2018) · CATENA · doi:10.1016/j.catena.2017.11.022 · Cited by 496
De Marco, P., & Nóbrega, C. C. (2018) · PLOS ONE · doi:10.1371/journal.pone.0202403 · Cited by 479
Hong, H., Pradhan, B., Xu, C., & Tien Bui, D. (2015) · CATENA · doi:10.1016/j.catena.2015.05.019 · Cited by 449
Metadata
- Authors
- Aguirre-Gutiérrez, J., Carvalheiro, L. G., Polce, C., van Loon, E. E., Raes, N., Reemer, M., & Biesmeijer, J. C.
- Venue
- PLoS ONE
- Publisher
- Public Library of Science (PLoS)
- Published
- 2013-05-14
- Volume
- 8
- Issue
- 5
- Pages
- e63708
- ISSN
- 1932-6203 (ISSN-L)
- OpenAlex
- W1963970295
- Cited by
- 303
- References
- 74
- FWCI
- 10.69
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.