The DOI matches its Crossref record; 77 of the 77 references it cites were found in a registry or an index.
Paintings predict the distribution of species, or the challenge of selecting environmental predictors and evaluation statistics
Abstract
Aim: Species distribution modelling, a family of statistical methods that predicts species distributions from a set of occurrences and environmental predictors, is now routinely applied in many macroecological studies. However, the reliability of evaluation metrics usually employed to validate these models remains questioned. Moreover, the emergence of online databases of environmental variables with global coverage, especially climatic, has favoured the use of the same set of standard predictors. Unfortunately, the selection of variables is too rarely based on a careful examination of the species' ecology. In this context, our aim was to highlight the importance of selecting ad hoc variables in species distribution models, and to assess the ability of classical evaluation statistics to identify models with no biological realism. Innovation: First, we reviewed the current practices in the field of species distribution modelling in terms of variable selection and model evaluation. Then, we computed distribution models of 509 European species using pseudo‐predictors derived from paintings or using a real set of climatic and topographic predictors. We calculated model performance based on the area under the receiver operating curve (AUC) and true skill statistics (TSS), partitioning occurrences into training and test data with different levels of spatial independence. Most models computed from pseudo‐predictors were classified as good and sometimes were even better evaluated than models computed using real environmental variables. However, on average they were better discriminated when the partitioning of occurrences allowed testing for model transferability. Main conclusions: These findings confirm the crucial importance of variable selection and the inability of current evaluation metrics to assess the biological significance of distribution models. We recommend that researchers carefully select variables according to the species' ecology and evaluate models only according to their capacity to be transfered in distant areas. Nevertheless, statistics of model evaluations must still be interpreted with great caution.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“The AUC score is the most widely used metric to assess and compare models of binary or categorical outcomes but has some issues in its use with models that use pseudo-absence points [93].”
From Advancing predictive modeling in archaeology: an evaluation of regression and machine learning methods on the grand staircase-escalante national monument (2020) · cites this paper as [93]
Citations
Cites
R: A Language and Environment for Statistical Computing
R Core Team (2025) · doi:10.32614/r.manuals · Cited by 352,181
Model selection and multimodel inference: a practical information-theoretic approach.
Guthery, F. S., Burnham, K. P., & Anderson, D. R. (2003) · The Journal of Wildlife Management · doi:10.2307/3802723 · Cited by 41,495
The meaning and use of the area under a receiver operating characteristic (ROC) curve.
Hanley, J. A., & McNeil, B. J. (1982) · Radiology · doi:10.1148/radiology.143.1.7063747 · Cited by 21,856
Very high resolution interpolated climate surfaces for global land areas
Hijmans, R. J., Cameron, S. E., Parra, J. L., Jones, P. G., & Jarvis, A. (2005) · International Journal of Climatology · doi:10.1002/joc.1276 · Cited by 19,825
Maximum entropy modeling of species geographic distributions
Phillips, S. J., Anderson, R. P., & Schapire, R. E. (2006) · Ecological Modelling · doi:10.1016/j.ecolmodel.2005.03.026 · Cited by 15,396
Measuring the Accuracy of Diagnostic Systems
Swets, J. A. (1988) · Science · doi:10.1126/science.3287615 · Cited by 10,058
Dormann, C. F., Elith, J., Bacher, S., Buchmann, C., Carl, G., Carré, G., Marquéz, J. R. G., Gruber, B., Lafourcade, B., Leitão, P. J., et al. (2013) · Ecography · doi:10.1111/j.1600-0587.2012.07348.x · Cited by 9,998
A review of methods for the assessment of prediction errors in conservation presence/absence models
FIELDING, A. H., & BELL, J. F. (1997) · Environmental Conservation · doi:10.1017/s0376892997000088 · Cited by 6,956
Species Distribution Models: Ecological Explanation and Prediction Across Space and Time
Elith, J., & Leathwick, J. R. (2009) · Annual Review of Ecology, Evolution, and Systematics · doi:10.1146/annurev.ecolsys.110308.120159 · Cited by 6,707
A statistical explanation of MaxEnt for ecologists
Elith, J., Phillips, S. J., Hastie, T., Dudík, M., Chee, Y. E., & Yates, C. J. (2011) · Diversity and Distributions · doi:10.1111/j.1472-4642.2010.00725.x · Cited by 6,699
Modeling of species distributions with Maxent: new extensions and a comprehensive evaluation
Phillips, S. J., & Dudík, M. (2008) · Ecography · doi:10.1111/j.0906-7590.2008.5203.x · Cited by 5,890
Rapid Range Shifts of Species Associated with High Levels of Climate Warming
Chen, I.-C., Hill, J. K., Ohlemüller, R., Roy, D. B., & Thomas, C. D. (2011) · Science · doi:10.1126/science.1206432 · Cited by 5,518
ALLOUCHE, O., TSOAR, A., & KADMON, R. (2006) · Journal of Applied Ecology · doi:10.1111/j.1365-2664.2006.01214.x · Cited by 5,172
Two-sided confidence intervals for the single proportion: comparison of seven methods
Newcombe, R. G. (1998) · Statistics in Medicine · doi:10.1002/(sici)1097-0258(19980430)17:8<857::aid-sim777>3.0.co;2-e · Cited by 5,107
Pearson, R. G., & Dawson, T. P. (2003) · Global Ecology and Biogeography · doi:10.1046/j.1466-822x.2003.00042.x · Cited by 4,252
Cross‐validation strategies for data with temporal, spatial, hierarchical, or phylogenetic structure
Roberts, D. R., Bahn, V., Ciuti, S., Boyce, M. S., Elith, J., Guillera‐Arroita, G., Hauenstein, S., Lahoz‐Monfort, J. J., Schröder, B., Thuiller, W., et al. (2017) · Ecography · doi:10.1111/ecog.02881 · Cited by 3,689
AUC: A misleading measure of the performance of predictive distribution models
Lobo, J. M., Jiménez‐Valverde, A., & Real, R. (2008) · Global Ecology and Biogeography · doi:10.1111/j.1466-8238.2007.00358.x · Cited by 3,499
Merow, C., Smith, M. J., & Silander, J. A. (2013) · Ecography · doi:10.1111/j.1600-0587.2013.07872.x · Cited by 3,392
raster: Geographic Data Analysis and Modeling
Hijmans, R. J. (2010) · CRAN: Contributed Packages · doi:10.32614/cran.package.raster · Cited by 2,907
ENVIRONMENTAL NICHE EQUIVALENCY VERSUS CONSERVATISM: QUANTITATIVE APPROACHES TO NICHE EVOLUTION
Warren, D. L., Glor, R. E., & Turelli, M. (2008) · Evolution · doi:10.1111/j.1558-5646.2008.00482.x · Cited by 2,663
Aiello‐Lammens, M. E., Boria, R. A., Radosavljevic, A., Vilela, B., & Anderson, R. P. (2015) · Ecography · doi:10.1111/ecog.01132 · Cited by 2,350
Warren, D. L., & Seifert, S. N. (2011) · Ecological Applications · doi:10.1890/10-1171.1 · Cited by 2,312
Predicting species distributions for conservation decisions
Guisan, A., Tingley, R., Baumgartner, J. B., Naujokaitis‐Lewis, I., Sutcliffe, P. R., Tulloch, A. I. T., Regan, T. J., Brotons, L., McDonald‐Madden, E., Mantyka‐Pringle, C., et al. (2013) · Ecology Letters · doi:10.1111/ele.12189 · Cited by 2,068
Muscarella, R., Galante, P. J., Soley‐Guardia, M., Boria, R. A., Kass, J. M., Uriarte, M., & Anderson, R. P. (2014) · Methods in Ecology and Evolution · doi:10.1111/2041-210x.12261 · Cited by 1,962
Grinnellian and Eltonian niches and geographic distributions of species
Soberón, J. (2007) · Ecology Letters · doi:10.1111/j.1461-0248.2007.01107.x · Cited by 1,935
Barve, N., Barve, V., Jiménez-Valverde, A., Lira-Noriega, A., Maher, S. P., Peterson, A. T., Soberón, J., & Villalobos, F. (2011) · Ecological Modelling · doi:10.1016/j.ecolmodel.2011.02.011 · Cited by 1,881
Making better M axent models of species distributions: complexity, overfitting and evaluation
Radosavljevic, A., & Anderson, R. P. (2014) · Journal of Biogeography · doi:10.1111/jbi.12227 · Cited by 1,723
Validation of species–climate impact models under climate change
Araújo, M. B., Pearson, R. G., Thuiller, W., & Erhard, M. (2005) · Global Change Biology · doi:10.1111/j.1365-2486.2005.01000.x · Cited by 1,669
ENMTools: a toolbox for comparative studies of environmental niche models
Warren, D. L., Glor, R. E., & Turelli, M. (2010) · Ecography · doi:10.1111/j.1600-0587.2009.06142.x · Cited by 1,629
Selecting thresholds for the prediction of species occurrence with presence‐only data
Liu, C., White, M., & Newell, G. (2013) · Journal of Biogeography · doi:10.1111/jbi.12058 · Cited by 1,613
Rethinking receiver operating characteristic analysis applications in ecological niche modeling
Peterson, A. T., Papeş, M., & Soberón, J. (2008) · Ecological Modelling · doi:10.1016/j.ecolmodel.2007.11.008 · Cited by 1,526
HIJMANS, R. J., & GRAHAM, C. H. (2006) · Global Change Biology · doi:10.1111/j.1365-2486.2006.01256.x · Cited by 1,179
Fourcade, Y., Engler, J. O., Rödder, D., & Secondi, J. (2014) · PLoS ONE · doi:10.1371/journal.pone.0097122 · Cited by 1,098
Self-citationUses and misuses of bioclimatic envelope modeling
Araújo, M. B., & Peterson, A. T. (2012) · Ecology · doi:10.1890/11-1930.1 · Cited by 1,097
Booth, T. H., Nix, H. A., Busby, J. R., & Hutchinson, M. F. (2014) · Diversity and Distributions · doi:10.1111/ddi.12144 · Cited by 986
Use of niche models in invasive species risk assessments
Jiménez-Valverde, A., Peterson, A. T., Soberón, J., Overton, J. M., Aragón, P., & Lobo, J. M. (2011) · Biological Invasions · doi:10.1007/s10530-011-9963-4 · Cited by 829
Jiménez‐Valverde, A. (2012) · Global Ecology and Biogeography · doi:10.1111/j.1466-8238.2011.00683.x · Cited by 803
Presence‐only modelling using MAXENT: when can we trust the inferences?
Yackulic, C. B., Chandler, R., Zipkin, E. F., Royle, J. A., Nichols, J. D., Campbell Grant, E. H., & Veran, S. (2013) · Methods in Ecology and Evolution · doi:10.1111/2041-210x.12004 · Cited by 752
Correlation and process in species distribution models: bridging a dichotomy
Dormann, C. F., Schymanski, S. J., Cabral, J., Chuine, I., Graham, C., Hartig, F., Kearney, M., Morin, X., Römermann, C., Schröder, B., et al. (2012) · Journal of Biogeography · doi:10.1111/j.1365-2699.2011.02659.x · Cited by 748
Climate, climate change and range boundaries
Thomas, C. D. (2010) · Diversity and Distributions · doi:10.1111/j.1472-4642.2010.00642.x · Cited by 692
Improving species distribution models for climate change studies: variable selection and scale
Austin, M. P., & Van Niel, K. P. (2011) · Journal of Biogeography · doi:10.1111/j.1365-2699.2010.02416.x · Cited by 660
The uncertain nature of absences and their importance in species distribution modelling
Lobo, J. M., Jiménez‐Valverde, A., & Hortal, J. (2010) · Ecography · doi:10.1111/j.1600-0587.2009.06039.x · Cited by 656
Veloz, S. D. (2009) · Journal of Biogeography · doi:10.1111/j.1365-2699.2009.02174.x · Cited by 646
Assessing transferability of ecological models: an underappreciated aspect of statistical validation
Wenger, S. J., & Olden, J. D. (2012) · Methods in Ecology and Evolution · doi:10.1111/j.2041-210x.2011.00170.x · Cited by 642
Hijmans, R. J. (2012) · Ecology · doi:10.1890/11-0826.1 · Cited by 636
Syfert, M. M., Smith, M. J., & Coomes, D. A. (2013) · PLoS ONE · doi:10.1371/journal.pone.0055158 · Cited by 612
Morales, N. S., Fernández, I. C., & Baca-González, V. (2017) · PeerJ · doi:10.7717/peerj.3093 · Cited by 464
A quantitative synthesis of the importance of variables used in MaxEnt species distribution models
Bradie, J., & Leung, B. (2017) · Journal of Biogeography · doi:10.1111/jbi.12894 · Cited by 420
Porfirio, L. L., Harris, R. M. B., Lefroy, E. C., Hugh, S., Gould, S. F., Lee, G., Bindoff, N. L., & Mackey, B. (2014) · PLoS ONE · doi:10.1371/journal.pone.0113749 · Cited by 411
Opening the climate envelope reveals no macroscale associations with climate in European birds
Beale, C. M., Lennon, J. J., & Gimona, A. (2008) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0803506105 · Cited by 317
Braunisch, V., Coppes, J., Arlettaz, R., Suchant, R., Schmid, H., & Bollmann, K. (2013) · Ecography · doi:10.1111/j.1600-0587.2013.00138.x · Cited by 311
Mistaking geography for biology: inferring processes from species distributions
Warren, D. L., Cardillo, M., Rosauer, D. F., & Bolnick, D. I. (2014) · Trends in Ecology & Evolution · doi:10.1016/j.tree.2014.08.003 · Cited by 297
Interoperability of Biodiversity Databases: Biodiversity Information on Every Desktop
Edwards, J. L., Lane, M. A., & Nielsen, E. S. (2000) · Science · doi:10.1126/science.289.5488.2312 · Cited by 283
Petitpierre, B., Broennimann, O., Kueffer, C., Daehler, C., & Guisan, A. (2017) · Global Ecology and Biogeography · doi:10.1111/geb.12530 · Cited by 253
Synes, N. W., & Osborne, P. E. (2011) · Global Ecology and Biogeography · doi:10.1111/j.1466-8238.2010.00635.x · Cited by 245
Testing the predictive performance of distribution models
Bahn, V., & McGill, B. J. (2013) · Oikos · doi:10.1111/j.1600-0706.2012.00299.x · Cited by 245
Model selection and information theory in geographical ecology
Diniz‐Filho, J. A. F., Rangel, T. F. L. V. B., & Bini, L. M. (2008) · Global Ecology and Biogeography · doi:10.1111/j.1466-8238.2008.00395.x · Cited by 225
Can niche‐based distribution models outperform spatial interpolation?
Bahn, V., & McGill, B. J. (2007) · Global Ecology and Biogeography · doi:10.1111/j.1466-8238.2007.00331.x · Cited by 213
Novel methods to select environmental variables in MaxEnt: A case study using invasive crayfish
Zeng, Y., Low, B. W., & Yeo, D. C. J. (2016) · Ecological Modelling · doi:10.1016/j.ecolmodel.2016.09.019 · Cited by 203
POC plots: calibrating species distribution models with presence‐only data
Phillips, S. J., & Elith, J. (2010) · Ecology · doi:10.1890/09-0760.1 · Cited by 202
Using species distribution models in paleobiogeography: A matter of data, predictors and concepts
Varela, S., Lobo, J. M., & Hortal, J. (2011) · Palaeogeography Palaeoclimatology Palaeoecology · doi:10.1016/j.palaeo.2011.07.021 · Cited by 199
Rödder, D., Schmidtlein, S., Veith, M., & Lötters, S. (2009) · PLoS ONE · doi:10.1371/journal.pone.0007843 · Cited by 192
Dobrowski, S. Z., Thorne, J. H., Greenberg, J. A., Safford, H. D., Mynsberge, A. R., Crimmins, S. M., & Swanson, A. K. (2011) · Ecological Monographs · doi:10.1890/10-1325.1 · Cited by 184
Accounting for spatially biased sampling effort in presence‐only species distribution modelling
Stolar, J., & Nielsen, S. E. (2014) · Diversity and Distributions · doi:10.1111/ddi.12279 · Cited by 180
Jiménez‐Valverde, A., Acevedo, P., Barbosa, A. M., Lobo, J. M., & Real, R. (2012) · Global Ecology and Biogeography · doi:10.1111/geb.12007 · Cited by 156
Murray, J. V., Goldizen, A. W., O’Leary, R. A., McAlpine, C., Possingham, H. P., & Low‐Choy, S. (2009) · Journal of Applied Ecology · doi:10.1111/j.1365-2664.2009.01671.x · Cited by 147
Verbruggen, H., Tyberghein, L., Belton, G. S., Mineur, F., Jueterbock, A. O., Hoarau, G. G., Gurgel, C. F. D., & Clerck, O. D. (2013) · PLoS ONE · doi:10.1371/journal.pone.0068337 · Cited by 120
Esselman, P. C., & Allan, J. D. (2010) · Freshwater Biology · doi:10.1111/j.1365-2427.2010.02417.x · Cited by 106
Jiménez‐Valverde, A. (2014) · Biodiversity and Conservation · doi:10.1007/s10531-013-0606-1 · Cited by 103
Dominant climate influences on North American bird distributions
Jiménez‐Valverde, A., Barve, N., Lira‐Noriega, A., Maher, S. P., Nakazawa, Y., Papeş, M., Soberón, J. M., Sukumaran, J., & Peterson, A. T. (2010) · Global Ecology and Biogeography · doi:10.1111/j.1466-8238.2010.00574.x · Cited by 70
Weak climatic associations among British plant distributions
Chapman, D. S. (2010) · Global Ecology and Biogeography · doi:10.1111/j.1466-8238.2010.00561.x · Cited by 69
Rödder, D., & Lötters, S. (2010) · Die Naturwissenschaften · doi:10.1007/s00114-010-0694-7 · Cited by 68
Smith, A. B. (2013) · Diversity and Distributions · doi:10.1111/ddi.12031 · Cited by 66
Wang, L., & Jackson, D. A. (2014) · Biological Invasions · doi:10.1007/s10530-014-0649-6 · Cited by 20
Evaluating Model Performance and Significance
Peterson, A. T., Soberón, J. M., Pearson, R. G., Anderson, R. P., Martínez‐Meyer, E., Nakamura, M., & Araújo, M. B. (2011) · Princeton University Press eBooks · doi:10.23943/princeton/9780691136868.003.0009 · Cited by 13
(1950) · doi:10.1002/1097-0142(1950)3:1<32::aid-cncr2820030106>3.0.co;2-3
Research works printed but not linked: 1
- von Humboldt A., 1805, Essai sur la géographie des plantes; accompagné d'un tableau physique des régions équinoxiales
Cited by
Northrup, J. M., Vander Wal, E., Bonar, M., Fieberg, J., Laforge, M. P., Leclerc, M., Prokopenko, C. M., & Gerber, B. D. (2022) · Ecological Applications · doi:10.1002/eap.2470 · Cited by 227
“…to differences in the relative abundance of habitat in other areas, missing predictors or model misspecification that will result in coefficients that poorly reflect causal effects (Matthiopoulos et al. 2011, Fourcade et al. 2018; see Functional responses for a discussion of functional responses).”
BackgroundNearest neighbour distance matching Leave‐One‐Out Cross‐Validation for map validation
Milà, C., Mateu, J., Pebesma, E., & Meyer, H. (2022) · Methods in Ecology and Evolution · doi:10.1111/2041-210x.13851 · Cited by 119
Environmental filtering improves ecological niche models across multiple scales
Castellanos, A. A., Huntley, J. W., Voelker, G., & Lawing, A. M. (2019) · Methods in Ecology and Evolution · doi:10.1111/2041-210x.13142 · Cited by 118
Yaworsky, P. M., Vernon, K. B., Spangler, J. D., Brewer, S. C., & Codding, B. F. (2020) · PLOS One · doi:10.1371/journal.pone.0239424 · Cited by 104
Moudrý, V., Gábor, L., Marselis, S., Pracná, P., Barták, V., Prošek, J., Navrátilová, B., Novotný, J., Potůčková, M., Gdulová, K., et al. (2024) · Ecosphere · doi:10.1002/ecs2.70026 · Cited by 43
Metadata
- Authors
- Fourcade, Y., Besnard, A. G., & Secondi, J.
- Affiliations
- GECCO (Group of ecology and conservation of vertebrates) Université d'Angers Angers France
- Venue
- Global Ecology and Biogeography
- Publisher
- Wiley
- Published
- 2017-11-22
- Volume
- 27
- Issue
- 2
- Pages
- 245-256
- ISSN
- 1466-822X
- 1466-8238
- Cited by
- 500
- References
- 77
- Language
- en
- Funders
- European Regional Development Fund
- Angers Loire Métropole
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.