Transferability and model evaluation in ecological niche modeling: a comparison of GARP and Maxent
The DOI matches its Crossref record; 35 of the 35 references it cites were found in a registry or an index.
Abstract
We compared predictive success in two common algorithms for modeling species’ ecological niches, GARP and Maxent, in a situation that challenged the algorithms to be general – that is, to be able to predict the species’ distributions in broad unsampled regions, here termed transferability. The results were strikingly different between the two algorithms – Maxent models reconstructed the overall distributions of the species at low thresholds, but higher predictive levels of Maxent predictions reflected overfitting to the input data; GARP models, on the other hand, succeeded in anticipating most of the species’ distributional potential, at the cost of increased (apparent, at least) commission error. Receiver operating characteristic (ROC) tests were weak in discerning models able to predict into broad unsampled areas from those that were not. Such transferability is clearly a novel challenge for modeling algorithms, and requires different qualities than does predicting within densely sampled landscapes – in this case, Maxent was transferable only at very low thresholds, and biases and gaps in input data may frequently affect results based on higher Maxent thresholds, requiring careful interpretation of model results.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
DeLong, E. R., DeLong, D. M., & Clarke-Pearson, D. L. (1988) · Biometrics · doi:10.2307/2531595 · Cited by 22,649
Maximum entropy modeling of species geographic distributions
Phillips, S. J., Anderson, R. P., & Schapire, R. E. (2006) · Ecological Modelling · doi:10.1016/j.ecolmodel.2005.03.026 · Cited by 15,396
Novel methods improve prediction of species’ distributions from occurrence data
Elith*, J., H. Graham*, C., P. Anderson, R., Dudík, M., Ferrier, S., Guisan, A., J. Hijmans, R., Huettmann, F., R. Leathwick, J., Lehmann, A., et al. (2006) · Ecography · doi:10.1111/j.2006.0906-7590.04596.x · Cited by 9,088
Extinction risk from climate change
Thomas, C. D., Cameron, A., Green, R. E., Bakkenes, M., Beaumont, L. J., Collingham, Y. C., Erasmus, B. F. N., de Siqueira, M. F., Grainger, A., Hannah, L., et al. (2004) · Nature · doi:10.1038/nature02121 · Cited by 7,695
Self-citationPredictive habitat distribution models in ecology
Guisan, A., & Zimmermann, N. E. (2000) · Ecological Modelling · doi:10.1016/s0304-3800(00)00354-9 · Cited by 7,359
A review of methods for the assessment of prediction errors in conservation presence/absence models
FIELDING, A. H., & BELL, J. F. (1997) · Environmental Conservation · doi:10.1017/s0376892997000088 · Cited by 6,956 · cited 1×
“We focused our model evaluation on the area under the curve (AUC) in receiver operating characteristic analyses ( Fielding and Bell 1997 ), which is the measure generally accepted as best for evaluating model performance, employed in recent comprehensive evaluations (Elith et al. 2006).”
MethodPearson, R. G., Raxworthy, C. J., Nakamura, M., & Townsend Peterson, A. (2007) · Journal of Biogeography · doi:10.1111/j.1365-2699.2006.01594.x · Cited by 3,138
Self-citationSelecting thresholds of occurrence in the prediction of species distributions
Liu, C., Berry, P. M., Dawson, T. P., & Pearson, R. G. (2005) · Ecography · doi:10.1111/j.0906-7590.2005.03957.x · Cited by 2,701
Climate change threats to plant diversity in Europe
Thuiller, W., Lavorel, S., Araújo, M. B., Sykes, M. T., & Prentice, I. C. (2005) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0409902102 · Cited by 2,568
A maximum entropy approach to species distribution modeling
Phillips, S. J., Dudík, M., & Schapire, R. E. (2004) · Twenty-first international conference on Machine learning - ICML '04 · doi:10.1145/1015330.1015412 · Cited by 2,252
Interpretation of Models of Fundamental Ecological Niches and Species’ Distributional Areas
Soberon, J., & Peterson, A. T. (2005) · Biodiversity Informatics · doi:10.17161/bi.v2i0.4 · Cited by 2,170
Validation of species–climate impact models under climate change
Araújo, M. B., Pearson, R. G., Thuiller, W., & Erhard, M. (2005) · Global Change Biology · doi:10.1111/j.1365-2486.2005.01000.x · Cited by 1,669
Evaluating predictive models of species’ distributions: criteria for selecting optimal models
Anderson, R. P., Lew, D., & Peterson, A. T. (2003) · Ecological Modelling · doi:10.1016/s0304-3800(02)00349-6 · Cited by 1,285
Effects of sample size on accuracy of species distribution models
Stockwell, D. R. B., & Peterson, A. T. (2002) · Ecological Modelling · doi:10.1016/s0304-3800(01)00388-x · Cited by 1,214
New developments in museum-based informatics and applications in biodiversity analysis
GRAHAM, C., FERRIER, S., HUETTMAN, F., MORITZ, C., & PETERSON, A. (2004) · Trends in Ecology & Evolution · doi:10.1016/j.tree.2004.07.006 · Cited by 1,115
Model‐based uncertainty in species range prediction
Pearson, R. G., Thuiller, W., Araújo, M. B., Martinez‐Meyer, E., Brotons, L., McClean, C., Miles, L., Segurado, P., Dawson, T. P., & Lees, D. C. (2006) · Journal of Biogeography · doi:10.1111/j.1365-2699.2006.01460.x · Cited by 981
Are niche‐based species distribution models transferable in space?
Randin, C. F., Dirnböck, T., Dullinger, S., Zimmermann, N. E., Zappa, M., & Guisan, A. (2006) · Journal of Biogeography · doi:10.1111/j.1365-2699.2006.01466.x · Cited by 768
How Does Climate Change Affect Biodiversity?
Araújo, M. B., & Rahbek, C. (2006) · Science · doi:10.1126/science.1131758 · Cited by 615
Continuum Concept, Ordination Methods, and Niche Theory
Austin, M. (1985) · Annual Review of Ecology and Systematics · doi:10.1146/annurev.ecolsys.16.1.39 · Cited by 567
Sensitivity of predictive species distribution models to change in grain size
Guisan, A., Graham, C. H., Elith, J., Huettmann, F., & the NCEAS Species Distribution Modelling Group (2007) · Diversity and Distributions · doi:10.1111/j.1472-4642.2007.00342.x · Cited by 543
Uses and Requirements of Ecological Niche Models and Related Distributional Models
Peterson, A. T. (2006) · Biodiversity Informatics · doi:10.17161/bi.v3i0.29 · Cited by 482
Stockwell, D. R. B., & Noble, I. R. (1992) · Mathematics and Computers in Simulation · doi:10.1016/0378-4754(92)90126-2 · Cited by 445
Manel, S., Dias, J.-M., & Ormerod, S. J. (1999) · Ecological Modelling · doi:10.1016/s0304-3800(99)00113-1 · Cited by 435
Biodiversity informatics: managing and applying primary biodiversity data
Soberón, J., & Peterson, T. (2004) · Philosophical Transactions of the Royal Society of London. Series B: Biological Sciences · doi:10.1098/rstb.2003.1439 · Cited by 431
Do we need land‐cover data to model species distributions in Europe?
Thuiller, W., Araújo, M. B., & Lavorel, S. (2004) · Journal of Biogeography · doi:10.1046/j.0305-0270.2003.00991.x · Cited by 414
WHAT MATTERS FOR PREDICTING THE OCCURRENCES OF TREES: TECHNIQUES, DATA, OR SPECIES' CHARACTERISTICS?
Guisan, A., Zimmermann, N. E., Elith, J., Graham, C. H., Phillips, S., & Peterson, A. T. (2007) · Ecological Monographs · doi:10.1890/06-1060.1 · Cited by 385
Peterson, A. T., & Shaw, J. (2003) · International Journal for Parasitology · doi:10.1016/s0020-7519(03)00094-8 · Cited by 317
Alternative methods for predicting species distribution: an illustration with Himalayan river birds
Manel, S., Dias, J. M., Buckton, S. T., & Ormerod, S. J. (1999) · Journal of Applied Ecology · doi:10.1046/j.1365-2664.1999.00440.x · Cited by 311
Sensitivity of distributional prediction algorithms to geographic data completeness
Peterson, A. T., & Cohoon, K. P. (1999) · Ecological Modelling · doi:10.1016/s0304-3800(99)00023-x · Cited by 300
Araújo, M. B., Thuiller, W., Williams, P. H., & Reginster, I. (2005) · Global Ecology and Biogeography · doi:10.1111/j.1466-822x.2004.00128.x · Cited by 259
Application and testing of a procedure to evaluate transferability of habitat suitability criteria
Thomas, J. A., & Bovee, K. D. (1993) · Regulated Rivers Research & Management · doi:10.1002/rrr.3450080307 · Cited by 141
Bio, A. M. F., Becker, P. D., Bie, E. D., Huybrechts, W., & Wassen, M. J. (2002) · Biodiversity and Conservation · doi:10.1023/a:1021346712677 · Cited by 82
Validation of plant functional types across two contrasting landscapes
Kleyer, M. (2002) · Journal of Vegetation Science · doi:10.1111/j.1654-1103.2002.tb02036.x · Cited by 67
Are habitat models transferable in space and time
Schröder, B., & Richter, O. (2000) · Cited by 60
García-Varea, I., & Casacuberta, F. (2005) · Machine Learning · doi:10.1007/s10994-005-0915-z · Cited by 36
Cited by
ENVIRONMENTAL NICHE EQUIVALENCY VERSUS CONSERVATISM: QUANTITATIVE APPROACHES TO NICHE EVOLUTION
Warren, D. L., Glor, R. E., & Turelli, M. (2008) · Evolution · doi:10.1111/j.1558-5646.2008.00482.x · Cited by 2,663
Barve, N., Barve, V., Jiménez-Valverde, A., Lira-Noriega, A., Maher, S. P., Peterson, A. T., Soberón, J., & Villalobos, F. (2011) · Ecological Modelling · doi:10.1016/j.ecolmodel.2011.02.011 · Cited by 1,881
Making better M axent models of species distributions: complexity, overfitting and evaluation
Radosavljevic, A., & Anderson, R. P. (2014) · Journal of Biogeography · doi:10.1111/jbi.12227 · Cited by 1,723
“…models lack generality, which hinders studies that involve model transfer to another region or time period or that aim to compare species niches (Peterson, 2003; Ara ujo et al., 2005a; Hijmans & Graham, 2006; Randin et al., 2006; Peterson et al., 2007, 2011; Phillips, 2008; Jezkova et al., 2009).”
BackgroundMethodRethinking receiver operating characteristic analysis applications in ecological niche modeling
Peterson, A. T., Papeş, M., & Soberón, J. (2008) · Ecological Modelling · doi:10.1016/j.ecolmodel.2007.11.008 · Cited by 1,526
Self-citationElith, J., & Graham, C. H. (2009) · Ecography · doi:10.1111/j.1600-0587.2008.05505.x · Cited by 1,098
Metadata
- Authors
- Townsend Peterson, A., Papeş, M., & Eaton, M.
- Venue
- Ecography
- Publisher
- Wiley
- Published
- 2007-08
- Volume
- 30
- Issue
- 4
- Pages
- 550-560
- ISSN
- 0906-7590 (ISSN-L)
- 1600-0587
- OpenAlex
- W2046669039
- Cited by
- 971
- References
- 35
- FWCI
- 26.51
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.