The DOI matches its Crossref record; 3 of the 3 references it cites were found in a registry or an index.
ENM eval: An R package for conducting spatially independent evaluations and estimating optimal model complexity for Maxent ecological niche models
Abstract
Summary: Recent studies have demonstrated a need for increased rigour in building and evaluating ecological niche models ( ENM s) based on presence‐only occurrence data. Two major goals are to balance goodness‐of‐fit with model complexity (e.g. by ‘tuning’ model settings) and to evaluate models with spatially independent data. These issues are especially critical for data sets suffering from sampling bias, and for studies that require transferring models across space or time (e.g. responses to climate change or spread of invasive species). Efficient implementation of procedures to accomplish these goals, however, requires automation. We developed ENM eval , an R package that: (i) creates data sets for k ‐fold cross‐validation using one of several methods for partitioning occurrence data (including options for spatially independent partitions), (ii) builds a series of candidate models using Maxent with a variety of user‐defined settings and (iii) provides multiple evaluation metrics to aid in selecting optimal model settings. The six methods for partitioning data are n −1 jackknife, random k ‐folds ( = bins), user‐specified folds and three methods of masked geographically structured folds. ENM eval quantifies six evaluation metrics: the area under the curve of the receiver‐operating characteristic plot for test localities ( AUC TEST ), the difference between training and testing AUC ( AUC DIFF ), two different threshold‐based omission rates for test localities and the Akaike information criterion corrected for small sample sizes ( AIC c). We demonstrate ENM eval by tuning model settings for eight tree species of the genus Coccoloba in Puerto Rico based on AIC c. Evaluation metrics varied substantially across model settings, and models selected with AIC c differed from default ones. In summary, ENMeval facilitates the production of better ENM s and should promote future methodological research on many outstanding issues.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Allowing more feature classes enables a more flexible fit to the observed data; however, higher flexibility has been shown to result is an overfitted model (Hastie, Tibshirani & Friedman 2009; Muscarella et al. 2014; Peterson et al. 2011; Phillips & Dudík 2008).”
From A maxent predictive model for hunter-gatherer sites in the southern pampas, argentina (2021) · cites this paper as Muscarella et al. 2014
Citations
Cites
The Elements of Statistical Learning
Hastie, T., Tibshirani, R., & Friedman, J. (2009) · Springer Series in Statistics · doi:10.1007/978-0-387-84858-7 · Cited by 25,970
The art of modelling range-shifting species: The art of modelling range-shifting species
Elith, J., Kearney, M., & Phillips, S. (2010) · Methods in Ecology and Evolution · doi:10.1111/j.2041-210x.2010.00036.x · Cited by 2,813
Warren, D. L., & Seifert, S. N. (2011) · Ecological Applications · doi:10.1890/10-1171.1 · Cited by 2,312
Research works printed but not linked: 36
- 10.1046/j.1365-2699.2003.00867.x · DOI
- 10.1111/nyas.12264 · DOI
- 10.1016/j.ecolmodel.2011.04.011 · DOI
- 10.1111/j.1365-2699.2006.01584.x · DOI
- 10.1890/11-1930.1 · DOI
- Bawiec W.J. ed. (1999)Geology geochemistry geophysics mineral occurrences and mineral resource assessment for the Commonwealth of Puerto Rico: U.S. Geological Survey Open‐File Report 98‐038 available online only. · DOI
- 10.1177/0049124104268644 · DOI · Paper page
- 10.1016/j.ecolmodel.2013.03.012 · DOI
- 10.1002/joc.937 · DOI
- 10.1111/j.1365-2699.2011.02659.x · DOI
- 10.1111/j.2006.0906-7590.04596.x · DOI · Paper page
- 10.1111/j.1472-4642.2010.00725.x · DOI · Paper page
- 10.1017/S0376892997000088 · DOI · Paper page
- 10.1214/13-AOAS667 · DOI
- 10.1111/j.1461-0248.2005.00792.x · DOI
- 10.1148/radiology.143.1.7063747 · DOI · Paper page
- 10.1890/11-0826.1 · DOI
- 10.1016/j.tree.2008.02.001 · DOI
- 10.1111/j.1466-8238.2007.00358.x · DOI · Paper page
- 10.1111/j.1600-0587.2013.07872.x · DOI · Paper page
- 10.1111/j.1365-2699.2006.01594.x · DOI
- 10.23943/princeton/9780691136868.001.0001 · DOI
- 10.1111/j.0906-7590.2008.5378.x · DOI
- 10.1016/j.ecolmodel.2005.03.026 · DOI · Paper page
- 10.1111/j.0906-7590.2008.5203.x · DOI · Paper page
- 10.1890/07-2153.1 · DOI · Paper page
- 10.1111/jbi.12227 · DOI · Paper page
- 10.1111/j.1541-0420.2012.01824.x · DOI
- 10.2307/1935534 · DOI
- 10.1016/j.ecolmodel.2013.08.011 · DOI
- 10.1371/journal.pone.0055158 · DOI
- 10.1111/j.1365-2699.2009.02174.x · DOI
- 10.1111/j.1558-5646.2008.00482.x · DOI
- 10.1111/ddi.12160 · DOI
- 10.1111/j.2041-210X.2011.00170.x · DOI
- 10.1111/2041-210x.12004 · DOI
Cited by
Sorted by citations
A checklist for maximizing reproducibility of ecological niche models
Feng, X., Park, D. S., Walker, C., Peterson, A. T., Merow, C., & Papeş, M. (2019) · Nature Ecology & Evolution · doi:10.1038/s41559-019-0972-5 · Cited by 323
Environmental filtering improves ecological niche models across multiple scales
Castellanos, A. A., Huntley, J. W., Voelker, G., & Lawing, A. M. (2019) · Methods in Ecology and Evolution · doi:10.1111/2041-210x.13142 · Cited by 118
Freeman, B., Roehrdanz, P. R., & Peterson, A. T. (2019) · Biodiversity and Conservation · doi:10.1007/s10531-018-01684-6 · Cited by 38
A maxent predictive model for hunter-gatherer sites in the southern pampas, argentina
Rafuse, D. J. (2021) · Open Quaternary · doi:10.5334/oq.97 · Cited by 17
Metadata
- Authors
- Muscarella, R., Galante, P. J., Soley‐Guardia, M., Boria, R. A., Kass, J. M., Uriarte, M., & Anderson, R. P.
- Affiliations
- Department of Ecology, Evolution and Environmental Biology Columbia University 1200 Amsterdam Ave. New York, NY 10027 USA
- Department of Biology City College of the City University of New York 160 Convent Ave., New York NY 10031 USA
- Venue
- Methods in Ecology and Evolution
- Publisher
- Wiley
- Published
- 2014-09-25
- Volume
- 5
- Issue
- 11
- Pages
- 1198-1205
- ISSN
- 2041-210X
- Cited by
- 1,962
- References
- 3
- Language
- en
- Funders
- National Science Foundation (1311367, 1119915)
- Graduate Center of the City University of New York
- Luis Stokes Alliance for Minority Participation
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review