The DOI matches its Crossref record; 57 of the 57 references it cites were found in a registry or an index.
The ODD protocol: A review and first update
Abstract
The ‘ODD’ (Overview, Design concepts, and Details) protocol was published in 2006 to standardize the published descriptions of individual-based and agent-based models (ABMs). The primary objectives of ODD are to make model descriptions more understandable and complete, thereby making ABMs less subject to criticism for being irreproducible. We have systematically evaluated existing uses of the ODD protocol and identified, as expected, parts of ODD needing improvement and clarification. Accordingly, we revise the definition of ODD to clarify aspects of the original version and thereby facilitate future standardization of ABM descriptions. We discuss frequently raised critiques in ODD but also two emerging, and unanticipated, benefits: ODD improves the rigorous formulation of models and helps make the theoretical foundations of large models more visible. Although the protocol was designed for ABMs, it can help with documenting any large, complex model, alleviating some general objections against such models.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
On Optimal Use of a Patchy Environment
MacArthur, R. H., & Pianka, E. R. (1966) · The American Naturalist · doi:10.1086/282454 · Cited by 4,593
Natural Selection, the Costs of Reproduction, and a Refinement of Lack's Principle
Williams, G. C. (1966) · The American Naturalist · doi:10.1086/282461 · Cited by 3,276
A standard protocol for describing individual-based and agent-based models
Grimm, V., Berger, U., Bastiansen, F., Eliassen, S., Ginot, V., Giske, J., Goss-Custard, J., Grand, T., Heinz, S. K., Huse, G., et al. (2006) · Ecological Modelling · doi:10.1016/j.ecolmodel.2006.04.023 · Cited by 2,981
Self-citationPattern-Oriented Modeling of Agent-Based Complex Systems: Lessons from Ecology
Grimm, V., Revilla, E., Berger, U., Jeltsch, F., Mooij, W. M., Railsback, S. F., Thulke, H.-H., Weiner, J., Wiegand, T., & DeAngelis, D. L. (2005) · Science · doi:10.1126/science.1116681 · Cited by 2,175
Self-citationIndividual-based Modeling and Ecology
Grimm, V., & Railsback, S. F. (2005) · Princeton University Press eBooks · doi:10.1515/9781400850624 · Cited by 1,940
Self-citationBehavioural reaction norms: animal personality meets individual plasticity
Dingemanse, N. J., Kazem, A. J. N., Réale, D., & Wright, J. (2010) · Trends in Ecology & Evolution · doi:10.1016/j.tree.2009.07.013 · Cited by 1,496
The Role of Time and Energy in Food Preference
Emlen, J. M. (1966) · The American Naturalist · doi:10.1086/282455 · Cited by 1,470
Grimm, V. (1999) · Ecological Modelling · doi:10.1016/s0304-3800(98)00188-4 · Cited by 939
Self-citationThe Swarm Simulation System: A Toolkit for Building Multi-Agent Simulations
Minar, N., Burkhart, R., Langton, C. G., & Askenazi, M. (1996) · Cited by 739
Individual-Based Modeling of Ecological and Evolutionary Processes
DeAngelis, D. L., & Mooij, W. M. (2005) · Annual Review of Ecology, Evolution, and Systematics · doi:10.1146/annurev.ecolsys.36.102003.152644 · Cited by 634
Self-citationUses and Abuses of Mathematics in Biology
May, R. M. (2004) · Science · doi:10.1126/science.1094442 · Cited by 456
The virtual ecologist approach: simulating data and observers
Zurell, D., Berger, U., Cabral, J. S., Jeltsch, F., Meynard, C. N., Münkemüller, T., Nehrbass, N., Pagel, J., Reineking, B., Schröder, B., et al. (2010) · Oikos · doi:10.1111/j.1600-0706.2009.18284.x · Cited by 361
Self-citationThe Science of Scientific Writing
Gopen, G. D., & Swan, J. A. (1990) · American Scientist · Cited by 345
Integrating function and mechanism
McNamara, J. M., & Houston, A. I. (2009) · Trends in Ecology & Evolution · doi:10.1016/j.tree.2009.05.011 · Cited by 325
Island Species Richness Increases with Habitat Diversity
Hortal, J., Triantis, K. A., Meiri, S., Thébault, E., & Sfenthourakis, S. (2009) · The American Naturalist · doi:10.1086/645085 · Cited by 316
Tree Spacing and Coexistence in Semiarid Savannas
Jeltsch, F., Milton, S. J., Dean, W. R. J., & van Rooyen, N. (1996) · The Journal of Ecology · doi:10.2307/2261480 · Cited by 276
(2004) · Princeton University Press eBooks · doi:10.1515/9780691228846 · Cited by 249
Network-based diffusion analysis: a new method for detecting social learning
Franz, M., & Nunn, C. L. (2009) · Proceedings of the Royal Society B: Biological Sciences · doi:10.1098/rspb.2008.1824 · Cited by 231
Concepts from complex adaptive systems as a framework for individual-based modelling
Railsback, S. F. (2001) · Ecological Modelling · doi:10.1016/s0304-3800(01)00228-9 · Cited by 221
Self-citationIntegration of Ecosystem Theories: A Pattern
Jørgensen, S. E. (1992) · Ecology & Environment · doi:10.1007/978-94-011-2682-3 · Cited by 182
Gusset, M., Jakoby, O., Müller, M. S., Somers, M. J., Slotow, R., & Grimm, V. (2009) · Biological Conservation · doi:10.1016/j.biocon.2009.07.007 · Cited by 180
Self-citationBerger, U., Rivera-Monroy, V. H., Doyle, T. W., Dahdouh-Guebas, F., Duke, N. C., Fontalvo-Herazo, M. L., Hildenbrandt, H., Koedam, N., Mehlig, U., Piou, C., et al. (2008) · Aquatic Botany · doi:10.1016/j.aquabot.2007.12.015 · Cited by 178
Self-citationA bunch of tiny individuals—Individual-based modeling for microbes
Hellweger, F. L., & Bucci, V. (2009) · Ecological Modelling · doi:10.1016/j.ecolmodel.2008.09.004 · Cited by 167
Using the ODD Protocol for Describing Three Agent-Based Social Simulation Models of Land-Use Change
Polhill, G. J., Parker, D. C., Brown, D. G., & Grimm, V. (2008) · RePEc: Research Papers in Economics · Cited by 154
Self-citationBithell, M., & Brasington, J. (2008) · Environmental Modelling & Software · doi:10.1016/j.envsoft.2008.06.016 · Cited by 136
Wang, M., & Grimm, V. (2007) · Ecological Modelling · doi:10.1016/j.ecolmodel.2007.03.003 · Cited by 136
Self-citationPopulation Stability and Life History Phenomena
Murdoch, W. W. (1966) · The American Naturalist · doi:10.1086/282396 · Cited by 116
Guzy, M., Smith, C. L., Bolte, J. P., Hulse, D. W., & Gregory, S. V. (2008) · Ecology and Society · doi:10.5751/es-02388-130137 · Cited by 108
Towards a Community Framework for Agent-Based Modelling
Janssen, M. A., Alessa, L., Barton, C. M., Bergin, S. M., & Lee, A. (2008) · RePEc: Research Papers in Economics · Cited by 102
Understanding Artificial Anasazi
Janssen, M. A. (2009) · RePEc: Research Papers in Economics · Cited by 87
The impact of fragmentation and density regulation on forest succession in the Atlantic rain forest
Groeneveld, J., Alves, L. F., Bernacci, L. C., Catharino, E. L. M., Knogge, C., Metzger, J. P., Pütz, S., & Huth, A. (2009) · Ecological Modelling · doi:10.1016/j.ecolmodel.2009.06.015 · Cited by 86
A multi-agent simulation to assess the risk of malaria re-emergence in southern France
Linard, C., Ponçon, N., Fontenille, D., & Lambin, É. F. (2008) · Ecological Modelling · doi:10.1016/j.ecolmodel.2008.09.001 · Cited by 79
Modeling the impact of feeding stations on vulture scavenging service efficiency
Deygout, C., Gault, A., Sarrazin, F., & Bessa‐Gomes, C. (2009) · Ecological Modelling · doi:10.1016/j.ecolmodel.2009.04.030 · Cited by 79
A REJECTION MECHANISM IN 2D BOUNDED CONFIDENCE PROVIDES MORE CONFORMITY
Huet, S., Deffuant, G., & Jager, W. (2008) · Advances in Complex Systems · doi:10.1142/s0219525908001799 · Cited by 77
Modelling and simulation software to support individual-based ecological modelling
Lorek, H., & Sonnenschein, M. (1999) · Ecological Modelling · doi:10.1016/s0304-3800(98)00193-8 · Cited by 72
Stillman, R. A. (2008) · Ecological Modelling · doi:10.1016/j.ecolmodel.2008.04.014 · Cited by 70
LEARNING FROM LOCAL KNOWLEDGE: MODELING THE PASTORAL‐NOMADIC RANGE MANAGEMENT OF THE HIMBA, NAMIBIA
Müller, B. H., Linstädter, A., Frank, K., Bollig, M., & Wissel, C. (2007) · Ecological Applications · doi:10.1890/06-1193.1 · Cited by 66
Brochier, T., Lett, C., Tam, J., Fréon, P., Colas, F., & Ayón, P. (2008) · Progress In Oceanography · doi:10.1016/j.pocean.2008.10.004 · Cited by 66
Integrating ecology, psychology and neurobiology within a food-hoarding paradigm
Витальевич, П. В., & Smulders, T. V. (2010) · Philosophical Transactions of the Royal Society B Biological Sciences · doi:10.1098/rstb.2009.0216 · Cited by 60
Modeling rule-based behavior: habitat selection and the growth-survival trade-off in larval cod
Kristiansen, T., Jørgensen, C., Lough, R. G., Vikebø, F. B., & Fiksen, Ø. (2009) · Behavioral Ecology · doi:10.1093/beheco/arp023 · Cited by 55
Breeding synchrony in colonial birds: from local stress to global harmony
Jovani, R., & Grimm, V. (2008) · Proceedings of the Royal Society B Biological Sciences · doi:10.1098/rspb.2008.0125 · Cited by 46
Self-citationSATCHMO: A spatial simulation model of growth, competition, and mortality in cycling savanna patches
Meyer, K., Wiegand, K., Ward, D., & Moustakas, A. (2007) · Ecological Modelling · doi:10.1016/j.ecolmodel.2007.07.001 · Cited by 45
Swannack, T. M., Grant, W. E., & Forstner, M. R. J. (2008) · Ecological Modelling · doi:10.1016/j.ecolmodel.2008.09.006 · Cited by 44
How might we model an ecosystem
Caron-Lormier, G., Bohan, D. A., Hawes, C., Raybould, A., Haughton, A., & Humphry, R. (2009) · Ecological Modelling · doi:10.1016/j.ecolmodel.2009.04.021 · Cited by 41
A unifying evolutionary theory for the biomass–diversity–fertility relationship
Warren, J. M., Topping, C. J., & James, P. (2009) · Theoretical Ecology · doi:10.1007/s12080-008-0035-z · Cited by 41
Blaum, N., & WICHMANN, M. C. (2007) · Journal of Animal Ecology · doi:10.1111/j.1365-2656.2007.01283.x · Cited by 40
The Integration of Behaviour into Comparative Physiology
Gilmour, K. M., Wilson, R. W., & Sloman, K. A. (2005) · Physiological and Biochemical Zoology · doi:10.1086/432144 · Cited by 40
Vertical migration in adult Atlantic cod (Gadus morhua)
Strand, E., & Huse, G. (2007) · Canadian Journal of Fisheries and Aquatic Sciences · doi:10.1139/f07-135 · Cited by 36
Shepperd, W. D., & Fairweather, M. L. (1994) · Digital Commons - USU (Utah State University) · doi:10.2737/rm-gtr-247 · Cited by 32
Exploring community assembly through an individual-based model for trophic interactions
Giacomini, H. C., Júnior, P. D. M., & Petrere, M. (2008) · Ecological Modelling · doi:10.1016/j.ecolmodel.2008.09.005 · Cited by 30
Individual-based modeling of feeding ecology and prey selection of larval cod on Georges Bank
Kristiansen, T., Lough, R. G., Werner, F. E., Broughton, E., & Buckley, L. (2008) · Marine Ecology Progress Series · doi:10.3354/meps07796 · Cited by 26
Groeneveld, J., Enright, N. J., & Lamont, B. B. (2008) · Journal of Applied Ecology · doi:10.1111/j.1365-2664.2008.01539.x · Cited by 23
Grimm, V. (2008) · Elsevier eBooks · doi:10.1016/b978-008045405-4.00188-9 · Cited by 21
Self-citationA new hypothesis concerning the nature of small pelagic fish clusters
Fur, J. L., & Simon, P. (2009) · Ecological Modelling · doi:10.1016/j.ecolmodel.2009.02.012 · Cited by 18
Factors affecting information transfer from knowledgeable to naive individuals in groups
Mirabet, V., Fréon, P., & Lett, C. (2008) · Behavioral Ecology and Sociobiology · doi:10.1007/s00265-008-0647-8 · Cited by 18
SERGE: A spatially explicit generator of local rainfall in southern Africa
Eisinger, D., & Wiegand, K. (2008) · GRO · Cited by 11
A Common, Conceptual Framework for Behavioral Ecology and Evolutionary Psychology
White, D. W., Dill, L. M., & Crawford, C. B. (2007) · Evolutionary Psychology · doi:10.1177/147470490700500202 · Cited by 10
Cited by
Characterising performance of environmental models
Bennett, N. D., Croke, B. F. W., Guariso, G., Guillaume, J. H. A., Hamilton, S. H., Jakeman, A. J., Marsili-Libelli, S., Newham, L. T. H., Norton, J. P., Perrin, C., et al. (2013) · Environmental Modelling & Software · doi:10.1016/j.envsoft.2012.09.011 · Cited by 1,536
A standard protocol for reporting species distribution models
Zurell, D., Franklin, J., König, C., Bouchet, P. J., Dormann, C. F., Elith, J., Fandos, G., Feng, X., Guillera‐Arroita, G., Guisan, A., et al. (2020) · Ecography · doi:10.1111/ecog.04960 · Cited by 945
Grimm, V., Railsback, S. F., Vincenot, C. E., Berger, U., Gallagher, C., DeAngelis, D. L., Edmonds, B., Ge, J., Giske, J., Groeneveld, J., et al. (2020) · Journal of Artificial Societies and Social Simulation · doi:10.18564/jasss.4259 · Cited by 892
Self-citationDescribing human decisions in agent-based models – ODD + D, an extension of the ODD protocol
Müller, B., Bohn, F., Dreßler, G., Groeneveld, J., Klassert, C., Martin, R., Schlüter, M., Schulze, J., Weise, H., & Schwarz, N. (2013) · Environmental Modelling & Software · doi:10.1016/j.envsoft.2013.06.003 · Cited by 542
Modeling Metal Stocks and Flows: A Review of Dynamic Material Flow Analysis Methods
Müller, E., Hilty, L. M., Widmer, R., Schluep, M., & Faulstich, M. (2014) · Environmental Science & Technology · doi:10.1021/es403506a · Cited by 519
Metadata
- Authors
- Grimm, V., Berger, U., DeAngelis, D. L., Polhill, J. G., Giske, J., & Railsback, S. F.
- Venue
- Ecological Modelling
- Publisher
- Elsevier BV
- Published
- 2010-11
- Volume
- 221
- Issue
- 23
- Pages
- 2760-2768
- ISSN
- 0304-3800 (ISSN-L)
- OpenAlex
- W2140862057
- Cited by
- 2,440
- References
- 57
- FWCI
- 124.71
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.