The DOI matches its Crossref record; 54 of the 54 references it cites were found in a registry or an index.
The Exploration-Exploitation Dilemma: A Multidisciplinary Framework
Open accessAbstract
The trade-off between the need to obtain new knowledge and the need to use that knowledge to improve performance is one of the most basic trade-offs in nature, and optimal performance usually requires some balance between exploratory and exploitative behaviors. Researchers in many disciplines have been searching for the optimal solution to this dilemma. Here we present a novel model in which the exploration strategy itself is dynamic and varies with time in order to optimize a definite goal, such as the acquisition of energy, money, or prestige. Our model produced four very distinct phases: Knowledge establishment, Knowledge accumulation, Knowledge maintenance, and Knowledge exploitation, giving rise to a multidisciplinary framework that applies equally to humans, animals, and organizations. The framework can be used to explain a multitude of phenomena in various disciplines, such as the movement of animals in novel landscapes, the most efficient resource allocation for a start-up company, or the effects of old age on knowledge acquisition in humans.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Reinforcement Learning: An Introduction
Sutton, R. S., & Barto, A. G. (1998) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.1998.712192 · Cited by 27,225
Reinforcement Learning: An Introduction
(2005) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.2004.842673 · Cited by 24,496
The Theory of Economic Development
Schumpeter, J., & Backhaus, U. (2006) · The European Heritage in Economics and the Social Sciences · doi:10.1007/0-306-48082-4_3 · Cited by 22,506
Exploration and Exploitation in Organizational Learning
March, J. G. (1991) · Organization Science · doi:10.1287/orsc.2.1.71 · Cited by 21,942
Taking time seriously: A theory of socioemotional selectivity.
Carstensen, L. L., Isaacowitz, D. M., & Charles, S. T. (1999) · American Psychologist · doi:10.1037//0003-066x.54.3.165 · Cited by 5,377 · cited 2×
“Another popular theory that supports our framework is the Socioemotional Selectivity Theory [31,48,49].”
BackgroundExploitation, Exploration, and Process Management: The Productivity Dilemma Revisited
Benner, M. J., & Tushman, M. L. (2003) · The Academy of Management Review · doi:10.2307/30040711 · Cited by 4,371
Handbook of the Psychology of Aging
(2016) · Elsevier eBooks · doi:10.1016/c2012-0-07221-3 · Cited by 3,394
The Interplay Between Exploration and Exploitation
Gupta, A. K., Smith, K. G., & Shalley, C. E. (2006) · Academy of Management Journal · doi:10.5465/amj.2006.22083026 · Cited by 3,226
Cortical substrates for exploratory decisions in humans
Daw, N. D., O'Doherty, J. P., Dayan, P., Seymour, B., & Dolan, R. J. (2006) · Nature · doi:10.1038/nature04766 · Cited by 2,224
Socioemotional selectivity theory and the regulation of emotion in the second half of life
Carstensen, L. L., Fung, H. H., & Charles, S. T. (2003) · Motivation and Emotion · doi:10.1023/a:1024569803230 · Cited by 1,978
Exploration and exploitation alliances in biotechnology: a system of new product development
Rothaermel, F. T., & Deeds, D. L. (2004) · Strategic Management Journal · doi:10.1002/smj.376 · Cited by 1,941
Bandit processes and dynamic allocation indices
Gittins, J. C. (1979) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1979.tb01068.x · Cited by 1,487
Cohen, J. D., McClure, S. M., & Yu, A. J. (2007) · Philosophical Transactions of the Royal Society B Biological Sciences · doi:10.1098/rstb.2007.2098 · Cited by 1,121
Kirk, D. E. (1970) · Cited by 910
Exploration, exploitation, and financial performance: analysis of S&P 500 corporations
Uotila, J., Maula, M., Keil, T., & Zahra, S. A. (2009) · Strategic Management Journal · doi:10.1002/smj.738 · Cited by 906
Animal ecology meets GPS-based radiotelemetry: a perfect storm of opportunities and challenges
Cagnacci, F., Boitani, L., Powell, R. A., & Boyce, M. S. (2010) · Philosophical Transactions of the Royal Society B: Biological Sciences · doi:10.1098/rstb.2010.0107 · Cited by 782
Strategy as Vector and the Inertia of Coevolutionary Lock-in
Burgelman, R. A. (2002) · Administrative Science Quarterly · doi:10.2307/3094808 · Cited by 768
Rao, A. V., Benson, D. A., Darby, C., Patterson, M. A., Francolin, C., Sanders, I., & Huntington, G. T. (2010) · ACM Transactions on Mathematical Software · doi:10.1145/1731022.1731032 · Cited by 651
(1992) · PubMed · Cited by 646
Doya, K. (2008) · Nature Neuroscience · doi:10.1038/nn2077 · Cited by 642
Test of optimal sampling by foraging great tits
Krebs, J. R., Kacelnik, A., & Taylor, P. (1978) · Nature · doi:10.1038/275027a0 · Cited by 600
Potential disadvantages of using socially acquired information
Giraldeau, L., Valone, T. J., & Templeton, J. J. (2002) · Philosophical Transactions of the Royal Society of London. Series B: Biological Sciences · doi:10.1098/rstb.2002.1065 · Cited by 560
Motivation and Self-Regulation across the Life Span
(1998) · Cambridge University Press eBooks · doi:10.1017/cbo9780511527869 · Cited by 475
Bayesian theories of conditioning in a changing world
Courville, A. C., Daw, N. D., & Touretzky, D. S. (2006) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2006.05.004 · Cited by 457
Multiple movement modes by large herbivores at multiple spatiotemporal scales
Fryxell, J. M., Hazell, M., Börger, L., Dalziel, B. D., Haydon, D. T., Morales, J. M., McIntosh, T., & Rosatte, R. C. (2008) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0801737105 · Cited by 436
Influence of time on social preferences: Implications for life-span development.
Fung, H. H., Carstensen, L. L., & Lutz, A. M. (1999) · Psychology and Aging · doi:10.1037//0882-7974.14.4.595 · Cited by 392
The Significance of Ecological Factors for Exploration and Neophobia in Parrots
Mettke‐Hofmann, C., Winkler, H., & Leisler, B. (2002) · Ethology · doi:10.1046/j.1439-0310.2002.00773.x · Cited by 355
A stochastic reinforcement learning algorithm for learning real-valued functions
Gullapalli, V. (1990) · Neural Networks · doi:10.1016/0893-6080(90)90056-q · Cited by 295
Meta-learning in Reinforcement Learning
Schweighofer, N., & Doya, K. (2003) · Neural Networks · doi:10.1016/s0893-6080(02)00228-9 · Cited by 261 · cited 1×
“Moreover, analogical neurophysiologic pathways in the brain of animals and humans have been suggested, highlighting the neurobiological substrates that are related to the regulation of decision-making [17,18,20].”
BackgroundControl of exploitation–exploration meta-parameter in reinforcement learning
Ishii, S., Yoshida, W., & Yoshimoto, J. (2002) · Neural Networks · doi:10.1016/s0893-6080(02)00056-4 · Cited by 204
Everyday problem solving: theory and applications
(1989) · Choice Reviews Online · doi:10.5860/choice.27-1214 · Cited by 199
Theoretical approaches to language and aging
Burke, D. M., MacKay, D. G., & James, L. E. (2000) · Oxford University Press eBooks · doi:10.1093/oso/9780198524380.003.0008 · Cited by 197
Language Comprehension and Production in Normal Aging
THORNTON, R., & LIGHT, L. (2006) · Handbook of the Psychology of Aging · doi:10.1016/b9-78-012101-2/64950-015x · Cited by 185
A Life-Span Approach to Social Motivation
Carstensen, L. L. (1998) · Motivation and Self-Regulation across the Life Span · doi:10.1017/cbo9780511527869.015 · Cited by 176
Perfect, T. J., & Maylor, E. A. (2000) · Cited by 166
Bayesian learning theory applied to human cognition
Jacobs, R. A., & Kruschke, J. K. (2010) · Wiley Interdisciplinary Reviews Cognitive Science · doi:10.1002/wcs.80 · Cited by 157
Sinnott, J. D. (1989) · Cited by 152
Exploration or exploitation: life expectancy changes the value of learning in foraging strategies
Eliassen, S., Jørgensen, C., Mangel, M., & Giske, J. (2007) · Oikos · doi:10.1111/j.2006.0030-1299.15462.x · Cited by 140
Molina‐Castillo, F., Jiménez, D. J., & Alemán, J. L. M. (2011) · Industrial Marketing Management · doi:10.1016/j.indmarman.2010.12.017 · Cited by 136
Watts, D. P. (1998) · International Journal of Primatology · doi:10.1023/a:1020376925939 · Cited by 122
Freedom of movement and the stability of its unfolding in free exploration of mice
Fonio, E., Benjamini, Y., & Golani, I. (2009) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0812513106 · Cited by 103
Riediger, M., Li, S.-C., & Lindenberger, U. (2006) · Handbook of the Psychology of Aging · doi:10.1016/b978-012101264-9/50016-1 · Cited by 99
Temporal predictability facilitates causal learning.
Greville, W. J., & Buehner, M. J. (2010) · Journal of Experimental Psychology General · doi:10.1037/a0020976 · Cited by 90
Efficient harvesting of renewing resources
Ohashi, K., & Thomson, J. D. (2005) · Behavioral Ecology · doi:10.1093/beheco/ari031 · Cited by 84
Quantifying the Adaptive Value of Learning in Foraging Behavior
Eliassen, S., Jørgensen, C., Mangel, M., & Giske, J. (2009) · The American Naturalist · doi:10.1086/605370 · Cited by 83
Optimal patch time allocation for time-limited foragers
Wajnberg, É., Bernhard, P., Hamelin, F., & Boivin, G. (2006) · Behavioral Ecology and Sociobiology · doi:10.1007/s00265-005-0131-7 · Cited by 82
Response of a traplining hummingbird to changes in nectar availability
Garrison, J. S. E. (1999) · Behavioral Ecology · doi:10.1093/beheco/10.6.714 · Cited by 74
Medial prefrontal cortex and the adaptive regulation of reinforcement learning parameters
Khamassi, M., Enel, P., Dominey, P. F., & Procyk, E. (2013) · Progress in brain research · doi:10.1016/b978-0-444-62604-2.00022-8 · Cited by 73
The Glass is Half-Full: Overestimating the Quality of a Novel Environment is Advantageous
Berger‐Tal, O., & Avgar, T. (2012) · PLoS ONE · doi:10.1371/journal.pone.0034578 · Cited by 57
Self-citationPatch use by bumblebees (Hymenoptera Apidae): temperature, wind, flower density and traplining
Comba, L. (1999) · Ethology Ecology & Evolution · doi:10.1080/08927014.1999.9522826 · Cited by 55
Towards an evaluation framework for knowledge management systems
Nevo, D., Furneaux, B., & Wand, Y. (2007) · Information Technology and Management · doi:10.1007/s10799-007-0023-9 · Cited by 48
Environmental variability can select for optimism or pessimism
McNamara, J. M., Trimmer, P. C., Eriksson, A., Marshall, J. A. R., & Houston, A. I. (2010) · Ecology Letters · doi:10.1111/j.1461-0248.2010.01556.x · Cited by 44
Meyer, B. J. F., & Pollard, C. K. (2006) · Elsevier eBooks · doi:10.1016/b978-012101264-9/50014-8 · Cited by 21
Avni, R., & Eilam, D. (2007) · Animal Cognition · doi:10.1007/s10071-007-0119-y · Cited by 17
Cited by
Conservation translocations: a review of common difficulties and promising directions.
Berger‐Tal, O., Blumstein, D. T., & Swaisgood, R. R. (2020) · Animal Conservation · doi:10.1111/acv.12534 · Cited by 415
Self-citationThe science of science: From the perspective of complex systems
Zeng, A., Shen, Z., Zhou, J., Wu, J., Fan, Y., Wang, Y., & Stanley, H. E. (2017) · Physics Reports · doi:10.1016/j.physrep.2017.10.001 · Cited by 410
Biodiversity as insurance: from concept to measurement and application
Loreau, M., Barbier, M., Filotas, E., Gravel, D., Isbell, F., Miller, S. J., Montoya, J. M., Wang, S., Aussenac, R., Germain, R., et al. (2021) · Biological Reviews · doi:10.1111/brv.12756 · Cited by 328
When Is More Uncertainty Better? A Model of Uncertainty Regulation and Effectiveness
Griffin, M. A., & Grote, G. (2020) · Academy of Management Review · doi:10.5465/amr.2018.0271 · Cited by 223
A Primer on Foraging and the Explore/Exploit Trade-Off for Psychiatry Research
Addicott, M. A., Pearson, J. M., Sweitzer, M. M., Barack, D. L., & Platt, M. L. (2017) · Neuropsychopharmacology · doi:10.1038/npp.2017.108 · Cited by 219
Metadata
- Authors
- Berger-Tal, O., Nathan, J., Meron, E., & Saltz, D.
- Venue
- PLoS ONE
- Publisher
- Public Library of Science (PLoS)
- Published
- 2014-04-22
- Volume
- 9
- Issue
- 4
- Pages
- e95693
- ISSN
- 1932-6203 (ISSN-L)
- OpenAlex
- W2017741820
- Cited by
- 253
- References
- 54
- FWCI
- 8.52
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.