Humans use directed and random exploration to solve the explore–exploit dilemma.
Open accessThe DOI matches its Crossref record; 33 of the 34 references it cites were found in a registry or an index.
Abstract
All adaptive organisms face the fundamental tradeoff between pursuing a known reward (exploitation) and sampling lesser-known options in search of something better (exploration). Theory suggests at least two strategies for solving this dilemma: a directed strategy in which choices are explicitly biased toward information seeking, and a random strategy in which decision noise leads to exploration by chance. In this work we investigated the extent to which humans use these two strategies. In our "Horizon task," participants made explore-exploit decisions in two contexts that differed in the number of choices that they would make in the future (the time horizon). Participants were allowed to make either a single choice in each game (horizon 1), or 6 sequential choices (horizon 6), giving them more opportunity to explore. By modeling the behavior in these two conditions, we were able to measure exploration-related changes in decision making and quantify the contributions of the two strategies to behavior. We found that participants were more information seeking and had higher decision noise with the longer horizon, suggesting that humans use both strategies to solve the exploration-exploitation dilemma. We thus conclude that both information seeking and choice variability can be controlled and put to use in the service of exploration.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source says what the claim attributes to it.
In the citing paper
“People show both of these effects (27).”
From Using cognitive psychology to understand GPT-3 (2023) · cites this paper as [27]
The cited source says what the claim attributes to it.
In the citing paper
“While humans show such an effect (27), we did not find it in GPT-3 (β = −0.15 ± 0.27, z = −0.56, P = .58), which demonstrates that the model did not employ directed exploration.”
From Using cognitive psychology to understand GPT-3 (2023) · cites this paper as [27]
The cited source says what the claim attributes to it.
In the citing paper
“Previous research suggests that people solve this exploration-exploitation trade-off by applying a combination of two distinct strategies: directed and random exploration (27).”
From Using cognitive psychology to understand GPT-3 (2023) · cites this paper as [27]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Reinforcement Learning: An Introduction
(2005) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.2004.842673 · Cited by 24,496
Reinforcement Learning: A Survey
Kaelbling, L. P., Littman, M. L., & Moore, A. W. (1996) · Journal of Artificial Intelligence Research · doi:10.1613/jair.301 · Cited by 8,972
“Risk, Ambiguity, and the Savage Axioms.”
Ellsberg, D. (1961) · The Quarterly Journal of Economics · doi:10.2307/1884324 · Cited by 7,891
Finite-time Analysis of the Multiarmed Bandit Problem
Auer, P., Cesa-Bianchi, N., & Fischer, P. (2002) · Machine Learning · doi:10.1023/a:1013689704352 · Cited by 6,033
Aston-Jones, G., & Cohen, J. D. (2005) · Annual Review of Neuroscience · doi:10.1146/annurev.neuro.28.061604.135709 · Cited by 4,472
Self-citationFaisal, A. A., Selen, L. P. J., & Wolpert, D. M. (2008) · Nature Reviews Neuroscience · doi:10.1038/nrn2258 · Cited by 2,883
THOMPSON, W. R. (1933) · Biometrika · doi:10.1093/biomet/25.3-4.285 · Cited by 2,712
Pfanzagl, J., & Luce, R. D. (1962) · Econometrica · doi:10.2307/1911299 · Cited by 2,469
Cortical substrates for exploratory decisions in humans
Daw, N. D., O'Doherty, J. P., Dayan, P., Seymour, B., & Dolan, R. J. (2006) · Nature · doi:10.1038/nature04766 · Cited by 2,224
Recent developments in modeling preferences: Uncertainty and ambiguity
Camerer, C., & Weber, M. (1992) · Journal of Risk and Uncertainty · doi:10.1007/bf00122575 · Cited by 1,795
Research works printed but not linked: 2
- Bridle JS. Training stochastic model recognition algorithms as networks can lead to maximum mutual information estimates of parameters. In: Touretzky DS, editor. Advances in neural information processing systems. Vol. 2. Cambridge, MA: MIT Press; 1990. pp. 211–217. [Google Scholar]
- Watkins CJCH. Unpublished doctoral dissertation. Cambridge University; Cambridge, England: 1989. Learning from delayed rewards. [Google Scholar]
Cited by
Items 401–500 of 627
Phelps, C. E., Frisvold, A., Sreeram, M., Antoniou, V., Oliveira, L. E., Tooke, S. R., Lu, Y. Z., Lemon, A. C., Fraire, J. U., Delval, A. G., et al. (2025) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1012873 · Cited by 2
Self-citationOn the strategic learning of signal associations
Sherratt, T. N., & Voll, J. (2022) · Behavioral Ecology · doi:10.1093/beheco/arac027 · Cited by 2
Hunt, A., James, W., Reuther, J., Spilioti, M., Mackay, E., & Clarke, A. D. F. (2026) · Quarterly Journal of Experimental Psychology · doi:10.1177/17470218261484892 · Cited by 2
Strategy selection and function learning in decision making
Stojić, H. (2017) · LA Referencia (Red Federada de Repositorios Institucionales de Publicaciones Científicas) · Cited by 2
Towards a unifying theory of generalizationPreprint
Schulz, E. (2017) · PsyArXiv (OSF Preprints) · doi:10.31234/osf.io/rzj2m · Cited by 2
The Use of Implicit Human Motor Behaviour in the Online Personalisation of Prosthetic InterfacesPreprint
Garcia-Rosas, R., Yu, T., Oetomo, D., Manzie, C. G., Tan, Y., & Choong, P. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2003.01228 · Cited by 2
To act fast or to bide time? Adaptive exploration under competitive pressurePreprint
Markant, D. B., Phillips, N., Kareev, Y., Avrahami, J., & Hertwig, R. (2018) · PsyArXiv (OSF Preprints) · doi:10.31234/osf.io/3jwtq · Cited by 2
A neural and behavioral tradeoff underlies exploratory decisions in normative anxietyPreprint
Aberg, K. C., Toren, I., & Paz, R. (2020) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2020.09.16.300525 · Cited by 2
Decision bias and sampling asymmetry in reward-guided learningPreprint
Cao, Y., & Tsetsos, K. (2023) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2023.09.10.557023 · Cited by 2
On the computational principles underlying human explorationPreprint
Fox, L., Dan, O., & Loewenstein, Y. (2023) · eLife · doi:10.7554/elife.90684 · Cited by 2
Dynamic reinforcement learning reveals time-dependent shifts in strategy during reward learningPreprint
Venditto, S. J. C., Miller, K. J., Brody, C. D., & Daw, N. D. (2024) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2024.02.28.582617 · Cited by 3
Heuristics for meta-planning from a normative model of information searchPreprint
Kuperwajs, I., Ho, M. K., & Ma, W. J. (2024) · PsyArXiv (OSF Preprints) · doi:10.31234/osf.io/qtk9j · Cited by 3
Disinformation elicits learning biasesPreprint
Vidal-Perez, J., Dolan, R. J., & Moran, R. (2024) · Research Square · doi:10.21203/rs.3.rs-4468218/v1 · Cited by 2
Zhang, S., Tian, Y., Liu, Q., & Wu, H. (2024) · eLife · doi:10.7554/elife.92892.2 · Cited by 2
Shen, T., & Dayan, P. (2024) · eLife · doi:10.7554/elife.100366.1 · Cited by 3
Multiple and subject-specific roles of uncertainty in reward-guided decision-makingPreprint
Paunov, A. M., L’Hôtellier, M., Guo, D., He, Z., Yu, A. J., & Meyniel, F. (2024) · eLife · doi:10.7554/elife.103363.1 · Cited by 3
Disinformation elicits learning biasesPreprint
Vidal-Perez, J., Dolan, R. J., & Moran, R. (2025) · eLife · doi:10.7554/elife.106073.1 · Cited by 2
DynamicRL: Data-Driven Estimation of Trial-by-Trial Reinforcement Learning ParametersPreprint
Xiong, H.-D., Li, J., Mattar, M. G., & Wilson, R. C. (2025) · PsyArXiv (OSF Preprints) · doi:10.31234/osf.io/4xumc_v2 · Cited by 2
Self-citationThe role of framing, agency and uncertainty in a focus-divide dilemma
Claydon, J., Hunt, A. R., James, W., & Clarke, A. D. F. (2023) · Memory & Cognition · doi:10.3758/s13421-023-01484-6 · Cited by 1
Official Misconduct – An Entrepreneurial Explanation
Sløk‐Madsen, S. K., Jensen, C. B., & Christensen, T. S. (2024) · Entrepreneurship Research Journal · doi:10.1515/erj-2023-0323 · Cited by 1
Neural Correlates of Different Randomization Tasks
Guseva, M., Bogler, C., Allefeld, C., Ziya, E. B., & Haynes, J. (2025) · Journal of Cognitive Neuroscience · doi:10.1162/jocn_a_02280 · Cited by 2
Borenstein, B. E., Milfeld, T., & Nowlan, L. (2025) · Journal of Advertising Research · doi:10.1080/00218499.2025.2464306 · Cited by 1
Forgetting phenomena in the Iowa Gambling Task: a new computational model among diverse participants
Yang, T., Xie, C., & Wang, X. (2025) · Frontiers in Psychology · doi:10.3389/fpsyg.2025.1510151 · Cited by 2
Are ambient smart environments sufficient for developing good habits?
Becattini, V., & Severs, L. (2025) · Synthese · doi:10.1007/s11229-025-05060-0 · Cited by 1
Exploration and behavioral variability
Fauré, P. (2025) · Handbook of behavioral neuroscience · doi:10.1016/b978-0-443-29867-7.00026-8 · Cited by 3
Flimm, H., Tuzsus, D., Pappas, I., & Peters, J. (2025) · Computational Brain & Behavior · doi:10.1007/s42113-025-00258-4 · Cited by 3
Dopamine depletion in Parkinson’s increases directed but not random exploration
Meder, B., Sterf, M., Wu, C. M., & Guggenmos, M. (2026) · Science Advances · doi:10.1126/sciadv.aee6556 · Cited by 1
Rewitz, K., Schuck, N. W., & Wolff, W. (2025) · Psychology of sport and exercise · doi:10.1016/j.psychsport.2025.103036 · Cited by 2
A rational information gathering account of infant habituation.
Karni, G., Mattar, M. G., Emberson, L. L., & Daw, N. D. (2025) · Behavioral Neuroscience · doi:10.1037/bne0000635 · Cited by 2
Metacognitive sensitivity predicts the quality of information search in value-based decision making
Hu, X., Li, Y., Chen, X., Jian-yuan, W., Shi, J., Guo, Q., Liu, Y., Yang, C., & Luo, L. (2025) · Cognition · doi:10.1016/j.cognition.2025.106410 · Cited by 1
Increased Baseline Pupil Size Linked to Uncertainty Avoidance in Decision Making
Kakaei, E., Schlecht, A., & Hauser, T. U. (2026) · European Journal of Neuroscience · doi:10.1111/ejn.70394 · Cited by 1
Kim, E., Chowdhury, S. S., Song, H., & Suh, B. (2026) · ACM International Conference on Intelligent User Interfaces (IUI) · doi:10.1145/3742413.3789092 · Cited by 1
Addressing degeneracy in rodent studies of cognition
Constantinople, C. M. (2026) · Current Opinion in Neurobiology · doi:10.1016/j.conb.2026.103190 · Cited by 1
AI in Human Resource Management
Fu, X., Nah, F. F., Liu, S., Zhang, K., Huang, Z., Zheng, R., & Xie, W. (2026) · Wiley eBooks · doi:10.1002/9781394266401.ch14 · Cited by 1
Stochastic choice drives variability in patch foraging decisions in humans and rats
Scholey, E. V., Apps, M. A. J., & Humphries, M. D. (2026) · Communications Psychology · doi:10.1038/s44271-026-00465-0 · Cited by 1
Uncertainty for better and worse
Dayan, P. (2026) · Current Opinion in Neurobiology · doi:10.1016/j.conb.2026.103227 · Cited by 1
Task-Irrelevant Information Reduces Attentional Uncertainty
Geng, J. J., Shomstein, S., Wan, Q., & McEvoy, K. E. (2026) · Annual Review of Vision Science · doi:10.1146/annurev-vision-102122-112153 · Cited by 1
The influence of social cues in learning and decision-making over time
Perez, E., Shoenfelt, A., Frazier, I., El-Shafie, D., Lin, T., Lighthall, N. R., & Ebner, N. C. (2026) · Frontiers in Psychology · doi:10.3389/fpsyg.2026.1691925 · Cited by 1
Tyrer, A., Nikolova, N. E., Dubois, M., Banellis, L., Vejlø, M., Hauser, T. U., & Allen, M. (2026) · Computational Psychiatry · doi:10.5334/cpsy.164 · Cited by 1
Multi-Armed Bandits for Human-Machine Decision Making
Reverdy, P. B., & Srivastava, V. (2018) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp.2018.8461843 · Cited by 1
The Exploration-Exploitation Dilemma as a Tool for Studying Addiction
Dezza, I. C., Noël, X., Axel Cleeremans, B., & Yu, A. J. (2018) · Conference on Cognitive Computational Neuroscience (CCN) · doi:10.32470/ccn.2018.1080-0 · Cited by 1
Are Humans Bayesian in the Optimization of Black-Box Functions?
Candelieri, A., Perego, R., Giordani, I., & Archetti, F. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-40616-5_3 · Cited by 1
van Ments, L., Bhalwankar, R., & Jan Treur, A. (2021) · Lecture notes in networks and systems · doi:10.1007/978-3-030-90321-3_52 · Cited by 1
Dynamics, Adaptation, and Control for Mental Models Analysed from a Self-modeling Network Viewpoint
van Ments, L., Bhalwankar, R., & Jan Treur, A. (2022) · Studies in systems, decision and control · doi:10.1007/978-3-030-85821-6_21 · Cited by 1
The beauty of language structure: A single-case fMRI study of palindrome creation
León-Cabrera, P., Guillamon, A., Cucurell, D., & Rodríguez‐Fornells, A. (2022) · Journal of Neurolinguistics · doi:10.1016/j.jneuroling.2022.101086 · Cited by 1
The Effect of Gamification on Employee Boredom and Performance*
Zhao, Z. (2024) · Accounting Perspectives · doi:10.1111/1911-3838.12357 · Cited by 1
Kolling, N., & Scholl, J. (2024) · Current Opinion in Behavioral Sciences · doi:10.1016/j.cobeha.2024.101404 · Cited by 2
Schreiber, S., Hewitt, D., Seymour, B., & Yoshida, W. (2024) · Wellcome Open Research · doi:10.12688/wellcomeopenres.22288.1 · Cited by 2
DROP: Distributional and Regular Optimism and Pessimism for Reinforcement Learning
Kobayashi, T. (2026) · Neural Computation · doi:10.1162/neco.a.1546 · Cited by 1
Statistical Machine-Learning Methods to Model Brain Plasticity
Robles-Granda, P., Barbey, A. K., & Koyejo, S. (2025) · Oxford University Press eBooks · doi:10.1093/oxfordhb/9780197677131.013.15 · Cited by 1
Li, H., Xu, T., Qi, J., & Chen, Y. (2026) · Management Science · doi:10.1287/mnsc.2023.00475 · Cited by 1
Suzuki, S., Yamashita, Y., & Katahira, K. (2019) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/730614 · Cited by 1
Harris, C. A. (2022) · Utrecht University Repository (Utrecht University) · doi:10.33540/873 · Cited by 1
Connecting Exploration, Generalization, and Planning in Correlated TreesPreprint
Ludwig, T., Wu, C. M., & Schulz, E. (2022) · PsyArXiv (OSF Preprints) · doi:10.31234/osf.io/72wda · Cited by 1
Tamai, R., Shigemasu, H., & Murayama, K. (2023) · PsyArXiv (OSF Preprints) · doi:10.31234/osf.io/kzgby · Cited by 1
On the computational principles underlying human explorationPreprint
Fox, L., Dan, O., & Loewenstein, Y. (2023) · PsyArXiv (OSF Preprints) · doi:10.31234/osf.io/s96b2 · Cited by 1
On the computational principles underlying human explorationPreprint
Fox, L., Dan, O., & Loewenstein, Y. (2023) · eLife · doi:10.7554/elife.90684.1 · Cited by 3
State-Dependent Online Reactivations for Different Learning Strategies in ForagingPreprint
Son, S., Wang, M. Z., Hayden, B. Y., & Yoo, S. B. M. (2024) · SSRN Electronic Journal · doi:10.1101/2024.03.25.586512 · Cited by 1
Uchida, N. (2024) · eLife · doi:10.7554/elife.97612.1.sa2 · Cited by 1
Tuzsus, D., Pappas, I., & Peters, J. (2024) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2024.05.09.593363 · Cited by 2
Dopamine tracks adaptive learning of action representationsPreprint
Côme, M., Lespart, A., Gulmez, A., Keshishian, L., Jehl, J., Bousseyrol, E., Didienne, S., Vicq, É., Borgne, T. L., Mourot, A., et al. (2024) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2024.07.28.605479 · Cited by 1
Goetmaeckers, F., Goris, J., Wiersema, J. R., Verguts, T., & Braem, S. (2024) · Research Square · doi:10.21203/rs.3.rs-4926144/v1 · Cited by 1
Deep Learning Improves Parameter Estimation in Reinforcement Learning ModelsPreprint
Xiong, H.-D., Li, J., Mattar, M. G., & Wilson, R. C. (2025) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2025.03.21.644663 · Cited by 1
Self-citationExploratory Choice Reflects the Future Value of InformationPreprint
Rich, A., & Gureckis, T. M. (2018) · PsyArXiv (OSF Preprints) · doi:10.31234/osf.io/pdb83_v1 · Cited by 1
DynamicRL: Data-Driven Estimation of Trial-by-Trial Reinforcement Learning ParametersPreprint
Xiong, H.-D., Li, J., Mattar, M. G., & Wilson, R. C. (2025) · PsyArXiv (OSF Preprints) · doi:10.31234/osf.io/4xumc_v1 · Cited by 1
Self-citationMackenzie, G. M., Gilmour, W., Barnard, I. R. M., Yang, S.-S., Suveges, S., Macfarlane, J. A., Kanodia, A. K., Manfield, J., Khan, S., Osman‐Farah, J., et al. (2026) · Nature Communications · doi:10.1101/2025.06.03.657634 · Cited by 2
Where does this road go? Insights from reinforcement learning models on route choice behaviourPreprint
Rad, J. A., Hess, S., Hancock, T. O., Bliemer, M. C. J., Beck, M. J., Fayyaz, M., & Ben-Elia, E. (2025) · PsyArXiv (OSF Preprints) · doi:10.31234/osf.io/25sc9_v1 · Cited by 3
Prioritization of Perceptual DecisionsPreprint
Little, D. R., Steinberg, R., Bartlett, A., Russell, L., Xie, P., & Eidels, A. (2025) · PsyArXiv (OSF Preprints) · doi:10.31234/osf.io/ngzea_v1 · Cited by 1
Human Strategy Adaptation in Reinforcement Learning Resembles Policy Gradient AscentPreprint
Xiong, H.-D., Li, J., Wilson, R. C., & Mattar, M. G. (2025) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2025.07.28.667308 · Cited by 3
Self-citationEffort aversion and diminished exploration in apathy associated with Traumatic Brain InjuryPreprint
Hogeveen, J., Campbell, E. M., Aragon, D., Pearson, E., Enders, C., Romero, J. D., Brown, L., Campbell, R. A., Gill, D., Quinn, D. K., et al. (2025) · medRxiv · doi:10.1101/2025.08.22.25334260 · Cited by 1
Shen, T., & Dayan, P. (2025) · eLife · doi:10.7554/elife.100366.2 · Cited by 1
Ventral striatal astrocytes contribute to reinforcement learningPreprint
Pai, J., Sogukpinar, F., Ogasawara, K., Smith, G. J., Fiocchi, F. R., Dai, Y., Wu, Y., Frank, M. J., Ching, S., Lucantonio, F., et al. (2025) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2025.10.20.683205 · Cited by 2
A model-centered introduction to curiosityPreprint
Chartouny, A., Girard, B., & Khamassi, M. (2025) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2025.11.19.689250 · Cited by 1
Vejlø, M., Nikolova, N. E., Banellis, L., Tyrer, A., Skvortsova, V., Hauser, T. U., & Allen, M. (2026) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.64898/2026.02.24.707646 · Cited by 1
Temporoparietal alpha dynamics shape feedback-based updating during social bargainingPreprint
Figueroa-Vargas, A., Valdebenito-Oyarzo, G., Martínez-Molina, M. P., Soto‐Icaza, P., Figueroa-Taiba, P., Díaz-Díaz, M., Iriarte-Carter, M., Salinas, C., Stecher, X., Manterola, C., et al. (2026) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.64898/2026.04.03.716401 · Cited by 1
Task-space dimensions guide human exploration in complex environmentsPreprint
An, J., Hu, J., Wu, Y. E., Liu, C., Ning, S., Zhu, F., Pan, Y., Wang, R., & Ji, N. (2026) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.64898/2026.04.29.720265 · Cited by 1
Craig, A. S. (2016) · eScholarship (California Digital Library)
Psychological and Neural Dynamics of Trust
Bellucci, G. (2020) · Refubium (Universitätsbibliothek der Freien Universität Berlin) · doi:10.17169/refubium-26139
Flexibility of reinforcement biases and reaction times in competitive zero-sum games
Sundvall, J. R. I. (2020) · Sussex Research Online (University of Sussex)
Impulsivity and risk-seeking as Bayesian inference under dopaminergic controlPreprint
Mikhael, J. G., & Gershman, S. J. (2020) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2020.10.06.327775
Online Personalisation of Human-Prosthetic Interfaces
Garcia-Rosas, R. (2020) · Minerva Access (University of Melbourne)
Online Learning for Job Scheduling on Heterogeneous Machines
Ruan, Y., Yekkehkhany, A., & Etesami, S. R. (2020) · IEEE Conference on Decision and Control (CDC) · doi:10.1109/cdc42340.2020.9303733
Exploratory Noise Governs Both Flexibility and Spontaneous Errors and Is Regulated by CocainePreprint
Ebitz, R. B., Sleezer, B. J., Jedema, H. P., Bradberry, C. W., & Hayden, B. Y. (2018) · SSRN Electronic Journal · doi:10.2139/ssrn.3192038
An Adaptive Teachable Robot For Encouraging Teamwork
Ravari, P. B. (2021) · UWSpace (University of Waterloo)
Siddiqui, I. (2021) · TSpace (University of Toronto) · Cited by 1
Value maximization versus directed exploration in human learningPreprint
Dan, O., & Loewenstein, Y. (2020) · PsyArXiv (OSF Preprints) · doi:10.31234/osf.io/2pxg5
Marzuki, A. A. (2021) · Apollo (University of Cambridge) · doi:10.17863/cam.70408
Balance of exploratory and reward-based behaviors in children
Horn, T. (2020) · The Knowledge Bank (The Ohio State University)
Aversion to option loss in a restless bandit taskPreprint
Navarro, D., Tran, P., & Baz, N. (2018) · PsyArXiv (OSF Preprints) · doi:10.31234/osf.io/3g4p5
Exploration With a Finite BrainPreprint
Binz, M., & Schulz, E. (2022) · PsyArXiv (OSF Preprints) · doi:10.31234/osf.io/qx4h5
The Explore-Exploit Dilemma: Role of Time Horizon on Informant Selection
Clark, H. (2022) · Inquiry Queen s Undergraduate Research Conference Proceedings · doi:10.24908/iqurcp15513
Dezza, I. C., Schulz, E., & Wu, C. M. (2022) · Cambridge University Press eBooks · doi:10.1017/9781009026949.014
Human exploration strategically balances approaching and avoiding uncertainty
Abir, Y., Shadlen, M. N., & Shohamy, D. (2026) · eLife · doi:10.7554/elife.94231.3 · Cited by 1
Author response: Pallidal neuromodulation of the explore/exploit trade-off in decision-making
Marcelino, A. L. D. A., Gray, O., Al‐Fatly, B., Gilmour, W., Steele, J. D., Kühn, A. A., & Gilbertson, T. (2023) · eLife · doi:10.7554/elife.79642.sa2
Ionescu, T. (2023) · PsyArXiv (OSF Preprints) · doi:10.31234/osf.io/mg9aw
Zhang, S., Tian, Y., Liu, Q., & Wu, H. (2024) · eLife · doi:10.7554/elife.92892.1
How Variability, Predictability, and Harshness Shape Cognitive Flexibility
Pope, S. M. (2024) · The MIT Press eBooks · doi:10.7551/mitpress/15181.003.0016
Multiple and subject-specific roles of uncertainty in reward-guided decision-makingPreprint
Paunov, A. M., L’Hôtellier, M., Guo, D., He, Z., Yu, A. J., & Meyniel, F. (2024) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2024.03.27.587016
Metadata
- Authors
- Wilson, R. C., Geana, A., White, J. M., Ludvig, E. A., & Cohen, J. D.
- Affiliations
- Princeton University (US)
- Venue
- Journal of Experimental Psychology: General
- Published
- 2014
- Volume
- 143
- Issue
- 6
- Pages
- 2074-2081
- ISSN
- 0096-3445 (ISSN-L)
- 1939-2222
- PMC
- PMC5635655
- OpenAlex
- W2054698589
- Cited by
- 580
- References
- 34
- Citations by year
- 2026: 52 · 2025: 83 · 2024: 96 · 2023: 67 · 2022: 57 · 2021: 61 · 2020: 53 · 2019: 36 · 2018: 31 · 2017: 22 · 2016: 12 · 2015: 10
- FWCI
- 13.38
- Type
- journal article
- Language
- en
- Open access
- green
- www.ncbi.nlm.nih.gov
- Locations
- Journal of Experimental Psychology General (publishedVersion)
- PubMed (publishedVersion)
- PubMed Central (acceptedVersion)
- Funders
- John Templeton Foundation
- J. Insley Blair Pyne
- Topics
- Social Sciences › Decision Sciences › General Decision Sciences › Decision-Making and Behavioral Economics
- Life Sciences › Neuroscience › Cognitive Neuroscience › Neural and Behavioral Psychology Studies
- Social Sciences › Decision Sciences › Management Science and Operations Research › Advanced Bandit Algorithms Research
- Keywords
- exploration-exploitation balance, information seeking, decision noise, random exploration, directed exploration, sequential decision making, time horizon, choice variability, human decision-making
- MeSH terms
- Adolescent, Choice Behavior, Decision Making, Exploratory Behavior, Female, Humans, Male, Neuropsychological Tests, Reward, Young Adult
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.