The DOI matches its Crossref record; 58 of the 58 references it cites were found in a registry or an index.
A choice prediction competition: Choices from experience and from description
Open accessAbstract
Erev, Ert, and Roth organized three choice prediction competitions focused on three related choice tasks: One shot decisions from description (decisions under risk), one shot decisions from experience, and repeated decisions from experience. Each competition was based on two experimental datasets: An estimation dataset, and a competition dataset. The studies that generated the two datasets used the same methods and subject pool, and examined decision problems randomly selected from the same distribution. After collecting the experimental data to be used for estimation, the organizers posted them on the Web, together with their fit with several baseline models, and challenged other researchers to compete to predict the results of the second (competition) set of experimental sessions. Fourteen teams responded to the challenge: The last seven authors of this paper are members of the winning teams. The results highlight the robustness of the difference between decisions from description and decisions from experience. The best predictions of decisions from descriptions were obtained with a stochastic variant of prospect theory assuming that the sensitivity to the weighted values decreases with the distance between the cumulative payoff functions. The best predictions of decisions from experience were obtained with models that assume reliance on small samples. Merits and limitations of the competition method are discussed. Copyright © 2009 John Wiley & Sons, Ltd.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Prospect Theory: An Analysis of Decision under Risk
Kahneman, D., & Tversky, A. (1979) · Econometrica · doi:10.2307/1914185 · Cited by 48,524
Prospect theory: An analysis of decision under risk
Kahneman, D., & Tversky, A. (1988) · Decision, Probability and Utility · doi:10.1017/cbo9780511609220.014 · Cited by 32,474
Advances in prospect theory: Cumulative representation of uncertainty
Tversky, A., & Kahneman, D. (1992) · Journal of Risk and Uncertainty · doi:10.1007/bf00122574 · Cited by 15,467
Allais, M. (1953) · Econometrica · doi:10.2307/1907921 · Cited by 4,112
The Handbook of experimental economics
(1995) · Choice Reviews Online · doi:10.5860/choice.33-1645 · Cited by 3,679
Stevens, S. S. (1957) · Psychological Review · doi:10.1037/h0046162 · Cited by 3,361
The Utility Analysis of Choices Involving Risk
Friedman, M., & Savage, L. J. (1948) · Journal of Political Economy · doi:10.1086/256692 · Cited by 3,077
The Atomic Components of Thought
Anderson, J. R., & Lebiere, C. J. (2014) · Psychology Press eBooks · doi:10.4324/9781315805696 · Cited by 2,173
Self-citationCombining forecasts: A review and annotated bibliography
Clemen, R. T. (1989) · International Journal of Forecasting · doi:10.1016/0169-2070(89)90012-5 · Cited by 2,164
Experience-weighted Attraction Learning in Normal Form Games
Camerer, C., & Hua Ho, T. (1999) · Econometrica · doi:10.1111/1468-0262.00054 · Cited by 1,487
The Atomic Components of Thought
Taatgen, N. (1999) · Trends in Cognitive Sciences · doi:10.1016/s1364-6613(98)01250-9 · Cited by 1,476
Combining forecasts: A review and annotated bibliography
(1990) · Long Range Planning · doi:10.1016/0024-6301(90)90316-v · Cited by 1,465
Chapter 4 Forecast Combinations
Timmermann, A. (2006) · Handbook of Economic Forecasting · doi:10.1016/s1574-0706(05)01004-9 · Cited by 1,314
Decisions from Experience and the Effect of Rare Events in Risky Choice
Hertwig, R., Barron, G., Weber, E. U., & Erev, I. (2004) · Psychological Science · doi:10.1111/j.0956-7976.2004.00715.x · Cited by 1,225
Self-citationReflections of the Environment in Memory
Anderson, J. R., & Schooler, L. J. (1991) · Psychological Science · doi:10.1111/j.1467-9280.1991.tb00174.x · Cited by 1,085
PROBABILITY WEIGHTING FUNCTIONPreprint
al‐Nowaihi, A., & Dhami, S. (2005) · SSRN Electronic Journal · Cited by 1,077
Curvature of the Probability Weighting Function
Wu, G., & Gonzalez, R. (1996) · Management Science · doi:10.1287/mnsc.42.12.1676 · Cited by 987
The description–experience gap in risky choice
Hertwig, R., & Erev, I. (2009) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2009.09.004 · Cited by 911
Self-citationProceedings of the 26th annual conference of the cognitive science society
Dieussaert, K., Ford, M., & Horsten, L. (2004) · Cited by 853
Human Judgment and Social Policy: Irreducible Uncertainty, Inevitable Error, Unavoidable Injustice
Hammond, K. R. (1996) · doi:10.1093/oso/9780195097344.001.0001 · Cited by 851
The priority heuristic: Making choices without trade-offs.
Brandstätter, E., Gigerenzer, G., & Hertwig, R. (2006) · Psychological Review · doi:10.1037/0033-295x.113.2.409 · Cited by 745
Self-citationSmall feedback‐based decisions and their limited correspondence to description‐based decisions
Barron, G., & Erev, I. (2003) · Journal of Behavioral Decision Making · doi:10.1002/bdm.443 · Cited by 735
Self-citationWeber, E. U., Shafir, S., & Blais, A.-R. (2004) · Psychological Review · doi:10.1037/0033-295x.111.2.430 · Cited by 724
Adaptation as Information Restriction: The Hot Stove Effect
Denrell, J., & March, J. G. (2001) · Organization Science · doi:10.1287/orsc.12.5.523.10092 · Cited by 715
Unit weighting schemes for decision making
Einhorn, H. J., & Hogarth, R. M. (1975) · Organizational Behavior and Human Performance · doi:10.1016/0030-5073(75)90044-6 · Cited by 673
Simultaneous over- and underconfidence: the role of error in judgment processes
Erev, I., Wallsten, T. S., & Budescu, D. V. (1994) · Psychological Review · doi:10.1037/0033-295x.101.3.519 · Cited by 644
Self-citationInstance‐based learning in dynamic decision making
Gonzalez, C., Lerch, J. F., & Lebiere, C. (2003) · Cognitive Science · doi:10.1207/s15516709cog2704_2 · Cited by 535
Self-citationJudgment and decision making: (550512004-001)
WGBH-Boston, B., & American Psychological Association, W. (1990) · PsycEXTRA Dataset · doi:10.1037/e550512004-001 · Cited by 511
On Adaptation, Maximization, and Reinforcement Learning Among Cognitive Strategies.
Erev, I., & Barron, G. (2005) · Psychological Review · doi:10.1037/0033-295x.112.4.912 · Cited by 475
Self-citationIntuitions about combining opinions: misappreciation of the averaging principle
Larrick, R. P., & Soll, J. B. (2006) · Management Science · doi:10.1287/mnsc.1050.0459 · Cited by 410
The Role of Representative Design in an Ecological Approach to Cognition.
Dhami, M. K., Hertwig, R., & Hoffrage, U. (2004) · Psychological Bulletin · doi:10.1037/0033-2909.130.6.959 · Cited by 408
Self-citationWhat Have We Learned from Market Design?
Roth, A. E. (2008) · The Economic Journal · doi:10.1111/j.1468-0297.2007.02121.x · Cited by 383
Self-citationStudies of scientific discovery: Complementary approaches and convergent findings.
Klahr, D., & Simon, H. A. (1999) · Psychological Bulletin · doi:10.1037/0033-2909.125.5.524 · Cited by 352
Axiomatic Characterization of the Quadratic Scoring Rule
Selten, R. (1998) · Experimental Economics · doi:10.1007/bf01426214 · Cited by 337
To combine or not to combine: selecting among forecasts and their combinations
Hibon, M., & Evgeniou, T. (2005) · International Journal of Forecasting · doi:10.1016/j.ijforecast.2004.05.002 · Cited by 325
Model Comparisons and Model Selections Based on Generalization Criterion Methodology
Busemeyer, J. R., & Wang, Y.-M. (2000) · Journal of Mathematical Psychology · doi:10.1006/jmps.1999.1282 · Cited by 283
Are Probabilities Overweighted or Underweighted When Rare Outcomes Are Experienced (Rarely)?
Ungemach, C., Chater, N., & Stewart, N. (2009) · Psychological Science · doi:10.1111/j.1467-9280.2009.02319.x · Cited by 276
Proceedings of the 29th Annual Cognitive Science Society
McNamara, D. S., & Trafton, J. G. (2007) · Cited by 268
Hau, R., Pleskac, T. J., Kiefer, J., & Hertwig, R. (2008) · Journal of Behavioral Decision Making · doi:10.1002/bdm.598 · Cited by 252
Self-citationThe False Consensus Effect and Overconfidence: Flaws in Judgment or Flaws in How We Study Judgment?
Dawes, R. M., & Mulford, M. (1996) · Organizational Behavior and Human Decision Processes · doi:10.1006/obhd.1996.0020 · Cited by 239
Armstrong, J. S. (2001) · International Series in Operations Research & Management Science · doi:10.1007/978-0-306-47630-3_19 · Cited by 237
The probabilistic nature of preferential choice.
Rieskamp, J. (2008) · Journal of Experimental Psychology: Learning, Memory, and Cognition · doi:10.1037/a0013646 · Cited by 225
Busemeyer, J. R. (1985) · Journal of Experimental Psychology: Learning, Memory, and Cognition · doi:10.1037//0278-7393.11.3.538 · Cited by 202
Loss aversion, diminishing sensitivity, and the effect of experience on repeated decisions
Erev, I., Ert, E., & Yechiam, E. (2008) · Journal of Behavioral Decision Making · doi:10.1002/bdm.602 · Cited by 200
Self-citationTesting Descriptive Utility Theories: Violations of Stochastic Dominance and Cumulative Independence
Birnbaum, M. H., & Navarrete, J. B. (1998) · Journal of Risk and Uncertainty · doi:10.1023/a:1007739200913 · Cited by 168
Rakow, T., Demes, K. A., & Newell, B. R. (2008) · Organizational Behavior and Human Decision Processes · doi:10.1016/j.obhdp.2008.02.001 · Cited by 151
On the Optimal Design of Lotteries
Quiggin, J. C. (1991) · Economica · doi:10.2307/2554972 · Cited by 127
Erev, I., Bereby‐Meyer, Y., & Roth, A. E. (1999) · Journal of Economic Behavior & Organization · doi:10.1016/s0167-2681(99)00028-1 · Cited by 121
Self-citationLearning, risk attitude and hot stoves in restless bandit problems
Biele, G., Erev, I., & Ert, E. (2008) · Journal of Mathematical Psychology · doi:10.1016/j.jmp.2008.05.006 · Cited by 114
Self-citationWhat impacts the impact of rare events
Erev, I., Glozman, I., & Hertwig, R. (2008) · Journal of Risk and Uncertainty · doi:10.1007/s11166-008-9035-z · Cited by 102
Self-citationHertwig, R., & Pleskac, T. J. (2008) · Oxford University Press eBooks · doi:10.1093/acprof:oso/9780199216093.003.0010 · Cited by 77
Self-citationThe game of life : how small samples render choice simpler
Hertwig, R., & Pleskac, T. J. (2008) · MPG.PuRe (Max Planck Society) · Cited by 65
Self-citationErev, I., Roth, A. E., Slonim, R. L., & Barron, G. (2007) · Economic Theory · doi:10.1007/s00199-007-0214-y · Cited by 59
Self-citationInstance-Based Decision Making Model of Repeated Binary Choice
Lebiere, C., Gonzalez, C., & Martin, M. (2018) · Figshare · doi:10.1184/r1/6571190 · Cited by 53
Self-citationAn initial implementation of the Turing tournament to learning in repeated two-person games
Arifovic, J., McKelvey, R. D., & Pevnitskaya, S. (2006) · Games and Economic Behavior · doi:10.1016/j.geb.2006.03.013 · Cited by 33
Chandrasekharan, S., Lebiere, C. J., Stewart, T. C., & West, R. L. (2005) · eScholarship (California Digital Library) · Cited by 20
Self-citationCombining a Theoretical Prediction with Experimental EvidencePreprint
Erev, I., Roth, A. E., Slonim, R. L., & Barron, G. (2008) · SSRN Electronic Journal · doi:10.2139/ssrn.1111712 · Cited by 19
Self-citationVERIFICATION OF FORECASTS EXPRESSED IN TERMS OF PROBABILITY
BRIER, G. W. (1950) · Monthly Weather Review · doi:10.1175/1520-0493(1950)078<0001:vofeit>2.0.co;2
Cited by
The description–experience gap in risky choice
Hertwig, R., & Erev, I. (2009) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2009.09.004 · Cited by 911
Self-citationInstance-based learning: Integrating sampling and repeated decisions from experience.
Gonzalez, C., & Dutt, V. (2011) · Psychological Review · doi:10.1037/a0024558 · Cited by 255
Maximization, learning, and economic behavior
Erev, I., & Roth, A. E. (2014) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1402846111 · Cited by 155
Self-citationChen, J., Mishler, S., & Hu, B. (2021) · IEEE Transactions on Human-Machine Systems · doi:10.1109/thms.2021.3051137 · Cited by 40
Nonlinear transformation of probabilities by large language models
Hintze, A., Bisht, C., Schossau, J., & Hertwig, R. (2025) · Computers in Human Behavior: Artificial Humans · doi:10.1016/j.chbah.2025.100227 · Cited by 1
Self-citation
Metadata
- Authors
- Erev, I., Ert, E., Roth, A. E., Haruvy, E., Herzog, S. M., Hau, R., Hertwig, R., Stewart, T., West, R., & Lebiere, C.
- Venue
- Journal of Behavioral Decision Making
- Publisher
- Wiley
- Published
- 2009-12-21
- Volume
- 23
- Issue
- 1
- Pages
- 15-47
- ISSN
- 0894-3257 (ISSN-L)
- 1099-0771
- OpenAlex
- W2013660131
- Cited by
- 329
- References
- 58
- FWCI
- 11.00
- Type
- journal article
- Language
- en
- Open access
- bronze
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.