Cited by 28Decision-Making and Behavioral EconomicsMemory Processes and InfluencesNeural and Behavioral Psychology Studies

Process and Content in Decisions From Memory

Open access
Zhao, Wenjia Joyce, Richie, Russell, Bhatia, Sudeep·2022·Psychological Review

Abstract

Information stored in memory influences the formation of preferences and beliefs in most everyday decision tasks. The richness of this information, and the complexity inherent in interacting memory and decision processes, makes the quantitative model-driven analysis of such decisions very difficult. In this paper we present a general framework that can address the theoretical and methodological barriers to building formal models of naturalistic memory-based decision making. Our framework implements established theories of memory search and decision making within a single integrated cognitive system, and uses computational language models to quantify the thoughts over which memory and decision processes operate.It can thus describe both the content of the information that is sampled from memory, as well as the processes involved in retrieving and evaluating this information in order to make a decision. Furthermore, our framework is tractable, and the parameters that characterize memory-based decisions can be recovered using thought-listing and choice data from existing experimental tasks, and in turn be used to make quantitative predictions regarding choice probability, length of deliberation, retrieved thoughts, and the effects of decision context. We showcase the power and generality of our framework by applying it to naturalistic binary choices from domains such as risk perception, consumer behavior, financial decision making, ethical decision making, legal decision making, food choice, and social judgment.

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1037/rev0000318

Cites

4 of 4 references verified0 citation errors · 0 not checkable

Statistics

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

  • Retrieval plays a key role in human decision-making.

    “While retrieval plays a key role in human decision-making (Zhou et al., 2023a; Zhao et al., 2022), adaptive and context-specific recall remains understudied in language agents.”

    From Cognitive Architectures for Language Agents (2023) · cites this paper as Zhao et al., 2022

  • Recent computational psychological models implicate an integrated process of memory recall and decision-making.

    “Recent computational psychological models implicate an integrated process of memory recall and decision-making (Zhou et al., 2023a; Zhao et al., 2022)”

    From Cognitive Architectures for Language Agents (2023) · cites this paper as Zhao et al., 2022

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Cites

Flagged first, then by citations

Research works printed but not linked: 79

  1. Alba, J. W., Hutchinson, J. W., & Lynch, Jr., J. G. (1991), Memory and Decision Making. In Harold H. Kassarjian and Thomas S. Robertson (Eds.) Handbook of Consumer Theory and Research (pp. 1-49.) . Prentice-Hall.
  2. Anderson, J. R. (2007). How can the human mind occur in the physical universe? Oxford University Press.
  3. Anderson, J. R., Bothell, D., Byrne, M. D., Douglass, S., Lebiere, C., & Qin, Y. (2004). An integrated theory of the mind. Psychological Review, 111 , 1036-1060.
  4. Abbott, J. T., Austerweil, J. L., & Griffiths, T. L. (2015). Random walks on semantic networks can resemble optimal foraging. Psychological Review, 122 (3), 558-569.
  5. Atkinson, R. C., & Shiffrin, R. M. (1968). Human memory: A proposed system and its control processes. Psychology of Learning and Motivation , 2 (4), 89-195.
  6. Bhatia, S. (2013). Associations and the accumulation of preference. Psychological Review, 120 (3), 522.
  7. Bhatia, S. (2016). The dynamics of bidirectional thought. Thinking & Reasoning, 22 (4), 397-442.
  8. Bhatia, S. (2019). Semantic processes in preferential decision making. Journal of Experimental Psychology: Learning, Memory, and Cognition, 45 (4), 627-640.
  9. Bhatia, S. & Walasek, L. (2019). Association and response accuracy in the wild. Memory & Cognition, 47 (2), 292-298.
  10. Busemeyer, J. R., & Rapoport, A. (1988). Psychological models of deferred decision making. Journal of Mathematical Psychology, 32 (2), 91-134.
  11. Busemeyer, J. R., Gluth, S., Rieskamp, J., & Turner, B. M. (2019). Cognitive and neural bases of multi-attribute, multi-alternative, value-based decisions. Trends in Cognitive Sciences, 23 (3), 251-263.
  12. Busemeyer, J. R., & Townsend, J. T. (1993). Decision field theory: a dynamic-cognitive approach to decision making in an uncertain environment. Psychological Review, 100 (3), 432.
  13. Cer, D., Yang, Y., Kong, S. Y., Hua, N., Limtiaco, N., John, R. S., ... & Sung, Y. H. (2018). Universal sentence encoder. arXiv preprint arXiv:1803.11175. · arXiv
  14. Cox, G. E., & Shiffrin, R. M. (2017). A dynamic approach to recognition memory. Psychological Review, 124 (6), 795.
  15. Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (2018). Bert: Pre-training of deep bidirectional transformers for language understanding. arXiv preprint arXiv:1810.04805. · arXiv
  16. Dougherty, M. R., Gettys, C. F., & Ogden, E. E. (1999). MINERVA-DM: A memory processes model for judgments of likelihood. Psychological Review, 106 (1), 180.
  17. Fodor, J. A., & Pylyshyn, Z. W. (1988). Connectionism and cognitive architecture: A critical analysis. Cognition, 28 (1-2), 3-71.
  18. Gigerenzer, G., & Gaissmaier, W. (2011). Heuristic decision making. Annual Review of Psychology, 62 , 451-482.
  19. Gigerenzer, G., & Goldstein, D. G. (1996). Reasoning the fast and frugal way: Models of bounded rationality. Psychological Review, 103(4), 650-669.
  20. Gluth, S., Rieskamp, J., & Büchel, C. (2012). Deciding when to decide: time-variant sequential sampling models explain the emergence of value-based decisions in the human brain. Journal of Neuroscience, 32 (31), 10686-10698.
  21. Gonzalez, C., Lerch, J. F., & Lebiere, C. (2003). Instance-based learning in dynamic decision making. Cognitive Science , 27 (4), 591-635.
  22. Hardisty, D. J., Johnson, E. J., & Weber, E. U. (2010). A dirty word or a dirty world? Attribute framing, political affiliation, and query theory. Psychological Science, 21 (1), 86-92.
  23. Hawkins, G. E., Forstmann, B. U., Wagenmakers, E. J., Ratcliff, R., & Brown, S. D. (2015). Revisiting the evidence for collapsing boundaries and urgency signals in perceptual decision-making. Journal of Neuroscience, 35 (6), 2476-2484.
  24. Hertwig, R., Herzog, S. M., Schooler, L. J., & Reimer, T. (2008). Fluency heuristic: A model of how the mind exploits a by-product of information retrieval. Journal of Experimental Psychology: Learning, Memory, and Cognition, 34 (5), 1191.
  25. Hills, T. T., Jones, M. N., & Todd, P. M. (2012). Optimal foraging in semantic memory. Psychological Review, 119 (2), 431.
  26. Hintzman, D. L. (1984). MINERVA 2: A simulation model of human memory. Behavior Research Methods, Instruments, & Computers, 16 (2), 96-101.
  27. Hockley, W. E., & Murdock, B. B. (1987). A decision model for accuracy and response latency in recognition memory. Psychological Review, 94 (3), 341.
  28. Holyoak, K. J., & Simon, D. (1999). Bidirectional reasoning in decision making by constraint satisfaction. Journal of Experimental Psychology: General, 128 (1), 3.
  29. Howard, M. W., & Kahana, M. J. (2002). A distributed representation of temporal context. Journal of Mathematical Psychology, 46 (3), 269-299.
  30. Johnson, E. J., Häubl, G., & Keinan, A. (2007). Aspects of endowment: a query theory of value construction. Journal of Experimental Psychology: Learning, Memory, and Cognition, 33 (3), 461.
  31. Jones, M. N., & Mewhort, D. J. (2007). Representing word meaning and order information in a composite holographic lexicon. Psychological Review, 114 (1), 1.
  32. Jones, M. N., Willits, J. A., & Dennis, S. (2015). Models of semantic memory. In J. R. Busemeyer & J. T. Townsend (Eds.) Oxford Handbook of Mathematical and Computational Psychology (pp. 232-254). Oxford University Press.
  33. Juslin, P., & Persson, M. (2002). PROBabilities from EXemplars (PROBEX): A 'lazy' algorithm for probabilistic inference from generic knowledge. Cognitive Science, 26 (5), 563-607.
  34. Kahana, M. J. (2020). Computational Models of Memory Search. Annual Review of Psychology , 71 , 107-138.
  35. Keeney, R. L., & Raiffa, H. (1993). Decisions with multiple objectives: Preferences and value trade-offs. Cambridge University Press .
  36. Landauer, T. K., & Dumais, S. T. (1997). A solution to Plato's problem: The latent semantic analysis theory of acquisition, induction, and representation of knowledge. Psychological Review, 104 (2), 211.
  37. Lee, M. D., & Cummins, T. D. (2004). Evidence accumulation in decision making: Unifying the 'take the best' and the 'rational' models. Psychonomic Bulletin & Review, 11 (2), 343352.
  38. Lee, M. D., Gluck, K. A., & Walsh, M. M. (2019). Understanding the complexity of simple decisions: Modeling multiple behaviors and switching strategies. Decision , 6 (4), 335.
  39. Lenci, A. (2018). Distributional models of word meaning. Annual Review of Linguistics, 4 , 151171.
  40. Lieder, F., & Griffiths, T. (2020). Advancing rational analysis to the algorithmic level. Behavioral and Brain Sciences, 43 , E27. doi:10.1017/S0140525X19002012. · DOI
  41. Link, D., & Marewski, J. N. (2015). Populating ACT-R's Declarative Memory with Internet Statistics. In N. A. Taatgen, M. K. van Vugt, J. P. Borst, & K. Mehlhorn (Eds.) Proceedings of the 13th International Conference on Cognitive Modeling (ICCM) (pp. 69-70). University of Groningen.
  42. Link, D., Marewski, J. N, & Schooler, L. J. (2016). An ecological model of memory and inferences. In A. Papafragou, D. Grodner, D. Mirman, & J.C. Trueswell (Eds.), Proceedings of the 38th Annual Conference of the Cognitive Science Society (pp. 18831888). Cognitive Science Society
  43. Mandera, P., Keuleers, E., & Brysbaert, M. (2017). Explaining human performance in psycholinguistic tasks with models of semantic similarity based on prediction and counting: A review and empirical validation. Journal of Memory and Language, 92 , 5778.
  44. Marewski, J. N., & Schooler, L. J. (2011). Cognitive niches: An ecological model of strategy selection. Psychological Review, 118 (3), 393-437.
  45. Mikolov, T., Sutskever, I., Chen, K., Corrado, G. S., & Dean, J. (2013). Distributed representations of words and phrases and their compositionality. In Advances in Neural Information Processing Systems (pp. 3111-3119).
  46. Mulder, M. J., Wagenmakers, E. J., Ratcliff, R., Boekel, W., & Forstmann, B. U. (2012). Bias in the brain: a diffusion model analysis of prior probability and potential payoff. Journal of Neuroscience, 32 (7), 2335-2343.
  47. Murdock, B. B. (1982). A theory for the storage and retrieval of item and associative information. Psychological Review, 89 (6), 609.
  48. Noguchi, T., & Stewart, N. (2018). Multialternative decision by sampling: A model of decision making constrained by process data. Psychological Review, 125 (4), 512.
  49. Nosofsky, R. M., & Palmeri, T. J. (1997). An exemplar-based random walk model of speeded classification. Psychological Review, 104 (2), 266.
  50. Oberauer, K., Farrell, S., Jarrold, C., & Lewandowsky, S. (2016). What limits working memory capacity?. Psychological Bulletin, 142 (7), 758-799.
  51. Oppenheimer, D. M., & Kelso, E. (2015). Information processing as a paradigm for decision making. Annual Review of Psychology, 66 , 277-294.
  52. Pedregosa, F., Varoquaux, G., Gramfort, A., Michel, V., Thirion, B., Grisel, O., ... & Vanderplas, J. (2011). Scikit-learn: Machine learning in Python. Journal of Machine Learning Research , 12 , 2825-2830.
  53. Pennington, J., Socher, R., & Manning, C. (2014, October). Glove: Global vectors for word representation. In Proceedings of the 2014 conference on Empirical Methods in Natural Language Processing (EMNLP) (pp. 1532-1543).
  54. Polyn, S. M., Norman, K. A., & Kahana, M. J. (2009). A context maintenance and retrieval model of organizational processes in free recall. Psychological Review, 116 (1), 129.
  55. Raaijmakers, J. G., & Shiffrin, R. M. (1981). Search of associative memory. Psychological Review, 88 (2), 93.
  56. Ratcliff, R. (1978). A theory of memory retrieval. Psychological Review, 85 (2), 59.
  57. Reutskaja, E., Nagel, R., Camerer, C. F., & Rangel, A. (2011). Search dynamics in consumer choice under time pressure: An eye-tracking study. American Economic Review , 101 (2), 900-926.
  58. Richie, R., Zou, W., & Bhatia, S. (2019). Predicting high-level human judgment across diverse behavioral domains. Collabra: Psychology, 5 (1), 50. DOI: http://doi.org/10.1525/collabra.282 · DOI
  59. Roe, R. M., Busemeyer, J. R., & Townsend, J. T. (2001). Multialternative decision field theory: A dynamic connectionist model of decision making. Psychological Review, 108 (2), 370.
  60. Russo, J. E., & Dosher, B. A. (1983). Strategies for multiattribute binary choice. Journal of Experimental Psychology: Learning, Memory, and Cognition, 9 (4), 676.
  61. Schooler, L. J., & Hertwig, R. (2005). How forgetting aids heuristic inference. Psychological Review, 112 (3), 610-628.
  62. Schulte-Mecklenbeck, M., Kühberger, A., & Johnson, J. G. (Eds.). (2011). A handbook of process tracing methods for decision research: A critical review and user's guide . Psychology Press.
  63. Shadlen M & Shohamy D (2016). Decision Making and Sequential Sampling from Memory. Neuron , 90(5):927-39.
  64. Simon, D., Krawczyk, D. C., & Holyoak, K. J. (2004). Construction of preferences by constraint satisfaction. Psychological Science, 15 (5), 331-336.
  65. Simon, H. A. (1956). Rational choice and the structure of the environment. Psychological review, 63 (2), 129.
  66. Stewart, N., Chater, N., & Brown, G. D. (2006). Decision by sampling. Cognitive Psychology, 53 (1), 1-26.
  67. Suri, G., Gross, J. J., & McClelland, J. L. (2020). Value-based decision making: An interactive activation perspective . Psychological Review , 127(2), 153-185.
  68. Thomas, R. P., Dougherty, M. R., Sprenger, A. M., & Harbison, J. (2008). Diagnostic hypothesis generation and human judgment. Psychological Review, 115 (1), 155.
  69. Trueblood, J. S., Heathcote, A., Evans, N. J., & Holmes, W. R. (2021). Urgency, leakage, and the relative nature of information processing in decision-making. Psychological Review , 128(1), 160-186.
  70. Turner, B. M., Schley, D. R., Muller, C., & Tsetsos, K. (2018). Competing theories of multialternative, multiattribute preferential choice. Psychological Review, 125 (3), 329.
  71. Turner, B. M., Sederberg, P. B., & McClelland, J. L. (2016). Bayesian analysis of simulationbased models. Journal of Mathematical Psychology, 72, 191-199.
  72. Tversky, A. (1969). Intransitivity of preferences. Psychological Review, 76 (1), 31.
  73. Tversky, A., & Kahneman, D. (1973). Availability: A heuristic for judging frequency and probability. Cognitive Psychology, 5 (2), 207-232.
  74. Usher, M., & McClelland, J. L. (2001). The time course of perceptual choice: The leaky, competing accumulator model. Psychological Review, 108 (3), 550.
  75. Usher, M., & McClelland, J. L. (2004). Loss aversion and inhibition in dynamical models of multialternative choice. Psychological Review, 111 (3), 757.
  76. von Helversen, B., & Rieskamp, J. (2008). The mapping model: A cognitive theory of quantitative estimation. Journal of Experimental Psychology: General, 137 (1), 73.
  77. Voss, A., Lerche, V., Mertens, U., & Voss, J. (2019). Sequential sampling models with variable boundaries and non-normal noise: A comparison of six models. Psychonomic Bulletin & Review, 26 (3), 813-832.
  78. Weber, E. U., & Johnson, E. J. (2009). Mindful judgment and decision making. Annual Review of Psychology, 60 , 53-85.
  79. Weber, E. U., Johnson, E. J., Milch, K. F., Chang, H., Brodscholl, J. C., & Goldstein, D. G. (2007). Asymmetric discounting in intertemporal choice: A query-theory account. Psychological Science, 18 (6), 516-523.

Cited by

Sorted by citations

Authors
Zhao, W. J., Richie, R., & Bhatia, S.
Affiliations
  • The Ohio State University (US)
  • University of Pennsylvania (US)
Corresponding author
Zhao, Wenjia Joyce
Venue
Psychological Review
Published
2022-01
Volume
129
Issue
1
Pages
73-106
ISSN
  • 0033-295X (ISSN-L)
  • 1939-1471
OpenAlex
W3135352592
Cited by
28
References
4
Citations by year
2026: 6 · 2025: 5 · 2024: 4 · 2023: 7 · 2022: 2 · 2021: 2 · 2020: 2
FWCI
2.51
Type
journal article
Language
en
Open access
Locations
  • Psychological Review (publishedVersion, other-oa)
  • PubMed (publishedVersion)
  • Warwick Research Archive Portal (University of Warwick) (acceptedVersion)
  • eScholarship (California Digital Library) (submittedVersion)
  • OSF Preprints (OSF Preprints) (submittedVersion)
  • PsyArXiv (OSF Preprints) (submittedVersion, cc-by)
  • PsyArXiv (OSF Preprints) (submittedVersion)
Funders
  • National Science Foundation (SES-1847794)
  • Alfred P. Sloan Foundation
Topics
  • Social Sciences › Decision Sciences › General Decision Sciences › Decision-Making and Behavioral Economics
  • Life Sciences › Neuroscience › Cognitive Neuroscience › Memory Processes and Influences
  • Life Sciences › Neuroscience › Cognitive Neuroscience › Neural and Behavioral Psychology Studies
Keywords
memory-based decision making, deliberation, choice probabilities, deliberation time, risk perception, consumer behavior, financial decision-making, ethical decision-making, legal decision-making, food choice, social judgment, binary choice
MeSH terms
Decision Making, Humans, Judgment, Probability

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review