Modeling visual problem solving as analogical reasoning.
The DOI matches its Crossref record; 96 of the 96 references it cites were found in a registry or an index.
Abstract
We present a computational model of visual problem solving, designed to solve problems from the Raven's Progressive Matrices intelligence test. The model builds on the claim that analogical reasoning lies at the heart of visual problem solving, and intelligence more broadly. Images are compared via structure mapping, aligning the common relational structure in 2 images to identify commonalities and differences. These commonalities or differences can themselves be reified and used as the input for future comparisons. When images fail to align, the model dynamically rerepresents them to facilitate the comparison. In our analysis, we find that the model matches adult human performance on the Standard Progressive Matrices test, and that problems which are difficult for the model are also difficult for people. Furthermore, we show that model operations involving abstraction and rerepresentation are particularly difficult for people, suggesting that these operations may be critical for performing visual problem solving, and reasoning more generally, at the highest level. (PsycINFO Database Record
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Often this involves a process of re-representation , in which an initial problem representation is revised so as to facilitate the discovery of an analogy. 36-38”
From Emergent analogical reasoning in large language models (2023) · cites this paper as [38]
In the citing paper
“Human reasoners are capable of identifying abstract similarities between situations even when these situations are superficially quite different.”
From Emergent analogical reasoning in large language models (2023) · cites this paper as [38]
Citations
Cites
Discrete-Time Signal Processing
Oppenheim, A. V., & Schafer, R. W. (1989) · Cited by 12,571
Mental Rotation of Three-Dimensional Objects
Shepard, R. N., & Metzler, J. (1971) · Science · doi:10.1126/science.171.3972.701 · Cited by 6,246
Recognition-by-components: A theory of human image understanding.
Biederman, I. (1987) · Psychological Review · doi:10.1037/0033-295x.94.2.115 · Cited by 5,621
(1998) · Cited by 4,172
Forest before trees: The precedence of global features in visual perception
Navon, D. (1977) · Cognitive Psychology · doi:10.1016/0010-0285(77)90012-3 · Cited by 4,005
Ericsson, K. A., & Kintsch, W. (1995) · Psychological Review · doi:10.1037/0033-295x.102.2.211 · Cited by 3,498
Schema induction and analogical transfer
Gick, M. L., & Holyoak, K. J. (1983) · Cognitive Psychology · doi:10.1016/0010-0285(83)90002-6 · Cited by 3,010
Theory of fluid and crystallized intelligence: A critical experiment.
Cattell, R. B. (1963) · Journal of Educational Psychology · doi:10.1037/h0046743 · Cited by 2,536
Representation and recognition of the spatial organization of three-dimensional shapes
Marr, D., & Nishihara, H. K. (1978) · Proceedings of the Royal Society of London. Series B. Biological Sciences · doi:10.1098/rspb.1978.0020 · Cited by 2,158
Image And Brain: The Resolution of the Imagery Debate
Kosslyn, S. M. (1994) · doi:10.7551/mitpress/3653.001.0001 · Cited by 1,977
Mental Images and Their Transformations
D., C. P., Shepard, R. N., & Cooper, L. A. (1983) · The American Journal of Psychology · doi:10.2307/1422825 · Cited by 1,685
Carpenter, P. A., Just, M. A., & Shell, P. (1990) · Psychological Review · doi:10.1037/0033-295x.97.3.404 · Cited by 1,648
Laws of organization in perceptual forms.
Wertheimer, M. (1938) · A source book of Gestalt psychology. · doi:10.1037/11496-005 · Cited by 1,493
The structure-mapping engine: Algorithm and examples
Falkenhainer, B., Forbus, K. D., & Gentner, D. (1989) · Artificial Intelligence · doi:10.1016/0004-3702(89)90077-5 · Cited by 1,454
Self-citationHochstein (2002) · doi:10.1016/s0896-6273(02)01091-7 · Cited by 1,397
Image and Brain: The Resolution of the Imagery Debate
Kosslyn, S. M. (1994) · Cited by 1,352
Hoffman, D. D., & Richards, W. A. (1984) · Cognition · doi:10.1016/0010-0277(84)90022-2 · Cited by 1,342
Darwin's mistake: Explaining the discontinuity between human and nonhuman minds
Penn, D. C., Holyoak, K. J., & Povinelli, D. J. (2008) · Behavioral and Brain Sciences · doi:10.1017/s0140525x08003543 · Cited by 1,174
Ullman, S. (1984) · Cognition · doi:10.1016/0010-0277(84)90023-4 · Cited by 1,027
Johnson, D. M., & Sternberg, R. J. (1978) · The American Journal of Psychology · doi:10.2307/1421839 · Cited by 999
Dynamic binding in a neural network for shape recognition.
Hummel, J. E., & Biederman, I. (1992) · Psychological Review · doi:10.1037/0033-295x.99.3.480 · Cited by 924
Distributed representations of structure: A theory of analogical access and mapping.
Hummel, J. E., & Holyoak, K. J. (1997) · Psychological Review · doi:10.1037/0033-295x.104.3.427 · Cited by 910
Structure-mapping: A theoretical framework for analogy
GENTNER, D. (1983) · Cognitive Science · doi:10.1016/s0364-0213(83)80009-3 · Cited by 816
Surfaces and Essences: Analogy as the fuel and fire of thinking
Sander, E., & Hofstadter, M. (2013) · HAL · Cited by 780
Categories and particulars: Prototype effects in estimating spatial location.
Huttenlocher, J., Hedges, L. V., & Duncan, S. (1991) · Psychological Review · doi:10.1037//0033-295x.98.3.352 · Cited by 754
Rethinking perceptual organization: The role of uniform connectedness
Palmer, S., & Rock, I. (1994) · Psychonomic Bulletin & Review · doi:10.3758/bf03200760 · Cited by 658
Hierarchical structure in perceptual representation
Palmer, S. E. (1977) · Cognitive Psychology · doi:10.1016/0010-0285(77)90016-0 · Cited by 630
Bootstrapping the Mind: Analogical Processes and Symbol Systems
Gentner, D. (2010) · Cognitive Science · doi:10.1111/j.1551-6709.2010.01114.x · Cited by 519
Kosslyn, S. M., Koenig, O., Barrett, A., & Cave, C. B. (1989) · Journal of Experimental Psychology: Human Perception and Performance · doi:10.1037//0096-1523.15.4.723 · Cited by 487
The Transfer of Scientific Principles Using Concrete and Idealized Simulations
Goldstone, R. L., & Son, J. Y. (2005) · Journal of the Learning Sciences · doi:10.1207/s15327809jls1401_4 · Cited by 452
The order of visual processing: “Top-down,” “bottom-up,” or “middle-out”
Kinchla, R. A., & Wolfe, J. M. (1979) · Perception & Psychophysics · doi:10.3758/bf03202991 · Cited by 447
Core Knowledge of Geometry in an Amazonian Indigene Group
Dehaene, S., Izard, V., Pica, P., & Spelke, E. (2006) · Science · doi:10.1126/science.1121739 · Cited by 415
Structural Alignment in Comparison: No Difference Without Similarity
Gentner, D., & Markman, A. B. (1994) · Psychological Science · doi:10.1111/j.1467-9280.1994.tb00652.x · Cited by 411
A theory of the discovery and predication of relational concepts.
Doumas, L. A. A., Hummel, J. E., & Sandhofer, C. M. (2008) · Psychological Review · doi:10.1037/0033-295x.115.1.1 · Cited by 354
A cognitive design system approach to generating valid tests: Application to abstract reasoning.
Embretson, S. E. (1998) · Psychological Methods · doi:10.1037//1082-989x.3.3.380 · Cited by 349
A brief outline of the texton theory of human vision
Julesz, B. (1984) · Trends in Neurosciences · doi:10.1016/s0166-2236(84)80275-1 · Cited by 348
Qualitative spatial reasoning: The CLOCK project
Forbus, K. D., Nielsen, P., & Faltings, B. (1991) · Artificial Intelligence · doi:10.1016/0004-3702(91)90116-2 · Cited by 315
Self-citationImplications of cognitive psychology for educational measurement.
Snow, R. E., & Lohman, D. F. (1989) · Cited by 312
Relational similarity and the nonindependence of features in similarity judgments
Goldstone, R. L., Medin, D. L., & Gentner, D. (1991) · Cognitive Psychology · doi:10.1016/0010-0285(91)90010-l · Cited by 299
The Advantage of Abstract Examples in Learning Math
Kaminski, J. A., Sloutsky, V. M., & Heckler, A. F. (2008) · Science · doi:10.1126/science.1154659 · Cited by 276
Texture segmentation and pop-out from orientation contrast
Nothdurft, H. C. (1991) · Vision Research · doi:10.1016/0042-6989(91)90211-m · Cited by 262
Hahn, U., Chater, N., & Richardson, L. B. (2003) · Cognition · doi:10.1016/s0010-0277(02)00184-1 · Cited by 258
Analogy-Making as Perception: A Computer Model
Mitchell, M. (1993) · Medical Entomology and Zoology · Cited by 251
Analogical Reasoning and Conceptual Change: A Case Study of Johannes Kepler
Gentner, D., Brem, S., Ferguson, R. W., Markman, A. B., Levidow, B. B., Wolff, P., & Forbus, K. D. (1997) · Journal of the Learning Sciences · doi:10.1207/s15327809jls0601_2 · Cited by 251
Self-citationUNSWORTH, N., & ENGLE, R. (2005) · Intelligence · doi:10.1016/j.intell.2004.08.003 · Cited by 248
Global Precedence, Spatial Frequency Channels, and the Statistics of Natural Images
Hughes, H. C., Nozawa, G., & Kitterle, F. (1996) · Journal of Cognitive Neuroscience · doi:10.1162/jocn.1996.8.3.197 · Cited by 245
"Same"-"different" judgments: A review of current controversies in perceptual comparisons.
Farell, B. (1985) · Psychological Bulletin · doi:10.1037//0033-2909.98.3.419 · Cited by 235
Commonalities and differences in similarity comparisons
Markman, A. B., & Gentner, D. (1996) · Memory & Cognition · doi:10.3758/bf03200884 · Cited by 223
Components of geometric analogy solution
Mulholland, T. M., Pellegrino, J. W., & Glaser, R. (1980) · Cognitive Psychology · doi:10.1016/0010-0285(80)90011-0 · Cited by 219
Bornstein, M. H., & Korda, N. O. (1984) · Psychological Research · doi:10.1007/bf00308884 · Cited by 217
CogSketch: Sketch Understanding for Cognitive Science Research and for Education
Forbus, K. D., Usher, J., Lovett, A., Lockwood, K., & Wetzel, J. (2011) · Topics in Cognitive Science · doi:10.1111/j.1756-8765.2011.01149.x · Cited by 181
Self-citationAdaptive reasoning: Componential and eye movement analysis of geometric analogy performance
Bethell-Fox, C. E., Lohman, D. F., & Snow, R. E. (1984) · Intelligence · doi:10.1016/0160-2896(84)90009-6 · Cited by 173
Intelligence, information processing, and analogical reasoning
Reed, S. K. (1977) · Intelligence · doi:10.1016/0160-2896(77)90015-0 · Cited by 167
Sex differences on three factors identified in Raven's Standard Progressive Matrices
Lynn, R., Allïk, J., & Paul Irwing, B. (2004) · Intelligence · doi:10.1016/j.intell.2004.06.007 · Cited by 144
Hofstadter, D. R., & Boden, M. A. (1997) · Cited by 143
The information content of texture gradients
Stevens, K. A. (1981) · Biological Cybernetics · doi:10.1007/bf00336727 · Cited by 132
SEQL: Category learning as progressive abstraction using structure mapping
Kuehne, S. E., Forbus, K. D., & Gentner, D. (2000) · Cited by 118
Self-citationThe contribution of working memory to children's mathematical word problem solving
Andersson, U. (2007) · Applied Cognitive Psychology · doi:10.1002/acp.1317 · Cited by 117
A Rasch analysis of Raven’s standard progressive matrices
van der Ven, A. H. G. S., & Ellis, J. L. (2000) · Personality and Individual Differences · doi:10.1016/s0191-8869(99)00177-4 · Cited by 116
Effects of good form and spatial frequency on global precedence
LaGasse, L. L. (1993) · Perception & Psychophysics · doi:10.3758/bf03211718 · Cited by 108
Far-Out Thinking: Generating Solutions to Distant Analogies Promotes Relational Thinking
Vendetti, M. S., Wu, A., & Holyoak, K. J. (2014) · Psychological Science · doi:10.1177/0956797613518079 · Cited by 104
Computational Models of Analogy-Making
Kokinov, B. N., & French, R. M. (2003) · Cited by 102
An Architecture for Rapid, Hierarchical Structural Description
Hummel, J. E., & Stankiewicz, B. J. (1996) · The MIT Press eBooks · doi:10.7551/mitpress/1479.003.0012 · Cited by 101
Williams, C. L., Davidson, J., & Montgomery, I. (1980) · Journal of Clinical Psychology · doi:10.1002/1097-4679(198001)36:1<166::aid-jclp2270360118>3.0.co;2-# · Cited by 100
Kunda, M., McGreggor, K., & Goel, A. K. (2012) · Cognitive Systems Research · doi:10.1016/j.cogsys.2012.08.001 · Cited by 100
Hobeika, L., Diard‐Detoeuf, C., Garcin, B., Levy, R., & Volle, E. (2016) · Human Brain Mapping · doi:10.1002/hbm.23149 · Cited by 94
Solving Geometric Analogy Problems Through Two‐Stage Analogical Mapping
Lovett, A., Tomai, E., Forbus, K., & Usher, J. (2009) · Cognitive Science · doi:10.1111/j.1551-6709.2009.01052.x · Cited by 92
Self-citationA Neural Model of Rule Generation in Inductive Reasoning
Rasmussen, D., & Eliasmith, C. (2011) · Topics in Cognitive Science · doi:10.1111/j.1756-8765.2010.01127.x · Cited by 92
Exploring Analogy in the Large
Forbus, K. D. (2001) · The MIT Press eBooks · doi:10.7551/mitpress/1251.003.0005 · Cited by 88
Self-citationCAB: Connectionist Analogy Builder
Larkey, L. B., & Love, B. C. (2003) · Cognitive Science · doi:10.1016/s0364-0213(03)00066-1 · Cited by 86
A Structural Account of Global and Local Processing
Love, B. C., Rouder, J. N., & Wisniewski, E. J. (1999) · Cognitive Psychology · doi:10.1006/cogp.1998.0697 · Cited by 85
What Difference Reveals About Similarity
Sagi, E., Dedre Gentner, C., & Lovett, A. (2012) · Cognitive Science · doi:10.1111/j.1551-6709.2012.01250.x · Cited by 83
Self-citationQualitative Reasoning About Space and Motion
Forbus, K. D. (2014) · Psychology Press eBooks · doi:10.4324/9781315802725-8 · Cited by 82
Self-citationEquivalence of standard and computerized versions of the Raven Progressive Matrices Test
Williams, J. E., & McCord, D. (2004) · Computers in Human Behavior · doi:10.1016/j.chb.2004.03.005 · Cited by 80
Concavities as basic features in visual search: Evidence from search asymmetries
Hulleman, J., Winkel, W. T., & Boselie, F. (2000) · Perception & Psychophysics · doi:10.3758/bf03212069 · Cited by 69
Error analysis of raven test performance
Matzen, L. V., van der Molen, M. W., & Dudink, A. C. M. (1994) · Personality and Individual Differences · doi:10.1016/0191-8869(94)90070-1 · Cited by 64
A Theory of Rerepresentation in Analogical Matching
Jin, Y., Forbus, K. D., & Gentner, D. (2003) · doi:10.21236/ada466013 · Cited by 54
Self-citationCultural commonalities and differences in spatial problem-solving: A computational analysis
Lovett, A., & Forbus, K. D. (2011) · Cognition · doi:10.1016/j.cognition.2011.06.012 · Cited by 53
Self-citationOn the relationship between solution strategies in two mental rotation tasks
Janssen, A. B., & Geiser, C. (2010) · Learning and Individual Differences · doi:10.1016/j.lindif.2010.03.002 · Cited by 40
Comparison and Mapping Facilitate Relation Discovery and Predication
Doumas, L. A. A., & Hummel, J. E. (2013) · PLoS ONE · doi:10.1371/journal.pone.0063889 · Cited by 40
Why do categorization effects occur in comparative judgment tasks?
Maki, R. H. (1982) · Memory & Cognition · doi:10.3758/bf03197637 · Cited by 38
Kim, J. G., & Biederman, I. (2012) · NeuroImage · doi:10.1016/j.neuroimage.2012.08.066 · Cited by 38
Varieties of sameness: the impact of relational complexity on perceptual comparisons*
Kroger, J. K., Holyoak, K. J., & Hummel, J. E. (2004) · Cognitive Science · doi:10.1207/s15516709cog2803_2 · Cited by 37
Raven's Progressive Matrices: More on Construct Validity
Burke, H. R., & Bingham, W. C. (1969) · The Journal of Psychology · doi:10.1080/00223980.1969.10543505 · Cited by 35
McGreggor, K., Kunda, M., & Goel, A. K. (2014) · Artificial Intelligence · doi:10.1016/j.artint.2014.05.005 · Cited by 34
Arce-Ferrer, A. J., & Guzmán, E. M. (2009) · Educational and Psychological Measurement · doi:10.1177/0013164409332219 · Cited by 33
Categorical perception of relative orientation in visual object recognition
Rosielle, L. J., & Cooper, E. E. (2001) · Memory & Cognition · doi:10.3758/bf03195742 · Cited by 29
Modeling Multiple Strategies for Solving Geometric Analogy Problems
Lovett, A., & Forbus, K. D. (2012) · eScholarship (California Digital Library) · Cited by 23
Self-citationProcesses in verbal analogy solution.
Grudin, J. T. (1980) · Journal of Experimental Psychology Human Perception & Performance · doi:10.1037/0096-1523.6.1.67 · Cited by 18
Modeling Qualitative Differences in Symmetry Judgments
Ferguson, R. W., Aminoff, A., & Gentner, D. (1996) · Cited by 17
Edge-cycles: A qualitative sketch representation to support recognition
McLure, M. D., Friedman, S., Lovett, A., & Forbus, K. D. (2011) · Cited by 10
Self-citationBetween architecture and model: Strategies for cognitive control
Taatgen, N. (2014) · Biologically Inspired Cognitive Architectures · doi:10.1016/j.bica.2014.03.010 · Cited by 8
Structure of a psychodiagnostic test battery for children
Zagar, R. J., Arbit, J., & Friedland, J. (1980) · Journal of Clinical Psychology · Cited by 8
Organizing and Representing Space for Visual Problem-Solving
Lovett, A., & Forbus, K. D. (2011) · Cited by 7
Self-citationSolving Geometric Proportional Analogies with the Analogy Model HDTP
Gust, H., Ulf Krumnack, A., Kühnberger, K., & Schwering, A. (2009) · eScholarship (California Digital Library) · Cited by 7
Animation Facilitates Source Understanding and Spontaneous Analogical Transfer.
Kubricht, J., Lu, H., & Holyoak, K. J. (2015) · Cognitive Science · Cited by 2
Cited by
Emergent analogical reasoning in large language models
Webb, T., Holyoak, K. J., & Lu, H. (2023) · Nature Human Behaviour · doi:10.1038/s41562-023-01659-w · Cited by 404
RAVEN: A Dataset for Relational and Analogical Visual REasoNing
Zhang, C., Gao, F., Jia, B., Zhu, Y., & Zhu, S.-C. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00546 · Cited by 175
“However, an oversimplified assumption was usually made in the experiments that the computer programs had access to a symbolic representation of the image and the operations of rules [7, 32, 33, 34].”
BackgroundMethodResultInfluentialAbstraction and analogy‐making in artificial intelligence
Mitchell, M. (2021) · Annals of the New York Academy of Sciences · doi:10.1111/nyas.14619 · Cited by 125
“This example is one of the easier RPM problems; often they involve more than two shapes per square and changes in multiple attributes (shape, color, position, number, etc.) Lovett et al. 72 used SME as one component of a system to solve RPM problems.”
MethodInfluentialStratified Rule-Aware Network for Abstract Visual Reasoning
Hu, S., Ma, Y., Liu, X., Wei, Y., & Bai, S. (2021) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v35i2.16248 · Cited by 147
“Computational models for RPM in the cognitive science community access symbolic representations of the images (Carpenter, Just, and Shell 1990; Lovett and Forbus 2017; Lovett, Forbus, and Usher 2010; Lovett et al. 2010).”
Representation and Computation in Cognitive Models
Forbus, K. D., Liang, C., & Rabkina, I. (2017) · Topics in Cognitive Science · doi:10.1111/tops.12277 · Cited by 69
Self-citation
Metadata
- Authors
- Lovett, A., & Forbus, K.
- Affiliations
- Northwestern University (US)
- Venue
- Psychological Review
- Published
- 2017
- Volume
- 124
- Issue
- 1
- Pages
- 60-90
- ISSN
- 0033-295X (ISSN-L)
- 1939-1471
- OpenAlex
- W2566388524
- Cited by
- 117
- References
- 94
- Citations by year
- 2026: 4 · 2025: 8 · 2024: 15 · 2023: 19 · 2022: 12 · 2021: 14 · 2020: 19 · 2019: 12 · 2018: 7 · 2017: 7
- FWCI
- 7.12
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Psychological Review (publishedVersion)
- PubMed (publishedVersion)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › AI-based Problem Solving and Planning
- Physical Sciences › Computer Science › Artificial Intelligence › Logic, Reasoning, and Knowledge
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Categorization, perception, and language
- Keywords
- visual problem solving, analogical reasoning, Raven's Progressive Matrices, structure mapping, image comparison, abstraction, relational structures
- MeSH terms
- Adolescent, Female, Humans, Logic, Male, Models, Psychological, Problem Solving, Thinking, Visual Perception, Young Adult
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.