Formalizing Neurath’s ship: Approximate algorithms for online causal learning.
Open accessThe DOI matches its Crossref record; 138 of the 138 references it cites were found in a registry or an index.
Abstract
metaphor in philosophy of science, where theory change is cast as a stochastic and gradual process shaped as much by people's limited willingness to abandon their current theory when considering alternatives as by the ground truth they hope to approach. Inspired by this metaphor and by algorithms for approximating Bayesian inference in machine learning, we propose an algorithmic-level model of causal structure learning under which learners represent only a single global hypothesis that they update locally as they gather evidence. We propose a related scheme for understanding how, under these limitations, learners choose informative interventions that manipulate the causal system to help elucidate its workings. We find support for our approach in the analysis of 3 experiments. (PsycINFO Database Record
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“The research focus on deploying AI in education is gradually shifting from a computational focus that demonstrates use cases of new technology to cognitive focus that incorporates cognition in its design”
From Challenges and Future Directions of Big Data and Artificial Intelligence in Education (2020) · cites this paper as Bramley et al., 2017
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
The Measurement of Observer Agreement for Categorical Data
Landis, J. R., & Koch, G. G. (1977) · Biometrics · doi:10.2307/2529310 · Cited by 81,148 · cited 1×
“Interrater agreement on the primary category was 0.73, and Cohen’s κ = 0.64 ± 0.04, both higher than their respective heuristic criteria for adequacy of 0.7 and 0.6 (Krippendorff, 2012; Landis & Koch, 1977).”
InfluentialA Mathematical Theory of Communication
Shannon, C. E. (1948) · Bell System Technical Journal · doi:10.1002/j.1538-7305.1948.tb00917.x · Cited by 48,949
Estimating the Dimension of a Model
Schwarz, G. (1978) · The Annals of Statistics · doi:10.1214/aos/1176344136 · Cited by 47,033 · cited 3×
“Baseline acts as the null model for computing BIC’s (Schwarz, 1978) and pseudo-R2’s (Dobson, 2010) for all other models.”
Equation of State Calculations by Fast Computing Machines
Metropolis, N., Rosenbluth, A. W., Rosenbluth, M. N., Teller, A. H., & Teller, E. (1953) · The Journal of Chemical Physics · doi:10.1063/1.1699114 · Cited by 37,192
The Structure of Scientific Revolutions
Kuhn, T. S., & Schlegel, R. (1963) · Physics Today · doi:10.1063/1.3050879 · Cited by 35,538
Tversky, A., & Kahneman, D. (1974) · Science · doi:10.1126/science.185.4157.1124 · Cited by 28,810
James, W. (1913) · Henry Holt and Company eBooks · doi:10.1037/11059-000 · Cited by 25,226
Content Analysis: An Introduction to its Methodology.
Shelley, M., & Krippendorff, K. (1984) · Journal of the American Statistical Association · doi:10.2307/2288384 · Cited by 24,312
Book Review: Pattern Recognition and Machine Learning
Nasrabadi, N. M. (2007) · Journal of Electronic Imaging · doi:10.1117/1.2819119 · Cited by 22,066 · cited 2×
“, 2008), comes from variational Bayes (Bishop, 2006; Weierstrass, 1902).”
BackgroundMethodStochastic relaxation, gibbs distributions, and the bayesian restoration of images.
Geman, S., & Geman, D. (1984) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.1984.4767596 · Cited by 17,949 · cited 1×
“A simple case is Gibbs sampling (Geman & Geman, 1984), starting with some structural hypothesis and repeatedly selecting an edge (randomly or systematically) and re-sampling it (either adding, removing or reversing) conditional on state of the other edges.”
Amazon's Mechanical Turk: A New Source of Inexpensive, Yet High-Quality, Data?
Buhrmester, M., Kwang, T., & Gosling, S. D. (2011) · Perspectives on Psychological Science · doi:10.1177/1745691610393980 · Cited by 9,996
Rescorla, R. A. (1972) · Medical Entomology and Zoology · Cited by 9,459
The Structure of Scientific Revolutions
Hall, M. B., & Kuhn, T. S. (1963) · The American Historical Review · doi:10.2307/1847040 · Cited by 7,479
Confirmation Bias: A Ubiquitous Phenomenon in Many Guises
Nickerson, R. S. (1998) · Review of General Psychology · doi:10.1037/1089-2680.2.2.175 · Cited by 7,267 · cited 2×
“Confirmatory evidence gathering is a ubiquitous psychological phenomenon (Nickerson, 1998; Klayman & Ha, 1989).”
Georges, A., Kotliar, G., Krauth, W., & Rozenberg, M. J. (1996) · Reviews of Modern Physics · doi:10.1103/revmodphys.68.13 · Cited by 6,901 · cited 1×
“This is a common problem in the context of the adaptive toolbox (Gigerenzer, 2001)—it is hard to have a theory of the collection of tools. A second shared problem follows on from this—namely how to choose which rule to apply under which circumstance. In our case, this is evident again in the mixtures of local focus ru…”
Simple Heuristics That Make Us SmartPreprint
Gigerenzer, G., & Todd, P. M. (1999) · RePEc: Research Papers in Economics · Cited by 6,398
(1960) · Medical Entomology and Zoology · Cited by 5,851
Judgment Under Uncertainty: Heuristics and Biases.
Shafer, G. R., Kahnerman, D., Slovic, P., & Tversky, A. (1984) · Journal of the American Statistical Association · doi:10.2307/2288362 · Cited by 5,657
New extension of the Kalman filter to nonlinear systems
Julier, S. J., & Uhlmann, J. K. (1997) · SPIE Proceedings · doi:10.1117/12.280797 · Cited by 5,331 · cited 2×
“In some instances they can be rational; for instance moderate recency is rational in a changing world (Julier & Uhlmann, 1997).”
CAUSALITY: MODELS, REASONING AND INFERENCE
Hitchcock, C. (2001) · The Philosophical Review · doi:10.1215/00318108-110-4-639 · Cited by 4,741 · cited 3×
“We use a standard representation for causal models – the parameterized directed acyclic graph (Pearl, 2000, see Figure 1a).”
Ericsson (1993) · doi:10.1037/0033-295x.87.3.215 · Cited by 4,539 · cited 1×
“Subjective explanations are notoriously problematic (Ericsson & Simon, 1980, 1993; Russo, Johnson, & Stephens, 1989).”
A Bayesian method for the induction of probabilistic networks from data
Cooper, G. F., & Herskovits, E. (1992) · Machine Learning · doi:10.1007/bf00994110 · Cited by 4,204 · cited 2×
“Applied to causal structure inference, we might in either case consider transitions that change at most a single edge in the model (Cooper & Herskovits, 1992; Goudie & Mukherjee, 2011).”
Protocol Analysis: Verbal Reports as Data
Ericsson, K. A., & Simon, H. A. (1993) · doi:10.7551/mitpress/5657.001.0001 · Cited by 3,537 · cited 1×
“Subjective explanations are notoriously problematic (Ericsson & Simon, 1980, 1993; Russo, Johnson, & Stephens, 1989).”
Conducting behavioral research on Amazon’s Mechanical Turk
Mason, W., & Suri, S. (2012) · Behavior Research Methods · doi:10.3758/s13428-011-0124-6 · Cited by 3,172 · cited 1×
“It offers an well validated (Buhrmester, Kwang, & Gosling, 2011; Crump, McDonnell, & Gureckis, 2013; Gosling, Vazire, Srivastava, & John, 2004; Hauser & Schwarz, 2015; Mason & Suri, 2012) subject pool, diverse in age and background, suitable for high-level cognition tasks.”
Simulated annealing: theory and applications.
(1988) · Mathematics and Computers in Simulation · doi:10.1016/0378-4754(88)90023-7 · Cited by 2,966
Gosling, S. D., Vazire, S., Srivastava, S., & John, O. P. (2004) · American Psychologist · doi:10.1037/0003-066x.59.2.93 · Cited by 2,932
Prediction and Entropy of Printed English
Shannon, C. E. (1951) · Bell System Technical Journal · doi:10.1002/j.1538-7305.1951.tb01366.x · Cited by 2,686
Pattern recognition and machine learning
(2007) · Choice Reviews Online · doi:10.5860/choice.44-5091 · Cited by 2,650
Lycan, W. G., & Dennett, D. C. (1993) · The Philosophical Review · doi:10.2307/2185913 · Cited by 2,638
An Introduction to Generalized Linear Models.
Chang, P. C., & Dobson, A. J. (1991) · Journal of the American Statistical Association · doi:10.2307/2290548 · Cited by 2,509
Pfanzagl, J., & Luce, R. D. (1962) · Econometrica · doi:10.2307/1911299 · Cited by 2,469 · cited 6×
“It has one inverse temperature parameter θ ∈ [0,∞] governing soft maximization (Luce, 1959) over the global expected information gains.”
InfluentialSequential Monte Carlo Methods for Dynamic Systems
Liu, J. S., & Chen, R. (1998) · Journal of the American Statistical Association · doi:10.1080/01621459.1998.10473765 · Cited by 2,191 · cited 2×
“The idea that learners focus on resolving local rather than global uncertainty results in a metaproblem of choosing what to focus on next, making intervention choice a two stage process.”
The Adaptive Character of Thought
Massaro, D. W., Friedman, D., & Anderson, J. R. (1991) · The American Journal of Psychology · doi:10.2307/1423253 · Cited by 2,174
The Aim and Structure of Physical Theory
Duhem, P. M. M. (1954) · doi:10.1515/9780691233857 · Cited by 2,128
Bayesian integration in sensorimotor learning
Körding, K. P., & Wolpert, D. M. (2004) · Nature · doi:10.1038/nature02169 · Cited by 2,004
The computational complexity of probabilistic inference using bayesian belief networks
Cooper, G. F. (1990) · Artificial Intelligence · doi:10.1016/0004-3702(90)90060-d · Cited by 1,937 · cited 10×
“This is variously known as “constraint-seeking” (Ruggeri & Lombrozo, 2014) or “the split half heuristic” (Nelson, Divjak, Gudmundsdottir, Martignon, & Meder, 2014).”
InfluentialThe max-min hill-climbing Bayesian network structure learning algorithm
Tsamardinos, I., Brown, L. E., & Aliferis, C. F. (2006) · Machine Learning · doi:10.1007/s10994-006-6889-7 · Cited by 1,822
Hauser, D. J., & Schwarz, N. (2016) · Behavior Research Methods · doi:10.3758/s13428-015-0578-z · Cited by 1,739 · cited 1×
“It offers an well validated (Buhrmester, Kwang, & Gosling, 2011; Crump, McDonnell, & Gureckis, 2013; Gosling, Vazire, Srivastava, & John, 2004; Hauser & Schwarz, 2015; Mason & Suri, 2012) subject pool, diverse in age and background, suitable for high-level cognition tasks.”
Equation of state calculations by fast computing machines
Metropolis, N., Rosenbluth, A. W., Rosenbluth, M. N., Teller, A. H., & Teller, E. (1953) · doi:10.2172/4390578 · Cited by 1,701
Evaluating amazon’s mechanical turk as a tool for experimental behavioral research
Crump, M. J. C., McDonnell, J. V., & Gureckis, T. M. (2013) · PLoS ONE · doi:10.1371/journal.pone.0057410 · Cited by 1,617 · cited 1×
“One proposal is the dynamic Bayesian network (Dean & Kanazawa, 1989), which can be “unfolded” to form regular acyclic network with causal influences passing forward through time.”
In two minds: dual-process accounts of reasoning
Evans, J. S. B. T. (2003) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2003.08.012 · Cited by 1,569 · cited 1×
“Rather than claiming these are completely different processes (Evans, 2003), the approximate probabilistic inference perspective can accommodate the whole continuum.”
Hippocampal place-cell sequences depict future paths to remembered goals
Pfeiffer, B. E., & Foster, D. J. (2013) · Nature · doi:10.1038/nature12112 · Cited by 1,216 · cited 1×
“This means learners need not do extensive prospective calculation on every test but can learn gradually, for instance through experience and preplay (Pfeiffer & Foster, 2013), which interventions are likely to be informative relative to generic types of local focus.”
From covariation to causation: A causal power theory.
Cheng, P. W. (1997) · Psychological Review · doi:10.1037//0033-295x.104.2.367 · Cited by 1,206 · cited 2×
“, Griffiths & Tenenbaum, 2009; Holyoak & Cheng, 2011; Lagnado & Sloman, 2004, 2006; Lagnado, Waldmann, Hagmayer, & Sloman, 2007). Related work has begun to explore how people engage in “active learning”—selecting interventions on variables in systems of interest to be effective at reducing uncertainty about the true c…”
Model Selection and Accounting for Model Uncertainty in Graphical Models Using Occam's Window
Madigan, D., & Raftery, A. E. (1994) · Journal of the American Statistical Association · doi:10.1080/01621459.1994.10476894 · Cited by 1,205 · cited 1×
“For example we found (data not shown) fairly good fits by replacing Gibbs sampling with a form of Metropolis-Hastings MCMC sampling – using an MC3 proposal and acceptance distribution (Madigan & Raftery, 1994; Madigan, York, & Allard, 1995).”
Settles, B. (2012) · Cited by 1,183
Bayesian Graphical Models for Discrete Data
Madigan, D., York, J., & Allard, D. (1995) · International Statistical Review / Revue Internationale de Statistique · doi:10.2307/1403615 · Cited by 1,090
A model for reasoning about persistence and causation
Dean, T., & Kanazawa, K. (1989) · Computational Intelligence · doi:10.1111/j.1467-8640.1989.tb00324.x · Cited by 999 · cited 1×
“One proposal is the dynamic Bayesian network (Dean & Kanazawa, 1989), which can be “unfolded” to form regular acyclic network with causal influences passing forward through time.”
Dolan, R. J., & Dayan, P. (2013) · Neuron · doi:10.1016/j.neuron.2013.09.007 · Cited by 977 · cited 1×
“Such representations enable humans to exploit their physical and social environments in flexible and inherently model-based ways (Dolan & Dayan, 2013; Griffiths & Tenenbaum, 2007; Sloman, 2005).”
BackgroundSelf-citationAn Introduction to Generalized Linear Models
Dobson, A., & Barnett, A. (2008) · Chapman & Hall/CRC eBooks · doi:10.1201/9780367807849 · Cited by 930
Einhorn, H. J., & Hogarth, R. M. (1986) · Psychological Bulletin · doi:10.1037//0033-2909.99.1.3 · Cited by 912 · cited 2×
“The Neurath’s ship approach is related to anchor-and-adjust models (Einhorn & Hogarth, 1986; Petrov & Anderson, 2005) of sequential magnitude estimation.”
Models of Bounded Rationality: Empirically Grounded Economic Reason
Simon, H. A. (1997) · Cited by 827
Stochastic Relaxation, Gibbs Distributions, and the Bayesian Restoration of Images
GEMAN, S., & GEMAN, D. (1987) · Readings in Computer Vision · doi:10.1016/b978-0-08-051581-6.50057-x · Cited by 750
Failure to Detect Mismatches Between Intention and Outcome in a Simple Decision Task
Johansson, P., Hall, L., Sikström, S., & Olsson, A. (2005) · Science · doi:10.1126/science.1111709 · Cited by 686
Simulation as an engine of physical scene understanding
Battaglia, P. W., Hamrick, J. B., & Tenenbaum, J. B. (2013) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1306572110 · Cited by 681
Causal Models: How People Think about the World and Its Alternatives
Sloman, S. (2005) · doi:10.1093/acprof:oso/9780195183115.001.0001 · Cited by 677 · cited 1×
“Such representations enable humans to exploit their physical and social environments in flexible and inherently model-based ways (Dolan & Dayan, 2013; Griffiths & Tenenbaum, 2007; Sloman, 2005).”
Protocol analysis: Verbal reports as data, Rev. ed.
Ericsson, K. A., & Simon, H. A. (1993) · Cited by 655
Unconscious influences on decision making: A critical review
Newell, B. R., & Shanks, D. R. (2014) · Behavioral and Brain Sciences · doi:10.1017/s0140525x12003214 · Cited by 652
The validity of verbal protocols
Russo, J. E., Johnson, E. J., & Stephens, D. L. (1989) · Memory & Cognition · doi:10.3758/bf03202637 · Cited by 543
Amazon's Mechanical Turk: A new source of inexpensive, yet high-quality, data?: (527772014-223)
Buhrmester, M., Kwang, T., & Gosling, S. (2011) · PsycEXTRA Dataset · doi:10.1037/e527772014-223 · Cited by 534
Inferring causal networks from observations and interventions
Steyvers, M. (2003) · Cognitive Science · doi:10.1016/s0364-0213(03)00010-7 · Cited by 530
Cognitive emissions of 1/f noise.
Gilden, D. L. (2001) · Psychological Review · doi:10.1037/0033-295x.108.1.33 · Cited by 516 · cited 2×
“Regardless, there are a plethora of non Bayesian models that can reproduce various sequential effects (DeCarlo, 1992; Treisman & Williams, 1984; Gilden, 2001).”
A rational analysis of rule-based concept learning
Goodman, N. D., Tenenbaum, J. B., Feldman, J., & Griffiths, T. L. (2008) · Cognitive Science · doi:10.1080/03640210701802071 · Cited by 469
Self-citationGriffiths, T. L., Lieder, F., & Goodman, N. D. (2015) · Topics in Cognitive Science · doi:10.1111/tops.12142 · Cited by 397
Self-citationTheory-based causal induction.
Griffiths, T. L., & Tenenbaum, J. B. (2009) · Psychological Review · doi:10.1037/a0017201 · Cited by 387 · cited 2×
“…make broadly normative causal inferences based on cues like observed contingencies or the outcomes of interventions, which are manipulations or tests of the system (e.g. Griffiths & Tenenbaum, 2009; Holyoak & Cheng, 2011; Lagnado & Sloman, 2004, 2006; Lagnado, Waldmann, Hagmayer, & Sloman, 2007).”
Self-citationRational approximations to rational models: alternative algorithms for category learning
Sanborn, A. N., Griffiths, T. L., & Navarro, D. J. (2010) · Psychological Review · doi:10.1037/a0020511 · Cited by 369 · cited 1×
“The idea that stochastic local search plays an important role in cognition has some precedent (Gershman, Vul, & Tenenbaum, 2012; Sanborn et al., 2010).”
Self-citationCounting unlabeled acyclic digraphs
Robinson, R. W. (1977) · Lecture Notes in Mathematics · doi:10.1007/bfb0069178 · Cited by 368 · cited 1×
“…paper 10The number of directed acyclic graphs on N nodes, |M|N , can be computed with the recurrence relation |M|N =∑ k∈N (−1) k−1(N 2 ) 2k(N−k)|M|N−1 (see Robinson, 1977) ple under deterministic or sparse hypotheses spaces or peaked priors (Austerweil & Griffiths, 2011; Navarro & Perfors, 2011).”
A theory of criterion setting with an application to sequential dependencies.
Treisman, M., & Williams, T. C. (1984) · Psychological Review · doi:10.1037//0033-295x.91.1.68 · Cited by 340 · cited 2×
“Regardless, there are a plethora of non Bayesian models that can reproduce various sequential effects (DeCarlo, 1992; Gilden, 2001; Treisman & Williams, 1984).”
Hwang, C.-R. (1988) · Acta Applicandae Mathematicae · doi:10.1007/bf00047572 · Cited by 335
Bayesian modeling of uncertainty in low-level vision
Szeliski, R. (1990) · International Journal of Computer Vision · doi:10.1007/bf00126502 · Cited by 303 · cited 1×
“In lower level cognition, inference takes place over simple quantities like magnitudes, and is certainly highly probabilistic the sense that people have a sense of their uncertainty as well as their expectations (Gershman et al., 2012; Szeliski, 1990).”
BackgroundTake the best or look at the rest? Factors influencing "one-reason" decision making.
Newell, B. R., & Shanks, D. R. (2003) · Journal of Experimental Psychology: Learning, Memory, & Cognition · doi:10.1037//0278-7393.29.1.53 · Cited by 286 · cited 1×
“However, subsequent analyses have revealed that participants behave somewhere between the two (Newell & Shanks, 2003; Parpart, Jones, & Love, in revision) often using more than one cue, but certainly less than all the information available.”
Kim, N. S., & Ahn, W.-K. (2002) · Journal of Experimental Psychology: General · doi:10.1037//0096-3445.131.4.451 · Cited by 271
Tutorial on Variational Approximation Methods
Jaakkola, T. S. (2001) · Advanced Mean Field Methods · doi:10.7551/mitpress/1100.003.0014 · Cited by 269 · cited 1×
“Divergence between this approximation and the full model can then be minimized mathematically by updating each of the local distributions in turn (Jaakkola, 2001).”
MethodChain Graph Models and their Causal Interpretations
Lauritzen, S. L., & Richardson, T. S. (2002) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/1467-9868.00340 · Cited by 265 · cited 1×
“Another is the chain graph (Lauritzen & Richardson, 2002), in which undirected edges are mixed with directed edges and used to model the equilibria of the cyclic parts of the system.”
The Advantage of Timely Intervention.
Lagnado, D. A., & Sloman, S. (2004) · Journal of Experimental Psychology: Learning, Memory, and Cognition · doi:10.1037/0278-7393.30.4.856 · Cited by 264 · cited 2×
“…make broadly normative causal inferences based on cues like observed contingencies or the outcomes of interventions, which are manipulations or tests of the system (e.g. Griffiths & Tenenbaum, 2009; Holyoak & Cheng, 2011; Lagnado & Sloman, 2004, 2006; Lagnado, Waldmann, Hagmayer, & Sloman, 2007).”
Self-citationThe Aim and Structure of Physical Theory
Becker, J. F., Duhem, P., & Wiener, P. P. (1955) · Southern Economic Journal · doi:10.2307/1054018 · Cited by 262
Finding Useful Questions: On Bayesian Diagnosticity, Probability, Impact, and Information Gain.
Nelson, J. D. (2005) · Psychological Review · doi:10.1037/0033-295x.112.4.979 · Cited by 253 · cited 2×
“However, it is one that has proved at least as long-run successful as a number of variants when applied as a greedy strategy for choosing interventions (Bramley, Nelson, Speekenbrink, & Lagnado, 2014) or asking binary questions (Nelson, 2005).”
BackgroundHypothesis testing in rule discovery: Strategy, structure, and content.
Klayman, J., & Ha, Y.-W. (1989) · Journal of Experimental Psychology Learning Memory and Cognition · doi:10.1037//0278-7393.15.4.596 · Cited by 252
Lucas, C. G., Bridgers, S., Griffiths, T. L., & Gopnik, A. (2014) · Cognition · doi:10.1016/j.cognition.2013.12.010 · Cited by 240
Self-citationCausal Learning and Inference as a Rational Process: The New Synthesis
Holyoak, K. J., & Cheng, P. W. (2011) · Annual Review of Psychology · doi:10.1146/annurev.psych.121208.131634 · Cited by 225
Model Selection and Accounting for Model Uncertainty in Graphical Models Using Occam's Window
Madigan, D., & Raftery, A. E. (1994) · Journal of the American Statistical Association · doi:10.2307/2291017 · Cited by 212
Beyond Covariation: Cues to Causal Structure
Lagnado, D. A., Waldmann, M. R., Hagmaye, Y., & Sloman, S. A. (2007) · Causal Learning · doi:10.1093/acprof:oso/9780195176803.003.0011 · Cited by 201
Self-citationBayesian generic priors for causal learning.
Lu, H., Yuille, A. L., Liljeholm, M., Cheng, P. W., & Holyoak, K. J. (2008) · Psychological Review · doi:10.1037/a0013256 · Cited by 200 · cited 2×
“Additionally, we considered a sparse-strong (SS) variant following Lu et al (2008), encoding an expectation of high edge reliability – wS ∼ Beta(2, 10), and relatively little background noise – wB ∼ Beta(10, 2).”
Continuous Time Bayesian Networks
Nodelman, U., Shelton, C. R., & Koller, D. (2012) · arXiv (Cornell University) · doi:10.48550/arxiv.1301.0591 · Cited by 169
Lagnado, D. A., & Sloman, S. A. (2006) · Journal of Experimental Psychology: Learning, Memory, and Cognition · doi:10.1037/0278-7393.32.3.451 · Cited by 156 · cited 1×
“…make broadly normative causal inferences based on cues like observed contingencies or the outcomes of interventions, which are manipulations or tests of the system (e.g. Griffiths & Tenenbaum, 2009; Holyoak & Cheng, 2011; Lagnado & Sloman, 2004, 2006; Lagnado, Waldmann, Hagmayer, & Sloman, 2007).”
Self-citationMultistability and perceptual inference
Gershman, S. J., Vul, E., & Tenenbaum, J. B. (2012) · Neural Computation · doi:10.1162/neco_a_00226 · Cited by 140 · cited 2×
“At the lower level the brain can average over many values, as in particle filtering (Abbott & Griffiths, 2011), with a whole fleet of Neurath’s ships, or via lots of long chains (Gershman et al., 2012; Lieder et al., 2012).”
Win-Stay, Lose-Sample: A simple sequential algorithm for approximating Bayesian inference
Bonawitz, E., Denison, S., Gopnik, A., & Griffiths, T. L. (2014) · Cognitive Psychology · doi:10.1016/j.cogpsych.2014.06.003 · Cited by 131 · cited 13×
“Summed across all participants, NS has the lowest total BIC (93381) with the SE in second place (94326), followed by WSLS with (97643), then NS-RE (101837), Rational (1207209) and finally Baseline with (149313).”
InfluentialSelf-citationTesting Bayesian Models of Human Coincidence Timing
Miyazaki, M., Nozaki, D., & Nakajima, Y. (2005) · Journal of Neurophysiology · doi:10.1152/jn.01168.2004 · Cited by 126 · cited 2×
“Doing so efficiently would require choosing maximally informative interventions, a task which poses even greater computational challenges: consideration and weighting of all possible outcomes, under all possible models for all possible interventions (Murphy, 2001; Nyberg & Korb, 2006). To understand better the cogniti…”
Expected and Unexpected Uncertainty: ACh and NE in the Neocortex
Dayan, P., & Yu, A. J. (2002) · TUbilio (Technical University of Darmstadt) · Cited by 123
Self-citationActive Learning of Causal Bayes Net Structure
Murphy, K. P. (2006) · Cited by 122
Bramley, N. R., Lagnado, D. A., & Speekenbrink, M. (2014) · Journal of Experimental Psychology Learning Memory and Cognition · doi:10.1037/xlm0000061 · Cited by 118 · cited 37×
“This was true in the majority of cases in Bramley, Lagnado, and Speekenbrink (2015) and Experiment 2.”
BackgroundMethodResultInfluentialSelf-citationStrategies to intervene on causal systems are adaptively selected
Coenen, A., Rehder, B., & Gureckis, T. M. (2015) · Cognitive Psychology · doi:10.1016/j.cogpsych.2015.02.004 · Cited by 111 · cited 3×
“Accordingly, Coenen et al. (2015) propose that causal learners adopt a “positive test strategy” when distinguishing causal models. They define this as a preference to “turn on” a parent component of one’s hypothesis—observing whether the activity propagates to the other variables in the way that this hypothesis predic…”
InfluentialBurn-in, bias, and the rationality of anchoring
Lieder, F., Griffiths, T. L., & Goodman, N. D. (2012) · neural information processing systems · Cited by 104
Self-citationCausal learning with local computations.
Fernbach, P. M., & Sloman, S. A. (2009) · Journal of Experimental Psychology: Learning, Memory, and Cognition · doi:10.1037/a0014928 · Cited by 100 · cited 5×
“An interesting alternative approach to complex model induction via local computations (Fernbach & Sloman, 2009; Waldmann et al., 2008), comes from variational Bayes (Bishop, 2006; Weierstrass, 1902).”
InfluentialThe Dynamics of Scaling: A Memory-Based Anchor Model of Category Rating and Absolute Identification.
Petrov, A. A., & Anderson, J. R. (2005) · Psychological Review · doi:10.1037/0033-295x.112.2.383 · Cited by 100 · cited 3×
“The Neurath’s ship approach is related to anchor-and-adjust models (Einhorn & Hogarth, 1986; Petrov & Anderson, 2005) of sequential magnitude estimation.”
The importance of decision making in causal learning from interventions
Sobel, D. M., & Kushnir, T. (2006) · Memory & Cognition · doi:10.3758/bf03193418 · Cited by 98 · cited 1×
“…learning” – selecting interventions on variables in systems of interest in order to be effective at reducing uncertainty about the true causal model (Bramley, Lagnado, & Speekenbrink, 2015; Coenen, Rehder, & Gureckis, 2015; Sobel & Kushnir, 2006; Steyvers, Tenenbaum, Wagenmakers, & Blum, 2003).”
Children’s sequential information search is sensitive to environmental probabilities
Nelson, J. D., Divjak, B., Gudmundsdottir, G., Martignon, L. F., & Meder, B. (2013) · Cognition · doi:10.1016/j.cognition.2013.09.007 · Cited by 94
A closed-form expression for the Sharma–Mittal entropy of exponential families
Nielsen, F., & Nock, R. (2011) · Journal of Physics A Mathematical and Theoretical · doi:10.1088/1751-8113/45/3/032003 · Cited by 93 · cited 2×
“Shannon is just one of a broad family of possible entropy measures (Nielsen & Nock, 2011).”
Independence and dependence in human causal reasoning
Rehder, B. (2014) · Cognitive Psychology · doi:10.1016/j.cogpsych.2014.02.002 · Cited by 91 · cited 2×
“…between them, ending up with a modular causal model that allows for good local inferences but which leads to so-called “Markov violations” in more complex inferences where participants fail to respect the conditional dependencies and independences implied by the global model (Rehder, 2014).”
Theory learning as stochastic search in the language of thought
Ullman, T. D., Goodman, N. D., & Tenenbaum, J. B. (2012) · Cognitive Development · doi:10.1016/j.cogdev.2012.07.005 · Cited by 91 · cited 3×
“…Lucas, Williams, & Kalish, 2009); hierarchical organization (Griffiths & Tenenbaum, 2009; Williamson & Gabbay, 2005); and temporal (Pacer & Griffiths, 2012) and spatial (Battaglia, Hamrick, & Tenenbaum, 2013; Ullman et al., 2012; Ullman, Stuhlmüller, Goodman, & Tenenbaum, 2014) semantics.”
Hypothesis generation, sparse categories, and the positive test strategy.
Navarro, D. J., & Perfors, A. F. (2011) · Psychological Review · doi:10.1037/a0021110 · Cited by 86 · cited 15×
“At the lower level the brain can average over many values, as in particle filtering (Abbott & Griffiths, 2011), with a whole fleet of Neurath’s ships, or via lots of long chains (Gershman et al., 2012; Lieder et al., 2012).”
InfluentialSimulation as an Engine of Physical Scene Understanding
Battaglia, P., Hamrick, J. B., & Tenenbaum, J. B. (2013) · PsycEXTRA Dataset · doi:10.1037/e633262013-904 · Cited by 81
Children’s use of interventions to learn causal structure
McCormack, T., Bramley, N. R., Frosch, C. A., Patrick, F., & Lagnado, D. A. (2015) · Journal of Experimental Child Psychology · doi:10.1016/j.jecp.2015.06.017 · Cited by 73
Self-citationModeling human function learning with Gaussian processes
Griffiths, T. L., Lucas, C., Williams, J. J., & Kalish, M. L. (2008) · Cited by 69
Self-citationOne and Done? Optimal Decisions from Very Few Samples
Goodman, N. D., Griffiths, T. L., Tenenbaum, J. B., & Vul, E. (2009) · eScholarship (California Digital Library) · Cited by 68
Self-citationRational analysis, intractability, and the prospects of ‘as if’-explanations
van Rooij, I., Wright, C., Kwisthout, J., & Wareham, T. (2014) · Synthese · doi:10.1007/s11229-014-0532-0 · Cited by 65 · cited 1×
“By taking the Neurath’s ship metaphor to reveal an intuitive answer as to how people sidestep the intractability of rational theory formation (van Rooij et al., 2014), we can start to build more realistic models of how people generate the theories that they do and how and why they get stuck.”
Learning in a changing environment.
Speekenbrink, M., & Shanks, D. R. (2010) · Journal of Experimental Psychology: General · doi:10.1037/a0018620 · Cited by 62 · cited 1×
“The theory of unexpected uncertainty (Yu & Dayan, 2003), and substantial work on changepoint tasks (Speekenbrink & Shanks, 2010) are associated with the notion that people will sometimes “start over” if they are having consistently poor predictions from their existing model.”
Causal learning in rats and humans: A minimal rational model
Waldmann, M. R., Cheng, P. W., Hagmayer, Y., & Blaisdell, A. P. (2008) · Cited by 59
Human memory search as a random walk in a semantic network
Austerweil, J. L., Abbott, J. T., & Griffiths, T. L. (2012) · neural information processing systems · Cited by 57
Self-citationOptimal Teaching for Limited-Capacity Human Learners
Patil, K. R., Zhu, X., Kopeć, Ł., & Love, B. C. (2014) · Cited by 56
Self‐Directed Learning Favors Local, Rather Than Global, Uncertainty
Markant, D. B., Settles, B., & Gureckis, T. M. (2015) · Cognitive Science · doi:10.1111/cogs.12220 · Cited by 55
Lagnado, D. A., & Sloman, S. A. (2019) · Routledge eBooks · doi:10.4324/9781315782379-132 · Cited by 50 · cited 2×
“There are typically many different classes of Markov chain transitions that share the same stationary distribution, but differ in the properties of burn-in and subsampling.”
Self-citationInferring Hidden Causal Structure
Kushnir, T., Alison Gopnik, C., Lucas, C., & Schulz, L. (2010) · Cognitive Science · doi:10.1111/j.1551-6709.2009.01072.x · Cited by 49
Think again? The amount of mental simulation tracks uncertainty in the outcome
Hamrick, J. B., Smith, K. A., Griffiths, T. L., & Vul, E. (2015) · Figshare · doi:10.6084/m9.figshare.1554893 · Cited by 47
Self-citationTypes of approximation for probabilistic cognition: Sampling and variational.
Sanborn, A. N. (2017) · Brain and Cognition · doi:10.1016/j.bandc.2015.06.008 · Cited by 45 · cited 2×
“The biases induced by this process make the two approaches distinguishable in principle (Sanborn, 2015), meaning that an interesting avenue for future work may be to design experiments that distinguish between the two approaches to approximation in cognition.”
Seeking Confirmation Is Rational for Deterministic Hypotheses
Austerweil, J. L., & Griffiths, T. L. (2011) · Cognitive Science · doi:10.1111/j.1551-6709.2010.01161.x · Cited by 44 · cited 1×
“…paper 10The number of directed acyclic graphs on N nodes, |M|N , can be computed with the recurrence relation |M|N =∑ k∈N (−1) k−1(N 2 ) 2k(N−k)|M|N−1 (see Robinson, 1977) ple under deterministic or sparse hypotheses spaces or peaked priors (Austerweil & Griffiths, 2011; Navarro & Perfors, 2011).”
Self-citationThink again? The amount of mental simulation tracks uncertainty in the outcome
Hamrick, J. B., Smith, K. A., Griffiths, T. L., et al. (2015) · doi:10.6084/m9.figshare.1554893.v1 · Cited by 44
Self-citationTwo Proposals for Causal Grammars
Griffiths, T. L., & Tenenbaum, J. B. (2007) · Causal Learning · doi:10.1093/acprof:oso/9780195176803.003.0021 · Cited by 43 · cited 1×
“Such representations enable humans to exploit their physical and social environments in flexible and inherently model-based ways (Dolan & Dayan, 2013; Griffiths & Tenenbaum, 2007; Sloman, 2005).”
Self-citationDoes the utility of information influence sampling behavior
Markant, D. B., & Gureckis, T. M. (2012) · eScholarship (California Digital Library) · Cited by 43
When to use which heuristic: A rational solution to the strategy selection problem
Lieder, F., & Griffiths, T. L. (2015) · eScholarship (California Digital Library) · doi:10.13140/rg.2.2.28760.42241 · Cited by 41
Self-citationActive learning strategies in a spatial concept learning game
Gureckis, T. M., & Markant, D. B. (2009) · Proceedings of the Annual Meeting of the Cognitive Science Society · Cited by 38
Category Learning Through Active Sampling
Markant, D. B., & Gureckis, T. M. (2010) · Proceedings of the Annual Meeting of the Cognitive Science Society · Cited by 34
The anchoring bias reflects rational use of cognitive resourcesPreprint
Lieder, F., Griffiths, T. L., Huys, Q. J. M., & Goodman, N. D. (2017) · PsyArXiv (OSF Preprints) · doi:10.31234/osf.io/5x2em · Cited by 33
Self-citationIntertrial interval and sequential effects in magnitude scaling.
DeCarlo, L. T. (1992) · Journal of Experimental Psychology Human Perception & Performance · doi:10.1037//0096-1523.18.4.1080 · Cited by 29 · cited 2×
“Regardless, there are a plethora of non Bayesian models that can reproduce various sequential effects (DeCarlo, 1992; Treisman & Williams, 1984; Gilden, 2001).”
Elements of a rational framework for continuous-time causal induction
Pacer, M., & Griffiths, T. L. (2012) · eScholarship (California Digital Library) · Cited by 23
Self-citationExploring the influence of particle filter parameters on order effects in causal learning
Abbott, J. T., & Griffiths, T. L. (2011) · eScholarship (California Digital Library) · Cited by 23
Self-citationWin-Stay, Lose-Sample: A Simple Sequential Algorithm for Approximating Bayesian InferencePreprint
Bonawitz, E. B., Denison, S., Alison Gopnik, C., & Griffiths, T. L. (2018) · OSF Preprints (OSF Preprints) · doi:10.31219/osf.io/pm4au · Cited by 23
Self-citationThere aren't plenty more fish in the sea: A causal network approach
Nikolic, M., & Lagnado, D. A. (2015) · British Journal of Psychology · doi:10.1111/bjop.12113 · Cited by 22 · cited 1×
“However, in tasks where people draw causal models of real-world phenomena, they often draw cyclic or reciprocal relationships (Kim & Ahn, 2002; Nikolic & Lagnado, 2015), and many real world processes are characterized by bidirectional causality, such as supply and demand in economics or homeostasis…”
Self-citationIntertrial interval and sequential effects in magnitude scaling.
DeCarlo, L. T. (1992) · Journal of Experimental Psychology Human Perception & Performance · doi:10.1037/0096-1523.18.4.1080 · Cited by 22
Recursive Causality in Bayesian Networks and Self-Fibring Networks
Williamson, J., & Gabbay, M. (2004) · Kent Academic Repository (University of Kent) · Cited by 21
A rational model of causal induction with continuous causes
Pacer, M., & Griffiths, T. L. (2011) · neural information processing systems · Cited by 21
Self-citationCourville, A. C., & Daw, N. D. (2007) · neural information processing systems · Cited by 20
Learning By Asking: How Children Ask Questions To Achieve Efficient Search
Ruggeri, A., & Lombrozo, T. (2014) · eScholarship (California Digital Library) · Cited by 18
The order of things: Inferring causal structure from temporal patterns
Bramley, N. R., Gerstenberg, T., & Lagnado, D. A. (2014) · eScholarship (California Digital Library) · doi:10.13140/2.1.1997.4089 · Cited by 16
Self-citationEdge replacement and nonindependence in causation
Buchanan, D. W., Tenenbaum, J. B., & Sobel, D. M. (2010) · eScholarship (California Digital Library) · Cited by 15
Staying afloat on Neurath's boat: Heuristics for sequential causal learning
Bramley, N. R., Dayan, P., & Lagnado, D. A. (2015) · UCL Discovery (University College London) · Cited by 11
Self-citationEstimating Human Priors on Causal Strength
Yeung, S., & Griffiths, T. L. (2011) · eScholarship (California Digital Library) · Cited by 5
Self-citationDiscovering hidden causes using statistical evidence
Lucas, C. G., Holstein, K., & Kemp, C. (2018) · eScholarship (California Digital Library) · doi:10.1184/r1/6614381 · Cited by 3
Heron, J. (2001) · SAGE Publications Ltd eBooks · doi:10.4135/9781446221167.n5 · Cited by 1
Research works printed but not linked: 8
- Ericsson, K. A., & Simon, H. A. (1980). Verbal reports as data. Psychological Review , 87 (3), 215.
- Ericsson, K. A., & Simon, H. A. (1993). Protocol analysis. Cambridge, MA: MIT Press.
- Gigerenzer, G. (2001). The adaptive toolbox. In G. Gigerenzer & R. Selten (Eds.), Bounded rationality (pp. 37-50). MIT Press.
- Lieder, F., Griffiths, T. L., Huys, Q. J. M., & Goodman, N. D. (under review). Reinterpreting anchoring-and-adjustment as rational use of cognitive resource.
- Neurath, O. (1932). Protocol statements. In Philosophical papers 1913-1946 (pp. 91-99). Springer.
- Patil, K. R., Zhu, X., Kope´ c, Ł., & Love, B. C. (2014). Optimal teaching for limitedcapacity human learners. In Advances in Neural Information Processing Systems (pp. 2465-2473).
- Pearl, J. (2000). Causality . New York: Cambridge University Press (2nd edition).
- Ullman, T., Stuhlm¨ uller, A., Goodman, N., & Tenenbaum, J. B. (2014). Learning physics from dynamical scenes. In Proceedings of the 36 th Annual Meeting of the Cognitive Science Society. Austin, TX: Cognitive Science Society.
Cited by
Lieder, F., & Griffiths, T. L. (2020) · Behavioral and Brain Sciences · doi:10.1017/s0140525x1900061x · Cited by 892
Self-citationChallenges and Future Directions of Big Data and Artificial Intelligence in Education
Luan, H., Geczy, P., Lai, H., Gobert, J., Yang, S. J. H., Ogata, H., Baltes, J., Guerra, R., Li, P., & Tsai, C.-C. (2020) · Frontiers in Psychology · doi:10.3389/fpsyg.2020.580820 · Cited by 667
“…on deploying AI in education is gradually shifting from a computational focus that demonstrates use cases of new technology to cognitive focus that incorporates cognition in its design, such as perception (VanRullen, 2017), emotion (Song et al., 2016), and cognitive thinking (Bramley et al., 2017).”
BackgroundLearning task-state representations
Niv, Y. (2019) · Nature Neuroscience · doi:10.1038/s41593-019-0470-8 · Cited by 356
Generalization guides human exploration in vast decision spaces
Wu, C. M., Schulz, E., Speekenbrink, M., Nelson, J. D., & Meder, B. (2018) · Nature Human Behaviour · doi:10.1038/s41562-018-0467-4 · Cited by 242
Contextual inference underlies the learning of sensorimotor repertoires
Heald, J. B., Lengyel, M., & Wolpert, D. M. (2021) · Nature · doi:10.1038/s41586-021-04129-3 · Cited by 238
Metadata
- Authors
- Bramley, N. R., Dayan, P., Griffiths, T. L., & Lagnado, D. A.
- Affiliations
- Gatsby Computational Neuroscience Unit (GB)
- University College London (GB)
- University of London (GB)
- Corresponding author
- Bramley, Neil R.
- Venue
- Psychological Review
- Published
- 2017-04
- Volume
- 124
- Issue
- 3
- Pages
- 301-338
- ISSN
- 0033-295X (ISSN-L)
- 1939-1471
- OpenAlex
- W2522500382
- Cited by
- 136
- References
- 138
- Citations by year
- 2026: 3 · 2025: 13 · 2024: 10 · 2023: 21 · 2022: 17 · 2021: 8 · 2020: 18 · 2019: 22 · 2018: 13 · 2017: 11
- FWCI
- 10.44
- Type
- journal article
- Language
- en
- Open access
- hybrid
- doi.org
- Locations
- Psychological Review (publishedVersion, other-oa)
- PubMed (publishedVersion)
- arXiv (Cornell University) (submittedVersion)
- UCL Discovery (University College London) (submittedVersion)
- Edinburgh Research Explorer (University of Edinburgh) (submittedVersion, other-oa)
- MPG.PuRe (Max Planck Society) (submittedVersion)
- arXiv (Cornell University)
- Funders
- University College London
- Air Force Office of Scientific Research (FA9550-13-1-0170)
- Gatsby Charitable Foundation
- Economic and Social Research Council (RES 062330004)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Bayesian Modeling and Causal Inference
- Social Sciences › Arts and Humanities › History and Philosophy of Science › Philosophy of Biology and Scientific Explanation
- Physical Sciences › Computer Science › Artificial Intelligence › Logic, Reasoning, and Knowledge
- Keywords
- causal discovery, approximate algorithms, theory change, intervention selection, philosophy of science
- MeSH terms
- Algorithms, Bayes Theorem, Cognition, Humans, Learning, Causality
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.