Information flow in context-dependent hierarchical Bayesian inference
The DOI matches its Crossref record; 20 of the 20 references it cites were found in a registry or an index.
Abstract
Recent theories developing broad notions of context and its effects on inference are becoming increasingly important in fields as diverse as cognitive psychology, information science and quantum information theory and computing. Here we introduce a novel and general approach to the characterisation of contextuality using the techniques of Chu spaces and Channel Theory viewed as general theories of information flow. This involves introducing three essential components into the formulism: events, conditions and measurement systems. Incorporating these factors in relationship to conditional probabilities leads to information flows both in the setting of Chu spaces and Channel Theory. The latter provides a representation of semantic content using local logics from which conditionals can be derived. We employ these features to construct cone-cocone diagrams, commutativity of which enforces inferential coherence. With these we build a scale-free architecture incorporating a Bayesian-like hierarchical structure, in which there is an interpretation of active inference and Markov blankets. We compare this architecture with other theories of contextuality which we briefly review. We also show that this development of ideas conveniently accommodates negative probabilities, leading to the notion of signed information flow, and address how quantum contextuality can be interpreted within this model. Finally, we relate contextuality to the Frame Problem, another way of characterising a fundamental limitation on the observational and inferential capabilities of finite agents.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
The free-energy principle: a unified brain theory?
Friston, K. (2010) · Nature Reviews Neuroscience · doi:10.1038/nrn2787 · Cited by 8,120 · cited 6×
“As Friston (2010, 2013) has emphasised, observation is not a passive process (c.f. enactive cognition, e.g., Froese & Ziemke, 2009).”
BackgroundInfluentialWhatever next? Predictive brains, situated agents, and the future of cognitive science
Clark, A. (2013) · Behavioral and Brain Sciences · doi:10.1017/s0140525x12000477 · Cited by 5,924 · cited 5×
“As Friston (2010, 2013) has emphasised, observation is not a passive process (c.f. enactive cognition, e.g., Froese & Ziemke, 2009).”
BackgroundInfluentialDual-Processing Accounts of Reasoning, Judgment, and Social Cognition
Evans, J. S. B. T. (2008) · Annual Review of Psychology · doi:10.1146/annurev.psych.59.103006.093629 · Cited by 5,137
On the Problem of Hidden Variables in Quantum Mechanics
BELL, J. S. (1966) · Reviews of Modern Physics · doi:10.1103/revmodphys.38.447 · Cited by 2,845
The Bayesian brain: The role of uncertainty in neural coding and computation
Knill, D. C., & Pouget, A. (2004) · Trends in Neurosciences · doi:10.1016/j.tins.2004.10.007 · Cited by 2,588 · cited 2×
“It is standard to view prior probabilities as ‘downward’ constraints that assemble sets of expected lower-level features; this interpretation of prior probabilities is implemented by pre-dictive-coding models (e.g., Bubic et al., 2010; Clark, 2013; Friston & Kiebel, 2009; Knill & Pouget, 2004).”
BackgroundTowards a cognitive neuroscience of consciousness: basic evidence and a workspace framework
Dehaene, S. (2001) · Cognition · doi:10.1016/s0010-0277(00)00123-2 · Cited by 2,498 · cited 2×
“At least as far as ‘heuristic solutions’ for humans go, such solutions emerge from the methodology of the massively parallel, competitively based, distributed system implemented by the GNW architecture (Dehaene & Naccache, 2001; Shanahan & Baars, 2005).”
BackgroundThe Quantum Postulate and the Recent Development of Atomic Theory1
BOHR, N. (1928) · Nature · doi:10.1038/121580a0 · Cited by 1,700 · cited 1×
“Quantum theory formalises the needed knowledge in Bohr’s notion of complementarity: observables are complementary whenever their operators do not commute (Bohr, 1928).”
BackgroundPredictive coding under the free-energy principle
Friston, K., & Kiebel, S. (2009) · Philosophical Transactions of the Royal Society B: Biological Sciences · doi:10.1098/rstb.2008.0300 · Cited by 1,579
Daselaar, S. M. (2009) · Frontiers in Human Neuroscience · doi:10.3389/neuro.09.013.2009 · Cited by 1,501
A free energy principle for the brain
Friston, K., Kilner, J., & Harrison, L. (2006) · Journal of Physiology-Paris · doi:10.1016/j.jphysparis.2006.10.001 · Cited by 1,369
Research works printed but not linked: 99
- 10.1007/s11229-011-9912-x · DOI
- Abramsky S., 2014, Lecture Notes in Computer Science 8464, 59
- 10.1103/PhysRevLett.119.050504 · DOI
- 10.1088/1367-2630/13/11/113036 · DOI · Paper page
- Adámek, J., Herrlich, H. & Strecker, G. E. (2004). Abstract and concrete categories: The joy of cats. Wiley. Retrieved May 26, 2019, from http://katmat.math.uni-bremen.de/acc
- Adams E. W., 1998, A Primer of Probabilistic Logic
- 10.1007/s11229-008-9407-6 · doi:10.1007/s11229-008-9407-6
- Allwein G., 2004, NSPW ’04: Proceedings of 2004 Workshop on New Security Paradigms (Nova Scotia, Canada, September 20-23, 2004), 23
- 10.21236/ADA420108 · doi:10.21236/ada420108
- Allwein G., 2011, Logic and Logical Philosophy, 20, 1
- Awodey S., 2010, Category Theory
- 10.1103/PhysRev.109.2198 · DOI · Paper page
- Barbosa R. S., 2019, International Conference on Quantum Physics and Logic (QPL 2019)
- 10.1007/BFb0064579 · DOI · Paper page
- 10.1017/S0960129500001274 · DOI · Paper page
- 10.1103/PhysRevLett.103.040403 · DOI · Paper page
- 10.1305/ndjfl/1039540766 · DOI
- Barwise J., 1983, Situations and Attitudes
- 10.1017/CBO9780511895968 · DOI · Paper page
- 10.1037/xge0000585 · DOI · Paper page
- 10.1103/PhysicsPhysiqueFizika.1.195 · DOI · Paper page
- Brown R., 2006, What is Category Theory?, 257
- Bubic A., 2010, Frontiers in Human Neuroscience, 4, 25
- 10.1037/dec0000095 · DOI
- 10.1007/978-94-017-7303-4_6 · DOI
- Clark A., 2017, Philosophy and predictive processing, 3, 19
- 10.3389/fpsyg.2015.00818 · DOI
- 10.1142/9789814295482_0004 · doi:10.1142/9789814295482_0004
- Cover T. M., 2006, Elements of Information Theory
- Culbertson, J. & Sturtz, K. (2013). Bayesian machine learning via category theory. arXiv:1312.1445v1[math.CT]. · arXiv
- Dennett D., 1984, Minds, machines and evolution, 129
- Dietrich E., 1996, The Robot’s Dilemma Revisited, 9
- 10.3390/a13070175 · DOI
- Döring, A. & Frembs, M. (2019). Contextuality and the fundamental theorems of quantum mechanics. arXiv:1910.09591v1[math-ph]. · arXiv
- Dretske F., 1981, Knowledge and the flow of information
- 10.1016/j.ins.2019.03.057 · DOI
- Dzhafarov E. N., 2016, Lecture notes in computer science, 9525, 12
- Dzhafarov E. N., 2017, Lecture Notes in Computer Science, 10106, 16
- 10.1098/rsta.2016.0389 · DOI · Paper page
- 10.1098/rsta.2015.0099 · DOI
- 10.1016/j.jmp.2018.06.001 · DOI
- 10.1016/j.pbiomolbio.2015.07.004 · DOI
- Ehresmann A. C., 2007, Memory evolutive systems; Hierarchy, emergence, cognition (studies in multidisciplinarity)
- 10.1088/0034-4885/77/1/016001 · DOI · Paper page
- Feynman R. P., 1987, Quantum implications: Essays in Honor of David Bohm, 235
- Feynman R. P., 1965, Feynman Lectures on Physics
- 10.1007/s00426-010-0290-7 · DOI
- Fields C., 2012, Frontiers in Psychology: Perception Science, 2, 49
- 10.1007/s10339-013-0555-3 · DOI
- 10.1080/0952813X.2012.741624 · DOI
- 10.3390/e20100797 · DOI
- 10.1080/0952813X.2018.1544282 · DOI
- 10.1080/0952813X.2018.1544285 · DOI
- 10.3390/sym12050810 · DOI
- 10.1007/s10339-020-00981-9 · DOI
- 10.1016/j.plrev.2019.08.004 · DOI
- 10.3390/quantum1020022 · DOI
- Flombaum J. I., 2008, The origins of object knowledge, 135
- 10.7551/mitpress/4737.001.0001 · DOI · Paper page
- Frembs, M. & Döring, A. (2019). No-signalling, contextuality and the arrow of time. arXiv:1910.09596v1[quant-ph]. · arXiv
- 10.1207/s15516709cog0702_3 · doi:10.1207/s15516709cog0702_3 · Paper page
- 10.1037/0003-066X.52.1.45 · doi:10.1037/0003-066x.52.1.45 · Paper page
- 10.1017/S0960129500000050 · doi:10.1017/s0960129500000050
- 10.1016/j.tcs.2006.07.051 · doi:10.1016/j.tcs.2006.07.051
- 10.1007/s10701-019-00235-5 · DOI
- 10.1080/00107514.2015.1063233 · DOI
- 10.1016/0010-0285(92)90007-O · DOI · Paper page
- 10.1007/978-1-4020-9593-1 · DOI · Paper page
- Kikuchi M., 2003, Proceedings of Society of Instrument and Control Engineers (SICE) Annual Conference 2003, 2085
- 10.1038/nature08172 · DOI · Paper page
- Kochen S., 1967, Journal of Mathematics and Mechanics, 17, 59
- Kreinovich V., 1999, 42nd Midwest Symposium on Circuits and Systems (pp. 427–430)
- 10.1007/11524564_15 · doi:10.1007/11524564_15
- 10.1016/j.plrev.2019.06.001 · DOI
- Lindvall T., 1992, Lectures on the coupling method
- McCarthy J., 1969, Machine intelligence, 4, 463 502
- McClelland J. L., 1998, Rational Models of Cognition, 21
- 10.1103/RevModPhys.65.803 · DOI · Paper page
- 10.1088/1361-6633/aae2c6 · DOI
- 10.20965/jaciii.2001.p0149 · doi:10.20965/jaciii.2001.p0149
- Nhuy N., 2001, Acta Mathematica Vietnamica, 26, 241
- Old L. J., 2001, Proceedings of the 12th Midwest Artificial Intelligence and Cognitive Science Conference, 99
- OPERA Collaboration, 2012, Journal of High-Energy Physics, 10, 093, 10.1007/JHEP10(2012)093 · doi:10.1007/jhep10(2012)093
- 10.1142/S0218488500000319 · doi:10.1142/s0218488500000319
- 10.1002/9780470746684 · DOI · Paper page
- 10.1007/BFb0015256 · DOI
- 10.1016/S1571-0661(05)80415-3 · DOI
- Pratt V., 1997, Proceedings ‘Express’97: Fourth Workshop on Expressiveness in Concurrency’, 21
- Pratt V., 1999, School on Category Theory and Applications (Coimbra 1999), Vol. 21 of Textos Mat. Sér. B, 39
- 10.1016/S0168-0072(98)00043-8 · DOI
- 10.1007/3-540-27698-X · DOI
- 10.1016/j.tics.2016.10.003 · DOI · Paper page
- Schorlemmer M., 2002, Informatics Research Report EDI-INF-RR-0134. Division of Informatics, University of Edinburgh, 2002. (see also ‘International Symposium on Artificial Intelligence and Mathematics’ AI&M 2002 (M. Golumbic et al. organizers)
- 10.1103/PhysRevA.49.1562 · doi:10.1103/physreva.49.1562
- 10.1007/978-3-642-00659-3_8 · doi:10.1007/978-3-642-00659-3_8
- van Benthem J., 2000, Logic Journal of the Interest Group in Pure and Applied Logics (IGPL), 8, 719
- 10.1016/j.tcs.2006.01.015 · DOI
- 10.1007/BFb0012800 · doi:10.1007/bfb0012800
- Zhang G.-Q., 2006, Theory and Applications of Categories, 17, 80
Cited by
Fields, C., & Levin, M. (2022) · Entropy · doi:10.3390/e24060819 · Cited by 121
Self-citationThe Physical Meaning of the Holographic Principle
Fields, C., Glazebrook, J. F., & Marcianò, A. (2022) · Quanta · doi:10.12743/quanta.v11i1.206 · Cited by 37
Self-citationQuantum formalism for the dynamics of cognitive psychology
Brody, D. C. (2023) · Scientific Reports · doi:10.1038/s41598-023-43403-4 · Cited by 13
Metadata
- Authors
- Fields, C., & Glazebrook, J. F.
- Venue
- Journal of Experimental & Theoretical Artificial Intelligence
- Publisher
- Informa UK Limited
- Published
- 2020-10-30
- Volume
- 34
- Issue
- 1
- Pages
- 111-142
- ISSN
- 0952-813X (ISSN-L)
- 1362-3079
- OpenAlex
- W3097696452
- Cited by
- 40
- References
- 20
- FWCI
- 2.37
- Type
- journal article
- Language
- en
- Open access
- closed
- Funders
- Federico and Elvia Faggin Foundation (N/A)
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Information flow in context-dependent hierarchical Bayesian inference. https://app.cochat.ai/papers/10.1080/0952813x.2020.1836034
- The paper
- Fields, C., & Glazebrook, J. F. (2022). Information flow in context-dependent hierarchical Bayesian inference. Journal of Experimental & Theoretical Artificial Intelligence. https://doi.org/10.1080/0952813x.2020.1836034
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.