The DOI matches its Crossref record.
Methods of Information Geometry
Abstract
Information geometry provides the mathematical sciences with a new framework of analysis. It has emerged from the investigation of the natural differential geometric structure on manifolds of probability distributions, which consists of a Riemannian metric defined by the Fisher information and a one-parameter family of affine connections called the \\alpha-connections. The duality between the \\alpha-connection and the (-\\alpha)-connection together with the metric play an essential role in this geometry. This kind of duality, having emerged from manifolds of probability distributions, is ubiquitous, appearing in a variety of problems which might have no explicit relation to probability theory. Through the duality, it is possible to analyze various fundamental problems in a unified perspective. The first half of this book is devoted to a comprehensive introduction to the mathematical foundation of information geometry, including preliminaries from differential geometry, the geometry of manifolds or probability distributions, and the general theory of dual affine connections. The second half of the text provides an overview of wide areas of applications, such as statistics, linear systems, information theory, quantum mechanics, convex analysis, neural networks, and affine differential geometry. The book will serve as a suitable text for a topics course for advanced undergraduates and graduate students.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cited by
Optimization Methods for Large-Scale Machine Learning
Bottou, L., Curtis, F. E., & Nocedal, J. (2018) · SIAM Review · doi:10.1137/16m1080173 · Cited by 3,128
Graphical Models, Exponential Families, and Variational Inference
Wainwright, M. J., & Jordan, M. I. (2007) · now publishers, Inc. eBooks · doi:10.1561/9781601981851 · Cited by 2,959
Adaptive Blind Signal and Image Processing: Learning Algorithms and Applications
Cichocki, A., & Amari, S. (2002) · Wiley eBooks · doi:10.1002/0470845899 · Cited by 1,863
Self-citationDataset Shift in Machine Learning
(2008) · doi:10.7551/mitpress/9780262170055.001.0001 · Cited by 1,553
Riemann manifold langevin and hamiltonian monte carlo methods
Girolami, M., & Calderhead, B. (2011) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.1467-9868.2010.00765.x · Cited by 1,473
Image Classification with the Fisher Vector: Theory and Practice
Sánchez, J., Perronnin, F., Mensink, T., & Verbeek, J. (2013) · International Journal of Computer Vision · doi:10.1007/s11263-013-0636-x · Cited by 1,498
“From the theory of information geometry (Amari and Nagaoka, 2000), a parametric family of distributions U = { u λ , λ ∈ Λ } can be regarded as a Riemanninan manifold M Λ with a local metric given by the Fisher Information Matrix (FIM) F λ ∈ R M × M : Following this observation, Jaakkola and…”
Clustering with Bregman Divergences
Banerjee, A., Merugu, S., Dhillon, I., & Ghosh, J. (2004) · Proceedings of the 2004 SIAM International Conference on Data Mining · doi:10.1137/1.9781611972740.22 · Cited by 1,472
Kernel Methods in Computational Biology
(2004) · The MIT Press eBooks · doi:10.7551/mitpress/4057.001.0001 · Cited by 1,032
CHOMP: Gradient optimization techniques for efficient motion planning
Ratliff, N., Zucker, M., Bagnell, J. A., & Srinivasa, S. (2009) · 2009 IEEE International Conference on Robotics and Automation · doi:10.1109/robot.2009.5152817 · Cited by 992
CHOMP: Covariant Hamiltonian optimization for motion planning
Zucker, M., Ratliff, N., Dragan, A. D., Pivtoraiko, M., Klingensmith, M., Dellin, C. M., Bagnell, J. A., & Srinivasa, S. S. (2013) · The International Journal of Robotics Research · doi:10.1177/0278364913488805 · Cited by 758
A Hilbert Space Embedding for Distributions
Smola, A., Gretton, A., Song, L., & Schölkopf, B. (2007) · Lecture Notes in Computer Science · doi:10.1007/978-3-540-75225-7_5 · Cited by 706
Observable Measure of Quantum Coherence in Finite Dimensional Systems
Girolami, D. (2014) · Physical Review Letters · doi:10.1103/physrevlett.113.170401 · Cited by 537
Families of Alpha- Beta- and Gamma- Divergences: Flexible and Robust Measures of Similarities
Cichocki, A., & Amari, S.-I. (2010) · Entropy · doi:10.3390/e12061532 · Cited by 459
Self-citationThe geometric foundations of Hamiltonian Monte Carlo
Betancourt, M., Byrne, S., Livingstone, S., & Girolami, M. (2017) · Bernoulli · doi:10.3150/16-bej810 · Cited by 452
Density Ratio Estimation in Machine Learning
Sugiyama, M., Suzuki, T., & Kanamori, T. (2012) · Cambridge University Press eBooks · doi:10.1017/cbo9781139035613 · Cited by 431
Fast Computation of Wasserstein Barycenters
Cuturi, M., & Arnaud Doucet, B. (2013) · arXiv (Cornell University) · doi:10.48550/arxiv.1310.4375 · Cited by 420
Principles of maximum entropy and maximum caliber in statistical physics
Pressé, S., Ghosh, K., Lee, J., & Dill, K. A. (2013) · Reviews of Modern Physics · doi:10.1103/revmodphys.85.1115 · Cited by 413
Information geometry on hierarchy of probability distributions
Amari, S.-I. (2001) · IEEE Transactions on Information Theory · doi:10.1109/18.930911 · Cited by 401
Self-citationVerdu, S. (1998) · IEEE Transactions on Information Theory · doi:10.1109/18.720531 · Cited by 316
Graph embedding discriminant analysis on Grassmannian manifolds for improved image set matching
Harandi, M. T., Sanderson, C., Shirazi, S., & Lovell, B. C. (2011) · CVPR 2011 · doi:10.1109/cvpr.2011.5995564 · Cited by 290
Parameter Space Compression Underlies Emergent Theories and Predictive Models
Machta, B. B., Chachra, R., Transtrum, M. K., & Sethna, J. P. (2013) · Science · doi:10.1126/science.1238723 · Cited by 285
Qualia: The Geometry of Integrated Information
Balduzzi, D., & Tononi, G. (2009) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1000462 · Cited by 269
Multi-parameter quantum metrology
Szczykulska, M., Baumgratz, T., & Datta, A. (2016) · Advances in Physics: X · doi:10.1080/23746149.2016.1230476 · Cited by 267
Generalized Geometric Quantum Speed Limits
Pires, D. P., Cianciaruso, M., Céleri, L. C., Adesso, G., & Soares-Pinto, D. O. (2016) · Physical Review X · doi:10.1103/physrevx.6.021031 · Cited by 265
“Information geometry, in particular, applies methods of differential geometry in order to achieve this task [46].”
MethodInformation-geometric approach to inferring causal directions
Janzing, D., Mooij, J., Zhang, K., Lemeire, J., Zscheischler, J., Daniušis, P., Steudel, B., & Schölkopf, B. (2012) · Artificial Intelligence · doi:10.1016/j.artint.2012.01.002 · Cited by 259
Relating neuronal firing patterns to functional differentiation of cerebral cortex.
Shinomoto, S., Kim, H., Shimokawa, T., Matsuno, N., Funahashi, S., Shima, K., Fujita, I., Tamura, H., Doi, T., Kawano, K., et al. (2009) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1000433 · Cited by 239
Measuring Integrated Information from the Decoding Perspective
Oizumi, M., Amari, S.-I., Yanagawa, T., Fujii, N., & Tsuchiya, N. (2016) · PLOS Computational Biology · doi:10.1371/journal.pcbi.1004654 · Cited by 184
Surface/state correspondence as a generalized holography
Miyaji, M., & Takayanagi, T. (2015) · Progress of Theoretical and Experimental Physics · doi:10.1093/ptep/ptv089 · Cited by 184
“[43, 44, 45]):”
BackgroundThe free energy principle made simpler but not too simple
Friston, K., Da Costa, L., Sajid, N., Heins, C., Ueltzhöffer, K., Pavliotis, G. A., & Parr, T. (2023) · Physics Reports · doi:10.1016/j.physrep.2023.07.001 · Cited by 163
Spectral Entropies as Information-Theoretic Tools for Complex Network Comparison
De Domenico, M., & Biamonte, J. (2016) · Physical Review X · doi:10.1103/physrevx.6.041062 · Cited by 160
Towards a neuronal gauge theory
Sengupta, B., Tozzi, A., Cooray, G. K., Douglas, P. K., & Friston, K. J. (2016) · PLOS Biology · doi:10.1371/journal.pbio.1002400 · Cited by 132
Wigner–Yanase information on quantum state space: The geometric approach
Gibilisco, P., & Isola, T. (2003) · Journal of Mathematical Physics · doi:10.1063/1.1598279 · Cited by 105
Consistency and fluctuations for stochastic gradient Langevin dynamics
(2016) · Warwick Research Archive Portal (University of Warwick) · doi:10.5555/2946645.2946652 · Cited by 104
A Plug&Play P300 BCI Using Information Geometry
Barachant, A., & Congedo, M. (2014) · arXiv · doi:10.48550/arxiv.1409.0107 · Cited by 102
EEG-Based User Reaction Time Estimation Using Riemannian Geometry Features
Wu, D., Lance, B. J., Lawhern, V. J., Gordon, S., Jung, T.-P., & Lin, C.-T. (2017) · IEEE Transactions on Neural Systems and Rehabilitation Engineering · doi:10.1109/tnsre.2017.2699784 · Cited by 64
Escort evolutionary game theory
Harper, M. (2011) · Physica D: Nonlinear Phenomena · doi:10.1016/j.physd.2011.04.008 · Cited by 51
Geometric robustness theory and biological networks
AY, N., & KRAKAUER, D. (2006) · Theory in Biosciences · doi:10.1016/j.thbio.2006.06.002 · Cited by 45
A Distributional Approach to Controlled Text Generation
Khalifa, M., Elsahar, H., & Dymetman, M. (2020) · arXiv · doi:10.48550/arxiv.2012.11635 · Cited by 39
“We follow Csiszár & Shields (2004) on this question, a problem that is at the core of the field of Information Geometry (Nielsen, 2018; Amari & Nagaoka, 2000).”
BackgroundUnivariate time series classification using information geometry
Sun, J., Yang, Y., Liu, Y., Chen, C., Rao, W., & Bai, Y. (2019) · Pattern Recognition · doi:10.1016/j.patcog.2019.05.040 · Cited by 31
Da Costa, L., Seth, A. K., Friston, K., Ramstead, M. J. D., & Sandved-Smith, L. (2026) · Neuroscience of Consciousness · doi:10.1093/nc/niag026 · Cited by 3
Metadata
- Authors
- Amari, S.-I., & Nagaoka, H.
- Venue
- Translations of Mathematical Monographs
- Publisher
- American Mathematical Society
- Published
- 2007-04-13
- ISSN
- 0065-9282 (ISSN-L)
- 2472-5137
- OpenAlex
- W1573082642
- Cited by
- 2,204
- References
- 0
- FWCI
- 90.82
- Type
- book
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.