The DOI matches its Crossref record; 79 of the 79 references it cites were found in a registry or an index.
A Tutorial on Fisher information
Open accessAbstract
In many statistical applications that concern mathematical psychologists, the concept of Fisher information plays an important role. In this tutorial we clarify the concept of Fisher information as it manifests itself across three different statistical paradigms. First, in the frequentist paradigm, Fisher information is used to construct hypothesis tests and confidence intervals using maximum likelihood estimators; second, in the Bayesian paradigm, Fisher information is used to define a default prior; lastly, in the minimum description length paradigm, Fisher information is used to measure model complexity.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
A Mathematical Theory of Communication
Shannon, C. E. (1948) · Bell System Technical Journal · doi:10.1002/j.1538-7305.1948.tb01338.x · Cited by 88,486
A new look at the statistical model identification
Akaike, H. (1974) · IEEE Transactions on Automatic Control · doi:10.1109/tac.1974.1100705 · Cited by 51,879
Estimating the Dimension of a Model
Schwarz, G. (1978) · The Annals of Statistics · doi:10.1214/aos/1176344136 · Cited by 47,033
Model selection and multimodel inference: a practical information-theoretic approach.
Guthery, F. S., Burnham, K. P., & Anderson, D. R. (2003) · The Journal of Wildlife Management · doi:10.2307/3802723 · Cited by 41,495
Elements of Information Theory
Cover, T. M., & Thomas, J. A. (2001) · Wiley eBooks · doi:10.1002/0471200611 · Cited by 36,808
Ratcliff, R. (1978) · Psychological Review · doi:10.1037/0033-295x.85.2.59 · Cited by 4,513
Vaart, A. W. V. D. (1998) · doi:10.1017/cbo9780511802256 · Cited by 4,159
Maximum Likelihood Estimation of Misspecified Models
White, H. (1982) · Econometrica · doi:10.2307/1912526 · Cited by 4,098
On the mathematical foundations of theoretical statistics
Fisher, R. A. (1922) · Philosophical Transactions of the Royal Society of London. Series A, Containing Papers of a Mathematical or Physical Character · doi:10.1098/rsta.1922.0009 · Cited by 4,039
On Measures of Entropy and Information
Rényi, A. (1961) · Project Euclid (Cornell University) · Cited by 4,031
Interval Estimation for a Binomial Proportion
Brown, L. D., Cai, T. T., & DasGupta, A. (2001) · Statistical Science · doi:10.1214/ss/1009213286 · Cited by 3,538
Stevens, S. S. (1957) · Psychological Review · doi:10.1037/h0046162 · Cited by 3,361
Stastical Decision Theory and Bayesian Analysis.
Ghosh, M., & Berger, J. (1988) · Journal of the American Statistical Association · doi:10.2307/2288950 · Cited by 2,905
Theory of Statistical Estimation
Fisher, R. A. (1925) · Mathematical Proceedings of the Cambridge Philosophical Society · doi:10.1017/s0305004100009580 · Cited by 2,869
An invariant form for the prior probability in estimation problems
Jeffreys, H. (1946) · Proceedings of the Royal Society of London. Series A. Mathematical and Physical Sciences · doi:10.1098/rspa.1946.0056 · Cited by 2,323
Statistical Decision Functions
Wald, A. (1949) · The Annals of Mathematical Statistics · doi:10.1214/aoms/1177730030 · Cited by 2,176
Information and the Accuracy Attainable in the Estimation of Statistical Parameters
Rao, C. R. (1992) · Springer Series in Statistics · doi:10.1007/978-1-4612-0919-5_16 · Cited by 1,808
Tutorial on maximum likelihood estimation
Myung, I. J. (2003) · Journal of Mathematical Psychology · doi:10.1016/s0022-2496(02)00028-7 · Cited by 1,802
The Minimum Description Length Principle
Grünwald, P. D. (2007) · doi:10.7551/mitpress/4643.001.0001 · Cited by 1,644
Riemann manifold langevin and hamiltonian monte carlo methods
Girolami, M., & Calderhead, B. (2011) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.1467-9868.2010.00765.x · Cited by 1,473
Efficient and Adaptive Estimation for Semiparametric Models.
Do, K. A., Bickel, P. J., Klaassen, C. A. J., Ritov, Y., & Wellner, J. A. (1994) · Biometrics · doi:10.2307/2533465 · Cited by 1,403
Parameter Orthogonality and Approximate Conditional Inference
Cox, D. R., & Reid, N. (1987) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1987.tb01422.x · Cited by 1,366
(2013) · Cited by 1,351
The History of Statistics: The Measurement of Uncertainty before 1900
Stigler, S. M. (1986) · Medical Entomology and Zoology · Cited by 1,146
Mixtures of g Priors for Bayesian Variable Selection
Liang, F., Paulo, R., Molina, G., Clyde, M. A., & Berger, J. O. (2008) · Journal of the American Statistical Association · doi:10.1198/016214507000001337 · Cited by 1,089
How persuasive is a good fit? A comment on theory testing.
Roberts, S., & Pashler, H. (2000) · Psychological Review · doi:10.1037//0033-295x.107.2.358 · Cited by 875
Fisher information and stochastic complexity
Rissanen, J. J. (1996) · IEEE Transactions on Information Theory · doi:10.1109/18.481776 · Cited by 814
Theoretical and empirical review of multinomial process tree modeling
Batchelder, W. H., & Riefer, D. M. (1999) · Psychonomic Bulletin & Review · doi:10.3758/bf03210812 · Cited by 619
Tribus, M., & McIrvine, E. C. (1971) · Scientific American · doi:10.1038/scientificamerican0971-179 · Cited by 607
Kotz, S., Kozubowski, T. J., & Podgórski, K. (2001) · Cited by 592
Toward a method of selecting among computational models of cognition.
Pitt, M. A., Myung, I. J., & Zhang, S. (2002) · Psychological Review · doi:10.1037//0033-295x.109.3.472 · Cited by 506
Asymptotics in statistics : some basic concepts
Cam, L. M. L., & Yang, G. L. (1990) · Springer eBooks · Cited by 444
001: On an Absolute Criterion for Fitting Frequency Curves.
Fisher, R. A. (1912) · Adelaide Research & Scholarship (AR&S) (University of Adelaide) · Cited by 393
Ly, A., Verhagen, J., & Wagenmakers, E.-J. (2016) · Journal of Mathematical Psychology · doi:10.1016/j.jmp.2015.06.004 · Cited by 384
Self-citationInconsistency of Bayesian Inference for Misspecified Linear Models, and a Proposal for Repairing It
Grünwald, P., & van Ommen, T. (2017) · Bayesian Analysis · doi:10.1214/17-ba1085 · Cited by 373
LOCAL ASYMPTOTIC MINIMAX AND ADMISSIBILITY IN ESTIMATION
Häjek, J. (1972) · Theory of Statistics · doi:10.1525/9780520325883-012 · Cited by 309
Criteria for Bayesian model choice with application to variable selection
Bayarri, M. J., Berger, J. O., Forte, A., & García-Donato, G. (2012) · The Annals of Statistics · doi:10.1214/12-aos1013 · Cited by 293
A characterization of limiting distributions of regular estimates
H�jek, J. (1970) · Probability Theory and Related Fields · doi:10.1007/bf00533669 · Cited by 281
Fisher, R. A. (1920) · Monthly Notices of the Royal Astronomical Society · doi:10.1093/mnras/80.8.758 · Cited by 279
Burbea, J., & Rao, C. R. (1982) · Journal of Multivariate Analysis · doi:10.1016/0047-259x(82)90065-3 · Cited by 274
Analytic posteriors for Pearson's correlation coefficient
Ly, A., Marsman, M., & Wagenmakers, E. (2018) · Statistica Neerlandica · doi:10.1111/stan.12111 · Cited by 267
Self-citationOn the Assumptions Used to Prove Asymptotic Normality of Maximum Likelihood Estimates
LeCam, L. M. (1970) · The Annals of Mathematical Statistics · doi:10.1214/aoms/1177696960 · Cited by 261
The Geometry of Asymptotic Inference
Kass, R. E. (1989) · Statistical Science · doi:10.1214/ss/1177012480 · Cited by 211
Two inequalities implied by unique decipherability
McMillan, B. (1956) · IEEE Transactions on Information Theory · doi:10.1109/tit.1956.1056818 · Cited by 203
Harold Jeffreys’s Theory of Probability Revisited
Robert, C. P., Chopin, N., & Rousseau, J. (2009) · Statistical Science · doi:10.1214/09-sts284 · Cited by 170
Kass, R. E., & Vaidyanathan, S. K. (1992) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1992.tb01868.x · Cited by 168
Counting probability distributions: Differential geometry and model selection
Myung, I. J., Balasubramanian, V., & Pitt, M. A. (2000) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.170283897 · Cited by 163
Model selection by normalized maximum likelihood
Myung, J. I., Navarro, D., & Pitt, M. A. (2005) · Journal of Mathematical Psychology · doi:10.1016/j.jmp.2005.06.008 · Cited by 154
Gronau, Q. F., Ly, A., & Wagenmakers, E.-J. (2020) · The American Statistician · doi:10.1080/00031305.2018.1562983 · Cited by 150
Self-citationXLII. On certain fundamental principles of scientific inquiry
Wrinch, D. M., & Jeffreys, H. (1921) · The London Edinburgh and Dublin Philosophical Magazine and Journal of Science · doi:10.1080/14786442108633773 · Cited by 143
van Erven, T., Grünwald, P., & de Rooij, S. (2012) · Journal of the Royal Statistical Society Series B (Statistical Methodology) · doi:10.1111/j.1467-9868.2011.01025.x · Cited by 111
Accumulative prediction error and the selection of time series models
Wagenmakers, E., Grünwald, P., & Mark Steyvers, B. (2006) · Journal of Mathematical Psychology · doi:10.1016/j.jmp.2006.01.004 · Cited by 106
Self-citationMixtures of g -Priors in Generalized Linear Models
Li, Y., & Clyde, M. A. (2018) · Journal of the American Statistical Association · doi:10.1080/01621459.2018.1469992 · Cited by 101
Separation of storage and retrieval factors in free recall of clusterable pairs.
Batchelder, W. H., & Riefer, D. M. (1980) · Psychological Review · doi:10.1037/0033-295x.87.4.375 · Cited by 92
The Minimum Description Length Principle and Reasoning under Uncertainty
Grünwald, P. (1998) · Cited by 81
The semiparametric Bernstein–von Mises theorem
Bickel, P. J., & Kleijn, B. (2012) · The Annals of Statistics · doi:10.1214/11-aos921 · Cited by 72
LXXV. On some aspects of the theory of probability
Wrinch, D. M., & Jeffreys, H. (1919) · The London Edinburgh and Dublin Philosophical Magazine and Journal of Science · doi:10.1080/14786441208636005 · Cited by 70
A history of parametric statistical inference from Bernoulli to Fisher, 1713-1935
(2007) · Choice Reviews Online · doi:10.5860/choice.44-6209 · Cited by 64
Accelerating Metropolis-Hastings algorithms by Delayed Acceptance
Banterle, M., Grazian, C., Lee, A., & Robert, C. P. (2019) · Foundations of Data Science · doi:10.3934/fods.2019005 · Cited by 59
The expected demise of the Bayes factor
Robert, C. P. (2015) · Journal of Mathematical Psychology · doi:10.1016/j.jmp.2015.08.002 · Cited by 51
Statistical Tests for Comparing Possibly Misspecified and Nonnested Models
Golden, R. M. (2000) · Journal of Mathematical Psychology · doi:10.1006/jmps.1999.1281 · Cited by 49
An evaluation of alternative methods for testing hypotheses, from the perspective of Harold Jeffreys
Ly, A., Verhagen, J., & Wagenmakers, E. (2016) · Journal of Mathematical Psychology · doi:10.1016/j.jmp.2016.01.003 · Cited by 49
Self-citationThe statistical work of Lucien Le Cam
van der Vaart, A. (2002) · The Annals of Statistics · doi:10.1214/aos/1028674836 · Cited by 47
Further Comments on Some Comments on a Paper by Bradley Efron
Dawid, A. P. (1977) · The Annals of Statistics · doi:10.1214/aos/1176344011 · Cited by 42
Minimum description length model selection of multinomial processing tree models
Wu, H., Myung, J. I., & Batchelder, W. H. (2010) · Psychonomic Bulletin & Review · doi:10.3758/pbr.17.3.275 · Cited by 41
Klauer, K. C., & Kellen, D. (2011) · Journal of Mathematical Psychology · doi:10.1016/j.jmp.2011.09.002 · Cited by 37
Effective connectivity of fMRI data using ancestral graph theory: Dealing with missing regions
Waldorp, L., Christoffels, I. K., & van de Ven, V. G. (2010) · NeuroImage · doi:10.1016/j.neuroimage.2010.10.054 · Cited by 33
XXXVII. On certain fundamental principles of scientific inquiry. (Second Paper)
Wrinch, D., & Jeffreys, H. (1923) · The London Edinburgh and Dublin Philosophical Magazine and Journal of Science · doi:10.1080/14786442308634125 · Cited by 31
Heck, D. W., Moshagen, M., & Erdfelder, E. (2014) · Journal of Mathematical Psychology · doi:10.1016/j.jmp.2014.06.002 · Cited by 29
Making Correct Statistical Inferences Using a Wrong Probability Model
Golden, R. M. (1995) · Journal of Mathematical Psychology · doi:10.1006/jmps.1995.1002 · Cited by 26
Fast Rates with Unbounded Losses.
Grünwald, P., & Mehta, N. A. (2016) · Centrum Wiskunde & Informatica (CWI), the national research institute for mathematics and computer science in the Netherlands · Cited by 20
Waldorp, L. (2009) · International Journal of Biomedical Imaging · doi:10.1155/2009/723912 · Cited by 15
The Statistical Education of Harold Jeffreys
Aldrich, J. (2006) · International Statistical Review · doi:10.1111/j.1751-5823.2005.tb00150.x · Cited by 12
Informed Bayesian T-TestsPreprint
Gronau, Q. F., Ly, A., & Wagenmakers, E. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1704.02479 · Cited by 10
Self-citationMinimax theory for a class of nonlinear statistical inverse problems
Ray, K., & Schmidt-Hieber, J. (2016) · Inverse Problems · doi:10.1088/0266-5611/32/6/065003 · Cited by 9
Waldorp, L., Huizenga, H. M., & Grasman, R. P. P. P. (2005) · IEEE Transactions on Signal Processing · doi:10.1109/tsp.2005.853213 · Cited by 8
Self-citationLuckiness and Regret in Minimum Description Length Inference
de Rooij, S., & Grünwald, P. (2011) · Elsevier eBooks · doi:10.1016/b978-0-444-51862-0.50029-0 · Cited by 8
Approximate integrated likelihood via ABC methods
Grazian, C., & Liseo, B. (2015) · Statistics and Its Interface · doi:10.4310/sii.2015.v8.n2.a4 · Cited by 8
Four Requirements for an Acceptable Research Program
Marsman, M., Ly, A., & Wagenmakers, E. (2016) · Basic and Applied Social Psychology · doi:10.1080/01973533.2016.1221349 · Cited by 8
Self-citation
Cited by
Hoefler, T., Alistarh, D., Ben-Nun, T., Dryden, N., & Peste, A. (2021) · ETH Zurich · doi:10.3929/ethz-b-000519202 · Cited by 423
Ly, A., Verhagen, J., & Wagenmakers, E.-J. (2016) · Journal of Mathematical Psychology · doi:10.1016/j.jmp.2015.06.004 · Cited by 384
Self-citationCombustion machine learning: Principles, progress and prospects
Ihme, M., Chung, W. T., & Mishra, A. A. (2022) · Progress in Energy and Combustion Science · doi:10.1016/j.pecs.2022.101010 · Cited by 265
The Right to be Forgotten in Federated Learning: An Efficient Realization with Rapid Retraining
Liu, Y., Xu, L., Yuan, X., Wang, C., & Li, B. (2022) · IEEE INFOCOM 2022 - IEEE Conference on Computer Communications · doi:10.1109/infocom48880.2022.9796721 · Cited by 202
Aslam, S., Rasool, A., Li, X., & Wu, H. (2025) · Interdisciplinary Sciences: Computational Life Sciences · doi:10.1007/s12539-024-00675-2 · Cited by 23
Metadata
- Authors
- Ly, A., Marsman, M., Verhagen, J., Grasman, R. P. P. P., & Wagenmakers, E.-J.
- Venue
- Journal of Mathematical Psychology
- Publisher
- Elsevier BV
- Published
- 2017-10
- Volume
- 80
- Pages
- 40-55
- ISSN
- 0022-2496 (ISSN-L)
- OpenAlex
- W2610335526
- Cited by
- 274
- References
- 79
- FWCI
- 9.99
- Type
- journal article
- Language
- en
- Open access
- bronze
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.