An invariant form for the prior probability in estimation problems
The DOI matches its Crossref record.
Abstract
It is shown that a certain differential form depending on the values of the parameters in a law of chance is invariant for all transformations of the parameters when the law is differentiable with regard to all parameters. For laws containing a location and a scale parameter a form with a somewhat restricted type of invariance is found even when the law is not everywhere differentiable with regard to the parameters. This form has the properties required to give a general rule for stating the prior probability in a large class of estimation problems.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cited by
Divergence measures based on the Shannon entropy
Lin, J. (1991) · IEEE Transactions on Information Theory · doi:10.1109/18.61115 · Cited by 5,140
Bias reduction of maximum likelihood estimates
FIRTH, D. (1993) · Biometrika · doi:10.1093/biomet/80.1.27 · Cited by 5,035
Bayesian Coalescent Inference of Past Population Dynamics from Molecular Sequences
Drummond, A. J. (2005) · Molecular Biology and Evolution · doi:10.1093/molbev/msi103 · Cited by 3,143
The Divergence and Bhattacharyya Distance Measures in Signal Selection
Kailath, T. (1967) · IEEE Transactions on Communications · doi:10.1109/tcom.1967.1089532 · Cited by 1,856
Axiomatic derivation of the principle of maximum entropy and the principle of minimum cross-entropy
Shore, J., & Johnson, R. (1980) · IEEE Transactions on Information Theory · doi:10.1109/tit.1980.1056144 · Cited by 1,774
(2003) · Cited by 1,680
Aleatoric and epistemic uncertainty in machine learning: an introduction to concepts and methods
Hüllermeier, E., & Waegeman, W. (2021) · Machine Learning · doi:10.1007/s10994-021-05946-3 · Cited by 1,834
“See work on “non-informative” priors, however (Jeffreys, 1946; Bernardo, 1979). dominated probability distributions: P ..= { P ∈ P”
BackgroundMathematical Foundations of Information Theory.
Snell, J. L., Khinchin, A. I., Silverman, R. A., & Friedman, M. D. (1959) · The American Mathematical Monthly · doi:10.2307/2310044 · Cited by 1,451
The Selection of Prior Distributions by Formal Rules
Kass, R. E., & Wasserman, L. (1996) · Journal of the American Statistical Association · doi:10.1080/01621459.1996.10477003 · Cited by 1,308
Texture analysis of SAR sea ice imagery using gray level co-occurrence matrices
Soh, L.-K., & Tsatsoulis, C. (1999) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/36.752194 · Cited by 1,223
Ackermann, M., Albert, A., Anderson, B., Atwood, W. B., Baldini, L., Barbiellini, G., Bastieri, D., Bechtol, K., Bellazzini, R., Bissaldi, E., et al. (2015) · Physical Review Letters · doi:10.1103/physrevlett.115.231301 · Cited by 1,116
Reference Posterior Distributions for Bayesian Inference
Bernardo, J. M. (1979) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1979.tb01066.x · Cited by 1,095
Penalising Model Component Complexity: A Principled, Practical Approach to Constructing Priors
Simpson, D., Rue, H., Riebler, A., Martins, T. G., & Sørbye, S. H. (2017) · Statistical Science · doi:10.1214/16-sts576 · Cited by 1,085
Drummond, A. J., Nicholls, G. K., Rodrigo, A. G., & Solomon, W. (2002) · Genetics · doi:10.1093/genetics/161.3.1307 · Cited by 1,059
Random Matrix Methods for Wireless Communications
Couillet, R., & Debbah, M. (2011) · Cambridge University Press eBooks · doi:10.1017/cbo9780511994746 · Cited by 966
Bayesian inference of population size history from multiple loci
Heled, J., & Drummond, A. J. (2008) · BMC Evolutionary Biology · doi:10.1186/1471-2148-8-289 · Cited by 738
Effects of Distance Measure Choice on K-Nearest Neighbor Classifier Performance: A Review
Abu Alfeilat, H. A., Hassanat, A. B. A., Lasassmeh, O., Tarawneh, A. S., Alhasanat, M. B., Eyal Salman, H. S., & Prasath, V. B. S. (2019) · Big Data · doi:10.1089/big.2018.0175 · Cited by 667
Scaling Policy Preferences from Coded Political Texts
LOWE, W., BENOIT, K., MIKHAYLOV, S., & LAVER, M. (2011) · Legislative Studies Quarterly · doi:10.1111/j.1939-9162.2010.00006.x · Cited by 651
Domain Adaptation Problems: A DASVM Classification Technique and a Circular Validation Strategy
Bruzzone, L., & Marconcini, M. (2010) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2009.57 · Cited by 591
Bayes factor approaches for testing interval null hypotheses.
Morey, R. D., & Rouder, J. N. (2011) · Psychological Methods · doi:10.1037/a0024377 · Cited by 582
Jones, M., & Love, B. C. (2011) · Behavioral and Brain Sciences · doi:10.1017/s0140525x10003134 · Cited by 533
The human gut microbiome as a screening tool for colorectal cancer
Zackular, J. P., Rogers, M. A. M., Ruffin, M. T., & Schloss, P. D. (2014) · Cancer Prevention Research · doi:10.1158/1940-6207.capr-14-0129 · Cited by 551
“1 to each cell and calculated the likelihood ratio of a positive test and the 95% confidence intervals (CI) using Jeffreys’ Bayesian credible interval (36).”
MethodDealing with uncertainty in model updating for damage assessment: a review
Simoen, E., De Roeck, G., & Lombaert, G. (2015) · Mechanical Systems and Signal Processing · doi:10.1016/j.ymssp.2014.11.001 · Cited by 540
Bayesian Evolutionary Analysis with BEAST
Drummond, A. J., & Bouckaert, R. R. (2015) · Cambridge University Press eBooks · doi:10.1017/cbo9781139095112 · Cited by 527
Imputation-Based Analysis of Association Studies: Candidate Regions and Quantitative Traits
Servin, B., & Stephens, M. (2007) · PLoS Genetics · doi:10.1371/journal.pgen.0030114 · Cited by 515
Families of Alpha- Beta- and Gamma- Divergences: Flexible and Robust Measures of Similarities
Cichocki, A., & Amari, S.-I. (2010) · Entropy · doi:10.3390/e12061532 · Cited by 459
Nonlinear Unmixing of Hyperspectral Images Using a Generalized Bilinear Model
Halimi, A., Altmann, Y., Dobigeon, N., & Tourneret, J.-Y. (2011) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2010.2098414 · Cited by 443
Merhav, N., & Feder, M. (1998) · IEEE Transactions on Information Theory · doi:10.1109/18.720534 · Cited by 438
On the convexity of some divergence measures based on entropy functions
Burbea, J., & Rao, C. (1982) · IEEE Transactions on Information Theory · doi:10.1109/tit.1982.1056497 · Cited by 423
Abbott, R., Abbott, T. D., Abraham, S., Acernese, F., Ackley, K., Adams, A., Adams, C., Adhikari, R. X., Adya, V. B., Affeldt, C., et al. (2021) · Physical Review D · doi:10.1103/physrevd.104.022004 · Cited by 415
Principles of maximum entropy and maximum caliber in statistical physics
Pressé, S., Ghosh, K., Lee, J., & Dill, K. A. (2013) · Reviews of Modern Physics · doi:10.1103/revmodphys.85.1115 · Cited by 413
Non-parametric Roughness Penalty for Probability Densities
GOOD, I. J. (1971) · Nature Physical Science · doi:10.1038/physci229029a0 · Cited by 411
The formal definition of reference priors
Berger, J. O., Bernardo, J. M., & Sun, D. (2009) · The Annals of Statistics · doi:10.1214/07-aos587 · Cited by 399
Maximum Entropy for Hypothesis Formulation, Especially for Multidimensional Contingency Tables
Good, I. J. (1963) · The Annals of Mathematical Statistics · doi:10.1214/aoms/1177704014 · Cited by 392
Shibata, T., Kawakami, S., Noguchi, T., Tanaka, T., Asaumi, Y., Kanaya, T., Nagai, T., Nakao, K., Fujino, M., Nagatsuka, K., et al. (2015) · Circulation · doi:10.1161/circulationaha.114.015134 · Cited by 389
Ly, A., Verhagen, J., & Wagenmakers, E.-J. (2016) · Journal of Mathematical Psychology · doi:10.1016/j.jmp.2015.06.004 · Cited by 384
Altitudinal Changes in Malaria Incidence in Highlands of Ethiopia and Colombia
Siraj, A. S., Santos-Vega, M., Bouma, M. J., Yadeta, D., Carrascal, D. R., & Pascual, M. (2014) · Science · doi:10.1126/science.1244325 · Cited by 363
Akaike, H. (1985) · A Celebration of Statistics · doi:10.1007/978-1-4613-8560-8_1 · Cited by 360
Hausser, J., & Strimmer, K. (2008) · arXiv (Cornell University) · doi:10.48550/arxiv.0811.3579 · Cited by 356
The philosophy of Bayes factors and the quantification of statistical evidence
Morey, R. D., Romeijn, J.-W., & Rouder, J. N. (2016) · Journal of Mathematical Psychology · doi:10.1016/j.jmp.2015.11.001 · Cited by 313
Bayesian Random-Effects Meta-Analysis Using the bayesmeta R Package
Röver, C. (2020) · Journal of Statistical Software · doi:10.18637/jss.v093.i06 · Cited by 310
“…the uninformative prior for a scale parameter in a simple normal model is commonly taken to be uniform in log(τ) (and log(τ2)) with density p(τ) ∝ 1τ (Jeffreys 1946; Gelman et al. 2014), however, this “log-uniform” prior will not lead to proper, integrable posteriors in the present context…”
BackgroundInfluentialAnalysis and Design of Echo State Networks
Ozturk, M. C., Xu, D., & Príncipe, J. C. (2007) · Neural Computation · doi:10.1162/neco.2007.19.1.111 · Cited by 308
On the formation history of Galactic double neutron stars
Vigna-Gómez, A., Neijssel, C. J., Stevenson, S., Barrett, J. W., Belczynski, K., Justham, S., de Mink, S. E., Müller, B., Podsiadlowski, P., Renzo, M., et al. (2018) · Monthly Notices of the Royal Astronomical Society · doi:10.1093/mnras/sty2463 · Cited by 298
Machine Learning in Materials Science: Recent Progress and Emerging Applications
Mueller, T., Kusne, A. G., & Ramprasad, R. (2016) · Reviews in Computational Chemistry · doi:10.1002/9781119148739.ch4 · Cited by 295
A tutorial introduction to the minimum description length principle
Grunwald, P. (2004) · arXiv · doi:10.48550/arxiv.math/0406077 · Cited by 293
Sason, I., & Verdu, S. (2016) · IEEE Transactions on Information Theory · doi:10.1109/tit.2016.2603151 · Cited by 292
Parameter Space Compression Underlies Emergent Theories and Predictive Models
Machta, B. B., Chachra, R., Transtrum, M. K., & Sethna, J. P. (2013) · Science · doi:10.1126/science.1238723 · Cited by 285
Inductive biases for deep learning of higher-level cognition
Goyal, A., & Bengio, Y. (2022) · Proceedings of the Royal Society A: Mathematical, Physical and Engineering Sciences · doi:10.1098/rspa.2021.0068 · Cited by 300
Noninformative priors for one parameter of many
TIBSHIRANI, R. (1989) · Biometrika · doi:10.1093/biomet/76.3.604 · Cited by 283
A Solution to Separation in Binary Response Models
Zorn, C. (2005) · Political Analysis · doi:10.1093/pan/mpi009 · Cited by 280
Smid, S. C., McNeish, D., Miočević, M., & van de Schoot, R. (2020) · Structural Equation Modeling: A Multidisciplinary Journal · doi:10.1080/10705511.2019.1577140 · Cited by 280
Planck 2015 results: X. Diffuse component separation: Foreground maps
Planck Collaboration, Adam, R., Ade, P. A. R., Aghanim, N., Alves, M. I. R., Arnaud, M., Ashdown, M., Aumont, J., Baccigalupi, C., Banday, A. J., et al. (2016) · Astronomy & Astrophysics · doi:10.1051/0004-6361/201525967 · Cited by 278
A Tutorial on Fisher information
Ly, A., Marsman, M., Verhagen, J., Grasman, R. P. P. P., & Wagenmakers, E.-J. (2017) · Journal of Mathematical Psychology · doi:10.1016/j.jmp.2017.05.006 · Cited by 274
Bayesian coherent analysis of in-spiral gravitational wave signals with a detector network
Veitch, J., & Vecchio, A. (2010) · Physical Review D · doi:10.1103/physrevd.81.062003 · Cited by 271
Yang, Q., Zhang, Y., Dai, W., & Pan, S. J. (2020) · Cambridge University Press eBooks · doi:10.1017/9781139061773 · Cited by 254
Toward Optimal Feature Selection in Naive Bayes for Text Categorization
Tang, B., Kay, S., & He, H. (2016) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2016.2563436 · Cited by 253
Liepe, J., Kirk, P., Filippi, S., Toni, T., Barnes, C. P., & Stumpf, M. P. H. (2014) · Nature Protocols · doi:10.1038/nprot.2014.025 · Cited by 217
A multi-tissue full lifespan epigenetic clock for mice
Thompson, M. J., Chwiałkowska, K., Rubbi, L., Lusis, A. J., Davis, R. C., Srivastava, A., Korstanje, R., Churchill, G. A., Horvath, S., & Pellegrini, M. (2018) · Aging · doi:10.18632/aging.101590 · Cited by 203
The use of Bayesian priors in Ecology: The good, the bad and the not great
Banner, K. M., Irvine, K. M., & Rodhouse, T. J. (2020) · Methods in Ecology and Evolution · doi:10.1111/2041-210x.13407 · Cited by 135
“Invariance with respect to transformations is often true for Jeffreys' priors (Jeffreys, 1946), but there are some cases (albeit somewhat unrealistic) where the Jeffreys' prior does not remain non-informative (i.e. Tuyl, Gerlach, & Mengersen, 2012, Beta-Binomial models when the observed data are…”
MethodInfluentialParameter uncertainty in biochemical models described by ordinary differential equations
Vanlier, J., Tiemann, C. A., Hilbers, P. A. J., & van Riel, N. A. W. (2013) · Mathematical Biosciences · doi:10.1016/j.mbs.2013.03.006 · Cited by 116
“The latter is usually accomplished either by choosing wide priors (such as gamma priors for parameters with only positive support [38]) or priors that exhibit invariance to parameter transformation [52].”
BackgroundIntegrating Probability and Nonprobability Samples for Survey Inference
Wiśniowski, A., Sakshaug, J. W., Perez Ruiz, D. A., & Blom, A. G. (2020) · Journal of Survey Statistics and Methodology · doi:10.1093/jssam/smz051 · Cited by 102
Additionality in U.S. Agricultural Conservation Programs
Claassen, R., Duquette, E. N., & Smith, D. J. (2018) · Land Economics · doi:10.3368/le.94.1.19 · Cited by 73
An integrated strategy for prediction uncertainty analysis
Vanlier, J., Tiemann, C. A., Hilbers, P. A. J., & van Riel, N. A. W. (2012) · Bioinformatics · doi:10.1093/bioinformatics/bts088 · Cited by 67
Das, J., & Umamahesh, N. V. (2017) · Journal of Hydrologic Engineering · doi:10.1061/(asce)he.1943-5584.0001571 · Cited by 41
Genetic interaction mapping informs integrative structure determination of protein complexes
Braberg, H., Echeverria, I., Bohn, S., Cimermancic, P., Shiver, A., Alexander, R., Xu, J., Shales, M., Dronamraju, R., Jiang, S., et al. (2020) · Science · doi:10.1126/science.aaz4910 · Cited by 37
Frank, S. A. (2012) · Journal of Evolutionary Biology · doi:10.1111/jeb.12010 · Cited by 21
Hidden Skewness: On the Difficulty of Multiplicative Compounding Under Random Shocks
Ensthaler, L., Nottmeyer, O., Weizsäcker, G., & Zankiewicz, C. (2018) · Management Science · doi:10.1287/mnsc.2016.2618 · Cited by 11
Credible Intervals for Knowledge Graph Accuracy Estimation
Marchesin, S., & Silvello, G. (2025) · Proceedings of the ACM on Management of Data · doi:10.1145/3725279 · Cited by 7
Trempler, I., Bürkner, P.-C., El-Sourani, N., Binder, E., Reker, P., Fink, G. R., & Schubotz, R. I. (2020) · NeuroImage · doi:10.1016/j.neuroimage.2020.116674 · Cited by 6
“The prior counts αkð0Þ before observing the first trial were set to 1/3 for all events representing an uninformative prior (Jeffreys, 1946).”
BackgroundA Survey of Frontiers in LLM Reasoning: Inference Scaling, Learning to Reason, and Agentic Systems
Ke, Z., Jiao, F., Ming, Y., Nguyen, X.-P., Xu, A., Long, D. X., Li, M., Qin, C., Wang, P., Savarese, S., et al. (2025) · arXiv · doi:10.48550/arxiv.2504.09037 · Cited by 4
Metadata
- Authors
- Jeffreys, H.
- Venue
- Proceedings of the Royal Society of London. Series A. Mathematical and Physical Sciences
- Publisher
- The Royal Society
- Published
- 1946-09-24
- Volume
- 186
- Issue
- 1007
- Pages
- 453-461
- ISSN
- 0080-4630 (ISSN-L)
- 2053-9169
- OpenAlex
- W2006681603
- Cited by
- 2,323
- References
- 0
- FWCI
- 1.50
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.