The DOI matches its Crossref record; 45 of the 45 references it cites were found in a registry or an index.
Information-theoretic asymptotics of Bayes methods
Abstract
In the absence of knowledge of the true density function, Bayesian models take the joint density function for a sequence of n random variables to be an average of densities with respect to a prior. The authors examine the relative entropy distance D/sub n/ between the true density and the Bayesian density and show that the asymptotic distance is (d/2)(log n)+c, where d is the dimension of the parameter vector. Therefore, the relative entropy rate D/sub n//n converges to zero at rate (log n)/n. The constant c, which the authors explicitly identify, depends only on the prior density function and the Fisher information matrix evaluated at the true parameter value. Consequences are given for density estimation, universal data compression, composite hypothesis testing, and stock-market portfolio selection.>
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Estimating the Dimension of a Model
Schwarz, G. (1978) · The Annals of Statistics · doi:10.1214/aos/1176344136 · Cited by 47,033
Information theory and statistics
(1959) · Journal of the Franklin Institute · doi:10.1016/0016-0032(59)90368-0 · Cited by 7,094
Probability Inequalities for sums of Bounded Random Variables
Hoeffding, W. (1994) · Springer Series in Statistics · doi:10.1007/978-1-4612-0865-5_26 · Cited by 6,666
Probability Inequalities for Sums of Bounded Random Variables
Hoeffding, W. (1963) · Journal of the American Statistical Association · doi:10.1080/01621459.1963.10500830 · Cited by 4,852
Ziegel, E. R., Lehmann, E. L., & Casella, G. (1999) · Technometrics · doi:10.2307/1270597 · Cited by 4,203
On the Uniform Convergence of Relative Frequencies of Events to Their Probabilities
Vapnik, V. N., & Chervonenkis, A. Y. (2015) · Measures of Complexity · doi:10.1007/978-3-319-21852-6_3 · Cited by 3,105
A Course in Probability Theory
(1974) · Elsevier eBooks · doi:10.1016/c2009-0-22097-6 · Cited by 2,668
Wald, A. (1943) · Transactions of the American Mathematical Society · doi:10.1090/s0002-9947-1943-0012401-3 · Cited by 2,511
On the Uniform Convergence of Relative Frequencies of Events to Their Probabilities
Vapnik, V. N., & Chervonenkis, A. Y. (1971) · Theory of Probability & Its Applications · doi:10.1137/1116025 · Cited by 2,448
Accurate Approximations for Posterior Moments and Marginal Densities
Tierney, L., & Kadane, J. B. (1986) · Journal of the American Statistical Association · doi:10.1080/01621459.1986.10478240 · Cited by 2,129
Optimal Statistical Decisions.
Lindley, D. V., & de Groot, M. (1971) · Applied Statistics · doi:10.2307/2346640 · Cited by 1,802
A New Interpretation of Information Rate
Kelly, J. L. (1956) · Bell System Technical Journal · doi:10.1002/j.1538-7305.1956.tb03809.x · Cited by 1,586
Information Theory and Statistics.
Dwass, M., & Kullback, S. (1960) · The American Mathematical Monthly · doi:10.2307/2309734 · Cited by 1,537
Lehmann, E. L. (1983) · Springer eBooks · doi:10.1007/978-1-4757-2769-2 · Cited by 1,356
Asymptotic methods in analysis
de Bruijn, N. G. (1958) · International Linear Collider · Cited by 1,332
Statistical Estimation: Asymptotic Theory
Samaniego, F. J. (2014) · Chapman & Hall/CRC eBooks · doi:10.1201/b16414-10 · Cited by 1,155
Note on the Consistency of the Maximum Likelihood Estimate
Wald, A. (1949) · The Annals of Mathematical Statistics · doi:10.1214/aoms/1177729952 · Cited by 1,100
Principles and practice of information theory
Blahut, R. E. (1987) · Medical Entomology and Zoology · Cited by 1,008
Randolph, P. H. (1970) · Technometrics · doi:10.1080/00401706.1970.10488715 · Cited by 986
Stochastic Complexity and Modeling
Rissanen, J. (1986) · The Annals of Statistics · doi:10.1214/aos/1176350051 · Cited by 922
Universal coding, information, prediction, and estimation
Rissanen, J. (1984) · IEEE Transactions on Information Theory · doi:10.1109/tit.1984.1056936 · Cited by 898
On the Distribution of the Likelihood Ratio
Chernoff, H. (1954) · The Annals of Mathematical Statistics · doi:10.1214/aoms/1177728725 · Cited by 783
Mathematical Theory of Probability and Statistics
(1964) · Elsevier eBooks · doi:10.1016/c2013-0-12460-9 · Cited by 623
The performance of universal encoding
Krichevsky, R., & Trofimov, V. (1981) · IEEE Transactions on Information Theory · doi:10.1109/tit.1981.1056331 · Cited by 535
Some Limit Theorems in Statistics
Bahadur, R. R. (1971) · Society for Industrial and Applied Mathematics eBooks · doi:10.1137/1.9781611970630 · Cited by 500
Minimum complexity density estimation
Barron, A. R., & Cover, T. M. (1991) · IEEE Transactions on Information Theory · doi:10.1109/18.86996 · Cited by 497
Self-citationThompson, W. A. (1963) · Technometrics · doi:10.1080/00401706.1963.10490115 · Cited by 455
Schwartz, L. (1965) · Probability Theory and Related Fields · doi:10.1007/bf00535479 · Cited by 415
Limiting Behavior of Posterior Distributions when the Model is Incorrect
Berk, R. H. (1966) · The Annals of Mathematical Statistics · doi:10.1214/aoms/1177699597 · Cited by 406
Fundamentals of Statistical Exponential Families
Brown, L. D. (1987) · Cited by 386
Davisson, L. (1973) · IEEE Transactions on Information Theory · doi:10.1109/tit.1973.1055092 · Cited by 365
Statistical decision rules and optimal inference
Chent︠s︡ov, N. N. (1982) · Medical Entomology and Zoology · Cited by 353
On the Asymptotic Behaviour of Posterior Distributions
Walker, A. M. (1969) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1969.tb00767.x · Cited by 332
On the Choice of a Model to Fit Data from an Exponential Family
Haughton, D. M. A. (1988) · The Annals of Statistics · doi:10.1214/aos/1176350709 · Cited by 274
AITCHISON, J. (1975) · Biometrika · doi:10.1093/biomet/62.3.547 · Cited by 256
Large-Sample Theory: Parametric Case
Chernoff, H. (1956) · The Annals of Mathematical Statistics · doi:10.1214/aoms/1177728347 · Cited by 248
Asymptotic Expansions Associated with Posterior Distributions
Johnson, R. A. (1970) · The Annals of Mathematical Statistics · doi:10.1214/aoms/1177696963 · Cited by 193
Mathematical Theory of Probability and Statistics
Bergström, H., von Mises, R., Geiringer, H., & Bergstrom, H. (1966) · Technometrics · doi:10.2307/1266701 · Cited by 180
New Ways to Prove Central Limit Theorems
Pollard, D. (1985) · Econometric Theory · doi:10.1017/s0266466600011233 · Cited by 151
Hartigan, J. A. (1983) · Springer series in statistics · doi:10.1007/978-1-4613-8242-3 · Cited by 151
Stochastic complexity and the mdl principle
Rissanen, J. (1987) · Econometric Reviews · doi:10.1080/07474938708800126 · Cited by 92
Berk, R. H. (1970) · The Annals of Mathematical Statistics · doi:10.1214/aoms/1177696967 · Cited by 81
Uniformly Powerful Goodness of Fit Tests
Barron, A. R. (1989) · The Annals of Statistics · doi:10.1214/aos/1176347005 · Cited by 59
Self-citationA bound on the financial value of information
Barron, A. R., & Cover, T. M. (1988) · IEEE Transactions on Information Theory · doi:10.1109/18.21241 · Cited by 58
Self-citationAsymptotic cumulative risk and Bayes risk under entropy loss, with applications
Clarke, B. S. (1989) · Illinois Digital Environment for Access to Learning and Scholarship (University of Illinois at Urbana-Champaign) · Cited by 13
Self-citation
Cited by
Prediction, Learning, and Games
Cesa-Bianchi, N., & Lugosi, G. (2006) · Cambridge University Press eBooks · doi:10.1017/cbo9780511546921 · Cited by 3,162
The horseshoe estimator for sparse signals
Carvalho, C. M., Polson, N. G., & Scott, J. G. (2010) · Biometrika · doi:10.1093/biomet/asq017 · Cited by 1,381
The Selection of Prior Distributions by Formal Rules
Kass, R. E., & Wasserman, L. (1996) · Journal of the American Statistical Association · doi:10.1080/01621459.1996.10477003 · Cited by 1,308
(1998) · Springer eBooks · doi:10.1007/978-1-4615-5529-2 · Cited by 1,235
The minimum description length principle in coding and modeling
Barron, A., Rissanen, J., & Yu, B. (1998) · IEEE Transactions on Information Theory · doi:10.1109/18.720554 · Cited by 1,019
Self-citation
Metadata
- Authors
- Clarke, B. S., & Barron, A. R.
- Venue
- IEEE Transactions on Information Theory
- Published
- 1990-05
- Volume
- 36
- Issue
- 3
- Pages
- 453-471
- ISSN
- 0018-9448 (ISSN-L)
- OpenAlex
- W2160570986
- Cited by
- 431
- References
- 45
- FWCI
- 4.68
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.