The DOI matches its Crossref record; 22 of the 22 references it cites were found in a registry or an index.
Maximum Entropy for Hypothesis Formulation, Especially for Multidimensional Contingency Tables
Open accessAbstract
The principle of maximum entropy, together with some generalizations, is interpreted as a heuristic principle for the generation of null hypotheses. The main application is to $m$-dimensional population contingency tables, with the marginal totals given down to dimension $m - r$ ("restraints of the $r$th order"). The principle then leads to the null hypothesis of no "$r$th-order interaction." Significance tests are given for testing the hypothesis of no $r$th-order or higher-order interaction within the wider hypothesis of no $s$th-order or higher-order interaction, some cases of which have been treated by Bartlett and by Roy and Kastenbaum. It is shown that, if a complete set of $r$th-order restraints are given, then the hypothesis of the vanishing of all $r$th-order and higher-order interactions leads to a unique set of cell probabilities, if the restraints are consistent, but not only just consistent. This confirms and generalizes a recent conjecture due to Darroch. A kind of duality between maximum entropy and maximum likelihood is proved. Some relationships between maximum entropy, interactions, and Markov chains are proved.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
A Mathematical Theory of Communication
Shannon, C. E. (1948) · Bell System Technical Journal · doi:10.1002/j.1538-7305.1948.tb01338.x · Cited by 88,486
Information theory and statistical mechanics
Jaynes, E. T. (1957) · Physical Review · doi:10.1103/physrev.106.620 · Cited by 12,931
ON ESTIMATING THE RELATION BETWEEN BLOOD GROUP AND DISEASE
WOOLF, B. (1955) · Annals of Human Genetics · doi:10.1111/j.1469-1809.1955.tb01348.x · Cited by 2,723
An invariant form for the prior probability in estimation problems
Jeffreys, H. (1946) · Proceedings of the Royal Society of London. Series A. Mathematical and Physical Sciences · doi:10.1098/rspa.1946.0056 · Cited by 2,323
Further Results on Tests of Separate Families of Hypotheses
Cox, D. R. (1962) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1962.tb00468.x · Cited by 1,026
Probability and the Weighing of Evidence.
M., P. A., & Good, I. J. (1950) · Journal of the Royal Statistical Society. Series A (General) · doi:10.2307/2981046 · Cited by 753
Self-citationThe Interaction Algorithm and Practical Fourier Analysis
Good, I. J. (1958) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1958.tb00300.x · Cited by 509
Self-citationContingency Table Interactions
Bartlett, M. S. (1935) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.2307/2983639 · Cited by 310
Approximating probability distributions to reduce storage requirements
Lewis, P. (1959) · Information and Control · doi:10.1016/s0019-9958(59)90207-4 · Cited by 166
Tests for Contingency Tables and Markov Chains
Kullback, S., Kupperman, M., & Ku, H. H. (1962) · Technometrics · doi:10.1080/00401706.1962.10490041 · Cited by 165
The Use of Prior Probability Distributions in Statistical Inference and Decisions
Lindley, D. V. (1961) · Project Euclid (Cornell University) · Cited by 131
THE THEORY OF CONFOUNDING IN FACTORIAL EXPERIMENTS IN RELATION TO THE THEORY OF GROUPS
Fisher, R. A. (1941) · Annals of Eugenics · doi:10.1111/j.1469-1809.1941.tb02298.x · Cited by 112
Interactions in Multi-Factor Contingency Tables
Darroch, J. N. (1962) · Journal of the Royal Statistical Society Series B (Statistical Methodology) · doi:10.1111/j.2517-6161.1962.tb00457.x · Cited by 112
Good, I. J. (1959) · Science · doi:10.1126/science.129.3347.443 · Cited by 109
Self-citationComplex Contingency Tables Treated by the Partition of χ2
Lancaster, H. O. (1951) · Journal of the Royal Statistical Society Series B (Statistical Methodology) · doi:10.1111/j.2517-6161.1951.tb00089.x · Cited by 98
A note on approximations to discrete probability distributions
Brown, D. T. (1959) · Information and Control · doi:10.1016/s0019-9958(59)80016-4 · Cited by 97
A Note on Interactions in Contingency Tables
Plackett, R. L. (1962) · Journal of the Royal Statistical Society Series B (Statistical Methodology) · doi:10.1111/j.2517-6161.1962.tb00449.x · Cited by 92
Calculation of Chi-Square for Complex Contingency Tables
Norton, H. W. (1945) · Journal of the American Statistical Association · doi:10.1080/01621459.1945.10501855 · Cited by 66
On the Estimation of Small Frequencies in Contingency Tables
Good, I. J. (1956) · Journal of the Royal Statistical Society Series B (Statistical Methodology) · doi:10.1111/j.2517-6161.1956.tb00216.x · Cited by 61
Self-citationAnalogues of Poisson's Summation Formula
Good, I. J. (1962) · American Mathematical Monthly · doi:10.1080/00029890.1962.11989879 · Cited by 48
Self-citationCalculation of Chi-Square to Test the No Three-Factor Interaction Hypothesis
Kastenbaum, M. A., & Lamphiear, D. E. (1959) · Biometrics · doi:10.2307/2527605 · Cited by 42
The application of some basic inequalities for entropy
Hartmanis, J. (1959) · Information and Control · doi:10.1016/s0019-9958(59)90199-8 · Cited by 14
Cited by
Information Theory and an Extension of the Maximum Likelihood Principle
Akaike, H. (1998) · Springer Series in Statistics · doi:10.1007/978-1-4612-1694-0_15 · Cited by 17,781
Information Theory and an Extension of the Maximum Likelihood Principle
Akaike, H. (1992) · Springer Series in Statistics · doi:10.1007/978-1-4612-0919-5_38 · Cited by 3,028
“statistical circle has been quite limited [10, 12,20]; The distinction between Shannon-Wiener's entropy and Fisher's information was discussed as early as in 1950 by Bartlett [7], where the use of the Kullback-Leibler type definition of information was implicit.”
MethodAxiomatic derivation of the principle of maximum entropy and the principle of minimum cross-entropy
Shore, J., & Johnson, R. (1980) · IEEE Transactions on Information Theory · doi:10.1109/tit.1980.1056144 · Cited by 1,774
Jaynes, E. (1968) · IEEE Transactions on Systems Science and Cybernetics · doi:10.1109/tssc.1968.300117 · Cited by 1,750
$I$-Divergence Geometry of Probability Distributions and Minimization Problems
Csiszar, I. (1975) · The Annals of Probability · doi:10.1214/aop/1176996454 · Cited by 1,645
Metadata
- Authors
- Good, I. J.
- Venue
- The Annals of Mathematical Statistics
- Publisher
- Institute of Mathematical Statistics
- Published
- 1963-09
- Volume
- 34
- Issue
- 3
- Pages
- 911-934
- ISSN
- 0003-4851 (ISSN-L)
- OpenAlex
- W2089611415
- Cited by
- 392
- References
- 22
- FWCI
- 6.01
- Type
- journal article
- Language
- en
- Open access
- diamond
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.