The DOI matches its Crossref record.
Information Theory and Statistics
Abstract
This chapter contains sections titled: Method of Types Law of Large Numbers Universal Source Coding Large Deviation Theory Examples of Sanov's Theorem Conditional Limit Theorem Hypothesis Testing Chernoff–Stein Lemma Chernoff Information Fisher Information and the Cramér–Rao Inequality Summary Problems Historical Notes
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cited by
Multiresolution gray-scale and rotation invariant texture classification with local binary patterns
Ojala, T., Pietikainen, M., & Maenpaa, T. (2002) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2002.1017623 · Cited by 15,398
A comparative study of texture measures with classification based on featured distributions
Ojala, T., Pietikäinen, M., & Harwood, D. (1996) · Pattern Recognition · doi:10.1016/0031-3203(95)00067-4 · Cited by 6,882
Divergence measures based on the Shannon entropy
Lin, J. (1991) · IEEE Transactions on Information Theory · doi:10.1109/18.61115 · Cited by 5,140
Vertex component analysis: a fast algorithm to unmix hyperspectral data
Nascimento, J. M. P., & Dias, J. M. B. (2005) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2005.844293 · Cited by 2,669
Knowledge Graph Embedding: A Survey of Approaches and Applications
Wang, Q., Mao, Z., Wang, B., & Guo, L. (2017) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2017.2754499 · Cited by 2,654
Kelly, P. H., Seviour, P. W., & Iversen, S. D. (1975) · Brain Research · doi:10.1016/0006-8993(75)90233-4 · Cited by 1,731
Osada, R., Funkhouser, T., Chazelle, B., & Dobkin, D. (2002) · ACM Transactions on Graphics · doi:10.1145/571647.571648 · Cited by 1,661
Speaker recognition: a tutorial
Campbell, J. P. (1997) · Proceedings of the IEEE · doi:10.1109/5.628714 · Cited by 1,629
Anomaly detection in crowded scenes
Mahadevan, V., Li, W., Bhalodia, V., & Vasconcelos, N. (2010) · 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2010.5539872 · Cited by 1,512
Ojala, T., Pietikainen, M., & Harwood, D. (2002) · Proceedings of 12th International Conference on Pattern Recognition · doi:10.1109/icpr.1994.576366 · Cited by 1,392
Normalized Mutual Information Feature Selection
Estevez, P. A., Tesmer, M., Perez, C. A., & Zurada, J. M. (2009) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.2008.2005601 · Cited by 1,288
Approximating the Kullback Leibler Divergence Between Gaussian Mixture Models
Hershey, J. R., & Olsen, P. A. (2007) · 2007 IEEE International Conference on Acoustics, Speech and Signal Processing - ICASSP '07 · doi:10.1109/icassp.2007.366913 · Cited by 1,189
An algorithm for computing the capacity of arbitrary discrete memoryless channels
Arimoto, S. (1972) · IEEE Transactions on Information Theory · doi:10.1109/tit.1972.1054753 · Cited by 838
Alignment-free sequence comparison—a review
Vinga, S., & Almeida, J. (2003) · Bioinformatics · doi:10.1093/bioinformatics/btg005 · Cited by 804
Kolenikov, S., & Angeles, G. (2009) · Review of Income and Wealth · doi:10.1111/j.1475-4991.2008.00309.x · Cited by 775
An HMM-based threshold model approach for gesture recognition
Lee, H.-K., & Kim, J. H. (1999) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.799904 · Cited by 671
Matching 3D models with shape distributions
Osada, R., Funkhouser, T., Chazelle, B., & Dobkin, D. (2002) · Proceedings International Conference on Shape Modeling and Applications · doi:10.1109/sma.2001.923386 · Cited by 591
Membership Inference Attacks on Machine Learning: A Survey
Hu, H., Salcic, Z., Sun, L., Dobbie, G., Yu, P. S., & Zhang, X. (2022) · ACM Computing Surveys · doi:10.1145/3523273 · Cited by 564
An empirical comparison of selection measures for decision-tree induction
Mingers, J. (1989) · Machine Learning · doi:10.1007/bf00116837 · Cited by 561
Björklund, A., Dunnett, S. B., Stenevi, U., Lewis, M. E., & Iversen, S. D. (1980) · Brain Research · doi:10.1016/0006-8993(80)90692-7 · Cited by 552
On channel capacity per unit cost
Verdu, S. (1990) · IEEE Transactions on Information Theory · doi:10.1109/18.57201 · Cited by 522
Data-driven chance constrained stochastic program
Jiang, R., & Guan, Y. (2016) · Mathematical Programming · doi:10.1007/s10107-015-0929-7 · Cited by 485
Distortion measures for speech processing
Gray, R., Buzo, A., Gray, A., & Matsuyama, Y. (1980) · IEEE Transactions on Acoustics, Speech, and Signal Processing · doi:10.1109/tassp.1980.1163421 · Cited by 388
An error-entropy minimization algorithm for supervised training of nonlinear adaptive systems
Erdogmus, D., & Principe, J. C. (2002) · IEEE Transactions on Signal Processing · doi:10.1109/tsp.2002.1011217 · Cited by 353
Design of computer experiments: A review
Garud, S. S., Karimi, I. A., & Kraft, M. (2017) · Computers & Chemical Engineering · doi:10.1016/j.compchemeng.2017.05.010 · Cited by 348
An algorithm for data-driven bandwidth selection
Comaniciu, D. (2003) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2003.1177159 · Cited by 336
Verdu, S. (1998) · IEEE Transactions on Information Theory · doi:10.1109/18.720531 · Cited by 316
Intrusion detection systems using long short-term memory (LSTM)
Laghrissi, F., Douzi, S., Douzi, K., & Hssina, B. (2021) · Journal of Big Data · doi:10.1186/s40537-021-00448-4 · Cited by 304
Of bits and wows: A Bayesian theory of surprise with applications to attention
Baldi, P., & Itti, L. (2010) · Neural Networks · doi:10.1016/j.neunet.2009.12.007 · Cited by 302
Huang, Y., Rong, C., Zhang, R., & Liu, S. (2017) · Journal of Molecular Modeling · doi:10.1007/s00894-016-3175-x · Cited by 258
Toward Optimal Feature Selection in Naive Bayes for Text Categorization
Tang, B., Kay, S., & He, H. (2016) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2016.2563436 · Cited by 253
Hybrid physics-informed neural networks for lithium-ion battery modeling and prognosis
Nascimento, R. G., Corbetta, M., Kulkarni, C. S., & Viana, F. A. C. (2021) · Journal of Power Sources · doi:10.1016/j.jpowsour.2021.230526 · Cited by 224
Executive function in Tourette’s syndrome and obsessive–compulsive disorder
WATKINS, L. H., SAHAKIAN, B. J., ROBERTSON, M. M., VEALE, D. M., ROGERS, R. D., PICKARD, K. M., AITKEN, M. R. F., & ROBBINS, T. W. (2005) · Psychological Medicine · doi:10.1017/s0033291704003691 · Cited by 210
Improving astronaut cancer risk assessment from space radiation with an ensemble model framework
Simonsen, L. C., & Slaba, T. C. (2021) · Life Sciences in Space Research · doi:10.1016/j.lssr.2021.07.002 · Cited by 36
Metadata
- Venue
- Elements of Information Theory
- Publisher
- Wiley
- Published
- 2005-04-07
- Pages
- 347-408
- OpenAlex
- W4300906944
- Cited by
- 729
- References
- 0
- Type
- other
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.