The DOI matches its Crossref record.
Elements of Information Theory
Abstract
Information theory deals with the quantitative aspects of storage and transmission of messages. Some of these aspects involve the inner structure of messages: the grammar of their language, the acoustic spectrum of their sound etc. We will not enter into questions of this kind. For us here, messages are elements of a set, and when we handle them, our sole concern is to keep distinct messages distinct, i.e. to make the mappings resulting from our manipulations injective (= one-to-one). Aiming at this, we face two obstacles: lack of capacity of storage or transmission procedures noise , i.e. distortion of messages during transmission. These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cited by
The “independent components” of natural scenes are edge filters
Bell, A. J., & Sejnowski, T. J. (1997) · Vision Research · doi:10.1016/s0042-6989(97)00121-1 · Cited by 2,201
Entanglement measures and purification procedures
Vedral, V., & Plenio, M. B. (1998) · Physical Review A · doi:10.1103/physreva.57.1619 · Cited by 1,419
An information-theoretic perspective of tf–idf measures
Aizawa, A. (2003) · Information Processing & Management · doi:10.1016/s0306-4573(02)00021-3 · Cited by 1,419
Robustness of cellular functions
Stelling, J., Sauer, U., Szallasi, Z., Doyle, F. J., & Doyle, J. (2004) · Cell · doi:10.1016/j.cell.2004.09.008 · Cited by 1,049
Distributional clustering of English words
Pereira, F., Tishby, N., & Lee, L. (1993) · Proceedings of the 31st annual meeting on Association for Computational Linguistics - · doi:10.3115/981574.981598 · Cited by 974
Metadata
- Authors
- Jacobs, K.
- Venue
- Discrete Stochastics
- Publisher
- Birkhäuser Basel
- Published
- 1992
- Pages
- 155-183
- OpenAlex
- W285471286
- Cited by
- 2,918
- References
- 0
- FWCI
- 20.25
- Type
- book chapter
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Elements of Information Theory. https://app.cochat.ai/papers/10.1007/978-3-0348-8645-1_7
- The paper
- Jacobs, K. (1992). Elements of Information Theory. Discrete Stochastics. https://doi.org/10.1007/978-3-0348-8645-1_7
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.
