The DOI matches its Crossref record; 33 of the 33 references it cites were found in a registry or an index.
Mutual Information and Minimum Mean-Square Error in Gaussian Channels
Open accessAbstract
This paper deals with arbitrarily distributed finite-power input signals observed through an additive Gaussian noise channel. It shows a new formula that connects the input-output mutual information and the minimum mean-square error (MMSE) achievable by optimal estimation of the input given the output. That is, the derivative of the mutual information (nats) with respect to the signal-to-noise ratio (SNR) is equal to half the MMSE, regardless of the input statistics. This relationship holds for both scalar and vector signals, as well as for discrete-time and continuous-time noncausal MMSE estimation. This fundamental information-theoretic result has an unexpected consequence in continuous-time nonlinear estimation: For any input signal with finite power, the causal filtering MMSE achieved at SNR is equal to the average value of the noncausal smoothing MMSE achieved with a channel whose SNR is chosen uniformly distributed between 0 and SNR.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
A Mathematical Theory of Communication
Shannon, C. E. (1948) · Bell System Technical Journal · doi:10.1002/j.1538-7305.1948.tb01338.x · Cited by 88,486
A Mathematical Theory of Communication
Shannon, C. E. (1948) · Bell System Technical Journal · doi:10.1002/j.1538-7305.1948.tb00917.x · Cited by 48,949
Elements of Information Theory
Cover, T. M., & Thomas, J. A. (2001) · Wiley eBooks · doi:10.1002/0471200611 · Cited by 36,808
Elements of Information Theory
Cover, T. M., & Thomas, J. A. (2005) · doi:10.1002/047174882x · Cited by 13,791
Doob, J. L., & Doob, J. L. (1953) · CERN Document Server (European Organization for Nuclear Research) · Cited by 9,053
Communication in the presence of noise
Shannon, C. E. (1949) · Proceedings of the IRE · doi:10.1109/jrproc.1949.232969 · Cited by 6,539
Information Theory and Reliable Communication.
Lee, P. M., & Gallager, R. T. (1970) · Journal of the Royal Statistical Society. Series A (General) · doi:10.2307/2344305 · Cited by 5,399
Principles of mathematical analysis
Rudin, W. (1964) · UCLA - Biblioteca de Ciencias y Tecnologia Felix Morales Bueno · Cited by 5,298
Extrapolation, Interpolation, and Smoothing of Stationary Time Series: With Engineering Applications
Wiener, N. (1949) · The MIT Press eBooks · doi:10.7551/mitpress/2946.001.0001 · Cited by 4,826
Communication In The Presence Of Noise
Shannon, C. E. (1998) · Proceedings of the IEEE · doi:10.1109/jproc.1998.659497 · Cited by 4,804
Principles of mathematical analysis
Hammer, C. (1953) · Journal of the Franklin Institute · doi:10.1016/0016-0032(53)90617-6 · Cited by 3,985
Stochastic Differential Equations: An Introduction with Applications.
Jacka, S. D., & Oksendal, B. (1987) · Journal of the American Statistical Association · doi:10.2307/2288814 · Cited by 3,964
An Introduction to Signal Detection and Estimation
Poor, H. V. (1988) · Springer Texts in Electrical Engineering · doi:10.1007/978-1-4757-3863-6 · Cited by 3,149
An Introduction to Signal Detection and Estimation
Poor, H. V. (1994) · Springer Texts in Electrical Engineering · doi:10.1007/978-1-4757-2341-0 · Cited by 2,659
Stochastic Differential Equations
Øksendal, B. (2003) · Universitext · doi:10.1007/978-3-642-14394-6 · Cited by 2,082
Spectral efficiency in the wideband regime
Verdu, S. (2002) · IEEE Transactions on Information Theory · doi:10.1109/tit.2002.1003824 · Cited by 1,214
Self-citationInformation Theory and Reliable Communication
Gallager, R. (1972) · Springer eBooks · doi:10.1007/978-3-7091-2945-6 · Cited by 1,204
Principles and practice of information theory
Blahut, R. E. (1987) · Medical Entomology and Zoology · Cited by 1,008
Spectral efficiency of CDMA with random spreading
Verdu, S., & Shamai, S. (1999) · IEEE Transactions on Information Theory · doi:10.1109/18.749007 · Cited by 885
Self-citationTukey, J. W., & Wiener, N. (1952) · Journal of the American Statistical Association · doi:10.2307/2280758 · Cited by 760
Information and information stability of random variables and processes
(1964) · Journal of the Franklin Institute · doi:10.1016/0016-0032(64)90319-9 · Cited by 758
Extrinsic information transfer functions: model and erasure channel properties
Ashikhmin, A., Kramer, G., & ten Brink, S. (2004) · IEEE Transactions on Information Theory · doi:10.1109/tit.2004.836693 · Cited by 756
Some inequalities satisfied by the quantities of information of Fisher and Shannon
Stam, A. J. (1959) · Information and Control · doi:10.1016/s0019-9958(59)90348-1 · Cited by 706
A statistical-mechanics approach to large-system analysis of CDMA multiuser detectors
Tanaka, T. (2002) · IEEE Transactions on Information Theory · doi:10.1109/tit.2002.804053 · Cited by 562
On channel capacity per unit cost
Verdu, S. (1990) · IEEE Transactions on Information Theory · doi:10.1109/18.57201 · Cited by 522
Self-citationOn the capacity of wireless networks: the relay case
Gastpar, M., & Vetterli, M. (2003) · Proceedings.Twenty-First Annual Joint Conference of the IEEE Computer and Communications Societies · doi:10.1109/infcom.2002.1019409 · Cited by 467
Some Applications of Stochastic Differential Equations to Optimal Nonlinear Filtering
Wonham, W. M. (1964) · Journal of the Society for Industrial and Applied Mathematics Series A Control · doi:10.1137/0302028 · Cited by 423
Randomly Spread CDMA: Asymptotics Via Statistical Physics
Guo, D., & Verdu, S. (2005) · IEEE Transactions on Information Theory · doi:10.1109/tit.2005.847700 · Cited by 399
Self-citationOn the Shannon theory of information transmission in the case of continuous signals
Kolmogorov, A. (1956) · IRE Transactions on Information Theory · doi:10.1109/tit.1956.1056823 · Cited by 394
Hestenes, A. D. (1950) · Journal of the Franklin Institute · doi:10.1016/0016-0032(50)90526-6 · Cited by 298
The innovations approach to detection and estimation theory
Kailath, T. (1970) · Proceedings of the IEEE · doi:10.1109/proc.1970.7723 · Cited by 238
Detection of stochastic processes
Kailath, T., & Poor, H. V. (1998) · IEEE Transactions on Information Theory · doi:10.1109/18.720538 · Cited by 215
Mutual Information and Conditional Mean Estimation in Poisson Channels
Guo, D., Shamai, S. S., & Verdú, S. (2008) · IEEE Transactions on Information Theory · doi:10.1109/tit.2008.920206 · Cited by 105
Self-citation
Cited by
Integrated Sensing and Communications: Toward Dual-Functional Wireless Networks for 6G and Beyond
Liu, F., Cui, Y., Masouros, C., Xu, J., Han, T. X., Eldar, Y. C., & Buzzi, S. (2022) · IEEE Journal on Selected Areas in Communications · doi:10.1109/jsac.2022.3156632 · Cited by 3,857
Bit-interleaved coded modulation
Caire, G., Taricco, G., & Biglieri, E. (2002) · Proceedings of IEEE International Symposium on Information Theory · doi:10.1109/isit.1997.613011 · Cited by 1,927
Weighted sum-rate maximization using weighted MMSE for MIMO-BC beamforming design
Christensen, S. S., Agarwal, R., De Carvalho, E., & Cioffi, J. M. (2008) · IEEE Transactions on Wireless Communications · doi:10.1109/t-wc.2008.070851 · Cited by 1,014
MIMO radar waveform design based on mutual information and minimum mean-square error estimation
Yang, Y., & Blum, R. (2007) · IEEE Transactions on Aerospace and Electronic Systems · doi:10.1109/taes.2007.357137 · Cited by 610
Near-Field Communications: A Tutorial Review
Liu, Y., Wang, Z., Xu, J., Ouyang, C., Mu, X., & Schober, R. (2023) · IEEE Open Journal of the Communications Society · doi:10.1109/ojcoms.2023.3305583 · Cited by 575
Metadata
- Authors
- Guo, D., Shamai, S., & Verdu, S.
- Venue
- IEEE Transactions on Information Theory
- Published
- 2005-04
- Volume
- 51
- Issue
- 4
- Pages
- 1261-1282
- ISSN
- 0018-9448 (ISSN-L)
- OpenAlex
- W2111616148
- Cited by
- 1,201
- References
- 33
- FWCI
- 53.59
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.