The DOI matches its Crossref record; 33 of the 33 references it cites were found in a registry or an index.
Mutual Information and Minimum Mean-Square Error in Gaussian Channels
Open accessAbstract
This paper deals with arbitrarily distributed finite-power input signals observed through an additive Gaussian noise channel. It shows a new formula that connects the input-output mutual information and the minimum mean-square error (MMSE) achievable by optimal estimation of the input given the output. That is, the derivative of the mutual information (nats) with respect to the signal-to-noise ratio (SNR) is equal to half the MMSE, regardless of the input statistics. This relationship holds for both scalar and vector signals, as well as for discrete-time and continuous-time noncausal MMSE estimation. This fundamental information-theoretic result has an unexpected consequence in continuous-time nonlinear estimation: For any input signal with finite power, the causal filtering MMSE achieved at SNR is equal to the average value of the noncausal smoothing MMSE achieved with a channel whose SNR is chosen uniformly distributed between 0 and SNR.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
A Mathematical Theory of Communication
Shannon, C. E. (1948) · Bell System Technical Journal · doi:10.1002/j.1538-7305.1948.tb01338.x · Cited by 88,486
A Mathematical Theory of Communication
Shannon, C. E. (1948) · Bell System Technical Journal · doi:10.1002/j.1538-7305.1948.tb00917.x · Cited by 48,949
Elements of Information Theory
Cover, T. M., & Thomas, J. A. (2001) · Wiley eBooks · doi:10.1002/0471200611 · Cited by 36,808
Elements of Information Theory
Cover, T. M., & Thomas, J. A. (2005) · doi:10.1002/047174882x · Cited by 13,791
Doob, J. L., & Doob, J. L. (1953) · CERN Document Server (European Organization for Nuclear Research) · Cited by 9,053
Communication in the presence of noise
Shannon, C. E. (1949) · Proceedings of the IRE · doi:10.1109/jrproc.1949.232969 · Cited by 6,539
Information Theory and Reliable Communication.
Lee, P. M., & Gallager, R. T. (1970) · Journal of the Royal Statistical Society. Series A (General) · doi:10.2307/2344305 · Cited by 5,399
Principles of mathematical analysis
Rudin, W. (1964) · UCLA - Biblioteca de Ciencias y Tecnologia Felix Morales Bueno · Cited by 5,298
Extrapolation, Interpolation, and Smoothing of Stationary Time Series: With Engineering Applications
Wiener, N. (1949) · The MIT Press eBooks · doi:10.7551/mitpress/2946.001.0001 · Cited by 4,826
Communication In The Presence Of Noise
Shannon, C. E. (1998) · Proceedings of the IEEE · doi:10.1109/jproc.1998.659497 · Cited by 4,804
Cited by
Integrated Sensing and Communications: Toward Dual-Functional Wireless Networks for 6G and Beyond
Liu, F., Cui, Y., Masouros, C., Xu, J., Han, T. X., Eldar, Y. C., & Buzzi, S. (2022) · IEEE Journal on Selected Areas in Communications · doi:10.1109/jsac.2022.3156632 · Cited by 3,857
Bit-interleaved coded modulation
Caire, G., Taricco, G., & Biglieri, E. (2002) · Proceedings of IEEE International Symposium on Information Theory · doi:10.1109/isit.1997.613011 · Cited by 1,927
Weighted sum-rate maximization using weighted MMSE for MIMO-BC beamforming design
Christensen, S. S., Agarwal, R., De Carvalho, E., & Cioffi, J. M. (2008) · IEEE Transactions on Wireless Communications · doi:10.1109/t-wc.2008.070851 · Cited by 1,014
MIMO radar waveform design based on mutual information and minimum mean-square error estimation
Yang, Y., & Blum, R. (2007) · IEEE Transactions on Aerospace and Electronic Systems · doi:10.1109/taes.2007.357137 · Cited by 610
Near-Field Communications: A Tutorial Review
Liu, Y., Wang, Z., Xu, J., Ouyang, C., Mu, X., & Schober, R. (2023) · IEEE Open Journal of the Communications Society · doi:10.1109/ojcoms.2023.3305583 · Cited by 575
Community Detection and Stochastic Block Models
Abbe, E. (2018) · now publishers, Inc. eBooks · doi:10.1561/9781680834772 · Cited by 544
Integrated Sensing and Communications: Recent Advances and Ten Open Challenges
Lu, S., Liu, F., Li, Y., Zhang, K., Huang, H., Zou, J., Li, X., Dong, Y., Dong, F., Zhu, J., et al. (2024) · IEEE Internet of Things Journal · doi:10.1109/jiot.2024.3361173 · Cited by 516
Foundations of MIMO Communication
Heath Jr, R. W., & Lozano, A. (2018) · Cambridge University Press eBooks · doi:10.1017/9781139049276 · Cited by 426
Randomly Spread CDMA: Asymptotics Via Statistical Physics
Guo, D., & Verdu, S. (2005) · IEEE Transactions on Information Theory · doi:10.1109/tit.2005.847700 · Cited by 399
Self-citationFramework for Link-Level Energy Efficiency Optimization with Informed Transmitter
Isheden, C., Chong, Z., Jorswieck, E., & Fettweis, G. (2012) · IEEE Transactions on Wireless Communications · doi:10.1109/twc.2012.060412.111829 · Cited by 383
On the Fundamental Tradeoff of Integrated Sensing and Communications Under Gaussian Channels
Xiong, Y., Liu, F., Cui, Y., Yuan, W., Han, T. X., & Caire, G. (2023) · IEEE Transactions on Information Theory · doi:10.1109/tit.2023.3284449 · Cited by 378
Gradient of mutual information in linear vector Gaussian channels
Palomar, D. P., & Verdu, S. (2006) · IEEE Transactions on Information Theory · doi:10.1109/tit.2005.860424 · Cited by 363
Self-citationCooperative Algorithms for MIMO Interference Channels
Peters, S. W., & Heath, R. W. (2011) · IEEE Transactions on Vehicular Technology · doi:10.1109/tvt.2010.2085459 · Cited by 348
Seventy Years of Radar and Communications: The road from separation to integration
Liu, F., Zheng, L., Cui, Y., Masouros, C., Petropulu, A. P., Griffiths, H., & Eldar, Y. C. (2023) · IEEE Signal Processing Magazine · doi:10.1109/msp.2023.3272881 · Cited by 276
Integrated Sensing and Communication Waveform Design: A Survey
Zhou, W., Zhang, R., Chen, G., & Wu, W. (2022) · IEEE Open Journal of the Communications Society · doi:10.1109/ojcoms.2022.3215683 · Cited by 272
Data Assimilation in Chaotic Systems Using Deep Reinforcement Learning
Hammoud, M. A. E. R., Raboudi, N., Titi, E. S., Knio, O., & Hoteit, I. (2024) · Journal of Advances in Modeling Earth Systems · doi:10.1029/2023ms004178 · Cited by 11
Metadata
- Authors
- Guo, D., Shamai, S., & Verdu, S.
- Venue
- IEEE Transactions on Information Theory
- Published
- 2005-04
- Volume
- 51
- Issue
- 4
- Pages
- 1261-1282
- ISSN
- 0018-9448 (ISSN-L)
- OpenAlex
- W2111616148
- Cited by
- 1,201
- References
- 33
- FWCI
- 53.59
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.