The DOI matches its Crossref record; 63 of the 63 references it cites were found in a registry or an index.
Linear prediction: A tutorial review
Abstract
This paper gives an exposition of linear prediction in the analysis of discrete signals. The signal is modeled as a linear combination of its past values and present and past values of a hypothetical input to a system whose output is the given signal. In the frequency domain, this is equivalent to modeling the signal spectrum by a pole-zero spectrum. The major part of the paper is devoted to all-pole models. The model parameters are obtained by a least squares analysis in the time domain. Two methods result, depending on whether the signal is assumed to be stationary or nonstationary. The same results are then derived in the frequency domain. The resulting spectral matching formulation allows for the modeling of selected portions of a spectrum, for arbitrary spectral shaping in the frequency domain, and for the modeling of continuous as well as discrete spectra. This also leads to a discussion of the advantages and disadvantages of the least squares error criterion. A spectral interpretation is given to the normalized minimum prediction error. Applications of the normalized error are given, including the determination of an "optimal" number of poles. The use of linear prediction in data compression is reviewed. For purposes of transmission, particular attention is given to the quantization and encoding of the reflection (or partial correlation) coefficients. Finally, a brief introduction to pole-zero modeling is given.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
A new look at the statistical model identification
Akaike, H. (1974) · IEEE Transactions on Automatic Control · doi:10.1109/tac.1974.1100705 · Cited by 51,879
A New Approach to Linear Filtering and Prediction Problems
Kalman, R. E. (1960) · Journal of Basic Engineering · doi:10.1115/1.3662552 · Cited by 31,751
Information Theory and an Extension of the Maximum Likelihood Principle
Akaike, H. (1998) · Springer Series in Statistics · doi:10.1007/978-1-4612-1694-0_15 · Cited by 17,781
Probability, Random Variables, and Stochastic Processes
Miller, I. (1966) · Technometrics · doi:10.1080/00401706.1966.10490365 · Cited by 8,452
Spectral Analysis and its Applications.
Freiberger, W. F., Jenkins, G. M., & Watts, D. G. (1969) · Journal of the American Statistical Association · doi:10.2307/2286100 · Cited by 4,981
Extrapolation, Interpolation, and Smoothing of Stationary Time Series: With Engineering Applications
Wiener, N. (1949) · The MIT Press eBooks · doi:10.7551/mitpress/2946.001.0001 · Cited by 4,826
Information Theory and Reliable Communication
Bell, D. A. (1969) · Electronics and Power · doi:10.1049/ep.1969.0319 · Cited by 4,012
Information Theory and an Extension of the Maximum Likelihood Principle
Akaike, H. (1992) · Springer Series in Statistics · doi:10.1007/978-1-4612-0919-5_38 · Cited by 3,028
Singular value decomposition and least squares solutions
Golub, G. H., & Reinsch, C. (1970) · Numerische Mathematik · doi:10.1007/bf02163027 · Cited by 2,929
A First Course in Numerical Analysis
Maisel, H., & Ralston, A. (1966) · Technometrics · doi:10.1080/00401706.1966.10490393 · Cited by 2,560
Hannan, E. J. (1970) · Wiley Series in Probability and Statistics · doi:10.1002/9780470316429 · Cited by 2,369
Random data: Analysis and measurement procedures
Braun, S. (1987) · Mechanical Systems and Signal Processing · doi:10.1016/0888-3270(87)90088-4 · Cited by 2,359
Time Series Analysis Forecasting and Control
Bartholomew, D. J. (1971) · Journal of the Operational Research Society · doi:10.1057/jors.1971.52 · Cited by 1,792
Computational Methods of Linear Algebra
H., A. S., Faddeev, D. K., & Faddeeva, V. N. (1964) · Mathematics of Computation · doi:10.2307/2003785 · Cited by 1,599
Toeplitz Forms and Their Applications
Grenander, U., & Szego, G. (1958) · University of California Press eBooks · doi:10.1525/9780520355408 · Cited by 1,526
System identification—A survey
Åström, K. J., & Eykhoff, P. (1971) · Automatica · doi:10.1016/0005-1098(71)90059-8 · Cited by 1,495
Speech Analysis Synthesis and Perception
Flanagan, J. L. (1972) · doi:10.1007/978-3-662-01562-9 · Cited by 1,469
Maximum likelihood identification of Gaussian autoregressive moving average models
AKAIKE, H. (1973) · Biometrika · doi:10.1093/biomet/60.2.255 · Cited by 1,444
Schweppe, F. C. (1973) · Medical Entomology and Zoology · Cited by 1,275
Yule, G. U. (1927) · Philosophical Transactions of the Royal Society of London. Series A, Containing Papers of a Mathematical or Physical Character · doi:10.1098/rsta.1927.0007 · Cited by 1,275
The Statistical Analysis of Time Series.
Priestley, M. B., & Anderson, T. W. (1972) · Journal of the Royal Statistical Society. Series A (General) · doi:10.2307/2344686 · Cited by 1,269
Statistical predictor identification
Akaike, H. (1970) · Annals of the Institute of Statistical Mathematics · doi:10.1007/bf02506337 · Cited by 1,250
Statistical Predictor Identification
Akaike, H. (1998) · Springer Series in Statistics · doi:10.1007/978-1-4612-1694-0_11 · Cited by 1,213
Speech Analysis and Synthesis by Linear Prediction of the Speech Wave
Atal, B. S., & Hanauer, S. L. (1971) · The Journal of the Acoustical Society of America · doi:10.1121/1.1912679 · Cited by 1,209
System Identification Parameter and State Estimation
Eykhoff, P. (1974) · Virtual Defense Library (Ministerio de Defensa) · Cited by 1,083
The Fitting of Time-Series Models
Durbin, J. (1960) · Revue de l'Institut International de Statistique / Review of the International Statistical Institute · doi:10.2307/1401322 · Cited by 1,056
Widrow, B., Mantey, P. E., Griffiths, L. J., & Goode, B. B. (1967) · Proceedings of the IEEE · doi:10.1109/proc.1967.6092 · Cited by 1,051
Gold, B., & Rader, C. M. (1969) · CERN Document Server (European Organization for Nuclear Research) · Cited by 940
An exact recursion for the composite nearest-neighbor degeneracy for a 2×N lattice space
McQuistan, R. B., & Hock, J. L. (1984) · Journal of Mathematical Physics · doi:10.1063/1.526133 · Cited by 924
On the Statistical Treatment of Linear Stochastic Difference Equations
Mann, H. B., & Wald, A. (1943) · Econometrica · doi:10.2307/1905674 · Cited by 757
A view of three decades of linear filtering theory
Kailath, T. (1974) · IEEE Transactions on Information Theory · doi:10.1109/tit.1974.1055174 · Cited by 702
Buehler, R. J., & Wilde, D. J. (1965) · Econometrica · doi:10.2307/1909808 · Cited by 695
Torrieri, D. J. (1979) · doi:10.21236/ada082999 · Cited by 651
On the asymptotic eigenvalue distribution of Toeplitz matrices
Gray, R. (1972) · IEEE Transactions on Information Theory · doi:10.1109/tit.1972.1054924 · Cited by 526
Nonlinear filtering of multiplied and convolved signals
Oppenheim, A. V., Schafer, R. W., & Stockham, T. G. (1968) · Proceedings of the IEEE · doi:10.1109/proc.1968.6570 · Cited by 506
What is the fast Fourier transform?
Cochran, W., Cooley, J., Favin, D., Helms, H., Kaenel, R., Lang, W., Maling, G., Nelson, D., Rader, C., & Welch, P. (1967) · IEEE Transactions on Audio and Electroacoustics · doi:10.1109/tau.1967.1161899 · Cited by 490
Modern techniques of power spectrum estimation
Bingham, C., Godfrey, M., & Tukey, J. (1967) · IEEE Transactions on Audio and Electroacoustics · doi:10.1109/tau.1967.1161895 · Cited by 426
EFFICIENT ESTIMATION OF PARAMETERS IN MOVING-AVERAGE MODELS
DURBIN, J. (1959) · Biometrika · doi:10.1093/biomet/46.3-4.306 · Cited by 401
WHITTLE, P. (1963) · Biometrika · doi:10.1093/biomet/50.1-2.129 · Cited by 398
Power spectrum estimation through autoregressive model fitting
Akaike, H. (1969) · Annals of the Institute of Statistical Mathematics · doi:10.1007/bf02532269 · Cited by 394
The Relationship Between Maximum Entropy Spectra And Maximum Likelihood Spectra
Burg, J. P. (1972) · Geophysics · doi:10.1190/1.1440265 · Cited by 387
On periodicity in series of related terms
Walker, G. T. (1931) · Proceedings of the Royal Society of London. Series A, Containing Papers of a Mathematical and Physical Character · doi:10.1098/rspa.1931.0069 · Cited by 381
Predictive decomposition of time series with application to seismic exploration
Robinson, E. A. (1967) · Geophysics · doi:10.1190/1.1439873 · Cited by 365
Åström, K. J. (1972) · Lecture notes in mathematics · doi:10.1007/bfb0064933 · Cited by 346
Statistical Analysis of Stationary Time-Series.
Bartlett, M. S., Grenander, U., & Rosenblatt, M. (1957) · Journal of the Royal Statistical Society Series A (General) · doi:10.2307/2343106 · Cited by 313
Alternative interpretation of maximum entropy spectral analysis (Corresp.)
van den Bos, A. (1971) · IEEE Transactions on Information Theory · doi:10.1109/tit.1971.1054660 · Cited by 267
Multichannel Time Series Analysis with Digital Computer Programs.
Healy, M. J. R., & Robinson, E. A. (1968) · Journal of the Royal Statistical Society. Series A (General) · doi:10.2307/2343738 · Cited by 267
Direct estimation of the vocal tract shape by inverse filtering of acoustic speech waveforms
Wakita, H. (1973) · IEEE Transactions on Audio and Electroacoustics · doi:10.1109/tau.1973.1162506 · Cited by 261
Adaptive Predictive Coding of Speech Signals
Atal, B. S., & Schroeder, M. R. (1970) · Bell System Technical Journal · doi:10.1002/j.1538-7305.1970.tb04297.x · Cited by 256
Digital inverse filtering-a new tool for formant trajectory estimation
Markel, J. (1972) · IEEE Transactions on Audio and Electroacoustics · doi:10.1109/tau.1972.1162367 · Cited by 165
Spectral analysis of EEG's by autoregressive decomposition of time series
Gersch, W. (1970) · Mathematical Biosciences · doi:10.1016/0025-5564(70)90049-0 · Cited by 150
Gray, A., & Markel, J. D. (1974) · IEEE Transactions on Acoustics Speech and Signal Processing · doi:10.1109/tassp.1974.1162572 · Cited by 145
Digital representations of speech signals
Schafer, R. W., & Rabiner, L. R. (1975) · Proceedings of the IEEE · doi:10.1109/proc.1975.9799 · Cited by 143
Improved quantizer for adaptive predictive coding of speech signals at low bit rates
Atal, B. S., & Schroeder, M. R. (2005) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp.1980.1170967 · Cited by 129
Eliaš, P. (1955) · IEEE Transactions on Information Theory · doi:10.1109/tit.1955.1055116 · Cited by 95
A Survey of Maximum Likelihood Estimation
Norden, R. H. (1972) · International Statistical Review · doi:10.2307/1402471 · Cited by 89
Estimation of power spectra with finite-order autoregressive models
Gersch, W., & Sharpe, D. (1973) · IEEE Transactions on Automatic Control · doi:10.1109/tac.1973.1100350 · Cited by 83
A spectral characterization of the ill-conditioning in numerical deconvolution
Ekstrom, M. P. (1973) · IEEE Transactions on Audio and Electroacoustics · doi:10.1109/tau.1973.1162493 · Cited by 72
On estimating the orders of an autoregressive moving-average process with uncertain observations
Chow, J. (1972) · IEEE Transactions on Automatic Control · doi:10.1109/tac.1972.1100122 · Cited by 61
Image Data Compression by Predictive Coding I: Prediction Algorithms
Kobayashi, H., & Bahl, L. R. (1974) · IBM Journal of Research and Development · doi:10.1147/rd.182.0164 · Cited by 55
Mathematical simulation of the electroencephalogram using an autoregressive series
Fenwick, P. B. C., Michie, P. T., Dollimore, J., & Fenton, G. W. (1971) · International Journal of Bio-Medical Computing · doi:10.1016/0020-7101(71)90005-5 · Cited by 38
The theoretical analysis of data compression systems
Davisson, L. (1968) · Proceedings of the IEEE · doi:10.1109/proc.1968.6212 · Cited by 33
An optimal discrete window for the calculation of power spectra
Eberhard, A. (1973) · IEEE Transactions on Audio and Electroacoustics · doi:10.1109/tau.1973.1162426 · Cited by 31
Research works printed but not linked: 60
- geronimus, 1961, Orthogonal Polynomials
- 10.1109/TAU.1973.1162433 · doi:10.1109/tau.1973.1162433
- 10.1121/1.1909942 · doi:10.1121/1.1909942
- 10.1147/rd.52.0141 · doi:10.1147/rd.52.0141
- 10.1190/1.1440342 · doi:10.1190/1.1440342
- itakura, 1968, Analysis synthesis telephony based on the maximum likelihood method, Repts 6th Int Congr Acoustics
- itakura, 1970, A statistical method for estimation of speech spectral density and formant frequencies, Electron Commun Japan, 53 a, 36
- kunz, 1957, Numerical Analysis
- kolmogorov, 1941, Interpolation und Extrapolation von station�ren zuf�lligen Folgen, Bull Acad Sci U S S R Math Ser, 5, 3
- itakura, 1972, On the optimum quantization of feature parameters in the Parcor speech synthesizer, IEEE Conf Rec 1972 Conf Speech Communication and Processing, 434
- itakura, 1971, Digital filtering techniques for speech analysis and synthesis, Conf Rec 7th Int Congr Acoust
- hildebrand, 1956, Introduction to Numerical Values
- 10.1109/PROC.1967.5481 · doi:10.1109/proc.1967.5481
- hannan, 1960, Time Series Analysis
- 10.1121/1.1912957 · doi:10.1121/1.1912957
- 10.1109/TCOM.1973.1091782 · doi:10.1109/tcom.1973.1091782
- 10.1109/MC.1974.6323525 · doi:10.1109/mc.1974.6323525
- levinson, 1947, The Wiener RMS (root mean square) error criterion in filter design and prediction, J Math Phys, 25, 261, 10.1002/sapm1946251261 · doi:10.1002/sapm1946251261
- 10.1080/00207177108931940 · doi:10.1080/00207177108931940
- 10.1109/TCS.1974.1083791 · doi:10.1109/tcs.1974.1083791
- 10.1109/TAC.1968.1098950 · doi:10.1109/tac.1968.1098950
- matsui, 1972, An adaptive method for speech analysis based on Kalman filtering theory, Bull Electrotech Lab, 36, 42
- oppenheim, 1973, Pole-zero modeling using cepstral prediction, 157
- 10.2307/1402786 · doi:10.2307/1402786
- 10.2307/2346277 · doi:10.2307/2346277
- lee, 1964, Optimal Estimation Identification and Control
- 10.1109/TAU.1973.1162470 · doi:10.1109/tau.1973.1162470
- makhoul, 1974, Selective linear prediction and analysis-by-synthesis in speech analysis
- makhoul, 1972, Linear prediction and the spectral analysis of speech
- makhoul, 1974, Quantization Properties of Transmission Parameters in Linear Predictive Systems, 10.21236/ADA108350 · doi:10.21236/ada108350
- mark, 1970, Spectral analysis of the convolution and filtering of non-stationary stochastic processes, J Sound Vib, 19, 10.1016/S0022-460X(70)80106-7 · doi:10.1016/s0022-460x(70)80106-7
- 10.1109/TAU.1973.1162440 · doi:10.1109/tau.1973.1162440
- 10.1145/321075.321076 · doi:10.1145/321075.321076
- tribolet, 1974, Identification of linear discrete systems with applications to speech processing
- 10.1109/TAC.1967.1098544 · doi:10.1109/tac.1967.1098544
- wiener, 1949, Extrapolation Interpolation and Smoothing of Stationary Time Series with Engineering Applications, 10.7551/mitpress/2946.001.0001 · DOI · Paper page
- szeg�, 1959, Orthogonal Polynomials, xxiii
- 10.1109/TIT.1957.1057413 · doi:10.1109/tit.1957.1057413
- whittle, 1963, Prediction and Regulation by Linear Least Square Methods
- 10.1190/1.1439855 · doi:10.1190/1.1439855
- 10.2307/2333753 · doi:10.2307/2333753
- whittle, 1954, A Study in the Analysis of Stationary Time Series
- 10.1016/0013-4694(71)90167-2 · doi:10.1016/0013-4694(71)90167-2
- 10.1007/978-3-662-39778-7 · doi:10.1007/978-3-662-39778-7
- wold, 1954, A Study in the Analysis of Stationary Time Series
- wilkinson, 1967, The solution of ill-conditioned linear equations, Mathematical Methods for Digital Computers, 65
- 10.1175/1520-0493(1931)59<277:OPISOR>2.0.CO;2 · doi:10.1175/1520-0493(1931)59<277:opisor>2.0.co;2
- wang, 1971, Optimum window length for the measurement of time-varying power spectra, J Acoust Soc Amer, 52, 33, 10.1121/1.1913074 · doi:10.1121/1.1913074
- bartlett, 1956, An Introduction to Stochastic Processes with Special Reference to Methods and Applications
- blackman, 1958, The Measurement of Power Spectra
- 10.1147/rd.173.0194 · doi:10.1147/rd.173.0194
- boll, 1973, A priori digital speech analysis
- ralston, 1967, Mathematical Methods for Digital Computers, ii
- 10.1109/TAU.1970.1162093 · doi:10.1109/tau.1970.1162093
- 10.1109/PROC.1973.9151 · doi:10.1109/proc.1973.9151
- wood, 0, Seismic signal processing, 649
- wold, 1965, Bibliography on Time Series and Stochastic Processes
- 10.1109/TAU.1972.1162405 · doi:10.1109/tau.1972.1162405
- robinson, 1967, Statistical Communication and Detection
- robinson, 1973, The Robinson Treitel Reader
Cited by
A tutorial on hidden Markov models and selected applications in speech recognition
Rabiner, L. R. (1989) · Proceedings of the IEEE · doi:10.1109/5.18626 · Cited by 22,743
Spectrum analysis—A modern perspective
Kay, S. M., & Marple, S. L. (1981) · Proceedings of the IEEE · doi:10.1109/proc.1981.12184 · Cited by 3,146
Godara, L. C. (1997) · Proceedings of the IEEE · doi:10.1109/5.622504 · Cited by 2,073
A Tutorial on Hidden Markov Models and Selected Applications in Speech Recognition
RABINER, L. R. (1990) · Readings in Speech Recognition · doi:10.1016/b978-0-08-051584-7.50027-9 · Cited by 1,869
The Geneva Minimalistic Acoustic Parameter Set (GeMAPS) for Voice Research and Affective Computing
Eyben, F., Scherer, K. R., Schuller, B. W., Sundberg, J., Andre, E., Busso, C., Devillers, L. Y., Epps, J., Laukka, P., Narayanan, S. S., et al. (2016) · IEEE Transactions on Affective Computing · doi:10.1109/taffc.2015.2457417 · Cited by 1,818
Metadata
- Authors
- Makhoul, J.
- Venue
- Proceedings of the IEEE
- Published
- 1975
- Volume
- 63
- Issue
- 4
- Pages
- 561-580
- ISSN
- 0018-9219 (ISSN-L)
- OpenAlex
- W1966264494
- Cited by
- 4,023
- References
- 63
- FWCI
- 50.59
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.