The DOI matches its Crossref record; 83 of the 83 references it cites were found in a registry or an index.
Recent Developments in Nonparametric Density Estimation
Abstract
Advances in computation and the fast and cheap computational facilities now available to statisticians have had a significant impact upon statistical research, and especially the development of nonparametric data analysis procedures. In particular, theoretical and applied research on nonparametric density estimation has had a noticeable influence on related topics, such as nonparametric regression, nonparametric discrimination, and nonparametric pattern recognition. This article reviews recent developments in nonparametric density estimation and includes topics that have been omitted from review articles and books on the subject. The early density estimation methods, such as the histogram, kernel estimators, and orthogonal series estimators are still very popular, and recent research on them is described. Different types of restricted maximum likelihood density estimators, including order-restricted estimators, maximum penalized likelihood estimators, and sieve estimators, are discussed, where restrictions are imposed upon the class of densities or on the form of the likelihood function. Nonparametric density estimators that are data-adaptive and lead to locally smoothed estimators are also discussed; these include variable partition histograms, estimators based on statistically equivalent blocks, nearest-neighbor estimators, variable kernel estimators, and adaptive kernel estimators. For the multivariate case, extensions of methods of univariate density estimation are usually straightforward but can be computationally expensive. A method of multivariate density estimation that did not spring from a univariate generalization is described, namely, projection pursuit density estimation, in which both dimensionality reduction and density estimation can be pursued at the same time. Finally, some areas of related research are mentioned, such as nonparametric estimation of functionals of a density, robust parametric estimation, semiparametric models, and density estimation for censored and incomplete data, directional and spherical data, and density estimation for dependent sequences of observations.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Density Estimation for Statistics and Data Analysis
Silverman, B. W. (2018) · Routledge eBooks · doi:10.1201/9781315140919 · Cited by 15,796
Introduction to Statistical Pattern Recognition
(1990) · Elsevier eBooks · doi:10.1016/c2009-0-27872-x · Cited by 11,031
On Estimation of a Probability Density Function and Mode
Parzen, E. (1962) · The Annals of Mathematical Statistics · doi:10.1214/aoms/1177704472 · Cited by 10,585
Remarks on Some Nonparametric Estimates of a Density Function
Rosenblatt, M. (1956) · The Annals of Mathematical Statistics · doi:10.1214/aoms/1177728190 · Cited by 4,547
Devijver, P. A., & Kittler, J. (1982) · Prentice-Hall International eBooks · Cited by 2,910
On optimal and data-based histograms
SCOTT, D. W. (1979) · Biometrika · doi:10.1093/biomet/66.3.605 · Cited by 1,819
A Projection Pursuit Algorithm for Exploratory Data Analysis
Friedman, J. H., & Tukey, J. W. (1974) · IEEE Transactions on Computers · doi:10.1109/t-c.1974.224051 · Cited by 1,652
Order Restricted Statistical Inference.
Santner, T., Robertson, T., Wright, F. T., & Dykstra, R. L. (1990) · Journal of the American Statistical Association · doi:10.2307/2289813 · Cited by 1,586
Statistical Inference Under Order Restrictions
Kalbfleisch, J. D. (1975) · Technometrics · doi:10.1080/00401706.1975.10489288 · Cited by 1,546
Spline Smoothing and Nonparametric Regression.
Jones, M. C., & Eubank, R. L. (1989) · Journal of the Royal Statistical Society. Series A (Statistics in Society) · doi:10.2307/2982831 · Cited by 1,031
Using Kernel Density Estimates to Investigate Multimodality
Silverman, B. W. (1981) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1981.tb01155.x · Cited by 1,007
An alternative method of cross-validation for the smoothing of density estimates
BOWMAN, A. W. (1984) · Biometrika · doi:10.1093/biomet/71.2.353 · Cited by 934
Statistical Inference under Order Restrictions (The Theory and Application of Isotonic Regression)
Vincze, I., Barlow, R. E., Bartholomew, D. J., Bremner, J. M., & Brunk, H. D. (1973) · International Statistical Review / Revue Internationale de Statistique · doi:10.2307/1402630 · Cited by 842
Exploratory Projection Pursuit
Friedman, J. H. (1987) · Journal of the American Statistical Association · doi:10.1080/01621459.1987.10478427 · Cited by 794
Nonparametric Density Estimation: The L 1 View.
Thompson, J. R., Devroye, L., & Györfi, L. (1987) · Journal of the American Statistical Association · doi:10.2307/2289176 · Cited by 784
Nonparametric Functional Estimation
(1983) · Elsevier eBooks · doi:10.1016/c2013-0-11326-8 · Cited by 783
A Nonparametric Estimate of a Multivariate Density Function
Loftsgaarden, D. O., & Quesenberry, C. P. (1965) · The Annals of Mathematical Statistics · doi:10.1214/aoms/1177700079 · Cited by 781
Minimum Hellinger Distance Estimates for Parametric Models
Beran, R. (1977) · The Annals of Statistics · doi:10.1214/aos/1176343842 · Cited by 741
A Statistical Perspective on Ill-Posed Inverse Problems
O'Sullivan, F. (1986) · Statistical Science · doi:10.1214/ss/1177013525 · Cited by 670
Estimation of a multivariate density
Cacoullos, T. (1966) · Annals of the Institute of Statistical Mathematics · doi:10.1007/bf02869528 · Cited by 654
On Bandwidth Variation in Kernel Estimates-A Square Root Law
Abramson, I. S. (1982) · The Annals of Statistics · doi:10.1214/aos/1176345986 · Cited by 646
Comparison of Data-Driven Bandwidth Selectors
Park, B. U., & Marron, J. S. (1990) · Journal of the American Statistical Association · doi:10.1080/01621459.1990.10475307 · Cited by 503
A Course in Density Estimation.
Jones, M. C., & Devroye, L. (1988) · Journal of the Royal Statistical Society. Series A (Statistics in Society) · doi:10.2307/2982771 · Cited by 503
Variable Kernel Estimates of Multivariate Densities
Breiman, L., Meisel, W., & Purcell, E. (1977) · Technometrics · doi:10.1080/00401706.1977.10489521 · Cited by 488
Biased and Unbiased Cross-Validation in Density Estimation
Scott, D. W., & Terrell, G. R. (1987) · Journal of the American Statistical Association · doi:10.1080/01621459.1987.10478550 · Cited by 484
Kernels for Nonparametric Curve Estimation
Gasser, T., MÜller, H.-G., & Mammitzsch, V. (1985) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1985.tb01350.x · Cited by 470
Nonparametric probability density estimation
Tapia, R. A., & Thompson, J. (1978) · Cited by 454
On the theory of mortality measurement
Grenander, U. (1956) · Scandinavian Actuarial Journal · doi:10.1080/03461238.1956.10414944 · Cited by 423
Non-parametric Roughness Penalty for Probability Densities
GOOD, I. J. (1971) · Nature Physical Science · doi:10.1038/physci229029a0 · Cited by 411
An Asymptotically Optimal Window Selection Rule for Kernel Density Estimates
Stone, C. J. (1984) · The Annals of Statistics · doi:10.1214/aos/1176346792 · Cited by 410
Nonparametric methods in statistics.
Fraser, D. A. S. (1956) · John Wiley & Sons, Inc. eBooks · doi:10.1037/13191-000 · Cited by 403
Nonparametric Maximum Likelihood Estimation by the Method of Sieves
Geman, S., & Hwang, C.-R. (1982) · The Annals of Statistics · doi:10.1214/aos/1176345782 · Cited by 367
Algorithm AS 176: Kernel Density Estimation Using the Fast Fourier Transform
Silverman, B. W. (1982) · Applied Statistics · doi:10.2307/2347084 · Cited by 306
On the Estimation of a Probability Density Function by the Maximum Penalized Likelihood Method
Silverman, B. W. (1982) · The Annals of Statistics · doi:10.1214/aos/1176345872 · Cited by 305
Multivariate k-nearest neighbor density estimates
Mack, Y. P., & Rosenblatt, M. (1979) · Journal of Multivariate Analysis · doi:10.1016/0047-259x(79)90065-4 · Cited by 297
The Maximal Smoothing Principle in Density Estimation
Terrell, G. R. (1990) · Journal of the American Statistical Association · doi:10.1080/01621459.1990.10476223 · Cited by 295
Sheather, S. J., & Marron, J. S. (1990) · Journal of the American Statistical Association · doi:10.1080/01621459.1990.10476214 · Cited by 290
Review Papers: Recent Developments in Nonparametric Density Estimation
Izenman, A. J. (1991) · Journal of the American Statistical Association · doi:10.1080/01621459.1991.10475021 · Cited by 281
Self-citationAveraged Shifted Histograms: Effective Nonparametric Density Estimators in Several Dimensions
Scott, D. W. (1985) · The Annals of Statistics · doi:10.1214/aos/1176349654 · Cited by 277
Good, I. J., & Gaskins, R. A. (1980) · Journal of the American Statistical Association · doi:10.1080/01621459.1980.10477419 · Cited by 255
The bootstrap: To smooth or not to smooth?
SILVERMAN, B. W., & YOUNG, G. A. (1987) · Biometrika · doi:10.1093/biomet/74.3.469 · Cited by 243
Nonparametric Probability Density Estimation: I. A Summary of Available Methods
Wegman, E. J. (1972) · Technometrics · doi:10.1080/00401706.1972.10488943 · Cited by 237
Projection Pursuit Density Estimation
Friedman, J. H., Stuetzle, W., & Schroeder, A. (1984) · Journal of the American Statistical Association · doi:10.1080/01621459.1984.10478086 · Cited by 234
Estimation of Probability Density by an Orthogonal Series
Schwartz, S. C. (1967) · The Annals of Mathematical Statistics · doi:10.1214/aoms/1177698795 · Cited by 232
On Kullback-Leibler Loss and Density Estimation
Hall, P. (1987) · The Annals of Statistics · doi:10.1214/aos/1176350606 · Cited by 218
WATSON, G. S., & LEADBETTER, M. R. (1964) · Biometrika · doi:10.1093/biomet/51.1-2.175 · Cited by 212
Minimum Hellinger Distance Estimation for the Analysis of Count Data
Simpson, D. G. (1987) · Journal of the American Statistical Association · doi:10.1080/01621459.1987.10478501 · Cited by 210
The Estimation of the Hazard Function from Randomly Censored Data by the Kernel Method
Tanner, M. A., & Wong, W. H. (1983) · The Annals of Statistics · doi:10.1214/aos/1176346265 · Cited by 207
Groeneboom, P. (1984) · Centrum Wiskunde & Informatica (CWI), the national research institute for mathematics and computer science in the Netherlands · Cited by 195
An Extension of Wilks' Method for Setting Tolerance Limits
Wald, A. (1943) · The Annals of Mathematical Statistics · doi:10.1214/aoms/1177731491 · Cited by 193
Spline Transformations: Three New Diagnostic Aids for the Statistical Data-Analyst
Boneva, L. I., Kendall, D., & Stefanov, I. (1971) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1971.tb00855.x · Cited by 189
On the Smoothing of Probability Density Functions
Whittle, P. (1958) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1958.tb00298.x · Cited by 188
Estimation of entropy and other functionals of a multivariate density
Joe, H. (1989) · Annals of the Institute of Statistical Mathematics · doi:10.1007/bf00057735 · Cited by 177
Canonical kernels for density estimation
Marron, J. S., & Nolan, D. (1988) · Statistics & Probability Letters · doi:10.1016/0167-7152(88)90050-8 · Cited by 176
Density Estimation, Stochastic Processes and Prior Information
Leonard, T. (1978) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1978.tb01655.x · Cited by 174
Tukey, J. W. (1947) · The Annals of Mathematical Statistics · doi:10.1214/aoms/1177730343 · Cited by 173
Philatelic Mixtures and Multimodal Densities
Izenman, A. J., & Sommer, C. J. (1988) · Journal of the American Statistical Association · doi:10.1080/01621459.1988.10478683 · Cited by 163
Self-citationWahba, G. (1975) · The Annals of Statistics · doi:10.1214/aos/1176342997 · Cited by 161
A Smooth Nonparametric Estimator of a Quantile Function
Yang, S. (1985) · Journal of the American Statistical Association · doi:10.1080/01621459.1985.10478217 · Cited by 155
Speed of Estimation in Positron Emission Tomography and Related Inverse Problems
Johnstone, I. M., & Silverman, B. W. (1990) · The Annals of Statistics · doi:10.1214/aos/1176347500 · Cited by 142
Comparative Effects of Aging and Coronary Heart Disease on Submaximal and Maximal Exercise
Kasser, I. S., & Bruce, R. A. (1969) · Circulation · doi:10.1161/01.cir.39.6.759 · Cited by 125
Consistency Properties of Nearest Neighbor Density Function Estimators
Moore, D. S., & Yackel, J. W. (1977) · The Annals of Statistics · doi:10.1214/aos/1176343747 · Cited by 120
Consistent Cross-Validated Density Estimation
Chow, Y. S., Geman, S., & Wu, L.-D. (1983) · The Annals of Statistics · doi:10.1214/aos/1176346053 · Cited by 109
Kernel estimators of density function of directional data
Bai, Z., Rao, C. R., & Zhao, L. C. (1988) · Journal of Multivariate Analysis · doi:10.1016/0047-259x(88)90113-3 · Cited by 104
Random approximations to some measures of accuracy in nonparametric curve estimation
Marron, J. S., & Härdle, W. K. (1986) · Journal of Multivariate Analysis · doi:10.1016/0047-259x(86)90021-7 · Cited by 98
Data-Based Optimal Smoothing of Orthogonal Series Density Estimates
Wahba, G. (1981) · The Annals of Statistics · doi:10.1214/aos/1176345341 · Cited by 98
Smooth Estimates for the Hazard Function
Anderson, J. A. D. W., & Senthilselvan, A. (1980) · Journal of the Royal Statistical Society Series B (Statistical Methodology) · doi:10.1111/j.2517-6161.1980.tb01130.x · Cited by 98
Discretized and Interpolated Kernel Density Estimates
Jones, M. C. (1989) · Journal of the American Statistical Association · doi:10.1080/01621459.1989.10478827 · Cited by 85
On stochastic complexity and nonparametric density estimation
Hall, P. M., & Hannan, E. J. (1988) · Biometrika · doi:10.1093/biomet/75.4.705 · Cited by 75
An Asymptotically Efficient Solution to the Bandwidth Problem of Kernel Density Estimation
Marron, J. S. (1985) · The Annals of Statistics · doi:10.1214/aos/1176349653 · Cited by 73
Density Ratios, Empirical Likelihood and Cot Death
Silverman, B. W. (1978) · Journal of the Royal Statistical Society Series C (Applied Statistics) · doi:10.2307/2346222 · Cited by 72
A histogram method of density estimation
Ryzin, J. V. (1973) · Communications in Statistics · doi:10.1080/03610927308827093 · Cited by 69
Beran, R. J. (1977) · The Annals of Statistics · doi:10.1214/aos/1176343841 · Cited by 67
Developments in Nonparametric Density Estimation
Bean, S. J., & Tsokos, C. P. (1980) · International Statistical Review · doi:10.2307/1402941 · Cited by 67
Nonparametric estimates of probability densities
Wagner, T. J. (1975) · IEEE Transactions on Information Theory · doi:10.1109/tit.1975.1055408 · Cited by 65
Scott, D. W., Gotto, A. M., Cole, J. S., & Gorry, G. A. (1978) · Journal of Chronic Diseases · doi:10.1016/0021-9681(78)90049-8 · Cited by 63
On the Nonconsistency of Maximum Likelihood Nonparametric Density Estimators
Schuster, E. F., & Gregory, G. G. (1981) · Springer eBooks · doi:10.1007/978-1-4613-9464-8_43 · Cited by 62
Statistical Density Estimation: A Survey.
Lii, K., & Wertz, W. (1980) · Journal of the American Statistical Association · doi:10.2307/2287421 · Cited by 54
On the Rate of Convergence of Orthogonal Series Density Estimators
Hall, P. M. (1986) · Journal of the Royal Statistical Society Series B (Statistical Methodology) · doi:10.1111/j.2517-6161.1986.tb01396.x · Cited by 35
The Consistency of Automatic Kernel Density Estimates
Devroye, L., & Penrod, C. S. (1984) · The Annals of Statistics · doi:10.1214/aos/1176346789 · Cited by 29
Friedman, J. H., & Stuetzle, W. (1982) · Elsevier eBooks · doi:10.1016/b978-0-12-438180-3.50013-x · Cited by 27
Schafer, H. (1985) · The Annals of Statistics · doi:10.1214/aos/1176349560 · Cited by 24
A Note on Density Estimation Using Orthogonal Expansions
Crain, B. R. (1973) · Journal of the American Statistical Association · doi:10.1080/01621459.1973.10481455 · Cited by 14
Cited by
Jenkinson, M., Bannister, P., Brady, M., & Smith, S. (2002) · NeuroImage · doi:10.1006/nimg.2002.1132 · Cited by 11,888
A global optimisation method for robust affine registration of brain images
Jenkinson, M., & Smith, S. (2001) · Medical Image Analysis · doi:10.1016/s1361-8415(01)00036-6 · Cited by 6,872
Estimating Continuous Distributions in Bayesian Classifiers
John, G. H., & Langley, P. (2013) · arXiv (Cornell University) · doi:10.48550/arxiv.1302.4964 · Cited by 2,885
Violin Plots: A Box Plot-Density Trace Synergism
Hintze, J. L., & Nelson, R. D. (1998) · The American Statistician · doi:10.1080/00031305.1998.10480559 · Cited by 1,802
Hengl, T. (2006) · Computers & Geosciences · doi:10.1016/j.cageo.2005.11.008 · Cited by 840
Metadata
- Authors
- Izenman, A. J.
- Venue
- Journal of the American Statistical Association
- Publisher
- JSTOR
- Published
- 1991-03
- Volume
- 86
- Issue
- 413
- Pages
- 205
- ISSN
- 0162-1459 (ISSN-L)
- OpenAlex
- W2141620354
- Cited by
- 464
- References
- 83
- FWCI
- 9.80
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.