The DOI matches its Crossref record; 15 of the 15 references it cites were found in a registry or an index.
Cross-Validation and the Estimation of Conditional Probability Densities
Open accessAbstract
Many practical problems, especially some connected with forecasting, require nonparametric estimation of conditional densities from mixed data. For example, given an explanatory data vector X for a prospective customer, with components that could include the customer's salary, occupation, age, sex, marital status, and address, a company might wish to estimate the density of the expenditure, Y, that could be made by that person, basing the inference on observations of (X, Y) for previous clients. Choosing appropriate smoothing parameters for this problem can be tricky, not in the least because plug-in rules take a particularly complex form in the case of mixed data. An obvious difficulty is that there exists no general formula for the optimal smoothing parameters. More insidiously, and more seriously, it can be difficult to determine which components of X are relevant to the problem of conditional inference. For example, if the jth component of X is independent of Y, then that component is irrelevant to estimating the density of Y given X, and ideally should be dropped before conducting inference. In this article we show that cross-validation overcomes these difficulties. It automatically determines which components are relevant and which are not, through assigning large smoothing parameters to the latter and consequently shrinking them toward the uniform distribution on the respective marginals. This effectively removes irrelevant components from contention, by suppressing their contribution to estimator variance; they already have very small bias, a consequence of their independence of Y. Cross-validation also yields important information about which components are relevant; the relevant components are precisely those that cross-validation has chosen to smooth in a traditional way, by assigning them smoothing parameters of conventional size. Indeed, cross-validation produces asymptotically optimal smoothing for relevant components, while eliminating irrelevant components by oversmoothing. In the problem of nonparametric estimation of a conditional density, cross-validation comes into its own as a method with no obvious peers.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
The Statistical Analysis of Failure Time Data.
Aitkin, M., Kalbfleisch, J. D., & Prentice, R. L. (1981) · Biometrics · doi:10.2307/2530581 · Cited by 9,877
Martingale Limit Theory and its Application.
Loynes, R. M., Hall, P., & Heyde, C. C. (1984) · Journal of the Royal Statistical Society. Series A (General) · doi:10.2307/2981599 · Cited by 2,685
Self-citationEfficient Estimation of Average Treatment Effects Using the Estimated Propensity Score
Hirano, K., Imbens, G. W., & Ridder, G. (2003) · Econometrica · doi:10.1111/1468-0262.00442 · Cited by 2,355
Friedman, J. H., & Stuetzle, W. (1981) · Journal of the American Statistical Association · doi:10.1080/01621459.1981.10477729 · Cited by 2,216
Smoothing Methods in Statistics
Yandell, B. S. (1997) · Technometrics · doi:10.1080/00401706.1997.10485134 · Cited by 1,295
Mroz, T. A. (1987) · Econometrica · doi:10.2307/1911029 · Cited by 1,003
Hahn, J. (1998) · Econometrica · doi:10.2307/2998560 · Cited by 996
Semiparametric Estimation of Index Coefficients
Powell, J. L., Stock, J. H., & Stoker, T. M. (1989) · Econometrica · doi:10.2307/1913713 · Cited by 936
An alternative method of cross-validation for the smoothing of density estimates
BOWMAN, A. W. (1984) · Biometrika · doi:10.1093/biomet/71.2.353 · Cited by 934
An Efficient Semiparametric Estimator for Binary Response Models
Klein, R. W., & Spady, R. H. (1993) · Econometrica · doi:10.2307/2951556 · Cited by 759
Empirical Choice of Histograms and Kernel Density Estimators
Rudemo, M. (1982) · Cited by 719
Multivariate binary discrimination by the kernel method
AITCHISON, J., & AITKEN, C. G. G. (1976) · Biometrika · doi:10.1093/biomet/63.3.413 · Cited by 579
An Asymptotically Optimal Window Selection Rule for Kernel Density Estimates
Stone, C. J. (1984) · The Annals of Statistics · doi:10.1214/aos/1176346792 · Cited by 410
Large Sample Optimality of Least Squares Cross-Validation in Density Estimation
Hall, P. (1983) · The Annals of Statistics · doi:10.1214/aos/1176346329 · Cited by 240
Self-citationProjection Pursuit Density Estimation
Friedman, J. H., Stuetzle, W., & Schroeder, A. (1984) · Journal of the American Statistical Association · doi:10.1080/01621459.1984.10478086 · Cited by 234
Cited by
Liu, L., Oza, S., Hogan, D., Chu, Y., Perin, J., Zhu, J., Lawn, J. E., Cousens, S., Mathers, C., & Black, R. E. (2016) · The Lancet · doi:10.1016/s0140-6736(16)31593-8 · Cited by 3,453
Gneiting, T., & Katzfuss, M. (2014) · Annual Review of Statistics and Its Application · doi:10.1146/annurev-statistics-062713-085831 · Cited by 888
Broadstock, D. C., Matousek, R., Meyer, M., & Tzeremes, N. G. (2020) · Journal of Business Research · doi:10.1016/j.jbusres.2019.07.014 · Cited by 439
A Family of Nonparametric Density Estimation Algorithms
Tabak, E. G., & Turner, C. V. (2013) · Communications on Pure and Applied Mathematics · doi:10.1002/cpa.21423 · Cited by 346
The performance of estimators based on the propensity score
Huber, M., Lechner, M., & Wunsch, C. (2013) · Journal of Econometrics · doi:10.1016/j.jeconom.2012.11.006 · Cited by 311
Metadata
- Authors
- Hall, P., Racine, J., & Li, Q.
- Venue
- Journal of the American Statistical Association
- Publisher
- Informa UK Limited
- Published
- 2004-12
- Volume
- 99
- Issue
- 468
- Pages
- 1015-1026
- ISSN
- 0162-1459 (ISSN-L)
- 1537-274X
- OpenAlex
- W1987315804
- Cited by
- 487
- References
- 15
- FWCI
- 9.51
- Type
- journal article
- Language
- en
- Open access
- bronze
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.