The DOI matches its Crossref record; 11 of the 11 references it cites were found in a registry or an index.
A Note on the Use of Principal Components in Regression
Abstract
The use of principal components in regression has received a lot of attention in the literature in the past few years, and the topic is now beginning to appear in textbooks. Along with the use of principal component regression there appears to have been a growth in the misconception that the principal components with small eigenvalues will very rarely be of any use in regression. The purpose of this note is to demonstrate that these components can be as important as those with large variance. This is illustrated with four examples, three of which have already appeared in the literature.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
A Biometrics Invited Paper. The Analysis and Selection of Variables in Linear Regression
Hocking, R. R. (1976) · Biometrics · doi:10.2307/2529336 · Cited by 1,765
(1977) · CERN Document Server (European Organization for Nuclear Research) · Cited by 1,548
Principal Components Regression in Exploratory Statistical Research
Massy, W. F. (1965) · Journal of the American Statistical Association · doi:10.1080/01621459.1965.10480787 · Cited by 830
A Course in Multivariate Analysis.
Bargmann, R. E., & Kendall, M. G. (1958) · Journal of the American Statistical Association · doi:10.2307/2282056 · Cited by 546
Two Case Studies in the Application of Principal Component Analysis
Jeffers, J. N. R. (1967) · Applied Statistics · doi:10.2307/2985919 · Cited by 448
Regression Analysis and Its Application: A Data-Oriented Approach
Mack, G. A., Gunst, R. F., & Mason, R. L. (1981) · Technometrics · doi:10.2307/1267800 · Cited by 273
A Critique of Some Ridge Regression Methods
Smith, G., & Campbell, F. (1980) · Journal of the American Statistical Association · doi:10.1080/01621459.1980.10477428 · Cited by 212
THE RELATIONS OF THE NEWER MULTIVARIATE STATISTICAL METHODS TO FACTOR ANALYSIS
Hotelling, H. (1957) · British Journal of Statistical Psychology · doi:10.1111/j.2044-8317.1957.tb00179.x · Cited by 169
On the Investigation of Alternative Regressions by Principal Component Analysis
Hawkins, D. M. (1973) · Journal of the Royal Statistical Society Series C (Applied Statistics) · doi:10.2307/2346776 · Cited by 110
An Analytic Variable Selection Technique for Principal Component Regression
Mansfield, E. R., Webster, J. T., & Gunst, R. F. (1977) · Journal of the Royal Statistical Society Series C (Applied Statistics) · doi:10.2307/2346865 · Cited by 74
Cited by
An Intercomparison of Methods for Finding Coupled Patterns in Climate Data
Bretherton, C. S., Smith, C., & Wallace, J. M. (1992) · Journal of Climate · doi:10.1175/1520-0442(1992)005<0541:aiomff>2.0.co;2 · Cited by 1,549
Data Mining and Analytics in the Process Industry: The Role of Machine Learning
Ge, Z., Song, Z., Ding, S. X., & Huang, B. (2017) · IEEE Access · doi:10.1109/access.2017.2756872 · Cited by 922
“variable on the explanatory variables directly, the principal components of the explanatory variables which are extracted by the PCA method are used as regressors [129].”
MethodGeeleher, P., Cox, N. J., & Huang, R. S. (2014) · Genome Biology · doi:10.1186/gb-2014-15-3-r47 · Cited by 890
Kernel partial least squares regression in reproducing kernel hilbert space
Rosipal, R., & Trejo, L. J. (2002) · doi:10.5555/944790.944806 · Cited by 873
Multivariate Data Analysis in Chemistry
Wold, S., Albano, C., Dunn, W. J., Edlund, U., Esbensen, K., Geladi, P., Hellberg, S., Johansson, E., Lindberg, W., & Sjöström, M. (1984) · Chemometrics · doi:10.1007/978-94-017-1026-8_2 · Cited by 617
Regression, Prediction and Shrinkage
Copas, J. B. (1983) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1983.tb01258.x · Cited by 612
The Effect of Multiplicative Scatter Correction (MSC) and Linearity Improvement in NIR Spectroscopy
Isaksson, T., & Næs, T. (1988) · Applied Spectroscopy · doi:10.1366/0003702884429869 · Cited by 600
Modern Koopman Theory for Dynamical Systems
Brunton, S. L., Budišić, M., Kaiser, E., & Kutz, J. N. (2022) · SIAM Review · doi:10.1137/21m1401243 · Cited by 576
On the structure of partial least squares regression
Helland, I. S. (1988) · Communications in Statistics - Simulation and Computation · doi:10.1080/03610918808812681 · Cited by 559
Stone, M., & Brooks, R. J. (1990) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1990.tb01786.x · Cited by 542
Mass spectrometry-based metabolomics in microbiome investigations
Bauermeister, A., Mannochio-Russo, H., Costa-Lotufo, L. V., Jarmusch, A. K., & Dorrestein, P. C. (2022) · Nature Reviews Microbiology · doi:10.1038/s41579-021-00621-9 · Cited by 525
Higgins-Chen, A. T., Thrush, K. L., Wang, Y., Minteer, C. J., Kuo, P.-L., Wang, M., Niimi, P., Sturm, G., Lin, J., Moore, A. Z., et al. (2022) · Nature Aging · doi:10.1038/s43587-022-00248-2 · Cited by 502
Activity flow over resting-state networks shapes cognitive task activations
Cole, M. W., Ito, T., Bassett, D. S., & Schultz, D. H. (2016) · Nature Neuroscience · doi:10.1038/nn.4406 · Cited by 489
Partial least squares analysis with cross‐validation for the two‐class problem: A Monte Carlo study
Ståhle, L., & Wold, S. (1987) · Journal of Chemometrics · doi:10.1002/cem.1180010306 · Cited by 487
Simple rules for passive diffusion through the nuclear pore complex
Timney, B. L., Raveh, B., Mironska, R., Trivedi, J. M., Kim, S. J., Russel, D., Wente, S. R., Sali, A., & Rout, M. P. (2016) · Journal of Cell Biology · doi:10.1083/jcb.201601004 · Cited by 457
Spatial, temporal, and socioeconomic patterns in the use of Twitter and Flickr
Li, L., Goodchild, M. F., & Xu, B. (2013) · Cartography and Geographic Information Science · doi:10.1080/15230406.2013.777139 · Cited by 419
Analysis of two partial-least-squares algorithms for multivariate calibration
Manne, R. (1987) · Chemometrics and Intelligent Laboratory Systems · doi:10.1016/0169-7439(87)80096-5 · Cited by 350
Digital medicine and the curse of dimensionality
Berisha, V., Krantsevich, C., Hahn, P. R., Hahn, S., Dasarathy, G., Turaga, P., & Liss, J. (2021) · npj Digital Medicine · doi:10.1038/s41746-021-00521-5 · Cited by 344
Townsend, C. R., Dolédec, S., Norris, R., Peacock, K., & Arbuckle, C. (2003) · Freshwater Biology · doi:10.1046/j.1365-2427.2003.01043.x · Cited by 309
Fisher Lecture: Dimension Reduction in Regression
Cook, R. D. (2007) · Statistical Science · doi:10.1214/088342306000000682 · Cited by 283
Shallow neural networks for fluid flow reconstruction with limited sensors
Erichson, N. B., Mathelin, L., Yao, Z., Brunton, S. L., Mahoney, M. W., & Kutz, J. N. (2020) · Proceedings of the Royal Society A: Mathematical, Physical and Engineering Sciences · doi:10.1098/rspa.2020.0097 · Cited by 259
Enhancing Explainability of Neural Networks Through Architecture Constraints
Yang, Z., Zhang, A., & Sudjianto, A. (2021) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2020.3007259 · Cited by 106
Stone, J. R., Avants, B. B., Tustison, N. J., Wassermann, E. M., Gill, J., Polejaeva, E., Dell, K. C., Carr, W., Yarnell, A. M., LoPresti, M. L., et al. (2020) · Journal of Neurotrauma · doi:10.1089/neu.2020.7141 · Cited by 81
Liu, Z., Barnett, I., & Lin, X. (2020) · The Annals of Applied Statistics · doi:10.1214/19-aoas1312 · Cited by 7
Metadata
- Authors
- Jolliffe, I. T.
- Venue
- Applied Statistics
- Publisher
- JSTOR
- Published
- 1982
- Volume
- 31
- Issue
- 3
- Pages
- 300
- ISSN
- 0035-9254 (ISSN-L)
- OpenAlex
- W2740586183
- Cited by
- 829
- References
- 11
- FWCI
- 5.21
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.