The DOI matches its Crossref record; 31 of the 31 references it cites were found in a registry or an index.
Dimension Reduction by Local Principal Component Analysis
Abstract
Reducing or eliminating statistical redundancy between the components of high-dimensional vector data enables a lower-dimensional representation without significant loss of information. Recognizing the limitations of principal component analysis (PCA), researchers in the statistics and neural network communities have developed nonlinear extensions of PCA. This article develops a local linear approach to dimension reduction that provides accurate representations and is fast to compute. We exercise the algorithms on speech and image data, and compare performance with PCA and with neural network implementations of nonlinear PCA. We find that both nonlinear techniques can provide more accurate representations than PCA and show that the local linear techniques outperform neural network implementations.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Multilayer feedforward networks are universal approximators
Hornik, K., Stinchcombe, M., & White, H. (1989) · Neural Networks · doi:10.1016/0893-6080(89)90020-8 · Cited by 21,728
Numerical Recipes, The Art of Scientific Computing
Press, W. H., Flannery, B. P., Teukolsky, S. A., Vetterling, W. T., & Gould, H. (1987) · American Journal of Physics · doi:10.1119/1.14981 · Cited by 10,024
Multilayer feedforward networks are universal approximators
HornikK., StinchcombeM., & WhiteH. (1989) · Neural Networks · doi:10.5555/70405.70408 · Cited by 9,081
Vector Quantization and Signal Compression
Gersho, A., & Gray, R. M. (1992) · Springer eBooks · doi:10.1007/978-1-4615-3626-0 · Cited by 7,003
Locally Weighted Regression: An Approach to Regression Analysis by Local Fitting
Cleveland, W. S., & Devlin, S. J. (1988) · Journal of the American Statistical Association · doi:10.1080/01621459.1988.10478639 · Cited by 5,742
On the approximate realization of continuous mappings by neural networks
Funahashi, K.-I. (1989) · Neural Networks · doi:10.1016/0893-6080(89)90003-8 · Cited by 4,206 · cited 1×
“By the universal approximation theorem for single hidden-layer sigmoidal nets (Funahashi, 1989; Hornik, Stinchcombe, & White, 1989), any continuous composition of immersion and projection (on compact domain) can be approximated arbitrarily closely by the structure.”
BackgroundThe JPEG still picture compression standard
Wallace, G. K. (1991) · Communications of the ACM · doi:10.1145/103085.103089 · Cited by 3,784
Detection of signals by information theoretic criteria
Wax, M., & Kailath, T. (1985) · IEEE Transactions on Acoustics, Speech, and Signal Processing · doi:10.1109/tassp.1985.1164557 · Cited by 3,426
Nonlinear principal component analysis using autoassociative neural networks
Kramer, M. A. (1991) · AIChE Journal · doi:10.1002/aic.690370209 · Cited by 3,037
Gray, R. M. (1990) · Readings in Speech Recognition · doi:10.1016/b978-0-08-051584-7.50011-5 · Cited by 2,845
Simplified neuron model as a principal component analyzer
Oja, E. (1982) · Journal of Mathematical Biology · doi:10.1007/bf00275687 · Cited by 2,309 · cited 1×
“A neural network implementation of one-dimensional PCA implemented by Hebb learning was introduced by Oja (1982) and expanded to hierarchical, multidimensional PCA by Sanger (1989), Kung and Diemantaras (1990), and Rubner and Tavan (1989).”
MethodNeural networks and principal component analysis: Learning from examples without local minima
Baldi, P., & Hornik, K. (1989) · Neural Networks · doi:10.1016/0893-6080(89)90014-2 · Cited by 1,383
Auto-association by multilayer perceptrons and singular value decomposition
Bourlard, H., & Kamp, Y. (1988) · Biological Cybernetics · doi:10.1007/bf00332918 · Cited by 1,345
Hastie, T., & Stuetzle, W. (1989) · Journal of the American Statistical Association · doi:10.1080/01621459.1989.10478797 · Cited by 1,249
NEURAL NETWORKS, PRINCIPAL COMPONENTS, AND SUBSPACES
Oja, E. (1989) · International Journal of Neural Systems · doi:10.1142/s0129065789000475 · Cited by 821
SEXNET: A Neural Network Identifies Sex From Human Faces
Golomb, B. A., Lawrence, D. T., & Sejnowski, T. J. (1990) · neural information processing systems · Cited by 483
A novelty detection approach to classification
Japkowicz, N., Myers, C. E., & Gluck, M. A. (1995) · Cited by 412
An Algorithm for Finding Intrinsic Dimensionality of Data
Fukunaga, K., & Olsen, D. R. (1971) · IEEE Transactions on Computers · doi:10.1109/t-c.1971.223208 · Cited by 343
Non-Linear Dimensionality Reduction
DeMers, D., & Cottrell, G. W. (1992) · neural information processing systems · Cited by 249
A Self-Organizing Network for Principal-Component Analysis
Rubner, J., & Tavan, P. (1989) · Europhysics Letters (EPL) · doi:10.1209/0295-5075/10/7/015 · Cited by 237
EMPATH: Face, Emotion, and Gender Recognition Using Holons
Cottrell, G. W., & Metcalfe, J. (1990) · neural information processing systems · Cited by 231
A neural network learning algorithm for adaptive principal component extraction (APEX)
Kung, S. Y., & Diamantaras, K. I. (2002) · International Conference on Acoustics, Speech, and Signal Processing · doi:10.1109/icassp.1990.115975 · Cited by 163
Replicator Neural Networks for Universal Optimal Source Coding
Hecht-Nielsen, R. (1995) · Science · doi:10.1126/science.269.5232.1860 · Cited by 134
Note on Learning Rate Schedules for Stochastic Optimization
Darken, C. J., & Moody, J. E. (1990) · neural information processing systems · Cited by 134
Optimally adaptive transform coding
Dony, R. D., & Haykin, S. (1995) · IEEE Transactions on Image Processing · doi:10.1109/83.465101 · Cited by 105
An Optimality Principle for Unsupervised Learning
Sanger, T. D. (1988) · Cited by 104
Fast Non-Linear Dimension Reduction
Kambhatla, N., Leen, T. K., Kambhatla, A., & Leen, T. K. (n.d.) · Cited by 99
Self-citationRecognizing Handwritten Digits Using Mixtures of Linear Models
Hinton, G. E., Revow, M. D., & Dayan, P. (1994) · Cited by 97
On Langevin Updating in Multilayer Perceptrons
Rognvaldsson, T. S. (1994) · Neural Computation · doi:10.1162/neco.1994.6.5.916 · Cited by 56
A Neural Network Autoassociator for Induction Motor Failure Prediction
Petsche, T., Marcantonio, A., Darken, C. J., Hanson, S. J., Kuhn, G. M., & Santoso, N. I. (1995) · neural information processing systems · Cited by 42
Topology and Geometry of Single Hidden Layer Network, Least Squares Weight Solutions
Coetzee, F. M., & Stonick, V. L. (1995) · Neural Computation · doi:10.1162/neco.1995.7.4.672 · Cited by 11
Cited by
Reducing the dimensionality of data with neural networks
Hinton, G. E., & Salakhutdinov, R. R. (2006) · Science · doi:10.1126/science.1127647 · Cited by 20,928
Nonlinear Dimensionality Reduction by Locally Linear Embedding
Roweis, S. T., & Saul, L. K. (2000) · Science · doi:10.1126/science.290.5500.2323 · Cited by 14,965
Mixtures of Probabilistic Principal Component Analyzers
Tipping, M. E., & Bishop, C. M. (1999) · Neural Computation · doi:10.1162/089976699300016728 · Cited by 1,873
Feature Selection for Unsupervised Learning
Dy, J., & Brodley, C. E. (2004) · doi:10.5555/1005332.1016787 · Cited by 885
RM-MEDA: A Regularity Model-Based Multiobjective Estimation of Distribution Algorithm
Zhang, Q., Zhou, A., & Jin, Y. (2008) · IEEE Transactions on Evolutionary Computation · doi:10.1109/tevc.2007.894202 · Cited by 827
Metadata
- Authors
- Kambhatla, N., & Leen, T. K.
- Venue
- Neural Computation
- Publisher
- MIT Press - Journals
- Published
- 1997-10-01
- Volume
- 9
- Issue
- 7
- Pages
- 1493-1516
- ISSN
- 0899-7667 (ISSN-L)
- 1530-888X
- OpenAlex
- W2121122425
- Cited by
- 717
- References
- 31
- FWCI
- 9.22
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.