The DOI matches its Crossref record; 47 of the 47 references it cites were found in a registry or an index.
Iterative kernel principal component analysis for image modeling
Abstract
In recent years, Kernel Principal Component Analysis (KPCA) has been suggested for various image processing tasks requiring an image model such as, e.g., denoising or compression. The original form of KPCA, however, can be only applied to strongly restricted image classes due to the limited number of training examples that can be processed. We therefore propose a new iterative method for performing KPCA, the Kernel Hebbian Algorithm which iteratively estimates the Kernel Principal Components with only linear order memory complexity. In our experiments, we compute models for complex image classes such as faces and natural images which require a large number of training examples. The resulting image models are tested in single-frame super-resolution and denoising applications. The KPCA model is not specifically tailored to these tasks; in fact, the same model can be used in super-resolution with variable input resolution, or denoising with unknown noise characteristics. In spite of this, both super-resolution and denoising performance are comparable to existing methods.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Neural Networks: A Comprehensive Foundation
Haykin, S. (1998) · Cited by 30,070
Learning with Kernels: Support Vector Machines, Regularization, Optimization, and Beyond
Schölkopf, B., & Smola, A. J. (2001) · The MIT Press eBooks · doi:10.7551/mitpress/4175.001.0001 · Cited by 11,703
Nonlinear Component Analysis as a Kernel Eigenvalue Problem
Schölkopf, B., Smola, A., & Müller, K.-R. (1998) · Neural Computation · doi:10.1162/089976698300017467 · Cited by 8,084
Emergence of simple-cell receptive field properties by learning a sparse code for natural images
Olshausen, B. A., & Field, D. J. (1996) · Nature · doi:10.1038/381607a0 · Cited by 5,694
Face recognition using eigenfaces
Turk, M. A., & Pentland, A. P. (2002) · Proceedings. 1991 IEEE Computer Society Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.1991.139758 · Cited by 5,197
From few to many: illumination cone models for face recognition under variable lighting and pose
Georghiades, A. S., Belhumeur, P. N., & Kriegman, D. J. (2001) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.927464 · Cited by 4,912
Cubic convolution interpolation for digital image processing
Keys, R. (1981) · IEEE Transactions on Acoustics, Speech, and Signal Processing · doi:10.1109/tassp.1981.1163711 · Cited by 3,255
Fisher discriminant analysis with kernels
Mika, S., Ratsch, G., Weston, J., Scholkopf, B., & Mullers, K. R. (2003) · Neural Networks for Signal Processing IX: Proceedings of the 1999 IEEE Signal Processing Society Workshop (Cat. No.98TH8468) · doi:10.1109/nnsp.1999.788121 · Cited by 2,661
Self-citationExample-based super-resolution
Freeman, W. T., Jones, T. R., & Pasztor, E. C. (2002) · IEEE Computer Graphics and Applications · doi:10.1109/38.988747 · Cited by 2,498
Simplified neuron model as a principal component analyzer
Oja, E. (1982) · Journal of Mathematical Biology · doi:10.1007/bf00275687 · Cited by 2,309
The “independent components” of natural scenes are edge filters
Bell, A. J., & Sejnowski, T. J. (1997) · Vision Research · doi:10.1016/s0042-6989(97)00121-1 · Cited by 2,201
Hertzmann, A., Jacobs, C. E., Oliver, N., Curless, B., & Salesin, D. H. (2001) · Proceedings of the 28th annual conference on Computer graphics and interactive techniques · doi:10.1145/383259.383295 · Cited by 1,518
Optimal unsupervised learning in a single-layer linear feedforward neural network
Sanger, T. D. (1989) · Neural Networks · doi:10.1016/0893-6080(89)90044-0 · Cited by 1,509
Freeman, W. T., Pasztor, E. C., & Carmichael, O. T. (2000) · International Journal of Computer Vision · doi:10.1023/a:1026501619075 · Cited by 1,459
Gupta, R. P. (1991) · Remote Sensing Geology · doi:10.1007/978-3-662-12914-2_12 · Cited by 1,425
Limits on super-resolution and how to break them
Baker, S., & Kanade, T. (2002) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2002.1033210 · Cited by 1,205
Limits on super-resolution and how to break them
Baker, S., & Kanade, T. (2002) · Proceedings IEEE Conference on Computer Vision and Pattern Recognition. CVPR 2000 (Cat. No.PR00662) · doi:10.1109/cvpr.2000.854852 · Cited by 1,184
What Is the Goal of Sensory Coding?
Field, D. J. (1994) · Neural Computation · doi:10.1162/neco.1994.6.4.559 · Cited by 1,183
Contour and Texture Analysis for Image Segmentation
Malik, J., Belongie, S., Leung, T., & Shi, J. (2001) · International Journal of Computer Vision · doi:10.1023/a:1011174803800 · Cited by 1,089
Kernel PCA and De-Noising in Feature Spaces
Mika, S., Schölkopf, B., Smola, A. J., Müller, K., Scholz, M., & Rätsch, G. (1998) · Cited by 888
Cristianini, N., Kandola, J., Elisseeff, A., & Shawe-Taylor, J. (2006) · Studies in Fuzziness and Soft Computing · doi:10.1007/3-540-33486-6_8 · Cited by 837
Principal components, minor components, and linear neural networks
Oja, E. (1992) · Neural Networks · doi:10.1016/s0893-6080(05)80089-9 · Cited by 814
Learning Kernel Classifiers: Theory and Algorithms
Herbrich, R. (2001) · The MIT Press eBooks · doi:10.7551/mitpress/4170.001.0001 · Cited by 547
A kernel view of the dimensionality reduction of manifolds
Ham, J., Lee, D. D., Mika, S., & Schölkopf, B. (2004) · Twenty-first international conference on Machine learning - ICML '04 · doi:10.1145/1015330.1015417 · Cited by 532
Image compression via joint statistical characterization in the wavelet domain
Buccigrossi, R. W., & Simoncelli, E. P. (1999) · IEEE Transactions on Image Processing · doi:10.1109/83.806616 · Cited by 523
An Equivalence Between Sparse Approximation and Support Vector Machines
Girosi, F. (1998) · Neural Computation · doi:10.1162/089976698300017269 · Cited by 506
Cristianini, N., Shawe-Taylor, J., Elisseeff, A., & Kandola, J. (2002) · Advances in Neural Information Processing Systems 14 · doi:10.7551/mitpress/1120.003.0052 · Cited by 474
The Pre-Image Problem in Kernel Methods
Kwok, J. T.-Y., & Tsang, I. W.-H. (2004) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.2004.837781 · Cited by 437
Simplified support vector decision rules
Burges, C. J. C. (1996) · Cited by 427
Pizurica, A., & Philips, W. (2006) · IEEE Transactions on Image Processing · doi:10.1109/tip.2005.863698 · Cited by 411
Origins of scaling in natural images
Ruderman, D. L. (1997) · Vision Research · doi:10.1016/s0042-6989(97)00008-4 · Cited by 355
Model Selection for Support Vector Machines
Chapelle, O., & Vapnik, V. N. (1999) · Cited by 355
Prior learning and Gibbs reaction-diffusion
Zhu, S. C., & Mumford, D. (1997) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.632983 · Cited by 319
Bayesian Denoising of Visual Images in the Wavelet Domain
Simoncelli, E. P. (1999) · Lecture Notes in Statistics · doi:10.1007/978-1-4612-0567-8_18 · Cited by 236
The principal components of natural images
Hancock, P., Baddeley, R., & Smith, L. S. (1992) · Network Computation in Neural Systems · doi:10.1088/0954-898x/3/1/008 · Cited by 233
Occlusion Models for Natural Images: A Statistical Study of a Scale-Invariant Dead Leaves Model
Lee, A. B., Mumford, D., & Huang, J. (2001) · International Journal of Computer Vision · doi:10.1023/a:1011109015675 · Cited by 229
(2000) · CrossRef Listing of Deleted DOIs · doi:10.1162/153244302760185252 · Cited by 212
A Multi-View Nonlinear Active Shape Model Using Kernel PCA
Romdhani, S., Gong, S., & Psarrou, A. (1999) · Procedings of the British Machine Vision Conference 1999 · doi:10.5244/c.13.48 · Cited by 211
Probability models for clutter in natural images
Grenander, U., & Srivastava, A. (2001) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.917579 · Cited by 126
Speech feature extraction using independent component analysis
Lee, J., Jung, H., Lee, T.-W., & Lee, S. Y. (2002) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp.2000.862023 · Cited by 99
A statistical analysis of natural images matches psychophysically derived orientation tuning curves
Baddeley, R., & Hancock, P. (1991) · Proceedings of the Royal Society B Biological Sciences · doi:10.1098/rspb.1991.0147 · Cited by 89
Global convergence of Oja's subspace algorithm for principal component extraction
Chen, T., Hua, Y., & Yan, W. (1998) · IEEE Transactions on Neural Networks · doi:10.1109/72.655030 · Cited by 75
Kernel Principal Component Analysis and the construction of non-linear Active Shape Models
Twining, C., & Taylor, C. (2001) · British Machine Vision Conference (BMVC) · doi:10.5244/c.15.4 · Cited by 69
Image Feature Extraction Using Independent Component Analysis
Hurri, J., Hyvärinen, A., Karhunen, J., & Erkki Oja, A. (1996) · Cited by 51
Bounds on Error Expectation for SVM
Vapnik, V. N., & Chapelle, O. (2000) · The MIT Press eBooks · doi:10.7551/mitpress/1113.003.0020 · Cited by 37
Kernel Hebbian Algorithm for Iterative Kernel Principal Component Analysis
Kim, K. I., Franz, M., & Schölkopf, B. (2003) · Lancaster EPrints (Lancaster University) · Cited by 23
Self-citationConvergence analysis for principal component flows
Yoshizawa, S., Helmke, U., & Starkov, K. E. (2001) · Cited by 15
Cited by
Single-Image Super-Resolution Using Sparse Regression and Natural Image Prior
Kim, K. I., & Kwon, Y. (2010) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2010.25 · Cited by 956
Kernel Mean Embedding of Distributions: A Review and Beyond
Muandet, K., Fukumizu, K., Sriperumbudur, B., & Schölkopf, B. (2017) · Foundations and Trends® in Machine Learning · doi:10.1561/2200000060 · Cited by 409
Support vector machines in engineering: an overview
Salcedo‐Sanz, S., Rojo‐Álvarez, J. L., Martínez‐Ramón, M., & Camps‐Valls, G. (2014) · WIREs Data Mining and Knowledge Discovery · doi:10.1002/widm.1125 · Cited by 301
Fusion of range and color images for denoising and resolution enhancement with a non-local filter
Huhle, B., Schairer, T., Jenke, P., & Straßer, W. (2010) · Computer Vision and Image Understanding · doi:10.1016/j.cviu.2009.11.004 · Cited by 116
Metadata
- Authors
- Kwa, Franz, M. O., & Scholkopf, B.
- Venue
- IEEE Transactions on Pattern Analysis and Machine Intelligence
- Published
- 2005-09
- Volume
- 27
- Issue
- 9
- Pages
- 1351-1366
- ISSN
- 0162-8828 (ISSN-L)
- OpenAlex
- W2169945149
- Cited by
- 306
- References
- 47
- FWCI
- 17.95
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.