The DOI matches its Crossref record; 1 of the 1 references it cites were found in a registry or an index.
Auto-association by multilayer perceptrons and singular value decomposition
Open accessAbstract
The multilayer perceptron, when working in auto-association mode, is sometimes considered as an interesting candidate to perform data compression or dimensionality reduction of the feature space in information processing applications. The present paper shows that, for auto-association, the nonlinearities of the hidden units are useless and that the optimal parameter values can be derived directly by purely linear techniques relying on singular value decomposition and low rank matrix approximation, similar in spirit to the well-known Karhunen-Loève transform. This approach appears thus as an efficient alternative to the general error back-propagation algorithm commonly used for training multilayer perceptrons. Moreover, it also gives a clear interpretation of the rôle of the different parameters.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Golub, G. (2012) · doi:10.56021/9781421407944 · Cited by 34,505
Research works printed but not linked: 13
- Ahmed N, Rao KR (1975) Orthogonal transforms for digital signal processing. Springer, New York Berlin Heidelberg · DOI · Paper page
- Bourlard H, Kamp Y, Wellekens CJ (1985) Speaker dependent connected speech recognition via phonemic Markov models. Proc ICASSP, pp 1213–1216
- Bunch JR, Nielsen CP (1978) Updating the singular value decomposition. Numer Math 31:111–129 · DOI · Paper page
- Cottrell GW, Munro PW, Zipser D (1988) Image compression by back propagation: a demonstration of extensional programming. In: Sharkey NE (ed) Advances in cognitive science, vol 2. Abbex, Norwood, (NJ) (in press)
- Delsarte P, Kamp Y (1988) Low rank matrices with a given sign pattern Philips Research Laboratory, Brussels SIAM J: (to be published) · DOI
- Elman JL, Zipser D (1987) Learning the hidden structure of speech. J Acoust Soc Am 83:1615–1626 · DOI · Paper page
- Golub GH (1968) Least squares, singular values and matrix approximations. Applikace Matematiky 13:44–51
- Harrison TD (1987) A Connectionist framework for continuous speech recognition. Cambridge University Ph. D. dissertation
- Lippmann RP (1987) An introduction to computing with neural nets. IEEE ASSP Magazine, pp 4–22 · DOI · Paper page
- Minsky M, Papert S (1969) Perceptrons. MIT Press, Cambridge
- Rumelhart DE, McClellarnd JL, and the PDP Research Group (1986) Parallel distributed processing. Exploration in the microstructure of cognition. vol 1–2. MIT Press, Cambridge · DOI · Paper page
- Rumelhart DE, Hinton GE, Williams RJ (1986) Learning internal representations by error propagation. In: Rumelhart DE, McClellan JL (eds) Parallel distributed processing. Exploration in the microstructure of cognition, vol 1. Foundations. MIT Press, Cambridge · DOI · Paper page
- Stewart GW (1973) Introduction to matrix computations. Academic Press, New York
Cited by
Representation Learning: A Review and New Perspectives
Bengio, Y., Courville, A., & Vincent, P. (2013) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2013.50 · Cited by 13,001
Deep learning in medical image analysis
Shen, D., Wu, G., & Suk, H.-I. (2017) · Annual Review of Biomedical Engineering · doi:10.1146/annurev-bioeng-071516-044442 · Cited by 4,968
Learning Deep Architectures for AI
Bengio, Y. (2009) · now publishers, Inc. eBooks · doi:10.1561/9781601982957 · Cited by 4,941
Neural Networks and the Bias/Variance Dilemma
Geman, S., Bienenstock, E., & Doursat, R. (1992) · Neural Computation · doi:10.1162/neco.1992.4.1.1 · Cited by 3,578
Deep learning for computer vision: A brief review
Voulodimos, A., Doulamis, N., Doulamis, A., & Protopapadakis, E. (2018) · Computational Intelligence and Neuroscience · doi:10.1155/2018/7068349 · Cited by 3,403
A survey of deep neural network architectures and their applications
Liu, W., Wang, Z., Liu, X., Zeng, N., Liu, Y., & Alsaadi, F. E. (2017) · Neurocomputing · doi:10.1016/j.neucom.2016.12.038 · Cited by 3,239
Unsupervised Learning of Visual Representations by Solving Jigsaw Puzzles
Noroozi, M., & Favaro, P. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46466-4_5 · Cited by 2,775
An Introduction to Variational Autoencoders
Kingma, D. P., & Welling, M. (2019) · Foundations and Trends® in Machine Learning · doi:10.1561/2200000056 · Cited by 2,609
Federated Learning in Mobile Edge Networks: A Comprehensive Survey
Lim, W. Y. B., Luong, N. C., Hoang, D. T., Jiao, Y., Liang, Y.-C., Yang, Q., Niyato, D., & Miao, C. (2020) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2020.2986024 · Cited by 2,565
Neural networks and principal component analysis: Learning from examples without local minima
Baldi, P., & Hornik, K. (1989) · Neural Networks · doi:10.1016/0893-6080(89)90014-2 · Cited by 1,383
Ahmed, R., Sreeram, V., Mishra, Y., & Arif, M. D. (2020) · Renewable and Sustainable Energy Reviews · doi:10.1016/j.rser.2020.109792 · Cited by 1,259
Wen, J., Thibeau-Sutre, E., Diaz-Melo, M., Samper-González, J., Routier, A., Bottani, S., Dormont, D., Durrleman, S., Burgos, N., & Colliot, O. (2020) · Medical Image Analysis · doi:10.1016/j.media.2020.101694 · Cited by 809
Fadlullah, Z. M., Tang, F., Mao, B., Kato, N., Akashi, O., Inoue, T., & Mizutani, K. (2017) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2017.2707140 · Cited by 810
Domain Generalization for Object Recognition with Multi-task Autoencoders
Ghifary, M., Kleijn, W. B., Zhang, M., & Balduzzi, D. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.293 · Cited by 664
Expert Gate: Lifelong Learning with a Network of Experts
Aljundi, R., Chakravarty, P., & Tuytelaars, T. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.753 · Cited by 619
Self-Supervised Video Representation Learning with Odd-One-Out Networks
Fernando, B., Bilen, H., Gavves, E., & Gould, S. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.607 · Cited by 421
Advances and opportunities in machine learning for process data analytics
Qin, S. J., & Chiang, L. H. (2019) · Computers & Chemical Engineering · doi:10.1016/j.compchemeng.2019.04.003 · Cited by 351
Ashraf, J., Bakhshi, A. D., Moustafa, N., Khurshid, H., Javed, A., & Beheshti, A. (2021) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2020.3017882 · Cited by 295
Generative Probabilistic Novelty Detection with Adversarial Autoencoders
Pidhorskyi, S., Almohsen, R., Adjeroh, D. A., & Doretto, G. (2018) · arXiv · doi:10.48550/arxiv.1807.02588 · Cited by 255
A Survey on Bayesian Deep Learning
Wang, H., & Yeung, D.-Y. (2021) · ACM Computing Surveys · doi:10.1145/3409383 · Cited by 247
Encoder Based Lifelong Learning
Rannen, A., Aljundi, R., Blaschko, M. B., & Tuytelaars, T. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.148 · Cited by 324
On the Expressive Power of Deep Architectures
Bengio, Y., & Delalleau, O. (2011) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-24412-4_3 · Cited by 182
Non-iterative and Fast Deep Learning: Multilayer Extreme Learning Machines
Zhang, J., Li, Y., Xiao, W., & Zhang, Z. (2020) · Journal of the Franklin Institute · doi:10.1016/j.jfranklin.2020.04.033 · Cited by 179
Tracing the evolution of AI in the past decade and forecasting the emerging trends
Shao, Z., Zhao, R., Yuan, S., Ding, M., & Wang, Y. (2022) · Expert Systems with Applications · doi:10.1016/j.eswa.2022.118221 · Cited by 153
esDNN: Deep Neural Network Based Multivariate Workload Prediction in Cloud Computing Environments
Xu, M., Song, C., Wu, H., Gill, S. S., Ye, K., & Xu, C. (2022) · ACM Transactions on Internet Technology · doi:10.1145/3524114 · Cited by 142
Molecular Insights from Conformational Ensembles via Machine Learning
Fleetwood, O., Kasimova, M. A., Westerlund, A. M., & Delemotte, L. (2020) · Biophysical Journal · doi:10.1016/j.bpj.2019.12.016 · Cited by 93
Free-riders in Federated Learning: Attacks and Defenses
Lin, J., Du, M., & Liu, J. (2019) · arXiv · doi:10.48550/arxiv.1911.12560 · Cited by 76
Tighter Variational Bounds are Not Necessarily Better
Rainforth, T., Kosiorek, A. R., Le, T. A., Maddison, C. J., Igl, M., Wood, F., & Teh, Y. W. (2018) · arXiv · doi:10.48550/arxiv.1802.04537 · Cited by 66
Deep learning applied to underwater mine warfare
Denos, K., Ravaut, M., Fagette, A., & Lim, H.-S. (2017) · OCEANS 2017 - Aberdeen · doi:10.1109/oceanse.2017.8084910 · Cited by 59
Diffusion Model as Representation Learner
Yang, X., & Wang, X. (2023) · 2023 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.01736 · Cited by 58
Learning tactile skills through curious exploration
Pape, L., Oddo, C. M., Controzzi, M., Cipriani, C., Förster, A., Carrozza, M. C., & Schmidhuber, J. (2012) · Frontiers in Neurorobotics · doi:10.3389/fnbot.2012.00006 · Cited by 51
Khayatian, F., Sarto, L., & Dall'O', G. (2017) · Applied Energy · doi:10.1016/j.apenergy.2017.08.237 · Cited by 40
EEG-based emotion recognition with autoencoder feature fusion and MSC-TimesNet model
Yin, J., Qiao, Z., Han, L., & Zhang, X. (2026) · Computer Methods in Biomechanics and Biomedical Engineering · doi:10.1080/10255842.2025.2477801 · Cited by 41
Kohiyama, M., Oka, K., & Yamashita, T. (2020) · Structural Control and Health Monitoring · doi:10.1002/stc.2552 · Cited by 38
Self-supervised learning with physics-aware neural networks – I. Galaxy model fitting
Aragon-Calvo, M. A., & Carvajal, J. C. (2020) · Monthly Notices of the Royal Astronomical Society · doi:10.1093/mnras/staa2228 · Cited by 17
An integrative approach for fine-mapping chromatin interactions
Jaroszewicz, A., & Ernst, J. (2020) · Bioinformatics · doi:10.1093/bioinformatics/btz843 · Cited by 7
Molecular insights from conformational ensembles via machine learning
(2019) · doi:10.1101/695254 · Cited by 6
Metadata
- Authors
- Bourlard, H., & Kamp, Y.
- Venue
- Biological Cybernetics
- Published
- 1988-09
- Volume
- 59
- Issue
- 4-5
- Pages
- 291-294
- ISSN
- 0340-1200 (ISSN-L)
- 1432-0770
- OpenAlex
- W2017257315
- Cited by
- 1,345
- References
- 1
- FWCI
- 11.18
- Type
- journal article
- Language
- en
- Open access
- green
- Licence
- www.springer.com/tdm (tdm)
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.
