Backpropagation
The DOI matches its Crossref record.
Abstract
Composed of three sections, this book presents the most popular training algorithm for neural networks: backpropagation. The first section presents the theory and principles behind backpropagation as seen from different perspectives such as statistics, machine learning, and dynamical systems. The second presents a number of network architectures that may be designed to match the general concepts of Parallel Distributed Processing with backpropagation learning. Finally, the third section shows how these principles can be applied to a number of different fields related to the cognitive sciences, including control, speech recognition, robotics, image processing, and cognitive psychology. The volume is designed to provide both a solid theoretical foundation and a set of examples that show the versatility of the concepts. Useful to experts in the field, it should also be most helpful to students seeking to understand the basic principles of connectionist learning and to engineers wanting to add neural networks in general -- and backpropagation in particular -- to their set of problem-solving methods.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Citations
Cites
Still being checked.
Cited by
Items 301–400 of 410
Convolutional neural network for clinical narrative categorization
Lauren, P., Qu, G., & Watta, P. B. (2017) · IEEE International Conference on Big Data (BigData) · doi:10.1109/bigdata.2017.8258146 · Cited by 5
DANTE: Deep alternations for training neural networks
Sinha, V. B., Kudugunta, S., Sankar, A. R., Chavali, S. T., & Balasubramanian, V. N. (2020) · Neural Networks · doi:10.1016/j.neunet.2020.07.026 · Cited by 6
Gómez, S. L. S., Riesgo, F. G., González-Gutiérrez, C., Rodríguez-Ramos, L. F., & Santos, J. (2020) · Mathematics · doi:10.3390/math9010015 · Cited by 5
Davarzani, S., Saucier, D. N., Talegaonkar, P., Parker, E., Turner, A. J., Middleton, C., Carroll, W., Ball, J. E., Gürbüz, A. C., Chander, H., et al. (2023) · Wearable Technologies · doi:10.1017/wtc.2023.3 · Cited by 5
Task Segmentation in a Mobile Robot by mnSOM and Clustering with Spatio-temporal Contiguity
Muslim, M. A., Ishikawa, M., & Furukawa, T. (2008) · Lecture notes in computer science · doi:10.1007/978-3-540-69162-4_112 · Cited by 5
The Sonda Project: Prevention, Prediction, and Psychological Disorder
Buscema, M. (1997) · Substance Use & Misuse · doi:10.3109/10826089709035469 · Cited by 5
Multimodal regression and mode recognition via an integrated deep neural network
Wang, D., Song, C., & Zhang, X. (2023) · IISE Transactions · doi:10.1080/24725854.2023.2223245 · Cited by 4
Games for Treating and Diagnosing Post Traumatic Stress Disorder
Holmgård, C., & Karstoft, K. (2016) · Socio-affective computing · doi:10.1007/978-3-319-41316-7_15 · Cited by 5
Utilizing symmetry in evolutionary design
Valsalam, V. K. (2010) · Texas ScholarWorks (Texas Digital Library) · Cited by 4
Location Agent: A Study Using Different Wireless Protocols for Indoor Localization
Neves, A. R. D. M. (2013) · International Journal of Wireless Communications and Mobile Computing · doi:10.11648/j.wcmc.20130101.11 · Cited by 4
Leveraging conscious and nonconscious learning for efficient AI
Clair, R. S., Coward, L. A., & Schneider, S. M. (2023) · Frontiers in Computational Neuroscience · doi:10.3389/fncom.2023.1090126 · Cited by 4
Non-linear RLS-based algorithm for pattern classification
Soria‐Olivas, E., Camps-Valls, G., Martín‐Guerrero, J. D., Calpe‐Maravilla, J., Vila‐Francés, J., & Serrano-López, A. J. (2005) · Signal Processing · doi:10.1016/j.sigpro.2005.09.004 · Cited by 4
Franco, D. P., Barboza, F. D., & Cardoso, N. M. (2022) · International Journal of Communication Networks and Information Security (IJCNIS) · doi:10.17762/ijcnis.v5i2.382 · Cited by 4
Anarado, I., Anam, M. A., Verdicchio, F., & Andreopoulos, Y. (2016) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2016.2589622 · Cited by 4
CESS-A System to Categorize Bangla Web Text Documents
Dhar, A., Mukherjee, H., Dash, N. S., & Roy, K. (2020) · ACM Transactions on Asian and Low-Resource Language Information Processing · doi:10.1145/3398070 · Cited by 4
LINEAR AND NON-LINEAR TECHNIQUES FOR ESTIMATING THE MONEY DEMAND FUNCTION: THE CASE OF SAUDI ARABIA
Alsahafi, M. (2009) · Cited by 4
Towards a Hybrid Model of First-Order Theory Refinement
Hallack, N. A., Zaverucha, G., & Barbosa, V. C. (2000) · Lecture notes in computer science · doi:10.1007/10719871_7 · Cited by 4
Jagapriya, J., & Annapoorani, G. (2011) · International Conference on Electronics Computer Technology · doi:10.1109/icectech.2011.5941661 · Cited by 3
Computational localization of transcription factor binding sites using extreme learning machines
Wang, D., & Do, H. T. (2012) · Soft Computing · doi:10.1007/s00500-012-0820-x · Cited by 3
Dual subspace learning via geodesic search on Stiefel manifold
Liu, L., Ge, R., Meng, J., & You, G. (2013) · International Journal of Machine Learning and Cybernetics · doi:10.1007/s13042-013-0217-x · Cited by 3
ARTIFICIAL NEURAL NETWORK TECHNIQUE FOR SOLVING ONE-DIMENSIONAL FRACTIONAL RAYLEIGH–STOKES EQUATION
AGHDAM, Y. E., MESGARANI, H., Bozorgi, S., Jafari, H., & Nguyen, V. T. (2025) · Fractals · doi:10.1142/s0218348x25401346 · Cited by 3
SpikeSynth: Energy-Efficient Adaptive Analog Printed Spiking Neural Networks
Pal, P., Studt, A., Gheshlaghi, T., Hefenbrock, M., Beigl, M., & Tahoori, M. B. (2025) · doi:10.1109/iccad66269.2025.11240803 · Cited by 3
Einführung in Künstliche Neuronale Netze
Zell, A. (1998) · Vieweg+Teubner eBooks · doi:10.1007/978-3-322-86843-5_1 · Cited by 3
Modeling, Analyzing, Identifying, and Synthesizing Expressive Popular Music Performances
Ramírez, R., Maestre, E., & Pérez, A. (2012) · Springer eBooks · doi:10.1007/978-1-4471-4123-5_5 · Cited by 3
Modeling of Reusability Estimation in Software Design with External Constraints
Selvarani, R., & Mangayarkarasi, P. (2017) · Computer communications and networks · doi:10.1007/978-3-319-54325-3_1 · Cited by 3
Peyret, R., AlSaeed, D., Khelifi, F., Al-Ghreimil, N., Al-Baity, H. H., & Bouridane, A. (2021) · JMIR Bioinformatics and Biotechnology · doi:10.2196/27394 · Cited by 3
Supervised Learning in Model Reference Adaptive Sliding Mode Control
Makke, O., & Lin, F. (2024) · International Journal of Control Automation and Systems · doi:10.1007/s12555-023-0761-4 · Cited by 3
From adaptive linear to information filtering
Príncipe, J. C., & Deniz Erdogmus, B. (2002) · IEEE Adaptive Systems for Signal Processing, Communications, and Control Symposium (AS-SPCC) · doi:10.1109/asspcc.2000.882454 · Cited by 3
MIMO radar pseudo-orthogonal waveform generation by a passive 1 ×Mmode-mixing microwave cavity
Kpré, E., Decroze, C., & Fromentèze, T. (2017) · International Journal of Microwave and Wireless Technologies · doi:10.1017/s175907871700023x · Cited by 3
A recognition approach using multilayer perceptron and keyboard dynamics patterns
Rezaei, A., & Mirzakuchaki, S. (2013) · Iranian Conference on Pattern Recognition and Image Analysis (PRIA) · doi:10.1109/pria.2013.6528445 · Cited by 3
An evolutionary computation approach to cognitive states classification
Ramírez, R., & Puiggròs, M. (2007) · IEEE Congress on Evolutionary Computation (CEC) · doi:10.1109/cec.2007.4424690 · Cited by 3
AnalogHTM: Memristive Spatial Pooler Learning with Backpropagation
Krestinskaya, O., & James, A. P. (2019) · IEEE International Conference on Artificial Intelligence Circuits and Systems (AICAS) · doi:10.1109/aicas.2019.8771628 · Cited by 3
Dense Broad Learning System with Proportional Integral Differential and Adaptive Moment Estimation
Zou, W., Xia, Y., & Cao, W. (2020) · International Conference on Machine Learning and Applications · doi:10.1109/icmla51294.2020.00103 · Cited by 3
CHAMELEON: A Deep Learning Meta-Architecture for News Recommender Systems [Phd. Thesis]Preprint
Moreira, G. D. S. P. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2001.04831 · Cited by 3
Using Artificial Intelligence to Verify Authorship of Anonymous Social Media Posts
Lagerholm, F. (2017) · DiVA (Mälardalen University College) · Cited by 3
Walker, I., Chakrapani, V., & Elmahboub, W. (2008) · Meteorological Applications · doi:10.1002/met.89 · Cited by 2
Exploring Artificial Neural Networks: A Data Complexity Perspective
Zorzi, L. P., & Lorena, A. C. (2019) · Brazilian Conference on Intelligent Systems · doi:10.1109/bracis.2019.00148 · Cited by 2
Multi-zone prediction analysis of city-scale travel order demand
Li, P., Chang, J., Zhang, Y., & Zhang, Y. (2021) · PLoS ONE · doi:10.1371/journal.pone.0248064 · Cited by 2
Dorado-Moreno, M., Sianes, A., & Hervás‐Martínez, C. (2015) · Quality & Quantity · doi:10.1007/s11135-015-0163-7 · Cited by 2
Improving the effectiveness of RBF classifier based on a hybrid cost function
Huang, D., & Chow, T. W. S. (2006) · Neural Computing and Applications · doi:10.1007/s00521-006-0063-9 · Cited by 2
Yahyazadehfar, M. (2012) · AFRICAN JOURNAL OF BUSINESS MANAGEMENT · doi:10.5897/ajbm11.1221 · Cited by 2
Venter, P., Venter, T., Luwes, N. J., de Smidt, O., & Lues, J. F. R. (2013) · Cited by 2
Emergence of Chaotic Time Series by Adversarial Imitation Learning
Yamazaki, S., Iizuka, H., & Yamamoto, M. (2018) · Conference on Artificial Life (ALIFE) · doi:10.1162/isal_a_00120 · Cited by 2
Köse, U., Deperlioğlu, Ö., Alzubi, J. A. A., & Pătruţ, B. (2020) · Studies in computational intelligence · doi:10.1007/978-981-15-6325-6_7 · Cited by 2
Iterative Global Sensitivity Analysis Algorithm with Neural Network Surrogate Modeling
Liu, Y., Nagawkar, J. R., Leifsson, L., Koziel, S. M., & Pietrenko‐Dabrowska, A. (2021) · Lecture notes in computer science · doi:10.1007/978-3-030-77970-2_23 · Cited by 2
Lakshmi, K. P., & Subadra, M. (2012) · Cited by 2
Al‐Khateeb, B. (2011) · Nottingham ePrints (University of Nottingham) · Cited by 2
Topic-aware chatbot using Recurrent Neural Networks and Nonnegative Matrix FactorizationPreprint
Guo, Y., Hanoian, N., Lin, Z., Liskij, N., Lyu, H., Needell, D. M., Qu, J., Sojico, H., Wang, Y., Xiong, Z., et al. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1912.00315 · Cited by 2
A Neural Network-Enabled OTFS-PAPR Reduction with Low Computational Complexity
Al-Rayif, M. I., & Eldukhri, E. E. (2026) · Radioengineering · doi:10.13164/re.2026.0105 · Cited by 1
Liang, Z., Li, X., Liang, C., Hu, Y., Zhao, Y., Liang, Z., Zhang, J., Wang, H., & Pan, L. (2026) · The VLDB Journal · doi:10.1007/s00778-026-00996-2 · Cited by 1
A Machine Learning Approach to Detecting Instantaneous Cognitive States from fMRI Data
Ramírez, R., & Puiggròs, M. (2007) · Springer eBooks · doi:10.1007/978-3-540-71701-0_26 · Cited by 1
Artificial Adaptive Systems in Data Visualization: Proactive Data
Buscema, M. (2012) · Springer eBooks · doi:10.1007/978-94-007-4914-6_5 · Cited by 1
Computational Comparisons of GPC and NGPC Schemes
Rao, D. N., Murthy, M. R. K., Harshal, D. N., & Rao, S. R. M. (2007) · Cited by 1
Automatic shape recognition of film sequence with application of backpropagation neural network
Głowacz, A., & Glowacz, W. (2008) · Conference on Human System Interactions · doi:10.1109/hsi.2008.4581412 · Cited by 1
Machine Learning and Financial Investing
Du, J., & Rada, R. (2010) · IGI Global eBooks · doi:10.4018/978-1-60566-766-9.ch017 · Cited by 1
Humanlike robotic vision system using artificial neural network
Zubair, K. A., Singha, S., Alam, S., & Ahmmed, K. T. (2015) · International Conference on Electrical Information and Communication Technologies · doi:10.1109/eict.2015.7391914 · Cited by 1
Heading control for an Autonomous Underwater Vehicle using ELM-based Q-learning
Wang, D., Shen, Y., Sha, Q., Li, G., Jiang, J., Yan, T., Wan, J., & He, B. (2017) · IEEE Underwater Technology (UT) · doi:10.1109/ut.2017.7890340 · Cited by 1
Globalización y desigualdad: un enfoque multidimensional a través de redes neuronales artificiales
Rojas, A. C. P., & Nacional, E. S. D. E. D. I. P. (2018) · Análisis Económico · doi:10.24275/uam/azc/dcsh/ae/2018v33n82/parada · Cited by 4
Gonçalves, I., Seca, M., & Castelli, M. (2020) · Genetic and evolutionary computation · doi:10.1007/978-3-030-39958-0_3 · Cited by 1
Gradient-Enhanced Multifidelity Neural Networks for High-Dimensional Function Approximation
Nagawkar, J. R., & Leifsson, L. (2021) · ASME International Design Engineering Technical Conferences and Computers and Information in Engineering Conference (IDETC/CIE) · doi:10.1115/detc2021-70502 · Cited by 1
Riesgo, F. G., Gómez, S. L. S., Alonso, E. D., González-Gutiérrez, C., & Santos, J. (2021) · Mathematics · doi:10.3390/math9141630 · Cited by 1
Reconstruction-Based One-Class Classification Anomaly Detection for Tabular Data
Lü, J., Li, W., & Zhao, Y. (2022) · Communications in computer and information science · doi:10.1007/978-981-19-4109-2_29 · Cited by 1
Operator chains and seismic data decomposition
Fomel, S. B. (2022) · Second International Meeting for Applied Geoscience & Energy · doi:10.1190/image2022-3751656.1 · Cited by 1
Artificial Intelligence in the Tribology: Review
Mahadeshwara, M. R., Kumar, S., & Dastidar, A. G. (2022) · Lecture notes in electrical engineering · doi:10.1007/978-981-19-5482-5_31 · Cited by 2
A Comparison Study of Deep Learning Algorithms for Metasurface Harvester Designs
Ajmi, H. A., Bait‐Suwailam, M. M., & Khriji, L. (2023) · International Conference on Intelligent Computing, Communication, Networking and Services (ICCNS) · doi:10.1109/iccns58795.2023.10193585 · Cited by 1
Research on Tar Yield Prediction Based on Correlation Analysis and Machine Learning
Liu, Z., Yang, S., Li, L., Liu, S., & Zhang, K. (2025) · International Conference on Digital Analysis and Processing, Intelligent Computation (DAPIC) · doi:10.1109/dapic66097.2025.00150 · Cited by 1
Neural Spatial Interaction Models: Network Training, Model Complexity and Generalization Performance
Fischer, M. M. (2013) · Lecture notes in computer science · doi:10.1007/978-3-642-39649-6_1 · Cited by 1
Efficient Classification and Prediction Algorithms for Biomedical Information
Kilany, R. (2013) · OpenCommons - UConn (University of Connecticut) · Cited by 1
La struttura complessa delle citta. Un approccio cognitivo basato su reti neurali
Buscema, M., & Diappi, L. (2011) · Cybergeo · doi:10.4000/cybergeo.4994 · Cited by 1
Blackwell Publishers Ltd, Mareschal, D., & Johnson, S. P. (2002) · Cited by 1
Applications of neural networks in market risk
Mostafa, F. (2011) · eSpace (Curtin University) · Cited by 1
MetaRec: Meta-Learning Meets Recommendation Systems
Le, J. (2020) · RIT Scholar Works (Rochester Institute of Technology) · Cited by 1
Mobile Robot Control Using BP Based Adaptive Critics
Jakša, R., Hudec, M., & Sinčák, P. (2000) · Physica-Verlag eBooks · doi:10.1007/978-3-7908-1844-4_45
Häusler, C. J. (2014) · Universitätsbibliothek der FU Berlin Hochschulschriftenstelle u. Dokumentenserver · doi:10.17169/refubium-11600
A Fast MLP-based Learning Method and its Application to Mine Countermeasure Missions
Shao, H. (2012) · uO Research (University of Ottawa) · doi:10.20381/ruor-6204
Franco, D. P., & Cardoso, N. M. (2014) · Brazilian Journal of Forensic Science Medical Law and Bioethics · doi:10.17063/bjfs3-4-y2014303
Image/Video Compression with Artificial Neural Networks
Palacio, D. Z., Crespo, R. A. G., Fernández, G. G., & Novelle, I. R. (2009) · Lecture notes in computer science · doi:10.1007/978-3-642-02481-8_47
Different model types for short-term forecasting of characteristic load points
Monteyne, M., Salome, T., de Viron, F., Renders, J.-M., Doulliez, P. J., Dongier, F., & Claus, J. (1997) · Lecture notes in computer science · doi:10.1007/bfb0020285
From Natural to Artificial Intelligence: Numerical Processing for Cognitive Tasks
Alexandre, F., & Frezza-Buet, H. (2004) · Springer eBooks · doi:10.1007/978-3-540-24708-1_7
THE INFLUENCE OF IMPLEMENTATION ON “HUB” MODELS OF SEMANTIC COGNITION
Guest, O., Cooper, R., & Davelaar, E. J. (2013) · Neural Computation and Psychology Workshop (NCPW) · doi:10.1142/9789814458849_0012
Cooperative Cutting Work for Two 2-dof Robots with RNN Model
Dai, Y., Konishi, M., & Imai, J. (2006) · International Conference on Innovative Computing, Information and Control · doi:10.1109/icicic.2006.255
Training a Classifier to Detect Instantaneous Musical Cognitive States
Ramírez, R., & Puiggròs, M. (2006)
Mixture Modeling to Incorporate Meaningful Constraints into Learning
Tchoumatchenko, I., & Ganascia, J. (1996) · Springer eBooks · doi:10.1007/978-94-011-5430-7_10
An exploration of musical style from human and connectionist perspectives
Buzzanca, G., & Baroni, M. (2006) · Archivio istituzionale della ricerca (Alma Mater Studiorum Università di Bologna)
Robust face alignment and partial face recognition
Weng, R. (2016) · DR-NTU (Nanyang Technological University) · doi:10.32657/10356/66026
A normalized fuzzy neural network and its application
Shang, F., Zhao, T., & Li, S. (2004) · International Conference on Machine Learning and Cybernetics · doi:10.1109/icmlc.2003.1259645
Selected Topics in Fuzzy Systems Designing
Cpałka, K. (2017) · Studies in computational intelligence · doi:10.1007/978-3-319-52881-6_2
What is Learning? A Definition for Cognitive Science.
Davies, J. (2017) · eScholarship (California Digital Library) · Cited by 3
Virtual Backup Server optimization on Data Centers using Neural Network
Hilmi, M. R., Sudarma, M., & Linawati, L. (2018) · International Conference on Smart-Green Technology in Electrical and Information Systems (ICSGTEIS) · doi:10.1109/icsgteis.2018.8709101
Constructing Reliable Skin Detector Based on Combining Texture and Color Features
Taqa, A. Y., & Jalab, H. A. (2012) · Mağallaẗ al-tarbiyaẗ wa-al-ʻilm · doi:10.33899/edusj.2012.59191
Yamazaki, S., Iizuka, H., & Yamamoto, M. (2019) · IEEE Symposium Series on Computational Intelligence (SSCI) · doi:10.1109/ssci44817.2019.9002650
Evolution of a heterogeneous hybrid extreme learning machine
Χρήστου, Β. (2019) · Research Explorer (The University of Manchester) · doi:10.12681/eadd/51006
Sain, K., & Kumar, P. C. (2022) · Special publications · doi:10.1002/9781119481874.ch6
Edge Computing on IoT: Architectures, Techniques, and Challenges
Mahalakshmi, R., Ismat, U., & Praveena, K. N. (2022) · Advances in systems analysis, software engineering, and high performance computing book series · doi:10.4018/978-1-6684-5722-1.ch004 · Cited by 1
Qayyum, Z., Mehmood, T., & Al‐Essa, L. A. (2023) · IEEE Access · doi:10.1109/access.2023.3272231
A Comparison of Visual Cue Combination Models
SHARKEY, A. J. C. (1999) · Perspectives in neural computing · doi:10.1007/978-1-4471-0793-4_8
Styrsystem för fordon med hjälp av artificiella neurala nätverk
Engerström, S. (2007) · University Library of Skövde (University of Skövde)
Evaluating ESNs Against Lagged Input Regression Computation
Griffin, D., Stovold, J., O’Keefe, S., & Stepney, S. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-15641-9_18
Genetic Algorithm Based Radial Basis Function Neural Network PID Control System for a Quadrotor UAV
Liu, K. (2025) · International Conference on Computer Communication, Networks and Information Science (CCNIS) · doi:10.1109/ccnis69465.2025.00082
Metadata
- Authors
- Chauvin, Y., & Rumelhart, D. E.
- Affiliations
- Stanford University (US)
- Venue
- Psychology Press eBooks
- Publisher
- Psychology Press
- Published
- 2013-02-01
- OpenAlex
- W1726370773
- Cited by
- 400
- References
- 0
- Citations by year
- 2026: 4 · 2025: 6 · 2024: 8 · 2023: 8 · 2022: 14 · 2021: 22 · 2020: 31 · 2019: 20 · 2018: 27 · 2017: 24 · 2016: 13 · 2015: 13 · 2014: 15 · 2013: 20
- FWCI
- 7.37
- Type
- book
- Language
- en
- Open access
- closed
- Locations
- Psychology Press eBooks (publishedVersion)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Neural Networks and Applications
- Physical Sciences › Computer Science › Artificial Intelligence › Machine Learning and ELM
- Physical Sciences › Computer Science › Artificial Intelligence › Artificial Intelligence Applications
- Keywords
- backpropagation, neural network training, connectionist learning, parallel distributed processing, network architecture, dynamical systems, speech recognition, robotics, image processing, control systems, cognitive psychology
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.