The DOI matches its Crossref record; 25 of the 25 references it cites were found in a registry or an index.
Neural Networks: Tricks of the Trade: Second Edition
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“However, CNN models require much more training data (Montavon et al., 2012)”
From Active learning-based systematic reviewing using switching classification models: the case of the onset, maintenance, and relapse of depressive disorders (2023) · cites this paper as Montavon et al., 2012
Citations
Cites
A Practical Guide to Training Restricted Boltzmann Machines
Hinton, G. E. (2012) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-35289-8_32 · Cited by 2,852
Practical Recommendations for Gradient-Based Training of Deep Architectures
Bengio, Y. (2012) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-35289-8_26 · Cited by 2,259
Stochastic Gradient Descent Tricks
Bottou, L. (2012) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-35289-8_25 · Cited by 1,929
Prechelt, L. (2012) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-35289-8_5 · Cited by 951
A Practical Guide to Applying Echo State Networks
Lukoševičius, M. (2012) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-35289-8_36 · Cited by 867
Learning Feature Representations with K-Means
Coates, A., & Ng, A. Y. (2012) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-35289-8_30 · Cited by 601
Deep Learning via Semi-supervised Embedding
Weston, J., Ratle, F., Mobahi, H., & Collobert, R. (2012) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-35289-8_34 · Cited by 534
Transformation Invariance in Pattern Recognition — Tangent Distance and Tangent Propagation
Simard, P. Y., LeCun, Y. A., Denker, J. S., & Victorri, B. (1998) · Lecture Notes in Computer Science · doi:10.1007/3-540-49430-8_13 · Cited by 229
Training Deep and Recurrent Networks with Hessian-Free Optimization
Martens, J., & Sutskever, I. (2012) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-35289-8_27 · Cited by 202
Neural Network Classification and Prior Class Probabilities
Lawrence, S., Burns, I., Back, A. D., Tsoi, A. C., & Giles, C. L. (2012) · Lecture notes in computer science · doi:10.1007/978-3-642-35289-8_19 · Cited by 100
Cited by
Deep learning in neural networks: an overview
Schmidhuber, J. (2015) · Neural Networks · doi:10.1016/j.neunet.2014.09.003 · Cited by 18,570
“Many additional, older tricks (Sections 5.6.2, 5.6.3) should also be applicable to today’s deep NNs; compare (Montavon et al., 2012; Orr & Müller, 1998).”
BackgroundInfluentialA survey on deep learning in medical image analysis
Litjens, G., Kooi, T., Bejnordi, B. E., Setio, A. A. A., Ciompi, F., Ghafoorian, M., van der Laak, J. A. W. M., van Ginneken, B., & Sánchez, C. I. (2017) · Medical Image Analysis · doi:10.1016/j.media.2017.07.005 · Cited by 15,332
Representation Learning: A Review and New Perspectives
Bengio, Y., Courville, A., & Vincent, P. (2013) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2013.50 · Cited by 13,001
Learning Deep Architectures for AI
Bengio, Y. (2009) · now publishers, Inc. eBooks · doi:10.1561/9781601982957 · Cited by 4,941
Deep Convolutional Neural Networks for Image Classification: A Comprehensive Review
Rawat, W., & Wang, Z. (2017) · Neural Computation · doi:10.1162/neco_a_00990 · Cited by 3,503
“…method to reduce overfitting is data augmentation (LeCun et al., 1998; Simard et al., 2003; Ciresan et al., 2011, 2012; Krizhevsky et al., 2012; Montavon et al., 2012; Chatfield et al., Downloaded from http://www.mitpressjournals.org/doi/pdf/10.1162/neco_a_00990 by guest on 04 June 2021 2014),…”
MethodInfluential
Metadata
- Authors
- Montavon, G., Müller, K.-R., & Orr, G. B.
- Affiliations
- Technische Universität Berlin (DE)
- Willamette University (US)
- Venue
- Lecture Notes in Computer Science
- Publisher
- Springer Berlin Heidelberg
- Published
- 2012
- ISSN
- 0302-9743 (ISSN-L)
- 1611-3349
- OpenAlex
- W1576278180
- Cited by
- 2,116
- References
- 25
- Citations by year
- 2026: 34 · 2025: 107 · 2024: 188 · 2023: 192 · 2022: 212 · 2021: 217 · 2020: 211 · 2019: 198 · 2018: 162 · 2017: 143 · 2016: 91 · 2015: 70 · 2014: 48 · 2013: 38 · 2012: 34
- FWCI
- 46.61
- Type
- conference paper
- Language
- en
- Open access
- closed
- Licence
- www.springer.com/tdm (tdm)
- Locations
- Lecture notes in computer science (publishedVersion)
- Digital Access to Libraries (Université catholique de Louvain (UCL), l'Université de Namur (UNamur) and the Université Saint-Louis (USL-B)) (submittedVersion)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Neural Networks and Applications
- Physical Sciences › Computer Science › Artificial Intelligence › Stochastic Gradient Optimization Techniques
- Physical Sciences › Computer Science › Artificial Intelligence › Machine Learning and ELM
- Keywords
- artificial neural networks, neural network training, deep learning, practical implementation, training speed, training accuracy
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Neural Networks: Tricks of the Trade: Second Edition. https://app.cochat.ai/papers/10.1007/978-3-642-35289-8
- The paper
- Montavon, G., Müller, K.-R., & Orr, G. B. (2012). Neural Networks: Tricks of the Trade: Second Edition. Lecture Notes in Computer Science. https://doi.org/10.1007/978-3-642-35289-8
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.