The DOI matches its Crossref record.
High-order and multilayer perceptron initialization
Open accessAbstract
Proper initialization is one of the most important prerequisites for fast convergence of feedforward neural networks like high-order and multilayer perceptrons. This publication aims at determining the optimal variance (or range) for the initial weights and biases, which is the principal parameter of random initialization methods for both types of neural networks. An overview of random weight initialization methods for multilayer perceptrons is presented. These methods are extensively tested using eight real-world benchmark data sets and a broad range of initial weight variances by means of more than 30000 simulations, in the aim to find the best weight initialization method for multilayer perceptrons. For high-order networks, a large number of experiments (more than 200000 simulations) was performed, using three weight distributions, three activation functions, several network orders, and the same eight data sets. The results of these experiments are compared to weight initialization techniques for multilayer perceptrons, which leads to the proposal of a suitable initialization method for high-order perceptrons. The conclusions on the initialization methods for both types of networks are justified by sufficiently small confidence intervals of the mean convergence times.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cited by
Artificial neural networks for rf and microwave design-from theory to practice
Zhang, Q.-J., Gupta, K. C., & Devabhaktuni, V. K. (2003) · IEEE Transactions on Microwave Theory and Techniques · doi:10.1109/tmtt.2003.809179 · Cited by 749
Quantum Generative Adversarial Networks for learning and loading random distributions
Zoufal, C., Lucchi, A., & Woerner, S. (2019) · npj Quantum Information · doi:10.1038/s41534-019-0223-2 · Cited by 480
Quantum Generative Adversarial Networks for learning and loading random distributions
Zoufal, C., Lucchi, A., & Woerner, S. (2019) · Repository for Publications and Research Data (ETH Zurich) · doi:10.3929/ethz-b-000382432 · Cited by 359
A review on weight initialization strategies for neural networks
Narkhede, M. V., Bartakke, P. P., & Sutaone, M. S. (2022) · Artificial Intelligence Review · doi:10.1007/s10462-021-10033-z · Cited by 311
Metadata
- Authors
- Thimm, G., & Fiesler, E.
- Venue
- IEEE Transactions on Neural Networks
- Published
- 1997-03
- Volume
- 8
- Issue
- 2
- Pages
- 349-359
- ISSN
- 1045-9227 (ISSN-L)
- 1941-0093
- OpenAlex
- W2118162660
- Cited by
- 178
- References
- 0
- FWCI
- 5.71
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: High-order and multilayer perceptron initialization. https://app.cochat.ai/papers/10.1109/72.557673
- The paper
- Thimm, G., & Fiesler, E. (1997). High-order and multilayer perceptron initialization. IEEE Transactions on Neural Networks. https://doi.org/10.1109/72.557673
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.