The DOI matches its Crossref record; 51 of the 51 references it cites were found in a registry or an index.
Optimal Linear Combinations of Neural Networks
Abstract
Neural network-based modeling often involves trying multiple networks with different architectures and training parameters in order to achieve acceptable model accuracy. Typically, one of the trained networks is chosen as best, while the rest are discarded. [Hashem and Schmeiser (1995)] proposed using optimal linear combinations of a number of trained neural networks instead of using a single best network. Combining the trained networks may help integrate the knowledge acquired by the components networks and thus improve model accuracy. In this paper, we extend the idea of optimal linear combinations (OLCs) of neural networks and discuss issues related to the generalization ability of the combined model. We then present two algorithms for selecting the component networks for the combination to improve the generalization ability of OLCs. Our experimental results demonstrate significant improvements in model accuracy, as a result of using OLCs, compared to using the apparent best network. Copyright 1997 Elsevier Science Ltd.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Multiple neural networks with identical architectures are trained to form an ensemble , where the predictions of each network in the ensemble are averaged to increase accuracy and generality [24-26].”
From Deep neural network ensembles for THz-TDS refractive index extraction exhibiting resilience to experimental and analytical errors (2023) · cites this paper as [26]
Citations
Cites
Neural Networks: A Comprehensive Foundation
Haykin, S. (1998) · Cited by 30,070
Applied Linear Statistical Models
Ziegel, E. R., Neter, J., Wasserman, W., & Kutner, M. (1992) · Technometrics · doi:10.2307/1269588 · Cited by 9,907
Wolpert, D. H. (1992) · Neural Networks · doi:10.1016/s0893-6080(05)80023-1 · Cited by 7,951
Regression Diagnostics: Identifying Influential Data and Sources of Collinearity
Belsley, D. A., Kuh, E., & Welsch, R. E. (1980) · Wiley Series in Probability and Statistics · doi:10.1002/0471725153 · Cited by 7,297
Regression Diagnostics -- Identifying Influential Data and Sources of Collinearity
Beaumont, C. D., Belsley, D. A., Kuh, E., & Welsch, R. E. (1981) · The Journal of the Operational Research Society · doi:10.2307/2581267 · Cited by 6,359
Lohrli, A. (1985) · Notes and Queries · doi:10.1093/notesj/32.3.377-a · Cited by 4,352
Hansen, L. K., & Salamon, P. (1990) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.58871 · Cited by 4,260
Hierarchical Mixtures of Experts and the EM Algorithm
Jordan, M. I., & Jacobs, R. A. (1994) · Neural Computation · doi:10.1162/neco.1994.6.2.181 · Cited by 2,673
Introduction to artificial neural systems
Żurada, J. M. (1992) · Medical Entomology and Zoology · Cited by 2,355
Combining forecasts: A review and annotated bibliography
Clemen, R. T. (1989) · International Journal of Forecasting · doi:10.1016/0169-2070(89)90012-5 · Cited by 2,164
Research works printed but not linked: 11
- Cherkassky, V., Gehring, D., & Mulier, F. (1995). Pragmatic comparison of statistical and neural network methods for function estimation. In Proceedings of the 1995 World Congress on Neural Networks, Vol. 2. (pp. 917–926). New Jersey: Lawrence Erlbaum Assoc.
- Hashem, S. (1993). Optimal Linear Combinations of Neural Networks. Unpublished PhD thesis, School of Industrial Engineering, Purdue University, West Lafayette, Indiana.
- Hashem, S., & Schmeiser, B. (1993). Approximating a function and its derivatives using MSE-optimal linear combinations of trained feed-forward neural networks, In Proceedings of the 1993 World Congress on Neural Networks, Vol. 1. (pp. 617–620). New Jersey: Lawrence Erlbaum Associates.
- Hashem, S., Yih, Y., & Schmeiser, B. (1993). An efficient model for product allocation using optimal combinations of neural networks. In C. Dagli, L.I. Burke, B.R. Fernández, & J. Ghosh (Eds.), Intelligent Engineering Systems through Artificial Neural Networks Vol. 3. (pp. 669–674). ASME Press.
- Laplace, P.D. (1818) Deuxième Supplément a la Théorie Analytique des Probabilités. Courcier, Paris. Reprinted 1847 in Oeuvers Complètes de Laplace, (Paris, Gauthier-Villars), 7, pp. 531–580.
- Markowitz, 1952, Portfolio selection, Journal of Finance, 7, 77
- Menezes, 1991, Specification of predictive distribution from a combination of forecasts, Methods of Operations Research, 64, 397
- Namatame, 1989, Improving the generalising capabilities of a back-propagation network, The International Journal of Neural Networks Research and Applications, 1, 86
- Ohno-Machado, L., & Musen, M.A. (1994). Hierarchical neural networks for partial diagnosis in medicine. In Proceedings of the 1994 World Congress on Neural Networks: Vol. 1 (pp. 291–296). New Jersey: Lawrence Erlbaum Associates.
- Parmanto, B., Munro, P.W., Doyle, H.R., Doria, C., Aldrighetti, L., Marino, I.R., Mitchel, S., & Fung, J.J. (1994). Neural network classifier for hepatoma detection. In Proceedings of the 1994 World Congress on Neural Networks, Vol. 1 (pp. 285–290). New Jersey: Lawrence Erlbaum Associates.
- Weigend, A.S., Rumelhart, D.E., & Huberman, B.A. (1991). Generalization by weight-elimination with application to forecasting. In R. Lippmann, J. Moody, & D. Touretzky (Eds.). Advances in neural information processing systems, Vol. 3 (pp. 875–882). California: Morgan Kaufman.
Cited by
Popular Ensemble Methods: An Empirical Study
Opitz, D., & Maclin, R. (1999) · Journal of Artificial Intelligence Research · doi:10.1613/jair.614 · Cited by 2,953
Neural networks for classification: a survey
Zhang, G. P. (2000) · IEEE Transactions on Systems, Man and Cybernetics, Part C (Applications and Reviews) · doi:10.1109/5326.897072 · Cited by 1,667
Decision templates for multiple classifier fusion: an experimental comparison
Kuncheva, L. I., Bezdek, J. C., & Duin, R. P. W. (2001) · Pattern Recognition · doi:10.1016/s0031-3203(99)00223-x · Cited by 1,003
Diversity creation methods: a survey and categorisation
Brown, G., Wyatt, J., Harris, R., & Yao, X. (2005) · Information Fusion · doi:10.1016/j.inffus.2004.04.004 · Cited by 985
A survey of multiple classifier systems as hybrid systems
Woźniak, M., Graña, M., & Corchado, E. (2014) · Information Fusion · doi:10.1016/j.inffus.2013.04.006 · Cited by 912
Metadata
- Authors
- Hashem, S.
- Affiliations
- Pacific Northwest National Laboratory (US)
- Corresponding author
- Hashem, Sherif
- ORCID
- Hashem, Sherif
- Venue
- Neural Networks
- Publisher
- Elsevier BV
- Published
- 1997-06
- Volume
- 10
- Issue
- 4
- Pages
- 599-614
- ISSN
- 0893-6080 (ISSN-L)
- OpenAlex
- W2073040595
- Semantic Scholar
- 6851478d76e48a8152260ff03cca3a7fa6f04053
- Cited by
- 499
- References
- 51
- Citations by year
- 2026: 4 · 2025: 11 · 2024: 9 · 2023: 14 · 2022: 18 · 2021: 12 · 2020: 12 · 2019: 13 · 2018: 10 · 2017: 7 · 2016: 11 · 2015: 16 · 2014: 21 · 2013: 20 · 2012: 14
- FWCI
- 16.56
- Type
- journal article
- Language
- en
- Open access
- closed
- Licence
- www.elsevier.com/tdm/userlicense/1.0/ (tdm)
- Locations
- Neural Networks (publishedVersion)
- PubMed (publishedVersion)
- Purdue e-Pubs (Purdue University System) (submittedVersion)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Neural Networks and Applications
- Physical Sciences › Computer Science › Artificial Intelligence › Machine Learning and Data Classification
- Physical Sciences › Computer Science › Artificial Intelligence › Machine Learning and ELM
- Keywords
- ensemble learning, model combination, model generalization, model accuracy, neural network architecture selection
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Optimal Linear Combinations of Neural Networks. https://app.cochat.ai/papers/10.1016/s0893-6080(96)00098-6
- The paper
- Hashem, S. (1997). Optimal Linear Combinations of Neural Networks. Neural Networks. https://doi.org/10.1016/s0893-6080(96)00098-6
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.