Student or educator? Sign up with your school email and get 6 months of Pro free.
CoChat

The DOI matches its Crossref record; 51 of the 51 references it cites were found in a registry or an index.

Optimal Linear Combinations of Neural Networks

Hashem, Sherif · 1997 · Neural Networks

Abstract

Neural network-based modeling often involves trying multiple networks with different architectures and training parameters in order to achieve acceptable model accuracy. Typically, one of the trained networks is chosen as best, while the rest are discarded. [Hashem and Schmeiser (1995)] proposed using optimal linear combinations of a number of trained neural networks instead of using a single best network. Combining the trained networks may help integrate the knowledge acquired by the components networks and thus improve model accuracy. In this paper, we extend the idea of optimal linear combinations (OLCs) of neural networks and discuss issues related to the generalization ability of the combined model. We then present two algorithms for selecting the component networks for the combination to improve the generalization ability of OLCs. Our experimental results demonstrate significant improvements in model accuracy, as a result of using OLCs, compared to using the apparent best network. Copyright 1997 Elsevier Science Ltd.

Overview

Integrity signals

Registry

Crossref · 10.1016/s0893-6080(96)00098-6

Cites

51 of 51 references verified0 citation errors · 0 not checkable

Statistics

Recomputing p-values needs the paper’s full text.

Verification

Claims the paper makes

This paper’s full text isn’t openly available, so its claims and self-check weren’t run. The registry and citation checks still apply.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Citations

Cites

Show all 51 references

Research works printed but not linked: 11

  1. Cherkassky, V., Gehring, D., & Mulier, F. (1995). Pragmatic comparison of statistical and neural network methods for function estimation. In Proceedings of the 1995 World Congress on Neural Networks, Vol. 2. (pp. 917–926). New Jersey: Lawrence Erlbaum Assoc.
  2. Hashem, S. (1993). Optimal Linear Combinations of Neural Networks. Unpublished PhD thesis, School of Industrial Engineering, Purdue University, West Lafayette, Indiana.
  3. Hashem, S., & Schmeiser, B. (1993). Approximating a function and its derivatives using MSE-optimal linear combinations of trained feed-forward neural networks, In Proceedings of the 1993 World Congress on Neural Networks, Vol. 1. (pp. 617–620). New Jersey: Lawrence Erlbaum Associates.
  4. Hashem, S., Yih, Y., & Schmeiser, B. (1993). An efficient model for product allocation using optimal combinations of neural networks. In C. Dagli, L.I. Burke, B.R. Fernández, & J. Ghosh (Eds.), Intelligent Engineering Systems through Artificial Neural Networks Vol. 3. (pp. 669–674). ASME Press.
  5. Laplace, P.D. (1818) Deuxième Supplément a la Théorie Analytique des Probabilités. Courcier, Paris. Reprinted 1847 in Oeuvers Complètes de Laplace, (Paris, Gauthier-Villars), 7, pp. 531–580.
  6. Markowitz, 1952, Portfolio selection, Journal of Finance, 7, 77
  7. Menezes, 1991, Specification of predictive distribution from a combination of forecasts, Methods of Operations Research, 64, 397
  8. Namatame, 1989, Improving the generalising capabilities of a back-propagation network, The International Journal of Neural Networks Research and Applications, 1, 86
  9. Ohno-Machado, L., & Musen, M.A. (1994). Hierarchical neural networks for partial diagnosis in medicine. In Proceedings of the 1994 World Congress on Neural Networks: Vol. 1 (pp. 291–296). New Jersey: Lawrence Erlbaum Associates.
  10. Parmanto, B., Munro, P.W., Doyle, H.R., Doria, C., Aldrighetti, L., Marino, I.R., Mitchel, S., & Fung, J.J. (1994). Neural network classifier for hepatoma detection. In Proceedings of the 1994 World Congress on Neural Networks, Vol. 1 (pp. 285–290). New Jersey: Lawrence Erlbaum Associates.
  11. Weigend, A.S., Rumelhart, D.E., & Huberman, B.A. (1991). Generalization by weight-elimination with application to forecasting. In R. Lippmann, J. Moody, & D. Touretzky (Eds.). Advances in neural information processing systems, Vol. 3 (pp. 875–882). California: Morgan Kaufman.

Cited by

See all 499

Metadata

Authors
Hashem, S.
Affiliations
Pacific Northwest National Laboratory (US)
Corresponding author
Hashem, Sherif
Venue
Neural Networks
Publisher
Elsevier BV
Published
1997-06
Volume
10
Issue
4
Pages
599-614
ISSN
0893-6080 (ISSN-L)
OpenAlex
W2073040595
Cited by
499
References
51
Citations by year
2026: 4 · 2025: 11 · 2024: 9 · 2023: 14 · 2022: 18 · 2021: 12 · 2020: 12 · 2019: 13 · 2018: 10 · 2017: 7 · 2016: 11 · 2015: 16 · 2014: 21 · 2013: 20 · 2012: 14
FWCI
16.56
Type
journal article
Language
en
Open access
closed
Licence
www.elsevier.com/tdm/userlicense/1.0/ (tdm)
Locations
  • Neural Networks (publishedVersion)
  • PubMed (publishedVersion)
  • Purdue e-Pubs (Purdue University System) (submittedVersion)
Topics
  • Physical Sciences › Computer Science › Artificial Intelligence › Neural Networks and Applications
  • Physical Sciences › Computer Science › Artificial Intelligence › Machine Learning and Data Classification
  • Physical Sciences › Computer Science › Artificial Intelligence › Machine Learning and ELM
Keywords
ensemble learning, model combination, model generalization, model accuracy, neural network architecture selection

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: Optimal Linear Combinations of Neural Networks. https://app.cochat.ai/papers/10.1016/s0893-6080(96)00098-6
The paper
Hashem, S. (1997). Optimal Linear Combinations of Neural Networks. Neural Networks. https://doi.org/10.1016/s0893-6080(96)00098-6

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.