The DOI matches its Crossref record; 11 of the 11 references it cites were found in a registry or an index.
Network information criterion-determining the number of hidden units for an artificial neural network model
Abstract
The problem of model selection, or determination of the number of hidden units, can be approached statistically, by generalizing Akaike's information criterion (AIC) to be applicable to unfaithful (i.e., unrealizable) models with general loss criteria including regularization terms. The relation between the training error and the generalization error is studied in terms of the number of the training examples and the complexity of a network which reduces to the number of parameters in the ordinary statistical theory of AIC. This relation leads to a new network information criterion which is useful for selecting the optimal network model based on a given training set.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
A new look at the statistical model identification
Akaike, H. (1974) · IEEE Transactions on Automatic Control · doi:10.1109/tac.1974.1100705 · Cited by 51,879
Learning Internal Representations by Error Propagation
Rumelhart, D. E., Hinton, G. E., & Williams, R. J. (1985) · doi:10.21236/ada164453 · Cited by 16,172
Advances in Neural Information Processing Systems 5
Zemel, R. S., Williams, C. K. I., & Mozer, M. C. (1993) · Cited by 1,896
Stochastic Complexity and Modeling
Rissanen, J. (1986) · The Annals of Statistics · doi:10.1214/aos/1176350051 · Cited by 922
Learning in Artificial Neural Networks: A Statistical Perspective
White, H. (1989) · Neural Computation · doi:10.1162/neco.1989.1.4.425 · Cited by 922
A Theory of Adaptive Pattern Classifiers
Amari, S. (1967) · IEEE Transactions on Electronic Computers · doi:10.1109/pgec.1967.264666 · Cited by 534
Self-citationMoody, J. E. (1991) · Cited by 437
Inverse and Ill-Posed Problems
(1987) · Elsevier eBooks · doi:10.1016/c2013-0-10621-6 · Cited by 235
(1992) · Annals of Internal Medicine · doi:10.7326/0003-4819-116-1-94_2 · Cited by 199
Statistical Theory of Learning Curves under Entropic Loss Criterion
Амари, Ш.-И., & Murata, N. (1993) · Neural Computation · doi:10.1162/neco.1993.5.1.140 · Cited by 134
Self-citation
Cited by
Bayesian Measures of Model Complexity and Fit
Spiegelhalter, D. J., Best, N. G., Carlin, B. P., & Van Der Linde, A. (2002) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/1467-9868.00353 · Cited by 151
Forecasting with artificial neural networks:
Zhang, G., Eddy Patuwo, B., & Y. Hu, M. (1998) · International Journal of Forecasting · doi:10.1016/s0169-2070(97)00044-7 · Cited by 4,229
An introduction to kernel-based learning algorithms
Muller, K.-R., Mika, S., Ratsch, G., Tsuda, K., & Scholkopf, B. (2001) · IEEE Transactions on Neural Networks · doi:10.1109/72.914517 · Cited by 3,473
(1999) · doi:10.1162/089976600300015565 · Cited by 2,799
Maier, H. R., & Dandy, G. C. (2000) · Environmental Modelling & Software · doi:10.1016/s1364-8152(99)00007-9 · Cited by 2,377
Neural networks for classification: a survey
Zhang, G. P. (2000) · IEEE Transactions on Systems, Man and Cybernetics, Part C (Applications and Reviews) · doi:10.1109/5326.897072 · Cited by 1,667
Image processing with neural networks—a review
Egmont-Petersen, M., de Ridder, D., & Handels, H. (2002) · Pattern Recognition · doi:10.1016/s0031-3203(01)00178-9 · Cited by 1,186
Review on Methods to Fix Number of Hidden Neurons in Neural Networks
Sheela, K. G., & Deepa, S. N. (2013) · Mathematical Problems in Engineering · doi:10.1155/2013/425740 · Cited by 941
Hydrological modelling using artificial neural networks
Dawson, C. W., & Wilby, R. L. (2001) · Progress in Physical Geography: Earth and Environment · doi:10.1177/030913330102500104 · Cited by 903
Combining Machine Learning and Computational Chemistry for Predictive Insights Into Chemical Systems
Keith, J. A., Vassilev-Galindo, V., Cheng, B., Chmiela, S., Gastegger, M., Müller, K.-R., & Tkatchenko, A. (2021) · Chemical Reviews · doi:10.1021/acs.chemrev.1c00107 · Cited by 849
Karlaftis, M. G., & Vlahogianni, E. I. (2011) · Transportation Research Part C: Emerging Technologies · doi:10.1016/j.trc.2010.10.004 · Cited by 826
FORSTER, M., & SOBER, E. (1994) · The British Journal for the Philosophy of Science · doi:10.1093/bjps/45.1.1 · Cited by 659
Introduction to machine learning for brain imaging
Lemm, S., Blankertz, B., Dickhaus, T., & Müller, K.-R. (2011) · NeuroImage · doi:10.1016/j.neuroimage.2010.11.004 · Cited by 630
An Introduction to Boosting and Leveraging
Meir, R., & Rätsch, G. (2003) · Lecture Notes in Computer Science · doi:10.1007/3-540-36434-x_4 · Cited by 447
Evolutionary artificial neural networks: a review
Ding, S., Li, H., Su, C., Yu, J., & Jin, F. (2013) · Artificial Intelligence Review · doi:10.1007/s10462-011-9270-6 · Cited by 412
The Focused Information Criterion
Claeskens, G., & Hjort, N. L. (2003) · Journal of the American Statistical Association · doi:10.1198/016214503000000819 · Cited by 380
Model selection in neural networks
Anders, U., & Korn, O. (1999) · Neural Networks · doi:10.1016/s0893-6080(98)00117-8 · Cited by 367
Asymptotic statistical theory of overtraining and cross-validation
Amari, S., Murata, N., Muller, K.-R., Finke, M., & Yang, H. H. (1997) · IEEE Transactions on Neural Networks · doi:10.1109/72.623200 · Cited by 351
Self-citationA survey of Bayesian predictive methods for model assessment, selection and comparison
Vehtari, A., & Ojanen, J. (2012) · Statistics Surveys · doi:10.1214/12-ss102 · Cited by 348
Neural networks in geophysical applications
van der Baan, M., & Jutten, C. (2000) · Geophysics · doi:10.1190/1.1444797 · Cited by 342
A simulation study of artificial neural networks for nonlinear time-series forecasting
Zhang, G. P., Patuwo, B. E., & Hu, M. Y. (2001) · Computers & Operations Research · doi:10.1016/s0305-0548(99)00123-9 · Cited by 336
Model Selection in Linear Mixed Models
Müller, S., Scealy, J. L., & Welsh, A. H. (2013) · Statistical Science · doi:10.1214/12-sts410 · Cited by 324
Structural learning with forgetting
Ishikawa, M. (1996) · Neural Networks · doi:10.1016/0893-6080(96)83696-3 · Cited by 300
On a Kernel-Based Method for Pattern Recognition, Regression, Approximation, and Operator Inversion
Smola, A. J., & Schölkopf, B. (1998) · Algorithmica · doi:10.1007/pl00013831 · Cited by 298
Neural Networks and Deep Learning
Franke, J., Härdle, W. K., & Hafner, C. M. (2019) · Universitext · doi:10.1007/978-3-030-13751-9_19 · Cited by 290
Pruning by explaining: A novel criterion for deep neural network pruning
Yeom, S.-K., Seegerer, P., Lapuschkin, S., Binder, A., Wiedemann, S., Müller, K.-R., & Samek, W. (2021) · Pattern Recognition · doi:10.1016/j.patcog.2021.107899 · Cited by 263
Human Activity Recognition Data Analysis: History, Evolutions, and New Trends
Ariza-Colpas, P. P., Vicario, E., Oviedo-Carrascal, A. I., Butt Aziz, S., Piñeres-Melo, M. A., Quintero-Linero, A., & Patara, F. (2022) · Sensors · doi:10.3390/s22093401 · Cited by 52
Metadata
- Authors
- Murata, N., Yoshizawa, S., & Amari, S.
- Venue
- IEEE Transactions on Neural Networks
- Published
- 1994
- Volume
- 5
- Issue
- 6
- Pages
- 865-872
- ISSN
- 1045-9227 (ISSN-L)
- OpenAlex
- W2098545770
- Cited by
- 645
- References
- 11
- FWCI
- 20.37
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.