Cited by 3,578Neural Networks and ApplicationsMachine Learning and AlgorithmsMachine Learning and ELM

The DOI matches its Crossref record; 103 of the 103 references it cites were found in a registry or an index.

Neural Networks and the Bias/Variance Dilemma

Geman, Stuart, Bienenstock, Elie, Doursat, René·1992·Neural Computation

DOI 10.1162/neco.1992.4.1.1

Open this paper in CoChat — free account

Abstract

Feedforward neural networks trained by error backpropagation are examples of nonparametric regression estimators. We present a tutorial on nonparametric inference and its relation to neural networks, and we use the statistical viewpoint to highlight strengths and weaknesses of neural models. We illustrate the main points with some recognition experiments involving artificial data as well as handwritten numerals. In way of conclusion, we suggest that current-generation feedforward neural networks are largely inadequate for difficult problems in machine perception and machine learning, regardless of parallel-versus-serial hardware or other implementation issues. Furthermore, we suggest that the fundamental challenges in neural modeling are about representation rather than learning per se. This last point is supported by additional experiments with handwritten numerals.

Integrity signals

Registry

Crossref · 10.1162/neco.1992.4.1.1

Cites

103 of 103 references verified0 citation errors · 0 not checkable

Statistics

Recomputing p-values needs the paper’s full text.

Claims the paper makes

This paper’s full text isn’t openly available, so its claims and self-check weren’t run. The registry and citation checks still apply.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Maximum Likelihood from Incomplete Data Via the EM Algorithm
Dempster, A. P., Laird, N. M., & Rubin, D. B. (1977) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1977.tb01600.x · Cited by 50,444
Learning representations by back-propagating errors
Rumelhart, D. E., Hinton, G. E., & Williams, R. J. (1986) · Nature · doi:10.1038/323533a0 · Cited by 31,892
Classification and Regression Trees.
Gordon, A. D., Breiman, L., Friedman, J. H., Olshen, R. A., & Stone, C. J. (1984) · Biometrics · doi:10.2307/2530946 · Cited by 23,867
Multilayer feedforward networks are universal approximators
Hornik, K., Stinchcombe, M., & White, H. (1989) · Neural Networks · doi:10.1016/0893-6080(89)90020-8 · Cited by 21,728
Classification and Regression Trees.
Ryzin, J. V., Breiman, L., Friedman, J. H., Olshen, R. A., & Stone, C. J. (1986) · Journal of the American Statistical Association · doi:10.2307/2288003 · Cited by 21,030
Information Theory and an Extension of the Maximum Likelihood Principle
Akaike, H. (1998) · Springer series in statistics · doi:10.1007/978-1-4612-1694-0_15 · Cited by 18,636
Learning Internal Representations by Error Propagation
Rumelhart, D. E., Hinton, G. E., & Williams, R. J. (1985) · doi:10.21236/ada164453 · Cited by 16,501
Approximation by superpositions of a sigmoidal function
Cybenko, G. (1989) · Mathematics of Control, Signals, and Systems · doi:10.1007/bf02551274 · Cited by 13,883
Untitled work
(1973) · CERN Document Server (European Organization for Nuclear Research) · Cited by 12,895
Backpropagation Applied to Handwritten Zip Code Recognition
LeCun, Y., Boser, B., Denker, J. S., Henderson, D., Howard, R. E., Hubbard, W., & Jackel, L. D. (1989) · Neural Computation · doi:10.1162/neco.1989.1.4.541 · Cited by 11,891

Flagged first, then by citations

Show all 96 references

Research works printed but not linked: 7

10.1016/S0364-0213(85)80012-4 · DOI · Paper page
Barron A. R., 1989, Florida, 280
Baum L. E., 1972, Inequalities, 3, 1
Burr D. J., 1980, IEEE Transact. Pattern Anal. Machine Intell. PAMI-3, 6, 708
Chauvin Y., 1990, Neural Information Processing Systems 11, D. S. Touretzky, ed., 642
Denker J., 1987, Complex Syst., 1, 877
Goldman L., 1982, J. Med., 307, 588

Sorted by citations

Items 601–700 of 1,006

Memetic Extreme Learning Machine
Zhang, Y., Wu, J. X., Cai, Z., Zhang, P., & Chen, L. (2016) · Pattern Recognition · doi:10.1016/j.patcog.2016.04.003 · Cited by 66
A combination forecasting approach applied in multistep wind speed forecasting based on a data processing strategy and an optimized artificial intelligence algorithm
Yang, Z., & Jian, W. (2018) · Applied Energy · doi:10.1016/j.apenergy.2018.09.037 · Cited by 66
Enhancing Diversity of Defocus Blur Detectors via Cross-Ensemble Network
Zhao, W., Zheng, B., Lin, Q., & Lu, H. (2019) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2019.00911 · Cited by 67
The Future of Time Series
Gershenfeld, N., & Weigand, A. S. (1993) · International Conference on Neural Information Processing · Cited by 66
Face recognition using a hybrid supervised/unsupervised neural network
Intrator, N., Reisfeld, D., & Yeshurun, Y. (1996) · Pattern Recognition Letters · doi:10.1016/0167-8655(95)00089-5 · Cited by 66
Why and how the brain weights contributions from a mixture of experts
O’Doherty, J. P., Lee, S. W., Tadayonnejad, R., Cockburn, J., Iigaya, K., & Charpentier, C. J. (2021) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2020.10.022 · Cited by 70
Design and regularization of neural networks: the optimal use of a validation set
Larsen, J. O., Hansen, L. K., Svarer, C., & Ohlsson, M. (2002) · Machine learning for signal processing ... · doi:10.1109/nnsp.1996.548336 · Cited by 65
Modern data mining tools in descriptive sensory analysis: A case study with a Random forest approach
Granitto, P. M., Gasperi, F., Franco Biasioli, A., Trainotti, E., & Furlanello, C. (2006) · Food Quality and Preference · doi:10.1016/j.foodqual.2006.11.001 · Cited by 65
Nonlinear time series forecasting with Bayesian neural networks
Kocadağlı, O., & Aşikgil, B. (2014) · Expert Systems with Applications · doi:10.1016/j.eswa.2014.04.035 · Cited by 71
Classification of Echolocation Calls from 14 Species of Bat by Support Vector Machines and Ensembles of Neural Networks
Redgwell, R. D., Szewczak, J. M., Jones, G., & Parsons, S. E. (2009) · Algorithms · doi:10.3390/a2030907 · Cited by 69
Flash flood forecasting in poorly gauged basins using neural networks: case study of the Gardon de Mialet basin (southern France)
Artigue, G., Johannet, A., Estupina, V. B., & Pistre, S. (2012) · Natural hazards and earth system sciences · doi:10.5194/nhess-12-3307-2012 · Cited by 65
Steady-state and transient-state analysis of growth and metabolite production in aSaccharomyces cerevisiae strain with reduced pyruvate-decarboxylase activity
Flikweert, M. T., Kuyper, M., van Maris, A. J. A., K�tter, P., van Dijken, J. P., & Pronk, J. T. (1999) · Biotechnology and Bioengineering · doi:10.1002/(sici)1097-0290(1999)66:1 · Cited by 49
A Model for Hourly Solar Radiation Data Generation from Daily Solar Radiation Data Using a Generalized Regression Artificial Neural Network
Khatib, T., & Elmenreich, W. (2015) · International Journal of Photoenergy · doi:10.1155/2015/968024 · Cited by 65
A comparison of three kinds of multimodel ensemble forecast techniques based on the TIGGE data
Zhi, X., Qi, H., Bai, Y., & Lin, C. (2012) · 气象学报：英文版 · doi:10.1007/s13351-012-0104-5 · Cited by 65
A novel automatic satire and irony detection using ensembled feature selection and data mining
Ravi, K., & Ravi, V. (2016) · Knowledge-Based Systems · doi:10.1016/j.knosys.2016.12.018 · Cited by 68
Improving time series forecasting: An approach combining bootstrap aggregation, clusters and exponential smoothing
Dantas, T. M., & Oliveira, F. L. C. (2018) · International Journal of Forecasting · doi:10.1016/j.ijforecast.2018.05.006 · Cited by 65
Learning as Extraction of Low-Dimensional Representations
Edelman, S., & Intrator, N. (1997) · The Psychology of learning and motivation/The psychology of learning and motivation · doi:10.1016/s0079-7421(08)60288-1 · Cited by 66
Must-have Qualities of Clinical Research on Artificial Intelligence and Machine Learning
Koçak, B., Cuocolo, R., Santos, D. P. D., Stanzione, A., & Ugga, L. (2023) · Balkan Medical Journal · doi:10.4274/balkanmedj.galenos.2022.2022-11-51 · Cited by 64
The limits of learning: Exploration, generalization, and the development of learning traps.
Rich, A. S., & Gureckis, T. M. (2018) · Journal of Experimental Psychology General · doi:10.1037/xge0000466 · Cited by 70
Learning quality characteristics for plastic injection molding processes using a combination of simulated and measured data
Finkeldey, F., Knoll, J., Zarges, J., Heim, H., & Wiederkehr, P. (2020) · Journal of Manufacturing Processes · doi:10.1016/j.jmapro.2020.10.028 · Cited by 64
Promises and pitfalls of deep neural networks in neuroimaging-based psychiatric research
Eitel, F., Schulz, M.-A., Seiler, M., Walter, H., & Ritter, K. (2021) · Experimental Neurology · doi:10.1016/j.expneurol.2021.113608 · Cited by 73
Downsampling for Binary Classification with a Highly Imbalanced Dataset Using Active Learning
Lee, W., & Seo, K. (2022) · Big Data Research · doi:10.1016/j.bdr.2022.100314 · Cited by 74
A review on the recent applications of deep learning in predictive drug toxicological studies
Sinha, K., Ghosh, N., & Sil, P. C. (2023) · Chemical Research in Toxicology · doi:10.1021/acs.chemrestox.2c00375 · Cited by 64
The rise of scientific machine learning: a perspective on combining mechanistic modelling with machine learning for systems biology
Noordijk, B., García‐Gómez, M. L., ten Tusscher, K., de Ridder, D., van Dijk, A. D. J., & Smith, R. W. (2024) · Frontiers in Systems Biology · doi:10.3389/fsysb.2024.1407994 · Cited by 73
Performance measures, consistency, and power for artificial neural network models
Twomey, J. M., & Smith, A. E. (1995) · Mathematical and Computer Modelling · doi:10.1016/0895-7177(94)00207-5 · Cited by 64
Improving generalization of MLPs with sliding mode control and the Levenberg–Marquardt algorithm
Costa, M. A., Braga, A. P., & de Menezes, B. R. (2006) · Neurocomputing · doi:10.1016/j.neucom.2006.09.003 · Cited by 64
Hyperspectral Image Classification With Limited Labeled Training Samples Using Enhanced Ensemble Learning and Conditional Random Fields
Li, F., Xu, L., Siva, P., Wong, A. K. C., & Clausi, D. A. (2015) · IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing · doi:10.1109/jstars.2015.2414816 · Cited by 64
Some fundamental issues in ensemble methods
Wang, W. (2008) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn.2008.4634108 · Cited by 64
Machine Learning Approaches to Bioinformatics
Yang, Z. R. (2010) · Science, engineering, and biology informatics · doi:10.1142/7454 · Cited by 66
Chapter 2 Computational aspects of motor control and motor learning
Jordan, M. I. (1996) · Handbook of perception and action · doi:10.1016/s1874-5822(06)80005-8 · Cited by 69
How to Improve Bayesian Reasoning without Instruction
Gigerenzer, G. (2002) · Oxford University Press eBooks · doi:10.1093/acprof:oso/9780195153729.003.0006 · Cited by 63
Optimal ensemble averaging of neural networks
Naftaly, U., Intrator, N., & Horn, D. (1997) · Network Computation in Neural Systems · doi:10.1088/0954-898x/8/3/004 · Cited by 64
Artificial neural networks and adaptive neuro-fuzzy inference system in energy modeling of agricultural products
Nabavi‐Pelesaraei, A., Rafiee, S., Hosseini-Fashami, F., & Chau, K. (2020) · Elsevier eBooks · doi:10.1016/b978-0-12-817772-3.00011-2 · Cited by 68
Majority voting ensemble with a decision trees for business failure prediction during economic downturns
Kim, S. Y., & Upneja, A. (2021) · Journal of Innovation & Knowledge · doi:10.1016/j.jik.2021.01.001 · Cited by 63
Generalization despite overfitting in quantum machine learning models
Peters, E., & Schuld, M. (2023) · Quantum · doi:10.22331/q-2023-12-20-1210 · Cited by 95
Machine Learning for Audio, Image and Video Analysis
Camastra, F., & Vinciarelli, A. (2007) · Springer eBooks · doi:10.1007/978-1-84800-007-0 · Cited by 64
Structural damage alarming using auto-associative neural network technique: Exploration of environment-tolerant capacity and setup of alarming threshold
Zhou, H. F., Ni, Y. Q., & Ko, J. M. (2011) · Mechanical Systems and Signal Processing · doi:10.1016/j.ymssp.2011.01.005 · Cited by 63
Adaptive Ensemble Undersampling-Boost: A novel learning framework for imbalanced data
Lu, W., Li, Z., & Chu, J. (2017) · Journal of Systems and Software · doi:10.1016/j.jss.2017.07.006 · Cited by 63
Investigating an SVM-driven, one-class approach to estimating ship systems condition
Lazakis, I., Gkerekos, C., & Θεοτοκάτος, Γ. (2018) · Ships and Offshore Structures · doi:10.1080/17445302.2018.1500189 · Cited by 64
Ensemble learning regression for estimating river discharges using satellite altimetry data: Central Congo River as a Test-bed
Kim, D.-H., Yu, H., Lee, H., Beighley, R. E., Durand, M., Alsdorf, D., & Hwang, E. (2018) · Remote Sensing of Environment · doi:10.1016/j.rse.2018.12.010 · Cited by 63
Accurate Measurement of Tropical Forest Canopy Heights and Aboveground Carbon Using Structure From Motion
Swinfield, T., Lindsell, J., Williams, J., Harrison, R. D., Agustiono, Habibi, H., Gemita, E., Schönlieb, C., & Coomes, D. A. (2019) · Remote Sensing · doi:10.3390/rs11080928 · Cited by 65
Pattern recognition: neural networks in perspective
Wang, D. (1993) · IEEE Expert · doi:10.1109/64.223991 · Cited by 65
A D-vine copula quantile regression approach for the prediction of residential heating energy consumption based on historical data
Niemierko, R., Töppel, J., & Tränkler, T. (2018) · Applied Energy · doi:10.1016/j.apenergy.2018.10.025 · Cited by 61
Selecting the model for multiple imputation of missing data: Just use an IC!
Noghrehchi, F., Stoklosa, J., Penev, S. I., & Warton, D. I. (2021) · Statistics in Medicine · doi:10.1002/sim.8915 · Cited by 65
Artificial Intelligence in Emergency Radiology: Where Are We Going?
Cellina, M., Cè, M., Irmici, G., Ascenti, V., Caloro, E., Bianchi, L., Pellegrino, G., D’Amico, N., Papa, S., & Carrafiello, G. (2022) · Diagnostics · doi:10.3390/diagnostics12123223 · Cited by 62
Ensemble reinforcement learning: A survey
Song, Y., Suganthan, P. N., Witold Pedrycz, C., Ou, J., He, Y., Chen, Y., & Wu, Y. (2023) · Applied Soft Computing · doi:10.1016/j.asoc.2023.110975 · Cited by 70
Reduced Rank Kernel Ridge Regression
Cawley, G. C., & Talbot, N. L. C. (2002) · Neural Processing Letters · doi:10.1023/a:1021798002258 · Cited by 62
Multiobjective criteria for neural network structure selection and identification of nonlinear systems using genetic algorithms
Liu, G. P., & Kadirkamanathan, V. (1999) · IEE Proceedings - Control Theory and Applications · doi:10.1049/ip-cta:19990501 · Cited by 62
PD recognition with knowledge-based preprocessing and neural networks
Cachin, C., & Wiesmann, H. J. (1995) · IEEE Transactions on Dielectrics and Electrical Insulation · doi:10.1109/94.407023 · Cited by 62
Rational Heuristics? Expectations and Behaviors in Evolving Economies with Heterogeneous Interacting AgentsPreprint
Giovanni Dosi, A., Napoletano, M., Andrea Roventini, B., Stiglitz, J. E., & Treibich, T. (2017) · SSRN Electronic Journal · doi:10.2139/ssrn.3085455 · Cited by 62
Cognitive Analytics
Gudivada, V. N., Irfan, M. T., Fathi, E., & Rao, D. L. (2016) · Handbook of Statistics · doi:10.1016/bs.host.2016.07.010 · Cited by 70
Perspective: Machine Learning of Thermophysical Properties
Jirasek, F., & Hasse, H. (2021) · Fluid Phase Equilibria · doi:10.1016/j.fluid.2021.113206 · Cited by 61
Ontology-Based Meta-Mining of Knowledge Discovery Workflows
Hilario, M., Nguyen, P., Do, H., Woźnica, A., & Kalousis, A. (2011) · Studies in computational intelligence · doi:10.1007/978-3-642-20980-2_9 · Cited by 61
A hybrid commodity price‐forecasting model applied to the sugar–alcohol sector
Ribeiro, C. D. O., & de Oliveira, S. M. (2011) · Australian Journal of Agricultural and Resource Economics · doi:10.1111/j.1467-8489.2011.00534.x · Cited by 67
Model combination for credit risk assessment: A stacked generalization approach
Doumpos, M., & Zopounidis, C. (2006) · Annals of Operations Research · doi:10.1007/s10479-006-0120-x · Cited by 61
Towards a generic artificial neural network model for dynamic predictions of algal abundance in freshwater lakes
Wilson, H., & Recknagel, F. (2001) · Ecological Modelling · doi:10.1016/s0304-3800(01)00297-6 · Cited by 61
Cerebellar supervised learning revisited: biophysical modeling and degrees-of-freedom control
Kawato, M., Kuroda, S., & Schweighofer, N. (2011) · Current Opinion in Neurobiology · doi:10.1016/j.conb.2011.05.014 · Cited by 62
Predictive uncertainty in environmental modelling
Cawley, G. C., Janacek, G. J., Haylock, M. R., & Dorling, S. R. (2007) · Neural Networks · doi:10.1016/j.neunet.2007.04.024 · Cited by 61
A novel computer-aided diagnosis system for breast MRI based on feature selection and ensemble learning
Lu, W., Li, Z., & Chu, J. (2017) · Computers in Biology and Medicine · doi:10.1016/j.compbiomed.2017.03.002 · Cited by 61
Integrating Models of Interval Timing and Reinforcement Learning
Petter, E. A., Gershman, S. J., & Meck, W. H. (2018) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2018.08.004 · Cited by 59
Normalized Hurricane Damages in the United States: 1925–95
Pielke, R. A., & Landsea, C. W. (1998) · Weather and Forecasting · doi:10.1175/1520-0434(1998)013 · Cited by 485
Neural networks and logistic regression: Part II
Vach, W., Roßner, R., & Schumacher, M. (1996) · Computational Statistics & Data Analysis · doi:10.1016/0167-9473(95)00033-x · Cited by 61
Statistical Mechanics of Deep Linear Neural Networks: The Backpropagating Kernel Renormalization
Li, Q., & Sompolinsky, H. (2021) · Physical Review X · doi:10.1103/physrevx.11.031059 · Cited by 85
Prediction of minimum temperatures in an alpine region by linear and non-linear post-processing of meteorological models
Eccel, E., Ghielmi, L., Granitto, P. M., Barbiero, R., Grazzini, F., & Césari, D. (2007) · Nonlinear processes in geophysics · doi:10.5194/npg-14-211-2007 · Cited by 60
Integrating complementary techniques for promoting diversity in classifier ensembles: A systematic study
Nascimento, D. S. C., Coelho, A. L. V., & Canuto, A. M. P. (2014) · Neurocomputing · doi:10.1016/j.neucom.2014.01.027 · Cited by 60
Assessment of Time-Series Machine Learning Methods for Forecasting Hospital Discharge Volume
McCoy, T. H., Pellegrini, A. M., & Perlis, R. H. (2018) · JAMA Network Open · doi:10.1001/jamanetworkopen.2018.4087 · Cited by 63
Application of deep learning to the classification of uterine cervical squamous epithelial lesion from colposcopy images
Miyagi, Y., Takehara, K., & Miyake, T. M. (2019) · Molecular and Clinical Oncology · doi:10.3892/mco.2019.1932 · Cited by 63
Identifying source(s) of out-of-control signals in multivariate manufacturing processes using selective neural network ensemble
Yu, J., Xi, L., & Zhou, X. (2008) · Engineering Applications of Artificial Intelligence · doi:10.1016/j.engappai.2008.05.009 · Cited by 60
Data mining: data analysis on a grand scale?
Smyth, P. (2000) · Statistical Methods in Medical Research · doi:10.1177/096228020000900402 · Cited by 60
Feasibility of deep learning for predicting live birth from a blastocyst image in patients classified by age
Miyagi, Y., Habara, T., Hirata, R., & Hayashi, N. (2019) · Reproductive Medicine and Biology · doi:10.1002/rmb2.12266 · Cited by 63
Transfer Learning and Few-Shot Learning Based Deep Neural Network Models for Underwater Sonar Image Classification With a Few Samples
Chungath, T. T., Nambiar, A., & Mittal, A. (2023) · IEEE Journal of Oceanic Engineering · doi:10.1109/joe.2022.3221127 · Cited by 62
Adaptive correction of the pseudo-enhancement of CT attenuation for fecal-tagging CT colonography
Näppi, J. J., & YOSHIDA, H. (2008) · Medical Image Analysis · doi:10.1016/j.media.2008.01.001 · Cited by 59
Automatic Parameter Optimization for Support Vector Regression for Land and Sea Surface Temperature Estimation From Remote Sensing Data
Moser, G., & Serpico, S. B. (2009) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2008.2005993 · Cited by 59
Ensemble Learning in Hyperspectral Image Classification: Toward Selecting a Favorable Bias-Variance Tradeoff
Merentitis, A., Debes, C., & Heremans, R. (2014) · IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing · doi:10.1109/jstars.2013.2295513 · Cited by 61
Application of deep learning to the classification of uterine cervical squamous epithelial lesion from colposcopy images combined with HPV types
Miyagi, Y., Takehara, K., Nagayasu, Y., & Miyake, T. M. (2019) · Oncology Letters · doi:10.3892/ol.2019.11214 · Cited by 64
Fast meta-models for local fusion of multiple predictive models
Bonissone, P. P., Xue, F., & Subbu, R. (2008) · Applied Soft Computing · doi:10.1016/j.asoc.2008.03.006 · Cited by 59
Declarative and Preferential Bias in GP-based Scientific Discovery
Keijzer, M., & Babovic, V. (2002) · Genetic Programming and Evolvable Machines · doi:10.1023/a:1014596120381 · Cited by 59
Emergence of Position-Independent Detectors of Sense of Rotation and Dilation with Hebbian Learning: An Analysis
Zhang, K., Sereno, M. I., & Sereno, M. E. (1993) · Neural Computation · doi:10.1162/neco.1993.5.4.597 · Cited by 59
From interpretability to inference: an estimation framework for universal approximatorsPreprint
Joseph, A. C. (2019) · SSRN Electronic Journal · doi:10.2139/ssrn.3351091 · Cited by 63
Simulation-only experiments to mimic the effects of the reality gap in the automatic design of robot swarms
Ligot, A., & Birattari, M. (2020) · Swarm Intelligence · doi:10.1007/s11721-019-00175-w · Cited by 55
Toward Intuitive Prosthetic Control: Solving Common Issues Using Force Myography, Surface Electromyography, and Pattern Recognition in a Pilot Case Study
Ahmadizadeh, C., Merhi, L.-K., Pousett, B., Sangha, S., & Menon, C. (2017) · IEEE Robotics & Automation Magazine · doi:10.1109/mra.2017.2747899 · Cited by 57
Opening the black box: Uncovering the leader trait paradigm through machine learning
Doornenbal, B. M., Spisak, B. R., & van der Laken, P. A. (2021) · The Leadership Quarterly · doi:10.1016/j.leaqua.2021.101515 · Cited by 65
Metabolomics integrated with machine learning to discriminate the geographic origin of Rougui Wuyi rock tea
Peng, Y., Zheng, C., Guo, S., Gao, F., Wang, X., Du, Z., Gao, F., Su, F., Zhang, W., Yu, X., et al. (2023) · npj Science of Food · doi:10.1038/s41538-023-00187-1 · Cited by 59
Predicting demersal fish species distributions in the Mediterranean Sea using artificial neural networks
Maravelias, C. D., Haralabous, J., & Papaconstantinou, C. (2003) · Marine Ecology Progress Series · doi:10.3354/meps255249 · Cited by 58
On Feature Selection, Bias-Variance, and Bagging
Munson, M. A., & Caruana, R. (2009) · Lecture notes in computer science · doi:10.1007/978-3-642-04174-7_10 · Cited by 58
Towards a Rational Theory of Heuristics
Gigerenzer, G. (2016) · Palgrave Macmillan UK eBooks · doi:10.1057/9781137442505_3 · Cited by 64
Homo heuristicus: Why Biased Minds Make Better Inferences
Gigerenzer, G., & Brighton, H. (2011) · Oxford University Press eBooks · doi:10.1093/acprof:oso/9780199744282.003.0001 · Cited by 66
Data Complexity Analysis for Classifier Combination
Ho, T. K. (2001) · Lecture notes in computer science · doi:10.1007/3-540-48219-9_6 · Cited by 58
Bayesian applications of belief networks and multilayer perceptrons for ovarian tumor classification with rejection
Antal, P., Fannes, G., Timmerman, D., Moreau, Y., & Moor, B. D. (2003) · Artificial Intelligence in Medicine · doi:10.1016/s0933-3657(03)00053-8 · Cited by 57
The Effect of Incentive Schemes and Organizational Arrangements on the New Product Development Process
Natter, M., Mild, A., Feurstein, M., Dorffner, G., & Taudes, A. (2001) · Management Science · doi:10.1287/mnsc.47.8.1029.10228 · Cited by 57
A Stochastic Algorithm for Feature Selection in Pattern Recognition
Gadat, S., Laurent Younes, B., & Guyon, I. (2007) · Cited by 58
Prediction of Gas-Chromatographic Retention Indices Using Topological Descriptors
Pompe, M., & Novič, M. (1998) · Journal of Chemical Information and Computer Sciences · doi:10.1021/ci980036z · Cited by 58
Statistical Ideas for Selecting Network Architectures
Ripley, B. D. (1995) · Springer eBooks · doi:10.1007/978-1-4471-3087-1_36 · Cited by 57
Optimizing number of hidden neurons in neural networks
Liu, Y., Starzyk, J. A., & Zhu, Z. (2007) · Conference on Artificial Intelligence for Applications · Cited by 57
Convergence of online gradient method for feedforward neural networks with smoothing L1/2 regularization penalty
Fan, Q., Żurada, J. M., & Wu, W. H. (2013) · Neurocomputing · doi:10.1016/j.neucom.2013.10.023 · Cited by 57
Deep Temporal Convolution Network for Time Series Classification
Koh, B. H. D., Lim, C. L. P., Rahimi, H., Woo, W. L., & Gao, B. (2021) · Sensors · doi:10.3390/s21020603 · Cited by 57
The Modularity of Social Intelligence
Gigerenzer, G. (2002) · Oxford University Press eBooks · doi:10.1093/acprof:oso/9780195153729.003.0011 · Cited by 57
TUNING DIVERSITY IN BAGGED ENSEMBLES
Carney, J. G., & Cunningham, P. (2000) · International Journal of Neural Systems · doi:10.1016/s0129-0657(00)00027-2 · Cited by 57
Heuristics: Tools for an Uncertain World
Neth, H., & Gigerenzer, G. (2015) · Wiley eBooks · doi:10.1002/9781118900772.etrds0394 · Cited by 59
Ensemble learning of coarse-grained molecular dynamics force fields with a kernel approach
Wang, J., Chmiela, S., Müller, K., Noé, F., & Clementi, C. (2020) · The Journal of Chemical Physics · doi:10.1063/5.0007276 · Cited by 53

Authors: Geman, S., Bienenstock, E., & Doursat, R.
Affiliations: Brown University (US)
ESPCI Paris (FR)
ORCID: Doursat, René
Venue: Neural Computation
Publisher: MIT Press
Published: 1992-01
Volume: 4
Issue: 1
Pages: 1-58
ISSN: 0899-7667 (ISSN-L)
1530-888X
DOI: 10.1162/neco.1992.4.1.1
OpenAlex: W2076118331
Cited by: 3,578
References: 96
Citations by year: 2026: 125 · 2025: 131 · 2024: 115 · 2023: 128 · 2022: 148 · 2021: 201 · 2020: 181 · 2019: 142 · 2018: 126 · 2017: 97 · 2016: 115 · 2015: 99 · 2014: 103 · 2013: 82 · 2012: 110
FWCI: 60.04
Type: journal article
Language: en
Open access: closed
Locations: Neural Computation (publishedVersion)
e-space (Manchester Metropolitan University) (submittedVersion)
Topics: Physical Sciences › Computer Science › Artificial Intelligence › Neural Networks and Applications
Physical Sciences › Computer Science › Artificial Intelligence › Machine Learning and Algorithms
Physical Sciences › Computer Science › Artificial Intelligence › Machine Learning and ELM
Keywords: bias-variance trade-off, feedforward neural networks, backpropagation, nonparametric regression, nonparametric inference, handwritten digit recognition, machine perception, neural network representations, statistical learning

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Neural Networks and the Bias/Variance Dilemma

Abstract

Overview

Integrity signals

Verification

Claims the paper makes

Claims other papers make about this one

Citations

Cites

Cited by

Related

Metadata

Record

About these checks