Cited by 3,578Neural Networks and ApplicationsMachine Learning and AlgorithmsMachine Learning and ELM

The DOI matches its Crossref record; 103 of the 103 references it cites were found in a registry or an index.

Neural Networks and the Bias/Variance Dilemma

Geman, Stuart, Bienenstock, Elie, Doursat, René·1992·Neural Computation

DOI 10.1162/neco.1992.4.1.1

Open this paper in CoChat — free account

Abstract

Feedforward neural networks trained by error backpropagation are examples of nonparametric regression estimators. We present a tutorial on nonparametric inference and its relation to neural networks, and we use the statistical viewpoint to highlight strengths and weaknesses of neural models. We illustrate the main points with some recognition experiments involving artificial data as well as handwritten numerals. In way of conclusion, we suggest that current-generation feedforward neural networks are largely inadequate for difficult problems in machine perception and machine learning, regardless of parallel-versus-serial hardware or other implementation issues. Furthermore, we suggest that the fundamental challenges in neural modeling are about representation rather than learning per se. This last point is supported by additional experiments with handwritten numerals.

Integrity signals

Registry

Crossref · 10.1162/neco.1992.4.1.1

Cites

103 of 103 references verified0 citation errors · 0 not checkable

Statistics

Recomputing p-values needs the paper’s full text.

Claims the paper makes

This paper’s full text isn’t openly available, so its claims and self-check weren’t run. The registry and citation checks still apply.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Maximum Likelihood from Incomplete Data Via the EM Algorithm
Dempster, A. P., Laird, N. M., & Rubin, D. B. (1977) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1977.tb01600.x · Cited by 50,444
Learning representations by back-propagating errors
Rumelhart, D. E., Hinton, G. E., & Williams, R. J. (1986) · Nature · doi:10.1038/323533a0 · Cited by 31,892
Classification and Regression Trees.
Gordon, A. D., Breiman, L., Friedman, J. H., Olshen, R. A., & Stone, C. J. (1984) · Biometrics · doi:10.2307/2530946 · Cited by 23,867
Multilayer feedforward networks are universal approximators
Hornik, K., Stinchcombe, M., & White, H. (1989) · Neural Networks · doi:10.1016/0893-6080(89)90020-8 · Cited by 21,728
Classification and Regression Trees.
Ryzin, J. V., Breiman, L., Friedman, J. H., Olshen, R. A., & Stone, C. J. (1986) · Journal of the American Statistical Association · doi:10.2307/2288003 · Cited by 21,030
Information Theory and an Extension of the Maximum Likelihood Principle
Akaike, H. (1998) · Springer series in statistics · doi:10.1007/978-1-4612-1694-0_15 · Cited by 18,636
Learning Internal Representations by Error Propagation
Rumelhart, D. E., Hinton, G. E., & Williams, R. J. (1985) · doi:10.21236/ada164453 · Cited by 16,501
Approximation by superpositions of a sigmoidal function
Cybenko, G. (1989) · Mathematics of Control, Signals, and Systems · doi:10.1007/bf02551274 · Cited by 13,883
Untitled work
(1973) · CERN Document Server (European Organization for Nuclear Research) · Cited by 12,895
Backpropagation Applied to Handwritten Zip Code Recognition
LeCun, Y., Boser, B., Denker, J. S., Henderson, D., Howard, R. E., Hubbard, W., & Jackel, L. D. (1989) · Neural Computation · doi:10.1162/neco.1989.1.4.541 · Cited by 11,891

Flagged first, then by citations

Show all 96 references

Research works printed but not linked: 7

10.1016/S0364-0213(85)80012-4 · DOI · Paper page
Barron A. R., 1989, Florida, 280
Baum L. E., 1972, Inequalities, 3, 1
Burr D. J., 1980, IEEE Transact. Pattern Anal. Machine Intell. PAMI-3, 6, 708
Chauvin Y., 1990, Neural Information Processing Systems 11, D. S. Touretzky, ed., 642
Denker J., 1987, Complex Syst., 1, 877
Goldman L., 1982, J. Med., 307, 588

Sorted by citations

Items 201–300 of 1,006

Downscaling recent streamflow conditions in British Columbia, Canada using ensemble neural network models
Cannon, A. J., & Whitfield, P. H. (2002) · Journal of Hydrology · doi:10.1016/s0022-1694(01)00581-9 · Cited by 207
The Wrapper Approach
Kohavi, R., & John, G. H. (1998) · Springer eBooks · doi:10.1007/978-1-4615-5725-8_3 · Cited by 213
Learning Internal Representations
Baxter, J. (1995) · Cited by 211
The Superego, the Ego, and the Id in Statistical Reasoning
Gigerenzer, G. (2002) · Oxford University Press eBooks · doi:10.1093/acprof:oso/9780195153729.003.0013 · Cited by 207
JETNET 3.0—A versatile artificial neural network package
Peterson, C., Rognvaldsson, T. S., & Lönnblad, L. (1994) · Computer Physics Communications · doi:10.1016/0010-4655(94)90120-1 · Cited by 204
A novel least squares support vector machine ensemble model for NOx emission prediction of a coal-fired boiler
Lv, Y., Liu, J., Yang, T., & Zeng, D. (2013) · Energy · doi:10.1016/j.energy.2013.02.062 · Cited by 202
Computational Medicine: Translating Models to Clinical Care
Winslow, R. L., Trayanova, N. A., Geman, D., & Miller, M. I. (2012) · Science Translational Medicine · doi:10.1126/scitranslmed.3003528 · Cited by 210
Physically Inspired Neural Network Model for RF Power Amplifier Behavioral Modeling and Digital Predistortion
Mkadem, F., & Boumaiza, S. (2011) · IEEE Transactions on Microwave Theory and Techniques · doi:10.1109/tmtt.2010.2098041 · Cited by 199
Entrepreneurs as Scientists: A Pragmatist Approach to Producing Value Out of Uncertainty
Zellweger, T. M., & Zenger, T. R. (2021) · Academy of Management Review · doi:10.5465/amr.2020.0503 · Cited by 205
Active Learning Query Strategies for Classification, Regression, and Clustering: A Survey
Kumar, P. R., & Gupta, A. K. (2020) · Journal of Computer Science and Technology · doi:10.1007/s11390-020-9487-4 · Cited by 208
Deep Learning and System Identification
Lennart Ljung, A., Andersson, C. R., Tiels, K., & Schön, T. B. (2020) · IFAC-PapersOnLine · doi:10.1016/j.ifacol.2020.12.1329 · Cited by 213
Accounts of Experiences in the Application of Artificial Neural Networks in Chemical Engineering
Himmelblau, D. M. (2008) · Industrial & Engineering Chemistry Research · doi:10.1021/ie800076s · Cited by 196
Using simulated annealing to optimize the feature selection problem in marketing applications
Meiri, R., & Zahavi, J. (2004) · European Journal of Operational Research · doi:10.1016/j.ejor.2004.09.010 · Cited by 196
Fast decorrelated neural network ensembles with random weights
Alhamdoosh, M., & Wang, D. (2014) · Information Sciences · doi:10.1016/j.ins.2013.12.016 · Cited by 195
Unsupervised Language AcquisitionPreprint
de Marcken, C. (1996) · arXiv (Cornell University) · doi:10.48550/arxiv.cmp-lg/9611002 · Cited by 197
Bagging gradient-boosted trees for high precision, low variance ranking models
Ganjisaffar, Y., Caruana, R., & Lopes, C. V. (2011) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/2009916.2009932 · Cited by 199
Time series forecasting with neural network ensembles: an application for exchange rate prediction
Zhang, G. P., & Berardi, V. L. (2001) · Journal of the Operational Research Society · doi:10.1057/palgrave.jors.2601133 · Cited by 190
Handwritten digit recognition by neural networks with single-layer training
Knerr, S., Personnaz, L., & Dreyfus, G. (1992) · IEEE Transactions on Neural Networks · doi:10.1109/72.165597 · Cited by 191
Sparse Multinomial Logistic Regression via Bayesian L1 Regularisation
Cawley, G. C., Talbot, N. L. C., & Girolami, M. (2007) · The MIT Press eBooks · doi:10.7551/mitpress/7503.003.0031 · Cited by 190
Side-Tuning: A Baseline for Network Adaptation via Additive Side Networks
Zhang, J. O., (Sasha), A. S., Zamir, A., Guibas, L. J., & Malik, J. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-58580-8_41 · Cited by 212
Localized Generalization Error Model and Its Application to Architecture Selection for Radial Basis Function Neural Network
Yeung, D. S., Ng, W. W. Y., Wang, D., Tsang, E. C. C., & Wang, X. (2007) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.2007.894058 · Cited by 189
Bootstrapping with Noise: An Effective Regularization Technique
Raviv, Y., & Intrator, N. (1996) · Connection Science · doi:10.1080/095400996116811 · Cited by 188
Estimating the scene illumination chromaticity by using a neural network
Cardei, V. C., Funt, B., & Barnard, K. (2002) · Journal of the Optical Society of America A · doi:10.1364/josaa.19.002374 · Cited by 187
A Bias and Variance Analysis for Multistep-Ahead Time Series Forecasting
Taieb, S. B., & Atiya, A. F. (2015) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2015.2411629 · Cited by 187
Introduction to the Special Issue on Meta-Learning
Giraud-Carrier, C. G., Vilalta, R., & Brazdil, P. (2004) · Machine Learning · doi:10.1023/b:mach.0000015878.60765.42 · Cited by 187
Uncertainty assessment and ensemble flood forecasting using bootstrap based artificial neural networks (BANNs)
Tiwari, M. K., & Chatterjee, C. (2009) · Journal of Hydrology · doi:10.1016/j.jhydrol.2009.12.013 · Cited by 186
Neural networks and logistic regression: Part I
Schumacher, M. C., Roßner, R., & Vach, W. (1996) · Computational Statistics & Data Analysis · doi:10.1016/0167-9473(95)00032-1 · Cited by 189
Evaluating machine learning models for engineering problems
Reich, Y., & Barai, S. V. (1999) · Artificial Intelligence in Engineering · doi:10.1016/s0954-1810(98)00021-1 · Cited by 184
Spatial prediction of landslide susceptibility using data mining-based kernel logistic regression, naive Bayes and RBFNetwork models for the Long County area (China)
Chen, W., Yan, X., Zhao, Z., Hong, H., Bui, D. T., & Pradhan, B. (2018) · Bulletin of Engineering Geology and the Environment · doi:10.1007/s10064-018-1256-z · Cited by 187
Global crustal thickness from neural network inversion of surface wave data
Meier, U., Curtis, A., & Jeannot Trampert, B. (2007) · Geophysical Journal International · doi:10.1111/j.1365-246x.2007.03373.x · Cited by 180
Interpretability constraints for fuzzy information granulation
Mencar, C., & Fanelli, A. M. (2008) · Information Sciences · doi:10.1016/j.ins.2008.08.015 · Cited by 179
Constructing deterministic finite-state automata in recurrent neural networks
Omlin, C. W. P., & Giles, C. L. (1996) · Journal of the ACM · doi:10.1145/235809.235811 · Cited by 178
Improving model accuracy using optimal linear combinations of trained neural networks
Hashem, S. R., & Schmeiser, B. W. (1995) · IEEE Transactions on Neural Networks · doi:10.1109/72.377990 · Cited by 177
Structured Event Memory: A neuro-symbolic model of event cognition.
Franklin, N. T., Norman, K. A., Ranganath, C., Zacks, J. M., & Gershman, S. J. (2020) · Psychological Review · doi:10.1037/rev0000177 · Cited by 177
G ryffin : An algorithm for Bayesian optimization of categorical variables informed by expert knowledge
Häse, F., Aldeghi, M., Hickman, R. J., Roch, L. M., & Aspuru‐Guzik, A. (2021) · Applied Physics Reviews · doi:10.1063/5.0048164 · Cited by 212
Hierarchical Mixtures of Experts and the EM Algorithm
Jordan, M. I., & Jacobs, R. A. (1994) · Springer eBooks · doi:10.1007/978-1-4471-2097-1_113 · Cited by 183
Bayesian Methods for Mixtures of Experts
Waterhouse, S. R., Mackay, D., & Robinson, A. J. (1995) · Cited by 178
On the Use of Neural Network Ensembles in QSAR and QSPR
Agrafiotis, D. K., Cedeño, W., & Lobanov, V. S. (2002) · Journal of Chemical Information and Computer Sciences · doi:10.1021/ci0203702 · Cited by 175
Bacterial colony counting with Convolutional Neural Networks in Digital Microbiology Imaging
Ferrari, A., Lombardi, S., & Signoroni, A. (2016) · Pattern Recognition · doi:10.1016/j.patcog.2016.07.016 · Cited by 180
Learning multidimensional signal processing
Knutsson, H. E., Borga, M., & Landelius, T. (2002) · Proceedings - International Conference on Pattern Recognition/Proceedings/International Conference on Pattern Recognition · doi:10.1109/icpr.1998.711968 · Cited by 175
Context and Hierarchy in a Probabilistic Image Model
Jin, Y., & Geman, S. (2006) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2006.86 · Cited by 175
Self-citation
On the Relationship between Generalization Error, Hypothesis Complexity, and Sample Complexity for Radial Basis Functions
Niyogi, P., & Girosi, F. (1996) · Neural Computation · doi:10.1162/neco.1996.8.4.819 · Cited by 172
AutoMoDe: A novel approach to the automatic design of control software for robot swarms
Francesca, G., Brambilla, M., Brutschy, A., Trianni, V., & Birattari, M. (2014) · Swarm Intelligence · doi:10.1007/s11721-014-0092-4 · Cited by 171
Diffusion Sparse Least-Mean Squares Over Networks
Liu, Y., Li, C., & Zhang, Z. (2012) · IEEE Transactions on Signal Processing · doi:10.1109/tsp.2012.2198468 · Cited by 171
Machine Learning Based on Attribute Interactions
Jakulin, A. (2005) · Repository of the University of Ljubljana (University of Ljubljana) · Cited by 182
RATIONAL HEURISTICS? EXPECTATIONS AND BEHAVIORS IN EVOLVING ECONOMIES WITH HETEROGENEOUS INTERACTING AGENTS
Giovanni Dosi, A., Napoletano, M., Andrea Roventini, B., Stiglitz, J. E., & Treibich, T. (2020) · Economic Inquiry · doi:10.1111/ecin.12897 · Cited by 174
I tried a bunch of things: The dangers of unexpected overfitting in classification of brain data
Hosseini, M., Powell, M., Collins, J., Callahan-Flintoft, C., Jones, W., Bowman, H., & Wyble, B. (2020) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2020.09.036 · Cited by 165
Conceptual complexity and the bias/variance tradeoff
Briscoe, E., & Feldman, J. (2010) · Cognition · doi:10.1016/j.cognition.2010.10.004 · Cited by 169
Feature Selection to Improve Generalization of Genetic Programming for High-Dimensional Symbolic Regression
Chen, Q., Zhang, M., & Xue, B. (2017) · IEEE Transactions on Evolutionary Computation · doi:10.1109/tevc.2017.2683489 · Cited by 170
TD(?) converges with probability 1
Dayan, P., & B, T. J. S. A. (1994) · Machine Learning · doi:10.1023/a:1022657612745 · Cited by 174
Active Learning for Regression Based on Query by Committee
Burbidge, R., Rowland, J. J., & King, R. D. (2007) · Springer eBooks · doi:10.1007/978-3-540-77226-2_22 · Cited by 168
Toward generalizability in the deployment of artificial intelligence in radiology: role of computation stress testing to overcome underspecification
Eche, T., Schwartz, L. H., Mokrane, F.-Z., & Dercle, L. (2021) · Radiology: Artificial Intelligence · doi:10.1148/ryai.2021210097 · Cited by 163
Neural network ensembles: evaluation of aggregation algorithms
Granitto, P. M., Verdes, P. F., & Ceccatto, H. A. (2004) · Artificial Intelligence · doi:10.1016/j.artint.2004.09.006 · Cited by 167
Bias in artificial intelligence for medical imaging: fundamentals, detection, avoidance, mitigation, challenges, ethics, and prospects
Koçak, B., Ponsiglione, A., Stanzione, A., Bluethgen, C., Santinha, J., Ugga, L., Huisman, M., Klontzas, M. E., Cannella, R., & Cuocolo, R. (2024) · Diagnostic and Interventional Radiology · doi:10.4274/dir.2024.242854 · Cited by 168
“14 In this context, bias can be defined as the distance (or error) between the prediction and the actual target variable, whereas variance signifies the dependence of predictions on the randomness in the training data sampling (Figure 2).”
A Unifeid Bias-Variance Decomposition and its Applications
Domingos, P. (2000) · International Conference on Machine Learning · Cited by 165
RotBoost: A technique for combining Rotation Forest and AdaBoost
Zhang, C., & Zhang, J. (2008) · Pattern Recognition Letters · doi:10.1016/j.patrec.2008.03.006 · Cited by 163
Joint bagged-boosted artificial neural networks: Using ensemble machine learning to improve short-term electricity load forecasting
Khwaja, A. S., Anpalagan, A., Naeem, M., & Venkatesh, B. (2019) · Electric Power Systems Research · doi:10.1016/j.epsr.2019.106080 · Cited by 164
CART: Classiﬁcation and Regression Trees
Steinberg, D. (2009) · Chapman & Hall/CRC eBooks · doi:10.1201/9781420089653-17 · Cited by 166
Model Selection Based on Minimum Description Length
Grünwald, P. (2000) · Journal of Mathematical Psychology · doi:10.1006/jmps.1999.1280 · Cited by 162
Predictive dynamic bandwidth allocation for efficient transport of real-time VBR video over ATM
Chong, S., Li, S.-Q., & Ghosh, J. (1995) · IEEE Journal on Selected Areas in Communications · doi:10.1109/49.363150 · Cited by 162
An Efficient Method To Estimate Bagging's Generalization Error
Wolpert, D. H., & Macready, W. G. (1999) · Machine Learning · doi:10.1023/a:1007519102914 · Cited by 161
Variance and Bias for General Loss Functions
James, G. M. (2003) · Machine Learning · doi:10.1023/a:1022899518027 · Cited by 160
Combinations of weak classifiers
Ji, C., & Ma, S. (1997) · IEEE Transactions on Neural Networks · doi:10.1109/72.554189 · Cited by 159
Should recognizers have ears?
Hynek Hermansky, B. (1998) · Speech Communication · doi:10.1016/s0167-6393(98)00027-2 · Cited by 159
Combining diverse neural nets
SHARKEY, A. J. C., & SHARKEY, N. E. (1997) · The Knowledge Engineering Review · doi:10.1017/s0269888997003123 · Cited by 157
A hybrid recommender system using artificial neural networks
Paradarami, T. K., Bastian, N. D., & Wightman, J. L. (2017) · Expert Systems with Applications · doi:10.1016/j.eswa.2017.04.046 · Cited by 164
Prediction Risk and Architecture Selection for Neural Networks
Moody, J. E. (1994) · Springer eBooks · doi:10.1007/978-3-642-79119-2_7 · Cited by 158
Data and models for statistical parsing with combinatory categorial grammar
Hockenmaier, J. (2003) · ERA · Cited by 158
Avoiding Pitfalls in Neural Network Research
Zhang, G. (2006) · IEEE Transactions on Systems Man and Cybernetics Part C (Applications and Reviews) · doi:10.1109/tsmcc.2006.876059 · Cited by 157
Multiobjective Neural Network Ensembles Based on Regularized Negative Correlation Learning
Chen, H., & Yao, X. (2010) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2010.26 · Cited by 157
Rapid learning of syllable classes from a perceptually continuous speech stream.
Endress, A., & Bonatti, L. (2007) · Cognition · doi:10.1016/j.cognition.2006.09.010 · Cited by 151
Generalizable Patterns in Neuroimaging: How Many Principal Components?
Hansen, L. K., Larsen, J. O., Nielsen, F. Å., Strother, S. C., Rostrup, E., Savoy, R. L., LANGE, N. D., Sidtis, J. J., Svarer, C., & Paulson, O. B. (1999) · NeuroImage · doi:10.1006/nimg.1998.0425 · Cited by 154
Fashion retail forecasting by evolutionary neural networks
Au, K.-F., Choi, T., & Yu, Y. T. (2008) · International Journal of Production Economics · doi:10.1016/j.ijpe.2007.06.013 · Cited by 154
Diversity in Neural Network Ensembles
Gavin Brown, B. (2004) · Cited by 154
Fit without fear: remarkable mathematical phenomena of deep learning through the prism of interpolation
Belkin, M. (2021) · Acta Numerica · doi:10.1017/s0962492921000039 · Cited by 188
Exploring nonlinear feature space dimension reduction and data representation in breast CADx with Laplacian eigenmaps and ‐SNE
Jamieson, A. R., Giger, M. L., Drukker, K., Li, H., Yuan, Y., & Bhooshan, N. (2009) · Medical Physics · doi:10.1118/1.3267037 · Cited by 151
Imbalanced regression and extreme value prediction
Ribeiro, R. P., & Moniz, N. (2020) · Machine Learning · doi:10.1007/s10994-020-05900-9 · Cited by 152
Optimized Approximation Algorithm in Neural Networks Without Overfitting
Liu, Y., Starzyk, J. A., & Zhu, Z. (2008) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.2007.915114 · Cited by 150
A Unified Bias-Variance Decomposition for Zero-One and Squared Loss
Domingos, P. (2000) · Cited by 150
Prediction of risk of coronary events in middle-aged men in the Prospective Cardiovascular Münster Study (PROCAM) using neural networks
Voß, R., Cullen, P., Schulte, H., & Assmann, G. (2002) · International Journal of Epidemiology · doi:10.1093/ije/31.6.1253 · Cited by 148
Ensemble Learning
Gavin Brown, B. (2010) · Encyclopedia of Machine Learning · doi:10.1007/978-0-387-30164-8_252 · Cited by 150
Relating the Partial Dependence Plot and Permutation Feature Importance to the Data Generating Process
Molnar, C., Freiesleben, T., König, G., Herbinger, J., Reisinger, T., Casalicchio, G., Wright, M. N., & Bischl, B. (2023) · Communications in computer and information science · doi:10.1007/978-3-031-44064-9_24 · Cited by 149
Neural Network Studies. 4. Introduction to Associative Neural Networks
Tetko, I. V. (2002) · Journal of Chemical Information and Computer Sciences · doi:10.1021/ci010379o · Cited by 150
Bearing fault detection based on hybrid ensemble detector and empirical mode decomposition
Georgoulas, G., Loutas, T., Stylios, C. D., & Kostopoulos, V. (2013) · Mechanical Systems and Signal Processing · doi:10.1016/j.ymssp.2013.02.020 · Cited by 148
One-class support vector classifiers: A survey
Alam, S., Sonbhadra, S. K., Agarwal, S., & Nagabhushan, P. N. (2020) · Knowledge-Based Systems · doi:10.1016/j.knosys.2020.105754 · Cited by 148
The nearest subclass classifier: a compromise between the nearest mean and nearest neighbor classifier
Veenman, C. J., & Reinders, M. J. T. (2005) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2005.187 · Cited by 148
A survey of fuzzy clustering algorithms for pattern recognition. II
Baraldi, A., & Blonda, P. N. (1999) · IEEE Transactions on Systems Man and Cybernetics Part B (Cybernetics) · doi:10.1109/3477.809033 · Cited by 148
Ant colony optimization and its application to adaptive routing in telecommunication networks
Di, G. A., & Dorigo, M. (2004) · Cited by 144
Model selection on solid ground: Rigorous comparison of nine ways to evaluate B ayesian model evidence
Guthke, A., Wöhling, T., Samaniego, L., & Nowak, W. (2014) · Water Resources Research · doi:10.1002/2014wr016062 · Cited by 147
Ridge polynomial networks
Shin, Y., & Ghosh, J. (1995) · IEEE Transactions on Neural Networks · doi:10.1109/72.377967 · Cited by 147
Disease Diagnosis in Smart Healthcare: Innovation, Technologies and Applications
Chui, K. T., Alhalabi, W., Pang, S. S. H., de Pablos, P. O., Liu, R. W., & Zhao, M. (2017) · Sustainability · doi:10.3390/su9122309 · Cited by 153
Bayesian classifiers based on kernel density estimation: Flexible classifiers
Pérez, A., Larrañaga, P., & Inza, I. (2008) · International Journal of Approximate Reasoning · doi:10.1016/j.ijar.2008.08.008 · Cited by 146
Data mining using /spl Mscr/ℒ/spl Cscr/++ a machine learning library in C++
Kohavi, R., Sommerfield, D. A., & Dougherty, J. (2005) · IEEE International Conference on Tools with Artificial Intelligence (ICTAI) · doi:10.1109/tai.1996.560457 · Cited by 145
Regularized Negative Correlation Learning for Neural Network Ensembles
Chen, H., & Yao, X. (2009) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.2009.2034144 · Cited by 138
Statistical mechanics of ensemble learning
Krogh, A., & Peter Sollich, A. (1997) · Physical review. E, Statistical physics, plasmas, fluids, and related interdisciplinary topics · doi:10.1103/physreve.55.811 · Cited by 143
Evolving hybrid ensembles of learning machines for better generalisation
Chandra, A., & Yao, X. (2006) · Neurocomputing · doi:10.1016/j.neucom.2005.12.014 · Cited by 141
Psychological Heuristics for Making Inferences: Definition, Performance, and the Emerging Theory and Practice
Katsikopoulos, K. V. (2010) · Decision Analysis · doi:10.1287/deca.1100.0191 · Cited by 143
Adaptive soft sensor for quality prediction of chemical processes based on selective ensemble of local partial least squares models
Shao, W., & Tian, X. (2015) · Process Safety and Environmental Protection · doi:10.1016/j.cherd.2015.01.006 · Cited by 142
The constructivist brain
Quartz, S. R. (1999) · Trends in Cognitive Sciences · doi:10.1016/s1364-6613(98)01270-4 · Cited by 140
Short-term prediction of household electricity consumption: Assessing weather sensitivity in a Mediterranean area
Beccali, M., Cellura, M., Brano, V. L., & Marvuglia, A. (2007) · Renewable and Sustainable Energy Reviews · doi:10.1016/j.rser.2007.04.010 · Cited by 141

Authors: Geman, S., Bienenstock, E., & Doursat, R.
Affiliations: Brown University (US)
ESPCI Paris (FR)
ORCID: Doursat, René
Venue: Neural Computation
Publisher: MIT Press
Published: 1992-01
Volume: 4
Issue: 1
Pages: 1-58
ISSN: 0899-7667 (ISSN-L)
1530-888X
DOI: 10.1162/neco.1992.4.1.1
OpenAlex: W2076118331
Cited by: 3,578
References: 96
Citations by year: 2026: 125 · 2025: 131 · 2024: 115 · 2023: 128 · 2022: 148 · 2021: 201 · 2020: 181 · 2019: 142 · 2018: 126 · 2017: 97 · 2016: 115 · 2015: 99 · 2014: 103 · 2013: 82 · 2012: 110
FWCI: 60.04
Type: journal article
Language: en
Open access: closed
Locations: Neural Computation (publishedVersion)
e-space (Manchester Metropolitan University) (submittedVersion)
Topics: Physical Sciences › Computer Science › Artificial Intelligence › Neural Networks and Applications
Physical Sciences › Computer Science › Artificial Intelligence › Machine Learning and Algorithms
Physical Sciences › Computer Science › Artificial Intelligence › Machine Learning and ELM
Keywords: bias-variance trade-off, feedforward neural networks, backpropagation, nonparametric regression, nonparametric inference, handwritten digit recognition, machine perception, neural network representations, statistical learning

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Neural Networks and the Bias/Variance Dilemma

Abstract

Overview

Integrity signals

Verification

Claims the paper makes

Claims other papers make about this one

Citations

Cites

Cited by

Related

Metadata

Record

About these checks