Approximation by superpositions of a sigmoidal function
Open accessThe DOI matches its Crossref record; 24 of the 25 references it cites were found in a registry or an index.
Abstract
In this paper we demonstrate that finite linear combinations of compositions of a fixed, univariate function and a set of affine functionals can uniformly approximate any continuous function ofn real variables with support in the unit hypercube; only mild conditions are imposed on the univariate function. Our results settle an open question about representability in the class of single hidden layer neural networks. In particular, we show that arbitrary decision regions can be arbitrarily well approximated by continuous feedforward neural networks with only a single internal, hidden layer and any continuous sigmoidal nonlinearity. The paper discusses approximation properties of other possible types of nonlinearities that might be implemented by artificial neural networks.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“The ANNs are considered highly flexible, powerful, and scalable models since they provide the possibility to handle large amounts of parameters and demonstrably approximate any function (Cybenko 1989; Gerón 2019).”
From Software sensors in the monitoring of microalgae cultivations (2024) · cites this paper as Cybenko 1989
In the citing paper
“These theorems guarantee that, provided enough free parameters, feedforward neural networks can approximate any continuous function on a closed and bounded subset of R n to an arbitrary degree of accuracy.”
From Continuous-variable quantum neural networks (2019) · cites this paper as [55]
In the citing paper
“For ordinal deep learning models, such as FFNs and CNNs, deep architecture immediately benefits from the universal approximation power and expressive capacity (Cybenko, 1989; Hornik, 1991; Telgarsky, 2016; Lu et al., 2017; Petersen & Voigtlaender, 2020; Zhou, 2020).”
From Anti-Oversmoothing in Deep Vision Transformers via the Fourier Domain Analysis: From Theory to Practice (2022) · cites this paper as Cybenko, 1989
In the citing paper
“An artificial neural network model composed of more than two layers is known to be able to approximate any continuous mapping (Cybenko, 1989; Funahashi, 1989; Hornik et al., 1989), which is a theoretical basis of the universal cerebellar transform (Schmahmann, 2004).”
From The Cerebro-Cerebellum as a Locus of Forward Model: A Review (2020) · cites this paper as Cybenko, 1989
In the citing paper
“For example, in a generic M-theory setting (without localized sources), I classical is given by I classical = I F 4 = 1 6 g 11-d (e (d- 8)A (12 -d) f 2 4 -d e dA f 2 4 ) ≤ 0 , (D.15) where we are working with F 4 = F 7 and we have decomposed F 4 = f4 + f 4 , with f4 being the space-time component (which is non-vanishing only for d = 4).The last inequality follows from f 2 4 ≤ 0 23 .”
From Hyperbolic compactification of M-theory and de Sitter quantum gravity (2022) · cites this paper as [66]
5 more claims about this paper
Create a free account to see every claim other papers make about this one.
Citations
Cites
Multilayer feedforward networks are universal approximators
Hornik, K., Stinchcombe, M., & White, H. (1989) · Neural Networks · doi:10.1016/0893-6080(89)90020-8 · Cited by 21,728
Parallel Distributed Processing: Explorations in the Microstructure of Cognition: Foundations
Rumelhart, D. E., McClelland, J. L., & AU (1986) · doi:10.7551/mitpress/5236.001.0001 · Cited by 15,686
Rudin, W. (1973) · Cited by 13,740
Garreau, G. A., & Rudin, W. (1987) · The Statistician · doi:10.2307/2348852 · Cited by 10,622
An introduction to computing with neural nets
Lippmann, R. (1987) · IEEE ASSP Magazine · doi:10.1109/massp.1987.1165576 · Cited by 7,825
On the approximate realization of continuous mappings by neural networks
Funahashi, K.-I. (1989) · Neural Networks · doi:10.1016/0893-6080(89)90003-8 · Cited by 4,206
Valiant, L. G. (1984) · Communications of the ACM · doi:10.1145/1968.1972 · Cited by 3,279
What Size Net Gives Valid Generalization?
Baum, E. B., & Haussler, D. (1989) · Neural Computation · doi:10.1162/neco.1989.1.1.151 · Cited by 1,541
Huber, P. J. (1985) · The Annals of Statistics · doi:10.1214/aos/1176349519 · Cited by 1,277
Real Analysis and Probability.
Ross, K. A., & Ash, R. B. (1975) · The American Mathematical Monthly · doi:10.2307/2319153 · Cited by 714
Research works printed but not linked: 5
- [K] A. N. Kolmogorov, On the representation of continuous functions of many variables by superposition of continuous functions of one variable and addition,Dokl. Akad. Nauk. SSSR,114 (1957), 953–956.
- [MSJ] J. Makhoul, R. Schwartz, and A. El-Jaroudi, Classification capabilities of two-layer neural nets.Proceedings of the IEEE International Conference on Acoustics, Speech, and Signal Processing, Glasgow, 1989 (to appear).
- [MP] M. Minsky and S. Papert,Perceptrons, MIT Press, Cambridge, MA, 1969.
- [N] N. J. Nilsson,Learning Machines, McGraw-Hill, New York, 1965.
- [WL] A Wieland and R. Leighton, Geometric analysis of neural network capabilities,Proceedings of IEEE First International Conference on Neural Networks, San Diego, CA, pp. III-385–III-392, 1987.
Cited by
Items 701–800 of 1,050
Estimation of Soil Physical Properties Using Remote Sensing and Artificial Neural Network
Chang, D. (2000) · Remote Sensing of Environment · doi:10.1016/s0034-4257(00)00144-9 · Cited by 158
State of the Art of Artificial Neural Networks in Geotechnical Engineering
Shahin, M. A., Jaksa, M. B., & Maier, H. R. (2008) · Adelaide Research & Scholarship (AR&S) (University of Adelaide) · Cited by 222
Taheri, K., Hasanipanah, M., Golzar, S. B., & Majid, M. Z. A. (2017) · Engineering with Computers · doi:10.1007/s00366-016-0497-3 · Cited by 158
Machine learning techniques for monthly river flow forecasting of Hunza River, Pakistan
Hussain, D., & Khan, A. A. (2020) · Earth Science Informatics · doi:10.1007/s12145-020-00450-z · Cited by 165
Segmenting the market of West Australian senior tourists using an artificial neural network
Kim, J., Wei, S., & Ruys, H. (2003) · Tourism Management · doi:10.1016/s0261-5177(02)00050-x · Cited by 158
ECG analysis using nonlinear PCA neural networks for ischemia detection
Stamkopoulos, T., Diamantaras, K., Maglaveras, N., & Strintzis, M. (1998) · IEEE Transactions on Signal Processing · doi:10.1109/78.726818 · Cited by 160
Learning pattern classification-a survey
Kulkarni, S. R., Lugosi, G., & Venkatesh, S. S. (1998) · IEEE Transactions on Information Theory · doi:10.1109/18.720536 · Cited by 161
Representation, similarity, and the chorus of prototypes
Edelman, S. (1995) · Minds and Machines · doi:10.1007/bf00974189 · Cited by 160
Facial Expression Recognition Using Constructive Feedforward Neural Networks
Ma, L., & Khorasani, K. (2004) · IEEE Transactions on Systems, Man and Cybernetics, Part B (Cybernetics) · doi:10.1109/tsmcb.2004.825930 · Cited by 160
Ma, T., Antoniou, C., & Toledo, T. (2020) · Transportation Research Part C Emerging Technologies · doi:10.1016/j.trc.2019.12.022 · Cited by 160
Machine Learning Applications in Hydrology
Lange, H., & Sippel, S. (2020) · Ecological studies · doi:10.1007/978-3-030-26086-6_10 · Cited by 189
A perspective on machine learning methods in turbulence modeling
Beck, A., & Kurz, M. (2021) · GAMM-Mitteilungen · doi:10.1002/gamm.202100002 · Cited by 188
Avoiding Pitfalls in Neural Network Research
Zhang, G. (2006) · IEEE Transactions on Systems Man and Cybernetics Part C (Applications and Reviews) · doi:10.1109/tsmcc.2006.876059 · Cited by 174
Are All Layers Created Equal?Preprint
Zhang, C., Bengio, S., & Singer, Y. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1902.01996 · Cited by 166
Multivariate sigmoidal neural network approximation
Anastassiou, G. A. (2011) · Neural Networks · doi:10.1016/j.neunet.2011.01.003 · Cited by 174
Deep learning and model predictive control for self-tuning mode-locked lasers
Baumeister, T., Brunton, S. L., & Nathan Kutz, J. (2018) · Journal of the Optical Society of America B · doi:10.1364/josab.35.000617 · Cited by 158
Deep distributed convolutional neural networks: Universality
Zhou, D. (2018) · Analysis and Applications · doi:10.1142/s0219530518500124 · Cited by 176
Evaluation of Different Machine Learning Approaches to Forecasting PM2.5 Mass Concentrations
Karimian, H., Li, Q., Wu, C., Qi, Y., Mo, Y., Chen, G., Zhang, X., & Sachdeva, S. (2019) · Aerosol and Air Quality Research · doi:10.4209/aaqr.2018.12.0450 · Cited by 172
Solving Fokker-Planck equation using deep learning
Xu, Y., Zhang, H., Li, Y., Zhou, K., Liu, Q., & Kurths, J. (2020) · Chaos An Interdisciplinary Journal of Nonlinear Science · doi:10.1063/1.5132840 · Cited by 159
Backpropagation-free training of deep physical neural networks
Momeni, A., Rahmani, B., Malléjac, M., del Hougne, P., & Fleury, R. (2023) · Science · doi:10.1126/science.adi8474 · Cited by 215
Brown, D. F. R., Gibbs, M. N., & Clary, D. C. (1996) · The Journal of Chemical Physics · doi:10.1063/1.472596 · Cited by 154
Multilayer Perceptrons to Approximate Quaternion Valued Functions
Arena, P., Fortuna, L., Muscato, G., & Xibilia, M. G. (1997) · Neural Networks · doi:10.1016/s0893-6080(96)00048-2 · Cited by 167
Representing molecule-surface interactions with symmetry-adapted neural networks
Behler, J., Lorenz, S., & Reuter, K. (2007) · The Journal of Chemical Physics · doi:10.1063/1.2746232 · Cited by 155
Dermatological disease detection using image processing and machine learning
Kumar, V. B., Kumar, S. S., & Saboo, V. (2016) · doi:10.1109/icaipr.2016.7585217 · Cited by 158
Dimopoulos, I., Chronopoulos, J., Chronopoulou-Sereli, A., & Lek, S. (1999) · Ecological Modelling · doi:10.1016/s0304-3800(99)00099-x · Cited by 158
What graph neural networks cannot learn: depth vs widthPreprint
Loukas, A. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1907.03199 · Cited by 228
Modern applications of machine learning in quantum sciencesPreprint
Dawid, A., Arnold, J., Requena, B., Gresch, A., Płodzień, M., Donatella, K., Nicoli, K. A., Stornati, P., Koch, R., Büttner, M., et al. (2022) · arXiv (Cornell University) · doi:10.48550/arxiv.2204.04198 · Cited by 180
Approximation properties of a multilayered feedforward artificial neural network
Mhaskar, H. N. (1993) · Advances in Computational Mathematics · doi:10.1007/bf02070821 · Cited by 157
Applications of artificial neural nets in clinical biomechanics
Schöllhorn, W. I. (2004) · Clinical Biomechanics · doi:10.1016/j.clinbiomech.2004.04.005 · Cited by 172
Perrusquía, A., & Yu, W. (2021) · Neurocomputing · doi:10.1016/j.neucom.2021.01.096 · Cited by 157
Physics-informed neural networks for the shallow-water equations on the sphere
Bihlo, A., & Popovych, R. O. (2022) · Journal of Computational Physics · doi:10.1016/j.jcp.2022.111024 · Cited by 180
Complexity Regularization with Application to Artificial Neural Networks
Barron, A. R. (1991) · Nonparametric Functional Estimation and Related Topics · doi:10.1007/978-94-011-3222-0_42 · Cited by 160
Prediction of tunnel convergence using Artificial Neural Networks
Mahdevari, S., & Torabi, S. R. (2011) · Tunnelling and Underground Space Technology · doi:10.1016/j.tust.2011.11.002 · Cited by 156
Chang, S., Timothy Cohen, A., & Ostdiek, B. (2018) · Physical review. D/Physical review. D. · doi:10.1103/physrevd.97.056009 · Cited by 156
Contrastive Learning for Debiased Candidate Generation in Large-Scale Recommender Systems
Zhou, C., Ma, J., Zhang, J., Zhou, J., & Yang, H. (2021) · Proceedings of the 27th ACM SIGKDD Conference on Knowledge Discovery & Data Mining · doi:10.1145/3447548.3467102 · Cited by 134
Nonlinear principal component analysis by neural networks
Hsieh, W. W. (2001) · Tellus A Dynamic Meteorology and Oceanography · doi:10.1034/j.1600-0870.2001.00251.x · Cited by 157
Neural Networks as Statistical Tools for Business Researchers
Detienne, K. B., Detienne, D. H., & Joshi, S. A. (2003) · Organizational Research Methods · doi:10.1177/1094428103251907 · Cited by 158
Discrete-Time Adaptive Backstepping Nonlinear Control via High-Order Neural Networks
Alanís, A. Y., Sanchez, E. N., & Loukianov, A. G. (2007) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.2007.899170 · Cited by 158
The power of deeper networks for expressing natural functions
Rolnick, D., & Tegmark, M. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1705.05502 · Cited by 109
The Cerebro-Cerebellum as a Locus of Forward Model: A Review
Tanaka, H., Ishikawa, T., Lee, J., & Kakei, S. (2020) · Frontiers in Systems Neuroscience · doi:10.3389/fnsys.2020.00019 · Cited by 155
Soil Moisture Retrieval Using Neural Networks: Application to SMOS
Rodríguez-Fernández, N. J., Aires, F., Richaume, P., Kerr, Y. H., Prigent, C., Kolassa, J., Cabot, F., Jiménez, C., Mahmoodi, A., & Drusch, M. (2015) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2015.2430845 · Cited by 155
An overview on the mathematical modeling of hydrogels’ behavior for drug delivery systems
Caccavo, D. (2019) · International Journal of Pharmaceutics · doi:10.1016/j.ijpharm.2019.01.076 · Cited by 164
Feedforward nets for interpolation and classification
Sontag, E. D. (1992) · Journal of Computer and System Sciences · doi:10.1016/0022-0000(92)90039-l · Cited by 158
Structural damage detection and identification using neural networks
Tsou, P., & Shen, M.-H. H. (1994) · AIAA Journal · doi:10.2514/3.11964 · Cited by 155
Machine Learning at Central BanksPreprint
Chakraborty, C., & Joseph, A. C. (2017) · SSRN Electronic Journal · doi:10.2139/ssrn.3031796 · Cited by 233
Forecasting model of global stock index by stochastic time effective neural network
Liao, Z., & Wang, J. (2009) · Expert Systems with Applications · doi:10.1016/j.eswa.2009.05.086 · Cited by 154
Pakdaman, M., Ahmadian, A., Effati, S., Salahshour, S., & Bǎleanu, D. (2016) · Applied Mathematics and Computation · doi:10.1016/j.amc.2016.07.021 · Cited by 154
A priori estimates of the population risk for two-layer neural networks
E, W., Ma, C., & Wu, L. (2018) · Communications in Mathematical Sciences · doi:10.4310/cms.2019.v17.n5.a11 · Cited by 157
Transformer Fault Prognosis Using Deep Recurrent Neural Network Over Vibration Signals
Zollanvari, A., Kunanbayev, K., Bitaghsir, S. A., & Bagheri, M. (2020) · IEEE Transactions on Instrumentation and Measurement · doi:10.1109/tim.2020.3026497 · Cited by 155
Physics‐Informed Neural Network Method for Forward and Backward Advection‐Dispersion Equations
He, Q., & Tartakovsky, A. M. (2021) · Water Resources Research · doi:10.1029/2020wr029479 · Cited by 154
Gorr, W. L., Nagin, D. S., & Szczypula, J. (1994) · International Journal of Forecasting · doi:10.1016/0169-2070(94)90046-9 · Cited by 183
ANN-based model for predicting the bearing capacity of strip footing on multi-layered cohesive soil
Kuo, Y. L., Jaksa, M. B., Lyamin, A. V., & Kaggwa, W. S. (2008) · Computers and Geotechnics · doi:10.1016/j.compgeo.2008.07.002 · Cited by 155
Machine learning of explicit order parameters: From the Ising model to SU(2) lattice gauge theory
Wetzel, S. J., & Scherzer, M. (2017) · Physical review. B./Physical review. B · doi:10.1103/physrevb.96.184410 · Cited by 169
Data-driven discovery of PDEs in complex datasets
Berg, J., & Nyström, K. (2019) · Journal of Computational Physics · doi:10.1016/j.jcp.2019.01.036 · Cited by 174
Wessels, H., Weißenfels, C., & Wriggers, P. (2020) · Computer Methods in Applied Mechanics and Engineering · doi:10.1016/j.cma.2020.113127 · Cited by 171
Tanno, R., Worrall, D. E., Kaden, E., Ghosh, A., Grussu, F., Bizzi, A., Sotiropoulos, S. N., Criminisi, A., & Alexander, D. C. (2021) · NeuroImage · doi:10.1016/j.neuroimage.2020.117366 · Cited by 113
Learning Adaptive Differential Evolution Algorithm From Optimization Experiences by Policy Gradient
Sun, J., Liu, X., Bäck, T., & Xu, Z. (2021) · IEEE Transactions on Evolutionary Computation · doi:10.1109/tevc.2021.3060811 · Cited by 153
Evapotranspiration estimation by two different neuro-fuzzy inference systems
Çobaner, M. (2011) · Journal of Hydrology · doi:10.1016/j.jhydrol.2010.12.030 · Cited by 152
Machine learning applications in activity-travel behaviour research: a review
Koushik, A. N., Manoj, M., & Nezamuddin, N. (2020) · Transport Reviews · doi:10.1080/01441647.2019.1704307 · Cited by 165
The Role of Neural Network Activation Functions
Parhi, R., & Nowak, R. D. (2020) · IEEE Signal Processing Letters · doi:10.1109/lsp.2020.3027517 · Cited by 152
Development and multi-utility of an ANN model for an industrial gas turbine
Fast, M., Assadi, M., & De, S. (2008) · Applied Energy · doi:10.1016/j.apenergy.2008.03.018 · Cited by 152
Quantum neural networks (QNNs): inherently fuzzy feedforward neural networks
Purushothaman, G., & Karayiannis, N. B. (2002) · Proceedings of International Conference on Neural Networks (ICNN'96) · doi:10.1109/icnn.1996.549049 · Cited by 148
Neural network adaptive robust control of nonlinear systems in semi-strict feedback form
Gong, J. Q., & Yao, B. (2001) · Automatica · doi:10.1016/s0005-1098(01)00069-3 · Cited by 154
Control of nonlinear systems using polynomial ARMA models
Hernández, E., & Arkun, Y. (1993) · AIChE Journal · doi:10.1002/aic.690390308 · Cited by 152
Mathematics of Deep LearningPreprint
Vidal, R., Bruna, J., Giryes, R., & Soatto, S. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1712.04741 · Cited by 166
de Oliveira, E. M., Leme, D. S., Barbosa, B. H. G., Rodarte, M. P., & Pereira, R. G. F. A. (2015) · Journal of Food Engineering · doi:10.1016/j.jfoodeng.2015.10.009 · Cited by 151
Moustapha, A. I., & Selmic, R. R. (2008) · IEEE Transactions on Instrumentation and Measurement · doi:10.1109/tim.2007.913803 · Cited by 149
Automatic physical inference with information maximizing neural networks
Charnock, T., Lavaux, G., & Wandelt, B. D. (2018) · Physical Review D · doi:10.1103/physrevd.97.083004 · Cited by 113
The Gap between Theory and Practice in Function Approximation with Deep Neural Networks
Adcock, B., & Dexter, N. (2021) · SIAM Journal on Mathematics of Data Science · doi:10.1137/20m131309x · Cited by 177
Kuo, Y.-M., Liu, C., & Lin, K. (2003) · Water Research · doi:10.1016/j.watres.2003.09.026 · Cited by 151
Robust adaptive control of nonholonomic mobile robot with parameter and nonparameter uncertainties
Dong, W., & Kuhnert, K. ‐. (2005) · IEEE Transactions on Robotics · doi:10.1109/tro.2004.837236 · Cited by 151
Ciampi, F., & Gordini, N. (2012) · Journal of Small Business Management · doi:10.1111/j.1540-627x.2012.00376.x · Cited by 178
Wu, T., & Kareem, A. (2011) · Journal of Wind Engineering and Industrial Aerodynamics · doi:10.1016/j.jweia.2010.12.011 · Cited by 150
Ahmed, R., Sayed, M. E., Gadsden, S. A., Tjong, J., & Habibi, S. R. (2014) · IEEE Transactions on Vehicular Technology · doi:10.1109/tvt.2014.2317736 · Cited by 150
Gogna, A., Majumdar, A., & Ward, R. (2017) · IEEE Transactions on Biomedical Engineering · doi:10.1109/tbme.2016.2631620 · Cited by 147
Deep Learning: A Review for the Radiation Oncologist
Boldrini, L., Bibault, J., Masciocchi, C., Shen, Y., & Bittner, M.-I. (2019) · Frontiers in Oncology · doi:10.3389/fonc.2019.00977 · Cited by 162
Schmidt, L., Heße, F., Attinger, S., & Kumar, R. (2020) · Water Resources Research · doi:10.1029/2019wr025924 · Cited by 162
Calculation of the Volterra kernels of non-linear dynamic systems using an artificial neural network
Wray, J., & Green, G. G. R. (1994) · Biological Cybernetics · doi:10.1007/bf00202758 · Cited by 161
PREDICTING BANK FAILURES: A NEURAL NETWORK APPROACH
TAM, K. Y., & KIANG, M. (1990) · Applied Artificial Intelligence · doi:10.1080/08839519008927951 · Cited by 148
Nonlinear system identification via direct weight optimization
Roll, J., Nazin, A., & Lennart Ljung, A. (2005) · Automatica · doi:10.1016/j.automatica.2004.11.010 · Cited by 150
Empiricism without magic: transformational abstraction in deep convolutional neural networks
Buckner, C. (2018) · Synthese · doi:10.1007/s11229-018-01949-1 · Cited by 149
“…of mathematical abstraction, all neural networks perform pattern recognition or dimensionality reduction, and the universal approximation theory shows that in principle a three-layer perceptron with an unlimited number of nodes can approximate any continuous function (Cybenko 1989; Hornik 1991).”
BackgroundEvolving neural networks with genetic algorithms to study the string landscape
Ruehle, F. (2017) · Journal of High Energy Physics · doi:10.1007/jhep08(2017)038 · Cited by 177
A generic physics-informed neural network-based constitutive model for soft biological tissues
Liu, M., Liang, L., & Sun, W. (2020) · Computer Methods in Applied Mechanics and Engineering · doi:10.1016/j.cma.2020.113402 · Cited by 167
Shin, Y., & Ghosh, J. (1995) · IEEE Transactions on Neural Networks · doi:10.1109/72.377967 · Cited by 149
Kolmogorov-Arnold Networks: A Critical Assessment of Claims, Performance, and Practical ViabilityPreprint
Hou, Y., Ji, T., Zhang, D., & Stefanidis, A. (2025) · Research Square · doi:10.21203/rs.3.rs-7063327/v1 · Cited by 149
Nonlinear multivariate and time series analysis by neural network methods
Hsieh, W. W. (2004) · Reviews of Geophysics · doi:10.1029/2002rg000112 · Cited by 148
“continuous functions fj, only one layer of hidden neurons is enough, provided enough hidden neurons are used in that layer [Hornik et al., 1989; Cybenko, 1989].”
MethodDeepPerf: Performance Prediction for Configurable Software with Deep Sparse Neural Network
Ha, H., & Zhang, H. (2019) · ACM/IEEE International Conference on Software Engineering: Companion Proceedings (ICSE-Companion) · doi:10.1109/icse.2019.00113 · Cited by 168
A feasibility study of deep learning for predicting hemodynamics of human thoracic aorta
Liang, L., Mao, W., & Sun, W. (2019) · Journal of Biomechanics · doi:10.1016/j.jbiomech.2019.109544 · Cited by 155
Review and Classification of Bio-inspired Algorithms and Their Applications
Fan, X., Sayers, W., Zhang, S., Han, Z., Ren, L., & Chizari, H. (2020) · Journal of Bionic Engineering · doi:10.1007/s42235-020-0049-9 · Cited by 168
Rivals, I., & Personnaz, L. (2000) · IEEE Transactions on Neural Networks · doi:10.1109/72.822512 · Cited by 148
Nonparametric estimation via empirical risk minimization
Lugosi, G., & Zeger, K. (1995) · IEEE Transactions on Information Theory · doi:10.1109/18.382014 · Cited by 163
Non-linear systems identification using radial basis functions
Chen, S., Billings, S. A., Cowan, C. F. N., & Grant, P. M. (1990) · International Journal of Systems Science · doi:10.1080/00207729008910567 · Cited by 148
Beating the Perils of Non-Convexity: Guaranteed Training of Neural Networks using Tensor MethodsPreprint
Janzamin, M., Sedghi, H., & Anandkumar, A. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1506.08473 · Cited by 176
A Survey on Activation Functions and their relation with Xavier and He Normal InitializationPreprint
Datta, L. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2004.06632 · Cited by 180
Masson, V., Grimmond, S., & Oke, T. R. (2002) · Journal of applied meteorology · doi:10.1175/1520-0450(2002)041<0046:eiocvi>2.0.co;2 · Cited by 306
A neural network architecture that computes its own reliability
Leonard, J. A., Kramer, M. A., & Ungar, L. (1992) · Computers & Chemical Engineering · doi:10.1016/0098-1354(92)80035-8 · Cited by 147
A Cross‐Validation Analysis of Neural Network Out‐of‐Sample Performance in Exchange Rate Forecasting
Hu, M. Y., Zhang, G., Jiang, C. X., & Patuwo, B. E. (1999) · Decision Sciences · doi:10.1111/j.1540-5915.1999.tb01606.x · Cited by 147
Artificial neural networks for fast and accurate EM-CAD of microwave circuits
Creech, G. L., Paul, B. J., Lesniak, C., Jenkins, T., & Calcatera, M. (1997) · IEEE Transactions on Microwave Theory and Techniques · doi:10.1109/22.575602 · Cited by 147
On the Turing Completeness of Modern Neural Network Architectures
Pérez, J. E. P., Marinković, J., & Barceló, P. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1901.03429 · Cited by 78
Metadata
- Authors
- Cybenko, G.
- Affiliations
- University of Illinois Urbana-Champaign (US)
- Corresponding author
- Cybenko, G.
- ORCID
- Cybenko, G.
- Venue
- Mathematics of Control, Signals, and Systems
- Published
- 1989-12
- Volume
- 2
- Issue
- 4
- Pages
- 303-314
- ISSN
- 0932-4194 (ISSN-L)
- 1435-568X
- OpenAlex
- W2103496339
- Semantic Scholar
- 8da1dda34ecc96263102181448c94ec7d645d085
- Cited by
- 13,883
- References
- 25
- Citations by year
- 2026: 640 · 2025: 889 · 2024: 793 · 2023: 746 · 2022: 827 · 2021: 1050 · 2020: 1001 · 2019: 761 · 2018: 542 · 2017: 414 · 2016: 312 · 2015: 313 · 2014: 289 · 2013: 310 · 2012: 296
- FWCI
- 94.52
- Type
- journal article
- Language
- en
- Open access
- green
- hal.science
- Licence
- cc-by-nc
- www.springer.com/tdm (tdm)
- Locations
- Mathematics of Control Signals and Systems (publishedVersion)
- HAL (submittedVersion, cc-by-nc)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Neural Networks and Applications
- Physical Sciences › Computer Science › Artificial Intelligence › Machine Learning and ELM
- Physical Sciences › Mathematics › Applied Mathematics › Approximation Theory and Sequence Spaces
- Keywords
- universal approximation, sigmoidal function, single hidden layer neural network, feedforward neural networks, approximation of continuous functions, decision regions, nonlinear activation functions, unit hypercube
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.