Approximation by superpositions of a sigmoidal function
Open accessThe DOI matches its Crossref record; 24 of the 25 references it cites were found in a registry or an index.
Abstract
In this paper we demonstrate that finite linear combinations of compositions of a fixed, univariate function and a set of affine functionals can uniformly approximate any continuous function ofn real variables with support in the unit hypercube; only mild conditions are imposed on the univariate function. Our results settle an open question about representability in the class of single hidden layer neural networks. In particular, we show that arbitrary decision regions can be arbitrarily well approximated by continuous feedforward neural networks with only a single internal, hidden layer and any continuous sigmoidal nonlinearity. The paper discusses approximation properties of other possible types of nonlinearities that might be implemented by artificial neural networks.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“The ANNs are considered highly flexible, powerful, and scalable models since they provide the possibility to handle large amounts of parameters and demonstrably approximate any function (Cybenko 1989; Gerón 2019).”
From Software sensors in the monitoring of microalgae cultivations (2024) · cites this paper as Cybenko 1989
In the citing paper
“These theorems guarantee that, provided enough free parameters, feedforward neural networks can approximate any continuous function on a closed and bounded subset of R n to an arbitrary degree of accuracy.”
From Continuous-variable quantum neural networks (2019) · cites this paper as [55]
In the citing paper
“For ordinal deep learning models, such as FFNs and CNNs, deep architecture immediately benefits from the universal approximation power and expressive capacity (Cybenko, 1989; Hornik, 1991; Telgarsky, 2016; Lu et al., 2017; Petersen & Voigtlaender, 2020; Zhou, 2020).”
From Anti-Oversmoothing in Deep Vision Transformers via the Fourier Domain Analysis: From Theory to Practice (2022) · cites this paper as Cybenko, 1989
In the citing paper
“An artificial neural network model composed of more than two layers is known to be able to approximate any continuous mapping (Cybenko, 1989; Funahashi, 1989; Hornik et al., 1989), which is a theoretical basis of the universal cerebellar transform (Schmahmann, 2004).”
From The Cerebro-Cerebellum as a Locus of Forward Model: A Review (2020) · cites this paper as Cybenko, 1989
In the citing paper
“For example, in a generic M-theory setting (without localized sources), I classical is given by I classical = I F 4 = 1 6 g 11-d (e (d- 8)A (12 -d) f 2 4 -d e dA f 2 4 ) ≤ 0 , (D.15) where we are working with F 4 = F 7 and we have decomposed F 4 = f4 + f 4 , with f4 being the space-time component (which is non-vanishing only for d = 4).The last inequality follows from f 2 4 ≤ 0 23 .”
From Hyperbolic compactification of M-theory and de Sitter quantum gravity (2022) · cites this paper as [66]
5 more claims about this paper
Create a free account to see every claim other papers make about this one.
Citations
Cites
Multilayer feedforward networks are universal approximators
Hornik, K., Stinchcombe, M., & White, H. (1989) · Neural Networks · doi:10.1016/0893-6080(89)90020-8 · Cited by 21,728
Parallel Distributed Processing: Explorations in the Microstructure of Cognition: Foundations
Rumelhart, D. E., McClelland, J. L., & AU (1986) · doi:10.7551/mitpress/5236.001.0001 · Cited by 15,686
Rudin, W. (1973) · Cited by 13,740
Garreau, G. A., & Rudin, W. (1987) · The Statistician · doi:10.2307/2348852 · Cited by 10,622
An introduction to computing with neural nets
Lippmann, R. (1987) · IEEE ASSP Magazine · doi:10.1109/massp.1987.1165576 · Cited by 7,825
On the approximate realization of continuous mappings by neural networks
Funahashi, K.-I. (1989) · Neural Networks · doi:10.1016/0893-6080(89)90003-8 · Cited by 4,206
Valiant, L. G. (1984) · Communications of the ACM · doi:10.1145/1968.1972 · Cited by 3,279
What Size Net Gives Valid Generalization?
Baum, E. B., & Haussler, D. (1989) · Neural Computation · doi:10.1162/neco.1989.1.1.151 · Cited by 1,541
Huber, P. J. (1985) · The Annals of Statistics · doi:10.1214/aos/1176349519 · Cited by 1,277
Real Analysis and Probability.
Ross, K. A., & Ash, R. B. (1975) · The American Mathematical Monthly · doi:10.2307/2319153 · Cited by 714
Research works printed but not linked: 5
- [K] A. N. Kolmogorov, On the representation of continuous functions of many variables by superposition of continuous functions of one variable and addition,Dokl. Akad. Nauk. SSSR,114 (1957), 953–956.
- [MSJ] J. Makhoul, R. Schwartz, and A. El-Jaroudi, Classification capabilities of two-layer neural nets.Proceedings of the IEEE International Conference on Acoustics, Speech, and Signal Processing, Glasgow, 1989 (to appear).
- [MP] M. Minsky and S. Papert,Perceptrons, MIT Press, Cambridge, MA, 1969.
- [N] N. J. Nilsson,Learning Machines, McGraw-Hill, New York, 1965.
- [WL] A Wieland and R. Leighton, Geometric analysis of neural network capabilities,Proceedings of IEEE First International Conference on Neural Networks, San Diego, CA, pp. III-385–III-392, 1987.
Cited by
Items 201–300 of 1,050
The use of backpropagating artificial neural networks in land cover classification
Kavzoglu, T., & Mather, P. M. (2003) · International Journal of Remote Sensing · doi:10.1080/0143116031000114851 · Cited by 457
The Challenge of Machine Learning in Space Weather: Nowcasting and Forecasting
Camporeale, E. (2019) · Space Weather · doi:10.1029/2018sw002061 · Cited by 403
Thermodynamics-based Artificial Neural Networks for constitutive modeling
Masi, F., Stefanou, I., Vannucci, P., & Maffi-Berthier, V. (2021) · Journal of the Mechanics and Physics of Solids · doi:10.1016/j.jmps.2020.104277 · Cited by 417
Robust and Adaptive Backstepping Control for Nonlinear Systems Using RBF Neural Networks
Li, Y., Qiang, S., Zhuang, X., & Kaynak, O. (2004) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.2004.826215 · Cited by 455
Robust backstepping control of nonlinear systems using neural networks
Kwan, C., & Lewis, F. L. (2000) · IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans · doi:10.1109/3468.895898 · Cited by 459
Computational capabilities of recurrent NARX neural networks
Siegelmann, H. T., Horne, B. G., & Giles, C. L. (1997) · IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics) · doi:10.1109/3477.558801 · Cited by 455
Artificial neural networks: an econometric perspective∗
Kuan, C.-M., & White, H. (1994) · Econometric Reviews · doi:10.1080/07474939408800273 · Cited by 454
Model complexity of deep learning: a survey
Hu, X., Chu, L., Pei, J., Liu, W., & Bian, J. (2021) · Knowledge and Information Systems · doi:10.1007/s10115-021-01605-0 · Cited by 402
Haghighat, E., & Juanes, R. (2021) · Computer Methods in Applied Mechanics and Engineering · doi:10.1016/j.cma.2020.113552 · Cited by 425
Bond Risk Premiums with Machine Learning
Bianchi, D., Büchner, M., & Tamoni, A. (2021) · The Review of Financial Studies · doi:10.1093/rfs/hhaa062 · Cited by 409
Chaos in a Noisy World: New Methods and Evidence from Time-Series Analysis
Ellner, S., & Turchin, P. (1995) · The American Naturalist · doi:10.1086/285744 · Cited by 461
Adaptive output feedback control of nonlinear systems using neural networks
Calise, A. J., Hovakimyan, N., & Idan, M. (2001) · Automatica · doi:10.1016/s0005-1098(01)00070-x · Cited by 449
Back-propagation fuzzy system as nonlinear dynamic system identifiers
Wang, L.-X., & Mendel, J. M. (2003) · [1992 Proceedings] IEEE International Conference on Fuzzy Systems · doi:10.1109/fuzzy.1992.258711 · Cited by 450
A systematic literature review of methods and datasets for anomaly-based network intrusion detection
Yang, Z., Liu, X., Li, T., Wu, D., Wang, J., Zhao, Y., & Han, H. (2022) · Computers & Security · doi:10.1016/j.cose.2022.102675 · Cited by 453
Deep learning for accelerated all-dielectric metasurface design
Nadell, C. C., Huang, B., Malof, J. M., & Padilla, W. J. (2019) · Optics Express · doi:10.1364/oe.27.027523 · Cited by 450
Nonlinear PLS modeling using neural networks
Qin, S. J., & McAvoy, T. J. (1992) · Computers & Chemical Engineering · doi:10.1016/0098-1354(92)80055-e · Cited by 450
Levin, A. U., & Narendra, K. S. (1996) · IEEE Transactions on Neural Networks · doi:10.1109/72.478390 · Cited by 441
Machine Learning for Electronically Excited States of Molecules
Westermayr, J., & Marquetand, P. (2021) · Chemical Reviews · doi:10.1021/acs.chemrev.0c00749 · Cited by 398
(2016) · Conference on Learning Theory · Cited by 443
Fisher, E. R., Anderson, S., Tan-Chiu, E., Fisher, B., Eaton, L., & Wolmark, N. (2001) · Cancer · doi:10.1002/1097-0142(20010415)91:8+<1679::aid-cncr1183>3.0.co;2-8 · Cited by 217
An introduction to domain adaptation and transfer learning
Kouw, W. M., & Loog, M. (2018) · arXiv (Cornell University) · doi:10.13140/rg.2.2.33906.56004 · Cited by 234
Capabilities of a four-layered feedforward neural network: four layers versus three
Tamura, S., & Tateishi, M. (1997) · IEEE Transactions on Neural Networks · doi:10.1109/72.557662 · Cited by 422
Analysis and synthesis of feedforward neural networks using discrete affine wavelet transformations
Pati, Y. C., & Krishnaprasad, P. S. (1993) · IEEE Transactions on Neural Networks · doi:10.1109/72.182697 · Cited by 424
A Deep Learning Approach for Objective-Driven All-Dielectric Metasurface Design
An, S., Fowler, C., Zheng, B., Shalaginov, M. Y., Tang, H., Li, H., Zhou, L., Ding, J., Agarwal, A. M., Rivero-Baleine, C., et al. (2019) · ACS Photonics · doi:10.1021/acsphotonics.9b00966 · Cited by 413
Forecasting exchange rates using feedforward and recurrent neural networks
Kuan, C., & Liu, T. (1995) · Journal of Applied Econometrics · doi:10.1002/jae.3950100403 · Cited by 428
Empirical Asset Pricing via Machine Learning
Gu, S., Kelly, B., & Xiu, D. (2018) · National Bureau of Economic Research · doi:10.3386/w25398 · Cited by 378
A comparative overview of microwave and wireless power-amplifier behavioral modeling approaches
Pedro, J. C., & Maas, S. A. (2005) · IEEE Transactions on Microwave Theory and Techniques · doi:10.1109/tmtt.2005.845723 · Cited by 419
Learning from Protein Structure with Geometric Vector Perceptrons
Jing, B., Eismann, S., Suriana, P., Townshend, R. J. L., & Dror, R. O. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2009.01411 · Cited by 179
A Review of Activation Function for Artificial Neural Network
Rasamoelina, A. D., Adjailia, F., & Sincak, P. (2020) · 2020 IEEE 18th World Symposium on Applied Machine Intelligence and Informatics (SAMI) · doi:10.1109/sami48414.2020.9108717 · Cited by 319
Continuous-variable quantum neural networks
Killoran, N., Bromley, T. R., Arrazola, J. M., Schuld, M., Quesada, N., & Lloyd, S. (2019) · Physical Review Research · doi:10.1103/physrevresearch.1.033063 · Cited by 418
Competitive Coevolution through Evolutionary Complexification
Stanley, K. O., & Miikkulainen, R. (2004) · Journal of Artificial Intelligence Research · doi:10.1613/jair.1338 · Cited by 413
Using the R-MAPE index as a resistant measure of forecast accuracy
Montaño Moreno, J., Palmer Pol, A., Sesé Abad, A., & Cajal Blasco, B. (2013) · Psicothema · doi:10.7334/psicothema2013.23 · Cited by 363
Applying Neural Network Models to Prediction and Data Analysis in Meteorology and Oceanography
Hsieh, W. W., & Tang, B. (1998) · Bulletin of the American Meteorological Society · doi:10.1175/1520-0477(1998)079<1855:annmtp>2.0.co;2 · Cited by 415
Geometric deep learning on molecular representations
Atz, K., Grisoni, F., & Schneider, G. (2021) · Nature Machine Intelligence · doi:10.1038/s42256-021-00418-8 · Cited by 373
Artificial neural networks: Opening the black box
Dayhoff, J. E., & DeLeo, J. M. (2001) · Cancer · doi:10.1002/1097-0142(20010415)91:8+<1615::aid-cncr1175>3.0.co;2-l · Cited by 414
Benali, L., Notton, G., Fouilloy, A., Voyant, C., & Dizene, R. (2019) · Renewable Energy · doi:10.1016/j.renene.2018.08.044 · Cited by 402
Bouwmans, T., Javed, S., Sultana, M., & Jung, S. K. (2019) · Neural Networks · doi:10.1016/j.neunet.2019.04.024 · Cited by 396
Optimization problems for machine learning: A survey
Gambella, C., Ghaddar, B., & Naoum-Sawaya, J. (2021) · European Journal of Operational Research · doi:10.1016/j.ejor.2020.08.045 · Cited by 365
Representing potential energy surfaces by high-dimensional neural network potentials
Behler, J. (2014) · Journal of Physics: Condensed Matter · doi:10.1088/0953-8984/26/18/183001 · Cited by 392
Understanding Neural Networks as Statistical Tools
Warner, B., & Misra, M. (1996) · The American Statistician · doi:10.1080/00031305.1996.10473554 · Cited by 277
Assessment of artificial neural network and genetic programming as predictive tools
Gandomi, A. H., & Roke, D. A. (2015) · Advances in Engineering Software · doi:10.1016/j.advengsoft.2015.05.007 · Cited by 406
The Stone-Weierstrass theorem and its application to neural networks
Cotter, N. E. (1990) · IEEE Transactions on Neural Networks · doi:10.1109/72.80265 · Cited by 400
Lepot, M., Aubin, J.-B., & Clemens, F. (2017) · Water · doi:10.3390/w9100796 · Cited by 350
LEE, T., & CHEN, I. (2005) · Expert Systems with Applications · doi:10.1016/j.eswa.2004.12.031 · Cited by 389
Chen, T., & Chen, H. (1995) · IEEE Transactions on Neural Networks · doi:10.1109/72.392252 · Cited by 394
Sharifzadeh, M., Sikinioti-Lock, A., & Shah, N. (2019) · Renewable and Sustainable Energy Reviews · doi:10.1016/j.rser.2019.03.040 · Cited by 381
SpookyNet: Learning force fields with electronic degrees of freedom and nonlocal effects
Unke, O. T., Chmiela, S., Gastegger, M., Schütt, K. T., Sauceda, H. E., & Müller, K.-R. (2021) · Nature Communications · doi:10.1038/s41467-021-27504-0 · Cited by 344
Real-Time Neuroevolution in the NERO Video Game
Stanley, K. O., Bryant, B. D., & Miikkulainen, R. (2005) · IEEE Transactions on Evolutionary Computation · doi:10.1109/tevc.2005.856210 · Cited by 390
Why Does Deep and Cheap Learning Work So Well?
Lin, H. W., Tegmark, M., & Rolnick, D. (2017) · Journal of Statistical Physics · doi:10.1007/s10955-017-1836-5 · Cited by 393
“It has long been known that neural networks are universal1 approximators [8,9], in the sense that networks with virtually all popular nonlinear activation functions σ(x) can approximate any smooth function to any desired accuracy—even using merely a single hidden layer.”
BackgroundKraus, M., Feuerriegel, S., & Oztekin, A. (2020) · European Journal of Operational Research · doi:10.1016/j.ejor.2019.09.018 · Cited by 392
Vucetic, S., Brown, C. J., Dunker, A. K., & Obradovic, Z. (2003) · Proteins: Structure, Function, and Bioinformatics · doi:10.1002/prot.10437 · Cited by 385
Azlan Hussain, M. (1999) · Artificial Intelligence in Engineering · doi:10.1016/s0954-1810(98)00011-9 · Cited by 381
Direct Fit to Nature: An Evolutionary Perspective on Biological and Artificial Neural Networks
Hasson, U., Nastase, S. A., & Goldstein, A. (2020) · Neuron · doi:10.1016/j.neuron.2019.12.002 · Cited by 387
Computational homogenization of nonlinear elastic materials using neural networks
Le, B. A., Yvonnet, J., & He, Q. ‐. (2015) · International Journal for Numerical Methods in Engineering · doi:10.1002/nme.4953 · Cited by 380
Deep neural networks for data-driven LES closure models
Beck, A., Flad, D., & Munz, C.-D. (2019) · Journal of Computational Physics · doi:10.1016/j.jcp.2019.108910 · Cited by 356
Support vector regression with genetic algorithms in forecasting tourism demand
Chen, K.-Y., & Wang, C.-H. (2007) · Tourism Management · doi:10.1016/j.tourman.2005.12.018 · Cited by 378
Pathology image analysis using segmentation deep learning algorithms
Wang, S., Yang, D. M., Rong, R., Zhan, X., & Xiao, G. (2019) · The American Journal of Pathology · doi:10.1016/j.ajpath.2019.05.007 · Cited by 382
“The American Journal of Pathology - ajp.amjpathol.org Although ANNs claim excellent performances based on theoretical work, 11 historically, it has been notoriously hard to calculate the network parameters when the total number of network layers exceeded three, which limited the performance of the…”
BackgroundReLU Deep Neural Networks and Linear Finite Elements
He, J., Li, L., Xu, J., & Zheng, C. (2020) · Journal of Computational Mathematics · doi:10.4208/jcm.1901-m2018-0160 · Cited by 383
Lee, T.-S., Chiu, C.-C., Chou, Y.-C., & Lu, C.-J. (2006) · Computational Statistics & Data Analysis · doi:10.1016/j.csda.2004.11.006 · Cited by 378
Adaptive control of nonlinear systems using neural networks
CHEN, F.-C., & KHALIL, H. K. (1992) · International Journal of Control · doi:10.1080/00207179208934286 · Cited by 382
An introduction to Neural Networks
Kröse, B., Kröse, B., van der Smagt, P., & van der Smagt, P. (1993) · Cited by 384
Hasani, R., Lechner, M., Amini, A., Rus, D., & Grosu, R. (2021) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v35i9.16936 · Cited by 312
Eighty Years of the Finite Element Method: Birth, Evolution, and Future
Liu, W. K., Li, S., & Park, H. S. (2022) · Archives of Computational Methods in Engineering · doi:10.1007/s11831-022-09740-9 · Cited by 322
Noori, R., Karbassi, A. R., Moghaddamnia, A., Han, D., Zokaei-Ashtiani, M. H., Farokhnia, A., & Gousheh, M. G. (2011) · Journal of Hydrology · doi:10.1016/j.jhydrol.2011.02.021 · Cited by 371
Universal Function Approximation by Deep Neural Nets with Bounded Width and ReLU Activations
Hanin, B. (2019) · Mathematics · doi:10.3390/math7100992 · Cited by 202
Quantum Computing for High-Energy Physics: State of the Art and Challenges
Di Meglio, A., Jansen, K., Tavernelli, I., Alexandrou, C., Arunachalam, S., Bauer, C. W., Borras, K., Carrazza, S., Crippa, A., Croft, V., et al. (2024) · PRX Quantum · doi:10.1103/prxquantum.5.037001 · Cited by 215
Swanson, N. R., & White, H. (1997) · Review of Economics and Statistics · doi:10.1162/003465397557123 · Cited by 363
Neural networks for nonlinear internal model control
Hunt, K. J., & Sbarbaro, D. (1991) · IEE Proceedings D Control Theory and Applications · doi:10.1049/ip-d.1991.0059 · Cited by 367
Machine learning of molecular electronic properties in chemical compound space
Montavon, G., Rupp, M., Gobre, V. V., Vázquez‐Mayagoitia, Á., Hansen, K., Tkatchenko, A., Müller, K., & von Lilienfeld, O. A. (2013) · MPG.PuRe (Max Planck Society) · doi:10.3929/ethz-b-000071765 · Cited by 366
Deadzone compensation in motion control systems using neural networks
Selmic, R. R., & Lewis, F. L. (2000) · IEEE Transactions on Automatic Control · doi:10.1109/9.847098 · Cited by 358
Drought forecasting using feed-forward recursive neural network
Mishra, A. K., & Desai, V. R. (2006) · Ecological Modelling · doi:10.1016/j.ecolmodel.2006.04.017 · Cited by 362
A review of deep learning applications for genomic selection
Montesinos-López, O. A., Montesinos-López, A., Pérez-Rodríguez, P., Barrón-López, J. A., Martini, J. W. R., Fajardo-Flores, S. B., Gaytan-Lugo, L. S., Santana-Mancilla, P. C., & Crossa, J. (2021) · BMC Genomics · doi:10.1186/s12864-020-07319-x · Cited by 361
Credit scoring using the hybrid neural discriminant technique
Lee, T.-S., Chiu, C.-C., Lu, C.-J., & Chen, I.-F. (2002) · Expert Systems with Applications · doi:10.1016/s0957-4174(02)00044-1 · Cited by 355
Cooperative Adaptive Cruise Control: A Reinforcement Learning Approach
Desjardins, C., & Chaib-draa, B. (2011) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2011.2157145 · Cited by 344
Control of nonlinear dynamical systems using neural networks: controllability and stabilization
Levin, A. U., & Narendra, K. S. (1993) · IEEE Transactions on Neural Networks · doi:10.1109/72.207608 · Cited by 361
Parmezan, A. R. S., Souza, V. M. A., & Batista, G. E. A. P. A. (2019) · Information Sciences · doi:10.1016/j.ins.2019.01.076 · Cited by 337
Machine-learning-based spatio-temporal super resolution reconstruction of turbulent flows
Fukami, K., Fukagata, K., & Taira, K. (2021) · Journal of Fluid Mechanics · doi:10.1017/jfm.2020.948 · Cited by 306
TP Model Transformation as a Way to LMI-Based Controller Design
Baranyi, P. (2004) · IEEE Transactions on Industrial Electronics · doi:10.1109/tie.2003.822037 · Cited by 348
Continuous-variable quantum neural networks
Killoran, N., Bromley, T. R., Arrazola, J. M., Schuld, M., Quesada, N., & Lloyd, S. (2018) · DSpace@MIT (Massachusetts Institute of Technology) · Cited by 361
Wang, Y., Sun, J., Bai, J., Anitescu, C., Eshaghi, M. S., Zhuang, X., Rabczuk, T., & Liu, Y. (2025) · Computer Methods in Applied Mechanics and Engineering · doi:10.1016/j.cma.2024.117518 · Cited by 214
Fundamentals of Artificial Neural Networks and Deep Learning
Montesinos López, O. A., Montesinos López, A., & Crossa, J. (2022) · Multivariate Statistical Machine Learning Methods for Genomic Prediction · doi:10.1007/978-3-030-89010-0_10 · Cited by 283
Physics-Informed Deep Learning for Computational Elastodynamics without Labeled Data
Rao, C., Sun, H., & Liu, Y. (2021) · Journal of Engineering Mechanics · doi:10.1061/(asce)em.1943-7889.0001947 · Cited by 330
Progress and recent trends in wind energy
SAHIN, A. (2004) · Progress in Energy and Combustion Science · doi:10.1016/j.pecs.2004.04.001 · Cited by 336
Modelling Nonlinear Economic Time Series
Teräsvirta, T., Tjøstheim, D., & Granger, C. W. J. (2010) · doi:10.1093/acprof:oso/9780199587148.001.0001 · Cited by 352
Neural Network Potentials: A Concise Overview of Methods
Kocer, E., Ko, T. W., & Behler, J. (2022) · Annual Review of Physical Chemistry · doi:10.1146/annurev-physchem-082720-034254 · Cited by 306
Neural networks in geophysical applications
van der Baan, M., & Jutten, C. (2000) · Geophysics · doi:10.1190/1.1444797 · Cited by 342
Beck, C., E, W., & Jentzen, A. (2019) · Journal of Nonlinear Science · doi:10.1007/s00332-018-9525-3 · Cited by 308
Restricted Boltzmann machine learning for solving strongly correlated quantum systems
Nomura, Y., Darmawan, A. S., Yamaji, Y., & Imada, M. (2017) · Physical Review B · doi:10.1103/physrevb.96.205152 · Cited by 318
Prediction Intervals for Artificial Neural Networks
Hwang, J. T. G., & Ding, A. A. (1997) · Journal of the American Statistical Association · doi:10.1080/01621459.1997.10474027 · Cited by 341
SOFMLS: Online Self-Organizing Fuzzy Modified Least-Squares Network
de Jesus Rubio, J. (2009) · IEEE Transactions on Fuzzy Systems · doi:10.1109/tfuzz.2009.2029569 · Cited by 346
A simulation study of artificial neural networks for nonlinear time-series forecasting
Zhang, G. P., Patuwo, B. E., & Hu, M. Y. (2001) · Computers & Operations Research · doi:10.1016/s0305-0548(99)00123-9 · Cited by 336
An Overview of Deep-Learning-Based Audio-Visual Speech Enhancement and Separation
Michelsanti, D., Tan, Z.-H., Zhang, S.-X., Xu, Y., Yu, M., Yu, D., & Jensen, J. (2021) · IEEE/ACM Transactions on Audio, Speech, and Language Processing · doi:10.1109/taslp.2021.3066303 · Cited by 316
Büyükşahin, Ü. Ç., & Ertekin, Ş. (2019) · Neurocomputing · doi:10.1016/j.neucom.2019.05.099 · Cited by 307
Neural Networks for Optimal Approximation of Smooth and Analytic Functions
Mhaskar, H. N. (1996) · Neural Computation · doi:10.1162/neco.1996.8.1.164 · Cited by 321
Nonlinear Approximation and (Deep) $$\mathrm {ReLU}$$ Networks
Daubechies, I., DeVore, R., Foucart, S., Hanin, B., & Petrova, G. (2022) · Constructive Approximation · doi:10.1007/s00365-021-09548-z · Cited by 212
Recursive hybrid algorithm for non-linear system identification using radial basis function networks
CHEN, S., BILLINGS, S. A., & GRANT, P. M. (1992) · International Journal of Control · doi:10.1080/00207179208934272 · Cited by 343
A Survey of Android Malware Detection with Deep Neural Models
Qiu, J., Zhang, J., Luo, W., Pan, L., Nepal, S., & Xiang, Y. (2021) · ACM Computing Surveys · doi:10.1145/3417978 · Cited by 321
Customer churn prediction by hybrid neural networks
Tsai, C.-F., & Lu, Y.-H. (2009) · Expert Systems with Applications · doi:10.1016/j.eswa.2009.05.032 · Cited by 321
Soft sensors for product quality monitoring in debutanizer distillation columns
Fortuna, L., Graziani, S., & Xibilia, M. G. (2005) · Control Engineering Practice · doi:10.1016/j.conengprac.2004.04.013 · Cited by 327
Nonlinear predictive control with application to manipulator with flexible forearm
Song, B. J., & Koivo, A. J. (1999) · IEEE Transactions on Industrial Electronics · doi:10.1109/41.793340 · Cited by 332
Metadata
- Authors
- Cybenko, G.
- Affiliations
- University of Illinois Urbana-Champaign (US)
- Corresponding author
- Cybenko, G.
- ORCID
- Cybenko, G.
- Venue
- Mathematics of Control, Signals, and Systems
- Published
- 1989-12
- Volume
- 2
- Issue
- 4
- Pages
- 303-314
- ISSN
- 0932-4194 (ISSN-L)
- 1435-568X
- OpenAlex
- W2103496339
- Semantic Scholar
- 8da1dda34ecc96263102181448c94ec7d645d085
- Cited by
- 13,883
- References
- 25
- Citations by year
- 2026: 640 · 2025: 889 · 2024: 793 · 2023: 746 · 2022: 827 · 2021: 1050 · 2020: 1001 · 2019: 761 · 2018: 542 · 2017: 414 · 2016: 312 · 2015: 313 · 2014: 289 · 2013: 310 · 2012: 296
- FWCI
- 94.52
- Type
- journal article
- Language
- en
- Open access
- green
- hal.science
- Licence
- cc-by-nc
- www.springer.com/tdm (tdm)
- Locations
- Mathematics of Control Signals and Systems (publishedVersion)
- HAL (submittedVersion, cc-by-nc)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Neural Networks and Applications
- Physical Sciences › Computer Science › Artificial Intelligence › Machine Learning and ELM
- Physical Sciences › Mathematics › Applied Mathematics › Approximation Theory and Sequence Spaces
- Keywords
- universal approximation, sigmoidal function, single hidden layer neural network, feedforward neural networks, approximation of continuous functions, decision regions, nonlinear activation functions, unit hypercube
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.