Approximation by superpositions of a sigmoidal function
Open accessThe DOI matches its Crossref record; 24 of the 25 references it cites were found in a registry or an index.
Abstract
In this paper we demonstrate that finite linear combinations of compositions of a fixed, univariate function and a set of affine functionals can uniformly approximate any continuous function ofn real variables with support in the unit hypercube; only mild conditions are imposed on the univariate function. Our results settle an open question about representability in the class of single hidden layer neural networks. In particular, we show that arbitrary decision regions can be arbitrarily well approximated by continuous feedforward neural networks with only a single internal, hidden layer and any continuous sigmoidal nonlinearity. The paper discusses approximation properties of other possible types of nonlinearities that might be implemented by artificial neural networks.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“The ANNs are considered highly flexible, powerful, and scalable models since they provide the possibility to handle large amounts of parameters and demonstrably approximate any function (Cybenko 1989; Gerón 2019).”
From Software sensors in the monitoring of microalgae cultivations (2024) · cites this paper as Cybenko 1989
In the citing paper
“These theorems guarantee that, provided enough free parameters, feedforward neural networks can approximate any continuous function on a closed and bounded subset of R n to an arbitrary degree of accuracy.”
From Continuous-variable quantum neural networks (2019) · cites this paper as [55]
In the citing paper
“For ordinal deep learning models, such as FFNs and CNNs, deep architecture immediately benefits from the universal approximation power and expressive capacity (Cybenko, 1989; Hornik, 1991; Telgarsky, 2016; Lu et al., 2017; Petersen & Voigtlaender, 2020; Zhou, 2020).”
From Anti-Oversmoothing in Deep Vision Transformers via the Fourier Domain Analysis: From Theory to Practice (2022) · cites this paper as Cybenko, 1989
In the citing paper
“An artificial neural network model composed of more than two layers is known to be able to approximate any continuous mapping (Cybenko, 1989; Funahashi, 1989; Hornik et al., 1989), which is a theoretical basis of the universal cerebellar transform (Schmahmann, 2004).”
From The Cerebro-Cerebellum as a Locus of Forward Model: A Review (2020) · cites this paper as Cybenko, 1989
In the citing paper
“For example, in a generic M-theory setting (without localized sources), I classical is given by I classical = I F 4 = 1 6 g 11-d (e (d- 8)A (12 -d) f 2 4 -d e dA f 2 4 ) ≤ 0 , (D.15) where we are working with F 4 = F 7 and we have decomposed F 4 = f4 + f 4 , with f4 being the space-time component (which is non-vanishing only for d = 4).The last inequality follows from f 2 4 ≤ 0 23 .”
From Hyperbolic compactification of M-theory and de Sitter quantum gravity (2022) · cites this paper as [66]
5 more claims about this paper
Create a free account to see every claim other papers make about this one.
Citations
Cites
Multilayer feedforward networks are universal approximators
Hornik, K., Stinchcombe, M., & White, H. (1989) · Neural Networks · doi:10.1016/0893-6080(89)90020-8 · Cited by 21,728
Parallel Distributed Processing: Explorations in the Microstructure of Cognition: Foundations
Rumelhart, D. E., McClelland, J. L., & AU (1986) · doi:10.7551/mitpress/5236.001.0001 · Cited by 15,686
Rudin, W. (1973) · Cited by 13,740
Garreau, G. A., & Rudin, W. (1987) · The Statistician · doi:10.2307/2348852 · Cited by 10,622
An introduction to computing with neural nets
Lippmann, R. (1987) · IEEE ASSP Magazine · doi:10.1109/massp.1987.1165576 · Cited by 7,825
On the approximate realization of continuous mappings by neural networks
Funahashi, K.-I. (1989) · Neural Networks · doi:10.1016/0893-6080(89)90003-8 · Cited by 4,206
Valiant, L. G. (1984) · Communications of the ACM · doi:10.1145/1968.1972 · Cited by 3,279
What Size Net Gives Valid Generalization?
Baum, E. B., & Haussler, D. (1989) · Neural Computation · doi:10.1162/neco.1989.1.1.151 · Cited by 1,541
Huber, P. J. (1985) · The Annals of Statistics · doi:10.1214/aos/1176349519 · Cited by 1,277
Real Analysis and Probability.
Ross, K. A., & Ash, R. B. (1975) · The American Mathematical Monthly · doi:10.2307/2319153 · Cited by 714
Research works printed but not linked: 5
- [K] A. N. Kolmogorov, On the representation of continuous functions of many variables by superposition of continuous functions of one variable and addition,Dokl. Akad. Nauk. SSSR,114 (1957), 953–956.
- [MSJ] J. Makhoul, R. Schwartz, and A. El-Jaroudi, Classification capabilities of two-layer neural nets.Proceedings of the IEEE International Conference on Acoustics, Speech, and Signal Processing, Glasgow, 1989 (to appear).
- [MP] M. Minsky and S. Papert,Perceptrons, MIT Press, Cambridge, MA, 1969.
- [N] N. J. Nilsson,Learning Machines, McGraw-Hill, New York, 1965.
- [WL] A Wieland and R. Leighton, Geometric analysis of neural network capabilities,Proceedings of IEEE First International Conference on Neural Networks, San Diego, CA, pp. III-385–III-392, 1987.
Cited by
Items 101–200 of 1,050
High-order neural network structures for identification of dynamical systems
Kosmatopoulos, E. B., Polycarpou, M. M., Christodoulou, M. A., & Ioannou, P. A. (1995) · IEEE Transactions on Neural Networks · doi:10.1109/72.363477 · Cited by 802
Bebis, G., & Georgiopoulos, M. (1994) · IEEE Potentials · doi:10.1109/45.329294 · Cited by 746
How Attentive are Graph Attention Networks?
Brody, S., Alon, U., & Yahav, E. (2021) · arXiv · doi:10.48550/arxiv.2105.14491 · Cited by 789
Approximation by superpositions of a sigmoidal function
Cybenko, G. (1992) · Mathematics of Control, Signals, and Systems · doi:10.1007/bf02134016 · Cited by 703
Self-citationNeural network potential-energy surfaces in chemistry: a tool for large-scale simulations
Behler, J. (2011) · Physical Chemistry Chemical Physics · doi:10.1039/c1cp21668f · Cited by 781
Solving inverse problems using data-driven models
Arridge, S., Maass, P., Öktem, O., & Schönlieb, C.-B. (2019) · Acta Numerica · doi:10.1017/s0962492919000059 · Cited by 686
A Nonparametric Approach to Pricing and Hedging Derivative Securities Via Learning Networks
HUTCHINSON, J. M., LO, A. W., & POGGIO, T. (1994) · The Journal of Finance · doi:10.1111/j.1540-6261.1994.tb00081.x · Cited by 717
Kolmogorov's theorem and multilayer neural networks
Kůrková, V. (1992) · Neural Networks · doi:10.1016/0893-6080(92)90012-8 · Cited by 747
Ball, J. E., Anderson, D. T., & Chan, C. S. (2017) · Journal of Applied Remote Sensing · doi:10.1117/1.jrs.11.042609 · Cited by 746
Compositional pattern producing networks: A novel abstraction of development
Stanley, K. O. (2007) · Genetic Programming and Evolvable Machines · doi:10.1007/s10710-007-9028-8 · Cited by 713
A comprehensive review of deep learning applications in hydrology and water resources
Sit, M., Demiray, B. Z., Xiang, Z., Ewing, G. J., Sermet, Y., & Demir, I. (2020) · Water Science and Technology · doi:10.2166/wst.2020.369 · Cited by 618
Using wavelet network in nonparametric estimation
Zhang, Q. (1997) · IEEE Transactions on Neural Networks · doi:10.1109/72.557660 · Cited by 727
Stochastic Configuration Networks: Fundamentals and Algorithms
Wang, D., & Li, M. (2017) · IEEE Transactions on Cybernetics · doi:10.1109/tcyb.2017.2734043 · Cited by 727
Neural networks for nonlinear dynamic system modelling and identification
CHEN, S., & BILLINGS, S. A. (1992) · International Journal of Control · doi:10.1080/00207179208934317 · Cited by 720
Novikov, A., Podoprikhin, D., Osokin, A., & Vetrov, D. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1509.06569 · Cited by 558
Control of a nonholonomic mobile robot using neural networks
Fierro, R., & Lewis, F. L. (1998) · IEEE Transactions on Neural Networks · doi:10.1109/72.701173 · Cited by 717
Behler, J. (2017) · Angewandte Chemie International Edition · doi:10.1002/anie.201703114 · Cited by 707
Spiking Neural Networks and Their Applications: A Review
Yamazaki, K., Vo-Ho, V.-K., Bulsara, D., & Le, N. (2022) · Brain Sciences · doi:10.3390/brainsci12070863 · Cited by 626
Data re-uploading for a universal quantum classifier
Pérez-Salinas, A., Cervera-Lierta, A., Gil-Fuster, E., & Latorre, J. I. (2020) · Quantum · doi:10.22331/q-2020-02-06-226 · Cited by 713
A Theory of Networks for Approximation and Learning
Poggio, T., & Girosi, F. (1989) · Cited by 785
Gao, H., Sun, L., & Wang, J.-X. (2021) · Journal of Computational Physics · doi:10.1016/j.jcp.2020.110079 · Cited by 621
Non-intrusive reduced order modeling of nonlinear problems using neural networks
Hesthaven, J. S., & Ubbiali, S. (2018) · Journal of Computational Physics · doi:10.1016/j.jcp.2018.02.037 · Cited by 616
A Survey on Deep Learning for Data-Driven Soft Sensors
Sun, Q., & Ge, Z. (2021) · IEEE Transactions on Industrial Informatics · doi:10.1109/tii.2021.3053128 · Cited by 665
VAMPnets for deep learning of molecular kinetics
Mardt, A., Pasquali, L., Wu, H., & Noé, F. (2018) · Nature Communications · doi:10.1038/s41467-017-02388-1 · Cited by 497
Multilayer perceptron and neural networks
Popescu, M.-C., Bălaş, V. E., Perescu-Popescu, L., & Mastorakis, N. E. (2009) · doi:10.5555/1639537.1639542 · Cited by 586
Machine learning of molecular electronic properties in chemical compound space
Montavon, G., Rupp, M., Gobre, V., Vazquez-Mayagoitia, A., Hansen, K., Tkatchenko, A., Müller, K.-R., & Anatole von Lilienfeld, O. (2013) · New Journal of Physics · doi:10.1088/1367-2630/15/9/095003 · Cited by 623
Connectionist nonparametric regression: Multilayer feedforward networks can learn arbitrary mappings
White, H. (1990) · Neural Networks · doi:10.1016/0893-6080(90)90004-5 · Cited by 679
Artificial neural networks in bankruptcy prediction: General framework and cross-validation analysis
Zhang, G., Y. Hu, M., Eddy Patuwo, B., & C. Indro, D. (1999) · European Journal of Operational Research · doi:10.1016/s0377-2217(98)00051-4 · Cited by 677
“Based on the results from [14,23,37,42], networks with one hidden layer is generally sucient for most problems including classi®cation.”
BackgroundLarkoski, A. J., Moult, I., & Nachman, B. (2020) · Physics Reports · doi:10.1016/j.physrep.2019.11.001 · Cited by 361
(2008) · Intelligent Infrastructure · doi:10.1201/9781482281767-9 · Cited by 665
Use of neural nets for dynamic modeling and control of chemical process systems
Bhat, N., & McAvoy, T. J. (1990) · Computers & Chemical Engineering · doi:10.1016/0098-1354(90)87028-n · Cited by 669
Nonparametric regression using deep neural networks with ReLU activation function
Schmidt-Hieber, J. (2020) · The Annals of Statistics · doi:10.1214/19-aos1875 · Cited by 292
On the problem of local minima in backpropagation
Gori, M., & Tesi, A. (1992) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.107014 · Cited by 650
Dying ReLU and Initialization: Theory and Numerical Examples
Lu, L., Shin, Y., Su, Y., & Em Karniadakis, G. (2020) · Communications in Computational Physics · doi:10.4208/cicp.oa-2020-0165 · Cited by 281
Bhasin, S., Kamalapurkar, R., Johnson, M., Vamvoudakis, K. G., Lewis, F. L., & Dixon, W. E. (2013) · Automatica · doi:10.1016/j.automatica.2012.09.019 · Cited by 642
The Expressive Power of Neural Networks: A View from the WidthPreprint
Zhou, L., Pu, H., Wang, F., Hu, Z., & Wang, L. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1709.02540 · Cited by 864
A survey on modern trainable activation functions
Apicella, A., Donnarumma, F., Isgrò, F., & Prevete, R. (2021) · Neural Networks · doi:10.1016/j.neunet.2021.01.026 · Cited by 571
Neural net robot controller with guaranteed tracking performance
Lewis, F. L., Liu, K., & Yesildirek, A. (1995) · IEEE Transactions on Neural Networks · doi:10.1109/72.377975 · Cited by 638
The evolutionary origins of modularity
Clune, J., Mouret, J.-B., & Lipson, H. (2013) · Proceedings of the Royal Society B: Biological Sciences · doi:10.1098/rspb.2012.2863 · Cited by 466
Lu, L., Meng, X., Cai, S., Mao, Z., Goswami, S., Zhang, Z., & Karniadakis, G. E. (2022) · Computer Methods in Applied Mechanics and Engineering · doi:10.1016/j.cma.2022.114778 · Cited by 514
Computational Intelligence: An Introduction
Fulcher, J. (2008) · Studies in Computational Intelligence · doi:10.1007/978-3-540-78293-3_1 · Cited by 629
Neural Networks and Related Methods for Classification
Ripley, B. D. (1994) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1994.tb01990.x · Cited by 627
Metaheuristic design of feedforward neural networks: A review of two decades of research
Ojha, V. K., Abraham, A., & Snášel, V. (2017) · Engineering Applications of Artificial Intelligence · doi:10.1016/j.engappai.2017.01.013 · Cited by 606
Deep Learning in Human Activity Recognition with Wearable Sensors: A Review on Advances
Zhang, S., Li, Y., Zhang, S., Shahabi, F., Xia, S., Deng, Y., & Alshurafa, N. (2022) · Sensors · doi:10.3390/s22041476 · Cited by 625
“Second, deep neural networks have been shown to be universal function approximators, capable of approximating almost any function given a large enough network and sufficient observations [77, 243, 340].”
BackgroundDaily reservoir inflow forecasting using artificial neural networks with stopped training approach
Coulibaly, P., Anctil, F., & Bobée, B. (2000) · Journal of Hydrology · doi:10.1016/s0022-1694(00)00214-6 · Cited by 609
Deep learning for financial applications : A survey
Ozbayoglu, A. M., Gudelek, M. U., & Sezer, O. B. (2020) · Applied Soft Computing · doi:10.1016/j.asoc.2020.106384 · Cited by 545
Introduction to neural networks
Cross, S. S., Harrison, R. F., & Kennedy, R. L. (1995) · The Lancet · doi:10.1016/s0140-6736(95)91746-2 · Cited by 615
Basha, S. H. S., Dubey, S. R., Pulabaigari, V., & Mukherjee, S. (2020) · Neurocomputing · doi:10.1016/j.neucom.2019.10.008 · Cited by 574
FNet: Mixing Tokens with Fourier Transforms
Lee-Thorp, J., Ainslie, J., Eckstein, I., & Ontanon, S. (2022) · Proceedings of the 2022 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies · doi:10.18653/v1/2022.naacl-main.319 · Cited by 519
A critique of pure learning and what artificial neural networks can learn from animal brains
Zador, A. M. (2019) · Nature Communications · doi:10.1038/s41467-019-11786-6 · Cited by 536
Machine learning advances for time series forecasting
Masini, R. P., Medeiros, M. C., & Mendes, E. F. (2023) · Journal of Economic Surveys · doi:10.1111/joes.12429 · Cited by 515
Modeling chemical processes using prior knowledge and neural networks'
Thompson, M. L., & Kramer, M. A. (1994) · AIChE Journal · doi:10.1002/aic.690400806 · Cited by 596
Deep Learning With TensorFlow: A Review
Pang, B., Nijkamp, E., & Wu, Y. N. (2020) · Journal of Educational and Behavioral Statistics · doi:10.3102/1076998619872761 · Cited by 541
Pattern analysis for machine olfaction: a review
Gutierrez-Osuna, R. (2002) · IEEE Sensors Journal · doi:10.1109/jsen.2002.800688 · Cited by 578
Neural network models and deep learning
Kriegeskorte, N., & Golan, T. (2019) · Current Biology · doi:10.1016/j.cub.2019.02.034 · Cited by 543
Scarselli, F., & Chung Tsoi, A. (1998) · Neural Networks · doi:10.1016/s0893-6080(97)00097-x · Cited by 571
Shahid, N., Rappon, T., & Berta, W. (2019) · PLOS ONE · doi:10.1371/journal.pone.0212356 · Cited by 529
Chapter 76 Large Sample Sieve Estimation of Semi-Nonparametric Models
Chen, X. (2007) · Handbook of Econometrics · doi:10.1016/s1573-4412(07)06076-x · Cited by 535
Neural Collaborative Filtering vs. Matrix Factorization Revisited
Rendle, S., Krichene, W., Zhang, L., & Anderson, J. (2020) · Fourteenth ACM Conference on Recommender Systems · doi:10.1145/3383313.3412488 · Cited by 479
Model-Free Real-Time EV Charging Scheduling Based on Deep Reinforcement Learning
Wan, Z., Li, H., He, H., & Prokhorov, D. (2019) · IEEE Transactions on Smart Grid · doi:10.1109/tsg.2018.2879572 · Cited by 548
Bandara, K., Bergmeir, C., & Smyl, S. (2020) · Expert Systems with Applications · doi:10.1016/j.eswa.2019.112896 · Cited by 435
Huang, G.-B., & Babri, H. A. (1998) · IEEE Transactions on Neural Networks · doi:10.1109/72.655045 · Cited by 538
He, W., Williard, N., Chen, C., & Pecht, M. (2014) · International Journal of Electrical Power & Energy Systems · doi:10.1016/j.ijepes.2014.04.059 · Cited by 539
Adaptive control of a class of nonlinear discrete-time systems using neural networks
Chen, F.-C., & Khalil, H. K. (1995) · IEEE Transactions on Automatic Control · doi:10.1109/9.384214 · Cited by 540
A gentle introduction to deep learning in medical image processing
Maier, A., Syben, C., Lasser, T., & Riess, C. (2019) · Zeitschrift für Medizinische Physik · doi:10.1016/j.zemedi.2018.12.003 · Cited by 515
Information Theoretic Learning
Erdogmus, D., & Principe, J. C. (2009) · Encyclopedia of Artificial Intelligence · doi:10.4018/978-1-59904-849-9.ch133 · Cited by 506
Graph Neural Networks Exponentially Lose Expressive Power for Node Classification
Oono, K., & Suzuki, T. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1905.10947 · Cited by 180
Variational Physics-Informed Neural Networks For Solving Partial Differential Equations
Kharazmi, E., Zhang, Z., & Karniadakis, G. E. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1912.00873 · Cited by 183
Universality of deep convolutional neural networks
Zhou, D.-X. (2020) · Applied and Computational Harmonic Analysis · doi:10.1016/j.acha.2019.06.004 · Cited by 530
Liang, L., Liu, M., Martin, C., & Sun, W. (2018) · Journal of The Royal Society Interface · doi:10.1098/rsif.2017.0844 · Cited by 502
Applying data mining to telecom churn management
Hung, S.-Y., Yen, D. C., & Wang, H.-Y. (2006) · Expert Systems with Applications · doi:10.1016/j.eswa.2005.09.080 · Cited by 514
Why Does Deep and Cheap Learning Work So Well?Preprint
Lin, H. W., Tegmark, M., & Rolnick, D. (2017) · DSpace@MIT (Massachusetts Institute of Technology) · Cited by 527
Mocanu, D. C., Mocanu, E., Stone, P., Nguyen, P. H., Gibescu, M., & Liotta, A. (2018) · Nature Communications · doi:10.1038/s41467-018-04316-3 · Cited by 524
“In (Cybenko, 1989), it has been demonstrated that MLPs are universal function approximators, so they can be used to model any type of regression or classification problems.”
BackgroundAlwosheel, A., van Cranenburgh, S., & Chorus, C. G. (2018) · Journal of Choice Modelling · doi:10.1016/j.jocm.2018.07.002 · Cited by 524
A Deep Collocation Method for the Bending Analysis of Kirchhoff Plate
Guo, H., Zhuang, X., & Rabczuk, T. (2019) · Computers, Materials & Continua · doi:10.32604/cmc.2019.06660 · Cited by 466
Neural network models of potential energy surfaces
Blank, T. B., Brown, S. D., Calhoun, A. W., & Doren, D. J. (1995) · The Journal of Chemical Physics · doi:10.1063/1.469597 · Cited by 498
On the Complexity of Neural Network Classifiers: A Comparison Between Shallow and Deep Architectures
Bianchini, M., & Scarselli, F. (2014) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2013.2293637 · Cited by 500
Quantum machine learning: a classical perspective
Ciliberto, C., Herbster, M., Ialongo, A. D., Pontil, M., Rocchetto, A., Severini, S., & Wossnig, L. (2018) · Proceedings of the Royal Society A: Mathematical, Physical and Engineering Sciences · doi:10.1098/rspa.2017.0551 · Cited by 518
Statistical aspects of neural networks
Ripley, B. D. (1993) · Networks and Chaos — Statistical and Probabilistic Aspects · doi:10.1007/978-1-4899-3099-6_2 · Cited by 504
Wetzel, S. J. (2017) · Physical Review E · doi:10.1103/physreve.96.022140 · Cited by 488
Artificial intelligence and machine learning for medical imaging: A technology review
Barragán-Montero, A., Javaid, U., Valdés, G., Nguyen, D., Desbordes, P., Macq, B., Willems, S., Vandewinckele, L., Holmström, M., Löfman, F., et al. (2021) · Physica Medica · doi:10.1016/j.ejmp.2021.04.016 · Cited by 450
SOUSA, S., MARTINS, F., ALVIMFERRAZ, M., & PEREIRA, M. (2007) · Environmental Modelling & Software · doi:10.1016/j.envsoft.2005.12.002 · Cited by 500
Deep learning-based structural health monitoring
Cha, Y.-J., Ali, R., Lewis, J., & Büyükӧztürk, O. (2024) · Automation in Construction · doi:10.1016/j.autcon.2024.105328 · Cited by 418
Detection of Depression-Related Posts in Reddit Social Media Forum
Tadesse, M. M., Lin, H., Xu, B., & Yang, L. (2019) · IEEE Access · doi:10.1109/access.2019.2909180 · Cited by 463
Some new results on neural network approximation
Hornik, K. (1993) · Neural Networks · doi:10.1016/s0893-6080(09)80018-x · Cited by 496
Simplifying Particle Swarm Optimization
Pedersen, M. E. H., & Chipperfield, A. J. (2010) · Applied Soft Computing · doi:10.1016/j.asoc.2009.08.029 · Cited by 495
A multilevel multimodal circuit enhances action selection in drosophila
Ohyama, T., Schneider-Mizell, C. M., Fetter, R. D., Aleman, J. V., Franconville, R., Rivera-Alba, M., Mensh, B. D., Branson, K. M., Simpson, J. H., Truman, J. W., et al. (2015) · Nature · doi:10.1038/nature14297 · Cited by 502
Discovering Physical Concepts with Neural Networks
Iten, R., Metger, T., Wilming, H., del Rio, L., & Renner, R. (2020) · Physical Review Letters · doi:10.1103/physrevlett.124.010508 · Cited by 458
Kwok, T.-Y., & Yeung, D.-Y. (1997) · IEEE Transactions on Neural Networks · doi:10.1109/72.572102 · Cited by 493
A review of deep learning with special emphasis on architectures, applications and recent trends
Sengupta, S., Basak, S., Saikia, P., Paul, S., Tsalavoutis, V., Atiah, F., Ravi, V., & Peters, A. (2020) · Knowledge-Based Systems · doi:10.1016/j.knosys.2020.105596 · Cited by 454
Software Vulnerability Detection Using Deep Neural Networks: A Survey
Lin, G., Wen, S., Han, Q.-L., Zhang, J., & Xiang, Y. (2020) · Proceedings of the IEEE · doi:10.1109/jproc.2020.2993293 · Cited by 457
Evolving fuzzy neural networks for supervised/unsupervised online knowledge-based learning
Kasabov, N. (2001) · IEEE Transactions on Systems, Man and Cybernetics, Part B (Cybernetics) · doi:10.1109/3477.969494 · Cited by 482
Neural Network Models for Time Series Forecasts
Hill, T., O'Connor, M., & Remus, W. (1996) · Management Science · doi:10.1287/mnsc.42.7.1082 · Cited by 468
SimplE Embedding for Link Prediction in Knowledge Graphs
Kazemi, S. M., & Poole, D. (2018) · arXiv · doi:10.48550/arxiv.1802.04868 · Cited by 476
Approximation and estimation bounds for artificial neural networks
Barron, A. R. (1994) · Machine Learning · doi:10.1007/bf00993164 · Cited by 399
Optimal approximation of piecewise smooth functions using deep ReLU neural networks
Petersen, P., & Voigtlaender, F. (2018) · Neural Networks · doi:10.1016/j.neunet.2018.08.019 · Cited by 432
A Riemannian Network for SPD Matrix Learning
Huang, Z., & Van Gool, L. (2017) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v31i1.10866 · Cited by 410
Advances in Modeling and Simulation of Grinding Processes
Brinksmeier, E., Aurich, J. C., Govekar, E., Heinzel, C., Hoffmeister, H.-W., Klocke, F., Peters, J., Rentsch, R., Stephenson, D. J., Uhlmann, E., et al. (2006) · CIRP Annals · doi:10.1016/j.cirp.2006.10.003 · Cited by 463
Jones, L. K. (1992) · The Annals of Statistics · doi:10.1214/aos/1176348546 · Cited by 474
VAMPnets for deep learning of molecular kinetics
Mardt, A., Pasquali, L., Wu, H., & Noé, F. (2018) · RePEc: Research Papers in Economics · doi:10.17169/refubium-964 · Cited by 465
Metadata
- Authors
- Cybenko, G.
- Affiliations
- University of Illinois Urbana-Champaign (US)
- Corresponding author
- Cybenko, G.
- ORCID
- Cybenko, G.
- Venue
- Mathematics of Control, Signals, and Systems
- Published
- 1989-12
- Volume
- 2
- Issue
- 4
- Pages
- 303-314
- ISSN
- 0932-4194 (ISSN-L)
- 1435-568X
- OpenAlex
- W2103496339
- Semantic Scholar
- 8da1dda34ecc96263102181448c94ec7d645d085
- Cited by
- 13,883
- References
- 25
- Citations by year
- 2026: 640 · 2025: 889 · 2024: 793 · 2023: 746 · 2022: 827 · 2021: 1050 · 2020: 1001 · 2019: 761 · 2018: 542 · 2017: 414 · 2016: 312 · 2015: 313 · 2014: 289 · 2013: 310 · 2012: 296
- FWCI
- 94.52
- Type
- journal article
- Language
- en
- Open access
- green
- hal.science
- Licence
- cc-by-nc
- www.springer.com/tdm (tdm)
- Locations
- Mathematics of Control Signals and Systems (publishedVersion)
- HAL (submittedVersion, cc-by-nc)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Neural Networks and Applications
- Physical Sciences › Computer Science › Artificial Intelligence › Machine Learning and ELM
- Physical Sciences › Mathematics › Applied Mathematics › Approximation Theory and Sequence Spaces
- Keywords
- universal approximation, sigmoidal function, single hidden layer neural network, feedforward neural networks, approximation of continuous functions, decision regions, nonlinear activation functions, unit hypercube
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.