Approximation by superpositions of a sigmoidal function
Open accessThe DOI matches its Crossref record; 24 of the 25 references it cites were found in a registry or an index.
Abstract
In this paper we demonstrate that finite linear combinations of compositions of a fixed, univariate function and a set of affine functionals can uniformly approximate any continuous function ofn real variables with support in the unit hypercube; only mild conditions are imposed on the univariate function. Our results settle an open question about representability in the class of single hidden layer neural networks. In particular, we show that arbitrary decision regions can be arbitrarily well approximated by continuous feedforward neural networks with only a single internal, hidden layer and any continuous sigmoidal nonlinearity. The paper discusses approximation properties of other possible types of nonlinearities that might be implemented by artificial neural networks.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“The ANNs are considered highly flexible, powerful, and scalable models since they provide the possibility to handle large amounts of parameters and demonstrably approximate any function (Cybenko 1989; Gerón 2019).”
From Software sensors in the monitoring of microalgae cultivations (2024) · cites this paper as Cybenko 1989
In the citing paper
“These theorems guarantee that, provided enough free parameters, feedforward neural networks can approximate any continuous function on a closed and bounded subset of R n to an arbitrary degree of accuracy.”
From Continuous-variable quantum neural networks (2019) · cites this paper as [55]
In the citing paper
“For ordinal deep learning models, such as FFNs and CNNs, deep architecture immediately benefits from the universal approximation power and expressive capacity (Cybenko, 1989; Hornik, 1991; Telgarsky, 2016; Lu et al., 2017; Petersen & Voigtlaender, 2020; Zhou, 2020).”
From Anti-Oversmoothing in Deep Vision Transformers via the Fourier Domain Analysis: From Theory to Practice (2022) · cites this paper as Cybenko, 1989
In the citing paper
“An artificial neural network model composed of more than two layers is known to be able to approximate any continuous mapping (Cybenko, 1989; Funahashi, 1989; Hornik et al., 1989), which is a theoretical basis of the universal cerebellar transform (Schmahmann, 2004).”
From The Cerebro-Cerebellum as a Locus of Forward Model: A Review (2020) · cites this paper as Cybenko, 1989
In the citing paper
“For example, in a generic M-theory setting (without localized sources), I classical is given by I classical = I F 4 = 1 6 g 11-d (e (d- 8)A (12 -d) f 2 4 -d e dA f 2 4 ) ≤ 0 , (D.15) where we are working with F 4 = F 7 and we have decomposed F 4 = f4 + f 4 , with f4 being the space-time component (which is non-vanishing only for d = 4).The last inequality follows from f 2 4 ≤ 0 23 .”
From Hyperbolic compactification of M-theory and de Sitter quantum gravity (2022) · cites this paper as [66]
5 more claims about this paper
Create a free account to see every claim other papers make about this one.
Citations
Cites
Multilayer feedforward networks are universal approximators
Hornik, K., Stinchcombe, M., & White, H. (1989) · Neural Networks · doi:10.1016/0893-6080(89)90020-8 · Cited by 21,728
Parallel Distributed Processing: Explorations in the Microstructure of Cognition: Foundations
Rumelhart, D. E., McClelland, J. L., & AU (1986) · doi:10.7551/mitpress/5236.001.0001 · Cited by 15,686
Rudin, W. (1973) · Cited by 13,740
Garreau, G. A., & Rudin, W. (1987) · The Statistician · doi:10.2307/2348852 · Cited by 10,622
An introduction to computing with neural nets
Lippmann, R. (1987) · IEEE ASSP Magazine · doi:10.1109/massp.1987.1165576 · Cited by 7,825
On the approximate realization of continuous mappings by neural networks
Funahashi, K.-I. (1989) · Neural Networks · doi:10.1016/0893-6080(89)90003-8 · Cited by 4,206
Valiant, L. G. (1984) · Communications of the ACM · doi:10.1145/1968.1972 · Cited by 3,279
What Size Net Gives Valid Generalization?
Baum, E. B., & Haussler, D. (1989) · Neural Computation · doi:10.1162/neco.1989.1.1.151 · Cited by 1,541
Huber, P. J. (1985) · The Annals of Statistics · doi:10.1214/aos/1176349519 · Cited by 1,277
Real Analysis and Probability.
Ross, K. A., & Ash, R. B. (1975) · The American Mathematical Monthly · doi:10.2307/2319153 · Cited by 714
Research works printed but not linked: 5
- [K] A. N. Kolmogorov, On the representation of continuous functions of many variables by superposition of continuous functions of one variable and addition,Dokl. Akad. Nauk. SSSR,114 (1957), 953–956.
- [MSJ] J. Makhoul, R. Schwartz, and A. El-Jaroudi, Classification capabilities of two-layer neural nets.Proceedings of the IEEE International Conference on Acoustics, Speech, and Signal Processing, Glasgow, 1989 (to appear).
- [MP] M. Minsky and S. Papert,Perceptrons, MIT Press, Cambridge, MA, 1969.
- [N] N. J. Nilsson,Learning Machines, McGraw-Hill, New York, 1965.
- [WL] A Wieland and R. Leighton, Geometric analysis of neural network capabilities,Proceedings of IEEE First International Conference on Neural Networks, San Diego, CA, pp. III-385–III-392, 1987.
Cited by
Items 901–1,000 of 1,050
Random Features Strengthen Graph Neural Networks
Sato, R., Yamada, M., & Kashima, H. (2021) · Society for Industrial and Applied Mathematics eBooks · doi:10.1137/1.9781611976700.38 · Cited by 285
Quantitative digital microscopy with deep learning
Midtvedt, B., Helgadóttir, S., Argun, A., Pineda, J. D., Midtvedt, D., & Volpe, G. (2021) · Applied Physics Reviews · doi:10.1063/5.0034891 · Cited by 137
Neural network potentials for chemistry: concepts, applications and prospects
Käser, S., Vazquez-Salazar, L. I., Meuwly, M., & Töpfer, K. (2023) · Digital Discovery · doi:10.1039/d2dd00102k · Cited by 151
Complex-valued radial basic function network, Part I: Network architecture and learning algorithms
Chen, S., McLaughlin, S., & Mulgrew, B. (1994) · Signal Processing · doi:10.1016/0165-1684(94)90187-2 · Cited by 139
Krasnopolsky, V. M., & Schiller, H. (2003) · Neural Networks · doi:10.1016/s0893-6080(03)00027-3 · Cited by 145
On Clifford neurons and Clifford multi-layer perceptrons
Buchholz, S., & Sommer, G. (2008) · Neural Networks · doi:10.1016/j.neunet.2008.03.004 · Cited by 132
Prescribed performance adaptive control of SISO feedback linearizable systems with disturbances
Bechlioulis, C. P., & Rovithakis, G. A. (2008) · Mediterranean Conference on Control and Automation (MED) · doi:10.1109/med.2008.4601971 · Cited by 132
Evaluation of data driven models for river suspended sediment concentration modeling
Zounemat‐Kermani, M., Kişi, Ö., Adamowski, J., & Ramezani-Charmahineh, A. (2016) · Journal of Hydrology · doi:10.1016/j.jhydrol.2016.02.012 · Cited by 132
Sun, C., Tian, Y., Gao, L., Niu, Y., Zhang, T., Li, H., Zhang, Y., Yue, Z., Gilon, N., & Yu, J. (2019) · Scientific Reports · doi:10.1038/s41598-019-47751-y · Cited by 133
NeuralSens : Sensitivity Analysis of Neural Networks
Gonzalo, J. P., Portela, J., & Roque, A. M. S. (2022) · Journal of Statistical Software · doi:10.18637/jss.v102.i07 · Cited by 138
A COMPARISON OF VAR AND NEURAL NETWORKS WITH GENETIC ALGORITHM IN FORECASTING PRICE OF OIL
Mirmirani, S., & Li, H. C. (2004) · Advances in econometrics · doi:10.1016/s0731-9053(04)19008-7 · Cited by 132
Magnetic hysteresis modeling via feed-forward neural networks
Serpico, C., & Visone, C. (1998) · IEEE Transactions on Magnetics · doi:10.1109/20.668055 · Cited by 132
Florence, P., Lynch, C., Zeng, A., Ramirez, O., Wahid, A., Downs, L., Wong, A., Lee, J., Mordatch, I., & Tompson, J. (2021) · arXiv · doi:10.48550/arxiv.2109.00137 · Cited by 131
Anctil, F., & Tape, D. G. (2004) · Journal of Environmental Engineering and Science · doi:10.1139/s03-071 · Cited by 131
Reservoir Computing Universality With Stochastic Inputs
Gonon, L., & Ortega, J. (2019) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2019.2899649 · Cited by 177
Fouling modeling and prediction approach for heat exchangers using deep learning
Sundar, S., Rajagopal, M. C., Zhao, H., Kuntumalla, G., Meng, Y., Chang, H. C., Shao, C., FERREIRA, P. M., Miljkovic, N., Sinha, S., et al. (2020) · International Journal of Heat and Mass Transfer · doi:10.1016/j.ijheatmasstransfer.2020.120112 · Cited by 143
Archer, N., & Wang, S. (1993) · Decision Sciences · doi:10.1111/j.1540-5915.1993.tb00462.x · Cited by 160
Discrete-time neural net controller for a class of nonlinear dynamical systems
Jagannathan, S., & Lewis, F. L. (1996) · IEEE Transactions on Automatic Control · doi:10.1109/9.544013 · Cited by 131
Depth-Width Tradeoffs in Approximating Natural Functions with Neural NetworksPreprint
Safran, I., & Shamir, O. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1610.09887 · Cited by 134
Construction of high-dimensional neural network potentials using environment-dependent atom pairs
Jose, K. V. J., Artrith, N., & Behler, J. (2012) · The Journal of Chemical Physics · doi:10.1063/1.4712397 · Cited by 130
Iturrarán‐Viveros, U., & Parra, J. O. (2014) · Journal of Applied Geophysics · doi:10.1016/j.jappgeo.2014.05.010 · Cited by 130
Khoub, A. R. (2007) · Irrigation Science · doi:10.1007/s00271-007-0090-z · Cited by 130
Artrith, N., Hiller, B., & Behler, J. (2012) · physica status solidi (b) · doi:10.1002/pssb.201248370 · Cited by 130
Neural operator prediction of linear instability waves in high-speed boundary layers
Leoni, P. C. D., Lu, L., Meneveau, C., Karniadakis, G. E., & Zaki, T. A. (2022) · Journal of Computational Physics · doi:10.1016/j.jcp.2022.111793 · Cited by 142
Evolving recurrent perceptrons for time-series modeling
McDonnell, J. R., & Waagen, D. E. (1994) · IEEE Transactions on Neural Networks · doi:10.1109/72.265958 · Cited by 142
Vaferi, B., Samimi, F., Pakgohar, E., & Mowla, D. (2014) · Powder Technology · doi:10.1016/j.powtec.2014.06.062 · Cited by 129
Machine learning for fast and reliable solution of time-dependent differential equations
Regazzoni, F., Dede’, L., & Quarteroni, A. M. (2019) · Journal of Computational Physics · doi:10.1016/j.jcp.2019.07.050 · Cited by 170
Neural network wave functions and the sign problem
Szabó, A., & Castelnovo, C. (2020) · Physical Review Research · doi:10.1103/physrevresearch.2.033075 · Cited by 86
Rautela, M., Senthilnath, J., Moll, J., & Gopalakrishnan, S. (2021) · Ultrasonics · doi:10.1016/j.ultras.2021.106451 · Cited by 126
Orthogonal least-squares algorithm for training multioutput radial basis function networks
Chen, S., Grant, P. M., & Cowan, C. F. N. (1992) · IEE Proceedings F Radar and Signal Processing · doi:10.1049/ip-f-2.1992.0054 · Cited by 129
Benchmarking a reduced multivariate polynomial pattern classifier
Toh, K., Tran, Q.-L., & Srinivasan, D. (2004) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2004.3 · Cited by 139
Combination of machine scores for automatic grading of pronunciation quality
Franco, H., Neumeyer, L., Digalakis, V., & Ronen, O. (2000) · Speech Communication · doi:10.1016/s0167-6393(99)00045-x · Cited by 129
On the Limitations of Representing Functions on SetsPreprint
Wagstaff, E., Fuchs, F. B., Engelcke, M., Posner, I., & Osborne, M. A. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1901.09006 · Cited by 129
High-Dimensional Neural Network Potentials for Organic Reactions and an Improved Training Algorithm
Gastegger, M., & Marquetand, P. (2015) · Journal of Chemical Theory and Computation · doi:10.1021/acs.jctc.5b00211 · Cited by 131
Conditional DQN-Based Motion Planning With Fuzzy Logic for Autonomous Driving
Chen, L. F., Hu, X., Tang, B., & Cheng, Y. (2020) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2020.3025671 · Cited by 141
Random Approximants and Neural Networks
Makovoz, Y. (1996) · Journal of Approximation Theory · doi:10.1006/jath.1996.0031 · Cited by 128
Nonlinear modelling and prediction with feedforward and recurrent networks
Gençay, R., & Liu, T. (1997) · Physica D Nonlinear Phenomena · doi:10.1016/s0167-2789(97)82009-x · Cited by 141
Making sense of a complex world [chaotic events modeling]
Haykin, S., & Príncipe, J. C. (1998) · IEEE Signal Processing Magazine · doi:10.1109/79.671132 · Cited by 145
The effect of wind generation and weekday on Spanish electricity spot price forecasting
Cruz, A., Roque, A. M. S., Macho, J. L. Z., & Espínola, R. (2011) · Electric Power Systems Research · doi:10.1016/j.epsr.2011.06.002 · Cited by 127
Vaferi, B., Eslamloueyan, R., & Ayatollahi, S. (2011) · Journal of Petroleum Science and Engineering · doi:10.1016/j.petrol.2011.03.002 · Cited by 127
Tasadduq, I. A. (2002) · Renewable Energy · doi:10.1016/s0960-1481(01)00082-9 · Cited by 137
Samarawickrama, A. J. P., & Fernando, T. G. I. (2017) · IEEE International Conference on Industrial and Information Systems (ICIIS) · doi:10.1109/iciinfs.2017.8300345 · Cited by 127
Machine Learning and Sampling Scheme: An Empirical Study of Money Laundering Detection
Zhang, Y., & Trubey, P. (2018) · Computational Economics · doi:10.1007/s10614-018-9864-z · Cited by 150
Dynamics of stochastic gradient descent for two-layer neural networks in the teacher–student setup*
Goldt, S., Advani, M. S., Saxe, A., Krząkała, F., & Zdeborová, L. (2020) · Journal of Statistical Mechanics Theory and Experiment · doi:10.1088/1742-5468/abc61e · Cited by 153
Wang, S., Wang, Q., & Zhao, J. (2020) · Transportation Research Part C Emerging Technologies · doi:10.1016/j.trc.2020.102701 · Cited by 154
Predicting post-stroke pneumonia using deep neural network approaches
Ge, Y., Wang, Q., Wang, L., Wu, H., Chen, P., Wang, J., Xu, Y., Xiong, G., Zhang, Y., & Yi, Y. (2019) · International Journal of Medical Informatics · doi:10.1016/j.ijmedinf.2019.103986 · Cited by 142
Safe Policies for Reinforcement Learning via Primal-Dual Methods
Paternain, S., Calvo-Fullana, M., Chamon, L. F. O., & Ribeiro, A. (2022) · IEEE Transactions on Automatic Control · doi:10.1109/tac.2022.3152724 · Cited by 191
Wang, S., Mo, B., & Zhao, J. (2020) · Transportation Research Part C Emerging Technologies · doi:10.1016/j.trc.2020.01.012 · Cited by 152
Finite Neuron Method and Convergence Analysis
Xu, J. (2020) · Communications in Computational Physics · doi:10.4208/cicp.oa-2020-0191 · Cited by 129
BERT-Based Deep Spatial-Temporal Network for Taxi Demand Prediction
Cao, D., Zeng, K., Wang, J., Sharma, P. K., Ma, X., Liu, Y., & Zhou, S. (2021) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2021.3122114 · Cited by 127
Fermionic wave functions from neural-network constrained hidden states
Robledo Moreno, J., Carleo, G., Georges, A., & Stokes, J. (2022) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.2122059119 · Cited by 85
Chapter 8 Forecasting economic variables with nonlinear models
Teräsvirta, T. (2006) · Handbook of economic forecasting · doi:10.1016/s1574-0706(05)01008-6 · Cited by 160
Characterisation of Si-crystalline PV modules by artificial neural networks
Almonacid, F. M., Rus-Casas, C., Hontoria, L., Fuentes, M., & Nofuentes, G. (2008) · Renewable Energy · doi:10.1016/j.renene.2008.06.010 · Cited by 139
Forecasting Thailand’s rice export: Statistical techniques vs. artificial neural networks
Co, H. C., & Boosarawongse, R. (2007) · Computers & Industrial Engineering · doi:10.1016/j.cie.2007.06.005 · Cited by 127
Dengel, S., Zona, D., Sachs, T., Aurela, M., Jammet, M., Parmentier, F. W., Oechel, W. C., & Vesala, T. (2013) · Biogeosciences · doi:10.5194/bg-10-8185-2013 · Cited by 132
Streamflow Modelling: A Primer on Applications, Approaches and Challenges
Bourdin, D. R., Fleming, S. W., & Stull, R. B. (2012) · ATMOSPHERE-OCEAN · doi:10.1080/07055900.2012.734276 · Cited by 141
Deep Stochastic Configuration Networks with Universal Approximation Property
Wang, D., & Li, M. (2018) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn.2018.8489695 · Cited by 126
Huré, C., Pham, H., Bachouch, A., & Langrené, N. (2021) · SIAM Journal on Numerical Analysis · doi:10.1137/20m1316640 · Cited by 165
Non-intrusive reduced-order modeling for fluid problems: A brief review
Yu, J. Z., Yan, C. Y., & Guo, M. (2019) · Proceedings of the Institution of Mechanical Engineers Part G Journal of Aerospace Engineering · doi:10.1177/0954410019890721 · Cited by 126
Embedding and approximation theorems for echo state networks
Hart, A., Hook, J., & Dawes, J. (2020) · Neural Networks · doi:10.1016/j.neunet.2020.05.013 · Cited by 155
Art in the Age of Machine Learning
Audry, S. (2021) · The MIT Press eBooks · doi:10.7551/mitpress/12832.001.0001 · Cited by 112
HCFNN: High-order coverage function neural network for image classification
Ning, X., Tian, W., Yu, Z., Li, W., Bai, X. P., & Wang, Y. (2022) · Pattern Recognition · doi:10.1016/j.patcog.2022.108873 · Cited by 133
Exploring QCD matter in extreme conditions with Machine Learning
Zhou, K., Wang, L., Pang, L.-G., & Shi, S. (2023) · Progress in Particle and Nuclear Physics · doi:10.1016/j.ppnp.2023.104084 · Cited by 145
A Brief History of Connectionism
Medler, D. A. (1998) · Cited by 137
Çelikoğlu, H. B. (2006) · Mathematical and Computer Modelling · doi:10.1016/j.mcm.2006.02.002 · Cited by 126
Neural networks for statistical recognition of continuous speech
Morgan, N., & Bourlard, H. A. (1995) · Proceedings of the IEEE · doi:10.1109/5.381844 · Cited by 144
Limitations of nonlinear PCA as performed with generic neural networks
Malthouse, E. C. (1998) · IEEE Transactions on Neural Networks · doi:10.1109/72.655038 · Cited by 128
Generating fuzzy rules by learning from examples
Wang, L.-X., & Mendel, J. (1991) · Proceedings of the 1991 IEEE International Symposium on Intelligent Control · doi:10.1109/isic.1991.187368 · Cited by 3,285
Esfandiari, K., Abdollahi, F., & Talebi, H. A. (2014) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2014.2378991 · Cited by 129
A rear-end collision prediction scheme based on deep learning in the Internet of Vehicles
Chen, C., Xiang, H., Qiu, T., Wang, C., Zhou, Y., & Chang, V. I. C. (2017) · Journal of Parallel and Distributed Computing · doi:10.1016/j.jpdc.2017.08.014 · Cited by 128
Flowfield Reconstruction Method Using Artificial Neural Network
Yu, J. Z., & Hesthaven, J. S. (2018) · AIAA Journal · doi:10.2514/1.j057108 · Cited by 125
New Error Bounds for Deep ReLU Networks Using Sparse Grids
Montanelli, H., & Du, Q. (2019) · SIAM Journal on Mathematics of Data Science · doi:10.1137/18m1189336 · Cited by 161
Approximation Spaces of Deep Neural Networks
Gribonval, R., Kutyniok, G., Nielsen, M., & Voigtlaender, F. (2021) · Constructive Approximation · doi:10.1007/s00365-021-09543-4 · Cited by 156
Two-stream RNN/CNN for action recognition in 3D videos
Zhao, R., Ali, H., & van der Smagt, P. (2017) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros.2017.8206288 · Cited by 151
Credit default prediction from user-generated text in peer-to-peer lending using deep learning
Kriebel, J., & Stitz, L. (2020) · European Journal of Operational Research · doi:10.1016/j.ejor.2021.12.024 · Cited by 141
Han, Y., Pereira, F. C., Ben-Akiva, M. E., & Zegras, P. C. (2022) · Transportation Research Part B Methodological · doi:10.1016/j.trb.2022.07.001 · Cited by 148
Phase-field modeling of fracture with physics-informed deep learning
Manav, M., Molinaro, R., Mishra, S., & Lorenzis, L. D. (2024) · Computer Methods in Applied Mechanics and Engineering · doi:10.1016/j.cma.2024.117104 · Cited by 151
Discrete time recurrent neural network architectures: A unifying review
Tsoi, A. C., & Back, A. D. (1997) · Neurocomputing · doi:10.1016/s0925-2312(97)00161-6 · Cited by 141
Bounding and Counting Linear Regions of Deep Neural NetworksPreprint
Serra, T., Tjandraatmadja, C., & Ramalingam, S. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1711.02114 · Cited by 271
Winkler, D. A., & Le, T. C. (2017) · Molecular Informatics · doi:10.1002/minf.201600118 · Cited by 121
Pixel-Aware Deep Function-Mixture Network for Spectral Super-Resolution
Zhang, L., Lang, Z., Wang, P., Wei, W., Liao, S., Shao, L., & Zhang, Y. (2020) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v34i07.6978 · Cited by 133
Optimal approximation rate of ReLU networks in terms of width and depth
Shen, Z., Yang, H., & Zhang, S. (2021) · Journal de Mathématiques Pures et Appliquées · doi:10.1016/j.matpur.2021.07.009 · Cited by 229
Intelligent failure-tolerant control
Stengel, R. F. (1991) · IEEE Control Systems · doi:10.1109/37.88586 · Cited by 166
Introduction to computation and learning in artificial neural networks
Másson, E., & Wang, Y.-J. (1990) · European Journal of Operational Research · doi:10.1016/0377-2217(90)90085-p · Cited by 147
Stable Adaptive Control of Robot Manipulators Using “Neural” Networks
Sanner, R. M., & Slotine, J.-J. E. (1995) · Neural Computation · doi:10.1162/neco.1995.7.4.753 · Cited by 127
Learning Functional Causal Models with Generative Neural Networks
Goudet, O., Kalainathan, D., Caillou, P., Guyon, I., Lopez-Paz, D., & Sebag, M. (2018) · The Springer Series on Challenges in Machine Learning · doi:10.1007/978-3-319-98131-4_3 · Cited by 123
Soft Computing for Knowledge Discovery and Data Mining
Maimon, O., & Rokach, L. (2007) · Springer eBooks · doi:10.1007/978-0-387-69935-6 · Cited by 129
Inverse-Free Extreme Learning Machine With Optimal Information Updating
Li, S., You, Z., Guo, H., Luo, X., & Zhao, Z. (2015) · IEEE Transactions on Cybernetics · doi:10.1109/tcyb.2015.2434841 · Cited by 136
On the approximation by single hidden layer feedforward neural networks with fixed weights
Guliyev, N. J., & Ismailov, V. E. (2017) · Neural Networks · doi:10.1016/j.neunet.2017.12.007 · Cited by 147
Large data sets and machine learning: Applications to statistical arbitrage
Huck, N. (2019) · European Journal of Operational Research · doi:10.1016/j.ejor.2019.04.013 · Cited by 138
Goto, T., Tran, Q. H., & Nakajima, K. (2021) · Physical Review Letters · doi:10.1103/physrevlett.127.090506 · Cited by 168
Artificial olfactory sensor technology that mimics the olfactory mechanism: a comprehensive review
Kim, C., Lee, K. K., Kang, M. S., Shin, D., Oh, J., Lee, C., & Han, D. (2022) · Biomaterials Research · doi:10.1186/s40824-022-00287-1 · Cited by 131
Artificial Intelligence and Advanced Materials
López, C. (2023) · Advanced Materials · doi:10.1002/adma.202208683 · Cited by 144
Stranieri, A., Zeleznikow, J., Gawler, M., & Lewis, B. (1999) · Artificial Intelligence and Law · doi:10.1023/a:1008325826599 · Cited by 123
Identification of nonlinear dynamical systems using multilayered neural networks
Jagannathan, S., & Lewis, F. L. (1996) · Automatica · doi:10.1016/s0005-1098(96)80007-0 · Cited by 128
Nonlinear Prediction of the Hot Metal Silicon Content in the Blast Furnace
Saxén, H., & Pettersson, F. (2007) · ISIJ International · doi:10.2355/isijinternational.47.1732 · Cited by 122
Hemmat Esfe, M., Rostamian, H., Esfandeh, S., & Afrand, M. (2018) · Physica A: Statistical Mechanics and its Applications · doi:10.1016/j.physa.2018.06.041 · Cited by 121
Deep learning in biomedical data science
Baldi, P. (2018) · Annual Review of Biomedical Data Science · doi:10.1146/annurev-biodatasci-080917-013343 · Cited by 119
Deep learning versus traditional machine learning methods for aggregated energy demand prediction
Paterakis, N. G., Mocanu, E., Gibescu, M., Stappers, B., & van Alst, W. (2017) · 2017 IEEE PES Innovative Smart Grid Technologies Conference Europe (ISGT-Europe) · doi:10.1109/isgteurope.2017.8260289 · Cited by 118
“In [27], it was demonstrated that MLPs are universal function approximators.”
Nguyen, T., Raghu, M., & Kornblith, S. (2020) · arXiv · doi:10.48550/arxiv.2010.15327 · Cited by 112
Metadata
- Authors
- Cybenko, G.
- Affiliations
- University of Illinois Urbana-Champaign (US)
- Corresponding author
- Cybenko, G.
- ORCID
- Cybenko, G.
- Venue
- Mathematics of Control, Signals, and Systems
- Published
- 1989-12
- Volume
- 2
- Issue
- 4
- Pages
- 303-314
- ISSN
- 0932-4194 (ISSN-L)
- 1435-568X
- OpenAlex
- W2103496339
- Semantic Scholar
- 8da1dda34ecc96263102181448c94ec7d645d085
- Cited by
- 13,883
- References
- 25
- Citations by year
- 2026: 640 · 2025: 889 · 2024: 793 · 2023: 746 · 2022: 827 · 2021: 1050 · 2020: 1001 · 2019: 761 · 2018: 542 · 2017: 414 · 2016: 312 · 2015: 313 · 2014: 289 · 2013: 310 · 2012: 296
- FWCI
- 94.52
- Type
- journal article
- Language
- en
- Open access
- green
- hal.science
- Licence
- cc-by-nc
- www.springer.com/tdm (tdm)
- Locations
- Mathematics of Control Signals and Systems (publishedVersion)
- HAL (submittedVersion, cc-by-nc)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Neural Networks and Applications
- Physical Sciences › Computer Science › Artificial Intelligence › Machine Learning and ELM
- Physical Sciences › Mathematics › Applied Mathematics › Approximation Theory and Sequence Spaces
- Keywords
- universal approximation, sigmoidal function, single hidden layer neural network, feedforward neural networks, approximation of continuous functions, decision regions, nonlinear activation functions, unit hypercube
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.