Wireless Network Intelligence at the Edge
Open accessThe DOI matches its Crossref record; 205 of the 224 references it cites were found in a registry or an index, and 6 are not checked yet.
Abstract
Fueled by the availability of more data and computing power, recent breakthroughs in cloud-based machine learning (ML) have transformed every aspect of our lives from face recognition and medical diagnosis to natural language processing. However, classical ML exerts severe demands in terms of energy, memory, and computing resources, limiting their adoption for resource-constrained edge devices. The new breed of intelligent devices and high-stake applications (drones, augmented/virtual reality, autonomous systems, and so on) requires a novel paradigm change calling for distributed, low-latency and reliable ML at the wireless network edge (referred to as edge ML). In edge ML, training data are unevenly distributed over a large number of edge nodes, which have access to a tiny fraction of the data. Moreover, training and inference are carried out collectively over wireless links, where edge devices communicate and exchange their learned models (not their private data). In a first of its kind, this article explores the key building blocks of edge ML, different neural network architectural splits and their inherent tradeoffs, as well as theoretical and technical enablers stemming from a wide range of mathematical disciplines. Finally, several case studies pertaining to various high-stake applications are presented to demonstrate the effectiveness of edge ML in unlocking the full potential of 5G and beyond.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Examples of adversarial attacks include data poisoning [69, 319], model update poisoning [44, 67], and model evasion attacks [441, 69, 211].”
From Advances and Open Problems in Federated Learning (2021) · cites this paper as [211]
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Hochreiter, S., & Schmidhuber, J. (1997) · Neural Computation · doi:10.1162/neco.1997.9.8.1735 · Cited by 102,318
Elements of Information Theory
Cover, T. M., & Thomas, J. A. (2001) · Wiley eBooks · doi:10.1002/0471200611 · Cited by 36,808
(2014) · Cited by 33,419
Learning Phrase Representations using RNN Encoder–Decoder for Statistical Machine Translation
Cho, K., van Merrienboer, B., Gulcehre, C., Bahdanau, D., Bougares, F., Schwenk, H., & Bengio, Y. (2014) · Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.3115/v1/d14-1179 · Cited by 25,545
Multilayer feedforward networks are universal approximators
Hornik, K., Stinchcombe, M., & White, H. (1989) · Neural Networks · doi:10.1016/0893-6080(89)90020-8 · Cited by 21,728
Communication-Efficient Learning of Deep Networks from Decentralized Data
McMahan, H. B., Moore, E., Ramage, D., Hampson, S., & Arcas, B. A. Y. (2016) · arXiv · doi:10.48550/arxiv.1602.05629 · Cited by 14,215
Distilling the Knowledge in a Neural Network
Hinton, G., Vinyals, O., & Dean, J. (2015) · arXiv · doi:10.48550/arxiv.1503.02531 · Cited by 14,204
Approximation by superpositions of a sigmoidal function
Cybenko, G. (1989) · Mathematics of Control, Signals, and Systems · doi:10.1007/bf02551274 · Cited by 13,883
Foundations of statistical natural language processing
Manning, C. D., & Schütze, H. (1999) · Cited by 9,816
Playing Atari with Deep Reinforcement Learning
Mnih, V., Kavukcuoglu, K., Silver, D., Graves, A., Antonoglou, I., Wierstra, D., & Riedmiller, M. (2013) · arXiv · doi:10.48550/arxiv.1312.5602 · Cited by 9,471
Multilayer feedforward networks are universal approximators
HornikK., StinchcombeM., & WhiteH. (1989) · Neural Networks · doi:10.5555/70405.70408 · Cited by 9,081
Conditional Generative Adversarial Nets
Mirza, M., & Osindero, S. (2014) · arXiv · doi:10.48550/arxiv.1411.1784 · Cited by 8,863
Model-Agnostic Meta-Learning for Fast Adaptation of Deep Networks
Finn, C., Abbeel, P., & Levine, S. (2017) · arXiv · doi:10.48550/arxiv.1703.03400 · Cited by 8,512
Asynchronous Methods for Deep Reinforcement Learning
Mnih, V., Badia, A. P., Mirza, M., Graves, A., Lillicrap, T. P., Harley, T., Silver, D., & Kavukcuoglu, K. (2016) · arXiv · doi:10.48550/arxiv.1602.01783 · Cited by 7,132 · cited 1×
“The RL scheduler is trained using an asynchronous advantage actor-critic (A3C) algorithm [218] in an offline manner.”
MethodFederated Machine Learning: Concept and Applications
Yang, Q., Liu, Y., Chen, T., & Tong, Y. (2019) · ACM Transactions on Intelligent Systems and Technology · doi:10.1145/3298981 · Cited by 6,322 · cited 1×
“For more details on state dimensionality reduction and advanced FL and FD frameworks in both supervised learning and RL, the readers are encouraged to check [186], [195], and [196].”
BackgroundFederated learning: Challenges, methods, and future directions
Li, T., Sahu, A. K., Talwalkar, A., & Smith, V. (2020) · IEEE Signal Processing Magazine · doi:10.1109/msp.2020.2975749 · Cited by 6,210
Markowitz, H. (1952) · The Journal of Finance · doi:10.1111/j.1540-6261.1952.tb01525.x · Cited by 5,641
(1999) · Cited by 5,147
Han, S., Mao, H., & Dally, W. J. (2015) · arXiv · doi:10.48550/arxiv.1510.00149 · Cited by 4,662
Markowitz, H. (1952) · The Journal of Finance · doi:10.2307/2975974 · Cited by 4,599
In-Datacenter Performance Analysis of a Tensor Processing Unit
Jouppi, N. P., Young, C., Patil, N., Patterson, D., Agrawal, G., Bajwa, R., Bates, S., Bhatia, S., Boden, N., Borchers, A., et al. (2017) · Proceedings of the 44th Annual International Symposium on Computer Architecture · doi:10.1145/3079856.3080246 · Cited by 4,537 · cited 1×
“, 24 MB with tens of nanoseconds access latency [110], [111].”
BackgroundLarge Scale Distributed Deep Networks
Dean, J. B., Corrado, G. S., Monga, R., Chen, K., Devin, M., Mao, M., Ranzato, M., Senior, A., Tucker, P. A., Yang, K., et al. (2012) · neural information processing systems · Cited by 4,489
Bayesian Learning for Neural Networks
Neal, R. M. (1996) · Lecture Notes in Statistics · doi:10.1007/978-1-4612-0745-0 · Cited by 4,276
Conditional value-at-risk for general loss distributions
Rockafellar, R. T., & Uryasev, S. (2002) · Journal of Banking & Finance · doi:10.1016/s0378-4266(02)00271-6 · Cited by 3,820
Federated Learning: Strategies for Improving Communication Efficiency
Konečný, J., McMahan, H. B., Yu, F. X., Richtárik, P., Suresh, A. T., & Bacon, D. (2016) · arXiv · doi:10.48550/arxiv.1610.05492 · Cited by 3,766
Learning Phrase Representations using RNN Encoder-Decoder for Statistical Machine Translation
Cho, K., van Merrienboer, B., Gulcehre, C., Bahdanau, D., Bougares, F., Schwenk, H., & Bengio, Y. (2014) · arXiv · doi:10.48550/arxiv.1406.1078 · Cited by 3,317
Valiant, L. G. (1984) · Communications of the ACM · doi:10.1145/1968.1972 · Cited by 3,279 · cited 1×
“This missing block can be addressed by the Bayesian learning theory [125] and the probably approximately correct (PAC) framework [126].”
BackgroundIntelligent Manufacturing in the Context of Industry 4.0: A Review
Zhong, R. Y., Xu, X., Klotz, E., & Newman, S. T. (2017) · Engineering · doi:10.1016/j.eng.2017.05.015 · Cited by 2,913
Beyond regression : new fools for prediction and analysis in the behavioral sciences
Werbos, P. J. (1974) · Medical Entomology and Zoology · Cited by 2,739
Lasry, J.-M., & Lions, P.-L. (2007) · Japanese Journal of Mathematics · doi:10.1007/s11537-007-0657-8 · Cited by 2,635
The information bottleneck method
Tishby, N., Pereira, F. C., & Bialek, W. (2000) · arXiv · doi:10.48550/arxiv.physics/0004057 · Cited by 2,626 · cited 1×
“(b) IB Under KL Divergence: The formulation (2) in IB is a special case for obtaining the ratedistortion function R(D) with a distortion measure given as a KL divergence [164].”
MethodLee, H., Grosse, R., Ranganath, R., & Ng, A. Y. (2009) · Proceedings of the 26th Annual International Conference on Machine Learning · doi:10.1145/1553374.1553453 · Cited by 2,412
Sinkhorn Distances: Lightspeed Computation of Optimal TransportPreprint
Cuturi, M. (2013) · Cited by 2,385
A fully homomorphic encryption scheme
Boneh, D., & Gentry, C. (2009) · Cited by 2,341
Computational Optimal Transport with Applications to Data Sciences
Gabriel, P., & Marco, C. (2019) · Foundations and Trends® in Machine Learning · doi:10.1561/2200000073 · Cited by 2,319
Adaptive Federated Learning in Resource Constrained Edge Computing Systems
Wang, S., Tuor, T., Salonidis, T., Leung, K. K., Makaya, C., He, T., & Chan, K. (2019) · IEEE Journal on Selected Areas in Communications · doi:10.1109/jsac.2019.2904348 · Cited by 2,232
Arjovsky, M., Chintala, S., & Bottou, L. (2017) · arXiv · doi:10.48550/arxiv.1701.07875 · Cited by 2,225
Neural ordinary differential equations
Chen, R. T. Q., Rubanova, Y., Bettencourt, J., & Duvenaud, D. (2018) · arXiv · doi:10.48550/arxiv.1806.07366 · Cited by 2,097
Federated Learning with Non-IID Data
Zhao, Y., Li, M., Lai, L., Suda, N., Civin, D., & Chandra, V. (2018) · arXiv · doi:10.48550/arxiv.1806.00582 · Cited by 2,077
(2013) · Cited by 2,056
Accelerating Stochastic Gradient Descent using Predictive Variance Reduction
Johnson, R., & Zhang, T. (2013) · Cited by 1,889
Client Selection for Federated Learning with Heterogeneous Resources in Mobile Edge
Nishio, T., & Yonetani, R. (2019) · ICC 2019 - 2019 IEEE International Conference on Communications (ICC) · doi:10.1109/icc.2019.8761315 · Cited by 1,875 · cited 2×
“FL has been shown to improve communication efficiency by MSI quantization [30], adjusting the MSI update period [28], and optimizing devices’ scheduling policy [31].”
BackgroundMethodClient Selection for Federated Learning with Heterogeneous Resources in Mobile Edge
Nishio, T., & Yonetani, R. (2018) · arXiv · doi:10.48550/arxiv.1804.08333 · Cited by 1,875
Bayesian Learning via Stochastic Gradient Langevin Dynamics
Welling, M., & Teh, Y. W. (2012) · Cited by 1,860
Rainbow: Combining Improvements in Deep Reinforcement Learning
Hessel, M., Modayil, J., Van Hasselt, H., Schaul, T., Ostrovski, G., Dabney, W., Horgan, D., Piot, B., Azar, M., & Silver, D. (2018) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v32i1.11796 · Cited by 1,846
Gray, R. M., & Neuhoff, D. L. (1998) · IEEE Transactions on Information Theory · doi:10.1109/18.720541 · Cited by 1,642
Federated Optimization: Distributed Machine Learning for On-Device Intelligence
Konečný, J., McMahan, H. B., Ramage, D., & Richtárik, P. (2016) · arXiv · doi:10.48550/arxiv.1610.02527 · Cited by 1,563
Deep Learning Applications in Medical Image Analysis
Ker, J., Wang, L., Rao, J., & Lim, T. (2018) · IEEE Access · doi:10.1109/access.2017.2788044 · Cited by 1,481
Deep learning and the information bottleneck principle
Tishby, N., & Zaslavsky, N. (2015) · 2015 IEEE Information Theory Workshop (ITW) · doi:10.1109/itw.2015.7133169 · Cited by 1,409
Mechanism Design via Differential Privacy
McSherry, F., & Talwar, K. (2007) · 48th Annual IEEE Symposium on Foundations of Computer Science (FOCS'07) · doi:10.1109/focs.2007.66 · Cited by 1,371
Do Deep Nets Really Need to be Deep?
Ba, J. L., & Caruana, R. (2013) · arXiv (Cornell University) · doi:10.48550/arxiv.1312.6184 · Cited by 1,335
Towards Sharp Inapproximability For Any 2-CSP
Austrin, P. (2007) · 48th Annual IEEE Symposium on Foundations of Computer Science (FOCS'07) · doi:10.1109/focs.2007.41 · Cited by 1,294
In-Datacenter Performance Analysis of a Tensor Processing Unit
Jouppi, N. P., Young, C., Patil, N., Patterson, D., Agrawal, G., Bajwa, R., Bates, S., Bhatia, S., Boden, N., Borchers, A., et al. (2017) · ACM SIGARCH Computer Architecture News · doi:10.1145/3140659.3080246 · Cited by 1,240
(2011) · doi:10.5591/978-1-57735-516-8/ijcai11-210 · Cited by 1,229
Information propagation in the Bitcoin network
Decker, C., & Wattenhofer, R. (2013) · IEEE P2P 2013 Proceedings · doi:10.1109/p2p.2013.6688704 · Cited by 1,192
Micikevicius, P., Narang, S., Alben, J., Diamos, G., Elsen, E., Garcia, D., Ginsburg, B., Houston, M., Kuchaiev, O., Venkatesh, G., et al. (2017) · arXiv · doi:10.48550/arxiv.1710.03740 · Cited by 1,179 · cited 2×
“In this respect, mixed-precision training [114] is a viable solution, where the precision is downconverted from floating point (FP) 32 to FP 16 during the forward and backward propagation processes, and then upconverted back to FP 32 when updating the master copy of model weights.”
MethodUnmanned Aerial Vehicle With Underlaid Device-to-Device Communications: Performance and Tradeoffs
Mozaffari, M., Saad, W., Bennis, M., & Debbah, M. (2016) · IEEE Transactions on Wireless Communications · doi:10.1109/twc.2016.2531652 · Cited by 1,126
Self-citationParallelized Stochastic Gradient Descent
Zinkevich, M., Weimer, M., Li, L., & Smola, A. J. (2010) · Cited by 1,124
Artificial Neural Networks-Based Machine Learning for Wireless Networks: A Tutorial
Chen, M., Challita, U., Saad, W., Yin, C., & Debbah, M. (2019) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2019.2926625 · Cited by 1,117
Self-citationFotouhi, A., Qiang, H., Ding, M., Hassan, M., Giordano, L. G., Garcia-Rodriguez, A., & Yuan, J. (2019) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2019.2906228 · Cited by 1,115
A Relationship Between Arbitrary Positive Matrices and Doubly Stochastic Matrices
Sinkhorn, R. (1964) · The Annals of Mathematical Statistics · doi:10.1214/aoms/1177703591 · Cited by 1,032
In-Edge AI: Intelligentizing Mobile Edge Computing, Caching and Communication by Federated Learning
Wang, X., Han, Y., Wang, C., Zhao, Q., Chen, X., & Chen, M. (2019) · IEEE Network · doi:10.1109/mnet.2019.1800286 · Cited by 1,030 · cited 1×
“A similar procedure is applicable to deep Q-learning in MARL, where each agent approximates the Q values using an NN, as demonstrated in [184].”
MethodMobile-Edge Computing: Partial Computation Offloading Using Dynamic Voltage Scaling
Wang, Y., Sheng, M., Wang, X., Wang, L., & Li, J. (2016) · IEEE Transactions on Communications · doi:10.1109/tcomm.2016.2599530 · Cited by 1,002
5G Wireless Network Slicing for eMBB, URLLC, and mMTC: A Communication-Theoretic View
Popovski, P., Trillingsgaard, K. F., Simeone, O., & Durisi, G. (2018) · IEEE Access · doi:10.1109/access.2018.2872781 · Cited by 979
Visualizing the Loss Landscape of Neural Nets
Li, H., Xu, Z., Taylor, G., Studer, C., & Goldstein, T. (2017) · Repository for Publications and Research Data (ETH Zurich) · doi:10.3929/ethz-b-000461393 · Cited by 926
Blockchained On-Device Federated Learning
Kim, H., Park, J., Bennis, M., & Kim, S.-L. (2020) · IEEE Communications Letters · doi:10.1109/lcomm.2019.2921755 · Cited by 887 · cited 3×
“On another level, the training process can become robust against malicious and/or malfunctioning devices by the aid of blockchain technologies [172], as elaborated next.”
BackgroundMethodSelf-citationBlockchained On-Device Federated Learning
Kim, H., Park, J., Bennis, M., & Kim, S.-L. (2018) · arXiv · doi:10.48550/arxiv.1808.03949 · Cited by 882 · cited 3×
“The local distributed ledger is synchronized with the other devices’ ledgers via DLT such as a blockchain algorithm [160] or a directed acyclic graph (DAG) based Byzantine fault tolerance (BFT) algorithm [162].”
BackgroundMethodInfluentialSelf-citationLearning to Optimize: Training Deep Neural Networks for Interference Management
Sun, H., Chen, X., Shi, Q., Hong, M., Fu, X., & Sidiropoulos, N. D. (2018) · IEEE Transactions on Signal Processing · doi:10.1109/tsp.2018.2866382 · Cited by 874
Deep Learning Based Communication Over the Air
Dorner, S., Cammerer, S., Hoydis, J., & Brink, S. T. (2018) · IEEE Journal of Selected Topics in Signal Processing · doi:10.1109/jstsp.2017.2784180 · Cited by 859
QSGD: Communication-Efficient SGD via Gradient Quantization and Encoding
Alistarh, D., Grubic, D., Li, J., Tomioka, R., & Vojnović, M. (2016) · London School of Economics and Political Science Research Online (London School of Economics and Political Science) · doi:10.48550/arxiv.1610.02132 · Cited by 859
Computational Optimal Transport
Peyré, G., & Cuturi, M. (2019) · now publishers, Inc. eBooks · doi:10.1561/9781680835519 · Cited by 847
Decision theoretic generalizations of the PAC model for neural net and other learning applications
Haussler, D. (1992) · Information and Computation · doi:10.1016/0890-5401(92)90010-d · Cited by 843
E, W., Han, J., & Jentzen, A. (2017) · Communications in Mathematics and Statistics · doi:10.1007/s40304-017-0117-6 · Cited by 822
Mean Field Games and Mean Field Type Control Theory
Bensoussan, A., Frehse, J., & Yam, P. (2013) · SpringerBriefs in Mathematics · doi:10.1007/978-1-4614-8508-7 · Cited by 760
1Unmanned Aerial Vehicle with Underlaid Device-to-Device Communications: Performance and Tradeoffs
Mozaffari, M., Member, S., Saad, W., Member, S., Member, S., & Debbah, M. A. (2016) · Cited by 760
Self-citationThe Loss Surfaces of Multilayer Networks
Choromanska, A., Henaff, M., Mathieu, M., Arous, G. B., & LeCun, Y. (2014) · arXiv · doi:10.48550/arxiv.1412.0233 · Cited by 733
Designing Energy-Efficient Convolutional Neural Networks Using Energy-Aware Pruning
Yang, T.-J., Chen, Y.-H., & Sze, V. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.643 · Cited by 732 · cited 2×
“Alternatively, one can optimize the pruning process based on energy consumption [201], as shown in Fig.”
BackgroundMethodHochreiter, S., & Schmidhuber, J. (1997) · Neural Computation · doi:10.1162/neco.1997.9.1.1 · Cited by 676
TernGrad: Ternary Gradients to Reduce Communication in Distributed Deep Learning
Wen, W., Xu, C., Yan, F., Wu, C., Wang, Y., Chen, Y., & Li, H. H. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1705.07878 · Cited by 622
Demystifying Parallel and Distributed Deep Learning: An In-depth Concurrency Analysis
Ben-Nun, T., & Hoefler, T. (2020) · ACM Computing Surveys · doi:10.1145/3320060 · Cited by 577
Revisiting Distributed Synchronous SGD
Pan, X., Chen, J., Monga, R., Bengio, S., & Józefowicz, R. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1702.05800 · Cited by 548
Deep learning with Elastic Averaging SGDPreprint
Zhang, S., Choromanska, A., & LeCun, Y. (2014) · arXiv (Cornell University) · doi:10.48550/arxiv.1412.6651 · Cited by 546
Split learning for health: Distributed deep learning without sharing raw patient data
Vepakomma, P., Gupta, O., Swedish, T., & Raskar, R. (2018) · arXiv · doi:10.48550/arxiv.1812.00564 · Cited by 513 · cited 1×
“More general model split-based edge ML frameworks are discussed in [206] and [207], in the context of health applications with private patient data.”
BackgroundStich, S. U., Cordonnier, J.-B., & Jaggi, M. (2018) · arXiv · doi:10.48550/arxiv.1809.07599 · Cited by 508
On the information bottleneck theory of deep learning*
Saxe, A. M., Bansal, Y., Dapello, J., Advani, M., Kolchinsky, A., Tracey, B. D., & Cox, D. D. (2019) · Journal of Statistical Mechanics: Theory and Experiment · doi:10.1088/1742-5468/ab3985 · Cited by 493
Jeong, E., Oh, S., Kim, H., Park, J., Bennis, M., & Kim, S.-L. (2018) · arXiv · doi:10.48550/arxiv.1811.11479 · Cited by 465 · cited 4×
“This method and its scalability are demonstrated by federated augmentation (FAug) in our previous study [166].”
BackgroundMethodInfluentialSelf-citationMcAllester, D. A. (1998) · Proceedings of the eleventh annual conference on Computational learning theory · doi:10.1145/279943.279989 · Cited by 464
Distributed Federated Learning for Ultra-Reliable Low-Latency Vehicular Communications
Samarakoon, S., Bennis, M., Saad, W., & Debbah, M. (2020) · IEEE Transactions on Communications · doi:10.1109/tcomm.2019.2956472 · Cited by 459
Self-citationDeep Learning for Joint Source-Channel Coding of Text
Farsad, N., Rao, M., & Goldsmith, A. (2018) · 2018 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) · doi:10.1109/icassp.2018.8461983 · Cited by 438
Communication-Efficient Distributed Optimization using an Approximate Newton-type Method
Shamir, O., Srebro, N., & Zhang, T. (2013) · arXiv · doi:10.48550/arxiv.1312.7853 · Cited by 424 · cited 1×
“Besides, similar to ESGD, FSVRG keeps track of the global MSI and updates it based on the distributed approximate Newton (DANE) [178] that also ensures a constant learning rate.”
MethodLian, X., Zhang, C., Zhang, H., Hsieh, C., Zhang, W., & Liu, J. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1705.09056 · Cited by 395
Emergent Complexity via Multi-Agent CompetitionPreprint
Bansal, T., Pachocki, J., Sidor, S., Sutskever, I., & Mordatch, I. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1710.03748 · Cited by 392
Wireless Access for Ultra-Reliable Low-Latency Communication: Principles and Building Blocks
Popovski, P., Nielsen, J. J., Stefanovic, C., Carvalho, E. D., Strom, E., Trillingsgaard, K. F., Bana, A.-S., Kim, D. M., Kotaba, R., Park, J., et al. (2018) · IEEE Network · doi:10.1109/mnet.2018.1700258 · Cited by 390
Self-citationThe Architectural Implications of Autonomous Driving: Constraints and Acceleration
Lin, S.-C., Zhang, Y., Hsu, C.-H., Skach, M., Haque, M. E., Tang, L., & Mars, J. (2018) · Proceedings of the Twenty-Third International Conference on Architectural Support for Programming Languages and Operating Systems · doi:10.1145/3173162.3173191 · Cited by 367
Neural Network Detection of Data Sequences in Communication Systems
Farsad, N., & Goldsmith, A. (2018) · IEEE Transactions on Signal Processing · doi:10.1109/tsp.2018.2868322 · Cited by 358
Drone networks: Communications, coordination, and sensing
Yanmaz, E., Yahyanejad, S., Rinner, B., Hellwagner, H., & Bettstetter, C. (2018) · Ad Hoc Networks · doi:10.1016/j.adhoc.2017.09.001 · Cited by 348
Functional mechanism: regression analysis under differential privacy
Zhang, J., Zhang, Z., Xiao, X., Yang, Y., & Winslett, M. (2012) · Proceedings of the VLDB Endowment · doi:10.14778/2350229.2350253 · Cited by 345
A Bayesian Perspective on Generalization and Stochastic Gradient DescentPreprint
Smith, S. L., & Le, Q. V. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1710.06451 · Cited by 334
LAG: Lazily Aggregated Gradient for Communication-Efficient Distributed LearningPreprint
Chen, T., Giannakis, G. B., Sun, T., & Yin, W. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1805.09965 · Cited by 329
Rudd, E. M., Jain, L. P., Scheirer, W. J., & Boult, T. E. (2018) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2017.2707495 · Cited by 326
The Meta Distribution of the SIR in Poisson Bipolar and Cellular Networks
Haenggi, M. (2016) · IEEE Transactions on Wireless Communications · doi:10.1109/twc.2015.2504983 · Cited by 311
Mean Field Multi-Agent Reinforcement Learning
Yang, Y., Luo, R., Li, M., Zhou, M. Q., Zhang, W., & Wang, J. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1802.05438 · Cited by 286
Universal Function Approximation by Deep Neural Nets with Bounded Width and ReLU Activations
Hanin, B. (n.d.) · RePEc: Research Papers in Economics · Cited by 278
Channel Agnostic End-to-End Learning Based Communication Systems with Conditional GAN
Ye, H., Li, G. Y., Juang, B.-H. F., & Sivanesan, K. (2018) · 2018 IEEE Globecom Workshops (GC Wkshps) · doi:10.1109/glocomw.2018.8644250 · Cited by 244
A Distributional Perspective on Reinforcement Learning
Bellemare, M. G., Dabney, W., & Munos, R. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1707.06887 · Cited by 237
PAC-Bayesian Generalisation Error Bounds for Gaussian Process Classification
Seeger, M. (2003) · Journal of Machine Learning Research · doi:10.1162/153244303765208386 · Cited by 229
Offloading Schemes in Mobile Edge Computing for Ultra-Reliable Low Latency Communications
Liu, J., & Zhang, Q. (2018) · IEEE Access · doi:10.1109/access.2018.2800032 · Cited by 225
Dziugaite, G. K., & Roy, D. M. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1703.11008 · Cited by 217
Wireless Edge Computing With Latency and Reliability Guarantees
Elbamby, M. S., Perfecto, C., Liu, C., Park, J., Samarakoon, S., Chen, X., & Bennis, M. (2019) · Proceedings of the IEEE · doi:10.1109/jproc.2019.2917084 · Cited by 206
Self-citationDemystifying Parallel and Distributed Deep Learning: An In-Depth Concurrency Analysis
Ben‐Nun, T., & Hoefler, T. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1802.09941 · Cited by 203
Universal Function Approximation by Deep Neural Nets with Bounded Width and ReLU Activations
Hanin, B. (2019) · Mathematics · doi:10.3390/math7100992 · Cited by 202
Latency and Reliability-Aware Task Offloading and Resource Allocation for Mobile Edge Computing
Liu, C.-F., Bennis, M., & Poor, H. V. (2017) · 2017 IEEE Globecom Workshops (GC Wkshps) · doi:10.1109/glocomw.2017.8269175 · Cited by 201
Self-citationMD-GAN: Multi-Discriminator Generative Adversarial Networks for Distributed Datasets
Hardy, C., Le Merrer, E., & Sericola, B. (2019) · 2019 IEEE International Parallel and Distributed Processing Symposium (IPDPS) · doi:10.1109/ipdps.2019.00095 · Cited by 201
A Service-Oriented Deployment Policy of End-to-End Network Slicing Based on Complex Network Theory
Guan, W., Wen, X., Wang, L., Lu, Z., & Shen, Y. (2018) · IEEE Access · doi:10.1109/access.2018.2822398 · Cited by 194
Amjad, R. A., & Geiger, B. C. (2020) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2019.2909031 · Cited by 193
Machine Learning for Wireless Networks with Artificial Intelligence: A Tutorial on Neural NetworksPreprint
Chen, M., Challita, U., Saad, W., Yin, C., & Debbah, M. A. (2017) · arXiv (Cornell University) · Cited by 184
Self-citationProactive Resource Management for LTE in Unlicensed Spectrum: A Deep Learning Perspective
Challita, U., Dong, L., & Saad, W. (2018) · IEEE Transactions on Wireless Communications · doi:10.1109/twc.2018.2829773 · Cited by 183
Superneurons: dynamic GPU memory management for training deep neural networks
Wang, L., Ye, J., Zhao, Y., Wu, W., Li, A., Song, S. L., Xu, Z., & Kraska, T. (2018) · Proceedings of the 23rd ACM SIGPLAN Symposium on Principles and Practice of Parallel Programming · doi:10.1145/3178487.3178491 · Cited by 175
Essentially No Barriers in Neural Network Energy Landscape
Draxler, F., Veschgini, K., Manfred Salmhofer, B., & Hamprecht, F. A. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1803.00885 · Cited by 171
McAllester, D. A. (1999) · Machine Learning · doi:10.1023/a:1007618624809 · Cited by 162
Information Bottleneck for Gaussian Variables
Chechik, G., Globerson, A., Tishby, N., & Weiss, Y. (2003) · Cited by 161
Generalization error bounds for Bayesian mixture algorithms
Meir, R., & Zhang, T. (2003) · Rare & Special e-Zone (The Hong Kong University of Science and Technology) · doi:10.5555/945365.964297 · Cited by 160
Ultrareliable and Low-Latency Wireless Communication: Tail, Risk, and Scale
Bennis, M., Debbah, M., & Poor, H. V. (2018) · Proceedings of the IEEE · doi:10.1109/jproc.2018.2867029 · Cited by 156
Self-citationA Brief Introduction to Machine Learning for Engineers
Simeone, O. (2018) · Foundations and Trends® in Signal Processing · doi:10.1561/2000000102 · Cited by 154
Explore, exploit, and explain: personalizing explainable recommendations with bandits
McInerney, J., Lacker, B., Hansen, S., Higley, K., Bouchard, H., Gruson, A., & Mehrotra, R. (2018) · Proceedings of the 12th ACM Conference on Recommender Systems · doi:10.1145/3240323.3240354 · Cited by 151
Deep relaxation: partial differential equations for optimizing deep neural networks
Chaudhari, P., Oberman, A. M., Osher, S., Soatto, S., & Carlier, G. (2018) · Research in the Mathematical Sciences · doi:10.1007/s40687-018-0148-y · Cited by 147
Evaluating the Robustness of Neural Networks: An Extreme Value Theory Approach
Weng, T.-W., Zhang, H., Chen, P., Yi, J., Su, D., Gao, Y., Hsieh, C., & Daniel, L. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1801.10578 · Cited by 147
Wang, J., & Joshi, G. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1808.07576 · Cited by 146
Joint Link Adaptation and Scheduling for 5G Ultra-Reliable Low-Latency Communications
Pocovi, G., Pedersen, K. I., & Mogensen, P. (2018) · IEEE Access · doi:10.1109/access.2018.2838585 · Cited by 144
Supporting Very Large Models using Automatic Dataflow Graph Partitioning
Wang, M., Huang, C.-C., & Li, J. (2019) · Proceedings of the Fourteenth EuroSys Conference 2019 · doi:10.1145/3302424.3303953 · Cited by 141
Generalized Gaussian Mechanism for Differential Privacy
Liu, F. (2019) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2018.2845388 · Cited by 139
Steps Toward Robust Artificial Intelligence
Dietterich, T. G. (2017) · AI Magazine · doi:10.1609/aimag.v38i3.2756 · Cited by 139 · cited 1×
“Unfortunately, such a one-time training process is vulnerable to initially unmodeled phenomena, as it is practically impossible to enumerate all preconditions and ensuing consequences, referred to as qualification and ramification problems, respectively [82].”
BackgroundCommunications and Control for Wireless Drone-Based Antenna Array
Mozaffari, M., Saad, W., Bennis, M., & Debbah, M. A. (2018) · IEEE Transactions on Communications · doi:10.1109/tcomm.2018.2871453 · Cited by 139
Self-citationProactive edge computing in latency-constrained fog networks
Elbamby, M. S., Bennis, M., & Saad, W. (2017) · European Conference on Networks and Communications · doi:10.1109/eucnc.2017.7980678 · Cited by 134
Self-citationOne-Bit OFDM Receivers via Deep Learning
Balevi, E., & Andrews, J. G. (2019) · IEEE Transactions on Communications · doi:10.1109/tcomm.2019.2903811 · Cited by 133
Large scale distributed neural network training through online distillation
Anil, R., Pereyra, G., Passos, A., Ormandi, R., Dahl, G. E., & Hinton, G. E. (2018) · arXiv · doi:10.48550/arxiv.1804.03235 · Cited by 129
Deep Multi-User Reinforcement Learning for Dynamic Spectrum Access in Multichannel Wireless Networks
Naparstek, O., & Cohen, K. (2017) · Globecom · doi:10.1109/glocom.2017.8254101 · Cited by 127
MmWave Vehicular Beam Selection With Situational Awareness Using Machine Learning
Wang, Y., Klautau, A., Ribero, M., Soong, A. C. K., & Heath, R. W. (2019) · IEEE Access · doi:10.1109/access.2019.2922064 · Cited by 126
Sharp Minima Can Generalize For Deep Nets
Dinh, L., Pascanu, R., Bengio, S., & Bengio, Y. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1703.04933 · Cited by 125
Semantic-Effectiveness Filtering and Control for Post-5G Wireless Connectivity
Popovski, P., Simeone, O., Boccardi, F., Gündüz, D., & Sahin, O. (2020) · Journal of the Indian Institute of Science · doi:10.1007/s41745-020-00165-6 · Cited by 125
A Regularization Approach to Learning Task Relationships in Multitask Learning
Zhang, Y., & Yeung, D. (2014) · ACM Transactions on Knowledge Discovery from Data · doi:10.1145/2538028 · Cited by 123
Robust Control of Mobility and Communications in Autonomous Robot Teams
Fink, J., Ribeiro, A., & Kumar, V. R. (2013) · IEEE Access · doi:10.1109/access.2013.2262013 · Cited by 123
Data-dependent PAC-Bayes priors via differential privacyPreprint
Dziugaite, G. K., & Roy, D. M. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1802.09583 · Cited by 120
Faster gaze prediction with dense networks and Fisher pruning
Theis, L., Korshunova, I., Tejani, A., & Huszár, F. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1801.05787 · Cited by 117
Knowledge Transfer with Jacobian MatchingPreprint
Srinivas, S., & Fleuret, F. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1803.00443 · Cited by 116
Joint computation and communication cooperation for mobile edge computing
Cao, X., Wang, F., Xu, J., Zhang, R., & Cui, S. R. (2018) · International Symposium on Modeling and Optimization in Mobile, Ad Hoc, and Wireless Networks (WiOpt) · doi:10.23919/wiopt.2018.8362865 · Cited by 115
Park, J., Kim, S., & Zander, J. (2016) · IEEE Transactions on Wireless Communications · doi:10.1109/twc.2016.2540626 · Cited by 111
Self-citationCollaborative Deep Learning in Fixed Topology Networks
Jiang, Z., Balu, A., Hegde, C., & Sarkar, S. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1706.07880 · Cited by 110
Opportunistic Spatial Preemptive Scheduling for URLLC and eMBB Coexistence in Multi-User 5G Networks
Esswie, A. A., & Pedersen, K. I. (2018) · IEEE Access · doi:10.1109/access.2018.2854292 · Cited by 107
Towards Understanding Generalization of Deep Learning: Perspective of Loss Landscapes
Wu, L., Zhu, Z., & Weinan, E. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1706.10239 · Cited by 105
MmWave Beam Prediction with Situational Awareness: A Machine Learning Approach
Wang, Y., Narasimha, M., & Heath, R. W. (2018) · IEEE International Workshop on Signal Processing Advances in Wireless Communications (SPAWC) · doi:10.1109/spawc.2018.8445969 · Cited by 103
Smith, V., Chiang, C.-K., Sanjabi, M., & Talwalkar, A. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1705.10467 · Cited by 101
On-Device Federated Learning via Blockchain and its Latency Analysis.
Kim, H., Park, J., Bennis, M., & Kim, S. (2018) · Cited by 99
Self-citationMulti-Generator Generative Adversarial NetsPreprint
Hoang, Q., Nguyen, T. D., Le, T., & Phung, D. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1708.02556 · Cited by 97
A Scalable Near-Memory Architecture for Training Deep Neural Networks on Large In-Memory Datasets
Schuiki, F., Schaffner, M., Gürkaynak, F. K., & Benini, L. (2018) · IEEE Transactions on Computers · doi:10.1109/tc.2018.2876312 · Cited by 86
How to scale distributed deep learning?
Jin, P. H., Yuan, Q., Iandola, F., & Keutzer, K. (2016) · arXiv · doi:10.48550/arxiv.1611.04581 · Cited by 85 · cited 3×
“The communication among devices can be enabled by a push–pull gossip algorithm [104] or by following a predefined communication network topology [105], [106].”
BackgroundMethodMachine learning for improved diagnosis and prognosis in healthcare
Maity, N. G., & Das, S. (2017) · IEEE Aerospace Conference (AERO) · doi:10.1109/aero.2017.7943950 · Cited by 83
Caveats for information bottleneck in deterministic scenariosPreprint
Kolchinsky, A., Tracey, B., & Kuyk, S. V. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1808.07593 · Cited by 83
A Statistical Learning Approach to Ultra-Reliable Low Latency Communication
Angjelichinoski, M., Trillingsgaard, K. F., & Popovski, P. (2019) · IEEE Transactions on Communications · doi:10.1109/tcomm.2019.2907241 · Cited by 82
Deep Model Compression: Distilling Knowledge from Noisy Teachers
Sau, B. B., & Balasubramanian, V. N. (2016) · Research Archive of Indian Institute of Technology Hyderabad (Indian Institute of Technology Hyderabad) · doi:10.48550/arxiv.1610.09650 · Cited by 81
Adaptive Federated Learning in Resource Constrained Edge Computing SystemsPreprint
Wang, S., Tuor, T., Salonidis, T., et al. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1804.05271 · Cited by 80
Massive Autonomous UAV Path Planning: A Neural Network Based Mean-Field Game Theoretic Approach
Shiri, H., Park, J., & Bennis, M. (2019) · Globecom · doi:10.1109/globecom38437.2019.9013181 · Cited by 80
Self-citationEdge computing meets millimeter-wave enabled VR: Paving the way to cutting the cord
Elbamby, M. S., Perfecto, C., Bennis, M., & Doppler, K. (2018) · IEEE Wireless Communications and Networking Conference · doi:10.1109/wcnc.2018.8377419 · Cited by 79
Self-citationRebato, M., Park, J., Popovski, P., de Carvalho, E., & Zorzi, M. (2019) · IEEE Transactions on Communications · doi:10.1109/tcomm.2019.2895850 · Cited by 78
Self-citationRalaivola, L., Szafranski, M., & Stempfel, G. (2009) · arXiv (Cornell University) · doi:10.48550/arxiv.0909.1933 · Cited by 76
Multi-agent reinforcement learning
Stanković, M. S. (2016) · Symposium on Neural Networks and Applications (NEUREL) · doi:10.1109/neurel.2016.7800108 · Cited by 72
Wasserstein Training of Restricted Boltzmann Machines
Montavon, G., Müller, K. R., & Cuturi, M. (2016) · neural information processing systems · Cited by 71
Optimizing the CVaR via Sampling
Tamar, A., Glassner, Y., & Mannor, S. (2015) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v29i1.9561 · Cited by 67
High-Accuracy Low-Precision Training
De, C., Leszczynski, M., Zhang, J., Marzoev, A., Aberger, C. R., Olukotun, K., & Ré, C. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1803.03383 · Cited by 67
A Joint Control–Communication Design for Reliable Vehicle Platooning in Hybrid Traffic
Liu, B., Jia, D., Lu, K., Ngoduy, D., Wang, J., & Wu, L. (2017) · IEEE Transactions on Vehicular Technology · doi:10.1109/tvt.2017.2702650 · Cited by 63
URLLC-eMBB Slicing to Support VR Multimodal Perceptions over Wireless Cellular Systems
Park, J., & Bennis, M. (2018) · Globecom · doi:10.1109/glocom.2018.8647208 · Cited by 62
Self-citationA survey on sentiment analysis by using machine learning methods
Peng, Y., & Chen, Y. (2017) · IEEE Information Technology, Networking, Electronic and Automation Control Conference (ITNEC) · doi:10.1109/itnec.2017.8284920 · Cited by 59
Generative Adversarial Estimation of Channel Covariance in Vehicular Millimeter Wave Systems
Li, X., Alkhateeb, A., & Tepedelenlioğlu, C. (2018) · Asilomar Conference on Signals, Systems and Computers (ACSSC) · doi:10.1109/acssc.2018.8645463 · Cited by 57
Ultra-Reliable Low-Latency Vehicular Networks: Taming the Age of Information Tail
Abdel-Aziz, M. K., Liu, C.-F., Samarakoon, S., Bennis, M., & Saad, W. (2018) · Globecom · doi:10.1109/glocom.2018.8647466 · Cited by 55
Self-citationElgabli, A., Khan, H., Krouka, M., & Bennis, M. (2019) · IEEE Symposium on Computers and Communications (ISCC) · doi:10.1109/iscc47284.2019.8969641 · Cited by 52
Self-citationMassive UAV-to-Ground Communication and its Stable Movement Control: A Mean-Field Approach
Kim, H., Park, J., Bennis, M., & Kim, S. (2018) · IEEE International Workshop on Signal Processing Advances in Wireless Communications (SPAWC) · doi:10.1109/spawc.2018.8445906 · Cited by 50
Self-citationLien, S., Hung, S.-C., Deng, D., & Wang, Y. J. (2017) · Globecom · doi:10.1109/glocom.2017.8254211 · Cited by 49
Ultra-Reliable Communication in 5G mmWave Networks: A Risk-Sensitive Approach
Vu, T. K., Bennis, M., Debbah, M. A., Latva‐aho, M., & Hong, C. S. (2018) · IEEE Communications Letters · doi:10.1109/lcomm.2018.2802902 · Cited by 45
Self-citationGADMM: Fast and Communication Efficient Framework for Distributed Machine Learning
Elgabli, A., Park, J., Bedi, A. S., Bennis, M., & Aggarwal, V. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1909.00047 · Cited by 42
Self-citationCommunication and Autonomous Control of Multi-UAV System in Disaster Response Tasks
Aljehani, M., & Inoue, M. (2017) · Smart innovation, systems and technologies · doi:10.1007/978-3-319-59394-4_12 · Cited by 39
Zhao, L., Chi, X., & Zhu, Y. (2018) · IEEE Internet of Things Journal · doi:10.1109/jiot.2018.2794614 · Cited by 39
Kagawa, T., Ono, F., Shan, L., Takizawa, K., Miura, R., Li, H.-B., Kojima, F., & Kato, S. (2017) · International Symposium on Wireless Personal Multimedia Communications (WPMC) · doi:10.1109/wpmc.2017.8301849 · Cited by 38
Face recognition using modified deep learning neural network
Aiman, U., & Vishwakarma, V. P. (2017) · International Conference on Computing, Communication and Networking Technologies (ICCCNT) · doi:10.1109/icccnt.2017.8203981 · Cited by 37
Dziugaite, G. K., & Roy, D. M. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1712.09376 · Cited by 37
Stability and generalization in structured prediction
London, B., Huang, B., & Getoor, L. C. (2016) · Journal of Machine Learning Research · Cited by 31
Geometry of Energy Landscapes and the Optimizability of Deep Neural Networks
Becker, S., Zhang, Y., & Lee, A. A. (2020) · Physical Review Letters · doi:10.1103/physrevlett.124.108301 · Cited by 31
GADMM: Fast and Communication Efficient Framework for Distributed Machine Learning
Elgabli, A., Park, J., Bedi, A. S., Bennis, M., & Aggarwal, V. (2020) · Own your potential (DEAKIN) · Cited by 29
Self-citationSignal space diversity aided dynamic multiplexing for eMBB and URLLC traffics
Wu, Z., Zhao, F., & Liu, X. (2017) · IEEE International Conference on Computer and Communications (ICCC) · doi:10.1109/compcomm.2017.8322772 · Cited by 29
Exploring Energy and Accuracy Tradeoff in Structure Simplification of Trained Deep Neural Networks
Zhang, B., Davoodi, A., & Hu, Y. H. (2018) · IEEE Journal on Emerging and Selected Topics in Circuits and Systems · doi:10.1109/jetcas.2018.2833383 · Cited by 28
Ultra-dense edge caching under spatio-temporal demand and network dynamics
Kim, H., Park, J., Bennis, M., Kim, S., & Debbah, M. A. (2017) · International Conference on Communications · doi:10.1109/icc.2017.7996764 · Cited by 27
Self-citationDistilling On-Device Intelligence at the Network Edge
Park, J., Wang, S., Elgabli, A., Oh, S., Jeong, E., Cha, H., Kim, H., Kim, S., & Bennis, M. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1908.05895 · Cited by 26
Self-citationFace Recognition with Convolutional Neural Networks and subspace learning
Wan, L., Na, L., Huo, H., & Fang, T. (2017) · International Conference on Image, Vision and Computing (ICIVC) · doi:10.1109/icivc.2017.7984551 · Cited by 24
Seo, H., Park, J., Bennis, M., & Choi, W. (2018) · IEEE International Symposium on Dynamic Spectrum Access Networks · doi:10.1109/dyspan.2018.8610467 · Cited by 20
Self-citationMulti-hop Federated Private Data Augmentation with Sample Compression
Jeong, E., Oh, S., Park, J., Kim, H., Bennis, M., & Kim, S. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1907.06426 · Cited by 17
Self-citationLakhanpal, S., Gupta, A. K., & Agrawal, R. K. (2015) · Cited by 17
Flow of Information in Feed-Forward Deep Neural NetworksPreprint
Khadivi, P., Tandon, R., & Ramakrishnan, N. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1603.06220 · Cited by 17
Networked control systems: Time delays and robust control design issues
Joelianto, E. (2011) · International Conference on Instrumentation, Control, and Automation (ICA) · doi:10.1109/ica.2011.6130121 · Cited by 17
Federated Reinforcement Distillation with Proxy Experience MemoryPreprint
Cha, H., Park, J., Kim, H., Kim, S., & Bennis, M. (2020) · doi:10.36227/techrxiv.12645497 · Cited by 15
Self-citationViterbi-based Pruning for Sparse Matrix with Fixed and High Index Compression Ratio
Lee, D., Ahn, D., Kim, T., Chuang, P., & Kim, J. (2018) · Open Access System for Information Sharing (Pohang University of Science and Technology) · Cited by 14
Extreme Value Theory for Open Set Classification -- GPD and GEV ClassifiersPreprint
Vignotto, E., & Engelke, S. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1808.09902 · Cited by 11
Research works printed but not linked: 30
- 2018, Apple iPhone Xs Max
- 2018, Snapdragon 845 Mobile Platform
- 2018, Comparison Chart
- oulu, 2018, 6G Flagship
- 2018, Cloud TPU
- panda, 2018, RDMA-Based Networking Technologies and Middleware for Next-Generation Clusters and Data Centers
- 2018, Architecture Specification
- 2016, Feasibility Study on New Services and Markets Technology Enablers Release-14
- 2017, Study on New Radio Access Technology Physical Layer Aspects Release-14
- 2018, Study on Scenarios and Requirements for Next Generation Access Technologies Release 14
- iwabuchi, 2018, Field experiments on 5G ultra-reliable low-latency communication (URLLC), NTT DoCoMo Tech J, 20, 14
- 2017, Minimum Requirements Related to Technical Performance for IMT-2020 Radio Interface(s)
- 2018, Google Pixel 3 XL
- 10.1109/glocom.2016.7842367 · doi:10.1109/glocom.2016.7842367
- 2016, Recommendations for NGMN KPIs and Requirements for 5G
- briman, 2018, Another Look at Alphago vs Lee Sedol The Power Angle
- goodfellow, 2016, Deep Learning
- 2018, Service Requirements for the 5G System Stage 1 Release-14
- chaudhari, 2017, Entropy-SGD: Biasing gradient descent into wide valleys, Proc ICLR, 1
- vepakomma, 2019, Reducing leakage in distributed deep learning for sensitive health data, Proc ICLR, 1
- nakamoto, 2018, Bitcoin A Peer-to-Peer Electronic Cash System
- 2017, Coverage Analysis of LTE-M Category-M1
- metz, 2018, Machine Learning Invades the Real World on Internet Balloons
- weisstein, 2018, Fractional Chromatic Number
- 2015, IMT vision—Framework and overall objectives of the future development of IMT for 2020 and beyond
- 2017, Study on New Radio Access Technology Radio Access Architecture and Interfaces Release-14
- elgabli, 2019, Communication-efficient decentralized machine learning framework for 5G and beyond, Proc Globecom, 1
- 2018, Intel Skylake X
- 2018, Intel SSD DC P3700 Review
- 2017, Augmented and Virtual Reality The First Wave of 5G Killer Apps
Cited by
Advances and Open Problems in Federated Learning
Kairouz, P., & McMahan, H. B. (2021) · Foundations and Trends in Machine Learning · doi:10.1561/2200000083 · Cited by 7,772
Self-citationA Vision of 6G Wireless Systems: Applications, Trends, Technologies, and Open Research Problems
Saad, W., Bennis, M., & Chen, M. (2020) · IEEE Network · doi:10.1109/mnet.001.1900287 · Cited by 4,985
Self-citationAdaptive Federated Learning in Resource Constrained Edge Computing Systems
Wang, S., Tuor, T., Salonidis, T., Leung, K. K., Makaya, C., He, T., & Chan, K. (2019) · IEEE Journal on Selected Areas in Communications · doi:10.1109/jsac.2019.2904348 · Cited by 2,232
Towards 6G wireless communication networks: vision, enabling technologies, and new paradigm shifts
You, X., Wang, C.-X., Huang, J., Gao, X., Zhang, Z., Wang, M., Huang, Y., Zhang, C., Jiang, Y., Wang, J., et al. (2021) · Science China Information Sciences · doi:10.1007/s11432-020-2955-6 · Cited by 2,027
Smart radio environments empowered by reconfigurable AI meta-surfaces: an idea whose time has come
Renzo, M. D., Debbah, M., Phan-Huy, D.-T., Zappone, A., Alouini, M.-S., Yuen, C., Sciancalepore, V., Alexandropoulos, G. C., Hoydis, J., Gacanin, H., et al. (2019) · EURASIP Journal on Wireless Communications and Networking · doi:10.1186/s13638-019-1438-9 · Cited by 1,717
Self-citation
Metadata
- Authors
- Park, J., Samarakoon, S., Bennis, M., & Debbah, M.
- Affiliations
- University of Oulu (FI)
- Université Paris-Saclay (FR)
- Venue
- Proceedings of the IEEE
- Published
- 2019-11
- Volume
- 107
- Issue
- 11
- Pages
- 2204-2239
- ISSN
- 0018-9219 (ISSN-L)
- 1558-2256
- OpenAlex
- W2904648777
- Cited by
- 92
- References
- 224
- Citations by year
- 2026: 8 · 2025: 2 · 2024: 6 · 2023: 10 · 2022: 13 · 2021: 8 · 2020: 29 · 2019: 16
- FWCI
- 9.03
- Type
- journal article
- Language
- en
- Open access
- green
- arxiv.org
- Licence
- Locations
- Proceedings of the IEEE (publishedVersion)
- arXiv (Cornell University) (submittedVersion)
- Figshare (submittedVersion, cc-by)
- arXiv (Cornell University)
- Funders
- Academy of Finland (294128)
- 6Genesis Flagship (318927)
- Kvantum Institute Strategic Project SAFARI
- Academy of Finland through the MISSION Project (319759)
- Artificial Intelligence for Mobile Wireless Systems AIMS project at the University of Oulu
- Topics
- Physical Sciences › Computer Science › Computer Networks and Communications › IoT and Edge/Fog Computing
- Physical Sciences › Computer Science › Artificial Intelligence › Privacy-Preserving Technologies in Data
- Physical Sciences › Computer Science › Computer Networks and Communications › Distributed Sensor Networks and Detection Algorithms
- Keywords
- edge machine learning, wireless networks, distributed learning, resource-constrained edge devices, 5G, federated learning, low-latency inference, autonomous systems, unmanned aerial vehicles, virtual and augmented reality
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.