Edge Intelligence: Paving the Last Mile of Artificial Intelligence With Edge Computing
Open accessAbstract
With the breakthroughs in deep learning, the recent years have witnessed a booming of artificial intelligence (AI) applications and services, spanning from personal assistant to recommendation systems to video/audio surveillance. More recently, with the proliferation of mobile computing and Internet of Things (IoT), billions of mobile and IoT devices are connected to the Internet, generating zillions bytes of data at the network edge. Driving by this trend, there is an urgent need to push the AI frontiers to the network edge so as to fully unleash the potential of the edge big data. To meet this demand, edge computing, an emerging paradigm that pushes computing tasks and services from the network core to the network edge, has been widely recognized as a promising solution. The resulted new interdiscipline, edge AI or edge intelligence (EI), is beginning to receive a tremendous amount of interest. However, research on EI is still in its infancy stage, and a dedicated venue for exchanging the recent advances of EI is highly desired by both the computer system and AI communities. To this end, we conduct a comprehensive survey of the recent research efforts on EI. Specifically, we first review the background and motivation for AI running at the network edge. We then provide an overview of the overarching architectures, frameworks, and emerging key technologies for deep learning model toward training/inference at the network edge. Finally, we discuss future research opportunities on EI. We believe that this survey will elicit escalating attentions, stimulate fruitful discussions, and inspire further research ideas on EI.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
10 of 54 cited sources checked · 4 supported · 0 flagged · accuracy not yet measured
- Premisecitation
Stamoulis et al. achieve an improvement by up to 6× in terms of minimum energy per image under accuracy constraints by casting adaptive DNN model selection as a hyperparameter optimization problem and using Bayesian optimization.
“Stamoulis et al. [106] cast the adaptive DNN model selection issue as a hyperparameter optimization problem by taking into account the accuracy and communication constraints imposed by the devices.Then, a Bayesian optimization (BO) is adopted to solve this problem, achieving an improvement by up to 6× in terms of minimum energy per image under accuracy constraints.”
Quote in the paperNot a substantial claim1 of 1 sources checked- cites [106] 106. D. Stamoulis et al., "Designing adaptive neural networks for energy-constrained image classification," in Proc. ACM ICCAD, 2018, Art. no. 23. source
- Premisecitation
The performance of transfer learning varies with architectures and transfer techniques.
“The result varies with architectures and transfer techniques.”
Quote in the paperSubstantial claim1 of 2 sources checked- cites [62] 62. R. Sharma, S. Biookaghazadeh, B. Li, and M. Zhao, "Are existing knowledge transfer techniques effective for deep learning with edge devices?" in Proc. IEEE Int. Conf. Edge Comput. (EDGE), Jul. 2018, pp. 42-49. source
- cites [44] 44. Q. Chen, Z. Zheng, C. Hu, D. Wang, and F. Liu, "Data-driven task allocation for multi-task transfer learning on the edge," in Proc. IEEE 39th Int. Conf. Distrib. Comput. Syst. (ICDCS), 2019. source
Section 5.2.2 (p. 6) reports accuracy for one architecture under different distributed-training conditions, but does not compare architectures or transfer-learning techniques. Section 6 (p. 6) calls studies of other DNN architectures future work. Searches for transfer learning and variation across architectures or transfer techniques found no passage addressing the claim. (LLM, conf=0.76)
Experimental — accuracy not yet measured
- Premisecitation
Cachier can increase responsiveness by 3× or more.
“Cachier can increase responsiveness by 3× or more.”
Quote in the paperNot a substantial claim1 of 1 sources checked- cites [93] 93. U. Drolia, K. Guo, J. Tan, R. Gandhi, and P. Narasimhan, "Cachier: Edge-caching for recognition applications," in Proc. IEEE ICDCS, Jun. 2017, pp. 276-286. source
The Results section discusses Edgent’s inference latency, but does not report a result for Cachier. Searches for “Cachier” and “responsiveness three times” found no passage supporting a 3× improvement. (LLM, conf=0.77)
Experimental — accuracy not yet measured
- Interpretationreasoning
Data generated at the network edge need AI to fully unlock their potential.
“Data Generated at the Network Edge Need AI to Fully Unlock Their Potential”
- Also stated in: § A. Motivation and Benefits of Edge Intelligence · boosted
“AI will be functionally necessary due to its ability to quickly analyze those huge data volumes and extract insights from them for high-quality decision making.”
Quote in the paperSubstantial claim - Also stated in: § A. Motivation and Benefits of Edge Intelligence · boosted
- Premisecitation
Cisco estimates that nearly 850 ZB will be generated by all people, machines, and things at the network edge by 2021.
“Cisco estimates that nearly 850 ZB will be generated by all people, machines, and things at the network edge by 2021 [3].”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [3] 3. Cisco Global Cloud Index: Forecast and Methodology, 2016-2021, White Paper. [Online]. Available: https://www.cisco.com/c/en/us/ solutions/collateral/service-provider/global- cloud-index-gci/white-paper-c11-738085.html
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- Premisecitation
Lin et al. [53] observe that 99.9% of the gradient exchange in distributed SGD (DSGD) are redundant.
“Lin et al. [53] observe that 99.9% of the gradient exchange in distributed SGD (DSGD) are redundant, which demonstrates the power of gradient compression.”
Quote in the paperSubstantial claim0 of 1 sources checked- cites [53] 53. Y. Lin, S. Han, H. Mao, Y. Wang, and W. J. Dally, "Deep gradient compression: Reducing the communication bandwidth for distributed training," 2017, arXiv:1712.01887. [Online]. Available: https://arxiv.org/abs/1712.01887 source
- Premisecitation
While preserving client's own privacy, the training loss can be reduced by sharing the models among clients, compared to training solely on their own inputs.
“Specifically, while preserving client's own privacy, the training loss can be reduced by sharing the models among clients, comparing to training solely on their own inputs.”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [46] 46. R. Shokri and V. Shmatikov, "Privacy-preserving deep learning," in Proc. 22nd ACM SIGSAC Conf. Comput. Commun. Secur., 2015, pp. 1310-1321. source
- Interpretationreasoning
Edge computing is able to prosper AI with richer data and application scenarios.
“Edge Computing Is Able to Prosper AI With Richer Data and Application Scenarios”
- Also stated in: § 2) Edge Computing Is Able to Prosper AI With Richer Data and Application Scenarios: · hedged
“edge computing is proposed to achieve low-latency data processing by sinking the computing capability from the cloud data center to the edge side, i.e., data generation source, which may enable AI processing with high performance.”
Quote in the paperSubstantial claim - Also stated in: § 2) Edge Computing Is Able to Prosper AI With Richer Data and Application Scenarios: · hedged
- Premisenone given
A flaw of [46] is that it does not consider unbalanced and nonindependent identical distribution (non-IID) data.
“A flaw of [46] is that it does not consider unbalanced and nonindependent identical distribution (non-IID) data.”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [46] 46. R. Shokri and V. Shmatikov, "Privacy-preserving deep learning," in Proc. 22nd ACM SIGSAC Conf. Comput. Commun. Secur., 2015, pp. 1310-1321. source
- Premisecitation
Big data have recently shifted in source from megascale cloud datacenters to increasingly widespread end devices such as mobile devices and Internet-of-Things devices.
“big data have recently gone through a radical shift of data source from the megascale cloud datacenters to the increasingly widespread end devices, e.g., mobile devices and Internetof-Things (IoT) devices.”
Quote in the paperSubstantial claim0 of 1 sources checked- cites [3] 3. Cisco Global Cloud Index: Forecast and Methodology, 2016-2021, White Paper. [Online]. Available: https://www.cisco.com/c/en/us/ solutions/collateral/service-provider/global- cloud-index-gci/white-paper-c11-738085.html
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- Premisecitation
Sparsified SGD with error compensation converges at the same rate as vanilla SGD.
“The analysis shows that this scheme converges at the same rate as vanilla SGD when equipped with error compensation (keeping track of accumulated errors in memory).”
Quote in the paperSubstantial claim0 of 1 sources checked- cites [55] 55. S. U. Stich, J.-B. Cordonnier, and M. Jaggi, "Sparsified sgd with memory," in Proc. Adv. Neural Inf. Process. Syst., 2018, pp. 4452-4463. source
- Premisereasoning
The control of updates aggregation frequency significantly influences the communication overhead.
“In this case, the control of updates aggregation frequency significantly influences the communication overhead.”
Quote in the paperSubstantial claim - Interpretationnone given
Increasing the computation of local updates on clients to decrease the number of rounds for training is impractical when the clients are under severe computation resources constraint.
“However, it is impractical when the clients are under severe computation resources constraint.”
Quote in the paperNot a substantial claim - Interpretationreasoning
As the level of EI goes higher, the amount and path length of data offloading reduce.
“As the level of EI goes higher, the amount and path length of data offloading reduce.”
Quote in the paperSubstantial claim - Interpretationreasoning
Edge computing can be popularized with AI applications.
“Edge Computing Can Be Popularized With AI Applications”
- Also stated in: § 4) Edge Computing Can Be Popularized With AI Applications: · boosted
“novel AI applications emerged from the sectors such as IIoT, intelligent robots, smart cities, and smart home will play a crucial role in the popularization of edge computing.”
Quote in the paperSubstantial claim - Also stated in: § 4) Edge Computing Can Be Popularized With AI Applications: · boosted
- Premisecitation
Global datacenter traffic will only reach 20.6 ZB by 2021.
“the global datacenter traffic will only reach 20.6 ZB by 2021.”
Quote in the paperSubstantial claim0 of 1 sources checked- cites [3] 3. Cisco Global Cloud Index: Forecast and Methodology, 2016-2021, White Paper. [Online]. Available: https://www.cisco.com/c/en/us/ solutions/collateral/service-provider/global- cloud-index-gci/white-paper-c11-738085.html
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- Interpretationreasoning
AI democratization requires edge computing as a key infrastructure.
“AI Democratization Requires Edge Computing as a Key Infrastructure”
- Also stated in: § 3) AI Democratization Requires Edge Computing as a Key · boosted
“edge computing is naturally a key enabler for ubiquitous AI.”
Quote in the paperNot a substantial claim - Also stated in: § 3) AI Democratization Requires Edge Computing as a Key · boosted
- Premisecitation
Deep gradient compression (DGC) compresses the gradient by 270-600× for a wide range of CNNs and RNNs.
“Based on this observation, Lin et al. propose deep gradient compression (DGC), which compresses the gradient by 270-600× for a wide range of CNNs and RNNs.”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [53] 53. Y. Lin, S. Han, H. Mao, Y. Wang, and W. J. Dally, "Deep gradient compression: Reducing the communication bandwidth for distributed training," 2017, arXiv:1712.01887. [Online]. Available: https://arxiv.org/abs/1712.01887 source
- Premisecitation
BlockFL works for a fully decentralized network, where the ML model can be trained without any central coordination even when some devices lack their own training data samples.
“BlockFL also works for a fully decentralized network, where the ML model can be trained without any central coordination even when some devices lack their own training data samples.”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [49] 49. H. Kim, J. Park, M. Bennis, and S.-L. Kim, "On-device federated learning via blockchain and its latency analysis," 2018, arXiv:1808.03949. [Online]. Available: https://arxiv.org/abs/ 1808.03949 source
- Interpretationreasoning
For large models, sending a full model or full model update back to the server in a typical round is likely to be the bottleneck due to unreliable network connections.
“For large models, this step is likely to be the bottleneck due to the unreliable network connections.”
Quote in the paperSubstantial claim - Premisecitation
For DNN models, running them with edge-cloud synergy can reduce both end-to-end latency and energy consumption compared with local execution.
“for DNN models, running them with edge-cloud synergy can reduce both the end-to-end latency and energy consumption when compared to the local execution approach.”
Quote in the paperSubstantial claim - Interpretationreasoning
Existing systems and frameworks have adopted different subsets of enabling techniques tailored to specific EI applications and requirements.
“Clearly, the existing systems and frameworks have adopted different subsets of enabling techniques tailored to specific EI applications and requirements.”
Quote in the paperNot a substantial claim - Premisecitation
Applying a differentially private mechanism on activations is feasible for outsourcing training tasks to untrusted edge servers.
“The proof in [58] guarantees that applying differentially private mechanism on activations is feasible for outsourcing training tasks to untrusted edge servers.”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [58] 58. Y. Mao, S. Yi, Q. Li, J. Feng, F. Xu, and S. Zhong, "A privacy-preserving deep learning approach for face recognition with edge computing," in Proc. USENIX, 2018.
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- Interpretationnone given
DNN splitting also works for dealing with the tremendous computation of DNN.
“When applying DNN splitting for privacy-preserving, it is remarkable that this technique also works for dealing with the tremendous computation of DNN.”
Quote in the paperNot a substantial claim - Interpretationcitation
Communication can be reduced by a factor of the dimension of the problem (sometimes even more) while still converging at the same rate.
“In other words, communication can be reduced by a factor of the dimension of the problem (sometimes even more) while still converging at the same rate.”
Quote in the paperSubstantial claim0 of 1 sources checked- cites [55] 55. S. U. Stich, J.-B. Cordonnier, and M. Jaggi, "Sparsified sgd with memory," in Proc. Adv. Neural Inf. Process. Syst., 2018, pp. 4452-4463. source
- Premisenone given
Computation latency is tightly dependent on the capability of the edge nodes.
“The computation latency is tightly dependent on the capability of the edge nodes.”
Quote in the paperNot a substantial claim - Premisecitation
Empirical measurements show that there is no single edge AI programming framework that can outperform other frameworks in all metrics.
“empirical measurements [115] show that there is no single winner that can outperform other frameworks in all metrics.”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [115] 115. X. Zhang, Y. Wang, and W. Shi, "pCAMP: Performance comparison of machine learning packages on the edges," in Proc. USENIX Workshop Hot Topics Edge Comput. (HotEdge), 2018. source
- Premisecitation
Shadow Puppets achieves a latency improvement of 5-10× by using a small-footprint DNN to generate hash codes.
“in Shadow Puppets [96], it uses a small-footprint DNN to generate hash codes to represent the input data and get a remarkable latency improvement of 5-10×.”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [96] 96. S. Venugopal, M. Gazzetti, Y. Gkoufas, and K. Katrinis, "Shadow puppets: Cloud-level accurate AI inference at the speed and economy of edge," in Proc. USENIX Workshop Hot Topics in Edge Comput. (HotEdge), 2018.
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- Premisenone given
For DNNs characterized by a directed acyclic graph rather than a chain, optimizing the model partition to minimize latency is NP-hard in general.
“For DNNs those are characterized by a directed acyclic graph (DAG) rather than a chain, optimizing the model partition to minimize the latency is proven to be NP-hard in general.”
Quote in the paperNot a substantial claim - Premisecitation
Extrapolation compression and difference compression both converge at the rate of O(1/√nT), matching the convergence rate for full precision, centralized training.
“The analysis on the two algorithms proves that both converge at the rate of O(1/ √ nT ), where n is the number of clients and T is the number of iterations, matching the convergence rate for full precision, centralized training.”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [56] 56. H. Tang, S. Gan, C. Zhang, T. Zhang, and J. Liu, "Communication compression for decentralized training," in Proc. Adv. Neural Inf. Process. Syst., 2018, pp. 7663-7673. source
- Premisecitation
GossipGrad reduces the overall communication complexity from Θ(log(p)) to O(1).
“GossipGrad reduces the overall communication complexity from Θ(log(p)) to O(1) and considers diffusion such that computing nodes exchange their updates (gradients) indirectly after every log(p) steps.”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [66] 66. J. Daily, A. Vishnu, C. Siegel, T. Warfel, and V. Amatya, "GossipGraD: Scalable deep learning using gossip communication based asynchronous gradient descent," 2018, arXiv:1803.05880. [Online]. Available: https://arxiv.org/ abs/1803.05880 source
- Premisecitation
MoDNN accelerates DNN model inference by 2.17-4.28× with two to four worker nodes.
“The experiment shows that with two to four worker nodes, MoDNN accelerates the DNN model inference by 2.17-4.28×.”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [85] 85. J. Mao, X. Chen, K. W. Nixon, C. Krieger, and Y. Chen, "MoDNN: Local distributed mobile computing system for deep neural network," in Proc. Design, Autom. Test Eur. Conf. Exhib. (DATE), 2017, pp. 1396-1401. source
- Premisecitation
Deep compression and Minerva combine weight pruning and data quantization to enable fast, low-power, and highly accurate DNN inference.
“both deep compression [71] and Minerva [74] combine weight pruning and data quantization to enable fast, low-power, and highly accurate DNN inference.”
Quote in the paperNot a substantial claim0 of 2 sources checked- cites [71] 71. S. Han, H. Mao, and W. J. Dally, "Deep compression: Compressing deep neural networks with pruning, trained quantization and Huffman coding," 2015, arXiv:1510.00149. [Online]. Available: https://arxiv.org/abs/1510.00149 source
- cites [74] 74. B. Reagen et al., "Minerva: Enabling low-power, highly-accurate deep neural network accelerators," ACM SIGARCH Comput. Archit. News, vol. 44, no. 3, pp. 267-278, 2016. source
- Rests on an assumption: Most existing efforts use a single compression technique.
- Premisereasoning
DNN splitting protects user privacy by transmitting partially processed data rather than raw data.
“DNN splitting protects user privacy by transmitting partially processed data rather than transmitting raw data.”
Quote in the paperSubstantial claim - Premisenone given
Training a DNN model is data-intensive because raw data or intermediate data must be transferred across the nodes.
“Training the DNN model is data-intensive since the raw data or intermediate data should be transferred across the nodes.”
Quote in the paperSubstantial claim - Interpretationreasoning
Systems based on centralized and hybrid architectures would implement more extra efforts in data privacy protection.
“For this reason, the systems based on these two architectures would implement more extra efforts in data privacy protection.”
Quote in the paperNot a substantial claim - Premisereasoning
A key challenge for distributed EI model training is the data privacy issue.
“In general, a key challenge for distributed EI model training is the data privacy issue.”
Quote in the paperSubstantial claim - Premisecitation
Arden achieves privacy protection by arbitrary data nullification and random noise addition.
“By arbitrary data nullification and random noise addition, Arden achieves privacy protection.”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [59] 59. J. Wang, J. Zhang, W. Bao, X. Zhu, B. Cao, and P. S. Yu, "Not just privacy: Improving performance of private deep learning in mobile cloud," in Proc. 24th ACM SIGKDD Int. Conf. Knowl. Discovery Data Mining, 2018, pp. 2407-2416. source
- Premisecitation
Glimpse achieves an acceleration of 1.6-5.5×.
“Glimpse achieves an acceleration of 1.6-5.5×.”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [92] 92. T. Y.-H. Chen, L. Ravindranath, S. Deng, P. Bahl, and H. Balakrishnan, "Glimpse: Continuous, real-time object recognition on mobile devices," in Proc. ACM Sensys, 2015. source
- Classified as probably not a substantial claim. 28
- May combine two claims. 27
Probably not a substantial claim: may not pass S3 (load-bearing).
PremisecitationVGG-16 requires 138 million weights and 15.5G MACs to classify an image of size 224 × 224.
“VGG-16 [19] is trained to a deeper structure of 16 layers consisting of 13 convolution layers and three fully connected layers, requiring 138 million weights and 15.5G MACs to classify the image with a size of 224 × 224.”
Quote in the paperNot a substantial claim1 of 1 sources checked- cites [19] 19. K. Simonyan and A. Zisserman, "Very deep convolutional networks for large-scale image recognition," 2014, arXiv:1409.1556. [Online]. Available: https://arxiv.org/abs/1409.1556 source
Table 1 (p. 3) identifies configuration D as a 16-weight-layer network with a 224 × 224 RGB input, and Table 2 (p. 3) lists 138 million parameters for D. Section 2.1 (p. 2) describes the three fully connected layers. Our copy does not report the claimed 15.5G MACs per image, so that part is unsupported. (LLM, conf=0.88)
Experimental — accuracy not yet measured
Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.
PremisecitationFedCS allows the centralized server to aggregate as many client updates as possible and to accelerate performance improvement in ML models.
“In particular, an update aggregation protocol named FedCS is developed to allow the centralized server to aggregate as many client updates as possible and to accelerate performance improvement in ML models.”
Quote in the paperNot a substantial claim1 of 1 sources checked- cites [52] 52. T. Nishio and R. Yonetani, "Client selection for federated learning with heterogeneous resources in mobile edge," 2018, arXiv:1804.08333. [Online]. Available: https://arxiv.org/abs/ 1804.08333 source
The Introduction (p. 2) describes pruning, quantization, and Huffman coding, while §6.3 (pp. 9–10) discusses inference speedups from compression. Searches for FedCS, client-update aggregation, and federated client selection found no passage addressing the claimed protocol or its effect on model improvement. (LLM, conf=0.76)
Experimental — accuracy not yet measured
Probably not a substantial claim: may not pass S3 (load-bearing).
PremisereasoningThe optimization in [45] emphasizes the properties of unbalanced and non-IID since the distributed data may come from various sources.
“The optimization in [45] emphasizes the properties of unbalanced and non-IID since the distributed data may come from various sources.”
Quote in the paperNot a substantial claim1 of 1 sources checked- cites [45] 45. H. B. McMahan, E. Moore, D. Ramage, S. Hampson, and B. A. Y. Arcas, "Communication-efficient learning of deep networks from decentralized data," 2016, arXiv:1602.05629. [Online]. Available: https://arxiv.org/abs/1602.05629 source
May combine two claims.
PremisecitationMoving a tremendous amount of data across the wide area network can incur prohibitively high monetary cost and transmission delay, and privacy leakage can be a major concern.
“when moving a tremendous amount of data across the wide area network (WAN), both monetary cost and transmission delay can be prohibitively high, and the privacy leakage can also be a major concern [5].”
Quote in the paperSubstantial claim1 of 1 sources checked- cites [5] 5. Q. Pu et al., "Low latency geo-distributed data analytics," in Proc. ACM SIGCOMM, 2015, pp. 421-434. source
The Introduction and Section 6 (Advantages and disadvantages; page numbers unavailable) discuss generative models and their computational properties, not transferring large datasets over a WAN. Searches for WAN costs, transmission delay, and privacy leakage found no passage addressing the claim. (LLM, conf=0.75)
Experimental — accuracy not yet measured
May combine two claims.
PremisecitationPhysical proximity between computing and information-generation sources promises benefits compared with traditional cloud-based computing, including low latency, energy efficiency, privacy protection, reduced bandwidth consumption, on-premises operation, and context awareness.
“the physical proximity between the computing and information-generation sources promises several benefits compared to the traditional cloud-based computing paradigm, including low latency, energy efficiency, privacy protection, reduced bandwidth consumption, on-premises, and context awareness [6], [8].”
Quote in the paperSubstantial claim1 of 2 sources checked- cites [6] 6. W. Shi, J. Cao, Q. Zhang, Y. Li, and L. Xu, "Edge computing: Vision and challenges," IEEE Internet Things J., vol. 3, no. 5, pp. 637-646, Oct. 2016. source
- cites [8] 8. Y. Mao, C. You, J. Zhang, K. Huang, and K. B. Letaief, "A survey on mobile edge computing: The communication perspective," IEEE Commun. Surveys Tuts., vol. 19, no. 4, pp. 2322-2358, 4th Quart., 2017. source
May combine two claims.
PremisecitationA good performance improvement is obtained by transferring knowledge from both the intermediate layers and last layer of the teacher to a shallower student, while other architectures and transfer techniques do not fare so well and some even lead to negative performance impact.
“A good performance improvement is obtained by transferring knowledge from both the intermediate layers and last layer of the teacher to a shallower student while other architectures and transfer techniques do not fare so well and some of them even lead to negative performance impact.”
Quote in the paperSubstantial claim1 of 2 sources checked- cites [62] 62. R. Sharma, S. Biookaghazadeh, B. Li, and M. Zhao, "Are existing knowledge transfer techniques effective for deep learning with edge devices?" in Proc. IEEE Int. Conf. Edge Comput. (EDGE), Jul. 2018, pp. 42-49. source
- cites [44] 44. Q. Chen, Z. Zheng, C. Hu, D. Wang, and F. Liu, "Data-driven task allocation for multi-task transfer learning on the edge," in Proc. IEEE 39th Int. Conf. Distrib. Comput. Syst. (ICDCS), 2019. source
Split into 2 atoms — 0 confirmed, 0 partially supported, 0 disputed, 0 misattributed, 2 unverifiable. Expand the claim to see per-atom verdicts.
Experimental — accuracy not yet measured
Probably not a substantial claim: may not pass S3 (load-bearing).
PremisecitationGossip averaging can fast converge toward a consensus among nodes by exchanging information peer to peer.
“The early work on random gossip algorithms is gossip averaging [63], which can fast converge toward a consensus among nodes by exchanging information peer to peer.”
Quote in the paperNot a substantial claim1 of 1 sources checked- cites [63] 63. S. Boyd, A. Ghosh, B. Prabhakar, and D. Shah, "Randomized gossip algorithms," IEEE Trans. Inf. Theory, vol. 52, no. 6, pp. 2508-2530, Jun. 2006. source
May combine two claims.
PremisecitationThe control algorithm proposed by Wang et al. [51] is based on convergence analysis of distributed gradient descent and can be applied to federated learning in edge computing with provable convergence.
“The algorithm is based on the convergence analysis of distributed gradient descent and can be applied to federated learning in edge computing with provable convergence.”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [51] 51. S. Wang et al., "Adaptive federated learning in resource constrained edge computing systems," IEEE J. Sel. Areas Commun., vol. 37, no. 3, pp. 1205-1221, Jun. 2019.
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
May combine two claims.
InterpretationreasoningAs the level of EI goes higher, the transmission latency of data offloading decreases, data privacy increases, and WAN bandwidth cost reduces.
“As a result, the transmission latency of data offloading decreases, the data privacy increases, and the WAN bandwidth cost reduces.”
Quote in the paperSubstantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
Premisenone givenThe main challenges of federated learning are optimization and communication.
“The main challenges of federated learning are optimization and communication.”
Quote in the paperNot a substantial claimClassified as probably not a substantial claim. May combine two claims.
InterpretationreasoningEdge computing and AI complement each other from a technical perspective, and their application and popularization are mutually beneficial.
“While edge computing and AI complement each other from a technical perspective, their application and popularization are also mutually beneficial.”
Quote in the paperSubstantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
Premisenone givenFederated learning is built upon a central server for aggregating local updates.
“Though the federated learning technique exploits a new decentralized deep learning architecture, it is built upon a central server for aggregating local updates.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
PremisecitationGartner forecasts that more than 80% of enterprise IoT projects will include an AI component by 2022, up from only 10% today.
“As forecast by Gartner [33], more than 80% of enterprise IoT projects will include an AI component by 2022, up from only 10% today.”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [33] 33. AI Trends for Enterprise Computing. [Online]. Available: https://www.gartner.com/ smarterwithgartner/3-ai-trends-for-enterprise- computing/
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
May combine two claims.
InterpretationreasoningThere is no single best level of EI in general; the best level is application-dependent and should be determined by jointly considering multiple criteria such as latency, energy efficiency, privacy, and WAN bandwidth cost.
“This conflict indicates that there is no”
Quote in the paperSubstantial claimProbably not a substantial claim: may not pass S3 (load-bearing), S4 (based).
Premisenone givenEnergy efficiency is mainly affected by the size of the target training model and resources of the used devices.
“Energy efficiency is mainly affected by the size of the target training model and resources of the used devices.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.
PremisecitationResNet reaches human-level accuracy with a top-5 error rate below 5%.
“ResNet [20], the state-of-the-art effort, uses the”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [20] 20. K. He, X. Zhang, S. Ren, and J. Sun, "Deep residual learning for image recognition," in Proc. IEEE CVPR, Jun. 2016, pp. 770-778. source
Probably not a substantial claim: may not pass S3 (load-bearing).
PremisecitationReal-time video analytics is envisioned to be a killer application for edge computing.
“real-time video analytics is envisioned to be a killer application for edge computing [12], [37], [38].”
Quote in the paperNot a substantial claim0 of 3 sources checked- cites [12] 12. G. Ananthanarayanan et al., "Real-time video analytics: The killer app for edge computing," Computer, vol. 50, no. 10, pp. 58-67, 2017. source
- cites [37] 37. H. Zhang, G. Ananthanarayanan, P. Bodik, M. Philipose, P. Bahl, and M. J. Freedman, "Live video analytics at scale with approximation and delay-tolerance," in Proc. USENIX NSDI, 2017, pp. 377-392.
- cites [38] 38. C.-C. Hung et al., "VideoEdge: Processing camera streams using hierarchical clusters," in Proc. IEEE/ACM Symp. Edge Comput. (SEC), Oct. 2018, pp. 115-131. source
Probably not a substantial claim: may not pass S3 (load-bearing).
PremisecitationAlexNet requires 61 million weights and 724 million MACs to classify an image of size 227 × 227.
“AlexNet requires 61 million weights and 724 million MACs (multiply-add computation) to classify the image with a size of 227 × 227.”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [18] 18. A. Krizhevsky, I. Sutskever, and G. E. Hinton, "Imagenet classification with deep convolutional neural networks," in Proc. NIPS, 2012, pp. 1097-1105.
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
May combine two claims.
PremisecitationGaia focuses on geodistributed datacenters that are capacity-unlimited, making it not generally applicable to edge computing nodes whose capacity is highly constrained.
“However, Gaia focuses on geodistributed datacenters that are capacity-unlimited, making it is not generally applicable to edge computing nodes whose capacity is highly constrained.”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [50] 50. K. Hsieh, A. Harlap, N. Vijaykumar, D. Konomis, G. R. Ganger, and P. B. Gibbons, "Gaia: Geo-distributed machine learning approaching LAN speeds," in Proc. NSDI, 2017, pp. 629-647.
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based).
Premisenone givenUnder decentralized training mode, the convergence value depends on the way the gradient is synchronized and updated.
“Under the decentralized training mode, the convergence value depends on the way the gradient is synchronized and updated.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing), S4 (based).
Premisenone givenWhen training a DNN model using data originated at massive end devices, raw or intermediate data should be transferred out of the end devices.
“When training the DNN model by using the data originated at a massive of end devices, the raw data or intermediate data should be transferred out of the end devices.”
Quote in the paperNot a substantial claimMay combine two claims.
InterpretationreasoningDeep learning represents state-of-the-art AI technology and is a highly resource-demanding workload that naturally suits edge computing.
“Deep learning represents the state-of-the-art AI technology as well as a highly resource-demanding workload that naturally suits for edge computing.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S4 (based). May combine two claims.
Premisenone givenWhen training a DNN model in a decentralized manner, both computation and communication processes consume enormous energy.
“When training the DNN model in a decentralized manner, both the computation and communication processes consume enormous energy.”
Quote in the paperNot a substantial claim- Rests on an assumption: For most end devices, they are energy-constrained.
May combine two claims.
InterpretationreasoningAs the level of EI goes higher, computational latency and energy consumption increase.
“However, this is achieved at the cost of increased computational latency and energy consumption.”
Quote in the paperSubstantial claimMay combine two claims.
PremisecitationGoogleNet achieves better accuracy than VGG-16 while requiring seven million weights and 1.43G MACs to process an image of the same size.
“GoogleNet achieves a better accuracy performance than VGG-16, while only requiring seven million weights and 1.43G MACs to process the image with the same size.”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [28] 28. C. Szegedy et al., "Going deeper with convolutions," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., Jun. 2015, pp. 1-9. source
Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.
PremisecitationMeDNN improves DNN model inference by 1.86-2.44× with two to four worker nodes and saves 26.5% of additional computing time and 14.2% of extra communication time.
“MeDNN improves the DNN model inference by 1.86-2.44×with two to four worker nodes and saves 26.5% of additional computing time and 14.2% of extra communication time.”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [84] 84. J. Mao et al., "MeDNN: A distributed mobile system with enhanced partition and deployment for large-scale DNNs," in Proc. 36th Int. Conf. Comput.-Aided Design, Nov. 2017, pp. 751-756. source
Probably not a substantial claim: may not pass S3 (load-bearing).
PremisereasoningCommunication overhead is affected by the size of the original input data, the way of transmission, and the available bandwidth.
“Communication overhead is affected by the size of the original input data, the way of transmission, and the available bandwidth.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.
InterpretationreasoningThe high-dimensional configuration problem involves a huge search space of parameters and is very challenging to tackle due to its combinatorial nature.
“Due to the combinatorial nature, the high-dimensional configuration problem involves a huge search space of parameters and is very challenging to tackle.”
Quote in the paperNot a substantial claim- Rests on an assumption: Standard performance indicators such as top-k accuracy or mean average precision fail to reflect the runtime performance of DNN model inference on edge devices.
May combine two claims.
Premisenone givenData parallelism may bring heavy overhead of communication, while model parallelism usually leads to severe underutilization of computation resources.
“However, data parallelism may bring heavy overhead of communication, while model parallelism usually leads to severe underutilization of computation resources.”
Quote in the paperNot a substantial claimMay combine two claims.
PremisecitationPipeDream shows the advantage of reducing communication overhead and utilizing computing resource efficiently.
“PipeDream shows the advantage of reducing communication overhead and utilizing computing resource efficiently.”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [61] 61. A. Harlap, D. Narayanan, A. Phanishayee, V. Seshadri, G. R. Ganger, and P. B. Gibbons, "PipeDream: Fast and efficient pipeline parallel DNN training," 2018, arXiv:1806.03377. [Online]. Available: https://arxiv.org/abs/1806.03377 source
Probably not a substantial claim: may not pass S3 (load-bearing).
PremisereasoningCommunication latency may vary with the size of transmitted raw or intermediate data and the bandwidth of the network connection.
“The communication latency may vary from the size of transmitted raw or intermediate data and the bandwidth of network connection.”
Quote in the paperNot a substantial claimMay combine two claims.
PremisecitationBy deployment on large-scale systems, trivial gossip-based algorithms at scale lead to a communication imbalance, poor convergence, and heavy communication overhead.
“By deployment on large-scale systems, Daily et al. [66] show that the trivial gossip-based algorithms at scale lead to a communication imbalance, poor convergence, and heavy communication overhead.”
Quote in the paperSubstantial claim0 of 1 sources checked- cites [66] 66. J. Daily, A. Vishnu, C. Siegel, T. Warfel, and V. Amatya, "GossipGraD: Scalable deep learning using gossip communication based asynchronous gradient descent," 2018, arXiv:1803.05880. [Online]. Available: https://arxiv.org/ abs/1803.05880 source
May combine two claims.
PremisecitationFoggyCache reduces computation latency and energy consumption by a factor of 3× to 10×.
“FoggyCache reduces computation latency and energy consumption by a factor of 3× to 10×.”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [95] 95. P. Guo, B. Hu, R. Li, and W. Hu, "FoggyCache: Cross-device approximate computation reuse," in Proc. ACM Mobicom, 2018, pp. 19-34. source
Probably not a substantial claim: may not pass S3 (load-bearing).
PremisereasoningLatency is one of the most fundamental performance indicators of distributed DNN model training because it directly influences when the trained model is available for use.
“Arguably, latency is one of the most fundamental performance indicators of distributed DNN model training since it directly influences when the trained model is available for use.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S4 (based).
Premisenone givenA DNN model can be split inside between two successive layers with two partitions deployed on different locations without losing accuracy.
“This is based on the important observation that a DNN model can be split inside between two successive layers with two partitions deployed on different locations without losing accuracy.”
Quote in the paperNot a substantial claimMay combine two claims.
PremisecitationAdaDeep formulates goals and constraints on accuracy, latency, storage, and energy into a unified optimization problem and uses DRL to find a good combination of compression techniques.
“the proposed automatic optimization framework AdaDeep [75] systematically formulates the goals and constraints on accuracy, latency, storage, and energy into a unified optimization problem and leverages DRL to effectively find a good combination of compression techniques.”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [75] 75. S. Liu, Y. Lin, Z. Zhou, K. Nan, H. Liu, and J. Du, "On-demand deep model compression for mobile devices: A usage-driven model selection framework," in Proc. 16th Annu. Int. Conf. Mobile Syst., Appl., Services, 2018, pp. 389-400. source
May combine two claims.
InterpretationreasoningThe decentralized architecture is naturally friendly to user's privacy, for which systems based on the decentralized architecture such as BlockFL and GossipGraD typically preserve privacy better.
“The decentralized architecture is naturally friendly to user's privacy, for which the systems that are based on the decentralized architecture such as BlockFL and GossipGraD typically preserve privacy better.”
Quote in the paperNot a substantial claimMay combine two claims.
PremisereasoningCommunication overhead increases training latency, energy, and bandwidth consumption.
“Intuitively, this communication overhead increases the training latency, energy, and bandwidth consumption.”
Quote in the paperSubstantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
PremisecitationPrecog reaches a speedup of 5× by using predictions of Markov chains to prefetch data onto the mobile device.
“Precog uses predictions of Markov chains to prefetch data onto the mobile device and reach a speedup of 5×.”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [94] 94. U. Drolia, K. Guo, and P . Narasimhan, "Precog: Prefetching for image recognition applications at the edge," in Proc. ACM/IEEE Symp. Edge Comput. (SEC), Oct. 2017, p. 17. source
May combine two claims.
InterpretationreasoningCompared with DNN training under the cloud-based framework, DNN training under edge-based framework pays more attention to protecting users' privacy and training an available deep learning model faster.
“Compared with the DNN training under the cloud-based framework, the DNN training under edge-based framework pays more attention to protecting users' privacy and training an available deep learning model faster.”
Quote in the paperSubstantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
PremisereasoningThe latency of distributed training typically consists of computation latency and communication latency.
“The latency of the distributed training process typically consists of the computation latency and the communication latency.”
Quote in the paperNot a substantial claimMay combine two claims.
Premisenone givenBoth Blot et al. [64] and Jin et al. [65] apply gossip algorithms on the updates of SGD, but neither of them has performance convergence degradation at large scale.
“Both Blot et al. [64] and Jin et al. [65] apply gossip algorithms on the updates of SGD, but neither of them has performance convergence degradation at large scale.”
Quote in the paperNot a substantial claim0 of 2 sources checked- cites [64] 64. M. Blot, D. Picard, M. Cord, and N. Thome, "Gossip training for deep learning," 2016, arXiv:1611.09726. [Online]. Available: https://arxiv.org/abs/1611.09726 source
- cites [65] 65. P. H. Jin, Q. Yuan, F. Iandola, and K. Keutzer, "How to scale distributed deep learning?" 2016, arXiv:1611.04581. [Online]. Available: https://arxiv.org/abs/1611.04581 source
Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.
PremisecitationReXCam reduces computation workload by 4.6× and improves DNN model inference accuracy by 27%.
“ReXCam reduces computation workload by 4.6× and improves DNN model inference accuracy by 27%.”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [99] 99. S. Jain, J. Jiang, Y. Shu, G. Ananthanarayanan, and J. Gonzalez, "ReXCam: Resource-efficient, cross-camera video analytics at enterprise scale," 2018, arXiv:1811.01268. [Online]. Available: https://arxiv.org/abs/1811.01268 source
Probably not a substantial claim: may not pass S3 (load-bearing).
PremisecitationHuang et al. found a new combination of factors (number of proposals, input image size, and feature extractor) that outperforms the state-of-the-art method for object recognition.
“For the object recognition application, Huang et al. [120] investigate the influence of the main factors, e.g., number of proposals, input image size, and the selection of feature extractor, on inference speed and accuracy.Based on their experiment results, a new combination of these factors is found to outperform the state-of-the-art method.”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [120] 120. J. Huang et al., "Speed/accuracy trade-offs for modern convolutional object detectors," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit. (CVPR), Jul. 2017, pp. 7310-7311. source
- Rests on an assumption: Standard performance indicators such as top-k accuracy or mean average precision fail to reflect the runtime performance of DNN model inference on edge devices.
May combine two claims.
PremisecitationIONN significantly improves query performance and energy consumption during DNN model uploading compared to uploading the entire model.
“Compared to the approach that uploads the entire model, IONN significantly improves query performance and energy consumption during DNN model uploading.”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [82] 82. H.-J. Jeong, H.-J. Lee, C. H. Shin, and S.-M. Moon, "IONN: Incremental offloading of neural network computations from mobile devices to edge servers," in Proc. ACM Symp. Cloud Comput., 2018, pp. 401-411. source
Probably not a substantial claim: may not pass S3 (load-bearing).
PremisereasoningGossip distributed algorithms enjoy the advantage of full asynchronization and total decentralization as they have no requirement on centralized nodes or variables.
“The gossip distributed algorithms enjoy the advantage of full asynchronization and total decentralization as they have no requirement on centralized nodes or variables.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
PremisecitationThe cascading network achieves a speedup of 20% by adding the MP layer and fully connected layer to the standard DNN model.
“the cascading network [91] simply adds the MP layer and fully connected layer to the standard DNN model and achieves a speedup of 20%.”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [91] 91. S. Leroux et al., "The cascading neural network: Building the Internet of smart things," Knowl. Inf. Syst., vol. 52, no. 3, pp. 791-814, 2017.
Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based).
Premisenone givenTransfer learning tends to work if the features are general (suitable to both base and target tasks) instead of specific to the base task.
“This process will tend to work if the features are general (i.e., suitable to both base and target tasks) instead of specific to the base task.”
Quote in the paperNot a substantial claim
The paper relies on this without support.
There is a lack of a dedicated venue for summarizing, discussing, and disseminating recent advances of edge intelligence in both industry and academia.
“There is, in general, a lack of venue dedicated for summarizing, discussing, and disseminating the recent advances of EI, in both industrial and academia.”
The paper relies on this without support.
Research and practice on edge intelligence are still in a very early stage.
“Notably, research and practice on this emerging interdiscipline-EI-are still in a very early stage.”
The paper relies on this without support.
The edge ecosystem will present many novel application scenarios for AI and fuel the continuous booming of AI.
“Clearly, via bringing the huge volumes of data to AI, the edge ecosystem will present many novel application scenarios for AI and fuel the continuous booming of AI.”
The paper relies on this without support.
For most end devices, they are energy-constrained.
“However, for most end devices, they are energy-constrained.”
The paper relies on this without support.
It is inevitable to deal with privacy issues when raw or intermediate data are transferred out of end devices.
“Obviously, it is inevitable to deal with privacy issues in this scenario.”
The paper relies on this without support.
For some real-time intelligent mobile applications, they usually have stringent deadline requirement such as 100-ms latency.
“For some real-time intelligent mobile applications (e.g., AR/VR mobile gaming and intelligent robots), they usually have stringent deadline requirement such as 100-ms latency.”
The paper relies on this without support.
For some mobile applications requiring high reliability, they demand ultrahigh accuracy on DNN model inference.
“For some mobile applications requiring a high level of reliability, such as self-driving car and face authentication, they demand the ultrahigh accuracy on the DNN model inference.”
The paper relies on this without support.
Most existing efforts use a single compression technique.
“While most existing efforts use a single compression technique, they may not suffice to meet the diverse requirements and constraints on accuracy, latency, storage, and energy imposed by some IoT devices.”
The paper relies on this without support.
Standard performance indicators such as top-k accuracy or mean average precision fail to reflect the runtime performance of DNN model inference on edge devices.
“However, it is difficult for software developers to choose an appropriate DNN model for the EI application because the standard performance indicators such as top-k accuracy or mean average precision fail to reflect the runtime performance of DNN model inference on edge devices.”
The paper relies on this without support.
Most current edge AI programming/software platforms mainly serve as relays for connecting to cloud data centers.
“Nevertheless, currently, most of these platforms mainly serve as relays for connecting to the powerful cloud data centers.”
The paper relies on this without support.
Most deep learning-based AI models are highly resource-intensive.
“Most of the deep learning-based AI models are highly resourceintensive, which means that powerful computing capability supported by abundant hardware resources (e.g., GPU, field-programmable gate array (FPGA), and TPU) is important to boost the performance of these AI models.”
The paper relies on this without support.
For an EI application with a specific mission, there is usually a series of DNN model candidates that are capable of finishing the task.
“For an EI application with a specific mission, there is usually a series of DNN model candidates that are capable of finishing the task.”
The paper relies on this without support.
The service environments for many EI application scenarios are of high dynamics and it is hard to accurately predict future events.
“Since for many EI application scenarios (e.g., smart cities), the service environments are of high dynamics and it is hard to accurately predict future events.”
The paper relies on this without support.
The high-efficiency operation of EI services may require close collaboration and integration across different service providers.
“The high-efficiency operation of EI services may require close collaboration and integration across different service providers, e.g., for implementing expanded resource sharing and smooth service handover.”
The paper relies on this without support.
A user can be a service consumer and, meanwhile, a data generator as well.
“Also, for EI service, a user can be a service consumer and, meanwhile, a data generator as well.”
The paper relies on this without support.
There is a stringent need to push the AI frontier from the cloud to the network edge.
“Driving by flourishing of both AI and IoT, there is a stringent need to pushing the AI frontier from the cloud to the network edge.”
The paper relies on this without support.
Edge computing is widely recognized as a promising solution to support computation-intensive AI applications in resource-constrained environments.
“To fulfill this trend, edge computing has been widely recognized as a promising solution to support computation-intensive AI applications in resource-constrained environments.”
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
UAVs generate lots of data at the network edge, and directly sharing original data sets between many edge nodes has a high risk associated with it.
“Additionally, UAVs generate lots of data at the network edge and directly sharing original data sets between many edge nodes has a high risk associated with it [8].”
From A Survey on the Convergence of Edge Computing and AI for UAVs: Opportunities and Challenges (2022) · cites this paper as [8]
The Security and Privacy Issues section says end users and devices generate massive amounts of data at the network edge and that sharing original data sets among multiple edge nodes risks privacy leakage. It does not make that combined claim specifically about UAVs; its discussion of drones in the Input Filtering section concerns video transmission and bandwidth, not data-sharing privacy risk. (LLM, conf=0.86)
Experimental — accuracy not yet measuredEdge Intelligence (EI) proposes a new paradigm combining AI and edge computing, with the goal of performing distributed computing of DL models.
“Edge Intelligence (EI) Zhou et al. (2019) proposes a new paradigm combining AI and edge computing, with the goal of performing distributed computing of DL models.”
From Deepfakes: current and future trends (2024) · cites this paper as Zhou et al. 2019
Edge computing entails advantages such as low latency, energy and bandwidth efficiency, privacy protection, and context awareness.
“This entails some advantages such as low latency, energy and bandwidth efficiency, privacy protection, and context awareness (Zhou et al. 2019).”
From Deepfakes: current and future trends (2024) · cites this paper as Zhou et al. 2019
In edge computing environments where distributed models are trained locally and updates are aggregated centrally, control of updates aggregation frequency has a significant influence on communication overhead.
“In the case of training a deep learning model in an edge computing environment, where distributed models are trained locally first and then updates are aggregated centrally (e.g., federated learning), the control of updates aggregation frequency has a significant influence on the communication overhead.”
From A Survey on the Convergence of Edge Computing and AI for UAVs: Opportunities and Challenges (2022) · cites this paper as [8]
Edge AI provides a promising solution for connected intelligence by enabling data collection, processing, transmission, and consumption at the network edge.
“Edge AI provides a promising solution for connected intelligence by enabling data collection, processing, transmission, and consumption at the network edge [29], [30].”
From Edge artificial intelligence for 6g: vision, enabling technologies, and applications (2022) · cites this paper as [30]
Existing reviews of edge computing or edge intelligence only have a small fraction discussing edge DNN design, which is key to edge intelligence.
“All of these reviews only have a small fraction to discuss the edge DNN design which is the key element of edge intelligence systems.”
From Bringing ai to edge: from deep learning’s perspective (2022) · cites this paper as [13]
Smart city is another important application scenario for deep-learning-enabled edge computing.
“Smart city [113] is another important application scenario for deep-learning-enabled edge computing.”
From Deep learning for edge computing applications: A State-of-the-Art survey (2020) · cites this paper as [113]
Blockchain provides a high degree of privacy for health data.
“In the current scenario, Blockchain provides a high degree of privacy for health data [49].”
From 6G Communication Technology: A Vision on Intelligent Healthcare (2021) · cites this paper as [49]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
Each contradiction between two passages listed here was confirmed by an independent check.
Inference metrics are counted as five but six are listed
MinorThe section introduces five inference metrics, but its numbered list runs from latency through memory footprint and contains six.
“To describe the service quality of the EI model inference, we introduce the following five metrics.”
“## 6) Memory Footprint:”
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474 · see citing works
ImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155 · cited 7× · see citing works
“This is because for DNNs as exemplified by AlexNet, the energy of the convolutional layers dominates the total energy cost, while the number in the fully connected layers contributes most of the total number of weights in the DNN.”
BackgroundMethodInfluentialHochreiter, S., & Schmidhuber, J. (1997) · Neural Computation · doi:10.1162/neco.1997.9.8.1735 · Cited by 102,318 · cited 4× · see citing works
“4, each neuron in LSTM is called memory cell and includes a multiplicative forget gate, input gate, and output gate.”
BackgroundInfluentialLeCun, Y., Bengio, Y., & Hinton, G. (2015) · Nature · doi:10.1038/nature14539 · Cited by 84,126 · see citing works
Very Deep Convolutional Networks for Large-Scale Image Recognition
Simonyan, K., & Zisserman, A. (2014) · arXiv · doi:10.48550/arxiv.1409.1556 · Cited by 74,248 · cited 5× · see citing works
“GoogleNet achieves a better accuracy performance than VGG-16, while only requiring seven million weights and 1.43G MACs to process the image with the same size.”
BackgroundMethodInfluentialYou Only Look Once: Unified, Real-Time Object Detection
Redmon, J., Divvala, S., Girshick, R., & Farhadi, A. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.91 · Cited by 53,803 · see citing works
Going deeper with convolutions
Szegedy, C., Liu, W., Jia, Y., Sermanet, P., Reed, S., Anguelov, D., Erhan, D., Vanhoucke, V., & Rabinovich, A. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298594 · Cited by 48,562 · cited 2× · see citing works
“GoogleNet achieves a better accuracy performance than VGG-16, while only requiring seven million weights and 1.43G MACs to process the image with the same size.”
MethodLearning representations by back-propagating errors
Rumelhart, D. E., Hinton, G. E., & Williams, R. J. (1986) · Nature · doi:10.1038/323533a0 · Cited by 31,892 · cited 1× · see citing works
“Leveraging the backpropagation mechanism [26], [27], the error rate is propagated back across the whole neural network, and the weights are updated based on the gradient and the learning rate.”
(2016) · Cited by 31,590 · see citing works
Human-level control through deep reinforcement learning
Mnih, V., Kavukcuoglu, K., Silver, D., Rusu, A. A., Veness, J., Bellemare, M. G., Graves, A., Riedmiller, M., Fidjeland, A. K., Ostrovski, G., et al. (2015) · Nature · doi:10.1038/nature14236 · Cited by 30,357 · cited 2× · see citing works
“[32] V.”
SSD: Single Shot MultiBox Detector
Liu, W., Anguelov, D., Erhan, D., Szegedy, C., Reed, S., Fu, C.-Y., & Berg, A. C. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46448-0_2 · Cited by 22,128 · cited 3× · see citing works
“[24] W. Liu et al., “SSD: Single shot multibox detector,” in Proc.”
Labaca-Castro, R. (2023) · Springer eBooks · doi:10.1007/978-3-658-40442-0_9 · Cited by 21,100 · see citing works
GAN(Generative Adversarial Nets)
淳司, 柴. (2017) · Journal of Japan Society for Fuzzy Theory and Intelligent Informatics · doi:10.3156/jsoft.29.5_177_2 · Cited by 19,268 · see citing works
MobileNets: Efficient Convolutional Neural Networks for Mobile Vision Applications
Howard, A. G., Zhu, M., Chen, B., Kalenichenko, D., Wang, W., Weyand, T., Andreetto, M., & Adam, H. (2017) · arXiv · doi:10.48550/arxiv.1704.04861 · Cited by 19,015 · cited 4× · see citing works
“[21] A. G. Howard et al., “MobileNets: Efficient convolutional neural networks for mobile vision applications,” 2017, arXiv:1704.04861.”
BackgroundInfluentialCommunication-Efficient Learning of Deep Networks from Decentralized Data
McMahan, H. B., Moore, E., Ramage, D., Hampson, S., & Arcas, B. A. Y. (2016) · arXiv · doi:10.48550/arxiv.1602.05629 · Cited by 14,215 · cited 4× · see citing works
“[45] propose to increase the computation of local updates on clients.”
BackgroundMethodInfluentialEdge computing: Vision and challenges
Shi, W., Cao, J., Zhang, Q., Li, Y., & Xu, L. (2016) · IEEE Internet of Things Journal · doi:10.1109/jiot.2016.2579198 · Cited by 8,733 · cited 2× · see citing works
“Essentially, the physical proximity between the computing and information-generation sources promises several benefits compared to the traditional cloud-based computing paradigm, including low latency, energy efficiency, privacy protection, reduced bandwidth consumption, on-premises, and context awareness [6], [8].”
BackgroundNatural Language Processing (almost) from ScratchPreprint
Collobert, R., Weston, J., Bottou, L., Karlen, M., Kavukcuoglu, K., & Kuksa, P. P. (2011) · arXiv (Cornell University) · doi:10.48550/arxiv.1103.0398 · Cited by 6,882 · cited 1× · see citing works
“MLP models are the most basic DNN, which is composed of a series of fully connected layers [17].”
BackgroundLarge-Scale Machine Learning with Stochastic Gradient Descent
Bottou, L. (2010) · Proceedings of COMPSTAT'2010 · doi:10.1007/978-3-7908-2604-3_16 · Cited by 5,795 · cited 25× · see citing works
“Amiri and Gunduz [57] implement DSGD at the wireless edge with the help of a remote parameter server and further develop DSGD in digital and analog schemes, respectively.”
MethodInfluentialA Survey on Mobile Edge Computing: The Communication Perspective
Mao, Y., You, C., Zhang, J., Huang, K., & Letaief, K. B. (2017) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2017.2745201 · Cited by 5,607 · cited 1× · see citing works
“Essentially, the physical proximity between the computing and information-generation sources promises several benefits compared to the traditional cloud-based computing paradigm, including low latency, energy efficiency, privacy protection, reduced bandwidth consumption, on-premises, and context awareness [6], [8].”
BackgroundSelf-citationNeural Architecture Search with Reinforcement LearningPreprint
Zoph, B., & Le, Q. V. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1611.01578 · Cited by 5,091 · cited 1× · see citing works
“Instead of utilizing the existing resource-intensive AI models, we can leverage the AutoML idea [116] and the neural architecture search (NAS) techniques [117] to devise resource-efficient edge AI models tailored to the hardware resource constraints of the underlying edge devices and servers.”
MethodBackpropagation through time: what it does and how to do it
Werbos, P. J. (1990) · Proceedings of the IEEE · doi:10.1109/5.58337 · Cited by 4,879 · cited 2× · see citing works
“The training of RNN Vol. 107, No. 8, August 2019 | PROCEEDINGS OF THE IEEE 1741 is based on backpropagation through time (BPTT) [29].”
Han, S., Mao, H., & Dally, W. J. (2015) · arXiv · doi:10.48550/arxiv.1510.00149 · Cited by 4,662 · cited 2× · see citing works
“The follow-up work deep compression [71], which blends the advantages of pruning, weight sharing, and Huffman coding to compress DNNs, further pushes the compression ratio to 35–49×.”
BackgroundMethodEfficient Processing of Deep Neural Networks: A Tutorial and Survey
Sze, V., Chen, Y.-H., Yang, T.-J., & Emer, J. S. (2017) · Proceedings of the IEEE · doi:10.1109/jproc.2017.2761740 · Cited by 4,215 · cited 1× · see citing works
“Interested readers are encouraged to refer to the recent monograph [114] for more comprehensive discussions about recent advancements on hardware acceleration for DNN processing.”
BackgroundDeep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2015) · arXiv · doi:10.48550/arxiv.1512.03385 · Cited by 4,196 · see citing works
Federated Learning: Strategies for Improving Communication Efficiency
Konečný, J., McMahan, H. B., Yu, F. X., Richtárik, P., Suresh, A. T., & Bacon, D. (2016) · arXiv · doi:10.48550/arxiv.1610.05492 · Cited by 3,766 · cited 1× · see citing works
“[47] propose to reduce communication cost with two new update schemes, namely, structured update and sketched update.”
BackgroundThe case for vm-based cloudlets in mobile computing
Satyanarayanan, M., Bahl, P., Caceres, R., & Davies, N. (2009) · IEEE Pervasive Computing · doi:10.1109/mprv.2009.82 · Cited by 3,660 · cited 1× · see citing works
“To clear up the doubt, Microsoft has conducted continuous exploration on what kinds should be moved from the cloud to the edge since 2009 [35], ranging from voice command recognition, AR/VR, and interactive cloud gaming [36] to real-time video analytics.”
BackgroundDeep Learning: Methods and Applications
Deng, L., & Yu, D. (2014) · Foundations and Trends® in Signal Processing · doi:10.1561/2000000039 · Cited by 3,480 · cited 2× · see citing works
“, AlphaGo) and robotics [2].”
Speed/Accuracy Trade-Offs for Modern Convolutional Object Detectors
Huang, J., Rathod, V., Sun, C., Zhu, M., Korattikara, A., Fathi, A., Fischer, I., Wojna, Z., Song, Y., Guadarrama, S., et al. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.351 · Cited by 2,743 · cited 1× · see citing works
“[120] investigate the influence of the main factors, e.”
BackgroundBoyd, S., Ghosh, A., Prabhakar, B., & Shah, D. (2006) · IEEE Transactions on Information Theory · doi:10.1109/tit.2006.874516 · Cited by 2,439 · cited 1× · see citing works
“The early work on random gossip algorithms is gossip averaging [63], which can fast converge toward a consensus among nodes by exchanging information peer to peer.”
BackgroundPrivacy-preserving deep learning
Shokri, R., & Shmatikov, V. (2015) · Proceedings of the 22nd ACM SIGSAC Conference on Computer and Communications Security · doi:10.1145/2810103.2813687 · Cited by 2,356 · cited 3× · see citing works
“Shokri and Shmatikov [46] design a selective SGD (SSGD) protocol, allowing the clients to train independently on their own data sets and selectively share small subsets of their model’s key parameters to the centralized aggregator.”
BackgroundInfluentialAdaptive Federated Learning in Resource Constrained Edge Computing Systems
Wang, S., Tuor, T., Salonidis, T., Leung, K. K., Makaya, C., He, T., & Chan, K. (2019) · IEEE Journal on Selected Areas in Communications · doi:10.1109/jsac.2019.2904348 · Cited by 2,232 · cited 1× · see citing works
“[51] propose a control algorithm that determines the best tradeoff between the local update and global parameter aggregation under a given resource budget.”
BackgroundClient Selection for Federated Learning with Heterogeneous Resources in Mobile Edge
Nishio, T., & Yonetani, R. (2018) · arXiv · doi:10.48550/arxiv.1804.08333 · Cited by 1,875
Client Selection for Federated Learning with Heterogeneous Resources in Mobile Edge
Nishio, T., & Yonetani, R. (2019) · ICC 2019 - 2019 IEEE International Conference on Communications (ICC) · doi:10.1109/icc.2019.8761315 · Cited by 1,875 · see citing works
Deep Learning: Methods and Applications
Deng, L. (2014) · now publishers, Inc. eBooks · doi:10.1561/9781601988157 · Cited by 1,785 · see citing works
Introduction to multi-layer feed-forward neural networks
Svozil, D., Kvasnicka, V., & Pospichal, J. (1997) · Chemometrics and Intelligent Laboratory Systems · doi:10.1016/s0169-7439(97)00061-0 · Cited by 1,600 · cited 1× · see citing works
“Among the existing ML methods, deep learning, by leveraging artificial neural networks (ANNs) [16] to learn the deep representation of the data, has resulted in an amazing performance in multiple tasks, including image classification, face recognition, and so on.”
MethodGoing Deeper with Convolutions
Szegedy, C., Liu, W., Jia, Y., Sermanet, P., Reed, S., Anguelov, D., Erhan, D., Vanhoucke, V., & Rabinovich, A. (2014) · arXiv · doi:10.48550/arxiv.1409.4842 · Cited by 1,461 · see citing works
AMC: AutoML for Model Compression and Acceleration on Mobile Devices
He, Y., Lin, J., Liu, Z., Wang, H., Li, L.-J., & Han, S. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-01234-2_48 · Cited by 1,400 · cited 1× · see citing works
“Instead of utilizing the existing resource-intensive AI models, we can leverage the AutoML idea [116] and the neural architecture search (NAS) techniques [117] to devise resource-efficient edge AI models tailored to the hardware resource constraints of the underlying edge devices and servers.”
MethodBranchyNet: Fast inference via early exiting from deep neural networks
Teerapittayanon, S., McDanel, B., & Kung, H. T. (2016) · 2016 23rd International Conference on Pattern Recognition (ICPR) · doi:10.1109/icpr.2016.7900006 · Cited by 1,326 · cited 1× · see citing works
“BranchyNet [87] is a programming framework that implements the model early-exit mechanism.”
MethodEyeriss: a spatial architecture for energy-efficient dataflow for convolutional neural networks
Chen, Y.-H., Emer, J., & Sze, V. (2016) · ACM SIGARCH Computer Architecture News · doi:10.1145/3007787.3001177 · Cited by 1,182 · cited 1× · see citing works
“However, for energy-constrained end devices, the above magnitude-based weight pruning method may not be directly applicable since empirical measurements show that the reduction in the number of weights does not necessarily translate into significant energy saving [72].”
BackgroundDeep Gradient Compression: Reducing the Communication Bandwidth for Distributed Training
Lin, Y., Han, S., Mao, H., Wang, Y., & Dally, W. J. (2017) · arXiv · doi:10.48550/arxiv.1712.01887 · Cited by 1,134 · cited 1× · see citing works
“Inspired by [53], Tao and Li [54] propose edge SGD (eSGD), a family of sparse schemes with both convergence and practical performance guarantees.”
MethodIn-Edge AI: Intelligentizing Mobile Edge Computing, Caching and Communication by Federated Learning
Wang, X., Han, Y., Wang, C., Zhao, Q., Chen, X., & Chen, M. (2019) · IEEE Network · doi:10.1109/mnet.2019.1800286 · Cited by 1,030 · cited 1× · see citing works
“Indeed, the marriage of edge computing and AI has given rise to a new research area, namely, “edge intelligence (EI)” or “edge AI” [9], [10].”
BackgroundSelf-citationBlockchained On-Device Federated Learning
Kim, H., Park, J., Bennis, M., & Kim, S.-L. (2018) · arXiv · doi:10.48550/arxiv.1808.03949 · Cited by 882 · see citing works
Distributed Deep Neural Networks Over the Cloud, the Edge and End Devices
Teerapittayanon, S., McDanel, B., & Kung, H. T. (2017) · 2017 IEEE 37th International Conference on Distributed Computing Systems (ICDCS) · doi:10.1109/icdcs.2017.226 · Cited by 843 · cited 4× · see citing works
“DDNNs [88] N/A Cloud-Edge-Device Level-1 • Latency • Accuracy • Model selection N/A • Latency reduction: over 20×”
MethodInfluentialDesigning Energy-Efficient Convolutional Neural Networks Using Energy-Aware Pruning
Yang, T.-J., Chen, Y.-H., & Sze, V. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.643 · Cited by 732 · cited 1× · see citing works
“Based on this energy estimation tool, an energy-aware pruning method called EAP [73] is proposed.”
MethodNeurosurgeon: Collaborative Intelligence Between the Cloud and Mobile Edge
Kang, Y., Hauswald, J., Gao, C., Rovinski, A., Mudge, T., Mars, J., & Tang, L. (2017) · Proceedings of the Twenty-Second International Conference on Architectural Support for Programming Languages and Operating Systems · doi:10.1145/3037697.3037698 · Cited by 673 · cited 3× · see citing works
“For the model partition between the server and the device, Neurosurgeon [79] represents an iconic effort.”
BackgroundInfluentialMachine Learning at the Wireless Edge: Distributed Stochastic Gradient Descent Over-the-Air
Amiri, M., & Gündüz, D. (2019) · International Symposium on Information Theory · doi:10.1109/isit.2019.8849334 · Cited by 608 · see citing works
Eyeriss: A Spatial Architecture for Energy-Efficient Dataflow for Convolutional Neural Networks
Chen, Y., Emer, J., & Sze, V. (2016) · Proceedings - International Symposium on Computer Architecture/Proceedings · doi:10.1109/isca.2016.40 · Cited by 558 · see citing works
Machine Learning at the Wireless Edge: Distributed Stochastic Gradient Descent Over-the-Air
Mohammadi Amiri, M., & Gunduz, D. (2020) · IEEE Transactions on Signal Processing · doi:10.1109/tsp.2020.2981904 · Cited by 548 · see citing works
Large-Scale Machine Learning with Stochastic Gradient Descent
Bottou, L. (2011) · Chapman & Hall/CRC series in computer science & data analysis/Series in computer science and data analysis · doi:10.1201/b11429-4 · Cited by 540 · see citing works
Stich, S. U., Cordonnier, J.-B., & Jaggi, M. (2018) · arXiv · doi:10.48550/arxiv.1809.07599 · Cited by 508 · cited 1× · see citing works
“A concise convergence analysis of sparsified SGD is given in [55], where SGD is analyzed with k-sparsification or compression (e.”
MethodDeepThings: Distributed Adaptive Deep Learning Inference on Resource-Constrained IoT Edge Clusters
Zhao, Z., Barijough, K. M., & Gerstlauer, A. (2018) · IEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems · doi:10.1109/tcad.2018.2858384 · Cited by 502 · cited 2× · see citing works
“[86] Z. Zhao, K. M. Barijough, and A. Gerstlauer, “DeepThings: Distributed adaptive deep learning inference on resource-constrained IoT edge clusters,” IEEE Trans.”
MethodReal-Time Video Analytics: The Killer App for Edge Computing
Ananthanarayanan, G., Bahl, P., Bodik, P., Chintalapudi, K., Philipose, M., Ravindranath, L., & Sinha, S. (2017) · Computer · doi:10.1109/mc.2017.3641638 · Cited by 496 · cited 2× · see citing works
“By comparison, real-time video analytics is envisioned to be a killer application for edge computing [12], [37], [38].”
BackgroundTowards wearable cognitive assistance
Ha, K., Chen, Z., Hu, W., Richter, W., Pillai, P., & Satyanarayanan, M. (2014) · Proceedings of the 12th annual international conference on Mobile systems, applications, and services · doi:10.1145/2594368.2594383 · Cited by 476 · cited 1× · see citing works
“These efforts have boosted a wide spectrum of AI applications, spanning from live video analytics [12], cognitive assistance [13] to precision agriculture, smart home [14], and Industrial Internet of Things (IIoT) [15].”
BackgroundChameleon: scalable adaptation of video analytics
Jiang, J., Ananthanarayanan, G., Bodik, P., Sen, S., & Stoica, I. (2018) · Proceedings of the 2018 Conference of the ACM Special Interest Group on Data Communication · doi:10.1145/3230543.3230574 · Cited by 467 · see citing works
Deep Learning for Smart Industry: Efficient Manufacture Inspection System With Fog Computing
Li, L., Ota, K., & Dong, M. (2018) · IEEE Transactions on Industrial Informatics · doi:10.1109/tii.2018.2842821 · Cited by 466 · cited 2× · see citing works
“DeepIns [15] proposes a manufacture inspection system for the smart industry using DNN model early exit.”
BackgroundMethodMachine Learning at Facebook: Understanding Inference at the Edge
Wu, C.-J., Brooks, D. M., Chen, K., Chen, D., Choudhury, S., Dukhan, M., Hazelwood, K., Isaac, E., Jia, Y., Jia, B., et al. (2019) · IEEE International Symposium on High-Performance Computer Architecture (HPCA) · doi:10.1109/hpca.2019.00048 · Cited by 455 · cited 1× · see citing works
“On the other hand, unlike high-performance discrete GPUs on the cloud data center, there is no dedicated high-bandwidth memory for mobile GPUs on mobile devices [69].”
BackgroundDeepDecision: A Mobile Deep Learning Framework for Edge Video Analytics
Ran, X., Chen, H., Zhu, X., Liu, Z., & Chen, J. (2018) · IEEE INFOCOM 2018 - IEEE Conference on Computer Communications · doi:10.1109/infocom.2018.8485905 · Cited by 450 · cited 1× · see citing works
“DeepDecision [112] formulates the knob-tunning problem as a multiple-choice multiple-constraint knapsack program and solves it with an improved brute-force search method.”
MethodDeepX: A Software Accelerator for Low-Power Deep Learning Inference on Mobile Devices
Lane, N. D., Bhattacharya, S., Georgiev, P., Forlivesi, C., Jiao, L., Qendro, L., & Kawsar, F. (2016) · 2016 15th ACM/IEEE International Conference on Information Processing in Sensor Networks (IPSN) · doi:10.1109/ipsn.2016.7460664 · Cited by 450 · cited 3× · see citing works
“Model Compression • Weight pruning and quantization to reduce storage and computation [70]–[77]”
BackgroundMethodInfluentialMinerva: enabling low-power, highly-accurate deep neural network accelerators
Reagen, B., Whatmough, P., Adolf, R., Rama, S., Lee, H., Lee, S. K., Hernández-Lobato, J. M., Wei, G.-Y., & Brooks, D. (2016) · ACM SIGARCH Computer Architecture News · doi:10.1145/3007787.3001165 · Cited by 446 · cited 2× · see citing works
“[74] B. Reagen et al., “Minerva: Enabling low-power, highly-accurate deep neural network accelerators,” ACM SIGARCH Comput.”
Gradient Coding: Avoiding Stragglers in Distributed Learning
Tandon, R., Lei, Q., Dimakis, A. G., & Karampatziakis, N. (2017) · International Conference on Machine Learning · Cited by 431 · see citing works
Dynamic Adaptive DNN Surgery for Inference Acceleration on the Edge
Hu, C., Bao, W., Wang, D., & Liu, F. (2019) · IEEE INFOCOM 2019 - IEEE Conference on Computer Communications · doi:10.1109/infocom.2019.8737614 · Cited by 416 · cited 1× · see citing works
“[80] propose an approximation algorithm that provides worst-case performance guarantee, based on the graph min-cut method.”
Method(2013) · doi:10.4324/9780203763247 · Cited by 400 · cited 1× · see citing works
“Leveraging the backpropagation mechanism [26], [27], the error rate is propagated back across the whole neural network, and the weights are updated based on the gradient and the learning rate.”
Edge Intelligence: On-Demand Deep Learning Model Co-Inference with Device-Edge Synergy
Li, E., Zhou, Z., & Chen, X. (2018) · Proceedings of the 2018 Workshop on Mobile Edge Communications · doi:10.1145/3229556.3229562 · Cited by 385 · cited 2× · see citing works
“Indeed, the marriage of edge computing and AI has given rise to a new research area, namely, “edge intelligence (EI)” or “edge AI” [9], [10].”
BackgroundMethodSelf-citationNoScope: optimizing neural network queries over video at scale
Kang, D., Emmons, J., Abuzaid, F., Bailis, P., & Zaharia, M. (2017) · Proceedings of the VLDB Endowment · doi:10.14778/3137628.3137664 · Cited by 367 · see citing works
Glimpse: Continuous, Real-Time Object Recognition on Mobile Devices
Chen, T. Y.-H., Ravindranath, L., Deng, S., Bahl, P., & Balakrishnan, H. (2015) · Proceedings of the 13th ACM Conference on Embedded Networked Sensor Systems · doi:10.1145/2809695.2809711 · Cited by 358 · cited 2× · see citing works
“inference with the model of full precision. &DFKHG 5HVXOWV 0RGHO ZLWKIXOO SUHFLVLRQ 0RELOH'HYLFHV (GJH6HUYHU &ORXG'DWDFHQWHU Fig. 15: The process of semantic cache technique Glimpse [92] is a pioneering effort to introduce cache technique to DNN inference task. For an object detection application, Gl…”
BackgroundMethodMoDNN: Local distributed mobile computing system for Deep Neural Network
Mao, J., Chen, X., Nixon, K. W., Krieger, C., & Chen, Y. (2017) · Design, Automation & Test in Europe Conference & Exhibition (DATE), 2017 · doi:10.23919/date.2017.7927211 · Cited by 331 · cited 6× · see citing works
“Note that DNN layers are partitioned horizontally in MoDNN and MeDNN, whereas DeepThings [86] employs a fused tile partitioning method that partitions the DNN layers vertically to reduce the memory footprint.”
MethodInfluentialSelf-citation(2017) · Networked Systems Design and Implementation · Cited by 329 · see citing works
Natural Language Processing (Almost) from Scratch
CollobertRonan, WestonJason, BottouLéon, KarlenMichael, KavukcuogluKoray, & KuksaPavel (2011) · Journal of Machine Learning Research · doi:10.5555/1953048.2078186 · Cited by 309 · see citing works
NestDNN: Resource-Aware Multi-Tenant On-Device Deep Learning for Continuous Mobile Vision
Fang, B., Zeng, X., & Zhang, M. (2018) · Proceedings of the 24th Annual International Conference on Mobile Computing and Networking · doi:10.1145/3241539.3241559 · Cited by 291 · cited 6× · see citing works
“Taking the dynamics of runtime resources into consideration, NestDNN [107] is proposed to offering flexible resource–accuracy tradeoffs for each DNN model.”
MethodInfluentialVideoEdge: Processing Camera Streams using Hierarchical Clusters
Hung, C.-C., Ananthanarayanan, G., Bodik, P., Golubchik, L., Yu, M., Bahl, P., & Philipose, M. (2018) · 2018 IEEE/ACM Symposium on Edge Computing (SEC) · doi:10.1109/sec.2018.00016 · Cited by 287 · cited 1× · see citing works
“By comparison, real-time video analytics is envisioned to be a killer application for edge computing [12], [37], [38].”
BackgroundMinerva: Enabling Low-Power, Highly-Accurate Deep Neural Network Accelerators
Reagen, B., Whatmough, P. N., Adolf, R., Rama, S., Lee, H., Lee, S. K., Hernández-Lobato, J. M., Wei, G.-Y., & Brooks, D. M. (2016) · Proceedings - International Symposium on Computer Architecture/Proceedings · doi:10.1109/isca.2016.32 · Cited by 262 · see citing works
Notice of Removal: A Hybrid Deep Learning Architecture for Privacy-Preserving Mobile Analytics
Osia, S. A., Shamsabadi, A. S., Sajadmanesh, S., Taheri, A., Katevas, K., Rabiee, H. R., Lane, N. D., & Haddadi, H. (2020) · IEEE Internet of Things Journal · doi:10.1109/jiot.2020.2967734 · Cited by 258 · see citing works
Adaptive Neural Networks for Efficient Inference
Bolukbasi, T., Wang, J., Dekel, O., & Saligrama, V. (2017) · arXiv · doi:10.48550/arxiv.1702.07811 · Cited by 251 · cited 1× · see citing works
“[89] train a policy that determines whether the current samples should proceed to the next layer by adding regularization to the evaluation latency of the DNN model.”
BackgroundLow Latency Geo-distributed Data Analytics
Pu, Q., Ananthanarayanan, G., Bodik, P., Kandula, S., Akella, A., Bahl, P., & Stoica, I. (2015) · Proceedings of the 2015 ACM Conference on Special Interest Group on Data Communication · doi:10.1145/2785956.2787505 · Cited by 246 · cited 1× · see citing works
“However, when moving a tremendous amount of data across the wide area network (WAN), both monetary cost and transmission delay can be prohibitively high, and the privacy leakage can also be a major concern [5].”
BackgroundExploiting Massive D2D Collaboration for Energy-Efficient Mobile Edge Computing
Chen, X., Pu, L., Gao, L., Wu, W., & Wu, D. (2017) · IEEE Wireless Communications · doi:10.1109/mwc.2017.1600321 · Cited by 239 · cited 1× · see citing works
“1, here an edge node can be nearby end-device connectable by device-to-device (D2D) communications [7], a server attached to an access point (e.”
BackgroundSelf-citationPrivacy-preserving deep learning
Shokri, R., & Shmatikov, V. (2015) · 2015 53rd Annual Allerton Conference on Communication, Control, and Computing (Allerton) · doi:10.1109/allerton.2015.7447103 · Cited by 223 · see citing works
sharma (2018) · doi:10.1109/mic.2018.112102519 · Cited by 220 · see citing works
On-Demand Deep Model Compression for Mobile Devices: A Usage-Driven Model Selection Framework
Liu, S., Lin, Y., Zhou, Z., Nan, K., Liu, H., & Du, J. (2018) · Proceedings of the 16th Annual International Conference on Mobile Systems, Applications, and Services · doi:10.1145/3210240.3210337 · Cited by 217 · cited 1× · see citing works
“To this end, the proposed automatic optimization framework AdaDeep [75] systematically formulates the goals and constraints on accuracy, latency, storage, and energy into a unified optimization problem and leverages DRL to effectively find a good combination of compression techniques.”
MethodSelf-citationCommunication Compression for Decentralized Training
Tang, H., Gan, S., Zhang, C., Zhang, T., & Liu, J. (2018) · arXiv · doi:10.48550/arxiv.1803.06443 · Cited by 206 · cited 1× · see citing works
“[56] develop a framework of compressed, decentralized training and propose two different algorithms, called extrapolation compression and difference compression, respectively.”
Bandwidth-Efficient Live Video Analytics for Drones Via Edge Computing
Wang, J., Feng, Z., Chen, Z., George, S., Bala, M., Pillai, P., Yang, S.-W., & Satyanarayanan, M. (2018) · 2018 IEEE/ACM Symposium on Edge Computing (SEC) · doi:10.1109/sec.2018.00019 · Cited by 204 · cited 1× · see citing works
“[98] optimize for the first hop wireless bandwidth of DNN inference.”
Not Just Privacy: Improving Performance of Private Deep Learning in Mobile Cloud
Wang, J., Zhang, J., Bao, W., Zhu, X., Cao, B., & Yu, P. S. (2018) · Proceedings of the 24th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining · doi:10.1145/3219819.3220106 · Cited by 188 · cited 5× · see citing works
“As [59] referred, the design of DNN splitting in Arden is inspired by transfer learning.”
BackgroundMethodInfluentialSelf-citationNeurosurgeon: Collaborative Intelligence Between the Cloud and Mobile Edge
Kang, Y., Hauswald, J., Gao, C., Rovinski, A., Mudge, T., Mars, J., & Tang, L. (2017) · ACM SIGPLAN Notices · doi:10.1145/3093336.3037698 · Cited by 185 · see citing works
Big Data Privacy Preserving in Multi-Access Edge Computing for Heterogeneous Internet of Things
Du, M., Wang, K., Chen, Y., Wang, X., & Sun, Y. (2018) · IEEE Communications Magazine · doi:10.1109/mcom.2018.1701148 · Cited by 178 · see citing works
Low Latency Geo-distributed Data Analytics
Pu, Q., Ananthanarayanan, G., Bodík, P., Kandula, S., Akella, A., Bahl, P., & Stoica, I. G. (2015) · ACM SIGCOMM Computer Communication Review · doi:10.1145/2829988.2787505 · Cited by 177 · see citing works
A Berkeley View of Systems Challenges for AI
Stoica, I., Song, D., Popa, R. A., Patterson, D., Mahoney, M. W., Katz, R., Joseph, A. D., Jordan, M., Hellerstein, J. M., Gonzalez, J. E., et al. (2017) · arXiv · doi:10.48550/arxiv.1712.05855 · Cited by 171 · cited 1× · see citing works
“In December 2017, in a white paper, “A Berkeley View of Systems Challenges for AI” [39] published by the University of California Berkeley, the cloud–edge AI system is envisioned as an important research direction to achieve the goal of mission-critical and personalized AI.”
BackgroundJALAD: Joint Accuracy-And Latency-Aware Deep Structure Decoupling for Edge-Cloud Execution
Li, H., Hu, C., Jiang, J., Wang, Z., Wen, Y., & Zhu, W. (2018) · 2018 IEEE 24th International Conference on Parallel and Distributed Systems (ICPADS) · doi:10.1109/padsw.2018.8645013 · Cited by 160 · cited 2× · see citing works
“[81] H. Li, C. Hu, J. Jiang, Z. Wang, Y. Wen, and W. Zhu, “JALAD: Joint accuracy-and latency-aware deep structure decoupling for edge-cloud execution,” 2018, arXiv:1812.10027.”
MethodInfluentialZeng, L., Li, E., Zhou, Z., & Chen, X. (2019) · IEEE Network · doi:10.1109/mnet.001.1800506 · Cited by 159 · cited 2× · see citing works
“Model Early-Exit • Partial DNNs model inference • Accuracy-aware [10], [15], [78], [87]–[91]”
BackgroundSelf-citationKo, J. H., Na, T., Amir, M. F., & Mukhopadhyay, S. (2018) · 2018 15th IEEE International Conference on Advanced Video and Signal Based Surveillance (AVSS) · doi:10.1109/avss.2018.8639121 · Cited by 153 · cited 1× · see citing works
“[83] propose an edge-host partitioning method, which combines model partition with lossy feature encoding.”
MethodPipeDream: Fast and Efficient Pipeline Parallel DNN Training
Harlap, A., Narayanan, D., Phanishayee, A., Seshadri, V., Devanur, N., Ganger, G., & Gibbons, P. (2018) · arXiv · doi:10.48550/arxiv.1806.03377 · Cited by 153 · cited 2× · see citing works
“[61] design PipeDream, a system that supports pipelined training and automatically determines how to systematically split a given model across the available computing nodes.”
BackgroundCachier: Edge-Caching for Recognition Applications
Drolia, U., Guo, K., Tan, J., Gandhi, R., & Narasimhan, P. (2017) · 2017 IEEE 37th International Conference on Distributed Computing Systems (ICDCS) · doi:10.1109/icdcs.2017.94 · Cited by 148 · see citing works
Peer-to-peer Federated Learning on Graphs
Lalitha, A., Kilinc, O. C., Javidi, T., & Koushanfar, F. (2019) · arXiv · doi:10.48550/arxiv.1901.11173 · Cited by 146 · cited 1× · see citing works
“[48] propose a Bayesian-based distributed algorithm, in which each device updates its belief by aggregating information from its one-hop neighbors to train a model that best fits the observations over the entire network.”
BackgroundIONN: Incremental Offloading of Neural Network Computations from Mobile Devices to Edge Servers
Jeong, H.-J., Lee, H.-J., Shin, C. H., & Moon, S.-M. (2018) · Proceedings of the ACM Symposium on Cloud Computing · doi:10.1145/3267809.3267828 · Cited by 143 · cited 4× · see citing works
“IONN [82] propose an incremental offloading technique for EI application.”
MethodInfluentialBig/little deep neural network for ultra low power inference
Park, E., Kim, D., Kim, S., Kim, Y.-D., Kim, G., Yoon, S., & Yoo, S. (2015) · 2015 International Conference on Hardware/Software Codesign and System Synthesis (CODES+ISSS) · doi:10.1109/codesisss.2015.7331375 · Cited by 130 · cited 1× · see citing works
“[102] propose a big/little DNN model selection framework.”
BackgroundMathur, A., Lane, N. D., Bhattacharya, S., Boran, A., Forlivesi, C., & Kawsar, F. (2017) · Proceedings of the 15th Annual International Conference on Mobile Systems, Applications, and Services · doi:10.1145/3081333.3081359 · Cited by 128 · cited 4× · see citing works
“DeepEye first segregates DNN layers of all tasks into two pools: convolution layers and fully connected layers.”
InfluentialAdaptive deep learning model selection on embedded systems
Taylor, B., Marco, V. S., Wolff, W., Elkhatib, Y., & Wang, Z. (2018) · ACM SIGPLAN Notices · doi:10.1145/3299710.3211336 · Cited by 114 · see citing works
MeDNN: A distributed mobile system with enhanced partition and deployment for large-scale DNNs
Mao, J., Yang, Z., Wen, W., Wu, C., Song, L., Nixon, K. W., Chen, X., Li, H., & Chen, Y. (2017) · 2017 IEEE/ACM International Conference on Computer-Aided Design (ICCAD) · doi:10.1109/iccad.2017.8203852 · Cited by 97 · see citing works
Self-citationTowards Real-Time Object Detection on Embedded Systems
Mao, H., Yao, S., Tang, T., Li, B., Yao, J., & Wang, Y. (2018) · IEEE Transactions on Emerging Topics in Computing · doi:10.1109/tetc.2016.2593643 · Cited by 94 · cited 2× · see citing works
“Applying various convolutional filters, CNN models can capture the high-level representation of the input data, making it most popular for computer vision tasks, e.g., image classification (e.g., AlexNet [18], VGG network [19], ResNet [20], and MobileNet [21]) and object detection (e.g., Fast R-CNN [22], YOLO [23], an…”
On-Device Federated Learning via Blockchain and its Latency Analysis.
Kim, H., Park, J., Bennis, M., & Kim, S. (2018) · Cited by 94 · see citing works
eSGD: Communication Efficient Distributed Deep Learning on the Edge
Tao, Z., & Li, Q. (2018) · Cited by 92 · see citing works
FoggyCache: Cross-Device Approximate Computation Reuse
Guo, P., Hu, B., Li, R., & Hu, W. (2018) · Proceedings of the 24th Annual International Conference on Mobile Computing and Networking · doi:10.1145/3241539.3241557 · Cited by 91 · cited 5× · see citing works
“There are two challenges in FoggyCache: one is that the input data distribution is unknown so the problem is how to index the input data with a constant lookup quality and the other is how to represent the similarity of the input data.”
MethodInfluentialAdaptive deep learning model selection on embedded systems
Taylor, B., Marco, V. S., Wolff, W., Elkhatib, Y., & Wang, Z. (2018) · Proceedings of the 19th ACM SIGPLAN/SIGBED International Conference on Languages, Compilers, and Tools for Embedded Systems · doi:10.1145/3211332.3211336 · Cited by 90 · cited 1× · see citing works
“[103] point out that different DNN models (e.”
BackgroundTowards Wearable Cognitive Assistance
Ha, K., Chen, Z., Hu, W., et al. (2013) · doi:10.21236/ada591470 · Cited by 90 · see citing works
Li, Y., Park, J., Alian, M., Yuan, Y., Qu, Z., Pan, P., Wang, R., Schwing, A. G., Esmaeilzadeh, H., & Kim, N. S. (2018) · IEEE/ACM International Symposium on Microarchitecture (MICRO) · doi:10.1109/micro.2018.00023 · Cited by 86 · cited 1× · see citing works
“INCEPTIONN [68] Hybrid Level-5 • Maximizing the opportunities for”
BackgroundHow to scale distributed deep learning?
Jin, P. H., Yuan, Q., Iandola, F., & Keutzer, K. (2016) · arXiv · doi:10.48550/arxiv.1611.04581 · Cited by 85 · cited 25× · see citing works
“Amiri and Gunduz [57] implement DSGD at the wireless edge with the help of a remote parameter server and further develop DSGD in digital and analog schemes, respectively.”
MethodInfluentialGossipGraD: Scalable Deep Learning using Gossip Communication based Asynchronous Gradient Descent
Daily, J., Vishnu, A., Siegel, C., Warfel, T., & Amatya, V. (2018) · arXiv · doi:10.48550/arxiv.1803.05880 · Cited by 80 · cited 2× · see citing works
“[66] show that the trivial gossip-based algorithms at scale lead to a communication imbalance, poor convergence, and heavy communication overhead.”
BackgroundMethodGossip training for deep learning
Blot, M., Picard, D., Cord, M., & Thome, N. (2016) · arXiv · doi:10.48550/arxiv.1611.09726 · Cited by 77 · cited 1× · see citing works
“Inspired by this, Gossip SGD (GoSGD) [64] is proposed to train DNN models in an asynchronous and decentralized way.”
MethodpCAMP: Performance Comparison of Machine Learning Packages on the Edges
Zhang, X., Wang, Y., & Shi, W. (2019) · arXiv · doi:10.48550/arxiv.1906.01878 · Cited by 77 · cited 1× · see citing works
“, TensorFlow Lite, Caffe2, CoreML, and MXNet); however, empirical measurements [115] show that there is no single winner that can outperform other frameworks in all metrics.”
BackgroundMainstream: dynamic stem-sharing for multi-tenant video processing
Jiang, A. H., Wong, D., Canel, C., Tang, L., Misra, I., Kaminsky, M., Kozuch, M. A., Pillai, P. S., Andersen, D. G., & Ganger, G. R. (2018) · USENIX Annual Technical Conference · Cited by 75 · see citing works
Big/little deep neural network for ultra low power inference
Park, E., Kim, D., Kim, S., et al. (2015) · Seoul National University Open Repository (Seoul National University) · doi:10.5555/2830840.2830854 · Cited by 67 · see citing works
Designing adaptive neural networks for energy-constrained image classification
Stamoulis, D., Chin, T.-W. (., Prakash, A. K., Fang, H., Sajja, S., Bognar, M., & Marculescu, D. (2018) · Proceedings of the International Conference on Computer-Aided Design · doi:10.1145/3240765.3240796 · Cited by 63 · cited 1× · see citing works
“[106] cast the adaptive DNN model selection issue as a hyperparameter optimization problem by taking into account the accuracy and communication constraints imposed by the devices.”
MethodThe cascading neural network: building the Internet of Smart Things
Leroux, S., Bohez, S., De Coninck, E., Verbelen, T., Vankeirsbilck, B., Simoens, P., & Dhoedt, B. (2017) · Knowledge and Information Systems · doi:10.1007/s10115-017-1029-1 · Cited by 59 · cited 1× · see citing works
“For example, the cascading network [91] simply adds the MP layer and fully connected layer to the standard DNN model and achieves a speedup of 20%.”
BackgroundEdge Intelligence: On-Demand Deep Learning Model Co-Inference with Device-Edge SynergyPreprint
Li, E., Zhou, Z., & Chen, X. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1806.07840 · Cited by 59 · see citing works
Self-citationGeorgiev, P., Lane, N. D., Rachuri, K. K., & Mascolo, C. (2016) · Proceedings of the 22nd Annual International Conference on Mobile Computing and Networking · doi:10.1145/2973750.2973777 · Cited by 58 · cited 1× · see citing works
“LEO [113] is a novel sensing algorithm scheduler that maximizes the performance for multiple continuous mobile sensor applications by partitioning the sensing algorithm execution and distributing tasks on CPU, coprocessor, GPU and the cloud.”
BackgroundOptimizing Grouped Aggregation in Geo-Distributed Streaming Analytics
Heintz, B., Chandra, A., & Sitaraman, R. K. (2015) · ACM International Symposium on High-Performance Parallel and Distributed Computing (HPDC) · doi:10.1145/2749246.2749276 · Cited by 53 · cited 1× · see citing works
“Toward this goal, the conventional wisdom is to transport the data bulks from the IoT devices to the cloud datacenters for analytics [4].”
BackgroundEdgeOS_H: A Home Operating System for Internet of Everything
Cao, J., Xu, L., Abdallah, R., & Shi, W. (2017) · IEEE International Conference on Distributed Computing Systems (ICDCS) · doi:10.1109/icdcs.2017.325 · Cited by 51 · see citing works
Privacy-Preserving Machine Learning Based Data Analytics on Edge Devices
Zhao, J., Mortier, R., Crowcroft, J., & Wang, L. (2018) · Proceedings of the AAAI/ACM Conference on AI Ethics and Society · doi:10.1145/3278721.3278778 · Cited by 49 · cited 1× · see citing works
“Zoo [67] Hybrid Level-4 • Reducing communication cost • Privacy preservation • Federated Learning • Composable services • Processes each image within constant time despite the size difference of images”
BackgroundA Dynamic Deep Neural Network Design for Efficient Workload Allocation in Edge Computing
Lo, C., Su, Y.-Y., Lee, C.-Y., & Chang, S.-C. (2017) · 2017 IEEE International Conference on Computer Design (ICCD) · doi:10.1109/iccd.2017.49 · Cited by 48 · cited 1× · see citing works
“[90] propose adding an authentic operation (AO) unit to the basic BranchyNet model.”
Data-driven Task Allocation for Multi-task Transfer Learning on the Edge
Chen, Q., Zheng, Z., Hu, C., Wang, D., & Liu, F. (2019) · IEEE International Conference on Distributed Computing Systems (ICDCS) · doi:10.1109/icdcs.2019.00107 · Cited by 48 · cited 1× · see citing works
“[44] provide extensive studies on the performance (in both accuracy and convergence speed) of transfer learning, considering different student network architectures and different techniques for transferring knowledge from teacher to student.”
BackgroundLow-Latency Broadband Analog Aggregation for Federated Edge Learning.Preprint
Zhu, G., Wang, Y., & Huang, K. (2018) · arXiv (Cornell University) · Cited by 43 · see citing works
Are Existing Knowledge Transfer Techniques Effective for Deep Learning with Edge Devices?
Sharma, R., Biookaghazadeh, S., Li, B., & Zhao, M. X. (2018) · IEEE International Conference on Edge Computing and Communications (EDGE) · doi:10.1109/edge.2018.00013 · Cited by 41 · see citing works
EdgeOSH: A Home Operating System for Internet of Everything
Cao, J., Zhang, Q., & Shi, W. (2018) · SpringerBriefs in computer science · doi:10.1007/978-3-030-02083-5_2 · Cited by 34 · see citing works
Broadband Analog Aggregation for Low-Latency Federated Edge Learning (Extended Version)Preprint
Zhu, G., Wang, Y., & Huang, K. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1812.11494 · Cited by 33 · see citing works
(2017) · doi:10.1145/3132211.3134456 · Cited by 32 · see citing works
IF-CNN: Image-Aware Inference Framework for CNN With the Collaboration of Mobile Devices and Cloud
Shu, G., Liu, W., Zheng, X., & Li, J. (2018) · IEEE Access · doi:10.1109/access.2018.2880196 · Cited by 30 · cited 2× · see citing works
“Similarly, IF-CNN [105] also trains a model selector called the recognition predictor (RP) to change the model used in the task.”
MethodAccelerating Deep Learning Workloads Through Efficient Multi-Model Execution
Narayanan, D., Santhanam, K., Phanishayee, A., & Zaharia, M. (2018) · Cited by 27 · see citing works
Kang, Y., Hauswald, J., Gao, C., Rovinski, A., Mudge, T., Mars, J., & Tang, L. (2017) · ACM SIGOPS Operating Systems Review · doi:10.1145/3093315.3037698 · Cited by 27 · see citing works
A portable, automatic data qantizer for deep neural networks
Oh, Y. H., Quan, Q., Kim, D.-Y., Kim, S., Heo, J., Jung, S., Jang, J.-Y., & Lee, J. W. (2018) · International Conference on Parallel Architectures and Compilation Techniques (PACT) · doi:10.1145/3243176.3243180 · Cited by 24 · see citing works
(2018) · Cited by 22 · see citing works
FFS-VA: A Fast Filtering System for Large-scale Video Analytics
Zhang, C., Cao, Q., Jiang, H., Zhang, W., Li, J., & Yao, J. (2018) · Proceedings of the 47th International Conference on Parallel Processing · doi:10.1145/3225058.3225103 · Cited by 16 · cited 3× · see citing works
“Available: https://arxiv.org/abs/1811.01268 [100] C. Zhang, Q. Cao, H. Jiang, W. Zhang, J. Li, and J. Yao, “FFS-VA: A fast filtering system for large-scale video analytics,” in Proc.”
BackgroundInfluentialKLRA: A Kernel Level Resource Auditing Tool For IoT Operating System Security
Li, D., Zhang, Z., Liao, W., et al. (2018) · IEEE/ACM Symposium on Edge Computing (SEC) · doi:10.1109/sec.2018.00058 · Cited by 15 · cited 1× · see citing works
“The open nature of edge computing imposes that the decentralized trust is required such that the EI services provided by different entities are trustworthy [121].”
BackgroundReXCam: Resource-Efficient, Cross-Camera Video Analytics at Enterprise Scale.Preprint
Jain, S., Jiang, J., Shu, Y., et al. (2018) · arXiv (Cornell University) · Cited by 12 · see citing works
ReXCam: Resource-Efficient, Cross-Camera Video Analytics at Scale
Jain, S., Zhang, X., Zhou, Y., Ananthanarayanan, G., Jiang, J., Shu, Y., & Gonzalez, J. (2018) · arXiv · doi:10.48550/arxiv.1811.01268 · Cited by 5 · see citing works
Mitigating Multi-tenant Interference in Continuous Mobile Offloading
Fang, Z., Luo, M., Yu, T., Mengshoel, O. J., Srivastava, M. B., & Gupta, R. K. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-94295-7_2 · Cited by 4 · cited 1× · see citing works
“[109] Z.”
Mitigating multi-tenant interference on mobile offloading servers
Fang, Z., Luo, M., Yu, T., Mengshoel, O. J., Srivastava, M. B., & Gupta, R. K. (2017) · Symposium on Cloud Computing · doi:10.1145/3127479.3132563 · Cited by 2
In-Edge AI: Intelligentizing Mobile Edge Computing, Caching and Communication by Federated Learning
Wang, X., Han, Y., Wang, C., et al. (2018) · arXiv · doi:10.48550/arxiv.1809.07857
Machine Learning at the Wireless Edge: Distributed Stochastic Gradient Descent Over-the-Air
Amiri, M. M., & Gunduz, D. (2019) · arXiv · doi:10.48550/arxiv.1901.00844
A Hybrid Deep Learning Architecture for Privacy-Preserving Mobile Analytics
Osia, S. A., Shamsabadi, A. S., Sajadmanesh, S., et al. (2017) · arXiv · doi:10.48550/arxiv.1703.02952
JALAD: Joint Accuracy- and Latency-Aware Deep Structure Decoupling for Edge-Cloud Execution
Li, H., Hu, C., Jiang, J., et al. (2018) · arXiv · doi:10.48550/arxiv.1812.10027
Ko, J. H., Na, T., Amir, M. F., et al. (2018) · arXiv · doi:10.48550/arxiv.1802.03835
Flagged first, then by citations
29 of the 168 references couldn’t be matched to a known paper.
Research works printed but not linked: 11
- 0, 3 AI Trends for Enterprise Computing
- 0, Microsoft Interactive Cloud Gaming
- 0, Democratizing AI
- hsieh, 2017, Gaia: Geo-distributed machine learning approaching LAN speeds, Proc NSDI, 629
- 2018, 5 Trends Emerge in the Gartner Hype Cycle for Emerging Technologies
- 0, Cisco global cloud index Forecast and methodology 2016–2021
- 0, Accelerating AI on the Intelligent Edge
- 2017, IEC White Paper Edge Intelligence
- 0, Edge Intelligence for Industrial Internet of Things
- han, 2015, Learning both weights and connections for efficient neural network, Proc Adv Neural Inf Process Syst, 1135
- 2018, 5 Trends Emerge in the Gartner Hype Cycle for Emerging Technologies
Cited by
Sorted by citations
Federated Learning in Mobile Edge Networks: A Comprehensive Survey
Lim, W. Y. B., Luong, N. C., Hoang, D. T., Jiao, Y., Liang, Y.-C., Yang, Q., Niyato, D., & Miao, C. (2020) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2020.2986024 · Cited by 2,565 · see citing works
“In particular, the authors in [14], [37], and [38] study the architectures and process of training and inference at edge networks without considering the challenges to FL implementation.”
BackgroundConvergence of Edge Computing and Deep Learning: A Comprehensive Survey
Wang, X., Han, Y., Leung, V. C. M., Niyato, D., Yan, X., & Chen, X. (2020) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2020.2970550 · Cited by 1,498 · see citing works
“Besides, discussions about DL inference and training are the main contribution of [19]–[21].”
BackgroundSelf-citation6G Internet of Things: A Comprehensive Survey
Nguyen, D. C., Ding, M., Pathirana, P. N., Seneviratne, A. P., Li, J., Niyato, D. T., Dobre, O. A., & Poor, H. V. (2021) · IEEE Internet of Things Journal · doi:10.1109/jiot.2021.3103320 · Cited by 1,468 · see citing works
“6G is envisioned to be a unified communication platform, not only on the land but also on the sky (such as flight) and underwater (such as voyage), to achieve an extremely broad coverage and ubiquitous connectivity for fully supporting future IoT applications.”
BackgroundAcosta, J. N., Falcone, G. J., Rajpurkar, P., & Topol, E. J. (2022) · Nature Medicine · doi:10.1038/s41591-022-01981-2 · Cited by 1,365 · see citing works
“An additional layer of safety can be obtained by leveraging novel developments in edge computing 171 .”
BackgroundEdge Intelligence: The Confluence of Edge Computing and Artificial Intelligence
Deng, S., Zhao, H., Fang, W. J., Yin, J., Dustdar, S., & Zomaya, A. Y. (2020) · IEEE Internet of Things Journal · doi:10.1109/jiot.2020.2984887 · Cited by 1,218 · see citing works
“For example, Zhou et al. believe that the scope of Edge Intelligence should not be restricted to running AI models solely on the edge servers or devices but in the manner of the collaboration of edge and cloud [4].”
BackgroundMethodEdge AI: On-Demand Accelerating Deep Neural Network Inference via Edge Computing
Li, E., Zeng, L., Zhou, Z., & Chen, X. (2020) · IEEE Transactions on Wireless Communications · doi:10.1109/twc.2019.2946140 · Cited by 929 · see citing works
“By hosting artificial intelligence on mobile devices, mobile DNN computation deploys DNN models close to users in order to achieve more flexible execution as well as more secure interaction [15].”
MethodSelf-citationEdge Computing in Industrial Internet of Things: Architecture, Advances and Challenges
Qiu, T., Chi, J., Zhou, X., Ning, Z., Atiquzzaman, M., & Wu, D. O. (2020) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2020.3009103 · Cited by 857 · see citing works
“Therefore, deploying AI algorithms on edge devices can theoretically achieve the complementary combination of edge computing and AI [127].”
BackgroundMethodEdge artificial intelligence for 6g: vision, enabling technologies, and applications
Letaief, K. B., Shi, Y., Lu, J., & Lu, J. (2022) · IEEE Journal on Selected Areas in Communications · doi:10.1109/jsac.2021.3126076 · Cited by 829 · see citing works
“processing, transmission, and consumption at the network edge [29], [30].”
BackgroundSurvey on 6G Frontiers: Trends, Applications, Requirements, Technologies and Future Research
de Alwis, C., Kalla, A., Pham, Q., Kumar, P., Dev, K., Hwang, W., & Liyanage, M. (2021) · IEEE Open Journal of the Communications Society · doi:10.1109/ojcoms.2021.3071496 · Cited by 809 · see citing works
“1) Related work: According to [140], the total data traffic generated by applications, machines, and things at the edge is 850 ZB, whereas the total data center traffic is only 20.6 ZB.”
BackgroundInfluentialA Survey on Federated Learning for Resource-Constrained IoT Devices
Imteaj, A., Thakker, U., Wang, S., Li, J., & Amini, M. H. (2022) · IEEE Internet of Things Journal · doi:10.1109/jiot.2021.3095077 · Cited by 774 · see citing works
“On the other hand, edge computing surveys [13]– [19] are mainly conducted on edge computing infrastructure, applications including ML and AI, resource management, wireless communication, and security and privacy issues.”
AI for next generation computing: Emerging trends and future directions
Gill, S. S., Xu, M., Ottaviani, C., Patros, P., Rami Bahsoon, A., Shaghaghi, A., Golec, M., Stankovski, V., Wu, H., Abraham, A., et al. (2022) · Internet of Things · doi:10.1016/j.iot.2022.100514 · Cited by 736 · see citing works
“elp automated processes is supplied [115].”
InfluentialWu, Q., Xu, J., Zeng, Y., Ng, D. W. K., Al‐Dhahir, N., Schober, R., & Swindlehurst, A. L. (2021) · IEEE Journal on Selected Areas in Communications · doi:10.1109/jsac.2021.3088681 · Cited by 588 · see citing works
“porated into BSs and APs at the network edge, for enabling various intelligent applications (such as autonomous driving and industrial automation) with extensive communication and computation requirements [293], [294].”
BackgroundEdge Computing with Artificial Intelligence: A Machine Learning Perspective
Hua, H., Li, Y., Wang, T., Dong, N., Li, W., & Cao, J. (2022) · ACM Computing Surveys · doi:10.1145/3555802 · Cited by 594 · see citing works
“In Reference [11], authors focus on the motivation and research work of deploying AI algorithm on the edge of the network.”
BackgroundMethodInfluentialMobile Edge Intelligence and Computing for the Internet of Vehicles
Zhang, J., & Letaief, K. B. (2020) · Proceedings of the IEEE · doi:10.1109/jproc.2019.2947490 · Cited by 537 · see citing works
“[37] Z.”
BackgroundSelf-citationJan, Z. M., Ahamed, F., Mayer, W., Patel, N., Großmann, G., Stumptner, M., & Kuusk, A. (2022) · Expert Systems with Applications · doi:10.1016/j.eswa.2022.119456 · Cited by 586 · see citing works
6G networks: Beyond Shannon towards semantic and goal-oriented communications
Strinati, E. C., & Barbarossa, S. (2021) · Computer Networks · doi:10.1016/j.comnet.2021.107930 · Cited by 539 · see citing works
“…whereas all previous network generations have been designed by humans, the design of next generation networks will see a significant contribution from machines, driven by a pervasive introduction of artificial intelligence at the edge of the network, as close as possible to the end-users [46], [47].”
BackgroundCommunication-efficient edge ai: algorithms and systems
Shi, Y., Yang, K., Jiang, T., Zhang, J., & Letaief, K. B. (2020) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2020.3007787 · Cited by 488 · see citing works
“To unleash its full potential, the upcoming edge AI [9], [18] shall rely on advances in various aspects, including the smart design of distributed learning algorithms and system architectures, supported by efficient communication protocols.”
BackgroundInfluentialSelf-citationA Survey on the Convergence of Edge Computing and AI for UAVs: Opportunities and Challenges
McEnroe, P., Wang, S., & Liyanage, M. (2022) · IEEE Internet of Things Journal · doi:10.1109/jiot.2022.3176400 · Cited by 482 · see citing works
“…and distributed security mechanism designs can be designed to establish user authentication and access control, model/data integrity, and mutual platform verification [8]. d) The use of federated learning, blockchain, or the integration of both (e.g., [37]) can further improve security/privacy.”
BackgroundMethodInfluentialUser-Centric Cell-Free Massive MIMO Networks: A Survey of Opportunities, Challenges and Solutions
Ammar, H. A., Adve, R., Shahbazpanahi, S., Boudreau, G., & Srinivas, K. V. (2021) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2021.3135119 · Cited by 458 · see citing works
“Still, the federated learning framework looks interesting, especially with the growing use of on-mobile artificial intelligence (AI) [260, 261].”
BackgroundComputation Offloading Toward Edge Computing
Lin, L. Z., Liao, X., Jin, H., & Li, P. (2019) · Proceedings of the IEEE · doi:10.1109/jproc.2019.2922285 · Cited by 461 · see citing works
“Furthermore, computing at the edge can reduce the network traffic of the core network [11], driving data analytics toward geo-distributed processing, known as edge analytics [42]–[44].”
BackgroundLuo, S., Chen, X., Wu, Q., Zhou, Z., & Yu, S. (2020) · IEEE Transactions on Wireless Communications · doi:10.1109/twc.2020.3003744 · Cited by 456 · see citing works
“AS MOBILE and internet of things (IoT) devices have emerged in large numbers and are generating a massive amount of data [1], Machine Learning (ML) has been witnessed to go through a high-speed development due to big”
BackgroundSelf-citationA review on TinyML: State-of-the-art and prospects
Ray, P. P. (2022) · Journal of King Saud University - Computer and Information Sciences · doi:10.1016/j.jksuci.2021.11.019 · Cited by 460 · see citing works
Personalized Federated Learning for Intelligent IoT Applications: A Cloud-Edge Based Framework
Wu, Q., He, K., & Chen, X. (2020) · IEEE Open Journal of the Computer Society · doi:10.1109/ojcs.2020.2993259 · Cited by 424 · see citing works
“To tackle the high communication and computation cost issues in device heterogeneity, we resort to edge computing which brings the necessary on-demand computing power in the proximity of IoT devices [2].”
BackgroundSelf-citationA Survey of Recent Advances in Edge-Computing-Powered Artificial Intelligence of Things
Chang, Z., Liu, S., Xiong, X., Cai, Z., & Tu, G. (2021) · IEEE Internet of Things Journal · doi:10.1109/jiot.2021.3088875 · Cited by 431 · see citing works
Efficient Acceleration of Deep Learning Inference on Resource-Constrained Edge Devices: A Review
Shuvo, M. M. H., Islam, S. K., Cheng, J., & Morshed, B. I. (2023) · Proceedings of the IEEE · doi:10.1109/jproc.2022.3226481 · Cited by 436 · see citing works
“The EI of DL models can be categorized into three types [18]: 1) inference on the edge server; 2) inference on the edge device; and 3) collaborative inference on the edge device and edge server.”
BackgroundMethodDistributed Artificial Intelligence Empowered by End-Edge-Cloud Computing: A Survey
Duan, S., Wang, D., Ren, J., Lyu, F., Zhang, Y., Wu, H., & Shen, X. (2022) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2022.3218527 · Cited by 419 · see citing works
“erences [13], [14] provided overviews of the architectures and several key technologies for DL model computation at the network edge.”
BackgroundFrom Semantic Communication to Semantic-Aware Networking: Model, Architecture, and Open Problems
Shi, G., Xiao, Y., Li, Y., & Xie, X. (2021) · IEEE Communications Magazine · doi:10.1109/mcom.001.2001239 · Cited by 407 · see citing works
“We propose a novel architecture based on federated edge intelligence [10]–[12] that has the potential to address the above challenges mentioned in Section III.”
MethodMachine Learning at the Network Edge: A Survey
Murshed, M. G. S., Murphy, C., Hou, D., Khan, N., Ananthanarayanan, G., & Hussain, F. (2021) · ACM Computing Surveys · doi:10.1145/3469029 · Cited by 535 · see citing works
Fraga‐Lamas, P., Lopes, S. I., & Fernández‐Caramés, T. M. (2021) · Sensors · doi:10.3390/s21175745 · Cited by 434 · see citing works
“Besides the well-known Cloud Intelligence (CI), which consists in training and in-ferencing the DNN models fully in the cloud, EI, as described in [110], can be classified into the six levels depicted in Figure 5.”
MethodUnleashing the Power of Edge-Cloud Generative AI in Mobile Networks: A Survey of AIGC Services
Xu, M., Du, H., Niyato, D. T., Kang, J., Xiong, Z., Mao, S., Han, Z., Jamalipour, A., Kim, D. I., Shen, X., et al. (2024) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2024.3353265 · Cited by 475 · see citing works
“Although AIGC is acknowledged for its potential to revolutionize existing production processes, users accessing AIGC services on mobile devices currently lack support for interactive and resource-intensive data generation services [1], [18], [29].”
Holistic Network Virtualization and Pervasive Network Intelligence for 6G
Shen, X., Gao, J., Wu, W. R., Li, M., Zhou, C., & Zhuang, W. (2021) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2021.3135829 · Cited by 395 · see citing works
“Readers are referred to [4], [131], [182], [234] for discussions on the aforementioned challenges, such as privacy preservation, AI model selection, intelligent modules, and more open issues about data abstraction and processing.”
BackgroundInfluentialJoint Device Scheduling and Resource Allocation for Latency Constrained Wireless Federated Learning
Shi, W., Zhou, S., Niu, Z., Jiang, M., & Geng, L. (2021) · IEEE Transactions on Wireless Communications · doi:10.1109/twc.2020.3025446 · Cited by 381 · see citing works
“Therefore, the model accuracy within certain training time budgets (i.e., convergence rate w.r.t. time ), which is critical for latency constrained FL applications [27], [28], has not been addressed yet.”
BackgroundSAFA: A Semi-Asynchronous Protocol for Fast Federated Learning With Low Overhead
Wu, W., He, L., Lin, W., Mao, R., Maple, C., & Jarvis, S. A. (2020) · IEEE Transactions on Computers · doi:10.1109/tc.2020.2994391 · Cited by 379 · see citing works
Deep Reinforcement Learning for Energy-Efficient Computation Offloading in Mobile-Edge Computing
Zhou, H., Jiang, K. Y., Liu, X., Li, X., & Leung, V. C. M. (2021) · IEEE Internet of Things Journal · doi:10.1109/jiot.2021.3091142 · Cited by 352 · see citing works
Yu, S., Chen, X., Zhou, Z., Gong, X., & Wu, D. (2020) · IEEE Internet of Things Journal · doi:10.1109/jiot.2020.3026589 · Cited by 362 · see citing works
“Take the task of deep neural network (DNN) model partition [33] with sequential dependency as an example.”
MethodSelf-citationResearch Review for Broad Learning System: Algorithms, Theory, and Applications
Gong, X., Zhang, T., Chen, C. L. P., & Liu, Z. (2021) · IEEE Transactions on Cybernetics · doi:10.1109/tcyb.2021.3061094 · Cited by 354 · see citing works
“Edge intelligence is also becoming the focus of attention [313], [314].”
BackgroundFederated Learning in Edge Computing: A Systematic Survey
Abreha, H. G., Hayajneh, M., & Serhani, M. A. (2022) · Sensors · doi:10.3390/s22020450 · Cited by 366 · see citing works
“…edge computing paradigms X X X X [6] Survey on the integrated management of mobile computing and wireless communication resources in MEC X X X [63] Edge intelligence architectures and frameworks’ survey X X X X [64] Survey on edge intelligence specifically for 6G networks X X X [65] Management…”
BackgroundDeep Reinforcement Learning for Delay-Oriented IoT Task Scheduling in SAGIN
Zhou, C., Wu, W. R., He, H., Yang, P., Lyu, F., Cheng, N., & Shen, X. (2020) · IEEE Transactions on Wireless Communications · doi:10.1109/twc.2020.3029143 · Cited by 334 · see citing works
“latency of task execution, but also save the power consumption of IoT devices [7].”
BackgroundWu, Y., Dai, H.-N., & Wang, H. (2021) · IEEE Internet of Things Journal · doi:10.1109/jiot.2020.3025916 · Cited by 323 · see citing works
“can serve an important complement to IoT devices [166].”
BackgroundSecurity and Privacy on 6G Network Edge: A Survey
Mao, B., Liu, J., Wu, Y., & Kato, N. (2023) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2023.3244674 · Cited by 323 · see citing works
“Moreover, they have been challenged by similar security threats, for which the considered techniques all include FL [20], [33] and blockchain [34], [40].”
BackgroundMethodZeng, L., Chen, X., Zhou, Z., Yang, L., & Zhang, J. (2020) · IEEE/ACM Transactions on Networking · doi:10.1109/tnet.2020.3042320 · Cited by 315 · see citing works
“To tackle these challenges, a promising approach is to exploit available computation resources in the proximity to the data source with the emerging edge intelligence paradigm [13].”
BackgroundSelf-citationArtificial Intelligence-Enabled Cellular Networks: A Critical Path to Beyond-5G and 6G
Shafin, R., Liu, L., Chandrasekhar, V., Chen, H., Reed, J. H., & Zhang, J. C. (2020) · IEEE Wireless Communications · doi:10.1109/mwc.001.1900323 · Cited by 309 · see citing works
Self-citationDistributed Control and Communication Strategies in Networked Microgrids
Zhou, Q., Shahidehpour, M., Paaso, E. A., Bahramirad, S., Alabdulwahab, A., & Abusorrah, A. M. (2020) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2020.3023963 · Cited by 313 · see citing works
“Edge computing realizes an efficient utilization of available computation resources, which provides a promising solution to support computation-intensive artificial intelligence (AI) applications in NMGs [473].”
BackgroundA survey on computation offloading modeling for edge computing
Lin, H., Zeadally, S., Chen, Z., Labiod, H., & Wang, L. (2020) · Journal of Network and Computer Applications · doi:10.1016/j.jnca.2020.102781 · Cited by 313 · see citing works
Autonomous Vehicles Enabled by the Integration of IoT, Edge Intelligence, 5G, and Blockchain
Biswas, A., & Wang, H.-C. (2023) · Sensors · doi:10.3390/s23041963 · Cited by 289 · see citing works
“This does not imply that all the training and inference of the model will be carried out on the edge but it should be able to work in cloud–device–edge coordination via data offloading [103].”
BackgroundInfluentialA Survey on Intelligent Internet of Things: Applications, Security, Privacy, and Future Directions
Aouedi, O., Vu, T.-H., Sacco, A., Nguyen, D. C., Piamrat, K., Marchetto, G., & Pham, Q. (2024) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2024.3430368 · Cited by 318 · see citing works
Edge Intelligence: Empowering Intelligence to the Edge of Network
Xu, D., Li, T., Li, Y., Su, X. J., Tarkoma, S., Jiang, T., Crowcroft, J., & Hui, P. (2021) · Proceedings of the IEEE · doi:10.1109/jproc.2021.3119950 · Cited by 281 · see citing works
Deep learning for edge computing applications: A State-of-the-Art survey
Wang, F., Zhang, M., Wang, X., Ma, X., & Liu, J. (2020) · IEEE Access · doi:10.1109/access.2020.2982411 · Cited by 259 · see citing works
“[13] mainly focused on the deep learning model training and inference with edge computing.”
BackgroundYang, Q., Liu, Y., Cheng, Y., Kang, Y., Chen, T., & Yu, H. (2019) · Synthesis lectures on artificial intelligence and machine learning · doi:10.2200/s00960ed2v01y201910aim043 · Cited by 397 · see citing works
Deep Learning in Smart Grid Technology: A Review of Recent Advancements and Future Prospects
Massaoudi, M., Abu‐Rub, H., Refaat, S. S., Chihi, I., & Oueslati, F. S. (2021) · IEEE Access · doi:10.1109/access.2021.3071269 · Cited by 260 · see citing works
“EI coordinates a set of connected edge IoT devices that are used for data collection, caching, processing, and analysis based on AI [147].”
MethodBourechak, A., Zedadra, O., Kouahla, M. N., Guerrieri, A., Séridi, H., & Fortino, G. (2023) · Sensors · doi:10.3390/s23031639 · Cited by 295 · see citing works
“It has been proven that the FRL approach improves the computational efficiency compared to the centralized training mode and normal federated learning (FL) [2].”
BackgroundEdge Intelligence in Intelligent Transportation Systems: A Survey
Gong, T., Zhu, L., Yu, F. R., & Tang, T. (2023) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2023.3275741 · Cited by 282 · see citing works
“According to [1], the wide deployment of EI requires the close cooperation of AI software providers, EI platform providers, network operators, edge equipment providers, data providers, and service consumers during deployment.”
BackgroundMethodInfluentialTang, X., Cao, C., Wang, Y., et al. (2021) · China Communications · doi:10.23919/jcc.2021.02.011 · Cited by 245 · see citing works
“environment that can obtain wireless network information in real time, so as to provide differentiated services for terminal users [12].”
BackgroundAn Efficiency-Boosting Client Selection Scheme for Federated Learning With Fairness Guarantee
Huang, T., Lin, W., Wu, W., He, L., Li, K., & Zomaya, A. Y. (2020) · IEEE Transactions on Parallel and Distributed Systems · doi:10.1109/tpds.2020.3040887 · Cited by 294 · see citing works
Zhu, G., Lyu, Z., Jiao, X., Liu, P., Chen, M.-Z., Xu, J., Cui, S., & Zhang, P. (2022) · Science China Information Sciences · doi:10.1007/s11432-022-3652-2 · Cited by 263 · see citing works
Privacy for Free: Wireless Federated Learning via Uncoded Transmission With Adaptive Power Control
Liu, D., & Simeone, O. (2021) · IEEE Journal on Selected Areas in Communications · doi:10.1109/jsac.2020.3036948 · Cited by 234 · see citing works
Tan, L., Kuang, Z., Zhao, L. Y., & Liu, A. (2021) · IEEE Transactions on Wireless Communications · doi:10.1109/twc.2021.3108641 · Cited by 232 · see citing works
“In order to effectively meet the high bandwidth and low latency required by the rapid development of mobile Internet and IoTs, mobile computing has changed from centralized mobile cloud computing to Mobile Edge Computing (MEC) [1]–[3].”
BackgroundClient Selection for Federated Learning With Non-IID Data in Mobile Edge Computing
Zhang, W., Wang, X., Zhou, P., Wu, W., & Zhang, X. (2021) · IEEE Access · doi:10.1109/access.2021.3056919 · Cited by 234 · see citing works
“To obtain useful information from big data in IoT, machine learning techniques are often applied [5]–[7].”
MethodDecentralized AI: Edge Intelligence and Smart Blockchain, Metaverse, Web3, and DeSci
Cao, L. (2022) · IEEE Intelligent Systems · doi:10.1109/mis.2022.3181504 · Cited by 230 · see citing works
Microgrid Digital Twins: Concepts, Applications, and Future Trends
Bazmohammadi, N., Madary, A., Vasquez, J. C., Mohammadi, H. B., Khan, B., Wu, Y., & Guerrero, J. M. (2022) · IEEE Access · doi:10.1109/access.2021.3138990 · Cited by 233 · see citing works
“• To reduce the data transmission latency and high bandwidth requirements and to enhance data privacy, edge intelligence (implementing the AI at the network edge) is recognized as a promising solution to perform data analysis in the proximity of the data source [49].”
BackgroundGiuffrida, G., Fanucci, L., Meoni, G., Batič, M., Buckley, L., Dunne, A. K., van Dijk, C., Esposito, M., Hefele, J., Vercruyssen, N., et al. (2021) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2021.3125567 · Cited by 231 · see citing works
“link bandwidth by transmitting to ground only useful data or only meta-information [27], [28].”
BackgroundLiang, Y., Samtani, S., Guo, B., & Yu, Z. (2020) · IEEE Internet of Things Journal · doi:10.1109/jiot.2020.3004077 · Cited by 221 · see citing works
Optimal UAV Caching and Trajectory in Aerial-Assisted Vehicular Networks: A Learning-Based Approach
Wu, H., Lyu, F., Zhou, C., Chen, J., Wang, L., & Shen, X. (2020) · IEEE Journal on Selected Areas in Communications · doi:10.1109/jsac.2020.3005469 · Cited by 213 · see citing works
“trajectory optimization (JCTO) problem is intractable directly and timely due to the coupling of variables, we propose a learning-based scheme named LB-JCTO to enable edge intelligence (EI) [18] and make real-time decisions in the highly dynamic vehicular environments.”
MethodFAIR: Quality-Aware Federated Learning with Precise User Incentive and Model Aggregation
Deng, Y., Lyu, F., Ren, J., Chen, Y., Yang, P., Zhou, Y., & Zhang, Y. (2021) · IEEE Conference on Computer Communications (INFOCOM) · doi:10.1109/infocom42981.2021.9488743 · Cited by 224 · see citing works
“With the rapid development of Internet of Things (IoT), a large amount of data is continuously generated at the network edge, which provides opportunities to enable learningbased intelligent services [1]–[3].”
BackgroundTask-Oriented Communication for Multidevice Cooperative Edge Inference
Shao, J., Mao, Y., & Zhang, J. (2023) · IEEE Transactions on Wireless Communications · doi:10.1109/twc.2022.3191118 · Cited by 209 · see citing works
Self-citationResearch on Artificial Intelligence Enhancing Internet of Things Security: A Survey
Wu, H., Han, H., Wang, X., & Sun, S. (2020) · IEEE Access · doi:10.1109/access.2020.3018170 · Cited by 221 · see citing works
“Edge AI chip [97] is a chip that can perform or accelerate machine”
BackgroundNing, H., Yu, Z., Zhang, Q., Wen, H., Gao, B., Mao, Y., Li, Y., Zhou, Y., Zhou, Y., Chen, J., et al. (2023) · Nature Nanotechnology · doi:10.1038/s41565-023-01343-0 · Cited by 198 · see citing works
Zhang, X., Cao, Z., & Dong, W. (2020) · IEEE Access · doi:10.1109/access.2020.3013005 · Cited by 212 · see citing works
“According to the introduction of [26], the author summarizes the framework of edge intelligence, which includes the edge-basedmode, device-basedmode, edge-devicemode, and edge-cloud mode, as shown in Fig.”
BackgroundMethodEmpowering Edge Intelligence: A Comprehensive Survey on On-Device AI Models
Wang, X., Tang, Z., Guo, J., Meng, T., Wang, C., Wang, T., & Weijia Jia, B. (2025) · ACM Computing Surveys · doi:10.1145/3724420 · Cited by 230 · see citing works
“Through a review and analysis of relevant literature, this paper provides researchers and engineers with a clear perspective to help them understand the key issues and solutions related to on-device AI models.”
Influential6G-Enabled Edge AI for Metaverse: Challenges, Methods, and Future Research Directions
Chang, L., Zhang, Z., Li, P., Xi, S., Guo, W., Shen, Y., Xiong, Z., Kang, J., Niyato, D. T., Qiao, X., et al. (2022) · Journal of Communications and Information Networks · doi:10.23919/jcin.2022.9815195 · Cited by 204 · see citing works
EC-SAGINs: Edge-Computing-Enhanced Space–Air–Ground-Integrated Networks for Internet of Vehicles
Yu, S., Gong, X., Shi, Q., Wang, X., & Chen, X. (2022) · IEEE Internet of Things Journal · doi:10.1109/jiot.2021.3052542 · Cited by 201 · see citing works
“Edge computing [2] is a state-of-the-art computing paradigm by moving the cloud computing services and resources closer to end users, in order to achieve high data rates, saved bandwidth resources and improved the quality of service (QoS) for real-time services.”
BackgroundMethodInfluentialSelf-citationLiu, J. B., Xiang, J., Jin, Y., Liu, R., Yan, J., & Wang, L. (2021) · Remote Sensing · doi:10.3390/rs13214387 · Cited by 195 · see citing works
Friha, O., Ferrag, M. A., Kantarcı, B., Çakmak, B., Ozgun, A., & Ghoualmi‐Zine, N. (2024) · IEEE Open Journal of the Communications Society · doi:10.1109/ojcoms.2024.3456549 · Cited by 209 · see citing works
Task-Oriented Communications for 6G: Vision, Principles, and Technologies
Shi, Y., Zhou, Y. H., Wen, D., Wu, Y., Jiang, C., & Letaief, K. B. (2023) · IEEE Wireless Communications · doi:10.1109/mwc.002.2200468 · Cited by 199 · see citing works
“By splitting deep neural networks (DNN) between edge devices and servers and leveraging the sensing and computation capabilities of edge devices, edge model inference is able to deliver real-time, private, and secure intelligent services [3].”
BackgroundBaccour, E., Mhaisen, N., Abdellatif, A. A., Erbad, A., Mohamed, A. M. S., Hamdi, M., & Guizani, M. (2022) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2022.3200740 · Cited by 209 · see citing works
“The surveys in [69], [70], [71], [72], [73], [74] conducted”
BackgroundA review of edge computing: Features and resource virtualization
Mansouri, Y., & Babar, M. A. (2021) · Journal of Parallel and Distributed Computing · doi:10.1016/j.jpdc.2020.12.015 · Cited by 190 · see citing works
Edge Computing in Healthcare: Innovations, Opportunities, and Challenges
Rancea, A., Anghel, I. M., & Cioara, T. (2024) · Future Internet · doi:10.3390/fi16090329 · Cited by 227 · see citing works
“Efficient tools to protect data privacy and security at the edge are lacking, and the dynamic environment of edge networks adds to their vulnerability [14,19].”
BackgroundEdge QoE: Computation Offloading With Deep Reinforcement Learning for Internet of Things
Lu, H., He, X., Du, M., Ruan, X., Sun, Y., & Wang, K. (2020) · IEEE Internet of Things Journal · doi:10.1109/jiot.2020.2981557 · Cited by 175 · see citing works
“ity of coding error probability [13].”
A survey on deep learning for cybersecurity: Progress, challenges, and opportunities
Macas, M., Wu, C., & Fuertes, W. (2022) · Computer Networks · doi:10.1016/j.comnet.2022.109032 · Cited by 192 · see citing works
Machine learning for next-generation intelligent transportation systems: A survey
Yuan, T., Da Rocha Neto, W., Rothenberg, C. E., Obraczka, K., Barakat, C., & Turletti, T. (2022) · Transactions on Emerging Telecommunications Technologies · doi:10.1002/ett.4427 · Cited by 179 · see citing works
“This is largely due to the breakthroughs in edge computing that have enabled ML on edge- and end user devices [247].”
BackgroundWaqar, N., Hassan, S. A., Mahmood, A., Dev, K., Do, D., & Gidlund, M. (2022) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2022.3179987 · Cited by 176 · see citing works
“To address this challenge, recent trends involve offloading these computation-intensive tasks to network edges [3].”
BackgroundBringing ai to edge: from deep learning’s perspective
Liu, D., Kong, H., Luo, X., Liu, W., & Subramaniam, R. (2022) · Neurocomputing · doi:10.1016/j.neucom.2021.04.141 · Cited by 171 · see citing works
“Considering the anticipated emergence of numerous edge intelligence systems in the next years [13], this motivates us to comprehensively review the”
BackgroundWireless Powered Mobile Edge Computing Networks: A Survey
Wang, X., Li, J., Ning, Z., Song, Q., Guo, L., Guo, S., & Obaidat, M. S. (2023) · ACM Computing Surveys · doi:10.1145/3579992 · Cited by 171 · see citing works
Review of Lightweight Deep Convolutional Neural Networks
Chen, F., Li, S., Han, J., Ren, F., & Yang, Z. (2023) · Archives of Computational Methods in Engineering · doi:10.1007/s11831-023-10032-z · Cited by 172 · see citing works
“[13, 14, 16] mainly emphasized EI and the relationship between edge computing and intelligent applications.”
Communication-Computation Trade-off in Resource-Constrained Edge Inference
Shao, J., & Zhang, J. (2020) · IEEE Communications Magazine · doi:10.1109/mcom.001.2000373 · Cited by 162 · see citing works
“While communication-efficient methods for edge training have received significant attention [ 3], the counterpart on edge inference is less well investigated.”
BackgroundSelf-citationToward Self-Learning Edge Intelligence in 6G
Xiao, Y., Shi, G., Li, Y., Saad, W., & Poor, H. V. (2020) · IEEE Communications Magazine · doi:10.1109/mcom.001.2000388 · Cited by 158 · see citing works
“Edge intelligence is commonly considered to be one of the key missing components in 5G [5] and is well recognized as a major enabler for 6G to unleash the full potential of ”edge-native AI” and bring network intelligentization [6, 7].”
BackgroundYOLO with adaptive frame control for real-time object detection applications
Lee, J., & Hwang, K. (2021) · Multimedia Tools and Applications · doi:10.1007/s11042-021-11480-0 · Cited by 166 · see citing works
Zeng, L., Li, E., Zhou, Z., & Chen, X. (2019) · IEEE Network · doi:10.1109/mnet.001.1800506 · Cited by 159 · see citing works
“[6] Z.”
BackgroundSelf-citationIntelligent Cooperative Edge Computing in Internet of Things
Gong, C., Lin, F., Gong, X., & Lu, Y. (2020) · IEEE Internet of Things Journal · doi:10.1109/jiot.2020.2986015 · Cited by 158 · see citing works
“[27] proposed the definition of edge intelligence (EI) and discussed the possibility of deploying the currently popular deep learning framework to the network edge.”
BackgroundLyapunov-Guided Delay-Aware Energy Efficient Offloading in IIoT-MEC Systems
Wu, H., Chen, J., Nguyen, T. N., & Tang, H. (2022) · IEEE Transactions on Industrial Informatics · doi:10.1109/tii.2022.3206787 · Cited by 157 · see citing works
“Mobile edge computing (MEC), where data processing can be implemented at edge nodes, can better support the real-time intelligent execution of IIoT services [8].”
BackgroundCollaborative Data Scheduling for Vehicular Edge Computing via Deep Reinforcement Learning
Luo, Q., Li, C., Luan, T. H., & Shi, W. (2020) · IEEE Internet of Things Journal · doi:10.1109/jiot.2020.2983660 · Cited by 158 · see citing works
“Good at abstracting many factors that affect the VEC environment to a mapping problem and learning optimal resource allocation strategy from the environment, deep reinforcement learning (DRL) is becoming a research hotspot to solve the resource allocation problem [12], [13].”
BackgroundTaha, M. F., Mao, H., Zhang, Z., ElMasry, G. M., Awad, M. A., Abdalla, A., Mousa, S., Elwakeel, A. E., & Elsherbiny, O. (2025) · Agriculture · doi:10.3390/agriculture15060582 · Cited by 180 · see citing works
Enabling AI in Future Wireless Networks: A Data Life Cycle Perspective
Nguyen, D. C., Cheng, P., Ding, M., Lopez-Perez, D., Pathirana, P. N., Li, J., Seneviratne, A., Li, Y., & Poor, H. V. (2021) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2020.3024783 · Cited by 160 · see citing works
“The benefits of ML for solving data-driven wireless issues such as data sensing, data access, and user device intelligence have not been explored.”
BackgroundBruce Lee-Inspired Fluid Antenna System: Six Research Topics and the Potentials for 6G
Wong, K., Tong, K., Shen, Y., Chen, Y., & Zhang, Y. (2022) · Frontiers in Communications and Networks · doi:10.3389/frcmn.2022.853416 · Cited by 155 · see citing works
Gradient Statistics Aware Power Control for Over-the-Air Federated Learning
Zhang, N., & Tao, M. (2021) · IEEE Transactions on Wireless Communications · doi:10.1109/twc.2021.3065748 · Cited by 153 · see citing works
“This emerging technology is known as Edge Machine Learning [2] or Edge Intelligence [3].”
MethodEdge-Cloud Polarization and Collaboration: A Comprehensive Survey for AI
Yao, J., Zhang, S., Yao, Y., Wang, F., Ma, J., Zhang, J., Chu, Y., Ji, L., Jia, K., Shen, T., et al. (2022) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2022.3178211 · Cited by 156 · see citing works
“Edge-cloud collaborative modeling has received significant interest across separate research communities due to the recent privacy concerns, the latency requirements or the personalization [6].”
BackgroundInfluentialSelf-citationAn Anonymous Batch Authentication and Key Exchange Protocols for 6G Enabled VANETs
Vijayakumar, P., Maria, A., Kozlov, S. A., & Rodrigues, J. J. P. C. (2021) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2021.3099488 · Cited by 151 · see citing works
Edge deep learning in computer vision and medical diagnostics: a comprehensive survey
Xu, Y., Khan, T. M., Song, Y., & Meijering, E. H. W. (2025) · Artificial Intelligence Review · doi:10.1007/s10462-024-11033-5 · Cited by 174 · see citing works
Tallat, R., Hawbani, A., Wang, X., Al‐Dubai, A., Zhao, L., Liu, Z., Min, G., Zomaya, A. Y., & Alsamhi, S. H. (2023) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2023.3329472 · Cited by 159 · see citing works
“As a result of this, the future evolution of intelligence is inextricably linked to networking [82].”
BackgroundEdge Intelligence for Internet of Vehicles: A Survey
Yan, G., Liu, K., Liu, C., & Zhang, J. (2024) · IEEE Transactions on Consumer Electronics · doi:10.1109/tce.2024.3378509 · Cited by 154 · see citing works
“At its core, VEI leverages the concept of edge intelligence into vehicular environments, which allows deploying AI models and algorithms closer to the edge of the network, especially within the vehicles themselves or at the nearby infrastructures [10], [21].”
BackgroundMethodSelf-citation
- Authors
- Zhou, Z., Chen, X., Li, E., Zeng, L., Luo, K., & Zhang, J.
- Affiliations
- Sun Yat-sen University (CN)
- Arizona State University (US)
- Venue
- Proceedings of the IEEE
- Published
- 2019-08
- Volume
- 107
- Issue
- 8
- Pages
- 1738-1762
- ISSN
- 0018-9219 (ISSN-L)
- 1558-2256
- OpenAlex
- W2950865323
- Semantic Scholar
- 928cd808aba140ec298508df87c5579811ff2f41
- Cited by
- 2,455
- References
- 168
- Citations by year
- 2026: 455 · 2025: 352 · 2024: 332 · 2023: 363 · 2022: 370 · 2021: 341 · 2020: 215 · 2019: 26 · 2012: 1
- FWCI
- 130.23
- Type
- journal article
- Language
- en
- Open access
- bronze
- doi.org
- Locations
- Proceedings of the IEEE (publishedVersion)
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- Funders
- National Basic Research Program of China (2017YFB1001703)
- National Natural Science Foundation of China (U1711265, 61802449)
- Program for Guangdong Introducing Innovative and Entrepreneurial Teams (2017ZT07X355)
- Guangdong Natural Science Funds (2018A030313032)
- Fundamental Research Funds for the Central Universities (17lgjc40)
- Army Research Office (W911NF-16-1-0448)
- Defense Threat Reduction Agency (HDTRA1-13-1-0029)
- Topics
- Physical Sciences › Computer Science › Computer Networks and Communications › IoT and Edge/Fog Computing
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Neural Network Applications
- Physical Sciences › Computer Science › Information Systems › Internet of Things and AI
- Keywords
- edge AI, edge computing, edge computing architecture, deep learning training, deep learning inference, Internet of Things, mobile computing
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Claims read by deepseek-v4.1-flash under definition version 3 (extract-v3) on 2026-10-11.
Classified by jev-1.13-20260917 (gold-guideline-v0.2) on 2026-10-11.
Cited sources are checked by gpt-6-sol.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review