A Review on Edge Large Language Models: Design, Execution, and Applications

Zheng, Yue, Chen, Yuhao, Qian, Bin, Shi, Xiufang, Shu, Yuanchao, Chen, Jiming·2025·ACM Computing Surveys

Cited by (171)

Items 101–171 of 171

  1. A survey on edge multimodal large models: Compression, inference acceleration, and applications
    Siru Chen, Yuanchao Shu, Cong Wang, Jiming Chen · 2026 · National Science Open
  2. AI-Powered Authentication and Access Control in IoT for Autonomous Vehicles
    Siva Raja Sindiramutty, Basheer Riskhan · 2026 · Advances in computational intelligence and robotics book series
  3. Research on NL2SQL in the logistics field based on large language models under resource constraints
    Hailong Jiang, Mengyuan Zhu, Qian Zhang, Guangpei Zhong, Guoqing Li · 2025 · International Conference on Big Data, Artificial Intelligence and Risk Management (ICBAR)
  4. Xrbit: Toward Breaking the Thermodynamic Wall of Persistent LLMs in Mobile XR
    Haneol Kim, Jonghwan Bae, Seo-Woo Shin, Sanghun Park · 2026 · 2026 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops (VRW)
  5. Superintelligent NLP at the Edge: AI-Driven Cloud-Orchestrated Realtime Cognitive Interfaces
    Phani Rohitha Kaza · 2026 · IEEE International Conference on Emerging Computing and Intelligent Technologies (ICoECIT)
  6. GQoD: Group-aware quantization for efficient layer-wise pipelined inference of Multi-Exit BERT on end devices
    Zonglin Zou, Jinghui Zhang, Wei Zhang, Weilong Xin, Ding Ding, Jiahui Jin · 2026 · Journal of Systems Architecture
  7. A lightweight model RDMSegNet enabling UAV-Based high-resolution mapping of Sonneratia apetala for mangrove ecosystem ecological monitoring
    Ziheng Zhang, Kai Liu, Wenwei Li, Jingjing Cao, Xin Wen, Chuying Yu, Haojian Deng, Zhe Xiang, Yuanhui Zhu · 2026 · International Journal of Remote Sensing
  8. ADLGen: Synthesizing Symbolic, Event-Triggered Sensor Sequences for Smart-Home Human Activity Modeling
    Weihang You, Hanqi Jiang, Jiahui Li, Zishuai Liu, Tianming Liu, Jin Lu, Fei Dou · 2026
  9. LLMSEG: Semantic Segmentation and Few-Shot Recognition of Human Activity Recognition Data Using Large Language Models
    Jiashu Liu, Kevin Post, Reo Kuchida, Agustin Zuniga, Fatemeh Sarhaddi, Huber Flores, Petteri Nurmi, Ngoc Thi Nguyen · 2026
  10. RVLLM-Bench: A Comprehensive Benchmark for Large Language Model Inference with RISC-V Vector Extension
    Zhilu Pan, Xiaofeng Zou, Panfeng Chen, Mei Chen, Hui Li, Yue Wang · 2026 · Lecture notes in computer science
  11. GraphDelta: A distributed incremental framework for efficient dynamic graph computing in edge intelligence
    Mengsi He, Zhongming Fu, Xiong Xiao, Xin Eric Wang, Zhuo Tang · 2026 · Journal of Systems Architecture
  12. PC-FT: A Lightweight and Utility-Preserving Private Fine-Tuning Framework for Edge-Based Agentic AI
    Peisheng Zhang, Renao Zhang, Zefang Lv, Qing Fan, Shuai Yuan, Zhitao Guan · 2026 · IEEE Transactions on Network Science and Engineering
  13. A Theoretical Evaluation of Distributed Large Language Model Inference on a Raspberry Pi 5 Edge Cluster
    Theodor-Radu Grumeza, Grigore-Liviu Staniloiu, Alexandra Fortis · 2026 · Lecture notes on data engineering and communications technologies
  14. Effective Lightweight Language Models for Edge Deployment in Low-Resource Settings
    Shivam Panjolia, Akash Chaudhary, Parth Yadav, Enjula Uchoi, Jobanpreet Singh, Kanika Debbarma · 2026 · International Conference on Intelligent Systems in Engineering, Secured Systems and Cybersecurity (ICISESSC)
  15. Adaptive Edge-LLMs: Unifying Compression, Distillation, and Federated Learning for IoT
    Keshav Gaur, Badiea Abdulkarem Mohammed, Lalit Kumar, Varun Shukla, Manoj Kumar Misra, Mehul Kumar Das · 2026 · International Conference on Intelligent Systems in Engineering, Secured Systems and Cybersecurity (ICISESSC)
  16. Agentenbasierte Fahrgastinformationssysteme für den ÖPNV
    Michael Palk, Stefan Voß · 2026 · HMD Praxis der Wirtschaftsinformatik
  17. From Reactive Scheduling to Adaptive Coordination: A Predictive - Cognitive System for Resource‑Aware Task Placement in Edge Environments
    Dinesh Kumar Karthikeyan, Tommi Mikkonen, Niko Mäkitalo · 2026 · SSRN Electronic Journal
  18. An Edge–Cloud Collaborative ECG-Assisted Diagnostic System Leveraging Cross-Lead Knowledge Distillation and Large Language Models
    Haohan Su, Shuai Wang, Hongxiao Wang, Keni Qiu · 2026 · Sensors
  19. CogGuard: Cognitive and Operational Profiling for Proactive Warning in Edge Intelligent Services
    Zhi Yao, Weihao Chen, Zhiqing Tang, Hanshuai Cui, Q L Ma, Weijia Jia, Wei Zhao · 2026 · IEEE International Conference on Web Services (ICWS)
  20. Empirical Study of Process Reward-Guided Model Ensemble for Edge Reasoning
    Yide Liu, Yuqi Wu, Shengming Zhao, Tianyi Ye, Jie Chen · 2026 · IEEE International Symposium on Circuits and Systems proceedings
  21. Communication-efficient agentic edge intelligence: A survey of federated multi-agent information fusion for LLM-driven edge AI
    Omar Dib · 2026 · Information Fusion
  22. Joint Optimization of Secure and Energy Efficient Retrieval Augmented Generation for Mobile Edge Computing
    Chang Liu, Liangxin Qian, Chaitanya Dhananjay Jadhav, J Z Zhao · 2026 · IEEE Conference on Computer Communications (INFOCOM)
  23. A Cloud-Edge Collaborative System for Efficient LLM Fine-Tuning with Backbone Activation Caching
    Yuchu Chen, Yingchi Mao, Si Chen, Rongzhi Qi, Tianfu Pang, Zhenxiang Pan · 2026 · IEEE Conference on Computer Communications (INFOCOM)
  24. Latency-Aware Co-Design Framework for ARM– NPU Heterogeneous Edge Architectures, Enabling Real-Time Speech Recognition with Deterministic Timing Guarantees
    Mallareddy Adudhodla, Prudhivi Pranav, Dasari Akshith Reddy, Kodati Naga Venkata Sai Teja, Pavan Kumar Reddy Manellore · 2026 · International Conference on Inventive Computing and Informatics (ICICI)
  25. Performant and Small: Can We Have Both? SLMs on Mobile Devices for Healthcare Chatbots
    Aqila Farahmand, Sara Montagna, Alessandro Bogliolo, Stefano Ferretti, Matteo Magnini · 2026 · IEEE International Conference on Pervasive Computing and Communications Workshops (PerCom Workshops)
  26. Conceptualising local AI infrastructure using small language models (SLMs) for primary education
    Misbah Zulfiqar, Umair Iqbal · 2026 · Frontiers in the Internet of Things
  27. Co-Optimizing Request Scheduling and KV Caching for Edge LLM Serving
    Xishuo Li, Wei Jiao, Junyi He, Shan Zhang · 2026 · IEEE Internet of Things Journal
  28. Representation Paradigms in AI-based 3D Radiological Image Reconstruction: A Literature Review
    Yanrong Yang, Lei Bi, Boyu Yang, Yi Wang, Yang He, Yige Peng, Zhe Jin, Xingbo Dong, Jinman Kim · 2026 · Research Square
  29. BGSG: A Bi-Level Genetic Algorithm to Stackelberg Diagnosis Game for Edge Service Performance Monitoring
    Shengli Pan, Kouichi Sakurai, Ying‐Chang Liang · 2026 · IEEE Transactions on Cloud Computing
  30. Generative AI at the Edge: A Comprehensive Survey of Architectures, Hardware and Applications
    Mozhgan Navardi, Yuzhe Fu, Yueqian Lin, Hai Helen Li, Yiran Chen, Tinoosh Mohsenin · 2026 · ACM Computing Surveys
  31. Characterizing Prefill and Decode Regimes for Edge LLM Inference
    Jonas Scheffler, Stefan Naumann, Florian Mohr, Lejla Begic Fazlic · 2026 · International Convention on Information and Communication Technology, Electronics and Microelectronics
  32. Hardware-software co-design for edge computing in bridge monitoring: Heterogeneous multi-MCU architecture with Q-Learning augmented PSO
    Yuliang Lu, Min Liu, Hua Li, Xiang Chen, Songrong Qian · 2026 · Internet of Things
  33. A Privacy-Preserving On-Device Multi-Agent Architecture for AI PC (POMA) Workflow Automation
    Sultana Begum, Michael Rosenzweig · 2026 · IEEE International Conference on AI and Data Analytics (ICAD)
  34. A Bibliometric Review of Emerging Trends and Strategic Mapping of Defense Mechanisms in Large Language Models from 2024 to 2026
    Sebastián Vargas Yáñez, Sergio Tobón · 2026 · Research Square
  35. A Survey of Dynamic Token Computation in Transformers: Taxonomy, Stability, and Budget-Aware Evaluation
    Abuzar Khan, Ahmad Junaid, Abid Iqbal, Ghassan Husnain, Wonseop Shin, Sangsoon Lim · 2026 · IEEE Access
  36. Real-time Intelligent Identification of UAV RF Fingerprints Based on YOLO26 and Embedded System Validation
    Hanqing Xue, Rongkai Qie, Chao Chen, Qibin He, Peng Wang, Xiaoming Dou, Lingxi Guo, Haiwen Sun · 2026 · International Conference on Control and Automation
  37. In-Browser Split Inference for Autoregressive Large Language Models With Activation Quantization
    Yuseong Lee, Yeohn-Shik Choee, Seung-Hyun Lee, Soonchul Kwon · 2026 · IEEE Access
  38. Diffusion Language Models for Mobile Edge Agentic AI: Foundations, Applications, and Challenges
    Chenqi Li, Minghui Min, Dusit Niyato, Wei Ni · 2026 · Research Square
  39. LLM-Driven Context-Aware Health Monitoring for Resource-Constrained Edge Devices
    Ioannis Tzitzios, Asimina Dimara, Georgiana Petridou, Ioannis Kostavelis, Stelios Krinidis · 2026 · Electronics
  40. A CIM-Aware Roofline Framework for Evaluating Compute-in-Memory Adaptation in Large Language Model Inference
    Liqiu Ma, Jingdi Liu, Xiaotao Li · 2026 · International Conference on Computer Communication and Artificial Intelligence (CCAI)
  41. A workflow-aligned multimodal framework for interpretable breast cancer diagnosis and molecular subtyping
    Weiyi Zhao, Lv Chen, Weiyu Pu, Liang Liu, Xiaoyu Tan, Sijia Li, Xihe Qiu, Jia Fan, Miao Zhu, Zhenglin Wang · 2026 · Expert Systems with Applications
  42. Knowledge Accuracy and Response Characteristics of an On-Device Large Language Model in Building Environmental Engineering: a Preliminary Case Study of EXAONE 4.0 1.2B Using ChatGPT-4o as a Cloud Reference
    Chang-Heon Cheong, Jeong-Hoon Lee · 2026 · Architectural research
  43. The Deviation and Influencing Factors of Self Personality Cognition and Social Media Behavior among Young People
    Lihao Zhang · 2026 · SHS Web of Conferences
  44. Application-Level Feasibility of on-Device AI for Mobile Applications
    Aqila Akther Siddiquee, Abu Baker, Md Abrar Hamim, Antu Chowdhury · 2026 · International Conference on Circuit, Systems and Communication (ICCSC)
  45. Local LLMs as a plasticity layer for fixed cloud LLMs
    Kei Itoh · 2026 · Discover Artificial Intelligence
  46. Ygg: Tree-Based Collaborative Speculative Decoding with Token-Only Transmission
    Sijia Li, Yumeng Liang, Ruiqi Li, Jianjiang Li, Jie Wu · 2026 · International Workshop on Quality of Service
  47. Federated Learning for Large Language Models: Opportunities, Challenges, and Open Research Directions
    Fatiha Ait Baali, Chaima Lhasnaoui, Addi Ait‐Mlouk, Tarik Agouti · 2026 · Machine Learning
  48. Talk, See, Support (TSS): A Wearable Multimodal, Intelligent, Agentic LLM-Powered Construction Assistant for Real-Time On-Site Guidance and Compliance Monitoring
    Oscar Poudel, Mohamad Assaf, Rayan H. Assaad, Mohamad Awada · 2026 · ASCE Construction Research Congress (CRC)
  49. NavAI: an application-agnostic llm framework for navigation tasks in virtual reality environments
    Jiajie Wang, Sumesh Surendran Letha, Matthew G Digiovanni, Kebin Peng, Sen He · 2026 · Automated Software Engineering
  50. Design and Implementation of a Large Language Model-Based Smart Assistant to Support Daily Activities
    Steven Johan Sutantio, Owen Theodore Yosephus, Steven Bandong · 2026 · IEEE International Conference on Instrumentation, Networks, Future Sustainability, Information Theory, Transportation, and Systems (INFINITYS)
  51. DualTeach: Disagreement-Aware Dual-Teacher Distillation for Reliable Agentic Services
    Kamyar Taeb, Wei Emma Zhang, Parimehr Morassa Far, Alireza Shammasi, Ali Shahsavandi, Mohammadhossein Ahmadi, Anthony Shaw, Amin Beheshti · 2026 · IEEE International Conference on Web Services (ICWS)
  52. SG-LR QoS: Sparse-Gating and Layered Low-Rank Based Lightweight QoS Monitoring for Multi-Tenant Clouds
    Pengwei Liu, Minxian Xu, Jiongjiong Gu, Chuanfei Xu, Weipeng Cao, Zhong Ming · 2026 · IEEE International Conference on Web Services (ICWS)
  53. Large or Small? Cloud or Edge? Investigating the Use of Language Models for Smart Drone Services
    Peilin He, Xiao Liu, Jia Xu, Jonathan Kua, Disen Jia · 2026 · IEEE International Conference on Web Services (ICWS)
  54. Service Integrity of LLM-Driven Edge Web Services Under Semantic Backdoor Attacks
    Chun Yun Wang, Wei Emma Zhang, Zhigang Lu, Yan Meng, Shuchao Pang, Quan Z. Sheng · 2026 · IEEE International Conference on Web Services (ICWS)
  55. Low-Resource SLM Models for Elastic Semantic Search
    Stoyan Cheresharov, Georgi Gustinov, Veneta Veselinova Tabakova-Komsalova, Ivan Stoyanov, Penyo Georgiev · 2026 · Electronics
  56. Latency Optimization of Cascaded Voice Dialogue Systems with a Pipeline-Parallel Streaming Architecture
    Haihua Mo, Zhengyou Liang · 2026 · International Conference on Intelligent Systems and Robotics (CISR)
  57. Using Multimodal Large Language Models for False Alarm Reduction in Image-Based Fire Detection
    Qie Gao, Haihui Wang, Zhenhai Qin, Linhao Fan, Kang Li, Chong Wang, Qixing Zhang · 2026 · Fire Technology
  58. Latent-CURE: Interpretable Breast Cancer Diagnosis via Dual-Asymmetric Chain-of-Thought
    Weiyi Zhao, Xiaoyu Tan, Lu Gan, Liang Liu, Xihe Qiu · 2026 · Lecture notes in computer science
  59. Toward Industrial World Models: A Review of Multimodal Fusion for Time Series and Text in IIoT
    Chong Chen, Weisong Chen, Tao Wang, Zhuowei Wang, Zhuyun Chen, Haidong Shao, Jiewu Leng · 2026 · IEEE Internet of Things Journal
  60. Towards robust privacy unlearning in edge-hosted large language models via attack-aware preference optimization
    Shuhan Yang, Peng Chen, Rongzhen Li, Shijing Hu, Hengqi Guo, Simon Fong, Qiang Duan · 2026 · Journal of Systems Architecture
  61. SLM-Driven Schema Evolution for IoT Data Streams
    Filip Stamenkovic, Dušan Mitrović, Stanojević Jelica, Petar Ilić, Ivan Milenković · 2026 · Communications in computer and information science
  62. Comparative Evaluation of GGUF and GPTQ Quantization for Llama 3.1 Inference on x86 and ARM Architectures
    Setiawan Budiman, Siti Rochimah, Siahaan Daniel · 2026 · International Electronics Symposium (IES)
  63. ALPS: An Application-Aware, Length-Predictive Scheduler for Efficient LLM Inference at Edge
    Chen Chen, Lei Jiao, Richard Mortier · 2026 · IEEE Transactions on Parallel and Distributed Systems
  64. Cost-effective on-premises multimodal RAG deployment with Kubernetes: a GroundX case study
    Mohamed Farag, Andrew Dai, Sara Elhamouly · 2026 · Academia AI and Applications
  65. Visual-Auditory Assistive Systems for People With Visual Impairment
    Mohamed Aslam, G. Revathy, Burle Kavya Sri, Kasula Lohitha, Kiran Sree Pokkuluri · 2026 · Advances in computational intelligence and robotics book series
  66. Dynamic Semantic Adaptation for Efficient Large Language Model Inference
    Guanghui Han, Yidan Yan, Lei Wei, Da Gao, Shougang Feng · 2026 · International Joint Conference on Neural Networks (IJCNN)
  67. NPUGen: NPU as KV Generator for Stable Long-Context Mobile LLM Inference
    Kun Wang, Jiani Cao, Zhenjiang Li · 2026 · ACM Annual International Conference on Mobile Computing and Networking (MobiCom)
  68. ExoMem: OS-Governed Memory for Local Large-LLM Inference on Mobile Edge Devices
    Jun You, Kun Wang, Jiesong Chen, Zhidan Liu, Zhenjiang Li · 2026 · ACM Annual International Conference on Mobile Computing and Networking (MobiCom)
  69. Toward sustainable on-device intelligence: A survey on energy-efficient RAG systems with small language models
    Zhiyuan Cheng, Longying Lai, Yue Liu, Yu Sun · 2026 · Neurocomputing
  70. PRECOG-Edge: A predictive–cognitive system from reactive scheduling to adaptive coordination in edge environments
    Dinesh Kumar Karthikeyan, Tommi Mikkonen, Niko Mäkitalo · 2026 · Intelligent Systems with Applications
  71. LittleBit: Ultra Low-Bit Quantization via Latent Factorization
    Lee, Banseok, Kim, Dongkyu, You, Youngcheon, Kim, Youngmin · 2025 · arXiv