The DOI matches its DataCite record; 1 of the 1 references it cites were found in a registry or an index.
A Survey on Collaborative Mechanisms Between Large and Small Language Models
Open accessAbstract
Large Language Models (LLMs) deliver powerful AI capabilities but face deployment challenges due to high resource costs and latency, whereas Small Language Models (SLMs) offer efficiency and deployability at the cost of reduced performance. Collaboration between LLMs and SLMs emerges as a crucial paradigm to synergistically balance these trade-offs, enabling advanced AI applications, especially on resource-constrained edge devices. This survey provides a comprehensive overview of LLM-SLM collaboration, detailing various interaction mechanisms (pipeline, routing, auxiliary, distillation, fusion), key enabling technologies, and diverse application scenarios driven by on-device needs like low latency, privacy, personalization, and offline operation. While highlighting the significant potential for creating more efficient, adaptable, and accessible AI, we also discuss persistent challenges including system overhead, inter-model consistency, robust task allocation, evaluation complexity, and security/privacy concerns. Future directions point towards more intelligent adaptive frameworks, deeper model fusion, and expansion into multimodal and embodied AI, positioning LLM-SLM collaboration as a key driver for the next generation of practical and ubiquitous artificial intelligence.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Collaborative and multi-agent systems benefit from effective context management in multi-turn dialogues or sequential tasks where maintaining consistent state and synchronizing internal information between collaborating models is essential [157].”
From A Survey of Context Engineering for Large Language Models (2025) · cites this paper as [157]
In the citing paper
“These capabilities support applications including distributed task processing, collaborative content creation, and multi-agent problem-solving where contextual coherence across multiple interactions must be maintained [157].”
From A Survey of Context Engineering for Large Language Models (2025) · cites this paper as [157]
Citations
Cites
The publisher hasn’t deposited this paper’s reference list.
Cited by
Sorted by citations
A Survey of Context Engineering for Large Language Models
Mei, L., Yao, J., Ge, Y., Wang, Y., Bi, B., Cai, Y., Liu, J., Li, M., Li, Z.-Z., Zhang, D., et al. (2025) · arXiv · doi:10.48550/arxiv.2507.13334 · Cited by 281
A semantic matching method for calculating textual spatial correlation
Qiu, P., Wang, S., Xing, H., Zhu, Y. C., & Jin, F. (2026) · International Journal of Digital Earth · doi:10.1080/17538947.2026.2694150
RAQA-GFS: A Tool for Global Forecast System Dataset VisualizationPreprint
Rad, A. K., & Nematollahi, M. J. (2026) · Research Square · doi:10.21203/rs.3.rs-10344441/v1
Integrating Computer Vision and Large Language Models for Real-Time Blind Navigation
Sharma, A., Rajput, D., Kumar, S., Narke, Y., & Wategaonkar, D. (2026) · Cureus Journal of Computer Science. · doi:10.7759/s44389-026-00265-x
Metadata
- Authors
- Chen, Y., Zhao, J., & Han, H.
- Affiliations
- Chinese Academy of Sciences (CN)
- Venue
- arXiv
- Publisher
- arXiv
- Published
- 2025
- ISSN
- 2331-8422 (ISSN-L)
- arXiv
- 2505.07460
- OpenAlex
- W4417516992
- Cited by
- 3
- References
- 0
- Citations by year
- 2026: 3
- Type
- posted content
- Language
- en
- Open access
- green
- arxiv.org
- Licence
- Locations
- arXiv (Cornell University) (submittedVersion, cc-by)
- arXiv (Cornell University) (cc-by)
- Topics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Neural Network Applications
- Physical Sciences › Computer Science › Artificial Intelligence › Topic Modeling
- Physical Sciences › Computer Science › Artificial Intelligence › Natural Language Processing Techniques
- Keywords
- large language models, small language models, edge deployment, resource-constrained devices, model distillation, model fusion, pipeline parallelism, routing, auxiliary model, low latency, privacy, personalization, offline operation, task allocation, privacy and security
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
