Llama Guard 3-1B-INT4: Compact and Efficient Safeguard for Human-AI Conversations
Open accessAbstract
This paper presents Llama Guard 3-1B-INT4, a compact and efficient Llama Guard model, which has been open-sourced to the community during Meta Connect 2024. We demonstrate that Llama Guard 3-1B-INT4 can be deployed on resource-constrained devices, achieving a throughput of at least 30 tokens per second and a time-to-first-token of 2.5 seconds or less on a commodity Android mobile CPU. Notably, our experiments show that Llama Guard 3-1B-INT4 attains comparable or superior safety moderation scores to its larger counterpart, Llama Guard 3-1B, despite being approximately 7 times smaller in size (440MB).
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
General-purpose moderators provide broad coverage across harmful content categories, but typically rely on single-model judgment and may collapse prompt intent and response harm into one decision.
“However, these systems typically rely on single-model judgment and may collapse prompt intent and response harm into one decision.”
From Verifying Intent and Harm: A Unified Defense Against LLM-Generated Threats (2026) · cites this paper as [10]
Existing LLM defenses typically analyze either user prompts or generated outputs, but not both.
“Existing defenses typically analyze either user prompts or generated outputs, but not both.”
From Verifying Intent and Harm: A Unified Defense Against LLM-Generated Threats (2026) · cites this paper as [10]
Cites
Still being checked.
Cited by
Sorted by citations
ThinkSLM: Towards Reasoning in Small Language Models
Srivastava, G., Cao, S., & Wang, X. (2025) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2025.emnlp-main.1659 · Cited by 21 · see citing works
Benchmarking Large Language Models for Cryptanalysis and Side-Channel Vulnerabilities
Maskey, U., Zhu, C., & Naseem, U. (2025) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2025.findings-emnlp.1082 · Cited by 5 · see citing works
LionGuard 2: Building Lightweight, Data-Efficient & Localised Multilingual Content Moderators
Tan, L., Chua, G. Y. P., Ge, Z. Y., & Lee, R. K.-W. (2025) · Conference on Empirical Methods in Natural Language Processing: System Demonstrations (EMNLP) · doi:10.18653/v1/2025.emnlp-demos.20 · Cited by 2 · see citing works
The State of Simulation Frameworks for Evaluating Emerging LLM Accelerators
Maczynski, S., Ganguly, A., & Indovina, M. A. (2025) · ACM Great Lakes Symposium on VLSI (GLSVLSI) · doi:10.1145/3716368.3735292 · Cited by 1 · see citing works
CM-MRAG: A multimodal retrieval-augmented framework for content moderation
Qu, W., Chen, C., Lu, W., Wei, Y., & Li, T. (2025) · Expert Systems with Applications · doi:10.1016/j.eswa.2025.130768 · Cited by 1 · see citing works
Verifying Intent and Harm: A Unified Defense Against LLM-Generated Threats
Thota, P., Lei, Y., Thangaraj, S., Jonnalagadda, S. R., & Nilizadeh, S. (2026) · arXiv · doi:10.48550/arxiv.2606.26377
“General-purpose moderators such as LlamaGuard [10], ShieldGemma [11], WildGuard [12], and the OpenAI Mod-eration API [13] provide broad coverage across harmful content categories.”
InfluentialSecReEvalBench: A real-world scenario-based security resilience benchmark for large language models
Cui, H., & Liu, W. (2026) · Neural Networks · doi:10.1016/j.neunet.2026.109065
To Lie or Not to Lie? Investigating The Biased Spread of Global Lies by LLMs
Khan, Z., Dogan, M., Okoh, I., Sadeghi, P., Shrestha, S., Nyah, S. J., Mokhiamar, M. O., Ryan, M. J., & Naous, T. (2026) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2026.acl-long.695
MobileLLM-Flash: Latency-Guided On-Device LLM Design for Industry Scale Deployment
Huang, H., Fedorov, I., Gromov, A., Beckerman, B., Suda, N., Eriksson, D., Balandat, M., Conway, R., Huber, P., Sankar, C., et al. (2026) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2026.acl-industry.51
Self-citationAI Control Through Causal Agents
Kaushik, M. M., Karthik, K. N. V., & Arjan Durresi, A. (2026) · Lecture notes on data engineering and communications technologies · doi:10.1007/978-3-032-23304-2_11
- Authors
- Fedorov, I., Plawiak, K., Wu, L., Elgamal, T., Suda, N., Smith, E., Zhan, H., Chi, J., Hulovatyy, Y., Patel, K., Liu, Z., Zhao, C., Shi, Y., Blankevoort, T., Pasupuleti, M., Soran, B., Coudert, Z. D., Alao, R., Krishnamoorthi, R., & Chandra, V.
- Venue
- arXiv
- Publisher
- arXiv
- Published
- 2024
- ISSN
- 2331-8422 (ISSN-L)
- arXiv
- 2411.17713
- OpenAlex
- W4404990086
- Cited by
- 0
- References
- 0
- Type
- posted content
- Language
- en
- Open access
- green
- arxiv.org
- Licence
- Locations
- arXiv (Cornell University) (submittedVersion, cc-by)
- arXiv (Cornell University) (cc-by)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Hate Speech and Cyberbullying Detection
- Physical Sciences › Computer Science › Artificial Intelligence › Adversarial Robustness in Machine Learning
- Physical Sciences › Computer Science › Artificial Intelligence › Topic Modeling
- Keywords
- AI safety, content moderation, low-bit quantization, INT4 quantization, model compression, mobile deployment, resource-constrained devices
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
