TIPS: A Prompt Engineering Framework for Code Classification and Generation on Resource-Constrained Systems
Open accessThe DOI matches its Crossref record; 61 of the 61 references it cites were found in a registry or an index.
Abstract
Recent advances in AI-assisted programming have demonstrated the potential of Large Language Models (LLMs) in complex code classification and generation. However, their high computational demands and reliance on large-scale datasets limit deployment in resource-constrained environments such as educational tools, edge devices, and small-scale development settings. To address these challenges, this paper introduces the Template-Integrated Prompting System (TIPS), a modular prompt engineering framework designed for lightweight and efficient code analysis. TIPS integrates small-model training, semantically guided demonstration selection, and structured prompt templates to construct an interpretable reasoning pipeline that combines few-shot learning with Chain-of-Thought (CoT) reasoning. Experiments on a benchmark dataset of multithreaded Pthread programs show that TIPS achieves higher precision, recall, and F1-scores than traditional classifiers and prompt-based baselines, even under class imbalance. These results demonstrate that model effectiveness depends not only on scale but also on semantic guidance and structured reasoning. TIPS provides a scalable and interpretable solution, with potential applications in education, software development, and intelligent assistance systems, particularly in resource-constrained environments.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Citations
Cites
Breiman, L. (1996) · Machine Learning · doi:10.1007/bf00058655 · Cited by 16,325
Huang, L., Yu, W., Ma, W., Zhong, W., Feng, Z., Wang, H., Chen, Q., Peng, W., Feng, X., Qin, B., et al. (2025) · ACM Transactions on Information Systems · doi:10.1145/3703155 · Cited by 4,688 · cited 1×
“Finally, mixed-quality training data can induce hallucinations in LLMs, leading to unnecessary energy consumption and poor performance in critical tasks [49].”
Longformer: The Long-Document Transformer
Beltagy, I., Peters, M. E., & Cohan, A. (2020) · arXiv · doi:10.48550/arxiv.2004.05150 · Cited by 2,281
Zephyr: Direct Distillation of LM AlignmentPreprint
Tunstall, L., Beeching, E., Lambert, N., Rajani, N. F., Rasul, K., Belkada, Y., Huang, S., von Werra, L., Fourrier, C., Habib, N., et al. (2023) · arXiv (Cornell University) · doi:10.48550/arxiv.2310.16944 · Cited by 1,234
Self-Consistency Improves Chain of Thought Reasoning in Language Models
Wang, X., Wei, J., Schuurmans, D., Le, Q., Chi, E., Narang, S., Chowdhery, A., & Zhou, D. (2022) · arXiv · doi:10.48550/arxiv.2203.11171 · Cited by 829
Large language models for software engineering: survey and open problems
Fan, A., Gokkaya, B., Harman, M., Lyubarskiy, M., Sengupta, S., Yoo, S., & Zhang, J. M. (2023) · 2023 IEEE/ACM International Conference on Software Engineering: Future of Software Engineering (ICSE-FoSE) · doi:10.1109/icse-fose59343.2023.00008 · Cited by 650 · cited 2×
“Moreover, unlike conventional classifiers, the TIPS framework provides not only label predictions but also an interpretable reasoning chain, addressing the lack of transparency in traditional approaches, as noted by Fan et al. [22].”
Code Llama: Open Foundation Models for Code
Rozière, B., Gehring, J., Gloeckle, F., Sootla, S., Gat, I., Tan, X. E., Adi, Y., Liu, J., Sauvestre, R., Remez, T., et al. (2023) · arXiv · doi:10.48550/arxiv.2308.12950 · Cited by 531
Large Language Models for Software Engineering: Survey and Open Problems
Fan, A., Gokkaya, B., Harman, M., Lyubarskiy, M., Sengupta, S., Yoo, S., & Zhang, J. M. (2023) · arXiv · doi:10.48550/arxiv.2310.03533 · Cited by 523 · cited 2×
“Moreover, unlike conventional classifiers, the TIPS framework provides not only label predictions but also an interpretable reasoning chain, addressing the lack of transparency in traditional approaches, as noted by Fan et al. [22].”
Comparing the quality of human and ChatGPT feedback of students’ writing
Steiss, J., Tate, T., Graham, S., Cruz, J., Hebert, M., Wang, J., Moon, Y., Tseng, W., Warschauer, M., & Olson, C. B. (2024) · Learning and Instruction · doi:10.1016/j.learninstruc.2024.101894 · Cited by 509 · cited 1×
“Beyond programming tasks, LLMs can generate context-aware content to support writing assistance, educational material development, and AI-driven programming education [4].”
A review of green artificial intelligence: Towards a more sustainable future
Bolón-Canedo, V., Morán-Fernández, L., Cancela, B., & Alonso-Betanzos, A. (2024) · Neurocomputing · doi:10.1016/j.neucom.2024.128096 · Cited by 486 · cited 1×
“In compute-constrained scenarios such as IoT, edge computing, and cloud devices, memory efficiency and execution latency are of paramount importance [40], [41].”
GQA: Training Generalized Multi-Query Transformer Models from Multi-Head Checkpoints
Ainslie, J., Lee-Thorp, J., de Jong, M., Zemlyanskiy, Y., Lebron, F., & Sanghai, S. (2023) · Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/2023.emnlp-main.298 · Cited by 454
GQA: Training Generalized Multi-Query Transformer Models from Multi-Head Checkpoints
Ainslie, J., Lee-Thorp, J., de Jong, M., Zemlyanskiy, Y., Lebrón, F., & Sanghai, S. (2023) · arXiv · doi:10.48550/arxiv.2305.13245 · Cited by 447 · cited 1×
“Jiang et al. [15] introduced Mistral, an efficient 7B model incorporating Grouped Query Attention (GQA) [60] for faster inference and Sliding Window Attention (SWA) [61] to effectively handle long sequences.”
Efficient and precise datarace detection for multithreaded object-oriented programs
Choi, J.-D., Lee, K., Loginov, A., O'Callahan, R., Sarkar, V., & Sridharan, M. (2002) · Proceedings of the ACM SIGPLAN 2002 conference on Programming language design and implementation · doi:10.1145/512529.512560 · Cited by 441 · cited 1×
“Choi et al. [29] proposed a hybrid framework combining static and dynamic analysis to improve the detection of race conditions in object-oriented programs.”
Unveiling security, privacy, and ethical concerns of ChatGPT
Wu, X., Duan, R., & Ni, J. (2024) · Journal of Information and Intelligence · doi:10.1016/j.jiixd.2023.10.007 · Cited by 314
AWQ: Activation-aware Weight Quantization for On-Device LLM Compression and Acceleration
Lin, J., Tang, J., Tang, H., Yang, S., Xiao, G., & Han, S. (2025) · GetMobile: Mobile Computing and Communications · doi:10.1145/3714983.3714987 · Cited by 274 · cited 1×
“Techniques such as Activation-aware Weight Quantization (AWQ) [17] and Generative Pre-trained Transformers Quantization (GPTQ) [18] have been widely adopted in recent work for model compression, as they maintain accuracy comparable to full-precision models across a range of tasks.”
StarCoder: may the source be with you!
Li, R., Allal, L. B., Zi, Y., Muennighoff, N., Kocetkov, D., Mou, C., Marone, M., Akiki, C., Li, J., Chim, J., et al. (2023) · arXiv · doi:10.48550/arxiv.2305.06161 · Cited by 261
Few-shot training LLMs for project-specific code-summarization
Ahmed, T., & Devanbu, P. (2022) · Proceedings of the 37th IEEE/ACM International Conference on Automated Software Engineering · doi:10.1145/3551349.3559555 · Cited by 240 · cited 3×
“By combining CoT with small-model assistance, the TIPS framework reduces misclassification rates, aligning with findings from Ahmed and Devanbu [26] and Nashid et al. [25].”
GPTQ: Accurate Post-Training Quantization for Generative Pre-trained Transformers
Frantar, E., Ashkboos, S., Hoefler, T., & Alistarh, D. (2022) · arXiv · doi:10.48550/arxiv.2210.17323 · Cited by 197
A Performance Study of LLM-Generated Code on Leetcode
Coignion, T., Quinton, C., & Rouvoy, R. (2024) · International Conference on Evaluation and Assessment in Software Engineering (EASE) · doi:10.1145/3661167.3661221 · Cited by 187 · cited 1×
“Common evaluation metrics include memory usage, CPU utilization, runtime, and code complexity [42], [43].”
InCoder: A Generative Model for Code Infilling and Synthesis
Fried, D., Aghajanyan, A., Lin, J., Wang, S., Wallace, E., Shi, F., Zhong, R., Yih, W.-T., Zettlemoyer, L., & Lewis, M. (2022) · arXiv · doi:10.48550/arxiv.2204.05999 · Cited by 187
Retrieval-Based Prompt Selection for Code-Related Few-Shot Learning
Nashid, N., Sintaha, M., & Mesbah, A. (2023) · 2023 IEEE/ACM 45th International Conference on Software Engineering (ICSE) · doi:10.1109/icse48619.2023.00205 · Cited by 178 · cited 4×
“By combining CoT with small-model assistance, the TIPS framework reduces misclassification rates, aligning with findings from Ahmed and Devanbu [26] and Nashid et al. [25].”
InfluentialGenerative Artificial Intelligence in Education: From Deceptive to Disruptive.
Alier, M., García Peñalvo, F. J., & D. Camba, J. (2024) · International Journal of Interactive Multimedia and Artificial Intelligence · doi:10.9781/ijimai.2024.02.011 · Cited by 178 · cited 1×
“It enables users to elicit latent knowledge and reasoning capabilities from LLMs without retraining, thereby expanding applicability at minimal computational cost [57], [65].”
EffiBench: Benchmarking the Efficiency of Automatically Generated Code
Huang, D., Qing, Y., Shang, W., Cui, H., & Zhang, J. M. (2024) · neural information processing systems · doi:10.52202/079017-0367 · Cited by 173
An extensive study on pre-trained models for program understanding and generation
Zeng, Z., Tan, H., Zhang, H., Li, J., Zhang, Y., & Zhang, L. (2022) · Proceedings of the 31st ACM SIGSOFT International Symposium on Software Testing and Analysis · doi:10.1145/3533767.3534390 · Cited by 153 · cited 1×
“Building on these capabilities, recent studies have shown that LLMs can understand program semantics, enabling the generation of syntactically correct and functionally valid code [5], [6], [7].”
Mercury: A Code Efficiency Benchmark for Code Large Language Models
Du, M., Tuan, L. A., Ji, B., Liu, Q., & Ng, S.-K. (2024) · neural information processing systems · doi:10.52202/079017-0529 · Cited by 143 · cited 1×
“Du et al. [48] define code efficiency as the ability to perform tasks with minimal resource utilization, such as time, memory, and computational power, thus improving user experience, reducing energy consumption, and improving cost effectiveness.”
Jiang, A. Q., Sablayrolles, A., Roux, A., Mensch, A., Savary, B., Bamford, C., Chaplot, D. S., Casas, D. D. L., Hanna, E. B., Bressand, F., et al. (2024) · arXiv · doi:10.48550/arxiv.2401.04088 · Cited by 143
Gunasekar, S., Zhang, Y., Aneja, J., Mendes, C. C. T., Del Giorno, A., Gopi, S., Javaheripi, M., Kauffmann, P., de Rosa, G., Saarikivi, O., et al. (2023) · arXiv · doi:10.48550/arxiv.2306.11644 · Cited by 138
Natural Language Generation and Understanding of Big Code for AI-Assisted Programming: A Review
Wong, M.-F., Guo, S., Hang, C.-N., Ho, S.-W., & Tan, C.-W. (2023) · Entropy · doi:10.3390/e25060888 · Cited by 134 · cited 1×
“First, code generation must ensure an accurate interpretation of natural language instructions while adhering to strict syntactic and semantic constraints of programming languages [10].”
Parameter-Efficient Fine-Tuning for Large Models: A Comprehensive Survey
Han, Z., Gao, C., Liu, J., Zhang, J., & Zhang, S. Q. (2024) · arXiv · doi:10.48550/arxiv.2403.14608 · Cited by 129
What is wrong with your code generated by large language models? An extensive study
Dou, S., Jia, H., Wu, S., Zheng, H., Wu, M., Tao, Y., Zhang, M., Chai, M., Fan, J., Xu, N., et al. (2026) · Science China Information Sciences · doi:10.1007/s11432-025-4632-8 · Cited by 117
Dynamic Race Detection with LLVM Compiler
Serebryany, K., Potapenko, A., Iskhodzhanov, T., & Vyukov, D. (2012) · Lecture notes in computer science · doi:10.1007/978-3-642-29860-8_9 · Cited by 94
HPC-GPT: Integrating Large Language Model for High-Performance Computing
Ding, X., Chen, L., Emani, M. K., Liao, C., Lin, P., Vanderbruggen, T., Xie, Z., Cerpa, A., & Du, W. (2023) · International Conference for High Performance Computing, Networking, Storage and Analysis (SC) · doi:10.1145/3624062.3624172 · Cited by 82 · cited 1×
“Ding et al. [33] fine-tuned LLaMA on an HPC-specific QA dataset to produce HPC-GPT, which aids in HPC code generation.”
How Efficient is LLM-Generated Code? A Rigorous & High-Standard Benchmark
Qiu, R., Zeng, W. W., Ezick, J., Lott, C., & Tong, H. (2024) · International Conference on Learning Representations · doi:10.48550/arxiv.2406.06647 · Cited by 79
He, X., Huang, W., & Lv, C. (2024) · Transportation Research Part C Emerging Technologies · doi:10.1016/j.trc.2024.104632 · Cited by 76 · cited 1×
“Similar reliability issues have been reported in other domains, including NLP [36], computer vision [37], autonomous driving [38], and healthcare [39], where predictive outputs occasionally fail to meet domain-specific precision and safety requirements.”
An Empirical Study on Usage and Perceptions of LLMs in a Software Engineering Project
Rasnayaka, S., Wang, G., Shariffdeen, R., & Iyer, G. N. (2024) · Proceedings of the 1st International Workshop on Large Language Models for Code · doi:10.1145/3643795.3648379 · Cited by 70 · cited 1×
“Building on these capabilities, recent studies have shown that LLMs can understand program semantics, enabling the generation of syntactically correct and functionally valid code [5], [6], [7].”
On Evaluating the Efficiency of Source Code Generated by LLMs
Niu, C., Zhang, T., Li, C., Luo, B., & Ng, V. (2024) · IEEE/ACM International Conference on AI Foundation Models and Software Engineering (FORGE) · doi:10.1145/3650105.3652295 · Cited by 68 · cited 2×
“For instance, Niu et al. [47] observed that combining simple prompts for basic tasks with CoT for complex reasoning reduced execution time by 15% and decreased memory usage by 12%.”
A study on prompt design, advantages and limitations of ChatGPT for deep learning program repair
Cao, J., Li, M., Wen, M., & Cheung, S.-C. (2025) · Automated Software Engineering · doi:10.1007/s10515-025-00492-x · Cited by 65 · cited 2×
“For instance, Cao et al. [8] investigated the role of prompt engineering in improving LLM-based debugging by introducing tasks involving structurally complex bugs with high interdependencies, thereby assessing the practical utility of LLMs in realistic debugging contexts.”
LM4HPC: Towards Effective Language Model Application in High-Performance Computing
Chen, L., Lin, P., Vanderbruggen, T., Liao, C., Emani, M. K., & de Supinski, B. R. (2023) · Lecture notes in computer science · doi:10.1007/978-3-031-40744-4_2 · Cited by 61 · cited 1×
“Chen et al. [31] introduced LM4HPC, a model designed for semantic understanding and structural adaptation in HPC scenarios, demonstrating robustness in automated design and optimization.”
HumanEval Pro and MBPP Pro: Evaluating Large Language Models on Self-invoking Code GenerationPreprint
Yu, Z.-J., Zhao, Y., Cohan, A., & Zhang, X.-P. (2024) · arXiv.org · doi:10.48550/arxiv.2412.21199 · Cited by 58
Evaluating zero-shot multilingual aspect-based sentiment analysis with large language models
Wu, C., Ma, B., Zhang, Z., Deng, N., He, Y., & Xue, Y. (2025) · International Journal of Machine Learning and Cybernetics · doi:10.1007/s13042-025-02711-z · Cited by 57
LLMs: A game-changer for software engineers?
Haque, M. A. (2025) · BenchCouncil Transactions on Benchmarks Standards and Evaluations · doi:10.1016/j.tbench.2025.100204 · Cited by 53
OMPGPT: A Generative Pre-trained Transformer Model for OpenMP
Chen, L., Bhattacharjee, A., Ahmed, N. K., Hasabnis, N., Oren, G., Vo, V. A., & Jannesari, A. (2024) · Lecture notes in computer science · doi:10.1007/978-3-031-69577-3_9 · Cited by 48
Comparing Large Language Models and Human Programmers for Generating Programming Code
Hou, W., & Ji, Z. (2025) · Advanced Science · doi:10.1002/advs.202412279 · Cited by 48 · cited 1×
“In contrast, human-authored code consistently demonstrates superior efficiency [45], [46].”
Defense-PointNet: Protecting PointNet Against Adversarial Attacks
Zhang, Y., Liang, G., Salem, T., & Jacobs, N. (2019) · IEEE International Conference on Big Data (BigData) · doi:10.1109/bigdata47090.2019.9006307 · Cited by 44
Huang, Q., Yuan, Z., Xing, Z., Xu, X., Zhu, L., & Lu, Q. (2022) · Proceedings of the 37th IEEE/ACM International Conference on Automated Software Engineering · doi:10.1145/3551349.3556912 · Cited by 42 · cited 1×
“Huang et al. addressed the ambiguity in fully qualified names (FQNs) by using code-masked language modeling, significantly improving resolution in incomplete code segments [24].”
AI-Powered, But Power-Hungry? Energy Efficiency of LLM-Generated Code
Solovyeva, L., Weidmann, S., & Castor, F. (2025) · IEEE/ACM International Conference on AI Foundation Models and Software Engineering (FORGE) · doi:10.1109/forge66646.2025.00012 · Cited by 35 · cited 1×
“In compute-constrained scenarios such as IoT, edge computing, and cloud devices, memory efficiency and execution latency are of paramount importance [40], [41].”
Advising OpenMP Parallelization via A Graph-Based Approach with Transformers
Kadosh, T., Schneider, N., Hasabnis, N., Mattson, T. G., Pinter, Y., & Oren, G. (2023) · Lecture notes in computer science · doi:10.1007/978-3-031-40744-4_1 · Cited by 31
Espejel, J. L., Alassan, M. S. Y., Chouham, E. M., Dahhane, W., & Ettifouri, E. H. (2023) · Natural Language Processing Journal · doi:10.1016/j.nlp.2023.100013 · Cited by 28 · cited 1×
“The performance of LLMs in code generation remains inferior to their performance in natural language generation tasks [9].”
Envisioning Class Entity Reasoning by Large Language Models for Few-shot Learning
Liu, M., Wu, F., Li, B., Lu, Z., Yu, Y., & Li, X. (2025) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v39i18.34081 · Cited by 28
MiniCPM: Unveiling the Potential of Small Language Models with Scalable Training Strategies
Hu, S., Tu, Y., Han, X., He, C., Cui, G., Long, X., Zheng, Z., Fang, Y., Huang, Y., Zhao, W., et al. (2024) · arXiv · doi:10.48550/arxiv.2404.06395 · Cited by 28
Enhancing Zero-Shot Chain-of-Thought Reasoning in Large Language Models through Logic
Zhao, X., Li, M., Lu, W., Weber, C., Lee, J. H., Chu, K., & Wermter, S. (2023) · arXiv · doi:10.48550/arxiv.2309.13339 · Cited by 26
When to Stop? Towards Efficient Code Generation in LLMs with Excess Token Prevention
Guo, L., Wang, Y., Shi, E., Zhong, W., Zhang, H., Chen, J., Zhang, R., Ma, Y., & Zheng, Z. (2024) · Proceedings of the 33rd ACM SIGSOFT International Symposium on Software Testing and Analysis · doi:10.1145/3650212.3680343 · Cited by 20 · cited 2×
“LLMs such as PaLM (175B) [12], GPT-3 (175B) [13], and GPT-4 (up to 1.7T) [14] have shown strong abilities in language understanding and generation.”
An assessment of large language models for OpenMP-based code parallelization: a user perspective
Mišić, M. J., & Dodović, M. (2024) · Journal Of Big Data · doi:10.1186/s40537-024-01019-z · Cited by 20 · cited 3×
“For example, Mišić and Dodović [34] found that GitHub Copilot exhibited unstable behavior when handling low-frequency synchronization errors, which required the support of external static analysis tools.”
InfluentialSound and Partially-Complete Static Analysis of Data-Races in GPU Programs
Liew, D., Cogumbreiro, T., & Lange, J. (2024) · Proceedings of the ACM on Programming Languages · doi:10.1145/3689797 · Cited by 19
Can a Llama Be a Watchdog? Exploring Llama 3 and Code Llama for Static Application Security Testing
Curto, C., Giordano, D., Indelicato, D. G., & Patatu, V. (2024) · IEEE International Conference on Cyber Security and Resilience (CSR) · doi:10.1109/csr61664.2024.10679444 · Cited by 18 · cited 1×
“Although subsequently superseded by LLaMA-3 [54] and LLaMA-3.”
API comparison knowledge extraction via prompt-tuned language model
Yang, Y., Zhu, Y., Chen, S., & Jian, P. (2023) · Journal of Computer Languages · doi:10.1016/j.cola.2023.101200 · Cited by 10 · cited 1×
“Yang et al. proposed APICKnow, a fine-tuned model that accurately recognizes API entities and their semantic relations in Stack Overflow discussions [23].”
Self-citationDetecting Data Races in OpenMP with Deep Learning and Large Language Models
Alsofyani, M., & Wang, L. (2024) · doi:10.1145/3677333.3678160 · Cited by 9 · cited 1×
“Alsofyani and Wang [35] used LLMs to detect concurrency errors in OpenMP programs.”
Defending mutation-based adversarial text perturbation: a black-box approach
Deanda, D., Alsmadi, I. M., Guerrero, J., & Liang, G. (2025) · Cluster Computing · doi:10.1007/s10586-024-04916-3 · Cited by 5 · cited 1×
“Similar reliability issues have been reported in other domains, including NLP [36], computer vision [37], autonomous driving [38], and healthcare [39], where predictive outputs occasionally fail to meet domain-specific precision and safety requirements.”
Chain-of-Thought in Large Language Models: Decoding, Projection, and Activation
Yang, H., Zhao, Q., & Li, L. (2024) · arXiv · doi:10.48550/arxiv.2412.03944
RaceFixer -- An Automated Data Race Fixer
Malakar, S., Haider, T. B., & Shahriar, R. (2024) · arXiv (Cornell University) · doi:10.48550/arxiv.2401.04221
Context-Masked Meta-Prompting for Privacy-Preserving LLM Adaptation in Finance
Hiraou, S. R. (2024) · arXiv (Cornell University) · doi:10.48550/arxiv.2407.18920
Research works printed but not linked: 13
- Xia, 2022, Practical program repair in the era of large pre-trained language models, arXiv:2210.14179 · arXiv
- Chowdhery, 2023, Palm: Scaling language modeling with pathways, J. Mach. Learn. Res., 24, 1
- Brown, Language models are few-shot learners, 33, 1877
- Grattafiori, 2024, The llama 3 herd of models, arXiv:2407.21783 · arXiv
- Chen, 2021, Evaluating large language models trained on code, arXiv:2107.03374 · arXiv
- Deanda, 2025, Benchmarking robustness of contrastive learning models for medical image-report retrieval
- Li, 2023, Textbooks are all you need II: Phi-1.5 technical report
- Javaheripi, 2023, Phi-2: The surprising power of small language models, Microsoft Res. Blog, 1, 3
- Taori, 2023, Stanford alpaca: An instruction-following llama model
- Touvron, 2023, Llama 2: Open foundation and fine-tuned chat models, arXiv:2307.09288 · arXiv
- Oswald, Transformers learn in-context by gradient descent, 35151
- Joachims, Transductive inference for text classification using support vector machines, 99, 200
- Freund, Experiments with a new boosting algorithm, 96, 148
Cited by
Exploring the Capabilities of an LLM from CFD Simulations of Turbulent Flow in a Manifold
Morano-Okuno, H. R., Vicente-Cisneros, A. R. S., & Sandoval-Benitez, G. (2026) · Applied Sciences · doi:10.3390/app16115300
Inteligencia artificial en la ingenieria de software
Salazar, S. (2026) · SAP Engineering and Industry · doi:10.62486/ei2026103
Structure-Aware Thesis Content Description Using Large Language Models
Hrvacević, L., Dodović, M., Tufegdžić, J., & Mišić, M. J. (2026) · International Conference on Electrical, Electronic and Computing Engineering (IcETRAN) · doi:10.1109/icetran71739.2026.11727876
“In addition, the TIPS [19] metric is employed as a composite measure that combines semantic, lexical, and syntactic similarity into a single score, providing a more comprehensive evaluation of generated text.”
Metadata
- Authors
- Chen, W.-C., & Chen, S.-Y.
- Affiliations
- National Cheng Kung University (TW)
- Department of Engineering Science, National Cheng Kung University, Tainan, Taiwan
- Venue
- IEEE Access
- Published
- 2026
- Volume
- 14
- Pages
- 15723-15735
- ISSN
- 2169-3536 (ISSN-L)
- OpenAlex
- W7125985562
- Cited by
- 3
- References
- 42
- Citations by year
- 2026: 3
- FWCI
- 25.52
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Locations
- IEEE Access (publishedVersion, cc-by)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Topics
- Physical Sciences › Computer Science › Information Systems › Software Engineering Research
- Physical Sciences › Computer Science › Artificial Intelligence › Topic Modeling
- Physical Sciences › Computer Science › Computer Science Applications › Teaching and Learning Programming
- Keywords
- prompt engineering, code classification, code generation, resource-constrained systems, large language models, chain-of-thought reasoning, few-shot learning, demonstration selection, prompt templates, class imbalance, edge devices, AI-assisted programming
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.