The DOI matches its DataCite record.
Optimized Quran Passage Retrieval Using an Expanded QA Dataset and Fine-Tuned Language Models
Open accessAbstract
Understanding the deep meanings of the Qur'an and bridging the language gap between modern standard Arabic and classical Arabic is essential to improve the question-and-answer system for the Holy Qur'an. The Qur'an QA 2023 shared task dataset had a limited number of questions with weak model retrieval. To address this challenge, this work updated the original dataset and improved the model accuracy. The original dataset, which contains 251 questions, was reviewed and expanded to 629 questions with question diversification and reformulation, leading to a comprehensive set of 1895 categorized into single-answer, multi-answer, and zero-answer types. Extensive experiments fine-tuned transformer models, including AraBERT, RoBERTa, CAMeLBERT, AraELECTRA, and BERT. The best model, AraBERT-base, achieved a MAP@10 of 0.36 and MRR of 0.59, representing improvements of 63% and 59%, respectively, compared to the baseline scores (MAP@10: 0.22, MRR: 0.37). Additionally, the dataset expansion led to improvements in handling "no answer" cases, with the proposed approach achieving a 75% success rate for such instances, compared to the baseline's 25%. These results demonstrate the effect of dataset improvement and model architecture optimization in increasing the performance of QA systems for the Holy Qur'an, with higher accuracy, recall, and precision.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source says what the claim attributes to it.
In the citing paper
“As the augmentation showed noticeable improvements, we decide to continue exploring in this direction and propose new augmentation techniques.”
From Burhan at IslamicEval: Fact-Augmented and LLM-Driven Retrieval for Islamic QA (2025) · cites this paper as Basem et al., 2024
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
No references could be resolved yet.
Research works printed but not linked: 21
- Alawwad, H., Alawwad, L., Alharbi, J., Alharbi, A.: Ahjl at qur'an qa 2023 shared task: Enhancing passage retrieval using sentence transformer and translation. In: Proceedings of ArabicNLP 2023, pp. 702-707 (2023)
- Aljamel, A., Khalil, H., Aburawi, Y.: Comparative study of fine-tuned bert-based models and rnn-based models. case study: Arabic fake news detection. The International Journal of Engineering and Information Technology (IJEIT) 12(1), 56-64 (2024)
- Antoun, W., Baly, F., Hajj, H.: Arabert: Transformer-based model for arabic language understanding. arXiv preprint arXiv:2003.00104 (2020). URL https://arxiv.org/abs/2003.00104 · arXiv
- Antoun, W., Baly, F., Hajj, H.: Araelectra: Pre-training text discriminators for arabic language understanding. In: Proceedings of the Sixth Arabic Natural Language Processing Workshop, pp. 191-195. Association for Computational Linguistics (2021). URL https://aclanthology.org/2021.wanlp-1.21/
- Clark, J., et al.: Tydi qa: A benchmark for information-seeking question answering in typologically diverse languages. Transactions of the ACL (2020)
- Devlin, J., Chang, M.W., Lee, K., Toutanova, K.: Bert: Pre-training of deep bidirectional transformers for language understanding. In: Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, pp. 4171-4186. Association for Computational Linguistics (2019). URL https://aclanthology.org/N19-1423/
- Elkomy, M., Sarhan, A.: Tce at qur'an qa 2023 shared task: Low resource enhanced transformer-based ensemble approach for qur'anic qa. In: Proceedings of ArabicNLP 2023, pp. 728-742. Association for Computational Linguistics, Singapore (Hybrid) (2023)
- Essam, M., Deif, M., Elgohary, R.: Deciphering arabic question: A dedicated survey on arabic question analysis methods, challenges, limitations and future pathways. Artificial Intelligence Review 57(9), 1-37 (2024)
- Hamdi, A., Shaban, K., Zainal, A.: A review on challenging issues in arabic sentiment analysis. Journal of Computer Science (2016)
- Hamdi, A., Shaban, K., Zainal, A.: Clasenti: a class-specific sentiment analysis framework. ACM Transactions on Asian and Low-Resource Language Information Processing (TALLIP) 17(4), 1-28 (2018)
- Hillman, J., Baydoun, E.: Quality assurance and relevance in academia: a review. Springer (2019)
- Inoue, G., Habash, N.: Camelbert: A language model for arabic. In: Proceedings of the Sixth Arabic Natural Language Processing Workshop, pp. 270-278. Association for Computational Linguistics (2021). URL https://aclanthology.org/2021.wanlp-1.29/
- Liu, Y., Ott, M., Goyal, N., Du, J., Joshi, M., Chen, D., Levy, O., Lewis, M., Zettlemoyer, L., Stoyanov, V.: Roberta: A robustly optimized bert pretraining approach. arXiv preprint arXiv:1907.11692 (2019). URL https://arxiv.org/abs/1907.11692 · arXiv
- Liu, Z., Li, Y., Chen, N., Wang, Q., Hooi, B., He, B.: A survey of imbalanced learning on graphs: Problems, techniques, and future directions. arXiv preprint arXiv:2308.13821 (2023) · arXiv
- Mahmoudi, G., Eetemadi, S., Morshedzadeh, Y.: A multi-task transfer learning approach for qur'an-related question answering. In: Proceedings of the First Arabic Natural Language Processing Conference (ArabicNLP 2023). ACL Anthology (2023)
- Malhas, M., et al.: Qur'an qa 2023 shared task: Overview of passage retrieval and reading comprehension tasks over the holy qur'an. In: ArabicNLP-WS 2023, pp. 1-13. Association for Computational Linguistics (2023)
- Malhas, R.: Arabic question answering on the holy qur'an. Ph.D. thesis, Ph.D. thesis (2023)
- Qamar, F., Latif, S., Latif, R.: A benchmark dataset with larger context for non-factoid question-answering over islamic text. Preprint submitted to Elsevier (2024)
- Sardar, Z.: Reading the Qur'an: The contemporary relevance of the sacred text of Islam. Oxford University Press (2017)
- Sun, L., Xia, C., Yin, W., Liang, T., Yu, P.S., He, L.: Mixup-transformer: Dynamic data augmentation for nlp tasks. arXiv preprint arXiv:2010.02394 (2020) · arXiv
- Zheng, H., Shen, L., Tang, A., Luo, Y., Hu, H., Du, B., Tao, D.: Learn from model beyond fine-tuning: A survey. arXiv preprint arXiv:2310.08184 (2023) · arXiv
Cited by
Sorted by citations
Burhan at IslamicEval: Fact-Augmented and LLM-Driven Retrieval for Islamic QA
Basheer, M., Mansour, W., Touma, A., & Qadeib Alban, A. (2025) · Proceedings of The Third Arabic Natural Language Processing Conference: Shared Tasks · doi:10.18653/v1/2025.arabicnlp-sharedtasks.73
“The task of Qur’anic passage retrieval has garnered significant scholarly interest due to the distinct linguistic and contextual challenges posed by the Qur’an (Basem et al., 2024).”
Metadata
- Authors
- Basem, M., Oshallah, I., Hikal, B., Hamdi, A., & Mohamed, A.
- Affiliations
- October University of Modern Sciences and Arts (EG)
- Corresponding author
- Basem, Mohamed
- ORCID
- Hamdi, Ali
- Venue
- arXiv
- Publisher
- arXiv
- Published
- 2024
- Pages
- 244-254
- ISSN
- 2367-4512 (ISSN-L)
- arXiv
- 2412.11431
- OpenAlex
- W4411628394
- Cited by
- 3
- References
- 0
- Citations by year
- 2026: 1 · 2025: 2
- FWCI
- 2.84
- Type
- conference paper
- Language
- en
- Open access
- green
- arxiv.org
- Licence
- Locations
- Lecture notes on data engineering and communications technologies (publishedVersion)
- arXiv (Cornell University) (submittedVersion, cc-by)
- arXiv (Cornell University) (cc-by)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Topic Modeling
- Physical Sciences › Computer Science › Information Systems › Information Retrieval and Search Behavior
- Physical Sciences › Computer Science › Artificial Intelligence › Natural Language Processing Techniques
- Keywords
- dataset expansion, query rewriting, Arabic question answering, AraBERT, RoBERTa, CAMeLBERT, BERT, Classical Arabic
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Optimized Quran Passage Retrieval Using an Expanded QA Dataset and Fine-Tuned Language Models. https://app.cochat.ai/papers/10.48550/arxiv.2412.11431
- The paper
- Basem, M., Oshallah, I., Hikal, B., Hamdi, A., & Mohamed, A. (2024). Optimized Quran Passage Retrieval Using an Expanded QA Dataset and Fine-Tuned Language Models. arXiv. https://doi.org/10.48550/arxiv.2412.11431
