The DOI matches its DataCite record.
TCE at Qur'an QA 2023 Shared Task: Low Resource Enhanced Transformer-based Ensemble Approach for Qur'anic QA
Open accessAbstract
In this paper, we present our approach to tackle Qur'an QA 2023 shared tasks A and B. To address the challenge of low-resourced training data, we rely on transfer learning together with a voting ensemble to improve prediction stability across multiple runs. Additionally, we employ different architectures and learning mechanisms for a range of Arabic pre-trained transformer-based models for both tasks. To identify unanswerable questions, we propose using a thresholding mechanism. Our top-performing systems greatly surpass the baseline performance on the hidden split, achieving a MAP score of 25.05% for task A and a partial Average Precision (pAP) of 57.11% for task B.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“As the augmentation showed noticeable improvements, we decide to continue exploring in this direction and propose new augmentation techniques.”
From Burhan at IslamicEval: Fact-Augmented and LLM-Driven Retrieval for Islamic QA (2025) · cites this paper as Elkomy and Sarhan, 2024
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
No references could be resolved yet.
Research works printed but not linked: 23
- Wissam Antoun, Fady Baly, and Hazem Hajj. 2020. Arabert: Transformer-based model for arabic lan- guage understanding. pages 9-15. European Lan- guage Resource Association.
- Wissam Antoun, Fady Baly, and Hazem Hajj. 2021. Araelectra: Pre-training text discriminators for arabic language understanding. pages 191-195. Association for Computational Linguistics.
- Muhammad Huzaifa Bashir, Aqil M Azmi, Haq Nawaz, Wajdi Zaghouani, Mona Diab, Ala Al-Fuqaha, and Junaid Qadir. 2021. Arabic natural language process- ing for qur'anic research: A systematic review.
- Jonathan H Clark, Eunsol Choi, Michael Collins, Dan Garrette, Tom Kwiatkowski, Vitaly Nikolaev, and Jennimaria Palomaki. 2020. Tydi qa: A benchmark for information-seeking question answering in ty- pologically diverse languages. Transactions of the Association for Computational Linguistics.
- Jacob Devlin, Ming-Wei Chang, Kenton Lee, and Kristina Toutanova. 2019. Bert: Pre-training of deep bidirectional transformers for language understand- ing. pages 4171-4186. Association for Computa- tional Linguistics. · DOI · Paper page
- Mohamemd Elkomy and Amany M Sarhan. 2022. Tce at qur'an qa 2022: Arabic language question answer- ing over holy qur'an using a post-processed ensemble of bert-based models. pages 154-161. European Lan- guage Resources Association.
- Siddhant Garg, Thuy Vu, and Alessandro Moschitti. 2020. Tanda: Transfer and adapt pre-trained trans- former models for answer sentence selection. vol- ume 34, pages 7780-7788.
- Go Inoue, Bashar Alhafni, Nurpeiis Baimukan, Houda Bouamor, and Nizar Habash. 2021. The interplay of variant, size, and task type in arabic pre-trained language models. Association for Computational Linguistics.
- Amr Keleg and Walid Magdy. 2022. Smash at qur'an qa 2022: Creating better faithful data splits for low- resourced question answering scenarios. pages 136- 145. European Language Resources Association.
- Rana Malhas and Tamer Elsayed. 2020. AyaTEC: Build- ing a Reusable Verse-based Test Collection for Ara- bic Question Answering on the Holy Qur'an. ACM Transactions on Asian and Low-Resource Language Information Processing, 19(6):1-21.
- Rana Malhas and Tamer Elsayed. 2022. Arabic Ma- chine Reading Comprehension on the Holy Qur'an using CL-AraBERT. Information Processing & Man- agement, 59(6):103068.
- Rana Malhas, Watheq Mansour, and Tamer Elsayed. 2022. Qur'an QA 2022: Overview of the First Shared Task on Question Answering over the Holy Qur'an. In Proceedings of the 5th Workshop on Open-Source Arabic Corpora and Processing Tools (OSACT5) at the 13th Language Resources and Evaluation Con- ference (LREC 2022), pages 79-87.
- Rana Malhas, Watheq Mansour, and Tamer Elsayed. 2023. Qur'an QA 2023 Shared Task: Overview of Passage Retrieval and Reading Comprehension Tasks over the Holy Qur'an. In Proceedings of the First Arabic Natural Language Processing Confer- ence (ArabicNLP 2023), Singapore.
- RANA R MALHAS. 2023. ARABIC QUESTION AN- SWERING ON THE HOLY QUR'AN. Ph.D. thesis.
- Ali Mostafa and Omar Mohamed. 2022. Gof at qur'an qa 2022: Towards an efficient question answering for the holy qu'ran in the arabic language using deep learning-based approach. pages 104-111. European Language Resources Association.
- Pranav Rajpurkar, Robin Jia, and Percy Liang. 2018. Know what you don't know: Unanswerable ques- tions for SQuAD. In Proceedings of the 56th Annual Meeting of the Association for Computational Lin- guistics (Volume 2: Short Papers), pages 784-789, Melbourne, Australia. Association for Computational Linguistics. · DOI · Paper page
- Pranav Rajpurkar, Jian Zhang, Konstantin Lopyrev, and Percy Liang. 2016. Squad: 100,000+ questions for machine comprehension of text. pages 2383-2392. Association for Computational Linguistics. · DOI · Paper page
- Omer Sagi and Lior Rokach. 2018. Ensemble learn- ing: A survey. WIREs Data Mining and Knowledge Discovery, 8(4):e1249. · DOI · Paper page
- Minjoon Seo, Aniruddha Kembhavi, Ali Farhadi, and Hannaneh Hajishirzi. 2016. Bidirectional attention flow for machine comprehension. arXiv preprint arXiv:1611.01603. · arXiv
- Ahmed Sleem, Eman Mohammed lotfy Elrefai, Marwa Mohammed Matar, and Haq Nawaz. 2022. Stars at qur'an qa 2022: Building automatic extrac- tive question answering systems for the holy qur'an with transformer models and releasing a new dataset. pages 146-153. European Language Resources As- sociation.
- Thomas Wolf, Lysandre Debut, Victor Sanh, Julien Chaumond, Clement Delangue, Anthony Moi, Pier- ric Cistac, Tim Rault, Rémi Louf, Morgan Funtowicz, and Jamie Brew. 2019. Huggingface's transformers: State-of-the-art natural language processing. CoRR, abs/1910.03771. · arXiv
- Andrew Yates, Rodrigo Nogueira, and Jimmy Lin. 2021. Pretrained transformers for text ranking: BERT and beyond. In Proceedings of the 2021 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Tech- nologies: Tutorials, pages 1-4, Online. Association for Computational Linguistics. · DOI
- Jingtao Zhan, Jiaxin Mao, Yiqun Liu, Jiafeng Guo, Min Zhang, and Shaoping Ma. 2021. Optimizing dense retrieval model training with hard negatives. In Pro- ceedings of the 44th International ACM SIGIR Con- ference on Research and Development in Information Retrieval, SIGIR '21, page 1503-1512, New York, NY, USA. Association for Computing Machinery. · DOI · Paper page
Cited by
Sorted by citations
Burhan at IslamicEval: Fact-Augmented and LLM-Driven Retrieval for Islamic QA
Basheer, M., Mansour, W., Touma, A., & Qadeib Alban, A. (2025) · Proceedings of The Third Arabic Natural Language Processing Conference: Shared Tasks · doi:10.18653/v1/2025.arabicnlp-sharedtasks.73
Metadata
- Authors
- Elkomy, M. A., & Sarhan, A.
- Affiliations
- Tanta University (EG)
- ORCID
- Sarhan, Amany
- Venue
- arXiv
- Publisher
- arXiv
- Published
- 2024
- Pages
- 728-742
- arXiv
- 2401.13060
- OpenAlex
- W4389518327
- Cited by
- 5
- References
- 0
- Citations by year
- 2025: 2 · 2024: 2
- FWCI
- 0.89
- Type
- conference paper
- Language
- en
- Open access
- green
- arxiv.org
- Licence
- Locations
- Arabic Natural Language Processing Conference (ArabicNLP) (publishedVersion)
- arXiv (Cornell University) (submittedVersion, cc-by)
- arXiv (Cornell University) (cc-by)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Topic Modeling
- Physical Sciences › Computer Science › Artificial Intelligence › Natural Language Processing Techniques
- Physical Sciences › Computer Science › Information Systems › Information Retrieval and Search Behavior
- Keywords
- transfer learning, ensemble voting, Quran
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
