The DOI matches its Crossref record; 9 of the 9 references it cites were found in a registry or an index; none of the 11 sources its claims cite is checked for support yet.
A Dataset of Wolof Ajami Manuscripts for HTR and OCR
Open accessAbstract
We present the first ever dataset of manually segmented and transcribed Ajami manuscripts written in Wolof.The term Ajami refers to modified Arabic-script orthographies used to transcribe African languages.Handwritten text recognition (HTR) and optical character recognition (OCR) models for Arabic-script languages perform poorly on African languages written in Ajami orthographies because these languages are not represented in the pre-training data of the models.This leads to recognition models being unable to extract unique Arabic-script letters and ubiquitous diacritics used in African languages, and struggling to adapt to various calligraphy styles used across Africa.We release the following as an open-source dataset: an ALTO formatting of high-quality images of handwritten and printed, 20th-century Wolof manuscripts; manual segmentation (region and line); and manual transcriptions.We extend our contribution by evaluating several Arabic-script recognition models intended for historical manuscripts and find they produce character error rates (CER) of 61-81%.Transcriptions produced by the evaluated recognition models, as well as a keyboard to transcribe Wolof Ajami manuscripts, are released as well.The digitally transcribed text in the dataset can also be utilized for various natural language processing (NLP) and historical linguistic tasks.
Overview
CoChat Summary
TL;DR
The paper presents the first dataset of manually segmented and transcribed Ajami manuscripts written in Wolof, comprising 19 20th-century manuscripts (4,743 lines, 313 pages) in ALTO format plus a specialized keyboard. It evaluates OpenITI Arabic-script recognition models and reports high character error rates of 61–81%.
Key findings
- The dataset contains 19 20th-century Wolof Ajami manuscripts covering 4,743 lines and 313 pages; 9 prose and 10 poetry manuscripts; 8 handwritten and 11 printed; all in Maghrebi calligraphy; provenance Touba, Senegal.
- Evaluated OpenITI Arabic-script HTR/OCR models produce CERs of 61–81% on Wolof Ajami; MS Mellon Print performs best (CER 0.625) and Urdu Print worst (CER 0.822).
- Models struggle to recognize Arabic-script diacritics (tashkīl) and unique Wolof Ajami letters/diacritics absent from their pre-training languages; top three models better capture general line structure but omit diacritics and unique Wolof characters.
- The authors release the ALTO-formatted dataset, model transcriptions, and a Keyman keyboard for transcribing historical Wolof Ajami manuscripts as open source.
Methods
- Curated 19 20th-century Wolof Ajami manuscripts from Boston University’s Ajami collection (“The Four Languages” and “African Ajami Library”); dataset includes high-quality images, manual region and line segmentation, line order, and manual transcriptions in ALTO format.
- Annotation used eScriptorium; each manuscript was transcribed by a philologist with Wolof Ajami expertise and then independently reviewed for error correction.
- Baseline experiments evaluated OpenITI’s suite of Arabic-script recognition models for historical manuscripts (MS Mellon Print, MS Pretrained, Generalized, Mellon Ottoturk Print, Mellon Print, Pretrained Print, Urdu Print) using character error rate (CER).
Limitations
- The paper does not include a dedicated limitations section; it states that existing recognition models perform poorly due to lack of appropriate training data for Wolof Ajami orthography and the heavy use of diacritics and unique letters absent from pre-training languages.
- Evident from the text: the dataset is limited to 20th-century Wolof Ajami manuscripts from Touba, Senegal, all in Maghrebi calligraphy, sourced from Boston University’s Ajami collection (8 handwritten, 11 printed).
- Evident from the text: the manuscript count is inconsistent—Section 2 reports 19 manuscripts, while the Conclusion reports 17 manuscripts; baseline evaluation is limited to OpenITI’s suite of Arabic-script models.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
0 Valid · 0 Not valid · 7 Not checked · 33 Own results and interpretations
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“As seen in Table 3, we observe high CERs when these existing recognition models for historical Arabic-script manuscripts attempt to transcribe Wolof Ajami manuscripts.”
§ A Dataset of Wolof Ajami Manuscripts for HTR and OCR > 3.1. Results and Analysis
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Furthermore, the models are also unable to recognize unique letters and diacritics that exist in the Wolof Ajami orthography (Figure 2) and are not represented in the training data for these models.”
§ A Dataset of Wolof Ajami Manuscripts for HTR and OCR > 3.1. Results and Analysis
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper states — it cites no source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Conversely, much longer words are produced by the Mellon Ottoturk Print and Mellon Print models.”
§ A Dataset of Wolof Ajami Manuscripts for HTR and OCR > 3.1. Results and Analysis
plainstates an association- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“We qualitatively observe in many examples that the top three models better recognize the general structure of the ground truth lines.”
§ A Dataset of Wolof Ajami Manuscripts for HTR and OCR > 3.1. Results and Analysis
hedgedstates an association- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper states — it cites no source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“we have created a Keyman 1 keyboard with specifications that reflect the character inventory needed to transcribe historical Wolof manuscripts.”
§ A Dataset of Wolof Ajami Manuscripts for HTR and OCR > 2. Dataset and Curation
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Rests on 2 assumptions not shown here.
18 more claims
Create a free account to see all 40 claims and to verify the 1 reference still open.
- It may state two separate claims as one. 13
- Probably not a substantial claim. 5
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
Each contradiction between two passages listed here was confirmed by an independent check.
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
§ A Dataset of Wolof Ajami Manuscripts for HTR and OCR > 4. Conclusion
“We find that these existing models produce high character error rates of 61-81% when trying to transcribe Wolof Ajami text.”
§ A Dataset of Wolof Ajami Manuscripts for HTR and OCR > 4. Conclusion
“| Urdu Print | 0.822 |”
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
§ A Dataset of Wolof Ajami Manuscripts for HTR and OCR > 2. Dataset and Curation
“We have curated 19 20th-century Wolof Ajami manuscripts covering 4,743 lines and 313 pages in total.”
§ A Dataset of Wolof Ajami Manuscripts for HTR and OCR > 4. Conclusion
“Our opensource dataset contains high-quality images of 17 manuscripts, manual segmentation for the region and line level, and diplomatic transcriptions provided by experts.”
Citations
Cites
No Language Left Behind: Scaling Human-Centered Machine Translation
Nllb Team, Costa‐jussà, M. R., Cross, J., Çelebi, O., Elbayad, M., Heafield, K., Heffernan, K. S., Kalbassi, E., Lam, J., Licht, D. J., et al. (2022) · arXiv (Cornell University) · doi:10.48550/arxiv.2207.04672 · Cited by 362
MasakhaNER 2.0: Africa-centric Transfer Learning for Named Entity Recognition
Adelani, D. I., Neubig, G., Ruder, S., Rijhwani, S., Beukman, M., Palen-Michel, C., Lignos, C., Alabi, J. O., Muhammad, S. H., Nabende, P., et al. (2022) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2022.emnlp-main.298 · Cited by 80
Self-citationAfroLM: A Self-Active Learning-based Multilingual Pretrained Language Model for 23 African LanguagesPreprint
Dossou, B. F. P., Tonja, A. L., Yousuf, O., Osei, S., Oppong, A., Shode, I., Awoyomi, O. O., & Emezue, C. C. (2022) · arXiv (Cornell University) · doi:10.48550/arxiv.2211.03263 · Cited by 36
Self-citationAfriQA: Cross-lingual Open-Retrieval Question Answering for African LanguagesPreprint
Ogundepo, O., Gwadabe, T., Rivera, C. E., Clark, J. H., Ruder, S., Adelani, D. I., Dossou, B. F. P., Abdou Aziz, D. I. O. P., Sikasote, C., Hacheme, G., et al. (2023) · arXiv (Cornell University) · doi:10.48550/arxiv.2305.06897 · Cited by 32
MasakhaPOS: Part-of-Speech Tagging for Typologically Diverse African languages
Dione, C. M. B., Adelani, D. I., Nabende, P., Alabi, J. O., Sindane, T., Buzaaba, H., Muhammad, S. H., Emezue, C. C., Ogayo, P., Aremu, A., et al. (2023) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2023.acl-long.609 · Cited by 26
OCR Improves Machine Translation for Low-Resource Languages
Ignat, O., Maillard, J., Chaudhary, V., & Guzmán, F. (2022) · Findings of the Association for Computational Linguistics: ACL (Findings of ACL) · doi:10.18653/v1/2022.findings-acl.92 · Cited by 25
Adelani, D. I., Alabi, J. O., Fan, A., Kreutzer, J., Shen, X., Reid, M., Ruiter, D., Klakow, D., Nabende, P., Chang, E., et al. (2022) · arXiv (Cornell University) · doi:10.48550/arxiv.2205.02022 · Cited by 23
Self-citationAdvances and Limitations in Open Source Arabic-Script OCR: A Case Study
Kiessling, B., Kurin, G., Miller, M. T., & Smail, K. (2021) · Digital Studies / Le champ numérique · doi:10.16995/dscn.8094 · Cited by 22
Where Are We? Evaluating LLM Performance on African Languages
Adebara, I., Toyin, H. O., Ghebremichael, N. T., Elmadany, A., & Abdul-Mageed, M. (2025) · arXiv · doi:10.48550/arxiv.2502.19582
Research works printed but not linked: 17
- Birhanu Belay, Tewodros Habtegebrial, Million Meshesha, Marcus Liwicki, Gebeyehu Belay, and Didier Stricker. 2020. Amharic ocr: an end- to-end learning. Applied Sciences, 10(3):1117.
- Birhanu Hailu Belay, Isabelle Guyon, Tadele Mengiste, Bezawork Tilahun, Marcus Liwicki, Tesfa Tegegne, and Romain Egele. 2024. A his- torical handwritten dataset for ethiopic ocr with baseline models and human-level performance. In International Conference on Document Analy- sis and Recognition, pages 23-38. Springer.
- Emanuela Boroş, Ahmed Hamdi, Elvys Linhares Pontes, Luis-Adrián Cabrera-Diego, Jose G Moreno, Nicolas Sidere, and Antoine Doucet. 2020. Alleviating digitization errors in named entity recognition for historical documents. In Proceedings of the 24th conference on computa- tional natural language learning, pages 431-441.
- Safiullah Faizullah, Muhammad Sohaib Ayub, Sajid Hussain, and Muhammad Asad Khan. 2023. A survey of ocr in arabic language: applications, techniques, and challenges. Applied Sciences, 13(7):4584.
- Mahmoud SalahEldin Kasem, Mohamed Mah- moud, and Hyun-Soo Kang. 2023. Advance- ments and challenges in arabic optical charac- ter recognition: A comprehensive survey. ACM Computing Surveys.
- Benjamin Kiessling, Robin Tissot, Peter Stokes, and Daniel Stökl Ben Ezra. 2019. escriptorium: an open source platform for historical document analysis. In 2019 international conference on document analysis and recognition workshops (icdarw), volume 2, pages 19-19. IEEE.
- Daniel Lopresti. 2008. Optical character recogni- tion errors and their effects on natural language processing. In Proceedings of the second work- shop on Analytics for Noisy Unstructured Text Data, pages 9-16.
- Mohammed Lutf, Xinge You, Yiu-ming Cheung, and CL Philip Chen. 2014. Arabic font recognition based on diacritics features. Pattern Recognition, 47(2):672-684.
- Matthew Thomas Miller, Maxim G Romanov, and Sarah Bowen Savant. 2018. Digitizing the textual heritage of the premodern islamicate world: Prin- ciples and plans. International Journal of Middle East Studies, 50(1):103-109.
- Meikal Mumin. 2014. The arabic script in africa: understudied literacy. In The Arabic Script in Africa, pages 41-76. Brill.
- Fallou Ngom. 2016. Muslims beyond the Arab world: The odyssey of ajami and the Muridiyya. Oxford University Press.
- Fallou Ngom. 2017. West african manuscripts in arabic and african languages and digital preser- vation. In Oxford research encyclopedia of African history.
- Fallou Ngom, Daivi Rodima-Taylor, and David Robinson. 2023. ajamī literacies of africa: The hausa, fula, mandinka, and wolof traditions. Is- lamic Africa, 14(2):119-143.
- Maxim Romanov, Matthew Thomas Miller, Sarah Bowen Savant, and Masoumeh Seydi. 2019. Open islamicate texts initiative: A machine-readable corpus of texts produced in the premodern islamicate world (poster). In Digital Humanities 2019 Conference Papers (9-12 July 2019). Utrecht University, 2019.
- Eddie Antonio Santos and Atticus Harrigan. 2020. Design and evaluation of a smartphone key- board for plains cree syllabics. In Proceedings of the 1st Joint Workshop on Spoken Language Technologies for Under-Resourced Languages (SLTU) and Collaboration and Computing for Under-Resourced Languages (CCURL), pages 88-96.
- Esther H Showalter. 2016. Mobile device keyboard customization for a newly constructed orthogra- phy of a rural west african language. In Proceed- ings of the Eighth International Conference on Information and Communication Technologies and Development, pages 1-4.
- Oreen Yousuf, Abdulmalik Aminu, Musa Salih Muhammad, Bashir Usman, Mustapha Kurfi Hashim, Joakim Nivre, Beáta Megyesi, and Christian Høgel. 2025. A handwritten text recog- nition dataset for ajami manuscripts in fulfulde and hausa. In International Conference on Docu- ment Analysis and Recognition, pages 620-637. Springer.
Cited by
Brisville-Fertin, O. (2026) · Journal of Open Humanities Data · doi:10.5334/johd.646
Metadata
- Authors
- Yousuf, O., Diagne, E. D., Høgel, C., Megyesi, B., & Nivre, J.
- Affiliations
- Uppsala University (SE)
- Lund University (SE)
- Venue
- Proceedings of the Language Resources and Evaluation Conference
- Published
- 2026-05
- Pages
- 3234-3239
- ISSN
- 2522-2686
- OpenAlex
- W7160193388
- Semantic Scholar
- 0e8ada12f59df227408c7472cdf31e2cc09015e3
- Cited by
- 0
- References
- 9
- FWCI
- 1.29
- Type
- conference paper
- Language
- en
- Open access
- bronze
- doi.org
- Locations
- Language Resources and Evaluation Conference (LREC) (publishedVersion)
- Funders
- Vetenskapsrådet (2022-06343)
- Riksbankens Jubileumsfond (M24-0028)
- Topics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Handwritten Text Recognition Techniques
- Social Sciences › Arts and Humanities › Literature and Literary Theory › Digital Humanities and Scholarship
- Physical Sciences › Computer Science › Artificial Intelligence › Natural Language Processing Techniques
- Keywords
- Ajami script, Wolof language, handwriting recognition, optical character recognition, historical manuscripts, character error rate, diacritics, calligraphic style, transcription, low-resource languages
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
A language model drew the claims from the paper on 2026-11-16, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-11-16 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: A Dataset of Wolof Ajami Manuscripts for HTR and OCR. https://app.cochat.ai/papers/10.63317/4pz98ojeeqpw
- The paper
- Yousuf, O., Diagne, E. D., Høgel, C., Megyesi, B., & Nivre, J. (2026). A Dataset of Wolof Ajami Manuscripts for HTR and OCR. Proceedings of the Language Resources and Evaluation Conference. https://doi.org/10.63317/4pz98ojeeqpw
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.