The DOI matches its DataCite record; 6 of the 17 references it cites were found in a registry or an index, and 11 are not checked yet; none of the 53 sources its claims cite is checked for support yet.
CHURRO: Making History Readable with an Open-Weight Large Vision-Language Model for High-Accuracy, Low-Cost Historical Text Recognition
Open accessAbstract
Accurate text recognition for historical documents can greatly advance the study and preservation of cultural heritage. Existing vision-language models (VLMs), however, are designed for modern, standardized texts and are not equipped to read the diverse languages and scripts, irregular layouts, and frequent degradation found in historical materials. This paper presents CHURRO, a 3B-parameter open-weight VLM specialized for historical text recognition. The model is trained on CHURRO-DS, the largest historical text recognition dataset to date. CHURRO-DS unifies 155 historical corpora comprising 99,491 pages, spanning 22 centuries of textual heritage across 46 language clusters, including historical variants and dead languages. We evaluate several open-weight and closed VLMs and optical character recognition (OCR) systems on CHURRO-DS and find that CHURRO outperforms all other VLMs. On the CHURRO-DS test set, CHURRO achieves 82.3% (printed) and 70.1% (handwritten) normalized Levenshtein similarity, surpassing the second-best model, Gemini 2.5 Pro, by 1.4% and 6.5%, respectively, while being 15.5 times more cost-effective. By releasing the model and dataset, we aim to enable community-driven research to improve the readability of historical texts and accelerate scholarship.
Checked 2026-11-16 · 11 references not checked yet
Overview
CoChat Summary
TL;DR
CHURRO is a 3B open-weight vision-language model fine-tuned on CHURRO-DS, a unified historical text recognition dataset of 155 corpora and 99,491 pages spanning 22 centuries, 46 language clusters, and 14 scripts. It achieves 82.3% printed and 70.1% handwritten normalized Levenshtein similarity, outperforming Gemini 2.5 Pro by 1.4% and 6.5% while being 15.5 times more cost-effective.
Key findings
- CHURRO-DS unifies 155 historical corpora comprising 99,491 pages, spanning 22 centuries, 46 language clusters, and 14 scripts; it contains 97,151 training samples and 1,170 samples each for validation and test, with 29 of 46 language clusters appearing in validation/test.
- CHURRO achieves 82.3% (printed) and 70.1% (handwritten) normalized Levenshtein similarity, surpassing the second-best model, Gemini 2.5 Pro, by 1.4% and 6.5%, respectively, while being 15.5 times more cost-effective. Fine-tuning improves Qwen 2.5 VL (3B) by 14.5% on printed and 27.2% on handwritten documents.
- Zero-shot best commercial model Gemini 2.5 Pro reaches 80.9% printed and 63.6% handwritten; best open-weight VLMs reach 72.7% printed (NuMarkdown) and 54.5% handwritten (Qwen 2.5 VL 72B); Azure OCR reaches 71.9% printed and 47.7% handwritten.
- In error analysis of 50 predictions, zero-shot Qwen 2.5 VL (3B) had major reading-order errors in 42% and major hallucinations in 36%; CHURRO had 16% reading-order errors and no hallucinations. Historical Chinese is hardest, with even the oracle ensemble at only 14.4% on printed Chinese; handwritten Sanskrit, Khmer, and Hebrew oracle scores are 26.1%, 32.9%, and 59.1%.
Methods
- Dataset curation: selected corpora predating the mid-20th century with research-use licenses and human-annotated page-level gold text; standardized ALTO XML, PAGE XML, JSON, and plain text into one reading-order string per page; used diplomatic transcription; added language/script metadata; removed pages under 30 tokens and about 15,000 near-duplicates via Min-Hash; resized large images to fit within 2500×2500 pixels.
- Model training: fine-tuned Qwen 2.5 VL (3B) for 5 epochs on 32 NVIDIA H100 GPUs with effective batch size 128, learning rate 5×10⁻⁵, cosine schedule, about 25 hours; limited inputs to 5,120 image patches of 28×28 pixels; total computation about 6,000 GPU-hours.
- Evaluation: benchmarked open-weight and closed VLMs plus OCR systems on the CHURRO-DS test set in zero-shot and fine-tuned settings; computed character-level normalized Levenshtein similarity per example and averaged separately for printed and handwritten subsets; applied same normalization to all predictions and additional Arabic diacritics/hamza normalization with PyArabic; used temperature 0 and max generation of 20,000 tokens for non-reasoning models and 40,000 for reasoning models.
Limitations
- The paper states CHURRO-DS still underrepresents some languages, reflecting scarcity of annotated historical datasets for lower-resource languages, and currently includes no languages native to the African continent. It also states only standard supervised fine-tuning was explored, with future work needed on more advanced training methods.
- Evident from the text: some language clusters have very few training examples (e.g., printed Chinese has 6, handwritten Portuguese has 12), and 17 of 46 language clusters appear only in training, not validation/test. The paper also reports gold-standard annotation omissions in 2 of 50 error-analysis examples, remaining CHURRO reading-order errors (e.g., a Danish postcard), repetitive degeneration on a Latin manuscript, and low performance on Chinese, Sanskrit, Khmer, and Hebrew.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Figures

















Verification
Claims the paper makes
0 Valid · 4 Not valid · 41 Not checked · 126 Own results and interpretations
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Relative to Azure OCR alone, the hybrid system improves notably for Bengali and Romanian.”
§ CHURRO: Making History Readable with an Open-Weight Large Vision-Language Model for High-Accuracy, Low-Cost Historical Text Recognition > 4.3 Evaluation Results on Printed Documents
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“CHURRO outperforms all other VLMs.”
§ CHURRO: Making History Readable with an Open-Weight Large Vision-Language Model for High-Accuracy, Low-Cost Historical Text Recognition > Abstract
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“improving upon the original Qwen 2.5 VL (3B) by 27.2%.”
§ CHURRO: Making History Readable with an Open-Weight Large Vision-Language Model for High-Accuracy, Low-Cost Historical Text Recognition > 4.4 Evaluation Results on Handwritten Texts
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“70.1% (handwritten) normalized Levenshtein similarity”
§ CHURRO: Making History Readable with an Open-Weight Large Vision-Language Model for High-Accuracy, Low-Cost Historical Text Recognition > Abstract
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Manual checks indicate that more than 98% of reading orders are accurate.”
§ CHURRO: Making History Readable with an Open-Weight Large Vision-Language Model for High-Accuracy, Low-Cost Historical Text Recognition > 3.2 Dataset Curation
hedged- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
77 more claims
Create a free account to see all 171 claims and to verify the 9 references still open.
- It may state two separate claims as one. 34
- Probably not a substantial claim. 62
- The quote only partly states this claim. 2
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
Each contradiction between two passages listed here was confirmed by an independent check.
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
§ CHURRO: Making History Readable with an Open-Weight Large Vision-Language Model for High-Accuracy, Low-Cost Historical Text Recognition > 4.1 Experimental Setup
“Nanonets OCR (3B) (Mandal et al., 2025)”
§ CHURRO: Making History Readable with an Open-Weight Large Vision-Language Model for High-Accuracy, Low-Cost Historical Text Recognition > Correspondence during the lifetime of Antoine-Louis Barye Anonymous documentation on Antoine-Louis Barye Documents relating to Barye's activity during his lifetime Biographical documentation on Antoine-Louis Barye Documents relating to the trade and exhibition of Barye's works after his death Iconographic documentation
“Nanonets OCR (4B)”
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
§ CHURRO: Making History Readable with an Open-Weight Large Vision-Language Model for High-Accuracy, Low-Cost Historical Text Recognition > 4.1 Experimental Setup
“MiMo VL (8B)(Xiaomi, 2025)”
§ CHURRO: Making History Readable with an Open-Weight Large Vision-Language Model for High-Accuracy, Low-Cost Historical Text Recognition > Correspondence during the lifetime of Antoine-Louis Barye Anonymous documentation on Antoine-Louis Barye Documents relating to Barye's activity during his lifetime Biographical documentation on Antoine-Louis Barye Documents relating to the trade and exhibition of Barye's works after his death Iconographic documentation
“MiMo VL (7B)”
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
§ CHURRO: Making History Readable with an Open-Weight Large Vision-Language Model for High-Accuracy, Low-Cost Historical Text Recognition > 3.1 Dataset Selection
“1) Documents must originate prior to the mid-20th century.”
§ CHURRO: Making History Readable with an Open-Weight Large Vision-Language Model for High-Accuracy, Low-Cost Historical Text Recognition > References
“Digital Peraire (Chagué and Pérez, 2023) Description: The documents are handwritten, dat- ing from the second half of the 20th century”
Citations
Cites
Sigmoid Loss for Language Image Pre-Training
Zhai, X., Mustafa, B., Kolesnikov, A., & Beyer, L. (2023) · 2023 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.01100 · Cited by 1,127
Phi-4-Mini Technical Report: Compact yet Powerful Multimodal Language Models via Mixture-of-LoRAsPreprint
Microsoft, :, Abouelenin, A., Ashfaq, A., Atkinson, A., Awadalla, H. H., Bách, N., Bao, J., Benhaim, A., Cai, M., et al. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2503.01743 · Cited by 815
Vision-R1: Incentivizing Reasoning Capability in Multimodal Large Language ModelsPreprint
Huang, W., Jia, B., Zhai, Z., Cao, S., Ye, Z., Zhao, F., Xu, Z., Tang, X., Hu, Y., & Lin, S. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2503.06749 · Cited by 805
Intern VL: Scaling up Vision Foundation Models and Aligning for Generic Visual-Linguistic Tasks
Chen, Z., Wu, J., Wang, W., Su, W., Chen, G., Xing, S., Zhong, M., Zhang, Q., Zhu, X., Lu, L., et al. (2024) · 2024 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52733.2024.02283 · Cited by 734
MMBench: Is Your Multi-modal Model an All-Around Player?
Liu, Y., Duan, H., Zhang, Y., Li, B., Zhang, S., Zhao, W., Yuan, Y., Wang, J., He, C., Liu, Z., et al. (2025) · Lecture Notes in Computer Science · doi:10.1007/978-3-031-72658-3_13 · Cited by 668
DocBank: A Benchmark Dataset for Document Layout Analysis
Li, M., Xu, Y., Cui, L., Huang, S., Wei, F., Li, Z., & Zhou, M. (2020) · Proceedings of the 28th International Conference on Computational Linguistics · doi:10.18653/v1/2020.coling-main.82 · Cited by 217
Kahle, P., Colutto, S., Hackl, G., & Muhlberger, G. (2017) · 2017 14th IAPR International Conference on Document Analysis and Recognition (ICDAR) · doi:10.1109/icdar.2017.307 · Cited by 108
Sulaiman, A., Omar, K., & Nasrudin, M. F. (2019) · Journal of Imaging · doi:10.3390/jimaging5040048 · Cited by 100
A survey of OCR evaluation tools and metrics
Neudecker, C., Baierer, K., Gerber, M., Clausner, C., Antonacopoulos, A., & Pletschacher, S. (2021) · The 6th International Workshop on Historical Document Imaging and Processing · doi:10.1145/3476887.3476888 · Cited by 81
Yang, H., Jin, L., Huang, W., Yang, Z., Lai, S., & Sun, J. (2018) · IEEE Access · doi:10.1109/access.2018.2840218 · Cited by 59
Research works printed but not linked: 65
- 2023. Aldicam-2023: Diachronic and interactive lin- guistic atlas of the community of madrid. https: //aldicam.corpuscodea.es/consultas.php. Accessed: 2025-05-18. 2025. Osman agha dataset: Images and transcription from british library ms. or. 3213 and kreutel's 1980 edition. Based on London, British Library, MS. Or. 3213 and Richard F. Kreutel's 1980 transcription: *Die Autobiographie des Dolmetschers Osman Aga aus Temeschwar*, The E. J. W. Gibb Memorial Trust, Cambridge.
- Lien Ceard, Fanny Lebreton, and Cécile Sajdak. 2022. Projet correspondance berlioz. Created as part of a transcription project of the active correspondence from Hector Berlioz to his sister Nanci Berlioz, by students of the TNAH master's program at the École nationale des chartes. Center for Open Data in the Humanities. 2019. Japanese classics dataset (collection of the national museum of japanese literature, etc.). Center for Open Data in the Humanities (CODH) and National Institute for Japanese Language and Linguis- tics (NINJAL). 2025. Modern magazine ocr training dataset. · doi:10.20676/00000415
- Alix Chagué. 2021. Tapuscorpus. If you use this soft- ware, please cite it as above. · doi:10.5072/zenodo.977649
- Liang Cheng, Jonas Frankemölle, Adam Axelsson, and Ekta Vats. 2024. Uncovering the handwritten text in the margins: End-to-end handwritten text detection and recognition. In Proceedings of the 8th Joint SIGHUM Workshop on Computational Linguistics for Cultural Heritage, Social Sciences, Humanities and Literature (LaTeCH-CLfL 2024), pages 111-120, St. Julians, Malta. Association for Computational Linguistics.
- Wei-Lin Chiang, Lianmin Zheng, Ying Sheng, Anas- tasios Nikolas Angelopoulos, Tianle Li, Dacheng Li, Banghua Zhu, Hao Zhang, Michael I. Jordan, Joseph E. Gonzalez, and Ion Stoica. 2024. Chat- bot arena: An open platform for evaluating llms by human preference. In Forty-first International Con- ference on Machine Learning, ICML 2024, Vienna, Austria, July 21-27, 2024. OpenReview.net. Floriane Chiffoleau. 2021. dahncorpus. · doi:10.5281/zenodo.5911868
- Christian Clausner, Apostolos Antonacopoulos, Tom Derrick, and Stefan Pletschacher. 2017. Icdar2017 competition on recognition of early indian printed documents -reid2017. In 2017 14th IAPR Interna- tional Conference on Document Analysis and Recog- nition (ICDAR), volume 01, pages 1411-1416. · doi:10.1109/icdar.2017.230
- Christian Clausner, Apostolos Antonacopoulos, Tom Derrick, and Stefan Pletschacher. 2019a. Icdar2019 competition on recognition of early indian printed documents-reid2019. In 2019 International Con- ference on Document Analysis and Recognition (IC- DAR), pages 1527-1532. IEEE.
- Christian Clausner, Apostolos Antonacopoulos, Nora McGregor, and Daniel Wilson-Nunn. 2018. Icfhr 2018 competition on recognition of historical arabic scientific manuscripts -rasm2018. 2018 16th In- ternational Conference on Frontiers in Handwriting Recognition (ICFHR), pages 471-476.
- Hoang-Quan Dang, Duy-Anh Nguyen, Phu-Phuoc Pham, Ngoc-Thinh Nguyen, Tan Chau, Duc-Vu Ngo, Trung-Hieu Nguyen, Chau-Thang Phan, The-Hien Trinh, Minh-Tri Nguyen, and 1 others. 2022. Nom- naocr: The first dataset for optical character recogni- tion on han-nom script. In 2022 RIVF International Conference on Computing and Communication Tech- nologies (RIVF), pages 476-481. IEEE.
- Andreas Wagner David Glück, Cindy Rico Carmona. 2018. Edition guidelines. https://www.salamanc a.school/guidelines.html.
- Melissa Dell, Jacob Carlson, Tom Bryan, Emily Sil- cock, Abhishek Arora, Zejiang Shen, Luca D'Amico- Wong, Quan Le, Pablo Querubin, and Leander Heldring. 2023. American stories: A large-scale structured text dataset of historical U.S. newspapers. In Advances in Neural Information Processing Sys- tems 36: Annual Conference on Neural Information Processing Systems 2023, NeurIPS 2023, New Or- leans, LA, USA, December 10 -16, 2023.
- Hans J.G.A. Dolfing, Jerome Bellegarda, Jan Chorowski, Ricard Marxer, and Antoine Laurent. 2020. The "ScribbleLens" Dutch historical handwrit- ing corpus. In International Conference on Frontiers of Handwriting Recognition (ICFHR), page To Appear. http://www.openslr.org/84/.
- Senka Drobac, Pekka Kauppinen, and Krister Lindén. 2017. OCR and post-correction of historical Finnish texts. In Proceedings of the 21st Nordic Conference on Computational Linguistics, pages 70-76, Gothen- burg, Sweden. Association for Computational Lin- guistics.
- David Fernández-Mota, Joan Almazán, Núria Cirera, Alicia Fornés, and Josep Lladós. 2014. Bh2m: The barcelona historical handwritten marriages database. In Proceedings of the 22nd International Conference on Pattern Recognition (ICPR), pages 256-261.
- Marc Frincu, Simina Frincu, and Marius E. Penteliuc. 2023. Challenges and solutions in transliterating 19th century Romanian texts from the transitional to the Latin script. In Proceedings of the 4th Conference on Language, Data and Knowledge, pages 226-231, Vienna, Austria.
- Ling Fu, Biao Yang, Zhebin Kuang, Jiajun Song, Yuzhe Li, Linghao Zhu, Qidi Luo, Xinyu Wang, Hao Lu, Mingxin Huang, and 1 others. 2025. Ocrbench v2: An improved benchmark for evaluating large multi- modal models on visual text localization and reason- ing. ArXiv preprint, abs/2501.00321. · arXiv
- Gemini Team Google. 2023. Gemini: A family of highly capable multimodal models. ArXiv preprint, abs/2312.11805. · arXiv
- Gemma Team, Thomas Mesnard, Cassidy Hardin, Robert Dadashi, Surya Bhupatiraju, Shreya Pathak, Laurent Sifre, Morgane Rivière, Mihir Sanjay Kale, Juliette Love, and 1 others. 2024. Gemma: Open models based on gemini research and technology. ArXiv preprint, abs/2403.08295. · arXiv
- Kioumars Ghereghlou, editor. 2018. Persian Text, vol- ume 98, pages 1-372. American Oriental Society. Accessed 20 May 2025. · doi:10.2307/j.ctv9b2vrs.5
- Estelle Guéville and David Joseph Wrisley. 2022. Tran- scribing medieval manuscripts for machine learning. ArXiv preprint, abs/2207.07726. · arXiv
- Adam W Harley, Alex Ufkes, and Konstantinos G Der- panis. 2015. Evaluation of deep convolutional nets for document image classification and retrieval. In 2015 13th international conference on document analysis and recognition (ICDAR), pages 991-995. IEEE.
- Aaron Jaech, Adam Kalai, Adam Lerer, Adam Richard- son, Ahmed El-Kishky, Aiden Low, Alec Helyar, Aleksander Madry, Alex Beutel, Alex Carney, and 1 others. 2024. Openai o1 system card. ArXiv preprint, abs/2412.16720. · arXiv
- Romain Karpinski, Devashish Lohani, and Abdel Be- laid. 2018. Metrics for complete evaluation of ocr performance. In Proceedings of the 22nd Interna- tional Conference on Image Processing, Computer Vision, and Pattern Recognition (IPCV), Las Vegas, United States. HAL Id: hal-01981731.
- Majeed Kassis, Alaa Abdalhaleem, Ahmad Droby, Reem Alaasam, and Jihad El-Sana. 2017. Vml-hd: The historical arabic documents dataset for recog- nition systems. In 1st International Workshop on Arabic Script Analysis and Recognition. IEEE.
- Benjamin Kiessling, Robin Tissot, Peter Stokes, and Daniel Stökl Ben Ezra. 2019. escriptorium: An open source platform for historical document analysis. In 2019 International Conference on Document Analy- sis and Recognition Workshops (ICDARW), volume 2, pages 19-19. · doi:10.1109/icdarw.2019.10032
- LECTAUREP, Aurélia Rostaing, Marc Durand, and Alix Chagué. 2021. Notaires de paris -répertoires: Ground truth for various parisian registries of notary deeds (french 19th and 20th centuries). Released on 2021-12-07. · doi:10.5072/zenodo.977691
- Kenton Lee, Mandar Joshi, Iulia Raluca Turc, Hexi- ang Hu, Fangyu Liu, Julian Martin Eisenschlos, Ur- vashi Khandelwal, Peter Shaw, Ming-Wei Chang, and Kristina Toutanova. 2023. Pix2struct: Screen- shot parsing as pretraining for visual language under- standing. In International Conference on Machine Learning, ICML 2023, 23-29 July 2023, Honolulu, Hawaii, USA, volume 202 of Proceedings of Machine Learning Research, pages 18893-18912.
- PMLR.
- David Lewis, Gady Agam, Shlomo Argamon, Ophir Frieder, David Grossman, and Jefferson Heard. 2006. Building a test collection for complex document in- formation processing. In Proceedings of the 29th annual international ACM SIGIR conference on Re- search and development in information retrieval, pages 665-666.
- Haotian Liu, Chunyuan Li, Qingyang Wu, and Yong Jae Lee. 2023a. Visual instruction tuning. In Advances in Neural Information Processing Systems 36: An- nual Conference on Neural Information Processing Systems 2023, NeurIPS 2023, New Orleans, LA, USA, December 10 -16, 2023.
- Yuliang Liu, Zhang Li, Mingxin Huang, Biao Yang, Wenwen Yu, Chunyuan Li, Xu-Cheng Yin, Cheng- Lin Liu, Lianwen Jin, and Xiang Bai. 2024b. Ocr- bench: on the hidden mystery of ocr in large multi- modal models. Science China Information Sciences, 67(12):220102.
- Ayush Maheshwari, Nikhil Singh, Amrith Krishna, and Ganesh Ramakrishnan. 2022b. A benchmark and dataset for post-OCR text correction in Sanskrit. In Findings of the Association for Computational Linguistics: EMNLP 2022, pages 6258-6265, Abu Dhabi, United Arab Emirates. Association for Com- putational Linguistics. · DOI
- Minesh Mathew, Dimosthenis Karatzas, and CV Jawa- har. 2021. Docvqa: A dataset for vqa on document images. In Proceedings of the IEEE/CVF winter con- ference on applications of computer vision, pages 2200-2209.
- Nicole Merkel-Hilf. 2022. Ground truth data for printed devanagari. · doi:10.11588/data/egokei
- Lucas Noëmie, Clément Salah, and Chahan Vidal- Gorène. 2022. New Results for the Text Recogni- tion of Arabic Maghribī Manuscripts -Managing an Under-resourced Script. Working paper or preprint.
- Vít Novotný, Kristýna Seidlová, Tereza Vrabcová, and Aleš Horák. 2021. When tesseract brings friends: Layout analysis, language identification, and super- resolution in the optical character recognition of me- dieval texts. In Proceedings of Recent Advances in Slavonic Natural Language Processing, RASLAN 2021, pages 91-100. Tribun EU. Numind. 2025. NuMarkdown-8B-Thinking. Model page. NVIDIA. 2025. Llama-3.1-Nemotron-Nano-VL-8B- V1. Model page.
- Sarah Oberbichler, Emanuela Boroş, Antoine Doucet, Jani Marjanen, Eva Pfanzelter, Juha Rautiainen, Hannu Toivonen, and Mikko Tolonen. 2022. Inte- grated interdisciplinary workflows for research on historical newspapers: Perspectives from humanities scholars, computer scientists, and librarians. Jour- nal of the Association for Information Science and Technology, 73(2):225-239.
- Linke Ouyang, Yuan Qu, Hongbin Zhou, Jiawei Zhu, Rui Zhang, Qunshu Lin, Bin Wang, Zhiyuan Zhao, Man Jiang, Xiaomeng Zhao, and 1 others. 2024. Omnidocbench: Benchmarking diverse pdf docu- ment parsing with comprehensive annotations. ArXiv preprint, abs/2412.07626. · arXiv
- Alexander James O'Neill and Nathan Hill. 2022. Text recognition for nepalese manuscripts in pracalit script. Journal of Open Humanities Data. · doi:10.5334/johd.90
- Werner Pantke, Martin Dennhardt, Daniel Fecker, Volker Märgner, and Tim Fingscheidt. 2014. An his- torical handwritten arabic dataset for segmentation- free word spotting -hadara80p. In 2014 14th In- ternational Conference on Frontiers in Handwriting Recognition, pages 15-20. · doi:10.1109/icfhr.2014.11
- Christos Papadopoulos, Stefan Pletschacher, Christian Clausner, and Apostolos Antonacopoulos. 2013. The impact dataset of historical document images. In Proceedings of the 2nd International Workshop on Historical Document Imaging and Processing, HIP '13, page 123-130, New York, NY, USA. Association for Computing Machinery. · doi:10.1145/2501115.2501130
- Paraskevi Platanou, John Pavlopoulos, and Georgios Papaioannou. 2022. Handwritten paleographic greek text recognition dataset (century-based). This dataset is part of the work: Platanou, P., Pavlopoulos, J., and Papaioannou, G. (2022). Handwritten Paleo- graphic Greek Text Recognition: A Century-Based Approach. In *Proceedings of the Thirteenth Lan- guage Resources and Evaluation Conference*, pp. 6585-6589, Marseille, France: ELRA.
- Stefan Pletschacher and Apostolos Antonacopoulos. 2010. The PAGE (Page Analysis and Ground-Truth Elements) Format Framework. In 2010 20th Inter- national Conference on Pattern Recognition, pages 257-260. IEEE.
- Irina Rabaev, Berat Kurar Bakarat, and Jihad El-Sana. 2019. The pinkas dataset. · doi:10.1109/icdar.2019.00122_dataset
- Alec Radford, Jong Wook Kim, Chris Hallacy, Aditya Ramesh, Gabriel Goh, Sandhini Agarwal, Girish Sas- try, Amanda Askell, Pamela Mishkin, Jack Clark, Gretchen Krueger, and Ilya Sutskever. 2021. Learn- ing transferable visual models from natural language supervision. In Proceedings of the 38th International Conference on Machine Learning, ICML 2021, 18-24 July 2021, Virtual Event, volume 139 of Proceedings of Machine Learning Research, pages 8748-8763. PMLR. Research Group Texts for the History of Spanish [GITHE]. 2022. CODEA+ 2022 (Corpus of Spanish documents prior to 1900). https://doi.org/10.3 7536/CODEA.2015. [online; accessed 2025-03-09]. · doi:10.37536/codea.2015
- Christian Reul, Dennis Christ, Alexander Hartelt, Nico Balbach, Maximilian Wehner, Uwe Springmann, Christoph Wick, Christine Grundig, Andreas Büttner, and Frank Puppe. 2019. Ocr4all-an open-source tool providing a (semi-) automatic ocr workflow for historical printings. Applied Sciences, 9(22):4853.
- Justyna Rogos-Hebda. 2025. Making sense of abbre- viation in late middle english literary manuscripts. In Abbreviating Middle English: Scribal Practices, Visual Texts and Medieval Multimodalities, pages 157-169. Springer.
- Matteo Romanello, Najem-Meyer Sven, and Bruce Robertson. 2021. Optical Character Recognition of 19th Century Classical Commentaries: The Current State of Affairs. In The 6th International Workshop on Historical Document Imaging and Processing (HIP '21), Lausanne. Association for Computing Ma- chinery. · doi:10.1145/3476887.3476911
- C.A. Romein, Michel de Gruijter, and Sara Floor Veld- hoen. 2020. The datafication of early modern ordi- nances. DH Benelux Journal, 2.
- Verónica Romero, Alejandro H. Toselli, Enrique Vidal, Joan Andreu Sánchez, Carlos Alonso, and Lourdes Marqués. 2019. Modern vs diplomatic transcripts for historical handwritten text recognition. In New Trends in Image Analysis and Processing -ICIAP 2019: ICIAP International Workshops, BioFor, Pa- tReCH, e-BADLE, DeepRetail, and Industrial Ses- sion, Trento, Italy, September 9-10, 2019, Revised Selected Papers, page 103-114, Berlin, Heidelberg. Springer-Verlag. · doi:10.1007/978-3-030-30754-7_11
- Yongxin Shi, Chongyu Liu, Dezhi Peng, Cheng Jian, Jiarong Huang, and Lianwen Jin. 2023. M5hisdoc: A large-scale multi-style chinese historical document analysis benchmark. In Advances in Neural Infor- mation Processing Systems 36: Annual Conference on Neural Information Processing Systems 2023, NeurIPS 2023, New Orleans, LA, USA, December 10 -16, 2023.
- Phillip Ströbel and Simon Clematide. 2019. Improv- ing ocr of black letter in historical newspapers: The unreasonable effectiveness of htr models on low- resolution images. In Proceedings of the Digital Humanities 2019, (DH2019). Accepted.
- Michał Turski, Tomasz Stanisławek, Karol Kaczmarek, Paweł Dyda, and Filip Graliński. 2023. Ccpdf: Build- ing a high quality corpus for visually rich documents from web crawl data. In International Conference on Document Analysis and Recognition, pages 348-365. Springer.
- Tübingen University Library. 2023. Ground truth data for printed malayalam. · doi:10.11588/data/l2krzo
- Chahan Vidal-Gorène, Noëmie Lucas, Clément Salah, Aliénor Decours-Perez, and Boris Dupin. 2021. Rasam -a dataset for the recognition and analysis of scripts in arabic maghrebi. In Document Analysis and Recognition -ICDAR 2021 Workshops, pages 265-281, Cham. Springer International Publishing.
- Peng Wang, Shuai Bai, Sinan Tan, Shijie Wang, Zhi- hao Fan, Jinze Bai, Keqin Chen, Xuejing Liu, Jialin Wang, Wenbin Ge, and 1 others. 2024a. Qwen2- vl: Enhancing vision-language model's perception of the world at any resolution. ArXiv preprint, abs/2409.12191. · arXiv
- Zirui Wang, Mengzhou Xia, Luxi He, Howard Chen, Yitao Liu, Richard Zhu, Kaiqu Liang, Xindi Wu, Hao- tian Liu, Sadhika Malladi, Alexis Chevalier, Sanjeev Arora, and Danqi Chen. 2024b. Charxiv: Charting gaps in realistic chart understanding in multimodal llms. In Advances in Neural Information Process- ing Systems 38: Annual Conference on Neural In- formation Processing Systems 2024, NeurIPS 2024, Vancouver, BC, Canada, December 10 -15, 2024.
- Maurice Weber, Carlo Siebenschuh, Rory Butler, Anton Alexandrov, Valdemar Thanner, Georgios Tsolakis, Haris Jabbar, Ian T. Foster, Bo Li, Rick Stevens, and Ce Zhang. 2023. Wordscape: a pipeline to extract multilingual, visually rich documents with layout annotations from web crawl data. In Advances in Neural Information Processing Systems 36: Annual Conference on Neural Information Processing Sys- tems 2023, NeurIPS 2023, New Orleans, LA, USA, December 10 -16, 2023.
- An Yang, Baosong Yang, Beichen Zhang, Binyuan Hui, Bo Zheng, Bowen Yu, Chengyuan Li, Day- iheng Liu, Fei Huang, Haoran Wei, and 1 others. 2024a. Qwen2.5 technical report. ArXiv preprint, abs/2412.15115. · arXiv
- Zhibo Yang, Jun Tang, Zhaohai Li, Pengfei Wang, Jian- qiang Wan, Humen Zhong, Xuejing Liu, Mingkun Yang, Peng Wang, Yuliang Liu, and 1 others. 2024b. Cc-ocr: A comprehensive and challenging ocr bench- mark for evaluating large multimodal models in liter- acy. ArXiv preprint, abs/2412.02210. · arXiv
- Kaining Ying, Fanqing Meng, Jin Wang, Zhiqian Li, Han Lin, Yue Yang, Hao Zhang, Wenbo Zhang, Yuqi Lin, Shuo Liu, Jiayi Lei, Quanfeng Lu, Runjian Chen, Peng Xu, Renrui Zhang, Haozhe Zhang, Peng Gao, Yali Wang, Yu Qiao, and 3 others. 2024. Mmt-bench: A comprehensive multimodal benchmark for evaluat- ing large vision-language models towards multitask AGI. In Forty-first International Conference on Ma- chine Learning, ICML 2024, Vienna, Austria, July 21-27, 2024. OpenReview.net.
- Pan Zhang, Xiaoyi Dong, Bin Wang, Yuhang Cao, Chao Xu, Linke Ouyang, Zhiyuan Zhao, Haodong Duan, Songyang Zhang, Shuangrui Ding, and 1 oth- ers. 2023. Internlm-xcomposer: A vision-language large model for advanced text-image comprehension and composition. ArXiv preprint, abs/2309.15112. · arXiv
- Xu Zhong, Jianbin Tang, and Antonio Jimeno Yepes. 2019. Publaynet: largest dataset ever for document layout analysis. In 2019 International conference on document analysis and recognition (ICDAR), pages 1015-1022. IEEE.
- license Ground Truth data for printed Malayalam (Tübingen University Library, 2023) Description: Link: https://heidata.uni-heidelberg.de /dataset.xhtml?persistentId=doi:10.11588 /data/L2KRZO License: CC BY 4.0 Ground-Truthed Data Set of Zenon Papyri for Handwritten Text Recognition (Marthot- Santaniello and Hodel, 2022) Description: Link: https://zenodo.org/records/6565706 License: CC BY 4.0 · doi:10.11588/data/l2krzo
- Assisi, Fondo Antico presso la Biblioteca del Sacro Convento, 408 (Sacro Convento di San Francesco in Assisi, 2024) Description: Link: https://www.internetculturale.it/i t/1175/assisi-fondo-antico-del-sacro-c onvento-mediatheca-franciscana License: CC BY-NC-SA 4.0 Ground Truth Model for Pracalit for Sanskrit and Newar MSS 16th to 19th C. (O'Neill and Hill, 2022) Description: Link: https://heidata.uni-heidelberg.de /dataset.xhtml?persistentId=doi:10.11588 /data/WI9184 License: CC BY 4.0 ICDAR 2019 Historical Document Reading Challenge on Large Structured Chinese Family Records (ICDAR2019HDRC) ( · doi:10.11588/data/wi9184
Cited by
PreScience: A Dataset and Benchmark for Scientific ForecastingPreprint
Ajith, A., Singh, A., DeYoung, J., Kunievsky, N., Kozlowski, A. C., Tafjord, O., Evans, J., Weld, D. S., Hope, T., & Downey, D. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2602.20459 · Cited by 14
Gardella, M., Mari{ñ}o, C., Belzarena, D., Ram{í}rez, I., Randall, G., & Morel, J. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2607.24077 · Cited by 3
Vidal-Gorène, C., & Kindt, B. (2026) · Language Resources and Evaluation Conference (LREC) · doi:10.63317/2gvtaxwvjtc7
Cargnelutti, M., Brobston, C., English, E., Sadow, J., Bailey, K., Leppert, G., Watson, A., Chapel, J., & Zittrain, J. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2608.18972
The Color Line: Measurement and Consequences of Racial ClassificationPreprint
Martínez, J. J. (2026) · SSRN Electronic Journal · doi:10.2139/ssrn.7637138
Metadata
- Authors
- Semnani, S. J., Zhang, H., He, X., Tekgürler, M., & Lam, M. S.
- Affiliations
- Stanford University (US)
- ORCID
- Lam, Monica S.
- Venue
- arXiv
- Publisher
- arXiv
- Published
- 2025
- ISSN
- 2331-8422 (ISSN-L)
- arXiv
- 2509.19768
- OpenAlex
- W7083329071
- Cited by
- 5
- References
- 6
- Citations by year
- 2026: 5
- Type
- posted content
- Language
- en
- Open access
- green
- arxiv.org
- Licence
- cc-by-nc-nd
- arxiv.org/licenses/nonexclusive-distrib/1.0/
- Locations
- arXiv (Cornell University) (submittedVersion, cc-by-nc-nd)
- arXiv (Cornell University)
- Funders
- Alfred P. Sloan Foundation
- Brown Institute for Media Innovation
- Topics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Handwritten Text Recognition Techniques
- Social Sciences › Arts and Humanities › Literature and Literary Theory › Digital Humanities and Scholarship
- Physical Sciences › Computer Science › Artificial Intelligence › Topic Modeling
- Keywords
- historical text recognition, vision-language models, open-weight models, historical documents, cultural heritage preservation, optical character recognition, handwritten text, multilingual text, dead languages, historical scripts
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
A language model drew the claims from the paper on 2026-11-16, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-11-16 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: CHURRO: Making History Readable with an Open-Weight Large Vision-Language Model for High-Accuracy, Low-Cost Historical Text Recognition. https://app.cochat.ai/papers/10.48550/arxiv.2509.19768
- The paper
- Semnani, S. J., Zhang, H., He, X., Tekgürler, M., & Lam, M. S. (2025). CHURRO: Making History Readable with an Open-Weight Large Vision-Language Model for High-Accuracy, Low-Cost Historical Text Recognition. arXiv. https://doi.org/10.48550/arxiv.2509.19768
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.