Student or educator? Sign up with your school email and get 6 months of Pro free.

The DOI matches its DataCite record; 6 of the 17 references it cites were found in a registry or an index, and 11 are not checked yet; none of the 53 sources its claims cite is checked for support yet.

CHURRO: Making History Readable with an Open-Weight Large Vision-Language Model for High-Accuracy, Low-Cost Historical Text Recognition

Open access
Semnani, Sina J., Zhang, Han, He, Xinyan, Tekgürler, Merve, Lam, Monica S. · 2025 · arXiv

Abstract

Accurate text recognition for historical documents can greatly advance the study and preservation of cultural heritage. Existing vision-language models (VLMs), however, are designed for modern, standardized texts and are not equipped to read the diverse languages and scripts, irregular layouts, and frequent degradation found in historical materials. This paper presents CHURRO, a 3B-parameter open-weight VLM specialized for historical text recognition. The model is trained on CHURRO-DS, the largest historical text recognition dataset to date. CHURRO-DS unifies 155 historical corpora comprising 99,491 pages, spanning 22 centuries of textual heritage across 46 language clusters, including historical variants and dead languages. We evaluate several open-weight and closed VLMs and optical character recognition (OCR) systems on CHURRO-DS and find that CHURRO outperforms all other VLMs. On the CHURRO-DS test set, CHURRO achieves 82.3% (printed) and 70.1% (handwritten) normalized Levenshtein similarity, surpassing the second-best model, Gemini 2.5 Pro, by 1.4% and 6.5%, respectively, while being 15.5 times more cost-effective. By releasing the model and dataset, we aim to enable community-driven research to improve the readability of historical texts and accelerate scholarship.

Checked 2026-11-16 · 11 references not checked yet

Overview

CoChat Summary

TL;DR

CHURRO is a 3B open-weight vision-language model fine-tuned on CHURRO-DS, a unified historical text recognition dataset of 155 corpora and 99,491 pages spanning 22 centuries, 46 language clusters, and 14 scripts. It achieves 82.3% printed and 70.1% handwritten normalized Levenshtein similarity, outperforming Gemini 2.5 Pro by 1.4% and 6.5% while being 15.5 times more cost-effective.

Key findings

  • CHURRO-DS unifies 155 historical corpora comprising 99,491 pages, spanning 22 centuries, 46 language clusters, and 14 scripts; it contains 97,151 training samples and 1,170 samples each for validation and test, with 29 of 46 language clusters appearing in validation/test.
  • CHURRO achieves 82.3% (printed) and 70.1% (handwritten) normalized Levenshtein similarity, surpassing the second-best model, Gemini 2.5 Pro, by 1.4% and 6.5%, respectively, while being 15.5 times more cost-effective. Fine-tuning improves Qwen 2.5 VL (3B) by 14.5% on printed and 27.2% on handwritten documents.
  • Zero-shot best commercial model Gemini 2.5 Pro reaches 80.9% printed and 63.6% handwritten; best open-weight VLMs reach 72.7% printed (NuMarkdown) and 54.5% handwritten (Qwen 2.5 VL 72B); Azure OCR reaches 71.9% printed and 47.7% handwritten.
  • In error analysis of 50 predictions, zero-shot Qwen 2.5 VL (3B) had major reading-order errors in 42% and major hallucinations in 36%; CHURRO had 16% reading-order errors and no hallucinations. Historical Chinese is hardest, with even the oracle ensemble at only 14.4% on printed Chinese; handwritten Sanskrit, Khmer, and Hebrew oracle scores are 26.1%, 32.9%, and 59.1%.

Methods

  • Dataset curation: selected corpora predating the mid-20th century with research-use licenses and human-annotated page-level gold text; standardized ALTO XML, PAGE XML, JSON, and plain text into one reading-order string per page; used diplomatic transcription; added language/script metadata; removed pages under 30 tokens and about 15,000 near-duplicates via Min-Hash; resized large images to fit within 2500×2500 pixels.
  • Model training: fine-tuned Qwen 2.5 VL (3B) for 5 epochs on 32 NVIDIA H100 GPUs with effective batch size 128, learning rate 5×10⁻⁵, cosine schedule, about 25 hours; limited inputs to 5,120 image patches of 28×28 pixels; total computation about 6,000 GPU-hours.
  • Evaluation: benchmarked open-weight and closed VLMs plus OCR systems on the CHURRO-DS test set in zero-shot and fine-tuned settings; computed character-level normalized Levenshtein similarity per example and averaged separately for printed and handwritten subsets; applied same normalization to all predictions and additional Arabic diacritics/hamza normalization with PyArabic; used temperature 0 and max generation of 20,000 tokens for non-reasoning models and 40,000 for reasoning models.

Limitations

  • The paper states CHURRO-DS still underrepresents some languages, reflecting scarcity of annotated historical datasets for lower-resource languages, and currently includes no languages native to the African continent. It also states only standard supervised fine-tuning was explored, with future work needed on more advanced training methods.
  • Evident from the text: some language clusters have very few training examples (e.g., printed Chinese has 6, handwritten Portuguese has 12), and 17 of 46 language clusters appear only in training, not validation/test. The paper also reports gold-standard annotation omissions in 2 of 50 error-analysis examples, remaining CHURRO reading-order errors (e.g., a Danish postcard), repetitive degeneration on a Latin manuscript, and low performance on Chinese, Sanskrit, Khmer, and Hebrew.

Model-written summary. Check it against the paper before relying on it.

Integrity signals

Registry

DataCite · 10.48550/arxiv.2509.19768

Cites

6 of 17 references verified0 citation errors · 0 not checkable

Statistics

Nothing to recompute.

Figures

Figure 1 Summary of the performance-cost trade-off across different VLMs on historical documents, measured on the full CHURRO-DS test set. CHURRO outperforms the 3B-parameter Qwen 2.5 VL by 21.3%. It also outperforms the second-best model (Gemini 2.5 Pro) by 4.1% while being 15.5 times more cost-effective. Costs for closed models are measured with the 50% batching discount offered by providers. The costs of open-weight models are estimated following Poznanski et al. (2025).
Figure 1 Summary of the performance-cost trade-off across different VLMs on historical documents, measured on the full CHURRO-DS test set. CHURRO outperforms the 3B-parameter Qwen 2.5 VL by 21.3%. It also outperforms the second-best model (Gemini 2.5 Pro) by 4.1% while being 15.5 times more cost-effective. Costs for closed models are measured with the 50% batching discount offered by providers. The costs of open-weight models are estimated following Poznanski et al. (2025).CC-BY-NC-ND · From the PDF
Figure 2 Overview and examples from the two subsets of CHURRO-DS. Donut charts show the distribution of language clusters . For example, the German cluster includes Modern German, Old High German, Middle High German, and Middle Low German.
Figure 2 Overview and examples from the two subsets of CHURRO-DS. Donut charts show the distribution of language clusters . For example, the German cluster includes Modern German, Old High German, Middle High German, and Middle Low German.CC-BY-NC-ND · From the PDF
Figure 3 Distribution of Qwen 2.5 VL tokens in the gold text. Log-scale x-axis. Red dashed line shows the median.
Figure 3 Distribution of Qwen 2.5 VL tokens in the gold text. Log-scale x-axis. Red dashed line shows the median.CC-BY-NC-ND · From the PDF
Figure 4 Plot of image dimensions in CHURRO-DS. Each point shows the width and height of a single image. Note that we resize large images to fit inside a 2500 × 2500 pixel box while maintaining their original aspect ratio.
Figure 4 Plot of image dimensions in CHURRO-DS. Each point shows the width and height of a single image. Note that we resize large images to fit inside a 2500 × 2500 pixel box while maintaining their original aspect ratio.CC-BY-NC-ND · From the PDF
Figure 5 The effect of document length on normalized Levenshtein similarity. Here we show this effect for Gemini 2.5 Pro on the left and CHURRO on the right.
Figure 5 The effect of document length on normalized Levenshtein similarity. Here we show this effect for Gemini 2.5 Pro on the left and CHURRO on the right.CC-BY-NC-ND · From the PDF
Figure 6 Document example where the unusual reading order causes the zero-shot VLM to make major mistakes. 3
Figure 6 Document example where the unusual reading order causes the zero-shot VLM to make major mistakes. 3CC-BY-NC-ND · From the PDF
Image 7
CC-BY-NC-ND · From the PDF
Figure 8 A 20th-century Danish postcard that begins on the right side of the page, which causes mistakes even in CHURRO predictions.
Figure 8 A 20th-century Danish postcard that begins on the right side of the page, which causes mistakes even in CHURRO predictions.CC-BY-NC-ND · From the PDF
Figure 9 19th-century English
Figure 9 19th-century EnglishCC-BY-NC-ND · From the PDF
Figure 10 A 19th-century German letter where the zero-shot VLM exhibits repetitive degeneration.
Figure 10 A 19th-century German letter where the zero-shot VLM exhibits repetitive degeneration.CC-BY-NC-ND · From the PDF
Image 11
CC-BY-NC-ND · From the PDF
Figure 12 A 19th-century transitional Romanian book where the zero-shot VLM is unable to recognize Latin characters.
Figure 12 A 19th-century transitional Romanian book where the zero-shot VLM is unable to recognize Latin characters.CC-BY-NC-ND · From the PDF
Image 13
CC-BY-NC-ND · From the PDF
Figure 13 Middle High German
Figure 13 Middle High GermanCC-BY-NC-ND · From the PDF
Image 15
CC-BY-NC-ND · From the PDF
Figure 16 18th-century Dutch letter with marginalia
Figure 16 18th-century Dutch letter with marginaliaCC-BY-NC-ND · From the PDF
Figure 17 19th-20th-century Norwegian letter
Figure 17 19th-20th-century Norwegian letterCC-BY-NC-ND · From the PDF

Verification

Claims the paper makes

0 Valid · 4 Not valid · 41 Not checked · 126 Own results and interpretations

77 more claims

Create a free account to see all 171 claims and to verify the 9 references still open.

See all claims — free account
  • It may state two separate claims as one. 34
  • Probably not a substantial claim. 62
  • The quote only partly states this claim. 2

Create a free account to see these claims.

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

Each contradiction between two passages listed here was confirmed by an independent check.

3 of 3

Citations

Cites

Show all 6 references

Research works printed but not linked: 65

  1. 2023. Aldicam-2023: Diachronic and interactive lin- guistic atlas of the community of madrid. https: //aldicam.corpuscodea.es/consultas.php. Accessed: 2025-05-18. 2025. Osman agha dataset: Images and transcription from british library ms. or. 3213 and kreutel's 1980 edition. Based on London, British Library, MS. Or. 3213 and Richard F. Kreutel's 1980 transcription: *Die Autobiographie des Dolmetschers Osman Aga aus Temeschwar*, The E. J. W. Gibb Memorial Trust, Cambridge.
  2. Lien Ceard, Fanny Lebreton, and Cécile Sajdak. 2022. Projet correspondance berlioz. Created as part of a transcription project of the active correspondence from Hector Berlioz to his sister Nanci Berlioz, by students of the TNAH master's program at the École nationale des chartes. Center for Open Data in the Humanities. 2019. Japanese classics dataset (collection of the national museum of japanese literature, etc.). Center for Open Data in the Humanities (CODH) and National Institute for Japanese Language and Linguis- tics (NINJAL). 2025. Modern magazine ocr training dataset. · doi:10.20676/00000415
  3. Alix Chagué. 2021. Tapuscorpus. If you use this soft- ware, please cite it as above. · doi:10.5072/zenodo.977649
  4. Liang Cheng, Jonas Frankemölle, Adam Axelsson, and Ekta Vats. 2024. Uncovering the handwritten text in the margins: End-to-end handwritten text detection and recognition. In Proceedings of the 8th Joint SIGHUM Workshop on Computational Linguistics for Cultural Heritage, Social Sciences, Humanities and Literature (LaTeCH-CLfL 2024), pages 111-120, St. Julians, Malta. Association for Computational Linguistics.
  5. Wei-Lin Chiang, Lianmin Zheng, Ying Sheng, Anas- tasios Nikolas Angelopoulos, Tianle Li, Dacheng Li, Banghua Zhu, Hao Zhang, Michael I. Jordan, Joseph E. Gonzalez, and Ion Stoica. 2024. Chat- bot arena: An open platform for evaluating llms by human preference. In Forty-first International Con- ference on Machine Learning, ICML 2024, Vienna, Austria, July 21-27, 2024. OpenReview.net. Floriane Chiffoleau. 2021. dahncorpus. · doi:10.5281/zenodo.5911868
  6. Christian Clausner, Apostolos Antonacopoulos, Tom Derrick, and Stefan Pletschacher. 2017. Icdar2017 competition on recognition of early indian printed documents -reid2017. In 2017 14th IAPR Interna- tional Conference on Document Analysis and Recog- nition (ICDAR), volume 01, pages 1411-1416. · doi:10.1109/icdar.2017.230
  7. Christian Clausner, Apostolos Antonacopoulos, Tom Derrick, and Stefan Pletschacher. 2019a. Icdar2019 competition on recognition of early indian printed documents-reid2019. In 2019 International Con- ference on Document Analysis and Recognition (IC- DAR), pages 1527-1532. IEEE.
  8. Christian Clausner, Apostolos Antonacopoulos, Nora McGregor, and Daniel Wilson-Nunn. 2018. Icfhr 2018 competition on recognition of historical arabic scientific manuscripts -rasm2018. 2018 16th In- ternational Conference on Frontiers in Handwriting Recognition (ICFHR), pages 471-476.
  9. Hoang-Quan Dang, Duy-Anh Nguyen, Phu-Phuoc Pham, Ngoc-Thinh Nguyen, Tan Chau, Duc-Vu Ngo, Trung-Hieu Nguyen, Chau-Thang Phan, The-Hien Trinh, Minh-Tri Nguyen, and 1 others. 2022. Nom- naocr: The first dataset for optical character recogni- tion on han-nom script. In 2022 RIVF International Conference on Computing and Communication Tech- nologies (RIVF), pages 476-481. IEEE.
  10. Andreas Wagner David Glück, Cindy Rico Carmona. 2018. Edition guidelines. https://www.salamanc a.school/guidelines.html.
  11. Melissa Dell, Jacob Carlson, Tom Bryan, Emily Sil- cock, Abhishek Arora, Zejiang Shen, Luca D'Amico- Wong, Quan Le, Pablo Querubin, and Leander Heldring. 2023. American stories: A large-scale structured text dataset of historical U.S. newspapers. In Advances in Neural Information Processing Sys- tems 36: Annual Conference on Neural Information Processing Systems 2023, NeurIPS 2023, New Or- leans, LA, USA, December 10 -16, 2023.
  12. Hans J.G.A. Dolfing, Jerome Bellegarda, Jan Chorowski, Ricard Marxer, and Antoine Laurent. 2020. The "ScribbleLens" Dutch historical handwrit- ing corpus. In International Conference on Frontiers of Handwriting Recognition (ICFHR), page To Appear. http://www.openslr.org/84/.
  13. Senka Drobac, Pekka Kauppinen, and Krister Lindén. 2017. OCR and post-correction of historical Finnish texts. In Proceedings of the 21st Nordic Conference on Computational Linguistics, pages 70-76, Gothen- burg, Sweden. Association for Computational Lin- guistics.
  14. David Fernández-Mota, Joan Almazán, Núria Cirera, Alicia Fornés, and Josep Lladós. 2014. Bh2m: The barcelona historical handwritten marriages database. In Proceedings of the 22nd International Conference on Pattern Recognition (ICPR), pages 256-261.
  15. Marc Frincu, Simina Frincu, and Marius E. Penteliuc. 2023. Challenges and solutions in transliterating 19th century Romanian texts from the transitional to the Latin script. In Proceedings of the 4th Conference on Language, Data and Knowledge, pages 226-231, Vienna, Austria.
  16. Ling Fu, Biao Yang, Zhebin Kuang, Jiajun Song, Yuzhe Li, Linghao Zhu, Qidi Luo, Xinyu Wang, Hao Lu, Mingxin Huang, and 1 others. 2025. Ocrbench v2: An improved benchmark for evaluating large multi- modal models on visual text localization and reason- ing. ArXiv preprint, abs/2501.00321. · arXiv
  17. Gemini Team Google. 2023. Gemini: A family of highly capable multimodal models. ArXiv preprint, abs/2312.11805. · arXiv
  18. Gemma Team, Thomas Mesnard, Cassidy Hardin, Robert Dadashi, Surya Bhupatiraju, Shreya Pathak, Laurent Sifre, Morgane Rivière, Mihir Sanjay Kale, Juliette Love, and 1 others. 2024. Gemma: Open models based on gemini research and technology. ArXiv preprint, abs/2403.08295. · arXiv
  19. Kioumars Ghereghlou, editor. 2018. Persian Text, vol- ume 98, pages 1-372. American Oriental Society. Accessed 20 May 2025. · doi:10.2307/j.ctv9b2vrs.5
  20. Estelle Guéville and David Joseph Wrisley. 2022. Tran- scribing medieval manuscripts for machine learning. ArXiv preprint, abs/2207.07726. · arXiv
  21. Adam W Harley, Alex Ufkes, and Konstantinos G Der- panis. 2015. Evaluation of deep convolutional nets for document image classification and retrieval. In 2015 13th international conference on document analysis and recognition (ICDAR), pages 991-995. IEEE.
  22. Aaron Jaech, Adam Kalai, Adam Lerer, Adam Richard- son, Ahmed El-Kishky, Aiden Low, Alec Helyar, Aleksander Madry, Alex Beutel, Alex Carney, and 1 others. 2024. Openai o1 system card. ArXiv preprint, abs/2412.16720. · arXiv
  23. Romain Karpinski, Devashish Lohani, and Abdel Be- laid. 2018. Metrics for complete evaluation of ocr performance. In Proceedings of the 22nd Interna- tional Conference on Image Processing, Computer Vision, and Pattern Recognition (IPCV), Las Vegas, United States. HAL Id: hal-01981731.
  24. Majeed Kassis, Alaa Abdalhaleem, Ahmad Droby, Reem Alaasam, and Jihad El-Sana. 2017. Vml-hd: The historical arabic documents dataset for recog- nition systems. In 1st International Workshop on Arabic Script Analysis and Recognition. IEEE.
  25. Benjamin Kiessling, Robin Tissot, Peter Stokes, and Daniel Stökl Ben Ezra. 2019. escriptorium: An open source platform for historical document analysis. In 2019 International Conference on Document Analy- sis and Recognition Workshops (ICDARW), volume 2, pages 19-19. · doi:10.1109/icdarw.2019.10032
  26. LECTAUREP, Aurélia Rostaing, Marc Durand, and Alix Chagué. 2021. Notaires de paris -répertoires: Ground truth for various parisian registries of notary deeds (french 19th and 20th centuries). Released on 2021-12-07. · doi:10.5072/zenodo.977691
  27. Kenton Lee, Mandar Joshi, Iulia Raluca Turc, Hexi- ang Hu, Fangyu Liu, Julian Martin Eisenschlos, Ur- vashi Khandelwal, Peter Shaw, Ming-Wei Chang, and Kristina Toutanova. 2023. Pix2struct: Screen- shot parsing as pretraining for visual language under- standing. In International Conference on Machine Learning, ICML 2023, 23-29 July 2023, Honolulu, Hawaii, USA, volume 202 of Proceedings of Machine Learning Research, pages 18893-18912.
  28. PMLR.
  29. David Lewis, Gady Agam, Shlomo Argamon, Ophir Frieder, David Grossman, and Jefferson Heard. 2006. Building a test collection for complex document in- formation processing. In Proceedings of the 29th annual international ACM SIGIR conference on Re- search and development in information retrieval, pages 665-666.
  30. Haotian Liu, Chunyuan Li, Qingyang Wu, and Yong Jae Lee. 2023a. Visual instruction tuning. In Advances in Neural Information Processing Systems 36: An- nual Conference on Neural Information Processing Systems 2023, NeurIPS 2023, New Orleans, LA, USA, December 10 -16, 2023.
  31. Yuliang Liu, Zhang Li, Mingxin Huang, Biao Yang, Wenwen Yu, Chunyuan Li, Xu-Cheng Yin, Cheng- Lin Liu, Lianwen Jin, and Xiang Bai. 2024b. Ocr- bench: on the hidden mystery of ocr in large multi- modal models. Science China Information Sciences, 67(12):220102.
  32. Ayush Maheshwari, Nikhil Singh, Amrith Krishna, and Ganesh Ramakrishnan. 2022b. A benchmark and dataset for post-OCR text correction in Sanskrit. In Findings of the Association for Computational Linguistics: EMNLP 2022, pages 6258-6265, Abu Dhabi, United Arab Emirates. Association for Com- putational Linguistics. · DOI
  33. Minesh Mathew, Dimosthenis Karatzas, and CV Jawa- har. 2021. Docvqa: A dataset for vqa on document images. In Proceedings of the IEEE/CVF winter con- ference on applications of computer vision, pages 2200-2209.
  34. Nicole Merkel-Hilf. 2022. Ground truth data for printed devanagari. · doi:10.11588/data/egokei
  35. Lucas Noëmie, Clément Salah, and Chahan Vidal- Gorène. 2022. New Results for the Text Recogni- tion of Arabic Maghribī Manuscripts -Managing an Under-resourced Script. Working paper or preprint.
  36. Vít Novotný, Kristýna Seidlová, Tereza Vrabcová, and Aleš Horák. 2021. When tesseract brings friends: Layout analysis, language identification, and super- resolution in the optical character recognition of me- dieval texts. In Proceedings of Recent Advances in Slavonic Natural Language Processing, RASLAN 2021, pages 91-100. Tribun EU. Numind. 2025. NuMarkdown-8B-Thinking. Model page. NVIDIA. 2025. Llama-3.1-Nemotron-Nano-VL-8B- V1. Model page.
  37. Sarah Oberbichler, Emanuela Boroş, Antoine Doucet, Jani Marjanen, Eva Pfanzelter, Juha Rautiainen, Hannu Toivonen, and Mikko Tolonen. 2022. Inte- grated interdisciplinary workflows for research on historical newspapers: Perspectives from humanities scholars, computer scientists, and librarians. Jour- nal of the Association for Information Science and Technology, 73(2):225-239.
  38. Linke Ouyang, Yuan Qu, Hongbin Zhou, Jiawei Zhu, Rui Zhang, Qunshu Lin, Bin Wang, Zhiyuan Zhao, Man Jiang, Xiaomeng Zhao, and 1 others. 2024. Omnidocbench: Benchmarking diverse pdf docu- ment parsing with comprehensive annotations. ArXiv preprint, abs/2412.07626. · arXiv
  39. Alexander James O'Neill and Nathan Hill. 2022. Text recognition for nepalese manuscripts in pracalit script. Journal of Open Humanities Data. · doi:10.5334/johd.90
  40. Werner Pantke, Martin Dennhardt, Daniel Fecker, Volker Märgner, and Tim Fingscheidt. 2014. An his- torical handwritten arabic dataset for segmentation- free word spotting -hadara80p. In 2014 14th In- ternational Conference on Frontiers in Handwriting Recognition, pages 15-20. · doi:10.1109/icfhr.2014.11
  41. Christos Papadopoulos, Stefan Pletschacher, Christian Clausner, and Apostolos Antonacopoulos. 2013. The impact dataset of historical document images. In Proceedings of the 2nd International Workshop on Historical Document Imaging and Processing, HIP '13, page 123-130, New York, NY, USA. Association for Computing Machinery. · doi:10.1145/2501115.2501130
  42. Paraskevi Platanou, John Pavlopoulos, and Georgios Papaioannou. 2022. Handwritten paleographic greek text recognition dataset (century-based). This dataset is part of the work: Platanou, P., Pavlopoulos, J., and Papaioannou, G. (2022). Handwritten Paleo- graphic Greek Text Recognition: A Century-Based Approach. In *Proceedings of the Thirteenth Lan- guage Resources and Evaluation Conference*, pp. 6585-6589, Marseille, France: ELRA.
  43. Stefan Pletschacher and Apostolos Antonacopoulos. 2010. The PAGE (Page Analysis and Ground-Truth Elements) Format Framework. In 2010 20th Inter- national Conference on Pattern Recognition, pages 257-260. IEEE.
  44. Irina Rabaev, Berat Kurar Bakarat, and Jihad El-Sana. 2019. The pinkas dataset. · doi:10.1109/icdar.2019.00122_dataset
  45. Alec Radford, Jong Wook Kim, Chris Hallacy, Aditya Ramesh, Gabriel Goh, Sandhini Agarwal, Girish Sas- try, Amanda Askell, Pamela Mishkin, Jack Clark, Gretchen Krueger, and Ilya Sutskever. 2021. Learn- ing transferable visual models from natural language supervision. In Proceedings of the 38th International Conference on Machine Learning, ICML 2021, 18-24 July 2021, Virtual Event, volume 139 of Proceedings of Machine Learning Research, pages 8748-8763. PMLR. Research Group Texts for the History of Spanish [GITHE]. 2022. CODEA+ 2022 (Corpus of Spanish documents prior to 1900). https://doi.org/10.3 7536/CODEA.2015. [online; accessed 2025-03-09]. · doi:10.37536/codea.2015
  46. Christian Reul, Dennis Christ, Alexander Hartelt, Nico Balbach, Maximilian Wehner, Uwe Springmann, Christoph Wick, Christine Grundig, Andreas Büttner, and Frank Puppe. 2019. Ocr4all-an open-source tool providing a (semi-) automatic ocr workflow for historical printings. Applied Sciences, 9(22):4853.
  47. Justyna Rogos-Hebda. 2025. Making sense of abbre- viation in late middle english literary manuscripts. In Abbreviating Middle English: Scribal Practices, Visual Texts and Medieval Multimodalities, pages 157-169. Springer.
  48. Matteo Romanello, Najem-Meyer Sven, and Bruce Robertson. 2021. Optical Character Recognition of 19th Century Classical Commentaries: The Current State of Affairs. In The 6th International Workshop on Historical Document Imaging and Processing (HIP '21), Lausanne. Association for Computing Ma- chinery. · doi:10.1145/3476887.3476911
  49. C.A. Romein, Michel de Gruijter, and Sara Floor Veld- hoen. 2020. The datafication of early modern ordi- nances. DH Benelux Journal, 2.
  50. Verónica Romero, Alejandro H. Toselli, Enrique Vidal, Joan Andreu Sánchez, Carlos Alonso, and Lourdes Marqués. 2019. Modern vs diplomatic transcripts for historical handwritten text recognition. In New Trends in Image Analysis and Processing -ICIAP 2019: ICIAP International Workshops, BioFor, Pa- tReCH, e-BADLE, DeepRetail, and Industrial Ses- sion, Trento, Italy, September 9-10, 2019, Revised Selected Papers, page 103-114, Berlin, Heidelberg. Springer-Verlag. · doi:10.1007/978-3-030-30754-7_11
  51. Yongxin Shi, Chongyu Liu, Dezhi Peng, Cheng Jian, Jiarong Huang, and Lianwen Jin. 2023. M5hisdoc: A large-scale multi-style chinese historical document analysis benchmark. In Advances in Neural Infor- mation Processing Systems 36: Annual Conference on Neural Information Processing Systems 2023, NeurIPS 2023, New Orleans, LA, USA, December 10 -16, 2023.
  52. Phillip Ströbel and Simon Clematide. 2019. Improv- ing ocr of black letter in historical newspapers: The unreasonable effectiveness of htr models on low- resolution images. In Proceedings of the Digital Humanities 2019, (DH2019). Accepted.
  53. Michał Turski, Tomasz Stanisławek, Karol Kaczmarek, Paweł Dyda, and Filip Graliński. 2023. Ccpdf: Build- ing a high quality corpus for visually rich documents from web crawl data. In International Conference on Document Analysis and Recognition, pages 348-365. Springer.
  54. Tübingen University Library. 2023. Ground truth data for printed malayalam. · doi:10.11588/data/l2krzo
  55. Chahan Vidal-Gorène, Noëmie Lucas, Clément Salah, Aliénor Decours-Perez, and Boris Dupin. 2021. Rasam -a dataset for the recognition and analysis of scripts in arabic maghrebi. In Document Analysis and Recognition -ICDAR 2021 Workshops, pages 265-281, Cham. Springer International Publishing.
  56. Peng Wang, Shuai Bai, Sinan Tan, Shijie Wang, Zhi- hao Fan, Jinze Bai, Keqin Chen, Xuejing Liu, Jialin Wang, Wenbin Ge, and 1 others. 2024a. Qwen2- vl: Enhancing vision-language model's perception of the world at any resolution. ArXiv preprint, abs/2409.12191. · arXiv
  57. Zirui Wang, Mengzhou Xia, Luxi He, Howard Chen, Yitao Liu, Richard Zhu, Kaiqu Liang, Xindi Wu, Hao- tian Liu, Sadhika Malladi, Alexis Chevalier, Sanjeev Arora, and Danqi Chen. 2024b. Charxiv: Charting gaps in realistic chart understanding in multimodal llms. In Advances in Neural Information Process- ing Systems 38: Annual Conference on Neural In- formation Processing Systems 2024, NeurIPS 2024, Vancouver, BC, Canada, December 10 -15, 2024.
  58. Maurice Weber, Carlo Siebenschuh, Rory Butler, Anton Alexandrov, Valdemar Thanner, Georgios Tsolakis, Haris Jabbar, Ian T. Foster, Bo Li, Rick Stevens, and Ce Zhang. 2023. Wordscape: a pipeline to extract multilingual, visually rich documents with layout annotations from web crawl data. In Advances in Neural Information Processing Systems 36: Annual Conference on Neural Information Processing Sys- tems 2023, NeurIPS 2023, New Orleans, LA, USA, December 10 -16, 2023.
  59. An Yang, Baosong Yang, Beichen Zhang, Binyuan Hui, Bo Zheng, Bowen Yu, Chengyuan Li, Day- iheng Liu, Fei Huang, Haoran Wei, and 1 others. 2024a. Qwen2.5 technical report. ArXiv preprint, abs/2412.15115. · arXiv
  60. Zhibo Yang, Jun Tang, Zhaohai Li, Pengfei Wang, Jian- qiang Wan, Humen Zhong, Xuejing Liu, Mingkun Yang, Peng Wang, Yuliang Liu, and 1 others. 2024b. Cc-ocr: A comprehensive and challenging ocr bench- mark for evaluating large multimodal models in liter- acy. ArXiv preprint, abs/2412.02210. · arXiv
  61. Kaining Ying, Fanqing Meng, Jin Wang, Zhiqian Li, Han Lin, Yue Yang, Hao Zhang, Wenbo Zhang, Yuqi Lin, Shuo Liu, Jiayi Lei, Quanfeng Lu, Runjian Chen, Peng Xu, Renrui Zhang, Haozhe Zhang, Peng Gao, Yali Wang, Yu Qiao, and 3 others. 2024. Mmt-bench: A comprehensive multimodal benchmark for evaluat- ing large vision-language models towards multitask AGI. In Forty-first International Conference on Ma- chine Learning, ICML 2024, Vienna, Austria, July 21-27, 2024. OpenReview.net.
  62. Pan Zhang, Xiaoyi Dong, Bin Wang, Yuhang Cao, Chao Xu, Linke Ouyang, Zhiyuan Zhao, Haodong Duan, Songyang Zhang, Shuangrui Ding, and 1 oth- ers. 2023. Internlm-xcomposer: A vision-language large model for advanced text-image comprehension and composition. ArXiv preprint, abs/2309.15112. · arXiv
  63. Xu Zhong, Jianbin Tang, and Antonio Jimeno Yepes. 2019. Publaynet: largest dataset ever for document layout analysis. In 2019 International conference on document analysis and recognition (ICDAR), pages 1015-1022. IEEE.
  64. license Ground Truth data for printed Malayalam (Tübingen University Library, 2023) Description: Link: https://heidata.uni-heidelberg.de /dataset.xhtml?persistentId=doi:10.11588 /data/L2KRZO License: CC BY 4.0 Ground-Truthed Data Set of Zenon Papyri for Handwritten Text Recognition (Marthot- Santaniello and Hodel, 2022) Description: Link: https://zenodo.org/records/6565706 License: CC BY 4.0 · doi:10.11588/data/l2krzo
  65. Assisi, Fondo Antico presso la Biblioteca del Sacro Convento, 408 (Sacro Convento di San Francesco in Assisi, 2024) Description: Link: https://www.internetculturale.it/i t/1175/assisi-fondo-antico-del-sacro-c onvento-mediatheca-franciscana License: CC BY-NC-SA 4.0 Ground Truth Model for Pracalit for Sanskrit and Newar MSS 16th to 19th C. (O'Neill and Hill, 2022) Description: Link: https://heidata.uni-heidelberg.de /dataset.xhtml?persistentId=doi:10.11588 /data/WI9184 License: CC BY 4.0 ICDAR 2019 Historical Document Reading Challenge on Large Structured Chinese Family Records (ICDAR2019HDRC) ( · doi:10.11588/data/wi9184

Cited by

See all 6

Metadata

Authors
Semnani, S. J., Zhang, H., He, X., Tekgürler, M., & Lam, M. S.
Affiliations
Stanford University (US)
Venue
arXiv
Publisher
arXiv
Published
2025
ISSN
2331-8422 (ISSN-L)
OpenAlex
W7083329071
Cited by
5
References
6
Citations by year
2026: 5
Type
posted content
Language
en
Open access
Locations
  • arXiv (Cornell University) (submittedVersion, cc-by-nc-nd)
  • arXiv (Cornell University)
Funders
  • Alfred P. Sloan Foundation
  • Brown Institute for Media Innovation
Topics
  • Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Handwritten Text Recognition Techniques
  • Social Sciences › Arts and Humanities › Literature and Literary Theory › Digital Humanities and Scholarship
  • Physical Sciences › Computer Science › Artificial Intelligence › Topic Modeling
Keywords
historical text recognition, vision-language models, open-weight models, historical documents, cultural heritage preservation, optical character recognition, handwritten text, multilingual text, dead languages, historical scripts

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

A language model drew the claims from the paper on 2026-11-16, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).

A second model labelled each claim on 2026-11-16 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: CHURRO: Making History Readable with an Open-Weight Large Vision-Language Model for High-Accuracy, Low-Cost Historical Text Recognition. https://app.cochat.ai/papers/10.48550/arxiv.2509.19768
The paper
Semnani, S. J., Zhang, H., He, X., Tekgürler, M., & Lam, M. S. (2025). CHURRO: Making History Readable with an Open-Weight Large Vision-Language Model for High-Accuracy, Low-Cost Historical Text Recognition. arXiv. https://doi.org/10.48550/arxiv.2509.19768

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.