CoChat
Sign Up
PreprintCited by 8Natural Language Processing TechniquesTopic ModelingMultilingual Education and Policy

Harnessing the Power of Artificial Intelligence to Vitalize Endangered Indigenous Languages: Technologies and Experiences

Open access
Pinhanez, Claudio, Cavalin, Paulo, Storto, Luciana, Finbow, Thomas, Cobbinah, Alexander, Nogima, Julio, Vasconcelos, Marisa, Domingues, Pedro +4 more·2024·arXiv
DOI 10.48550/arxiv.2407.12620arXiv 2407.12620
Open this paper in CoChat — free accountOpen PDF

Abstract

Since 2022 we have been exploring application areas and technologies in which Artificial Intelligence (AI) and modern Natural Language Processing (NLP), such as Large Language Models (LLMs), can be employed to foster the usage and facilitate the documentation of Indigenous languages which are in danger of disappearing. We start by discussing the decreasing diversity of languages in the world and how working with Indigenous languages poses unique ethical challenges for AI and NLP. To address those challenges, we propose an alternative development AI cycle based on community engagement and usage. Then, we report encouraging results in the development of high-quality machine learning translators for Indigenous languages by fine-tuning state-of-the-art (SOTA) translators with tiny amounts of data and discuss how to avoid some common pitfalls in the process. We also present prototypes we have built in projects done in 2023 and 2024 with Indigenous communities in Brazil, aimed at facilitating writing, and discuss the development of Indigenous Language Models (ILMs) as a replicable and scalable way to create spell-checkers, next-word predictors, and similar tools. Finally, we discuss how we envision a future for language documentation where dying languages are preserved as interactive language models.

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

DataCite · 10.48550/arxiv.2407.12620

Cites

Statistics

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

  • IBM Brazil's collaboration on Guarani Mbya and Nheengatu languages included consent protocols but kept ultimate control-ownership, deployment, and technical design-within institutional hands, privileging text-centric norms over oral traditions.

    “IBM Brazil's collaboration on Guarani Mbya and Nheengatu languages included consent protocols but kept ultimate controlownership, deployment, and technical designwithin institutional hands, privileging text-centric norms over oral traditions (Pinhanez et al., 2024).”

    From Towards a decolonial AI sovereignty model for indigenous educational settings (2026) · cites this paper as Pinhanez et al., 2024

    Split into 2 atoms — 0 confirmed, 1 partially supported, 1 disputed, 0 misattributed, 0 unverifiable. Expand the claim to see per-atom verdicts.

    Checked by a reasoning model — may be wrong.

    Experimental — accuracy not yet measured

  • Guaraní is spoken by more than 6.5 million people in Paraguay and neighboring countries.

    “Guaraní is spoken by more than 6.5 million people (Pinhanez et al. 2024) in Paraguay (where it is co-official with Spanish) and in neighboring countries.”

    From Data colonialism and indigenous languages in AI: a critical review of existing initiatives and their struggles with data sovereignty (2026) · cites this paper as Pinhanez et al. 2024

    Section 2, “Language Diversity is Decreasing,” reports 6.5 million Guarani speakers, not more than 6.5 million. Section 3.2 says Guarani is spoken by millions in Paraguay and Bolivia, supporting the geographic part of the claim. (LLM, conf=0.86)

    Experimental — accuracy not yet measured

  • Even systems that appear 'less biased' can still reproduce epistemic dispossession when Indigenous languages and protocols are subordinated to proprietary architectures.

    “Even systems that appear 'less biased' can still reproduce epistemic dispossession when Indigenous languages and protocols are subordinated to proprietary architectures (Pinhanez et al., 2024).”

    From Towards a decolonial AI sovereignty model for indigenous educational settings (2026) · cites this paper as Pinhanez et al., 2024

    Section 3.1 discusses knowledge extractivism and the need for Indigenous control of language data and consent; Section 8 says AI tools should be developed with communities under principles of data sovereignty. The paper does not establish the claim about apparently ‘less biased’ systems reproducing epistemic dispossession through proprietary architectures. Section 5 instead describes an open-source approach with community governance of data and models. (LLM, conf=0.84)

    Experimental — accuracy not yet measured

  • The collaboration between IBM Research Brazil and the University of São Paulo developed generative writing assistants and translation tools for endangered Indigenous languages, including Guarani Mbya and Nheengatu.

    “This collaboration between IBM Research Brazil and the University of São Paulo developed generative writing assistants and translation tools for endangered Indigenous languages, including Guarani Mbya and Nheengatu (Pinhanez et al., 2024).”

    From Towards a decolonial AI sovereignty model for indigenous educational settings (2026) · cites this paper as Pinhanez et al., 2024

  • Safeguards such as data non-release, consent-based testing, and damage containment protocols were embedded in the IBM/University of São Paulo project to address risks of extractivism and 'white savior' narratives.

    “Safeguards such as data non-release, consent-based testing, and damage containment protocols were embedded to address risks of extractivism and 'white savior' narratives (Pinhanez et al., 2024: 26).”

    From Towards a decolonial AI sovereignty model for indigenous educational settings (2026) · cites this paper as Pinhanez et al., 2024

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Cites

No references could be resolved yet.

Research works printed but not linked: 69

  1. David Adelani, Jesujoba Alabi, Angela Fan, Julia Kreutzer, Xiaoyu Shen, Machel Reid, Dana Ruiter, Dietrich Klakow, Peter Nabende, Ernie Chang, Tajud- deen Gwadabe, Freshia Sackey, Bonaventure F. P. Dossou, Chris Emezue, Colin Leong, Michael Beuk- man, Shamsuddeen Muhammad, Guyo Jarso, Oreen Yousuf, Andre Niyongabo Rubungo, Gilles Hacheme, Eric Peter Wairagala, Muhammad Umair Nasir, Ben- jamin Ajibade, Tunde Ajayi, Yvonne Gitau, Jade Abbott, Mohamed Ahmed, Millicent Ochieng, An- uoluwapo Aremu, Perez Ogayo, Jonathan Mukiibi, Fatoumata Ouoba Kabore, Godson Kalipe, Derguene Mbaye, Allahsera Auguste Tapo, Victoire Memd- jokam Koagne, Edwin Munkoh-Buabeng, Valen- cia Wagner, Idris Abdulmumin, Ayodele Awokoya, Happy Buzaaba, Blessing Sibanda, Andiswa Bukula, and Sam Manthalu. 2022. A few thousand transla- tions go a long way! leveraging pre-trained mod- els for African news translation. In Proceedings of the 2022 Conference of the North American Chap- ter of the Association for Computational Linguistics: Human Language Technologies (NAACL'24), pages 3053-3070, Seattle, United States. Association for Computational Linguistics. · DOI
  2. S. Alavi, J. Brixey, and D. Traum. 2015. Can we use a spoken dialogue system to document endangered languages? In Dialog for Good Conference.
  3. A. Anastasopoulos. 2019. Computational tools for en- dangered language documentation. Ph.D. thesis, University of Notre Dame.
  4. A. Anastasopoulos, C. Cox, G. Neubig, and H. Cruz. 2020. Endangered languages meet modern NLP. In Proc. of COLING'20.
  5. K. Arola. 2017. Indigenous interfaces. In D. Walss and S. Vie, editors, Social writing/social media: Publics, presentations, and pedagogies. Elsevier.
  6. M. T. Ávila. 2021. Proposta de dicionário nheengatu- português. Tese de doutorado, Faculdade de Filosofia, Letras e Ciências Humanas, Universidade de São Paulo, São Paulo. Recuperado em 2023-12- 27, de www.teses.usp.br. · DOI
  7. K. Awori, F. Vetere, and W. Smith. 2015. Transnational- ism, indigenous knowledge and technology: Insights from the kenyan diaspora. In CHI'15.
  8. S. Bird. 2018. Designing mobile applications for endan- gered languages. In Oxford Handbook of Endangered Languages, pages 842-861. Oxford University Press.
  9. Alessandra Buccella. 2023. "AI for all" is a matter of social justice. AI and Ethics, 3(4):1143-1152.
  10. Jo Anna Burn, Ineke Crezee, Kim Hastwell, Elizabeth Brugh, and Rosemary Harison. 2014. 'I study long, long time in my language, so I never forget it': read- ing and first language maintenance. Intercultural Education, 25(5):377-390.
  11. S. Carroll, I. Garba, O. Figueroa-Rodríguez, J. Hol- brook, et al. 2020. The CARE principles for In- digenous data governance. Data Science Journal, 19(1):43. Number: 1. · DOI · Paper page
  12. Paulo Cavalin, Pedro Domingues, Julio Nogima, and Claudio Pinhanez. 2023. Understanding native lan- guage identification for brazilian indigenous lan- guages. In Proceedings of the Workshop on Natural Language Processing for Indigenous Languages of the Americas (AmericasNLP'23), pages 12-18.
  13. Paulo Cavalin, Pedro H. Domingues, Claudio Pinhanez, and Julio Nogima. 2024. Fixing rogue memorization in many-to-one multilingual translators of extremely- low-resource languages by rephrasing training sam- ples. In Proceedings of the 2024 Annual Conference of the North American Chapter of the Association for Computational Linguistics (NAACL'24).
  14. Wei-Rui Chen and Muhammad Abdul-Mageed. 2022. Improving neural machine translation of indigenous languages with multilingual transfer learning. arXiv preprint: 2205.06993. · DOI
  15. H. Cruz and J. Waring. 2019. Deploying technology to save endangered languages. ArXiv, abs/1908.08971. · arXiv
  16. Pedro Domingues, Claudio Pinhanez, Paulo Cavalin, , and Julio Nogima. 2024. Quantifying the ethical dilemma of using culturally toxic training data in ai tools for indigenous languages. In Proceedings of 3rd Annual Meeting of the Special Interest Group on Under-resourced Languages (SIGUL'24)).
  17. R. Everson, W. Honoré, and S. Grimm. 2019. An online platform for community-based language description and documentation. In Proc. of ComputEL'19.
  18. B. Foley, J. Arnold, R. Coto-Solano, G. Durantin, et al. 2018. Building speech recognition systems for lan- guage documentation: the CoEDL endangered lan- guage pipeline and inference system (ELPIS). In Proc of SLTU'18.
  19. Bruna Franchetto. 2020. Língua (s): cosmopolíticas, micropolíticas, macropolíticas. Campos-Revista de Antropologia, 21(1):21-36.
  20. William Gaver and Anthony Dunne. 1999. Projected realities: conceptual design for cultural effect. In Proceedings of the SIGCHI conference on Human Factors in Computing Systems, pages 600-607.
  21. K. Hale, M. Krauss, L. Watahomigie, A. Yamamoto, C. Craig, M. Jeanne, and N. England. 1992. Endan- gered languages. Language, 68(1):1-42.
  22. Anna Harding, Barbara Harper, Dave Stone, Catherine O'Neill, Patricia Berger, Stuart Harris, and Jamie Donatuto. 2012. Conducting research with tribal communities: Sovereignty, ethics, and data-sharing issues. Environmental health perspectives, 120(1):6- 10.
  23. K. Harrison. 2008. When languages die: The extinction of the world's languages and the erosion of human knowledge. Oxford University Press.
  24. M. Hermes, M. Bang, and A. Marin. 2012. Designing indigenous language revitalization. Harvard Educa- tional Review, 82(3).
  25. Hilary Hutchinson, Wendy Mackay, Bo Westerlund, Benjamin B Bederson, Allison Druin, Catherine Plaisant, Michel Beaudouin-Lafon, Stéphane Con- versy, Helen Evans, Heiko Hansen, et al. 2003. Tech- nology probes: inspiring design for and with families. In Proceedings of the SIGCHI conference on Human factors in computing systems, pages 17-24. IBGE. 2010. Censo demográfico 2010. Accessed on 2022-12-30.
  26. Laksiri Jayasuriya, David Sang, and Angela Fielding. 1992. Ethnicity, immigration and mental illness: A critical review of Australian research. Bureau of immigration research.
  27. C. Johnson. 1997. Levi-strauss: The writing lesson revisited. The Modern Language Review.
  28. Ha-Young Joo, Hyeontaek Oh, and Jinhong Yang. 2023. A survey on open source based large language mod- els. The Journal of Korea Institute of Informa- tion, Electronics, and Communication Technology, 16(4):193-202.
  29. A. Katinskaia, J. Nouri, and R. Yangarber. 2017. Re- vita: a system for language learning and supporting endangered languages. In Proc. of the workshop on NLP for CALL and for Language Acquisition.
  30. P. Kruthika. 2019. Improving automatic speech recog- nition on endangered languages. Master's thesis, Rochester Institute of Technology.
  31. R. Kuhn, F. Davis, A. Désilets, E. Joanis, et al. 2020. The Indigenous languages technology project at NRC Canada: An empowerment-oriented approach to de- veloping language software. In Proc. of COLING'20, pages 5866-5878.
  32. Tahu Kukutai and John Taylor. 2016. Indigenous data sovereignty: Toward an agenda. ANU press.
  33. D.C. Leal and E.C. Teles. 2022. Tangible and intangi- ble spaces of community connectivity. Interactions, 29(3):62-65.
  34. En-Shiun Lee, Sarubi Thillainathan, Shravan Nayak, Surangika Ranathunga, David Adelani, Ruisi Su, and Arya McCarthy. 2022. Pre-trained multilin- gual sequence-to-sequence models: A hope for low- resource language translation? In Proceedings of the 60th Annual Meeting of the Association for Computa- tional Linguistics -Findings (ACL'22), pages 58-67, Dublin, Ireland. Association for Computational Lin- guistics. · DOI
  35. M. Mager, X. Gutierrez-Vasques, G. Sierra, and I. Meza. 2018. Challenges of language technologies for the Indigenous languages of the Americas. In Proc. of COLING, page 55-69.
  36. Manuel Mager, Rajat Bhatnagar, Graham Neubig, Ngoc Thang Vu, and Katharina Kann. 2023. Neural machine translation for the indigenous languages of the Americas: An introduction. In Proceedings of the Workshop on Natural Language Processing for Indigenous Languages of the Americas (Americas- NLP), pages 109-133, Toronto, Canada. Association for Computational Linguistics. · DOI
  37. M. Maxwell and A. Bills. 2017. Endangered data for endangered languages: Digitizing print dictionaries. In Proc. of ComputEL'17.
  38. Devon A Mihesuah. 1993. Suggested guidelines for institutions with scholars who conduct research on american indians. American Indian Culture and Re- search Journal, 17(3):131-139.
  39. A. Mirza. 2017. Design and implementation of social persuasive ubiquitous knowledge systems to revitalise endangered languages. Ph.D. thesis, Auckland.
  40. C. Muashekele, H. Winschiers-Theophilus, and G. Ka- puire. 2019. Co-design as a means of fostering appro- priation of conservation monitoring technology by indigenous communities. In Proc. of the 9th Interna- tional Conference on Communities & Technologies- Transforming Communities.
  41. Muntean, R.and Antle, B. Matkin, K. Hennessy, S. Rowley, and J. Wilson. 2017. Designing cultural values into interaction. In CHI'17.
  42. Eduardo de Almeida Navarro. 2011. Um texto anônimo, em língua geral amazônica, do século xviii. Revista USP, 90:181-192. · DOI
  43. Eduardo de Almeida Navarro. 2016. Curso de língua geral (nheengatu ou tupi moderno): a língua das origens da civilização amazônica, 2 edition. Edição do Autor, São Paulo.
  44. G. Neubig, S. Rijhwani, A. Palmer, J. MacKenzie, et al. 2020. A summary of the first workshop on language technology for language documentation and revital- ization. arXiv preprint arXiv:2004.13203. · arXiv
  45. Nathan Ng, Kyra Yee, Alexei Baevski, Myle Ott, Michael Auli, and Sergey Edunov. 2019. Facebook FAIR's WMT19 news translation task submission. In Proceedings of the Fourth Conference on Machine Translation (Volume 2: Shared Task Papers, Day 1), pages 314-319, Florence, Italy. Association for Computational Linguistics. · DOI
  46. Kishore Papineni, Salim Roukos, Todd Ward, and Wei- Jing Zhu. 2002. Bleu: a method for automatic evalu- ation of machine translation. In Proceedings of the 40th Annual Meeting of the Association for Computa- tional Linguistics (ACL'02), pages 311-318, Philadel- phia, Pennsylvania, USA. Association for Computa- tional Linguistics. · DOI · Paper page
  47. C. Pinhanez, P. Cavalin, M. Vasconcelos, and J. Nogima. 2023. Balancing social impact, opportunities, and ethical constraints of using ai in the documentation and vitalization of indigenous languages. In Proc. of the 2023 International Joint Conference on Artificial Ingelligence (IJCAI'23), Macao, China.
  48. Claudio Pinhanez, Paulo Cavalin, and Julio Nogima. 2024. Human evaluation of the usefulness of fine- tuned english translators for the guarani mbya and nheengatu indigenous languages. In Proceedings of First Workshop on NLP for Indigenous Languages of Lusophone Countries (ILLC-NLP'24).
  49. Claudio Santos Pinhanez. 2023. How to structure the design workshop of a conversational language aid for/with an indigenous community? In Proc. of the Conversational User Interfaces workshop of the CHI'23 (CUIatCHI'23).
  50. Maja Popović. 2015. chrF: character n-gram F-score for automatic MT evaluation. In Proceedings of the Tenth Workshop on Statistical Machine Translation, pages 392-395, Lisbon, Portugal. Association for Computational Linguistics. · DOI
  51. Matt Post. 2018. A call for clarity in reporting BLEU scores. In Proceedings of the Third Conference on Machine Translation: Research Papers, pages 186- 191, Brussels, Belgium. Association for Computa- tional Linguistics. · DOI · Paper page
  52. L. Reitsma, A. Light, T. Zaman, and P. Rodgers. 2019. A respectful design framework. incorporating indige- nous knowledge in the design process. The Design Journal, 22.
  53. Fahimeh Saleh, Wray Buntine, Gholamreza Haffari, and Lan Du. 2021. Multilingual neural machine transla- tion: Can linguistic hierarchies help? In Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing (EMNLP 2021), pages 1313-1330, Punta Cana, Dominican Republic. Asso- ciation for Computational Linguistics. · DOI
  54. Monika S Schmid. 2011. Contact x time: External factors and variability in l1 attrition. Modeling bilin- gualism: From structure to chaos, pages 155-176.
  55. Thibault Sellam, Dipanjan Das, and Ankur P Parikh. 2020. Bleurt: Learning robust metrics for text gen- eration. In Proceedings of the 48th Annual Confer- ence of the Association of Computational Linguistics (ACL'20). Association for Computational Linguis- tics.
  56. K. Shedlock and P. Hudson. 2022. Kaupapa māori con- cept modelling for the creation of māori it artefacts. Journal of the Royal Society of New Zealand, 52.
  57. L. Smith. 1999. Decolonizing methodologies: research and Indigenous peoples. Zed Books ; University of Otago Press.
  58. Yuqing Tang, Chau Tran, Xian Li, Peng-Jen Chen, Na- man Goyal, Vishrav Chaudhary, Jiatao Gu, and An- gela Fan. 2020. Multilingual translation with exten- sible multilingual pretraining and finetuning. arXiv preprint: 2008.00401. · arXiv
  59. J. Taylor, A. Soro, P. Roe, A. Lee Hong, and M. Br- ereton. 2017. Situational when: Designing for time across cultures. In CHI'17.
  60. S. Thomason. 2015. Endangered languages. Cam- bridge University Press.
  61. I. Ubaleht. 2021. Lexeme: the concept of system and the creation of speech corpora for two endangered languages. In Proc. of ComputEL'21. UNESCO. 2020a. Los pinos declaration [chapoltepek] - making a decade of action for indigenous languages. https://en.unesco.org/sites/default/ files/los_pinos_declaration_170720_en.pdf. Accessed: 2022-02-02.
  62. D. van Esch, B. Foley, and N. San. 2019. Future direc- tions in technological support for language documen- tation. In Proc. of ComputEL, volume 1.
  63. Marisa Vasconcelos, Priscila de Souza Mizukami, and Claudio Santos Pinhanez. 2024. Disappearing with- out a trace: Coverage, community, quality, and tem- poral dynamics of wikipedia articles on endangered brazilian indigenous languages. In Proc. of the 18th International AAAI Conference on Web and Social Media (ICSWM'24).
  64. Ashish Vaswani, Noam Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aidan N Gomez, Łukasz Kaiser, and Illia Polosukhin. 2017. Attention is all you need. In Proc. of Advances in Neural Informa- tion Processing Systems (Neurips'17).
  65. Maggie Walter, Tahu Kukutai, Stephanie Russo Carroll, and Desi Rodriguez-Lonebear. 2021. Indigenous data sovereignty and policy. Taylor & Francis.
  66. Sholom M. Weiss, Nitin Indurkhya, and Tong Zhang. 2010. Fundamentals of Predictive Text Mining, 1st edition. Springer Publishing Company, Incorporated.
  67. R. Yangarber. 2018. Support for endangered and low- resource languages via e-learning, translation and crowd-sourcing. In Proc. of FEL, pages 90-97.
  68. Tianyi Zhang, Varsha Kishore, Felix Wu, Kilian Q. Weinberger, and Yoav Artzi. 2020. Bertscore: Evalu- ating text generation with bert. In Proc. of the 2020 International Conference on Learning Representa- tions (ICLR'20).
  69. G. Zuckerman, S. Vigfússon, M. Rayner, N. Chiaráin, et al. 2021. LARA in the service of revivalistics and documentary linguistics: Community engagement and endangered languages. In Proc. of ComputEl'21, pages 13-23.

Cited by

Sorted by citations

Authors
Pinhanez, C., Cavalin, P., Storto, L., Finbow, T., Cobbinah, A., Nogima, J., Vasconcelos, M., Domingues, P., Mizukami, P. D. S., Grell, N., Gongora, M., & Gonçalves, I.
Affiliations
  • Universidade de São Paulo (BR)
  • IBM Research - Brazil (BR)
ORCID
Venue
arXiv
Publisher
arXiv
Published
2024
ISSN
2331-8422 (ISSN-L)
DOI
10.48550/arxiv.2407.12620
arXiv
2407.12620
OpenAlex
W4402466742
Cited by
8
References
0
Citations by year
2026: 5 · 2025: 2 · 2022: 1
Type
posted content
Language
en
Open access
Licence
Locations
  • arXiv (Cornell University) (submittedVersion, cc-by)
  • arXiv (Cornell University) (cc-by)
Funders
  • International Business Machines Corporation
  • Fundação de Amparo à Pesquisa do Estado de São Paulo
  • Universidade de São Paulo
  • Universidade Estadual de Campinas
Topics
  • Physical Sciences › Computer Science › Artificial Intelligence › Natural Language Processing Techniques
  • Physical Sciences › Computer Science › Artificial Intelligence › Topic Modeling
  • Social Sciences › Linguistics and Language › Multilingual Education and Policy
Keywords
endangered languages, indigenous languages, language revitalization, large language models, machine translation, low-resource languages, fine-tuning, spell checker, next-word prediction, language documentation, community participation, ethical challenges of AI, indigenous languages of Brazil

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review