AI and Language: New Forms for Old Discriminations? A Case Study in Google Translate and Canva
The DOI matches its Crossref record; 7 of the 7 references it cites were found in a registry or an index.
Abstract
The development of artificial intelligence (AI) is one of the greatest technological revolutions in recent human history. AI technology is widely used in various fields, including education. In this field, AI is studied as a discipline, and used as a tool to overcome social barriers. Like any human revolution, however, it is necessary to be careful about it and consider that the growing use of these new informatic systems also entails risks. One of them, it is the reinforcement of gender stereotypes and discrimination against women through linguistics feedback. Trough an experimental analysis conducted on common AI-integrated app –Google Translate and Canva–we will investigate linguistic behaviours such as responding to a command prompts. From the results obtained, we can demonstrate the existence of gender biases in the AI’s productions, both in textual and visual language. Gender biases are consequences of the structural inequalities present in society: it is not the technology that is sexist, but it is the dataset on which it is based, which in turn is based on the results produced by users and published on internet. In a society based on democracy and equality, it is important to ensure that the use of such a widespread technology as AI does not perpetuate existing stereotypes and does not allow to become a new form of strengthening discriminations. From a linguistics perspective, this means paying attention to the linguistic outputs, both textual and visual, provided by the AI and checking the dataset it has been training on. Due to their central role in the education of new generations, schools and institutions should prepare students for a critical vision of the phenomenon and provide them with the tools to contrast it. This path could start from teaching AI mechanisms and ethics of technology to students and using an inclusive language in the educational context.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“For instance, AI applications have been shown to replicate gender bias in classroom content, influencing students' writing and framing decisions (Mattiazzi, 2025).”
From Epistemic authority and generative AI in learning spaces: rethinking knowledge in the algorithmic age (2025) · cites this paper as Mattiazzi, 2025
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Austin, J. L. (1975) · doi:10.1093/acprof:oso/9780198245537.001.0001 · Cited by 21,496
Searle, J. R. (1969) · doi:10.1017/cbo9781139173438 · Cited by 11,718
Assessing gender bias in machine translation: a case study with Google Translate
Prates, M. O. R., Avelar, P. H., & Lamb, L. C. (2020) · Neural Computing and Applications · doi:10.1007/s00521-019-04144-6 · Cited by 410
Assessing Gender Bias in Machine Translation -- A Case Study with Google Translate
Prates, M. O. R., Avelar, P. H. C., & Lamb, L. (2018) · arXiv · doi:10.48550/arxiv.1809.02208 · Cited by 409
Should ChatGPT be Biased? Challenges and Risks of Bias in Large Language Models
Ferrara, E. (2023) · arXiv · doi:10.48550/arxiv.2304.03738 · Cited by 282
Should ChatGPT be biased? Challenges and risks of bias in large language models
Ferrara, E. (2023) · First Monday · doi:10.5210/fm.v28i11.13346 · Cited by 282
What ChatGPT Tells Us about Gender: A Cautionary Tale about Performativity and Gender Biases in AI
Gross, N. (2023) · Social Sciences · doi:10.3390/socsci12080435 · Cited by 162
Research works printed but not linked: 15
- Bartneck, C., Lütge, C., Wagner, A., & Welsh, S. (2021). An Introduction to Ethics in Robotics and AI. Springer. https://doi.org/10.1007/978-3-030-51110-4 · DOI · Paper page
- Bazzan, B. (2022). Il peccato originale delle intelligenze artificiali [Unpublished master's thesis]. Politecnico di Milano - Scuola del Design. POLITesi - Archivio digitale delle tesi di laurea e dottorato. https://www.politesi.polimi.it/handle/10589/187945
- Directorate-General for Education, Youth, Sport and Culture, European Commission. (2022). Ethical guidelines on the use of artificial intelligence (AI) and data in teaching and learning for educators. Publications Office of the European Union. https://doi.org/10.2766/153756 · doi:10.2766/153756
- Ghosh, S., & Caliskan, A. (2023). ChatGPT Perpetuates Gender Bias in Machine Translation and Ignores Non-Gendered Pronouns: Findings across Bengali and Five other Low-Resource Languages. In F. Rossi, S. Das, J. Davis, K. Firth-Butterfield & A. John (Eds.), AIES '23: Proceedings of the 2023 AAAI/ACM Conference on AI, Ethics, and Society (pp. 901-912). Association for Computing Machinery. https://doi.org/10.1145/3600211.3604672 · DOI · Paper page
- Gianini-Belotti, E. (2013). Dalla parte delle bambine. L'influenza dei condizionamenti sociali nella formazione del ruolo femminile nei primi anni di vita (28th ed.). Feltrinelli (Original work published 1973).
- Giusti, G. (2011). Riferimento al genere e costruzione d'identità. In G. Giusti (Ed.), Nominare per esistere: nomi e cognomi. Atti del primo convegno Lingua e Identità di Genere. Venezia, Auditorium s. Margherita, 19 settembre 2011 (pp. 9-24). Libreria Editrice Cafoscarina.
- Leavy, S., Meaney, G., Wade, K., & Greene, D. (2020). Mitigating Gender Bias in Machine Learning Data Sets. In L. Boratto, S. Faralli, M. Marras & G. Stilo (Eds.), Bias and Social Aspects in Search and Recommendation. BIAS 2020. Communications in Computer and Information Science (pp. 12-26). Springer, Cham. https://doi.org/10.1007/978-3-030-52485-2_2 · DOI
- Mezzadri, M. (2002). La correzione degli errori. In.it, 1(3), 4-9.
- Nota, L., Soresi, S., & Santilli, S. (2013). Le abilità sociali e il loro ruolo in un contesto socioculturale. In A. Vieno & M. Santinello (Eds.), Metodi di intervento in psicologia di comunità. Dalla progettazione alle esperienze professionali (pp. 77-95). Il Mulino.
- Rossi, S. (2018). Il feedback tra pari come strumento per l'apprendimento linguistico. In R. Grassi (Ed.), Il trattamento dell'errore nella classe di italiano L2: teorie e pratiche a confronto (pp. 111-124). Franco Cesati Editore.
- Russell, S., & Norvig P. (2021). Artificial Intelligence: A Modern Approach. Pearson.
- Saturno, J. (2018). Correzioni tra pari nelle fasi iniziali dell'acquisizione: uno strumento appropriato? In R. Grassi (Ed.), Il trattamento dell'errore nella classe di italiano L2: teorie e pratiche a confronto (pp. 97-110). Franco Cesati Editore.
- Segatello, F. (2021). La valutazione tra pari per lo sviluppo delle abilità sociali. Uno studio quasi-sperimentale in una classe quinta di Scuola Primaria [Master's thesis, Università degli Studi di Padova - Dipartimento di Filosofia, Sociologia, Pedagogia e Psicologia applicata]. Padua Thesis and Dissertation Archive. https://thesis.unipd.it/handle/20.500.12608/37326?mode=simple
- Tecuci, G. (2011). Artificial intelligence. WIREs Computational Statistics, 4, 168-180. https://doi.org/10.1002/wics.200 · DOI · Paper page
- Trang, C. K. (2021). Exploring Bias Against Women in Artificial Intelligence: Practitioners' Views on Systems of Discrimination [Master's Thesis, Department of Informatics - The Faculty of Mathematics and Natural Sciences, University of Oslo]. UiO DUO vitenarkiv. https://www.duo.uio.no/handle/10852/88551?show=full
Cited by
Jose, B., Cleetus, A., Joseph, B., Joseph, L., Jose, B., & John, A. K. (2025) · Frontiers in Education · doi:10.3389/feduc.2025.1647687 · Cited by 63
Metadata
- Authors
- Mattiazzi, M.
- ORCID
- Mattiazzi, Martina
- Venue
- Feminismo/s
- Published
- 2025-01-21
- Issue
- 45
- Pages
- 118-138
- ISSN
- 1989-9998
- Cited by
- 3
- References
- 7
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: AI and Language: New Forms for Old Discriminations? A Case Study in Google Translate and Canva. https://app.cochat.ai/papers/10.14198/fem.2025.45.05
- The paper
- Mattiazzi, M. (2025). AI and Language: New Forms for Old Discriminations? A Case Study in Google Translate and Canva. Feminismo/s. https://doi.org/10.14198/fem.2025.45.05
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.