CoChat

AI and Language: New Forms for Old Discriminations? A Case Study in Google Translate and Canva

Mattiazzi, Martina · 2025 · Feminismo/s
Cited by 3

The DOI matches its Crossref record; 7 of the 7 references it cites were found in a registry or an index.

Abstract

The development of artificial intelligence (AI) is one of the greatest technological revolutions in recent human history. AI technology is widely used in various fields, including education. In this field, AI is studied as a discipline, and used as a tool to overcome social barriers. Like any human revolution, however, it is necessary to be careful about it and consider that the growing use of these new informatic systems also entails risks. One of them, it is the reinforcement of gender stereotypes and discrimination against women through linguistics feedback. Trough an experimental analysis conducted on common AI-integrated app –Google Translate and Canva–we will investigate linguistic behaviours such as responding to a command prompts. From the results obtained, we can demonstrate the existence of gender biases in the AI’s productions, both in textual and visual language. Gender biases are consequences of the structural inequalities present in society: it is not the technology that is sexist, but it is the dataset on which it is based, which in turn is based on the results produced by users and published on internet. In a society based on democracy and equality, it is important to ensure that the use of such a widespread technology as AI does not perpetuate existing stereotypes and does not allow to become a new form of strengthening discriminations. From a linguistics perspective, this means paying attention to the linguistic outputs, both textual and visual, provided by the AI and checking the dataset it has been training on. Due to their central role in the education of new generations, schools and institutions should prepare students for a critical vision of the phenomenon and provide them with the tools to contrast it. This path could start from teaching AI mechanisms and ethics of technology to students and using an inclusive language in the educational context.

Overview

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.14198/fem.2025.45.05

Cites

7 of 7 references verified0 citation errors · 0 not checkable

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Show all 7 references

Research works printed but not linked: 15

  1. Bartneck, C., Lütge, C., Wagner, A., & Welsh, S. (2021). An Introduction to Ethics in Robotics and AI. Springer. https://doi.org/10.1007/978-3-030-51110-4 · DOI · Paper page
  2. Bazzan, B. (2022). Il peccato originale delle intelligenze artificiali [Unpublished master's thesis]. Politecnico di Milano - Scuola del Design. POLITesi - Archivio digitale delle tesi di laurea e dottorato. https://www.politesi.polimi.it/handle/10589/187945
  3. Directorate-General for Education, Youth, Sport and Culture, European Commission. (2022). Ethical guidelines on the use of artificial intelligence (AI) and data in teaching and learning for educators. Publications Office of the European Union. https://doi.org/10.2766/153756 · doi:10.2766/153756
  4. Ghosh, S., & Caliskan, A. (2023). ChatGPT Perpetuates Gender Bias in Machine Translation and Ignores Non-Gendered Pronouns: Findings across Bengali and Five other Low-Resource Languages. In F. Rossi, S. Das, J. Davis, K. Firth-Butterfield & A. John (Eds.), AIES '23: Proceedings of the 2023 AAAI/ACM Conference on AI, Ethics, and Society (pp. 901-912). Association for Computing Machinery. https://doi.org/10.1145/3600211.3604672 · DOI · Paper page
  5. Gianini-Belotti, E. (2013). Dalla parte delle bambine. L'influenza dei condizionamenti sociali nella formazione del ruolo femminile nei primi anni di vita (28th ed.). Feltrinelli (Original work published 1973).
  6. Giusti, G. (2011). Riferimento al genere e costruzione d'identità. In G. Giusti (Ed.), Nominare per esistere: nomi e cognomi. Atti del primo convegno Lingua e Identità di Genere. Venezia, Auditorium s. Margherita, 19 settembre 2011 (pp. 9-24). Libreria Editrice Cafoscarina.
  7. Leavy, S., Meaney, G., Wade, K., & Greene, D. (2020). Mitigating Gender Bias in Machine Learning Data Sets. In L. Boratto, S. Faralli, M. Marras & G. Stilo (Eds.), Bias and Social Aspects in Search and Recommendation. BIAS 2020. Communications in Computer and Information Science (pp. 12-26). Springer, Cham. https://doi.org/10.1007/978-3-030-52485-2_2 · DOI
  8. Mezzadri, M. (2002). La correzione degli errori. In.it, 1(3), 4-9.
  9. Nota, L., Soresi, S., & Santilli, S. (2013). Le abilità sociali e il loro ruolo in un contesto socioculturale. In A. Vieno & M. Santinello (Eds.), Metodi di intervento in psicologia di comunità. Dalla progettazione alle esperienze professionali (pp. 77-95). Il Mulino.
  10. Rossi, S. (2018). Il feedback tra pari come strumento per l'apprendimento linguistico. In R. Grassi (Ed.), Il trattamento dell'errore nella classe di italiano L2: teorie e pratiche a confronto (pp. 111-124). Franco Cesati Editore.
  11. Russell, S., & Norvig P. (2021). Artificial Intelligence: A Modern Approach. Pearson.
  12. Saturno, J. (2018). Correzioni tra pari nelle fasi iniziali dell'acquisizione: uno strumento appropriato? In R. Grassi (Ed.), Il trattamento dell'errore nella classe di italiano L2: teorie e pratiche a confronto (pp. 97-110). Franco Cesati Editore.
  13. Segatello, F. (2021). La valutazione tra pari per lo sviluppo delle abilità sociali. Uno studio quasi-sperimentale in una classe quinta di Scuola Primaria [Master's thesis, Università degli Studi di Padova - Dipartimento di Filosofia, Sociologia, Pedagogia e Psicologia applicata]. Padua Thesis and Dissertation Archive. https://thesis.unipd.it/handle/20.500.12608/37326?mode=simple
  14. Tecuci, G. (2011). Artificial intelligence. WIREs Computational Statistics, 4, 168-180. https://doi.org/10.1002/wics.200 · DOI · Paper page
  15. Trang, C. K. (2021). Exploring Bias Against Women in Artificial Intelligence: Practitioners' Views on Systems of Discrimination [Master's Thesis, Department of Informatics - The Faculty of Mathematics and Natural Sciences, University of Oslo]. UiO DUO vitenarkiv. https://www.duo.uio.no/handle/10852/88551?show=full

Cited by

See all 3

Metadata

Authors
Mattiazzi, M.
Venue
Feminismo/s
Published
2025-01-21
Issue
45
Pages
118-138
ISSN
1989-9998
Cited by
3
References
7

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: AI and Language: New Forms for Old Discriminations? A Case Study in Google Translate and Canva. https://app.cochat.ai/papers/10.14198/fem.2025.45.05
The paper
Mattiazzi, M. (2025). AI and Language: New Forms for Old Discriminations? A Case Study in Google Translate and Canva. Feminismo/s. https://doi.org/10.14198/fem.2025.45.05

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.