Toward Gender-Inclusive Coreference Resolution: An Analysis of Gender and Bias Throughout the Machine Learning Lifecycle
Open accessThe DOI matches its Crossref record; 329 of the 329 references it cites were found in a registry or an index.
Abstract
Correctly resolving textual mentions of people fundamentally entails making inferences about those people. Such inferences raise the risk of systematic biases in coreference resolution systems, including biases that can harm binary and non-binary trans and cis stakeholders. To better understand such biases, we foreground nuanced conceptualizations of gender from sociology and sociolinguistics, and investigate where in the machine learning pipeline such biases can enter a coreference resolution system. We inspect many existing data sets for trans-exclusionary biases, and develop two new data sets for interrogating bias in both crowd annotations and in existing coreference resolution systems. Through these studies, conducted on English text, we confirm that without acknowledging and building systems that recognize the complexity of gender, we will build systems that fail for: quality of service, stereotyping, and over- or under-representation, especially for binary and non-binary trans users.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“and processes of creating resources and technologies may further entrench such disparities [25, 38, 144].”
From Data Governance in the Age of Large-Scale Data-Driven Language Technology (2022) · cites this paper as [25]
Citations
Cites
Items 201–329 of 329
Removing the Training Wheels: A Coreference Dataset that Entertains Humans and Challenges Computers
Guha, A., Iyyer, M., Bouman, D., & Boyd-Graber, J. L. (2015) · Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT) · doi:10.3115/v1/n15-1117 · Cited by 32 · cited 2×
“used in dominant papers, the active learning algorithms used are not statistically unbiased (Ng and Cardie 2003; Laws, Heimerl, and Schütze 2012; Miller, Dligach, and Savova 2012; Sachan, Hovy, and Xing 2015; Guha et al. 2015).”
MethodSyntactic phrase reordering for English-to-Arabic statistical machine translation
Badr, I., Zbib, R., & Glass, J. (2009) · doi:10.3115/1609067.1609076 · Cited by 31
Proceedings of the ACL-2012 Special Workshop on Rediscovering 50 Years of Discoveries
Webber, B., & Joshi, A. (2012) · The Association for Computational Linguistics · Cited by 31
What's in a Name? Reducing Bias in Bios without Access to Protected Attributes
Romanov, A., De‐Arteaga, M., Wallach, H., Chayes, J., Borgs, C., Chouldechova, A., Geyik, S. C., Kenthapadi, K., Rumshisky, A., & Kalai, A. T. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1904.05233 · Cited by 31 · cited 1×
“…resolution, including, for instance, natural language inference (Rudinger, May, and Van Durme 2017), word embeddings (e.g., Bolukbasi et al. 2016; Romanov et al. 2019; Gonen and Goldberg 2019), sentiment analysis (Kiritchenko and Mohammad 2018), machine translation (Font and Costa-jussà 2019;…”
BackgroundAutomatic compilation of travel information from automatically identified travel blogs
Nanba, H., Taguma, H., Ozaki, T., Kobayashi, D., Ishino, A., & Takezawa, T. (2009) · Joint Conference of the Annual Meeting of the Association for Computational Linguistics and the International Joint Conference on Natural Language Processing (ACL-IJCNLP) · doi:10.3115/1667583.1667646 · Cited by 30 · cited 1×
“Garera and Yarowsky (2009) N Y Y Y N Y Y N Bergsma, Lin, and Goebel (2009) Y Y Y Y N Y Y N Nastase and Popescu (2009) N Y N N − − − − Nanba et al. (2009) N N N Y − − − − Robaldo and Di Carlo (2009) N N N Y − − − − Mukherjee and Liu (2010) N N Y Y − Y Y −”
Deception detection in Russian texts
Litvinova, O., Seredin, P. V., Litvinova, T., & Lyell, J. (2017) · Conference of the European Chapter of the Association for Computational Linguistics: Student Research Workshop (EACL SRW) · doi:10.18653/v1/e17-4005 · Cited by 30
Cross-lingual Coreference Resolution of Pronouns
Novák, M., & Žabokrtský, Z. (2014) · Institute of Formal and Applied Linguistics (ÚFAL) · Cited by 29
Russian. Doing gender in Russian
Doleschal, U., & Schmid, S. D. (2001) · Impact · doi:10.1075/impact.9.16dol · Cited by 29
Gender-Distinguishing Features in Film Dialogue
Schofield, A., & Mehr, L. (2016) · Joint SIGHUM Workshop on Computational Linguistics for Cultural Heritage, Social Sciences, Humanities and Literature (LaTeCH-CLfL) · doi:10.18653/v1/w16-0204 · Cited by 29
Levitan, S. I., Levitan, Y., An, G., Levine, M., Levitan, R., Rosenberg, A., & Hirschberg, J. (2016) · doi:10.18653/v1/w16-0806 · Cited by 28
Costa‐jussà, M. R. (2017) · Workshop on NLP for Similar Languages, Varieties and Dialects (VarDial) · doi:10.18653/v1/w17-1207 · Cited by 28
Two-step translation with grammatical post-processing
Mareček, D., Rosa, R., Galuščáková, P., & Bojar, O. (2011) · Cited by 27
Proceedings of the NAACL-HLT 2012 Workshop on Computational Linguistics for Literature
Elson, D. K., Kazantseva, A., Mihalcea, R. F., & Śzpakowicz, S. (2012) · North American Chapter of the Association for Computational Linguistics · Cited by 27
Referential Form, Word Duration, and Modeling the Listener in Spoken Dialogue
Bard, E. G., & Aylett, M. P. (2001) · eScholarship (California Digital Library) · Cited by 27
Word Segmentation, Unknown-word Resolution, and Morphological Agreement in a Hebrew Parsing System
Goldberg, Y., & Elhadad, M. (2012) · Computational Linguistics · doi:10.1162/coli_a_00137 · Cited by 26
Active Learning for Coreference Resolution
Miller, T. A., Dligach, D., & Savova, G. (2012) · North American Chapter of the Association for Computational Linguistics · Cited by 26
Nissim, M., Patti, V., & Plank, B. (2016) · Cited by 26
How Gender and Skin Tone Modifiers Affect Emoji Semantics in Twitter
Barbieri, F., & Camacho-Collados, J. (2018) · Joint Conference on Lexical and Computational Semantics · doi:10.18653/v1/s18-2011 · Cited by 26
Proceedings of the 2013 NAACL HLT Student Research Workshop
Louis, A. P., Socher, R., Hockenmaier, J., & Ringger, E. K. (2013) · North American Chapter of the Association for Computational Linguistics · Cited by 26
Introduction: Special Issue on Anaphora Resolution in Machine Translation and Multilingual NLP
Mitkov, R. (1999) · Machine Translation · doi:10.1023/a:1011132522992 · Cited by 25 · cited 1×
“In machine translation, producing correct gendered forms in gender languages often requires coreference to have been solved (Mitkov 1999; Hardmeier and Federico 2010; Guillou 2012; Hardmeier and Guillou 2018).”
BackgroundIdentifying zero pronouns in Japanese dialogue
Yoshimoto, K. (1988) · International Conference on Computational Linguistics · doi:10.3115/991719.991795 · Cited by 25
A MDL-based model of gender knowledge acquisition
Marchal, H., Lemaire, B., Bianco, M., & Dessus, P. (2008) · Conference on Computational Natural Language Learning · doi:10.3115/1596324.1596337 · Cited by 25 · cited 3×
“Badr, Zbib, and Glass (2008) N Y N N − − − − Marchal et al. (2008) N Y N N − − − − van Peursen (2009) N Y N N − − − − Badr, Zbib, and Glass (2009) N Y N N − − − − Garera and Yarowsky (2009) N Y Y Y N Y Y N Bergsma, Lin, and Goebel (2009) Y Y Y Y N Y Y N”
InfluentialExtracting Social Networks and Biographical Facts From Conversational Speech Transcripts
Jing, H., Kambhatla, N., & Roukos, S. (2007) · Cited by 25
Proceedings of the Society for Computation in Linguistics (SCiL) 2019
Jarosz, G. E., Nelson, M., O’Connor, B., & Pater, J. (2019) · Cited by 25
Knowledge-Lean Coreference Resolution and its Relation to Textual Cohesion and Coherence
Harabagiu, S. M., & Maiorano, S. J. (1999) · Cited by 24
Proceedings of ACL-08: HLT, Short Papers
Georgila, K., Wolters, M. K., & Moore, J. D. (2008) · The Association for Computational Linguistics · Cited by 24
Proceedings of the Second Workshop on Speech and Language Processing for Assistive Technologies
Fried-Oken, M. B., Ljunglöf, P., McCoy, K. F., & Waller, A. (2011) · Cited by 24
Romanov, A., De-Arteaga, M., Wallach, H., Chayes, J., Borgs, C., Chouldechova, A., Geyik, S., Kenthapadi, K., Rumshisky, A., & Kalai, A. (2019) · Proceedings of the 2019 Conference of the North · doi:10.18653/v1/n19-1424 · Cited by 24 · cited 1×
“…resolution, including, for instance, natural language inference (Rudinger, May, and Van Durme 2017), word embeddings (e.g., Bolukbasi et al. 2016; Romanov et al. 2019; Gonen and Goldberg 2019), sentiment analysis (Kiritchenko and Mohammad 2018), machine translation (Font and Costa-jussà 2019;…”
BackgroundAgarwal, O., Yang, Y., Wallace, B., & Nenkova, A. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2004.04123 · Cited by 24 · cited 1×
“One cue that we explored in detail is that around names, and it is worth pointing out recent work by Agarwal et al. (2020) in the context of named entity recognition.”
BackgroundProceedings of the Ninth International Conference on Computational Semantics (IWCS 2011)
Bos, J., & Pulman, S. (2011) · University of Groningen research database (University of Groningen / Centre for Information Technology) · Cited by 23
Language-independent Gender Prediction on Twitter
Ljubešić, N., Fišer, D., & Erjavec, T. (2017) · Workshop on Natural Language Processing and Computational Social Science (NLP+CSS) · doi:10.18653/v1/w17-2901 · Cited by 23
How to Use less Features and Reach Better Performance in Author Gender Identification
Juan Soler-Company, & Wanner, L. (2014) · Language Resources and Evaluation · Cited by 23
Patton, D., Blandfort, P., Frey, W., Gaskell, M., & Karaman, S. (2019) · Proceedings of the Annual Hawaii International Conference on System Sciences · doi:10.24251/hicss.2019.260 · Cited by 23
Kunneman, F., Iñurrieta, U., Camilleri, J. J., & Ardanuy, M. C. (2014) · doi:10.3115/v1/e14-3 · Cited by 22
Zooming in on Gender Differences in Social Media
Garimella, A., & Mihalcea, R. F. (2016) · International Conference on Computational Linguistics · Cited by 22
Toward Gender-Inclusive Coreference Resolution
Cao, Y. T., & Daumé III, H. (2020) · Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics · doi:10.18653/v1/2020.acl-main.418 · Cited by 22
Self-citationSeddah, D., Kübler, S., & Tsarfaty, R. (2010) · HAL (Le Centre pour la Communication Scientifique Directe) · Cited by 20
User Classification with Multiple Textual Perspectives.
Zhang, D., Li, S., Wang, H., & Zhou, G. (2016) · International Conference on Computational Linguistics · Cited by 20
On abstract finite-state morphology
Narayanan, A., & Hashem, L. (1993) · Conference of the European Chapter of the Association for Computational Linguistics · doi:10.3115/976744.976779 · Cited by 19
Using subcategorization knowledge to improve case prediction for translation to German
Weller, M., Fraser, A., & Walde, S. S. I. (2013) · Cited by 19
Identifying the sentiment styles of YouTube’s vloggers
Kleinberg, B., Mozes, M., & van der Vegt, I. (2018) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/d18-1394 · Cited by 19
Gender issues in machine translation
Monti, J. (2020) · Routledge eBooks · doi:10.4324/9781315158938-39 · Cited by 19
The joy of TEX : a gourmet guide to typesetting with the AMS-TEX macro package
Spivak, M. (1990) · CERN Document Server (European Organization for Nuclear Research) · Cited by 18
Enriching partially-specified representations for text realization using an attribute grammar
Channarukul, S., McRoy, S., & Ali, S. S. (2000) · doi:10.3115/1118253.1118276 · Cited by 18
Năstase, V., & Popescu, M. (2009) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.3115/1699648.1699683 · Cited by 17
A quantitative analysis of gender differences in movies using psycholinguistic normatives
Ramakrishna, A., Malandrakis, N., Staruk, E., & Narayanan, S. S. (2015) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/d15-1234 · Cited by 17 · cited 3×
“Citation Coref L.G S.G Eng L6=S 0/1 Imm Neo Sidner (1981) Y Y Y Y N − − − Bainbridge (1985) Y Y N Y − − − − Kameyama (1986) Y Y Y Y N Y Y N Mellish (1988) N Y N Y − − − − Danlos and Namer (1988) N Y N N − − − − Yoshimoto (1988) N Y N N − − − − Zock, Francopoulo, and Laroui (1988) N Y N N − − − − Popowich (1989) N Y N…”
BackgroundInfluentialVerhoeven, B., Škrjanec, I., & Pollak, S. (2017) · Workshop on Balto-Slavic Natural Language Processing (BSNLP) · doi:10.18653/v1/w17-1418 · Cited by 17
de Lauretis, T. (1990) · Pacific Coast Philology · doi:10.2307/1316801 · Cited by 17
Resolving individual and abstract anaphora in texts and dialogues
Navarretta, C. (2004) · International Conference on Computational Linguistics · doi:10.3115/1220355.1220389 · Cited by 17
RelaxCor Participation in CoNLL Shared Task on Coreference Resolution
Sapena, E., Padró, L., & Turmo, J. (2011) · Cited by 16
Chimera -- Three Heads for English-to-Czech Translation
Bojar, O., Rosa, R., & Tamchyna, A. (2013) · Workshop on Statistical Machine Translation · Cited by 16
A Pronoun Anaphora Resolution System based on Factorial Hidden Markov Models
Li, D., Miller, T., & Schuler, W. (2011) · Cited by 16
An active learning approach to coreference resolution
Sachan, M., Hovy, E. H., & Xing, E. P. (2015) · International Conference on Artificial Intelligence · Cited by 16
Active Learning for Coreference Resolution
Laws, F., Heimerl, F., & Schütze, H. (2012) · North American Chapter of the Association for Computational Linguistics · Cited by 15
Morphology and cross dependencies in the synthesis of personal pronouns in Romance languages
Danlos, L., & Namer, F. (1988) · International Conference on Computational Linguistics · doi:10.3115/991635.991664 · Cited by 15
A prototype of a grammar checker for Czech
Holan, T., Kuboň, V., & Plátek, M. (1997) · Conference on Applied Natural Language Processing · doi:10.3115/974557.974579 · Cited by 15
Acquisition system for Arabic noun morphology
Abuleil, S., Alsamara, K., & Evens, M. W. (2002) · doi:10.3115/1118637.1118640 · Cited by 15
Bootstrapping without the boot
Eisner, J. M., & Karakos, D. (2005) · doi:10.3115/1220575.1220625 · Cited by 15
Function Words for Chinese Authorship Attribution
Yu, B. (2012) · North American Chapter of the Association for Computational Linguistics · Cited by 15
Evaluation of named entity coreference
Agarwal, O., Subramanian, S., Nenkova, A., & Roth, D. (2019) · Workshop on Computational Models of Reference, Anaphora and Coreference (CRAC) · doi:10.18653/v1/w19-2801 · Cited by 15
The effect of anaphor and ellipsis resolution on proximity searching in a text database
Pirkola, A., & Järvelin, K. (1996) · Information Processing & Management · doi:10.1016/s0306-4573(96)85006-0 · Cited by 14 · cited 1×
“For instance, information retrieval can use coreference resolution to help accurately rank documents by up-weighting the importance of entities that are referred to frequently (Du and Liddy 1990; Pirkola and Järvelin 1996; Edens et al. 2003).”
BackgroundSyntactic and semantic transfer with f-structures
Dorna, M., Frank, A., van Genabith, J., & Emele, M. (1998) · International Conference on Computational Linguistics · doi:10.3115/980451.980903 · Cited by 14
Entrainment in Spoken Dialogue Systems: Adopting, Predicting and Influencing User Behavior
Levitan, R. (2013) · Cited by 14
Gender Prediction for Chinese Social Media Data
Li, W., & Dickinson, M. (2017) · International conference Recent advances in natural language processing · doi:10.26615/978-954-452-049-6_058 · Cited by 14 · cited 2×
“Verhoeven, Škrjanec, and Pollak (2017) N N Y Y − Y Y N Larson (2017) N Y Y Y Y N N Y Koolen and van Cranenburgh (2017) N N Y N − N Y − Tatman (2017) N N Y Y − Y Y N Soler-Company and Wanner (2017) N N Y Y − Y Y N Ljubešić, Fišer, and Erjavec (2017) N N Y N − Y Y − Litvinova et al. (2017) N N Y N − Y Y − Mohammad et al…”
BackgroundOntology-Based Incremental Annotation of Characters in Folktales
Declerck, T., Gmbh, D., & Koleva, N. (2013) · Cited by 13
Aspect-Oriented Opinion Mining from User Reviews in Croatian
Glavaš, G., Korenčić, D., & Šnajder, J. (2013) · MADOC (University of Mannheim) · Cited by 13
PAL: A Chatterbot System for Answering Domain-specific Questions
Liu, Y., Liu, M., Wang, X., Wang, L., & Li, J. (2013) · Cited by 13
The CMU Machine Translation Systems at WMT 2014
Matthews, A., Ammar, W., Bhatia, A., Feely, W., Hanneman, G., Schlinger, E., Swayamdipta, S., Tsvetkov, Y., Lavie, A., & Dyer, C. (2014) · Conference on Machine Translation (WMT) · doi:10.3115/v1/w14-3315 · Cited by 13
Extracting Human Temporal Orientation from Facebook Language
Schwartz, H. A., Park, G., Sap, M., Weingarten, E., Eichstaedt, J., Kern, M., Stillwell, D., Kosinski, M., Berger, J., Seligman, M., et al. (2015) · Proceedings of the 2015 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies · doi:10.3115/v1/n15-1044 · Cited by 13
Distributional Effects of Gender Contrasts Across Categories
Mickus, T., Bonami, O., & Paperno, D. (2019) · ScholarWorks@UMassAmherst (University of Massachusetts Amherst) · doi:10.7275/g11b-3s25 · Cited by 13
TweetGenie: Development, Evaluation, and Lessons Learned
Nguyen, D., Trieschnigg, D., & Meder, T. (2014) · University of Twente Research Information · Cited by 12
Bucholtz, M. (1999) · Journal of Linguistic Anthropology · doi:10.1525/jlin.1999.9.1-2.80 · Cited by 12
A reconfigurable stochastic tagger for languages with complex tag structure
Dębowski, L. (2003) · doi:10.3115/1613200.1613209 · Cited by 11
Gender and power: How gender and gender environment affect manifestations of power
Prabhakaran, V., Reid, E. E., & Rambow, O. (2014) · Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.3115/v1/d14-1211 · Cited by 11
Now We Stronger than Ever: African-American English Syntax in Twitter
Stewart, I. (2014) · Conference of the European Chapter of the Association for Computational Linguistics: Student Research Workshop (EACL SRW) · doi:10.3115/v1/e14-3004 · Cited by 11
Chinese Zero Pronoun Resolution: An Unsupervised Probabilistic Model Rivaling Supervised Resolvers
Chen, C., & Ng, V. (2014) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.3115/v1/d14-1084 · Cited by 11
Rich Morphology Generation Using Statistical Machine Translation
Kholy, A. E., & Habash, N. Y. (2012) · Cited by 10
Implementation of the Arabic numerals and their syntax in GF
Dada, A. (2007) · doi:10.3115/1654576.1654579 · Cited by 10
A Weighted Combination of Text and Image Classifiers for User Gender Inference
Taniguchi, T., Sakaki, S., Shigenaka, R., Tsuboshita, Y., & Ohkuma, T. (2015) · Workshop on Vision and Language (VL) · doi:10.18653/v1/w15-2814 · Cited by 10
Predicting Authorship and Author Traits from Keystroke Dynamics
Plank, B. (2018) · doi:10.18653/v1/w18-1113 · Cited by 10
Comparison of Gender- and Speaker-adaptive Emotion Recognition
Yuryevich, S. M., Ultes, S., & Schmitt, A. (2014) · Language Resources and Evaluation Conference (LREC) · doi:10.63317/4wxqwzrhi4t2 · Cited by 10
Identifying Broken Plurals, Irregular Gender, and Rationality in Arabic Text
Alkuhlani, S., & Habash, N. Y. (2012) · Cited by 9
Identification of patients with congestive heart failure using a binary classifier
Pakhomov, S., Buntrock, J. D., & Chute, C. G. (2003) · doi:10.3115/1118958.1118970 · Cited by 9
Light verb constructions with `do' and `be' in Hindi: A TAG analysis
Vaidya, A., Rambow, O., & Palmer, M. S. (2014) · doi:10.3115/v1/w14-5816 · Cited by 9
Stylometric Analysis of Parliamentary Speeches: Gender Dimension
Mandravickaitė, J., & Krilavičius, T. (2017) · Workshop on Balto-Slavic Natural Language Processing (BSNLP) · doi:10.18653/v1/w17-1416 · Cited by 9
Pérez‐Rosas, V., Davenport, Q., Dai, A. M., Abouelenien, M., & Mihalcea, R. F. (2017) · International Joint Conference on Natural Language Processing · Cited by 9
Social and Emotional Correlates of Capitalization on Twitter
Chan, S., & Fyshe, A. (2018) · doi:10.18653/v1/w18-1102 · Cited by 9
Robustness in Coreference Resolution
Moosavi, N. S. (2020) · heiDOK (Heidelberg University) · doi:10.11588/heidok.00027919 · Cited by 9 · cited 1×
“The first observation is that there is still plenty room for coreference systems to improve; the best performing system achieves as F1 score of 34%, but the Stanford neural system’s F1 score on CoNLL-2012 test set reaches 60% (Moosavi 2020).”
BackgroundMultiword lexical acquisition and dictionary formalization
Mota, C., Carvalho, P., & Ranchhod, E. (2004) · doi:10.3115/1610042.1610060 · Cited by 8
An investigation of broad coverage automatic pronoun resolution for information retrieval
Edens, R. J., Gaylard, H. L., Jones, G. J. F., & Lam-Adesina, A. M. (2003) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/860435.860511 · Cited by 8 · cited 2×
“For instance, information retrieval can use coreference resolution to help accurately rank documents by up-weighting the importance of entities that are referred to frequently (Du and Liddy 1990; Pirkola and Järvelin 1996; Edens et al. 2003).”
BackgroundThe P600 for singular “they”: How the brain reacts when John decides to treat themselves to sushi.Preprint
Prasad, G., & Morris, J. A. (2020) · doi:10.31234/osf.io/hwzke · Cited by 8
Zock, M., Francopoulo, G., & Laroui, A. (1988) · HAL · doi:10.3115/991719.991800 · Cited by 7
Source Language Categorization for improving a Speech into Sign Language Translation System
López-Ludeña, V., San-Segundo, R., Lufti, S. L., Lucas-Cuesta, J. M., Echevarry, J. D., & Martínez-González, B. (2011) · Hispana · Cited by 7
Bergsma, S., Lin, D., & Goebel, R. G. (2009) · Conference on Computational Natural Language Learning · doi:10.3115/1596374.1596396 · Cited by 7
Using Sequence Kernels to identify Opinion Entities in Urdu
Mukund, S., Ghosh, D., & Srihari, R. K. (2011) · Conference on Computational Natural Language Learning · Cited by 7
Semi-supervised Gender Classification with Joint Textual and Social Modeling.
Li, S., Dai, B., Gong, Z., & Zhou, G. (2016) · International Conference on Computational Linguistics · Cited by 7
Stylistic Variation in Social Media Part-of-Speech Tagging
Balusu, M. R. B., Merghani, T., & Eisenstein, J. (2018) · doi:10.18653/v1/w18-1602 · Cited by 7
Understanding the Effect of Gender and Stance in Opinion Expression in Debates on "Abortion"
Durmus, E., & Cardie, C. (2018) · doi:10.18653/v1/w18-1110 · Cited by 7
Popowich, F. P. (1989) · Annual Meeting of the Association for Computational Linguistics (ACL) · doi:10.3115/981623.981651 · Cited by 6
Learning Multimodal Gender Profile using Neural Networks
Estruch, C. P., Paredes, R., & Rosso, P. (2017) · International conference Recent advances in natural language processing · doi:10.26615/978-954-452-049-6_075 · Cited by 6
Pronoun Translation in English-French Machine Translation: An Analysis of Error TypesPreprint
Hardmeier, C., & Guillou, L. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1808.10196 · Cited by 6
INLG 2012 Proceedings of the Seventh International Natural Language Generation Conference
Eugenio, B. D., & McRoy, S. (2012) · International Conference on Natural Language Generation · Cited by 6
Gender Issues in Machine Translation
Karastergiou, A., & Diamantopoulos, K. A. (2024) · Transcultural Journal of Humanities and Social Sciences/Transcultural Journal of Humanities and Social Sciences · doi:10.21608/tjhss.2024.255087.1223 · Cited by 6
Using MMIL for the high level semantic annotation of the French MEDIA dialogue corpus
Rojas-Barahona, L. M., Bazillon, T., Quignard, M., & Lefèvre, F. (2011) · Cited by 5
Montagovian Definite Clause Grammar
Bainbridge, R. I. (1985) · Conference of the European Chapter of the Association for Computational Linguistics · doi:10.3115/976931.976935 · Cited by 5 · cited 2×
“Citation Coref L.G S.G Eng L6=S 0/1 Imm Neo Sidner (1981) Y Y Y Y N − − − Bainbridge (1985) Y Y N Y − − − − Kameyama (1986) Y Y Y Y N Y Y N Mellish (1988) N Y N Y − − − − Danlos and Namer (1988) N Y N N − − − − Yoshimoto (1988) N Y N N − − − − Zock, Francopoulo, and Laroui (1988) N Y N N − − − −…”
Poly-co: a multilayer perceptron approach for coreference detection
Charton, É., & Gagnon, M. (2011) · Cited by 5
Is Nike female? Exploring the role of sound symbolism in predicting brand name gender
Moorthy, S., Pogacar, R., Khan, S., & Xu, Y. (2018) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/d18-1142 · Cited by 5
Reusable workflows for gender prediction
Martinc, M., & Pollak, S. (2018) · Language Resources and Evaluation Conference (LREC) · doi:10.63317/3o52wzf3cjxx · Cited by 5
Disambiguating quantifier scope in DTS
Robaldo, L., & Carlo, J. D. (2009) · doi:10.3115/1693756.1693776 · Cited by 4
Towards a more user-friendly correction
Genthial, D., Courtin, J., & Énézo, J. (1994) · International Conference on Computational Linguistics · doi:10.3115/991250.991326 · Cited by 4
Controlling gender equality with shallow NLP techniques
Carl, M., Garnier, S., Haller, J., Altmayer, A., & Miemietz, B. (2004) · International Conference on Computational Linguistics · doi:10.3115/1220355.1220473 · Cited by 4 · cited 1×
“Tadić and Fulgosi (2003) N Y N N − − − − Debowski (2003) N Y N N − − − − Navarretta (2004) Y Y Y N N Y Y − Carl et al. (2004) Y Y Y N N Y Y − Mota, Carvalho, and Ranchhod (2004) N Y N Y − − − − Eisner and Karakos (2005) N Y N Y − − − −”
Streiter, O., Voltmer, L., & Goudin, Y. (2007) · Institutional Repositories DataBase (IRDB) · Cited by 4
An Algorithm for Resolving Individual and Abstract Anaphora in Danish Texts and Dialogues
Navarretta, C. (2004) · Cited by 4
An ontology of systematic relations for a shared grammar of Slavic
Avgustinova, T., & Uszkoreit, H. (2000) · International Conference on Computational Linguistics · doi:10.3115/990820.990825 · Cited by 3
Learning a Radically Lexical Grammar
Soloman, D., & Wood, M. M. (1994) · Cited by 3
The Romanian Neuter Examined Through A Two-Gender N-Gram Classification System
Dinu, L. P., Niculae, V., & Şulea, O.-M. (2012) · Language Resources and Evaluation Conference (LREC) · doi:10.63317/2chybvsdauac · Cited by 3
Deriving de/het gender classification for Dutch nouns for rule-based MT generation tasks
Babych, B., Geiger, J., Rosell, M. G., & Eberle, K. (2014) · doi:10.3115/v1/w14-1014 · Cited by 2 · cited 3×
“Novák and Žabokrtský (2014) Y Y N Y − − − − Babych et al. (2014) N Y N N − − − − Soler-Company and Wanner (2014) N N Y Y − Y Y N Chen and Ng (2014) Y Y Y Y N Y Y N Sap et al. (2014) N N Y Y − Y Y − Nguyen et al.”
InfluentialHow to establish a verbal paradigm on the basis of ancient Syriac manuscripts
van Peursen, W. (2009) · doi:10.3115/1621774.1621776 · Cited by 1
An HPSG parser based on Description Logics
Quantz, J. (1994) · International Conference on Computational Linguistics · doi:10.3115/991886.991958 · Cited by 1
Research in large vocabulary continuous speech recognition
Baker, J. M., Gillick, L., & Roth, R. (1993) · doi:10.3115/1075671.1075773 · Cited by 1
Kokkinakis, D., Ighe, A., & Malm, M. (2015) · doi:10.3115/v1/w15-0710 · Cited by 1
Automatic acquisition of Urdu nouns (along with gender and irregular plurals)
Khan, T. A. (2014) · Language Resources and Evaluation Conference (LREC) · doi:10.63317/2r5b5yyfcn2e · Cited by 1
(2014) · Data Archiving and Networked Services (DANS)
AllenNLP: A Deep Semantic Natural Language Processing Platform
Gardner, M., Grus, J., Neumann, M., et al. (2018) · arXiv · doi:10.48550/arxiv.1803.07640 · cited 2×
“In particular, we run five coreference resolution systems on our ablated data: the AI2 system (AI2; Gardner et al. 2017), hugging face (HF; Wolf 2017), which is a neural system based on spacy (Honnibal and Montani 2017), and the Stanford deterministic (SfdD; Raghunathan et al. 2010), statistical…”
MethodGender Archaeology in Native North America
Bruhns, K. O. (2006) · Handbook of Gender in Archaeology · doi:10.5040/9798216418313.ch-024
Counterfactual Data Augmentation for Mitigating Gender Stereotypes in Languages with Rich Morphology
Zmigrod, R., Mielke, S. J., Wallach, H., & Cotterell, R. (2019) · arXiv · doi:10.48550/arxiv.1906.04571 · cited 1×
“We then generate “counterfactual augmentations” of this dataset by ablating the various notions of linguistic gender described in §3.2, similar to Zmigrod et al. (2019) and Zhao et al. (2018a).”
MethodInfluentialHow to Use less Features and Reach Better Performance in Author Gender Identification
Juan Soler Company, & Wanner, L. (2014) · Proceedings of the Language Resources and Evaluation Conference · doi:10.63317/4wc2wz26gjta
Research works printed but not linked: 18
- Andrews, 2017, The singular, gender-neutral ‘they’ added to the Associated Press Stylebook
- Bagga, 1998, Algorithms for scoring coreference chains, 563
- Barocas, 2017, The problem with bias: Allocative versus representational harms in machine learning
- Bender, 2019, A typology of ethical risks in language technology with an eye towards where transparent documentation can help, The Future of Artificial Intelligence: Language, Ethics, Technology
- Blodgett, 2020, Language (technology) is power: The need to be explicit about NLP harms
- Burton, 1883, Kama Sutra, Translation
- Conrod, 2018, Changes in singular they
- Conrod, 2018, What does it mean to agree? Coreference with singular they
- Corbett, 2013, Number of genders
- Craig, 1994, Classifier languages, The Encyclopedia of Language and Linguistics, 2, 565
- Dryer, 2013, Expression of pronominal subjects
- HaNasi, 189, Mishnah bikkurim
- Mitchell, 2005, Ace 2004 multilingual training corpus, Linguistic Data Consortium, Philadelphia, 1, 1
- Ochs, 1992, Indexing gender, Rethinking Context: Language as an Interactive Phenomenon, 11, 335
- Orita, 2015, Why discourse affects speakers’ choice of referring expressions, 10.3115/v1/P15-1158 · DOI
- Silverstein, 1979, Language structure and linguistic ideology, The Elements: A Parasession on Linguistic Units and Levels, 193
- Stryker, 2008, Transgender History
- Weischedel, 2011, OntoNotes: A Large Training Corpus for Enhanced Processing
Cited by
Harms of Gender Exclusivity and Challenges in Non-Binary Representation in Language Technologies
Dev, S., Monajatipoor, M., Ovalle, A., Subramonian, A., Phillips, J., & Chang, K.-W. (2021) · Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/2021.emnlp-main.150 · Cited by 123
Ethics Sheet for Automatic Emotion Recognition and Sentiment Analysis
Mohammad, S. M. (2022) · Computational Linguistics · doi:10.1162/coli_a_00433 · Cited by 107
“See Cao and Daumé (2021) for a useful discussion on linguistic vs. social gender and also for a great example to create more inclusive data for research.”
BackgroundLee, J., Wang, J., Brown, E., Chu, L., Rodríguez, S., & Froehlich, J. E. (2024) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3613904.3642230 · Cited by 166
“Below, we describe GazePointAR’s design and implementation, starting with a taxonomy of pronoun usage drawn from linguistics literature.”
A Systematic Investigation of Commonsense Knowledge in Large Language Models
Li, X. L., Kuncoro, A., Hoffmann, J., d’Autume, C. D. M., Blunsom, P., & Nematzadeh, A. (2022) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2022.emnlp-main.812 · Cited by 133
Data Governance in the Age of Large-Scale Data-Driven Language Technology
Jernite, Y., Nguyen, H., Biderman, S., Rogers, A., Masoud, M., Danchev, V., Tan, S., Luccioni, A. S., Subramani, N., Johnson, I., et al. (2022) · 2022 ACM Conference on Fairness Accountability and Transparency · doi:10.1145/3531146.3534637 · Cited by 75
“Unsurprisingly, gendered and racial disparities have been documented in a number of language technologies [37, 79, 141], and processes of creating resources and technologies may further entrench such disparities [25, 38, 144].”
Background
Metadata
- Authors
- Cao, Y. T., & Daumé, H.
- Affiliations
- University of Maryland, College Park (US)
- Microsoft Research, University of Maryland. me@hal3.name
- Corresponding author
- Cao, Yang Trista
- Daumé, Hal
- Venue
- Computational Linguistics
- Publisher
- MIT Press - Journals
- Published
- 2021-11
- Volume
- 47
- Issue
- 3
- Pages
- 615-661
- ISSN
- 0891-2017 (ISSN-L)
- 1530-9312
- OpenAlex
- W3178522238
- Cited by
- 47
- References
- 319
- Citations by year
- 2026: 3 · 2025: 10 · 2024: 7 · 2023: 14 · 2022: 12 · 2021: 1
- FWCI
- 10.64
- Type
- journal article
- Language
- en
- Open access
- diamond
- doi.org
- Licence
- Locations
- Computational Linguistics (publishedVersion, cc-by-nc-nd)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Ethics and Social Impacts of AI
- Physical Sciences › Computer Science › Artificial Intelligence › Natural Language Processing Techniques
- Social Sciences › Gender Studies › Gender Studies in Language
- Keywords
- coreference resolution, gender bias, trans and non-binary people, stereotyping, machine learning pipelines
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.