RtGender: A Corpus for Studying Differential Responses to Gender
Open accessThe DOI matches its OpenAlex record; 6 of the 6 references it cites were found in a registry or an index.
Abstract
Like many social variables, gender pervasively influences how people communicate with one another.However, prior computational work has largely focused on linguistic gender difference and communications about gender, rather than communications directed to people of that gender, in part due to lack of data.Here, we fill a critical need by introducing a multi-genre corpus of more than 25M comments from five socially and topically diverse sources tagged for the gender of the addressee.Using these data, we describe pilot studies on how differential responses to gender can be measured and analyzed and present 30k annotations for the sentiment and relevance of these responses, showing that across our datasets responses to women are more likely to be emotive and about the speaker as an individual (rather than about the content being responded to).Our dataset enables studying socially important questions like gender bias, and has potential uses for downstream applications such as dialogue systems, gender detection or obfuscation, and debiasing language generation.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
The Ambivalent Sexism Inventory: Differentiating hostile and benevolent sexism.
Glick, P., & Fiske, S. T. (1996) · Journal of Personality and Social Psychology · doi:10.1037//0022-3514.70.3.491 · Cited by 5,202
Stereotype Threat and Women's Math Performance
Spencer, S. J., Steele, C. M., & Quinn, D. M. (1999) · Journal of Experimental Social Psychology · doi:10.1006/jesp.1998.1373 · Cited by 3,435 · cited 1×
“Nevertheless, biased responses to social categories like gender can lead to marginalization (Sue, 2010) and negatively impact a person’s self-esteem and ability through mechanisms such as stereotype threat (Spencer et al., 1999).”
BackgroundLakoff, R. (1973) · Language in Society · doi:10.1017/s0047404500000051 · Cited by 3,138 · cited 1×
“Gender is a performative social phenomenon in which individual behavior is often shaped – subtly, over a lifetime – by the responses to that behavior (Lakoff, 1973; Butler, 1990).”
BackgroundGender Stereotypes and Attitudes Toward Women and Men
Eagly, A. H., & Mladinic, A. (1989) · Personality and Social Psychology Bulletin · doi:10.1177/0146167289154008 · Cited by 785 · cited 1×
“Social issues like gender bias are often not just about hostility but also behaviors such as stereotype-reinforcing benevo-lence (Eagly and Mladinic, 1989; Glick and Fiske, 1996 Jha and Mamidi, 2017).”
BackgroundImplicit social cognition: from measures to mechanisms
Nosek, B. A., Hawkins, C. B., & Frazier, R. S. (2011) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2011.01.005 · Cited by 578 · cited 1×
“…Megyn Kelly) or inappropriate comments about physical appearances (“wow she is very sexy...”-TED comment to researcher Rachel Botsman); however, the larger problem is a subtle one in part because much of social bias is also not overt but rather implicit (Greenwald et al., 1985; Nosek et al., 2011).”
BackgroundMonroe, B. L., Colaresi, M. P., & Quinn, K. M. (2008) · Political Analysis · doi:10.1093/pan/mpn018 · Cited by 542
Cited by
On the Dangers of Stochastic Parrots: Can Language Models Be Too Big? 🦜
Bender, E. M., Gebru, T., McMillan-Major, A., & Shmitchell, S. (2021) · Proceedings of the 2021 ACM Conference on Fairness, Accountability, and Transparency · doi:10.1145/3442188.3445922 · Cited by 6,988
On the Opportunities and Risks of Foundation Models
Bommasani, R., Hudson, D. A., Adeli, E., Altman, R., Arora, S., von Arx, S., Bernstein, M. S., Bohg, J., Bosselut, A., Brunskill, E., et al. (2021) · arXiv · doi:10.48550/arxiv.2108.07258 · Cited by 2,676
Self-citationStyle transfer through back-translation
Prabhumoye, S., Tsvetkov, Y., Salakhutdinov, R., & Black, A. W. (2018) · Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.18653/v1/p18-1080 · Cited by 348
“Our second dataset is comprised of top-level comments on Facebook posts from all 412 current members of the United States Senate and House who have public Facebook pages (Voigt et al., 2018).”
BackgroundSelf-citationSocial Biases in NLP Models as Barriers for Persons with Disabilities
Hutchinson, B., Prabhakaran, V., Denton, E., Webster, K., Zhong, Y., & Denuyl, S. (2020) · Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics · doi:10.18653/v1/2020.acl-main.487 · Cited by 274
Self-citationSocial Biases in NLP Models as Barriers for Persons with Disabilities
Hutchinson, B., Prabhakaran, V., Denton, E., Webster, K., Zhong, Y., & Denuyl, S. (2020) · arXiv · doi:10.48550/arxiv.2005.00813 · Cited by 274
“We perform this method on a set of 1000 sentences extracted at random from the Reddit sub- 2Future work will see how to include non-binary pronouns. corpus of (Voigt et al., 2018).”
MethodSelf-citation
Metadata
- Authors
- Voigt, R., Jurgens, D., Prabhakaran, V., Jurafsky, D., & Tsvetkov, Y.
- Venue
- Language Resources and Evaluation Conference (LREC)
- Published
- 2018-05-01
- Pages
- 2814-2820
- OpenAlex
- W2805572053
- Cited by
- 49
- References
- 6
- FWCI
- 2.91
- Type
- conference paper
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: RtGender: A Corpus for Studying Differential Responses to Gender. https://app.cochat.ai/papers/10.63317/3di79eiki43x
- The paper
- Voigt, R., Jurgens, D., Prabhakaran, V., Jurafsky, D., & Tsvetkov, Y. (2018). RtGender: A Corpus for Studying Differential Responses to Gender. Language Resources and Evaluation Conference (LREC). https://doi.org/10.63317/3di79eiki43x
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.