Transgender-inclusive measures of sex/gender for population surveys: Mixed-methods evaluation and recommendations
Open accessThe DOI matches its Crossref record; 30 of the 30 references it cites were found in a registry or an index.
Abstract
Given that an estimated 0.6% of the U.S. population is transgender (trans) and that large health disparities for this population have been documented, government and research organizations are increasingly expanding measures of sex/gender to be trans inclusive. Options suggested for trans community surveys, such as expansive check-all-that-apply gender identity lists and write-in options that offer maximum flexibility, are generally not appropriate for broad population surveys. These require limited questions and a small number of categories for analysis. Limited evaluation has been undertaken of trans-inclusive population survey measures for sex/gender, including those currently in use. Using an internet survey and follow-up of 311 participants, and cognitive interviews from a maximum-diversity sub-sample (n = 79), we conducted a mixed-methods evaluation of two existing measures: a two-step question developed in the United States and a multidimensional measure developed in Canada. We found very low levels of item missingness, and no indicators of confusion on the part of cisgender (non-trans) participants for both measures. However, a majority of interview participants indicated problems with each question item set. Agreement between the two measures in assessment of gender identity was very high (K = 0.9081), but gender identity was a poor proxy for other dimensions of sex or gender among trans participants. Issues to inform measure development or adaptation that emerged from analysis included dimensions of sex/gender measured, whether non-binary identities were trans, Indigenous and cultural identities, proxy reporting, temporality concerns, and the inability of a single item to provide a valid measure of sex/gender. Based on this evaluation, we recommend that population surveys meant for multi-purpose analysis consider a new Multidimensional Sex/Gender Measure for testing that includes three simple items (one asked only of a small sub-group) to assess gender identity and lived gender, with optional additions. We provide considerations for adaptation of this measure to different contexts.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Figures
![Fig 1 Multidimensional test measure [4].](https://figures.cochat.ai/paper-figures/bf255c4ddf694f539d7b81fa50130b07/transgender-inclusive-measures-of-sex-gender-for-population-surveys-mixed-figure-1.jpg)
![Fig 2 Two-step gender identity test measure [24].](https://figures.cochat.ai/paper-figures/df699393fe4044ed939dff615c90dfbc/transgender-inclusive-measures-of-sex-gender-for-population-surveys-mixed-figure-2.jpg)


Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Other studies suggest that while most trans people are willing to disclose their trans identity in government health research, they have concerns regarding question wording and intent (Bauer et al., 2017; Holzberg et al., 2017).”
From Willingness to disclose sexual orientation and gender identity on federal government surveys: A community-based research study with gay, bisexual, transgender, and queer men and nonbinary and Two-Spirit people in Canada (2026) · cites this paper as Bauer et al., 2017
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Mapping the Margins: Intersectionality, Identity Politics, and Violence against Women of Color
Crenshaw, K. (1991) · Stanford Law Review · doi:10.2307/1229039 · Cited by 32,792
Losh-Hesselbart, S., & Fowler, F. J. (1985) · Journal of the American Statistical Association · doi:10.2307/2288598 · Cited by 4,764
Injustice at Every Turn: A Report of the National Transgender Discrimination Survey
Grant, J. M., Motter, L. A., & Tanis, J. (2011) · Cited by 2,065
Bowleg, L. (2008) · Sex Roles · doi:10.1007/s11199-008-9400-z · Cited by 2,004
Fink, A. (2010) · International Encyclopedia of Education · doi:10.1016/b978-0-08-044894-7.00296-7 · Cited by 1,963
Global health burden and needs of transgender populations: a review
Reisner, S. L., Poteat, T., Keatley, J., Cabral, M., Mothopeng, T., Dunham, E., Holland, C. E., Max, R., & Baral, S. D. (2016) · The Lancet · doi:10.1016/s0140-6736(16)00684-x · Cited by 1,476
Dillman, D. A. (1999) · Cited by 1,161
Genders, sexes, and health: what are the connections—and why does it matter?
Krieger, N. (2003) · International Journal of Epidemiology · doi:10.1093/ije/dyg156 · Cited by 788
Cognitive interviewing: verbal data in the design and pretesting of questionnaires
Drennan, J. (2003) · Journal of Advanced Nursing · doi:10.1046/j.1365-2648.2003.02579.x · Cited by 769
How Many Adults Identify as Transgender in the United States
Flores, A. R., Herman, J. L., Gates, G. J., & Brown, T. N. T. (2016) · eScholarship (California Digital Library) · Cited by 694
Mackay, I. R. (1995) · Cited by 667
Eby, L. T. (2003) · Organizational Research Methods · doi:10.1177/109442812003006001009 · Cited by 512
Capitalist Patriarchy and the Case for Socialist Feminism.
Brown, C. A., & Eisenstein, Z. R. (1981) · Contemporary Sociology · doi:10.2307/2067871 · Cited by 432
A Two-Question Method for Assessing Gender Categories in the Social and Medical Sciences
Tate, C. C., Ledbetter, J. N., & Youssef, C. P. (2013) · Journal of Sex Research · doi:10.1080/00224499.2012.690110 · Cited by 383
Intersex and Identity: The Contested Self
Post, L. L. (2003) · JAMA: The Journal of the American Medical Association · doi:10.1001/jama.290.21.2866 · Cited by 232
Scheim, A. I., & Bauer, G. R. (2015) · The Journal of Sex Research · doi:10.1080/00224499.2014.893553 · Cited by 212
Self-citationReisner, S. L., Conron, K. J., Tardiff, L. A., Jarvi, S., Gordon, A. R., & Austin, S. B. (2014) · BMC Public Health · doi:10.1186/1471-2458-14-1224 · Cited by 197
Two-Spirit People: Native American Gender Identity, Sexuality, and Spirituality
(Lumbee), J. C. W., Jacobs, S.-E., Thomas, W., & Lang, S. (1998) · Contemporary Sociology · doi:10.2307/2654503 · Cited by 193
Reisner, S. L., Biello, K. B., Rosenberger, J. G., Austin, S. B., Haneuse, S., Perez‐Brumer, A., Novak, D. S., & Mimiaga, M. J. (2014) · Archives of Sexual Behavior · doi:10.1007/s10508-014-0314-2 · Cited by 178
Intersex and identity : the contested self
Preves, S. (2003) · Cited by 170
The Demographics of the Transgender Population
Meier, S. C., & Labuski, C. M. (2013) · International handbooks of population · doi:10.1007/978-94-007-5512-3_16 · Cited by 153
Reisner, S. L., Conron, K. J., Scout, Baker, K., Herman, J., Lombardi, E. L., Greytak, E. A., Gill, A. M., & Matthews, A. K. (2015) · TSQ Transgender Studies Quarterly · doi:10.1215/23289252-2848877 · Cited by 142
International Handbook on the Demography of Sexuality
Baumle, A. K. (2013) · International handbooks of population · doi:10.1007/978-94-007-5512-3 · Cited by 119
Two-Spirit and Bisexual People: Different Umbrella, Same Rain
Robinson, M. (2017) · Journal of Bisexuality · doi:10.1080/15299716.2016.1261266 · Cited by 89
Habarta, N., Wang, G., Mulatu, M. S., & Larish, N. (2015) · American Journal of Public Health · doi:10.2105/ajph.2015.302659 · Cited by 72
Capitalist patriarchy and the case for socialist feminism
Eisenstein, Z. (1979) · Cited by 61
The Utility of the Two-Step Gender Measure Within Trans and Cis Populations
Lombardi, E., & Banik, S. (2016) · Sexuality Research and Social Policy · doi:10.1007/s13178-016-0220-6 · Cited by 58
Mavhu, W. M., Langhaug, L. F., Manyonga, B., Power, R. M., & Cowan, F. M. (2008) · Culture Health & Sexuality · doi:10.1080/13691050801948102 · Cited by 39
Ja, S., & Beauvais, J. E. (1998) · PubMed · Cited by 34
Virginia Transgender Health Initiative Study (THIS), 2005-2006
Bradford, J. (2015) · ICPSR Data Holdings · doi:10.3886/icpsr31721 · Cited by 3
Research works printed but not linked: 1
- Jans M, Grant D, Park R, Kil J, Viana J, Lordi N, et al. Using verbal paradata monitoring and behavior coding to pilot test gender identity questions in the California Health Interview Survey: the role of qualitative and quantitative feedback. Proceedings of the American Association for Public Opinion Research Annual Conference; 2015 May 14; Hollywood (FL).
Cited by
The future of sex and gender in psychology: Five challenges to the gender binary.
Hyde, J. S., Bigler, R. S., Joel, D., Tate, C. C., & van Anders, S. M. (2019) · American Psychologist · doi:10.1037/amp0000307 · Cited by 983
Peitzmeier, S. M., Malik, M., Kattari, S. K., Marrow, E., Stephenson, R., Agénor, M., & Reisner, S. L. (2020) · American Journal of Public Health · doi:10.2105/ajph.2020.305774 · Cited by 454
Proportion of people identified as transgender and non-binary gender in Brazil
Spizzirri, G., Eufrásio, R., Lima, M. C. P., de Carvalho Nunes, H. R., Kreukels, B. P. C., Steensma, T. D., & Abdo, C. H. N. (2021) · Scientific Reports · doi:10.1038/s41598-021-81411-4 · Cited by 230
Suen, L. W., Lunn, M. R., Katuzny, K., Finn, S., Duncan, L., Sevelius, J., Flentje, A., Capriotti, M. R., Lubensky, M. E., Hunt, C., et al. (2020) · Archives of Sexual Behavior · doi:10.1007/s10508-020-01810-y · Cited by 251
“Despite this, the two-step approach has not been largely adopted in research and health surveillance studies (Bauer et al., 2017; Patterson et al., 2017; Wolff et al., 2017).”
BackgroundMethodGender (mis)measurement: Guidelines for respecting gender diversity in psychological research
Cameron, J. J., & Stinson, D. A. (2019) · Social and Personality Psychology Compass · doi:10.1111/spc3.12506 · Cited by 246
Metadata
- Authors
- Bauer, G. R., Braimoh, J., Scheim, A. I., & Dharma, C.
- Affiliations
- Western University (CA)
- Corresponding author
- Bauer, Greta R.
- Venue
- PLOS ONE
- Publisher
- Public Library of Science (PLoS)
- Published
- 2017-05-25
- Volume
- 12
- Issue
- 5
- Pages
- e0178043
- ISSN
- 1932-6203 (ISSN-L)
- PMC
- PMC5444783
- OpenAlex
- W2617133394
- Cited by
- 452
- References
- 30
- Citations by year
- 2026: 35 · 2025: 46 · 2024: 85 · 2023: 52 · 2022: 52 · 2021: 63 · 2020: 61 · 2019: 38 · 2018: 19 · 2017: 1
- FWCI
- 46.62
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- Locations
- PLoS ONE (publishedVersion, cc-by)
- Europe PMC (PubMed Central) (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- RePEc: Research Papers in Economics (submittedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Figshare (submittedVersion, cc-by)
- Funders
- Canadian Institutes of Health Research (MOP-130489)
- Topics
- Social Sciences › Psychology › Social Psychology › LGBTQ Health, Identity, and Policy
- Social Sciences › Sociology and Political Science › Survey Methodology and Nonresponse
- Social Sciences › Gender Studies › Gender and Feminist Studies
- Keywords
- transgender people, gender identity, population survey, cognitive interviewing, non-binary people, proxy reporting, health disparities, measurement development
- MeSH terms
- Adolescent, Adult, Aged, Canada, Female, Gender Identity, Humans, Male, Middle Aged, Surveys and Questionnaires, Sexual Behavior, Transsexualism, United States, Young Adult, Transgender Persons
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.