The DOI matches its Crossref record; 3 of the 3 references it cites were found in a registry or an index.
Quantifying Sex Bias in Clinical Studies at Scale With Automated Data Extraction
Open accessAbstract
Importance: Analyses of female representation in clinical studies have been limited in scope and scale. Objective: To perform a large-scale analysis of global enrollment sex bias in clinical studies. Design, Setting, and Participants: In this cross-sectional study, clinical studies from published articles from PubMed from 1966 to 2018 and records from Aggregate Analysis of ClinicalTrials.gov from 1999 to 2018 were identified. Global disease prevalence was determined for male and female patients in 11 disease categories from the Global Burden of Disease database: cardiovascular, diabetes, digestive, hepatitis (types A, B, C, and E), HIV/AIDS, kidney (chronic), mental, musculoskeletal, neoplasms, neurological, and respiratory (chronic). Machine reading algorithms were developed that extracted sex data from tables in articles and records on December 31, 2018, at an artificial intelligence research institute. Male and female participants in 43 135 articles (792 004 915 participants) and 13 165 records (12 977 103 participants) were included. Main Outcomes and Measures: Sex bias was defined as the difference between the fraction of female participants in study participants minus prevalence fraction of female participants for each disease category. A total of 1000 bootstrap estimates of sex bias were computed by resampling individual studies with replacement. Sex bias was reported as mean and 95% bootstrap confidence intervals from articles and records in each disease category over time (before or during 1993 to 2018), with studies or participants as the measurement unit. Results: There were 792 004 915 participants, including 390 470 834 female participants (49%), in articles and 12 977 103 participants, including 6 351 619 female participants (49%), in records. With studies as measurement unit, substantial female underrepresentation (sex bias ≤ -0.05) was observed in 7 of 11 disease categories, especially HIV/AIDS (mean for articles, -0.17 [95% CI, -0.18 to -0.16]), chronic kidney diseases (mean, -0.17 [95% CI, -0.17 to -0.16]), and cardiovascular diseases (mean, -0.14 [95% CI, -0.14 to -0.13]). Sex bias in articles for all categories combined was unchanged over time with studies as measurement unit (range, -0.15 [95% CI, -0.16 to -0.13] to -0.10 [95% CI, -0.14 to -0.06]), but improved from before or during 1993 (mean, -0.11 [95% CI, -0.16 to -0.05]) to 2014 to 2018 (mean, -0.05 [95% CI, -0.09 to -0.02]) with participants as the measurement unit. Larger study size was associated with greater female representation. Conclusions and Relevance: Automated extraction of the number of participants in clinical reports provides an effective alternative to manual analysis of demographic bias. Despite legal and policy initiatives to increase female representation, sex bias against female participants in clinical studies persists. Studies with more participants have greater female representation. Differences between sex bias estimates with studies vs participants as measurement unit, and between articles vs records, suggest that sex bias with both measures and data sources should be reported.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“We follow the approach of Feldman et al. (2019) in mapping the MeSH vocabulary to the disease classes.”
From SPECTER: Document-level Representation Learning using Citation-informed Transformers (2020) · cites this paper as Feldman et al., 2019
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Naghavi, M., Abajobir, A. A., Abbafati, C., Abbas, K. M., Abd-Allah, F., Abera, S. F., Aboyans, V., Adetokunboh, O., Afshin, A., Agrawal, A., et al. (2017) · The Lancet · doi:10.1016/s0140-6736(17)32152-9 · Cited by 4,821
Self-citationTiming and Completeness of Trial Results Posted at ClinicalTrials.gov and Published in Journals
Riveros, C., Dechartres, A., Perrodeau, E., Haneef, R., Boutron, I., & Ravaud, P. (2013) · PLoS Medicine · doi:10.1371/journal.pmed.1001566 · Cited by 269
Wallach, J. D., Sullivan, P. G., Trepanowski, J. F., Steyerberg, E. W., & Ioannidis, J. P. A. (2016) · BMJ · doi:10.1136/bmj.i5826 · Cited by 89
Cited by
SPECTER: Document-level Representation Learning using Citation-informed Transformers
Cohan, A., Feldman, S., Beltagy, I., Downey, D., & Weld, D. (2020) · Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics · doi:10.18653/v1/2020.acl-main.207 · Cited by 1,108
Self-citationMechanisms of sex differences in Alzheimer’s disease
Lopez-Lee, C., Torres, E. R. S., Carling, G., & Gan, L. (2024) · Neuron · doi:10.1016/j.neuron.2024.01.024 · Cited by 376
Sex as a Biological Variable: A 5-Year Progress Report and Call to Action
Arnegard, M. E., Whitten, L. A., Hunter, C., & Clayton, J. A. (2020) · Journal of Women's Health · doi:10.1089/jwh.2019.8247 · Cited by 354
Steinberg, J. R., Turner, B. E., Weeks, B. T., Magnani, C. J., Wong, B. O., Rodriguez, F., Yee, L. M., & Cullen, M. R. (2021) · JAMA Network Open · doi:10.1001/jamanetworkopen.2021.13749 · Cited by 265
An acute bout of swimming increases post-exercise energy intake in young healthy men and women
Thackray, A. E., Willis, S. A., Sherry, A. P., Clayton, D. J., Broom, D. R., Demashkieh, M., Sargeant, J. A., James, L. J., Finlayson, G., Stensel, D. J., et al. (2020) · Appetite · doi:10.1016/j.appet.2020.104785 · Cited by 13
Metadata
- Authors
- Feldman, S., Ammar, W., Lo, K., Trepman, E., van Zuylen, M., & Etzioni, O.
- Venue
- JAMA Network Open
- Publisher
- American Medical Association (AMA)
- Published
- 2019-07-03
- Volume
- 2
- Issue
- 7
- Pages
- e196700
- ISSN
- 2574-3805 (ISSN-L)
- OpenAlex
- W2954058010
- Cited by
- 177
- References
- 3
- FWCI
- 21.22
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Quantifying Sex Bias in Clinical Studies at Scale With Automated Data Extraction. https://app.cochat.ai/papers/10.1001/jamanetworkopen.2019.6700
- The paper
- Feldman, S., Ammar, W., Lo, K., Trepman, E., van Zuylen, M., & Etzioni, O. (2019). Quantifying Sex Bias in Clinical Studies at Scale With Automated Data Extraction. JAMA Network Open. https://doi.org/10.1001/jamanetworkopen.2019.6700
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.