Doubly blind: a systematic review of gender in randomised controlled trials
Open accessThe DOI matches its Crossref record; 21 of the 21 references it cites were found in a registry or an index.
Abstract
BACKGROUND: Although observational data show social characteristics such as gender or socio-economic status to be strong predictors of health, their impact is seldom investigated in randomised controlled studies (RCTs). OBJECTIVE & DESIGN: Using a random sample of recent RCTs from high-impact journals, we examined how the most often recorded social characteristic, sex/gender, is considered in design, analysis, and interpretation. Of 712 RCTs published from September 2008 to 31 December 2013 in the Annals of Internal Medicine, British Medical Journal, Lancet, Canadian Medical Association Journal, or New England Journal of Medicine, we randomly selected 57 to analyse funding, methods, number of centres, documentation of social circumstances, inclusion/exclusion criteria, proportions of women/men, and reporting about sex/gender in analyses and discussion. RESULTS: Participants' sex was recorded in most studies (52/57). Thirty-nine percent included men and women approximately equally. Overrepresentation of men in 43% of studies without explicit exclusions for women suggested interference in selection processes. The minority of studies that did analyse sex/gender differences (22%) did not discuss or reflect upon these, or dismissed significant findings. Two studies reinforced traditional beliefs about women's roles, finding no impact of breastfeeding on infant health but nevertheless reporting possible benefits. Questionable methods such as changing protocols mid-study, having undefined exclusion criteria, allowing local researchers to remove participants from studies, and suggesting possible benefit where none was found were evident, particularly in industry-funded research. CONCLUSIONS: Social characteristics like sex/gender remain hidden from analyses and interpretation in RCTs, with loss of information and embedding of error all along the path from design to interpretation, and therefore, to uptake in clinical practice. Our results suggest that to broaden external validity, in particular, more refined trial designs and analyses that account for sex/gender and other social characteristics are needed.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
2 retracted
RETRACTED: Primary Prevention of Cardiovascular Disease with a Mediterranean Diet
Estruch, R., Ros, E., Salas-Salvadó, J., Covas, M.-I., Corella, D., Arós, F., Gómez-Gracia, E., Ruiz-Gutiérrez, V., Fiol, M., Lapetra, J., et al. (2013) · New England Journal of Medicine · doi:10.1056/nejmoa1200303 · Cited by 4,257
RetractedEstruch, R., Ros, E., Salas-Salvadó, J., Covas, M.-I., Corella, D., Arós, F., Gómez-Gracia, E., Ruiz-Gutiérrez, V., Fiol, M., Lapetra, J., et al. (2018) · New England Journal of Medicine · doi:10.1056/nejmc1806491 · Cited by 1,008
RetractedIncreased Survival in Pancreatic Cancer with nab-Paclitaxel plus Gemcitabine
Von Hoff, D. D., Ervin, T., Arena, F. P., Chiorean, E. G., Infante, J., Moore, M., Seay, T., Tjulandin, S. A., Ma, W. W., Saleh, M. N., et al. (2013) · New England Journal of Medicine · doi:10.1056/nejmoa1304369 · Cited by 6,712 · cited 2×
“In treatment trials for endocarditis (42) or pancreatic cancer (69), sex/gender as a determinant or an effect modifier seemed unlikely.”
BackgroundConstructions of masculinity and their influence on men's well-being: a theory of gender and health
Courtenay, W. H. (2000) · Social Science & Medicine · doi:10.1016/s0277-9536(99)00390-1 · Cited by 4,091
Alpha Emitter Radium-223 and Survival in Metastatic Prostate Cancer
Parker, C., Nilsson, S., Heinrich, D., Helle, S. I., O'Sullivan, J. M., Fosså, S. D., Chodacki, A., Wiechno, P., Logue, J., Seke, M., et al. (2013) · New England Journal of Medicine · doi:10.1056/nejmoa1213755 · Cited by 3,408
Alogliptin after acute coronary syndrome in patients with type 2 diabetes
White, W. B., Cannon, C. P., Heller, S. R., Nissen, S. E., Bergenstal, R. M., Bakris, G. L., Perez, A. T., Fleck, P. R., Mehta, C. R., Kupfer, S., et al. (2013) · New England Journal of Medicine · doi:10.1056/nejmoa1305889 · Cited by 2,502
Targeting BTK with Ibrutinib in Relapsed Chronic Lymphocytic Leukemia
Byrd, J. C., Furman, R. R., Coutre, S. E., Flinn, I. W., Burger, J. A., Blum, K. A., Grant, B., Sharman, J. P., Coleman, M., Wierda, W. G., et al. (2013) · New England Journal of Medicine · doi:10.1056/nejmoa1215637 · Cited by 2,270
Panitumumab–FOLFOX4 Treatment and RAS Mutations in Colorectal Cancer
Douillard, J.-Y., Oliner, K. S., Siena, S., Tabernero, J., Burkes, R., Barugel, M., Humblet, Y., Bodoky, G., Cunningham, D., Jassem, J., et al. (2013) · New England Journal of Medicine · doi:10.1056/nejmoa1305275 · Cited by 2,263 · cited 1×
“Douillard (industry) (32) Comparison of new and conventional treatments for colorectal cancer based on genetic markers Outcomes were associated with presence of gene mutations N 620 Women 30% Age 18 Documented race, ethnicity Elkenboom (industry) (33) Comparison of dabigatran and warfarin in patients with mechanical h…”
BackgroundUnpacking the Gender System: A Theoretical Perspective on Gender Beliefs and Social Relations
Ridgeway, C. L., & Correll, S. J. (2004) · Gender & Society · doi:10.1177/0891243204265269 · Cited by 1,823
Retinoic Acid and Arsenic Trioxide for Acute Promyelocytic Leukemia
Lo-Coco, F., Avvisati, G., Vignetti, M., Thiede, C., Orlando, S. M., Iacobelli, S., Ferrara, F., Fazi, P., Cicconi, L., Di Bona, E., et al. (2013) · New England Journal of Medicine · doi:10.1056/nejmoa1300874 · Cited by 1,611 · cited 1×
“Lo-Coco (primarily public, drugs donated by industry) (49) Comparison of two drug regimens to treat promyelocytic leukaemia New drug treatment was no better than old treatment N 156 Women 51% Reported as non-inferior”
BackgroundDabigatran versus warfarin in patients with mechanical heart valves
Eikelboom, J. W., Connolly, S. J., Brueckmann, M., Granger, C. B., Kappetein, A. P., Mack, M. J., Blatchford, J., Devenny, K., Friedman, J., Guiver, K., et al. (2013) · New England Journal of Medicine · doi:10.1056/nejmoa1300615 · Cited by 1,506
A Phase 3 Trial of Semagacestat for Treatment of Alzheimer's Disease
Doody, R. S., Raman, R., Farlow, M., Iwatsubo, T., Vellas, B., Joffe, S., Kieburtz, K., He, F., Sun, X., Thomas, R. G., et al. (2013) · New England Journal of Medicine · doi:10.1056/nejmoa1210951 · Cited by 1,224
Lenalidomide plus Dexamethasone for High-Risk Smoldering Multiple Myeloma
Mateos, M.-V., Hernández, M.-T., Giraldo, P., de la Rubia, J., de Arriba, F., Corral, L. L., Rosiñol, L., Paiva, B., Palomera, L., Bargay, J., et al. (2013) · New England Journal of Medicine · doi:10.1056/nejmoa1300439 · Cited by 1,171 · cited 2×
“In five papers, for example, there were unclear reasons for exclusions or high numbers of unexplained dropouts among those already enrolled (24, 30, 44, 52, 55).”
BackgroundEarly Surgery versus Conventional Treatment for Infective Endocarditis
Kang, D.-H., Kim, Y.-J., Kim, S.-H., Sun, B. J., Kim, D.-H., Yun, S.-C., Song, J.-M., Choo, S. J., Chung, C.-H., Song, J.-K., et al. (2012) · New England Journal of Medicine · doi:10.1056/nejmoa1112843 · Cited by 902
Prasugrel versus clopidogrel for acute coronary syndromes without revascularization
Roe, M. T., Armstrong, P. W., Fox, K. A. A., White, H. D., Prabhakaran, D., Goodman, S. G., Cornel, J. H., Bhatt, D. L., Clemmensen, P., Martinez, F., et al. (2012) · New England Journal of Medicine · doi:10.1056/nejmoa1205512 · Cited by 874
Inclusion: The Politics of Difference in Medical Research
Epstein, S. (2007) · doi:10.7208/chicago/9780226213118.001.0001 · Cited by 792
Chakravarthy, U., Harding, S. P., Rogers, C. A., Downes, S. M., Lotery, A. J., Culliford, L. A., & Reeves, B. C. (2013) · The Lancet · doi:10.1016/s0140-6736(13)61501-9 · Cited by 748 · cited 1×
“Byrd (industry) (24) Comparison of two doses of a drug to treat CLL Outcome described drug as effective but without a control group N 85 Women 24% Protocol changed during study Preponderance of men 34% attrition from study unclear if they dropped out or were removed or whether they were included in analyses Endpoints…”
BackgroundGriffin, S. J., Borch-Johnsen, K., Davies, M. J., Khunti, K., Rutten, G. E., Sandbæk, A., Sharp, S. J., Simmons, R. K., van den Donk, M., Wareham, N. J., et al. (2011) · The Lancet · doi:10.1016/s0140-6736(11)60698-3 · Cited by 462
Soofi, S., Cousens, S., Iqbal, S. P., Akhund, T., Khan, J., Ahmed, I., Zaidi, A. K., & Bhutta, Z. A. (2013) · The Lancet · doi:10.1016/s0140-6736(13)60437-7 · Cited by 330 · cited 1×
“Soofi (NGO/ industry) (66) Can 1 year of zinc or micronutrients improve growth and limit infection and diarrhoea in infants Supplementing with zinc decreased Fe deficiency anaemia but increased side effects N 2,746 Sex unspecified Documented water source, sewage system, household income Could have considered whether g…”
BackgroundThe effect of patients' sex on physicians' recommendations for total knee arthroplasty
Borkhoff, C. M., Hawker, G. A., Kreder, H. J., Glazier, R. H., Mahomed, N. N., & Wright, J. G. (2008) · Canadian Medical Association Journal · doi:10.1503/cmaj.071168 · Cited by 254
Sex differences in type 2 diabetes: focus on disease course and outcomes
Arnetz, L., Rajamand Ekberg, N., & Alvarsson, M. (2014) · Diabetes, Metabolic Syndrome and Obesity: Targets and Therapy · doi:10.2147/dmso.s51301 · Cited by 175 · cited 1×
“Significant sex/gender differences have been well documented with respect to, for example, heart diseases (11) and type 2 diabetes (12).”
Background
Cited by
Gender inequality and restrictive gender norms: Framing the challenges to health
Heise, L., Greene, M. E., Opper, N., Stavropoulou, M., Harper, C., Nascimento, M., Zewdie, D., Darmstadt, G. L., Greene, M. E., Hawkes, S., et al. (2019) · The Lancet · doi:10.1016/s0140-6736(19)30652-x · Cited by 1,163
Integrating and evaluating sex and gender in health research
Day, S., Mason, R., Lagosky, S., & Rochon, P. A. (2016) · Health Research Policy and Systems · doi:10.1186/s12961-016-0147-7 · Cited by 107
“or gender and other variables of interest in the study [21].”
BackgroundGruer, C., Hopper, K., Smith, R. C., Kelly, E., Maroko, A., & Sommer, M. (2021) · Reproductive Health · doi:10.1186/s12978-021-01133-8 · Cited by 46
Cultural sexism moderates efficacy of psychotherapy: Results from a spatial meta-analysis.
Price, M. A., McKetta, S., Weisz, J. R., Ford, J. V., Lattanner, M. R., Skov, H., Wolock, E., & Hatzenbuehler, M. L. (2021) · Clinical Psychology: Science and Practice · doi:10.1037/cps0000031 · Cited by 29
Metadata
- Authors
- Phillips, S. P., & Hamberg, K.
- Venue
- Global Health Action
- Publisher
- Informa UK Limited
- Published
- 2016-04-15
- Volume
- 9
- Issue
- 1
- Pages
- 29597
- ISSN
- 1654-9716 (ISSN-L)
- 1654-9880
- OpenAlex
- W2342115601
- Cited by
- 155
- References
- 21
- FWCI
- 4.32
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.