CoChat

Variation in serum biomarkers with sex and female hormonal status: implications for clinical tests

Open access

The DOI matches its Crossref record; 68 of the 70 references it cites were found in a registry or an index.

Abstract

Few serum biomarker tests are implemented in clinical practice and recent reports raise concerns about poor reproducibility of biomarker studies. Here, we investigated the potential role of sex and female hormonal status in this widespread irreproducibility. We examined 171 serum proteins and small molecules measured in 1,676 participants from the Netherlands Study of Depression and Anxiety. Concentrations of 96 molecules varied with sex and 66 molecules varied between oral contraceptive pill users, postmenopausal females and females in the follicular and luteal phases of the menstrual cycle (FDR-adjusted p-value <0.05). Simulations of biomarker studies yielded up to 40% false discoveries when patient and control groups were not matched for sex and up to 41% false discoveries when premenopausal females were not matched for oral contraceptive pill use. High accuracy (over 90%) classification tools were developed to label samples with sex and female hormonal status where this information was not collected.

Overview

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1038/srep26947

Cites

68 of 68 references verified0 citation errors · 0 not checkable

Statistics

Figures

Figure 1 Principal component analysis (PCA) plot of NESDA discovery cohort samples. The first two principal components (PCs) are plotted and coloured according to sex and female hormonal status. PCA was performed using all analyte data. Percentage of variation accounted for by each principal component is shown in brackets with the axis label.
Figure 1 Principal component analysis (PCA) plot of NESDA discovery cohort samples. The first two principal components (PCs) are plotted and coloured according to sex and female hormonal status. PCA was performed using all analyte data. Percentage of variation accounted for by each principal component is shown in brackets with the axis label.CC BY · PubMed Central
Figure 2 Serum analytes elevated significantly in (A) females and (B) males. Robust regression was used where *follows the analyte name. The log2 ratios of serum molecular concentrations in males compared to females shown in the plots were coefficients from the linear regression. Analytes in the plots are coloured in red where sex differences varied significantly with female hormonal status. Agreement with the validation cohort and our previous study is shown by a ✓ in the last columns. NM was used to indicate that the analyte was not measured in our previous study. To the right of the plots, biomarkers of schizophrenia (SCZ), major depressive disorder (MDD), and cancer are indicated by ↑ (elevated in patients); ↓ (reduced in patients); or × (conflicting evidence for elevated and reduced levels in patients). Analyte abbreviations can be found in Supplementary Table 1.
Figure 2 Serum analytes elevated significantly in (A) females and (B) males. Robust regression was used where *follows the analyte name. The log2 ratios of serum molecular concentrations in males compared to females shown in the plots were coefficients from the linear regression. Analytes in the plots are coloured in red where sex differences varied significantly with female hormonal status. Agreement with the validation cohort and our previous study is shown by a ✓ in the last columns. NM was used to indicate that the analyte was not measured in our previous study. To the right of the plots, biomarkers of schizophrenia (SCZ), major depressive disorder (MDD), and cancer are indicated by ↑ (elevated in patients); ↓ (reduced in patients); or × (conflicting evidence for elevated and reduced levels in patients). Analyte abbreviations can be found in Supplementary Table 1.CC BY · PubMed Central
Figure 3 Serum analytes varying significantly with female hormonal status. Robust regression was used where *follows the analyte name. The log2 ratios of serum molecular concentrations of males, postmenopausal females, and females taking the oral contraceptive pill (OC) compared to females with a menstrual cycle, shown in the plot with their 95% confidence intervals, were coefficients from the linear regression. Agreement with the validation cohort is shown by a ✓ in the last column. To the right of the plot, biomarkers of schizophrenia (SCZ), major depressive disorder (MDD), and cancer are indicated by ↑ (elevated in patients); ↓ (reduced in patients); or × (conflicting evidence for elevated and reduced levels in patients). Analyte abbreviations can be found in Supplementary Table 1.
Figure 3 Serum analytes varying significantly with female hormonal status. Robust regression was used where *follows the analyte name. The log2 ratios of serum molecular concentrations of males, postmenopausal females, and females taking the oral contraceptive pill (OC) compared to females with a menstrual cycle, shown in the plot with their 95% confidence intervals, were coefficients from the linear regression. Agreement with the validation cohort is shown by a ✓ in the last column. To the right of the plot, biomarkers of schizophrenia (SCZ), major depressive disorder (MDD), and cancer are indicated by ↑ (elevated in patients); ↓ (reduced in patients); or × (conflicting evidence for elevated and reduced levels in patients). Analyte abbreviations can be found in Supplementary Table 1.CC BY · PubMed Central
Figure 4 Average percentage of analytes falsely discovered between simulated patient and control groups with varying proportions of (A) males compared to females and (B) oral contraceptive pill (OC) users compared to females with menstrual cycles. Simulations represented biomarker studies for which there were no serum molecular differences between patient and control groups. For (A,B), the composition of the control group is shown on the x-axis, while the composition of the patient group is shown by lines of varying colours. Blue lines represent simulations with more (A) males or (B) OC users in the patient group, while red lines represent simulations with more (A) females or (B) females with menstrual cycles in the patient group. The y-axis shows the average percentage of analytes falsely discovered (p < 0.05) in each simulation.
Figure 4 Average percentage of analytes falsely discovered between simulated patient and control groups with varying proportions of (A) males compared to females and (B) oral contraceptive pill (OC) users compared to females with menstrual cycles. Simulations represented biomarker studies for which there were no serum molecular differences between patient and control groups. For (A,B), the composition of the control group is shown on the x-axis, while the composition of the patient group is shown by lines of varying colours. Blue lines represent simulations with more (A) males or (B) OC users in the patient group, while red lines represent simulations with more (A) females or (B) females with menstrual cycles in the patient group. The y-axis shows the average percentage of analytes falsely discovered (p < 0.05) in each simulation.CC BY · PubMed Central
Figure 5 Classification accuracy (A) and variable importance (B) for the random forest classifiers constructed to predict sex and female hormonal status using serum analyte measurements and other covariates in the discovery cohort. Female hormonal status included oral contraceptive pill (OC) users, females with a menstrual cycle, and postmenopausal females. The two leftmost plots in (A) show accuracies for the random forest classifier constructed using all data (189 predictors), while the rightmost plot shows accuracies for the random forest classifier constructed using only the ten most important variables for classification, which are shown in (B). Variable importance was assessed by the mean decrease in the Gini impurity criterion (a measure of node purity; more details in the Supplementary Methods). Abbreviations: BP (blood pressure). Analyte abbreviations can be found in Supplementary Table 1.
Figure 5 Classification accuracy (A) and variable importance (B) for the random forest classifiers constructed to predict sex and female hormonal status using serum analyte measurements and other covariates in the discovery cohort. Female hormonal status included oral contraceptive pill (OC) users, females with a menstrual cycle, and postmenopausal females. The two leftmost plots in (A) show accuracies for the random forest classifier constructed using all data (189 predictors), while the rightmost plot shows accuracies for the random forest classifier constructed using only the ten most important variables for classification, which are shown in (B). Variable importance was assessed by the mean decrease in the Gini impurity criterion (a measure of node purity; more details in the Supplementary Methods). Abbreviations: BP (blood pressure). Analyte abbreviations can be found in Supplementary Table 1.CC BY · PubMed Central

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Show all 68 references

Research works printed but not linked: 1

  1. Guest P. C. & Bahn S. Biomarkers of Neurological and Psychiatric Disease. (Elsevier Inc., 2011).

Cited by

Metadata

Authors
Ramsey, J. M., Cooper, J. D., Penninx, B. W. J. H., & Bahn, S.
Affiliations
  • University of Cambridge (GB)
  • Amsterdam Neuroscience (NL)
Corresponding author
Ramsey, Jordan M.
Venue
Scientific Reports
Published
2016-05-31
Volume
6
Issue
1
Pages
26947-26947
ISSN
2045-2322 (ISSN-L)
OpenAlex
W2416407254
Cited by
45
References
70
Citations by year
2026: 5 · 2025: 6 · 2024: 5 · 2023: 3 · 2022: 6 · 2021: 5 · 2020: 3 · 2019: 5 · 2018: 3 · 2017: 4
FWCI
3.97
Type
journal article
Language
en
Open access
Licence
Locations
  • Scientific Reports (publishedVersion, cc-by)
  • Europe PMC (PubMed Central) (publishedVersion, cc-by)
  • PubMed Central (publishedVersion, cc-by)
  • PubMed (publishedVersion)
  • Pure Amsterdam UMC (publishedVersion, other-oa)
  • Amsterdam UMC (VU Amsterdam) - Institutional Repository (publishedVersion)
  • EUR Research Repository (Erasmus University Rotterdam) (publishedVersion)
  • EUR Research Repository (Erasmus University Rotterdam) (submittedVersion)
  • Data Archiving and Networked Services (DANS) (submittedVersion)
Funders
  • Stanley Medical Research Institute
  • European Commission (286334)
  • Universiteit Leiden (10‐000‐1002)
  • ZonMw (10‐000‐1002)
  • Vrije Universiteit Amsterdam
  • GGZ inGeest
  • Rivierduinen
  • GGZ Friesland
  • GGZ Drenthe
  • Nederlands Instituut voor Onderzoek van de Gezondheidszorg (10-000-1002)
  • Trimbos-instituut
  • Cambridge Commonwealth Trust
  • Leids Universitair Medisch Centrum
  • Universitair Medisch Centrum Groningen
Topics
  • Health Sciences › Medicine › Public Health, Environmental and Occupational Health › Sex and Gender in Healthcare
  • Health Sciences › Health Professions › Medical Laboratory Technology › Clinical Laboratory Practices and Quality Control
  • Life Sciences › Biochemistry, Genetics and Molecular Biology › Molecular Biology › Metabolomics and Mass Spectrometry Studies
Keywords
serum biomarkers, sex differences, menstrual cycle, oral contraceptive use, postmenopausal women, biomarker reproducibility, false discovery rate, sample classification, anxiety and depression
MeSH terms
Adolescent, Adult, Aged, Anxiety Disorders, Contraceptives, Oral, Hormonal, Major Depressive Disorder, False Positive Reactions, Female, Humans, Male, Menstrual Cycle, Middle Aged, Netherlands, Sex Factors, Gonadal Steroid Hormones, Reproducibility of Results, Biomarkers, Case-Control Studies, Premenopause, Clinical Chemistry Tests

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.