Variation in serum biomarkers with sex and female hormonal status: implications for clinical tests
Open accessThe DOI matches its Crossref record; 68 of the 70 references it cites were found in a registry or an index.
Abstract
Few serum biomarker tests are implemented in clinical practice and recent reports raise concerns about poor reproducibility of biomarker studies. Here, we investigated the potential role of sex and female hormonal status in this widespread irreproducibility. We examined 171 serum proteins and small molecules measured in 1,676 participants from the Netherlands Study of Depression and Anxiety. Concentrations of 96 molecules varied with sex and 66 molecules varied between oral contraceptive pill users, postmenopausal females and females in the follicular and luteal phases of the menstrual cycle (FDR-adjusted p-value <0.05). Simulations of biomarker studies yielded up to 40% false discoveries when patient and control groups were not matched for sex and up to 41% false discoveries when premenopausal females were not matched for oral contraceptive pill use. High accuracy (over 90%) classification tools were developed to label samples with sex and female hormonal status where this information was not collected.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Figures





Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Controlling the False Discovery Rate: A Practical and Powerful Approach to Multiple Testing
Benjamini, Y., & Hochberg, Y. (1995) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1995.tb02031.x · Cited by 109,482
Gene Ontology: tool for the unification of biology
Ashburner, M., Ball, C. A., Blake, J. A., Botstein, D., Butler, H., Cherry, J. M., Davis, A. P., Dolinski, K., Dwight, S. S., Eppig, J. T., et al. (2000) · Nature Genetics · doi:10.1038/75556 · Cited by 43,206
Classification and Regression by randomForest
Liaw, A. I., & Wiener, M. C. (2007) · Cited by 18,594
Adjusting batch effects in microarray expression data using empirical Bayes methods
Johnson, W. E., Li, C., & Rabinovic, A. (2007) · Biostatistics · doi:10.1093/biostatistics/kxj037 · Cited by 8,658
Leek, J. T., Johnson, W. E., Parker, H. S., Jaffe, A. E., & Storey, J. D. (2012) · Bioinformatics · doi:10.1093/bioinformatics/bts034 · Cited by 6,231
Targeting Hypoxia-Inducible Factors for the Treatment of Anemia in Chronic Kidney Disease Patients
Locatelli, F., Fishbane, S., Block, G. A., & Macdougall, I. C. (2017) · American Journal of Nephrology · doi:10.1159/000455166 · Cited by 4,813
Clinical application of C-reactive protein for cardiovascular disease detection and prevention
Ridker, P. M. (2003) · Circulation · doi:10.1161/01.cir.0000053730.47739.3c · Cited by 2,513
Cross-national epidemiology of DSM-IV major depressive episode
Bromet, E., Andrade, L. H., Hwang, I., Sampson, N. A., Alonso, J., de Girolamo, G., de Graaf, R., Demyttenaere, K., Hu, C., Iwata, N., et al. (2011) · BMC Medicine · doi:10.1186/1741-7015-9-90 · Cited by 2,221
Effect of oestrogen during menopause on risk and age at onset of Alzheimer's disease
Tang, M.-X., Jacobs, D., Stern, Y., Marder, K., Schofield, P., Gurland, B., Andrews, H., & Mayeux, R. (1996) · The Lancet · doi:10.1016/s0140-6736(96)03356-9 · Cited by 1,647
Roles of matrix metalloproteinases in cancer progression and their pharmacological targeting
Gialeli, C., Theocharis, A. D., & Karamanos, N. K. (2011) · The FEBS Journal · doi:10.1111/j.1742-4658.2010.07919.x · Cited by 1,607
The Emergence of the Metabolic Syndrome with Menopause
Carr, M. C. (2003) · The Journal of Clinical Endocrinology & Metabolism · doi:10.1210/jc.2003-030242 · Cited by 1,449
Role of the Insulin-Like Growth Factor Family in Cancer Development and Progression
Yu, H. (2000) · Journal of the National Cancer Institute · doi:10.1093/jnci/92.18.1472 · Cited by 1,424
Goel, H. L., & Mercurio, A. M. (2013) · Nature Reviews Cancer · doi:10.1038/nrc3627 · Cited by 1,253
Biomarkers of Cardiovascular Disease: Molecular Basis and Practical Considerations
Vasan, R. S. (2006) · Circulation · doi:10.1161/circulationaha.104.482570 · Cited by 1,212
The X-files in immunity: sex-based differences predispose immune responses
Fish, E. N. (2008) · Nature Reviews Immunology · doi:10.1038/nri2394 · Cited by 1,162
Molecular and Cellular Basis of Cardiovascular Gender Differences
Mendelsohn, M. E., & Karas, R. H. (2005) · Science · doi:10.1126/science.1112062 · Cited by 1,101
The Netherlands Study of Depression and Anxiety (NESDA): rationale, objectives and methods
Penninx, B. W. J. H., Beekman, A. T. F., Smit, J. H., Zitman, F. G., Nolen, W. A., Spinhoven, P., Cuijpers, P., De Jong, P. J., Van Marwijk, H. W. J., Assendelft, W. J. J., et al. (2008) · International Journal of Methods in Psychiatric Research · doi:10.1002/mpr.256 · Cited by 927
Self-citationSex differences in schizophrenia, a review of the literature
Leung M.D., D. A., & Chue M. R. C. Psych., D. P. (2000) · Acta Psychiatrica Scandinavica · doi:10.1111/j.0065-1591.2000.0ap25.x · Cited by 748
Functional Cross‐Talk Between the Hypothalamic‐Pituitary‐Gonadal and ‐Adrenal Axes
Viau, V. (2002) · Journal of Neuroendocrinology · doi:10.1046/j.1365-2826.2002.00798.x · Cited by 744
Arnold, A. P. (2009) · Hormones and Behavior · doi:10.1016/j.yhbeh.2009.03.011 · Cited by 625
Power, M. L., & Schulkin, J. (2008) · British Journal of Nutrition · doi:10.1017/s0007114507853347 · Cited by 605
Poste, G. (2011) · Nature · doi:10.1038/469156a · Cited by 582
Sex Differences in Pharmacokinetics and Pharmacodynamics
Gandhi, M., Aweeka, F., Greenblatt, R. M., & Blaschke, T. F. (2004) · Annual Review of Pharmacology and Toxicology · doi:10.1146/annurev.pharmtox.44.101802.121453 · Cited by 542
Gender Differences in Cancer Susceptibility: An Inadequately Addressed Issue
Dorak, M. T., & Karpuzoglu, E. (2012) · Frontiers in Genetics · doi:10.3389/fgene.2012.00268 · Cited by 493
Serum protein markers for early detection of ovarian cancer
Mor, G., Visintin, I., Lai, Y., Zhao, H., Schwartz, P., Rutherford, T., Yue, L., Bray-Ward, P., & Ward, D. C. (2005) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0502178102 · Cited by 482
Menopause and cardiovascular disease: the evidence
Rosano, G. M. C., Vitale, C., Marazzi, G., & Volterrani, M. (2007) · Climacteric · doi:10.1080/13697130601114917 · Cited by 470
Biologic and therapeutic role of HER2 in cancer
Ménard, S., Pupa, S. M., Campiglio, M., & Tagliabue, E. (2003) · Oncogene · doi:10.1038/sj.onc.1206779 · Cited by 432
Non-genomic actions of sex steroid hormones
Simoncini, T., & Genazzani, A. (2003) · European Journal of Endocrinology · doi:10.1530/eje.0.1480281 · Cited by 368
A list of candidate cancer biomarkers for targeted proteomics.
Polanski, M., & Anderson, N. L. (2007) · PubMed Central · Cited by 350
Drucker, E., & Krapfenbauer, K. (2013) · EPMA Journal · doi:10.1186/1878-5085-4-7 · Cited by 349
Domenici, E., Willé, D. R., Tozzi, F., Prokopenko, I., Miller, S., McKeown, A., Brittain, C., Rujescu, D., Giegling, I., Turck, C. W., et al. (2010) · PLoS ONE · doi:10.1371/journal.pone.0009166 · Cited by 347
Serum levels of C‐reactive protein in Crohn's disease and ulcerative colitis
FAGAN, E. A., DYCK, R. F., MATON, P. N., HODGSON, H. J. F., CHADWICK, V. S., PETRIE, A., & PEPYS, M. B. (1982) · European Journal of Clinical Investigation · doi:10.1111/j.1365-2362.1982.tb02244.x · Cited by 311
Suárez-Fariñas, M., Li, K., Fuentes-Duculan, J., Hayden, K., Brodmerkel, C., & Krueger, J. G. (2012) · Journal of Investigative Dermatology · doi:10.1038/jid.2012.184 · Cited by 305
Sex Hormones and Risk of Liver Tumor
GIANNITRAPANI, L., SORESI, M., LA SPADA, E., CERVELLO, M., D'ALESSANDRO, N., & MONTALTO, G. (2006) · Annals of the New York Academy of Sciences · doi:10.1196/annals.1386.044 · Cited by 298
The Risk of Oral Contraceptives in the Etiology of Inflammatory Bowel Disease: A Meta-Analysis
Cornish, J. A., Tan, E., Simillis, C., Clark, S. K., Teare, J., & Tekkis, P. P. (2008) · The American Journal of Gastroenterology · doi:10.1111/j.1572-0241.2008.02064.x · Cited by 297
Li, Y., Ye, X., Tan, C., Hongo, J. A., Zha, J., Liu, J., Kallop, D., Ludlam, M. J. C., & Pei, L. (2009) · Oncogene · doi:10.1038/onc.2009.212 · Cited by 288
Hannaford, P. C., Iversen, L., Macfarlane, T. V., Elliott, A. M., Angus, V., & Lee, A. J. (2010) · BMJ · doi:10.1136/bmj.c927 · Cited by 243
HER3 Overexpression and Survival in Solid Tumors: A Meta-analysis
Ocana, A., Vera-Badillo, F., Seruga, B., Templeton, A., Pandiella, A., & Amir, E. (2013) · JNCI: Journal of the National Cancer Institute · doi:10.1093/jnci/djs501 · Cited by 225
Identification of a biological signature for schizophrenia in serum
Schwarz, E., Guest, P. C., Rahmoune, H., Harris, L. W., Wang, L., Leweke, F. M., Rothermundt, M., Bogerts, B., Koethe, D., Kranaster, L., et al. (2012) · Molecular Psychiatry · doi:10.1038/mp.2011.42 · Cited by 222
Self-citationFröhlich, H., Speer, N., Poustka, A., & Beißbarth, T. (2007) · BMC Bioinformatics · doi:10.1186/1471-2105-8-166 · Cited by 220
Detection of Rheumatoid Arthritis–Interstitial Lung Disease Is Enhanced by Serum Biomarkers
Doyle, T. J., Patel, A. S., Hatabu, H., Nishino, M., Wu, G., Osorio, J. C., Golzarri, M. F., Traslosheros, A., Chu, S. G., Frits, M. L., et al. (2015) · American Journal of Respiratory and Critical Care Medicine · doi:10.1164/rccm.201411-1950oc · Cited by 215
robustbase: Basic Robust Statistics
Maechler, M., Todorov, V., Ruckstuhl, A., Salibian-Barrera, M., Koller, M., & Conceicao, E. L. T. (2006) · CRAN: Contributed Packages · doi:10.32614/cran.package.robustbase · Cited by 190
Enroth, S., Johansson, Å., Enroth, S. B., & Gyllensten, U. (2014) · Nature Communications · doi:10.1038/ncomms5684 · Cited by 182
Mucosal Barrier in Ulcerative Colitis and Crohn’s Disease
Dorofeyev, A. E., Vasilenko, I. V., Rassokhina, O. A., & Kondratiuk, R. B. (2013) · Gastroenterology Research and Practice · doi:10.1155/2013/431231 · Cited by 171
Keyes, K. M., Cheslack-Postava, K., Westhoff, C., Heim, C. M., Haloossim, M., Walsh, K., & Koenen, K. (2013) · American Journal of Epidemiology · doi:10.1093/aje/kwt188 · Cited by 162
Schwarz, E., Izmailov, R., Spain, M., Barnes, A., Mapes, J. P., Guest, P. C., Rahmoune, H., Pietsch, S., Leweke, F. M., Rothermundt, M., et al. (2010) · Biomarker Insights · doi:10.4137/bmi.s4877 · Cited by 160
Self-citationGuest, P. C., Schwarz, E., Krishnamurthy, D., Harris, L. W., Leweke, F. M., Rothermundt, M., van Beveren, N. J. M., Spain, M. G., Barnes, A., Steiner, J. H., et al. (2011) · Psychoneuroendocrinology · doi:10.1016/j.psyneuen.2010.12.018 · Cited by 138
Self-citationSerum proteomic profiling of major depressive disorder
Bot, M., Chan, M. K., Jansen, R., Lamers, F., Vogelzangs, N., Steiner, J., Leweke, F. M., Rothermundt, M., Cooper, J., Bahn, S., et al. (2015) · Translational Psychiatry · doi:10.1038/tp.2015.88 · Cited by 137
Self-citationWu, J., Xie, X., Liu, Y., He, J., Benitez, R. S., Buckanovich, R. J., & Lubman, D. M. (2012) · Journal of Proteome Research · doi:10.1021/pr300330z · Cited by 132
Reproducibility of research and preclinical validation: problems and solutions
Pusztai, L., Hatzis, C., & André, F. (2013) · Nature Reviews Clinical Oncology · doi:10.1038/nrclinonc.2013.171 · Cited by 114
Identification of Serum Biomarker Signatures Associated with Pancreatic Cancer
Wingren, C., Sandström, A., Segersvärd, R., Carlsson, A., Andersson, R., Löhr, M., & Borrebaeck, C. A. K. (2012) · Cancer Research · doi:10.1158/0008-5472.can-11-2883 · Cited by 111
Chung, L., Moore, K., Phillips, L., Boyle, F. M., Marsh, D. J., & Baxter, R. C. (2014) · Breast Cancer Research · doi:10.1186/bcr3676 · Cited by 107
Proteomic changes in serum of first onset, antidepressant drug-naïve major depression patients
Stelzhammer, V., Haenisch, F., Chan, M. K., Cooper, J. D., Steiner, J., Steeb, H., Martins-de-Souza, D., Rahmoune, H., Guest, P. C., & Bahn, S. (2014) · The International Journal of Neuropsychopharmacology · doi:10.1017/s1461145714000819 · Cited by 105
Benefits and risks of oral contraceptives
Sherif, K. (1999) · American Journal of Obstetrics and Gynecology · doi:10.1016/s0002-9378(99)70694-0 · Cited by 88
Riggs, B. L. (1987) · American Journal of Obstetrics and Gynecology · doi:10.1016/0002-9378(87)90176-1 · Cited by 83
Circulating Angiogenesis Regulators in Cancer Patients
Kuroi, K., & Toi, M. (2001) · The International Journal of Biological Markers · doi:10.1177/172460080101600102 · Cited by 81
The Menstrual Cycle: Physiology, Reproductive Disorders, and Infertility
Ferin, M., Jewelewicz, R., & Warren, M. P. (1993) · Medical Entomology and Zoology · Cited by 70
Sex Differences in the Central Nervous System
(2016) · Elsevier eBooks · doi:10.1016/c2014-0-01274-9 · Cited by 63
Levitsky, J., Baker, T., Jie, C., Ahya, S. N., Levin, M. L., Friedewald, J. J., Al-Saden, P. C., Salomon, D. R., & Abecassis, M. M. (2014) · Hepatology · doi:10.1002/hep.27346 · Cited by 55
Contraceptive adherence among women Veterans with mental illness and substance use disorder
Callegari, L. S., Zhao, X., Nelson, K. M., & Borrero, S. B. (2015) · Contraception · doi:10.1016/j.contraception.2015.01.013 · Cited by 49
Chen, L., Ho, D. W., Lee, N. P. Y., Sun, S., Lam, B., Wong, K., Yi, X., Lau, G. K. K., Ng, E. W. Y., Poon, T. C. W., et al. (2010) · Annals of Surgical Oncology · doi:10.1245/s10434-010-1038-8 · Cited by 48
Srivastava, S., Kedia, S., Kumar, S., Mouli, V. P., Dhingra, R., Sachdev, V., Tiwari, V., Kurrey, L., Pradhan, R., & Ahuja, V. (2015) · Journal of Crohn s and Colitis · doi:10.1093/ecco-jcc/jjv075 · Cited by 43
Molecular Sex Differences in Human Serum
Ramsey, J. M., Schwarz, E., Guest, P. C., van Beveren, N. J. M., Leweke, F. M., Rothermundt, M., Bogerts, B., Steiner, J., Ruta, L., Baron-Cohen, S., et al. (2012) · PLoS ONE · doi:10.1371/journal.pone.0051504 · Cited by 36
Self-citationXu, B. J., An, Q. A., Gowda, S. S., 严文卫, Pierce, L. A., Abel, T. W., Rush, S. Z., Cooper, M. K., Ye, F., Shyr, Y., et al. (2012) · International Journal of Oncology · doi:10.3892/ijo.2012.1355 · Cited by 29
Screening and identification of serum proteomic biomarkers for gastric adenocarcinoma
Liu, C., Pan, C., & Liang, Y. (2012) · Experimental and Therapeutic Medicine · doi:10.3892/etm.2012.515 · Cited by 22
[Summary of the Dutch College of General Practitioners' practice guideline 'Contraception'].
Kurver, M., van der Wijden, C., & Burgers, J. S. (2012) · PubMed · Cited by 5
Research works printed but not linked: 1
- Guest P. C. & Bahn S. Biomarkers of Neurological and Psychiatric Disease. (Elsevier Inc., 2011).
Cited by
Biomarkers for depression: recent insights, current challenges and future prospects
Strawbridge, R., Young, A. H., & Cleare, A. J. (2017) · Neuropsychiatric Disease and Treatment · doi:10.2147/ndt.s114542 · Cited by 415
Rich-Edwards, J. W., Kaiser, U. B., Chen, G. L., Manson, J. E., & Goldstein, J. M. (2018) · Endocrine Reviews · doi:10.1210/er.2017-00246 · Cited by 273
Sex Differences in Cancer Immunotherapy Efficacy, Biomarkers, and Therapeutic Strategy
Wang, S., Cowley, L. A., & Liu, X.-S. (2019) · Molecules · doi:10.3390/molecules24183214 · Cited by 180
“analyzed the levels of over 170 protein and small-molecule biomarkers in men and women with varying hormonal statuses and reported that the concentration of 56% of biomarkers varied between men and women [64].”
BackgroundLet’s talk about sex: Differences in drug therapy in males and females
Madla, C. M., Gavins, F. K. H., Merchant, H. A., Orlu, M., Murdan, S., & Basit, A. W. (2021) · Advanced Drug Delivery Reviews · doi:10.1016/j.addr.2021.05.014 · Cited by 167
Sex differences in the human metabolome
Costanzo, M., Caterino, M., Sotgiu, G., Ruoppolo, M., Franconi, F., & Campesi, I. (2022) · Biology of Sex Differences · doi:10.1186/s13293-022-00440-4 · Cited by 180
Metadata
- Authors
- Ramsey, J. M., Cooper, J. D., Penninx, B. W. J. H., & Bahn, S.
- Affiliations
- University of Cambridge (GB)
- Amsterdam Neuroscience (NL)
- Corresponding author
- Ramsey, Jordan M.
- Venue
- Scientific Reports
- Published
- 2016-05-31
- Volume
- 6
- Issue
- 1
- Pages
- 26947-26947
- ISSN
- 2045-2322 (ISSN-L)
- PMC
- PMC4886262
- OpenAlex
- W2416407254
- Cited by
- 45
- References
- 70
- Citations by year
- 2026: 5 · 2025: 6 · 2024: 5 · 2023: 3 · 2022: 6 · 2021: 5 · 2020: 3 · 2019: 5 · 2018: 3 · 2017: 4
- FWCI
- 3.97
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- cc-by
- creativecommons.org/licenses/by/4.0 (tdm)
- creativecommons.org/licenses/by/4.0 (vor)
- Locations
- Scientific Reports (publishedVersion, cc-by)
- Europe PMC (PubMed Central) (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- Pure Amsterdam UMC (publishedVersion, other-oa)
- Amsterdam UMC (VU Amsterdam) - Institutional Repository (publishedVersion)
- EUR Research Repository (Erasmus University Rotterdam) (publishedVersion)
- EUR Research Repository (Erasmus University Rotterdam) (submittedVersion)
- Data Archiving and Networked Services (DANS) (submittedVersion)
- Funders
- Stanley Medical Research Institute
- European Commission (286334)
- Universiteit Leiden (10‐000‐1002)
- ZonMw (10‐000‐1002)
- Vrije Universiteit Amsterdam
- GGZ inGeest
- Rivierduinen
- GGZ Friesland
- GGZ Drenthe
- Nederlands Instituut voor Onderzoek van de Gezondheidszorg (10-000-1002)
- Trimbos-instituut
- Cambridge Commonwealth Trust
- Leids Universitair Medisch Centrum
- Universitair Medisch Centrum Groningen
- Topics
- Health Sciences › Medicine › Public Health, Environmental and Occupational Health › Sex and Gender in Healthcare
- Health Sciences › Health Professions › Medical Laboratory Technology › Clinical Laboratory Practices and Quality Control
- Life Sciences › Biochemistry, Genetics and Molecular Biology › Molecular Biology › Metabolomics and Mass Spectrometry Studies
- Keywords
- serum biomarkers, sex differences, menstrual cycle, oral contraceptive use, postmenopausal women, biomarker reproducibility, false discovery rate, sample classification, anxiety and depression
- MeSH terms
- Adolescent, Adult, Aged, Anxiety Disorders, Contraceptives, Oral, Hormonal, Major Depressive Disorder, False Positive Reactions, Female, Humans, Male, Menstrual Cycle, Middle Aged, Netherlands, Sex Factors, Gonadal Steroid Hormones, Reproducibility of Results, Biomarkers, Case-Control Studies, Premenopause, Clinical Chemistry Tests
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.