LETTER TO THE EDITOR: An Extraordinarily Inaccurate Assay for Free Testosterone Is Still with Us
Open accessThe DOI matches its Crossref record; 1 of the 1 references it cites were found in a registry or an index.
Abstract
Perusing the November 2000 issue of JCE&M, I noted an article in which one of the outcome measures was serum free testosterone (1). The method used to measure serum free testosterone, a direct RIA that purports to, but does not, measure the free testosterone concentration is one whose use I decried in a letter to the editor published more than 3 yr ago (2). Not long after, Vermeulen et al. (3) published a side-by-side experimental comparison of methods for determining the concentration of free testosterone in serum. Those experiments conclusively show that the direct RIA of free testosterone is seriously inaccurate, underestimating its concentration by many-fold. To my knowledge, there are no data that contradict these conclusions. Hence, I was surprised to find that the direct assay method not only was still being used for investigative purposes, but also was being published in what is among the foremost endocrine journals in the world. To see how pervasive this situation was, I undertook to examine the frequency with which those publishing in the journal were using this methodology. Methods. I conducted a full text, online search, of the JCE&M (January 1998-November 2000) using the term “free testosterone.” Then, I evaluated each retrieved citation containing the term and ascertained whether it revealed the use of a direct RIA for free testosterone, an alternate method for measuring free testosterone, or was not applicable (e.g. free testosterone mentioned in an editorial, a comment, a discussion, a bibliography, etc.). In addition to the foregoing, there were a number of publications in which no reference was given. Results. A total of 116 citations were retrieved: 49 were not applicable; 11 contained no reference for the method cited; 24 used a method other than direct RIA; and 32 used the direct RIA. Of the 116 citations, 67 were suitable to address the question at hand. Thus, 48% (32 of 67) of the applicable papers used a seriously inaccurate method for estimating free testosterone and, almost as serious, 16% (11 of 67) cited no method at all. Why would anyone choose to use this methodology? Perhaps the answer can be found in the technical bulletins of one of the companies that manufacture and sell kits that use this method. The relevant citations reveal that kits made by two companies, Diagnostic Products and Diagnostic Systems Laboratories, Inc. (DSL), account for almost all the inappropriate measurements of free testosterone in papers published in the journal during the period in question. A DSL technical bulletin (http://www. dslabs.com/techlit/4900tb2.doc) advertises: “Historically, free testosterone levels were determined by a method known as equilibrium dialysis. … The method is cumbersome, time-consuming, and equipment intensive.” Conversely, we are told, the DSL direct method is simple and rapid. The only difficulty is that “the equilibrium dialysis method gave values approximately 4 times higher than did the DSL kit.” As if to compensate for the inexcusable inaccuracy, the technical bulletin and accompanying X-Y plot of RIA vs. equilibrium dialysis makes the point that the correlation coefficient is 0.92. Even this is deceiving. The points at the upper end of the DSL method are the major contributors to the fitted line. Visual examination of the plot indicates that a line through the lower points (17 of 21 points below the fitted line and 2 points above it) would have a substantially different slope than that indicated by the published fitted line. Thus, in addition to being inaccurate, this observation indicates that, compared with equilibrium dialysis, the assay is not linear. Yet, the kit remains on the market because it is easy to use. Almost one half of the publications dealing with free testosterone, in the period under consideration, used an inaccurate assay for its measurement. Even if the (somewhat more time-consuming) procedure of equilibrium dialysis were the only alternative, the literature of science ought not to use a method so grossly inaccurate when better ones exist. We all know that there are numerous assays for hormones in serum that are method specific. However, I know of no other that has been demonstrated to be so egregiously incorrect. The journal might choose to return manuscripts that use it without further evaluation to discourage its use.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
A Critical Evaluation of Simple Methods for the Estimation of Free Testosterone in Serum
Vermeulen, A., Verdonck, L., & Kaufman, J. M. (1999) · The Journal of Clinical Endocrinology & Metabolism · doi:10.1210/jcem.84.10.6079 · Cited by 3,824
Cited by
Polycystic Ovary Syndrome: Definition, Aetiology, Diagnosis and Treatment
Escobar-Morreale, H. F. (2018) · Nature Reviews Endocrinology · doi:10.1038/nrendo.2018.24 · Cited by 2,083
Ding, E. L., Song, Y., Malik, V. S., & Liu, S. (2006) · JAMA · doi:10.1001/jama.295.11.1288 · Cited by 1,354
Rosner, W., Auchus, R. J., Azziz, R., Sluss, P. M., & Raff, H. (2007) · The Journal of Clinical Endocrinology & Metabolism · doi:10.1210/jc.2006-1864 · Cited by 1,176
Self-citationAndrogens and Cardiovascular Disease
Liu, P. Y., Death, A. K., & Handelsman, D. J. (2003) · Endocrine Reviews · doi:10.1210/er.2003-0005 · Cited by 695
Frequent Occurrence of Hypogonadotropic Hypogonadism in Type 2 Diabetes
Dhindsa, S., Prabhakar, S., Sethi, M., Bandyopadhyay, A., Chaudhuri, A., & Dandona, P. (2004) · The Journal of Clinical Endocrinology & Metabolism · doi:10.1210/jc.2004-0804 · Cited by 631
Metadata
- Authors
- Rosner, W.
- Venue
- The Journal of Clinical Endocrinology & Metabolism
- Publisher
- The Endocrine Society
- Published
- 2001-06
- Volume
- 86
- Issue
- 6
- Pages
- 2903-2903
- ISSN
- 0021-972X (ISSN-L)
- 1945-7197
- OpenAlex
- W2100445219
- Cited by
- 123
- References
- 1
- Type
- journal article
- Language
- en
- Open access
- bronze
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.