Second thoughts on the final rule: An analysis of baseline participant characteristics reports on ClinicalTrials.gov.
Open accessThe DOI matches its Crossref record; 19 of the 20 references it cites were found in a registry or an index.
Abstract
BACKGROUND: ClinicalTrials.gov is valuable for aggregate-level analysis of trials. The recently published final rule aims to improve reporting of trial results. We aimed to assess variability in ClinicalTirals.gov records reporting participants' baseline measures. METHODS AND FINDINGS: The September 2015 edition of the database for Aggregate Analysis of ClinicalTrials.gov (AACT), was used in this study. To date, AACT contains 186,941 trials of which 16,660 trials reporting baseline (participant) measures were analyzed. We also analyzed a subset of 13,818 Highly Likely Applicable Clinical Trials (HLACT), for which reporting of results is likely mandatory and compared a random sample of 30 trial records to their journal articles. We report counts for each mandatory baseline measure and variability reporting in their formats. The AACT dataset contains 8,161 baseline measures with 1206 unique measurement units. However, of these 6,940 (85%) variables appear only once in the dataset. Age and Gender are reported using many different formats (178 and 49 respectively). "Age" as the variable name is reported in 60 different formats. HLACT subset reports measures using 3,931 variables. The most frequent Age format (i.e. mean (years) ± sd) is found in only 45% of trials. Overall only 4 baseline measures (Region of Enrollment, Age, Number of Participants, and Gender) are reported by > 10% of trials. Discrepancies are found in both the types and formats of ClinicalTrials.gov records and their corresponding journal articles. On average, journal articles include twice the number of baseline measures (13.6±7.1 (sd) vs. 6.6±7.6) when compared to the ClinicalTrials.gov records that report any results. CONCLUSIONS: We found marked variability in baseline measures reporting. This is not addressed by the final rule. To support secondary use of ClinicalTrials.gov, a uniform format for baseline measures reporting is warranted.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Figures
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“The accuracy of the algorithm is reasonable given the large variety in the presentation of baseline tables, an issue that has been flagged by others. 29”
From Automated detection of over- and under-dispersion in baseline tables in randomised controlled trials. (2022) · cites this paper as [29]
In the citing paper
“Even supposedly simple statistics such as age and gender were inconsistently presented in baseline tables, and a previous study similarly found highly varied reporting in age and gender in the clinicaltrials.gov database. 29”
From Automated detection of over- and under-dispersion in baseline tables in randomised controlled trials. (2022) · cites this paper as [29]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Spironolactone for heart failure with preserved ejection fraction
Pitt, B., Pfeffer, M. A., Assmann, S. F., Boineau, R., Anand, I. S., Claggett, B., Clausell, N., Desai, A. S., Diaz, R., Fleg, J. L., et al. (2014) · New England Journal of Medicine · doi:10.1056/nejmoa1313731 · Cited by 2,809
External validity of randomised controlled trials: “To whom do the results of this trial apply?”
Rothwell, P. M. (2005) · The Lancet · doi:10.1016/s0140-6736(04)17670-8 · Cited by 2,544
Teerlink, J. R., Cotter, G., Davison, B. A., Felker, G. M., Filippatos, G., Greenberg, B. H., Ponikowski, P., Unemori, E., Voors, A. A., Adams, K. F., et al. (2013) · The Lancet · doi:10.1016/s0140-6736(12)61855-8 · Cited by 918
Validation of a common data model for active safety surveillance research
Overhage, J. M., Ryan, P. B., Reich, C. G., Hartzema, A. G., & Stang, P. E. (2012) · Journal of the American Medical Informatics Association · doi:10.1136/amiajnl-2011-000376 · Cited by 548
Characteristics of Clinical Trials Registered in ClinicalTrials.gov, 2007-2010
Califf, R. M. (2012) · JAMA · doi:10.1001/jama.2012.3424 · Cited by 516
Chen, H. H., Anstrom, K. J., Givertz, M. M., Stevenson, L. W., Semigran, M. J., Goldsmith, S. R., Bart, B. A., Bull, D. A., Stehlik, J., LeWinter, M. M., et al. (2013) · JAMA · doi:10.1001/jama.2013.282190 · Cited by 458
Trial Publication after Registration in ClinicalTrials.Gov: A Cross-Sectional Analysis
Ross, J. S., Mulvey, G. K., Hines, E. M., Nissen, S. E., & Krumholz, H. M. (2009) · PLoS Medicine · doi:10.1371/journal.pmed.1000144 · Cited by 401
Compliance with Results Reporting at ClinicalTrials.gov
Anderson, M. L., Chiswell, K., Peterson, E. D., Tasneem, A., Topping, J., & Califf, R. M. (2015) · New England Journal of Medicine · doi:10.1056/nejmsa1409364 · Cited by 380
Trial Reporting in ClinicalTrials.gov — The Final Rule
Zarin, D. A., Tse, T., Williams, R. J., & Carr, S. (2016) · New England Journal of Medicine · doi:10.1056/nejmsr1611785 · Cited by 332
Travers, J., Marsh, S., Williams, M., Weatherall, M., Caldwell, B., Shirtcliffe, P., Aldington, S., & Beasley, R. (2007) · Thorax · doi:10.1136/thx.2006.066837 · Cited by 310
Prayle, A. P., Hurley, M. N., & Smyth, A. R. (2012) · BMJ · doi:10.1136/bmj.d7373 · Cited by 290
Tasneem, A., Aberle, L., Ananth, H., Chakraborty, S., Chiswell, K., McCourt, B. J., & Pietrobon, R. (2012) · PLoS ONE · doi:10.1371/journal.pone.0033677 · Cited by 166
Clinical Trials Registration and Results Information Submission. Final rule.
(2016) · PubMed · Cited by 140
The effects of exercise on cardiovascular biomarkers in patients with chronic heart failure
Ahmad, T., Fiuzat, M., Mark, D. B., Neely, B., Neely, M., Kraus, W. E., Kitzman, D. W., Whellan, D. J., Donahue, M., Zannad, F., et al. (2014) · American Heart Journal · doi:10.1016/j.ahj.2013.10.018 · Cited by 62
Patel, K., Fonarow, G. C., Kitzman, D. W., Aban, I., Love, T. E., Allman, R. M., Gheorghiade, M., & Ahmed, A. (2013) · JACC Heart Failure · doi:10.1016/j.jchf.2012.08.001 · Cited by 49
Golwala, H. B., Thadani, U., Liang, L., Stavrakis, S., Butler, J., Yancy, C. W., Bhatt, D. L., Hernandez, A. F., & Fonarow, G. C. (2013) · Journal of the American Heart Association · doi:10.1161/jaha.113.000214 · Cited by 41
Research without results: Inadequate public reporting of clinical trial results
Gopal, R. K., Yamashita, T. E., & Prochazka, A. V. (2012) · Contemporary Clinical Trials · doi:10.1016/j.cct.2012.02.001 · Cited by 23
From ClinicalTrials.gov trial registry to an analysis-ready database of clinical trial results
Cepeda, M. S., Lobanov, V. S., & Berlin, J. A. (2013) · Clinical Trials · doi:10.1177/1740774513475849 · Cited by 22
An Analysis of Registered Clinical Trials in Otolaryngology from 2007 to 2010: ClinicalTrials.gov
Witsell, D. L., Schulz, K. A., Lee, W. T., & Chiswell, K. (2013) · Otolaryngology · doi:10.1177/0194599813506545 · Cited by 12
Cited by
Latent Dirichlet Allocation in predicting clinical trial terminations
Geletta, S., Follett, L., & Laugerman, M. R. (2019) · BMC Medical Informatics and Decision Making · doi:10.1186/s12911-019-0973-y · Cited by 32
Truong, B., Tran, L. T., Le, T. A., Pham, T. T., & Vo, T. (2023) · Research Synthesis Methods · doi:10.1002/jrsm.1653 · Cited by 22
Krese, K., Ingraham, B. A., O’Brien, M. K., Mummidisetty, C. K., McNulty, M., Srdanovic, N., Kocherginsky, M., & Ripley, D. L. (2020) · Brain Injury · doi:10.1080/02699052.2020.1776394 · Cited by 18
Barnett, A. (2022) · F1000Research · doi:10.12688/f1000research.123002.1 · Cited by 7
Vuong, M. L., Tu, P. H. T., Duong, K. L., & Vo, T. (2023) · Research Methods in Medicine & Health Sciences · doi:10.1177/26320843231191777 · Cited by 7
Metadata
- Authors
- Cahan, A., & Anand, V.
- Affiliations
- IBM (United States) (US)
- Corresponding author
- Cahan, Amos
- Venue
- PLOS ONE
- Publisher
- Public Library of Science (PLoS)
- Published
- 2017-11-06
- Volume
- 12
- Issue
- 11
- Pages
- e0185886
- ISSN
- 1932-6203 (ISSN-L)
- PMC
- PMC5673198
- OpenAlex
- W2767240320
- Cited by
- 10
- References
- 20
- Citations by year
- 2026: 1 · 2024: 1 · 2023: 3 · 2022: 2 · 2020: 1 · 2019: 1 · 2018: 1
- FWCI
- 0.73
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- Locations
- PLoS ONE (publishedVersion, cc-by)
- Europe PMC (PubMed Central) (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- RePEc: Research Papers in Economics (submittedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Figshare (submittedVersion, cc-by)
- Topics
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Physical Sciences › Computer Science › Information Systems › Research Data Management Practices
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods in Clinical Trials
- Keywords
- ClinicalTrials.gov, baseline characteristics, clinical trial registries, units of measurement
- MeSH terms
- Clinical Trials as Topic, Female, Humans, Male, United States, Internet
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.
