Ushering in a New Era of Open Science Through Data Sharing: The Wall Must Come Down
The DOI matches its Crossref record; 5 of the 5 references it cites were found in a registry or an index.
Abstract
IT MAY APPEAR THAT THE CLINICAL RESEARCH ENTERPRISE is functioning well, even thriving. Nearly 30 000 trials globally are recruiting patients, and results from 75 trials are published daily in biomedical journals. However, there is a crisis, with an attendant opportunity, that requires change. A wall surrounds much of these clinical research data, sequestering knowledge, impeding the free flow of information, and obscuring a clear view of the totality of evidence relevant to many research questions and clinical decisions. Nearly half of clinical research trials are never published. Moreover, publications are often incomplete, selectively reporting favorable outcomes and infrequently reporting relevant safety findings. Motivations and explanations for this phenomenon vary, but whether intended or not, selective publication distorts the medical evidence and inhibits the flow of information that is vital to decision making by patients and their clinicians.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Systematic Review of the Empirical Evidence of Study Publication Bias and Outcome Reporting Bias
Dwan, K., Altman, D. G., Arnaiz, J. A., Bloom, J., Chan, A.-W., Cronin, E., Decullier, E., Easterbrook, P. J., Von Elm, E., Gamble, C., et al. (2008) · PLoS ONE · doi:10.1371/journal.pone.0003081 · Cited by 1,546 · cited 2×
“Moreover, publications are often incomplete, selectively reporting favorable outcomes and infrequently reporting relevant safety findings.(3,5) Motivations and explanations for this phenomenon vary, but whether intended or not, selective publication distorts the medical evidence and inhibits the flow of information th…”
BackgroundSeventy-five trials and eleven systematic reviews a day: how will we ever keep up?
Bastian, H., Glasziou, P., & Chalmers, I. (2010) · PLoS Medicine · doi:10.1371/journal.pmed.1000326 · Cited by 1,188 · cited 1×
“Nearly 30 000 trials globally are recruiting patients,(1) and results from 75 trials are published daily in biomedical journals.(2) However, there is a crisis, with an attendant opportunity, that requires change.”
BackgroundCharacteristics of Clinical Trials Registered in ClinicalTrials.gov, 2007-2010
Califf, R. M. (2012) · JAMA · doi:10.1001/jama.2012.3424 · Cited by 516
Trial Publication after Registration in ClinicalTrials.Gov: A Cross-Sectional Analysis
Ross, J. S., Mulvey, G. K., Hines, E. M., Nissen, S. E., & Krumholz, H. M. (2009) · PLoS Medicine · doi:10.1371/journal.pmed.1000144 · Cited by 401 · cited 1×
“Nearly half of clinical research trials are never published.(3,4) Moreover, publications are often incomplete, selectively reporting favorable outcomes and infrequently reporting relevant safety findings.”
BackgroundSelf-citationReporting of Safety Results in Published Reports of Randomized Controlled Trials
(2009) · Archives of Internal Medicine · doi:10.1001/archinternmed.2009.306 · Cited by 287
Cited by
Ayers, J. W., Poliak, A., Dredze, M., Leas, E. C., Zhu, Z., Kelley, J. B., Faix, D. J., Goodman, A. M., Longhurst, C. A., Hogarth, M., et al. (2023) · JAMA Internal Medicine · doi:10.1001/jamainternmed.2023.1838 · Cited by 2,613
The Mass Production of Redundant, Misleading, and Conflicted Systematic Reviews and Meta‐analyses
IOANNIDIS, J. P. A. (2016) · The Milbank Quarterly · doi:10.1111/1468-0009.12210 · Cited by 1,483
Academic engagement: A review of the literature 2011-2019
Perkmann, M., Salandra, R., Tartari, V., McKelvey, M., & Hughes, A. (2021) · Research Policy · doi:10.1016/j.respol.2020.104114 · Cited by 556
The MIMIC Code Repository: enabling reproducibility in critical care research
Johnson, A. E. W., Stone, D. J., Celi, L. A., & Pollard, T. J. (2018) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocx084 · Cited by 442
“quite well described.(35,36) To achieve full transparency, researchers must be able to provide both the data used for analysis and the code used to process it.”
BackgroundPatient involvement in clinical research: why, when, and how
Sacristan, J. A., Aguaron, A., Avendaño, C., Garrido, P., Carrion, J., Gutierrez, A., Kroes, R., & Flores, A. (2016) · Patient Preference and Adherence · doi:10.2147/ppa.s104259 · Cited by 363
Metadata
- Authors
- Ross, J. S., & Krumholz, H. M.
- Venue
- JAMA
- Publisher
- American Medical Association (AMA)
- Published
- 2013-04-03
- Volume
- 309
- Issue
- 13
- Pages
- 1355
- ISSN
- 0002-9955 (ISSN-L)
- 0098-7484
- OpenAlex
- W1968644320
- Cited by
- 118
- References
- 5
- FWCI
- 47.76
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Ushering in a New Era of Open Science Through Data Sharing: The Wall Must Come Down. https://app.cochat.ai/papers/10.1001/jama.2013.1299
- The paper
- Ross, J. S., & Krumholz, H. M. (2013). Ushering in a New Era of Open Science Through Data Sharing: The Wall Must Come Down. JAMA. https://doi.org/10.1001/jama.2013.1299
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.