Assessment of concordance and discordance among clinical studies posted as preprints and subsequently published in high-impact journals
Open accessAbstract
This cross-sectional study examines the concordance between clinical studies posted as preprints and subsequently published in high-impact journals, including key study characteristics, reported results, and study interpretations.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The results are aligned with previous assessments before covid-19 that study interpretations and other study details do not change importantly between preprints and their later publications in high impact journals.
“Our results are also aligned with previous assessments before covid-19 that study interpretations and other study details do not change importantly between preprints and their later publications in high impact journals.”
From Consistency of covid-19 trial preprints with published reports and impact for decision making: retrospective review (2022) · cites this paper as [47]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
Preprints Involving Medical Research—Do the Benefits Outweigh the Challenges?
Flanagin, A., Fontanarosa, P. B., & Bauchner, H. (2020) · JAMA · doi:10.1001/jama.2020.20674 · Cited by 115 · see citing works
Reporting of Results in ClinicalTrials.gov and High-Impact Journals
Becker, J. E., Krumholz, H. M., Ben-Josef, G., & Ross, J. S. (2014) · JAMA · doi:10.1001/jama.2013.285634 · Cited by 99 · see citing works
Comparing published scientific journal articles to their pre-print versions
Klein, M., Broadwell, P., Farb, S. E., & Grappone, T. (2019) · International Journal on Digital Libraries · doi:10.1007/s00799-018-0234-1 · Cited by 76 · see citing works
Submissions and Downloads of Preprints in the First Year of medRxiv
Krumholz, H. M., Bloom, T., Sever, R., Rawlinson, C., Inglis, J. R., & Ross, J. S. (2020) · JAMA · doi:10.1001/jama.2020.17529 · Cited by 62 · see citing works
Assessment of Preprint Policies of Top-Ranked Clinical Journals
Massey, D. S., Opare, M. A., Wallach, J. D., Ross, J. S., & Krumholz, H. M. (2020) · JAMA Network Open · doi:10.1001/jamanetworkopen.2020.11127 · Cited by 57 · see citing works
Medical Preprints—A Debate Worth Having
Maslove, D. M. (2018) · JAMA · doi:10.1001/jama.2017.17566 · Cited by 53 · see citing works
Flagged first, then by citations
Cited by
Sorted by citations
Comparison of Clinical Study Results Reported in medRxiv Preprints vs Peer-reviewed Journal Articles
Janda, G., Khetpal, V., Shi, X., Ross, J. S., & Wallach, J. D. (2022) · JAMA Network Open · doi:10.1001/jamanetworkopen.2022.45847 · Cited by 47 · see citing works
Zeraatkar, D., Pitre, T., Leung, G., Cusano, E., Agarwal, A., Khalid, F., Escamilla, Z., Cooper, M. A., Ghadimi, M., Wang, Y., et al. (2022) · BMJ Medicine · doi:10.1136/bmjmed-2022-000309 · Cited by 44 · see citing works
Challenges and Controversies in Peer Review
Kusumoto, F. M., Bittl, J. A., Creager, M. A., Dauerman, H. L., Lala, A., McDermott, M. M., Turco, J. V., Taqueti, V. R., & Fuster, V. (2023) · Journal of the American College of Cardiology · doi:10.1016/j.jacc.2023.08.056 · Cited by 29 · see citing works
Transparency and reporting characteristics of COVID-19 randomized controlled trials
Kapp, P., Esmail, L., Ghosn, L., Ravaud, P., & Boutron, I. (2022) · BMC Medicine · doi:10.1186/s12916-022-02567-y · Cited by 25 · see citing works
Peer Review and Scientific Publication at a Crossroads
Ioannidis, J. P. A., Berkwits, M., Flanagin, A., & Bloom, T. (2023) · JAMA · doi:10.1001/jama.2023.17607 · Cited by 23 · see citing works
Predicting substantive biomedical citations without full text
Hoppe, T. A., Arabi, S., & Hutchins, B. I. (2023) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.2213697120 · Cited by 16 · see citing works
Gehanno, J.-F., Julien Grosjean, A., Darmoni, S. J., & Rollin, L. (2022) · PLoS ONE · doi:10.1371/journal.pone.0264661 · Cited by 15 · see citing works
Rapid, accurate publication and dissemination of clinical trial results: benefits and challenges
Zannad, F. M., Crea, F., Keaney, J. F., Spencer, S., Hill, J. A., Pfeffer, M. A., Pocock, S., Raderschadt, E., Ross, J. S., Sacks, C. A., et al. (2023) · European Heart Journal · doi:10.1093/eurheartj/ehad279 · Cited by 14 · see citing works
Preprints: a game changer in scientific publications?
Alfonso, F., & Crea, F. (2022) · European Heart Journal · doi:10.1093/eurheartj/ehac665 · Cited by 14 · see citing works
Bai, A. D., Jiang, Y., Nguyen, D. L., Lo, C. K. L., Stefanova, I. Z., Guo, K., Wang, F., Zhang, C., Sayeau, K., Garg, A., et al. (2023) · JAMA Network Open · doi:10.1001/jamanetworkopen.2022.53301 · Cited by 12 · see citing works
Evaluation of Publication of COVID-19–Related Articles Initially Presented as Preprints
Llor, C., Moragas, A., & Maier, M. (2022) · JAMA Network Open · doi:10.1001/jamanetworkopen.2022.45745 · Cited by 9 · see citing works
Students’ Perceptions of Preprints Discovered in Google: A Window into Recognition And Evaluation
Cataldo, T. T., Faniel, I. M., Buhler, A., Brannon, B., Connaway, L. S., & Putnam, S. R. (2023) · College & Research Libraries · doi:10.5860/crl.84.1.137 · Cited by 6 · see citing works
Sommer, I., Sunder-Plassmann, V., Ratajczak, P., Emprechtinger, R., Dobrescu, A. I., Griebler, U., & Gartlehner, G. (2023) · Scientific Reports · doi:10.1038/s41598-023-44291-4 · Cited by 6 · see citing works
Peer review and scientific publication at a crossroads
Ioannidis, J. P. A., Berkwits, M., Flanagin, A., & Bloom, T. (2023) · BMJ · doi:10.1136/bmj.p1992 · Cited by 4 · see citing works
Published peer review reports have higher informative content than unpublished reports
Álvarez-García, E., García-Costa, D., Squazzoni, F., Malički, M., Mehmani, B., & Grimaldo, F. (2025) · Journal of Informetrics · doi:10.1016/j.joi.2025.101760 · Cited by 4 · see citing works
Stoll, M., Lindner, S., Marquardt, B., Salholz‐Hillel, M., DeVito, N., Klemperer, D., & Lieb, K. (2023) · BMC Medical Research Methodology · doi:10.1186/s12874-023-01991-9 · Cited by 3 · see citing works
Zhang, J., Bierer, B. E., Spall, H. G. C. V., Liu, Y., Bai, X., Thabane, L., Lip, G. Y. H., Sun, X., Moher, D., & Li, G. (2025) · BMC Medicine · doi:10.1186/s12916-025-04328-z · Cited by 2 · see citing works
Preprint policies across journals and publishers in ecology and evolutionary biology
Purgar, M., Ivimey‐Cook, E. R., Čulina, A., & Wallach, J. D. (2025) · Proceedings of the Royal Society B Biological Sciences · doi:10.1098/rspb.2025.0524 · Cited by 2 · see citing works
Turoman, N., Heyard, R., Schwab, S., Furrer, E., Vergauwe, E., & Held, L. (2023) · F1000Research · doi:10.12688/f1000research.129814.1 · Cited by 2 · see citing works
Predicting causal citations without full textPreprint
Hoppe, T. A., Arabi, S., & Hutchins, B. I. (2022) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2022.07.05.498860 · Cited by 2 · see citing works
Mikulić, I., Puharić, D., & Malički, M. (2025) · International Nursing Review · doi:10.1111/inr.70088 · Cited by 1 · see citing works
Turoman, N., Heyard, R., Schwab, S., Furrer, E., Vergauwe, E., & Held, L. (2022) · doi:10.31222/osf.io/nb928
Morin, C., Padki, A., Wong, A., Miano, T. A., Kane‐Gill, S. L., Cozzi, G., & Deveau, R. (2023) · Journal of Intensive Care Medicine · doi:10.1177/08850666231182563
Turoman, N., Heyard, R., Schwab, S., Furrer, E., Vergauwe, E., & Held, L. (2024) · F1000Research · doi:10.12688/f1000research.129814.2
Kapp, P., Esmail, L. C., Ghosn, L., Ravaud, P., & Boutron, I. (2022) · Figshare · doi:10.6084/m9.figshare.21207016
Turoman, N., Heyard, R., Schwab, S., Furrer, E., Vergauwe, E., & Held, L. (2024) · F1000Research · doi:10.12688/f1000research.129814.3
Krumholz, H. M. (2025) · Journal of the American College of Cardiology · doi:10.1016/j.jacc.2025.08.006
Kapp, P., Esmail, L. C., Ghosn, L., Ravaud, P., & Boutron, I. (2022) · Figshare · doi:10.6084/m9.figshare.21207013
Cardiovascular medicine preprints: publication rates, citation rates, and time to publication
Nicolalde, B., Camacho, J., Zambrano, K., Castillo, K., Rosoph, L., Sewalem, Z. W., Caputi, A., & Vélez, M. (2026) · Scientometrics · doi:10.1007/s11192-026-05859-9
- Authors
- Shi, X., Ross, J. S., Amancharla, N., Niforatos, J. D., Krumholz, H. M., & Wallach, J. D.
- Affiliations
- Yale University (US)
- Johns Hopkins University (US)
- Corresponding author
- Wallach, Joshua D.
- Venue
- JAMA Network Open
- Publisher
- American Medical Association (AMA)
- Published
- 2021-03-18
- Volume
- 4
- Issue
- 3
- Pages
- e212110
- ISSN
- 2574-3805 (ISSN-L)
- PMC
- PMC7974637
- OpenAlex
- W3137473078
- Cited by
- 28
- References
- 6
- Citations by year
- 2026: 1 · 2025: 5 · 2024: 2 · 2023: 11 · 2022: 9
- FWCI
- 4.91
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- cc-by
- Locations
- JAMA Network Open (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- Funders
- China Scholarship Council
- National Institutes of Health (UL1TR001863)
- National Institute on Alcohol Abuse and Alcoholism (K01AA028258)
- National Center for Advancing Translational Sciences
- Topics
- Social Sciences › Decision Sciences › Information Systems and Management › Academic Publishing and Open Access
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › scientometrics and bibliometrics research
- Keywords
- preprints, concordance, discordance, high-impact journals, study characteristics, study interpretation
- MeSH terms
- Clinical Studies as Topic, Preprints as Topic, Humans, Periodicals as Topic, Publications, Journal Impact Factor
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
