The evolving role of preprints in the dissemination of COVID-19 research and their impact on the science communication landscape
Open accessPublished version of a preprint
The DOI matches its Crossref record; 56 of the 56 references it cites were found in a registry or an index; 20 of the 41 sources its claims cite were checked for support.
Abstract
The world continues to face a life-threatening viral pandemic. The virus underlying the Coronavirus Disease 2019 (COVID-19), Severe Acute Respiratory Syndrome Coronavirus 2 (SARS-CoV-2), has caused over 98 million confirmed cases and 2.2 million deaths since January 2020. Although the most recent respiratory viral pandemic swept the globe only a decade ago, the way science operates and responds to current events has experienced a cultural shift in the interim. The scientific community has responded rapidly to the COVID-19 pandemic, releasing over 125,000 COVID-19–related scientific articles within 10 months of the first confirmed case, of which more than 30,000 were hosted by preprint servers. We focused our analysis on bioRxiv and medRxiv, 2 growing preprint servers for biomedical research, investigating the attributes of COVID-19 preprints, their access and usage rates, as well as characteristics of their propagation on online platforms. Our data provide evidence for increased scientific and public engagement with preprints related to COVID-19 (COVID-19 preprints are accessed more, cited more, and shared more on various online platforms than non-COVID-19 preprints), as well as changes in the use of preprints by journalists and policymakers. We also find evidence for changes in preprinting and publishing behaviour: COVID-19 preprints are shorter and reviewed faster. Our results highlight the unprecedented role of preprints and preprint servers in the dissemination of COVID-19 science and the impact of the pandemic on the scientific communication landscape.
Overview
CoChat Summary
TL;DR
This paper analyzes bioRxiv and medRxiv preprints during the first 10 months of the COVID-19 pandemic, showing that COVID-19 preprints were posted in large numbers and accessed, cited, shared, and used in policy documents far more than non-COVID-19 preprints. It also finds that COVID-19 preprints were shorter and published in journals faster than non-COVID-19 preprints.
Key findings
- By October 31, 2020, over 125,000 COVID-19 publications had appeared, including 30,260 preprints (~25%); bioRxiv and medRxiv hosted 10,232 COVID-19 preprints in the first 10 months, compared with 78 Zika virus and 10 Ebola virus preprints on bioRxiv during those outbreaks.
- COVID-19 preprints on bioRxiv/medRxiv were accessed more (abstract views rate ratio = 18.2; PDF downloads rate ratio = 27.1), cited more (57.9% vs 21.5% received ≥1 citation; rate ratio = 13.7), tweeted more (98.9% vs 90.7% received >1 tweet; rate ratio = 7.6), covered in news more (28.7% vs 1.0%; rate ratio = 92.8), and commented on more (15.9% vs 3.1%; rate ratio = 11.0).
- COVID-19 preprints were 32% shorter than non-COVID-19 preprints (median 3,965 vs 5,427 words) and were published faster after posting (median 68 vs 116 days; 48-day difference); 21.1% of COVID-19 preprints were published by end of October vs 15.4% of non-COVID-19 preprints.
- Among COVID-19 corresponding authors, 85% were posting a bioRxiv/medRxiv preprint for the first time vs 69% of non-COVID-19 corresponding authors; 52 of 81 COVID-19 policy documents cited preprints, with medRxiv accounting for 209 of 255 preprint citations.
Methods
- Retrieved bioRxiv and medRxiv metadata via API through October 31, 2020 (N = 114,214 overall); comparative analysis used 44,503 preprints posted January–October 2020, of which 10,232 (23.0%) were classified as COVID-19 by keywords in titles/abstracts, plus a January–December 2019 control set (N = 30,094).
- Enhanced metadata with ROR affiliation matching, Crossref, Unpaywall, Dimensions citation data, Altmetric mentions, Disqus comment counts, and scraped bioRxiv/medRxiv usage data; policy analysis manually collected 81 COVID-19 and 38 non-COVID-19 policy documents.
- Used chi-squared tests, Mann–Whitney tests, Spearman correlations, time-adjusted negative binomial regressions, and 2-way ANOVAs with Tukey HSD post hoc comparisons.
Limitations
- Stated: COVID-19 classification relied on keyword matching of titles/abstracts at data extraction, so some early preprints revised to include COVID-19 keywords may have been captured; the tightly defined January–October 2020 window means preprints posted later had less time to accrue altmetric and usage metrics.
- Stated: policy document analysis was limited to a small set largely restricted to Europe, and whether preprint use in policy extends more globally remains to be explored; word and reference counts were limited to bioRxiv because medRxiv did not display full HTML texts.
- Evident: preprint publication status relied on bioRxiv/medRxiv DOI links and is likely an underestimate; Altmetric records only mentions it tracks, and missing responses were recorded as zero; the study is observational and does not establish causal effects of preprinting on later attention or publication outcomes.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Figures






Verification
Claims the paper makes
18 Valid · 1 Not valid · 14 Not checked · 141 Own results and interpretations
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“The COVID-19 crisis represents the first time that preprints have been widely used outside of specific communities to communicate during an epidemic.”
§ The evolving role of preprints in the dissemination of COVID-19 research and their impact on the science communication landscape > Introduction
What the sources say
- Not checked yetcites [13] Wellcome Trust. Sharing data during Zika and other global health emergencies | Wellcome. In: Wellcomeacuk [Internet]. 10 Feb 2016 [cited 13 May 2020]. Available from: https://wellcome.ac.uk/news/sharing-data-during-zika-and-other-global-health-emergencies
- Partly supportedcites [14] MA Johansson, 2018, An underutilized mechanism to accelerate outbreak science, PLoS Med sourceExperimental — accuracy not yet measured
The Summary points report that fewer than 5% of Ebola and Zika journal articles had been posted as preprints, and describe preprints as unfamiliar to many outside fields such as physics and statistics. That supports the claim’s contrast with earlier outbreaks. Published in 2018, the paper does not address preprint use during COVID-19 or establish that it was the first epidemic in which preprints were widely used outside those communities. (LLM, conf=0.87)
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
Every source the paper cites for this claim was checked and supports it.
In the paper
“The fourth most tweeted COVID-19 preprint was a widely criticised (and later withdrawn) study linking the SARS-CoV-2 spike protein to HIV-1 glycoproteins [23].”
§ The evolving role of preprints in the dissemination of COVID-19 research and their impact on the science communication landscape > Results > COVID-19 preprints were shared and cited more widely than non-COVID-19 preprints
What the sources say
- Supportedcites [23] P Pradhan, 2020, Uncanny similarity of unique inserts in the 2019-nCoV spike protein to HIV-1 gp120 and Gag, bioRxiv source
The source is the preprint identified in the citation: its title links the 2019-nCoV spike protein to HIV-1 gp120. The withdrawal notice (Abstract, no page) says the authors withdrew it in response to research-community comments on their approach and interpretation. The 'fourth most tweeted' ranking is the citing document’s characterization, not a finding attributed to this preprint. (LLM, conf=0.90)
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Rests on 2 assumptions not shown here.
- Supported
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“One of the primary concerns among authors around posting preprints is premature media coverage [16,31].”
§ The evolving role of preprints in the dissemination of COVID-19 research and their impact on the science communication landscape > Discussion
What the sources say
- Supportedcites [16] A Chiarelli, 2019, Scholarly Communication: An Exploratory Qualitative Study of Adoption, Practices, Drivers and Barriers, F1000Res source
In Results > Potential benefits and challenges of preprints (page not specified), the paper identifies media reporting of incorrect research as a frequently mentioned challenge and describes researchers’ concern that journalists could spread unreliable preprint findings. The Literature review (page not specified) explicitly describes the risk of uncertified science being reported prematurely in the media. (LLM, conf=0.88)
- Not matchedcites [31] ASAPbio. Preprint authors optimistic about benefits: preliminary results from the #bioPreprints2020 survey. In: ASAPbio [Internet]. 27 Jul 2020 [cited 1 Feb 2021]. Available from: https://asapbio.org/biopreprints2020-survey-initial-results
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Supported
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“Many of the negative hashtags have been perpetuated by public figures such as the former President of America and the right-wing media [35,36].”
§ The evolving role of preprints in the dissemination of COVID-19 research and their impact on the science communication landscape > Discussion
What the sources say
- Partly supportedcites [35] U. Yaqub, 2021, Tweeting During the Covid-19 Pandemic: Sentiment Analysis of Twitter Messages by President Trump, Digit Gov Res Pract sourceExperimental — accuracy not yet measured
The Discussion reports that Trump repeatedly used “Chinese virus” in tweets and employed negative rhetoric about China. It does not establish that these were hashtags or address their perpetuation by right-wing media. (LLM, conf=0.85)
- Not checked — no full text of the sourcecites [36] A Gruzd, 2020, Going viral: How a single tweet spawned a COVID-19 conspiracy theory on Twitter, Big Data Soc source
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Partly supported
Every source the paper cites for this claim was checked and supports it.
In the paper
“A recent study involving qualitative interviews of multiple research stakeholders found “early and rapid dissemination” to be among the most often cited benefits of preprints [16].”
§ The evolving role of preprints in the dissemination of COVID-19 research and their impact on the science communication landscape > Discussion
What the sources say
- Supportedcites [16] A Chiarelli, 2019, Scholarly Communication: An Exploratory Qualitative Study of Adoption, Practices, Drivers and Barriers, F1000Res source
The Methods (Analytical framework; page unavailable) report 38 semi-structured interviews with participants from multiple stakeholder groups. The Results (Potential benefits and challenges of preprints; page unavailable) identify early and rapid dissemination as the most frequently mentioned benefit. (LLM, conf=0.94)
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Supported
100 more claims · 6 with their cited sources checked
Create a free account to see all 174 claims and to verify the 2 references still open.
- Probably not a substantial claim. 30
- It may state two separate claims as one. 47
Statistics recomputed
Every reported test result, recomputed from its test statistic and degrees of freedom. A result shows as not adding up only once an independent check has confirmed it.
- Consistentz = 125reported p < .001 · recomputed p < .001
“z = 125.0, p < .001”
- Consistentz = 124.2reported p < .001 · recomputed p < .001
“z = 124.2, p < .001”
- Consistentz = 116.3reported p < .001 · recomputed p < .001
“z = 116.3, p < .001”
- Consistentz = 135.7reported p < .001 · recomputed p < .001
“z = 135.7, p < .001”
- Consistentz = 83.3reported p < .001 · recomputed p < .001
“z = 83.3, p < .001”
3 more recomputed tests
Create a free account to see every test the Stats check recomputed.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
Each contradiction between two passages listed here was confirmed by an independent check.
Rated major: it would touch a result — a value a result rests on, reported and recomputed p-values on opposite sides of the significance level, two passages that conflict with no sign which is right, or a cited work retracted before this paper was published.
In the paper
§ The evolving role of preprints in the dissemination of COVID-19 research and their impact on the science communication landscape > Results > COVID-19 preprints were shared and cited more widely than non-COVID-19 preprints
“we analysed the hashtags used in original tweets (i.e., excluding retweets) mentioning the top 100 most tweeted COVID-19 preprints (S4A Fig).”
§ The evolving role of preprints in the dissemination of COVID-19 research and their impact on the science communication landscape > Methods > Usage, altmetrics, and citation data
“we retrieved all tweets linking to the top 10 most-tweeted preprints.”
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
§ The evolving role of preprints in the dissemination of COVID-19 research and their impact on the science communication landscape > Results > Attributes of COVID-19 preprints posted between January and October 2020
“The majority of preprints existed as only a single version for both COVID-19 and non-COVID-19 works, with very few preprints existing in more than 2 versions (Fig 2C).”
§ The evolving role of preprints in the dissemination of COVID-19 research and their impact on the science communication landscape > Results > Attributes of COVID-19 preprints posted between January and October 2020
“(C) License type chosen by authors. (D) Number of versions per preprint.”
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
§ The evolving role of preprints in the dissemination of COVID-19 research and their impact on the science communication landscape > Results > COVID-19 preprints were shared and cited more widely than non-COVID-19 preprints
“the most commented non-COVID-19 preprint received only 68 comments, whereas the most commented COVID-19 preprint had over 580 comments (Table 5).”
§ The evolving role of preprints in the dissemination of COVID-19 research and their impact on the science communication landscape > Results > COVID-19 preprints were shared and cited more widely than non-COVID-19 preprints
“Table: Table 5 Top 10 most blogged COVID-19 preprints.”
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
§ The evolving role of preprints in the dissemination of COVID-19 research and their impact on the science communication landscape > Methods > Preprint metadata for bioRxiv and medRxiv
“For a subset of preprints posted between September 1, 2019 and April 30, 2020 (N = 25,883), we enhanced the basic preprint metadata with data from a number of other sources, as outlined below.”
§ The evolving role of preprints in the dissemination of COVID-19 research and their impact on the science communication landscape > Methods > Preprint metadata for bioRxiv and medRxiv
“In total, we matched 54,289 preprints to a country (72.8%); for COVID-19 preprints alone, 6,692 preprints (65.4%) were matched to a country.”
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
§ The evolving role of preprints in the dissemination of COVID-19 research and their impact on the science communication landscape > Results > COVID-19 preprints were shared and cited more widely than non-COVID-19 preprints
“whereas 8 of the top 10 tweeted COVID-19 preprints were tweeted over 10,500 times each (Table 2).”
§ The evolving role of preprints in the dissemination of COVID-19 research and their impact on the science communication landscape > Results > COVID-19 preprints were shared and cited more widely than non-COVID-19 preprints
“| 10 | medRxiv | 10.1101/2020.03.30.20048165 | Association of BCG vaccination policy with prevalence and mortality of COVID-19 | April 6, 2020 | 10,701 | 7 | 0 |”
1 more finding
Create a free account to see every finding of this check.
Cited works that were retracted
Works this paper cites that were later retracted, from the retraction notices publishers deposit. Major when the notice came out before this paper was published.
Rated major: it would touch a result — a value a result rests on, reported and recomputed p-values on opposite sides of the significance level, two passages that conflict with no sign which is right, or a cited work retracted before this paper was published.
In the paper
“Pradhan P, Pandey AK, Mishra A, Gupta P, Tripathi PK, Menon MB, et al. Uncanny similarity of unique inserts in the 2019-nCoV spike protein to HIV-1 gp120 and Gag. bioRxiv. 2020; 2020.01.30.927871. 10.1101/2020.01.30.927871 32511314”
Cited work 10.1101/2020.01.30.927871 · retracted 2020-02-02 · notice 10.1101/2020.01.30.927871 · this paper published 2021-04-02
Citations
Cites
1 retracted
Uncanny similarity of unique inserts in the 2019-nCoV spike protein to HIV-1 gp120 and Gag
Pradhan, P., Pandey, A. K., Mishra, A., Gupta, P., Tripathi, P. K., Menon, M. B., Gomes, J., Vivekanandan, P., & Kundu, B. (2020) · doi:10.1101/2020.01.30.927871 · Cited by 198
RetractedA novel coronavirus from patients with pneumonia in China, 2019
Zhu, N., Zhang, D., Wang, W., Li, X., Yang, B., Song, J., Zhao, X., Huang, B., Shi, W., Lu, R., et al. (2020) · New England Journal of Medicine · doi:10.1056/nejmoa2001017 · Cited by 28,244
Modern Applied Statistics with S
Venables, W. N., & Ripley, B. D. (2002) · Statistics and Computing · doi:10.1007/978-0-387-21706-2 · Cited by 24,305
Coronaviridae Study Group of the International Committee on Taxonomy of Viruses, Gorbalenya, A. E., Baker, S. C., Baric, R. S., de Groot, R. J., Drosten, C., Gulyaeva, A. A., Haagmans, B. L., Lauber, C., Leontovich, A. M., et al. (2020) · Nature Microbiology · doi:10.1038/s41564-020-0695-z · Cited by 8,403
Isolation of a Novel Coronavirus from a Man with Pneumonia in Saudi Arabia
Zaki, A. M., van Boheemen, S., Bestebroer, T. M., Osterhaus, A. D. M. E., & Fouchier, R. A. M. (2012) · New England Journal of Medicine · doi:10.1056/nejmoa1211721 · Cited by 5,735 · cited 1×
“Although multiple coronaviruses are ubiquitous among humans and cause only mild disease, epidemics of newly emerging coronaviruses were previously observed in SARS in 2002 [5] and Middle East Respiratory Syndrome (MERS) in 2012 [6].”
BackgroundA Novel Coronavirus Associated with Severe Acute Respiratory Syndrome
Ksiazek, T. G., Erdman, D., Goldsmith, C. S., Zaki, S. R., Peret, T., Emery, S., Tong, S., Urbani, C., Comer, J. A., Lim, W., et al. (2003) · New England Journal of Medicine · doi:10.1056/nejmoa030781 · Cited by 4,344 · cited 1×
“Although multiple coronaviruses are ubiquitous among humans and cause only mild disease, epidemics of newly emerging coronaviruses were previously observed in SARS in 2002 [5] and Middle East Respiratory Syndrome (MERS) in 2012 [6].”
BackgroundKrämer, W. (2003) · Computational Statistics & Data Analysis · Cited by 1,858
COVID-19 antibody seroprevalence in santa clara county, california
Bendavid, E., Mulaney, B., Sood, N., Shah, S., Bromley-Dulfano, R., Lai, C., Weissberg, Z., Saavedra-Walker, R., Tedrow, J., Bogan, A., et al. (2021) · International Journal of Epidemiology · doi:10.1093/ije/dyab010 · Cited by 669 · cited 2×
“The most tweeted COVID-19 preprint (26,763 tweets) was a study investigating antibody seroprevalence in California [22].”
BackgroundInfluentialCOVID-19 Antibody Seroprevalence in Santa Clara County, CaliforniaPreprint
Bendavid, E., Mulaney, B., Sood, N., et al. (2020) · medRxiv · doi:10.1101/2020.04.14.20062463 · Cited by 559
Coronavirus: the spread of misinformation
Mian, A., & Khan, S. (2020) · BMC Medicine · doi:10.1186/s12916-020-01556-3 · Cited by 534
Research works printed but not linked: 5
- Kaiser J, 2014, Am 12:00. BioRxiv at 1 year: A promising start. In: Science | AAAS [Internet]. 11 Nov 2014 [cited 13 May 2020]. Available from: https://www.sciencemag.org/news/2014/11/biorxiv-1-year-promising-start
- D. Himmelstein, 2016, The licensing of bioRxiv preprints, Satoshi Village
- ASAPbio. Preprint authors optimistic about benefits: preliminary results from the #bioPreprints2020 survey. In: ASAPbio [Internet]. 27 Jul 2020 [cited 1 Feb 2021]. Available from: https://asapbio.org/biopreprints2020-survey-initial-results
- Inglis J. We’ve just put an additional, cautionary note about the use of preprints on every @biorxivpreprint https://t.co/08eSXL4dDi. In: Twitter [Internet]. 1 Feb 2020 [cited 22 May 2020]. Available from: https://twitter.com/johnringlis/status/1223598414493077505
- OASPA. COVID-19 Publishers Open Letter of Intent—Rapid Review. In: OASPA [Internet]. 27 May 2020 [cited 13 May 2020]. Available from: https://oaspa.org/covid-19-publishers-open-letter-of-intent-rapid-review/
Cited by
Items 401–500 of 554
Cenci, J., Correa, M. O. O., Júnior, F. A. V., Cenci, M. S., & Montagner, A. F. (2022) · Revista da Faculdade de Odontologia de Porto Alegre · doi:10.22456/2177-0018.118837 · Cited by 2
Vasconcelos, S. M. R. (2022) · Reciis · doi:10.29397/reciis.v16i3.3470 · Cited by 1
Open peer review: some considerations on the selection and management of reviewers
Capaccioni, A. (2022) · JLIS it · doi:10.36253/jlis.it-508 · Cited by 3
Open source COVID research and the long tail effect
Jones, C. L. (2020) · Journal of Human Virology & Retrovirology · doi:10.15406/jhvrv.2020.08.00222 · Cited by 1
Preprints optimize research communication
Packer, A. L. (2021) · Revista Habanera de Ciencias Médicas · Cited by 2
Pourret, O., Irawan, D. E., Shaghaei, N., van Rijsingen, E. M., & Besançon, L. (2022) · SocArXiv (OSF Preprints) · doi:10.31235/osf.io/fbzgc · Cited by 1
Reporting uncertified science in the news media during the Covid-19 pandemicPreprint
Schalkwyk, F. B. V., & Dudek, J. (2022) · doi:10.14293/111.000/000025.v1 · Cited by 1
Issues with Ethics in Research – A Case Study of the IHU Mediterranee InfectionPreprint
Frank, F., Florens, N., Barrière, J., Billy, É., Saada, V., Samuel, A., & Besançon, L. (2023) · doi:10.31219/osf.io/rymtz · Cited by 1
Das, S., & Gutam, S. (2023) · Research Square · doi:10.21203/rs.3.rs-2565275/v1 · Cited by 1
Das, S., & Gutam, S. (2023) · Research Square · doi:10.21203/rs.3.rs-2565275/v2 · Cited by 1
Gutam, S., & Das, S. (2023) · Research Square · doi:10.21203/rs.3.rs-2565275/v3 · Cited by 1
Broer, I., Lemke, S., Mazarakis, A., Peters, I., & Zinke-Wehlmann, C. (2023) · De Gruyter eBooks · doi:10.1515/9783110776546-202 · Cited by 1
The art of sharing: From research to outreach in the social media era
Mohammad, M., Mohamed, A. A., Dahmen, J., Bjerre-Bastos, J. J., & Pihl, A. F. (2025) · Experimental Physiology · doi:10.1113/ep092887 · Cited by 2
“Moreover,physiologists who have shared preliminary data on social media have observed spikes in readership, discussion and, eventually, citations (Eysenbach, 2011; Fraser et al., 2021; Pulido et al., 2018).”
PreprintToPaper dataset: connecting bioRxiv preprints with journal publications
Badalova, F., Sienkiewicz, J., & Mayr, P. (2026) · Scientific Data · doi:10.1038/s41597-026-06867-3 · Cited by 1
“Values: True (confirmed as correct match), False (not a valid match), or NA (uncertain).”
Let’s Do Better: Public Representations of COVID-19 SciencePreprint
AISDL (2020) · OSF Preprints · doi:10.31219/osf.io/3cpvs · Cited by 4
Faisons mieux les choses : représentation publique de la science sur la COVID-19Preprint
AISDL (2020) · OSF Preprints · doi:10.31219/osf.io/ancgv
Mycopathologia 2020: Legacy and Change to Remain Relevant for Content, Creation, and Communication
Bouchara, J., Chotirmall, S. H., Hagen, F., & Chaturvedi, V. P. (2021) · Mycopathologia · doi:10.1007/s11046-021-00531-7
Renn, O., Betschart, L., & Dolenc, J. (2021) · Nachrichten aus der Chemie · doi:10.1002/nadc.20214104183
Tracking the development of COVID-19 related PsyArXiv preprintsPreprint
Yesilada, M., Holford, D. L., Wulf, M., Hahn, U., Lewandowsky, S., Herzog, S. M., Radosevic, M., Stuchlý, E., Taylor, K. S., Ye, S., et al. (2021) · doi:10.31234/osf.io/evmgs
Preprint: already the bride or still the bridesmaid?
Vaish, A., Sharma, D., & Vaishya, R. (2021) · Postgraduate Medical Journal · doi:10.1136/postgradmedj-2021-140852
Medeiros, J. D. S., & Sánchez‐Tarragó, N. (2021) · Encontros Bibli Revista Eletrônica de Biblioteconomia e Ciência da Informação · doi:10.5007/1518-2924.2021.81917
Stephen, D. M. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2110.07950
“I retrieved the titles of the 411 BMC Psychology and 91 RIPR articles published since 2016, excluding articles with “COVID-19” in the title as peer review of this special topic may not reflect normal peer review practices (Fraser et al., 2021; S. Horbach, 2021).”
MethodYudhoatmojo, S. B., Cristofaro, E. D., & Blackburn, J. (2021) · arXiv (Cornell University)
Development of Virtual Artistic Gymnastics-Based Competitions in Central Java
Darmawan, A., Soenyoto, T., Putri, D. T., et al. (2021) · doi:10.4108/eai.28-4-2021.2312205
Innovative IOT Covid-19 Monitoring System to Ameliorate Medical Professionals
Alex, H. (2021) · International Journal of Computer Science and Mobile Computing · doi:10.47760/ijcsmc.2021.v10i12.004
Improving preprint withdrawals: A template based approachPreprint
Wright, J., & Hosseini, M. R. (2021) · doi:10.33774/coe-2021-9sccm
“…challenges are amplified by other, wider, identified issues with preprints and publishing practices in general: • Concerns that lack of public understanding about preprints introduces risks to public health and science communication (Sheldon, 2018; Fraser et al ., 2021; Teixeira da Silva, 2021).”
BackgroundThe Sustainability Argument for Open SciencePreprint
Govaart, G. H., Hofmann, S., & Medawar, E. (2021) · doi:10.31219/osf.io/abt8q
Kamath, P., Gudi, N., Staunton, C., Jacob, A. G., & John, O. (2022) · doi:10.2196/preprints.37460
Luo, K., Yang, Y., & Teo, H. (2022) · doi:10.2196/preprints.37331
Commonwealth Collaboration to Build Back Better
Haßler, B., & Education, O. D. &. (2022) · doi:10.53832/21ccem.1
Martin, L. M. A., & Buck, G. W. (2021) · Ethics in Biology Engineering and Medicine An International Journal · doi:10.1615/ethicsbiologyengmed.2022043551
Neil‐Sztramko, S., Belita, E., Traynor, R. L., Clark, E., Hagerman, L., & Dobbins, M. (2021) · Research Square · doi:10.21203/rs.3.rs-289581/v2 · Cited by 2
Препринты: история развития и современное состояниеPreprint
Зельдина, М. М. (2020) · doi:10.24108/preprints-3112149
Why UGC- CARE List of Journals & Good Academic Research Practices (GARP) Both are Archaic?Preprint
Raju, N. V., & Harinarayan, N. S. (2021) · OSF Preprints (OSF Preprints) · doi:10.31219/osf.io/x8w9k
Host, parasite, and failure at the colony level: COVID-19 and the US information ecosystemPreprint
Cohen, P. N. (2021) · SocArXiv (OSF Preprints) · doi:10.31235/osf.io/4hgam
McGuinness, L. A., & Sheppard, A. L. (2020) · doi:10.31222/osf.io/p75xe
Crise de la connaissance et connaissance de la crise
Chartron, G. (2022) · EMS Editions eBooks · doi:10.3917/ems.cappe.2022.01.0289
Suh, D. C., & Huh, S. Y. (2022) · Neurointervention · doi:10.5469/neuroint.2022.00297
Bürgi, C. R. S., & Wohlrabe, K. (2022) · SSRN Electronic Journal · doi:10.2139/ssrn.4136952
de Souza, A. F., & Zoppa, A. L. D. V. D. (2022) · Applied Veterinary Research · doi:10.31893/avr.2022008
Rákóczi, A., & Krizsán, A. (2021) · Polgári szemle · doi:10.24307/psz.2021.1008
Falyuna, N. (2022) · Magyar Tudomány · doi:10.1556/2065.183.2022.5.7
Acesso aberto, democratização do conhecimento e divulgação científica
Barata, G. (2022) · Boletim Técnico do PPEC · doi:10.20396/btp.v7i00.9467
How do we tell what’s true?Preprint
Cohen, P. N. (2022) · SocArXiv (OSF Preprints) · doi:10.31235/osf.io/nwe7b
COVID-19 pandemic as reflected in Advances in Clinical and Experimental Medicine
Kujawa, K., Misiak, M., & Kurpas, D. (2022) · Advances in Clinical and Experimental Medicine · doi:10.17219/acem/157447
Heyder, R. (2022) · Gesundheitsökonomie & Qualitätsmanagement · doi:10.1055/a-1954-9222
Protecting science in times of crises
Bravo, I. G., & Buton, F. (2022) · Anaesthesia Critical Care & Pain Medicine · doi:10.1016/j.accpm.2022.101187
Pourquoi, en France, une journée des revues contribuant à la santé publique ?
Henrard, J., Castel, P., & Lambert, A. (2022) · Santé Publique · doi:10.3917/spub.224.0457
Hosseini, F., Pashaeypoor, S., Poortaghi, S., Sharifi, F., & Poorcheraghi, H. (2023) · ranian Journal of Health Education and Health Promotion · doi:10.52547/ijhehp.11.1.5 · Cited by 1
Darmawan, A., Soenyoto, T., Putri, D., et al. (2023) · doi:10.4108/eai.29-6-2022.2326114
Indian COVID-19 Preprints Submissions in bioRxiv and medRxiv Preprint ServersPreprint
Raju, N. V., Adakawa, M. I., Harinarayana, N. S., & Chandrappa (2023) · medRxiv · doi:10.1101/2023.02.14.23285870
“Under traditional publishing condition, a manuscript takes at least 6 months of scrutiny by scientists (peers) (Fraser et al., 2021) using either blind, double, triple, etc. blind reviews depending upon the domain and quality of the manuscript.”
BackgroundHirschfeld, M. N. C., Faria, L. R. R., Gil, G. D. S., & Fonseca, C. R. (2023) · Ethnobiology and Conservation · doi:10.15451/ec2023-03-12.02-1-16
Research and discovery: Essential partners but just a start
Miller, S. M., Moos, W. H., Munk, B. H., Munk, S. A., Hart, C. P., & Spellmeyer, D. C. (2023) · Elsevier eBooks · doi:10.1016/b978-0-12-824304-6.00011-0
Graduate and postgraduate education at a crossroads
Miller, S. M., Moos, W. H., Munk, B. H., Munk, S. A., Hart, C. P., & Spellmeyer, D. C. (2023) · Elsevier eBooks · doi:10.1016/b978-0-12-824304-6.00009-2
Preprint of Obstetrics and Gynecology Articles During and After the COVID-19 Pandemic
Keikha, F., Salari, Y., Salari, Y., et al. (2023) · Fertility Gynecology and Andrology · doi:10.5812/fga-135333
Current concerns on journal article with preprint: Korean Journal of Internal Medicine perspectives
Oh, H., & Kang, H. (2023) · The Korean Journal of Internal Medicine · doi:10.3904/kjim.2023.099 · Cited by 1
“Although the COVID-19 pandemic highlighted the benefits of preprints, including the rapid and open communication of research findings [5-7], concerns remain that early and open public access to preliminary medical research may harm patients or public health practices, by possibly expediting a misleading finding or fau…”
BackgroundOverview and Trends on Sleep and COVID-19 Publication Output
Pires, G. N., & Tufik, S. (2023) · Progress in Sleep Research · doi:10.1007/978-981-99-0240-8_25
Is the acceptance time shorter for submission with preprints?
Li, J., 田, 丹., & Liu, X. (2023) · International Conference on Science, Technology and Innovation Indicators (STI) · doi:10.55835/643e44b060d8975d0b762e74
Modified COVID-19 Mortality Scoring as a Mortality Prognostic in COVID-19 Patients
Lestari, R. P., Harinawantara, B. H., Damarjati, K. R., et al. (2022) · Academic Hospital Journal · doi:10.22146/ahj.v4i1.72845
Morin, C., Padki, A., Wong, A., Miano, T. A., Kane‐Gill, S. L., Cozzi, G., & Deveau, R. (2023) · Journal of Intensive Care Medicine · doi:10.1177/08850666231182563
“5 (137-158) 115 (68-126) 103 (80-222) 116 (87-124) 79 (38-112) Median Altmetric Attention Score, (IQR) 387 (194-581) 50 (8-238) 2611 (441-3532) 10 (2-81) 1 (1-478) Median Turnitin similarity, (%) 40.”
BackgroundSiemens, W., Bantle, G., Mahler, S., Nothacker, J., Stadelmaier, J., Bitzer, E. M., Schmucker, C. M., & Meerpohl, J. J. (2023) · SSRN Electronic Journal · doi:10.2139/ssrn.4499145
Using R to develop a corpus of full-text journal articles
Anderson, B. S., Bani-Yaghoub, M., Kantheti, V., & Curtis, S. (2023) · Journal of Information Science · doi:10.1177/01655515231171362
“Within the first 10 months of the first reported COVID-19 case, as many as 125,000 scientific articles related to the pandemic were published [5].”
An Open Access Strategy for the Drug Repurposing CommunityPreprint
Dawson, S. (2023) · doi:10.14293/s2199-1006.1.sor-.ppxiw81.v1
An Open Access Strategy for the Drug Repurposing CommunityPreprint
Dawson, S. (2023) · doi:10.58647/drugarxiv.pr000001.v1
Women and The Poverty Trap (Study on The South Merapi Slope)
Hastuti, H., & Sutrisnowati, S. A. (2023) · Geosfera Indonesia · doi:10.19184/geosi.v8i2.34798
“The current pandemic caused by the influenza virus SARS-CoV-2, coronavirus 2019 became the most contagious disease in history (Jin et al., 2020; Lai et al., 2020; Mckenzie & Adams, 2020; Wang et al., 2020; Forati & Ghose, 2021; Fraser et al., 2021; Grekousis et al., 2021; Suryasa et al., 2021).”
Using Natural Language Processing for Context Identification in COVID-19 Literature
Carvalho, F. C., Mariano, D., Bomfim, M., Maia, G. D. C. F., Bastos, L. L., de Abreu, A. P., Paixão, V. M., dos Santos, L. M., Silva, J. M. D., Puelles, A. L. A., et al. (2023) · Lecture notes in computer science · doi:10.1007/978-3-031-42715-2_7
Identification and categorization of iterative preprints in the life sciencesPreprint
Besançon, L., Carmali, S., Castelloe, A. A., Dine, R. D., Manna, D., Nandi, S., Polka, J., Puebla, I., Shelley, R., Tsagakis, I., et al. (2023) · doi:10.31219/osf.io/sqeg4
Self-citationBroer, I. (2023) · De Gruyter eBooks · doi:10.1515/9783110776546-002 · Cited by 1
Describing the landscape of medical education preprints on medRxivPreprint
Maggio, L. A., Costello, J. A., & Artino, A. R. (2023) · medRxiv · doi:10.1101/2023.10.19.23297205
“14,45,47 These and many other questions about preprints and their use should be collectively answered by the medical education community.”
Public perception of scientific advisory bodies: the case of France’s Covid-19 Scientific Council
Schultz, É., Ward, J. K., & Atlani-Duault, L. (2023) · Science and Public Policy · doi:10.1093/scipol/scad067
A more open future for nuclear science and technology
Little, R., Wright, G. P., Merzari, E., et al. (2023) · Nuclear Science and Technology Open Research · doi:10.12688/nuclscitechnolopenres.17478.1
Riyatno, A. A., & Juariyah, J. (2023) · Jurnal Bisnis dan Komunikasi Digital · doi:10.47134/jbkd.v1i2.1921 · Cited by 3
“Sebagai seorang pemimpin, pemilik UD Akar Dewa Jati tentu memiliki peranan yang sangat penting dalam mewujudkan hubungan yang baik antara seorang pimpinan dengan bawahan/karyawannya (Fraser, 2021).”
BackgroundSiemens, W., Bantle, G., Mahler, S., Nothacker, J., Stadelmaier, J., Bitzer, E. M., Schmucker, C. M., & Meerpohl, J. J. (2023) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2023.111236 · Cited by 2
Quality control of research data during the pandemic: A case study of retracted COVID-19 papers
(2023) · Data Science and Informetrics · doi:10.59494/dsi.2023.4.4
The impact of COVID-19 on the debate on open science: An analysis of expert opinionPreprint
Marshall, M. B., Pinfield, S., Abbott, P., Cox, A. M., Alperín, J. P., Barata, G., Chtena, N., Dorsch, I., Fleerackers, A., de Oliveira, M. B., et al. (2024) · doi:10.31235/osf.io/xy874
Norris, E., O’Mahony, A., Coyne, R., Varol, T., Green, J., Reynolds, J., & Toomey, E. C. (2024) · doi:10.31234/osf.io/bgudc
Can machine learning algorithms predict publication outcomes? A case study of COVID-19 preprints
Koneru, S., Wei, X. S., Wu, J. F., & Rajtmajer, S. M. (2023) · IEEE ... International Conference on Data Mining workshops · doi:10.1109/icdmw60847.2023.00138
“Of 125,000 COVID-19–related scientific articles published within 10 months of the first confirmed case, more than 30,000 were hosted by preprint servers [4].”
BackgroundBrown, D., Uddin, M., Al-Hossami, E., Janies, D. A., Shaikh, S., & Cheng, Z. (2024) · ASEE Annual Conference & Exposition · doi:10.18260/1-2--41892
Brown, D. C., Al-Hossami, E., Cheng, Z., Alameda, A., Johnson, T., Uddin, M., & Janies, D. A. (2024) · ASEE Annual Conference & Exposition · doi:10.18260/1-2--42441
Kapp, P., Esmail, L. C., Ghosn, L., Ravaud, P., & Boutron, I. (2022) · Figshare · doi:10.6084/m9.figshare.21207016
Peer review vs Publish all – Navigating the changing landscape of scientific publication
Pretorius, M. (2024) · South African Journal of Science · doi:10.17159/sajs.2024/17103 · Cited by 1
Hagerman, L., Clark, E., Neil‐Sztramko, S., Colangeli, T., & Dobbins, M. (2024) · BMC Medical Research Methodology · doi:10.1186/s12874-024-02246-x · Cited by 1
“However, preprints offered the quickest means for newly emerging evidence to be disseminated and made accessible to others [34, 35].”
BackgroundSystemic vasculitis in Kazakhstan: a complex research approach
Auanassova, A. (2024) · Central Asian Journal of Medical Hypotheses and Ethics · doi:10.47316/cajmhe.2024.5.2.01
Clinical outcomes and considerations in outpatient with COVID‐19 receiving remdesivir therapy
Siami, Z., Rasooli, A., Zebardast, J., et al. (2024) · Health Science Reports · doi:10.1002/hsr2.2252
Gray Goldmine: Charting the Course to Engineering Literature’s Treasures
Niehof, J., Barbrow, S., Grochowski, P., et al. (2024) · ASEE Annual Conference & Exposition · doi:10.18260/1-2--47513
-, M. M., & -, J. W. (2024) · International Journal For Multidisciplinary Research · doi:10.36948/ijfmr.2024.v06i04.25106
“Fraser et al., (2021) argues that a self-administered questionnaire is the only way to get individuals to be honest about their thoughts, feelings, and values.”
BackgroundTracking the Development of COVID-19-related PsyArXiv Preprints
Wulf, M., Yesilada, M., Holford, D. L., Abels, C. M., Radosevic, M., Stuchlý, E., Taylor, K. S., Ye, S., Saxena, G., El-Halaby, G., et al. (2024) · Collabra Psychology · doi:10.1525/collabra.121378
“Preprints have also been critiqued and assessed amongst the scientific community on social media platforms such as Twitter (Carlson & Harris, 2020), with preprints on COVID-19 receiving more attention than non-COVID preprints (Fraser et al., 2021).”
BackgroundSalsabila, N. B., Jalaludin, J., Suhaimi, N. F., Mansor, W. N. W., & Sumantri, A. (2024) · International Journal of Environmental Health Research · doi:10.1080/09603123.2024.2390479
“It has caused 2.2 million deaths and 98 million positive cases, since January 2020, all of which are life-threatening (Fraser et al. 2021).”
InfluentialDias, K. A. D. N., & Nobre, F. R. F. (2024) · Monções Revista de Relações Internacionais da UFGD · doi:10.30612/rmufgd.v12i24.17390
Sharp, M. K., Logullo, P., Murphy, P., Baral, P., Burke, S., Grimes, D. R., Ryan, M., & Clyne, B. (2024) · HRB Open Research · doi:10.12688/hrbopenres.13895.3 · Cited by 1
“Preprints played an unprecedented role in disseminating Covid-19 research 47 , so we will include them in our dataset, account for this in statistical analyses, and explicitly disclose this preprint prevalence in our dataset, and frame our findings with this in mind.”
Partially or fully (“silently”) withdrawn or retracted Center for Open Science preprints
da Silva, J. A. T. (2024) · Central Asian Journal of Medical Hypotheses and Ethics · doi:10.47316/cajmhe.2024.5.4.05
Kim, D. H., Jeon, K. L., & You, S. C. (2025) · medRxiv · doi:10.1101/2025.01.04.25319994
Pantano, D., Davis, R. J., Vitali, S., Carrara, E., Górska, A., Carra, L., Niesters, H. G. M., Agodi, A., Kochs, E. F., Niedźwiedzka‐Rystwej, P., et al. (2025) · Research Square · doi:10.21203/rs.3.rs-5615137/v1
Metadata
- Authors
- Fraser, N., Brierley, L., Dey, G., Polka, J. K., Pálfy, M., Nanni, F., & Coates, J. A.
- Affiliations
- ZBW – Leibniz-Informationszentrum Wirtschaft (DE)
- University of Liverpool (GB)
- MRC Laboratory for Molecular Cell Biology (GB)
- ASAPbio (US)
- Company of Biologists (GB)
- The Alan Turing Institute (GB)
- Queen Mary University of London (GB)
- Corresponding author
- Coates, Jonathon Alexis
- ORCID
- Venue
- PLOS Biology
- Publisher
- Public Library of Science (PLoS)
- Published
- 2021-04-02
- Volume
- 19
- Issue
- 4
- Pages
- e3000959
- ISSN
- 1544-9173 (ISSN-L)
- 1545-7885
- PMC
- PMC8046348
- OpenAlex
- W3150044582
- Cited by
- 555
- References
- 49
- Citations by year
- 2026: 30 · 2025: 61 · 2024: 86 · 2023: 128 · 2022: 129 · 2021: 96
- FWCI
- 94.62
- Type
- journal article
- Language
- en
- Update notices
- new_version (2021-04-14)
- Open access
- gold
- doi.org
- Licence
- Locations
- PLoS Biology (publishedVersion, cc-by)
- bioRxiv (Cold Spring Harbor Laboratory) (acceptedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- ZBW Publication Archive (ZBW – Leibniz Information Centre for Economics) (acceptedVersion, cc-by)
- Queen Mary Research Online (Queen Mary University of London) (submittedVersion, cc-by)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Apollo (University of Cambridge) (submittedVersion, cc-by)
- Apollo
- Funders
- OASE (01PU17005B, 01PU17011D)
- Medical Research Council (MR/T027355/1)
- Topics
- Social Sciences › Library and Information Sciences › Academic Publishing and Open Access
- Social Sciences › Library and Information Sciences › scientometrics and bibliometrics research
- Health Sciences › Medicine › Infectious Diseases › SARS-CoV-2 and COVID-19 Research
- Keywords
- preprints, COVID-19 research, preprint servers, bioRxiv, medRxiv, science communication, SARS-CoV-2, public engagement with science
- MeSH terms
- Preprints as Topic, COVID-19, SARS-CoV-2, Communication, Humans, Publishing, Peer Review, Research, Information Dissemination, Biomedical Research, Pandemics, Open Access Publishing
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
The claim verdicts this report counts are experimental: their accuracy is not yet measured.
A language model drew the claims from the paper on 2026-10-10, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-10-10 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Cited sources are checked with a language model’s help (gpt-6-sol).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.