The evolving role of preprints in the dissemination of COVID-19 research and their impact on the science communication landscape
Open accessPublished version of a preprint
The DOI matches its Crossref record; 56 of the 56 references it cites were found in a registry or an index; 20 of the 41 sources its claims cite were checked for support.
Abstract
The world continues to face a life-threatening viral pandemic. The virus underlying the Coronavirus Disease 2019 (COVID-19), Severe Acute Respiratory Syndrome Coronavirus 2 (SARS-CoV-2), has caused over 98 million confirmed cases and 2.2 million deaths since January 2020. Although the most recent respiratory viral pandemic swept the globe only a decade ago, the way science operates and responds to current events has experienced a cultural shift in the interim. The scientific community has responded rapidly to the COVID-19 pandemic, releasing over 125,000 COVID-19–related scientific articles within 10 months of the first confirmed case, of which more than 30,000 were hosted by preprint servers. We focused our analysis on bioRxiv and medRxiv, 2 growing preprint servers for biomedical research, investigating the attributes of COVID-19 preprints, their access and usage rates, as well as characteristics of their propagation on online platforms. Our data provide evidence for increased scientific and public engagement with preprints related to COVID-19 (COVID-19 preprints are accessed more, cited more, and shared more on various online platforms than non-COVID-19 preprints), as well as changes in the use of preprints by journalists and policymakers. We also find evidence for changes in preprinting and publishing behaviour: COVID-19 preprints are shorter and reviewed faster. Our results highlight the unprecedented role of preprints and preprint servers in the dissemination of COVID-19 science and the impact of the pandemic on the scientific communication landscape.
Overview
CoChat Summary
TL;DR
This paper analyzes bioRxiv and medRxiv preprints during the first 10 months of the COVID-19 pandemic, showing that COVID-19 preprints were posted in large numbers and accessed, cited, shared, and used in policy documents far more than non-COVID-19 preprints. It also finds that COVID-19 preprints were shorter and published in journals faster than non-COVID-19 preprints.
Key findings
- By October 31, 2020, over 125,000 COVID-19 publications had appeared, including 30,260 preprints (~25%); bioRxiv and medRxiv hosted 10,232 COVID-19 preprints in the first 10 months, compared with 78 Zika virus and 10 Ebola virus preprints on bioRxiv during those outbreaks.
- COVID-19 preprints on bioRxiv/medRxiv were accessed more (abstract views rate ratio = 18.2; PDF downloads rate ratio = 27.1), cited more (57.9% vs 21.5% received ≥1 citation; rate ratio = 13.7), tweeted more (98.9% vs 90.7% received >1 tweet; rate ratio = 7.6), covered in news more (28.7% vs 1.0%; rate ratio = 92.8), and commented on more (15.9% vs 3.1%; rate ratio = 11.0).
- COVID-19 preprints were 32% shorter than non-COVID-19 preprints (median 3,965 vs 5,427 words) and were published faster after posting (median 68 vs 116 days; 48-day difference); 21.1% of COVID-19 preprints were published by end of October vs 15.4% of non-COVID-19 preprints.
- Among COVID-19 corresponding authors, 85% were posting a bioRxiv/medRxiv preprint for the first time vs 69% of non-COVID-19 corresponding authors; 52 of 81 COVID-19 policy documents cited preprints, with medRxiv accounting for 209 of 255 preprint citations.
Methods
- Retrieved bioRxiv and medRxiv metadata via API through October 31, 2020 (N = 114,214 overall); comparative analysis used 44,503 preprints posted January–October 2020, of which 10,232 (23.0%) were classified as COVID-19 by keywords in titles/abstracts, plus a January–December 2019 control set (N = 30,094).
- Enhanced metadata with ROR affiliation matching, Crossref, Unpaywall, Dimensions citation data, Altmetric mentions, Disqus comment counts, and scraped bioRxiv/medRxiv usage data; policy analysis manually collected 81 COVID-19 and 38 non-COVID-19 policy documents.
- Used chi-squared tests, Mann–Whitney tests, Spearman correlations, time-adjusted negative binomial regressions, and 2-way ANOVAs with Tukey HSD post hoc comparisons.
Limitations
- Stated: COVID-19 classification relied on keyword matching of titles/abstracts at data extraction, so some early preprints revised to include COVID-19 keywords may have been captured; the tightly defined January–October 2020 window means preprints posted later had less time to accrue altmetric and usage metrics.
- Stated: policy document analysis was limited to a small set largely restricted to Europe, and whether preprint use in policy extends more globally remains to be explored; word and reference counts were limited to bioRxiv because medRxiv did not display full HTML texts.
- Evident: preprint publication status relied on bioRxiv/medRxiv DOI links and is likely an underestimate; Altmetric records only mentions it tracks, and missing responses were recorded as zero; the study is observational and does not establish causal effects of preprinting on later attention or publication outcomes.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Figures






Verification
Claims the paper makes
18 Valid · 1 Not valid · 14 Not checked · 141 Own results and interpretations
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“The COVID-19 crisis represents the first time that preprints have been widely used outside of specific communities to communicate during an epidemic.”
§ The evolving role of preprints in the dissemination of COVID-19 research and their impact on the science communication landscape > Introduction
What the sources say
- Not checked yetcites [13] Wellcome Trust. Sharing data during Zika and other global health emergencies | Wellcome. In: Wellcomeacuk [Internet]. 10 Feb 2016 [cited 13 May 2020]. Available from: https://wellcome.ac.uk/news/sharing-data-during-zika-and-other-global-health-emergencies
- Partly supportedcites [14] MA Johansson, 2018, An underutilized mechanism to accelerate outbreak science, PLoS Med sourceExperimental — accuracy not yet measured
The Summary points report that fewer than 5% of Ebola and Zika journal articles had been posted as preprints, and describe preprints as unfamiliar to many outside fields such as physics and statistics. That supports the claim’s contrast with earlier outbreaks. Published in 2018, the paper does not address preprint use during COVID-19 or establish that it was the first epidemic in which preprints were widely used outside those communities. (LLM, conf=0.87)
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
Every source the paper cites for this claim was checked and supports it.
In the paper
“The fourth most tweeted COVID-19 preprint was a widely criticised (and later withdrawn) study linking the SARS-CoV-2 spike protein to HIV-1 glycoproteins [23].”
§ The evolving role of preprints in the dissemination of COVID-19 research and their impact on the science communication landscape > Results > COVID-19 preprints were shared and cited more widely than non-COVID-19 preprints
What the sources say
- Supportedcites [23] P Pradhan, 2020, Uncanny similarity of unique inserts in the 2019-nCoV spike protein to HIV-1 gp120 and Gag, bioRxiv source
The source is the preprint identified in the citation: its title links the 2019-nCoV spike protein to HIV-1 gp120. The withdrawal notice (Abstract, no page) says the authors withdrew it in response to research-community comments on their approach and interpretation. The 'fourth most tweeted' ranking is the citing document’s characterization, not a finding attributed to this preprint. (LLM, conf=0.90)
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Rests on 2 assumptions not shown here.
- Supported
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“One of the primary concerns among authors around posting preprints is premature media coverage [16,31].”
§ The evolving role of preprints in the dissemination of COVID-19 research and their impact on the science communication landscape > Discussion
What the sources say
- Supportedcites [16] A Chiarelli, 2019, Scholarly Communication: An Exploratory Qualitative Study of Adoption, Practices, Drivers and Barriers, F1000Res source
In Results > Potential benefits and challenges of preprints (page not specified), the paper identifies media reporting of incorrect research as a frequently mentioned challenge and describes researchers’ concern that journalists could spread unreliable preprint findings. The Literature review (page not specified) explicitly describes the risk of uncertified science being reported prematurely in the media. (LLM, conf=0.88)
- Not matchedcites [31] ASAPbio. Preprint authors optimistic about benefits: preliminary results from the #bioPreprints2020 survey. In: ASAPbio [Internet]. 27 Jul 2020 [cited 1 Feb 2021]. Available from: https://asapbio.org/biopreprints2020-survey-initial-results
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Supported
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“Many of the negative hashtags have been perpetuated by public figures such as the former President of America and the right-wing media [35,36].”
§ The evolving role of preprints in the dissemination of COVID-19 research and their impact on the science communication landscape > Discussion
What the sources say
- Partly supportedcites [35] U. Yaqub, 2021, Tweeting During the Covid-19 Pandemic: Sentiment Analysis of Twitter Messages by President Trump, Digit Gov Res Pract sourceExperimental — accuracy not yet measured
The Discussion reports that Trump repeatedly used “Chinese virus” in tweets and employed negative rhetoric about China. It does not establish that these were hashtags or address their perpetuation by right-wing media. (LLM, conf=0.85)
- Not checked — no full text of the sourcecites [36] A Gruzd, 2020, Going viral: How a single tweet spawned a COVID-19 conspiracy theory on Twitter, Big Data Soc source
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Partly supported
Every source the paper cites for this claim was checked and supports it.
In the paper
“A recent study involving qualitative interviews of multiple research stakeholders found “early and rapid dissemination” to be among the most often cited benefits of preprints [16].”
§ The evolving role of preprints in the dissemination of COVID-19 research and their impact on the science communication landscape > Discussion
What the sources say
- Supportedcites [16] A Chiarelli, 2019, Scholarly Communication: An Exploratory Qualitative Study of Adoption, Practices, Drivers and Barriers, F1000Res source
The Methods (Analytical framework; page unavailable) report 38 semi-structured interviews with participants from multiple stakeholder groups. The Results (Potential benefits and challenges of preprints; page unavailable) identify early and rapid dissemination as the most frequently mentioned benefit. (LLM, conf=0.94)
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Supported
100 more claims · 6 with their cited sources checked
Create a free account to see all 174 claims and to verify the 2 references still open.
- Probably not a substantial claim. 30
- It may state two separate claims as one. 47
Statistics recomputed
Every reported test result, recomputed from its test statistic and degrees of freedom. A result shows as not adding up only once an independent check has confirmed it.
- Consistentz = 125reported p < .001 · recomputed p < .001
“z = 125.0, p < .001”
- Consistentz = 124.2reported p < .001 · recomputed p < .001
“z = 124.2, p < .001”
- Consistentz = 116.3reported p < .001 · recomputed p < .001
“z = 116.3, p < .001”
- Consistentz = 135.7reported p < .001 · recomputed p < .001
“z = 135.7, p < .001”
- Consistentz = 83.3reported p < .001 · recomputed p < .001
“z = 83.3, p < .001”
3 more recomputed tests
Create a free account to see every test the Stats check recomputed.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
Each contradiction between two passages listed here was confirmed by an independent check.
Rated major: it would touch a result — a value a result rests on, reported and recomputed p-values on opposite sides of the significance level, two passages that conflict with no sign which is right, or a cited work retracted before this paper was published.
In the paper
§ The evolving role of preprints in the dissemination of COVID-19 research and their impact on the science communication landscape > Results > COVID-19 preprints were shared and cited more widely than non-COVID-19 preprints
“we analysed the hashtags used in original tweets (i.e., excluding retweets) mentioning the top 100 most tweeted COVID-19 preprints (S4A Fig).”
§ The evolving role of preprints in the dissemination of COVID-19 research and their impact on the science communication landscape > Methods > Usage, altmetrics, and citation data
“we retrieved all tweets linking to the top 10 most-tweeted preprints.”
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
§ The evolving role of preprints in the dissemination of COVID-19 research and their impact on the science communication landscape > Results > Attributes of COVID-19 preprints posted between January and October 2020
“The majority of preprints existed as only a single version for both COVID-19 and non-COVID-19 works, with very few preprints existing in more than 2 versions (Fig 2C).”
§ The evolving role of preprints in the dissemination of COVID-19 research and their impact on the science communication landscape > Results > Attributes of COVID-19 preprints posted between January and October 2020
“(C) License type chosen by authors. (D) Number of versions per preprint.”
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
§ The evolving role of preprints in the dissemination of COVID-19 research and their impact on the science communication landscape > Results > COVID-19 preprints were shared and cited more widely than non-COVID-19 preprints
“the most commented non-COVID-19 preprint received only 68 comments, whereas the most commented COVID-19 preprint had over 580 comments (Table 5).”
§ The evolving role of preprints in the dissemination of COVID-19 research and their impact on the science communication landscape > Results > COVID-19 preprints were shared and cited more widely than non-COVID-19 preprints
“Table: Table 5 Top 10 most blogged COVID-19 preprints.”
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
§ The evolving role of preprints in the dissemination of COVID-19 research and their impact on the science communication landscape > Methods > Preprint metadata for bioRxiv and medRxiv
“For a subset of preprints posted between September 1, 2019 and April 30, 2020 (N = 25,883), we enhanced the basic preprint metadata with data from a number of other sources, as outlined below.”
§ The evolving role of preprints in the dissemination of COVID-19 research and their impact on the science communication landscape > Methods > Preprint metadata for bioRxiv and medRxiv
“In total, we matched 54,289 preprints to a country (72.8%); for COVID-19 preprints alone, 6,692 preprints (65.4%) were matched to a country.”
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
§ The evolving role of preprints in the dissemination of COVID-19 research and their impact on the science communication landscape > Results > COVID-19 preprints were shared and cited more widely than non-COVID-19 preprints
“whereas 8 of the top 10 tweeted COVID-19 preprints were tweeted over 10,500 times each (Table 2).”
§ The evolving role of preprints in the dissemination of COVID-19 research and their impact on the science communication landscape > Results > COVID-19 preprints were shared and cited more widely than non-COVID-19 preprints
“| 10 | medRxiv | 10.1101/2020.03.30.20048165 | Association of BCG vaccination policy with prevalence and mortality of COVID-19 | April 6, 2020 | 10,701 | 7 | 0 |”
1 more finding
Create a free account to see every finding of this check.
Cited works that were retracted
Works this paper cites that were later retracted, from the retraction notices publishers deposit. Major when the notice came out before this paper was published.
Rated major: it would touch a result — a value a result rests on, reported and recomputed p-values on opposite sides of the significance level, two passages that conflict with no sign which is right, or a cited work retracted before this paper was published.
In the paper
“Pradhan P, Pandey AK, Mishra A, Gupta P, Tripathi PK, Menon MB, et al. Uncanny similarity of unique inserts in the 2019-nCoV spike protein to HIV-1 gp120 and Gag. bioRxiv. 2020; 2020.01.30.927871. 10.1101/2020.01.30.927871 32511314”
Cited work 10.1101/2020.01.30.927871 · retracted 2020-02-02 · notice 10.1101/2020.01.30.927871 · this paper published 2021-04-02
Citations
Cites
1 retracted
Uncanny similarity of unique inserts in the 2019-nCoV spike protein to HIV-1 gp120 and Gag
Pradhan, P., Pandey, A. K., Mishra, A., Gupta, P., Tripathi, P. K., Menon, M. B., Gomes, J., Vivekanandan, P., & Kundu, B. (2020) · doi:10.1101/2020.01.30.927871 · Cited by 198
RetractedA novel coronavirus from patients with pneumonia in China, 2019
Zhu, N., Zhang, D., Wang, W., Li, X., Yang, B., Song, J., Zhao, X., Huang, B., Shi, W., Lu, R., et al. (2020) · New England Journal of Medicine · doi:10.1056/nejmoa2001017 · Cited by 28,244
Modern Applied Statistics with S
Venables, W. N., & Ripley, B. D. (2002) · Statistics and Computing · doi:10.1007/978-0-387-21706-2 · Cited by 24,305
Coronaviridae Study Group of the International Committee on Taxonomy of Viruses, Gorbalenya, A. E., Baker, S. C., Baric, R. S., de Groot, R. J., Drosten, C., Gulyaeva, A. A., Haagmans, B. L., Lauber, C., Leontovich, A. M., et al. (2020) · Nature Microbiology · doi:10.1038/s41564-020-0695-z · Cited by 8,403
Isolation of a Novel Coronavirus from a Man with Pneumonia in Saudi Arabia
Zaki, A. M., van Boheemen, S., Bestebroer, T. M., Osterhaus, A. D. M. E., & Fouchier, R. A. M. (2012) · New England Journal of Medicine · doi:10.1056/nejmoa1211721 · Cited by 5,735 · cited 1×
“Although multiple coronaviruses are ubiquitous among humans and cause only mild disease, epidemics of newly emerging coronaviruses were previously observed in SARS in 2002 [5] and Middle East Respiratory Syndrome (MERS) in 2012 [6].”
BackgroundA Novel Coronavirus Associated with Severe Acute Respiratory Syndrome
Ksiazek, T. G., Erdman, D., Goldsmith, C. S., Zaki, S. R., Peret, T., Emery, S., Tong, S., Urbani, C., Comer, J. A., Lim, W., et al. (2003) · New England Journal of Medicine · doi:10.1056/nejmoa030781 · Cited by 4,344 · cited 1×
“Although multiple coronaviruses are ubiquitous among humans and cause only mild disease, epidemics of newly emerging coronaviruses were previously observed in SARS in 2002 [5] and Middle East Respiratory Syndrome (MERS) in 2012 [6].”
BackgroundKrämer, W. (2003) · Computational Statistics & Data Analysis · Cited by 1,858
COVID-19 antibody seroprevalence in santa clara county, california
Bendavid, E., Mulaney, B., Sood, N., Shah, S., Bromley-Dulfano, R., Lai, C., Weissberg, Z., Saavedra-Walker, R., Tedrow, J., Bogan, A., et al. (2021) · International Journal of Epidemiology · doi:10.1093/ije/dyab010 · Cited by 669 · cited 2×
“The most tweeted COVID-19 preprint (26,763 tweets) was a study investigating antibody seroprevalence in California [22].”
BackgroundInfluentialCOVID-19 Antibody Seroprevalence in Santa Clara County, CaliforniaPreprint
Bendavid, E., Mulaney, B., Sood, N., et al. (2020) · medRxiv · doi:10.1101/2020.04.14.20062463 · Cited by 559
Coronavirus: the spread of misinformation
Mian, A., & Khan, S. (2020) · BMC Medicine · doi:10.1186/s12916-020-01556-3 · Cited by 534
Research works printed but not linked: 5
- Kaiser J, 2014, Am 12:00. BioRxiv at 1 year: A promising start. In: Science | AAAS [Internet]. 11 Nov 2014 [cited 13 May 2020]. Available from: https://www.sciencemag.org/news/2014/11/biorxiv-1-year-promising-start
- D. Himmelstein, 2016, The licensing of bioRxiv preprints, Satoshi Village
- ASAPbio. Preprint authors optimistic about benefits: preliminary results from the #bioPreprints2020 survey. In: ASAPbio [Internet]. 27 Jul 2020 [cited 1 Feb 2021]. Available from: https://asapbio.org/biopreprints2020-survey-initial-results
- Inglis J. We’ve just put an additional, cautionary note about the use of preprints on every @biorxivpreprint https://t.co/08eSXL4dDi. In: Twitter [Internet]. 1 Feb 2020 [cited 22 May 2020]. Available from: https://twitter.com/johnringlis/status/1223598414493077505
- OASPA. COVID-19 Publishers Open Letter of Intent—Rapid Review. In: OASPA [Internet]. 27 May 2020 [cited 13 May 2020]. Available from: https://oaspa.org/covid-19-publishers-open-letter-of-intent-rapid-review/
Cited by
Martín-Martín, A., Thelwall, M., Orduna-Malea, E., & Delgado López-Cózar, E. (2021) · Scientometrics · doi:10.1007/s11192-020-03690-4 · Cited by 1,018
Martín‐Martín, A., Thelwall, M. A., Orduña‐Malea, E., & Delgado López-Cózar, E. (2020) · LA Referencia (Red Federada de Repositorios Institucionales de Publicaciones Científicas) · Cited by 916
ChatGPT and the rise of large language models: the new AI-driven infodemic threat in public health
De Angelis, L., Baglivo, F., Arzilli, G., Privitera, G. P., Ferragina, P., Tozzi, A. E., & Rizzo, C. (2023) · Frontiers in Public Health · doi:10.3389/fpubh.2023.1166120 · Cited by 708
“In particular, health research has been strongly influenced by the mechanisms of dissemination of information regarding SARS-CoV-2 through preprint servers that often allowed for rapid media coverage and the consequent impact on individual health choices (6, 7).”
BackgroundCORD-19: The COVID-19 Open Research Dataset
Wang, L. L., Lo, K., Chandrasekhar, Y., Reas, R., Yang, J., Burdick, D., Eide, D., Funk, K., Katsis, Y., Kinney, R., et al. (2020) · arXiv · doi:10.48550/arxiv.2004.10706
Vuong, Q.-H., Le, T.-T., La, V.-P., Nguyen, H. T. T., Ho, M.-T., Van Khuc, Q., & Nguyen, M.-H. (2022) · Humanities and Social Sciences Communications · doi:10.1057/s41599-022-01034-6 · Cited by 344
Open science saves lives: lessons from the COVID-19 pandemic
Besançon, L., Peiffer-Smadja, N., Segalas, C., Jiang, H., Masuzzo, P., Smout, C., Billy, E., Deforet, M., & Leyrat, C. (2021) · BMC Medical Research Methodology · doi:10.1186/s12874-021-01304-y · Cited by 249
“However, Fraser et al [101] found that COVID-19 preprints were more commented (on preprint platforms) than non COVID-19 preprints.”
BackgroundResultInfluentialSquazzoni, F., Bravo, G., Grimaldo, F., García-Costa, D., Farjam, M., & Mehmani, B. (2021) · PLOS ONE · doi:10.1371/journal.pone.0257919 · Cited by 227
“Over 125,000 COVID-19–related papers were published in the first 10 months after the onset of the pandemic in 2020, of which more than 30,000 hosted by preprint servers [3].”
BackgroundThe impact of the COVID-19 pandemic on scientific research in the life sciences
Riccaboni, M., & Verginer, L. (2022) · PLOS ONE · doi:10.1371/journal.pone.0263001 · Cited by 226
Zhang, L., Carter, R. A., Qian, X., Yang, S., Rujimora, J., & Wen, S. (2022) · British Journal of Educational Technology · doi:10.1111/bjet.13191 · Cited by 221
The Pandemic Penalty: The Gendered Effects of COVID-19 on Scientific Productivity
King, M. M., & Frederickson, M. E. (2021) · Socius: Sociological Research for a Dynamic World · doi:10.1177/23780231211006977 · Cited by 203
Aviv-Reuven, S., & Rosenfeld, A. (2021) · Scientometrics · doi:10.1007/s11192-021-04059-x · Cited by 197
Publishing volumes in major databases related to Covid-19
da Silva, J. A. T., Tsigaris, P., & Erfanmanesh, M. (2020) · Scientometrics · doi:10.1007/s11192-020-03675-3 · Cited by 163
Fleerackers, A., Riedlinger, M. E., Moorhead, L. L., Ahmed, R., & Alperín, J. P. (2021) · Health Communication · doi:10.1080/10410236.2020.1864892 · Cited by 153
Preprints Involving Medical Research—Do the Benefits Outweigh the Challenges?
Flanagin, A., Fontanarosa, P. B., & Bauchner, H. (2020) · JAMA · doi:10.1001/jama.2020.20674 · Cited by 115
ChatGPT and the Rise of Large Language Models: The New AI-Driven Infodemic Threat in Public Health
De Angelis, L., Baglivo, F., Arzilli, G., Privitera, G. P., Ferragina, P., Tozzi, A. E., & Rizzo, C. (2023) · doi:10.2139/ssrn.4352931 · Cited by 708
Tracking changes between preprint posting and journal publication during a pandemic
Brierley, L., Nanni, F., Polka, J., Dey, G., Pálfy, M., Fraser, N., & Coates, J. A. (2022) · PLoS Biology · doi:10.1371/journal.pbio.3001285 · Cited by 103
“With a third of the early COVID-19 literature being shared as preprints [11], we assessed the differences between these preprints and their subsequently published versions and compared these results to a similar sample of non-COVID-19 preprints and their published articles.”
BackgroundMethodResultInfluentialSelf-citationA bibliometric analysis of COVID-19 research in Africa
Guleid, F. H., Oyando, R., Kabia, E., et al. (2021) · BMJ Global Health · doi:10.1136/bmjgh-2021-005690 · Cited by 81
Luo, S., Liang, Y., Wong, T. H. T., Schooling, C. M., & Yeung, S. L. A. (2022) · International Journal of Epidemiology · doi:10.1093/ije/dyac076 · Cited by 80
“Preprints are now increasingly used in the dissemination of COVID-19 research.(25) Two reviewers (T.”
MethodHekmatikar, A. H. A., Ferreira‐Júnior, J. B., Shahrbanian, S., & Suzuki, K. (2022) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph19042290 · Cited by 86
Vlasschaert, C., Topf, J. M., & Hiremath, S. S. (2020) · Advances in Chronic Kidney Disease · doi:10.1053/j.ackd.2020.08.003 · Cited by 78
Lessons from COVID-19 for managing transboundary climate risks and building resilience
Ringsmuth, A. K., Otto, I. M., van den Hurk, B., Lahn, G., Reyer, C., Carter, T. R., Magnuszewski, P., Monasterolo, I., Aerts, J. C. J. H., Benzie, M., et al. (2022) · Climate Risk Management · doi:10.1016/j.crm.2022.100395 · Cited by 71
“Researchers used online preprint servers to share research results more quickly than is usually possible through academic journals(98,99) (although the absence of peer review means that sharing results in this way requires safeguards against overinterpretation of preliminary findings, including careful communication a…”
Open Science Saves Lives: Lessons from the COVID-19 PandemicPreprint
Besançon, L., Peiffer‐Smadja, N., Ségalas, C., Jiang, H., Masuzzo, P., Smout, C., Billy, É., Déforet, M., & Leyrat, C. (2020) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2020.08.13.249847 · Cited by 59
Biosecurity in an age of open science
Smith, J. A., & Sandbrink, J. B. (2022) · PLoS Biology · doi:10.1371/journal.pbio.3001600 · Cited by 64
“Preprints may have played an important role in scientific and public engagement with COVID-19 research [29].”
Backgroundthe COVID-19 NMA Consortium, Oikonomidi, T., Boutron, I., Pierre, O., Cabanac, G., & Ravaud, P. (2020) · BMC Medicine · doi:10.1186/s12916-020-01880-8 · Cited by 54
Kodvanj, I., Homolak, J., Virag, D., & Trkulja, V. (2022) · Scientometrics · doi:10.1007/s11192-021-04249-7 · Cited by 61
“, overflow of publications on various aspects of COVID-19 disease and suggested (Fraser et al., 2021; Fu & Hughey, 2019) concurrent changes in preprinting of biomedical manuscripts, we considered that three questions deserved to be addressed: (i) are COVID-19-related manuscripts preferred for journal publishing over t…”
BackgroundInfluentialAn Alert to COVID-19 Literature in Predatory Publishing Venues
da Silva, J. A. T. (2020) · The Journal of Academic Librarianship · doi:10.1016/j.acalib.2020.102187 · Cited by 55
Let’s do better: public representations of COVID-19 science
Caulfield, T., Bubela, T. M., Kimmelman, J., & Ravitsky, V. (2021) · FACETS · doi:10.1139/facets-2021-0018 · Cited by 67
Lessons from the influx of preprints during the early COVID-19 pandemic
Brierley, L. (2021) · The Lancet Planetary Health · doi:10.1016/s2542-5196(21)00011-5 · Cited by 54
Self-citationComparison of Clinical Study Results Reported in medRxiv Preprints vs Peer-reviewed Journal Articles
Janda, G., Khetpal, V., Shi, X., Ross, J. S., & Wallach, J. D. (2022) · JAMA Network Open · doi:10.1001/jamanetworkopen.2022.45847 · Cited by 48
“of preprint versions, median (range) (n = 547) 1 (1-5) No.”
BackgroundReal-Time Bibliometrics: Dimensions as a Resource for Analyzing Aspects of COVID-19
Hook, D. W., Porter, S., Draux, H., & Herzog, C. (2021) · Frontiers in Research Metrics and Analytics · doi:10.3389/frma.2020.595299 · Cited by 63
An evaluation of prospective COVID-19 modelling studies in the USA: from data to science translation
Nixon, K., Jindal, S., Parker, F., Reich, N. G., Ghobadi, K., Lee, E. C., Truelove, S., & Gardner, L. (2022) · The Lancet Digital Health · doi:10.1016/s2589-7500(22)00148-0 · Cited by 59
How covid-19 bolstered an already perverse publishing system
Clark, J. (2023) · BMJ · doi:10.1136/bmj.p689 · Cited by 49
Frampton, G. K., Woods, L., & Scott, D. A. (2021) · PLoS ONE · doi:10.1371/journal.pone.0258935 · Cited by 58
Motivations, concerns and selection biases when posting preprints: A survey of bioRxiv authors
Fraser, N., Mayr, P., & Peters, I. (2022) · PLoS ONE · doi:10.1371/journal.pone.0274441 · Cited by 56
“The use and visibility of preprints has been growing in recent years, and the last year in particular has seen a surge of preprints published in response to the COVID-19 pandemic (Fraser et al., 2021).”
BackgroundSelf-citationEckmann, P., & Bandrowski, A. E. (2023) · PLoS ONE · doi:10.1371/journal.pone.0281659 · Cited by 54
“This initial growth was greatly accelerated by the COVID-19 pandemic, where fast dissemination of research was critical [22] and together, these servers now have over 20,000 COVID-19 related preprints [23].”
BackgroundRobustness of evidence reported in preprints during peer review
Nelson, L., Ye, H., Schwenn, A., Lee, S., Arabi, S., & Hutchins, B. I. (2022) · The Lancet Global Health · doi:10.1016/s2214-109x(22)00368-0 · Cited by 51
COVID-19 and the scientific publishing system: growth, open access and scientific fields
Nane, G. F., Robinson‐García, N., Schalkwyk, F. B. V., & Torres‐Salinas, D. (2022) · Scientometrics · doi:10.1007/s11192-022-04536-x · Cited by 63
“Indeed, while COVID-19 preprints increased, so did journal articles (Fraser et al., 2021).”
BackgroundInfluentialLoubere, L., Kasparian, S., & Ashkar, F. (2018) · Les cahiers du journalisme · doi:10.31188/cajsm · Cited by 42
The Covid infodemic: Competition and the hyping of virus research
Hyland, K., & Jiang, F. K. (2021) · International Journal of Corpus Linguistics · doi:10.1075/ijcl.20160.hyl · Cited by 43
COVID-19 Vaccine Hesitancy and Emerging Variants: Evidence from Six Countries
Mangla, S., Makkia, F. T. Z., Pathak, A. K., Robinson, R. F., Sultana, N., Koonisetty, K. S., Karamehić-Muratović, A., Nguyen, U., Rodriguez-Morales, A. J., Sánchez‐Duque, J. A., et al. (2021) · Behavioral Sciences · doi:10.3390/bs11110148 · Cited by 44
“Meanwhile, more than 200,000 COVID-19-related scientific articles were released [11].”
BackgroundDay-to-day discovery of preprint–publication links
Cabanac, G., Oikonomidi, T., & Boutron, I. (2021) · Scientometrics · doi:10.1007/s11192-021-03900-7 · Cited by 50
The importance of trustworthiness: lessons from the COVID-19 pandemic
Leonard, M. B., Pursley, D. M., Robinson, L. A., Abman, S. H., & Davis, J. M. (2021) · Pediatric Research · doi:10.1038/s41390-021-01866-z · Cited by 49
“Although preprints are essential in allowing scientists and public health officials to get an early look at the clinical manifestations and epidemiology of COVID-19, they have changed the landscape of scientific communication.(22) Hashtags associated with an individual, highly tweeted reprint revealed emergent themes…”
BackgroundNeil‐Sztramko, S., Belita, E., Traynor, R. L., Clark, E., Hagerman, L., & Dobbins, M. (2021) · BMC Medical Research Methodology · doi:10.1186/s12874-021-01436-1 · Cited by 42
The social contract for science and the value-free ideal
Douglas, H., & Branch, T. Y. (2024) · Synthese · doi:10.1007/s11229-023-04477-9 · Cited by 41
“Seeing the Deficit Model as a product of the social contract for science, and revising the contract, could allow for better models of scientific communication to emerge (see, e.g., Fraser et al., 2021 ; Hyland-Wood et al., 2021 ; Irwin, 1995 ).”
Analyzing and visualizing global research trends on COVID-19 linked to sustainable development goals
Zyoud, S. H. (2022) · Environment Development and Sustainability · doi:10.1007/s10668-022-02275-w · Cited by 45
Riedel, N., Wieschowski, S., Brückner, T., Holst, M., Kahrass, H., Nury, E., Meerpohl, J. J., Salholz‐Hillel, M., & Strech, D. (2021) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2021.12.012 · Cited by 46
Wingen, T., Berkessel, J. B., & Dohle, S. (2022) · Advances in Methods and Practices in Psychological Science · doi:10.1177/25152459211070559 · Cited by 42
Metagenomic pathogen sequencing in resource-scarce settings: Lessons learned and the road ahead
Yek, C., Pacheco, A. R., Vanaerschot, M., Bohl, J. A., Fahsbender, E., Aranda-Díaz, A., Lay, S., Chea, S., Oum, M. H., Lon, C., et al. (2022) · Frontiers in Epidemiology · doi:10.3389/fepid.2022.926695 · Cited by 42
“The COVID-19 pandemic democratized access because all major journals made COVID-19-related material freely available, and global use of preprint servers for submitted manuscripts soared (97, 98).”
BackgroundPreprints: Their Evolving Role in Science Communication
Puebla, I., Polka, J., & Rieger, O. Y. (2022) · doi:10.3998/mpub.12412508 · Cited by 48
Self-citationUsing preprints in evidence synthesis: Commentary on experience during the COVID-19 pandemic
Clyne, B., Walsh, K. A., Murchú, É. Ó., Sharp, M. K., Comber, L., O’Brien, K. K., Smith, S. M., Harrington, P., O’Neill, M., Teljeur, C., et al. (2021) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2021.05.010 · Cited by 34
Reporting preprints in the media during the COVID-19 pandemic
Schalkwyk, F. B. V., & Dudek, J. (2022) · Public Understanding of Science · doi:10.1177/09636625221077392 · Cited by 41
“As a result, preprints have taken on an important role in the rapid dissemination of science (Chiarelli et al., 2019) and during the COVID-19 pandemic in particular (Coates, 2021; Fraser et al., 2021; Sohrabi et al., 2021).”
BackgroundMalički, M., Costello, J., Alperin, J. P., & Maggio, L. A. (2020) · doi:10.1101/2020.10.14.340083 · Cited by 35
Real-time COVID-19 forecasting: challenges and opportunities of model performance and translation
Nixon, K., Jindal, S., Parker, F., Marshall, M., Reich, N. G., Ghobadi, K., Lee, E. C., Truelove, S., & Gardner, L. (2022) · The Lancet Digital Health · doi:10.1016/s2589-7500(22)00167-4 · Cited by 34
OECD Science, Technology and Innovation Outlook
OECD (2016) · OECD science, technology and innovation outlook · doi:10.1787/25186167 · Cited by 34
Analysis of single comments left for bioRxiv preprints till September 2019
Malički, M., Costello, J., Alperin, J. P., & Maggio, L. A. (2021) · Biochemia medica · doi:10.11613/bm.2021.020201 · Cited by 35
McGuinness, L. A., & Sheppard, A. L. (2021) · PLOS ONE · doi:10.1371/journal.pone.0250887 · Cited by 33
Bibliometric and Altmetric Analysis of Retracted Articles on COVID-19
Khan, H., Gupta, P., Zimba, O., & Gupta, L. (2022) · Journal of Korean Medical Science · doi:10.3346/jkms.2022.37.e44 · Cited by 41
Institutionalizing Open Science in Africa: Limitations and Prospects
Okafor, I. A., Mbagwu, S. I., Chia, T. I., Hasim, Z., Udokanma, E. E., & Chandran, K. (2022) · Frontiers in Research Metrics and Analytics · doi:10.3389/frma.2022.855198 · Cited by 54
“Similarly, some academic publishers have come together to support preprints to expedite knowledge transfer (Puebla, 2020; Fraser et al., 2021; Hayashi, 2021), and open-access policies to encourage the sharing of information that enable researchers to learn and synthesize from the emerging evidence (Kadakia et al.”
BackgroundHennrich, A. A., Sawatsky, B., Santos-Mandujano, R., Banda, D. H., Oberhuber, M., Schopf, A., Pfaffinger, V., Wittwer, K., Riedel, C., Pfaller, C. K., et al. (2021) · PLOS Pathogens · doi:10.1371/journal.ppat.1009064 · Cited by 30
Science in motion: A qualitative analysis of journalists’ use and perception of preprints
Fleerackers, A., Moorhead, L. L., Maggio, L. A., Fagan, K., & Alperín, J. P. (2022) · PLoS ONE · doi:10.1371/journal.pone.0277769 · Cited by 39
“As early as January 2020, scientists across the disciplinary spectrum began posting preprints in numbers not seen before [8–10], and COVID-19-related preprints soon surpassed those on other subjects in terms of uploads, views, downloads, comments, and citations [11].”
BackgroundAn analysis of the effects of sharing research data, code, and preprints on citations
Colavizza, G., Cadwallader, L., LaFlamme, M., Dozot, G., Lecorney, S., Rappo, D., & Hrynaszkiewicz, I. (2024) · PLoS ONE · doi:10.1371/journal.pone.0311493 · Cited by 44
“This effect was examined in detail during the COVID-19 pandemic [46], when media coverage of health-related preprints also saw a significant uptick [47].”
Messing with Merton: The intersection between open science practices and Mertonian values
Hosseini, M., Hidalgo, E. S., Horbach, S. P. J. M., Güttinger, S., & Penders, B. (2022) · Accountability in Research · doi:10.1080/08989621.2022.2141625 · Cited by 43
“Indeed, pre-prints are a manifestation of researchers’ desire for timely sharing and it is little surprise perhaps that they became vastly more prominent in times of emergency, such as the COVID-19 pandemic (Else 2020; Fraser et al. 2021).”
BackgroundPreprints: Their Evolving Role in Science CommunicationPreprint
Puebla, I., Polka, J., & Rieger, O. Y. (2021) · MetArXiv (OSF Preprints) · doi:10.31222/osf.io/ezfsk · Cited by 32
Self-citationKelly, J. D., Curteis, T., Rawal, A., Murton, M., Clark, L. J., Jafry, Z., Gupta, R. S., Berry, M., Espinueva, A., Chen, L., et al. (2023) · European Respiratory Review · doi:10.1183/16000617.0254-2022 · Cited by 38
Messing with Merton: The intersection between Open Science practices and Mertonian values
Hosseini, M., Senabre Hidalgo, E., Horbach, S. P. J. M., Guttinger, S., & Penders, B. (2022) · doi:10.31235/osf.io/9nyh8 · Cited by 30
da Silva, J. A. T. (2020) · Online Information Review · doi:10.1108/oir-08-2020-0371 · Cited by 28
Preprint paper platforms in the academic scholarly communication environment
Chaleplioglou, A., & Koulouris, A. (2021) · Journal of Librarianship and Information Science · doi:10.1177/09610006211058908 · Cited by 36
Hamilton, D. G., Page, M. J., Finch, S. J., Everitt, S., & Fidler, F. M. (2022) · BMC Medicine · doi:10.1186/s12916-022-02644-2 · Cited by 51
“Particularly as journals take on stronger positions on data availability, and as the uptake of other open science practices such as preprinting have substantially increased [62, 63].”
BackgroundJahn, N., Matthias, L., & Laakso, M. (2021) · Journal of the Association for Information Science and Technology · doi:10.1002/asi.24549 · Cited by 41
“Previous research, while lacking dedicated studies on license selection, suggests that authors tend to select more restrictive license variants when given a choice (Fraser et al., 2021; Noorden, 2013; Rowley et al., 2017).”
McDonald, S. J., Sharp, S., Morgan, R. L., Murad, M. H., & Navarro, D. F. (2023) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2022.12.023 · Cited by 29
Baždarić, K., Vrkić, I., Arh, E., Mavrinac, M., Marković, M. G., Bilić-Zulle, L., Stojanovski, J., & Malički, M. (2021) · PLoS ONE · doi:10.1371/journal.pone.0244529 · Cited by 28
Páez, A. (2021) · Geographical Analysis · doi:10.1111/gean.12307 · Cited by 27
“According to Fraser et al. (2021), over 125,000 COVID- 19- related papers were released in the first 10 months from the first confirmed case of the disease.”
BackgroundContexts and contradictions: a roadmap for computational drug repurposing with knowledge inference
Sosa, D. N., & Altman, R. B. (2022) · Briefings in Bioinformatics · doi:10.1093/bib/bbac268 · Cited by 37
“The situation is exacerbated in cases when scientific preprints without the gold standard of peer review are used to guide clinical decision-making, as was demonstrated during the COVID-19 pandemic [68].”
BackgroundTaylor, M. (2023) · Scientometrics · doi:10.1007/s11192-023-04653-1 · Cited by 39
“COVID-19 has fundamentally changed global health research, both in terms of its speed (Park et al., 2021) and openness (Fraser et al., 2021), and it seems likely that 1 3 policy impact timelines will have been reduced: without longevity of exposure, attention should be given to how research gains…”
BackgroundTransparency and reporting characteristics of COVID-19 randomized controlled trials
Kapp, P., Esmail, L., Ghosn, L., Ravaud, P., & Boutron, I. (2022) · BMC Medicine · doi:10.1186/s12916-022-02567-y · Cited by 25
“Some researchers, decision-makers, funders, and editors raised concerns related to the risk of disseminating reports that were not peer-reviewed [8, 13].”
BackgroundInfluentialMassarani, L., Neves, L. F. F., Entradas, M., Lougheed, T., & Bauer, M. W. (2021) · Journal of Science Communication · doi:10.22323/2.20070206 · Cited by 31
Most published systematic reviews of remdesivir for COVID-19 were redundant and lacked currency
McDonald, S. J., Turner, S., Page, M. J., & Turner, T. (2022) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2022.02.006 · Cited by 27
“The prominence of preprints during the pandemic has accelerated scientific dissemination [69] , but although most of the reviews published as preprints in our analysis were posted within three weeks of the search date, this was no guarantee of currency, with 45% (4/9) still out of date at time of publication.”
Otridge, J., Ogden, C. L., Bernstein, K. T., Knuth, M., Fishman, J., & Brooks, J. T. (2022) · JMIR Public Health and Surveillance · doi:10.2196/35276 · Cited by 22
Fleerackers, A., Nehring, L., Maggio, L. A., et al. (2022) · Scientometrics · doi:10.1007/s11192-022-04510-7 · Cited by 23
“More recent work relied on altmetric data to document online attention to COVID-19-related preprints, demonstrating that unreviewed COVID-19 studies received far more attention on Twitter, news sites, and blogs than preprints on other topics (Fraser et al., 2021; Sevryugina & Dicks, 2021).”
MethodCharacterization of Comments About bioRxiv and medRxiv Preprints
Carneiro, C. F. D., da Costa, G. G., Neves, K., de Abreu, M. B., Tan, P. B., Rayêe, D., Boos, F. Z., Andrejew, R., Lubiana, T., Malički, M., et al. (2023) · JAMA Network Open · doi:10.1001/jamanetworkopen.2023.31410 · Cited by 29
“General content was assessed by asking whether the comments included (1) criticisms, corrections, or suggestions; (2) compliments; (3) questions; or (4) other content not fitting these categories.”
Scholarly literature mining with information retrieval and natural language processing: Preface
Cabanac, G., Frommholz, I., & Mayr, P. (2020) · Scientometrics · doi:10.1007/s11192-020-03763-4 · Cited by 23
State of open science practices in france (SOSP-FR)
Béchec, M. L., Bouchard, A., Charrier, P., Denecker, C., Gallezot, G., & Rennes, S. (2022) · doi:10.52949/5 · Cited by 29
Demkowicz, O., Panayiotou, M., Parsons, S. D., Feltham, A., Arseneault, L., Ingram, B., Patalay, P., Edge, D., Pierce, M., Creswell, C., et al. (2021) · Frontiers in Psychiatry · doi:10.3389/fpsyt.2021.622562 · Cited by 24
Tantengco, O. A. G., Aquino, I. M. C., Asis, J. L. B., Tan, J. J. E., Uy, M. N. A. R., & Paz-Pacheco, E. T. (2021) · Diabetes & Metabolic Syndrome Clinical Research & Reviews · doi:10.1016/j.dsx.2021.102202 · Cited by 24
The use and acceptability of preprints in health and social care settings: A scoping review
Blatch-Jones, A., Recio‐Saucedo, A., & Giddins, B. (2023) · PLoS ONE · doi:10.1371/journal.pone.0291627 · Cited by 26
“, additional details on the funding statement) by the time of publication, but the majority of these changes do not qualitatively change the conclusions of the paper [10, 25].”
InfluentialTen simple rules for getting and giving credit for data
Wood‐Charlson, E. M., Crockett, Z., Erdmann, C. C., Arkin, A. P., & Robinson, C. (2022) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1010476 · Cited by 20
“For example, rapid dissemination of knowledge via preprints was critical in supporting a rapid response to the recent global pandemic [6,7].”
BackgroundHow open are hybrid journals included in transformative agreements?
Jahn, N. (2025) · Quantitative Science Studies · doi:10.1162/qss_a_00348 · Cited by 38
“Furthermore, the study design did not consider emerging publication practices such as preprints (Fraser et al., 2021) and special issues (Hanson et al., 2023) (Butler et al., 2023; Wenaas, 2022), as well as potential changes in authors’ behaviour following the introduction of these agreements…”
BackgroundHowells, E. J., Bay, L. K., & Bay, R. A. (2022) · Coral reefs of the world · doi:10.1007/978-3-031-07055-6_4 · Cited by 24
What Lessons can Be Learned From the Management of the COVID-19 Pandemic?
Quinn, G. A., Connolly, R., ÓhAiseadha, C. O., Hynds, P. D., Bagus, P., Brown, R. B., Cáceres, C. F., Craig, C. E. H., Connolly, M., Domingo, J. L., et al. (2025) · International Journal of Public Health · doi:10.3389/ijph.2025.1607727 · Cited by 27
“Within just the fi rst year of the pandemic, more than 100,000 COVID-19-related scienti fi c articles were published [383].”
InfluentialThe Scholarly Knowledge Ecosystem: Challenges and Opportunities for the Field of Information
Altman, M., & Cohen, P. N. (2022) · Frontiers in Research Metrics and Analytics · doi:10.3389/frma.2021.751553 · Cited by 35
Stephen, D. (2022) · Scientometrics · doi:10.1007/s11192-022-04357-y · Cited by 20
“I retrieved the titles of the 411 BMC Psychology and 91 RIPR articles published since 2016, excluding articles with “COVID-19” in the title as peer review of this special topic may not reflect normal peer review practices (Fraser et al., 2021; S. Horbach, 2021).”
MethodFraming COVID-19 Preprint Research as Uncertain: A Mixed-Method Study of Public Reactions
Ratcliff, C. L., Fleerackers, A., Wicke, R., Harvill, B., King, A. J., & Jensen, J. D. (2023) · Health Communication · doi:10.1080/10410236.2023.2164954 · Cited by 22
“Yet over 30,000 studies related to COVID-19 were published as preprints on servers such as bioRxiv and medRxiv during the first year of the COVID-19 crisis (Fraser et al., 2021).”
BackgroundChinn, S., Hiaeshutter-Rice, D., & Chen, K. (2023) · Political Communication · doi:10.1080/10584609.2023.2201174 · Cited by 26
“…audiences have long sought science information on social media (Brossard & Scheufele, 2013), the recent COVID-19 pandemic has grown public attention in emergent scientific research and preprints (Fraser et al., 2021), shifting the landscape of science communication toward greater public engagement.”
BackgroundWang, Y., Cao, Z., Zeng, D. D., Zhang, Q., & Luo, T. (2020) · International Journal of Infectious Diseases · doi:10.1016/j.ijid.2020.12.040 · Cited by 19
COVID-19 article retractions in journals indexed in PubMed
Peterson, C., Alexander, R. L., & NUGENT, K. M. (2022) · The American Journal of the Medical Sciences · doi:10.1016/j.amjms.2022.01.014 · Cited by 18
“The COIVD-19 pandemic has produced an unprecedented volume of research, with over 125,000 articles published or released in the first 10 months of the pandemic.(1) In addition, there has been an unusual number of article retractions and withdrawals, with papers being retracted far earlier than the usual time period, w…”
Examining linguistic shifts between preprints and publications
Nicholson, D. N., Rubinetti, V., Hu, D., Thielk, M., Hunter, L., & Greene, C. S. (2022) · PLoS Biology · doi:10.1371/journal.pbio.3001470 · Cited by 21
Holford, D. L., Fasce, A., Tapper, K., Demko, M., Lewandowsky, S., Hahn, U., Abels, C. M., Al‐Rawi, A., Alladin, S. N. B., Boender, T. S., et al. (2023) · Science Communication · doi:10.1177/10755470231162634 · Cited by 26
“Not all rapid publication was helpful to the pandemic response, but some did provide valuable updates to inform decision-making (Fraser et al., 2021).”
BackgroundSpungen, H. H., Burton, J. T., Schenkel, S. M., & Schriger, D. L. (2023) · JAMA · doi:10.1001/jama.2023.1784 · Cited by 21
Cheung, K. K. C., Chan, H., & Erduran, S. (2023) · Humanities and Social Sciences Communications · doi:10.1057/s41599-023-01771-2 · Cited by 25
Nishal, S., Sinchai, J., & Diakopoulos, N. A. (2024) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3637419 · Cited by 32
“They provide journalists timely and accessible findings for public dissemination across various fields [35, 37, 45, 58, 77, 100].”
Background
Metadata
- Authors
- Fraser, N., Brierley, L., Dey, G., Polka, J. K., Pálfy, M., Nanni, F., & Coates, J. A.
- Affiliations
- ZBW – Leibniz-Informationszentrum Wirtschaft (DE)
- University of Liverpool (GB)
- MRC Laboratory for Molecular Cell Biology (GB)
- ASAPbio (US)
- Company of Biologists (GB)
- The Alan Turing Institute (GB)
- Queen Mary University of London (GB)
- Corresponding author
- Coates, Jonathon Alexis
- ORCID
- Venue
- PLOS Biology
- Publisher
- Public Library of Science (PLoS)
- Published
- 2021-04-02
- Volume
- 19
- Issue
- 4
- Pages
- e3000959
- ISSN
- 1544-9173 (ISSN-L)
- 1545-7885
- PMC
- PMC8046348
- OpenAlex
- W3150044582
- Cited by
- 555
- References
- 49
- Citations by year
- 2026: 30 · 2025: 61 · 2024: 86 · 2023: 128 · 2022: 129 · 2021: 96
- FWCI
- 94.62
- Type
- journal article
- Language
- en
- Update notices
- new_version (2021-04-14)
- Open access
- gold
- doi.org
- Licence
- Locations
- PLoS Biology (publishedVersion, cc-by)
- bioRxiv (Cold Spring Harbor Laboratory) (acceptedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- ZBW Publication Archive (ZBW – Leibniz Information Centre for Economics) (acceptedVersion, cc-by)
- Queen Mary Research Online (Queen Mary University of London) (submittedVersion, cc-by)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Apollo (University of Cambridge) (submittedVersion, cc-by)
- Apollo
- Funders
- OASE (01PU17005B, 01PU17011D)
- Medical Research Council (MR/T027355/1)
- Topics
- Social Sciences › Library and Information Sciences › Academic Publishing and Open Access
- Social Sciences › Library and Information Sciences › scientometrics and bibliometrics research
- Health Sciences › Medicine › Infectious Diseases › SARS-CoV-2 and COVID-19 Research
- Keywords
- preprints, COVID-19 research, preprint servers, bioRxiv, medRxiv, science communication, SARS-CoV-2, public engagement with science
- MeSH terms
- Preprints as Topic, COVID-19, SARS-CoV-2, Communication, Humans, Publishing, Peer Review, Research, Information Dissemination, Biomedical Research, Pandemics, Open Access Publishing
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
The claim verdicts this report counts are experimental: their accuracy is not yet measured.
A language model drew the claims from the paper on 2026-10-10, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-10-10 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Cited sources are checked with a language model’s help (gpt-6-sol).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.