Pandemic publishing: Medical journals strongly speed up their publication process for COVID-19
Open accessPublished version of a preprint
The DOI matches its Crossref record; 21 of the 21 references it cites were found in a registry or an index.
Abstract
In times of public crises, including the current COVID-19 pandemic, rapid dissemination of relevant scientific knowledge is of paramount importance. The duration of scholarly journals’ publication process is one of the main factors that may hinder quick delivery of new information. Following initiatives of medical journals to accelerate their publication process, this study assesses whether medical journals have managed to speed up their publication process for coronavirus-related articles. It studies the duration of 14 medical journals’ publication processes both during and prior to the current pandemic. Assessing 669 articles, the study concludes that medical journals have indeed strongly accelerated their publication process for coronavirus-related articles since the outbreak of the pandemic: The time between submission and publication has decreased on average by 49%. The largest decrease in number of days between submission and publication of articles was due to a decrease in time required for peer review. For articles not related to COVID-19, no acceleration of the publication process is found. While the acceleration of the publication process is laudable from the perspective of quick information dissemination, it also may raise concerns relating to the quality of the peer review process and of the resulting publications.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Figures





Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source says what the claim attributes to it.
In the citing paper
“An analysis of publication timelines for 14 medical journals has shown that some publishers have taken steps to accelerate their publishing processes for COVID-19 research, reducing the time for the peer-review stage (submission to acceptance) on average by 45 days and the editing stage (acceptance to publication) by 14 days [29]”
From The evolving role of preprints in the dissemination of COVID-19 research and their impact on the science communication landscape (2021) · cites this paper as [29]
In the citing paper
“studies have found that these article types are often not backed by adequate data and/or are poorly reviewed in a rush to disseminate relevant scientific knowledge [27].”
From Use of Telehealth During the COVID-19 Pandemic: Scoping Review (2020) · cites this paper as [27]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
1 retracted
Gautret, P., Lagier, J.-C., Parola, P., Hoang, V. T., Meddeb, L., Mailhe, M., Doudier, B., Courjon, J., Giordanengo, V., Vieira, V. E., et al. (2020) · International Journal of Antimicrobial Agents · doi:10.1016/j.ijantimicag.2020.105949 · Cited by 5,288
RetractedPeer-review practices of psychological journals: The fate of published articles, submitted again
Peters, D. P., & Ceci, S. J. (1982) · Behavioral and Brain Sciences · doi:10.1017/s0140525x00011183 · Cited by 1,079
Peer Review: A Flawed Process at the Heart of Science and Journals
Smith, R. (2006) · Journal of the Royal Society of Medicine · doi:10.1177/014107680609900414 · Cited by 880 · cited 1×
“Commentators blame it for being inconsistent (Peters & Ceci, 1982), essentially flawed (Smith, 2006), biased (Teplitskiy, Acuna, et al., 2018), and—particularly relevant in these times of crisis—slow (Nguyen, Haddaway, et al., 2015).”
BackgroundThe publishing delay in scholarly peer-reviewed journals
Björk, B.-C., & Solomon, D. (2013) · Journal of Informetrics · doi:10.1016/j.joi.2013.09.001 · Cited by 432
The changing forms and expectations of peer review
Horbach, S. P. J. M., & Halffman, W. (. W. (2018) · Research Integrity and Peer Review · doi:10.1186/s41073-018-0051-5 · Cited by 179
Self-citationNguyen, V. M., Haddaway, N., Gutowsky, L. F. G., Wilson, A. D. M., Gallagher, A. J., Donaldson, M., Hammerschlag, N., & Cooke, S. J. (2015) · PLoS ONE · doi:10.1371/journal.pone.0132557 · Cited by 159
Khatri, P., Singh, S. R., Belani, N. K., Yeong, Y. L., Lohan, R., Lim, Y. W., & Teo, W. Z. (2020) · Travel Medicine and Infectious Disease · doi:10.1016/j.tmaid.2020.101636 · Cited by 147
A scientometric overview of CORD-19
Colavizza, G., Costas, R., Traag, V., van Eck, N. J., van Leeuwen, T. N., & Waltman, L. (2021) · PLoS ONE · doi:10.1371/journal.pone.0244839 · Cited by 136 · cited 2×
“Some doubt has been raised about the relevance of some of this database’s articles to the current pandemic (Colavizza et al., 2020),”
BackgroundThe Hemiptera (Insecta) of Canada: Constructing a Reference Library of DNA Barcodes
Gwiazdowski, R., Foottit, R. G., Maw, H. E. L., & Hebert, P. D. N. (2015) · PLoS ONE · doi:10.1371/journal.pone.0125635 · Cited by 116
The sociology of scientific validity: How professional networks shape judgement in peer review
Teplitskiy, M., Acuna, D., Elamrani-Raoult, A., Körding, K., & Evans, J. (2018) · Research Policy · doi:10.1016/j.respol.2018.06.014 · Cited by 113
Research works printed but not linked: 2
- Brock, J. (2020). Rapid Registered Reports initiative aims to stop coro- navirus researchers following false leads. Nature Index. https://www. natureindex.com/news-blog/rapid-registered-report-coronavirus- aims-to-stop-researchers-following-false-research-leads
- Marcus A., 2020, Wired
Cited by
Use of Telehealth During the COVID-19 Pandemic: Scoping Review
Doraiswamy, S., Abraham, A., Mamtani, R., & Cheema, S. (2020) · Journal of Medical Internet Research · doi:10.2196/24087 · Cited by 698
“Although the majority of shorter communications such as opinions, commentaries, and viewpoints may be useful for future research, studies have found that these article types are often not backed by adequate data and/or are poorly reviewed in a rush to disseminate relevant scientific knowledge [27].”
CORD-19: The COVID-19 Open Research Dataset
Wang, L. L., Lo, K., Chandrasekhar, Y., Reas, R., Yang, J., Burdick, D., Eide, D., Funk, K., Katsis, Y., Kinney, R., et al. (2020) · arXiv · doi:10.48550/arxiv.2004.10706
Fraser, N., Brierley, L., Dey, G., Polka, J. K., Pálfy, M., Nanni, F., & Coates, J. A. (2021) · PLOS Biology · doi:10.1371/journal.pbio.3000959 · Cited by 555
“and the editing stage (acceptance to publication) by 14 days [29], yet this still falls some way short of the approximately 1 to 3 days screening time for bioRxiv and medRxiv preprints (Fig 2B).”
BackgroundVuong, Q.-H., Le, T.-T., La, V.-P., Nguyen, H. T. T., Ho, M.-T., Van Khuc, Q., & Nguyen, M.-H. (2022) · Humanities and Social Sciences Communications · doi:10.1057/s41599-022-01034-6 · Cited by 344
Pandemic publishing poses a new COVID-19 challenge
Palayew, A., Norgaard, O., Safreed-Harmon, K., Andersen, T. H., Rasmussen, L. N., & Lazarus, J. V. (2020) · Nature Human Behaviour · doi:10.1038/s41562-020-0911-0 · Cited by 258
How COVID-19 has fundamentally changed clinical research in global health
Park, J. J. H., Mogg, R., Smith, G. E., Nakimuli-Mpungu, E., Jehan, F., Rayner, C. R., Condo, J., Decloedt, E. H., Nachega, J. B., Reis, G., et al. (2021) · The Lancet Global Health · doi:10.1016/s2214-109x(20)30542-8 · Cited by 218
How swamped preprint servers are blocking bad coronavirus research
Kwon, D. (2020) · Nature · doi:10.1038/d41586-020-01394-6 · Cited by 174
Doraiswamy, S., Jithesh, A., Mamtani, R., Abraham, A., & Cheema, S. (2021) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph18041755 · Cited by 164
“Given global concerns on the quality of publications that emerged since the onset of the pandemic [106,107], our decision to exclude gray literature and restrict our search to peer-reviewed articles only can be seen as the most appropriate approach to synthesize available evidence.”
Tracking changes between preprint posting and journal publication during a pandemic
Brierley, L., Nanni, F., Polka, J., Dey, G., Pálfy, M., Fraser, N., & Coates, J. A. (2022) · PLoS Biology · doi:10.1371/journal.pbio.3001285 · Cited by 108
Relationship between periodontitis and systemic diseases: A bibliometric and visual study
Isola, G., Polizzi, A., Serra, S., Boato, M., & Sculean, A. (2025) · Periodontology 2000 · doi:10.1111/prd.12621 · Cited by 131
“47,48 Moreover, in agreement with some recent reports, 49–51 the present results evidenced an upward trend in the number of annual publications related to periodontitis.”
No time for that now! Qualitative changes in manuscript peer review during the Covid-19 pandemic
Horbach, S. P. J. M. (2020) · Research Evaluation · doi:10.1093/reseval/rvaa037 · Cited by 86
“By now, a host of different ways of performing manuscript peer review is installed at different journals and publishers (Horbach and Halffman 2019; Halffman and Horbach 2020).”
BackgroundMethodInfluentialSelf-citationMSˆ2: Multi-Document Summarization of Medical Studies
DeYoung, J., Beltagy, I., van Zuylen, M., Kuehl, B., & Wang, L. (2021) · Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/2021.emnlp-main.594 · Cited by 83
“The urgency for automation technologies has been magnified by the COVID-19 pandemic, which has led to both an accelerated speed of publication (Horbach, 2020) as well as proliferation of non-peer-reviewed preprints which may be of lower quality (Lachapelle, 2020).”
BackgroundQuinn, T. J., Burton, J. K., Carter, B., Cooper, N. J., Dwan, K. M., Field, R., Freeman, S. C., Geue, C., Hsieh, P.-H., McGill, K., et al. (2021) · BMC Medicine · doi:10.1186/s12916-021-01920-x · Cited by 84
Retrieval and Investigation of Data on SARS-CoV-2 and COVID-19 Using Bioinformatics Approach
Fahmi, M., Kharisma, V. D., Ansori, A. N. M., & Ito, M. (2021) · Advances in experimental medicine and biology · doi:10.1007/978-3-030-63761-3_47 · Cited by 73
Challenges and Lessons Learned From COVID-19 Trials: Should We Be Doing Clinical Trials Differently?
Janiaud, P., Hemkens, L. G., & Ioannidis, J. P. A. (2021) · Canadian Journal of Cardiology · doi:10.1016/j.cjca.2021.05.009 · Cited by 75
Reducing publication delay to improve the efficiency and impact of conservation science
Christie, A. P., White, T., Martin, P. A., Petrovan, S. O., Bladon, A. J., Bowkett, A. E., Littlewood, N. A., Mupepele, A., Rocha, R., Sainsbury, K. A., et al. (2021) · PeerJ · doi:10.7717/peerj.12245 · Cited by 72
Delardas, O., & Giannos, P. (2022) · Journal of Medical Internet Research · doi:10.2196/43089 · Cited by 57
the COVID-19 NMA Consortium, Oikonomidi, T., Boutron, I., Pierre, O., Cabanac, G., & Ravaud, P. (2020) · BMC Medicine · doi:10.1186/s12916-020-01880-8 · Cited by 54
Kodvanj, I., Homolak, J., Virag, D., & Trkulja, V. (2022) · Scientometrics · doi:10.1007/s11192-021-04249-7 · Cited by 61
Jaljaa, A., Caminada, S., Tosti, M. E., D’Angelo, F., Angelozzi, A., Isonne, C., Marchetti, G., Mazzalai, E., Giannini, D., Turatto, F., et al. (2022) · BMC Public Health · doi:10.1186/s12889-021-12466-1 · Cited by 69
An evaluation of prospective COVID-19 modelling studies in the USA: from data to science translation
Nixon, K., Jindal, S., Parker, F., Reich, N. G., Ghobadi, K., Lee, E. C., Truelove, S., & Gardner, L. (2022) · The Lancet Digital Health · doi:10.1016/s2589-7500(22)00148-0 · Cited by 60
How covid-19 bolstered an already perverse publishing system
Clark, J. (2023) · BMJ · doi:10.1136/bmj.p689 · Cited by 49
Optimizing peer review to minimize the risk of retracting COVID-19-related literature
da Silva, J. A. T., Bornemann‐Cimenti, H., & Tsigaris, P. (2020) · Medicine Health Care and Philosophy · doi:10.1007/s11019-020-09990-z · Cited by 52
“…to curtail requests for additional experiments, and to shorten the revision period, suggesting that some peer review might be rushed and that some results might be too provisional or superficial, potentially lowering academic standards rather than upholding them (Eisen et al. 2020; Horbach 2020).”
BackgroundCOVID-19 and the scientific publishing system: growth, open access and scientific fields
Nane, G. F., Robinson‐García, N., Schalkwyk, F. B. V., & Torres‐Salinas, D. (2022) · Scientometrics · doi:10.1007/s11192-022-04536-x · Cited by 63
“A study comprising 14 medical journals found that journals had accelerated their publication processes; the time between submission and the publication of the journal articles decreased on average by 49% (Horbach, 2020).”
BackgroundPublications during COVID-19 times: An unexpected overall increase
Rousseau, R., Garcia-Zorita, C., & Sanz-Casado, E. (2023) · Journal of Informetrics · doi:10.1016/j.joi.2023.101461 · Cited by 44
Automation tools to support undertaking scoping reviews
Khalil, H., Pollock, D., McInerney, P., Evans, C., Moraes, E. B., Godfrey, C. M., Alexander, L., Tricco, A., Peters, M. D. J., Pieper, D., et al. (2024) · Research Synthesis Methods · doi:10.1002/jrsm.1731 · Cited by 43
The Covid infodemic: Competition and the hyping of virus research
Hyland, K., & Jiang, F. K. (2021) · International Journal of Corpus Linguistics · doi:10.1075/ijcl.20160.hyl · Cited by 50
Frauds in scientific research and how to possibly overcome them
Boetto, E., Golinelli, D., Carullo, G., & Fantini, M. P. (2020) · Journal of Medical Ethics · doi:10.1136/medethics-2020-106639 · Cited by 44
Preprints: Their Evolving Role in Science Communication
Puebla, I., Polka, J., & Rieger, O. Y. (2022) · doi:10.3998/mpub.12412508 · Cited by 49
Grammes, N. L., Millenaar, D., Fehlmann, T., Kern, F., Böhm, M., Mahfoud, F., & Keller, A. (2020) · Journal of Medical Internet Research · doi:10.2196/24514 · Cited by 36
Scientific publication speed and retractions of COVID-19 pandemic original articles
Luisa Schonhaut, B., Costa-Roldán, I., Ilan Oppenheimer, S., Pizarro, V., Han, D., & Díaz, F. (2022) · Revista Panamericana de Salud Pública · doi:10.26633/rpsp.2022.25 · Cited by 40
The effect of the COVID-19 pandemic on the gender gap in research productivity within academia
Lee, K., Čulina, A., Lukas, D., Dugdale, H. L., & Mennerat, A. (2023) · eLife · doi:10.7554/elife.85427 · Cited by 39
Reporting preprints in the media during the COVID-19 pandemic
Schalkwyk, F. B. V., & Dudek, J. (2022) · Public Understanding of Science · doi:10.1177/09636625221077392 · Cited by 42
“In this context, the availability of preprint articles has played an important role in advancing scientific discovery and in providing the latest scientific information about the virus to politicians and the public (Horbach, 2020).”
BackgroundLokhtina, I. A., Castelló, M., Lambrechts, A. A., Löfström, E., McGinn, M. K., Skakni, I., & van der Weijden, I. (2022) · Studies in Graduate and Postdoctoral Education · doi:10.1108/sgpe-10-2021-0076 · Cited by 28
Science in motion: A qualitative analysis of journalists’ use and perception of preprints
Fleerackers, A., Moorhead, L. L., Maggio, L. A., Fagan, K., & Alperín, J. P. (2022) · PLoS ONE · doi:10.1371/journal.pone.0277769 · Cited by 40
Over‐promotion and caution in abstracts of preprints during the COVID‐19 crisis
Bordignon, F., Ermakova, L., & Noel, M. (2021) · Learned Publishing · doi:10.1002/leap.1411 · Cited by 31
“Even though medical journals have managed to greatly accelerate their publication processes to make them nearly twice as fast for coronavirus-related articles (Horbach, 2020), researchers www.learned-publishing.org © 2021 The Authors.”
BackgroundPotentially effective drugs for the treatment of COVID-19 or MIS-C in children: a systematic review
Wang, Z., Zhao, S., Tang, Y., Wang, Z., Shi, Q., Dang, X., Gan, L., Peng, S., Li, W., Zhou, Q. X., et al. (2022) · European Journal of Pediatrics · doi:10.1007/s00431-022-04388-w · Cited by 37
“It is over a year and a half since the outbreak of coronavirus disease 2019 (COVID-19), and during this period, studies on COVID-19 are continuously emerging [1, 2].”
BackgroundStawicki, S. P., Papadimos, T. J., Soghoian, S., Nanayakkara, P. W. B., Singh, S., Miller, A., Saddikuti, V., Jayatilleke, A. U., Dubhashi, S., Firstenberg, M., et al. (2020) · Journal of Global Infectious Diseases · doi:10.4103/jgid.jgid_397_20 · Cited by 36
Challenges on the interaction of models and policy for pandemic control
Hadley, L., Challenor, P., Dent, C. J., Isham, V. S., Mollison, D., Robertson, D. A., Swallow, B., & Webb, C. R. (2021) · Epidemics · doi:10.1016/j.epidem.2021.100499 · Cited by 36
“One solution is through the use of ‘rapid review’ or ‘live review’ – in addition to many journals accelerating their peer review process at the beginning of the Covid-19 outbreak (Horbach, 2020), some implemented open-source platforms for dedicated rapid review.”
Preprints: Their Evolving Role in Science CommunicationPreprint
Puebla, I., Polka, J., & Rieger, O. Y. (2021) · MetArXiv (OSF Preprints) · doi:10.31222/osf.io/ezfsk · Cited by 36
Turatto, F., Mazzalai, E., Pagano, F., Migliara, G., Villari, P., & Vito, C. D. (2021) · Frontiers in Public Health · doi:10.3389/fpubh.2021.666669 · Cited by 32
da Silva, J. A. T. (2020) · Online Information Review · doi:10.1108/oir-08-2020-0371 · Cited by 30
COVID-19 enabled co-authoring networks: a country-case analysis
Sachini, E., Sioumalas-Christodoulou, K., Chrysomallidis, C., Siganos, G., Bouras, N., & Karampekios, N. (2021) · Scientometrics · doi:10.1007/s11192-021-03952-9 · Cited by 31
“As the only measure to boost the research validity of any potential breakthrough against the pandemic, editorial practises have been significantly diminished in terms of the necessary time to proceed to the review process (Horbach, 2020).”
BackgroundHe, J., Liu, X., Lu, X., Zhong, M., Jia, C., Lucero‐Prisno, D. E., Feei, Z., & Li, H. (2023) · BMJ Global Health · doi:10.1136/bmjgh-2022-011514 · Cited by 29
Forti, L. R., Solino, L., & Szabo, J. K. (2021) · Humanities and Social Sciences Communications · doi:10.1057/s41599-021-00920-9 · Cited by 32
Martinuka, O., von Cube, M., & Wolkewitz, M. (2021) · Clinical Microbiology and Infection · doi:10.1016/j.cmi.2021.03.003 · Cited by 28
Pfaff, H., & Schmitt, J. M. (2021) · Frontiers in Public Health · doi:10.3389/fpubh.2021.727427 · Cited by 30
Science, technology and innovation in the time of COVID-19
Paunov, C., & Planes-Satorra, S. (2021) · OECD science, technology and industry policy papers · doi:10.1787/234a00e5-en · Cited by 33
The Bibliometric Analysis of Studies on Distance Education
Hebebci, M. T. (2021) · International Journal of Technology in Education · doi:10.46328/ijte.199 · Cited by 37
“In addition to the journals that published special issues related to COVID-19, it is seen that article review durations were completed in a shorter time than usual (Horbach, 2020; Palayew et al., 2020).”
BackgroundTransparency and reporting characteristics of COVID-19 randomized controlled trials
Kapp, P., Esmail, L., Ghosn, L., Ravaud, P., & Boutron, I. (2022) · BMC Medicine · doi:10.1186/s12916-022-02567-y · Cited by 25
“Medical Journals reacted on the other hand by accelerating their editorial processes by up to 49% on average [4].”
BackgroundPreprints During the COVID‐19 Pandemic: Public Health Emergencies and Medical Literature
Guterman, E. L., & Braunstein, L. Z. (2020) · Journal of Hospital Medicine · doi:10.12788/jhm.3491 · Cited by 24
Pfaff, H., & Schmitt, J. M. (2023) · Journal of Evaluation in Clinical Practice · doi:10.1111/jep.13890 · Cited by 29
Reimagining the peer‐review system for translational health science journals
Smith, E. M. R. (2021) · Clinical and Translational Science · doi:10.1111/cts.13050 · Cited by 30
COVID-19 and the Drug Repurposing Tsunami
Mucke, H. A. (2020) · Assay and Drug Development Technologies · doi:10.1089/adt.2020.996 · Cited by 23
Rosenberger, K. J., Xu, C., & Lin, L. (2021) · Journal of Evaluation in Clinical Practice · doi:10.1111/jep.13578 · Cited by 18
“The publication time of articles related to COVID-19 has decreased by an average of 49% during the pandemic,(2) owing largely to the expedited peer-review process.(2,3) While the gravity of the COVID-19 pandemic warrants expedited efforts, there are concerns about the quality of peer reviews and resulting publications…”
BackgroundCOVID-19 Preprints and Their Publishing Rate: An Improved MethodPreprint
Lachapelle, F. (2020) · medRxiv · doi:10.1101/2020.09.04.20188771 · Cited by 16
“As a result, research indicates that the time between the submission and the publication of a manuscript has shrunk on average by 49% for coronavirus-related research (Horbach, 2020).”
BackgroundBrierley, L., Nanni, F., Polka, J., Dey, G., Pálfy, M., Fraser, N., & Coates, J. A. (2021) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2021.02.20.432090 · Cited by 21
“Bero et 77 al [18] and Oikonomidi et at [19] investigated changes in conclusions reported in COVID-related 78 clinical studies, finding that some preprints and journal articles differed in the outcomes reported.”
ResultSevryugina, Y. V., & Dicks, A. J. (2022) · Learned Publishing · doi:10.1002/leap.1483 · Cited by 21
“…posting period 1 January – 31 July 2020. than that almost a decade ago ( t β = 146.6 days; Björk & Solomon, 2013), it is 40% slower than that in September 2020 ( t β _09_20 = 14.6 days; Sevryugina & Dicks, 2021b) and 55% slower than that in March 2020 ( t β _03_20 = 9.3 days; Horbach, 2020).”
InfluentialThe editor: A demanding but underestimated role in scientific publishing
Vuong, Q. (2022) · Learned Publishing · doi:10.1002/leap.1466 · Cited by 17
“…professional publishers can help take care of many technical aspects, editors are required to spend additional time and effort to familiarize themselves with and reposition themselves in the rapidly changing publishing workflows and business models (Halffman & Horbach, 2020; Ponte et al., 2017).”
BackgroundResultRzayeva, N., Henriques, S. O., Pinfield, S., & Waltman, L. (2023) · PeerJ · doi:10.7717/peerj.15864 · Cited by 24
Competing with a pandemic: Trends in research design in a time of Covid-19
Bian, S. X., & Lin, E. (2020) · PLoS ONE · doi:10.1371/journal.pone.0238831 · Cited by 20
Sevryugina, Y. V., & Dicks, A. J. (2021) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2021.01.21.427563 · Cited by 15
Smith, E. M. R., Rakestraw, C., & Farroni, J. S. (2022) · Accountability in Research · doi:10.1080/08989621.2022.2029704 · Cited by 17
“Medical journals have increased the speed of peer review for COVID-19 (Horbach 2020).”
Publishing during pandemic: Innovation, collaboration, and change
Smart, P. (2020) · Learned Publishing · doi:10.1002/leap.1314 · Cited by 14
Unreviewed science in the news: The evolution of preprint media coverage from 2014–2021
Fleerackers, A., Shores, K., Chtena, N., & Alperín, J. P. (2024) · Quantitative Science Studies · doi:10.1162/qss_a_00282 · Cited by 17
Quality of early evidence on the pathogenesis, diagnosis, prognosis and treatment of COVID-19
Yang, S. S., Li, A., Eshaghpour, A., Ivanisevic, S., Salopek, A., Eikelboom, J. W., & Crowther, M. A. (2020) · BMJ Evidence-Based Medicine · doi:10.1136/bmjebm-2020-111499 · Cited by 13
A topic trend analysis on COVID-19 literature
Urru, S., Sciannameo, V., Lanera, C., Salaris, S., Gregori, D., & Berchialla, P. (2022) · Digital Health · doi:10.1177/20552076221133696 · Cited by 17
“24 The problem we address in this work is the rapid growth of literature since (1) quality of publications is not guaranteed, 3,25,26 (2) the search about a speci fi c topic is time expensive and the results include noisy data, 4 and (3) repositories on COVID-19 literature built so far still lack…”
Health sciences librarian research and instruction services in pandemic information environments
Charbonneau, D. H., & Vardell, E. (2022) · The Journal of Academic Librarianship · doi:10.1016/j.acalib.2022.102553 · Cited by 13
Publishing in the time of pandemic: Editorial policy of a dermatology journal during COVID-19
Panda, S. (2020) · Indian Journal of Dermatology Venereology and Leprology · doi:10.4103/ijdvl.ijdvl_704_20 · Cited by 11
MS2: Multi-Document Summarization of Medical Studies
DeYoung, J., Beltagy, I., van Zuylen, M., Kuehl, B., & Wang, L. L. (2021) · arXiv · doi:10.48550/arxiv.2104.06486 · Cited by 10
“The urgency for automation technologies has been magnified by the COVID-19 pandemic, which has led to both an accelerated speed of publication (Horbach, 2020) as well as proliferation of non-peer-reviewed preprints which may be of lower quality (Lachapelle, 2020).”
BackgroundAssessment Methods of Sport-Induced Neuromuscular Fatigue: A Scoping Review
Muñoz-Gracia, J. L., Alentorn‐Geli, E., Casals, M., Hewett, T. E., & Baiget, E. (2025) · International Journal of Sports Physical Therapy · doi:10.26603/001c.141230 · Cited by 19
Mitigating Biases in CORD-19 for Analyzing COVID-19 Literature
Kanakia, A., Wang, K., Dong, Y., Xie, B., Lo, K., Shen, Z., Wang, L. L., Huang, C., Eide, D., Kohlmeier, S., et al. (2020) · Frontiers in Research Metrics and Analytics · doi:10.3389/frma.2020.596624 · Cited by 12
Monitoring Information Flow on Coronavirus Disease 2019 (COVID-19)
Gasparyan, A. Y., Zimba, O., Misra, D. P., & Kitas, G. D. (2020) · Mediterranean Journal of Rheumatology · doi:10.31138/mjr.31.3.243 · Cited by 11
A systematic review of sport-related packages within the R CRAN repository
Casals, M., Fernández, J., Martínez, V., Lopez, M. J., Langohr, K., & Cortés, J. (2022) · International Journal of Sports Science & Coaching · doi:10.1177/17479541221136238 · Cited by 12
Lipworth, W. L., Kerridge, I., Stewart, C. L., Silva, D. A. S., & Upshur, R. E. G. (2023) · Journal of Bioethical Inquiry · doi:10.1007/s11673-023-10289-w · Cited by 11
The significant yet short‐term influence of research covidization on journal citation metrics
Zheng, X. M., & Ni, C. (2024) · Journal of the Association for Information Science and Technology · doi:10.1002/asi.24939 · Cited by 13
“As a result, there has been an unprecedented surge in the production of COVID-19 papers, with many active researchers contributing and journals speeding up the publication process (Aviv-Reuven & Rosenfeld, 2021; Else, 2020; Horbach, 2020; Riccaboni & Verginer, 2022; Sarkar et al., 2022).”
Publishing under COVID-19 in small book markets
Kovač, M., & Gudinavičius, A. (2020) · Knygotyra · doi:10.15388/knygotyra.2020.74.58 · Cited by 9
BIP4COVID19: Releasing impact measures for articles relevant to COVID-19
Vergoulis, T., Kanellos, I., Chatzopoulos, S., Karidi, D. P., & Dalamagas, T. (2021) · Quantitative Science Studies · doi:10.1162/qss_a_00169 · Cited by 11
Evaluation and publication delay in Ibero‐American scientific journals
Zabala, J., González‐Albo, B., García‐García, A., Garrido‐Domínguez, A., Liy, J. I. V., Álvarez‐Díez, L. R., Hernando‐Tundidor, S., Fernández, Y. M., & Peña, T. A. (2022) · Learned Publishing · doi:10.1002/leap.1497 · Cited by 12
“And it is possible to reduce publication delay when a real need exists, as happened in the recent COVID-19 pandemic (Forti et al., 2021; Horbach, 2020).”
BackgroundDonnici, C., Ilincic, N., Cao, C., Zhang, C., Deveaux, G., Clifton, D. A., Buckeridge, D. L., Bobrovitz, N., & Arora, R. K. (2022) · Epidemics · doi:10.1016/j.epidem.2022.100645 · Cited by 11
“However, the generalizability and validity of such non-peer-reviewed evidence has been questioned (Horbach, 2020; Ravinetto et al., 2021).”
Peer review: the attitudes and behaviours of Covid-19 pandemic-era early career researchers
Nicholas, D., Herman, E., Bravo, B. R., Watkinson, A., Boukacem‐Zeghmouri, C., Świgoń, M., Abrizah, A., Sims, D., Xu, J., Clark, D., et al. (2023) · El Profesional de la Informacion · doi:10.3145/epi.2023.may.06 · Cited by 9
“Indeed, coronavirus-related (vs. non-related) articles were considerably more expeditiously processed and published in peer-reviewed journals, largely due to quicker peer review processes (Helliwell et al., 2020; Horbach, 2020; 2021; Jung et al., 2021; Kodvanj et al., 2022).”
Em, S., Serey, M., Sam, R., Pen, D., & Chin, P. (2025) · IGI Global eBooks · doi:10.4018/979-8-3373-0654-4.ch003 · Cited by 8
Making science public: a review of journalists’ use of Open Access research
Fleerackers, A., Chtena, N., Pinfield, S., Alperín, J. P., Barata, G., de Oliveira, M. B., & Peters, I. (2023) · F1000Research · doi:10.12688/f1000research.133710.1 · Cited by 18
“Research suggests that journalistic discourses surrounding peer review tend to mirror those found in academic debates, portraying peer review as a “ guarantee of good science ” and the “ cornerstone of maintaining the quality ” of research (Ampollini & Bucchi, 2020, p. 466; Sebbah et al ., 2022).”
A pandemia e a emergência da Ciência Aberta
Rodrigues, E. (2020) · UMinho Editora eBooks · doi:10.21814/uminho.ed.24.12 · Cited by 12
“Tem sido observada uma redução significativa do tempo médio entre a submissão e a publicação dos artigos (Horbach,2020) e um estudo aos artigos publicados entre 30 de janeiro e 23 de abril de 2020 revelou que a mediana de tempo entre a submissão e a publicação foi de 6 dias para os artigos…”
Backgroundde la Hoz-M, J., Mendes, S., Gómez, M. J. F., & Silva, Y. G. (2022) · Computation · doi:10.3390/computation10090156 · Cited by 8
“Horbach [30] evidenced this in his study with the peer-review process of 14 medical publications.”
Kim, S.-J. (2024) · Science Editing · doi:10.6087/kcse.334 · Cited by 15
Peña, A. M., & Davies, T. (2022) · International Studies Review · doi:10.1093/isr/viac048 · Cited by 6
Impact of COVID-19 on Journal Impact Factor
Uddin, S., Khan, A. M., & Lu, H. (2023) · Journal of Informetrics · doi:10.1016/j.joi.2023.101458 · Cited by 13
Pandémie à SARS-CoV-2 : éthique et intégrité oubliées devant la précipitation pour publier
Maisonneuve, H., Plaud, B., & Caumes, É. (2020) · La Presse Médicale Formation · doi:10.1016/j.lpmfor.2020.10.021 · Cited by 7
Internationale wissenschaftliche Publikationsaktivität zu COVID-19
Strobl, S., & Roth, W. (2021) · Der Pathologe · doi:10.1007/s00292-020-00892-8 · Cited by 7
Battaglini, D., Cruz, F. F., Robba, C., Pelosi, P. P., & Rocco, P. R. M. (2022) · Expert Opinion on Investigational Drugs · doi:10.1080/13543784.2022.2120801 · Cited by 7
“Second, the reduced time of the peer review process [195].”
BackgroundThe most influential COVID-19 articles: A systematic review
Ahmad, S. J. S., Degiannis, K., Borucki, J. P., Pouwels, S., Rawaf, D. L., Head, M., Li, C. H., Archid, R., Ahmed, A., Lala, A., et al. (2023) · New Microbes and New Infections · doi:10.1016/j.nmni.2023.101094 · Cited by 8
Gestión de la pandemia. Visión del radiólogo
Valdés, P., Rovira, À., Guerrero, J., Rodriguez-Morales, A. J., Rovira, M., & Martínez, C. (2020) · Radiología · doi:10.1016/j.rx.2020.10.004 · Cited by 7
Massarani, L., Neves, L. F. F., & da Silva, C. M. (2021) · E-Compós · doi:10.30962/ec.2426 · Cited by 9
Covid-19 refereeing duration and impact in major medical journals
Kousha, K., & Thelwall, M. A. (2022) · Quantitative Science Studies · doi:10.1162/qss_a_00176 · Cited by 7
“%) due to faster peer review, but non-Covid-19 articles had no change in publishing speed (Horbach, 2020).”
BackgroundResultThe Differential Impact of the COVID-19 Pandemic in Geography in the United States
Neely, A. H., & Lopez, P. J. (2022) · The Professional Geographer · doi:10.1080/00330124.2021.2000448 · Cited by 9
“For instance, publications for both men and women rose in some science, technology, engineering, mathematics, and medicine fields, but men’s publications rose more sharply (Horbach 2020; Cui, Ding, and Zhu 2021).”
BackgroundSARSCOVIDB─A New Platform for the Analysis of the Molecular Impact of SARS-CoV-2 Viral Infection
da Rosa, R. L., Yang, T. S., Cagnini, E. F. T., Saciloto-de-Oliveira, L. R., Moraes, A. N. S., Tatara, J. M., Costa, R. P., Borges, J. S., Innocente-Alves, C., Berger, M., et al. (2021) · ACS Omega · doi:10.1021/acsomega.0c05701 · Cited by 6
Salsabila, S., Tyas, S. M. P., Romadhona, Y., & Purwitasari, D. (2023) · Journal of Information Systems Engineering and Business Intelligence · doi:10.20473/jisebi.9.1.84-94 · Cited by 6
Maggio, L. A., Costello, J. A., Brown, K. R., Artino, A. R., Durning, S. J., & Ma, T. (2024) · Perspectives on Medical Education · doi:10.5334/pme.1287 · Cited by 8
Chiari, W., Amirah, S., Lemu, Y. K., Subbaram, K., Edwards, R. J., Kretchy, J., Vento, S., Khader, Y. S., & Rademaker, M. (2024) · Narra X · doi:10.52225/narrax.v2i1.106 · Cited by 6
Metadata
- Authors
- Horbach, S. P. J. M.
- Affiliations
- Leiden University (NL)
- Corresponding author
- Horbach, Serge P. J. M.
- Venue
- Quantitative Science Studies
- Publisher
- MIT Press
- Published
- 2020-08
- Volume
- 1
- Issue
- 3
- Pages
- 1056-1067
- ISSN
- 2641-3337 (ISSN-L)
- OpenAlex
- W3034917217
- Cited by
- 268
- References
- 21
- Citations by year
- 2026: 17 · 2025: 24 · 2024: 33 · 2023: 36 · 2022: 52 · 2021: 67 · 2020: 38
- FWCI
- 47.85
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- cc-by
- Locations
- Quantitative Science Studies (publishedVersion, cc-by)
- bioRxiv (Cold Spring Harbor Laboratory) (acceptedVersion, cc-by)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Radboud Repository (Radboud University) (submittedVersion)
- Radboud Repository (Radboud University) (submittedVersion, other-oa)
- Funders
- Universiteit Leiden
- Topics
- Social Sciences › Library and Information Sciences › Academic Publishing and Open Access
- Social Sciences › Library and Information Sciences › Publishing and Scholarly Communication
- Social Sciences › Library and Information Sciences › scientometrics and bibliometrics research
- Keywords
- COVID-19 pandemic, medical journals, peer review time, time to publication, scholarly communication, scientific knowledge dissemination
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.