Impact of the COVID-19 pandemic on publication dynamics and non-COVID-19 research production
Open accessThe DOI matches its Crossref record; 25 of the 25 references it cites were found in a registry or an index.
Abstract
Background: The COVID-19 pandemic has severely affected health systems and medical research worldwide but its impact on the global publication dynamics and non-COVID-19 research has not been measured. We hypothesized that the COVID-19 pandemic may have impacted the scientific production of non-COVID-19 research. Methods: We conducted a comprehensive meta-research on studies (original articles, research letters and case reports) published between 01/01/2019 and 01/01/2021 in 10 high-impact medical and infectious disease journals (New England Journal of Medicine, Lancet, Journal of the American Medical Association, Nature Medicine, British Medical Journal, Annals of Internal Medicine, Lancet Global Health, Lancet Public Health, Lancet Infectious Disease and Clinical Infectious Disease). For each publication, we recorded publication date, publication type, number of authors, whether the publication was related to COVID-19, whether the publication was based on a case series, and the number of patients included in the study if the publication was based on a case report or a case series. We estimated the publication dynamics with a locally estimated scatterplot smoothing method. A Natural Language Processing algorithm was designed to calculate the number of authors for each publication. We simulated the number of non-COVID-19 studies that could have been published during the pandemic by extrapolating the publication dynamics of 2019 to 2020, and comparing the expected number to the observed number of studies. Results: Among the 22,525 studies assessed, 6319 met the inclusion criteria, of which 1022 (16.2%) were related to COVID-19 research. A dramatic increase in the number of publications in general journals was observed from February to April 2020 from a weekly median number of publications of 4.0 (IQR: 2.8–5.5) to 19.5 (IQR: 15.8–24.8) (p < 0.001), followed afterwards by a pattern of stability with a weekly median number of publications of 10.0 (IQR: 6.0–14.0) until December 2020 (p = 0.045 in comparison with April). Two prototypical editorial strategies were found: 1) journals that maintained the volume of non-COVID-19 publications while integrating COVID-19 research and thus increased their overall scientific production, and 2) journals that decreased the volume of non-COVID-19 publications while integrating COVID-19 publications. We estimated using simulation models that the COVID pandemic was associated with a 18% decrease in the production of non-COVID-19 research. We also found a significant change of the publication type in COVID-19 research as compared with non-COVID-19 research illustrated by a decrease in the number of original articles, (47.9% in COVID-19 publications vs 71.3% in non-COVID-19 publications, p < 0.001). Last, COVID-19 publications showed a higher number of authors, especially for case reports with a median of 9.0 authors (IQR: 6.0–13.0) in COVID-19 publications, compared to a median of 4.0 authors (IQR: 3.0–6.0) in non-COVID-19 publications (p < 0.001). Conclusion: In this meta-research gathering publications from high-impact medical journals, we have shown that the dramatic rise in COVID-19 publications was accompanied by a substantial decrease of non-COVID-19 research. Meta-research registration: https://osf.io/9vtzp/.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Safety and Efficacy of the BNT162b2 mRNA Covid-19 Vaccine
Polack, F. P., Thomas, S. J., Kitchin, N., Absalon, J., Gurtman, A., Lockhart, S., Perez, J. L., Pérez Marc, G., Moreira, E. D., Zerbini, C., et al. (2020) · New England Journal of Medicine · doi:10.1056/nejmoa2034577 · Cited by 14,592 · cited 1×
“Nevertheless, these findings should be interpreted in the light of the efforts made around COVID-19, in particular the commitment around the estimation of COVID-19 cases and related deaths worldwide [1], the implementation of massive, international collaborations [4], the fast-tracking process of COVID-19 medical rese…”
BackgroundVoysey, M., Clemens, S. A. C., Madhi, S. A., Weckx, L. Y., Folegatti, P. M., Aley, P. K., Angus, B., Baillie, V. L., Barnabas, S. L., Bhorat, Q. E., et al. (2021) · The Lancet · doi:10.1016/s0140-6736(20)32661-1 · Cited by 4,616 · cited 1×
“Nevertheless, these findings should be interpreted in the light of the efforts made around COVID-19, in particular the commitment around the estimation of COVID-19 cases and related deaths worldwide [1], the implementation of massive, international collaborations [4], the fast-tracking process of COVID-19 medical rese…”
BackgroundWynants, L., Van Calster, B., Bonten, M. M., Collins, G. S., Debray, T. P., De Vos, M., Haller, M. C., Heinze, G., Moons, K. G., Riley, R. D., et al. (2020) · doi:10.1101/2020.03.24.20041020 · Cited by 3,070
Coagulopathy and Antiphospholipid Antibodies in Patients with Covid-19
Zhang, Y., Xiao, M., Zhang, S., Xia, P., Cao, W., Jiang, W., Chen, H., Ding, X., Zhao, H., Zhang, H., et al. (2020) · New England Journal of Medicine · doi:10.1056/nejmc2007575 · Cited by 2,179 · cited 1×
“Moreover, recent research has reported a rising number of authors in COVID-19 publications [15], especially in case reports [16, 17], which may also reflect a lowering in scientific standards [12, 13].”
BackgroundThe Impact of Research Collaboration on Scientific Productivity
Lee, S., & Bozeman, B. (2005) · Social Studies of Science · doi:10.1177/0306312705052359 · Cited by 1,642 · cited 1×
“This phenomenon has been highlighted in numerous medical specialties [19–21] and may be the aggregate consequence of multiple forces, such as the growing complexity [22] and interdisciplinarity of medical research [23], increasing academic and career pressure, increasingly limited funding and the rising number of coll…”
BackgroundDefining the Epidemiology of Covid-19 — Studies Needed
Lipsitch, M., Swerdlow, D. L., & Finelli, L. (2020) · New England Journal of Medicine · doi:10.1056/nejmp2002125 · Cited by 1,248
Drug treatments for covid-19: living systematic review and network meta-analysis
Siemieniuk, R. A., Bartoszko, J. J., Zeraatkar, D., Kum, E., Qasim, A., Díaz Martinez, J. P., Izcovich, A., Rochwerg, B., Lamontagne, F., Han, M. A., et al. (2020) · BMJ · doi:10.1136/bmj.m2980 · Cited by 846
The COVID-19 Investigation Team (2020) · Nature Medicine · doi:10.1038/s41591-020-0877-5 · Cited by 405
Against pandemic research exceptionalism
London, A. J., & Kimmelman, J. (2020) · Science · doi:10.1126/science.abc1731 · Cited by 375 · cited 2×
“Moreover, recent research has reported a rising number of authors in COVID-19 publications [15], especially in case reports [16, 17], which may also reflect a lowering in scientific standards [12, 13].”
BackgroundCoronavirus disease 2019: The harms of exaggerated information and non‐evidence‐based measures
Ioannidis, J. P. A. (2020) · European Journal of Clinical Investigation · doi:10.1111/eci.13222 · Cited by 364 · cited 1×
“In addition, we showed a change in the publication type, that was mainly driven by the high proportion of research letters at the expense of original articles in COVID-19 publications, a phenomenon that has been previously illustrated [15] and might reflects how willingness to provoke immediate impact and provide nove…”
BackgroundGlasziou, P. P., Sanders, S., & Hoffmann, T. (2020) · BMJ · doi:10.1136/bmj.m1847 · Cited by 330 · cited 3×
“the editors rejected more papers than usual [29], supporting adherence and commitment to high scientific standards [13].”
BackgroundOrgan procurement and transplantation during the COVID-19 pandemic
Loupy, A., Aubert, O., Reese, P. P., Bastien, O. H., Bayer, F., & Jacquelinet, C. (2020) · The Lancet · doi:10.1016/s0140-6736(20)31040-0 · Cited by 320 · cited 1×
“Similarly, it has had detrimental effects on organ allocation and transplantation worldwide [8], with a significant reduction in the number of transplanted organs per day, with disastrous consequences for patients whose lives depend on getting transplanted.”
BackgroundSelf-citationWill SARS-CoV-2 variants of concern affect the promise of vaccines?
Gupta, R. K. (2021) · Nature Reviews Immunology · doi:10.1038/s41577-021-00556-5 · Cited by 204 · cited 1×
“In addition, the rise of many variants may challenge the efficacy of vaccines [40, 41] and delay the decrease in the number of cases and deaths.”
BackgroundCOVID-19 and readjusting clinical trials
van Dorn, A. (2020) · The Lancet · doi:10.1016/s0140-6736(20)31787-6 · Cited by 184 · cited 1×
“Overall, there has been a substantial redistribution of resources which has significantly impacted the nonCOVID-19 medical research worldwide [9], including clinical trials [10, 11].”
BackgroundGlobal coalition to accelerate COVID-19 clinical research in resource-limited settings
† (2020) · The Lancet · doi:10.1016/s0140-6736(20)30798-4 · Cited by 173
COVID-19-related medical research: a meta-research and critical appraisal
Raynaud, M., Zhang, H., Louis, K., Goutaudier, V., Wang, J., Dubourg, Q., Wei, Y., Demir, Z., Debiais, C., Aubert, O., et al. (2021) · BMC Medical Research Methodology · doi:10.1186/s12874-020-01190-w · Cited by 172 · cited 1×
“In addition, leading scientists have voiced concerns about science expediency [12] and the lowering of scientific standards [13, 14].”
BackgroundSelf-citationDagens, A., Sigfrid, L., Cai, E., Lipworth, S., Cheng, V., Harris, E., Bannister, P., Rigby, I., & Horby, P. (2020) · BMJ · doi:10.1136/bmj.m1936 · Cited by 156 · cited 1×
“Nevertheless, these findings should be interpreted in the light of the efforts made around COVID-19, in particular the commitment around the estimation of COVID-19 cases and related deaths worldwide [1], the implementation of massive, international collaborations [4], the fast-tracking process of COVID-19 medical rese…”
BackgroundImpact of the COVID-19 pandemic on clinical research
Tuttle, K. R. (2020) · Nature Reviews Nephrology · doi:10.1038/s41581-020-00336-9 · Cited by 136 · cited 2×
“As a consequence, based on our simulation, there was a 18% decrease in the production of non-COVID-19 research, revealing to what extent the COVID-19 research has deeply impacted the non-COVID-19 research, a phenomenon highlighted and criticized by many researchers and key opinion leaders [6, 7, 9].”
BackgroundWhy is India having a covid-19 surge?
Thiagarajan, K. (2021) · BMJ · doi:10.1136/bmj.n1124 · Cited by 107 · cited 1×
“Although the worldwide population is progressively getting vaccinated, the COVID-19 pandemic still exerts a very harmful effect on many countries [38, 39].”
BackgroundZdravković, M., Berger‐Estilita, J., Zdravković, B., & Berger, D. (2020) · PLoS ONE · doi:10.1371/journal.pone.0241826 · Cited by 90
A Comprehensive Analysis of Authorship in Radiology Journals
Dang, W., McInnes, M. D. F., Kielar, A. Z., & Hong, J. (2015) · PLoS ONE · doi:10.1371/journal.pone.0139005 · Cited by 33
Brunson, J. C., Wang, X., & Laubenbacher, R. (2017) · PLoS ONE · doi:10.1371/journal.pone.0173444 · Cited by 25 · cited 1×
“This phenomenon has been highlighted in numerous medical specialties [19–21] and may be the aggregate consequence of multiple forces, such as the growing complexity [22] and interdisciplinarity of medical research [23], increasing academic and career pressure, increasingly limited funding and the rising number of coll…”
BackgroundAuthorship in Radiation Oncology: Proliferation Trends Over 30 Years
Ojerholm, E., & Swisher-McClure, S. D. (2015) · International Journal of Radiation Oncology*Biology*Physics · doi:10.1016/j.ijrobp.2015.07.2289 · Cited by 22
Covid-19 makes the future of UK clinical research uncertain
Iacobucci, G. (2020) · BMJ · doi:10.1136/bmj.m1619 · Cited by 19 · cited 1×
“Linked to that, major collaborative efforts have been launched to urgently address COVID-19 related medical issues [3, 4], sometimes at the expense of non-COVID-19 research [5].”
BackgroundThe COVID-19 Pandemic and the JAMA Network
Berkwits, M., Flanagin, A., Bauchner, H., & Fontanarosa, P. (2020) · JAMA · doi:10.1001/jama.2020.18298 · Cited by 15
Cited by
Publications during COVID-19 times: An unexpected overall increase
Rousseau, R., Garcia-Zorita, C., & Sanz-Casado, E. (2023) · Journal of Informetrics · doi:10.1016/j.joi.2023.101461 · Cited by 44
Profiling research on PFAS in wildlife: Systematic evidence map and bibliometric analysis
Vendl, C., Taylor, M. D., Bräunig, J., Ricolfi, L., Ahmed, R., Chin, M., Gibson, M. J., Hesselson, D., Neely, G. G., Lagisz, M., et al. (2024) · Ecological Solutions and Evidence · doi:10.1002/2688-8319.12292 · Cited by 31
Meho, L. I. (2025) · Scientometrics · doi:10.1007/s11192-025-05480-2 · Cited by 27
“The study analyzed institutional publication patterns across two separate intervals, 2018–2019 and 2023–2024, to capture recent, rapid shifts while minimizing distortions associated with the COVID-19 period (Ioannidis et al., 2021; Raynaud et al., 2021; Zam-marchi et al., 2024).”
Benzies, K. M., Zanoni, P., & McNeil, D. A. (2024) · Implementation Science Communications · doi:10.1186/s43058-024-00644-2 · Cited by 4
Metadata
- Authors
- Raynaud, M., Goutaudier, V., Louis, K., Al-Awadhi, S., Dubourg, Q., Truchot, A., Brousse, R., Saleh, N., Giarraputo, A., Debiais, C., Demir, Z., Certain, A., Tacafred, F., Cortes-Garcia, E., Yanes, S., Dagobert, J., Naser, S., Robin, B., Bailly, É., Jouven, X., Reese, P. P., & Loupy, A.
- Venue
- BMC Medical Research Methodology
- Published
- 2021-11-22
- Volume
- 21
- Issue
- 1
- Pages
- 255-255
- ISSN
- 1471-2288 (ISSN-L)
- OpenAlex
- W3217707917
- Cited by
- 183
- References
- 25
- FWCI
- 25.15
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.