Will COVID-19 be evidence-based medicine’s nemesis?
Open accessThe DOI matches its Crossref record; 7 of the 7 references it cites were found in a registry or an index.
Abstract
Once defined in rhetorical but ultimately meaningless terms as "the conscientious, judicious and explicit use of current best evidence in making decisions about the care of individual patients" [1], evidence-based medicine rests on certain philosophical assumptions: a singular truth, ascertainable through empirical enquiry; a linear logic of causality in which interventions have particular effect sizes; rigour defined primarily in methodological terms (especially, a hierarchy of preferred study designs and tools for detecting bias); and a deconstructive approach to problem-solving (the evidence base is built by answering focused questions, typically framed as 'PICO'-population-intervention-comparison-outcome) [2].The trouble with pandemics is that these assumptions rarely hold.A pandemic-sized problem can be framed and contested in multiple ways.Some research questions around COVID-19, most notably relating to drugs and vaccines, are amenable to randomised controlled trials (and where such trials were possible, they were established with impressive speed and efficiency [3,4]).But many knowledge gaps are broader and cannot be reduced to PICO-style questions.Were care home deaths avoidable [5]?Why did the global supply chain for personal protective equipment break down [6]?What role does health system resilience play in controlling the pandemic [7]?And so on.Against these-and other-wider questions, the neat simplicity of a controlled, intervention-on versus intervention-off experiment designed to produce a definitive (i.e.statistically significant and widely generalisable) answer to a focused question rings hollow.In particular, upstream preventive public health interventions aimed at supporting widespread and sustained behaviour change across an entire population (as opposed to testing the impact of a short-term behaviour change in a select sample) rarely lend themselves to such a design [8,9].When implementing population-wide public health interventions-whether conventional measures such as diet or exercise, or COVID-19 related ones such as handwashing, social distancing and face coverings-we must not only persuade individuals to change their behavior but also adapt the environment to make such changes easier to make and sustain [10][11][12].Population-wide public health efforts are typically iterative, locally-grown and path-dependent, and they have an established methodology for rapid evaluation and adaptation [9].But evidence-based medicine has tended to classify such designs as "low methodological quality" [13].Whilst this has been recognised as a problem in public health practice for some time [11], the inadequacy of the dominant paradigm has suddenly become mission-critical.Whilst evidence-based medicine recognises that study designs must reflect the nature of question (randomized trials, for example, are preferred only for therapy questions [13]), even senior scientists sometimes over-apply its hierarchy of evidence.An interdisciplinary group of scholars from the UK's prestigious Royal Society recently reviewed the use of face masks by the general public, drawing on evidence from laboratory science, mathematical modelling and
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
GRADE: an emerging consensus on rating quality of evidence and strength of recommendations
Guyatt, G. H., Oxman, A. D., Vist, G. E., Kunz, R., Falck-Ytter, Y., Alonso-Coello, P., & Schünemann, H. J. (2008) · BMJ · doi:10.1136/bmj.39489.470347.ad · Cited by 23,305 · cited 2×
“Whilst evidence-based medicine recognises that study designs must reflect the nature of question (randomized trials, for example, are preferred only for therapy questions [13]), even senior scientists sometimes over-apply its hierarchy of evidence.”
BackgroundEvidence based medicine: what it is and what it isn't
Sackett, D. L., Rosenberg, W. M. C., Gray, J. A. M., Haynes, R. B., & Richardson, W. S. (1996) · BMJ · doi:10.1136/bmj.312.7023.71 · Cited by 15,769
Developing Covid-19 Vaccines at Pandemic Speed
Lurie, N., Saville, M., Hatchett, R., & Halton, J. (2020) · New England Journal of Medicine · doi:10.1056/nejmp2005630 · Cited by 1,557
The need for a complex systems model of evidence for public health
Rutter, H., Savona, N., Glonti, K., Bibby, J., Cummins, S., Finegood, D. T., Greaves, F., Harper, L., Hawe, P., Moore, L., et al. (2017) · The Lancet · doi:10.1016/s0140-6736(17)31267-9 · Cited by 1,260 · cited 2×
“Multiple interventions might each contribute to an overall beneficial effect through heterogeneous effects on disparate causal pathways, even though none would have a statistically significant impact on any predefined variable [11].”
BackgroundPhysical interventions to interrupt or reduce the spread of respiratory viruses
Jefferson, T., Del Mar, C. B., Dooley, L., Ferroni, E., Al-Ansary, L. A., Bawazeer, G. A., van Driel, M. L., Nair, N. S., Jones, M. A., Thorning, S., et al. (2011) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd006207.pub4 · Cited by 805
Applying principles of behaviour change to reduce SARS-CoV-2 transmission
West, R., Michie, S., Rubin, G. J., & Amlôt, R. (2020) · Nature Human Behaviour · doi:10.1038/s41562-020-0887-9 · Cited by 658 · cited 1×
“In particular, upstream preventive public health interventions aimed at supporting widespread and sustained behaviour change across an entire population (as opposed to testing the impact of a short-term behaviour change in a select sample) rarely lend themselves to such a design [8, 9].”
BackgroundAre high-performing health systems resilient against the COVID-19 epidemic?
Legido-Quigley, H., Asgari, N., Teo, Y. Y., Leung, G. M., Oshitani, H., Fukuda, K., Cook, A. R., Hsu, L. Y., Shibuya, K., & Heymann, D. (2020) · The Lancet · doi:10.1016/s0140-6736(20)30551-1 · Cited by 563
Cited by
Gattrell, W. T., Logullo, P., van Zuuren, E. J., Price, A., Hughes, E. L., Blazey, P., Winchester, C. C., Tovey, D., Goldman, K., Hungin, A. P., et al. (2024) · PLOS Medicine · doi:10.1371/journal.pmed.1004326 · Cited by 701
“…or guidance are needed and there is uncertainty on the best course of action, such as when evidence is emergent, inconsistent, limited, or absent—not least in rapidly evolving fields such as pandemics [3]—the collation and dissemination of knowledge, experience, and expertise becomes critical.”
BackgroundCOVID-19: effective policymaking depends on trust in experts, politicians, and the public
Cairney, P., & Wellstead, A. (2020) · Policy Design and Practice · doi:10.1080/25741292.2020.1837466 · Cited by 216
“The latter symbolizes distrust in outsiders, particularly when there are conflicting beliefs on policy, no regular interaction, and disagreement between internal and external scientists (such as during the shift toward mask use in public — Greenhalgh 2020).”
BackgroundThe UK Government’s COVID-19 Policy: What Does “Guided by the Science” Mean in Practice?
Cairney, P. (2021) · Frontiers in Political Science · doi:10.3389/fpos.2021.624068 · Cited by 79
Haber, N. A., Clarke-Deelder, E., Feller, A., Smith, E. R., Salomon, J. A., MacCormack-Gelles, B., Stone, E. M., Bolster-Foucault, C., Daw, J. R., Hatfield, L. A., et al. (2022) · BMJ Open · doi:10.1136/bmjopen-2021-053820 · Cited by 36
Metadata
- Authors
- Greenhalgh, T.
- Venue
- PLOS Medicine
- Publisher
- Public Library of Science (PLoS)
- Published
- 2020-06-30
- Volume
- 17
- Issue
- 6
- Pages
- e1003266
- ISSN
- 1549-1277 (ISSN-L)
- 1549-1676
- OpenAlex
- W3040565301
- Cited by
- 146
- References
- 7
- FWCI
- 25.65
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.