Evidence-based de-implementation for contradicted, unproven, and aspiring healthcare practices
Open accessThe DOI matches its Crossref record; 33 of the 33 references it cites were found in a registry or an index.
Abstract
Abandoning ineffective medical practices and mitigating the risks of untested practices are important for improving patient health and containing healthcare costs. Historically, this process has relied on the evidence base, societal values, cultural tensions, and political sway, but not necessarily in that order. We propose a conceptual framework to guide and prioritize this process, shifting emphasis toward the principles of evidence-based medicine, acknowledging that evidence may still be misinterpreted or distorted by recalcitrant proponents of entrenched practices and other biases.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The check wasn’t confident either way, so it gives no verdict — never disputed.
In the citing paper
“However, efforts to identify, develop, and test implementation strategies have been complicated by a lack of conceptual clarity [1,6-9].”
From A refined compilation of implementation strategies: results from the Expert Recommendations for Implementing Change (ERIC) project (2015) · cites this paper as [8]
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Fractional Flow Reserve–Guided PCI versus Medical Therapy in Stable Coronary Disease
De Bruyne, B., Pijls, N. H. J., Kalesan, B., Barbato, E., Tonino, P. A. L., Piroth, Z., Jagic, N., Möbius-Winkler, S., Rioufol, G., Witt, N., et al. (2012) · New England Journal of Medicine · doi:10.1056/nejmoa1205361 · Cited by 2,772 · cited 1×
“OMT, though there were no differences in cardiac death, myocardial infarction, or stroke [10].”
Stenting versus Aggressive Medical Therapy for Intracranial Arterial Stenosis
Chimowitz, M. I., Lynn, M. J., Derdeyn, C. P., Turan, T. N., Fiorella, D., Lane, B. F., Janis, L. S., Lutsep, H. L., Barnwell, S. L., Waters, M. F., et al. (2011) · New England Journal of Medicine · doi:10.1056/nejmoa1105335 · Cited by 1,901
Screening for breast cancer with mammography
Gøtzsche, P. C., & Jørgensen, K. J. (2013) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd001877.pub5 · Cited by 1,869 · cited 1×
“At times, such calculations may favor costly trials where the existing evidence base is weak, observational studies suggest inefficiencies, and the ongoing costs are large [22].”
BackgroundScientific evidence underlying the ACC/AHA clinical practice guidelines.
Tricoci, P. (2009) · JAMA · doi:10.1001/jama.2009.205 · Cited by 908 · cited 1×
“An empirical evaluation of the Cochrane Database of Systematic Reviews found that the existing evidence base was unable to support or refute 49% of interventions [17], and 48% of American College of Cardiology recommendations were supported by expert opinion only [18].”
MethodTargeted versus universal decolonization to prevent ICU infection
Huang, S. S., Septimus, E., Kleinman, K., Moody, J., Hickok, J., Avery, T. R., Lankiewicz, J., Gombosev, A., Terpstra, L., Hartford, F., et al. (2013) · New England Journal of Medicine · doi:10.1056/nejmoa1207290 · Cited by 795 · cited 1×
“Such resistance to adhere to the best available evidence inflates healthcare costs, and may distract from alternative strategies with promising early results of efficacy, such as universal decolonization protocols [16].”
BackgroundVeterans Affairs Initiative to Prevent Methicillin-Resistant Staphylococcus aureus Infections
Jain, R., Kralovic, S. M., Evans, M. E., Ambrose, M., Simbartl, L. A., Obrosky, D. S., Render, M. L., Freyberg, R. W., Jernigan, J. A., Muder, R. R., et al. (2011) · New England Journal of Medicine · doi:10.1056/nejmoa1007474 · Cited by 496 · cited 1×
“Another example is the routine use of gown and glove precautions among patients colonized with resistant pathogens, which is supported only by quasi-experimental, before-and-after, studies [11].”
BackgroundKatritsis, D. G., & Ioannidis, J. P. A. (2005) · Circulation · doi:10.1161/circulationaha.104.521864 · Cited by 431 · cited 1×
“corroborating meta-analyses [6,7] failed to stem the use”
ResultSelf-citationAn economic approach to clinical trial design and research priority-setting
Claxton, K., & Posnett, J. (1996) · Health Economics · doi:10.1002/(sici)1099-1050(199611)5:6<513::aid-hec237>3.0.co;2-9 · Cited by 395 · cited 2×
“Value of information (VOI) offers a decision-making framework that tries to capture several of the above issues, at least the ones that can be best quantified [19].”
BackgroundIntervention to Reduce Transmission of Resistant Bacteria in Intensive Care
Huskins, W. C., Huckabee, C. M., O'Grady, N. P., Murray, P., Kopetskie, H., Zimmer, L., Walker, M. E., Sinkowitz-Cochran, R. L., Jernigan, J. A., Samore, M., et al. (2011) · New England Journal of Medicine · doi:10.1056/nejmoa1000373 · Cited by 393 · cited 2×
“Yet, to date, two clusterrandomized trials have failed to support the benefits of this practice [12,13].”
BackgroundA Decade of Reversal: An Analysis of 146 Contradicted Medical Practices
Prasad, V., Vandross, A., Toomey, C., Cheung, M., Rho, J., Quinn, S., Chacko, S. J., Borkar, D., Gall, V., Selvaraj, S., et al. (2013) · Mayo Clinic Proceedings · doi:10.1016/j.mayocp.2013.05.012 · Cited by 381 · cited 2×
“One search produced over 150 potentially ineffective or unsafe practices [1], and empirical reviews of high impact medical journals have generated over 140 reversed medical practices [2].”
BackgroundSelf-citationPathological Complete Response and Accelerated Drug Approval in Early Breast Cancer
Prowell, T. M., & Pazdur, R. (2012) · New England Journal of Medicine · doi:10.1056/nejmp1205737 · Cited by 342 · cited 1×
“Unfortunately, regulatory agencies appear to move increasingly in the opposite direction, notably with the creation of the FDA’s ‘breakthrough’ designation [28], and emerging guidance to industry for expanded options of accelerated approval [29,30] —a regulatory mechanism where developers have historically shirked pos…”
BackgroundScreening for breast cancer with mammography
Gøtzsche, P. C., & Nielsen, M. (2011) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd001877.pub4 · Cited by 311
Harris, A. D. (2013) · JAMA · doi:10.1001/jama.2013.277815 · Cited by 266 · cited 2×
“Yet, to date, two clusterrandomized trials have failed to support the benefits of this practice [12,13].”
BackgroundOver 150 potentially low‐value health care practices: an Australian study
Elshaug, A. G., Watt, A. M., Mundy, L., & Willis, C. D. (2012) · Medical Journal of Australia · doi:10.5694/mja12.11083 · Cited by 224
Evaluation of Impermeable Covers for Bedding in Patients with Allergic Rhinitis
Terreehorst, I., Hak, E., Oosting, A. J., Tempels-Pavlica, Z., de Monchy, J. G. R., Bruijnzeel-Koomen, C. A. F. M., Aalberse, R. C., & Gerth van Wijk, R. (2003) · New England Journal of Medicine · doi:10.1056/nejmoa023171 · Cited by 224 · cited 1×
“At other times, small trials that eliminate boutique practices may be employed [23].”
BackgroundStergiopoulos, K. (2012) · Archives of Internal Medicine · doi:10.1001/archinternmed.2011.1484 · Cited by 212 · cited 1×
“corroborating meta-analyses [6,7] failed to stem the use”
ResultRegulatory Innovation and Drug Development for Early-Stage Alzheimer's Disease
Kozauer, N., & Katz, R. (2013) · New England Journal of Medicine · doi:10.1056/nejmp1302513 · Cited by 193 · cited 1×
“Unfortunately, regulatory agencies appear to move increasingly in the opposite direction, notably with the creation of the FDA’s ‘breakthrough’ designation [28], and emerging guidance to industry for expanded options of accelerated approval [29,30] —a regulatory mechanism where developers have historically shirked pos…”
BackgroundPatterns and Intensity of Medical Therapy in Patients Undergoing Percutaneous Coronary Intervention
Borden, W. B. (2011) · JAMA · doi:10.1001/jama.2011.601 · Cited by 188 · cited 8×
“Not only has COURAGE and corroborating meta-analyses [6,7] failed to stem the use of PCI, but it appears that they have also not improved adherence to OMT at time of PCI [8].”
BackgroundInfluentialEnsuring the integrity of clinical practice guidelines: a tool for protecting patients
Lenzer, J., Hoffman, J. R., Furberg, C. D., & Ioannidis, J. P. A. (2013) · BMJ · doi:10.1136/bmj.f5535 · Cited by 187 · cited 1×
“Expert-based meta-analyses with tailored eligibility criteria and outcome selection to show some benefit [3], and conflicted expert guidelines can follow suit [4].”
BackgroundSelf-citationStamatakis, E., Weiler, R., & Ioannidis, J. P. A. (2013) · European Journal of Clinical Investigation · doi:10.1111/eci.12074 · Cited by 113 · cited 1×
“Expert-based meta-analyses with tailored eligibility criteria and outcome selection to show some benefit [3], and conflicted expert guidelines can follow suit [4].”
BackgroundSelf-citationMapping the Cochrane evidence for decision making in health care
Dib, R. E., Atallah, Á. N., & Andriolo, R. B. (2007) · Journal of Evaluation in Clinical Practice · doi:10.1111/j.1365-2753.2007.00886.x · Cited by 96 · cited 1×
“An empirical evaluation of the Cochrane Database of Systematic Reviews found that the existing evidence base was unable to support or refute 49% of interventions [17], and 48% of American College of Cardiology recommendations were supported by expert opinion only [18].”
MethodIntervention to Reduce Transmission of Resistant Bacteria in Intensive Care
Huskins, W. C., Huckabee, C. M., O’Grady, N. P., Murray, P., Kopetskie, H., Zimmer, L., Walker, M. E., Sinkowitz-Cochran, R. L., Jernigan, J. A., Samore, M., et al. (2012) · Survey of Anesthesiology · doi:10.1097/sa.0b013e31824bba57 · Cited by 95
Targeted Versus Universal Decolonization to Prevent ICU Infection
Huang, S. S., Septimus, E., Kleinman, K., Moody, J., Hickok, J., Avery, T. R., Lankiewicz, J., Gombosev, A., Terpstra, L., Hartford, F., et al. (2014) · Survey of Anesthesiology · doi:10.1097/01.sa.0000441041.37323.f9 · Cited by 86
Lessons Learned Preparing for Medicare Bundled Payments
Mechanic, R. E., & Tompkins, C. P. (2012) · New England Journal of Medicine · doi:10.1056/nejmp1210823 · Cited by 55 · cited 1×
“Finally, as payment structures shift from fee for service towards bundles [24], costly components may lose faithful disciples.”
BackgroundBiologic agents in rheumatology: unmet issues after 200 trials and $200 billion sales
Ioannidis, J. P. A., Karassa, F. B., Druyts, E., Thorlund, K., & Mills, E. J. (2013) · Nature Reviews Rheumatology · doi:10.1038/nrrheum.2013.134 · Cited by 51 · cited 1×
“Collectively, there remains clinical uncertainty about how best to use these agents [20].”
BackgroundSelf-citationPrasad, V. K., Rho, J., & Cifu, A. S. (2013) · JAMA Internal Medicine · doi:10.1001/jamainternmed.2013.2725 · Cited by 49 · cited 1×
“At the same time, the IVC filter has never shown to improve any patient-centered outcome for any patient population in a prospective trial, and traces its approval through the FDAs 510 k mechanism [21].”
BackgroundSelf-citationAccelerated Approval and Possible Withdrawal of Midodrine
Dhruva, S. S., & Redberg, R. F. (2010) · JAMA · doi:10.1001/jama.2010.1695 · Cited by 40
User Fees and Beyond — The FDA Safety and Innovation Act of 2012
Kramer, D. B., & Kesselheim, A. S. (2012) · New England Journal of Medicine · doi:10.1056/nejmp1207800 · Cited by 29 · cited 1×
“Unfortunately, regulatory agencies appear to move increasingly in the opposite direction, notably with the creation of the FDA’s ‘breakthrough’ designation [28], and emerging guidance to industry for expanded options of accelerated approval [29,30] —a regulatory mechanism where developers have historically shirked pos…”
BackgroundUniversal Glove and Gown Use and Acquisition of Antibiotic-Resistant Bacteria in the ICU
Harris, A. D., Pineles, L. L., Belton, B. M., Johnson, J., Shardell, M. D., Loeb, M. B., Newhouse, R. P., Dembry, L. M., Braun, B. I., Perencevich, E. N., et al. (2014) · Survey of Anesthesiology · doi:10.1097/sa.0000000000000059 · Cited by 23
Siontis, G. C. M., Tatsioni, A., Katritsis, D. G., & Ioannidis, J. P. A. (2009) · American Heart Journal · doi:10.1016/j.ahj.2008.11.023 · Cited by 18 · cited 1×
“over, and poor study power [9].”
Self-citationPreventing Infections in the ICU: One Size Does Not Fit All
Malani, P. (2013) · JAMA · doi:10.1001/jama.2013.277816 · Cited by 12 · cited 1×
“Some have even claimed that ‘the likelihood of harm (more than clear evidence of benefit) should drive the decision to implement’ [15], i.”
BackgroundEvaluating Health System Processes With Randomized Controlled Trials
Ioannidis, J. P. A., & Prasad, V. K. (2013) · JAMA Internal Medicine · doi:10.1001/jamainternmed.2013.1044 · Cited by 8 · cited 2×
“These studies have failed to change this practice, however, and editorial ambivalence continues [14].”
BackgroundSelf-citationTrends in Intracranial Stenting Among Medicare Beneficiaries in the United States, 2006–2010
Gupta, A., Desai, M. M., Kim, N. V., Bulsara, K. R., Wang, Y., & Krumholz, H. M. (2013) · Journal of the American Heart Association · doi:10.1161/jaha.113.000084 · Cited by 6
Cited by
Powell, B. J., Waltz, T. J., Chinman, M. J., Damschroder, L. J., Smith, J. L., Matthieu, M. M., Proctor, E. K., & Kirchner, J. E. (2015) · Implementation Science · doi:10.1186/s13012-015-0209-1 · Cited by 4,963
Waltz, T. J., Powell, B. J., Matthieu, M. M., Damschroder, L. J., Chinman, M. J., Smith, J. L., Proctor, E. K., & Kirchner, J. E. (2015) · Implementation Science · doi:10.1186/s13012-015-0295-0 · Cited by 1,108
Pfadenhauer, L. M., Gerhardus, A., Mozygemba, K., Lysdahl, K. B., Booth, A., Hofmann, B., Wahlster, P., Polus, S., Burns, J., Brereton, L., et al. (2017) · Implementation Science · doi:10.1186/s13012-017-0552-5 · Cited by 1,016
Methods to Improve the Selection and Tailoring of Implementation Strategies
Powell, B. J., Beidas, R. S., Lewis, C. C., Aarons, G. A., McMillen, J. C., Proctor, E. K., & Mandell, D. S. (2017) · The Journal of Behavioral Health Services & Research · doi:10.1007/s11414-015-9475-6 · Cited by 967
What’s in a mechanism? Development of a key concept in realist evaluation
Dalkin, S. M., Greenhalgh, J., Jones, D., Cunningham, B., & Lhussier, M. (2015) · Implementation Science · doi:10.1186/s13012-015-0237-x · Cited by 896
Metadata
- Authors
- Prasad, V., & Ioannidis, J. P.
- Affiliations
- National Cancer Institute (US)
- Corresponding author
- Ioannidis, John PA
- Venue
- Implementation Science
- Published
- 2014-01-08
- Volume
- 9
- Issue
- 1
- Pages
- 1-1
- ISSN
- 1748-5908 (ISSN-L)
- PMC
- PMC3892018
- OpenAlex
- W1993198628
- Cited by
- 723
- References
- 33
- Citations by year
- 2026: 8 · 2025: 13 · 2024: 22 · 2023: 36 · 2022: 78 · 2021: 121 · 2020: 82 · 2019: 62 · 2018: 84 · 2017: 106 · 2016: 49 · 2015: 41 · 2014: 19
- FWCI
- 129.45
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- Locations
- Implementation Science (publishedVersion, cc-by)
- Europe PMC (PubMed Central) (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- eScholarship (California Digital Library) (submittedVersion, cc-by)
- Topics
- Health Sciences › Health Professions › General Health Professions › Health Policy Implementation Science
- Health Sciences › Health Professions › General Health Professions › Health Sciences Research and Education
- Health Sciences › Medicine › Public Health, Environmental and Occupational Health › Clinical practice guidelines implementation
- Keywords
- de-implementation, evidence-based medicine, conceptual framework, health care costs, patient health
- MeSH terms
- Diffusion of Innovation, Practice Patterns, Physicians', Quality of Health Care, Evidence-Based Medicine, Patient Safety
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.