Nonexperimental Comparative Effectiveness Research Using Linked Healthcare Databases
Open accessThe DOI matches its Crossref record; 8 of the 8 references it cites were found in a registry or an index.
Abstract
Comparative effectiveness research has gained a great deal of attention over the past years through the new federal coordinating council,1 a recent Institute of Medicine (IOM) report,2 and the American Recovery & Reinvestment Act stimulus funding.3 Comparative effectiveness research has a broad scope as defined by the IOM, addressing “... the generation and synthesis of evidence that compares the benefits and harms of alternative methods to prevent, diagnose, treat, and monitor a clinical condition or to improve the delivery of care. The purpose of [comparative effectiveness research] is to assist consumers, clinicians, purchasers, and policymakers to make informed decisions that will improve health care at both the individual and population levels.”2 So what's new? As pharmacoepidemiologists, we could point out that we have been generating evidence on health-relevant drug benefits and harms at the population level for over 25 years (the International Society for Pharmacoepdemiology just had its 26th International conference). And we could point out that we have moved from using untreated persons as a comparison group when assessing drug effects toward using persons treated with a realistic clinical alternative as a comparator group before the need for comparative effectiveness research became widely recognized (eg, Brookhart et al4). While comparative effectiveness research is much broader than pharmacoepidemiology, what is really new for us is the implicit acknowledgment of the value of nonexperimental evidence for benefits. Until recently,5 the U.S. Food and Drug Administration (FDA) has largely dismissed nonexperimental evidence on drug benefits (eg, Temple6), mainly because of fear about intractable confounding by indication.7,8 The FDA also insists on comparing treated with untreated persons (including those using a placebo) and does not accept the idea of a comparator drug for proof of efficacy.9 It is interesting to see that other U. S. government agencies, including the Agency for Health Care Research and Quality through their network of DEcIDE (Developing Evidence to Inform Decisions about Effectiveness) Centers,10 see this differently. It is also encouraging to see that some divisions of the FDA (eg, the Division of Epidemiology in the Office of Surveillance and Biometrics, Center for Devices and Radiologic Health) are pioneers in recognizing the value of nonexperimental research.5 When we focus on the nonexperimental evaluation of the use and the beneficial and harmful effects of drugs in the population (ie, pharmacoepidemiology), we have to acknowledge some specific aspects of drugs that we need to take into account. Drugs are the mainstay of contemporary medicine. They are used for the primary, secondary, and tertiary preventions of disease outcomes. A multibillion-dollar industry constantly screens chemical compounds for physiologic effects. Drugs are marketed only after experimental proof of efficacy (benefits) in humans. They are therefore likely to affect disease outcomes. Most prescription drugs are dispensed at pharmacies, which then submit claims to payors such as Medicare, Medicaid, or private insurance companies. Likewise, physician visits, hospital stays, laboratory test results, procedures, injections, and other encounters with the healthcare system generate paper trails (or the electronic equivalent thereof). By linking these data across various sources (insurance claims, electronic health records, clinical records, billing data, laboratory results, and vital statistics), an integrated picture of the patient's health and healthcare emerges. Researchers can obtain permission to access these data (stripped of key identifiers), with appropriate confidentiality safeguards.11 These databases have unique advantages for epidemiologic research. Most are population based and therefore less prone to the healthy (given the target) selection that is virtually unavoidable when recruiting and consenting participants for randomized trials or cohort studies.12 Linked healthcare databases include continuous service dates rather than the interval assessments (eg, every 2 years) that are common in epidemiologic cohort studies and many large trials. Continuous assessment of exposure and outcomes allows us to be specific about timing. This is an important consideration, given that having the exposure before the outcome is arguably the only sine qua non condition for causality.13 Linked healthcare databases contain information on almost all drugs prescribed or dispensed in an outpatient setting. They include codes for outpatient and inpatient diagnoses and procedures that the patient has received.11 They also have major downsides. Without pretending to be exhaustive (which is neither within the scope of this commentary nor necessary for our argument), these include lack of data on important confounders, lack of data on drugs administered during hospitalization or purchased over the counter, lack of mort
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Marginal Structural Models and Causal Inference in Epidemiology
Robins, J. M., Hernán, M. Á., & Brumback, B. (2000) · Epidemiology · doi:10.1097/00001648-200009000-00011 · Cited by 5,581
Constructing Inverse Probability Weights for Marginal Structural Models
Cole, S. R., & Hernan, M. A. (2008) · American Journal of Epidemiology · doi:10.1093/aje/kwn164 · Cited by 2,796
Evaluating medication effects outside of clinical trials: new-user designs
Ray, W. A. (2003) · American Journal of Epidemiology · doi:10.1093/aje/kwg231 · Cited by 1,646
A meta-analysis of the association between adherence to drug therapy and mortality
Simpson, S. H., Eurich, D. T., Majumdar, S. R., Padwal, R. S., Tsuyuki, R. T., Varney, J., & Johnson, J. A. (2006) · BMJ · doi:10.1136/bmj.38875.675486.55 · Cited by 1,353 · cited 1×
“Those not adherent to placebo in randomized trials have been shown to have twice the mortality rates of those adherent to placebo.(22) There is also the potential for immortal-time bias.”
BackgroundHemkens, L. G., Grouven, U., Bender, R., Günster, C., Gutschmidt, S., Selke, G. W., & Sawicki, P. T. (2009) · Diabetologia · doi:10.1007/s00125-009-1418-4 · Cited by 607 · cited 1×
“Current examples include insulin glargine and angiotensin receptor blockers, which have been suggested to increase risk for malignancies.(34,35) Fortunately in both cases we have obvious comparator drugs that allow us to limit the potential for bias, but we nonetheless need to be careful to avoid flaws in the study de…”
BackgroundIndications for propensity scores and review of their use in pharmacoepidemiology
Glynn, R. J., Schneeweiss, S., & Stürmer, T. (2006) · Basic & Clinical Pharmacology & Toxicology · doi:10.1111/j.1742-7843.2006.pto_293.x · Cited by 541
Self-citationObservational research, randomised trials, and two views of medical science
Vandenbroucke, J. P. (2008) · PLoS Medicine · doi:10.1371/journal.pmed.0050067 · Cited by 416
Messer, L. C., Oakes, J. M., & Mason, S. (2010) · American Journal of Epidemiology · doi:10.1093/aje/kwp435 · Cited by 161
Cited by
Registries for Evaluating Patient Outcomes: A User’s Guide
(2020) · doi:10.23970/ahrqepcregistries4 · Cited by 960
Lund, J. L., Richardson, D. B., & Stürmer, T. (2015) · Current Epidemiology Reports · doi:10.1007/s40471-015-0053-5 · Cited by 739
Self-citationShirani, A., Zhao, Y., Karim, M. E., Evans, C., Kingwell, E., van der Kop, M. L., Oger, J., Gustafson, P., Petkau, J., & Tremlett, H. (2012) · JAMA · doi:10.1001/jama.2012.7625 · Cited by 263
Use of Azithromycin and Death from Cardiovascular Causes
Svanström, H., Pasternak, B., & Hviid, A. (2013) · New England Journal of Medicine · doi:10.1056/nejmoa1300799 · Cited by 254
Hwang, Y. J., Dixon, S. N., Reiss, J. P., Wald, R., Parikh, C. R., Gandhi, S., Shariff, S. Z., Pannu, N., Nash, D. M., Rehman, F., et al. (2014) · Annals of Internal Medicine · doi:10.7326/m13-2796 · Cited by 136
Metadata
- Authors
- Stürmer, T., Jonsson Funk, M., Poole, C., & Brookhart, M. A.
- Venue
- Epidemiology
- Published
- 2011-05
- Volume
- 22
- Issue
- 3
- Pages
- 298-301
- ISSN
- 1044-3983 (ISSN-L)
- OpenAlex
- W2036645664
- Cited by
- 73
- References
- 8
- FWCI
- 10.02
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.