A General Framework for Considering Selection Bias in EHR-Based Studies: What Data are Observed and Why?
Open accessThe DOI matches its Crossref record; 9 of the 9 references it cites were found in a registry or an index.
Abstract
Electronic health records (EHR) data are increasingly seen as a resource for cost-effective comparative effectiveness research (CER). Since EHR data are collected primarily for clinical and/or billing purposes, their use for CER requires consideration of numerous methodologic challenges including the potential for confounding bias, due to a lack of randomization, and for selection bias, due to missing data. In contrast to the recent literature on confounding bias in EHR-based CER, virtually no attention has been paid to selection bias possibly due to the belief that standard methods for missing data can be readily-applied. Such methods, however, hinge on an overly simplistic view of the available/missing EHR data, so that their application in the EHR setting will often fail to completely control selection bias. Motivated by challenges we face in an on-going EHR-based comparative effectiveness study of choice of antidepressant treatment and long-term weight change, we propose a new general framework for selection bias in EHR-based CER. Crucially, the framework provides structure within which researchers can consider the complex interplay between numerous decisions, made by patients and health care providers, which give rise to health-related information being recorded in the EHR system, as well as the wide variability across EHR systems themselves. This, in turn, provides structure within which: (i) the transparency of assumptions regarding missing data can be enhanced, (ii) factors relevant to each decision can be elicited, and (iii) statistical methods can be better aligned with the complexity of the data.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Sterne, J. A. C., White, I. R., Carlin, J. B., Spratt, M., Royston, P., Kenward, M. G., Wood, A. M., & Carpenter, J. R. (2009) · BMJ · doi:10.1136/bmj.b2393 · Cited by 7,299
A structural approach to selection bias
Hernán, M. A., Hernández-Díaz, S., & Robins, J. M. (2004) · Epidemiology · doi:10.1097/01.ede.0000135174.63482.43 · Cited by 2,844
Weiskopf, N. G., & Weng, C. (2013) · Journal of the American Medical Informatics Association · doi:10.1136/amiajnl-2011-000681 · Cited by 1,216 · cited 2×
“Electronic health records (EHR) are playing an increasingly prominent role in comparative effectiveness research (CER) with key benefits including that they often contain rich information on large populations over long time frames, are relatively inexpensive to obtain, and can be updated in near real time.(1-4) Recogn…”
BackgroundSchneeweiss, S., Rassen, J. A., Glynn, R. J., Avorn, J., Mogun, H., & Brookhart, M. A. (2009) · Epidemiology · doi:10.1097/ede.0b013e3181a663cc · Cited by 1,128
Antidepressants and Body Weight: A Comprehensive Review and Meta-Analysis
Serretti, A., & Mandelli, L. (2010) · The Journal of Clinical Psychiatry · doi:10.4088/jcp.09r05346blu · Cited by 621 · cited 1×
“, paroxetine and mirtazapine), the existing literature is limited in that it focuses on short-term outcomes of 12 months or less.(25-29) Given the lack of evidence regarding long-term outcomes we took weight change at 24 months posttreatment initiation to be the primary outcome.”
BackgroundHersh, W. R., Weiner, M. G., Embi, P. J., Logan, J. R., Payne, P. R. O., Bernstam, E. V., Lehmann, H. P., Hripcsak, G., Hartzog, T. H., Cimino, J. J., et al. (2013) · Medical Care · doi:10.1097/mlr.0b013e31829b1dbd · Cited by 567
Johnson, M. L., Crown, W., Martin, B. C., Dormuth, C. R., & Siebert, U. (2009) · Value in Health · doi:10.1111/j.1524-4733.2009.00602.x · Cited by 285
An Electronic Health Records Study of Long-Term Weight Gain Following Antidepressant Use
Blumenthal, S. R., Castro, V. M., Clements, C. C., Rosenfield, H. R., Murphy, S. N., Fava, M., Weilburg, J. B., Erb, J. L., Churchill, S. E., Kohane, I. S., et al. (2014) · JAMA Psychiatry · doi:10.1001/jamapsychiatry.2014.414 · Cited by 151 · cited 1×
“, paroxetine and mirtazapine), the existing literature is limited in that it focuses on short-term outcomes of 12 months or less.(25-29) Given the lack of evidence regarding long-term outcomes we took weight change at 24 months posttreatment initiation to be the primary outcome.”
BackgroundToward Reuse of Clinical Data for Research and Quality Improvement: The End of the Beginning?
Weiner, M. G., & Embi, P. J. (2009) · Annals of Internal Medicine · doi:10.7326/0003-4819-151-5-200909010-00141 · Cited by 129
Cited by
Sellgren, C. M., Gracias, J., Watmuff, B., Biag, J. D., Thanos, J. M., Whittredge, P. B., Fu, T., Worringer, K., Brown, H. E., Wang, J., et al. (2019) · Nature Neuroscience · doi:10.1038/s41593-018-0334-7 · Cited by 786
Artificial Intelligence for Drug Toxicity and Safety
Basile, A. O., Yahi, A., & Tatonetti, N. P. (2019) · Trends in Pharmacological Sciences · doi:10.1016/j.tips.2019.07.005 · Cited by 363
Li, Q., Yang, X., Xu, J., Guo, Y., He, X., Hu, H., Lyu, T., Marra, D., Miller, A., Smith, G., et al. (2023) · Alzheimer's & Dementia · doi:10.1002/alz.12967 · Cited by 113
“The absolute SHAP value of each feature indicates its importance.”
BackgroundAssessing Missing Data Assumptions in EHR-Based Studies: A Complex and Underappreciated Task
Haneuse, S., Arterburn, D., & Daniels, M. J. (2021) · JAMA Network Open · doi:10.1001/jamanetworkopen.2021.0184 · Cited by 110
Self-citationSisk, R., Sperrin, M., Peek, N., van Smeden, M., & Martin, G. P. (2023) · Statistical Methods in Medical Research · doi:10.1177/09622802231165001 · Cited by 99
Metadata
- Authors
- Haneuse, S., & Daniels, M.
- Venue
- eGEMs (Generating Evidence & Methods to improve patient outcomes)
- Publisher
- Ubiquity Press, Ltd.
- Published
- 2016-08-31
- Volume
- 4
- Issue
- 1
- Pages
- 16
- ISSN
- 2327-9214 (ISSN-L)
- OpenAlex
- W2512716582
- Cited by
- 119
- References
- 9
- FWCI
- 6.49
- Type
- journal article
- Language
- en
- Open access
- diamond
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: A General Framework for Considering Selection Bias in EHR-Based Studies: What Data are Observed and Why? https://app.cochat.ai/papers/10.13063/2327-9214.1203
- The paper
- Haneuse, S., & Daniels, M. (2016). A General Framework for Considering Selection Bias in EHR-Based Studies: What Data are Observed and Why? eGEMs (Generating Evidence & Methods to improve patient outcomes). https://doi.org/10.13063/2327-9214.1203
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.