Illustrating Informed Presence Bias in Electronic Health Records Data: How Patient Interactions with a Health System Can Impact Inference
Open accessThe DOI matches its Crossref record; 8 of the 8 references it cites were found in a registry or an index.
Abstract
Electronic health record (EHR) data are becoming a primary resource for clinical research. Compared to traditional research data, such as those from clinical trials and epidemiologic cohorts, EHR data have a number of appealing characteristics. However, because they do not have mechanisms set in place to ensure that the appropriate data are collected, they also pose a number of analytic challenges. In this paper, we illustrate that how a patient interacts with a health system influences which data are recorded in the EHR. These interactions are typically informative, potentially resulting in bias. We term the overall set of induced biases informed presence. To illustrate this, we use examples from EHR based analyses. Specifically, we show that: 1) Where a patient receives services within a health facility can induce selection bias; 2) Which health system a patient chooses for an encounter can result in information bias; and 3) Referral encounters can create an admixture bias. While often times addressing these biases can be straightforward, it is important to understand how they are induced in any EHR based analysis.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Coding algorithms for defining comorbidities in ICD-9-CM and ICD-10 administrative data
Quan, H., Sundararajan, V., Halfon, P., Fong, A., Burnand, B., Luthi, J.-C., Saunders, L. D., Beck, C. A., Feasby, T. E., & Ghali, W. A. (2005) · Medical Care · doi:10.1097/01.mlr.0000182534.19832.83 · Cited by 10,669
External validity of randomised controlled trials: “To whom do the results of this trial apply?”
Rothwell, P. M. (2005) · The Lancet · doi:10.1016/s0140-6736(04)17670-8 · Cited by 2,544 · cited 1×
“The data collected in trials have mechanisms in place designed to minimize biases.(21) These mechanisms include scheduled encounters and pre-specified protocols that define the information that is to be collected at each encounter.”
BackgroundGoldstein, B. A., Navar, A. M., Pencina, M. J., & Ioannidis, J. P. A. (2017) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocw042 · Cited by 936
Self-citationAssessing the Gold Standard — Lessons from the History of RCTs
Bothwell, L. E., Greene, J. A., Podolsky, S. H., & Jones, D. S. (2016) · New England Journal of Medicine · doi:10.1056/nejmms1604593 · Cited by 664 · cited 1×
“The gold standard data source for clinical research are clinical trials and epidemiological cohort studies.(1) Clinical trials are governed by protocols and are carefully organized to answer discrete questions.”
BackgroundHersh, W. R., Weiner, M. G., Embi, P. J., Logan, J. R., Payne, P. R. O., Bernstam, E. V., Lehmann, H. P., Hripcsak, G., Hartzog, T. H., Cimino, J. J., et al. (2013) · Medical Care · doi:10.1097/mlr.0b013e31829b1dbd · Cited by 567 · cited 1×
“However, since they are designed for clinical care and billing purposes, rather than research, the data from them are inherently different from traditional data sources.(2) They present an opportunistic and non-random snapshot of patient interactions, capturing only the information that is relevant to each specific en…”
BackgroundRusanov, A., Weiskopf, N. G., Wang, S., & Weng, C. (2014) · BMC Medical Informatics and Decision Making · doi:10.1186/1472-6947-14-51 · Cited by 137 · cited 1×
“Rates of missingness vary across populations, potentially biasing estimates based on available data and even entire analytic samples.(10,11) Approaches to deal with these challenges have been proposed but have not been adopted uniformly across analyses.”
BackgroundIdentifying and mitigating biases in EHR laboratory tests
Pivovarov, R., Albers, D. J., Sepulveda, J. L., & Elhadad, N. (2014) · Journal of Biomedical Informatics · doi:10.1016/j.jbi.2014.03.016 · Cited by 91 · cited 1×
“, reason for lab measurement or if the encounter was patient initiat d) can improve analysis.(14,15)”
BackgroundNol, P. H., Copeland, L. A., Perrin, R. A., Lancaster, A. E., Pugh, M. J., Wang, C.-P., Bollinger, M. J., & Hazuda, H. P. (2010) · The Journal of Rehabilitation Research and Development · doi:10.1682/jrrd.2009.08.0110 · Cited by 77
Cited by
Axes of a revolution: challenges and promises of big data in healthcare
Shilo, S., Rossman, H., & Segal, E. (2020) · Nature Medicine · doi:10.1038/s41591-019-0727-5 · Cited by 370
Prediction of gestational diabetes based on nationwide electronic health records
Artzi, N. S., Shilo, S., Hadar, E., Rossman, H., Barbash-Hazan, S., Ben-Haroush, A., Balicer, R. D., Feldman, B., Wiznitzer, A., & Segal, E. (2020) · Nature Medicine · doi:10.1038/s41591-019-0724-8 · Cited by 281
Predicting bloodstream infection outcome using machine learning
Zoabi, Y., Kehat, O., Lahav, D., Weiss-Meilik, A., Adler, A., & Shomron, N. (2021) · Scientific Reports · doi:10.1038/s41598-021-99105-2 · Cited by 37
Informative presence bias in analyses of electronic health records-derived data: a cautionary note
Harton, J., Mitra, N., & Hubbard, R. A. (2022) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocac050 · Cited by 29
Frechman, E., Jaeger, B. C., Kowalkowski, M., Williamson, J. D., Lenoir, K. M., Palakshappa, J. A., Wells, B. J., Callahan, K. E., Pajewski, N. M., & Gabbard, J. L. (2025) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocaf062 · Cited by 3
“36 Both results highlight that one should exercise caution in ), and finally utilizing a machine learning (ML) approach instead of Cox regression including frailty and past inpatient hospitalizations as additional predictors (Re-calibrated þ covariates þ ML).”
Metadata
- Authors
- Phelan, M., Bhavsar, N., & Goldstein, B. A.
- Venue
- eGEMs (Generating Evidence & Methods to improve patient outcomes)
- Publisher
- Ubiquity Press, Ltd.
- Published
- 2017-12-06
- Volume
- 5
- Issue
- 1
- Pages
- 22
- ISSN
- 2327-9214 (ISSN-L)
- OpenAlex
- W2771201185
- Cited by
- 96
- References
- 8
- FWCI
- 9.61
- Type
- journal article
- Language
- en
- Open access
- diamond
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.