CoChat

Implicit bias of encoded variables: frameworks for addressing structured bias in EHR–GWAS data

Open access
Dueñas, Hillary R, Seah, Carina, Johnson, Jessica S, Huckins, Laura M · 2020 · Human Molecular Genetics

The DOI matches its Crossref record; 71 of the 71 references it cites were found in a registry or an index.

Abstract

The ‘discovery’ stage of genome-wide association studies required amassing large, homogeneous cohorts. In order to attain clinically useful insights, we must now consider the presentation of disease within our clinics and, by extension, within our medical records. Large-scale use of electronic health record (EHR) data can help to understand phenotypes in a scalable manner, incorporating lifelong and whole-phenome context. However, extending analyses to incorporate EHR and biobank-based analyses will require careful consideration of phenotype definition. Judgements and clinical decisions that occur ‘outside’ the system inevitably contain some degree of bias and become encoded in EHR data. Any algorithmic approach to phenotypic characterization that assumes non-biased variables will generate compounded biased conclusions. Here, we discuss and illustrate potential biases inherent within EHR analyses, how these may be compounded across time and suggest frameworks for large-scale phenotypic analysis to minimize and uncover encoded bias.

Overview

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1093/hmg/ddaa192

Cites

71 of 71 references verified0 citation errors · 0 not checkable

Statistics

Figures

Figure 1 Multi-level biases are inherent in EHR data. These may be explicitly encoded and detectable (e.g. length of stay) or implicit (e.g. societal bias).
Figure 1 Multi-level biases are inherent in EHR data. These may be explicitly encoded and detectable (e.g. length of stay) or implicit (e.g. societal bias).CC BY-NC · PubMed Central
Figure 2 Impact of case–control definition bias on genetic studies. (A) Case (left) and control (right) definitions shown on a liability threshold model when (i) individuals are diagnosed accurately and without bias; (ii) where bias leads to over-diagnosis; and (iii) where bias leads to under-diagnosis. (B) Genetic associations arising from the situations described in (A). (i) A variant is identified as associated with a given trait; (ii) over-diagnosis leads to underpowered studies; true associations may be missed; and (iii) under-diagnosis leads to spurious results; associations may be inflated.
Figure 2 Impact of case–control definition bias on genetic studies. (A) Case (left) and control (right) definitions shown on a liability threshold model when (i) individuals are diagnosed accurately and without bias; (ii) where bias leads to over-diagnosis; and (iii) where bias leads to under-diagnosis. (B) Genetic associations arising from the situations described in (A). (i) A variant is identified as associated with a given trait; (ii) over-diagnosis leads to underpowered studies; true associations may be missed; and (iii) under-diagnosis leads to spurious results; associations may be inflated.CC BY-NC · PubMed Central
Figure 3 Systemic differences in psychosis diagnosis and treatment in EHR. (A) Odds ratio for psychosis by racial group, normalized to racial makeup of all patients. (B) Odds ratio for racial distribution of schizophrenia versus depression with psychosis. (C) Odds ratio for Haldol administration in psychosis patients by racial group, normalized to racial makeup of all patients. (D) Odds ratio for Haldol administration in psychosis patients by racial group, normalized to racial makeup of psychosis patients.
Figure 3 Systemic differences in psychosis diagnosis and treatment in EHR. (A) Odds ratio for psychosis by racial group, normalized to racial makeup of all patients. (B) Odds ratio for racial distribution of schizophrenia versus depression with psychosis. (C) Odds ratio for Haldol administration in psychosis patients by racial group, normalized to racial makeup of all patients. (D) Odds ratio for Haldol administration in psychosis patients by racial group, normalized to racial makeup of psychosis patients.CC BY-NC · PubMed Central
Figure 4 Diagnostic journeys for two individuals through a healthcare system. Left: an ‘ideal’ non-biased diagnostic journey. Visit 1 produces a preliminary diagnosis (Dx1), with some uncertainty (σ1); a second visit refines this diagnosis (Dx2), resulting in reduced diagnostic uncertainty (σ2 < σ1) and treatment (Tx2). Visit 3 results in an increasingly appropriate diagnosis and treatment, and uncertainty continues to reduce (σ3 < < σ1). Right: modelling potential compound bias throughout a diagnostic journey. Here, an initial visit results in a diagnosis (Dx1) influenced by both uncertainty (σ1) and bias (B). Bias compounds across visits; Dx2 is influenced by both current physician bias (B) and bias relating to the previous diagnosis (B | Dx1). Similarly, treatments assigned at visit 3 will be influenced by compound bias based on knowledge of previous treatment options (B | Tx1) and response to those treatments (B | R | Tx1). Hx, hospital system; Dx, diagnosis; Tx, treatment; σ, uncertainty; B, bias; B | Dx, bias regarding previous diagnosis Dx; B | Tx, bias regarding previous treatment Tx; R | Tx, response to treatment Tx.
Figure 4 Diagnostic journeys for two individuals through a healthcare system. Left: an ‘ideal’ non-biased diagnostic journey. Visit 1 produces a preliminary diagnosis (Dx1), with some uncertainty (σ1); a second visit refines this diagnosis (Dx2), resulting in reduced diagnostic uncertainty (σ2 < σ1) and treatment (Tx2). Visit 3 results in an increasingly appropriate diagnosis and treatment, and uncertainty continues to reduce (σ3 < < σ1). Right: modelling potential compound bias throughout a diagnostic journey. Here, an initial visit results in a diagnosis (Dx1) influenced by both uncertainty (σ1) and bias (B). Bias compounds across visits; Dx2 is influenced by both current physician bias (B) and bias relating to the previous diagnosis (B | Dx1). Similarly, treatments assigned at visit 3 will be influenced by compound bias based on knowledge of previous treatment options (B | Tx1) and response to those treatments (B | R | Tx1). Hx, hospital system; Dx, diagnosis; Tx, treatment; σ, uncertainty; B, bias; B | Dx, bias regarding previous diagnosis Dx; B | Tx, bias regarding previous treatment Tx; R | Tx, response to treatment Tx.CC BY-NC · PubMed Central
Figure 5 Approaches to detect biases in EHR. (A) Consider order and convergence of diagnoses across the lifespan. Here, we consider three individuals (dark blue, light blue and grey), with identical variables within the EHR (single-dashed lines represent identical diagnoses, etc.). From a retrospective, ‘snapshot’ perspective, all individuals appear identical; however, order and persistence of diagnoses clearly differ. (B) Leverage known biology. Here, we illustrate how polygenic risk scores might be applied to test accuracy of phenotype definitions. In this case, we consider controls (‘-’), schizophrenia cases (‘+’) and individuals with ‘TRS’. If these definitions are accurately assigned, we expect increased PRS in cases versus controls and in TRS versus others (blue). If however some bias affects phenotype assignment, we may identify a group of individuals with divergent PRS (grey). (C) Here, we illustrate three EHR (EHR1, EHR2 and EHR3), with overlapping but not identical sets of biases B and phenotypes [x1…xN]. Genotypic and phenotypic associations {SNPs, ICDx}, which are present across multiple different EHR are more likely to represent true biological signal rather than representing biased inferences.
Figure 5 Approaches to detect biases in EHR. (A) Consider order and convergence of diagnoses across the lifespan. Here, we consider three individuals (dark blue, light blue and grey), with identical variables within the EHR (single-dashed lines represent identical diagnoses, etc.). From a retrospective, ‘snapshot’ perspective, all individuals appear identical; however, order and persistence of diagnoses clearly differ. (B) Leverage known biology. Here, we illustrate how polygenic risk scores might be applied to test accuracy of phenotype definitions. In this case, we consider controls (‘-’), schizophrenia cases (‘+’) and individuals with ‘TRS’. If these definitions are accurately assigned, we expect increased PRS in cases versus controls and in TRS versus others (blue). If however some bias affects phenotype assignment, we may identify a group of individuals with divergent PRS (grey). (C) Here, we illustrate three EHR (EHR1, EHR2 and EHR3), with overlapping but not identical sets of biases B and phenotypes [x1…xN]. Genotypic and phenotypic associations {SNPs, ICDx}, which are present across multiple different EHR are more likely to represent true biological signal rather than representing biased inferences.CC BY-NC · PubMed Central

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Research works printed but not linked: 1

  1. American Psychiatric Association, 2013, Highlights of Changes from DSM-IV-TR to DSM-5, 1

Cited by

See all 31

Metadata

Authors
Dueñas, H. R., Seah, C., Johnson, J. S., & Huckins, L. M.
Affiliations
  • Pamela Sklar Division of Psychiatric Genomics, Icahn School of Medicine at Mount Sinai, New York, NY 10029, USA
  • Icahn School of Medicine at Mount Sinai (US)
  • James J. Peters VA Medical Center (US)
Corresponding author
Huckins, Laura M
Venue
Human Molecular Genetics
Published
2020-09-02
Volume
29
Issue
R1
Pages
R33-R41
ISSN
  • 0964-6906 (ISSN-L)
  • 1460-2083
OpenAlex
W3083461656
Cited by
31
References
70
Citations by year
2026: 4 · 2025: 8 · 2024: 5 · 2023: 3 · 2022: 8 · 2021: 3
FWCI
0.12
Type
journal article
Language
en
Open access
Locations
  • Human Molecular Genetics (publishedVersion, cc-by-nc)
  • PubMed Central (publishedVersion, cc-by-nc)
  • PubMed (publishedVersion)
Funders
National Institute of Mental Health (R01MH121923)
Topics
  • Physical Sciences › Computer Science › Artificial Intelligence › Machine Learning in Healthcare
  • Health Sciences › Health Professions › Health Information Management › Electronic Health Records Systems
  • Life Sciences › Biochemistry, Genetics and Molecular Biology › Genetics › Genetic Associations and Epidemiology
Keywords
electronic health records, genome-wide association study, phenotype definition, biobank data, phenotypic characterization
MeSH terms
Disease, Humans, Phenotype, Prejudice, Computational Biology, Polymorphism, Single Nucleotide, Genome-Wide Association Study, Electronic Health Records

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.