CoChat

Stigma, biomarkers, and algorithmic bias: recommendations for precision behavioral health with artificial intelligence

Open access

The DOI matches its Crossref record; 69 of the 69 references it cites were found in a registry or an index.

Abstract

Effective implementation of artificial intelligence in behavioral healthcare delivery depends on overcoming challenges that are pronounced in this domain. Self and social stigma contribute to under-reported symptoms, and under-coding worsens ascertainment. Health disparities contribute to algorithmic bias. Lack of reliable biological and clinical markers hinders model development, and model explainability challenges impede trust among users. In this perspective, we describe these challenges and discuss design and implementation recommendations to overcome them in intelligent systems for behavioral and mental health.

Overview

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1093/jamiaopen/ooz054

Cites

69 of 69 references verified0 citation errors · 0 not checkable

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

3 more claims about this paper

Create a free account to see every claim other papers make about this one.

See all claims — free account

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Show all 69 references

Research works printed but not linked: 13

  1. Corrigan PW, Kleinlein P. The Impact of Mental Illness Stigma. In P. W. Corrigan ed. On the stigma of mental illness: Practical strategies for research and social change. Washington, DC, US: American Psychological Association; 2005:11–44.
  2. Choi E, Bahadori MT, Sun J, Kulas J, Schuetz A, Stewart W. Retain: An interpretable predictive model for healthcare using reverse time attention mechanism. In Advances in Neural Information Processing Systems, 2016: 3504–3512.
  3. Mikolov T, Sutskever I, Chen K, et al Distributed representations of words and phrases and their compositionality In: Proceedings of the 26th International Conference on Neural Information Processing Systems - Volume 2. Curran Associates Inc; 2013: 3111– 19; Lake Tahoe, CA. http://dl.acm.org/citation.cfm? id=2999792.2999959. Accessed July 22, 2019.
  4. Baeza-Yates R. Data and algorithmic bias in the web In: Proceedings of the 8th ACM Conference on Web Science. ACM; 2016: 1; Hannover, Germany.
  5. Danks D, London AJ. Algorithmic bias in autonomous systems In: IJCAI. 2017: 4691– 97.
  6. Hajian S, Bonchi F, Castillo C. Algorithmic bias: from discrimination discovery to fairness-aware data mining In: Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. New York, NY: ACM; 2016: 2125– 26.
  7. Lambrecht A, Tucker CE. Algorithmic bias? An empirical study into apparent gender-based discrimination in the display of STEM career ads. Management Science; 2019; 65 (7): 2947– 3448.
  8. Niculescu-Mizil A, Caruana R. Predicting good probabilities with supervised learning In: Proceedings of the 22nd International Conference on Machine Learning. New York, NY: ACM; 2005: 625– 32.
  9. Gunning D, Aha D. DARPA's Explainable Artificial Intelligence (XAI) Program. AI Magazine, 2019; 40 (2): 44–58.
  10. Guidotti R, Monreale A, Ruggieri S, Turini F, Giannotti F, Pedreschi D. A survey of methods for explaining black box models. ACM Comput. Surv. (CSUR) 2019; 51 (5): 93
  11. Chen I, Johansson FD, Sontag D. Why is my classifier discriminatory? In: Bengio S, Wallach H, Larochelle H, et al, eds. Advances in Neural Information Processing Systems 31. Curran Associates, Inc; 2018: 3539– 50; Montreal, Canada. http://papers.nips.cc/paper/7613-why-is-my-classifier-discriminatory.pdf. Accessed March 5, 2019.
  12. Goodman KW, Cushman R, Miller RA. Ethics in Biomedical and Health Informatics: Users, Standards, and Outcomes. In: Shortliffe EH and Cimino JJ, eds. Biomedical Informatics—Computer Applications in Health Care and Biomedicine. New York: Springer; 2014: 329– 53.
  13. Kaplan B, Ranchordás S. Alzheimer's and m-Health: Regulatory, Privacy, and Ethical Considerations. In: Hayre CM, Muller DJ, and Scherer MH, eds. Everyday Technologies in Healthcare. 1 ed. Boca Raton, FL: CRC Press, 2019: 31– 52.

Cited by

Items 101–139 of 139

Metadata

Authors
Walsh, C. G., Chaudhry, B., Dua, P., Goodman, K. W., Kaplan, B., Kavuluru, R., Solomonides, A., & Subbian, V.
Affiliations
  • Vanderbilt University Medical Center (US)
  • University of Louisiana at Lafayette (US)
  • Louisiana Tech University (US)
  • University of Miami (US)
  • Yale University (US)
  • University of Kentucky (US)
  • Endeavor Health (US)
  • University of Arizona (US)
Corresponding author
Walsh, Colin G
Venue
JAMIA Open
Published
2020-01-22
Volume
3
Issue
1
Pages
9-15
ISSN
2574-2531 (ISSN-L)
OpenAlex
W3001779409
Cited by
118
References
67
Citations by year
2026: 14 · 2025: 24 · 2024: 28 · 2023: 23 · 2022: 19 · 2021: 6 · 2020: 4
FWCI
3.83
Type
journal article
Language
en
Open access
Locations
  • JAMIA Open (publishedVersion, cc-by-nc)
  • PubMed Central (publishedVersion, cc-by-nc)
  • PubMed (publishedVersion)
Funders
  • National Institute of General Medical Sciences (# W81XWH-10-2-0181, R01 MH116269-01)
  • National Institutes of Health (#P20 GM103424-17)
  • U.S. National Center for Advancing Translational Sciences (#UL1TR001998)
  • National Science Foundation (#1838745)
Topics
  • Health Sciences › Medicine › Health Informatics › Artificial Intelligence in Healthcare and Education
  • Physical Sciences › Computer Science › Artificial Intelligence › Ethics and Social Impacts of AI
  • Health Sciences › Health Professions › Health Information Management › Artificial Intelligence in Healthcare
Keywords
algorithmic bias, stigma, self-stigma, social stigma, biomarkers, health disparities, model explainability, mental health, symptom underreporting, intelligent systems

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.