AI Fairness for People with Disabilities: Point of View
Open accessAbstract
We consider how fair treatment in society for people with disabilities might be impacted by the rise in the use of artificial intelligence, and especially machine learning methods. We argue that fairness for people with disabilities is different to fairness for other protected attributes such as age, gender or race. One major difference is the extreme diversity of ways disabilities manifest, and people adapt. Secondly, disability information is highly sensitive and not always shared, precisely because of the potential for discrimination. Given these differences, we explore definitions of fairness and how well they work in the disability space. Finally, we suggest ways of approaching fairness for people with disabilities in AI applications.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The literature on AI and accessibility suggests specific concerns regarding the use of AI and people with disabilities.
“More generally, the literature on AI and accessibility also suggests specific concerns regarding the use of AI and people with disabilities (Guo et al., 2020;Morris, 2020;Trewin, 2018).”
From Exploring the role of generative AI in higher education: Semi-structured interviews with students with disabilities (2025) · cites this paper as Trewin, 2018
Researchers have highlighted the lack of perspective of people with disabilities in AI fairness.
“Researchers have also highlighted the lack of perspective of people with disabilities in AI fairness (Baker & Hawn, 2021;Trewin, 2018).”
From Exploring the role of generative AI in higher education: Semi-structured interviews with students with disabilities (2025) · cites this paper as Trewin, 2018
Disability is a category that is very diverse, evolutive, and can be multiple.
“Disability is a category that is very diverse, evolutive, and can be multiple (Trewin, 2018).”
From Exploring the role of generative AI in higher education: Semi-structured interviews with students with disabilities (2025) · cites this paper as Trewin, 2018
Due to these characteristics, machine learning algorithms are likely to treat disability as noise in the data, and it is possible that there are not enough people with a specific disability to let the AI identify a category or pattern.
“Due to these characteristics, machine learning algorithms are likely to treat disability as noise in the data, and it is possible that there are not enough people with a specific disability to let the AI identify a category or pattern (Trewin, 2018).”
From Exploring the role of generative AI in higher education: Semi-structured interviews with students with disabilities (2025) · cites this paper as Trewin, 2018
One student reported that ChatGPT could be talking about autism in a harmful and biased manner.
“One student reported that ChatGPT could be talking about autism in a harmful and biased manner, concurring with concerns about bias in research on AI ethics and disability (Guo et al., 2020;Morris, 2020;Trewin, 2018).”
From Exploring the role of generative AI in higher education: Semi-structured interviews with students with disabilities (2025) · cites this paper as Trewin, 2018
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
Dwork, C., Hardt, M., Pitassi, T., Reingold, O., & Zemel, R. (2012) · Proceedings of the 3rd Innovations in Theoretical Computer Science Conference · doi:10.1145/2090236.2090255 · Cited by 3,501 · see citing works
(2018) · Cited by 1,167 · see citing works
Fairness definitions explained
Verma, S., & Rubin, J. (2018) · Proceedings of the International Workshop on Software Fairness · doi:10.1145/3194770.3194776 · Cited by 1,124 · see citing works
The Disability Employment Puzzle: A Field Experiment on Employer Hiring Behavior
Ameri, M., Schur, L. A., Adya, M., Bentley, F. S., McKay, P. F., & Kruse, D. L. (2017) · Industrial and Labor Relations Review · doi:10.1177/0019793917717474 · Cited by 298 · see citing works
Kruse, D. L., Schur, L. A., Rogers, S. E., & Ameri, M. (2017) · British Journal of Industrial Relations · doi:10.1111/bjir.12257 · Cited by 98 · see citing works
Flagged first, then by citations
Research works printed but not linked: 4
- Bellamy, R. K. E., Dey, K., Hind, M., Hoffman, S. C., Houde, S., Kannan, K., … Zhang, Y. (2018). AI Fairness 360: An Extensible Toolkit for Detecting, Understanding, and Mitigating Unwanted Algorithmic Bias. Retrieved from http://arxiv.org/abs/1810.01943 · arXiv
- Buolamwini, J., & Gebru, T. (2018). Gender Shades: Intersectional Accuracy Disparities in Commercial Gender Classification - MIT Media Lab. Proceedings of Machine Learning Research , 81 (1, Conference on Fairness, Accountability and Transparency), 1-15. Retrieved from https://www.media.mit.edu/publications/gender-shades-intersectionalaccuracy-disparities-in-commercial-gender-classification/
- Gajane, P., & Pechenizkiy, M. (2017). On Formalizing Fairness in Prediction with Machine Learning. Retrieved from http://arxiv.org/abs/1710.03184 · arXiv
- Xiong, W., Wu, L., Alleva, F., Droppo, J., Huang, X., & Stolcke, A. (2017). The Microsoft 2017 Conversational Speech Recognition System. Retrieved from http://arxiv.org/abs/1708.06073 · arXiv
Cited by
Sorted by citations
Disability, Work and Inclusion
OECD (2022) · OECD eBooks · doi:10.1787/1eaa5e9c-en · Cited by 248 · see citing works
AI Fairness in Data Management and Analytics: A Review on Challenges, Methodologies and Applications
Chen, P., Wu, L., & Wang, L. (2023) · Applied Sciences · doi:10.3390/app131810258 · Cited by 155 · see citing works
Considerations for AI fairness for people with disabilities
Trewin, S., Basson, S., Muller, M., Branham, S., Treviranus, J., Gruen, D., Hebert, D., Lyckowski, N., & Manser, E. (2019) · AI Matters · doi:10.1145/3362077.3362086 · Cited by 143 · see citing works
Self-citationBennett, C. L., Gleason, C., Scheuerman, M. K., Bigham, J. P., Guo, A., & To, A. (2021) · Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3411764.3445498 · Cited by 128 · see citing works
Morris, M. R. (2020) · Communications of the ACM · doi:10.1145/3356727 · Cited by 114 · see citing works
Buyl, M., Cociancig, C., Frattone, C., & Roekens, N. (2022) · ACM Conference on Fairness, Accountability, and Transparency (FAccT) · doi:10.1145/3531146.3533169 · Cited by 85 · see citing works
Artificial intelligence and disability: too much promise, yet too little substance?
Smith, P., & Smith, L. (2021) · AI and Ethics · doi:10.1007/s43681-020-00004-5 · Cited by 72 · see citing works
Scientism as illusio in HR algorithms: Towards a framework for algorithmic hygiene for bias proofing
Vassilopoulou, J., Kyriakidou, O., Özbilgin, M. F., & Groutsis, D. G. (2022) · Human Resource Management Journal · doi:10.1111/1748-8583.12430 · Cited by 75 · see citing works
Autonomous vehicles and mobility for people with special needs
Kaßens-Noor, E., Cai, M., Kotval-K, Z., & Decaminada, T. (2021) · Transportation Research Part A Policy and Practice · doi:10.1016/j.tra.2021.06.014 · Cited by 69 · see citing works
What is the Point of Fairness? Disability, AI and The Complexity of JusticePreprint
Bennett, C. L., & Keyes, O. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1908.01024 · Cited by 66 · see citing works
Could the Use of AI in Higher Education Hinder Students With Disabilities? A Scoping Review
Pierrès, O., Christen, M., Schmitt, F., & Darvishy, A. (2024) · IEEE Access · doi:10.1109/access.2024.3365368 · Cited by 72 · see citing works
Pierrès, O., Darvishy, A., & Christen, M. (2025) · Education and Information Technologies · doi:10.1007/s10639-024-13134-8 · Cited by 48 · see citing works
Data Representativeness in Accessibility Datasets: A Meta-Analysis
Kamikubo, R., Wang, L., Marte, C., Mahmood, A., & Kacorri, H. (2022) · International ACM SIGACCESS Conference on Computers and Accessibility (ASSETS) · doi:10.1145/3517428.3544826 · Cited by 41 · see citing works
Hassan, S., Huenerfauth, M., & Alm, C. O. (2021) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2021.findings-emnlp.267 · Cited by 43 · see citing works
Akter, T., Ahmed, T., Kapadia, A., & Swaminathan, M. (2022) · ACM Transactions on Accessible Computing · doi:10.1145/3506857 · Cited by 29 · see citing works
Consumer Artificial Intelligence Mishaps and Mitigation Strategies
Saeedi, S., Fong, A. C. M., Mohanty, S. P., Gupta, A. K., & Carr, S. (2021) · IEEE Consumer Electronics Magazine · doi:10.1109/mce.2021.3075329 · Cited by 24 · see citing works
AI Tools Like ChatGPT for People with Neurodevelopmental Disorders
Moraiti, I., & Drigas, A. S. (2023) · International Journal of Online and Biomedical Engineering (iJOE) · doi:10.3991/ijoe.v19i16.43399 · Cited by 22 · see citing works
Danemayer, J., Holloway, C., Cho, Y., Bianchi‐Berthouze, N., Singh, A., Bhot, W., Dixon, O., Grobelnik, M., & Shawe-Taylor, J. S. (2023) · International Journal of Human-Computer Studies · doi:10.1016/j.ijhcs.2023.103078 · Cited by 22 · see citing works
Gender Bias in AI: Implications for Managerial Practices
Nadeem, A., Marjanovic, O., & Abedin, B. (2021) · Lecture notes in computer science · doi:10.1007/978-3-030-85447-8_23 · Cited by 21 · see citing works
What is the point of fairness?
Bennett, C., & Keyes, O. (2020) · Interactions · doi:10.1145/3386383 · Cited by 19 · see citing works
Nugent, S. E., Jackson, P., Scott‐Parker, S., Partridge, J., Raper, R., Bakalis, C., Shepherd, A., Mitra, A., Long, J., Maynard, K., et al. (2020) · doi:10.31235/osf.io/emwn5 · Cited by 19 · see citing works
Contributing to Accessibility Datasets: Reflections on Sharing Study Data by Blind People
Kamikubo, R., Lee, K., & Kacorri, H. (2023) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3544548.3581337 · Cited by 19 · see citing works
Measuring justice in machine learning
Lundgard, A. (2020) · ACM Conference on Fairness, Accountability, and Transparency (FAccT) · doi:10.1145/3351095.3372838 · Cited by 17 · see citing works
Venkit, P. N., & Wilson, S. (2021) · arXiv · doi:10.48550/arxiv.2111.13259 · Cited by 14 · see citing works
Intersectional Bias in Causal Language ModelsPreprint
Magee, L., Ghahremanlou, L., Soldatić, K., & Robertson, S. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2107.07691 · Cited by 30 · see citing works
Application of fairness to healthcare, organizational justice, and finance: A survey
Birzhandi, P., & Cho, Y.-S. (2022) · Expert Systems with Applications · doi:10.1016/j.eswa.2022.119465 · Cited by 13 · see citing works
Bias and Discrimination in Artificial Intelligence
Weyerer, J. C., & Langer, P. F. (2020) · Advances in e-business research series · doi:10.4018/978-1-7998-1879-3.ch011 · Cited by 11 · see citing works
Using AI to support people with disability in the labour market
Touzet, C. (2023) · OECD artificial intelligence papers · doi:10.1787/008b32b7-en · Cited by 21 · see citing works
An Evaluation of the Effectiveness of Using Pedagogical Agents for Teaching in Inclusive Ways
Savin‐Baden, M., Bhakta, R., Mason-Robbie, V., & Burden, D. J. H. (2019) · Perspectives on rethinking and reforming education · doi:10.1007/978-981-13-8161-4_7 · Cited by 8 · see citing works
A Novel Approach for Diagnosing Neuro-Developmental Disorders using Artificial Intelligence
Vashisht, P., & Jatain, A. (2023) · INTELIGENCIA ARTIFICIAL · doi:10.4114/intartif.vol26iss71pp13-24 · Cited by 8 · see citing works
Smith, L., & Smith, P. (2024) · Elsevier eBooks · doi:10.1016/b978-0-443-18851-0.00022-6 · Cited by 7 · see citing works
Baeyaert, J. (2025) · Sustainable Futures · doi:10.1016/j.sftr.2025.101126 · Cited by 9 · see citing works
Castellani, A., Benassi, M., & Balboni, G. (2023) · Lecture notes in computer science · doi:10.1007/978-3-031-37114-1_7 · Cited by 6 · see citing works
Moore, R. J., Smith, R., & Liu, Q. (2020) · ACM SIGACCESS Accessibility and Computing · doi:10.1145/3412836.3412840 · Cited by 5 · see citing works
Wang, L., & Wong, A. K. C. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1905.07844 · Cited by 5 · see citing works
Lange, M., Kirkham, R., & Tannert, B. (2021) · Lecture notes in computer science · doi:10.1007/978-3-030-85616-8_25 · Cited by 5 · see citing works
Cultural Bias and Linguistic Representation in AI Curriculum Design
Usman, N., Kusumanegara, A., Husnaini, H., Said, Y. R., & Ismayanti, D. (2025) · Advances in computational intelligence and robotics book series · doi:10.4018/979-8-3373-1062-6.ch008 · Cited by 1 · see citing works
Generative AI-Language Models in Didactics and Communication for Inclusiveness
Müller, V. A., & Heidelberger, J. (2024) · Lecture notes in electrical engineering · doi:10.1007/978-3-031-61221-3_3
Disability and AI(Artificial Intelligence): Topic modeling of newspaper
Park, R. H., Pack, Y. H., & Chung, K. (2024) · 한국가정관리학회지 · doi:10.7466/jfbl.2024.42.3.119
Safe and Accessible AI for Youth with Disabilities and Neurodivergence
Yu, Y., Freed, D., Chanenson, J., Jessica Vitak, B., Erete, S. L., Clegg, T., & Chetty, M. (2026) · International ACM SIGACCESS Conference on Computers and Accessibility (ASSETS) · doi:10.1145/3797867.3832453
- Authors
- Trewin, S.
- Affiliations
- IBM (United States) (US)
- Corresponding author
- Trewin, Shari
- ORCID
- Trewin, Shari
- Venue
- arXiv
- Publisher
- arXiv
- Published
- 2018
- ISSN
- 2331-8422 (ISSN-L)
- arXiv
- 1811.10670
- OpenAlex
- W2903284953
- Cited by
- 38
- References
- 2
- Citations by year
- 2026: 1 · 2025: 2 · 2024: 4 · 2023: 6 · 2022: 6 · 2021: 8 · 2020: 7 · 2019: 4
- Type
- posted content
- Language
- en
- Open access
- green
- arxiv.org
- Locations
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- Topics
- Social Sciences › Safety Research › Ethics and Social Impacts of AI
- Social Sciences › Safety Research › Disability Rights and Representation
- Social Sciences › Human Factors and Ergonomics › Digital Accessibility for Disabilities
- Keywords
- algorithmic fairness, people with disabilities, algorithmic discrimination, machine learning, disability diversity
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
