The DOI matches its Crossref record; 48 of the 48 references it cites were found in a registry or an index.
Who is the "Human" in Human-Centered Machine Learning: The Case of Predicting Mental Health from Social Media
Abstract
"Human-centered machine learning" (HCML) combines human insights and domain expertise with data-driven predictions to answer societal questions. This area's inherent interdisciplinarity causes tensions in the obligations researchers have to the humans whose data they use. This paper studies how scientific papers represent human research subjects in HCML. Using mental health status prediction on social media as a case study, we conduct thematic discourse analysis on 55 papers to examine these representations. We identify five discourses that weave a complex narrative of who the human subject is in this research: Disorder/Patient, Social Media, Scientific, Data/Machine Learning, and Person. We show how these five discourses create paradoxical subject and object representations of the human, which may inadvertently risk dehumanization. We also discuss the tensions and impacts of interdisciplinary research; the risks of this work to scientific rigor, online communities, and mental health; and guidelines for stronger HCML research in this nascent area.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Using thematic analysis in psychology
Braun, V., & Clarke, V. (2006) · Qualitative Research in Psychology · doi:10.1191/1478088706qp063oa · Cited by 194,414
ImageNet: A large-scale hierarchical image database
Deng, J., Dong, W., Socher, R., Li, L.-J., Li, K., & Fei-Fei, L. (2009) · 2009 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2009.5206848 · Cited by 65,333
Social network sites: definition, history, and scholarship
boyd, D. M., & Ellison, N. B. (2007) · Journal of Computer-Mediated Communication · doi:10.1111/j.1083-6101.2007.00393.x · Cited by 16,251
Now I see it, now I don’t: researcher’s position and reflexivity in qualitative research
Berger, R. (2015) · Qualitative Research · doi:10.1177/1468794112468475 · Cited by 4,031 · cited 1×
“These experiences undoubtedly impact our perspectives on the critical analysis [21], and we view this position as “critical insiders” to be a unique and valuable opportunity to raise concerns and advocate for change.”
BackgroundExperimental evidence of massive-scale emotional contagion through social networks
Kramer, A. D. I., Guillory, J. E., & Hancock, J. T. (2014) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1320040111 · Cited by 3,687
How stigma interferes with mental health care.
Corrigan, P. (2004) · American Psychologist · doi:10.1037/0003-066x.59.7.614 · Cited by 3,648 · cited 4×
“Stigma has very dangerous consequences for those who suffer from mental disorders, such as causing delays in, non-compliance with, or unwillingness to participate in treatment [49], diminished social support [146], and decreased self-esteem and self-efficacy [146].”
BackgroundInfluentialDwork, C., Hardt, M., Pitassi, T., Reingold, O., & Zemel, R. (2012) · Proceedings of the 3rd Innovations in Theoretical Computer Science Conference · doi:10.1145/2090236.2090255 · Cited by 3,501
How the machine “thinks”: Understanding opacity in machine learning algorithms
Burrell, J. (2016) · Big Data & Society · doi:10.1177/2053951715622512 · Cited by 3,196 · cited 1×
“From our case study, we argue that HCML uniquely risks dehumanizing individuals because of the paradoxical contrast of its human-centered commitments and the ways of knowing in AI and machine learning [32].”
BackgroundBarocas, S., & Selbst, A. D. (2014) · doi:10.2139/ssrn.2477899 · Cited by 3,048 · cited 2×
“Representations have meaningful consequences on research methods [13, 15, 170] and practical risks in increasing stigma [117], reproducing stereotypes and discriminatory practices [9, 134], and harming individuals and communities [59, 103].”
BackgroundDehumanization: An integrative review
Haslam, N. (2006) · Personality and Social Psychology Review · doi:10.1207/s15327957pspr1003_4 · Cited by 2,919 · cited 6×
“[59] Dehumanizing data can lead to researcher negligence, ignoring risks in algorithmic design and practice because the humans have been, in Haslam’s terms, made “psychologically distant” [85].”
BackgroundInfluentialAlgorithms of Oppression: How Search Engines Reinforce Racism
Noble, S. U. (2020) · doi:10.2307/j.ctt1pwt9w5 · Cited by 2,709
Model Cards for Model Reporting
Mitchell, M., Wu, S., Zaldivar, A., Barnes, P., Vasserman, L., Hutchinson, B., Spitzer, E., Raji, I. D., & Gebru, T. (2019) · Proceedings of the Conference on Fairness, Accountability, and Transparency · doi:10.1145/3287560.3287596 · Cited by 2,681 · cited 1×
“In addition to questions about fairness and bias, the community is also interested in making algorithmic output more explainable [62, 106, 127, 144] and interpretable [89, 108, 126] by human actors involved in decision-making.”
BackgroundThe Parable of Google Flu: Traps in Big Data Analysis
Lazer, D., Kennedy, R., King, G., & Vespignani, A. (2014) · Science · doi:10.1126/science.1248506 · Cited by 2,523 · cited 3×
“In sum, we strongly advocate for HCML researchers to consider these approaches, in part to avoid the risks of “big data hubris” [112], as well as to do right by the communities and individuals our work claims to help.”
BackgroundGuidelines for Human-AI Interaction
Amershi, S., Weld, D., Vorvoreanu, M., Fourney, A., Nushi, B., Collisson, P., Suh, J., Iqbal, S., Bennett, P. N., Inkpen, K., et al. (2019) · Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3290605.3300233 · Cited by 2,439 · cited 1×
“HCI has also been interested in the use of ML to augment interactive and intelligent systems [2, 91, 183], emblematically seen in interest in automated chatbots [179] and criticisms of these practices [154].”
BackgroundThe Values and Value of Patient-Centered Care
Epstein, R. M., & Street, R. L. (2011) · The Annals of Family Medicine · doi:10.1370/afm.1239 · Cited by 1,956
Certifying and Removing Disparate Impact
Feldman, M., Friedler, S. A., Moeller, J., Scheidegger, C., & Venkatasubramanian, S. (2015) · Proceedings of the 21th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining · doi:10.1145/2783258.2783311 · Cited by 1,827
Fairness and Abstraction in Sociotechnical Systems
Selbst, A. D., Boyd, D., Friedler, S. A., Venkatasubramanian, S., & Vertesi, J. (2019) · Proceedings of the Conference on Fairness, Accountability, and Transparency · doi:10.1145/3287560.3287598 · Cited by 1,631
Understanding Black-box Predictions via Influence Functions
Koh, P. W., & Liang, P. (2017) · arXiv · doi:10.48550/arxiv.1703.04730 · Cited by 1,514
Stigma and its public health implications
Link, B. G., & Phelan, J. C. (2006) · The Lancet · doi:10.1016/s0140-6736(06)68184-1 · Cited by 1,498
Principles of mixed-initiative user interfaces
Horvitz, E. (1999) · Proceedings of the SIGCHI conference on Human factors in computing systems the CHI is the limit - CHI '99 · doi:10.1145/302979.303030 · Cited by 1,490
Kittur, A., Nickerson, J. V., Bernstein, M., Gerber, E., Shaw, A., Zimmerman, J., Lease, M., & Horton, J. (2013) · Proceedings of the 2013 conference on Computer supported cooperative work · doi:10.1145/2441776.2441923 · Cited by 1,034 · cited 1×
“Explicit focus on these concerns can drive critical reflection in a nascent area to identify best practices [61, 92, 104] and, possibly, support redirection [17].”
“But the data is already public”: on the ethics of research in Facebook
Zimmer, M. (2010) · Ethics and Information Technology · doi:10.1007/s10676-010-9227-5 · Cited by 900 · cited 4×
“In machine learning (ML) and related areas, there are few protocols for managing researcher relationships to data [92, 187]; ML has historically relied on large and public benchmark datasets, like ImageNet [57].”
BackgroundInfluentialMittelstadt, B., Russell, C., & Wachter, S. (2019) · Proceedings of the Conference on Fairness, Accountability, and Transparency · doi:10.1145/3287560.3287574 · Cited by 794
Social Networking Sites, Depression, and Anxiety: A Systematic Review
Seabrook, E. M., Kern, M. L., & Rickard, N. S. (2016) · JMIR Mental Health · doi:10.2196/mental.5842 · Cited by 763 · cited 4×
“This work has received increased attention [157, 182], not only within HCI and CSCW [37, 55, 168], but also in multiple subfields of CS, such as natural language processing (NLP), machine learning, and medical informatics [28, 45, 140, 176, 178].”
BackgroundMethodResultInfluentialQuantifying Mental Health Signals in Twitter
Coppersmith, G., Dredze, M., & Harman, C. (2014) · Proceedings of the Workshop on Computational Linguistics and Clinical Psychology: From Linguistic Signal to Clinical Reality · doi:10.3115/v1/w14-3207 · Cited by 722
A Contextual Approach to Privacy Online
Nissenbaum, H. (2011) · Daedalus · doi:10.1162/daed_a_00113 · Cited by 649
Where fairness fails: data, algorithms, and the limits of antidiscrimination discourse
Hoffmann, A. L. (2019) · Information, Communication & Society · doi:10.1080/1369118x.2019.1573912 · Cited by 535
Instagram photos reveal predictive markers of depression
Reece, A. G., & Danforth, C. M. (2017) · EPJ Data Science · doi:10.1140/epjds/s13688-017-0110-z · Cited by 519
Direct manipulation vs. interface agents
Shneiderman, B., & Maes, P. (1997) · Interactions · doi:10.1145/267505.267514 · Cited by 518 · cited 1×
“Recent excitement and growth in HCML bely a longer scholarly history in AI, HCI, and solving problems at these intersections [162].”
BackgroundThe Misgendering Machines: Trans/HCI Implications of Automatic Gender Recognition
Keyes, O. (2018) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3274357 · Cited by 505
Social media as a measurement tool of depression in populations
De Choudhury, M., Counts, S., & Horvitz, E. (2013) · Proceedings of the 5th Annual ACM Web Science Conference · doi:10.1145/2464464.2464480 · Cited by 497
Prediction and explanation in social systems
Hofman, J. M., Sharma, A., & Watts, D. J. (2017) · Science · doi:10.1126/science.aal3856 · Cited by 429
Language from police body camera footage shows racial disparities in officer respect
Voigt, R., Camp, N. P., Prabhakaran, V., Hamilton, W. L., Hetey, R. C., Griffiths, C. M., Jurgens, D., Jurafsky, D., & Eberhardt, J. L. (2017) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1702413114 · Cited by 407
Forecasting the onset and course of mental illness with Twitter data
Reece, A. G., Reagan, A. J., Lix, K. L. M., Dodds, P. S., Danforth, C. M., & Langer, E. J. (2017) · Scientific Reports · doi:10.1038/s41598-017-12961-9 · Cited by 401 · cited 3×
“who consistently referred to humans with Scientific and PersonCentered discourse [141].”
BackgroundInfluentialWhat Does Explainable AI Really Mean? A New Conceptualization of Perspectives
Doran, D., Schulz, S., & Besold, T. R. (2017) · arXiv · doi:10.48550/arxiv.1710.00794 · Cited by 333 · cited 1×
“In addition to questions about fairness and bias, the community is also interested in making algorithmic output more explainable [62, 106, 127, 144] and interpretable [89, 108, 126] by human actors involved in decision-making.”
BackgroundThe social impact of natural language processing
Hovy, D., & Spruit, S. L. (2016) · Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics (Volume 2: Short Papers) · doi:10.18653/v1/p16-2096 · Cited by 329
Measuring post traumatic stress disorder in Twitter
Coppersmith, G., Harman, C., & Dredze, M. (2014) · Proceedings of the International AAAI Conference on Web and Social Media · doi:10.1609/icwsm.v8i1.14574 · Cited by 316
Chandrasekharan, E., Samory, M., Jhaver, S., Charvat, H., Bruckman, A., Lampe, C., Eisenstein, J., & Gilbert, E. (2018) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3274301 · Cited by 282
Towards Assessing Changes in Degree of Depression through Facebook
Schwartz, H. A., Eichstaedt, J., Kern, M. L., Park, G., Sap, M., Stillwell, D., Kosinski, M., & Ungar, L. (2014) · Proceedings of the Workshop on Computational Linguistics and Clinical Psychology: From Linguistic Signal to Clinical Reality · doi:10.3115/v1/w14-3214 · Cited by 256 · cited 2×
“Research heavily adopts data-driven prediction methods from ML, like supervised binary classification [31, 94, 101], regression analysis [156], and recently deep learning [20, 77].”
BackgroundMethod#WhyWeTweetMH: Understanding why people use twitter to discuss mental health problems
Berry, N., Lobban, F., Belousov, M., Emsley, R., Nenadic, G., & Bucci, S. (2017) · Journal of Medical Internet Research · doi:10.2196/jmir.6173 · Cited by 228
Ethical research protocols for social media health research
Benton, A., Coppersmith, G., & Dredze, M. (2017) · Proceedings of the First ACL Workshop on Ethics in Natural Language Processing · doi:10.18653/v1/w17-1612 · Cited by 219
'Too Gay for Facebook': Presenting LGBTQ+ Identity Throughout the Personal Social Media Ecosystem
DeVito, M. A., Walker, A. M., & Birnholtz, J. (2018) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3274313 · Cited by 219
A Taxonomy of Ethical Tensions in Inferring Mental Health States from Social Media
Chancellor, S., Birnbaum, M. L., Caine, E. D., Silenzio, V. M. B., & De Choudhury, M. (2019) · Proceedings of the Conference on Fairness, Accountability, and Transparency · doi:10.1145/3287560.3287587 · Cited by 214 · cited 5×
“…use binary classification, this reduces mental health status to two corresponding machine learning classes “positive”/“negative” and the corresponding Disorder-focused “suffering”/“not suffering” can erase subtleties around the spectrum of mental illness severity and co-morbid diagnoses [36].”
BackgroundInfluentialSelf-citationQuantifying the Language of Schizophrenia in Social Media
Mitchell, M., Hollingshead, K., & Coppersmith, G. (2015) · Proceedings of the 2nd Workshop on Computational Linguistics and Clinical Psychology: From Linguistic Signal to Clinical Reality · doi:10.3115/v1/w15-1202 · Cited by 172
Birnbaum, M. L., Ernala, S. K., Rizvi, A. F., De Choudhury, M., & Kane, J. M. (2017) · Journal of Medical Internet Research · doi:10.2196/jmir.7956 · Cited by 168 · cited 5×
““Data...distinguish[es] users with schizophrenia from healthy controls ” [23][p. 1] However, “control” was always juxtaposed against an implied “treatment” position — in experimental setups, control groups are verified to not have the effect under observation.”
BackgroundInfluentialThe Sharing Economy in Computing: A Systematic Literature Review
Dillahunt, T. R., Wang, X., Wheeler, E., Cheng, H. F., Hecht, B., & Zhu, H. (2017) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3134673 · Cited by 130 · cited 1×
“We adopted the tools of a systematic literature review to gather studies, informed by general standards for literature/meta reviews [114] as well as those in HCI and CSCW [12, 60, 61].”
MethodToward human-centered algorithm design
Baumer, E. P. (2017) · Big Data & Society · doi:10.1177/2053951717718854 · Cited by 125
Self-citationModeling Stress with Social Media Around Incidents of Gun Violence on College Campuses
Saha, K., & De Choudhury, M. (2017) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3134727 · Cited by 124 · cited 2×
“” In some studies, individuals provided researcher access to their social media [136, 148].”
Background
Cited by
Methods in predictive techniques for mental health status on social media: a critical review
Chancellor, S., & De Choudhury, M. (2020) · npj Digital Medicine · doi:10.1038/s41746-020-0233-7 · Cited by 557
Self-citationThieme, A., Belgrave, D., & Doherty, G. (2020) · ACM Transactions on Computer-Human Interaction · doi:10.1145/3398069 · Cited by 406
Sociotechnical Harms of Algorithmic Systems: Scoping a Taxonomy for Harm Reduction
Shelby, R., Rismani, S., Henne, K., Moon, A., Rostamzadeh, N., Nicholas, P., Yilla-Akbari, N., Gallegos, J., Smart, A., Garcia, E., et al. (2023) · Proceedings of the 2023 AAAI/ACM Conference on AI, Ethics, and Society · doi:10.1145/3600211.3604673 · Cited by 279
Do Datasets Have Politics? Disciplinary Values in Computer Vision Dataset Development
Scheuerman, M. K., Hanna, A., & Denton, R. (2021) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3476058 · Cited by 216
The Who in XAI: How AI Background Shapes Perceptions of AI Explanations
Ehsan, U., Passi, S., Liao, Q. V., Chan, L., Lee, I.-H., Muller, M., & Riedl, M. O. (2024) · Proceedings of the CHI Conference on Human Factors in Computing Systems · doi:10.1145/3613904.3642474 · Cited by 123
Metadata
- Authors
- Chancellor, S., Baumer, E. P. S., & De Choudhury, M.
- Venue
- Proceedings of the ACM on Human-Computer Interaction
- Published
- 2019-11-07
- Volume
- 3
- Issue
- CSCW
- Pages
- 1-32
- ISSN
- 2573-0142 (ISSN-L)
- OpenAlex
- W2988595016
- Cited by
- 172
- References
- 48
- FWCI
- 29.81
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.