The DOI matches its Crossref record; 55 of the 55 references it cites were found in a registry or an index.
Modeling and Understanding Visual Attributes of Mental Health Disclosures in Social Media
Abstract
Content shared on social media platforms has been identified to be valuable in gaining insights into people's mental health experiences. Although there has been widespread adoption of photo-sharing platforms such as Instagram in recent years, the role of visual imagery as a mechanism of self-disclosure is less understood. We study the nature of visual attributes manifested in images relating to mental health disclosures on Instagram. Employing computer vision techniques on a corpus of thousands of posts, we extract and examine three visual attributes: visual features (e.g., color), themes, and emotions in images. Our findings indicate the use of imagery for unique self-disclosure needs, quantitatively and qualitatively distinct from those shared via the textual modality: expressions of emotional distress, calls for help, and explicit display of vulnerability. We discuss the relationship of our findings to literature in visual sociology, in mental health self disclosure, and implications for the design of health interventions.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“To date, the emergence of machine learning, a powerful computational method involving statistical and mathematical algorithms (Shatte, Hutchinson, & Teague, 2019), has made it possible to study large quantities of data captured from popular social media platforms such as Twitter or Instagram to illuminate various features of mental health (Manikonda & De Choudhury, 2017; Reece et al., 2017).”
From Social Media and Mental Health: Benefits, Risks, and Opportunities for Research and Practice (2020) · cites this paper as Manikonda & De Choudhury, 2017
Citations
Cites
Diagnostic and Statistical Manual of Mental Disorders
American Psychiatric Association (2013) · doi:10.1176/appi.books.9780890425596 · Cited by 116,369
ImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155
SURF: Speeded Up Robust Features
Bay, H., Tuytelaars, T., & Van Gool, L. (2006) · Lecture Notes in Computer Science · doi:10.1007/11744023_32 · Cited by 14,955
Stigma: Notes on the Management of Spoiled Identity
(1969) · Postgraduate Medical Journal · doi:10.1136/pgmj.45.527.642 · Cited by 14,255
Talking about pictures: A case for photo elicitation
Harper, D. (2002) · Visual Studies · doi:10.1080/14725860220137345 · Cited by 3,955
Harel, J., Koch, C., & Perona, P. (2007) · The MIT Press eBooks · doi:10.7551/mitpress/7503.003.0073 · Cited by 3,517
(1973) · Medical Entomology and Zoology · Cited by 2,836
The functions of deliberate self-injury: a review of the evidence
Klonsky, E. D. (2007) · Clinical Psychology Review · doi:10.1016/j.cpr.2006.08.002 · Cited by 1,979
Stricker, M. A., & Orengo, M. (1995) · Proceedings of SPIE, the International Society for Optical Engineering/Proceedings of SPIE · doi:10.1117/12.205308 · Cited by 1,749
Predicting Depression via Social Media
Choudhury, M. D., Gamon, M., Counts, S., & Horvitz, E. (2021) · Proceedings of the International AAAI Conference on Web and Social Media · doi:10.1609/icwsm.v7i1.14432 · Cited by 1,583
Self-disclosure: A literature review.
Cozby, P. C. (1973) · Psychological Bulletin · doi:10.1037/h0033950 · Cited by 1,314
Written emotional expression: Effect sizes, outcome types, and moderating variables
Smyth, J. M. (1998) · Journal of Consulting and Clinical Psychology · doi:10.1037/0022-006x.66.1.174 · Cited by 1,294
Written emotional expression: Effect sizes, outcome types, and moderating variables.
Smyth, J. M. (1998) · Journal of Consulting and Clinical Psychology · doi:10.1037//0022-006x.66.1.174 · Cited by 1,290
Eysenbach, G., Powell, J., Englesakis, M., Rizo, C., & Stern, A. (2004) · BMJ · doi:10.1136/bmj.328.7449.1166 · Cited by 1,268
Comparing Twitter and Traditional Media Using Topic Models
Zhao, W. X., Jiang, J., Weng, J., He, J., Lim, E.-P., Yan, H., & Li, X. (2011) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-20161-5_34 · Cited by 1,214
Instafame: Luxury Selfies in the Attention Economy
Marwick, A. E. (2015) · Public Culture · doi:10.1215/08992363-2798379 · Cited by 1,141
Mental Health Discourse on reddit: Self-Disclosure, Social Support, and Anonymity
De Choudhury, M., & De, S. (2014) · Proceedings of the International AAAI Conference on Web and Social Media · doi:10.1609/icwsm.v8i1.14526 · Cited by 836
What We Instagram: A First Analysis of Instagram Photo Content and User Types
Hu, Y., Manikonda, L., & Kambhampati, S. (2014) · Proceedings of the International AAAI Conference on Web and Social Media · doi:10.1609/icwsm.v8i1.14578 · Cited by 807
Self-citationSharing Health Data for Better Outcomes on PatientsLikeMe
Wicks, P., Massagli, M., Frost, J., Brownstein, C., Okun, S., Vaughan, T., Bradley, R., & Heywood, J. (2010) · Journal of Medical Internet Research · doi:10.2196/jmir.1549 · Cited by 603
Stephens, T. (1988) · Preventive Medicine · doi:10.1016/0091-7435(88)90070-9 · Cited by 544
Instagram photos reveal predictive markers of depression
Reece, A. G., & Danforth, C. M. (2017) · EPJ Data Science · doi:10.1140/epjds/s13688-017-0110-z · Cited by 519
Greenwood, S., Perrin, A., & Duggan, M. (2016) · Cited by 496
Aesthetics and Emotions in Images
Joshi, D., Datta, R., Fedorovskaya, E. A., Luong, Q.-T., Wang, J. Z., Li, J., & Luo, J. (2011) · IEEE Signal Processing Magazine · doi:10.1109/msp.2011.941851 · Cited by 407
Characterizing and predicting postpartum depression from shared facebook data
Choudhury, M. D., Counts, S., Horvitz, E., & Hoff, A. (2014) · ACM Conference on Computer Supported Cooperative Work (CSCW) · doi:10.1145/2531602.2531675 · Cited by 391
How flickr helps us make sense of the world
Kennedy, L. S., Naaman, M., Ahern, S., Nair, R., & Rattenbury, T. (2007) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/1291233.1291384 · Cited by 386
Sensitive Self-disclosures, Responses, and Social Support on Instagram
Andalibi, N., Ozturk, P., & Forte, A. (2017) · ACM Conference on Computer Supported Cooperative Work (CSCW) · doi:10.1145/2998181.2998243 · Cited by 366
Body Image in Anorexia Nervosa: Measurement, Theory and Clinical Implications
Garner, D. M., & Garfinkel, P. E. (1982) · The International Journal of Psychiatry in Medicine · doi:10.2190/r55q-2u6t-lam7-rqr7 · Cited by 356
Harrison, B. (2002) · Sociology of Health & Illness · doi:10.1111/1467-9566.00322 · Cited by 260
Quantifying and Predicting Mental Illness Severity in Online Pro-Eating Disorder Communities
Chancellor, S., Lin, Z. J., Goodman, E. L., Zerwas, S. C., & Choudhury, M. D. (2016) · ACM Conference on Computer Supported Cooperative Work (CSCW) · doi:10.1145/2818048.2819973 · Cited by 201
Detecting and Characterizing Mental Health Related Self-Disclosure in Social Media
Balani, S., & Choudhury, M. D. (2015) · CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA) · doi:10.1145/2702613.2732733 · Cited by 163
Catalyzing social support for breast cancer patients
Skeels, M. M., Unruh, K. T., Powell, C., & Pratt, W. (2010) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/1753326.1753353 · Cited by 163
Selfiecity: Exploring Photography and Self-Fashioning in Social Media
Tīfentāle, A., & Манович, Л. (2015) · Palgrave Macmillan UK eBooks · doi:10.1057/9781137437204_9 · Cited by 140
Collaborative help in chronic disease management
Huh, J., & Ackerman, M. S. (2012) · ACM Conference on Computer Supported Cooperative Work (CSCW) · doi:10.1145/2145204.2145331 · Cited by 118
Stigma. Notes on the Management of Spoiled Identity
Waldschmidt, A. (2022) · J.B. Metzler eBooks · doi:10.1007/978-3-476-05871-3_41 · Cited by 116
Healthy personality and self-disclosure.
Jourard, S. M. (1959) · PubMed · Cited by 108
Maclean, D. L., Gupta, S., Lembke, A., Manning, C. D., & Heer, J. (2015) · ACM Conference on Computer Supported Cooperative Work (CSCW) · doi:10.1145/2675133.2675146 · Cited by 94
Why We Filter Our Photos and How It Impacts Engagement
Bakhshi, S., Shamma, D. A., Kennedy, L. S., & Gilbert, É. (2021) · Proceedings of the International AAAI Conference on Web and Social Media · doi:10.1609/icwsm.v9i1.14622 · Cited by 93
Gillies, V., Harden, A., Johnson, K., Reavey, P., Strange, V., & Willig, C. (2005) · Qualitative Research in Psychology · doi:10.1191/1478088705qp038oa · Cited by 90
Social Media Image Analysis for Public Health
Garimella, V. R. K., Alfayad, A., & Weber, I. (2015) · International Conference on Human Factors in Computing Systems · doi:10.1145/2858036.2858234 · Cited by 87
Depression-related Imagery on Instagram
Andalibi, N., Ozturk, P., & Forte, A. (2015) · doi:10.1145/2685553.2699014 · Cited by 82
Constructing identities through storytelling in diabetes management
Mamykina, L., Miller, A. D., Mynatt, E. D., & Greenblatt, D. (2010) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/1753326.1753507 · Cited by 81
Social structure and depression in TrevorSpace
Homan, C. M., Lu, N., Tu, X. M., Lytle, M. C., & Silenzio, V. (2014) · ACM Conference on Computer Supported Cooperative Work (CSCW) · doi:10.1145/2531602.2531704 · Cited by 62
Manikonda, L., Meduri, V. V., & Subbarao Kambhampati, B. (2021) · Proceedings of the International AAAI Conference on Web and Social Media · doi:10.1609/icwsm.v10i1.14819 · Cited by 58
Self-citationUnsupervised Image Clustering Using the Information Bottleneck Method
Goldberger, J., Greenspan, H. K., & Shiri Gordon, A. (2002) · Lecture notes in computer science · doi:10.1007/3-540-45783-6_20 · Cited by 55
Visual Illness Narratives of Asthma: Explanatory Models and Health-related Behavior
Rich, M., Patashnick, J., & Chalfen, R. (2002) · American Journal of Health Behavior · doi:10.5993/ajhb.26.6.5 · Cited by 54
Abdullah, S., Murnane, E. L., Costa, J. M. D. R., & Choudhury, T. (2015) · ACM Conference on Computer Supported Cooperative Work (CSCW) · doi:10.1145/2675133.2675186 · Cited by 53
Looking for medical information on the Internet: Self-disclosure, privacy and trust
Buchanan, T., Joinson, A., Paine, C. B., & Reips, U. (2007) · Zurich Open Repository and Archive (University of Zurich) · doi:10.5167/uzh-19679 · Cited by 33
Smith, B. K., Frost, J. H., Albayrak, M., & Sudhakar, R. (2006) · Patient Education and Counseling · doi:10.1016/j.pec.2006.03.011 · Cited by 28
Monitoring adolescent alcohol use via multimodal analysis in social multimedia
Pang, R., Baretto, A., Kautz, H., & Luo, J. (2015) · IEEE International Conference on Big Data (BigData) · doi:10.1109/bigdata.2015.7363914 · Cited by 25
IS & T/SPIE's Symposium on Electronic Imaging : Science & Technology
Ojima, S. (1995) · Cited by 23
Emotional inhibition: A discourse analysis of disclosure
Ellis, D., & Cromby, J. (2011) · Psychology and Health · doi:10.1080/08870446.2011.584623 · Cited by 20
Craving, creating, and constructing comfort
Ferguson, R. D., Massimi, M., Crist, E., & Moffatt, K. (2014) · ACM Conference on Computer Supported Cooperative Work (CSCW) · doi:10.1145/2531602.2531631 · Cited by 20
Ekman, emotional expression, and the art of empirical epiphany
Keltner, D. J. (2003) · Journal of Research in Personality · doi:10.1016/j.jrp.2003.09.006 · Cited by 18
Weber, I. G., & Mejova, Y. (2016) · International Conference on Digital Health · doi:10.1145/2896338.2897727 · Cited by 18
A specific therapeutic approach to suicide risk in borderline clients
Callahan, J. (1996) · Clinical Social Work Journal · doi:10.1007/bf02190749 · Cited by 16
Flagged first, then by citations
Research works printed but not linked: 3
- Maeve Duggan , Nicole B Ellison , Cliff Lampe , Amanda Lenhart , and Mary Madden . 2015. Social media update 2014 . Pew Research Center 19 (2015). Maeve Duggan, Nicole B Ellison, Cliff Lampe, Amanda Lenhart, and Mary Madden. 2015. Social media update 2014. Pew Research Center 19 (2015).
- 10.5555/1211649 · DOI
- James W Pennebaker and Cindy K Chung . 2007. Expressive writing, emotional upheavals, and health. Foundations of health psychology ( 2007 ), 263--284. James W Pennebaker and Cindy K Chung. 2007. Expressive writing, emotional upheavals, and health. Foundations of health psychology (2007), 263--284.
Cited by
Sorted by citations
Social Media and Mental Health: Benefits, Risks, and Opportunities for Research and Practice
Naslund, J. A., Bondre, A., Torous, J., & Aschbrenner, K. A. (2020) · Journal of Technology in Behavioral Science · doi:10.1007/s41347-020-00134-x · Cited by 746
“…statistical and mathematical algorithms (Shatte et al. 2019), has made it possible to study large quantities of data captured from popular social media platforms such as Twitter or Instagram to illuminate various features of mental health (Manikonda and De Choudhury 2017; Reece et al. 2017).”
BackgroundDepression and Self-Harm Risk Assessment in Online Forums
Yates, A., Cohan, A., & Goharian, N. (2017) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/d17-1322 · Cited by 390
Responsible AI—two frameworks for ethical design practice
Peters, D., Vold, K., Robinson, D., & Calvo, R. A. (2020) · IEEE Transactions on Technology and Society · doi:10.1109/tts.2020.2974991 · Cited by 293
“Technology-specific guidelines have also been developed, including the guidelines for the design of interventions for mental health on social media [70].”
BackgroundBeyond Screen Time: Identity Development in the Digital Age
Granic, I., Morita, H., & Scholten, H. (2020) · Psychological Inquiry · doi:10.1080/1047840x.2020.1820214 · Cited by 237
“Facebook, Instagram, and Twitter can also host meaningful discourses around career or education choices, political views, gender identity concerns, and mental health advice (e.g. Manikonda & De Choudhury, 2017).”
BackgroundSanches, P., Janson, A., Karpashevich, P., Nadal, C., Qu, C., Roquet, C. D., Umair, M., Windlin, C., Doherty, G. J., Höök, K., et al. (2019) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3290605.3300475 · Cited by 248
Metadata
- Authors
- Manikonda, L., & De Choudhury, M.
- Affiliations
- Arizona State University (US)
- Georgia Tech, Atlanta, GA, USA
- ORCID
- Manikonda, Lydia
- Venue
- Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems
- Publisher
- ACM
- Published
- 2017-05-02
- Pages
- 170-181
- OpenAlex
- W2611167769
- Cited by
- 116
- References
- 54
- Citations by year
- 2026: 6 · 2025: 10 · 2024: 7 · 2023: 14 · 2022: 13 · 2021: 11 · 2020: 27 · 2019: 14 · 2018: 10 · 2017: 4
- FWCI
- 24.39
- Type
- conference paper
- Language
- en
- Open access
- closed
- Locations
- CHI Conference on Human Factors in Computing Systems (publishedVersion)
- Funders
- Office of Naval Research (N00014-13-1-0176,N00014-15-1-2027)
- National Institutes of Health (1R01GM11269701)
- Topics
- Social Sciences › Psychology › Social Psychology › Mental Health via Writing
- Social Sciences › Sociology and Political Science › Impact of Technology on Adolescents
- Physical Sciences › Computer Science › Human-Computer Interaction › Innovative Human-Technology Interaction
- Keywords
- Instagram, visual attributes, image color, emotional distress, vulnerability, visual sociology, social media, health interventions
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
