Social Media Image Analysis for Public Health
The DOI matches its Crossref record; 3 of the 3 references it cites were found in a registry or an index.
Abstract
Several projects have shown the feasibility to use emph{textual} social media data to track public health concerns, such as temporal influenza patterns or geographical obesity patterns. In this paper, we look at whether geo-tagged emph{images} from Instagram also provide a viable data source. Especially for "lifestyle" diseases, such as obesity, drinking or smoking, images of social gatherings could provide information that is not necessarily shared in, say, tweets. In this study, we explore whether (i) tags provided by the users and (ii) annotations obtained via automatic image tagging are indeed valuable for studying public health. We find that both user-provided and machine-generated tags provide information that can be used to infer a county's health statistics. Whereas for most statistics user-provided tags are better features, for predicting excessive drinking machine-generated tags such as "liquid' and "glass' yield better models. This hints at the potential of using machine-generated tags to study substance abuse.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Flourish: A Visionary New Understanding of Happiness and Well-Being
(2011) · Choice Reviews Online · doi:10.5860/choice.48-7217 · Cited by 5,543 · cited 1×
“atrix using Euclidean norm in order to remove dierences in image counts across counties. We also tried out various extensions of the text tags using external dictionaries such as LIWC [19] and PERMA [24]. We do not report results for these here as they did not lead to improvements, neither applied to human-generated n…”
MethodDeep visual-semantic alignments for generating image descriptions
Karpathy, A., & Fei-Fei, L. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298932 · Cited by 4,902
How Social Media Will Change Public Health
Dredze, M. (2012) · IEEE Intelligent Systems · doi:10.1109/mis.2012.76 · Cited by 207 · cited 1×
“lifestyle. Recent studies have shown that a large scale, real time, non-intrusive monitoring can be done using social media to get aggregate statistics about the health and well being of a population [7, 23, 11]. Twitter in particular has been widely used in studies on public health [17, 21, 16, 12], due to its vast a…”
Background
Cited by
Deep Learning for Health Informatics
Ravì, D., Wong, C., Deligianni, F., Berthelot, M., Andreu-Perez, J., Lo, B., & Yang, G.-Z. (2017) · IEEE Journal of Biomedical and Health Informatics · doi:10.1109/jbhi.2016.2636665 · Cited by 2,000
Learning Cross-Modal Embeddings for Cooking Recipes and Food Images
Salvador, A., Hynes, N., Aytar, Y., Marin, J., Ofli, F., Weber, I., & Torralba, A. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.327 · Cited by 404
Self-citationRecipe1M+: A Dataset for Learning Cross-Modal Embeddings for Cooking Recipes and Food Images
Marin, J., Biswas, A., Ofli, F., Hynes, N., Salvador, A., Aytar, Y., Weber, I., & Torralba, A. (2021) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2019.2927476 · Cited by 321
Self-citationMultimodal mental health analysis in social media
Yazdavar, A. H., Mahdavinejad, M. S., Bajaj, G., Romine, W., Sheth, A., Monadjemi, A. H., Thirunarayan, K., Meddar, J. M., Myers, A., Pathak, J., et al. (2020) · PLOS ONE · doi:10.1371/journal.pone.0226248 · Cited by 133
“The recent emergence of photo-sharing platforms such as Instagram has attracted researchers’ attention to study individual’s behavior from their visual narratives—ranging from mining their emotions [37], and happiness trend [38], to studying medical concerns [39].”
BackgroundModeling and Understanding Visual Attributes of Mental Health Disclosures in Social Media
Manikonda, L., & De Choudhury, M. (2017) · Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3025453.3025932 · Cited by 116
“Recently, a growing body of research has examined and characterized such imagery to identify sentiment and emotion [31], societal happiness [1], geographic landmarks [34], abusive behaviors such as alcohol use [41], public health challenges such as obesity [19], and fitness [52].”
Background
Metadata
- Authors
- Garimella, V. R. K., Alfayad, A., & Weber, I.
- Venue
- Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems
- Publisher
- ACM
- Published
- 2016-05-07
- Pages
- 5543-5547
- OpenAlex
- W2277302289
- Cited by
- 89
- References
- 3
- FWCI
- 143.45
- Type
- conference paper
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Social Media Image Analysis for Public Health. https://app.cochat.ai/papers/10.1145/2858036.2858234
- The paper
- Garimella, V. R. K., Alfayad, A., & Weber, I. (2016). Social Media Image Analysis for Public Health. Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems. https://doi.org/10.1145/2858036.2858234
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.