A novel surveillance approach for disaster mental health
Open accessThe DOI matches its Crossref record; 60 of the 60 references it cites were found in a registry or an index.
Abstract
BACKGROUND: Disasters have substantial consequences for population mental health. Social media data present an opportunity for mental health surveillance after disasters to help identify areas of mental health needs. We aimed to 1) identify specific basic emotions from Twitter for the greater New York City area during Hurricane Sandy, which made landfall on October 29, 2012, and to 2) detect and map spatial temporal clusters representing excess risk of these emotions. METHODS: We applied an advanced sentiment analysis on 344,957 Twitter tweets in the study area over eleven days, from October 22 to November 1, 2012, to extract basic emotions, a space-time scan statistic (SaTScan) and a geographic information system (QGIS) to detect and map excess risk of these emotions. RESULTS: Sadness and disgust were among the most prominent emotions identified. Furthermore, we noted 24 spatial clusters of excess risk of basic emotions over time: Four for anger, one for confusion, three for disgust, five for fear, five for sadness, and six for surprise. Of these, anger, confusion, disgust and fear clusters appeared pre disaster, a cluster of surprise was found peri disaster, and a cluster of sadness emerged post disaster. CONCLUSIONS: We proposed a novel syndromic surveillance approach for mental health based on social media data that may support conventional approaches by providing useful additional information in the context of disaster. We showed that excess risk of multiple basic emotions could be mapped in space and time as a step towards anticipating acute stress in the population and identifying community mental health need rapidly and efficiently in the aftermath of disaster. More studies are needed to better control for bias, identify associations with reliable and valid instruments measuring mental health, and to explore computational methods for continued model-fitting, causal relationships, and ongoing evaluation. Our study may be a starting point also for more fully elaborated models that can either prospectively detect mental health risk using real-time social media data or detect excess risk of emotional reactions in areas that lack efficient infrastructure during and after disasters. As such, social media data may be used for mental health surveillance after large scale disasters to help identify areas of mental health needs and to guide us in our knowledge where we may most effectively intervene to reduce the mental health consequences of disasters.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Figures

![Fig 2 Spatial distributions of geo-located Twitter tweets and percentages of emotions classified in quintiles at the census tract level in the greater New York City area between October 22 and November 1 2012. Storm surge according to FEMA [59].](https://figures.cochat.ai/paper-figures/7afa4084b459410cb590847f97622ee1/a-novel-surveillance-approach-for-disaster-mental-health-figure-2.jpg)
![Fig 3 Scan statistic results for the time frame October 22 and November 1 2012. Circles indicate spatio-temporal clusters of excess risk of emotional reactions along with the time of emergence. Shaded areas within circles highlight geo locations of cluster-relevant tweets, with darker shading indicating higher densities. Storm surge according to FEMA [59].](https://figures.cochat.ai/paper-figures/33c7173a8a48420fa0ae7225e729410b/a-novel-surveillance-approach-for-disaster-mental-health-figure-3.jpg)
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Women, those with low socioeconomic status, living in poverty, with scarce economic and social resources, reduction of social support, and mental health problems existing before the events, along with traumatic experiences (death or life risk, serious injury or sexual assault) and stressors, represent vulnerable groups that tend to develop new mental disorders or see their previous problems worsen”
From The Impact of Climate Change on Mental Health: A Systematic Descriptive Review (2020) · cites this paper as [49]
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“Research has shown that peritraumatic experience is highly related to acute stress during and immediately after a disaster, which is expected to lead to the onset of PTSD (49).”
From The Impact of Climate Change on Mental Health: A Systematic Descriptive Review (2020) · cites this paper as [49]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Conservation of resources: A new attempt at conceptualizing stress
Hobfoll, S. E. (1989) · American Psychologist · doi:10.1037/0003-066x.44.3.513 · Cited by 18,187
The nature of emotion: Fundamental questions.
Ekman, P., & Davidson, R. J. (1994) · Oxford University Press eBooks · Cited by 3,871
Earthquake shakes Twitter users: real-time event detection by social sensors
Sakaki, T., Okazaki, M., & Matsuo, Y. (2010) · Proceedings of the 19th international conference on World wide web · doi:10.1145/1772690.1772777 · Cited by 3,640
60,000 Disaster Victims Speak: Part I. An Empirical Review of the Empirical Literature, 1981–2001
Norris, F. H., Friedman, M. J., Watson, P. J., Byrne, C. M., Diaz, E., & Kaniasty, K. (2002) · Psychiatry: Interpersonal and Biological Processes · doi:10.1521/psyc.65.3.207.20173 · Cited by 3,128
The Parable of Google Flu: Traps in Big Data Analysis
Lazer, D., Kennedy, R., King, G., & Vespignani, A. (2014) · Science · doi:10.1126/science.1248506 · Cited by 2,523
Ekman, P. (1999) · Handbook of Cognition and Emotion · doi:10.1002/0470013494.ch3 · Cited by 2,125
Psychological Sequelae of the September 11 Terrorist Attacks in New York City
Galea, S., Ahern, J., Resnick, H., Kilpatrick, D., Bucuvalas, M., Gold, J., & Vlahov, D. (2002) · New England Journal of Medicine · doi:10.1056/nejmsa013404 · Cited by 1,904
Self-citationAdvances in natural language processing
Hirschberg, J., & Manning, C. D. (2015) · Science · doi:10.1126/science.aaa8685 · Cited by 1,712
Handbook of Cognition and Emotion
(1999) · Wiley eBooks · doi:10.1002/0470013494 · Cited by 1,670
A survey on opinion mining and sentiment analysis: Tasks, approaches and applications
Ravi, K., & Ravi, V. (2015) · Knowledge-Based Systems · doi:10.1016/j.knosys.2015.06.015 · Cited by 1,306
A Space–Time Permutation Scan Statistic for Disease Outbreak Detection
Kulldorff, M., Heffernan, R., Hartman, J., Assunção, R., & Mostashari, F. (2005) · PLoS Medicine · doi:10.1371/journal.pmed.0020059 · Cited by 1,148
Mental Health Consequences of Disasters
Goldmann, E., & Galea, S. (2014) · Annual Review of Public Health · doi:10.1146/annurev-publhealth-032013-182435 · Cited by 1,082
Self-citationModeling Public Mood and Emotion: Twitter Sentiment and Socio-Economic Phenomena
Bollen, J., Mao, H., & Pepe, A. (2021) · Proceedings of the International AAAI Conference on Web and Social Media · doi:10.1609/icwsm.v5i1.14171 · Cited by 936
Houston, J. B., Hawthorne, J., Perreault, M. F., Park, E. H., Goldstein Hode, M., Halliwell, M. R., Turner McGowen, S. E., Davis, R., Vaid, S., McElderry, J. A., et al. (2015) · Disasters · doi:10.1111/disa.12092 · Cited by 869
Thelwall, M., Buckley, K., & Paltoglou, G. (2011) · Journal of the American Society for Information Science and Technology · doi:10.1002/asi.21462 · Cited by 822
Quantifying Mental Health Signals in Twitter
Coppersmith, G., Dredze, M., & Harman, C. (2014) · Proceedings of the Workshop on Computational Linguistics and Clinical Psychology: From Linguistic Signal to Clinical Reality · doi:10.3115/v1/w14-3207 · Cited by 722
Rapid assessment of disaster damage using social media activity
Kryvasheyeu, Y., Chen, H., Obradovich, N., Moro, E., Van Hentenryck, P., Fowler, J., & Cebrian, M. (2016) · Science Advances · doi:10.1126/sciadv.1500779 · Cited by 637
Trends in mental illness and suicidality after Hurricane Katrina
Kessler, R. C., Galea, S., Gruber, M. J., Sampson, N. A., Ursano, R. J., & Wessely, S. (2008) · Molecular Psychiatry · doi:10.1038/sj.mp.4002119 · Cited by 617
Self-citationExposure to Hurricane-Related Stressors and Mental Illness After Hurricane Katrina
Galea, S., Brewin, C. R., Gruber, M., Jones, R. T., King, D. W., King, L. A., McNally, R. J., Ursano, R. J., Petukhova, M., & Kessler, R. C. (2007) · Archives of General Psychiatry · doi:10.1001/archpsyc.64.12.1427 · Cited by 584
Self-citationA test of the social support deterioration model in the context of natural disaster.
Kaniasty, K. Z., & Norris, F. H. (1993) · Journal of Personality and Social Psychology · doi:10.1037//0022-3514.64.3.395 · Cited by 582
Social media as a measurement tool of depression in populations
De Choudhury, M., Counts, S., & Horvitz, E. (2013) · Proceedings of the 5th Annual ACM Web Science Conference · doi:10.1145/2464464.2464480 · Cited by 497
langid.py: An Off-the-shelf Language Identification Tool
Lui, M., & Baldwin, T. (2012) · Cited by 471
Trends in weather related disasters – Consequences for insurers and society
Hoeppe, P. (2016) · Weather and Climate Extremes · doi:10.1016/j.wace.2015.10.002 · Cited by 378
From ADHD to SAD: Analyzing the Language of Mental Health on Twitter through Self-Reported Diagnoses
Coppersmith, G., Dredze, M., Harman, C., & Hollingshead, K. (2015) · Proceedings of the 2nd Workshop on Computational Linguistics and Clinical Psychology: From Linguistic Signal to Clinical Reality · doi:10.3115/v1/w15-1201 · Cited by 332
Olson, D. R., Konty, K. J., Paladini, M., Viboud, C., & Simonsen, L. (2013) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1003256 · Cited by 320
Measuring post traumatic stress disorder in Twitter
Coppersmith, G., Harman, C., & Dredze, M. (2014) · Proceedings of the International AAAI Conference on Web and Social Media · doi:10.1609/icwsm.v8i1.14574 · Cited by 316
Freedy, J. R., Shaw, D. L., Jarrell, M. P., & Masters, C. R. (1992) · Journal of Traumatic Stress · doi:10.1002/jts.2490050308 · Cited by 316
The Mental Health Consequences of Mass Shootings
Lowe, S. R., & Galea, S. (2017) · Trauma, Violence, & Abuse · doi:10.1177/1524838015591572 · Cited by 277
Self-citationDiscovering Health Topics in Social Media Using Topic Models
Paul, M. J., & Dredze, M. (2014) · PLoS ONE · doi:10.1371/journal.pone.0103408 · Cited by 269
Detecting unknown malicious code by applying classification techniques on OpCode patterns
Shabtai, A., Moskovitch, R., Feher, C., Dolev, S., & Elovici, Y. (2012) · Security Informatics · doi:10.1186/2190-8532-1-1 · Cited by 266
Sloan, L., & Morgan, J. (2015) · PLOS ONE · doi:10.1371/journal.pone.0142209 · Cited by 261
Proceedings of ACL 2018, System Demonstrations
(2018) · doi:10.18653/v1/p18-4 · Cited by 234
Multivariate scan statistics for disease surveillance
Kulldorff, M., Mostashari, F., Duczmal, L., Katherine Yih, W., Kleinman, K., & Platt, R. (2007) · Statistics in Medicine · doi:10.1002/sim.2818 · Cited by 223
TweetTracker: An Analysis Tool for Humanitarian and Disaster Relief
Kumar, S., Barbier, G., Abbasi, M., & Liu, H. (2021) · Proceedings of the International AAAI Conference on Web and Social Media · doi:10.1609/icwsm.v5i1.14079 · Cited by 203
Harvey, A. G., & Bryant, R. A. (1999) · Journal of Consulting and Clinical Psychology · doi:10.1037/0022-006x.67.6.985 · Cited by 191
Fussell, E., & Lowe, S. R. (2014) · Social Science & Medicine · doi:10.1016/j.socscimed.2014.05.025 · Cited by 190
Self-citationSpatial and Syndromic Surveillance for Public Health
(2005) · Wiley eBooks · doi:10.1002/0470092505 · Cited by 165
Mental Health Effects of Hurricane Sandy: Characteristics, Potential Aftermath, and Response
Neria, Y., & Shultz, J. M. (2012) · JAMA · doi:10.1001/jama.2012.110700 · Cited by 157
Nagar, R., Yuan, Q., Freifeld, C. C., Santillana, M., Nojima, A., Chunara, R., & Brownstein, J. S. (2014) · Journal of Medical Internet Research · doi:10.2196/jmir.3416 · Cited by 154
A model-adjusted space–time scan statistic with an application to syndromic surveillance
KLEINMAN, K. P., Abrams, A. M., Kulldorff, M., & Platt, R. G. (2005) · Epidemiology and Infection · doi:10.1017/s0950268804003528 · Cited by 131
Could Behavioral Medicine Lead the Web Data Revolution?
Ayers, J. W., Althouse, B. M., & Dredze, M. (2014) · JAMA · doi:10.1001/jama.2014.1505 · Cited by 129
A cross-hazard analysis of terse message retransmission on Twitter
Sutton, J. N., Gibson, C. B., Phillips, N. E., Spiro, E. S., League, C., Johnson, B., Fitzhugh, S. M., & Butts, C. T. (2015) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1508916112 · Cited by 124
World Disasters Report 2014 – Focus on Culture and Risk
Cannon, T. (2014) · Figshare · Cited by 121
Emotive ontology: extracting fine-grained emotions from terse, informal messages
Sykora, M. D., Jackson, T., O’Brien, A., & Elayan, S. (2013) · Loughborough University Institutional Repository (Loughborough University) · Cited by 97
Self-citationHoffmann, W. U., Latza, U., & Terschüren, C. (2005) · Das Gesundheitswesen · doi:10.1055/s-2004-813850 · Cited by 68
Novel surveillance of psychological distress during the great recession
Ayers, J. W., Althouse, B. M., Allem, J.-P., Childers, M. A., Zafar, W., Latkin, C., Ribisl, K. M., & Brownstein, J. S. (2012) · Journal of Affective Disorders · doi:10.1016/j.jad.2012.05.005 · Cited by 67
"Narco" Emotions: Affect and Desensitization in Social Media during the Mexican Drug War
Choudhury, M. D., Monroy‐Hernández, A., & Mark, G. J. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1507.01287 · Cited by 65
Influence of Spatial Resolution on Space-Time Disease Cluster Detection
Jones, S. G., & Kulldorff, M. (2012) · PLoS ONE · doi:10.1371/journal.pone.0048036 · Cited by 64
Population Health Concerns During the United States’ Great Recession
Althouse, B. M., Allem, J.-P., Childers, M., Dredze, M. H., & Ayers, J. W. (2014) · American Journal of Preventive Medicine · doi:10.1016/j.amepre.2013.10.008 · Cited by 63
"Narco" emotions: affect and desensitization in social media during the mexican drug war
De Choudhury, M., Monroy-Hernández, A., & Mark, G. (2014) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/2556288.2557197 · Cited by 62
Estimating Citizen Alertness in Crises Using Social Media Monitoring and Analysis
Johansson, F., Brynielsson, J., & Narganes, M. (2012) · European Intelligence and Security Informatics Conference · doi:10.1109/eisic.2012.23 · Cited by 60
Identifying depressive users in Twitter using multimodal analysis
Kang, K., Yoon, C., & Kim, E. Y. (2016) · International Conference on Big Data and Smart Computing · doi:10.1109/bigcomp.2016.7425918 · Cited by 53
IADIS INTERNATIONAL JOURNAL ON COMPUTER SCIENCE AND INFORMATION SYSTEMS
(2019) · IADIS INTERNATIONAL JOURNAL ON COMPUTER SCIENCE AND INFORMATION SYSTEMS · doi:10.33965/ijcsis · Cited by 53
Mental health surveillance after the terrorist attacks in Paris
Gruebner, O., Sykora, M. D., Lowe, S. R., Shankardass, K., Trinquart, L., Jackson, T., Subramanian, S. V., & Galea, S. (2016) · The Lancet · doi:10.1016/s0140-6736(16)30602-x · Cited by 49
Self-citationYang, J., Tsou, M., Jung, C., Allen, C., Spitzberg, B. H., Gawron, J. M., & Han, S.-Y. (2016) · Big Data & Society · doi:10.1177/2053951716652914 · Cited by 34
Estimating the sentiment of social media content for security informatics applications
Glass, K., & Colbaugh, R. (2012) · Security Informatics · doi:10.1186/2190-8532-1-3 · Cited by 27
National Security and Social Media Monitoring: A Presentation of the EMOTIVE and Related Systems
Sykora, M. D., Jackson, T., O’Brien, A., & Elayan, S. (2013) · European Intelligence and Security Informatics Conference · doi:10.1109/eisic.2013.38 · Cited by 25
Self-citationCan social media help us reason about mental health?
Choudhury, M. D. (2014) · International World Wide Web Conference (WWW) · doi:10.1145/2567948.2580064 · Cited by 22
Identifying Depression-Related Tweets from Twitter for Public Health Monitoring
Mowery, D. L., Smith, H. A., Cheney, T., Bryan, C. J., & Conway, M. A. (2016) · Online Journal of Public Health Informatics · doi:10.5210/ojphi.v8i1.6561 · Cited by 18
Estimating the sentiment of social media content for security informatics applications
Glass, K., & Colbaugh, R. (2011) · doi:10.1109/isi.2011.5984052 · Cited by 16
Cited by
The Impact of Climate Change on Mental Health: A Systematic Descriptive Review
Cianconi, P., Betrò, S., & Janiri, L. (2020) · Frontiers in Psychiatry · doi:10.3389/fpsyt.2020.00074 · Cited by 1,320
Social Determinants of Mental Health: Where We Are and Where We Need to Go
Alegría, M., NeMoyer, A., Falgàs Bagué, I., Wang, Y., & Alvarez, K. (2018) · Current Psychiatry Reports · doi:10.1007/s11920-018-0969-9 · Cited by 979
Sentiment analysis of Twitter data during critical events through Bayesian networks classifiers
Ruz, G. A., Henríquez, P. A., & Mascareño, A. (2020) · Future Generation Computer Systems · doi:10.1016/j.future.2020.01.005 · Cited by 332
Sentiment Analysis in Health and Well-Being: Systematic Review
Zunic, A., Corcoran, P., & Spasic, I. (2020) · JMIR Medical Informatics · doi:10.2196/16023 · Cited by 213
Social media use in disaster recovery: A systematic literature review
Ogie, R. I., James, S., Moore, A., Dilworth, T., Amirghasemi, M., & Whittaker, J. (2022) · International Journal of Disaster Risk Reduction · doi:10.1016/j.ijdrr.2022.102783 · Cited by 169
Metadata
- Authors
- Gruebner, O., Lowe, S. R., Sykora, M., Shankardass, K., Subramanian, S. V., & Galea, S.
- Affiliations
- Harvard University (US)
- Montclair State University (US)
- Loughborough University (GB)
- Wilfrid Laurier University (CA)
- Boston University (US)
- Corresponding author
- Gruebner, Oliver
- Venue
- PLOS ONE
- Publisher
- Public Library of Science (PLoS)
- Published
- 2017-07-19
- Volume
- 12
- Issue
- 7
- Pages
- e0181233
- ISSN
- 1932-6203 (ISSN-L)
- PMC
- PMC5516998
- OpenAlex
- W2738614877
- Cited by
- 105
- References
- 60
- Citations by year
- 2026: 4 · 2025: 14 · 2024: 12 · 2023: 5 · 2022: 22 · 2021: 17 · 2020: 13 · 2019: 10 · 2018: 6 · 2017: 2
- FWCI
- 12.14
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- Locations
- PLoS ONE (publishedVersion, cc-by)
- Europe PMC (PubMed Central) (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Loughborough University Institutional Repository (Loughborough University) (submittedVersion, cc-by)
- Loughborough University Research Repository (Loughborough University) (submittedVersion, cc-by)
- Funders
- Deutsche Forschungsgemeinschaft (GR 4302/1-1, GR 4302/2-1)
- Defense Science and Technology Laboratory
- Engineering and Physical Sciences Research Council (EP/J020532/1)
- Topics
- Social Sciences › Psychology › Social Psychology › Mental Health via Writing
- Health Sciences › Medicine › Epidemiology › Data-Driven Disease Surveillance
- Physical Sciences › Computer Science › Artificial Intelligence › Sentiment Analysis and Opinion Mining
- Keywords
- disaster mental health, syndromic surveillance, social media, Twitter, Hurricane Sandy, basic emotions, sentiment analysis, spatiotemporal clustering, acute stress, New York City
- MeSH terms
- Mental Disorders, Disasters, Emotions, Humans, Mental Health, New York, Population Surveillance, Geographic Information Systems, Cyclonic Storms, Social Media
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.