Using Twitter for Demographic and Social Science Research: Tools for Data Collection and Processing
Open accessThe DOI matches its Crossref record; 9 of the 9 references it cites were found in a registry or an index.
Abstract
Despite recent and growing interest in using Twitter to examine human behavior and attitudes, there is still significant room for growth regarding the ability to leverage Twitter data for social science research. In particular, gleaning demographic information about Twitter users—a key component of much social science research—remains a challenge. This article develops an accurate and reliable data processing approach for social science researchers interested in using Twitter data to examine behaviors and attitudes, as well as the demographic characteristics of the populations expressing or engaging in them. Using information gathered from Twitter users who state an intention to not vote in the 2012 presidential election, we describe and evaluate a method for processing data to retrieve demographic information reported by users that is not encoded as text (e.g., details of images) and evaluate the reliability of these techniques. We end by assessing the challenges of this data collection strategy and discussing how large-scale social media data may benefit demographic researchers.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
I tweet honestly, I tweet passionately: Twitter users, context collapse, and the imagined audience
Marwick, A. E., & boyd, D. (2011) · New Media & Society · doi:10.1177/1461444810365313 · Cited by 4,612
Conducting behavioral research on Amazon’s Mechanical Turk
Mason, W., & Suri, S. (2012) · Behavior Research Methods · doi:10.3758/s13428-011-0124-6 · Cited by 3,172
Sensitive questions in surveys.
Tourangeau, R., & Yan, T. (2007) · Psychological Bulletin · doi:10.1037/0033-2909.133.5.859 · Cited by 3,057
The Parable of Google Flu: Traps in Big Data Analysis
Lazer, D., Kennedy, R., King, G., & Vespignani, A. (2014) · Science · doi:10.1126/science.1248506 · Cited by 2,523
Cheap and fast---but is it good?: evaluating non-expert annotations for natural language tasks
Snow, R., O'Connor, B., Jurafsky, D., & Ng, A. Y. (2008) · Proceedings of the Conference on Empirical Methods in Natural Language Processing - EMNLP '08 · doi:10.3115/1613715.1613751 · Cited by 1,887
Friend networking sites and their relationship to adolescents’ well-being and social self-esteem
Valkenburg, P. M., Peter, J., & Schouten, A. P. (2006) · CyberPsychology & Behavior · doi:10.1089/cpb.2006.9.584 · Cited by 1,531
Diurnal and seasonal mood vary with work, sleep, and daylength across diverse cultures
Golder, S. A., & Macy, M. W. (2011) · Science · doi:10.1126/science.1202775 · Cited by 1,155 · cited 4×
“Web-based data collection has gained prominence among social science researchers as a means of collecting large amounts of data to explore topics such as election forecasting, tracking social trends, and time usage (Golder and Macy 2011; Naaman et al. 2011; Tumasjan et al. 2010).”
InfluentialDynamic debates: an analysis of group polarization over time on Twitter
Yardi, S., & Boyd, D. (2010) · Bulletin of Science, Technology & Society · doi:10.1177/0270467610380011 · Cited by 625
De Longueville, B., Smith, R. S., & Luraschi, G. (2009) · Proceedings of the 2009 International Workshop on Location Based Social Networks · doi:10.1145/1629890.1629907 · Cited by 307
Cited by
Computational Social Science and Sociology
Edelmann, A., Wolff, T., Montagne, D., & Bail, C. A. (2020) · Annual Review of Sociology · doi:10.1146/annurev-soc-121919-054621 · Cited by 305
“…demographic characteristics of neighborhoods (Gebru et al. 2017), crowd-sourcing techniques to measure demographics of social media populations (McCormick et al. 2017), websites to map large-scale genealogy trees (Kaplanis et al. 2018), and online image data to predict age (Helleringer et al.…”
Open Humans: a platform for participant-centered research and personal data exploration
Greshake Tzovaras, B., Angrist, M., Arvai, K., Dulaney, M., Estrada-Galiñanes, V., Gunderson, B., Head, T., Lewis, D., Nov, O., Shaer, O., et al. (2019) · GigaScience · doi:10.1093/gigascience/giz076 · Cited by 56
Hswen, Y., Naslund, J. A., Brownstein, J. S., & Hawkins, J. B. (2018) · Psychiatric Quarterly · doi:10.1007/s11126-017-9559-y · Cited by 48
Measures of the Degree of Departure from Ignorable Sample Selection
Little, R. J. A., West, B. T., Boonstra, P. S., & Hu, J. (2020) · Journal of Survey Statistics and Methodology · doi:10.1093/jssam/smz023 · Cited by 47
Hswen, Y., Naslund, J. A., Brownstein, J. S., & Hawkins, J. B. (2018) · JMIR Mental Health · doi:10.2196/11483 · Cited by 43
Metadata
- Authors
- McCormick, T. H., Lee, H., Cesare, N., Shojaie, A., & Spiro, E. S.
- Venue
- Sociological Methods & Research
- Publisher
- SAGE Publications
- Published
- 2015-10-09
- Volume
- 46
- Issue
- 3
- Pages
- 390-421
- ISSN
- 0049-1241 (ISSN-L)
- 1552-8294
- OpenAlex
- W2337647281
- Cited by
- 207
- References
- 9
- FWCI
- 27.14
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Using Twitter for Demographic and Social Science Research: Tools for Data Collection and Processing. https://app.cochat.ai/papers/10.1177/0049124115605339
- The paper
- McCormick, T. H., Lee, H., Cesare, N., Shojaie, A., & Spiro, E. S. (2017). Using Twitter for Demographic and Social Science Research: Tools for Data Collection and Processing. Sociological Methods & Research. https://doi.org/10.1177/0049124115605339
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.