Digital Trace Data in the Study of Public Opinion: An Indicator of Attention Toward Politics Rather Than Political Support
The DOI matches its Crossref record; 14 of the 14 references it cites were found in a registry or an index.
Abstract
In this article, we examine the relationship between metrics documenting politics-related Twitter activity with election results and trends in opinion polls. Various studies have proposed the possibility of inferring public opinion based on digital trace data collected on Twitter and even the possibility to predict election results based on aggregates of mentions of political actors. Yet, a systematic attempt at a validation of Twitter as an indicator for political support is lacking. In this article, building on social science methodology, we test the validity of the relationship between various Twitter-based metrics of public attention toward politics with election results and opinion polls. All indicators tested in this article suggest caution in the attempt to infer public opinion or predict election results based on Twitter messages. In all tested metrics, indicators based on Twitter mentions of political parties differed strongly from parties’ results in elections or opinion polls. This leads us to question the power of Twitter to infer levels of political support of political actors. Instead, Twitter appears to promise insights into temporal dynamics of public attention toward politics.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Reliability and Validity Assessment
Carmines, E., & Zeller, R. (1979) · doi:10.4135/9781412985642 · Cited by 5,884 · cited 1×
“Moreover, scholars should provide an auxiliary theory that links the indicator to the target concept (e.g., Carmines & Zeller, 1979; Cronbach & Meehl, 1955; Kane, 1992; Messick, 1989).”
BackgroundAnother look at measures of forecast accuracy
Hyndman, R. J., & Koehler, A. B. (2006) · International Journal of Forecasting · doi:10.1016/j.ijforecast.2006.03.001 · Cited by 5,757
Twitter mood predicts the stock market
Bollen, J., Mao, H., & Zeng, X. (2011) · Journal of Computational Science · doi:10.1016/j.jocs.2010.12.007 · Cited by 5,206
The Psychology of Survey Response
Tourangeau, R., Rips, L. J., & Rasinski, K. (2000) · doi:10.1017/cbo9780511819322 · Cited by 4,734
Lazer, D., Pentland, A., Adamic, L., Aral, S., Barabási, A.-L., Brewer, D., Christakis, N., Contractor, N., Fowler, J., Gutmann, M., et al. (2009) · Science · doi:10.1126/science.1167742 · Cited by 3,365
Concept Misformation in Comparative Politics
Sartori, G. (1970) · American Political Science Review · doi:10.2307/1958356 · Cited by 3,318 · cited 1×
“In this, proponents fall victim to a positivistic fallacy and resemble what Sartori (1970) has termed ‘‘the unconscious thinker,’’ a scholar using advanced quantitative methods without linking them sufficiently to the phenomena of interest.”
BackgroundThe Parable of Google Flu: Traps in Big Data Analysis
Lazer, D., Kennedy, R., King, G., & Vespignani, A. (2014) · Science · doi:10.1126/science.1248506 · Cited by 2,523
Predicting the Present with Google Trends
CHOI, H., & VARIAN, H. (2012) · Economic Record · doi:10.1111/j.1475-4932.2012.00809.x · Cited by 2,354
Predicting the future with social media
Asur, S., & Huberman, B. A. (2010) · 2010 IEEE/WIC/ACM International Conference on Web Intelligence and Intelligent Agent Technology · doi:10.1109/wi-iat.2010.63 · Cited by 2,081
Social media for large studies of behavior
Ruths, D., & Pfeffer, J. (2014) · Science · doi:10.1126/science.346.6213.1063 · Cited by 648 · cited 1×
“…of a tweet through machine learning (https://dev.twitter.com/overview/api/tweets), because the details of this proprietary approach are a black box to researchers not affiliated with Twitter and this filter could thus impact the data quality in uncontrollable ways (cf. Ruths & Pfeffer, 2014).”
Background
Cited by
Measuring algorithmically infused societies
Wagner, C., Strohmaier, M., Olteanu, A., Kıcıman, E., Contractor, N., & Eliassi-Rad, T. (2021) · Nature · doi:10.1038/s41586-021-03666-1 · Cited by 144
Bright, J., Hale, S., Ganesh, B., Bulovsky, A., Margetts, H., & Howard, P. (2020) · Communication Research · doi:10.1177/0093650219872394 · Cited by 104
Journalists’ Use of Social Media to Infer Public Opinion: The Citizens’ Perspective
Dubois, E., Gruzd, A., & Jacobson, J. (2020) · Social Science Computer Review · doi:10.1177/0894439318791527 · Cited by 84
Guerrero-Solé, F., & Lopez-Gonzalez, H. (2019) · Social Science Computer Review · doi:10.1177/0894439317744163 · Cited by 28
Metadata
- Authors
- Jungherr, A., Schoen, H., Posegga, O., & Jürgens, P.
- Venue
- Social Science Computer Review
- Publisher
- SAGE Publications
- Published
- 2016-02-15
- Volume
- 35
- Issue
- 3
- Pages
- 336-356
- ISSN
- 0894-4393 (ISSN-L)
- 1552-8286
- OpenAlex
- W2321872815
- Cited by
- 114
- References
- 14
- FWCI
- 23.74
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Digital Trace Data in the Study of Public Opinion: An Indicator of Attention Toward Politics Rather Than Political Support. https://app.cochat.ai/papers/10.1177/0894439316631043
- The paper
- Jungherr, A., Schoen, H., Posegga, O., & Jürgens, P. (2017). Digital Trace Data in the Study of Public Opinion: An Indicator of Attention Toward Politics Rather Than Political Support. Social Science Computer Review. https://doi.org/10.1177/0894439316631043
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.