The Application of Internet-Based Sources for Public Health Surveillance (Infoveillance): Systematic Review
Open accessThe DOI matches its Crossref record; 9 of the 9 references it cites were found in a registry or an index.
Abstract
Background: Public health surveillance is based on the continuous and systematic collection, analysis, and interpretation of data. This informs the development of early warning systems to monitor epidemics and documents the impact of intervention measures. The introduction of digital data sources, and specifically sources available on the internet, has impacted the field of public health surveillance. New opportunities enabled by the underlying availability and scale of internet-based sources (IBSs) have paved the way for novel approaches for disease surveillance, exploration of health communities, and the study of epidemic dynamics. This field and approach is also known as infodemiology or infoveillance. Objective: This review aimed to assess research findings regarding the application of IBSs for public health surveillance (infodemiology or infoveillance). To achieve this, we have presented a comprehensive systematic literature review with a focus on these sources and their limitations, the diseases targeted, and commonly applied methods. Methods: A systematic literature review was conducted targeting publications between 2012 and 2018 that leveraged IBSs for public health surveillance, outbreak forecasting, disease characterization, diagnosis prediction, content analysis, and health-topic identification. The search results were filtered according to previously defined inclusion and exclusion criteria. Results: Spanning a total of 162 publications, we determined infectious diseases to be the preferred case study (108/162, 66.7%). Of the eight categories of IBSs (search queries, social media, news, discussion forums, websites, web encyclopedia, and online obituaries), search queries and social media were applied in 95.1% (154/162) of the reviewed publications. We also identified limitations in representativeness and biased user age groups, as well as high susceptibility to media events by search queries, social media, and web encyclopedias. Conclusions: IBSs are a valuable proxy to study illnesses affecting the general population; however, it is important to characterize which diseases are best suited for the available sources; the literature shows that the level of engagement among online platforms can be a potential indicator. There is a necessity to understand the population’s online behavior; in addition, the exploration of health information dissemination and its content is significantly unexplored. With this information, we can understand how the population communicates about illnesses online and, in the process, benefit public health.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
The Parable of Google Flu: Traps in Big Data Analysis
Lazer, D., Kennedy, R., King, G., & Vespignani, A. (2014) · Science · doi:10.1126/science.1248506 · Cited by 2,523
Income, Health, and Well-Being around the World: Evidence from the Gallup World Poll
Deaton, A. (2008) · Journal of Economic Perspectives · doi:10.1257/jep.22.2.53 · Cited by 1,636
Social media as a measurement tool of depression in populations
De Choudhury, M., Counts, S., & Horvitz, E. (2013) · Proceedings of the 5th Annual ACM Web Science Conference · doi:10.1145/2464464.2464480 · Cited by 497
Olson, D. R., Konty, K. J., Paladini, M., Viboud, C., & Simonsen, L. (2013) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1003256 · Cited by 320 · cited 2×
“The studies by Olson et al [55], Alicino et al [85], and Yom-tov [109] report negative results caused by questionable reliability with search query data and media influence affecting social networks and web encyclopedias.”
BackgroundMethodWhat can we learn about the Ebola outbreak from tweets?
Odlum, M., & Yoon, S. (2015) · American Journal of Infection Control · doi:10.1016/j.ajic.2015.02.023 · Cited by 234
FluBreaks: Early Epidemic Detection from Google Flu Trends
Pervaiz, F., Pervaiz, M., Abdur Rehman, N., & Saif, U. (2012) · Journal of Medical Internet Research · doi:10.2196/jmir.2102 · Cited by 98
Twitter mining for fine-grained syndromic surveillance
Velardi, P., Stilo, G., Tozzi, A. E., & Gesualdo, F. (2014) · Artificial Intelligence in Medicine · doi:10.1016/j.artmed.2014.01.002 · Cited by 91 · cited 1×
“Furthermore, the use of lexical and syntactic features and the use of lexicons have shown to improve classification tasks, eg, self-mentions of disease and disease-related categories [81,162].”
Backgroundvan Velsen, L., van Gemert-Pijnen, J. E. W. C., Beaujean, D. J. M. A., Wentzel, J., & van Steenbergen, J. E. (2012) · Journal of Medical Internet Research · doi:10.2196/jmir.2123 · Cited by 53 · cited 1×
“The summary of the review results according to the data extraction guidelines is presented in Multimedia Appendix 1 [34-188].”
MethodA search for hope and understanding: an analysis of threatened miscarriage internet forums
Betts, D., Dahlen, H. G., & Smith, C. A. (2014) · Midwifery · doi:10.1016/j.midw.2013.12.011 · Cited by 28
Cited by
How to Fight an Infodemic: The Four Pillars of Infodemic Management
Eysenbach, G. (2020) · Journal of Medical Internet Research · doi:10.2196/21820 · Cited by 551
Higgins, T. S., Wu, A. W., Sharma, D., Illing, E. A., Rubel, K., Ting, J. Y., & Snot Force Alliance (2020) · JMIR Public Health and Surveillance · doi:10.2196/19702 · Cited by 129
Radwan, E., Radwan, A., & Radwan, W. (2020) · Heliyon · doi:10.1016/j.heliyon.2020.e05807 · Cited by 111
“The internet was and still used to collect data in research health regarding the people's practices during the outbreak of health diseases such as hand washing and sterilizing, using disinfectants, wearing face masks, and social distancing [16, 17, 18].”
Arillotta, D., Floresta, G., Guirguis, A., Corkery, J. M., Catalani, V., Martinotti, G., Sensi, S. L., & Schifano, F. (2023) · Brain Sciences · doi:10.3390/brainsci13111503 · Cited by 104
Romeiser, J. L., Jusko, N., & Williams, A. A. (2024) · Journal of Medical Internet Research · doi:10.2196/49928 · Cited by 6
Metadata
- Authors
- Barros, J. M., Duggan, J., & Rebholz-Schuhmann, D.
- Venue
- Journal of Medical Internet Research
- Publisher
- JMIR Publications Inc.
- Published
- 2020-03-13
- Volume
- 22
- Issue
- 3
- Pages
- e13680
- ISSN
- 1438-8871 (ISSN-L)
- OpenAlex
- W2991527047
- Cited by
- 111
- References
- 9
- FWCI
- 2.78
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.