The DOI matches its Crossref record; 22 of the 22 references it cites were found in a registry or an index.
HealthMap: Global Infectious Disease Monitoring through Automated Classification and Visualization of Internet Media Reports
Open accessAbstract
OBJECTIVE: Unstructured electronic information sources, such as news reports, are proving to be valuable inputs for public health surveillance. However, staying abreast of current disease outbreaks requires scouring a continually growing number of disparate news sources and alert services, resulting in information overload. Our objective is to address this challenge through the HealthMap.org Web application, an automated system for querying, filtering, integrating and visualizing unstructured reports on disease outbreaks. DESIGN: This report describes the design principles, software architecture and implementation of HealthMap and discusses key challenges and future plans. MEASUREMENTS: We describe the process by which HealthMap collects and integrates outbreak data from a variety of sources, including news media (e.g., Google News), expert-curated accounts (e.g., ProMED Mail), and validated official alerts. Through the use of text processing algorithms, the system classifies alerts by location and disease and then overlays them on an interactive geographic map. We measure the accuracy of the classification algorithms based on the level of human curation necessary to correct misclassifications, and examine geographic coverage. RESULTS: As part of the evaluation of the system, we analyzed 778 reports with HealthMap, representing 87 disease categories and 89 countries. The automated classifier performed with 84% accuracy, demonstrating significant usefulness in managing the large volume of information processed by the system. Accuracy for ProMED alerts is 91% compared to Google News reports at 81%, as ProMED messages follow a more regular structure. CONCLUSION: HealthMap is a useful free and open resource employing text-processing algorithms to identify important disease outbreak information through a user-friendly interface.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
4 What Is Web 2.0? Design Patterns and Business Models for the Next Generation of Software
O’Reilly, T. (2012) · The Social Media Reader · doi:10.18574/nyu/9780814764077.003.0008 · Cited by 5,601
Internet encyclopaedias go head to head
Giles, J. (2005) · Nature · doi:10.1038/438900a · Cited by 1,978 · cited 1×
“29 On the human side, taking inspiration from the highly successful Wikipedia model, 30 we plan to work with networks of experts to evaluate community collaboration as a mechanism for alert acquisition and classification.”
Ajax: A New Approach to Web Applications
Garrett, J. J. (2007) · Cited by 1,029
Structuring computer-mediated communication systems to avoid information overload
Hiltz, S. R., & Turoff, M. (1985) · Communications of the ACM · doi:10.1145/3894.3895 · Cited by 670
Emerging infectious pathogens of wildlife
Dobson, A., & Foufopoulos, J. (2001) · Philosophical Transactions of the Royal Society of London. Series B: Biological Sciences · doi:10.1098/rstb.2001.0900 · Cited by 630
Doyle, R. (2001) · Scientific American · doi:10.1038/scientificamerican0601-28 · Cited by 562
EMERGING AND RESURGING VECTOR-BORNE DISEASES
Gratz, N. G. (1999) · Annual Review of Entomology · doi:10.1146/annurev.ento.44.1.51 · Cited by 409
Chen, H. (1995) · Journal of the American Society for Information Science · doi:10.1002/(sici)1097-4571(199504)46:3<194::aid-asi4>3.0.co;2-s · Cited by 273
ProMED-mail: An Early Warning System for Emerging Diseases
Yu, V. L., & Madoff, L. C. (2004) · Clinical Infectious Diseases · doi:10.1086/422003 · Cited by 267
Hot spots in a wired world: WHO surveillance of emerging and re-emerging infectious diseases
Heymann, D. L., & Rodier, G. R. (2001) · The Lancet Infectious Diseases · doi:10.1016/s1473-3099(01)00148-7 · Cited by 236
Research works printed but not linked: 8
- 1997, Communications of the ACM, 40, 19
- 2006, Science, 314, 1363d, 10.1126/science.314.5804.1363d · doi:10.1126/science.314.5804.1363d
- 2007, The Lancet infectious diseases, 7, 91, 10.1016/S1473-3099(07)70018-X · doi:10.1016/s1473-3099(07)70018-x
- 2004, Communications of the ACM, 47, 47
- 2005, 38, 14
- Stix, 2001, Scientific American, 284, 28, 10.1038/scientificamerican0501-28 · doi:10.1038/scientificamerican0501-28
- 1999, Journal of the American Society for Information Science, 46, 194
- 2001, Journal of the American Society for Information Science, 52, 391, 10.1002/1532-2890(2001)9999:9999<::AID-ASI1083>3.0.CO;2-1 · doi:10.1002/1532-2890(2001)9999:9999<::aid-asi1083>3.0.co;2-1
Cited by
The global distribution and burden of dengue
Bhatt, S., Gething, P. W., Brady, O. J., Messina, J. P., Farlow, A. W., Moyes, C. L., Drake, J. M., Brownstein, J. S., Hoen, A. G., Sankoh, O., et al. (2013) · Nature · doi:10.1038/nature12060 · Cited by 10,037
“The Americas contributed 14% (13 [9-18] million infections) of apparent infections worldwide, of which over half occurred in Brazil and Mexico.”
Self-citationRefining the Global Spatial Limits of Dengue Virus Transmission by Evidence-Based Consensus
Brady, O. J., Gething, P. W., Bhatt, S., Messina, J. P., Brownstein, J. S., Hoen, A. G., Moyes, C. L., Farlow, A. W., Scott, T. W., & Hay, S. I. (2012) · PLoS Neglected Tropical Diseases · doi:10.1371/journal.pntd.0001760 · Cited by 1,864
Self-citationPATRIC, the bacterial bioinformatics database and analysis resource
Wattam, A. R., Abraham, D., Dalay, O., Disz, T. L., Driscoll, T., Gabbard, J. L., Gillespie, J. J., Gough, R., Hix, D., Kenyon, R., et al. (2014) · Nucleic Acids Research · doi:10.1093/nar/gkt1099 · Cited by 1,243
Statistical physics of vaccination
Wang, Z., Bauch, C. T., Bhattacharyya, S., d'Onofrio, A., Manfredi, P., Perc, M., Perra, N., Salathé, M., & Zhao, D. (2016) · Physics Reports · doi:10.1016/j.physrep.2016.10.006 · Cited by 872
Using Internet Searches for Influenza Surveillance
Polgreen, P. M., Chen, Y., Pennock, D. M., & Nelson, F. D. (2008) · Clinical Infectious Diseases · doi:10.1086/593098 · Cited by 566
What is Machine Learning? A Primer for the Epidemiologist
Bi, Q., Goodman, K. E., Kaminsky, J., & Lessler, J. (2019) · American Journal of Epidemiology · doi:10.1093/aje/kwz189 · Cited by 496
Using text mining and sentiment analysis for online forums hotspot detection and forecast
Li, N., & Wu, D. D. (2010) · Decision Support Systems · doi:10.1016/j.dss.2009.09.003 · Cited by 482
Brownstein, J. S., Freifeld, C. C., Reis, B. Y., & Mandl, K. D. (2008) · PLoS Medicine · doi:10.1371/journal.pmed.0050151 · Cited by 403
Self-citationMapping global environmental suitability for Zika virus
Messina, J. P., Kraemer, M. U., Brady, O. J., Pigott, D. M., Shearer, F. M., Weiss, D. J., Golding, N., Ruktanonchai, C. W., Gething, P. W., Cohn, E., et al. (2016) · eLife · doi:10.7554/elife.15272 · Cited by 370
Self-citationHuman Mobility and the Global Spread of Infectious Diseases: A Focus on Air Travel
Findlater, A., & Bogoch, I. I. (2018) · Trends in Parasitology · doi:10.1016/j.pt.2018.07.004 · Cited by 369
New psychoactive substances: challenges for drug surveillance, control, and public health responses
Peacock, A., Bruno, R., Gisev, N., Degenhardt, L., Hall, W., Sedefov, R., White, J., Thomas, K. V., Farrell, M., & Griffiths, P. (2019) · The Lancet · doi:10.1016/s0140-6736(19)32231-7 · Cited by 360
Situating Ecology as a Big-Data Science: Current Advances, Challenges, and Solutions
Farley, S. S., Dawson, A., Goring, S. J., & Williams, J. W. (2018) · BioScience · doi:10.1093/biosci/biy068 · Cited by 331
Public Health Surveillance Systems: Recent Advances in Their Use and Evaluation
Groseclose, S. L., & Buckeridge, D. L. (2017) · Annual Review of Public Health · doi:10.1146/annurev-publhealth-031816-044348 · Cited by 320
Internet-based surveillance systems for monitoring emerging infectious diseases
Milinovich, G. J., Williams, G. M., Clements, A. C. A., & Hu, W. (2014) · The Lancet Infectious Diseases · doi:10.1016/s1473-3099(13)70244-5 · Cited by 306
Global distribution maps of the leishmaniases
Pigott, D. M., Bhatt, S., Golding, N., Duda, K. A., Battle, K. E., Brady, O. J., Messina, J. P., Balard, Y., Bastien, P., Pratlong, F., et al. (2014) · eLife · doi:10.7554/elife.02851 · Cited by 284
Self-citationThe global distribution of Crimean-Congo hemorrhagic fever
Messina, J. P., Pigott, D. M., Golding, N., Duda, K. A., Brownstein, J. S., Weiss, D. J., Gibson, H., Robinson, T. P., Gilbert, M., William Wint, G. R., et al. (2015) · Transactions of The Royal Society of Tropical Medicine and Hygiene · doi:10.1093/trstmh/trv050 · Cited by 278
Self-citationEarly detection of disease outbreaks using the Internet
Wilson, K. R., & Brownstein, J. S. (2009) · Canadian Medical Association Journal · doi:10.1503/cmaj.090215 · Cited by 277
Self-citationDigital Drug Safety Surveillance: Monitoring Pharmaceutical Products in Twitter
Freifeld, C. C., Brownstein, J. S., Menone, C. M., Bao, W., Filice, R., Kass-Hout, T., & Dasgupta, N. (2014) · Drug Safety · doi:10.1007/s40264-014-0155-x · Cited by 267
Self-citationVELASCO, E., AGHENEZA, T., DENECKE, K., KIRCHNER, G., & ECKMANNS, T. (2014) · The Milbank Quarterly · doi:10.1111/1468-0009.12038 · Cited by 256
Global mapping of infectious disease
Hay, S. I., Battle, K. E., Pigott, D. M., Smith, D. L., Moyes, C. L., Bhatt, S., Brownstein, J. S., Collier, N., Myers, M. F., George, D. B., et al. (2013) · Philosophical Transactions of the Royal Society B: Biological Sciences · doi:10.1098/rstb.2012.0250 · Cited by 243
Self-citationZeng, D., Cao, Z., & Neill, D. B. (2021) · Artificial Intelligence in Medicine · doi:10.1016/b978-0-12-821259-2.00022-3 · Cited by 183
Using online social networks to track a pandemic: a systematic review
Al-garadi, M. A., Khan, M. S., Varathan, K. D., Mujtaba, G., & Al-Kabsi, A. M. (2016) · Journal of Biomedical Informatics · doi:10.1016/j.jbi.2016.05.005 · Cited by 166
Choi, J., Cho, Y., Shim, E., & Woo, H. (2016) · BMC Public Health · doi:10.1186/s12889-016-3893-0 · Cited by 140
Smartphone apps in the COVID-19 pandemic
Pandit, J. A., Radin, J. M., Quer, G., & Topol, E. J. (2022) · Nature Biotechnology · doi:10.1038/s41587-022-01350-x · Cited by 101
Volkova, S., Ayton, E., Porterfield, K., & Corley, C. D. (2017) · PLOS ONE · doi:10.1371/journal.pone.0188941 · Cited by 100
Discovering foodborne illness in online restaurant reviews
Effland, T., Lawson, A., Balter, S., Devinney, K., Reddy, V., Waechter, H., Gravano, L., & Hsu, D. (2018) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocx093 · Cited by 55
Artificial Intelligence in Government: Potentials, Challenges, and the Future
Ahn, M. J., & Chen, Y.-C. (2020) · The 21st Annual International Conference on Digital Government Research · doi:10.1145/3396956.3398260 · Cited by 51
Shah, H. A., & Househ, M. (2024) · BMJ Public Health · doi:10.1136/bmjph-2023-000374 · Cited by 7
Metadata
- Authors
- Freifeld, C. C., Mandl, K. D., Reis, B. Y., & Brownstein, J. S.
- Venue
- Journal of the American Medical Informatics Association
- Publisher
- Oxford University Press (OUP)
- Published
- 2008-03-01
- Volume
- 15
- Issue
- 2
- Pages
- 150-157
- ISSN
- 1067-5027 (ISSN-L)
- 1527-974X
- OpenAlex
- W2120467164
- Cited by
- 499
- References
- 22
- FWCI
- 11.31
- Type
- journal article
- Language
- en
- Open access
- bronze
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.