Proactive advising: a machine learning driven approach to vaccine hesitancy
Open accessAbstract
Despite once being nearly eradicated, Measles cases in Europe have surged to a 20-year high with more than 60,000 cases in 2018, due to a dramatic decrease in vaccination rates. The decrease in Measles, Mumps, and Rubella (MMR) vaccination rates can be attributed to an increase in ‘vaccine hesitancy’, or the delay in acceptance or refusal of vaccines despite their availability. Vaccine hesitancy is a relatively new global problem for which effective interventions are not yet established. In this paper, a novel machine learning approach to identify children at risk of not being vaccinated against MMR is proposed, with the objective of facilitating proactive action by healthcare workers and policymakers. A use case of the approach is the provision of individualized informative guidance to families that may otherwise become or are already vaccine hesitant. Using a LASSO logistic regression model trained on 44,000 child Electronic Health Records (EHRs), vaccine hesitant families can be identified with a higher precision (0.72) than predicting vaccine uptake based on a child’s infant vaccination record alone (0.63). The model uses a low number of attributes of the child and his or her family and community to produce a prediction, making it readily interpretable by healthcare professionals. The implementation of the machine learning model into an open source dashboard for use by healthcare providers and policymakers as an Early Warning and Monitoring System (EWS) against vaccine hesitancy is proposed. The EWS would facilitate a wide variety of proactive, anticipatory and therefore potentially more effective public health interventions, compared to reactive interventions taken after vaccine rejections.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The classifiers chosen are representative of the types of models commonly used in ML for public policy systems.
“We chose these classifiers because they are representative of the types of models commonly used in ML for public policy systems [9,12,20,56].”
From It’s Just Not That Simple: An Empirical Study of the Accuracy-Explainability Trade-off in Machine Learning for Public Policy (2022) · cites this paper as [9]
Cites
Vaccine hesitancy: Definition, scope and determinants
MacDonald, N. E. (2015) · Vaccine · doi:10.1016/j.vaccine.2015.04.036 · Cited by 5,573 · see citing works
Effective messages in vaccine promotion: a randomized trial
Nyhan, B., Reifler, J., Richey, S., & Freed, G. L. (2014) · Pediatrics · doi:10.1542/peds.2013-2365 · Cited by 1,300 · see citing works
Vaccination greatly reduces disease, disability, death and inequity worldwide
Fe, A., Booy, R., Bock, H. L., Clemens, J. D., Datta, S., John, T. J., Lee, B. W., Lolekha, S., Peltola, H., Ruff, T., et al. (2008) · Bulletin of the World Health Organization · doi:10.2471/blt.07.040089 · Cited by 1,261 · see citing works
Strategies intended to address vaccine hesitancy: Review of published reviews
Dubé, È., Gagnon, D., & MacDonald, N. E. (2015) · Vaccine · doi:10.1016/j.vaccine.2015.04.041 · Cited by 649 · see citing works
Using behavioral insights to increase vaccination policy effectiveness
Betsch, C., Böhm, R., & Chapman, G. B. (2015) · Policy Insights from the Behavioral and Brain Sciences · doi:10.1177/2372732215600716 · Cited by 378 · see citing works
Effectiveness of Decision Support for Families, Clinicians, or Both on HPV Vaccine Receipt
Fiks, A. G., Grundmeier, R. W., Mayne, S. L., Song, L., Feemster, K. A., Karavite, D., Hughes, C. C., Massey, J., Keren, R., Bell, L. M., et al. (2013) · PEDIATRICS · doi:10.1542/peds.2012-3122 · Cited by 215 · see citing works
The Measles Vaccination Narrative in Twitter: A Quantitative Analysis
Radzikowski, J., Stefanidis, A., Jacobsen, K. H., Croitoru, A., Crooks, A. T., & Delamater, P. L. (2016) · JMIR Public Health and Surveillance · doi:10.2196/publichealth.5059 · Cited by 147 · see citing works
Tangherlini, T. R., Roychowdhury, V., Glenn, B. A., Crespi, C. M., Bandari, R., Wadia, A., Falahi, M., Ebrahimzadeh, E., & Bastani, R. (2016) · JMIR Public Health and Surveillance · doi:10.2196/publichealth.6586 · Cited by 88 · see citing works
Williams, N., Woodward, H. I., Majeed, A., & Saxena, S. K. (2011) · JRSM Short Reports · doi:10.1258/shorts.2011.011112 · Cited by 67 · see citing works
Ward, K., Chow, M. Y. K., King, C. L., & Leask, J. (2012) · Australian and New Zealand Journal of Public Health · doi:10.1111/j.1753-6405.2012.00897.x · Cited by 51 · see citing works
Timely Versus Delayed Early Childhood Vaccination and Seizures
Hambidge, S. J., Newcomer, S. R., Narwaney, K. J., Glanz, J. M., Daley, M. F., Xu, S., Shoup, J. A., Rowhani‐Rahbar, A., Klein, N. P., Lee, G. M., et al. (2014) · PEDIATRICS · doi:10.1542/peds.2013-3429 · Cited by 49 · see citing works
Chandir, S., Siddiqi, D. A., Hussain, O. A., Niazi, T., Shah, M. T., Dharma, V. K., Habib, A., & Khan, A. J. (2018) · JMIR Public Health and Surveillance · doi:10.2196/publichealth.9681 · Cited by 37 · see citing works
Muehleisen, B., Baer, G., Schaad, U. B., et al. (2007) · The Journal of Pediatrics · doi:10.1016/j.jpeds.2007.07.051 · Cited by 25 · see citing works
A Prediction Model of Childhood Immunization Rates
Crouch, E. L., & Dickes, L. (2015) · Applied Health Economics and Health Policy · doi:10.1007/s40258-015-0157-6 · Cited by 20 · see citing works
Flagged first, then by citations
Cited by
Sorted by citations
Bell, A., Solano-Kamaiko, I., Nov, O., & Stoyanovich, J. (2022) · 2022 ACM Conference on Fairness Accountability and Transparency · doi:10.1145/3531146.3533090 · Cited by 103 · see citing works
Self-citation
- Authors
- Bell, A., Rich, A., Teng, M., Orešković, T., Bras, N. B., Mestrinho, L., Golubovic, S., Pristas, I., & Zejnilovic, L.
- Affiliations
- NOVA School of Business and Economics (PT)
- New York University (US)
- CentraleSupélec/ENS Paris-Sacla,Gif-sur-Yvette,France
- IBM (United States) (US)
- Universidade Autónoma de Lisboa,Lisbon,Portugal
- Nova School of Business and Economics,Lisbon,Portugal
- Hrvatski zavod za javno zdravstvo (HR)
- Croatian National Institute of Public Health,Zagreb,Croatia
- Venue
- 2019 IEEE International Conference on Healthcare Informatics (ICHI)
- Publisher
- IEEE
- Published
- 2019-06
- Pages
- 1-6
- OpenAlex
- W2991533154
- Cited by
- 12
- References
- 14
- Citations by year
- 2025: 3 · 2024: 1 · 2023: 3 · 2022: 1 · 2021: 4
- FWCI
- 13.48
- Type
- conference paper
- Language
- en
- Open access
- green
- hdl.handle.net
- Locations
- IEEE International Conference on Healthcare Informatics (ICHI) (publishedVersion)
- Portuguese National Funding Agency for Science, Research and Technology (RCAAP Project by FCT) (submittedVersion, other-oa)
- Topics
- Social Sciences › Health › Vaccine Coverage and Hesitancy
- Health Sciences › Health Professions › Health Information Management › Artificial Intelligence in Healthcare
- Physical Sciences › Computer Science › Artificial Intelligence › Machine Learning in Healthcare
- Keywords
- vaccine hesitancy, measles, MMR vaccination, risk prediction, LASSO logistic regression, electronic health records, early warning systems, model interpretability, childhood immunization, public health interventions, measles resurgence
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review