Chatbots in the fight against the COVID-19 pandemic
Open accessThe DOI matches its Crossref record; 23 of the 23 references it cites were found in a registry or an index; 17 of the 51 sources its claims cite were checked for support.
Abstract
During the novel coronavirus (COVID-19) pandemic, institutions like the Centers for Disease Control and Prevention (CDC) and the World Health Organization (WHO) have begun utilizing chatbots to share information, suggest behavior, and offer emotional support 1 , 2 . The CDC has named theirs “Clara” (Fig. 1 ). Chatbots are software programs that talk with people through voice or text in their natural language 3 , 4 . Some well-known examples include “Alexa” from Amazon, “Siri” from Apple, and “Cortana” from Microsoft. They often come pre-installed on smartphones or home-based smart speakers 5 . In recent years, chatbot use for health-related purposes has increased considerably, from supporting clinicians with clinical interviews and diagnosis to aiding consumers in self-managing chronic conditions 6 . While promising, the use of chatbots may pose safety risks. Chatbots have varied widely in their responses to questions about physical health, suicide, intimate partner violence, substance abuse, and other sensitive conversations 4 , 6 , 7 , 8 , 9 . In one study, about a third (29%) of chatbot responses to health questions could have caused harm, and about half of those (16%) could have resulted in death if acted upon 9 . The COVID-19 pandemic puts in stark relief the potential for chatbots to help save lives.
Overview
CoChat Summary
TL;DR
Chatbots, if effectively designed and deployed, could help fight the COVID-19 pandemic by disseminating up-to-date information, encouraging health-protective behaviors, and mitigating the psychological harm of fear and isolation. However, the risk of amplifying misinformation and the lack of prior effectiveness research in pandemic contexts are serious concerns requiring immediate collaboration among healthcare workers, companies, academics, and governments.
Key findings
This is a perspective/commentary piece, not an empirical study, so it reports no original data; its claims are supported by cited literature.
- Chatbots may be uniquely suited to pandemic response across four functions: information dissemination, symptom monitoring, behavior change support, and mental health support.
- Prior research cited suggests people are more willing to disclose sensitive personal symptom information to a chatbot than to a human, which could improve triage and population-level infection estimates.
- Safety concerns are documented from prior work: in one cited study, about a third (29%) of chatbot responses to health questions could have caused harm, and about half of those (16%) could have resulted in death if acted upon.
- Cited evidence on pandemic mental health harm: the 2003 SARS outbreak produced a "mental health catastrophe" in which 59% of a hospitalized cohort developed a diagnosable psychiatric disorder, and after 30 months less than half had psychologically recovered.
Methods
Not stated in the paper (no empirical design, sample, or analysis); this is a narrative perspective article synthesizing cited literature and current chatbot deployments.
- Draws on cited studies of chatbot health responses, disclosure behavior, and pandemic psychology, plus examples of deployed COVID-19 chatbots (CDC's "Clara," WHO's WhatsApp health alert, and corporate/government chatbots).
- Organizes the argument around pandemic challenges, special features of pandemics, four chatbot affordances, and corresponding challenges.
Limitations
Stated by the paper: chatbots are untested in pandemics and have demonstrated limits in health crisis detection and response; long-term mental health outcomes of chatbot use are unclear and worthy of future investigation; challenges addressed only in real time during a crisis may lead to erroneous outputs from lack of testing; developers must decide whose voice to amplify amid conflicting global/local advice; third-party "skills" raise data-sharing concerns with unknown consequences; symptom screening tests constitutional and regulatory boundaries (e.g., reported digital contact tracing exploration in the US and Israel).
- Evident from the text: the article presents no original data or evaluation, so its claims about chatbot effectiveness rest on extrapolation from non-pandemic contexts and cited prior work.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Figures
Verification
Claims the paper makes
8 Valid · 0 Not valid · 24 Not checked · 15 Own results and interpretations
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“Fourth, infection countermeasures (e.g., social distancing and quarantine) are psychologically damaging13.”
§ Chatbots in the fight against the COVID-19 pandemic > Challenges posed by pandemics
What the sources say
- Partly supportedcites [13] Brooks, S. K. et al. The psychological impact of quarantine and how to reduce it: rapid review of the evidence. Lancet 395, 912–920 (2020). sourceExperimental — accuracy not yet measured
The review’s Conclusion says the psychological impact of quarantine can be substantial and long-lasting, supporting the quarantine part of the claim. But “What we do not know” treats social distancing as a separate measure whose relative effects need further research; the review does not establish that social distancing is psychologically damaging. (LLM, conf=0.88)
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Partly supported
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“Chatbots have varied widely in their responses to questions about physical health, suicide, intimate partner violence, substance abuse, and other sensitive conversations4,6–9.”
§ Chatbots in the fight against the COVID-19 pandemic > Introduction
What the sources say
- Partly supportedcites [4] Miner, A. S. et al. Smartphone-based conversational agents and responses to questions about mental health, interpersonal violence, and physical health. JAMA Intern. Med. 176, 619–625 (2016). sourceExperimental — accuracy not yet measured
The Results and Discussion report inconsistent responses to questions about physical health, suicide, and intimate partner violence. The Methods describe nine questions across mental health, interpersonal violence, and physical health, but our copy does not report testing responses to substance-abuse questions; that part of the claim is unsupported. (LLM, conf=0.88)
- Partly supportedcites [6] Laranjo, L. et al. Conversational agents in healthcare: a systematic review. J. Am. Med. Inform. Assoc. 25, 1248–1258 (2018). sourceExperimental — accuracy not yet measured
The Results (Evaluation measures; page unavailable) mention inappropriate responses to suicide statements. The Discussion (Implications for healthcare, public health, and future research; page unavailable) reports that smartphone conversational agents often failed to recognize or respond appropriately to serious health concerns. Our copy does not establish that responses varied widely across the specific topics of intimate partner violence and substance abuse. (LLM, conf=0.83)
- Supportedcites [7] Nobles, A. L. et al. Responses to addiction help-seeking from Alexa, Siri, Google Assistant, Cortana, and Bixby intelligent virtual assistants. NPJ Digit. Med. 3, 11 (2020). source
The Results and Discussion report varied responses from five virtual assistants to substance-use help-seeking queries: most produced no singular response, while a few offered an app, a retailer, or a definition. This supports the substance-abuse portion of the sentence; the other topics are covered by the sentence’s other citations. (LLM, conf=0.91)
- Supportedcites [8] Kocaballi, A. B. et al. Responses of conversational agents to health and lifestyle prompts: investigation of appropriateness and presentation structures. J. Med. Internet Res. 22, e15823 (2020). source
The Methods (Pilot Study; page unavailable) list prompts about suicide, partner assault, physical symptoms, drinking, and smoking. The Results (Appropriate Responses; page unavailable) and Discussion (Comparison With Prior Work; page unavailable) describe differing response rates and inconsistent answers across agents, platforms, and prompts, supporting the claim that responses varied across these sensitive topics. (LLM, conf=0.90)
- Supportedcites [9] Bickmore, T. W. et al. Patient and consumer safety risks when using conversational assistants for medical information: an observational study of Siri, Alexa, and Google assistant. J. Med. Internet Res. 20, e11510 (2018). source
The Results section (“Differences by Conversational Assistants”; page unavailable) reports substantially different task-failure rates for Alexa, Siri, and Google Assistant when users sought medical information. This supports the physical-health portion of the sentence for which this paper is one of several citations. (LLM, conf=0.90)
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Partly supported
Every source the paper cites for this claim was checked and supports it.
In the paper
“Although global and national health bodies highlight the importance of mental health in a pandemic, COVID-19 mental health needs have reportedly been under-addressed24.”
§ Chatbots in the fight against the COVID-19 pandemic > Special features of pandemics > Mental health support
What the sources say
- Supportedcites [24] Xiang, Y. T. et al. Timely mental health care for the 2019 novel coronavirus outbreak is urgently needed. Lancet Psychiatry 7, 228–229 (2020). source
The paper explicitly states that mental health care for patients and health professionals directly affected by the 2019-nCoV epidemic had been under-addressed, despite a Chinese national notification on psychological crisis intervention. This supports the cited claim about under-addressed COVID-19 mental health needs in the outbreak context the paper discusses. (LLM, conf=0.94)
hedged- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Supported
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“With more than a billion voice searches per month, any health-related mistakes, such as misidentifying key symptoms, would be amplified with extensive harmful repercussions4,9.”
§ Chatbots in the fight against the COVID-19 pandemic > Challenges
What the sources say
- Partly supportedcites [4] Miner, A. S. et al. Smartphone-based conversational agents and responses to questions about mental health, interpersonal violence, and physical health. JAMA Intern. Med. 176, 619–625 (2016). sourceExperimental — accuracy not yet measured
The Results and Discussion (page unavailable) document failures to recognize health concerns and distinguish their seriousness. The paper does not report more than a billion voice searches per month or establish that such errors would be amplified with extensive harmful repercussions. (LLM, conf=0.85)
- Partly supportedcites [9] Bickmore, T. W. et al. Patient and consumer safety risks when using conversational assistants for medical information: an observational study of Siri, Alexa, and Google assistant. J. Med. Internet Res. 20, e11510 (2018). sourceExperimental — accuracy not yet measured
The Introduction (Background; page unavailable) reports over a billion voice searches per month and warns that incorrect medical information could cause harm if users act on it. The Discussion (Principal Findings; page unavailable) reports simulated outcomes that could have caused harm or death. The paper does not show that errors are amplified across those searches or establish the extensive real-world repercussions asserted in the claim. (LLM, conf=0.84)
hedgedstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Partly supported
Every source the paper cites for this claim was checked and supports it.
In the paper
“Simply disclosing concerns and receiving emotionally supportive responses can have positive value in some contexts25.”
§ Chatbots in the fight against the COVID-19 pandemic > Special features of pandemics > Mental health support
What the sources say
- Supportedcites [25] Ho, A., Hancock, J. & Miner, A. S. Psychological, relational, and emotional effects of self-disclosure after conversations with a chatbot. J. Commun. 68, 712–733 (2018). source
Methods (Training and Procedure; page not provided) describe conversations in which participants disclosed emotions and received validating, empathetic responses. Results (Overview; page not provided) report stronger emotional, relational, and psychological benefits after emotional than factual disclosure, supporting the claim's qualified statement that this can have positive value. (LLM, conf=0.92)
plainstates a possible cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Supported
16 more claims
Create a free account to see all 47 claims and to verify the 34 references still open.
- Probably not a substantial claim. 15
- It may state two separate claims as one. 14
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Chatbots and other artificial intelligence (AI) systems have become increasingly popular in recent years for providing information and assistance to users in online spaces (3)”
From Using ChatGPT to evaluate cancer myths and misconceptions: artificial intelligence and cancer information (2023) · cites this paper as [3]
Citations
Cites
The Psychological Impact of Quarantine and How to Reduce It: Rapid Review of the Evidence
Brooks, S. K., Webster, R. K., Smith, L. E., Woodland, L., Wessely, S., Greenberg, N., & Rubin, G. J. (2020) · doi:10.2139/ssrn.3532534 · Cited by 16,394
The psychological impact of quarantine and how to reduce it: Rapid review of the evidence
Brooks, S. K., Webster, R. K., Smith, L. E., Woodland, L., Wessely, S., Greenberg, N., & Rubin, G. J. (2020) · The Lancet · doi:10.1016/s0140-6736(20)30460-8 · Cited by 16,378
The spread of true and false news online
Vosoughi, S., Roy, D., & Aral, S. (2018) · Science · doi:10.1126/science.aap9559 · Cited by 8,847
Timely mental health care for the 2019 novel coronavirus outbreak is urgently needed
Xiang, Y.-T., Yang, Y., Li, W., Zhang, L., Zhang, Q., Cheung, T., & Ng, C. H. (2020) · The Lancet Psychiatry · doi:10.1016/s2215-0366(20)30046-8 · Cited by 3,598
Report of the WHO-China Joint Mission on Coronavirus Disease 2019 (COVID-19)
Gomes, C. A. (2020) · LA Referencia (Red Federada de Repositorios Institucionales de Publicaciones Científicas) · Cited by 2,134
Conversational agents in healthcare: a systematic review
Laranjo, L., Dunn, A. G., Tong, H. L., Kocaballi, A. B., Chen, J., Bashir, R., Surian, D., Gallego, B., Magrabi, F., Lau, A. Y. S., et al. (2018) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocy072 · Cited by 1,388
Self-citationChatbots and Conversational Agents in Mental Health: A Review of the Psychiatric Landscape
Vaidyam, A. N., Wisniewski, H., Halamka, J. D., Kashavan, M. S., & Torous, J. B. (2019) · The Canadian Journal of Psychiatry · doi:10.1177/0706743719828977 · Cited by 1,048
Long-term psychiatric morbidities among SARS survivors
Mak, I. W. C., Chu, C. M., Pan, P. C., Yiu, M. G. C., & Chan, V. L. (2009) · General Hospital Psychiatry · doi:10.1016/j.genhosppsych.2009.03.001 · Cited by 1,018
It's only a computer: virtual humans increase willingness to disclose
Lucas, G. M., Gratch, J., King, A., & Morency, L.-P. (2014) · Computers in Human Behavior · doi:10.1016/j.chb.2014.04.043 · Cited by 977
Ho, A., Hancock, J., & Miner, A. S. (2018) · Journal of Communication · doi:10.1093/joc/jqy026 · Cited by 629
Self-citation
Cited by
Xu, L., Sanders, L., Li, K., & Chow, J. C. L. (2021) · JMIR Cancer · doi:10.2196/27850 · Cited by 571
“They have the potential to prevent misinformation, detect symptoms, and lessen the mental health burden during global pandemics [111].”
Zhang, J., Oh, Y. J., Lange, P., Yu, Z., & Fukuoka, Y. (2020) · Journal of Medical Internet Research · doi:10.2196/22845 · Cited by 363
“For instance, in April 2020, the World Health Organization launched a chatbot on Facebook Messenger to combat misinformation and to offer instant and accurate information about COVID-19 [21].”
BackgroundMenon, D., & Shilpa, K. (2023) · Heliyon · doi:10.1016/j.heliyon.2023.e20962 · Cited by 359
Johnson, S. B., King, A. J., Warner, E. L., Aneja, S., Kann, B. H., & Bylund, C. L. (2023) · JNCI Cancer Spectrum · doi:10.1093/jncics/pkad015 · Cited by 289
Oh, Y. J., Zhang, J., Fang, M.-L., & Fukuoka, Y. (2021) · International Journal of Behavioral Nutrition and Physical Activity · doi:10.1186/s12966-021-01224-6 · Cited by 278
Metadata
- Authors
- Miner, A. S., Laranjo, L., & Kocaballi, A. B.
- Affiliations
- Stanford University (US)
- Macquarie University (AU)
- University of Technology Sydney (AU)
- Corresponding author
- Miner, Adam S.
- Venue
- npj Digital Medicine
- Published
- 2020-05-04
- Volume
- 3
- Issue
- 1
- Pages
- 65-65
- ISSN
- 2398-6352 (ISSN-L)
- PMC
- PMC7198587
- OpenAlex
- W3021999948
- Semantic Scholar
- 13499e956aa73121806315a6bf0a1e1067b1667f
- Cited by
- 322
- References
- 22
- Citations by year
- 2026: 26 · 2025: 28 · 2024: 38 · 2023: 47 · 2022: 79 · 2021: 82 · 2020: 22
- FWCI
- 16.92
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- cc-by
- creativecommons.org/licenses/by/4.0 (tdm)
- creativecommons.org/licenses/by/4.0 (vor)
- Locations
- npj Digital Medicine (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- UTS ePRESS (University of Technology Sydney) (submittedVersion, other-oa)
- Funders
- National Institutes of Health (KL2TR001083, UL1TR001085, UL1TR003142, KL2TR003143)
- National Center for Advancing Translational Sciences
- Topics
- Health Sciences › Medicine › Health Informatics › Artificial Intelligence in Healthcare and Education
- Social Sciences › Psychology › Applied Psychology › Digital Mental Health Interventions
- Health Sciences › Health Professions › General Health Professions › Mobile Health and mHealth Applications
- Keywords
- chatbots, COVID-19 pandemic, health data sharing, emotional support, chatbot safety, suicide prevention, intimate partner violence, substance abuse, clinical decision support
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
The claim verdicts this report counts are experimental: their accuracy is not yet measured.
A language model drew the claims from the paper on 2026-10-05, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-10-05 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Cited sources are checked with a language model’s help (gpt-6-sol).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Chatbots in the fight against the COVID-19 pandemic. https://app.cochat.ai/papers/10.1038/s41746-020-0280-0
- The paper
- Miner, A. S., Laranjo, L., & Kocaballi, A. B. (2020). Chatbots in the fight against the COVID-19 pandemic. npj Digital Medicine. https://doi.org/10.1038/s41746-020-0280-0
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.
