The DOI matches its Crossref record; 2 of the 2 references it cites were found in a registry or an index.
Just ask Siri? A pilot study comparing smartphone digital assistants and laptop Google searches for smoking cessation advice
Open accessAbstract
OBJECTIVE: To compare voice-activated internet searches by smartphone (two digital assistants) with laptop ones for information and advice related to smoking cessation. DESIGN: Responses to 80 questions on a range of topics related to smoking cessation (including the FAQ from a NHS website), compared for quality. SETTING: Smartphone and internet searches as performed in New Zealand. MAIN OUTCOME MEASURES: Ranked responses to the questions. RESULTS: Google laptop internet searches came first (or first equal) for best quality smoking cessation advice for 83% (66/80) of the responses. Voiced questions to Google Assistant ("OK Google") came first/first equal 76% of the time vs Siri (Apple) at 28%. Google and Google Assistant were statistically significantly better than Siri searches (odds ratio 12.4 and 8.5 respectively, p<0.0001 in each comparison). When asked FAQs from the National Health Service website, or to find information the Centers for Disease Control has made videos on, the best search results used expert sources 59% (31/52) of the time, "some expertise" (eg, Wikipedia) 18% of the time, but also magazines and other low quality sources 19% of the time. Using all three methods failed to find relevant information 8% (6/80) of the time, with Siri having the most failed responses (53% of the time). CONCLUSION: Google internet searches and Google Assistant were found to be significantly superior to the Siri digital assistant for smoking cessation information. While expert content was returned over half the time, there is still substantial room for improvement in how these software systems deliver smoking cessation advice.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source doesn’t support the claim as written.
In the citing paper
“A total of 4 papers [61,66,68,70] did not explicitly specify the study design they used, whereas the other papers provided labels.”
From Voice-Based Conversational Agents for the Prevention and Management of Chronic and Mental Health Conditions: Systematic Literature Review (2021) · cites this paper as [61]
Checked by a reasoning model — may be wrong.
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“One study [61] observed that the standard Google Search performs better than a voice-activated internet search performed with Google Assistant and Apple Siri.”
From Voice-Based Conversational Agents for the Prevention and Management of Chronic and Mental Health Conditions: Systematic Literature Review (2021) · cites this paper as [61]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“A total of 2 studies [61,70] qualitatively assessed the accuracy of the VCAs.”
From Voice-Based Conversational Agents for the Prevention and Management of Chronic and Mental Health Conditions: Systematic Literature Review (2021) · cites this paper as [61]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Half (n=6) of the included studies [61,63,64,68-70] evaluated the accuracy of the system.”
From Voice-Based Conversational Agents for the Prevention and Management of Chronic and Mental Health Conditions: Systematic Literature Review (2021) · cites this paper as [61]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“The majority of the included studies (n=8) also did not report controlling for participants’ previous experience with technology [59-63,66,69,70].”
From Voice-Based Conversational Agents for the Prevention and Management of Chronic and Mental Health Conditions: Systematic Literature Review (2021) · cites this paper as [61]
Experimental — accuracy not yet measured
15 more claims about this paper
Create a free account to see every claim other papers make about this one.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Miner, A. S., Milstein, A., Schueller, S., Hegde, R., Mangurian, C., & Linos, E. (2016) · JAMA Internal Medicine · doi:10.1001/jamainternmed.2016.0400 · Cited by 368
Higgins, O., Sixsmith, J., Barry, M. M., & Domegan, C. T. (2011) · Arrow@dit (Dublin Institute of Technology) · doi:10.2900/5788 · Cited by 129
Cited by
Bérubé, C., Schachner, T., Keller, R., Fleisch, E., v Wangenheim, F., Barata, F., & Kowatsch, T. (2021) · Journal of Medical Internet Research · doi:10.2196/25933 · Cited by 133
“Half of the studies (n=6) did not report on any system measures [59,60,62,65-67], whereas the other half reported either speech recognition performance measures (n=4) [63,64,68,69] or criterion-based evaluation of the goodness of the VCA’s response (n=2) [61,70].”
InfluentialKocaballi, A. B., Quiroz, J. C., Rezazadegan, D., Berkovsky, S., Magrabi, F., Coiera, E., & Laranjo, L. (2020) · Journal of Medical Internet Research · doi:10.2196/15823 · Cited by 73
Sezgin, E., Militello, L. K., Huang, Y., & Lin, S. (2020) · Translational Behavioral Medicine · doi:10.1093/tbm/ibz141 · Cited by 83
Nobles, A. L., Leas, E. C., Caputi, T. L., Zhu, S.-H., Strathdee, S. A., & Ayers, J. W. (2020) · npj Digital Medicine · doi:10.1038/s41746-019-0215-9 · Cited by 67
Palanica, A., Thommandram, A., Lee, A., Li, M., & Fossat, Y. (2019) · npj Digital Medicine · doi:10.1038/s41746-019-0133-x · Cited by 63
Metadata
- Authors
- Boyd, M., & Wilson, N.
- Affiliations
- University of Otago (NZ)
- Corresponding author
- Boyd, Matt
- Venue
- PLOS ONE
- Publisher
- Public Library of Science (PLoS)
- Published
- 2018-03-28
- Volume
- 13
- Issue
- 3
- Pages
- e0194811
- ISSN
- 1932-6203 (ISSN-L)
- PMC
- PMC5874038
- OpenAlex
- W2794532037
- Cited by
- 40
- References
- 2
- Citations by year
- 2023: 6 · 2022: 6 · 2021: 10 · 2020: 7 · 2019: 9 · 2018: 2
- FWCI
- 11.27
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- Locations
- PLoS ONE (publishedVersion, cc-by)
- Europe PMC (PubMed Central) (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- RePEc: Research Papers in Economics (submittedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion)
- Topics
- Physical Sciences › Computer Science › Information Systems › Information Retrieval and Search Behavior
- Health Sciences › Medicine › Public Health, Environmental and Occupational Health › Smoking Behavior and Cessation
- Health Sciences › Health Professions › General Health Professions › Health Literacy and Information Accessibility
- Keywords
- smoking cessation, virtual assistants, Google Assistant, Siri, health information quality, search result quality, expert sources, health information seeking
- MeSH terms
- Smartphone, Humans, New Zealand, Pilot Projects, Therapy, Computer-Assisted, Smoking Cessation, Internet, Information Seeking Behavior
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Just ask Siri? A pilot study comparing smartphone digital assistants and laptop Google searches for smoking cessation advice. https://app.cochat.ai/papers/10.1371/journal.pone.0194811
- The paper
- Boyd, M., & Wilson, N. (2018). Just ask Siri? A pilot study comparing smartphone digital assistants and laptop Google searches for smoking cessation advice. PLOS ONE. https://doi.org/10.1371/journal.pone.0194811
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.