Evaluating expert opinions on using a virtual patient app based on artificial intelligence for teaching brief smoking cessation advice to medical students: a cross-sectional study
Open accessThe DOI matches its Crossref record; 18 of the 18 references it cites were found in a registry or an index; 1 of the 10 sources its claims cite were checked for support.
Abstract
BACKGROUND: Smoking is one of the main preventable causes of premature disease and death. Anti-smoking counseling continues to be a challenge to cover the educational gap in this topic. Artificial intelligence and virtual-patient technologies are a promising next step in this evolving context, allowing for realistic, adaptive, and standardized simulations of clinical counseling scenarios. The objective of this study was to evaluate the perceptions and acceptance of a Generative Artificial Intelligence-based Virtual Patient Application for training medical students in brief smoking-cessation counseling among respiratory medicine professionals in Romania. METHODS: A cross-sectional survey, primarily descriptive, with additional analytical components to explore associations between key variables was conducted between May and October 2025 among respiratory medicine professionals in Romania. A structured, validated electronic questionnaire assessed perceived usefulness, feasibility, preferred counseling models, interface design, and expected educational and public health benefits of the GenAI-ViP application. Descriptive statistics summarized participant responses, while inferential analyses included Mann-Whitney U, Kruskal-Wallis, Chi-square tests, Spearman correlations, and binary logistic regression to identify predictors of perceived usefulness. Statistical significance was defined as p < 0.05. RESULTS: A total of 147 clinicians were included, most of whom were pulmonologists (89.1%), and digital engagement was high (95.3% reporting regular use of medical applications). Most respondents rated the application as useful (81.6% Likert scores 4-5) and reported high receptiveness (91.1% Likert scores 4-5). The preferred interface included multimodal interaction with voice and video (65.3%). The 5 A counseling model was identified as the most relevant framework (80.3%), followed by motivational interviewing (37.4%). Significant predictors of perceived usefulness included higher perceived student receptiveness (OR 2.535, 95% CI 1.416-4.539, p = 0.002), while clinicians without prior smoking cessation program involvement reported greater perceived usefulness (OR 0.266, 95% CI 0.087-0.815, p = 0.020). CONCLUSIONS: The Generative Artificial Intelligence-based Virtual Patient Application for smoking cessation training was highly accepted and perceived to be useful by respiratory medicine professionals and could address existing gaps in tobacco counseling education. Integration of such tools into undergraduate and postgraduate medical curricula could enhance smoking cessation competencies and support broader tobacco control strategies.
Overview
CoChat Summary
## TL;DR
This cross-sectional survey of 147 Romanian respiratory medicine professionals found high acceptance and perceived usefulness of a generative-AI virtual patient app (GenAI-ViP) for teaching brief smoking cessation counseling to medical students. The strongest support came from clinicians without prior involvement in the national Stop Smoking program and from regular users of digital medical tools.
## Key findings
- Among 147 respondents, 95.3% reported using digital medical apps at least weekly, and digital tools were rated as easy to use with a median score of 1 (IQR = 2) on a 1–5 Likert scale.
- Perceived usefulness was very high: the paper reports a mean of 4.4 and median of 5/5 for the application.
- The majority (53.7%) believed 5–10 clinical scenarios would be sufficient for training coverage.
- In the logistic regression model, prior involvement in the national Stop Smoking program was associated with lower odds of rating the app as useful/very useful (OR = 0.257; p = 0.019), while student receptivity was a strong predictor (p = 0.001).
- The regression model was statistically significant overall (likelihood ratio χ²[6] = 16.479, p = 0.011), with McFadden pseudo R² = 0.118, AUC = 0.709, and Brier score = 0.129.
## Methods
- Cross-sectional, primarily descriptive survey with analytical components, conducted in Romania from May to October 2025 among respiratory medicine professionals; the sample was a convenience/voluntary response sample.
- 147 valid questionnaires were analyzed; respondents were mainly pulmonologists, but also included internal medicine doctors and other clinicians involved in smoking cessation counseling or medical education.
- Data were collected via an electronic questionnaire with pre-established answers; analysis used descriptive statistics, group comparisons, correlation tests, categorical tests, and binary logistic regression to identify predictors of perceived usefulness.
## Limitations
- The paper states that the study was cross-sectional and self-reported, which limits causal interpretation.
- The sample was voluntary, convenience-based, and not probability-based; the authors say it is not fully representative of the Romanian respiratory medicine community.
- The questionnaire had no formal psychometric testing beyond content validation, so its predictive ability is uncertain and the instrument should be treated as exploratory.
- The low response rate (~15%) introduces possible selection and non-response bias; the paper also notes the modest sample size may have reduced the stability and precision of multivariable estimates.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
0 Valid · 0 Not valid · 5 Not checked · 56 Own results and interpretations
None of the sources cited for this claim have been checked yet.
In the paper
“previous systematic reviews showing that computer-based and web-based education are at least as effective as traditional learning in training health professionals to quit smoking [ 12 – 14 ].”
What the sources say
- Not checked yetcites [12] (2025). RStudio: Integrated Development Environment for R. Posit Software, PBC, Posit team, Boston. MA. URL http://www.posit.co/
- Not checked yetcites [13] Marusteri M, Bacarea V. Comparing groups for statistical differences: how to choose the right statistical test? Biochem Med (Zagreb). 2010;20:15–32. source
- Could not verifycites [14] Stamer T, Steinhäuser J, Flägel K. Artificial Intelligence Supporting the Training of Communication Skills in the Education of Health Care Professions: Scoping Review. J Med Internet Res 19 iunie. 2023;25:e43311. sourceExperimental — accuracy not yet measured
Our copy of the Stamer et al. (2023) scoping review contains no passage on smoking or tobacco cessation training; searches for 'quit smoking', 'smoking cessation', 'tobacco' and for 'computer-based/web-based versus traditional learning effectiveness' returned nothing on that topic. The closest material is the Discussion subsection 'Web-Based Consultations', which argues only that virtual patients are a cost-efficient, readily available means to practise rising-demand video consultations, and the Discussion subsection 'Levels of Research Evidence', which states the evidence on AI-/ML-supported communication skills training is relatively low (only 1 RCT identified) — neither addresses the comparative effectiveness of computer- or web-based training for smoking-cessation counselling. The claim therefore cannot be checked against this source. (LLM, conf=0.70)
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper states — it cites no source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“a multimodal interface (video + voice + AI adaptive interaction) was the preferred choice”
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“student receptivity is a strong predictor (p = 0.001)”
boostedstates an association- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Since 90.47% of respondents identified young physicians as the main target group”
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“participants with no prior involvement in the national smoking cessation program perceived the application as significantly more useful compared to experienced peers.”
plainstates an association- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
16 more claims
Create a free account to see all 61 claims and to verify the 9 references still open.
- Probably not a substantial claim. 32
- It may state two separate claims as one. 19
Citations
Cites
The Transtheoretical Model of Health Behavior Change.
Prochaska, J. O., & Velicer, W. F. (1997) · American Journal of Health Promotion · doi:10.4278/0890-1171-12.1.38 · Cited by 7,782 · cited 1×
“The initial pool of items was developed after a literature review on smoking-cessation training, incorporating international frameworks such as the 3 A (Ask–Advise– Act), 5 A (Ask–Advise–Assess–Assist–Arrange), motivational interviewing, and the transtheoretical model [7–10].”
Kononowicz, A. A., Woodham, L. A., Edelbring, S., Stathakarou, N., Davies, D., Saxena, N., Tudor Car, L., Carlstedt-Duke, J., Car, J., & Zary, N. (2019) · Journal of Medical Internet Research · doi:10.2196/14676 · Cited by 600 · cited 1×
“Despite their potential, there is a lack of evidence regarding the perceptions and acceptance of these AI-based educational tools among health professionals, particularly in Central and Eastern Europe [6].”
Smedberg, J., Lupattelli, A., Mårdby, A.-C., & Nordeng, H. (2014) · BMC Pregnancy and Childbirth · doi:10.1186/1471-2393-14-213 · Cited by 192 · cited 1×
“In Eastern Europe, the transition from the communist system to the capitalist economy was associated with a significant increase in the prevalence of smoking, especially in females [1, 2].”
Comparing groups for statistical differences: how to choose the right statistical test?
Marusteri, M., & Bacarea, V. (2010) · Biochemia Medica · doi:10.11613/bm.2010.004 · Cited by 184 · cited 1×
“Additionally, binary logistic regression was conducted to identify independent predictors of perceived usefulness, with results presented as odds ratios (OR) and 95% Confidence Intervals (CI); a p-value < 0.05 was considered statistically significant [13].”
InfluentialSelf-citationDigital Education in Health Professions: The Need for Overarching Evidence Synthesis
Car, J., Carlstedt-Duke, J., Tudor Car, L., Posadzki, P., Whiting, P., Zary, N., Atun, R., Majeed, A., Campbell, J., & Digital Health Education Collaboration (2019) · Journal of Medical Internet Research · doi:10.2196/12913 · Cited by 166 · cited 2×
“Prior research has shown that perceived usefulness and digital literacy [14], rather than academic affiliation, are the main determinants of adoption of digital educational tools in health professions training [15].”
Stamer, T., Steinhäuser, J., & Flägel, K. (2023) · Journal of Medical Internet Research · doi:10.2196/43311 · Cited by 160 · cited 3×
“Participants in our study, as in earlier reports, believed that enhanced artificial intelligence virtual scenarios were realistic, accessible, and effective for improving communication and motivational inter-viewing skills [14–17].”
Opinions and practices regarding electronic cigarette use among Romanian high school students
Lotrean, L. M., Varga, B., Popa, M., Radu-Loghin, C., Man, M. A., & Trofor, A. C. (2016) · Gaceta Sanitaria · doi:10.1016/j.gaceta.2016.05.001 · Cited by 129 · cited 1×
“In Eastern Europe, the transition from the communist system to the capitalist economy was associated with a significant increase in the prevalence of smoking, especially in females [1, 2].”
Smoking cessation for free: outcomes of a study of three Romanian clinics
Trofor, A. C., Man, M. A., Mărginean, C., et al. (2016) · Open Medicine · doi:10.1515/med-2016-0098 · Cited by 127 · cited 1×
“[20] and the rest of Europe [21] had as their main focus the effectiveness and benefits of public health, more than the educational component.”
Development of an Instrument to Document the 5A's for Smoking Cessation
Lawson, P. J., Flocke, S. A., & Casucci, B. A. (2009) · American Journal of Preventive Medicine · doi:10.1016/j.amepre.2009.04.027 · Cited by 79
Steenstra, I., Nouraei, F., & Bickmore, T. (2025) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3706598.3714014 · Cited by 61
Research works printed but not linked: 2
- Papadakis S, Anastasaki M, Papadakaki M, Antonopoulou Μ, Chliveros C, Daskalaki C, et al. Very brief advice’ (VBA) on smoking in family practice: a qualitative evaluation of the tobacco user’s perspective. BMC Fam Pract decembrie. 2020;21(1):1–11.
- Narayanan S, Ramakrishnan R, Durairaj E, Das A. Artificial Intelligence Revolutionizing the Field of Medical Education. Cureus noiembrie. 2023;15(11):e49604.
Cited by
Kim, J., Noh, Y., & Jang, J. (2026) · Applied Sciences · doi:10.3390/app16125971 · Cited by 2
Metadata
- Authors
- Budin, E.-C., Stoica-Buracinschi, F., Ianoși, E. S., Mărușteri, M.-Ș., Iantovics, L. B., & Nădășan, V.
- Affiliations
- Universitatea de Medicină, Farmacie, Științe și Tehnologie „George Emil Palade” din Târgu Mureș (RO)
- Corresponding author
- Stoica-Buracinschi, Florin
- Venue
- BMC Medical Education
- Published
- 2026-05-18
- Volume
- 26
- Issue
- 1
- ISSN
- 1472-6920 (ISSN-L)
- OpenAlex
- W7161558316
- Cited by
- 0
- References
- 18
- FWCI
- 0.00
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- cc-by-nc-nd
- creativecommons.org/licenses/by-nc-nd/4.0 (tdm)
- creativecommons.org/licenses/by-nc-nd/4.0 (vor, 53 d)
- Locations
- BMC Medical Education (publishedVersion, cc-by-nc-nd)
- PubMed Central (publishedVersion, cc-by-nc-nd)
- PubMed (publishedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion)
- Funders
- George Emil Palade University of Medicine, Pharmacy, Science, and Technology of Târgu Mureș (795/2/22.01.2025)
- Topics
- Health Sciences › Medicine › Health Informatics › Artificial Intelligence in Healthcare and Education
- Social Sciences › Education › Innovations in Medical Education
- Health Sciences › Medicine › Public Health, Environmental and Occupational Health › Smoking Behavior and Cessation
- Keywords
- smoking cessation counseling, virtual patients, generative AI, medical education, medical students, perceived usefulness, technology acceptance, motivational interviewing, multimodal interfaces, tobacco control, Romania
- MeSH terms
- Generative Artificial Intelligence, Adult, Artificial Intelligence, Attitude of Health Personnel, Counseling, Cross-Sectional Studies, Female, Humans, Male, Surveys and Questionnaires, Romania, Students, Medical, Smoking Cessation, Mobile Applications
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
The claim verdicts this report counts are experimental: their accuracy is not yet measured.
A language model drew the claims from the paper on 2026-10-11, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-10-11 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Cited sources are checked with a language model’s help (qwen3.8-omni-flash).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Evaluating expert opinions on using a virtual patient app based on artificial intelligence for teaching brief smoking cessation advice to medical students: a cross-sectional study. https://app.cochat.ai/papers/10.1186/s12909-026-09435-w
- The paper
- Budin, E.-C., Stoica-Buracinschi, F., Ianoși, E. S., Mărușteri, M.-Ș., Iantovics, L. B., & Nădășan, V. (2026). Evaluating expert opinions on using a virtual patient app based on artificial intelligence for teaching brief smoking cessation advice to medical students: a cross-sectional study. BMC Medical Education. https://doi.org/10.1186/s12909-026-09435-w
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.