Medical Instructed Real-Time Assistant for Patient with Glaucoma and Diabetic Conditions
Open accessThe DOI matches its Crossref record; 45 of the 45 references it cites were found in a registry or an index.
Abstract
Virtual assistants are involved in the daily activities of humans such as managing calendars, making appointments, and providing wake-up calls. They provide a conversational service to customers around-the-clock and make their daily life manageable. With this emerging trend, many well-known companies launched their own virtual assistants that manage the daily routine activities of customers. In the healthcare sector, virtual medical assistants also provide a list of relevant diseases linked to a specific symptom. Due to low accuracy and uncertainty, these generated recommendations are untrusted and may lead to hypochondriasis. In this study, we proposed a Medical Instructed Real-time Assistant (MIRA) that listens to the user’s chief complaint and predicts a specific disease. Instead of informing about the medical condition, the user is referred to a nearby appropriate medical specialist. We designed an architecture for MIRA that considers the limitations of existing virtual medical assistants such as weak authentication, lack of understanding multiple intent statements about a specific medical condition, and uncertain diagnosis recommendations. To implement the designed architecture, we collected the chief complaints along with the dialogue corpora of real patients. Then, we manually validated these data under the supervision of medical specialists. We then used these data for natural language understanding, disease identification, and appropriate response generation. For the prototype version of MIRA, we considered the cases of glaucoma (eye disease) and diabetes (an autoimmune disease) only. The performance measure of MIRA was evaluated in terms of accuracy (89%), precision (90%), sensitivity (89.8%), specificity (94.9%), and F-measure (89.8%). The task completion was calculated using Cohen’s Kappa ( k = 0.848 ) that categorizes MIRA as ‘Almost Perfect’. Furthermore, the voice-based authentication identifies the user effectively and prevent against masquerading attack. Simultaneously, the user experience shows relatively good results in all aspects based on the User Experience Questionnaire (UEQ) benchmark data. The experimental results show that MIRA efficiently predicts a disease based on chief complaints and supports the user in decision making.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Among the papers developing and evaluating a VCA, 6 [59,60,62,65-67] assessed the technology acceptance of the VCA, whereas 3 [63,64,68] assessed the system accuracy. Only one [69] assessed both performance and acceptance.”
From Voice-Based Conversational Agents for the Prevention and Management of Chronic and Mental Health Conditions: Systematic Literature Review (2021) · cites this paper as [69]
In the citing paper
“The majority (n=10) of the selected papers developed and evaluated VCA [59,60,62-69], whereas 2 [61,70] aimed to report a criterion-based performance evaluation of existing commercial conversational agents (eg, Google Assistant and Apple Siri).”
From Voice-Based Conversational Agents for the Prevention and Management of Chronic and Mental Health Conditions: Systematic Literature Review (2021) · cites this paper as [69]
In the citing paper
“The majority of the studies (n=10) did not report any behavioral measures [59-63,65-67,69,70], whereas 2 papers [64,68] did.”
From Voice-Based Conversational Agents for the Prevention and Management of Chronic and Mental Health Conditions: Systematic Literature Review (2021) · cites this paper as [69]
In the citing paper
“In total, 4 of those studies [63,64,68,69] described precise speech recognition performance”
From Voice-Based Conversational Agents for the Prevention and Management of Chronic and Mental Health Conditions: Systematic Literature Review (2021) · cites this paper as [69]
In the citing paper
“Of the 12 studies, 7 [59,60,62,65-67,69] reported technology acceptance findings, whereas the others (n=5) did not [61,63,64,68,70].”
From Voice-Based Conversational Agents for the Prevention and Management of Chronic and Mental Health Conditions: Systematic Literature Review (2021) · cites this paper as [69]
29 more claims about this paper
Create a free account to see every claim other papers make about this one.
Citations
Cites
The Measurement of Observer Agreement for Categorical Data
Landis, J. R., & Koch, G. G. (1977) · Biometrics · doi:10.2307/2529310 · Cited by 81,148 · cited 1×
“The interpretation of Kappa categorized MIRA as ‘Almost Perfect’ in term of task completion [57].”
MethodAllocation of Physician Time in Ambulatory Practice: A Time and Motion Study in 4 Specialties
Sinsky, C., Colligan, L., Li, L., Prgomet, M., Reynolds, S., Goeders, L., Westbrook, J., Tutty, M., & Blike, G. (2016) · Annals of Internal Medicine · doi:10.7326/m16-0961 · Cited by 1,494 · cited 1×
“According to a survey conducted in [13], primary care physicians spent more time managing electronic medical records (EMRs) than engaging with patients.”
BackgroundMetalearners for estimating heterogeneous treatment effects using machine learning
Künzel, S. R., Sekhon, J. S., Bickel, P. J., & Yu, B. (2019) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1804597116 · Cited by 1,056 · cited 1×
“In the healthcare sector, the adoption of machine learning facilitated diagnosis [8,9], treatment [10,11], and streamlining of administrative tasks [12].”
BackgroundColor Psychology: Effects of Perceiving Color on Psychological Functioning in Humans
Elliot, A. J., & Maier, M. A. (2014) · Annual Review of Psychology · doi:10.1146/annurev-psych-010213-115035 · Cited by 942 · cited 1×
“We used the color change technique because warm colors have a positive impact on the user’s emotions and behavior as per psychology [55].”
MethodEvaluation of symptom checkers for self diagnosis and triage: audit study
Semigran, H. L., Linder, J. A., Gidengil, C., & Mehrotra, A. (2015) · BMJ · doi:10.1136/bmj.h3480 · Cited by 489 · cited 1×
“Due to the low accuracy and uncertainty of the existing virtual medical assistants, the resulting list of conditions may lead to depression, anxiety, and hypochondriasis [24].”
BackgroundLearning to Respond with Deep Neural Networks for Retrieval-Based Human-Computer Conversation System
Yan, R., Song, Y., & Wu, H. (2016) · Proceedings of the 39th International ACM SIGIR conference on Research and Development in Information Retrieval · doi:10.1145/2911451.2911542 · Cited by 338 · cited 1×
“These virtual assistants provide an interactive user interface (text, speech, or both) that have the ability to understand requests, handle complex tasks, and generate an appropriate response using the machine learning model [7].”
BackgroundReporting Mental Health Symptoms: Breaking Down Barriers to Care with Virtual Human Interviewers
Lucas, G. M., Rizzo, A., Gratch, J., Scherer, S., Stratou, G., Boberg, J., & Morency, L.-P. (2017) · Frontiers in Robotics and AI · doi:10.3389/frobt.2017.00051 · Cited by 308 · cited 1×
“Lucus et al., proposed a virtual human interviewer, which conducts an interview with military service members involved in an intense situation and identifies the symptoms associated with their mental state [33].”
BackgroundBickmore, T. W., Trinh, H., Olafsson, S., O'Leary, T. K., Asadi, R., Rickles, N. M., & Cruz, R. (2018) · Journal of Medical Internet Research · doi:10.2196/11510 · Cited by 308 · cited 1×
“The recommendation is predicted based on one symptom and requires approval from the medical specialist [23].”
BackgroundPARADISE: a framework for evaluating spoken dialogue agents
Walker, M. A., Litman, D. J., Kamm, C., & Abella, A. (1997) · Conference of the European Chapter of the Association for Computational Linguistics · doi:10.3115/979617.979652 · Cited by 270
On the track of Artificial Intelligence: Learning with Intelligent Personal Assistants
Goksel Canbek, N., & Mutlu, M. E. (2016) · International Journal of Human Sciences · doi:10.14687/ijhs.v13i1.3549 · Cited by 213
Research works printed but not linked: 1
- Glass, J. (1999). Challenges for spoken dialogue systems. Proceedings of the 1999 IEEE ASRU Workshop, MIT Laboratory fot Computer Science.
Cited by
Schachner, T., Keller, R., & v Wangenheim, F. (2020) · Journal of Medical Internet Research · doi:10.2196/20701 · Cited by 267
“Other types of chronic conditions included respiratory [51,58], cardiovascular [50], nervous system [56], rheumatic [57], and autoimmune/eye conditions [59].”
BackgroundInfluentialBérubé, C., Schachner, T., Keller, R., Fleisch, E., v Wangenheim, F., Barata, F., & Kowatsch, T. (2021) · Journal of Medical Internet Research · doi:10.2196/25933 · Cited by 133
“In total, 4 of those studies [63,64,68,69] described precise speech recognition performance, whereas 3 [63,68,69] reported good or very good speech recognition performance, and 1 [64] study found mediocre recognition accuracy, with single-letter responses being slightly better recognized than word-based responses (det…”
InfluentialBin Sawad, A., Narayan, B., Alnefaie, A., Maqbool, A., Mckie, I., Smith, J., Yuksel, B., Puthal, D., Prasad, M., & Kocaballi, A. B. (2022) · Sensors · doi:10.3390/s22072625 · Cited by 113
“Two studies were for type 1 [29,39], one study was for type 2 [28], and one focused on diabetes in general, whether the patients have type 1 or 2 [40].”
BackgroundInfluentialApplication of Chatbots to Help Patients Self-Manage Diabetes: Systematic Review and Meta-Analysis
Wu, Y., Zhang, J., Ge, P., Duan, T., Zhou, J., Wu, Y., Zhang, Y.-P., Liu, S., Liu, X., Wan, E., et al. (2024) · Journal of Medical Internet Research · doi:10.2196/60380 · Cited by 84
Review of artificial intelligence‐based question‐answering systems in healthcare
Cilar, L., Gosak, L., & Štiglic, G. (2023) · Wiley Interdisciplinary Reviews Data Mining and Knowledge Discovery · doi:10.1002/widm.1487 · Cited by 86
Metadata
- Authors
- Rehman, U. U., Chang, D. J., Jung, Y., Akhtar, U., Razzaq, M. A., & Lee, S.
- Affiliations
- Kyung Hee University (KR)
- The Catholic University of Korea Yeouido St. Mary's Hospital (KR)
- Corresponding author
- Lee, Sungyoung
- Venue
- Applied Sciences
- Publisher
- MDPI AG
- Published
- 2020-03-25
- Volume
- 10
- Issue
- 7
- Pages
- 2216
- ISSN
- 2076-3417 (ISSN-L)
- OpenAlex
- W3013786371
- Cited by
- 37
- References
- 44
- Citations by year
- 2026: 3 · 2025: 4 · 2024: 5 · 2023: 10 · 2022: 5 · 2021: 9 · 2020: 1
- FWCI
- 5.45
- Type
- journal article
- Language
- en
- Open access
- gold
- dx.doi.org
- Licence
- Locations
- Applied Sciences (publishedVersion, cc-by)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Funders
- Institute for Information and Communications Technology Promotion (IITP-2017-0-01629, 2017-0-00655)
- National Research Foundation of Korea (NRF-2016K1A3A7A03951968, NRF-2019R1A2C2090504)
- Topics
- Health Sciences › Health Professions › Health Information Management › Artificial Intelligence in Healthcare
- Health Sciences › Medicine › Health Informatics › Artificial Intelligence in Healthcare and Education
- Physical Sciences › Computer Science › Artificial Intelligence › Speech and dialogue systems
- Keywords
- glaucoma, diabetes mellitus, chief complaint, disease prediction, voice-based authentication, natural language understanding, dialogue corpus, user experience, health anxiety, clinical decision support
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Medical Instructed Real-Time Assistant for Patient with Glaucoma and Diabetic Conditions. https://app.cochat.ai/papers/10.3390/app10072216
- The paper
- Rehman, U. U., Chang, D. J., Jung, Y., Akhtar, U., Razzaq, M. A., & Lee, S. (2020). Medical Instructed Real-Time Assistant for Patient with Glaucoma and Diabetic Conditions. Applied Sciences. https://doi.org/10.3390/app10072216
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.