CoChat

Leveraging the efficiency and transparency of artificial intelligence‐driven visual Chatbot through smart prompt learning concept

Open access
Goktas, Polat, Kucukkaya, Aycan, Karacay, Pelin · 2023 · Skin Research and Technology
Cited by 35

The DOI matches its Crossref record; 7 of the 7 references it cites were found in a registry or an index.

Abstract

With the advent of artificial intelligence (AI) technology's exponential growth, such as ChatGPT (OpenAI—Chat generative pretrained transformer), the incorporation of humanistic principles into education becomes critical to understanding the humanistic essence of medicine.1 Other significant AI chatbots, such as Google Med-PaLM 2,2 are also being explored for medical applications. In addition, AI chatbots like ChatGPT have shown promise in a variety of medical specialties, including radiology and allergy and immunology.3, 4 A deep comprehension of the AI technology structure in medical education is crucial to appreciate the relevance of this integration. In recent years, the rapid rise of AI-driven chatbot applications in education has brought tremendous opportunities, but it also poses challenges.5-7 While AI technologies can offer accurate results, as demonstrated by Hernández Montilla et al. (2023) in their study on the Automatic International Hidradenitis Suppurativa Severity Score System (AIHS4),8 the essential role of human judgement and expertise should always be considered. These include a potential overreliance on AI-generated data, and a risk of undermining the irreplaceable value of human judgement and expertise. In this letter, we explore the concept of 'Smart Prompt Learning' concept within the AI visual chatbot platform, such as the Large Language and Visual Assistant (LLaVA),9 emphasising the need for integrating humanities into education, providing a case study based on the Benner's Theory foundation model. This methodology through AI lens focuses on the importance of human decision-making and judgement, especially in complex case study where there may be some uncertainty or disagreement.10 By using smart prompt learning in education, we hope to reduce too much reliance on AI-generated information, and enhance human expertise in decision-making and critical thinking. For example, we used a visual ChatGPT assistant as the LLaVA to help diagnose a skin condition. We accessed the LLaVA interface (featuring the trained large multimodal model with default parameters) via https://llava.hliu.cc for the demo version using Microsoft Edge browser. When given a question and an image of a skin lesion about diagnosing a 48-year-old woman with itchy spots on her wrist provided in the Nursing in Practice,11 the AI visual assistant can provide a diagnosis and percentage likelihood for each potential answer choice, with a prompt of 'How much percentage you correctly choose the following options?' The virtual assistant said that 'The correct diagnosis, lichen planus, has a percentage chance of being chosen as: 100%. The other options, latex allergy, miliaria crystalline (heat rash) and shingles, have a lower probability of being chosen, with their respective percentages being: 0% (no chance), 0% (no chance) and 0% (no chance)'. This scenario could lead to too much reliance on AI-generated information without considering human judgement and expertise, while the AI assistant provided the correct response, which matched the outcome of the quiz.12 In the clinical practice, the AI-generated information might not always align with the realistic scenario that practitioner would encounter. To address this overreliance constraint from the AI lens, we applied the concept of the smart prompt learning by looking at the perspectives of different levels of healthcare professionals knowledge and skills, as determined by Patricia Benner's Theory of Skill Acquisition.13 When we asked the visual ChatGPT assistant for percentage values of each answer choice from the view of a novice nurse with a prompt of 'From the perspective of novice nurse determined from the Benner's Theory, please provide only percentage values for each answer choice', it responded, 'From the perspective of a novice nurse, the most likely diagnosis chosen would be lichen planus, with a percentage chance of 75%. The other options, latex allergy, miliaria crystalline (heat rash) and shingles, would be chosen less frequently by a novice nurse, with their respective percentages being: 25%, 0%, 0% and 0%. According to Benner's theory, novice nurses are more likely to focus on the surface features of a patient's condition and may not have the experience to identify subtle nuances or consider alternative diagnoses. As a novice nurse gains experience and expertise through clinical practice and education, their diagnostic accuracy and ability to consider a wider range of possibilities will improve'. This response considers the different levels of expertise among nurses in the practice. As for the Expert nurse situation, the visual assistant provided the following answer: 'From the perspective of an expert nurse, as defined by Benner's theory, the most likely diagnosis chosen would be lichen planus, with a percentage chance of 30%. The other options, latex allergy, miliaria crystalline (heat rash) and shingles, would be chosen less frequently, with their respective

Overview

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1111/srt.13417

Cites

7 of 7 references verified0 citation errors · 0 not checkable

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Show all 7 references

Cited by

Metadata

Authors
Goktas, P., Kucukkaya, A., & Karacay, P.
Venue
Skin Research and Technology
Publisher
Wiley
Published
2023-10-20
Volume
29
Issue
11
Pages
e13417-e13417
ISSN
  • 0909-752X (ISSN-L)
  • 1600-0846
OpenAlex
W4387817330
Cited by
35
References
7
FWCI
1.21
Type
journal article
Language
en
Open access
hybrid

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.