The virtual patient as a learning tool: a mixed quantitative qualitative study
Open accessAbstract
BACKGROUND: The use of simulation in medical education has been widely accepted. There are different types of medical simulators that vary in both accuracy to emulate the real world (fidelity) and cost of development or acquisition. There is significant evidence that supports the use of high-fidelity simulators (i.e. mannequins or dummies) to prepare students for clinical environments, less attention has been given to low-fidelity simulators. This article aims to present evidence regarding the effectiveness of a low-fidelity simulator: Virtual Patient (VP), which develops several interactive computer-based clinical scenarios, seeking to promote an alternative learning environment and the development of necessary medical skills such as clinical reasoning in students of medicine. METHODS: A quasi-experimental study was designed to investigate the results on the development of history taking and clinical reasoning skills in a group of undergraduate medical students, in a course devised under the concepts of constructivism in education, which used the Virtual Patient as the fundamental teaching tool. Results were measured through a mixed, quantitative and qualitative study, triangulating the results of the students' skills evaluation when facing a clinical case represented by an actor patient before and after the course. Additionally, the description of the students' and tool's performance was measured by way of a qualitative study. RESULTS: The comparison of the students' skills on the evaluation matrix before-and-after the course evidenced a statistically significant advance (p < 0.01) in all aspects (interview, physical exam, clinical judgment, relevance of medical exams, and presentation of case). Students described the VP as an easy-to-use and motivating tool for learning without stress, especially at the beginning of their career. VP allowed them to create logical and structured processes, to be wrong without consequences, and to review and reassess information available. From the professor perspective, it allowed a better follow-up of the students' learning process and favored reflections on the teaching-learning process. CONCLUSIONS: VP proved to be a valuable and useful tool for the development of clinical reasoning and history taking skills in medical students, as part of a constructivist learning course.
AI snapshot
Written from the paper’s full text.
TL;DR
In a 16-week elective course using a web-based Virtual Patient as the core tool, 20 preclinical medical students at Universidad del Rosario showed statistically significant pre-post improvement in history taking and clinical reasoning skills when assessed with an actor patient. Qualitative data indicated the VP was easy to use, motivating, and allowed error without patient risk, though the authors caution that effects cannot be attributed to the VP alone.
Key findings
- All five assessed skills—interview, physical exam, clinical judgment, relevance of medical exams, and presentation of case—improved significantly from pre- to post-course by Wilcoxon signed rank test across three evaluators (abstract reports p < 0.01 in all aspects; Table 3 reports p values from <0.01 to 0.02).
- Students described the VP as easy-to-use and motivating, allowing them to make mistakes without consequences, review/reassess information, and build logical/structured processes; it was seen as especially useful early in the career.
- Professors reported better follow-up of students’ learning and reflection on the teaching-learning process; qualitative categories included use of the tool, perceptions on learning, construction of knowledge/competencies, and contributions to teaching.
- Cost per hour of VP was USD 12, compared with USD 160–800 per hour for high-fidelity simulators and USD 30–40 per hour for standardized patients; software and faculty time cost $49,000 USD.
Methods
- Quasi-experimental before-and-after mixed-methods study. Participants: 20 voluntary undergraduate medical students from first to fifth academic periods at Universidad del Rosario, first half of 2012, without prior semiology course; elective “Introduction to clinical reasoning” lasted 16 weeks with two-hour weekly sessions using VP cases of abdominal pain.
- Quantitative: each student handled a clinical case enacted by a professional actor in first and last sessions; performances videotaped and scored by three evaluators on a 1–3 matrix for five skills; non-parametric analysis (Wilcoxon signed rank test) in SPSS v22; matrix validated by three evaluators with Kappa coefficient.
- Qualitative: student focus group, professor field journals, and ethnographic observation by an anthropologist; data transcribed, digitized, coded by predefined categories and analyzed/triangulated in Atlas.ti v7.0; mixed concurrent/triangulated design.
Limitations
- Stated: the VP was embedded in a course designed with solid pedagogical principles, so observed changes cannot be completely attributed to the VP; no comparison was made with other learning strategies; cost-effectiveness analysis was outside the study scope.
- Stated: current VP development is insufficient to simulate the complexity of physician–patient interaction; as sole methodology it can become monotonous, may have technical problems, and requires complementary methodologies.
- Evident from the text: small sample (20 students), single institution, voluntary elective, and no control group; pre-post design leaves possible confounding by course structure, teacher guidance, peer collaboration, and self-selection.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
0 of 33 cited sources checked · 0 supported · 0 flagged
- Findingown data
The Virtual Patient allowed students to learn to recognize the importance of each piece of information that may be provided by a patient.
“It was found that the VP allowed students to learn to recognize the importance of each piece of information that may be provided by a patient, as well as the need for conducting a logical process that contributes to being more organized and methodical, and building structured mental schemes, which guide them towards possible diagnoses.”
Quote in the paperSubstantial claim - Findingown data
The Virtual Patient allowed students to review and reassess information available.
“VP allowed them to create logical and structured processes, to be wrong without consequences, and to review and reassess information available.”
- Also stated in: § Use of the tool · plain
“The VP enabled getting to know a patient, tackling a clinical case, broadening and feeding the curiosity over the unknown, asking questions again, re-examining, and going back to revisit and evaluate all the information.”
Quote in the paperSubstantial claim - Also stated in: § Use of the tool · plain
- Findingown data
Throughout the implementation of the Virtual Patient during the course, more advantages than disadvantages were observed.
“Throughout the implementation of the tool during the course, it was possible to observe more advantages than disadvantages.”
Quote in the paperNot a substantial claim - Findingown data
The Virtual Patient allowed students to create logical and structured processes.
“VP allowed them to create logical and structured processes, to be wrong without consequences, and to review and reassess information available.”
Quote in the paperSubstantial claim - Findingown data
The Virtual Patient enabled students to broaden and feed curiosity over the unknown.
“The VP enabled getting to know a patient, tackling a clinical case, broadening and feeding the curiosity over the unknown, asking questions again, re-examining, and going back to revisit and evaluate all the information.”
Quote in the paperNot a substantial claim
- Findingown data
The Virtual Patient allowed students to be wrong without consequences.
“VP allowed them to create logical and structured processes, to be wrong without consequences, and to review and reassess information available.”
- Also stated in: § Use of the tool · plain
“participants perceived a motivating and easy-to-use tool, which allowed for making mistakes with no consequences over the integrity of a real patient.”
Quote in the paperSubstantial claim - Also stated in: § Use of the tool · plain
- Findingown data
The analysis revealed that the students understood the importance of exploring all possible information sources in relation to the patient's problem.
“Furthermore, the analysis also revealed that the students understood the importance of exploring all possible information sources in relation to the patient’s problem, and that the logical, organized and methodical processing of data gathered helps them to propose the possible diverse diagnoses.”
Quote in the paperSubstantial claim - Findingown data
For this specific course, the key to reaching a diagnosis of the various cases proposed by the virtual patient lay in a different section of the clinical record: Personal data, current disease, review by systems, medical history or physical exam.
“For this specific course, the key to reaching a diagnosis of the various cases proposed by the VP lay in a different section of the clinical record: Personal data, current disease, review by systems, medical history or physical exam.”
Quote in the paperNot a substantial claim - Findingcitation
Our results on clinical reasoning skills are similar to those previously reported in the literature by Cook and co.
“With regard to the clinical reasoning skills, our results are similar to those previously reported in the literature by Cook and co [26].”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [26] Cook DA, Erwin PJ, Triola MM. Computerized virtual patients in health professions education: a systematic review and meta-analysis. Acad Med. 2010;85:1589–602. source
Not checked in the free run.
- Findingown data
One of the most important contributions of our study relies on the qualitative analysis where we observed that students applied different resources, appropriate for their learning level, to solve problems, as suggested by Norman.
“Nonetheless, one of the most important contributions of our study relies on the qualitative analysis where we observed that students applied different resources, appropriate for their learning level, to solve problems, as suggested by Norman [8].”
Quote in the paperSubstantial claim0 of 1 sources checked- cites [8] Norman G. Research in clinical reasoning: past history and current trends. Med Educ. 2005;39:418–27. source
Not checked in the free run.
- Findingown data
Results attained show a remarkable contribution to the skill of students in conducting interviews and performing complete physical exams better aimed at understanding and producing a diagnosis of patient problems (p < 0.01).
“Results attained show a remarkable contribution to the skill of students in conducting interviews and performing complete physical exams better aimed at understanding and producing a diagnosis of patient problems (p < 0.01).”
Quote in the paperSubstantial claim - Findingown data
The logical, organized and methodical processing of data gathered helps students to propose possible diverse diagnoses.
“Furthermore, the analysis also revealed that the students understood the importance of exploring all possible information sources in relation to the patient’s problem, and that the logical, organized and methodical processing of data gathered helps them to propose the possible diverse diagnoses.”
Quote in the paperSubstantial claim - Findingown data
The qualitative analysis allows establishing that the tool was unable to replace other teaching strategies completely.
“The remaining question whether VP is superior to other strategies could be secondary because the qualitative analysis allows establishing that the tool was unable to replace other teaching strategies completely.”
Quote in the paperSubstantial claim - Findingown data
The virtual patient as a learning tool showed a significant contribution to improving history taking and clinical reasoning skills in students of medicine in a preclinical environment.
“We conclude that the VP as a learning tool showed a significant contribution to improving history taking and clinical reasoning skills in students of medicine in a preclinical environment.”
Quote in the paperSubstantial claim - Interpretationown data
The Virtual Patient proved to be a valuable and useful tool for the development of clinical reasoning and history taking skills in medical students, as part of a constructivist learning course.
“VP proved to be a valuable and useful tool for the development of clinical reasoning and history taking skills in medical students, as part of a constructivist learning course.”
Quote in the paperSubstantial claim- Rests on an assumption: The actor-patient clinical case exercise is the closest to authentic clinical performance of a physician.
- Rests on an assumption: The 20 undergraduate medical students from Universidad del Rosario are representative of medical students in general, so the study's conclusions can generalize to medical students.
- Premisecitation
Evidence suggests that the most common medical error results from inadequate clinical reasoning.
“Evidence suggests that the most common medical error results from inadequate clinical reasoning [3, 9].”
Quote in the paperSubstantial claim0 of 2 sources checked - Interpretationown data
At the start of the professional career, the virtual patient is useful for the student because it enables the development of skills and attitudes instrumental for the professional career.
“Indeed, at the start of the professional career, it is useful for the student given that he/she acquires new experiences by interacting with a tool that enables the development of skills and attitudes, which are instrumental for his/her professional career.”
Quote in the paperSubstantial claim - Interpretationreasoning
The virtual patient is relevant for training first academic period students.
“One of the benefits of the VP is that it proves to be relevant for training first academic period students.”
Quote in the paperSubstantial claim - Interpretationreasoning
The virtual patient allows students to make mistakes with no consequences over the integrity of real patients.
“which allows them to make mistakes with no consequences over the integrity of real patients.”
Quote in the paperSubstantial claim - Study design and conductreasoning
It may not be concluded that the progress made by the students is the exclusive result of the virtual patient as a teaching tool, since it happened within a comprehensive course and other learning sources cannot be ruled out during the study's observation period.
“Given that knowledge building and the acquisition of skills are complex processes, it may not be concluded that the progress made by the students therewith is the exclusive result of the VP as a teaching tool, since it happened within a comprehensive course and other learning sources cannot be ruled out during the study’s observation period.”
Quote in the paperSubstantial claim - Study design and conductnone given
Another limitation of the study was that no comparison was made with other learning strategies.
“Another limitation of the study was that no comparison was made with other learning strategies.”
Quote in the paperNot a substantial claim
- May combine two claims. 32
- The quote only partly states this claim. 1
- Classified as probably not a substantial claim. 27
May combine two claims.
Findingown dataThe Virtual Patient allowed students to learn the need for conducting a logical process that contributes to being more organized and methodical, and building structured mental schemes that guide them towards possible diagnoses.
“It was found that the VP allowed students to learn to recognize the importance of each piece of information that may be provided by a patient, as well as the need for conducting a logical process that contributes to being more organized and methodical, and building structured mental schemes, which guide them towards possible diagnoses.”
Quote in the paperSubstantial claimMay combine two claims.
Findingown dataStudents acquired new knowledge with the Virtual Patient, applied prior knowledge, and made connections without the pressure from the professor or from a real patient, which translated into being able to act without fear of making a mistake.
“By the same token, it was observed that they acquired new knowledge with the tool, they applied prior knowledge, and made connections without the pressure from the professor or from a real patient, which translated into being able to act “without fear of making a mistake.””
Quote in the paperSubstantial claimMay combine two claims.
Findingown dataStudents perceived the Virtual Patient as an easy-to-use and motivating tool for learning without stress, especially at the beginning of their career.
“Students described the VP as an easy-to-use and motivating tool for learning without stress, especially at the beginning of their career.”
Quote in the paperSubstantial claimMay combine two claims. The quote only partly states this claim.
Findingown dataIn undergraduate medical students who took the 16-week constructivist course using the Virtual Patient, scores on the evaluation matrix for history taking and clinical reasoning (interview, physical exam, clinical judgment, relevance of medical exams, and presentation of case) were significantly higher after the course than before, as assessed by three evaluators.
“The comparison of the students’ skills on the evaluation matrix before-and-after the course evidenced a statistically significant advance (p < 0.01) in all aspects (interview, physical exam, clinical judgment, relevance of medical exams, and presentation of case).”
- Also stated in: § Results · plain
“The student skills of history taking and clinical reasoning significantly improved after taking the course (Table 3).”
Quote in the paperSubstantial claim- Rests on an assumption: The actor-patient clinical case exercise is the closest to authentic clinical performance of a physician.
- Also stated in: § Results · plain
May combine two claims.
Findingown dataThe effect from both the Virtual Patient tool and the course design proved to be favorable for learning to take place.
“As can be seen, the effect from both the tool and the course design proved to be favorable for learning to take place.”
Quote in the paperSubstantial claimMay combine two claims.
Findingown dataFrom the professor perspective, the Virtual Patient allowed better follow-up of the students' learning process and favored reflections on the teaching-learning process.
“From the professor perspective, it allowed a better follow-up of the students’ learning process and favored reflections on the teaching-learning process.”
Quote in the paperSubstantial claimMay combine two claims.
Findingown dataThe Virtual Patient enabled students to get to know a patient and tackle a clinical case.
“The VP enabled getting to know a patient, tackling a clinical case, broadening and feeding the curiosity over the unknown, asking questions again, re-examining, and going back to revisit and evaluate all the information.”
Quote in the paperSubstantial claimClassified as probably not a substantial claim. May combine two claims.
Findingown dataThe virtual patient helped students learn to organize their ideas and understand that all actions must have a specific end (verify-reject ideas).
“I have learned to organize my ideas and I understand that all my actions must have a specific end (verify-reject ideas).”
Quote in the paperSubstantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
Findingown dataThe professor reported seeing evidence of learning in the classroom with this course more than in other courses.
“Professor: Of course, as a professor you know what your student is intended to learn so activities that allow the student to build that knowledge, develop such skills, such attitudes are proposed… and few times I have been able to see that evidence of learning in the classroom as with this course…”
Quote in the paperNot a substantial claimClassified as probably not a substantial claim. May combine two claims.
Findingown dataThe virtual patient enables putting into practice and relating concepts learned, as well as strengthening concepts.
“The VP enables putting into practice and relating concepts learned, as well as strengthening concepts.”
Quote in the paperSubstantial claimMay combine two claims.
Findingown dataThe use of the virtual patient tool allowed for better follow-up of the students' learning process and, for the professor, for a reflection on the teaching-learning process.
“The use of the VP tool also allowed for a better follow-up of the students’ learning process and, in the case of the professor, for a reflection on the teaching-learning process:”
Quote in the paperSubstantial claimClassified as probably not a substantial claim. May combine two claims.
Findingown dataThe virtual patient allowed students to relate various concepts, encouraged research of conditions they do not understand, and improved critical reasoning skills.
“The Virtual Patient has allowed me to relate various concepts. Likewise, I feel that it has encouraged me to research those conditions that I do not understand and to improve my critical reasoning skills.”
Quote in the paperSubstantial claimMay combine two claims.
Findingown dataHistory taking skills significantly improved after the course, despite the virtual patient being a Web-based simulator using chat-like interviewing and click-based physical examination.
“It should be noted that although the VP is a Web-based simulator that uses a chat-like interviewing methodology and a click-based physical examination, history taking skills significantly improved after the course.”
Quote in the paperSubstantial claimClassified as probably not a substantial claim. May combine two claims.
Findingown dataThe course led students to reflect on the importance of controlling their own bias and avoiding taking the easy way out when producing a diagnosis because it may lead to serious mistakes.
“that it is important to control “your own bias” and taking the easy way out when producing a diagnosis because it may lead to serious mistakes; they have reflected on the importance of taking the medical act with all due seriousness, also given the risks involved in taking it lightly;”
Quote in the paperSubstantial claimMay combine two claims.
Findingown dataA contribution was made regarding guidance and the relevance for requesting additional tests geared towards confirming the diagnosis, as well as the presentation of clinical cases, as evidence for the abilities of students for clinical reasoning.
“For the same reason, a contribution was made regarding guidance and the relevance for requesting additional tests geared towards confirming the diagnosis, as well as the presentation of clinical cases, a set of skills considered in this research, as evidence for the abilities of students for clinical reasoning.”
Quote in the paperSubstantial claimProbably not a substantial claim: may not pass S3 (load-bearing), S4 (based). May combine two claims.
Findingnone givenThe auto-filling feature of questions is determined by the development level of the simulation model, which to a certain extent substitutes the student's effort to consider the relevant questions within the clinical reasoning process.
“On another note, it is worth mentioning that the auto-filling feature of such questions is determined by the development level of the simulation model, which to a certain extent substitutes the student’s effort to consider the relevant questions within the clinical reasoning process.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S2 (checkable).
Findingown dataThe virtual patient is a good practice where students can put into practice their knowledge and practice at a consultation without compromising anyone's life or health.
“I feel it is a good practice, where we can not only put into practice our knowledge, but also our practice at a consultation without compromising anyone’s life or health.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.
Findingown dataThe course led students to see that they cannot ask questions and pay attention indefinitely, but must focus the interview on relevant aspects without neglecting the rest.
“I also believe they have seen that they cannot afford to ask questions and pay attention indefinitely, but rather, that they must start to somehow focus the interview on the relevant aspects (without neglecting the rest).”
Quote in the paperNot a substantial claimClassified as probably not a substantial claim.
Findingown dataThe virtual patient's structure allowed students to infer part of the clinical logic with which the doctor intervenes regarding the disease.
“From the Virtual Patient‘s structure, browsing the various tabs allowed the students to infer part of the clinical logic with which the doctor intervenes regarding the disease.”
Quote in the paperSubstantial claimMay combine two claims.
Findingown dataThe cost per hour of the virtual patient was USD 12, which is low compared to high-fidelity simulators (between USD 160 and 800 per hour) and standardized patients (from USD 30 to 40 per hour).
“From a cost perspective, the cost per hour of the VP was USD 12, which is noteworthy as it is low compared to high-fidelity simulators (between USD 160 and 800 per hour) and standardized patients (from USD 30 to 40 per hour).”
Quote in the paperNot a substantial claimMay combine two claims.
FindingcitationThe cost of the software and faculty time was $49,000 USD, similar to what was previously reported in the literature.
“The cost of the software and faculty time was similar to what was previously reported in the literature [30]: $49,000. USD.”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [30] Schwid HA, Souter KJ. Resident perceptions and cost analysis of a virtual patient application for anesthesia-related critical incidents. J Educ Perioper Med. 2014;16:E077.
Not checked in the free run.
Classified as probably not a substantial claim.
Study design and conductcitationThe results were measured through a mixed concurrent or triangulated study.
“The results were measured through a mixed concurrent or triangulated study [19–21].”
Quote in the paperSubstantial claim0 of 3 sources checked- cites [19] Greene JC, Caracelli VJ, Graham WF. Toward a conceptual framework for mixed-method evaluation designs. Educational Evaluation and Policy Analysis. 1989;11:255–74. source
Not checked in the free run.
- cites [20] Brewer J, Hunter A. Foundations of multimethod research. California: Thousand Oaks; 2018. https://doi.org/10.4135/9781412984294 . source
Not checked in the free run.
- cites [21] Greene JC. Mixed methods in social inquiry. 1st ed. San Francisco, CA: Jossey-Bass; 2007.
Not checked in the free run.
May combine two claims.
Study design and conductown dataThe evaluation matrix for history taking and clinical reasoning skills was validated by three evaluators using the Kappa coefficient with a 95% reliability interval, and its construct and content and inter-observer agreement were validated.
“Validation of the matrix was established by three evaluators using the agreement test through the Kappa coefficient, with a 95% reliability interval. Construct and content of the matrix were validated, as well as agreement amongst the observers (Table 1).”
Quote in the paperSubstantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
PremisecitationThe Virtual Patient has been accepted by the Liaison Committee on Medical Education (LCME) as a resource to teach rare but necessary clinical situations.
“This tool has been accepted by the Liaison Committee on Medical Education (LCME) as a resource to teach rare but necessary clinical situations [13].”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [13] Cendan J, Lok B. The use of virtual patients in medical school curricula. Adv Physiol Educ. 2012;36:48–53. source
Not checked in the free run.
Probably not a substantial claim: may not pass S3 (load-bearing).
PremisecitationThe Virtual Patient has been part of the United States Medical Licensing Examination (USMLE Step 3) since 1999.
“In addition, it is part of the United States Medical Licensing Examination (USMLE Step 3) since 1999 [13, 14].”
Quote in the paperNot a substantial claim0 of 2 sources checked- cites [13] Cendan J, Lok B. The use of virtual patients in medical school curricula. Adv Physiol Educ. 2012;36:48–53. source
Not checked in the free run.
- cites [14] Mehta NP, Kramer DB. A critique of the USMLE clinical skills examination. Medscape Gen Med. 2005;7:76–6.
Not checked in the free run.
Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.
Study design and conductnone givenPrior authorization from the University was requested, as well as informed consent from all students involved.
“Prior authorization from the University was requested, as well as an informed consent from all students involved.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
InterpretationreasoningThe improvement in history taking skills could be related to the simulator's function of displaying patient question suggestions to the student.
“This finding could be related to the simulator’s function of displaying patient question suggestions to the student.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S2 (checkable), S3 (load-bearing).
PremisecitationClinical reasoning is an essential skill that must be applied in every moment of patient attendance.
“This process is known as clinical reasoning, an essential skill that must be applied in every moment of patient attendance [8].”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [8] Norman G. Research in clinical reasoning: past history and current trends. Med Educ. 2005;39:418–27. source
Not checked in the free run.
May combine two claims.
PremisecitationPatient safety is recognized around the world as a priority, where trial-error-based learning cannot be an option in a real patient.
“Hence, patient safety is recognized around the world as a priority, where “trial-error”-based learning cannot be an option in a real patient [4].”
Quote in the paperSubstantial claim0 of 1 sources checked- cites [4] Aggarwal R, Mytton OT, Derbrew M, Hananel D, Heydenburg M, Issenberg B, et al. Training and simulation for patient safety. Qual Saf Health Care. 2010;19 Suppl 2:i34. source
Not checked in the free run.
Classified as probably not a substantial claim.
PremisecitationMedical error represents one of the leading causes of death.
“Current evidence suggests that medical error represents one of the leading causes of death [1–3].”
Quote in the paperSubstantial claim0 of 3 sources checked- cites [1] Weingart SN, McL Wilson R, Gibberd RW, Harrison B. Epidemiology of medical error. West J Med. 2000;172:390–3. source
Not checked in the free run.
- cites [2] Kohn LT, Corrigan JM, Donaldson MS, editors. To Err is Human: Building a Safer Health System. Washington (DC): National Academies Press (US); 2000.
Not checked in the free run.
- cites [3] Graber ML, Franklin N, Gordon R. Diagnostic error in internal medicine. Arch Intern Med. 2005;165:1493–9. source
Not checked in the free run.
Probably not a substantial claim: may not pass S2 (checkable), S3 (load-bearing).
PremisecitationGetting together relevant information such as personal and psychosocial state, related personal and family medical background, the reason for consulting, plus physical examination findings, should allow the physician to generate a diagnosis hypothesis.
“Getting together the relevant information such as personal and psychosocial state, related personal and family medical background, the reason for consulting, plus the physical examination findings, should allow the physician to generate a diagnosis hypothesis.”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [7] Keifenheim KE, Teufel M, Ip J, Speiser N, Leehr EJ, Zipfel S, et al. Teaching history taking to medical students: a systematic review. BMC Medical Education. 2015;15:159. source
Not checked in the free run.
Classified as probably not a substantial claim. May combine two claims.
PremisecitationEmergent teaching strategies based on constructivist concepts highlight the importance of repeated interaction between the learner and the object of learning, and the importance of others in knowledge construction.
“Emergent strategies are based on constructivist concepts, which highlight the importance of the repeated interaction between the learner and the object of learning, and the importance of others in the process of knowledge construction [6].”
Quote in the paperSubstantial claim0 of 1 sources checked- cites [6] Phillips DC. The good, the bad, and the ugly: the many faces of constructivism. Educ Res. 1995;24:5–12. source
Not checked in the free run.
May combine two claims.
InterpretationcitationThe virtual patient results in a valuable learning experience for the student, who at first has difficulties in asking questions, especially when it comes to sensitive issues or aspects relative to the patient's private life.
“This results in a valuable learning experience for the student, who at first has difficulties in asking questions, especially when it comes to sensitive issues or aspects relative to the patient’s private life [22–24].”
Quote in the paperSubstantial claim0 of 3 sources checked- cites [22] Edelbring S, Dastmalchi M, Hult H, Lundberg IE, Dahlgren LO. Experiencing virtual patients in clinical learning: a phenomenological study. Adv Health Sci Educ Theory Pract. 2011;16:331–45. source
Not checked in the free run.
- cites [23] Sandroni S. Enhancing clinical teaching with information technologies: what can we do right now? Academic medicine : journal of the Association of American Medical Colleges. 1997;72:770–4. source
Not checked in the free run.
- cites [24] Spencer J. Teaching about professionalism. Med Educ. 2003;37:288–9. source
Not checked in the free run.
Classified as probably not a substantial claim.
PremisecitationThe aim of the Virtual Patient is to expose students to virtual scenarios that would otherwise be difficult to find or to deal with in real life.
“The aim of VP is to expose students to virtual scenarios that would otherwise be difficult to find or to deal with in real life [11, 12].”
Quote in the paperSubstantial claim0 of 2 sources checked- cites [11] Friedrich MJ. Practice makes perfect: risk-free medical training with patient simulators. JAMA. 2002;288(2808):2811–2.
Not checked in the free run.
- cites [12] Ellaway R, Masters K. AMEE guide 32: e-learning in medical education part 1: learning, teaching and assessment. Med Teach. 2008;30:455–73. source
Not checked in the free run.
May combine two claims.
Study design and conductreasoningThe main limitation of the study is that the virtual patient was immersed in a course designed following solid pedagogical principles to strengthen history taking and clinical reasoning skills, so it is not possible to completely attribute the observed changes to the virtual patient.
“Nevertheless, the main limitation of the study is that the VP was immersed in a course that was designed following solid pedagogical principles to strengthen history taking and clinical reasoning skills. Hence, it is not possible to completely attribute the observed changes to the VP.”
Quote in the paperSubstantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
PremisecitationSimulation facilitates learning when used in appropriate conditions that include providing feedback, repetition, curriculum integration, individualized learning and controlled environment.
“However, it has been accepted that simulation facilitates learning when it is used in the appropriate conditions that include providing feedback, repetition, curriculum integration, individualized learning and controlled environment [28].”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [28] Issenberg SB, McGaghie WC, Petrusa ER, Lee Gordon D, Scalese RJ. Features and uses of high-fidelity medical simulations that lead to effective learning: a BEME systematic review. Med Teach. 2005;27:10–28. source
Not checked in the free run.
May combine two claims.
InterpretationreasoningThe virtual patient proposes a logical order and familiarizes the student with the way of asking questions, previously introduced by medical instructors who apply them in their actual professional context.
“In other terms, the VP proposes a logical order and familiarizes the student with the way of asking questions, previously introduced by medical instructors who apply them in their actual professional context.”
Quote in the paperSubstantial claimProbably not a substantial claim: may not pass S2 (checkable).
PremisecitationThese circumstances make it necessary to introduce changes to medical education.
“These circumstances make it necessary to introduce changes to medical education [5].”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [5] Ypinazar VA, Margolis SA. Clinical simulators: applications and implications for rural medical education. Rural Remote Health. 2006;6:527.
Not checked in the free run.
May combine two claims.
PremisecitationSimulation in medical education allows students to repeat a given scenario as many times as needed, make mistakes, learn from errors, ponder, receive proper feedback, trace a learning curve, and improve clinical skills without compromising patients' safety, as well as reduce stress from direct interaction with real patients.
“Simulation emerges as a new medical educational strategy allowing students to repeat a given scenario as many times as needed, make mistakes, learn from errors, ponder, receive proper feedback, trace a learning curve, and finally, improve the clinical skills required in clinical practice without compromising patients’ safety, as well as to reduce the stress produced by direct interaction with real”
Quote in the paperSubstantial claim0 of 2 sources checked- cites [5] Ypinazar VA, Margolis SA. Clinical simulators: applications and implications for rural medical education. Rural Remote Health. 2006;6:527.
Not checked in the free run.
- cites [10] Aper L, Reniers J, Derese A, Veldhuijzen W. Managing the complexity of doing it all: an exploratory study on students’ experiences when trained stepwise in conducting consultations. BMC Med Educ. 2014;14:206. source
Not checked in the free run.
May combine two claims.
InterpretationreasoningThe virtual patient challenges traditional preferences but not as a single tool, rather in a constructivist context.
“However, as it has been described above, VP challenges traditional preferences but not as a single tool, rather in a constructivist context.”
Quote in the paperSubstantial claimMay combine two claims.
Study design and conductreasoningThe virtual patient was used as the main tool of a course designed with solid pedagogical foundation, making it difficult to completely attribute the results to the single tool.
“However, VP was used as the main tool of a course that was designed with solid pedagogical foundation, making it difficult to completely attribute the results to the single tool.”
Quote in the paperSubstantial claimProbably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.
PremisecitationMedical students prefer a more traditional approach to learning (reflectors and theorists) than a pragmatic or even an activist, and instructional strategies should encourage students to self-directed learning.
“Additionally, as has been suggested by Guraya et al., medical students prefer a more traditional approach to learning (reflectors and theorists) than a pragmatic or even an activist, and that instructional strategies should encourage students to self-directed learning [27].”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [27] Guraya SS, Guraya SY, Habib FA, Khoshhal KI. Learning styles of medical students at Taibah University: trends and implications. J Res Med Sci. 2014;19:1155–62. source
Not checked in the free run.
May combine two claims.
PremisecitationSystematic reviews include studies where the virtual patient has been compared with other strategies and showed positive results against traditional lectures and even standardized patients, but evidence is not conclusive and heterogeneity of the data suggests that more research is needed.
“Moreover, it is possible to find systematic reviews that include studies where VP has been compared with some of those strategies and where it showed positive results against traditional lectures and even standardized patients, but evidence is not [7] conclusive and heterogeneity of the data suggest that more research is needed [7, 26, 29].”
Quote in the paperNot a substantial claim0 of 3 sources checked- cites [7] Keifenheim KE, Teufel M, Ip J, Speiser N, Leehr EJ, Zipfel S, et al. Teaching history taking to medical students: a systematic review. BMC Medical Education. 2015;15:159. source
Not checked in the free run.
- cites [26] Cook DA, Erwin PJ, Triola MM. Computerized virtual patients in health professions education: a systematic review and meta-analysis. Acad Med. 2010;85:1589–602. source
Not checked in the free run.
- cites [29] Cook DA, Triola MM. Virtual patients: a critical literature review and proposed next steps. Med Educ. 2009;43:303–11. source
Not checked in the free run.
Classified as probably not a substantial claim.
Interpretationown dataA learning environment that promotes individual construction through peer interaction, meaningful learning, repetition of the same problem with different variations, learning by doing and proper permanent feedback are essential to ensuring the efficacy of a Web-based virtual patient for developing clinical reasoning and history taking skills.
“Results suggest that a learning environment that promotes individual construction through peer interaction, meaningful learning, repetition of the same problem with different variations, learning by doing and a proper permanent feedback are essential to ensuring the efficacy of a Web-based virtual patient for developing clinical reasoning and history taking skills.”
Quote in the paperSubstantial claimProbably not a substantial claim: may not pass S2 (checkable), S3 (load-bearing), S4 (based).
Interpretationnone givenPermanent collaborative work amongst small student groups must have influenced the outcome.
“There was permanent collaborative work amongst small student groups, which must have influenced the outcome.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.
PremisecitationThe virtual patient and simulation in general are merely tools for training purposes, and success in their use does not depend so much on the accuracy of the simulation but rather on how it is used by the instructor and the student.
“We agree with Aggarwal et al. [4] on the importance of bearing in mind that the VP and the simulation in general are merely tools for training purposes, and that success in their use does not depend so much on the accuracy of the simulation but rather on how it is used by the instructor and the student.”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [4] Aggarwal R, Mytton OT, Derbrew M, Hananel D, Heydenburg M, Issenberg B, et al. Training and simulation for patient safety. Qual Saf Health Care. 2010;19 Suppl 2:i34. source
Not checked in the free run.
Probably not a substantial claim: may not pass S3 (load-bearing).
Study design and conductnone givenThe scope of the study did not include a cost-effectiveness analysis.
“Nonetheless, the scope of the study did not include a cost-effectiveness analysis and prospective studies are needed.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S2 (checkable), S3 (load-bearing). May combine two claims.
InterpretationcitationInstructional strategies, whether technology-based or not, must include some solid principles from pedagogical theory that were incorporated to the virtual patient course and some of what Issenberg et al. described as key for simulation-based learning.
“This suggests that instructional strategies, whether technology-based or not, must include some solid principles from pedagogical theory that were incorporated to the VP course and some of what Issenberg et al. described as key for simulation-based learning [28].”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [28] Issenberg SB, McGaghie WC, Petrusa ER, Lee Gordon D, Scalese RJ. Features and uses of high-fidelity medical simulations that lead to effective learning: a BEME systematic review. Med Teach. 2005;27:10–28. source
Not checked in the free run.
The paper relies on this without support.
The actor-patient clinical case exercise is the closest to authentic clinical performance of a physician.
“This exercise was considered as the closest to authentic clinical performance of a physician.”
The paper relies on this without support.
The 20 undergraduate medical students from Universidad del Rosario are representative of medical students in general, so the study's conclusions can generalize to medical students.
“The course involved 20 voluntary undergraduate medical students from first to fifth academic periods from Universidad del Rosario in the first half of 2012, who had not had a prior semiology course.”
The paper relies on this without support.
Less attention has been given to low-fidelity simulators than to high-fidelity simulators.
“There is significant evidence that supports the use of high-fidelity simulators (i.e. mannequins or dummies) to prepare students for clinical environments, less attention has been given to low-fidelity simulators.”
The paper relies on this without support.
The Virtual Patient is still under development and relatively unexplored from a pedagogic perspective.
“VP is still under development and relatively unexplored from a pedagogic perspective.”
The paper relies on this without support.
A greater number of worked cases results in better performance in real life.
“Evidence shows that a greater number of worked cases results in a better performance in real life.”
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the 3 included studies of virtual patients, users in all 3 reported liking that it provided a platform for risk-free learning because they were not practicing on real patients.
“In the included studies, 3 of the conversational agents were virtual patients, and users in all 3 studies reported liking that it provided a platform for risk-free learning because they were not practicing on real patients [15,41,50].”
From The Effectiveness of Artificial Intelligence Conversational Agents in Health Care: Systematic Review (2020) · cites this paper as [15]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
Each contradiction between two passages listed here was confirmed by an independent check.
Not all assessed skills had p < 0.01
MinorThe abstract says every assessed aspect improved at p < 0.01, but Table 3 reports p = 0.02 for clinical judgment as assessed by Evaluator 2.
“The comparison of the students’ skills on the evaluation matrix before-and-after the course evidenced a statistically significant advance (p < 0.01) in all aspects (interview, physical exam, clinical judgment, relevance of medical exams, and presentation of case).”
“| Clinical judgment | z = − 2.46 p = 0.01 | z = − 2.33 p = 0.02 | z = − 2.74 p < 0.01 |”
Cites
Wall, A. (2000) · British Journal of Healthcare Management · doi:10.12968/bjhc.2000.6.9.19311 · Cited by 5,909 · see citing works
Toward a Conceptual Framework for Mixed-Method Evaluation Designs
Greene, J. C., Caracelli, V. J., & Graham, W. F. (1989) · Educational Evaluation and Policy Analysis · doi:10.3102/01623737011003255 · Cited by 5,687 · see citing works
Educational Psychology: A Cognitive View
Ausubel, D. P., Novak, J. D., & Hanesian, H. (1968) · Medical Entomology and Zoology · Cited by 5,204 · see citing works
Barry Issenberg, S., Mcgaghie, W. C., Petrusa, E. R., Lee Gordon, D., & Scalese, R. J. (2005) · Medical Teacher · doi:10.1080/01421590500046924 · Cited by 3,966 · see citing works
To Err Is Human : Building A Safer Health System
Kohn, L. T., Corrigan, J., & Donaldson, M. S. (2000) · Cited by 2,844 · see citing works
Psychosomatic medicine in Germany: more timely than ever
Zipfel, S., Herzog, W., Kruse, J., & Henningsen, P. (2016) · Psychotherapy and Psychosomatics · doi:10.1159/000447701 · Cited by 2,323 · see citing works
Mixed Methods in Social Inquiry
Greene, J. C. (2007) · Cited by 1,960 · see citing works
Diagnostic error in internal medicine
Graber, M. L., Franklin, N., & Gordon, R. (2005) · Archives of Internal Medicine · doi:10.1001/archinte.165.13.1493 · Cited by 1,549 · see citing works
Conversational agents in healthcare: a systematic review
Laranjo, L., Dunn, A. G., Tong, H. L., Kocaballi, A. B., Chen, J., Bashir, R., Surian, D., Gallego, B., Magrabi, F., Lau, A. Y. S., et al. (2018) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocy072 · Cited by 1,388 · see citing works
The Good, the Bad, and the Ugly: The Many Faces of Constructivism
Phillips, D. C. (1995) · Educational Researcher · doi:10.3102/0013189x024007005 · Cited by 1,330 · see citing works
Research in clinical reasoning: past history and current trends
Norman, G. (2005) · Medical Education · doi:10.1111/j.1365-2929.2005.02127.x · Cited by 1,018 · see citing works
Training and simulation for patient safety
Aggarwal, R., Mytton, O. T., Derbrew, M., Hananel, D., Heydenburg, M., Issenberg, B., MacAulay, C., Mancini, M. E., Morimoto, T., Soper, N., et al. (2010) · Quality and Safety in Health Care · doi:10.1136/qshc.2009.038562 · Cited by 739 · see citing works
Weingart, S. N. (2000) · BMJ · doi:10.1136/bmj.320.7237.774 · Cited by 658 · see citing works
AMEE Guide 32: e-Learning in medical education Part 1: Learning, teaching and assessment
Ellaway, R., & Masters, K. (2008) · Medical Teacher · doi:10.1080/01421590802108331 · Cited by 652 · see citing works
Virtual patients: a critical literature review and proposed next steps
Cook, D. A., & Triola, M. M. (2009) · Medical Education · doi:10.1111/j.1365-2923.2008.03286.x · Cited by 624 · see citing works
Computerized Virtual Patients in Health Professions Education: A Systematic Review and Meta-Analysis
Cook, D. A., Erwin, P. J., & Triola, M. M. (2010) · Academic Medicine · doi:10.1097/acm.0b013e3181edfe13 · Cited by 570 · see citing works
Stevens, D. D., & Levi, A. J. (2004) · Cited by 469 · see citing works
The Narrative Nature of Clinical Reasoning
Mattingly, C. (1991) · American Journal of Occupational Therapy · doi:10.5014/ajot.45.11.998 · Cited by 319 · see citing works
Foundations of Multimethod Research
Brewer, J., & Hunter, A. (2006) · doi:10.4135/9781412984294 · Cited by 287 · see citing works
Teaching history taking to medical students: a systematic review
Keifenheim, K. E., Teufel, M., Ip, J., Speiser, N., Leehr, E. J., Zipfel, S., & Herrmann-Werner, A. (2015) · BMC Medical Education · doi:10.1186/s12909-015-0443-x · Cited by 218 · see citing works
The use of virtual patients in medical school curricula
Cendan, J., & Lok, B. (2012) · Advances in Physiology Education · doi:10.1152/advan.00054.2011 · Cited by 109 · see citing works
Practice Makes Perfect: Risk-Free Medical Training With Patient Simulators
Friedrich, M. J. (2002) · JAMA · doi:10.1001/jama.288.22.2808 · Cited by 98 · see citing works
Experiencing virtual patients in clinical learning: a phenomenological study
Edelbring, S., Dastmalchi, M., Hult, H., Lundberg, I. E., & Dahlgren, L. O. (2011) · Advances in Health Sciences Education · doi:10.1007/s10459-010-9265-0 · Cited by 77 · see citing works
Weingart, S. N. (2000) · Western Journal of Medicine · doi:10.1136/ewjm.172.6.390 · Cited by 68 · see citing works
Learning styles of medical students at Taibah University: Trends and implications
Guraya, S., Habib, F., Khoshhal, K., & Guraya, S. (2014) · Journal of Research in Medical Sciences · doi:10.4103/1735-1995.150455 · Cited by 43 · see citing works
Clinical simulators: applications and implications for rural medical education
Ypinazar, V., & Margolis, S. A. (2006) · Rural and Remote Health · doi:10.22605/rrh527 · Cited by 36 · see citing works
Pensar pedagógicamente desde el constructivismo. De las concepciones a las prácticas pedagógicas
Ordóñez, C. L. (2004) · DOAJ (DOAJ: Directory of Open Access Journals) · Cited by 28 · see citing works
Teaching about professionalism
Spencer, J. (2003) · Medical Education · doi:10.1046/j.1365-2923.2003.01479_1.x · Cited by 15 · see citing works
Aper, L., Reniers, J., Derese, A., & Veldhuijzen, W. (2014) · BMC Medical Education · doi:10.1186/1472-6920-14-206 · Cited by 13 · see citing works
Enhancing clinical teaching with information technologies: what can we do right now?
Sandroni, S. (1997) · Academic Medicine · doi:10.1097/00001888-199709000-00011 · Cited by 11 · see citing works
A Critique of the USMLE clinical skills examination.
Mehta, N., & Kramer, D. B. (2005) · PubMed · Cited by 10 · see citing works
Schwid, H. A., & Souter, K. J. (2014) · Journal of Education in Perioperative Medicine · doi:10.46374/volxvi-issue11-schwid · Cited by 10 · see citing works
Flagged first, then by citations
Cited by
Sorted by citations
The Effectiveness of Artificial Intelligence Conversational Agents in Health Care: Systematic Review
Milne-Ives, M., de Cock, C., Lim, E., Shehadeh, M. H., de Pennington, N., Mole, G., Normando, E., & Meinert, E. (2020) · Journal of Medical Internet Research · doi:10.2196/20346 · Cited by 626 · see citing works
Wijnen-Meijer, M., Brandhuber, T., Schneider, A., & Berberat, P. O. (2022) · Journal of Medical Education and Curricular Development · doi:10.1177/23821205221091511 · Cited by 207 · see citing works
Plackett, R., Kassianos, A. P., Mylan, S., Kambouri, M. A., Raine, R., & Sheringham, J. (2022) · BMC Medical Education · doi:10.1186/s12909-022-03410-x · Cited by 157 · see citing works
Strategies Used to Teach Soft Skills in Undergraduate Nursing Education: A Scoping Review
Azzouzi, W., & Gantare, A. (2022) · Journal of Professional Nursing · doi:10.1016/j.profnurs.2022.07.010 · Cited by 95 · see citing works
Suárez, A., Velasco, A. A., García, V. D., Freire, Y., & Algar, J. (2022) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph19148735 · Cited by 88 · see citing works
Potential applications and implications of large language models in primary care
Andrew, A. (2024) · Family Medicine and Community Health · doi:10.1136/fmch-2023-002602 · Cited by 69 · see citing works
Software-Based Dialogue Systems: Survey, Taxonomy, and Challenges
Motger, Q., Franch, X., & Marco, J. (2022) · ACM Computing Surveys · doi:10.1145/3527450 · Cited by 75 · see citing works
Hwang, G., Chang, C., & Ogata, H. (2021) · Nurse Education Today · doi:10.1016/j.nedt.2021.105164 · Cited by 54 · see citing works
Review of artificial intelligence‐based question‐answering systems in healthcare
Cilar, L., Gosak, L., & Štiglic, G. (2023) · Wiley Interdisciplinary Reviews Data Mining and Knowledge Discovery · doi:10.1002/widm.1487 · Cited by 60 · see citing works
An Overview of the Use of Chatbots in Medical and Healthcare Education
Frangoudes, F., Hadjiaros, M., Schiza, E. C., Matsangidou, M., Tsivitanidou, O., & Neokleous, K. (2021) · Lecture notes in computer science · doi:10.1007/978-3-030-77943-6_11 · Cited by 51 · see citing works
Plackett, R., Kassianos, A. P., Kambouri, M. A., Kay, N., Mylan, S., Hopwood, J., Schartau, P., Gray, S., Timmis, J., Bennett, S., et al. (2020) · BMC Medical Education · doi:10.1186/s12909-020-02168-4 · Cited by 48 · see citing works
A scoping review: virtual patients for communication skills in medical undergraduates
Kelly, S. B., Smyth, E., Murphy, P., & Pawlikowska, T. R. B. (2022) · BMC Medical Education · doi:10.1186/s12909-022-03474-9 · Cited by 46 · see citing works
Zeng, J., Qi, W., Shen, S., Liu, X., Li, S., Wang, B., Dong, C., Zhu, X., Shi, Y., Lou, X., et al. (2025) · Journal of Medical Internet Research · doi:10.2196/79091 · Cited by 49 · see citing works
Dua, A. B., Kilian, A., Grainger, R., Fantus, S. A., Wallace, Z. S., Buttgereit, F., & Jonas, B. (2020) · Clinical Rheumatology · doi:10.1007/s10067-020-05449-x · Cited by 41 · see citing works
Virtual Standardized Patients for Mental Health Education
Reger, G. M., Norr, A. M., Gramlich, M. A., & Buchman, J. M. (2021) · Current Psychiatry Reports · doi:10.1007/s11920-021-01273-5 · Cited by 38 · see citing works
Critical thinking pedagogical practices in medical education: a systematic review
Araújo, B., Gomes, S. F., & Ribeiro, L. V. P. T. (2024) · Frontiers in Medicine · doi:10.3389/fmed.2024.1358444 · Cited by 57 · see citing works
Koumpouras, F., & Helfgott, S. M. (2020) · Arthritis & Rheumatology · doi:10.1002/art.41278 · Cited by 36 · see citing works
Hess, O. M., Qian, J. J., Bruce, J. S., Wang, E., Rodríguez, S., Haber, N., & Caruso, T. J. (2022) · Medical Science Educator · doi:10.1007/s40670-022-01598-7 · Cited by 34 · see citing works
Lavoie, P., Lapierre, A., Maheu‐Cadotte, M., Fontaine, G., Khetir, I., & Bélisle, M. (2021) · Academic Medicine · doi:10.1097/acm.0000000000004522 · Cited by 35 · see citing works
García-Torres, D., Vicente Ripoll, M. A., Fernández Peris, C., & Mira Solves, J. J. (2024) · Healthcare · doi:10.3390/healthcare12222241 · Cited by 29 · see citing works
Luo, Y., Geng, C., Chen, X., Zhang, Y., Zou, Z., & Bai, J. (2021) · Nursing and Health Sciences · doi:10.1111/nhs.12842 · Cited by 27 · see citing works
Mestre, A., Muster, M., Adib, A. R. E., Egilsdottir, H. Ö., Byermoen, K. R., Padilha, J. M., Aguilar, T., Tabagari, N., Betts, L., Sales, L., et al. (2022) · BMC Medical Education · doi:10.1186/s12909-022-03426-3 · Cited by 27 · see citing works
Evaluation of the performance of ChatGPT‐4 and ChatGPT‐4o as a learning tool in endodontics
Öztürk, E. A., Gökduman, C. T., & Çanakçı, B. C. (2025) · International Endodontic Journal · doi:10.1111/iej.14217 · Cited by 26 · see citing works
Chen, Y., Lin, Q., Chen, X., Liu, T., Ke, Q., Yang, Q., Guan, B., & Ming, W.-K. (2023) · Digital Health · doi:10.1177/20552076231185435 · Cited by 24 · see citing works
Ziane-Casenave, S., Mauroux, M., Devillard, R., & Kérourédan, O. (2022) · European Journal Of Dental Education · doi:10.1111/eje.12767 · Cited by 21 · see citing works
Egilsdottir, H. Ö., Heyn, L. G., Brembo, E. A., Byermoen, K. R., Moen, A., & Eide, H. (2022) · BMC Nursing · doi:10.1186/s12912-022-00872-8 · Cited by 20 · see citing works
Bonnin, C., Pejoan, D., Ranvial, E., Marchat, M., Andrieux, N., Fourcade, L., & Perrochon, A. (2023) · Journal of Visual Communication in Medicine · doi:10.1080/17453054.2023.2216243 · Cited by 21 · see citing works
Healthcare agent: eliciting the power of large language models for medical consultation
Ren, Z., Zhan, Y., Yu, B., Ding, L., Xu, P., & Tao, D. (2025) · npj Artificial Intelligence · doi:10.1038/s44387-025-00021-x · Cited by 49 · see citing works
Ganji, J., Shirvani, M. A., Motahari-Tabari, N., & Tayebi, T. (2022) · Nurse Education Today · doi:10.1016/j.nedt.2022.105293 · Cited by 18 · see citing works
Friedman, N. M. G., Zuniga‐Hernandez, M., Titzler, J., Suen, M. Y., Wang, E., Rosales, O., Graham, J., D’Souza, P. A., Menendez, M., & Caruso, T. J. (2023) · Prehospital Emergency Care · doi:10.1080/10903127.2023.2224876 · Cited by 16 · see citing works
Lebdai, S., Mauget, M., Cousseau, P., Granry, J. C., & Martin, L. (2020) · Journal of surgical education · doi:10.1016/j.jsurg.2020.08.031 · Cited by 16 · see citing works
Polireddi, N. S. A., & Kavitha, J. (2023) · Soft Computing · doi:10.1007/s00500-023-08541-x · Cited by 16 · see citing works
RetractedTowards Integrating Virtual Reality into Medical Curricula: A Single Center Student Survey
Mergen, M., Meyerheim, M., & Graf, N. M. (2023) · Education Sciences · doi:10.3390/educsci13050477 · Cited by 19 · see citing works
ChatGPT Simulated Patient: Use in Clinical Training in Psychology
Cortés, A. S., Tapia, J. L., García-Carpintero, E., Rocabado, F., & Pedrajas, L. M. (2025) · Psicothema · doi:10.70478/psicothema.2025.37.21 · Cited by 19 · see citing works
Current trends and future perspectives for medical education in Colombia
Forero, D. A., Majeed, M. H., & Ruiz-Díaz, P. (2019) · Medical Teacher · doi:10.1080/0142159x.2019.1659944 · Cited by 14 · see citing works
Virtual patients improve history-taking competence and confidence in medical students
Raafat, N., Harbourne, A. D., Radia, K., Woodman, M. J., Swales, C. E., & Saunders, K. E. A. (2023) · Medical Teacher · doi:10.1080/0142159x.2023.2273782 · Cited by 13 · see citing works
Towards believable and educational conversations with virtual patients
Graf, L., Sykownik, P., Gradl-Dietsch, G., & Masuch, M. (2024) · Frontiers in Virtual Reality · doi:10.3389/frvir.2024.1377210 · Cited by 13 · see citing works
García-Torres, D., Fernández, C., Mira, J. J., Morales, A., & Vicente, M. A. (2025) · JMIR Medical Education · doi:10.2196/78857 · Cited by 11 · see citing works
Virtual patient simulation in pharmacy education: A systematic review
Beshir, S. A., Mohamed, A. P., Soorya, A., Goh, S. S. L., El‐labbad, E. M., Hussain, N., & Said, A. S. A. (2022) · Pharmacy Education · doi:10.46542/pe.2022.221.954970 · Cited by 11 · see citing works
Zhao, J., He, H., Du, J., Liu, Y., Li, Z., You, L., & Li, K. (2022) · Nurse Education in Practice · doi:10.1016/j.nepr.2022.103289 · Cited by 10 · see citing works
Su, W., & Chang, C. (2021) · Interactive Learning Environments · doi:10.1080/10494820.2021.1879873 · Cited by 10 · see citing works
Quality of Virtual Patients on WeChat for Nursing History-Taking Training
Luo, J., Zheng, J., He, H., Liu, T., Zhao, J., & Li, K. (2019) · Clinical Simulation in Nursing · doi:10.1016/j.ecns.2019.07.001 · Cited by 10 · see citing works
Teaching dermatology in the era of digital technology
Salava, A., & Kluger, N. (2022) · Annales de Dermatologie et de Vénéréologie · doi:10.1016/j.annder.2022.04.002 · Cited by 10 · see citing works
Huon, J., Nizet, P., Tollec, S., Vene, E., Fronteau, C., Leichnam, A., Tching-Sin, M., Michelet-Barbotin, V., Foucault‐Fruchard, L., & Nativel, F. (2024) · International Journal of Clinical Pharmacy · doi:10.1007/s11096-024-01715-z · Cited by 9 · see citing works
Liu, L., Chen, Y., Cao, Y., Yang, L., Yang, Y., Li, Y., Huang, D., Ye, L., & Zheng, Q. (2024) · Anatomical Sciences Education · doi:10.1002/ase.2538 · Cited by 10 · see citing works
Sangalli, L., Manning, E., Miller, C. S., Fricton, J., Lok, B. C. L., & Boggero, I. A. (2025) · Journal of Dental Education · doi:10.1002/jdd.13928 · Cited by 9 · see citing works
Bastías-Vega, N., Villalobos, C. P., Reyes-Aramburu, E. P., Behrens-Pérez, C., & Rivera, S. A. (2020) · Revista Latinoamericana de Simulación Clínica · doi:10.35366/92935 · Cited by 9 · see citing works
Designing Virtual Patients for Education of Nursing Students in Cancer Course
Bahrami, M., Hadadgar, A., & Fuladvandi, M. (2021) · Iranian Journal of Nursing and Midwifery Research · doi:10.4103/ijnmr.ijnmr_327_20 · Cited by 9 · see citing works
Christopher, A., Gortemiller, T., Zemmer, J., & Wronowski, M. L. (2021) · Medical Science Educator · doi:10.1007/s40670-021-01297-9 · Cited by 9 · see citing works
Cost-effectiveness of using chatbots in healthcare: a systematic review
Fgaier, M., & Zrubka, Z. (2022) · IEEE International Symposium on Computational Intelligence and Informatics (CINTI) · doi:10.1109/cinti-macro57952.2022.10029478 · Cited by 9 · see citing works
Sigler, R., Wooten, D. A., Kumar, R. N., Hand, J. M., Marschalk, N., Go, R., Prakash, K., Stohs, E. J., Schaenman, J. M. D., & Law, N. (2023) · Transplant Infectious Disease · doi:10.1111/tid.14177 · Cited by 9 · see citing works
Family-Planning counselling simulation for medical students: An exploratory educational intervention
Inurreta-Díaz, M., Morales-Gual, Y. M., Aguilar-Vargas, E., Álvarez-Baeza, A., Magriñá-Lizama, J. S., Cetina-Sauri, G., & Méndez‐Domínguez, N. (2020) · Educación Médica · doi:10.1016/j.edumed.2020.01.002 · Cited by 9 · see citing works
Lippitsch, A., Steglich, J., Ludwig, C., Kellner, J., Hempel, L., Stoevesandt, D., & Thews, O. (2024) · Computer Methods and Programs in Biomedicine · doi:10.1016/j.cmpb.2023.107964 · Cited by 8 · see citing works
Dávidovics, A., Dávidovics, K., Hillebrand, P., Rendeki, S., & Németh, T. (2025) · BMC Medical Education · doi:10.1186/s12909-025-08507-7 · Cited by 11 · see citing works
Hosseini, T. M., Ahmady, S., & Edelbring, S. (2022) · Journal of Contemporary Medical Sciences · doi:10.22317/jcms.v8i2.1158 · Cited by 7 · see citing works
A Review on Trustworthiness of Digital Assistants for Personal Healthcare
Bailoni, T., & Dragoni, M. (2025) · ACM Computing Surveys · doi:10.1145/3714999 · Cited by 9 · see citing works
Artificial Intelligence in Radiology
Khan, M. R. (2024) · Elsevier eBooks · doi:10.1016/b978-0-323-87865-4.00011-x · Cited by 7 · see citing works
Gönüllü, İ., Bayazıt, A., & Erden, Ş. (2024) · BMC Medical Education · doi:10.1186/s12909-024-05121-x · Cited by 7 · see citing works
Trinidad, D. R., & Wung, S. (2023) · Clinical Simulation in Nursing · doi:10.1016/j.ecns.2023.05.003 · Cited by 6 · see citing works
The use of virtual patient simulations in psychology: A scoping review
Hossain, S. I., Kelson, J. N., & Morrison, B. W. (2024) · Australasian Journal of Educational Technology · doi:10.14742/ajet.9559 · Cited by 6 · see citing works
Ahmady, S., & Hosseini, S. T. M. (2022) · Journal of Medical Education · doi:10.5812/jme-127021 · Cited by 6 · see citing works
A model for training ultrasound-guided fine-needle punctures
Luz, F. M., Yacoub, V. R. D., Silveira, K. A. A., Reis, F., & Dertkigil, S. S. J. (2022) · Revista da Associação Médica Brasileira · doi:10.1590/1806-9282.20220150 · Cited by 6 · see citing works
Zeng, M., Cai, Y., Cao, J., He, Q., Wang, X., Lü, Y., Liang, H., Xu, D. R., & Liao, J. (2022) · Journal of Medical Internet Research · doi:10.2196/40082 · Cited by 7 · see citing works
Learning Clinical Reasoning: The Experience of Postgraduate Psychiatry Trainee Doctors in Qatar
Albahari, D. (2023) · Teaching and Learning in Medicine · doi:10.1080/10401334.2023.2209076 · Cited by 6 · see citing works
Clinical reasoning and medical education: Scoping Review
Castro, G. G., & Ortega, F. J. R. (2021) · Educación Médica · doi:10.1016/j.edumed.2020.11.015 · Cited by 5 · see citing works
Distance assessment of counselling skills using virtual patients during the COVID-19 pandemic
Thomas, D., Beshir, S. A., Zachariah, S., Sam, K. G., & Hamdy, H. (2020) · Pharmacy Education · doi:10.46542/pe.2020.202.196204 · Cited by 5 · see citing works
Hall, S., Grant, G. D., Hussey, S., Harwood, B., Austin, L., & Gospos, E. (2026) · Currents in Pharmacy Teaching and Learning · doi:10.1016/j.cptl.2026.102588 · Cited by 4 · see citing works
Reppou, S. E., Tsoupouroglou, I., Pandria, N., & Bamidis, P. D. (2024) · International Conference on PErvasive Technologies Related to Assistive Environments (PETRA) · doi:10.1145/3652037.3663927 · Cited by 4 · see citing works
Alpay, S., Darafarin, Y., Dagdelen, B., Al-shammari, S., & Buyukbayram, I. (2025) · BMC Medical Education · doi:10.1186/s12909-025-08358-2 · Cited by 6 · see citing works
Virtual patient simulation method for learning and assessment in cardiology field
Manuaba, I. B. P., Dewi, N. G. A. P. L. S., Prabawa, I. P. Y., Bhargah, A., Darmayani, I. G. A. S., & Wu, C.-C. (2020) · Bali Medical Journal · doi:10.15562/bmj.v9i3.2010 · Cited by 4 · see citing works
Demiray, A., İLASLAN, N., Kızıltepe, S. K., & Açıl, A. (2023) · BMC Nursing · doi:10.1186/s12912-023-01486-4 · Cited by 4 · see citing works
Physical assessment educational programs for pharmacists and pharmacy students: A systematic review
Barry, A. R., Turgeon, R. D., & Ellis, U. M. (2020) · JACCP JOURNAL OF THE AMERICAN COLLEGE OF CLINICAL PHARMACY · doi:10.1002/jac5.1306 · Cited by 4 · see citing works
Mentoring Radiologists and Imaging Scientists in the Postpandemic Digital Era
Lee, S. I., Kahn, C. E., Luker, G. D., & Rosen, B. R. (2023) · Radiology · doi:10.1148/radiol.231702 · Cited by 4 · see citing works
Quek, F. F., Meldrum, S., & Hislop, J. F. (2025) · Cureus · doi:10.7759/cureus.77278 · Cited by 5 · see citing works
Virtual patients: an option for future distance midwifery education?
Urbanová, E., Bašková, M., Maskálová, E., Mazúchová, L., & Škodová, Z. (2022) · International Journal of Nursing Education Scholarship · doi:10.1515/ijnes-2021-0096 · Cited by 4 · see citing works
Bahrami, M., Hadadgar, A., & Fuladvandi, M. (2025) · Iranian Journal of Nursing and Midwifery Research · doi:10.4103/ijnmr.ijnmr_259_23 · Cited by 3 · see citing works
Sabzwari, S. R., Ishaque, S., Memon, S., & Musharrif, S. (2023) · Journal of College of Physicians And Surgeons Pakistan · doi:10.29271/jcpsp.2023.04.457 · Cited by 3 · see citing works
Woon, L. S., Daud, T. I. M., & Tong, S. F. (2023) · BMC Medical Education · doi:10.1186/s12909-023-04834-9 · Cited by 5 · see citing works
The Attractiveness of Blended Learning in the 21st Era in Higher Education
Nofirman, N., Salong, A., Rachman, A., Zulkarnain, I., & Bangun, E. U. P. B. (2024) · Al-Hijr Journal of Adulearn World · doi:10.55849/alhijr.v3i1.578 · Cited by 2 · see citing works
Subjective learning gain from a simulation-based health management course: a mixed methods study
Gu, R.-P., Zhao, F. R., Bai, J., Sun, S., & Zhu, A.-Y. (2024) · Frontiers in Public Health · doi:10.3389/fpubh.2024.1400135 · Cited by 2 · see citing works
Byun, J., Kim, H., Lim, J., Choi, J., & Ahn, S. (2026) · Korean journal of medical education · doi:10.3946/kjme.2025.108 · Cited by 2 · see citing works
Li, Y., Wang, G., Huang, Z., Ke, X., Qin, J., Yu, J., Liu, S., Li, J., & Xu, Y. (2026) · BMC Psychiatry · doi:10.1186/s12888-026-07896-3 · Cited by 3 · see citing works
Using Bots to Conduct Interviews in Journalism and Research Courses
Palacios, M. L. F., Noriega, C. A. L., & Rebolledo‐Mendez, G. (2022) · Transactions on computer systems and networks · doi:10.1007/978-981-19-3383-7_44 · Cited by 2 · see citing works
Cai, W., You, M., Li, J., Li, Q., Wang, D., & Wang, H. (2023) · BMC Medical Education · doi:10.1186/s12909-023-04831-y · Cited by 2 · see citing works
Adapting to change: a systematic review of anatomy education methods during the COVID-19 pandemic
Maani, A., Brachet, A., Rusek, J., & Baj, J. (2024) · Medical Research Journal · doi:10.5603/mrj.100107 · Cited by 2 · see citing works
REDESIGNING MEDICAL STUDENTS' TRAINING THROUGH VIRTUAL CLINICAL SIMULATION
Tecnologico de Monterrey, E. D. M. Y. C. D. L. S., Segura-Azuara, N. D. L. Á., Lopez, M. V., & Tecnologico de Monterrey, E. D. M. Y. C. D. L. S. (2021) · International conference on education · doi:10.17501/24246700.2021.7128 · Cited by 2 · see citing works
Kharidia, K. M., Lin, M. E., West, J. D., Sarode, D. N., Ma, H. J., Vanstrum, E. B., Wu, F. M., & Johns, M. M. E. (2022) · Annals of Otology Rhinology & Laryngology · doi:10.1177/00034894221139107 · Cited by 2 · see citing works
Empowering Medical Educators: A UTAUT Analysis of Technology Adoption in Inquiry-Based Learning
Anderson, M. C., York, C. S., Hodge-Zickerman, A., Park, Y. S., & Rhode, J. (2024) · Technology Knowledge and Learning · doi:10.1007/s10758-023-09709-y · Cited by 2 · see citing works
Use of virtual medical cases as a learning tool in medicine
Bureš, V., Čech, P., Husáková, M., Kokstein, Z., Kříž, P., Krylová, K., Nacházel, T., Ponce, D., Poulová, P., Ryška, A., et al. (2020) · Interactive Learning Environments · doi:10.1080/10494820.2020.1802297 · Cited by 2 · see citing works
E-AMB: um projeto piloto de e-learning na saúde
Valle, T. L. D., Antunes, T. D. A., de Oliveira, D. A., Zanini, Â. T., dos Santos, B. C., Barbosa, Y. R., & Antunes, C. V. D. A. (2024) · Brazilian Journal of Development · doi:10.34117/bjdv10n1-040 · Cited by 1 · see citing works
Kocher, P., & Awan, O. A. R. (2024) · Academic Radiology · doi:10.1016/j.acra.2024.09.030 · Cited by 1 · see citing works
The Practice and Thinking of Virtual Simulation in PhysiologyFusion Clinical Cases Teaching
毕, 逢. (2024) · Advances in Education · doi:10.12677/ae.2024.14112200 · Cited by 1 · see citing works
The Impact of Virtual Patient Education on Enhancing Clinical Reasoning in Nursing Students
Bahrami, M., Hadadgar, A., & Fuladvandi, M. (2026) · Iranian Journal of Nursing and Midwifery Research · doi:10.4103/ijnmr.ijnmr_192_24 · Cited by 1 · see citing works
Chen, Y., Jiang, L., Wu, L., Gong, W., Wu, J., Zhen, J., Tong, Y., Guo, Y., & Xu, Z. (2026) · BMC Medical Education · doi:10.1186/s12909-026-09607-8 · Cited by 1 · see citing works
Cecil, J., Kokje, E., Kleine, A., Schaffernak, I., Vogel, L., Angerer, S., Lermer, E., & Gaube, S. (2026) · BMC Medical Education · doi:10.1186/s12909-026-09917-x · Cited by 1 · see citing works
Ye, Y., Tao, H., Huang, S., Zou, M., Chen, Y., Shen, P., Hao, M., & Liu, C. (2026) · Frontiers in Medicine · doi:10.3389/fmed.2026.1904001 · Cited by 1 · see citing works
Learning by Doing in Medicine: Solution and Configuration of Virtual Medical Cases
Bureš, V., Čech, P., Husáková, M., Kříž, P., Krylová, K., Nacházel, T., Ponce, D., Poulová, P., Tachecí, I., & Tučník, P. (2019) · International Symposium on Educational Technology · doi:10.1109/iset.2019.00043 · Cited by 1 · see citing works
Blended Learning mit Virtuellen Kindernotfallpatientinnen und -patienten für Studierende
Steiner, I., Brandenberger, J. R., Wagner, F. L., & Huwendiek, S. (2021) · Praxis · doi:10.1024/1661-8157/a003749 · Cited by 1 · see citing works
Canadianizing and Evaluating a Virtual Simulation Program for Community Health
Chircop, A., Cobbett, S., Schofield, R., DiCasmirro, J., & Doucet, L. (2023) · Quality Advancement in Nursing Education - Avancées en formation infirmière · doi:10.17483/2368-6669.1403 · Cited by 1 · see citing works
- Authors
- Isaza-Restrepo, A., Gómez, M. T., Cifuentes, G., & Argüello, A.
- Affiliations
- Universidad del Rosario (CO)
- Universidad de Los Andes (CO)
- Corresponding author
- Isaza-Restrepo, Andrés
- Venue
- BMC Medical Education
- Published
- 2018-12
- Volume
- 18
- Issue
- 1
- Pages
- 297-297
- ISSN
- 1472-6920 (ISSN-L)
- PMC
- PMC6282259
- OpenAlex
- W2902116953
- Semantic Scholar
- 3f86d9f962c6ca562369957d9a85f7c2a573ef0b
- Cited by
- 129
- References
- 32
- Citations by year
- 2026: 11 · 2025: 14 · 2024: 21 · 2023: 20 · 2022: 32 · 2021: 17 · 2020: 11 · 2019: 3
- FWCI
- 5.31
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- Locations
- BMC Medical Education (publishedVersion, cc-by)
- Europe PMC (PubMed Central) (publishedVersion, other-oa)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- LA Referencia (Red Federada de Repositorios Institucionales de Publicaciones Científicas) (submittedVersion, other-oa)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Greater South Information System
- Funders
- Universidad de los Andes
- Universidad del Rosario
- Fundación Santa Fe de Bogotá
- Topics
- Health Sciences › Medicine › Physiology › Simulation-Based Education in Healthcare
- Health Sciences › Medicine › Public Health, Environmental and Occupational Health › Innovations in Medical Education
- Health Sciences › Medicine › Surgery › Surgical Simulation and Training
- Keywords
- virtual patients, low-fidelity simulation, simulation-based medical education, clinical reasoning, medical history, undergraduate medical students, constructivist learning
- MeSH terms
- Clinical Competence, Computer-Assisted Instruction, Education, Medical, Educational Measurement, Evaluation Studies as Topic, Humans, Health Knowledge, Attitudes, Practice, Learning, Manikins, Physical Examination, Students, Medical, User-Computer Interface, Patient Simulation, Problem-Based Learning, Qualitative Research
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Claims read by deepseek-v4.1-flash under definition version 3 (extract-v3) on 2026-10-10.
Classified by jev-1.13-20260917 (gold-guideline-v0.2) on 2026-10-10.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review