Promptology: enhancing human-AI interaction in large language models
Open accessThe DOI matches its Crossref record; 23 of the 23 references it cites were found in a registry or an index.
Abstract
This study investigates the integration of generative AI in higher education and the development of the SPARRO framework, a structured approach to improving human–AI interaction in academic settings. This ethnographic study explores the integration of generative AI in healthcare and nursing education, detailing the development of the SPARRO framework based on observations of student and faculty interactions with AI tools across five courses. The study identifies key challenges such as AI hallucination, mistrust of AI-generated summaries, and the difficulty in formulating effective prompts. The SPARRO framework addresses these challenges, offering a step-by-step guide for planning, prompt design, reviewing, and refining AI outputs. While the framework shows promise in improving AI integration, future research is needed to validate its applicability across other academic disciplines and assess its long-term impact on critical thinking and academic integrity. This study contributes to the growing body of research on AI in education, offering practical solutions for ethically and effectively integrating AI tools in academic settings.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“No longer limited to coding tasks, developers are now expected to perform as AI orchestrators-designing prompts, validating outputs, and applying ethical judgment in real time [9].”
From Redefining the Programmer: Human-AI Collaboration, LLMs, and Security in Modern Software Engineering (2025) · cites this paper as [9]
Experimental — accuracy not yet measuredThe check wasn’t confident either way, so it gives no verdict — never disputed.
In the citing paper
“GenAI systems inherit and amplify existing biases in their training data, leading to unfair or discriminatory outcomes.”
From MAPPING GENERATIVE AI'S ETHICAL ISSUES IN HIGHER EDUCATION: A FELT-GUIDED SYSTEMATIC REVIEW [PEMETAAN ISU ETIKA GENERATIVE AI DI PENDIDIKAN TINGGI: TINJAUAN SISTEMATIS BERPANDUAN FELT] (2025) · cites this paper as Olla et al., 2024
Experimental — accuracy not yet measuredThe check wasn’t confident either way, so it gives no verdict — never disputed.
In the citing paper
“AI models, trained on massive datasets reflecting”
From MAPPING GENERATIVE AI'S ETHICAL ISSUES IN HIGHER EDUCATION: A FELT-GUIDED SYSTEMATIC REVIEW [PEMETAAN ISU ETIKA GENERATIVE AI DI PENDIDIKAN TINGGI: TINJAUAN SISTEMATIS BERPANDUAN FELT] (2025) · cites this paper as Olla et al., 2024
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Liu, P., Yuan, W., Fu, J., Jiang, Z., Hayashi, H., & Neubig, G. (2023) · ACM Computing Surveys · doi:10.1145/3560815 · Cited by 4,361
Liu, P., Yuan, W., Fu, J., Jiang, Z., Hayashi, H., & Neubig, G. (2021) · arXiv · doi:10.48550/arxiv.2107.13586 · Cited by 4,352
Large language models encode clinical knowledge
Singhal, K., Azizi, S., Tu, T., Mahdavi, S. S., Wei, J., Chung, H. W., Scales, N., Tanwani, A., Cole-Lewis, H., Pfohl, S., et al. (2023) · Nature · doi:10.1038/s41586-023-06291-2 · Cited by 4,083
Large Language Models Encode Clinical Knowledge
Singhal, K., Azizi, S., Tu, T., Mahdavi, S. S., Wei, J., Chung, H. W., Scales, N., Tanwani, A., Cole-Lewis, H., Pfohl, S., et al. (2022) · arXiv · doi:10.48550/arxiv.2212.13138 · Cited by 4,083
Prompt Engineering as an Important Emerging Skill for Medical Professionals: Tutorial
Meskó, B. (2023) · Journal of Medical Internet Research · doi:10.2196/50638 · Cited by 709
Artificial Intelligence Applications for Industry 4.0: A Literature-Based Study
Javaid, M., Haleem, A., Singh, R. P., & Suman, R. (2022) · Journal of Industrial Integration and Management · doi:10.1142/s2424862221300040 · Cited by 578
ChatGPT and the rise of generative AI: Threat to academic integrity?
Eke, D. O. (2023) · Journal of Responsible Technology · doi:10.1016/j.jrt.2023.100060 · Cited by 532
The CLEAR path: A framework for enhancing information literacy through prompt engineering
Lo, L. S. (2023) · The Journal of Academic Librarianship · doi:10.1016/j.acalib.2023.102720 · Cited by 351
Ethics of large language models in medicine and medical research
Li, H., Moon, J. T., Purkayastha, S., Celi, L. A., Trivedi, H., & Gichoya, J. W. (2023) · The Lancet Digital Health · doi:10.1016/s2589-7500(23)00083-3 · Cited by 286
Designing fair AI for managing employees in organizations: a review, critique, and design agenda
Robert, L. P., Pierce, C., Marquis, L., Kim, S., & Alahmad, R. (2020) · Human–Computer Interaction · doi:10.1080/07370024.2020.1735391 · Cited by 268
Research works printed but not linked: 1
- 6. Trope, R.L. What a Piece of Work is AI"-Security and Al Developments. Bus. Law 2020, 76, 289-294.
Cited by
Integrating Generative AI in Hackathons: Opportunities, Challenges, and Educational Implications
Sajja, R., Ramirez, C. E., Li, Z., Demiray, B. Z., Sermet, Y., & Demir, I. (2024) · Big Data and Cognitive Computing · doi:10.3390/bdcc8120188 · Cited by 28
The Creation and Evaluation of an AI Assistant (GPT) for Educational Experience Design
López-Galisteo, A. J., & Borrás-Gené, O. (2025) · Information · doi:10.3390/info16020117 · Cited by 26
“Specifically, effective communication with AI models through prompts necessitates strong language skills, a nuanced understanding of the model’s capabilities and limitations, and a deep knowledge of the educational context [15,16], and adequate digital skills are essential [6].”
Kangwa, D., Msafiri, M. M., & Fute, A. (2025) · Journal of Computer Assisted Learning · doi:10.1111/jcal.70109 · Cited by 22
Basil, M., Ahmed, W., Hajeomar, R., Strawbridge, J., Lynch, M. R., & Mukhalalati, B. (2026) · BMC Medical Education · doi:10.1186/s12909-025-08527-3 · Cited by 20
Barus, O., Hidayanto, A., Eitiveni, I., Phusavat, K., & Sudibjo, N. (2025) · Interactive Learning Environments · doi:10.1080/10494820.2025.2596058 · Cited by 9
“Many identified frameworks tend to focus on partial aspects, such as optimizing human-AI interaction (Olla et al., 2024), student education policies (Chan, 2023), or assignment integrity (Shanto et al., 2023).”
Metadata
- Authors
- Olla, P., Elliott, L., Abumeeiz, M., Mihelich, K., & Olson, J.
- Affiliations
- University of Detroit Mercy (US)
- Western University (CA)
- Corresponding author
- Olla, Phillip
- ORCID
- Mihelich, Karen
- Venue
- Information
- Publisher
- MDPI AG
- Published
- 2024-10-14
- Volume
- 15
- Issue
- 10
- Pages
- 634
- ISSN
- 2078-2489 (ISSN-L)
- OpenAlex
- W4403606135
- Cited by
- 17
- References
- 19
- Citations by year
- 2026: 11 · 2025: 6
- FWCI
- 6.41
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- Locations
- Information (publishedVersion, cc-by)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Topics
- Social Sciences › Education › Artificial Intelligence in Education
- Health Sciences › Medicine › Health Informatics › Artificial Intelligence in Healthcare and Education
- Physical Sciences › Computer Science › Artificial Intelligence › Intelligent Tutoring Systems and Adaptive Learning
- Keywords
- human-AI interaction, large language models, prompt engineering, generative AI in higher education, nursing education, healthcare education, AI hallucination, academic integrity, critical thinking
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Promptology: enhancing human-AI interaction in large language models. https://app.cochat.ai/papers/10.3390/info15100634
- The paper
- Olla, P., Elliott, L., Abumeeiz, M., Mihelich, K., & Olson, J. (2024). Promptology: enhancing human-AI interaction in large language models. Information. https://doi.org/10.3390/info15100634
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.
