A Conversation with ChatGPT about Digital Leadership and Technology Integration: Comparative Analysis Based on Human–AI Collaboration
Open accessThe DOI matches its Crossref record; 32 of the 32 references it cites were found in a registry or an index.
Abstract
Artificial intelligence (AI) is one of the ground-breaking innovations of the 21st century that has accelerated the digitalization of societies. ChatGPT is a newer form of AI-based large language model that can generate complex texts that are almost indistinguishable from human-generated text. It has already garnered substantial interest from people due to its potential utility in a variety of contexts. The current study was conducted to evaluate the utility of ChatGPT in generating accurate, clear, concise, and unbiased information that could support a scientific research process. To achieve this purpose, we initiated queries on both versions of ChatGPT regarding digital school leadership and teachers’ technology integration, two significant topics currently discussed in educational literature, under four categories: (1) the definition of digital leadership, (2) the digital leadership skills of school principals, (3) the factors affecting teachers’ technology integration, and (4) the impact of digital leadership on teachers’ technology integration. Next, we performed a comparative analysis of the responses generated by ChatGPT-3.5 and ChatGPT-4. The results showed that both versions were capable of providing satisfactory information compatible with the relevant literature. However, ChatGPT-4 provided more comprehensive and categorical information as compared to ChatGPT-3.5, which produced responses that were more superficial and short-cut. Although the results are promising in aiding the research process with AI-based technologies, we should also caution that, in their current form, these tools are still in their infancy, and there is a long way to go before they become fully capable of supporting scientific work. Meanwhile, it is significant that researchers continue to develop the relevant knowledge base to support the responsible, safe, and ethical integration of these technologies into the process of scientific knowledge creation, as Pandora’s box has already been opened, releasing newer opportunities and risks to be tackled.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
ChatGPT for Good? On Opportunities and Challenges of Large Language Models for Education
Kasneci, E., Seßler, K., Küchemann, S., Bannert, M., Dementieva, D., Fischer, F., Gasser, U., Groh, G., Günnemann, S., Hüllermeier, E., et al. (2023) · doi:10.35542/osf.io/5er8f · Cited by 7,552
ChatGPT for good? On opportunities and challenges of large language models for education
Kasneci, E., Sessler, K., Küchemann, S., Bannert, M., Dementieva, D., Fischer, F., Gasser, U., Groh, G., Günnemann, S., Hüllermeier, E., et al. (2023) · Learning and Individual Differences · doi:10.1016/j.lindif.2023.102274 · Cited by 7,326
Dwivedi, Y. K., Kshetri, N., Hughes, L., Slade, E. L., Jeyaraj, A., Kar, A. K., Baabdullah, A. M., Koohang, A., Raghavan, V., Ahuja, M., et al. (2023) · International Journal of Information Management · doi:10.1016/j.ijinfomgt.2023.102642 · Cited by 4,584
Sallam, M. (2023) · Healthcare · doi:10.3390/healthcare11060887 · Cited by 3,126
Sallam, M. (2023) · doi:10.1101/2023.02.19.23286155 · Cited by 3,123 · cited 2×
“Another significant concern is about the reliability and accuracy of the responses, which are generated based on the corpus data on which it is trained (Lecler et al. 2023; Sallam 2023; Stokel-Walker and Van Noorden 2023).”
BackgroundBarocas, S., & Selbst, A. D. (2014) · doi:10.2139/ssrn.2477899 · Cited by 3,048 · cited 1×
“Therefore, ChatGPT has the potential to produce biased responses since it cannot identify the bias existing in its training corpus or the internet resource it reaches (Barocas and Selbst 2016; Zhai 2022).”
BackgroundTeacher beliefs and technology integration practices: A critical relationship
Ertmer, P. A., Ottenbreit-Leftwich, A. T., Sadik, O., Sendurur, E., & Sendurur, P. (2012) · Computers & Education · doi:10.1016/j.compedu.2012.02.001 · Cited by 2,107 · cited 1×
“ChatGPT can continuously improve itself by using the feedback received from its users (Farrokhnia et al. 2023; Mann 2023), and has the ability to find and summarize information retrieved from the internet literature in response to users’ queries (Cascella et al. 2023).”
BackgroundChatGPT: five priorities for research
van Dis, E. A. M., Bollen, J., Zuidema, W., van Rooij, R., & Bockting, C. L. (2023) · Nature · doi:10.1038/d41586-023-00288-7 · Cited by 1,842 · cited 1×
“…such as wiring poems and stories, taking life advice, producing software codes, performing mathematical calculations and statistical analysis as well as translating texts into different languages (Atlas 2023; D’Amico et al. 2023; Karakose 2023; Mhlanga 2023; Scharth 2022; van Dis et al. 2023).”
MethodArtificial hallucinations in ChatGPT: implications in scientific writing
Alkaissi, H., & McFarlane, S. I. (2023) · Cureus · doi:10.7759/cureus.35179 · Cited by 1,540
A SWOT analysis of ChatGPT: Implications for educational practice and research
Farrokhnia, M., Banihashem, S. K., Noroozi, O., & Wals, A. (2024) · Innovations in Education and Teaching International · doi:10.1080/14703297.2023.2195846 · Cited by 1,384
Examining Science Education in ChatGPT: An Exploratory Study of Generative Artificial Intelligence
Cooper, G. (2023) · Journal of Science Education and Technology · doi:10.1007/s10956-023-10039-y · Cited by 1,263 · cited 1×
“…intelligence technologies such as robotic systems, autonomous vehicles, facial recognition, natural language processing, and virtual agents are currently used to solve a wide variety of problems (Berente et al. 2021) and play an important role in the digitalization of societies (Cooper 2023).”
BackgroundChatGPT User Experience: Implications for Education
Zhai, X. (2023) · doi:10.2139/ssrn.4312418 · Cited by 935
Managing artificial intelligence
Berente, N., Gu, B., Recker, J., & Santhanam, R. (2021) · MIS Quarterly · doi:10.25300/misq/2021/16274 · Cited by 898
What ChatGPT and generative AI mean for science
Stokel-Walker, C., & Van Noorden, R. (2023) · Nature · doi:10.1038/d41586-023-00340-6 · Cited by 828
Open AI in Education, the Responsible and Ethical Use of ChatGPT Towards Lifelong Learning
Mhlanga, D. (2023) · doi:10.2139/ssrn.4354422 · Cited by 719 · cited 1×
“…such as wiring poems and stories, taking life advice, producing software codes, performing mathematical calculations and statistical analysis as well as translating texts into different languages (Atlas 2023; D’Amico et al. 2023; Karakose 2023; Mhlanga 2023; Scharth 2022; van Dis et al. 2023).”
MethodOpen AI in Education, the Responsible and Ethical Use of ChatGPT Towards Lifelong Learning
Mhlanga, D. (2023) · Sustainable Development Goals Series · doi:10.1007/978-3-031-37776-1_17 · Cited by 718
ChatGPT in education: Strategies for responsible implementation
Halaweh, M. (2023) · Contemporary Educational Technology · doi:10.30935/cedtech/13036 · Cited by 607
“What Can ChatGPT Do?” Analyzing Early Reactions to the Innovative AI Chatbot on Twitter
Taecharungroj, V. (2023) · Big Data and Cognitive Computing · doi:10.3390/bdcc7010035 · Cited by 489
Lecler, A., Duron, L., & Soyer, P. (2023) · Diagnostic and Interventional Imaging · doi:10.1016/j.diii.2023.02.003 · Cited by 385 · cited 2×
“Another significant concern is about the reliability and accuracy of the responses, which are generated based on the corpus data on which it is trained (Lecler et al. 2023; Sallam 2023; Stokel-Walker and Van Noorden 2023).”
BackgroundMeta-analysis of Cohen’s kappa
Sun, S. (2011) · Health Services and Outcomes Research Methodology · doi:10.1007/s10742-011-0077-3 · Cited by 282
Digital Leadership: A Bibliometric Analysis
Tigre, F. B., Curado, C., & Henriques, P. L. (2023) · Journal of Leadership & Organizational Studies · doi:10.1177/15480518221123132 · Cited by 226
Stokes, F., & Palmer, A. (2020) · Nursing Philosophy · doi:10.1111/nup.12306 · Cited by 200
Engineering Education in the Era of ChatGPT: Promise and Pitfalls of Generative AI for Education
Qadir, J. (2022) · doi:10.36227/techrxiv.21789434 · Cited by 161
Hafiza Hamzah, N., Khalid M. Nasir, M., & Abdul Wahab, J. (2021) · Journal of Education and e-Learning Research · doi:10.20448/journal.509.2021.82.216.221 · Cited by 134
D'Amico, R. S., White, T. G., Shah, H. A., & Langer, D. J. (2023) · Neurosurgery · doi:10.1227/neu.0000000000002414 · Cited by 118
A deeper dive into ChatGPT: history, use and future perspectives for orthopaedic research
Ollivier, M., Pareek, A., Dahmen, J., Kayaalp, M. E., Winkler, P. W., Hirschmann, M. T., & Karlsson, J. (2023) · Knee Surgery, Sports Traumatology, Arthroscopy · doi:10.1007/s00167-023-07372-5 · Cited by 108
Indicators of Digital Leadership in the Context of K-12 Education
Zhong, L. (2017) · Journal of Educational Technology Development and Exchange · doi:10.18785/jetde.1001.03 · Cited by 102
Artificial Intelligence Discusses the Role of Artificial Intelligence in Translational Medicine
Mann, D. L. (2023) · JACC: Basic to Translational Science · doi:10.1016/j.jacbts.2023.01.001 · Cited by 93 · cited 1×
“ChatGPT can continuously improve itself by using the feedback received from its users (Farrokhnia et al. 2023; Mann 2023), and has the ability to find and summarize information retrieved from the internet literature in response to users’ queries (Cascella et al. 2023).”
BackgroundJia, F., Sun, D., Ma, Q., & Looi, C.-K. (2022) · Sustainability · doi:10.3390/su142315527 · Cited by 90
Agustina, R., Kamdi, W., Hadi, S., Muladi, M., & Nurhadi, D. (2020) · International Journal of Learning, Teaching and Educational Research · doi:10.26803/ijlter.19.11.2 · Cited by 43 · cited 2×
“Scholars also stated that school principals had a positive effect on teachers’ willingness for and capability to integrate technology into the classroom (Agustina et al. 2020; Chang 2012).”
BackgroundResultChatgpt for Designing Course Outlines: A Boon or Bane to Modern Technology
Gupta, P. K., Raturi, S., & Venkateswarlu, P. (2023) · doi:10.2139/ssrn.4386113 · Cited by 34
Advances in apparent conceptual physics reasoning in GPT-4
West, C. G. (2023) · arXiv · doi:10.48550/arxiv.2303.17012 · Cited by 16
Cited by
Saif, N., Khan, S. U., Shaheen, I., ALotaibi, F. A., Alnfiai, M. M., & Arif, M. (2024) · Computers in Human Behavior · doi:10.1016/j.chb.2023.108097 · Cited by 301
A systematic review of ChatGPT use in K‐12 education
Zhang, P., & Tur, G. (2024) · European Journal of Education · doi:10.1111/ejed.12599 · Cited by 280
Spennemann, D. H. R. (2023) · Knowledge · doi:10.3390/knowledge3030032 · Cited by 93
Tülübaş, T., Karakose, T., & Papadakis, S. (2023) · European Journal of Investigation in Health, Psychology and Education · doi:10.3390/ejihpe13100143 · Cited by 90
Self-citationKarakose, T., Demirkol, M., Aslan, N., Köse, H., & Yirci, R. (2023) · Educational Process International Journal · doi:10.22521/edupij.2023.123.1 · Cited by 65
Self-citation
Metadata
- Authors
- Karakose, T., Demirkol, M., Yirci, R., Polat, H., Ozdemir, T. Y., & Tülübaş, T.
- Venue
- Administrative Sciences
- Publisher
- MDPI AG
- Published
- 2023-06-24
- Volume
- 13
- Issue
- 7
- Pages
- 157
- ISSN
- 2076-3387 (ISSN-L)
- OpenAlex
- W4382062567
- Cited by
- 86
- References
- 32
- FWCI
- 20.21
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.