Using ChatGPT and Other Large Language Model (LLM) Applications for Academic Paper Assignments
Open accessThe DOI matches its Crossref record; 27 of the 27 references it cites were found in a registry or an index; 7 of the 37 sources its claims cite were checked for support.
Abstract
Large language models (LLMs), like ChatGPT, GitHub Copilot, and Microsoft Copilot, present challenges in university education, particularly for paper assignments. These AI-driven tools enable students to (semi)automatically complete tasks that were previously considered evidence of skill acquisition, potentially affecting grading and skill development. However, the use of these tools is not legally considered plagiarism and is becoming increasingly integrated into various software solutions.
Overview
CoChat Summary
TL;DR
This working paper examines how ChatGPT/GPT-4 and other LLMs can support or undermine academic paper assignments, using digital misinformation and German elections as a running example. It argues LLMs are useful for exploration, structuring, hypotheses, and research questions but remain unreliable for case-specific, operationalization, data-analysis, and source-verification tasks.
Key findings
- ChatGPT/GPT-4 helped generate overviews, potential hypotheses, research questions, and theory lists; for example, it produced five testable hypotheses and linked them to theories such as issue voting, political trust, agenda-setting, political efficacy, and contextual voting.
- Performance declined as requests became more specific: for the German Federal Election 2021 and 2017, outputs remained general and not specific to the German context; GPT-4’s knowledge cutoff was September 2021, limiting analysis of the 2021 election.
- References can be plausible but not support the cited claims: in one response all listed sources existed, but Bordino et al. (2012) and Vosoughi et al. (2018) did not cover the economic consequences of misinformation as cited.
- LLM use is not legally considered plagiarism and is becoming integrated into software; the paper recommends responsible use, disclosure of AI use, and grading emphasis on tasks where models perform poorly.
Methods
- Conceptual/working paper offering guidelines for students at the Chair for the Governance of Complex and Innovative Technological Systems, University of Bamberg; no empirical sample or systematic benchmark is reported.
- The author ran prompts through the ChatGPT web interface using the GPT-4 model on March 18 and 19, 2023, with digital misinformation and German Federal Elections 2017/2021 as the running example; responses are described as non-deterministic and path-dependent.
- Analysis is a qualitative evaluation of model outputs across academic paper tasks: investigating literature, linking a case to a broader category, generating theory-driven hypotheses, formulating research questions, operationalizing expectations, conducting data analysis, and structuring/writing the paper.
Limitations
- Stated: the notes apply specifically to students at the Chair at the University of Bamberg, and other educators may have different guidelines; prompts and responses are non-deterministic and may not replicate.
- Stated: the paper focuses on academic paper assignments rather than broader LLM issues, and it uses one model/version and one example topic.
- Evident: there is no systematic coding, inter-rater reliability, or controlled comparison; conclusions rest on the author’s illustrative prompt sessions and may not generalize to other models, disciplines, or assignments.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
6 Valid · 27 Not valid · 15 Not checked · 117 Own results and interpretations
A result the paper states — it cites no source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“However, the model was less successful in accounting for the conditions of specific cases.”
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
In the paper
“However, the use of these tools is not legally considered plagiarism”
- Also stated in: § 1 Tensions in the use of ChatGPT and other large language model (LLM) applications for academic paper assignments · plain
“their use does not currently qualify as plagiarism (Salden & Leschke, 2023)”
What the sources say
- Not matchedcites Salden & Leschke, 2023
An author–year citation the paper’s reference list doesn’t settle. We don’t search these by name.
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Also stated in: § 1 Tensions in the use of ChatGPT and other large language model (LLM) applications for academic paper assignments · plain
In the paper
“and is becoming increasingly integrated into various software solutions.”
- Also stated in: § 1 Tensions in the use of ChatGPT and other large language model (LLM) applications for academic paper assignments · plain
“they are becoming an integral part of various industries. 4”
What the sources say
- Not matchedcites [4]
The reference list we hold has no entry [4].
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Also stated in: § 1 Tensions in the use of ChatGPT and other large language model (LLM) applications for academic paper assignments · plain
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“However, with applications like ChatGPT, students can now bypass these tasks, relying on LLMs to generate components of their written assignments.”
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: unclear — It is unclear why the paper says it holds.
None of the sources cited for this claim have been checked yet.
In the paper
“Learning these skills requires repeated practice, typically through written assignments.”
What the sources say
- Not checked — no full text of the sourcecites Gooblar, 2019
- Not matchedcites Lang, 2021
An author–year citation the paper’s reference list doesn’t settle. We don’t search these by name.
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
12 more claims
Create a free account to see all 165 claims and every source verdict.
- Probably not a substantial claim. 146
- It may state two separate claims as one. 49
Citations
Cites
Exploiting Generative AI to Scale up Intelligent Tutoring Systems
Jakubův, J., Chvalovský, K., Goertzel, Z., Kaliszyk, C., Olšák, M., Piotrowski, B., Schulz, S., Suda, M., & Urban, J. (2023) · DROPS (Schloss Dagstuhl – Leibniz Center for Informatics) · doi:10.4230/lipics.itp.2023.19 · Cited by 76,658
Language Models are Few-Shot Learners
Brown, T. B., Mann, B., Ryder, N., Subbiah, M., Kaplan, J., Dhariwal, P., Neelakantan, A., Shyam, P., Sastry, G., Askell, A., et al. (2020) · arXiv · doi:10.48550/arxiv.2005.14165 · Cited by 23,372
Kaugeranna, R., Kaugeranna, E., & Aion, (. S. 4. 6. (2023) · DROPS (Schloss Dagstuhl – Leibniz Center for Informatics) · doi:10.4230/lipics.giscience.2023.43 · Cited by 13,690
On the Dangers of Stochastic Parrots: Can Language Models Be Too Big? 🦜
Bender, E. M., Gebru, T., McMillan-Major, A., & Shmitchell, S. (2021) · Proceedings of the 2021 ACM Conference on Fairness, Accountability, and Transparency · doi:10.1145/3442188.3445922 · Cited by 6,988
Energy and Policy Considerations for Deep Learning in NLP
Strubell, E., Ganesh, A., & McCallum, A. (2019) · arXiv · doi:10.48550/arxiv.1906.02243 · Cited by 3,735
Energy and Policy Considerations for Deep Learning in NLP
Strubell, E., Ganesh, A., & McCallum, A. (2019) · Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics · doi:10.18653/v1/p19-1355 · Cited by 3,684
Gebru, T., Morgenstern, J., Vecchione, B., Vaughan, J. W., Wallach, H., Daumé, H., & Crawford, K. (2018) · arXiv · doi:10.48550/arxiv.1803.09010 · Cited by 2,474
Gebru, T., Morgenstern, J., Vecchione, B., Vaughan, J. W., Wallach, H., III, H. D., & Crawford, K. (2021) · Communications of the ACM · doi:10.1145/3458723 · Cited by 2,469
(1998) · Padova Digital University Archive (Ateneo di Padova) · Cited by 968
Tricks of the Trade: How to Think about Your Research While You're Doing It
Becker, H. S. (1998) · University of Chicago Press eBooks · doi:10.7208/chicago/9780226040998.001.0001 · Cited by 925
Research works printed but not linked: 2
- Becker, H. S. (2020). Writing for social scientists: How to start and finish your thesis, book, or article (3rd ed.). University of Chicago Press.
- Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A. N., Kaiser, L., & Polosukhin, I. (2017). Attention is all you need. In I. Guyon, U. von Luxburg, S. Bengio, H. Wallach, R. Fergus, S. V. N. Vishwanathan, & R. Garnett (Eds.), Nips 2017: 31st conference on neural information processing systems (pp. 1-11, Vol. 30). Curran Associates, Inc. https : / / proceedings . neurips . cc / paper / 2017 / file / 3f5ee243547dee91fbd053c1c4a845aa-Paper.pdf
Cited by
Chauncey, S. A., & McKenna, H. P. (2023) · Computers and Education: Artificial Intelligence · doi:10.1016/j.caeai.2023.100182 · Cited by 91
Exploring the frontiers of LLMs in psychological applications: a comprehensive review
Ke, L., Tong, S., Cheng, P., & Peng, K. (2025) · Artificial Intelligence Review · doi:10.1007/s10462-025-11297-5 · Cited by 148
Perceptions and detection of AI use in manuscript preparation for academic journals
Chemaya, N., & Martin, D. (2024) · PLOS ONE · doi:10.1371/journal.pone.0304807 · Cited by 54
The imitation game: Detecting human and AI-generated texts in the era of ChatGPT and BARD
Hayawi, K., Shahriar, S., & Mathew, S. S. (2024) · Journal of Information Science · doi:10.1177/01655515241227531 · Cited by 55
Ülkü, A. (2023) · Tourism & Management Studies · doi:10.18089/tms.2023.190402 · Cited by 48
Shah, S. B., Thapa, S., Acharya, A., Rauniyar, K., Poudel, S., Jain, S., Masood, A., & Naseem, U. (2025) · IEEE Access · doi:10.1109/access.2024.3406644 · Cited by 39
Zhu, Y., Zhu, C., Wu, T., Wang, S., Zhou, Y., Chen, J., Wu, F., & Li, Y. (2025) · Education and Information Technologies · doi:10.1007/s10639-024-12898-3 · Cited by 33
Lang, G., & Gürpinar, T. (2025) · Information Systems Education Journal · doi:10.62273/zklk5988 · Cited by 20
Wang, J., Huang, C., Yan, S., Xie, W., & He, D. (2024) · International Journal of Human-Computer Interaction · doi:10.1080/10447318.2024.2352919 · Cited by 26
DistilBERT: A Novel Approach to Detect Text Generated by Large Language Models (LLM)Preprint
Kumar, B. P., Ahmed, M. S., & Sadanandam, M. (2024) · Research Square · doi:10.21203/rs.3.rs-3909387/v1 · Cited by 19
Zhang, M. (2025) · Frontiers in Psychology · doi:10.3389/fpsyg.2025.1641212 · Cited by 21
ChatGPT Hallucinates Nonexistent Citations: Evidence from Economics
Buchanan, J., Hill, S., & Shapoval, O. (2023) · doi:10.2139/ssrn.4632842 · Cited by 8
Isop, W. A. (2025) · Frontiers in Artificial Intelligence · doi:10.3389/frai.2024.1377938 · Cited by 17
Dilling, M., & Owen, L. (2024) · Journal of Political Science Education · doi:10.1080/15512169.2024.2408767 · Cited by 6
Uzun, L. (2023) · Digital Society · doi:10.1007/s44206-023-00070-2 · Cited by 11
ChatGPT y la redacción académica en universitarios
Paredes, S. A. R., & Ledesma-Pérez, F. (2025) · Edutec Revista Electrónica de Tecnología Educativa · doi:10.21556/edutec.2025.92.3431 · Cited by 9
Students' opinions on the possibilities and limitations of using the ChatGPT system
Cabała, P., Kwiatkowska, K., Woźniak, K., & Zakrzewska, M. (2023) · e-mentor · doi:10.15219/em102.1638 · Cited by 8
Jhonnerie, R., Oktorini, Y., Darlis, V. V., Pebriandi, P., Prianto, E., Fatmawati, R., Nofrizal, N., Ramses, R., Miswadi, M., & Rahmatdillah, R. (2024) · BIO Web of Conferences · doi:10.1051/bioconf/202413603002 · Cited by 6
Zhou, Y., Si, M., & Doll, J. (2024) · Communications in computer and information science · doi:10.1007/978-3-031-78561-0_17 · Cited by 2
A Review on Conversational AI as a Tool in Academic Writing
Demiröz, H., & Tıkız‐Ertürk, G. (2025) · Eskiyeni (Online)/Eskiyeni · doi:10.37697/eskiyeni.1565854 · Cited by 6
Digitale Leistungsnachweise im Zeitalter von generativer künstlicher Intelligenz
MacKevett, D., Feubli, P., & Rast, V. (2024) · Zeitschrift für Hochschulentwicklung · doi:10.21240/zfhe/19-2/09 · Cited by 2
Gpt-3.5 Hallucinates Nonexistent Citations: Evidence from EconomicsPreprint
Buchanan, J. A., & Shapoval, O. (2023) · SSRN Electronic Journal · doi:10.2139/ssrn.4472220 · Cited by 3
REVOLUTIONIZE THE POTENTIAL OF CHATGPT AS TEACHING MATERIAL TO ENGAGE STUDENTS IN LEARNING
Rasyid, A. R., Yakin, A. M. A., Muthmainnah, M., Bin-Tahir, S. Z., & Obaid, A. J. (2024) · Lentera Pendidikan Jurnal Ilmu Tarbiyah dan Keguruan · doi:10.24252/lp.2024v27n1i1 · Cited by 1
Exploring VR and AI Adoption With Microsoft Copilot
Menon, V. A., Thomas, J., Thomas, L. P., Kunnumpurath, B., & Mathew, R. (2024) · Advances in educational technologies and instructional design book series · doi:10.4018/979-8-3693-6407-9.ch009 · Cited by 2
PeerSynergy: An Innovative Application Applying Large Language Model to Peer Instruction
Sam, K.-L., Ieong, U.-S., & da Costa, M. G. (2024) · IEEE International Conference on Teaching, Assessment, and Learning for Engineering · doi:10.1109/tale62452.2024.10834348 · Cited by 2
GPT-3.5 Hallucinates Nonexistent Citations: Evidence from EconomicsPreprint
Buchanan, J. A., & Shapoval, O. (2023) · SSRN Electronic Journal · doi:10.2139/ssrn.4467968 · Cited by 2
The Old Meets the New: “Old” Political Communication Concepts in a “‘New” Social Media Era
Salgado, S., Biscaia, A., & Papathanassopoulos, S. (2023) · Springer studies in media and political communication · doi:10.1007/978-3-031-45335-9_1 · Cited by 1
CHATGPT AND CREATIVE THINKING IN UNIVERSITY STUDENTS
Gonzales, J. D. R. (2024) · doi:10.53555//zenodo.7546575 · Cited by 1
CHATGPT AND CREATIVE THINKING IN UNIVERSITY STUDENTS
Gonzales, J. D. R. (2024) · doi:10.53555/zenodo.7546575
Measuring Chinese online populist discourse: an automated semantic text analysis method
Tao, Y., Zhan, Z., Zhou, H., Kang, J., & Sun, S. (2024) · Chinese Journal of Communication · doi:10.1080/17544750.2024.2420622 · Cited by 7
Leveraging LLMs for Fair Data Labeling and Validation in Crowdsourcing Environments [Vision Paper]
Serouis, I. M., & Sèdes, F. (2024) · IEEE International Conference on Big Data (BigData) · doi:10.1109/bigdata62323.2024.10825193 · Cited by 1
When understanding and remembering are important, it is TextWise to summarize what you read
Schneider, J., Limbu, B. H., Schiffner, D., Jäckel, Y., & Khuc, S. (2025) · International Conference on Education Technology and Computer · doi:10.1109/icetc66579.2025.11387104
van Heerden, K. (2026) · Springer eBooks · doi:10.1007/978-3-032-21685-4_12
Comparative Analysis of Neural Architectures and Hybrid Approach for AI-Generated Text Detection
Assylkhan, A., & Biloshchytska, S. (2026) · IEEE International Conference on Smart Information Systems and Technologies (SIST) · doi:10.1109/sist61674.2026.11596221
Metadata
- Authors
- Jungherr, A.
- Affiliations
- University of Bamberg (DE)
- Corresponding author
- Jungherr, Andreas
- ORCID
- Jungherr, Andreas
- Publisher
- Center for Open Science
- Published
- 2023-03-24
- OpenAlex
- W4360939370
- Cited by
- 37
- References
- 20
- Citations by year
- 2026: 2 · 2025: 8 · 2024: 19 · 2023: 8
- Type
- posted content
- Language
- en
- Open access
- gold
- doi.org
- Locations
- SocArXiv (OSF Preprints) (submittedVersion)
- SocArXiv (OSF Preprints) (submittedVersion, cc-by-nc-sa)
- Topics
- Social Sciences › Education › Artificial Intelligence in Education
- Social Sciences › Education › Academic integrity and plagiarism
- Health Sciences › Medicine › Health Informatics › Artificial Intelligence in Healthcare and Education
- Keywords
- large language models, ChatGPT, academic writing, research paper assignment, responsible AI use, student plagiarism, academic integrity, social studies education
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
The claim verdicts this report counts are experimental: their accuracy is not yet measured.
A language model drew the claims from the paper on 2026-10-04, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-10-04 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.