The DOI matches its Crossref record; 103 of the 103 references it cites were found in a registry or an index; 16 of the 87 sources its claims cite were checked for support.
Navigating the perils of artificial intelligence: a focused review on ChatGPT and responsible research and innovation
Open accessAbstract
While the rise of artificial intelligence (AI) tools holds promise for delivering benefits, it is important to acknowledge the associated risks of their deployment. In this article, we conduct a focused literature review to address two central research inquiries concerning ChatGPT and similar AI tools. Firstly, we examine the potential pitfalls linked with the development and implementation of ChatGPT across the individual, organizational, and societal levels. Secondly, we explore the role of a multi-stakeholder responsible research and innovation framework in guiding chatbots’ sustainable development and utilization. Drawing inspiration from responsible research and innovation and stakeholder theory principles, we underscore the necessity of comprehensive ethical guidelines to navigate the design, inception, and utilization of emerging AI innovations. The findings of the focused review shed light on the potential perils of ChatGPT implementation across various societal levels, including issues such as devaluation of relationships, unemployment, privacy concerns, bias, misinformation, and digital inequities. Furthermore, the proposed multi-stakeholder Responsible Research and Innovation framework can empower AI stakeholders to proactively anticipate and deliberate upon AI’s ethical, social, and environmental implications, thus substantially contributing to the pursuit of responsible AI implementation.
Overview
CoChat Summary
TL;DR
This focused review maps the perils of ChatGPT and similar AI tools at individual, organizational, and societal levels and proposes a multi-stakeholder Responsible Research and Innovation framework to guide ethical and sustainable chatbot development. It argues that anticipation, inclusiveness, reflexivity, and responsiveness, aligned with values such as safety, privacy, sustainability, quality of life, and gender equality, can help stakeholders proactively address AI’s ethical, social, and environmental implications.
Key findings
- The review identifies perils across three levels: individual (misinformation/disinformation, privacy and security concerns, emotional/psychological harm, devalued relationships and alienation), organizational (labor-market instability, job displacement, cybersecurity and phishing risks, confidentiality and legal risks, copyright/intellectual-labor theft, brand and customer-loyalty risks), and societal (education and research integrity, reduced student creativity, examination integrity, publishing ethics, digital inequities, and healthcare errors, privacy concerns, and ethical/legal dilemmas).
- It proposes a multi-stakeholder Responsible Research and Innovation framework involving the AI innovator, regulators, and direct/indirect stakeholders, with feedback loops and the dimensions anticipation, inclusiveness, reflexivity, and responsiveness; the framework aligns with values including safety, privacy, sustainability, quality of life, and gender equality, with transparency as an overarching value.
- The paper notes that ethical guidelines alone may not alter developers’ decision-making, citing McNamara et al. (2018), who found no statistically significant difference in participants’ ethical decision-making responses whether or not they saw a code of ethics.
- The literature search began with 1892 records, retained 118 after criteria, removed 58 duplicates, and after a cited/snowball search resulted in a final pool of 72 articles.
Methods
- A focused literature review was conducted, described as a concise examination of the most relevant literature rather than an exhaustive or bibliometric analysis.
- Searches used Scopus and Google Scholar with keyword combinations such as “ChatGPT AND responsible research and innovation,” “artificial intelligence AND responsible research and innovation,” “chatbot AND responsible research and innovation,” “ChatGPT AND perils,” “ChatGPT AND challenges,” and “ChatGPT AND implications.”
- Inclusion criteria were English-language literature published 2011–2023, full-text articles assessed for eligibility, and academic journal or conference papers; noninternational journals, preprints, and non-peer-reviewed papers were excluded. The final 72 articles were synthesized to map perils (RQ1) and propose a multi-stakeholder Responsible Research and Innovation framework (RQ2).
Limitations
- Stated limitations: Not stated in the paper.
- Limitations evident from the text: the review is not exhaustive and concentrates only on literature the authors judged most relevant; final selection was based on the authors’ opinion; it did not use bibliometric or quantitative citation/publication-trend analysis; and the proposed framework is conceptual and not empirically tested, with the authors calling for future empirical studies on Responsible Research and Innovation ecosystems and stakeholder engagement.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
10 Valid · 2 Not valid · 51 Not checked · 29 Own results and interpretations
Every source the paper cites for this claim was checked and supports it.
In the paper
“ChatGPT in specific, has been found to corrupt rather than improve moral judgment (Krügel, et al., 2023).”
§ Navigating the perils of artificial intelligence: a focused review on ChatGPT and responsible research and innovation > Introduction
What the sources say
- Supportedcites Krügel, et al., 2023 source
The Abstract states the conclusion verbatim: 'Thus, ChatGPT corrupts rather than improves its users’ moral judgment,' based on an experiment with US residents advised on a trolley dilemma. The Discussion repeats it ('ChatGPT threatens to corrupt rather than promises to improve moral judgment'), grounding it in inconsistent advice, influence on judgment, and users' underestimation of that influence (Results, Figs. 2-3). The citing paraphrase matches the source's own framing, with no qualifier dropped. (LLM, conf=0.92)
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Supported
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“Such adverse consequences of advanced AI tools such as ChatGPT have triggered an ongoing debate about the need to establish a set of principles to effectively regulate and monitor AI development and use (Arrieta et al., 2020;Fjeld et al., 2020;Mikalef et al., 2022).”
§ Navigating the perils of artificial intelligence: a focused review on ChatGPT and responsible research and innovation > Findings
What the sources say
- Partly supportedcites Arrieta et al., 2020 sourceExperimental — accuracy not yet measured
Section 6 (p. 36) says AI principles address potential threats to individuals and society and guide how AI is developed and used; section 6.2.2 (p. 40) discusses auditing and assessing negative impacts. The paper does not attribute the debate over those principles to adverse consequences of ChatGPT or similar tools, so that causal and tool-specific part is unsupported. (LLM, conf=0.86)
- Not checked yetcites Fjeld et al., 2020
- Partly supportedcites Mikalef et al., 2022 sourceExperimental — accuracy not yet measured
The Introduction (page unavailable) says adverse outcomes of AI use sparked an ongoing debate about principles for governing AI. Section 2 (page unavailable) gives the chatbot Tay as an example, but the passages do not identify ChatGPT or its consequences as a trigger for that debate. (LLM, conf=0.85)
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Partly supported
Every source the paper cites for this claim was checked and supports it.
In the paper
“Nonetheless, ethical guidelines do not necessarily alter the individual (developers') decision-making (Hagendorff, 2020).”
§ Navigating the perils of artificial intelligence: a focused review on ChatGPT and responsible research and innovation > Findings
What the sources say
- Supportedcites Hagendorff, 2020 source
Section 3.3 'Ethics in Practice' asks whether guidelines change individual decision-making and reports that the effectiveness of ethics codes is 'almost zero', quoting McNamara et al. 2018: 'No statistically significant difference in the responses for any vignette were found across individuals who did and did not see the code of ethics, either for students or for professionals.' The Conclusion (S.5) states the paper's own uptake of this: 'empirical experiments show that reading ethics guidelines has no significant influence on the decision-making of software developers.' The citing sentence is hedged ('do not necessarily alter'), weaker than what the source asserts, so it is supported; the underlying controlled study is McNamara et al. 2018, but Hagendorff reports and relies on the result as her own evidence rather than merely crediting it. (LLM, conf=0.90)
hedged- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Supported
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“Advanced AI tools like ChatGPT are also poised to significantly impact the healthcare sector (Ali et al., 2023;Patel et al., 2023;Sallam, 2023).”
§ Navigating the perils of artificial intelligence: a focused review on ChatGPT and responsible research and innovation > Findings
What the sources say
- Partly supportedcites Ali et al., 2023 sourceExperimental — accuracy not yet measured
The Research implications section (p. 15) describes cutting-edge AI solutions as a next generation of digital health tools being adopted in healthcare, supporting the broad prediction of substantial impact. The paper does not address ChatGPT specifically, so it does not support that example. (LLM, conf=0.82)
- Supportedcites Patel et al., 2023 source
The editorial’s health-care discussion describes potential clinical uses of ChatGPT, including automating discharge summaries and simplifying radiology reports, while warning that errors would require manual checks. Its conclusion calls ChatGPT a “game changer,” supporting the broad claim that it could significantly affect health care. Page numbers are not supplied in our copy. (LLM, conf=0.89)
- Supportedcites Sallam, 2023 source
The Discussion (§4.3) says ChatGPT and other large language models have transformative potential in healthcare practice, including diagnostics, clinical workflows, and drug discovery. The Conclusions (§5) describe their potential in clinical decision-making and workflow optimization as substantial, while urging caution. No page numbers are provided in our copy. (LLM, conf=0.91)
plainstates a possible cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Partly supported
Every source the paper cites for this claim was checked and supports it.
In the paper
“Given the nascent stage of AI ethics, there is a need to devise frameworks for AI advancements to incorporate ethical considerations (Lo Piano, 2020).”
§ Navigating the perils of artificial intelligence: a focused review on ChatGPT and responsible research and innovation > Discussion and implications
What the sources say
- Supportedcites Lo Piano, 2020 source
The Discussion and conclusions section states plainly that 'the field of AI ethics is just at its infancy and it is still to be conceptualised how AI developments that encompass ethical dimensions could be attained', which carries both halves of the paraphrase: the nascent stage and the resulting need to work out (devise) how ethical considerations get built into AI development. The same section's call to be open to negotiation across frictions between dimensions, and the paper's stated aim (Introduction) to 'discuss actions towards the inclusion of these dimensions in the future of AI ethics', reinforce the need-for-frameworks reading rather than contradict it. (LLM, conf=0.90)
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Supported
13 more claims
Create a free account to see all 92 claims and to verify the 71 references still open.
- It may state two separate claims as one. 33
- Probably not a substantial claim. 52
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The check wasn’t confident either way, so it gives no verdict — never disputed.
In the citing paper
“Previous research on jailbreaking has primarily explored its implications in the context of catastrophic risks in the general domain—cases where models are manipulated to produce extreme content, such as violence, hate speech, or other harmful material25–27.”
From When helpfulness backfires: LLMs and the risk of false medical information due to sycophantic behavior (2025) · cites this paper as [25]
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
Each contradiction between two passages listed here was confirmed by an independent check.
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
§ Navigating the perils of artificial intelligence: a focused review on ChatGPT and responsible research and innovation > Conclusion
“Stilgoe & Guston (2016)”
§ Navigating the perils of artificial intelligence: a focused review on ChatGPT and responsible research and innovation > References
“91. Stilgoe J, Guston D (2017) Responsible research and innovation.”
Citations
Cites
Arrieta, A. B., Díaz-Rodríguez, N., Del Ser, J., Bennetot, A., Tabik, S., Barbado, A., García, S., Gil-López, S., Molina, D., Benjamins, R., et al. (2019) · arXiv · doi:10.48550/arxiv.1910.10045 · Cited by 11,321
Barredo Arrieta, A., Díaz-Rodríguez, N., Del Ser, J., Bennetot, A., Tabik, S., Barbado, A., Garcia, S., Gil-Lopez, S., Molina, D., Benjamins, R., et al. (2020) · Information Fusion · doi:10.1016/j.inffus.2019.12.012 · Cited by 10,423
Mitchell, R. K., Agle, B. R., & Wood, D. J. (1997) · The Academy of Management Review · doi:10.2307/259247 · Cited by 5,039
Dwivedi, Y. K., Hughes, L., Ismagilova, E., Aarts, G., Coombs, C., Crick, T., Duan, Y., Dwivedi, R., Edwards, J., Eirug, A., et al. (2021) · International Journal of Information Management · doi:10.1016/j.ijinfomgt.2019.08.002 · Cited by 4,611
Dwivedi, Y. K., Kshetri, N., Hughes, L., Slade, E. L., Jeyaraj, A., Kar, A. K., Baabdullah, A. M., Koohang, A., Raghavan, V., Ahuja, M., et al. (2023) · International Journal of Information Management · doi:10.1016/j.ijinfomgt.2023.102642 · Cited by 4,584
Strategic Management: A Stakeholder Approach
Freeman, R. E. (2010) · Cambridge University Press eBooks · doi:10.1017/cbo9781139192675 · Cited by 4,494
Developing a framework for responsible innovation
Stilgoe, J., Owen, R., & Macnaghten, P. (2013) · Research Policy · doi:10.1016/j.respol.2013.05.008 · Cited by 3,184
Sallam, M. (2023) · Healthcare · doi:10.3390/healthcare11060887 · Cited by 3,126
Who Benefits from State and Local Economic Development Policies?
Bartik, T. J. (1991) · doi:10.17848/9780585223940 · Cited by 2,643
What if the devil is my guardian angel: ChatGPT as a case study of using chatbots in education
Tlili, A., Shehata, B., Adarkwah, M. A., Bozkurt, A., Hickey, D. T., Huang, R., & Agyemang, B. (2023) · Smart Learning Environments · doi:10.1186/s40561-023-00237-x · Cited by 2,003
Research works printed but not linked: 11
- Adner R (2017) Ecosystem as structure: an actionable construct for strategy. J Manag 43(1):39–58
- Agboola AO (2015) Neoclassical economics and new institutional economics: An assessment of their methodological implication for property market analysis. Prop Manag 33(5):412–429
- Atkins S, Badrie I, van Otterloo S (2021) Applying ethical AI frameworks in practice: Evaluating conversational AI chatbot solutions. Comput Soc Res J 1:1–6
- European Commission (2013) Directorate-General for Research and Innovation. Options for strengthening responsible research and innovation: report of the Expert Group on the State of Art in Europe on Responsible Research and Innovation. Publications Office. Retrieved on 4/4/2023 from https://data.europa.eu/doi/10.2777/46253 · doi:10.2777/46253
- Luo X, Tong S, Fang Z, Qu Z (2019) Frontiers: machines vs. humans: the impact of artificial intelligence chatbot disclosure on customer purchases. Mark Sci 38(6):937–947
- Mijwil M, Aljanabi M (2023) Towards artificial intelligence-based cybersecurity: the practices and ChatGPT generated ways to combat cybercrime. Iraqi J Comput Sci Math 4(1):65–70
- Nielsen MV (2016) The concept of responsiveness in the governance of research and innovation. Sci Public Policy 43(6):831–839
- Perkins M (2023) Academic Integrity considerations of AI Large Language Models in the post-pandemic era: ChatGPT and beyond. J Univ Teach Learn Pract 20(2):07
- Polyportis A (2020) Incidental emotions and hedonic forecasting: the role of the certainty-uncertainty appraisal dimension. PhD thesis. Athens University of Economics and Business, Greece. Retrieved on 22/4/2023 from https://www.didaktorika.gr/eadd/handle/10442/47930
- Stilgoe J, Guston D (2017) Responsible research and innovation. In Felt U, Fouché R, Miller CA, Smith-Doerr L (eds) The handbook of science and technology studies. The MIT Press. pp. 853–880
- Strowel A (2023) ChatGPT and generative AI tools: theft of intellectual labor? IIC Int Rev Intellect Prop Compet Law 54(4):491–494
Cited by
Sun, Y., Sheng, D., Zhou, Z., & Wu, Y. (2024) · Humanities and Social Sciences Communications · doi:10.1057/s41599-024-03811-x · Cited by 327
Polyportis, A., & Pahos, N. (2025) · Behaviour & Information Technology · doi:10.1080/0144929x.2024.2317364 · Cited by 194
Self-citationChen, S., Gao, M., Sasse, K., Hartvigsen, T., Anthony, B., Fan, L., Aerts, H., Gallifant, J., & Bitterman, D. S. (2025) · npj Digital Medicine · doi:10.1038/s41746-025-02008-z · Cited by 112
Andrade-Girón, D., Rodriguez, W. J. M., Sandivar-Rosas, J., Carreño-Cisneros, E., Ramírez, E. T. S., Zúñiga-Rojas, M. G., Ángeles-Morales, J., & Villarreal-Torres, H. (2024) · Iberoamerican Journal of Science Measurement and Communication · doi:10.47909/ijsmc.101 · Cited by 85
Strzelecki, A. (2024) · Learned Publishing · doi:10.1002/leap.1650 · Cited by 34
Metadata
- Authors
- Polyportis, A., & Pahos, N.
- Affiliations
- Delft University of Technology (NL)
- Corresponding author
- Polyportis, Athanasios
- Venue
- Humanities and Social Sciences Communications
- Published
- 2024-01-15
- Volume
- 11
- Issue
- 1
- ISSN
- 2055-1045 (ISSN-L)
- 2662-9992
- OpenAlex
- W4390875484
- Semantic Scholar
- 4cbb1415fcea2b0a62c7630822400b0608858422
- Cited by
- 64
- References
- 100
- Citations by year
- 2026: 20 · 2025: 23 · 2024: 21
- FWCI
- 26.65
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- cc-by
- creativecommons.org/licenses/by/4.0 (tdm)
- creativecommons.org/licenses/by/4.0 (vor)
- Locations
- Humanities and Social Sciences Communications (publishedVersion, cc-by)
- RePEc: Research Papers in Economics (submittedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Research Repository (Delft University of Technology) (submittedVersion, cc-by)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Ethics and Social Impacts of AI
- Physical Sciences › Computer Science › Artificial Intelligence › Artificial Intelligence Applications
- Social Sciences › Sociology and Political Science › Innovation, Technology, and Society
- Keywords
- ChatGPT, responsible research and innovation, AI ethics, multi-stakeholder framework, stakeholder theory, AI risks, unemployment, privacy concerns, algorithmic bias, misinformation, digital inequality, responsible AI deployment
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
The claim verdicts this report counts are experimental: their accuracy is not yet measured.
A language model drew the claims from the paper on 2026-10-06, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-10-06 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Cited sources are checked with a language model’s help (qwen3.8-omni-flash and gpt-6-sol).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Navigating the perils of artificial intelligence: a focused review on ChatGPT and responsible research and innovation. https://app.cochat.ai/papers/10.1057/s41599-023-02464-6
- The paper
- Polyportis, A., & Pahos, N. (2024). Navigating the perils of artificial intelligence: a focused review on ChatGPT and responsible research and innovation. Humanities and Social Sciences Communications. https://doi.org/10.1057/s41599-023-02464-6
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.