Attitudes and Perceptions of Biomedical Journal Editors-in-Chief Towards the Use of Artificial Intelligence Chatbots in the Scholarly Publishing Process: A Cross-Sectional Survey

Abstract

Background: Artificial intelligence chatbots (AICs) are designed to mimic human conversations through text or speech, offering both opportunities and challenges in scholarly publishing. While journal policies of AICs are becoming more defined, there is still a limited understanding of how Editors-in-Chief (EiCs) of biomedical journals’ view these tools. This survey examined EiCs’ attitudes and perceptions, highlighting positive aspects, such as language and grammar support, and concerns regarding setup time, training requirements, and ethical considerations towards the use of AICs in the scholarly publishing process. Methods: A cross-sectional survey was conducted, targeting EiCs of biomedical journals across multiple publishers. Of 3725 journals screened, 3381 eligible emails were identified through web scraping and manual verification. Survey invitations were sent to all identified EiCs. The survey remained open for 5 weeks, with three follow-up email reminders. Results: The survey had a response rate of 16.5% (510 total responses) and a completion rate of 87.0%. Most respondents were familiar with AI chatbots (66.7%), however, most had not utilized chatbots in their editorial work (83.7%) and many expressed interest in further training (64.4%). EiCs acknowledged benefits such as language and grammar support (70.8%) but expressed mixed attitudes on AIC roles in accelerating peer review. Perceptions included the initial time and resources required for setup (83.7%), training needs (83.9%), and ethical considerations (80.6%). Conclusions: This study found that EiCs have mixed attitudes toward AICs, with some EICs acknowledging their potential to enhance editorial efficiency, particularly in tasks like language editing, while others expressed concerns about the ethical implications, the time and resources required for implementation, and the need for additional training.