Ethical Chatbot Design for Reducing Negative Effects of Biased Data and Unethical Conversations
Abstract
AI technology is being introduced into various public and private service domains, transforming existing computing systems or creating new ones. While AI technologies can provide benefits to humans and society, the unexpected consequences (e.g., malfunctions) of AI systems can cause social losses. For this reason, research on ethical design for the development of AI-based systems is becoming important. In this paper, from existing studies on AI ethics, general guidelines such as transparency, explainability, predictability, accountability, fairness, privacy, and control for the ethical design of AI systems are reviewed. And, based on the ethical design guidelines, we discuss ethical design to reduce the negative effects of biased data and unethical dialogues in AI-based conversational chatbots.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Some customer service chatbots show biased responses to users who speak certain language dialects.
“However, some customer service chatbots show biased responses to users who speak certain language dialects [297-299].”
From AI Fairness in Data Management and Analytics: A Review on Challenges, Methodologies and Applications (2023) · cites this paper as [297]
Cites
The global landscape of AI ethics guidelines
Jobin, A., Ienca, M., & Vayena, E. (2019) · Nature Machine Intelligence · doi:10.1038/s42256-019-0088-2 · Cited by 6,220 · see citing works
Gebru, T., Morgenstern, J., Vecchione, B., Vaughan, J. W., Wallach, H., Daumé, H., & Crawford, K. (2018) · arXiv · doi:10.48550/arxiv.1803.09010 · Cited by 2,474
Gebru, T., Morgenstern, J., Vecchione, B., Vaughan, J. W., Wallach, H., III, H. D., & Crawford, K. (2021) · Communications of the ACM · doi:10.1145/3458723 · Cited by 2,469 · see citing works
MOOR, J. H. (1985) · Metaphilosophy · doi:10.1111/j.1467-9973.1985.tb00173.x · Cited by 863 · see citing works
How AI can be a force for good
Taddeo, M., & Floridi, L. (2018) · Science · doi:10.1126/science.aat5991 · Cited by 760 · see citing works
Lo Piano, S. (2020) · Humanities and Social Sciences Communications · doi:10.1057/s41599-020-0501-9 · Cited by 229 · see citing works
Contextual Integrity Up and Down the Data Food Chain
Nissenbaum, H. F. (2019) · Theoretical Inquiries in Law · doi:10.1515/til-2019-0008 · Cited by 138 · see citing works
Deep Learning for Deepfakes Creation and Detection: A Survey
Nguyen, T. T., Nguyen, M. C., Nguyen, D. T., Nguyen, D. T., & Nahavandi, S. (2020) · Figshare · doi:10.6084/m9.figshare.12731039.v1 · Cited by 122 · see citing works
A survey on ethical principles of AI and implementations
Zhou, J., Chen, F., Berry, A., Reed, M., Zhang, S., & Savage, S. (2020) · 2020 IEEE Symposium Series on Computational Intelligence (SSCI) · doi:10.1109/ssci47803.2020.9308437 · Cited by 99 · see citing works
The Current State of Industrial Practice in Artificial Intelligence Ethics
Vakkuri, V., Kemell, K., Kultanen, J., & Abrahamsson, P. (2020) · IEEE Software · doi:10.1109/ms.2020.2985621 · Cited by 98 · see citing works
A Machine Learning Approach to Prevent Malicious Calls over Telephony Networks
Li, H., Xu, X., Liu, C., Ren, T., Wu, K., Cao, X., Zhang, W., Yu, Y. H., & Song, D. X. (2018) · IEEE Symposium on Security and Privacy (S&P) · doi:10.1109/sp.2018.00034 · Cited by 57 · see citing works
Ethics for Big Data and Analytics
O’Leary, D. E. (2016) · IEEE Intelligent Systems · doi:10.1109/mis.2016.70 · Cited by 52 · see citing works
Designing a Value-Driven Future for Ethical Autonomous and Intelligent Systems
Adamson, G., Havens, J. C., & Chatila, R. (2019) · Proceedings of the IEEE · doi:10.1109/jproc.2018.2884923 · Cited by 52 · see citing works
From Principles to Practice. An interdisciplinary framework to operationalise AI ethics.
Hallensleben, S., Fetic, L., Fleischer, T., Grünke, Hagendorff, T., Hauer, M. P., Hauschke, A., Heesen, J., Herrmann, M., Hillerbrand, R., et al. (2020) · Cited by 52 · see citing works
Morley, J., Floridi, L., Kinsey, L., & Elhalal, A. (2019) · arXiv (Cornell University) · Cited by 39 · see citing works
AR/VR Based Smart Policing For Fast Response to Crimes in Safe City
Bang, J., Lee, Y., Lee, Y.-T., & Park, W. (2019) · IEEE International Symposium on Mixed and Augmented Reality Adjunct (ISMAR-Adjunct) · doi:10.1109/ismar-adjunct.2019.00126 · Cited by 34 · see citing works
Self-citationThe State of AI Ethics Report (June 2020)Preprint
Gupta, A., Lanteigne, C., Heath, V., Ganapini, M. B., Galinkin, E., Cohen, A., Gasperis, T. D., Akif, M., & Butalid, R. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2006.14662 · Cited by 4 · see citing works
The Social Contract for AIPreprint
Caron, M. S., & Gupta, A. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2006.08140 · Cited by 2 · see citing works
Flagged first, then by citations
1 of the 19 references couldn’t be matched to a known paper.
Cited by
Sorted by citations
AI Fairness in Data Management and Analytics: A Review on Challenges, Methodologies and Applications
Chen, P., Wu, L., & Wang, L. (2023) · Applied Sciences · doi:10.3390/app131810258 · Cited by 155 · see citing works
Korobenko, D., Nikiforova, A., & Sharma, R. R. (2024) · Annual International Conference on Digital Government Research · doi:10.1145/3657054.3657141 · Cited by 55 · see citing works
Chatbots in cancer applications, advantages and disadvantages: all that glitters is not gold
Goumas, G., Dardavesis, T. I., Syrigos, K., Syrigos, N., & Simou, E. (2024) · Journal of Personalized Medicine · doi:10.3390/jpm14080877 · Cited by 24 · see citing works
“…handle private or sensitive client data might lead to security issues, and it is essential to make sure that data are encrypted, stored safely, and shielded from unwanted access, because security lapses may result in serious repercussions, such as harm to one’s reputation and legal status [61,62].”
BackgroundCarmichael, L., Poirier, S., Coursaris, C. K., Léger, P., & Sénécal, S. (2022) · Applied Sciences · doi:10.3390/app122412660 · Cited by 26 · see citing works
Examination of Ethical Principles for LLM-Based Recommendations in Conversational AI
Bang, J., Lee, B., & Park, P. (2023) · International Conference on Platform Technology and Service · doi:10.1109/platcon60102.2023.10255221 · Cited by 22 · see citing works
Self-citationSahab, S., Haqbeen, J. A., Hadfi, R., Itō, T., Imade, R. E., Ohnuma, S., & Hasegawa, T. (2024) · Communications Psychology · doi:10.1038/s44271-024-00070-z · Cited by 18 · see citing works
Sahab, S., Haqbeen, J. A., & Itō, T. (2024) · IEICE Transactions on Information and Systems · doi:10.1587/transinf.2023ihp0014 · Cited by 15 · see citing works
Chatbots in Pharmacy: A Boon or a Bane for Patient Care and Pharmacy Practice?
Ramadhani, C. (2023) · Sciences of Pharmacy · doi:10.58920/sciphar02030001 · Cited by 14 · see citing works
A Survey on the Recent Advancements in Human-Centered Dialog Systems
Oruche, R., Goruganthu, S. K., Akula, R., Cheng, X., Goni, M. A., Shibo, B. W., Kee, K. F., Zampieri, M., & Calyam, P. P. (2025) · ACM Computing Surveys · doi:10.1145/3729220 · Cited by 9 · see citing works
Hotel Chatbot Receptionist for Smart Hospitality
Kovacevic, S., Popović, T., Jovović, I., Čakić, S., & Babić, D. (2024) · doi:10.1109/it61232.2024.10475740 · Cited by 8 · see citing works
Xu, S., Lo, C. K., Ling, M. H., & Chen, G. (2025) · Cogent Education · doi:10.1080/2331186x.2025.2560059 · Cited by 4 · see citing works
“The Implementation of Public Chatbots to Raise Awareness of Computer Crime”
Pimentel, L., Bernardo, M. D. R. M., & Rocha, T. (2025) · International Journal of Human-Computer Interaction · doi:10.1080/10447318.2025.2508302 · Cited by 5 · see citing works
An optimal deep feature–based AI chat conversation system for smart medical application
Lal, M., & Neduncheliyan, S. (2023) · Personal and Ubiquitous Computing · doi:10.1007/s00779-023-01713-4 · Cited by 2 · see citing works
Santis, P. S. R. D. (2024) · Operations and Supply Chain Management An International Journal · doi:10.31387/oscm0560413 · Cited by 2 · see citing works
A Study of Ethical Dilemmas and Regulation of AI Chatbots
Song, X. (2023) · Journal of Theory and Practice of Social Science · doi:10.53469/jtpss.2023.03(09).02 · Cited by 1 · see citing works
Benchmarking digital labor against Fairwork principles: an (auto)ethnography of chatbot training
Tomičić, A. (2025) · AI & Society · doi:10.1007/s00146-025-02421-8 · Cited by 1 · see citing works
“Design and evaluation of public chatbots for computer crime awareness: A scoping review”
Pimentel, L., Bernardo, M. D. R. M., & Rocha, T. (2026) · Universal Access in the Information Society · doi:10.1007/s10209-025-01307-2 · Cited by 1 · see citing works
Holistic Multi-layered System Design for Human-Centered Dialog Systems
Oruche, R., Akula, R., Goruganthu, S. K., & Calyam, P. P. (2024) · IEEE International Conference on Human-Machine Systems (ICHMS) · doi:10.1109/ichms59971.2024.10555807 · Cited by 1 · see citing works
AI-Powered Chatbots in Health Insurance: Assessing Their Effectiveness in Consumer Search Processes
Mathur, T., & Kumar, V. V. R. (2024) · Proceeding of the Electrical Engineering Computer Science and Informatics · doi:10.1109/eecsi63442.2024.10776387 · Cited by 1 · see citing works
Xue, K. (2023) · Queensland University of Technology · doi:10.5204/thesis.eprints.242761
Trust and Ethics in Chatbots: A Framework for Responsible AI Interactions
Sowmya, P., & Vasudeva (2026) · IEEE Access · doi:10.1109/access.2026.3653763 · Cited by 5 · see citing works
- Authors
- Bang, J., Kim, S., Nam, J. W., & Yang, D.-G.
- Affiliations
- Electronics and Telecommunications Research Institute (KR)
- Ewha Womans University (KR)
- Korea University of Science and Technology (KR)
- ORCID
- Bang, Junseong
- Venue
- 2021 International Conference on Platform Technology and Service (PlatCon)
- Publisher
- IEEE
- Published
- 2021-08-23
- Pages
- 1-5
- OpenAlex
- W4285376698
- Cited by
- 21
- References
- 19
- Citations by year
- 2026: 2 · 2025: 4 · 2024: 8 · 2023: 6 · 2022: 1
- FWCI
- 3.39
- Type
- conference paper
- Language
- en
- Open access
- closed
- Licence
- Locations
- International Conference on Platform Technology and Service (publishedVersion)
- International Conference on Platform Technology and Service
- Funders
- Korean National Police Agency
- Topics
- Social Sciences › Safety Research › Ethics and Social Impacts of AI
- Physical Sciences › Computer Science › Artificial Intelligence › AI in Service Interactions
- Physical Sciences › Computer Science › Artificial Intelligence › Explainable Artificial Intelligence (XAI)
- Keywords
- AI ethics, data bias, chatbots, fairness, transparency, explainability, accountability, privacy, artificial intelligence control, unintended consequences of AI
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review