CoChat
Sign Up
PreprintCited by 80Ethics and Social Impacts of AIExplainable Artificial Intelligence (XAI)Safety Systems Engineering in Autonomy

Towards Trustworthy AI: A Review of Ethical and Robust Large Language Models

Open access
Ferdaus, Md Meftahul, Abdelguerfi, Mahdi, Ioup, Elias, Niles, Kendall N., Pathak, Ken, Sloan, Steven·2024·arXiv
DOI 10.48550/arxiv.2407.13934arXiv 2407.13934
Open this paper in CoChat — free accountOpen PDF

Abstract

The rapid progress in Large Language Models (LLMs) could transform many fields, but their fast development creates significant challenges for oversight, ethical creation, and building user trust. This comprehensive review looks at key trust issues in LLMs, such as unintended harms, lack of transparency, vulnerability to attacks, alignment with human values, and environmental impact. Many obstacles can undermine user trust, including societal biases, opaque decision-making, potential for misuse, and the challenges of rapidly evolving technology. Addressing these trust gaps is critical as LLMs become more common in sensitive areas like finance, healthcare, education, and policy. To tackle these issues, we suggest combining ethical oversight, industry accountability, regulation, and public involvement. AI development norms should be reshaped, incentives aligned, and ethics integrated throughout the machine learning process, which requires close collaboration across technology, ethics, law, policy, and other fields. Our review contributes a robust framework to assess trust in LLMs and analyzes the complex trust dynamics in depth. We provide contextualized guidelines and standards for responsibly developing and deploying these powerful AI systems. This review identifies key limitations and challenges in creating trustworthy AI. By addressing these issues, we aim to build a transparent, accountable AI ecosystem that benefits society while minimizing risks. Our findings provide valuable guidance for researchers, policymakers, and industry leaders striving to establish trust in LLMs and ensure they are used responsibly across various applications for the good of society.

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

DataCite · 10.48550/arxiv.2407.13934

Cites

Statistics

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

  • Structured reasoning offers built-in interpretability and facilitates human-AI collaboration by breaking down problems into smaller steps.

    “Structured reasoning offers built-in interpretability and facilitates human-AI collaboration by breaking down problems into smaller steps (Luo et al., 2024;Ferdaus et al., 2024).”

    From STRICTA: Structured Reasoning in Critical Text Assessment for Peer Review and Beyond (2025) · cites this paper as Ferdaus et al., 2024

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Cites

No references could be resolved yet.

Research works printed but not linked: 130

  1. V. Rajaraman, "Johnmccarthy -father of artificial intelligence," Resonance, vol. 19, pp. 198-207, 2014.
  2. S. Cass, "What would marvin minsky read? key works from the ai titan's favorite authors," IEEE Spectrum, vol. 53, pp. 22-22, 2016.
  3. J. McCarthy, M. Minsky, N. Rochester, and C. Shannon, "A proposal for the dartmouth summer research project on artificial intelligence, august 31, 1955," AI Mag., vol. 27, pp. 12-14, 2006.
  4. D. C. Brock and B. Grad, "Expert systems: Commercializing artificial intelligence," IEEE Annals of the History of Computing, vol. 44, pp. 5-7, 2022. [Online]. Available: https://consensus.app/papers/systems -commercializing-artificial-intelligence-brock/f9558697b4685c8d930 d8a07bf14d053/?utm source=chatgpt
  5. N. Shlezinger, J. Whang, Y. C. Eldar, and A. G. Dimakis, "Model-based deep learning," Proceedings of the IEEE, 2023.
  6. O. e. a. Faust, "Deep learning for healthcare applications based on physiological signals: a review," Nature Scientific Reports, vol. 8, no. 1, pp. 1-13, 2018.
  7. V. Sze, Y. hsin Chen, T.-J. Yang, and J. Emer, "Efficient processing of deep neural networks: A tutorial and survey," Proceedings of the IEEE, vol. 105, pp. 2295-2329, 2017. [Online]. Available: https://consensus.app/papers/processing-neural-networks-tutorial-sur vey-sze/1ce800bda3bb5bb584632fb6c5302eb0/?utm source=chatgpt
  8. R. Tang, Y.-N. Chuang, and X. Hu, "The science of detecting llm- generated text," Communications of the ACM, vol. 67, no. 4, pp. 50-59, 2024.
  9. I. Sarker, "Machine learning: Algorithms, real-world applications and research directions," SN Comput. Sci., vol. 2, pp. 1-21, 2021.
  10. A. Saxe, S. Nelli, and C. Summerfield, "If deep learning is the answer, what is the question?" Nat. Rev. Neurosci., vol. 22, pp. 55-67, 2021.
  11. F. Piccialli, V. Di Somma, F. Giampaolo, S. Cuomo, and G. Fortino, "A survey on deep learning in medicine: Why, how and when?" Inf. Fusion, vol. 66, pp. 111-137, 2021.
  12. Z. Li, F. Liu, W. Yang, S. Peng, and J. Zhou, "A survey of convolutional neural networks: analysis, applications, and prospects," IEEE Trans. Neural Netw. Learn. Syst., 2021.
  13. G. Vilone and L. Longo, "Notions of explainability and evaluation approaches for explainable artificial intelligence," Inf. Fusion, vol. 76, pp. 89-106, 2021.
  14. P. Paudyal and B. L. W. Wong, "Algorithmic opacity: Making algorithmic processes transparent through abstraction hierarchy," in Proceedings of the Human Factors and Ergonomics Society Annual Meeting, vol. 62, 2018, pp. 192-196. [Online]. Available: https://cons ensus.app/papers/algorithmic-opacity-making-algorithmic-processes-p audyal/a1b137e6fcf059e89a9552ba4ffed77d/?utm source=chatgpt
  15. C. Ma, J. Li, K. Wei, B. Liu, M. Ding, L. Yuan, Z. Han, and H. V. Poor, "Trusted AI in multiagent systems: An overview of privacy and security for distributed learning," Proceedings of the IEEE, vol. 111, no. 9, pp. 1097-1132, 2023.
  16. H. Zhang, B. Wu, X. Yuan, S. Pan, H. Tong, and J. Pei, "Trustworthy graph neural networks: Aspects, methods, and trends," Proceedings of the IEEE, 2024.
  17. H. Zhao, H. Chen, F. Yang, N. Liu, H. Deng, H. Cai, S. Wang, D. Yin, and M. Du, "Explainability for large language models: A survey," ACM Transactions on Intelligent Systems and Technology, 2023.
  18. B. C. Das, M. H. Amini, and Y. Wu, "Security and privacy challenges of large language models: A survey," arXiv (Cornell University), 01 2024. [Online]. Available: https://arxiv.org/abs/2402.00888 · arXiv
  19. R. Staab, M. Vero, M. Balunović, and M. Vechev, "Beyond memorization: Violating privacy via inference with large language models," arXiv (Cornell University), 10 2023. [Online]. Available: https://arxiv.org/abs/2310.07298 · arXiv
  20. X. Pan, M. Zhang, S. Ji, and M. Yang, "Privacy risks of general-purpose language models," 05 2020. [Online]. Available: https://ieeexplore.ieee.org/document/9152761/
  21. Y. Yao, J. Duan, K. Xu, Y. Cai, E. Sun, and Y. Zhang, "A survey on large language model (llm) security and privacy: The good, the bad, and the ugly," arXiv (Cornell University), 12 2023. [Online]. Available: http://arxiv.org/abs/2312.02003 · arXiv
  22. L. Weidinger, J. W. Mellor, M. Rauh, C. Griffin, J. Uesato, P.-S. Huang, M. Cheng, M. Glaese, B. Balle, A. Kasirzadeh, Z. Kenton, S. Brown, W. Hawkins, T. Stepleton, C. Biles, A. Birhane, J. Haas, L. Rimell, L. A. Hendricks, W. M. Isaac, S. Legassick, G. Irving, and I. Gabriel, "Ethical and social risks of harm from language models," arXiv (Cornell University), 12 2021. [Online]. Available: https://arxiv.org/abs/2112.04359 · arXiv
  23. S. Neel and P. H. Chang, "Privacy issues in large language models: A survey," arXiv (Cornell University), 12 2023. [Online]. Available: https://arxiv.org/abs/2312.06717 · arXiv
  24. J. Zhi, Y. Su, Y. Han, B. Yuan, H. Xu, C. Liu, K. Chen, and M. Zhang, "When large language models meet vector databases: A survey," arXiv (Cornell University), 01 2024. [Online]. Available: https://arxiv.org/abs/2402.01763 · arXiv
  25. E. Derner and K. Batistič, "Beyond the safeguards: Exploring the security risks of chatgpt," arXiv (Cornell University), 05 2023. [Online]. Available: https://arxiv.org/abs/2305.08005 · arXiv
  26. M. Anderljung, J. Barnhart, J. Leung, A. Korinek, C. O'Keefe, J. Whittlestone, S. Avin, M. Brundage, J. Bullock, D. Cass-Beggs, B. Chang, T. Collins, T. Fist, G. K. Hadfield, A. Hayes, L. L. Ho, S. Hooker, E. Horvitz, N. Kolt, J. Schuett, Y. Shavit, D. Siddarth, R. F. Trager, and K.-D. Wolf, "Frontier ai regulation: Managing emerging risks to public safety," arXiv (Cornell University), 07 2023. [Online]. Available: https://arxiv.org/abs/2307.03718 · arXiv
  27. E. Kasneci, K. Sessler, S. Küchemann, M. Bannert, D. Dementieva, F. Fischer, U. Gasser, G. Groh, S. Günnemann, E. Hüllermeier, S. Krusche, G. Kutyniok, T. Michaeli, C. Nerdel, J. Pfeffer, O. Poquet, M. Sailer, A. Schmidt, T. Seidel, M. Stadler, J. Weller, J. Kühn, and G. Kasneci, "Chatgpt for good? on opportunities and challenges of large language models for education," Learning and Individual Differences, vol. 103, pp. 102 274-102 274, 04 2023. [Online]. Available: https://doi.org/10.1016/j.lindif.2023.102274 · DOI · Paper page
  28. M. Fan, C. Chen, C. Wang, and J. Huang, "On the trustworthiness landscape of state-of-the-art generative models: A survey and outlook," arXiv (Cornell University), 07 2023. [Online]. Available: https://arxiv.org/abs/2307.16680 · arXiv
  29. R. Navigli, S. Conia, and B. Roß, "Biases in large language models: Origins, inventory, and discussion," Journal of Data and Information Quality, vol. 15, no. 2, pp. 1-21, 06 2023. [Online]. Available: https://doi.org/10.1145/3597307 · DOI · Paper page
  30. F. Xiao, S. Che, M. Mao, H. Zhang, M. Zhao, and X. Zhao, "Bias of ai-generated content: An examination of news produced by large language models," Research Square (Research Square), 11 2023. [Online]. Available: https://arxiv.org/abs/2309.09825 · arXiv
  31. H. Kotek, R. Dockum, and D. Q. Sun, "Gender bias and stereotypes in large language models," 11 2023. [Online]. Available: https://arxiv.org/abs/2308.14921 · arXiv
  32. S. Caton and C. Haas, "Fairness in machine learning: A survey," 10 2020. [Online]. Available: https://www.semanticscholar.org/paper/Fair ness-in-Machine-Learning%3A-A-Survey-Caton-Haas/fee8f6397290 6214b77f16cfeca0b93ee8f36ba2
  33. E. Pierson, D. Shanmugam, R. Movva, J. Kleinberg, M. Agrawal, M. Dredze, K. Ferryman, J. W. Gichoya, D. Jurafsky, P. W. Koh, K. Levy, S. Mullainathan, Z. Obermeyer, H. Suresh, and K. Vafa, "Use large language models to promote equity," arXiv (Cornell University), 12 2023. [Online]. Available: https://arxiv.org/abs/2312.14804 · arXiv
  34. Q. V. Liao and J. Vaughan, "Ai transparency in the age of llms: A human-centered research roadmap," arXiv (Cornell University), 06 2023. [Online]. Available: https://arxiv.org/abs/2306.01941 · arXiv
  35. Y. Li, M. Du, R. Song, X. Wang, and W. Ying, "A survey on fairness in large language models," arXiv (Cornell University), 08 2023. [Online]. Available: https://arxiv.org/abs/2308.10149 · arXiv
  36. I. D. Raji, A. Smart, R. N. White, M. Mitchell, T. Gebru, B. Hutchinson, J. Smith-Loud, D. Theron, and P. Barnes, "Closing the ai accountability gap: Defining an end-to-end framework for internal algorithmic auditing," arXiv (Cornell University), 01 2020. [Online]. Available: https://arxiv.org/abs/2001.00973 · arXiv
  37. B. Xia, Q. Lu, L. Zhu, S. U. Lee, Y. Liu, and Z. Xing, "From principles to practice: An accountability metrics catalogue for managing ai risks," arXiv (Cornell University), 11 2023. [Online]. Available: https://arxiv.org/abs/2311.13158 · arXiv
  38. J. An, W. Ding, and L. Chen, "Chatgpt: tackle the growing carbon footprint of generative ai," Nature, vol. 615, no. 7953, pp. 586-586, 03 2023. [Online]. Available: https://www.nature.com/articles/d41586 -023-00843-2
  39. F. Ahmad, S. Kaneda, R. Wang, R. Osi, P. Sharma, F. Chen, and L. Jiang, "Llmcarbon: Modeling the end-to-end carbon footprint of large language models," arXiv (Cornell University), 09 2023. [Online]. Available: https://arxiv.org/abs/2309.14393 · arXiv
  40. A. S. Luccioni and Álex Hernández-García, "Counting carbon: A survey of factors influencing the emissions of machine learning," arXiv (Cornell University), 02 2023. [Online]. Available: https: //arxiv.org/abs/2302.08476
  41. X. Wang, C. Na, E. Strubell, S. A. Friedler, and S. Luccioni, "Energy and carbon considerations of fine-tuning bert," arXiv (Cornell University), 11 2023. [Online]. Available: https://arxiv.org/abs/2311.1 0267
  42. S. Pujari, A. Reis, Y. Zhao, S. Alsalamah, F. Serhan, J. C. Reeder, and A. Labrique, "Artificial intelligence for global health: cautious optimism with safeguards," Bulletin of The World Health Organization, vol. 101, no. 06, pp. 364-364A, 06 2023. [Online]. Available: https://doi.org/10.2471/blt.23.290215 · DOI
  43. K. He, R. Mao, Q. Lin, Y. Ruan, X. Liu, M. Feng, and E. Cambria, "A survey of large language models for healthcare: from data, technology, and applications to accountability and ethics," arXiv (Cornell University), 10 2023. [Online]. Available: https://arxiv.org/abs/2310.05694 · arXiv
  44. J. Wang, H. Li, H. Wang, S. J. Pan, and X. Xie, "Trustworthy machine learning: Robustness, generalization, and interpretability," 08 2023. [Online]. Available: https://doi.org/10.1145/3580305.3599574 · DOI
  45. J. Vig, "BERTviz: A tool for visualizing multi-head self-attention in the BERT model," in Proceedings of the ACL Workshop on BlackboxNLP: Analyzing and Interpreting Neural Networks for NLP, 2019. [Online]. Available: https://consensus.app/papers/language-mod els-lazy-learners-analyze-shortcuts-tang/e0a77cd55fd8527f92a0fa79 30711a0c/?utm source=chatgpt
  46. S. Jain and B. C. Wallace, "Attention is not explanation," in Proceedings of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, 2019. [Online]. Available: https://consensus.app/papers/language-models-laz y-learners-analyze-shortcuts-tang/e0a77cd55fd8527f92a0fa7930711a 0c/?utm source=chatgpt
  47. M. Sundararajan, A. Taly, and Q. Yan, "Axiomatic attribution for deep networks," in Proceedings of the 34th International Conference on Machine Learning, 2017. [Online]. Available: https://consensus.ap p/papers/towards-better-understanding-attribution-methods-deep-anc ona/1a7ebc13a3d352afaa01ec9bbb6810d7/?utm source=chatgpt
  48. M. T. Ribeiro, S. Singh, and C. Guestrin, "Why should i trust you?: Explaining the predictions of any classifier," in Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, 2016. [Online]. Available: https: //consensus.app/papers/language-models-lazy-learners-analyze-short cuts-tang/e0a77cd55fd8527f92a0fa7930711a0c/?utm source=chatgpt
  49. R. Tang, D. Kong, L.-l. Huang, and H. Xue, "Large language models can be lazy learners: Analyze shortcuts in in-context learning," Findings of the Association for Computational Linguistics: ACL 2023, 2023. [Online]. Available: https://consensus.app/papers/language-mod els-lazy-learners-analyze-shortcuts-tang/e0a77cd55fd8527f92a0fa79 30711a0c/?utm source=chatgpt
  50. J. Wei, X. Wang, D. Schuurmans, M. Bosma, F. Xia, E. Chi, Q. V. Le, D. Zhou et al., "Chain-of-thought prompting elicits reasoning in large language models," Advances in Neural Information Processing Systems, vol. 35, pp. 24 824-24 837, 2022.
  51. M. Turpin, J. Michael, E. Perez, and S. Bowman, "Language models don't always say what they think: unfaithful explanations in chain- of-thought prompting," Advances in Neural Information Processing Systems, vol. 36, 2024.
  52. L. Weidinger, J. Mellor, S. Riedel, and I. Augenstein, "Ethical and social risks of harm from language models," arXiv preprint arXiv:2112.04359, 2021. [Online]. Available: https://consensus.app/pa pers/language-models-lazy-learners-analyze-shortcuts-tang/e0a77cd5 5fd8527f92a0fa7930711a0c/?utm source=chatgpt · arXiv
  53. R. Tang, D. Kong, L.-l. Huang, and H. Xue, "Large language models can be lazy learners: Analyze shortcuts in in-context learning," in Findings of the Association for Computational Linguistics: ACL 2023, 2023. [Online]. Available: https://consensus.app/papers/language-mod els-lazy-learners-analyze-shortcuts-tang/e0a77cd55fd8527f92a0fa79 30711a0c/?utm source=chatgpt
  54. Y. Li, M. Du, R. Song, X. Wang, and Y. Wang, "A survey on fairness in large language models," arXiv preprint arXiv:2308.10149, 2023. · arXiv
  55. L. Luo, Y. Li, G. Haffari, and S. Pan, "Reasoning on graphs: Faithful and interpretable large language model reasoning," arXiv (Cornell University), 10 2023. [Online]. Available: https://arxiv.org/abs/2310.0 1061
  56. X. Huang, W. Ruan, W. Huang, G. Jin, Y. Dong, C. Wu, S. Bensalem, R. Mu, Q. Yi, X. Zhao, K. Cai, Y. Zhang, S.-Q. Wu, P. Xu, D. Wu, A. V. L. Freitas, and M. Mustafa, "A survey of safety and trustworthiness of large language models through the lens of verification and validation," arXiv (Cornell University), 05 2023. [Online]. Available: https://arxiv.org/abs/2305.11391 · arXiv
  57. L. Yang, Y. Yao, J.-F. Ton, X. Zhang, R. Cheng, Y. Klochkov, M. F. Taufiq, and H. Li, "Trustworthy llms: a survey and guideline for evaluating large language models' alignment," arXiv (Cornell University), 08 2023. [Online]. Available: https://arxiv.org/abs/2308.0 5374
  58. N. C. Chung, G. Dyer, and L. Brocki, "Challenges of large language models for mental health counseling," arXiv (Cornell University), 11 2023. [Online]. Available: https://arxiv.org/abs/2311.13857 · arXiv
  59. A. N. Talboy and E. Fuller, "Challenging the appearance of machine intelligence: Cognitive bias in llms and best practices for adoption," arXiv (Cornell University), 04 2023. [Online]. Available: https://arxiv.org/abs/2304.01358 · arXiv
  60. I.-B. Song, S. Pendse, N. Kumar, and M. D. Choudhury, "The typing cure: Experiences with large language model chatbots for mental health support," arXiv (Cornell University), 01 2024. [Online]. Available: http://arxiv.org/abs/2401.14362 · arXiv
  61. K. Zhou, J. D. Hwang, X. Ren, and M. Sap, "Relying on the unreliable: The impact of language models' reluctance to express uncertainty," arXiv (Cornell University), 01 2024. [Online]. Available: https://arxiv.org/abs/2401.06730 · arXiv
  62. Z. J. Guo, R. Jin, C. LIU, Y. Huang, D. Shi, Supryadi, L. Yu, Y. Liu, J. Li, B. Xiong, and D. Xiong, "Evaluating large language models: A comprehensive survey," arXiv (Cornell University), 10 2023. [Online]. Available: https://arxiv.org/abs/2310.19736 · arXiv
  63. J. Mökander, J. Schuett, H. R. Kirk, and L. Floridi, "Auditing large language models: a three-layered approach," arXiv (Cornell University), 02 2023. [Online]. Available: https://arxiv.org/abs/2302.0 8500
  64. K. Zhou, Z. Kilhoffer, M. R. Sanfilippo, T. Underwood, E. Gumusel, M. Wei, A. Choudhry, and J. Xiong, ""the teachers are confused as well": A multiple-stakeholder ethics discussion on large language models in computing education," arXiv (Cornell University), 01 2024. [Online]. Available: https://arxiv.org/abs/2401.12453 · arXiv
  65. Y. Chang, W. Xu, J. Wang, Y. H. Wu, K. Zhu, H. Chen, L. Yang, X. Yi, C. Wang, Y. Wang, W. Ye, Y. Zhang, Y.-C. Chang, P. S. Yu, Q. Yang, and X. Xie, "A survey on evaluation of large language models," arXiv (Cornell University), 07 2023. [Online]. Available: https://arxiv.org/abs/2307.03109 · arXiv
  66. E. Eigner and T. Handler, "Determinants of llm-assisted decision- making," arXiv (Cornell University), 02 2024. [Online]. Available: https://arxiv.org/abs/2402.17385 · arXiv
  67. T. Eloundou, S. Manning, P. Mishkin, and D. L. Rock, "Gpts are gpts: An early look at the labor market impact potential of large language models," arXiv (Cornell University), 03 2023. [Online]. Available: https://arxiv.org/abs/2303.10130 · arXiv
  68. B. Wang, W. Chen, H. Pei, C. Xie, M. Kang, C. Zhang, C. Xu, Z. Xiong, R. Dutta, R. Schaeffer et al., "Decodingtrust: A compre- hensive assessment of trustworthiness in gpt models," arXiv preprint arXiv:2306.11698, 2023. · arXiv
  69. Y. Liu, Y. Yao, J.-F. Ton, X. Zhang, R. G. H. Cheng, Y. Klochkov, M. F. Taufiq, and H. Li, "Trustworthy llms: a survey and guideline for evaluating large language models' alignment," arXiv preprint arXiv:2308.05374, 2023. · arXiv
  70. L. Sun, Y. Huang, H. Wang, S. Wu, Q. Zhang, C. Gao, Y. Huang, W. Lyu, Y. Zhang, X. Li et al., "Trustllm: Trustworthiness in large language models," arXiv preprint arXiv:2401.05561, 2024. · arXiv
  71. O. Van der Wal, J. Jumelet, K. Schulz, and W. H. Zuidema, "The birth of bias: A case study on the evolution of gender bias in an english language model," ArXiv, vol. abs/2207.10245, 2022. [Online]. Available: https://consensus.app/papers/birth-bias-case-study-evoluti on-gender-bias-english-wal/abd84bcebe8d576491a59c8b485e932c/?u tm source=chatgpt · arXiv
  72. E. Tokpo, P. Delobelle, B. Berendt, and T. Calders, "How far can it go?: On intrinsic gender bias mitigation for text classification," ArXiv, vol. abs/2301.12855, 2023. [Online]. Available: https://consensus.app/papers/gender-bias-mitigation-text-classificatio n-tokpo/33e815071d64587dbefa33dd76067c2d/?utm source=chatgpt · arXiv
  73. N. Kirtane, V. Manushree, and A. Kane, "Efficient gender debiasing of pre-trained indic language models," ArXiv, vol. abs/2209.03661, 2022. [Online]. Available: https://consensus.app/papers/gender-debiasi ng-pretrained-indic-language-models-kirtane/d8044c997b325bcba65 59b60f09cee79/?utm source=chatgpt · arXiv
  74. Y. Bai, A. Jones, K. Ndousse, A. Askell, A. Chen, N. DasSarma, D. Drain, S. Fort, D. Ganguli, T. Henighan et al., "Training a helpful and harmless assistant with reinforcement learning from human feedback," ArXiv, vol. abs/2204.05862, 2022. [Online]. Available: https://doi.org/10.48550/arXiv.2204.05862 · DOI · Paper page
  75. D. Lindner and M. El-Assady, "Humans are not boltzmann distributions: Challenges and opportunities for modelling human feedback and interaction in reinforcement learning," ArXiv, vol. abs/2206.13316, 2022. [Online]. Available: https://doi.org/10.48550/a rXiv.2206.13316 · DOI
  76. R. Le Bras, S. Swayamdipta, C. Bhagavatula, R. Zellers, M. Peters, A. Sabharwal, and Y. Choi, "Adversarial filters of dataset biases," in International conference on machine learning. PMLR, 2020, pp. 1078-1088.
  77. C. Ganhor, D. Penz, N. Rekabsaz, O. Lesota, and M. Schedl, "Un- learning protected user attributes in recommendations with adversarial training," in Proceedings of the 45th International ACM SIGIR Con- ference on Research and Development in Information Retrieval, 2022.
  78. V. Arya, R. K. Bellamy, P.-Y. Chen, A. Dhurandhar, M. Hind, S. C. Hoffman, S. Houde, Q. V. Liao, R. Luss, A. Mojsilović et al., "Ai explainability 360 toolkit," in Proceedings of the 3rd ACM India Joint International Conference on Data Science & Management of Data (8th ACM IKDD CODS & 26th COMAD), 2021, pp. 376-379.
  79. A. Bhat and A. Raychowdhury, "Non-uniform interpolation in integrated gradients for low-latency explainable-ai," 2023. [Online]. Available: https://doi.org/10.48550/arXiv.2302.11107 · DOI
  80. Y. Weng, M. Zhu, S. He, K. Liu, and J. Zhao, "Large language models are reasoners with self-verification," 2022. [Online]. Available: https://doi.org/10.48550/arXiv.2212.09561 · DOI · Paper page
  81. S. Schwettmann, T. Rott Shaham, J. Materzynska, N. Chowdhury, S. Li, J. Andreas, D. Bau, and A. Torralba, "Find: A function description benchmark for evaluating interpretability methods," arXiv e-prints, pp. arXiv-2309, 2023.
  82. N. Veerasamy and H. Pieterse, "Rising above misinformation and deepfakes," in International Conference on Cyber Warfare and Security, 2022. [Online]. Available: https://consensus.app/papers/risin g-above-misinformation-deepfakes-veerasamy/02383230aac25b339e6 a4edede202de1/?utm source=chatgpt
  83. X. Jiang, Y. Ge, Y. Ge, C. Yuan, and Y. Shan, "Supervised fine- tuning in turn improves visual foundation models," arXiv preprint arXiv:2401.10222, 2024. · arXiv
  84. R. Rafailov, A. Sharma, E. Mitchell, C. D. Manning, S. Ermon, and C. Finn, "Direct preference optimization: Your language model is secretly a reward model," Advances in Neural Information Processing Systems, vol. 36, 2024.
  85. A. Koene, L. Dowthwaite, and S. Seth, "Ieee p7003tm standard for algorithmic bias considerations," in 2018 IEEE/ACM International Workshop on Software Fairness (FairWare). IEEE, 2018, pp. 38-41.
  86. A. Winfield, L. Booth, R. Britter, G. Burnett, M. Chessell, H.-L. Cheung, M. Fisher, M. Fletcher, A. Gill, K. Glover et al., "Ieee p7001: A proposed standard on transparency," Frontiers in Robotics and AI, vol. 8, p. 225, 2021.
  87. T. F. Blauth, O. J. Gstrein, and A. Zwitter, "Artificial intelligence crime: An overview of malicious use and abuse of ai," IEEE Access, vol. 10, pp. 77 110-77 122, 2022.
  88. IEEE Educational Activities, "Continuing education units through ieee," February 2024. [Online]. Available: https://www.ieee.org/conte nt/dam/ieee-org/ieee/web/org/educ/ieee certificates program product .pdf
  89. 106"NSF-IEEE WORKSHOP: TOWARD EXPLAINABLE, RELIABLE, AND SUSTAINABLE MACHINE LEARNING IN SIGNAL & DATA SCIENCE," https://sites.google.com/umd.edu/workshop2023ml/home, 2023, accessed: 2024-03-01.
  90. National Conference of State Legislatures, "Artificial intelligence 2023 legislation," https://www.ncsl.org/state-legislatures-news/details/stat e-of-play-an-inside-look-at-artificial-intelligence-policy-and-state-act ions, 2024.
  91. I. Inuwa-Dutse, "Fate in ai: Towards algorithmic inclusivity and accessibility," in Proceedings of the 3rd ACM Conference on Equity and Access in Algorithms, Mechanisms, and Optimization, 2023. [Online]. Available: https://consensus.app/papers/fate-towards-algorit hmic-inclusivity-accessibility-inuwadutse/e93c38645e6e5a8da9c137 b028654558/?utm source=chatgpt
  92. E. Barrance, E. Kazim, A. Hilliard, M. Trengove, S. Zannone, and A. Koshiyama, "Overview and commentary of the cdei's extended roadmap to an effective ai assurance ecosystem," Frontiers in Artificial Intelligence, vol. 5, 2022. [Online]. Available: https: //consensus.app/papers/overview-cdeis-extended-assurance-ecosystem -barrance/3df4da31de305209a10b2e5e2c1c314d/?utm source=chatgpt
  93. N. Naik, B. Hameed, D. Shetty, D. Swain, M. Shah, R. Paul, K. Aggar- wal, S. Ibrahim, V. Patil, K. Smriti, S. Shetty, B. P. Rai, P. Chlosta, and B. Somani, "Legal and ethical consideration in artificial intelligence in healthcare: Who takes responsibility?" Frontiers in Surgery, vol. 9, 2022.
  94. M. Veale, F. Z. Borgesius, and J. Hage, "Demystifying the draft eu artificial intelligence act," Computer Law Review International, vol. 22, no. 4, pp. 97-112, 2021. [Online]. Available: https://www.de gruyter.com/document/doi/10.9785/cri-2021-220402/html?lang=en · DOI
  95. M. Veale, M. Van Kleek, and R. Binns, "Demystifying the draft eu artificial intelligence act," arXiv preprint arXiv:2103.14559, 2021. [Online]. Available: https://arxiv.org/abs/2103.09051 · arXiv
  96. M. Mitchell, S. Wu, A. Zaldivar, P. Barnes, L. Vasserman, B. Hutchin- son, E. Spitzer, I. D. Raji, and T. Gebru, "Model cards for model re- porting," in Proceedings of the Conference on Fairness, Accountability, and Transparency, 2019, pp. 220-229.
  97. T. Hagendorff, "The ethics of ai ethics: An evaluation of guidelines," Minds and Machines, vol. 30, no. 1, pp. 99-120, 2020.
  98. L. Floridi, "Establishing the rules for building trustworthy ai," Nature Machine Intelligence, vol. 1, no. 6, pp. 261-262, 2019.
  99. I. D. Raji, A. Smart, R. N. White, M. Mitchell, T. Gebru, B. Hutchin- son, J. Smith-Loud, D. Theron, and P. Barnes, "Closing the ai account- ability gap: Defining an end-to-end framework for internal algorithmic auditing," arXiv preprint arXiv:2001.00973, 2020. · arXiv
  100. K. Holstein, J. Wortman Vaughan, H. Daum'e III, M. Dudik, and H. Wallach, "Improving fairness in machine learning systems: What do industry practitioners need?" in Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems, 2019, pp. 1- 16.
  101. B. Friedman, P. H. Kahn Jr, and A. Borning, "Value-sensitive design," Interactions, vol. 9, no. 6, pp. 16-23, 2002.
  102. B. D. Mittelstadt, "Ai ethics-too principled to fail?" arXiv preprint arXiv:1906.06668, 2019. · arXiv
  103. A. Jobin, M. Ienca, and E. Vayena, "The global landscape of ai ethics guidelines," Nature Machine Intelligence, vol. 1, no. 9, pp. 389-399, 2019.
  104. J. Morley, L. Floridi, L. Kinsey, and A. Elhalal, "What do industry practitioners think about the purposes of ai ethics, and why does it matter?" arXiv preprint arXiv:1910.09488, 2019. · arXiv
  105. J. Smith and B. Jones, "Challenges in implementing privacy guidelines: The startup perspective," Journal of Privacy Studies, vol. 14, no. 2, pp. 55-78, 2021.
  106. M. Lee and K. Wilson, "A toolkit for implementing privacy guidelines in small businesses," in Proceedings of the International Conference on Privacy Engineering, 2022, pp. 105-119.
  107. A. Johnson and S. Wu, "Effective partnerships for privacy guideline implementation," Journal of Applied Privacy, vol. 5, no. 1, pp. 22-39, 2023.
  108. C. Martin, "Prioritization strategies for privacy guideline implemen- tation," in Privacy Engineering Handbook. CRC Press, 2021, pp. 77-99.
  109. T. Nguyen and O. Ahmed, "Deriving value from subset implementation of privacy standards," International Journal of Information Manage- ment, vol. 59, pp. 123-135, 2022.
  110. R. Patel and N. Desai, "Compliance software for implementing privacy guidelines," in IEEE Security and Privacy Workshops, 2023, pp. 55-61.
  111. A. Ng and J. Chen, "Tiered pricing models for privacy compliance software," in Americas Conference on Information Systems, 2022, pp. 12-19.
  112. E. Lee and L. Kim, "Automation for streamlining privacy guideline implementation," Journal of Information Security and Applications, vol. 67, pp. 102-112, 2021.
  113. R. Bommasani et al., "Opportunities and risks of foundation models," arXiv preprint arXiv:2108.07258, 2021. · arXiv
  114. J. Xu et al., "Ethics of artificial intelligence in health care," The Lancet Digital Health, vol. 4, no. 4, pp. e193-e201, 2022.
  115. I. D. Raji et al., "Closing the ai accountability gap: defining an end-to- end framework for internal algorithmic auditing," Fat*, vol. 1, no. 1, pp. 33-57, 2021.
  116. K. Holstein et al., "Improving the transparency, explainability and accountability of ai systems: An interdisciplinary framework," PloS one, vol. 17, no. 4, p. e0268494, 2022.
  117. I. Solaiman et al., "Release strategies and the social impacts of large language models," arXiv preprint arXiv:2201.11006, 2022. · arXiv
  118. V. Sharma et al., "Quantum computing and its impact on cryptography," Journal of Physics: Conference Series, vol. 2265, no. 1, p. 012027, 2022.
  119. B. D. Mittelstadt, "Principles alone cannot guarantee ethical ai," Nature Machine Intelligence, vol. 1, no. 11, pp. 501-507, 2019.
  120. L. Floridi and A. Strait, "Ethics-by-design for ai and the role of the ethicist-engineer," Science and engineering ethics, pp. 1-15, 2022.
  121. F. Jiang, Z. Xu, L. Niu, Z. Xiang, B. Ramasubramanian, B. Li, and R. Poovendran, "Artprompt: Ascii art-based jailbreak attacks against aligned llms," arXiv preprint arXiv:2402.11753, 2024. · arXiv
  122. D. Pastor-Escuredo, P. Treleaven, and R. Vinuesa, "An ethical frame- work for artificial intelligence and sustainable cities," AI, vol. 3, no. 4, pp. 961-974, 2022.
  123. A. McNamara, I. Ong, R. Williamson, J. Smith, and F. Provost, "Towards inclusive ai: Safely and effectively engaging marginalized populations," arXiv preprint arXiv:1812.05239, 2018. · arXiv
  124. B. Wagner, "Ethics as an escape from regulation: From ethics-washing to ethics-shopping?" Being profiling. Cogitas ergo sum, pp. 84-89, 2018.
  125. A. Rességuier and R. Rodrigues, "Ai ethics should not remain toothless! a call to bring back the teeth of ethics," Big Data & Society, vol. 7, no. 2, p. 2053951720950798, 2020.
  126. A. Hagerty and I. Rubinov, "Global ai ethics: A review of the social impacts and ethical implications of artificial intelligence," arXiv preprint arXiv:1907.07892, 2019. · arXiv
  127. S. S. Óh Éigeartaigh, Y. Liu, J. Whittlestone et al., "International per- spectives on artificial intelligence and public standards," in Proceedings of the AAAI/ACM Conference on AI, Ethics, and Society, 2020, pp. 147-154.
  128. M. Maas, "International law does not compute: Artificial intelligence and the development, displacement or destruction of the global legal order," Melbourne Journal of International Law, vol. 22, no. 1, pp. 29-54, 2021.
  129. M. N. Schmitt and B. T. O'Donnell, "Ai, cyberspace, and nuclear weapons," The Adelphi Papers, vol. 61, no. 509-510, pp. 7-134, 2021.
  130. K. Yeung, A. Howes, and G. Pogrebna, AI governance by human rights- centered design, deliberation, and oversight: An end to ethics washing. Oxford University Press, 2019, pp. 75-101.

Cited by

Sorted by citations

Authors
Ferdaus, M. M., Abdelguerfi, M., Ioup, E., Niles, K. N., Pathak, K., & Sloan, S.
Affiliations
  • LSU New Orleans (US)
  • Stennis Space Center (US)
  • United States Army Corps of Engineers (US)
ORCID
Venue
arXiv
Publisher
arXiv
Published
2024
Volume
58
Issue
7
Pages
1-43
ISSN
0360-0300 (ISSN-L)
DOI
10.48550/arxiv.2407.13934
arXiv
2407.13934
OpenAlex
W4416298062
Cited by
80
References
0
Citations by year
2026: 36 · 2025: 44
FWCI
58.01
Type
journal article
Language
en
Open access
Licence
Locations
  • ACM Computing Surveys (publishedVersion, other-oa)
  • arXiv (Cornell University) (submittedVersion)
  • arXiv (Cornell University)
Funders
  • Office of Naval Research
  • U.S. Army Corps of Engineers (W912HZ‐23‐2‐0004)
Topics
  • Social Sciences › Safety Research › Ethics and Social Impacts of AI
  • Physical Sciences › Computer Science › Artificial Intelligence › Explainable Artificial Intelligence (XAI)
  • Physical Sciences › Engineering › Safety, Risk, Reliability and Quality › Safety Systems Engineering in Autonomy
Keywords
trustworthy AI, large language models, AI ethics, robustness, unintended harm, opacity, social bias, value alignment, environmental impact of AI, AI regulation, accountability, responsible AI development

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review