The DOI matches its Crossref record; 25 of the 25 references it cites were found in a registry or an index.
Constructing Ethical AI Based on the “Human-in-the-Loop” System
Open accessAbstract
The Human-in-the-Loop (HITL) system was first proposed by Robert Monarch, a machine learning expert. It adopted a “hybrid” strategy combining human intelligence and machine intelligence, aiming to improve the accuracy of machine learning models and assist human learning. At present, there have been a number ethical design attempts based on the HITL system, and some progress has been made in the ethical choices of disaster rescue robots and nursing robots. However, there is no analysis of why the HITL system can serve as an effective path in constructing ethical AI and how it can implement the efficiency of AI in ethical scenarios. This paper draws on the feasibility of the HITL system and analyzes how ethical AIs are possible when using the HITL system. We advocate for its application to the entire process of ethical AI design.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Figures



Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source says what the claim attributes to it.
In the citing paper
“Chen et al. developed methodologies for creating ethical AI systems based on human-in-the-loop approaches, arguing that value alignment requires ongoing human involvement, not just initial goal specification [69].”
From Human-in-the-Loop Artificial Intelligence: A Systematic Review of Concepts, Methods, and Applications (2026) · cites this paper as [69]
The cited source says what the claim attributes to it.
In the citing paper
“Their model recognizes that human values are complex, situation-dependent, and sometimes internally contradictory, requiring means of human judgment to control system behavior when algorithmic methods are insufficient.”
From Human-in-the-Loop Artificial Intelligence: A Systematic Review of Concepts, Methods, and Applications (2026) · cites this paper as [69]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Ethical Decision Making by Individuals in Organizations: An Issue-Contingent Model
Jones, T. M. (1991) · The Academy of Management Review · doi:10.2307/258867 · Cited by 4,135
Awad, E., Dsouza, S., Kim, R., Schulz, J., Henrich, J., Shariff, A., Bonnefon, J.-F., & Rahwan, I. (2018) · Nature · doi:10.1038/s41586-018-0637-6 · Cited by 1,859
ChatGPT: five priorities for research
van Dis, E. A. M., Bollen, J., Zuidema, W., van Rooij, R., & Bockting, C. L. (2023) · Nature · doi:10.1038/d41586-023-00288-7 · Cited by 1,842
Unsupervised Data Augmentation for Consistency Training
Xie, Q., Dai, Z., Hovy, E., Luong, M.-T., & Le, Q. V. (2019) · arXiv · doi:10.48550/arxiv.1904.12848 · Cited by 1,517
HiDDeN: Hiding Data With Deep Networks
Zhu, J., Kaplan, R., Johnson, J., & Fei-Fei, L. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-01267-0_40 · Cited by 1,129
Greeno, J. G. (1994) · Psychological Review · doi:10.1037//0033-295x.101.2.336 · Cited by 812
A survey of human-in-the-loop for machine learning
Wu, X., Xiao, L., Sun, Y., Zhang, J., Ma, T., & He, L. (2022) · Future Generation Computer Systems · doi:10.1016/j.future.2022.05.014 · Cited by 800
Wallach, W., & Allen, C. (2009) · Oxford University Press · doi:10.1093/acprof:oso/9780195374049.001.0001 · Cited by 711
Floridi, L. (2013) · Oxford University Press eBooks · doi:10.1093/acprof:oso/9780199641321.001.0001 · Cited by 651
A survey on active learning and human-in-the-loop deep learning for medical image analysis
Budd, S., Robinson, E. C., & Kainz, B. (2021) · Medical Image Analysis · doi:10.1016/j.media.2021.102062 · Cited by 606
Research works printed but not linked: 6
- Cai, 2020, Review of Data Annotation Research, J. Softw., 31, 302
- Liu, J. (2022). International Conference on Social Robotics, Springer Nature.
- Narayanan, S., and Rothrock, L. (2011). Human-In-the-Loop Simulations: Methods and Practice, Springer.
- Jo, 2023, The promise and peril of generative AI, Nature, 614, 214
- Thiam, P., Meudt, S., Schwenker, F., and Palm, G. (2016). Artificial Neural Networks in Pattern Recognition: 7th IAPR TC3 Workshop, ANNPR 2016, Ulm, Germany, September 28–30, 2016, Proceedings 7, Springer International Publishing.
- Chai, 2020, Human-in-the-loop Techniques in Machine Learning, IEEE Data Eng. Bull., 43, 37
Cited by
Applications, Challenges, and Future Directions of Human-in-the-Loop Learning
Kumar, S., Datta, S., Singh, V., Datta, D., Kumar Singh, S., & Sharma, R. (2024) · IEEE Access · doi:10.1109/access.2024.3401547 · Cited by 168
“Restrictions apply. human and machine intelligence throughout the entire ethical AI design process [166].”
BackgroundLazaros, K., Vrahatis, A. G., & Kotsiantis, S. (2026) · Entropy · doi:10.3390/e28040377 · Cited by 50
Empowering Student Learning Through Artificial Intelligence: A Bibliometric Analysis
Yun, G., Lee, K. M., & Choi, H. H. (2024) · Journal of Educational Computing Research · doi:10.1177/07356331241278636 · Cited by 36
“Another focus of study under this cluster lies in evaluating the effectiveness and competitiveness of the prediction or evaluation models (Jamil & Hameed, 2023; Ni et al., 2023; Rivas-Posada & Chacon-Murguia, 2024; Wang, 2023).”
InfluentialJenkins, D. M., & Khanna, G. (2025) · Journal of Leadership Studies · doi:10.1002/jls.70004 · Cited by 35
Nolin-Lapalme, A., Corbin, D., Tastet, O., Avram, R., & Hussin, J. (2024) · Canadian Journal of Cardiology · doi:10.1016/j.cjca.2024.04.026 · Cited by 21
Metadata
- Authors
- Chen, X., Wang, X., & Qu, Y.
- Affiliations
- Xi'an Jiaotong University (CN)
- Corresponding author
- Chen, Ximeng
- Venue
- Systems
- Publisher
- MDPI AG
- Published
- 2023-11-13
- Volume
- 11
- Issue
- 11
- Pages
- 548
- ISSN
- 2079-8954 (ISSN-L)
- OpenAlex
- W4388628811
- Cited by
- 45
- References
- 25
- Citations by year
- 2026: 30 · 2025: 12 · 2024: 3
- FWCI
- 11.26
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- Locations
- Systems (publishedVersion, cc-by)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Funders
- Soft Science Research Plan of Shaanxi Province (2023-CX-RKX-140, SK2022047)
- 2022 Basic Scientific Research Project of Xi’an Jiaotong University (2023-CX-RKX-140, SK2022047)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Ethics and Social Impacts of AI
- Social Sciences › Business, Management and Accounting › Organizational Behavior and Human Resource Management › Ethics in Business and Education
- Health Sciences › Medicine › Health Informatics › Artificial Intelligence in Healthcare and Education
- Keywords
- human-in-the-loop, ethical AI, AI ethics, human-machine collaboration, disaster rescue robots, nursing robots
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Constructing Ethical AI Based on the “Human-in-the-Loop” System. https://app.cochat.ai/papers/10.3390/systems11110548
- The paper
- Chen, X., Wang, X., & Qu, Y. (2023). Constructing Ethical AI Based on the “Human-in-the-Loop” System. Systems. https://doi.org/10.3390/systems11110548
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.