The DOI matches its DataCite record; 27 of the 27 references it cites were found in a registry or an index.
Cooperative Inverse Reinforcement Learning
Open accessAbstract
For an autonomous system to be helpful to humans and to pose no unwarranted risks, it needs to align its values with those of the humans in its environment in such a way that its actions contribute to the maximization of value for the humans. We propose a formal definition of the value alignment problem as cooperative inverse reinforcement learning (CIRL). A CIRL problem is a cooperative, partial-information game with two agents, human and robot; both are rewarded according to the human's reward function, but the robot does not initially know what this is. In contrast to classical IRL, where the human is assumed to act optimally in isolation, optimal CIRL solutions produce behaviors such as active teaching, active learning, and communicative actions that are more effective in achieving value alignment. We show that computing optimal joint policies in CIRL games can be reduced to solving a POMDP, prove that optimality in isolation is suboptimal in CIRL, and derive an approximate CIRL algorithm.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Assistance games, such as cooperative inverse RL (CIRL) (Hadfield-Menell et al., 2016), provide a framework to analyze algorithms like RLHF.”
From Open Problems and Fundamental Limitations of Reinforcement Learning from Human Feedback (2023) · cites this paper as Hadfield-Menell et al., 2016
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Theory of the firm: Managerial behavior, agency costs and ownership structure
Jensen, M. C., & Meckling, W. H. (1976) · Journal of Financial Economics · doi:10.1016/0304-405x(76)90026-x · Cited by 71,491
Multitask principal – agent analyses: Incentive contracts, asset ownership, and job design
Holmstrom, B., & Milgrom, P. (1991) · The Journal of Law, Economics, and Organization · doi:10.1093/jleo/7.special_issue.24 · Cited by 6,046
Aggregation and Linearity in the Provision of Intertemporal Incentives
Holmstrom, B. R., & Milgrom, P. (1987) · Econometrica · doi:10.2307/1913238 · Cited by 2,870
Apprenticeship learning via inverse reinforcement learning
Abbeel, P., & Ng, A. Y. (2004) · International Conference on Machine Learning · doi:10.1145/1015330.1015430 · Cited by 2,855
Self-citationSuperintelligence: paths, dangers, strategies
Bostrom, N. (2015) · Choice Reviews Online · doi:10.5860/choice.187536 · Cited by 1,998
Maximum Entropy Inverse Reinforcement Learning
Ziebart, B. D., Maas, A. L., Bagnell, J. A., & Dey, A. K. (2018) · doi:10.1184/r1/6555512 · Cited by 1,868
The Optimal Control of Partially Observable Markov Processes over a Finite Horizon
Smallwood, R., & Sondik, E. (1973) · Operational Research · doi:10.1287/opre.21.5.1071 · Cited by 1,787
(2000) · doi:10.2460/ajvr.67.2.323 · Cited by 1,621
On the folly of rewarding A, while hoping for B
Kerr, S. (1975) · Academy of Management Journal · doi:10.2307/255378 · Cited by 1,585
An investigation of the Therac-25 accidents
Leveson, N. G., & Turner, C. S. (1993) · Computer · doi:10.1109/mc.1993.274940 · Cited by 1,245
Research works printed but not linked: 2
- Russell, S. and Norvig, P. Artificial Intelligence . Pearson, 2010.
- Waugh, K, Ziebart, B, and Bagnell, J. Computational rationalization: The inverse equilibrium problem. In ICML , 2011.
Cited by
Sorted by citations
Items 101–200 of 414
Challenges of Aligning Artificial Intelligence with Human Values
Sutrop, M. (2020) · Acta Baltica Historiae et Philosophiae Scientiarum · doi:10.11590/abhps.2020.2.04 · Cited by 44
Deep learning, transparency, and trust in human robot teamwork
Lewis, M., Li, H.-A., & Sycara, K. (2021) · Trust in Human-Robot Interaction · doi:10.1016/b978-0-12-819472-0.00014-9 · Cited by 29
Russell, S. (2021) · Oxford Review of Economic Policy · doi:10.1093/oxrep/grab013 · Cited by 44
Self-citationAdvanced Artificial Agents Intervene in the Provision of Reward
Cohen, M. K., Hutter, M., & Osborne, M. A. (2022) · AI Magazine · doi:10.1002/aaai.12064 · Cited by 30
Eckersley, P. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1901.00064 · Cited by 67
A review on AI Safety in highly automated driving
Wäschle, M., Thaler, F., Berres, A., Pölzlbauer, F., & Albers, A. (2022) · Frontiers in Artificial Intelligence · doi:10.3389/frai.2022.952773 · Cited by 28
Robot Planning with Mathematical Models of Human State and ActionPreprint
Dragan, A. D. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1705.04226 · Cited by 29
Self-citationChakraborti, T., & Subbarao Kambhampati, B. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1801.09854 · Cited by 29
A mathematical theory of cooperative communicationPreprint
Wang, P., Wang, J., Paranamana, P., & Shafto, P. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1910.02822 · Cited by 28
Mattila, R., Rojas, C. R., Krishnamurthy, V., & Wahlberg, B. (2020) · IEEE Transactions on Signal Processing · doi:10.1109/tsp.2020.3019177 · Cited by 28
An approach for combining ethical principles with public opinion to guide public policy
Awad, E., Anderson, M., Anderson, S. L., & Liao, B. (2020) · Artificial Intelligence · doi:10.1016/j.artint.2020.103349 · Cited by 33
Incomplete Contracting and AI Alignment
Hadfield-Menell, D., & Hadfield, G. K. (2019) · Proceedings of the AAAI/ACM Conference on AI Ethics and Society · doi:10.1145/3306618.3314250 · Cited by 36
Self-citationFeature Expansive Reward Learning
Bobu, A., Wiggert, M., Tomlin, C. J., & Dragan, A. D. (2021) · ACM/IEEE International Conference on Human-Robot Interaction (HRI) · doi:10.1145/3434073.3444667 · Cited by 36
Self-citationSpencer, J. C., Choudhury, S., Barnes, M., Schmittle, M., Chiang, M., Ramadge, P. J., & Srinivasa, S. (2021) · Autonomous Robots · doi:10.1007/s10514-021-10006-9 · Cited by 29
Control of neural systems at multiple scales using model-free, deep reinforcement learning
Mitchell, B., & Petzold, L. R. (2018) · Scientific Reports · doi:10.1038/s41598-018-29134-x · Cited by 24
Malicious Design in AIVR, Falsehood and Cybersecurity-oriented Immersive Defenses
Aliman, N.-M., & Kester, L. J. H. M. (2020) · IEEE International Conference on Artificial Intelligence and Virtual Reality (AIVR) · doi:10.1109/aivr50618.2020.00031 · Cited by 30
A Survey on Deep Learning Toolkits and Libraries for Intelligent User InterfacesPreprint
Zacharias, J., Barz, M., & Sonntag, D. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1803.04818 · Cited by 33
Penalizing side effects using stepwise relative reachability
Krakovna, V., Orseau, L., Kumar, R., Martic, M., & Legg, S. (2018) · arXiv · doi:10.48550/arxiv.1806.01186 · Cited by 26
AvE: Assistance via EmpowermentPreprint
Du, Y., Tiomkin, S., Kıcıman, E., Polani, D., Abbeel, P., & Dragan, A. D. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2006.14796 · Cited by 26
Self-citationVirtual laboratories: transforming research with AI
Arto Klami, A., Damoulas, T., Engkvist, O., Rinke, P., & Samuel Kaski, A. (2024) · Data-Centric Engineering · doi:10.1017/dce.2024.15 · Cited by 30
Learner-aware Teaching: Inverse Reinforcement Learning with Preferences and ConstraintsPreprint
Tschiatschek, S., Ghosh, A., Haug, L., Devidze, R., & Singla, A. K. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1906.00429 · Cited by 25
Dong, C., Zhang, Y., & Dolan, J. M. (2017) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros.2017.8206316 · Cited by 24
Inverse Learning for Data-Driven Calibration of Model-Based Statistical Path Planning
Menner, M., Berntorp, K., Zeilinger, M. N., & Cairano, S. D. (2020) · IEEE Transactions on Intelligent Vehicles · doi:10.1109/tiv.2020.3000323 · Cited by 24
Toward AI assistants that let designers design
Peuter, S. D., Oulasvirta, A., & Samuel Kaski, A. (2023) · AI Magazine · doi:10.1002/aaai.12077 · Cited by 24
Bridging the collectives: A review of collective human–robot construction
Han, I. X., Meggers, F., & Parascho, S. (2021) · International Journal of Architectural Computing · doi:10.1177/14780771211025153 · Cited by 23
Cao, K., & Xie, L. (2022) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2022.3148376 · Cited by 25
On the Controllability of Artificial Intelligence: An Analysis of Limitations
Yampolskiy, R. V. (2022) · Journal of Cyber Security and Mobility · doi:10.13052/jcsm2245-1439.1132 · Cited by 56
Chakraborti, T., & Subbarao Kambhampati, B. (2019) · Proceedings of the AAAI/ACM Conference on AI Ethics and Society · doi:10.1145/3306618.3314281 · Cited by 23
Theory of Mind based Communication for Human Agent Cooperation
Buehler, M. C., & Weisswange, T. H. (2020) · IEEE International Conference on Human-Machine Systems (ICHMS) · doi:10.1109/ichms49158.2020.9209472 · Cited by 23
Balancing Explicability and Explanation in Human-Aware PlanningPreprint
Chakraborti, T., Sreedharan, S., & Subbarao Kambhampati, B. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1708.00543 · Cited by 24
Opponent portrait for multiagent reinforcement learning in competitive environment
Ma, Y., Shen, M., Zhao, Y., Zhao, L., Tong, X., Zhang, Q., & Wang, Z. (2021) · International Journal of Intelligent Systems · doi:10.1002/int.22594 · Cited by 22
Prediction-Aware and Reinforcement Learning-Based Altruistic Cooperative Driving
Valiente, R., Razzaghpour, M., Toghi, B., Shah, G., & Fallah, Y. P. (2023) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2023.3323440 · Cited by 22
Inverse Filtering for Hidden Markov Models
Mattila, R., Rojas, C. R., Krishnamurthy, V., & Wahlberg, B. (2017) · neural information processing systems · Cited by 22
Enabling Value Sensitive AI Systems through Participatory Design FictionsPreprint
Liao, Q. V., & Muller, M. J. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1912.07381 · Cited by 22
Validating metrics for reward alignment in human-autonomy teaming
Sanneman, L., & Shah, J. (2023) · Computers in Human Behavior · doi:10.1016/j.chb.2023.107809 · Cited by 23
Scalarizing Multi-Objective Robot Planning Problems Using Weighted Maximization
Wilde, N., Smith, S. L., & Alonso–Mora, J. (2024) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2024.3357313 · Cited by 20
Learning to Communicate Implicitly by Actions
Tian, Z., Zou, S., Davies, I., Warr, T., Wu, L., Ammar, H. B., & Wang, J. (2020) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v34i05.6217 · Cited by 21
Aligning to Social Norms and Values in Interactive Narratives
Ammanabrolu, P., Jiang, L., Sap, M., Hajishirzi, H., & Choi, Y. (2022) · Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT) · doi:10.18653/v1/2022.naacl-main.439 · Cited by 31
Menner, M., Neuner, L., Lünenburger, L., & Zeilinger, M. N. (2020) · IEEE Transactions on Robotics · doi:10.1109/tro.2020.2964147 · Cited by 20
Reward Poisoning in Reinforcement Learning: Attacks Against Unknown Learners in Unknown EnvironmentsPreprint
Rakhsha, A., Zhang, X., Zhu, X., & Singla, A. K. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2102.08492 · Cited by 43
Socially intelligent machines that learn from humans and help humans learn
Gweon, H., Fan, J. E., & Kim, B. (2023) · Philosophical Transactions of the Royal Society A Mathematical Physical and Engineering Sciences · doi:10.1098/rsta.2022.0048 · Cited by 25
Influencing leading and following in human–robot teams
Li, M., Kwon, M., & Sadigh, D. (2021) · Autonomous Robots · doi:10.1007/s10514-021-10016-7 · Cited by 18
Nahian, M. S. A., Frazier, S., Riedl, M. O., & Harrison, B. E. (2020) · Proceedings of the AAAI/ACM Conference on AI Ethics and Society · doi:10.1145/3375627.3375825 · Cited by 33
Good and safe uses of AI OraclesPreprint
Armstrong, S., & O'Rorke, X. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1711.05541 · Cited by 35
Multi-View Decision Processes: The Helper-AI Problem
Christos Dimitrakakis, A., Parkes, D. C., Radanović, G., & Tylkin, P. (2017) · Digital Access to Scholarship at Harvard (DASH) (Harvard University) · Cited by 17
Recent advances in leveraging human guidance for sequential decision-making tasks
Zhang, R., Torabi, F., Warnell, G., & Stone, P. (2021) · Autonomous Agents and Multi-Agent Systems · doi:10.1007/s10458-021-09514-w · Cited by 20
The Thoughts the Civilized Keep
Vallor, S. (2024) · Oxford University Press eBooks · doi:10.1093/oso/9780197759066.003.0005 · Cited by 16
A Review on Machine Theory of Mind
Mao, Y., Liu, S., Ni, Q., Lin, X. A., & He, L. (2024) · IEEE Transactions on Computational Social Systems · doi:10.1109/tcss.2024.3416707 · Cited by 22
Scheutz, M. J., & Malle, B. F. (2021) · Oxford University Press eBooks · doi:10.1093/oso/9780197546048.003.0007 · Cited by 18
Avoiding Side Effects By Considering Future TasksPreprint
Krakovna, V., Orseau, L., Ngo, R., Martic, M., & Legg, S. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2010.07877 · Cited by 19
Vasilaras, A., Papadoudis, N., & Rizomiliotis, P. (2024) · Forensic Science International Digital Investigation · doi:10.1016/j.fsidi.2024.301737 · Cited by 21
Axes for Sociotechnical Inquiry in AI Research
Dean, S., Gilbert, T. K., Lambert, N., & Zick, T. (2021) · IEEE Transactions on Technology and Society · doi:10.1109/tts.2021.3074097 · Cited by 20
f-IRL: Inverse Reinforcement Learning via State Marginal MatchingPreprint
Ni, T., Sikchi, H., Wang, Y., Gupta, T., Lee, L., & Eysenbach, B. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2011.04709 · Cited by 26
Kenton, Z., Kumar, R., Farquhar, S., Richens, J., MacDermott, M., & Everitt, T. (2023) · Artificial Intelligence · doi:10.1016/j.artint.2023.103963 · Cited by 17
Chen, H., Zhang, Y., Bhatti, U. A., & Huang, M. (2023) · Sensors · doi:10.3390/s23031198 · Cited by 15
Towards machines that understand people
Howes, A., Jokinen, J., & Oulasvirta, A. (2023) · AI Magazine · doi:10.1002/aaai.12116 · Cited by 19
A General Methodology for Teaching Norms to Social Robots
Malle, B. F., Rosen, E., Chi, V. B., Berg, M., & Haas, P. J. (2020) · IEEE RO-MAN · doi:10.1109/ro-man47096.2020.9223610 · Cited by 15
Inverse Differential Games With Mixed Inequality Constraints
Awasthi, C., & Lamperski, A. (2020) · Proceedings of the ... American Control Conference/Proceedings of the American Control Conference · doi:10.23919/acc45564.2020.9147489 · Cited by 15
Learning from My Partner's Actions: Roles in Decentralized Robot TeamsPreprint
Losey, D. P., Li, M., Bohg, J., & Sadigh, D. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1910.07613 · Cited by 15
Medical Dead-ends and Learning to Identify High-risk States and TreatmentsPreprint
Fatemi, M., Killian, T. W., Subramanian, J., & Ghassemi, M. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2110.04186 · Cited by 16
What Would Jiminy Cricket Do? Towards Agents That Behave MorallyPreprint
Hendrycks, D., Mazeika, M., Zou, A., Patel, S., Zhu, C., Navarro, J., Song, D. X., Li, B., & Steinhardt, J. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2110.13136 · Cited by 41
Taherisadr, M., Stavroulakis, S., & Elmalaki, S. (2023) · IEEE/ACM International Conference on Internet-of-Things Design and Implementation (IoTDI) · doi:10.1145/3576842.3582325 · Cited by 18
Grolleau, F., Petit, F., Gaudry, S., Diard, É., Quenot, J., Dreyfuss, D., Tran, V.-T., & Porcher, R. (2024) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocae004 · Cited by 16
Inverse Filtering for Linear Gaussian State-Space Models
Mattila, R., Rojas, C. R., Krishnamurthy, V., & Wahlberg, B. (2018) · IEEE Conference on Decision and Control (CDC) · doi:10.1109/cdc.2018.8619013 · Cited by 14
Bayesian Persuasion in Sequential Decision-Making
Gan, J., Majumdar, R., Radanović, G., & Singla, A. K. (2022) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v36i5.20434 · Cited by 14
Chen, Z., Nakamura, Y., & Ishiguro, H. (2023) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2023.3267385 · Cited by 14
Lee, J. A., Fong, J., Kok, B. C., & Soh, H. (2020) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros45743.2020.9340736 · Cited by 14
Learning to Collaborate in Markov Decision ProcessesPreprint
Radanović, G., Devidze, R., Parkes, D. C., & Singla, A. K. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1901.08029 · Cited by 15
Communicative Learning: A Unified Learning Formalism
Yuan, L., & Zhu, S. C. (2023) · Engineering · doi:10.1016/j.eng.2022.10.017 · Cited by 15
Evolving general cooperation with a Bayesian theory of mind
Max Kleiman-weiner, A., Vientós, A., Rand, D. G., & Tenenbaum, J. B. (2025) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.2400993122 · Cited by 18
Temporal Spatial Inverse Semantics for Robots Communicating with Humans
Gong, Z., & Yu, Z. (2018) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra.2018.8460754 · Cited by 13
Human-AI Learning Performance in Multi-Armed Bandits
Pandya, R., Huang, S. H., Hadfield-Menell, D., & Dragan, A. D. (2019) · Proceedings of the AAAI/ACM Conference on AI Ethics and Society · doi:10.1145/3306618.3314245 · Cited by 13
Self-citationOptimally Solving Two-Agent Decentralized POMDPs Under One-Sided Information Sharing
Xie, Y., Dibangoye, J., & Buffet, O. (2020) · HAL · Cited by 13
AI Development for the Public Interest: From Abstraction Traps to Sociotechnical Risks
Andrus, M., Dean, S., Gilbert, T. K., Lambert, N., & Zick, T. (2020) · IEEE International Symposium on Technology and Society (ISTAS) · doi:10.1109/istas50296.2020.9462193 · Cited by 15
Kim, S. K., Kirchner, E. A., & Kirchner, F. (2020) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra40945.2020.9197538 · Cited by 13
Modeling AGI Safety Frameworks with Causal Influence DiagramsPreprint
Everitt, T., Kumar, R., Krakovna, V., & Legg, S. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1906.08663 · Cited by 13
The Challenge of Value Alignment: from Fairer Algorithms to AI SafetyPreprint
Gabriel, I., & Ghazavi, V. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2101.06060 · Cited by 13
Russell, S. (2022) · Daedalus · doi:10.1162/daed_a_01899 · Cited by 18
Self-citationReasoning about causality in games
Hammond, L., Fox, J., Everitt, T., Carey, R., Abate, A., & Wooldridge, M. (2023) · Artificial Intelligence · doi:10.1016/j.artint.2023.103919 · Cited by 13
Influencing Leading and Following in Human-Robot Teams
Kwon, M., Li, M., Bucquet, A., & Sadigh, D. (2019) · Robotics: Science and Systems · doi:10.15607/rss.2019.xv.075 · Cited by 12
Ethical Issues with Artificial Ethics Assistants
O’Neill, E., Klincewicz, M., & Kemmer, M. (2022) · Oxford University Press eBooks · doi:10.1093/oxfordhb/9780198857815.013.17 · Cited by 13
Goal Alignment: Re-analyzing Value Alignment Problems Using Human-Aware AI
Mechergui, M., & Sreedharan, S. (2024) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v38i9.28875 · Cited by 18
Petersen, S. (2020) · doi:10.1093/oso/9780190905033.003.0015 · Cited by 12
Towards Game-based Metrics for Computational Co-Creativity
Canaan, R., Menzel, S., Togelius, J., & Nealen, A. (2018) · IEEE Conference on Computational Intelligence and Games (CIG) · doi:10.1109/cig.2018.8490429 · Cited by 12
Online inference of human belief for cooperative robots
Buehler, M. C., & Weisswange, T. H. (2018) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros.2018.8594076 · Cited by 12
Mammalian Value SystemsPreprint
Sarma, G., & Hay, N. J. (2017) · OSF Preprints (OSF Preprints) · doi:10.31219/osf.io/hu68m · Cited by 12
Encoding Ethics to Compute Value-Aligned Norms
Serramia, M., Rodríguez-Soto, M., López-Sánchez, M., Rodríguez-Aguilar, J. A., Bistaffa, F., Boddington, P., Wooldridge, M., & Ansótegui, C. (2023) · Minds and Machines · doi:10.1007/s11023-023-09649-7 · Cited by 17
Contextualizing predictive minds
Butz, M. V., Mittenbühler, M., Schwöbel, S., Achimova, A., Gumbsch, C., Otte, S., & Kiebel, S. J. (2024) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2024.105948 · Cited by 17
General-Sum Multi-Agent Continuous Inverse Optimal Control
Neumeyer, C., Oliehoek, F. A., & Gavrila, D. M. (2021) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2021.3060411 · Cited by 11
Pragmatics in Language Grounding: Phenomena, Tasks, and Modeling Approaches
Fried, D., Tomlin, N., Hu, J. C. W., Patel, R., & Nematzadeh, A. (2023) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2023.findings-emnlp.840 · Cited by 29
Reinforcement Learning and Inverse Reinforcement Learning with System 1 and System 2
Peysakhovich, A. (2019) · Proceedings of the AAAI/ACM Conference on AI Ethics and Society · doi:10.1145/3306618.3314259 · Cited by 11
Interactive Teaching Algorithms for Inverse Reinforcement Learning
Kamalaruban, P., Devidze, R., Cevher, V., & Singla, A. K. (2019) · International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2019/374 · Cited by 11
Maximizing Legibility in Stochastic Environments
Miura, S., Cohen, A. L., & Shlomo Zilberstein, B. (2021) · IEEE RO-MAN · doi:10.1109/ro-man50785.2021.9515318 · Cited by 11
Measuring and avoiding side effects using relative reachabilityPreprint
Krakovna, V., Orseau, L., Martic, M., & Legg, S. (2018) · arXiv (Cornell University) · Cited by 12
Trust-Region Inverse Reinforcement Learning
Cao, K., & Xie, L. (2023) · IEEE Transactions on Automatic Control · doi:10.1109/tac.2023.3274629 · Cited by 10
Robust Robot Planning for Human-Robot Collaboration
You, Y., Thomas, V., Colas, F., Alami, R., & Buffet, O. (2023) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra48891.2023.10161406 · Cited by 10
Effectively Learning from Pedagogical Demonstrations.
Ho, M. K., Littman, M. L., Cushman, F. A., & Austerweil, J. L. (2018) · eScholarship (California Digital Library) · Cited by 10
Object Detection-Based One-Shot Imitation Learning with an RGB-D Camera
Shao, Q., Qi, J., Ma, J., Fang, Y., Wang, W., & Hu, J. (2020) · Applied Sciences · doi:10.3390/app10030803 · Cited by 9
Avoiding Negative Side Effects Due to Incomplete Knowledge of AI Systems
Saisubramanian, S., Zilberstein, S., & Kamar, E. S. (2021) · AI Magazine · doi:10.1609/aimag.v42i4.7390 · Cited by 20
Active Learning and Machine Teaching for Online Learning: A Study of Attention and Labelling Cost
Tegen, A., Davidsson, P., & Persson, J. (2021) · International Conference on Machine Learning and Applications · doi:10.1109/icmla52953.2021.00197 · Cited by 13
Metadata
- Authors
- Hadfield-Menell, D., Dragan, A., Abbeel, P., & Russell, S.
- Venue
- arXiv
- Publisher
- arXiv
- Published
- 2016
- Volume
- 29
- Pages
- 3909-3917
- ISSN
- 2331-8422 (ISSN-L)
- arXiv
- 1606.03137
- OpenAlex
- W2410842990
- Cited by
- 413
- References
- 25
- Citations by year
- 2026: 1 · 2025: 18 · 2024: 59 · 2023: 56 · 2022: 37 · 2021: 66 · 2020: 80 · 2019: 41 · 2018: 27 · 2017: 25 · 2016: 2
- Type
- posted content
- Language
- en
- Open access
- green
- arxiv.org
- Locations
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Reinforcement Learning in Robotics
- Physical Sciences › Computer Science › Artificial Intelligence › Machine Learning and Algorithms
- Physical Sciences › Computer Science › Artificial Intelligence › AI-based Problem Solving and Planning
- Keywords
- value alignment, human-robot interaction, partially observable Markov decision processes, active teaching methods, active learning (machine learning), communicative action, robot learning from humans, reward function learning
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
