iGibson 2.0: Object-Centric Simulation for Robot Learning of Everyday Household Tasks
Open accessAbstract
Recent research in embodied AI has been boosted by the use of simulation environments to develop and train robot learning approaches. However, the use of simulation has skewed the attention to tasks that only require what robotics simulators can simulate: motion and physical contact. We present iGibson 2.0, an open-source simulation environment that supports the simulation of a more diverse set of household tasks through three key innovations. First, iGibson 2.0 supports object states, including temperature, wetness level, cleanliness level, and toggled and sliced states, necessary to cover a wider range of tasks. Second, iGibson 2.0 implements a set of predicate logic functions that map the simulator states to logic states like Cooked or Soaked. Additionally, given a logic state, iGibson 2.0 can sample valid physical states that satisfy it. This functionality can generate potentially infinite instances of tasks with minimal effort from the users. The sampling mechanism allows our scenes to be more densely populated with small objects in semantically meaningful locations. Third, iGibson 2.0 includes a virtual reality (VR) interface to immerse humans in its scenes to collect demonstrations. As a result, we can collect demonstrations from humans on these new types of tasks, and use them for imitation learning. We evaluate the new capabilities of iGibson 2.0 to enable robot learning of novel tasks, in the hope of demonstrating the potential of this new simulator to support new research in embodied AI. iGibson 2.0 and its new dataset are publicly available at http://svl.stanford.edu/igibson/.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In OMNIGIBSON, the authors trade off rendering speed for visual realism (ray-traced), reaching around 60 fps for a house scene of around 60 objects (vs. around 100 fps in iGibson 2.0).
“In OMNIGIBSON, we trade off rendering speed for visual realism (ray-traced), reaching around 60 fps for a house scene of around 60 objects (v.s. around 100 fps in iGibson 2.0 [59]).”
From BEHAVIOR-1K: A Human-Centered, Embodied AI Benchmark with 1,000 Everyday Activities and Realistic Simulation (2024) · cites this paper as [59]
The citation is attached to the iGibson 2.0 speed comparison, not to OMNIGIBSON’s reported 60 fps. In A.4 (p. 19), the performance table gives a mean of 125 for iGibson 2.0; 100 is the mean for iGibson 1.0. The benchmark setup is described in A.4 (p. 18). (LLM, conf=0.88)
Checked by a reasoning model — may be wrong.
Experimental — accuracy not yet measuredRealistic simulation of the diverse activities in BEHAVIOR-1K is beyond the capability of iGibson 2.0.
“BEHAVIOR-100 is implemented in iGibson 2.0 [59]; however, realistic simulation of the diverse activities in BEHAVIOR-1K is beyond the capability of iGibson 2.0.”
From BEHAVIOR-1K: A Human-Centered, Embodied AI Benchmark with 1,000 Everyday Activities and Realistic Simulation (2024) · cites this paper as [59]
The Limitations and Future Work section (p. 20) says iGibson 2.0 cannot scalably simulate flexible materials or accurately model human behavior, preventing tasks such as folding laundry, making beds, and elderly care. It does not assess BEHAVIOR-1K or establish that its diverse activities as a whole exceed the simulator’s capabilities. In the citing sentence, the citation is attached to the preceding BEHAVIOR-100 clause, not explicitly to this broader conclusion. (LLM, conf=0.84)
Experimental — accuracy not yet measuredOMNIGIBSON runs at a comparable speed to iGibson 2.0 under similar settings, but with much higher rendering quality due to ray-tracing.
“OMNIGIBSON runs at a comparable speed to previous works like iGibson 2.0 [59] under similar settings, but with much higher rendering quality thanks to ray-tracing.”
From BEHAVIOR-1K: A Human-Centered, Embodied AI Benchmark with 1,000 Everyday Activities and Realistic Simulation (2024) · cites this paper as [59]
OMNIGIBSON extends the infrastructure of extended object states and logical predicates from iGibson 2.0 to accommodate the diversity and realism of BEHAVIOR-1K.
“OMNIGIBSON extends the infrastructure of extended object states and logical predicates from iGibson 2.0 [59] to accommodate the diversity and realism of BEHAVIOR-1K.”
From BEHAVIOR-1K: A Human-Centered, Embodied AI Benchmark with 1,000 Everyday Activities and Realistic Simulation (2024) · cites this paper as [59]
RoboCasa supports photorealistic rendering and multiple robot embodiments.
“RoboCasa is one of the few frameworks to feature photorealistic rendering [21, 40, 27, 10, 6] and multiple robot embodiments [21, 26, 27, 6, 34].”
From RoboCasa: Large-Scale Simulation of Everyday Tasks for Generalist Robots (2024) · cites this paper as [26]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
Barsalou, L. W. (1999) · Behavioral and Brain Sciences · doi:10.1017/s0140525x99002149 · Cited by 6,887 · see citing works
Soft actor-critic Off-policy maximum entropy deep reinforcement learning with a stochastic actor
Haarnoja, T., Zhou, A., Abbeel, P., & Levine, S. (2018) · arXiv · doi:10.48550/arxiv.1801.01290 · Cited by 5,594 · see citing works
STRIPS: A New Approach to the Application of Theorem Proving to Problem Solving
Fikes, R. E., & Nilsson, N. J. (1971) · Artificial Intelligence · doi:10.1016/0004-3702(71)90010-5 · Cited by 4,882 · see citing works
MuJoCo: A physics engine for model-based control
Todorov, E., Erez, T., & Tassa, Y. (2012) · 2012 IEEE/RSJ International Conference on Intelligent Robots and Systems · doi:10.1109/iros.2012.6386109 · Cited by 4,767 · see citing works
A Reduction of Imitation Learning and Structured Prediction to No-Regret Online Learning
Ross, S., Gordon, G. J., & Bagnell, J. A. (2018) · Carnegie Mellon University · doi:10.1184/r1/6550949 · Cited by 1,941 · see citing works
ALVINN, an autonomous land vehicle in a neural network
Pomerleau, D. A. (2018) · doi:10.1184/r1/6603146 · Cited by 1,403 · see citing works
Habitat: A Platform for Embodied AI Research
Savva, M., Kadian, A., Maksymets, O., Zhao, Y., Wijmans, E., Jain, B., Straub, J., Liu, J., Koltun, V., Malik, J., et al. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00943 · Cited by 1,237 · see citing works
Objects, parts, and categories.
Tversky, B., & Hemenway, K. (1984) · Journal of Experimental Psychology General · doi:10.1037/0096-3445.113.2.169 · Cited by 768 · see citing works
Gibson Env: Real-World Perception for Embodied Agents
Xia, F., Zamir, A. R., He, Z., Sax, A., Malik, J., & Savarese, S. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00945 · Cited by 763 · see citing works
Self-citationDeep Imitation Learning for Complex Manipulation Tasks from Virtual Reality Teleoperation
Zhang, T., McCarthy, Z., Jow, O., Lee, D., Chen, X., Goldberg, K., & Abbeel, P. (2018) · 2018 IEEE International Conference on Robotics and Automation (ICRA) · doi:10.1109/icra.2018.8461249 · Cited by 609 · see citing works
AI2-THOR: An Interactive 3D Environment for Visual AI
Kolve, E., Mottaghi, R., Han, W., VanderBilt, E., Weihs, L., Herrasti, A., Deitke, M., Ehsani, K., Gordon, D., Zhu, Y., et al. (2017) · arXiv · doi:10.48550/arxiv.1712.05474 · Cited by 578 · see citing works
SOFA: A Multi-Model Framework for Interactive Physical Simulation
Fauré, F., Christian Duriez, A., Delingette, H., Allard, J., Gilles, B., Marchesseau, S., Talbot, H., Courtecuisse, H., Bousquet, G., Peterlík, I., et al. (2012) · Studies in mechanobiology, tissue engineering and biomaterials · doi:10.1007/8415_2012_125 · Cited by 475 · see citing works
Meta-World: A Benchmark and Evaluation for Multi-Task and Meta Reinforcement Learning
Yu, T., Quillen, D., He, Z., Julian, R., Narayan, A., Shively, H., Bellathur, A., Hausman, K., Finn, C., & Levine, S. (2019) · arXiv · doi:10.48550/arxiv.1910.10897 · Cited by 450 · see citing works
SAPIEN: A SimulAted Part-Based Interactive ENvironment
Xiang, F., Qin, Y., Mo, K., Xia, Y., Zhu, H., Liu, F., Liu, M., Jiang, H., Yuan, Y., Wang, H., et al. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.01111 · Cited by 406 · see citing works
RLBench: The Robot Learning Benchmark & Learning Environment
James, S., Ma, Z., Arrojo, D. R., & Davison, A. J. (2020) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2020.2974707 · Cited by 405 · see citing works
VirtualHome: Simulating Household Activities Via Programs
Puig, X., Ra, K., Boben, M., Li, J., Wang, T., Fidler, S., & Torralba, A. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00886 · Cited by 378 · see citing works
Software toolkit for modeling, simulation, and control of soft robots
Coevoet, E., Bieze, T. M., Largilliere, F., Zhang, Z., Thieffry, M., Lopez, M. S., Carrez, B., Marchal, D., Goury, O., Dequidt, J., et al. (2017) · Advanced Robotics · doi:10.1080/01691864.2017.1395362 · Cited by 248 · see citing works
iGibson 1.0: A Simulation Environment for Interactive Tasks in Large Realistic Scenes
Shen, B., Xia, F., Li, C., Martín-Martín, R., Fan, L., Wang, G., Pérez-D’Arpino, C., Buch, S., Srivastava, S., Tchapmi, L. P., et al. (2021) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros51168.2021.9636667 · Cited by 182 · see citing works
Self-citationInteractive Gibson Benchmark: A Benchmark for Interactive Navigation in Cluttered Environments
Xia, F., Shen, W. B., Li, C., Kasimbeg, P., Tchapmi, M. E., Toshev, A., Martin-Martin, R., & Savarese, S. (2020) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2020.2965078 · Cited by 171 · see citing works
Self-citationrobosuite: A Modular Simulation Framework and Benchmark for Robot LearningPreprint
Zhu, Y., Wong, J., Mandlekar, A., Martín-Martín, R., Joshi, A., Lin, K., Maddukuri, A., Nasiriany, S., & Zhu, Y. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2009.12293 · Cited by 148 · see citing works
Self-citationSoftGym: Benchmarking Deep Reinforcement Learning for Deformable Object Manipulation
Lin, X., Wang, Y., Olkin, J., & Held, D. (2020) · arXiv · doi:10.48550/arxiv.2011.07215 · Cited by 140 · see citing works
ThreeDWorld: A Platform for Interactive Multi-Modal Physical SimulationPreprint
Gan, C., Schwartz, J., Alter, S., Mrowca, D., Schrimpf, M., Traer, J. A., Freitas, J. D., Kubilius, J., Bhandwaldar, A., Haber, N., et al. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2007.04954 · Cited by 138 · see citing works
Self-citationRearrangement: A Challenge for Embodied AI
Batra, D., Chang, A. X., Chernova, S., Davison, A. J., Deng, J., Koltun, V., Levine, S., Malik, J., Mordatch, I., Mottaghi, R., et al. (2020) · arXiv · doi:10.48550/arxiv.2011.01975 · Cited by 109 · see citing works
Martínez-González, P., Oprea, S., García-García, A., Jover-Álvarez, Á., Orts‐Escolano, S., & García‐Rodríguez, J. (2019) · Virtual Reality · doi:10.1007/s10055-019-00399-5 · Cited by 108 · see citing works
Unity Game Development Essentials
Goldstone, W. (2009) · Cited by 98 · see citing works
Weihs, L., Deitke, M., Kembhavi, A., & Mottaghi, R. (2021) · 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr46437.2021.00586 · Cited by 98 · see citing works
ManipulaTHOR: A Framework for Visual Object Manipulation
Ehsani, K., Han, W., Herrasti, A., VanderBilt, E., Weihs, L., Kolve, E., Kembhavi, A., & Mottaghi, R. (2021) · 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr46437.2021.00447 · Cited by 81 · see citing works
OCRTOC: A Cloud-Based Competition and Benchmark for Robotic Grasping and Manipulation
Liu, Z., Liu, W., Qin, Y., Xiang, F., Gou, M., Xin, S., Roa, M. A., Çallı, B., Su, H., Sun, Y., et al. (2021) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2021.3129136 · Cited by 52 · see citing works
Evolving soft robotic locomotion in PhysX
Rieffel, J. A., Saunders, F., Nadimpalli, S., Zhou, H., Hassoun, S., Rife, J. H., & Trimmer, B. A. (2009) · Genetic and Evolutionary Computation Conference Companion (GECCO Companion) · doi:10.1145/1570256.1570351 · Cited by 49 · see citing works
DelPreto, J., Lipton, J., Sanneman, L. M., Fay, A. J., Fourie, C. K., Choi, C., & Rus, D. (2020) · IEEE International Conference on Robotics and Automation · doi:10.1109/icra40945.2020.9196754 · Cited by 44 · see citing works
García-García, A., Martínez-González, P., Oprea, S., Castro-Vargas, J. A., Orts‐Escolano, S., García‐Rodríguez, J., & Jover-Álvarez, Á. (2018) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros.2018.8594495 · Cited by 43 · see citing works
VRKitchen: an Interactive 3D Virtual Environment for Task-oriented LearningPreprint
Gao, X., Gong, R., Shu, T., Xie, X., Wang, S., & Zhu, S. C. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1903.05757 · Cited by 37 · see citing works
Gan, C., Zhou, S., Schwartz, J., Alter, S., Bhandwaldar, A., Gutfreund, D., Yamins, D. L. K., DiCarlo, J. J., McDermott, J., Torralba, A., et al. (2021) · arXiv · doi:10.48550/arxiv.2103.14025 · Cited by 13 · see citing works
Flagged first, then by citations
Research works printed but not linked: 2
- [35][35] G. A. Miller. WordNet: a lexical database. Communications of the ACM , 38(11):39-41, 1995. -
- [42][42] K. Ehsani, W. Han, A. Herrasti, E. VanderBilt, L. Weihs, E. Kolve, A. Kembhavi, and R. Mottaghi. Manipulathor: A framework for visual object manipulation. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition , pages 4497-4506, 2021.
Cited by
Sorted by citations
Self-Driving Laboratories for Chemistry and Materials Science
Tom, G., Schmid, S. P., Baird, S. G., Cao, Y., Darvish, K., Hao, H., Lo, S., Pablo-García, S., Rajaonson, E. M., Skreta, M., et al. (2024) · Chemical Reviews · doi:10.1021/acs.chemrev.4c00055 · Cited by 707 · see citing works
Objaverse: A Universe of Annotated 3D Objects
Deitke, M., Schwenk, D., Salvador, J., Weihs, L., Michel, O., VanderBilt, E., Schmidt, L., Ehsanit, K., Kembhavi, A., & Farhadi, A. (2023) · 2023 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52729.2023.01263 · Cited by 725 · see citing works
A Survey on Active Simultaneous Localization and Mapping: State of the Art and New Frontiers
Placed, J. A., Strader, J., Carrillo, H., Atanasov, N., Indelman, V., Carlone, L., & Castellanos, J. A. (2023) · IEEE Transactions on Robotics · doi:10.1109/tro.2023.3248510 · Cited by 345 · see citing works
Orbit: A Unified Simulation Framework for Interactive Robot Learning Environments
Mittal, M., Yu, C., Yu, Q., Liu, J., Rudin, N., Hoeller, D., Yuan, J. L., Singh, R., Guo, Y., Mazhar, H., et al. (2023) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2023.3270034 · Cited by 279 · see citing works
MetaDrive: Composing Diverse Driving Scenarios for Generalizable Reinforcement Learning
Li, Q., Peng, Z., Feng, L., Zhang, Q., Xue, Z., & Zhou, B. (2023) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2022.3190471 · Cited by 246 · see citing works
Diffusion-based Generation, Optimization, and Planning in 3D Scenes
Huang, S., Wang, Z., Li, P., Jia, B., Liu, T., Zhu, Y., Liang, W., & Zhu, S.-C. (2023) · 2023 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52729.2023.01607 · Cited by 192 · see citing works
UniSim: A Neural Closed-Loop Sensor Simulator
Yang, Z., Chen, Y., Wang, J., Manivasagam, S., Ma, W.-C., Yang, A. J., & Urtasun, R. (2023) · 2023 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52729.2023.00140 · Cited by 170 · see citing works
Simple but Effective: CLIP Embeddings for Embodied AI
Khandelwal, A., Weihs, L., Mottaghi, R., & Kembhavi, A. (2022) · 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52688.2022.01441 · Cited by 172 · see citing works
Ditto: Building Digital Twins of Articulated Objects from Interaction
Jiang, Z., Hsu, C.-C., & Zhu, Y. (2022) · 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52688.2022.00553 · Cited by 92 · see citing works
Infinite Photorealistic Worlds Using Procedural Generation
Raistrick, A., Lipson, L., Ma, Z., Mei, L., Wang, M., Zuo, Y., Kayan, K., Wen, H., Han, B., Wang, Y., et al. (2023) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52729.2023.01215 · Cited by 89 · see citing works
Long, Y., Wang, W., Huang, T., Wang, Y., & Dou, Q. (2023) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2023.3284380 · Cited by 75 · see citing works
LEGO-Net: Learning Regular Rearrangements of Objects in Rooms
Wei, Q. A., Ding, S., Park, J. J., Sajnani, R., Poulenard, A., Sridhar, S., & Guibas, L. (2023) · 2023 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52729.2023.01825 · Cited by 60 · see citing works
PhyScene: Physically Interactable 3D Scene Synthesis for Embodied AI
Yang, Y., Jia, B., Zhi, P., & Huang, S. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.01539 · Cited by 55 · see citing works
Huang, Y., Guo, C., Xu, J., Zhang, M., Yang, L., Pei, B., Zhang, H., Lu, D., Wang, Y., Wang, L., et al. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.02084 · Cited by 43 · see citing works
RCare World: A Human-centric Simulation World for Caregiving Robots
Ye, R., Xu, W., Fu, H., Jenamani, R. K., Nguyễn, V., Lu, C., Dimitropoulou, K. A., & Bhattacharjee, T. (2022) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros47612.2022.9982244 · Cited by 41 · see citing works
Core Challenges in Embodied Vision-Language Planning
Francis, J., Kitamura, N., Labelle, F., Lu, X., Navarro, I., & Oh, J. (2022) · Journal of Artificial Intelligence Research · doi:10.1613/jair.1.13646 · Cited by 40 · see citing works
TVT-Transformer: A Tactile-visual-textual fusion network for object recognition
Li, B., Li, L., Wang, H., Chen, G., Wang, B., & Qiu, S. (2025) · Information Fusion · doi:10.1016/j.inffus.2025.102943 · Cited by 33 · see citing works
Multi-Robot Active Mapping via Neural Bipartite Graph Matching
Ye, K., Dong, S., Fan, Q., Wang, H., Yi, L., Xia, F., Wang, J., & Chen, B. (2022) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52688.2022.01442 · Cited by 32 · see citing works
Self-citationExploring Embodied Multimodal Large Models: Development, datasets, and future directions
Chen, S., Wu, Z., Zhang, K., Li, C., Zhang, B., Ma, F., Yu, F. R., & Li, Q. (2025) · Information Fusion · doi:10.1016/j.inffus.2025.103198 · Cited by 31 · see citing works
Self-citationDreamingV2: Reinforcement Learning with Discrete World Models without Reconstruction
Okada, M., & Taniguchi, T. (2022) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros47612.2022.9981405 · Cited by 26 · see citing works
Synthetic-to-Real Domain Adaptation for Action Recognition: A Dataset and Baseline Performances
Reddy, A., Shah, K., Paul, W., Mocharla, R., Hoffman, J., Katyal, K. D., Manocha, D., de Melo, C. M., & Chellappa, R. (2023) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra48891.2023.10160416 · Cited by 24 · see citing works
Bridging Requirements, Planning, and Evaluation: A Review of Social Robot Navigation
Karwowski, J., Szynkiewicz, W., & Niewiadomska‐Szynkiewicz, E. (2024) · Sensors · doi:10.3390/s24092794 · Cited by 21 · see citing works
Ditto in the House: Building Articulation Models of Indoor Scenes through Interactive Perception
Hsu, C.-C., Jiang, Z., & Zhu, Y. (2023) · 2023 IEEE International Conference on Robotics and Automation (ICRA) · doi:10.1109/icra48891.2023.10161431 · Cited by 21 · see citing works
“We evaluate our approach on the CubiCasa5K [17] dataset with the iGibson [21] simulator.”
MethodLearning Hierarchical Interactive Multi-Object Search for Mobile Manipulation
Schmalstieg, F., Honerkamp, D., Welschehold, T., & Valada, A. (2023) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2023.3329619 · Cited by 21 · see citing works
A Survey of Reasoning with Foundation ModelsPreprint
Sun, J., Zheng, C., Xie, E., Liu, Z., Chu, R., Liu, J., Xu, J., Ding, M., Li, H., Geng, M., et al. (2023) · doi:10.31219/osf.io/ac4sp · Cited by 51 · see citing works
Demonstrating RFUniverse: A Multiphysics Simulation Platform for Embodied AI
Fu, H., Xu, W., Ye, R., Han, X., Yu, Z., Tang, T., Li, Y., Du, W., Zhang, J., & Lu, C. (2023) · Robotics: Science and Systems · doi:10.15607/rss.2023.xix.087 · Cited by 19 · see citing works
Causal Policy Gradient for Whole-Body Mobile Manipulation
Hu, J., Stone, P., & Mart�n-Mart�n, R. (2023) · Robotics: Science and Systems · doi:10.15607/rss.2023.xix.049 · Cited by 18 · see citing works
Self-citationHabitat 3.0: A Co-Habitat for Humans, Avatars, and Robots
Puig, X., Undersander, E., Szot, A., Cote, M. D., Yang, T.-Y., Partsey, R., Desai, R., Clegg, A. W., Hlavac, M., Min, S. Y., et al. (2023) · arXiv · doi:10.48550/arxiv.2310.13724 · Cited by 15 · see citing works
Finding Fallen Objects Via Asynchronous Audio-Visual Integration
Gan, C., Gu, Y., Zhou, S., Schwartz, J., Alter, S., Traer, J. A., Gutfreund, D., Tenenbaum, J. B., McDermott, J. H., & Torralba, A. B. (2022) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52688.2022.01027 · Cited by 15 · see citing works
Murali, A., Mousavian, A., Eppner, C., Fishman, A., & Fox, D. (2023) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra48891.2023.10161528 · Cited by 14 · see citing works
Task-Driven Graph Attention for Hierarchical Relational Object Navigation
Lingelbach, M., Li, C., Hwang, M., Kurenkov, A., Lou, A., Martín-Martín, R., Zhang, R., Fei-Fei, L., & Wu, J. (2023) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra48891.2023.10161157 · Cited by 14 · see citing works
Self-citationTask and Motion Planning Methods: Applications and Limitations
Zhang, K., Lucet, E., Sandretto, J. A. D., Kchir, S., & Filliat, D. (2022) · International Conference on Informatics in Control, Automation and Robotics (ICINCO) · doi:10.5220/0011314000003271 · Cited by 11 · see citing works
A Wearable Robotic Hand for Hand-over-Hand Imitation Learning
Wei, D., & Xu, H. (2024) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra57147.2024.10610516 · Cited by 10 · see citing works
BEHAVIOR Vision Suite: Customizable Dataset Generation via Simulation
Ge, Y., Tang, Y., Xu, J., Gökmen, C., Li, C., Ai, W., Martinez, B., Aydin, A., Anvari, M., Chakravarthy, A. K., et al. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.02114 · Cited by 10 · see citing works
Self-citationLearning to Act with Affordance-Aware Multimodal Neural SLAM
Jia, Z., Lin, K., Zhao, Y., Gao, Q., Thattai, G., & Sukhatme, G. S. (2022) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros47612.2022.9981261 · Cited by 10 · see citing works
Sonicverse: A Multisensory Simulation Platform for Embodied Household Agents that See and Hear
Gao, R., Li, H., Dharan, G., Wang, Z., Li, C., Xia, F., Savarese, S., Fei-Fei, L., & Wu, J. (2023) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra48891.2023.10160461 · Cited by 9 · see citing works
Self-citationImmersive Demonstrations are the Key to Imitation Learning
Li, K., Chappell, D., & Rojas, N. (2023) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra48891.2023.10160560 · Cited by 8 · see citing works
EXCALIBUR: Encouraging and Evaluating Embodied Exploration
Zhu, H., Kapoor, R., Min, S. Y., Han, W., Li, J., Geng, K., Neubig, G., Bisk, Y., Kembhavi, A., & Weihs, L. (2023) · 2023 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52729.2023.01434 · Cited by 9 · see citing works
A Shared Autonomous Nursing Robot Assistant with Dynamic Workspace for Versatile Mobile Manipulation
Boguslavskii, N., Zhong, Z., Genua, L. M., & Li, Z. (2023) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros55552.2023.10342401 · Cited by 8 · see citing works
Mobile Manipulation Leveraging Multiple Views
Watkins-Valls, D., Allen, P. K., Maia, H. T., Seshadri, M., Sanabria, J., Waytowich, N. R., & Varley, J. (2022) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros47612.2022.9981277 · Cited by 7 · see citing works
Smart Help: Strategic Opponent Modeling for Proactive and Adaptive Robot Assistance in Households
Cao, Z., Wang, Z., Xie, S., Liu, A., & Fan, L. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.01713 · Cited by 7 · see citing works
A Survey and Comparison of Activities of Daily Living Datasets in Real-life and Virtual Spaces
Htun, S. N. N., Egami, S., & Fukuda, K. (2023) · IEEE/SICE International Symposium on System Integration (SII) · doi:10.1109/sii55687.2023.10039226 · Cited by 7 · see citing works
M-EMBER: Tackling Long-Horizon Mobile Manipulation via Factorized Domain Transfer
Wu, B., Martín-Martín, R., & Fei-Fei, L. (2023) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra48891.2023.10160934 · Cited by 7 · see citing works
Self-citationClay, V., Pipa, G., Kühnberger, K., & Peter König, B. (2023) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2023.3323040 · Cited by 7 · see citing works
Li, C., Zhang, R., Wong, J., Gokmen, C., Srivastava, S., Martín-Martín, R., Wang, C., Levine, G., Ai, W., Martinez, B., et al. (2024) · arXiv · doi:10.48550/arxiv.2403.09227 · Cited by 6 · see citing works
“Adapted from [59]. be useful to the broad embodied AI research community, with the goal of accelerating breakthroughs on BEHAVIOR-1K.”
BackgroundMethodInfluentialSelf-citationWorldGen: A Large Scale Generative Simulator
Singh, C. D., Kumari, R., Fermuller, C. M., Sanket, N. J., & Aloimonos, Y. (2023) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra48891.2023.10160861 · Cited by 5 · see citing works
Galactic: Scaling End-to-End Reinforcement Learning for Rearrangement at 100k Steps-Per-Second
Berges, V.-P., Szot, A., Chaplot, D. S., Gokaslan, A., Mottaghi, R., Batra, D., & Undersander, E. (2023) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52729.2023.01323 · Cited by 5 · see citing works
LUMINOUS: Indoor Scene Generation for Embodied AI ChallengesPreprint
Zhao, Y., Lin, K., Jia, Z., Gao, Q., Thattai, G., Thomason, J., & Sukhatme, G. S. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2111.05527 · Cited by 5 · see citing works
The Warehouse Robot Interaction Sim
Esterwood, C. T., & Robert, L. (2023) · ACM/IEEE International Conference on Human-Robot Interaction (HRI) · doi:10.1145/3568294.3580086 · Cited by 4 · see citing works
Learning Scene Representations for Human-assistive Displays Using Self-attention Networks
Ruiz-Serra, J., White, J., Petrie, S., Kameneva, T., & McCarthy, C. D. (2024) · ACM Transactions on Multimedia Computing Communications and Applications · doi:10.1145/3650111 · Cited by 4 · see citing works
(2023) · doi:10.1109/iros55552.2023.10341959 · Cited by 4 · see citing works
RoboCasa: Large-Scale Simulation of Everyday Tasks for Generalist Robots
Nasiriany, S., Maddukuri, A., Zhang, L., Parikh, A., Lo, A., Joshi, A., Mandlekar, A., & Zhu, Y. (2024) · arXiv · doi:10.48550/arxiv.2406.02523 · Cited by 3 · see citing works
“RoboCasa is one of the few frameworks to feature photorealistic rendering [21, 40, 27, 10, 6] and multiple robot embodiments [21, 26, 27, 6, 34].”
BackgroundGood Time to Ask: A Learning Framework for Asking for Help in Embodied Visual Navigation
Zhang, J., Yu, S. S., Duan, J., & Tan, C. (2023) · International Conference on Ubiquitous Robots (UR) · doi:10.1109/ur57808.2023.10202397 · Cited by 4 · see citing works
Wireless Channel Prediction in Partially Observed Environments
Yin, M., Hu, Y., Azzino, T., Kang, S., Mezzavilla, M., & Rangan, S. (2022) · IEEE International Workshop on Signal Processing Advances in Wireless Communications (SPAWC) · doi:10.1109/spawc51304.2022.9833929 · Cited by 2 · see citing works
Household Navigation and Manipulation for Everyday Object Rearrangement Tasks
Iyer, S. R., Pal, A., Hu, J., Adeleye, A., Aggarwal, A., & Christensen, H. I. (2023) · IEEE International Conference on Robotic Computing (IRC) · doi:10.1109/irc59093.2023.00021 · Cited by 2 · see citing works
Towards Multimodal Multitask Scene Understanding Models for Indoor Mobile Agents
Tsai, Y.-H. H., Goh, H., Farhadi, A., & Zhang, J. (2023) · International Conference on Robotics and Automation Engineering (ICRAE) · doi:10.1109/icrae59816.2023.10458473 · Cited by 2 · see citing works
Embodied visual route following by an insect-inspired robotPreprint
Yihe, L., Cen, J., Maroun, R. A., & Webb, B. H. (2024) · Research Square · doi:10.21203/rs.3.rs-4222706/v1 · Cited by 2 · see citing works
Complex Task Planning for General-Purpose Service Robots
Contreras, L., Savage, J., Ortuño-Chanelo, S., Negrete, M., & Okada, H. (2025) · Journal of Robotics and Mechatronics · doi:10.20965/jrm.2025.p0594 · Cited by 1 · see citing works
Vertens, J., & Burgard, W. (2022) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros47612.2022.9982014 · Cited by 1 · see citing works
Marinov, Z., Schneider, D., Roitberg, A., & Stiefelhagen, R. (2022) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros47612.2022.9981946 · Cited by 1 · see citing works
Ditto in the House: Building Articulation Models of Indoor Scenes through Interactive Perception
Hsu, C.-C., Jiang, Z., & Zhu, Y. (2023) · arXiv · Cited by 21 · see citing works
ANew VR Kitchen Environment for Recording Well Annotated Object Interaction Tasks
Koller, M. T., Patten, T., & Vincze, M. (2022) · ACM/IEEE International Conference on Human-Robot Interaction (HRI) · doi:10.1109/hri53351.2022.9889370
- Authors
- Li, C., Xia, F., Martín-Martín, R., Lingelbach, M., Srivastava, S., Shen, B., Vainio, K., Gokmen, C., Dharan, G., Jain, T., Kurenkov, A., Liu, C. K., Gweon, H., Wu, J., Fei-Fei, L., & Savarese, S.
- Affiliations
- Stanford University (US)
- ORCID
- Venue
- arXiv
- Publisher
- arXiv
- Published
- 2021
- ISSN
- 2331-8422 (ISSN-L)
- arXiv
- 2108.03272
- OpenAlex
- W3190215236
- Cited by
- 58
- References
- 33
- Citations by year
- 2025: 3 · 2024: 10 · 2023: 29 · 2022: 15 · 2021: 1
- Type
- posted content
- Language
- en
- Open access
- green
- arxiv.org
- Locations
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University) (cc-by)
- Funders
- National Science Foundation
- Multidisciplinary University Research Initiative (W911NF-15-1-0479)
- Office of Naval Research (N000141612127, N00014)
- Topics
- Physical Sciences › Engineering › Control and Systems Engineering › Robot Manipulation and Learning
- Physical Sciences › Computer Science › Artificial Intelligence › Reinforcement Learning in Robotics
- Physical Sciences › Engineering › Control and Systems Engineering › Robotics and Automated Systems
- Keywords
- robot learning, housework, simulation environment, object state, first-order logic, imitation learning, embodied AI, open-source simulator
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
