Interactive Gibson Benchmark: A Benchmark for Interactive Navigation in Cluttered Environments
Open accessThe DOI matches its Crossref record; 47 of the 47 references it cites were found in a registry or an index.
Abstract
We present Interactive Gibson Benchmark, the first comprehensive benchmark for training and evaluating Interactive Navigation solutions. Interactive Navigation tasks are robot navigation problems where physical interaction with objects (e.g., pushing) is allowed and even encouraged to reach the goal. Our benchmark comprises two novel elements: 1) a new experimental simulated environment, the Interactive Gibson Environment, that generate photo-realistic images of indoor scenes and simulates realistic physical interactions of robots and common objects found in these scenes; 2) the Interactive Navigation Score, a novel metric to study the interplay between navigation and physical interaction of Interactive Navigation solutions. We present and evaluate multiple learning-based baselines in Interactive Gibson Benchmark, and provide insights into regimes of navigation with different trade-offs between navigation, path efficiency and disturbance of surrounding objects. We make our benchmark publicly available1 and encourage researchers from related robotics disciplines (e.g., planning, learning, control) to propose, evaluate, and compare their Interactive Navigation solutions in Interactive Gibson Benchmark.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“The interactive navigation task [15] relaxes this assumption by placing objects that the robot has to push away to reach the target.”
From Learning Hierarchical Interactive Multi-Object Search for Mobile Manipulation (2023) · cites this paper as [15]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Inspiring as they are, the tasks and activities in those benchmarks are designed by researchers; it remains unclear if they are addressing the actual needs of humans.”
From BEHAVIOR-1K: A Human-Centered, Embodied AI Benchmark with 1,000 Everyday Activities and Realistic Simulation (2024) · cites this paper as [22]
Experimental — accuracy not yet measuredIn the citing paper
“The development of benchmarks requires careful consideration of workload representativeness to ensure that the tests reflect realworld usage scenarios [19].”
From Inadequacies of Large Language Model Benchmarks in the Era of Generative Artificial Intelligence (2026) · cites this paper as [19]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Fischler, M. A., & Bolles, R. C. (1981) · Communications of the ACM · doi:10.1145/358669.358692 · Cited by 25,893 · cited 1×
“We fill them using a RANSAC [51] plane fitting procedure (Fig.”
MethodContinuous control with deep reinforcement learning
Lillicrap, T. P., Hunt, J. J., Pritzel, A., Heess, N., Erez, T., Tassa, Y., Silver, D., & Wierstra, D. (2015) · arXiv · doi:10.48550/arxiv.1509.02971 · Cited by 10,782 · cited 2×
“We evaluate and compare three widely used reinforcement learning algorithms: PPO [16], DDPG [17], SAC [18] (implementations adopted from tf-agents [55] and modified to accommodate our environments).”
MethodProximal Policy Optimization Algorithms
Schulman, J., Wolski, F., Dhariwal, P., Radford, A., & Klimov, O. (2017) · arXiv · doi:10.48550/arxiv.1707.06347 · Cited by 10,625 · cited 2×
“We evaluate and compare three widely used reinforcement learning algorithms: PPO [16], DDPG [17], SAC [18] (implementations adopted from tf-agents [55] and modified to accommodate our environments).”
MethodAmazon's Mechanical Turk: A New Source of Inexpensive, Yet High-Quality, Data?
Buhrmester, M., Kwang, T., & Gosling, S. D. (2011) · Perspectives on Psychological Science · doi:10.1177/1745691610393980 · Cited by 9,996
Vision meets robotics: The KITTI dataset
Geiger, A., Lenz, P., Stiller, C., & Urtasun, R. (2013) · The International Journal of Robotics Research · doi:10.1177/0278364913491297 · Cited by 9,913 · cited 1×
“[27] provides datasets and metrics to evaluate SLAM solutions and other localization skills under the assumption that these components are common to all navigation systems.”
BackgroundMuJoCo: A physics engine for model-based control
Todorov, E., Erez, T., & Tassa, Y. (2012) · 2012 IEEE/RSJ International Conference on Intelligent Robots and Systems · doi:10.1109/iros.2012.6386109 · Cited by 4,767 · cited 3×
“[3] E. Todorov, T. Erez, and Y. Tassa, “Mujoco: A physics engine for model-based control,” in Proc.”
MethodDesign and use paradigms for gazebo, an open-source multi-robot simulator
Koenig, N., & Howard, A. (2005) · 2004 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) (IEEE Cat. No.04CH37566) · doi:10.1109/iros.2004.1389727 · Cited by 3,638 · cited 1×
“In robot manipulation, researchers have alleviated these risks using physics simulation engines [3]–[5].”
ShapeNet: An Information-Rich 3D Model Repository
Chang, A. X., Funkhouser, T., Guibas, L., Hanrahan, P., Huang, Q., Li, Z., Savarese, S., Savva, M., Song, S., Su, H., et al. (2015) · arXiv · doi:10.48550/arxiv.1512.03012 · Cited by 2,330 · cited 6×
“Object Alignment: The goal of this stage is to 1) select the most similar CAD model from a set of possibilities [46], and 2) obtain the scale and the pose to align the CAD model to the reconstructed mesh.”
MethodInfluentialSelf-citation4D Spatio-Temporal ConvNets: Minkowski Convolutional Neural Networks
Choy, C., Gwak, J., & Savarese, S. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00319 · Cited by 2,043 · cited 2×
“3: Annotation Process of the Interactive Gibson Assets In Gibson V1 each environment is composed by a single mesh (1); for Interactive Gibson we need to segment the instances of classes of interest to study Interactive Navigation into separate interactable meshes; We use a combination of a Minkowski SegNet [45] (2) an…”
MethodSelf-citationSoft Actor-Critic Algorithms and Applications
Haarnoja, T., Zhou, A., Hartikainen, K., Tucker, G., Ha, S., Tan, J., Kumar, V., Zhu, H., Gupta, A., Abbeel, P., et al. (2018) · arXiv · doi:10.48550/arxiv.1812.05905 · Cited by 1,994 · cited 5×
“We fill them using a RANSAC [51] plane fitting procedure (Fig.”
MethodInfluential
Research works printed but not linked: 7
- munoz, 0, Evaluation of navigation of an autonomous mobile robot, Proc of the Perf Metrics for Intell Sys Workshop, 15
- nowak, 2010, Benchmarks for mobile manipulation and robust obstacle avoidance and navigation, BRICS Deliverable D, 3, 1
- siciliano, 2007, Springer Handbook of Robotics
- del pobil, 0, Benchmarks in robotics research, Proc Int Conf Intell Robots Syst
- li, 0, HRL4IN: Hierarchical reinforcement learning forinteractive navigation with mobile manipulators, Proc Conf Robot Learn
- coumans, 2013, Bullet physics library, Open Source Bulletphysics Org, 15, 5
- shum, 2000, Visual Communications and Image Processing, 4067
Cited by
Multi-Stage Learning for Grasp-Constrained Object Manipulation with a Simulated Panda Robot
Zhu, Y., Wong, J., Mandlekar, A., Martín-Martín, R., Joshi, A., Lin, K., Maddukuri, A., Nasiriany, S., & Zhu, Y. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2009.12293 · Cited by 148
“In recent years, advances in physics-based simulations and graphics have led to a series of simulated platforms and toolkits [1, 14, 8, 2, 16] that have accelerated scientific progress on robotics and embodied AI.”
BackgroundA Survey on Vision--Language--Action Models for Embodied AI
Ma, Y., Song, Z., Zhuang, Y., Hao, J., & King, I. (2026) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2025.3650584 · Cited by 474
“Restrictions apply.”
A Survey of Embodied AI: From Simulators to Research Tasks
Duan, J., Yu, S., Tan, H. L., Zhu, H., & Tan, C. (2022) · IEEE Transactions on Emerging Topics in Computational Intelligence · doi:10.1109/tetci.2022.3141105 · Cited by 420
SAPIEN: A SimulAted Part-Based Interactive ENvironment
Xiang, F., Qin, Y., Mo, K., Xia, Y., Zhu, H., Liu, F., Liu, M., Jiang, H., Yuan, Y., Wang, H., et al. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.01111 · Cited by 406
Google Scanned Objects: A High-Quality Dataset of 3D Scanned Household Items
Downs, L., Francis, A., Koenig, N., Kinman, B., Hickman, R., Reymann, K., McHugh, T. B., & Vanhoucke, V. (2022) · 2022 International Conference on Robotics and Automation (ICRA) · doi:10.1109/icra46639.2022.9811809 · Cited by 377
Metadata
- Authors
- Xia, F., Shen, W. B., Li, C., Kasimbeg, P., Tchapmi, M. E., Toshev, A., Martin-Martin, R., & Savarese, S.
- Affiliations
- Stanford University (US)
- Google (United States) (US)
- Venue
- IEEE Robotics and Automation Letters
- Published
- 2020-04
- Volume
- 5
- Issue
- 2
- Pages
- 713-720
- ISSN
- 2377-3766 (ISSN-L)
- 2377-3774
- OpenAlex
- W2998903229
- Cited by
- 171
- References
- 47
- Citations by year
- 2026: 4 · 2025: 17 · 2024: 24 · 2023: 27 · 2022: 26 · 2021: 47 · 2020: 25
- FWCI
- 12.28
- Type
- journal article
- Language
- en
- Open access
- green
- arxiv.org
- Licence
- Locations
- IEEE Robotics and Automation Letters (publishedVersion)
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- Funders
- ONR, MURI (W911NF-15-1-0479)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Reinforcement Learning in Robotics
- Physical Sciences › Engineering › Control and Systems Engineering › Robotic Path Planning Algorithms
- Physical Sciences › Engineering › Control and Systems Engineering › Robot Manipulation and Learning
- Keywords
- interactive navigation, cluttered environments, benchmark, physical interaction, pushing, learning-based navigation, robotic manipulation
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Interactive Gibson Benchmark: A Benchmark for Interactive Navigation in Cluttered Environments. https://app.cochat.ai/papers/10.1109/lra.2020.2965078
- The paper
- Xia, F., Shen, W. B., Li, C., Kasimbeg, P., Tchapmi, M. E., Toshev, A., Martin-Martin, R., & Savarese, S. (2020). Interactive Gibson Benchmark: A Benchmark for Interactive Navigation in Cluttered Environments. IEEE Robotics and Automation Letters. https://doi.org/10.1109/lra.2020.2965078
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.