A dataset for developing and benchmarking active vision
The DOI matches its Crossref record; 40 of the 40 references it cites were found in a registry or an index.
Abstract
We present a new public dataset with a focus on simulating robotic vision tasks in everyday indoor environments using real imagery. The dataset includes 20,000+ RGB-D images and 50,000+ 2D bounding boxes of object instances densely captured in 9 unique scenes. We train a fast object category detector for instance detection on our data. Using the dataset we show that, although increasingly accurate and fast, the state of the art for object detection is still severely impacted by object scale, occlusion, and viewing direction all of which matter for robotics applications. We next validate the dataset for simulating active vision, and use the dataset to develop and evaluate a deep-network-based system for next best move prediction for object classification using reinforcement learning. Our dataset is available for download at cs.unc.edu/~ammirato/active_vision_dataset_website/.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“The latter is the only unsupervised method, while the former three need training data to learn the policy.”
From Unsupervised Active Visual Search With Monte Carlo Planning Under Uncertain Detections (2024) · cites this paper as [9]
In the citing paper
“From results reported in Table 1 we can clearly see that our approach POMP-BE-PD outperforms EAT in terms of SR, with a little increment in APL, which is reasonable since we are now considering more challenging situations, as we will deeply explore in Sect. 4.3.”
From Unsupervised Active Visual Search With Monte Carlo Planning Under Uncertain Detections (2024) · cites this paper as [9]
In the citing paper
“With respect to the standard protocol defined in the benchmark paper [8], this protocol provides results only using GT annotations for object detection, and on a limited number of scenes. Moreover, it uses only a subset of target objects.”
From Unsupervised Active Visual Search With Monte Carlo Planning Under Uncertain Detections (2024) · cites this paper as [9]
In the citing paper
“Our motion policy explicitly exploits the knowledge of the environment for the visibility modelling, instead other RL-based strategies [9], [10] implicitly encode such environment knowledge in a data-driven manner.”
From Unsupervised Active Visual Search With Monte Carlo Planning Under Uncertain Detections (2024) · cites this paper as [9]
Citations
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474
Very Deep Convolutional Networks for Large-Scale Image Recognition
Simonyan, K., & Zisserman, A. (2014) · arXiv · doi:10.48550/arxiv.1409.1556 · Cited by 114,148
You Only Look Once: Unified, Real-Time Object Detection
Redmon, J., Divvala, S., Girshick, R., & Farhadi, A. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.91 · Cited by 53,803
Microsoft COCO: Common Objects in Context
Lin, T.-Y., Maire, M., Belongie, S., Hays, J., Perona, P., Ramanan, D., Dollár, P., & Zitnick, C. L. (2014) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-10602-1_48 · Cited by 45,460
ImageNet Large Scale Visual Recognition Challenge
Russakovsky, O., Deng, J., Su, H., Krause, J., Satheesh, S., Ma, S., Huang, Z., Karpathy, A., Khosla, A., Bernstein, M., et al. (2015) · International Journal of Computer Vision · doi:10.1007/s11263-015-0816-y · Cited by 39,380
Self-citationRich Feature Hierarchies for Accurate Object Detection and Semantic Segmentation
Girshick, R., Donahue, J., Darrell, T., & Malik, J. (2014) · 2014 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2014.81 · Cited by 32,684
(2016) · Cited by 31,590
The pascal visual object classes (VOC) challenge
Everingham, M., Van Gool, L., Williams, C. K. I., Winn, J., & Zisserman, A. (2010) · International Journal of Computer Vision · doi:10.1007/s11263-009-0275-4 · Cited by 19,599 · cited 1×
“The datasets that have been a driving force in pushing the deep learning revolution in object recognition, Pascal VOC [4], the ImageNet Challenge [5], and MS COCO [6] are all collected from web images (usually from Flickr) using web search based on keywords.”
MethodStructure-from-Motion Revisited
Schonberger, J. L., & Frahm, J.-M. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.445 · Cited by 6,433 · cited 2×
“For each scan of each scene, we create a sparse reconstruction of the scene using the RGB structure from motion tool COLMAP from Sch¨onberger et al [30], [31].”
MethodSelective Search for Object Recognition
Uijlings, J. R. R., van de Sande, K. E. A., Gevers, T., & Smeulders, A. W. M. (2013) · International Journal of Computer Vision · doi:10.1007/s11263-013-0620-5 · Cited by 5,980
Research works printed but not linked: 1
- wiedemeyer, 0, IAI Kinect2, Institute for Artificial Intelligence University Bremen 2014–2015
Cited by
Habitat: A Platform for Embodied AI Research
Savva, M., Kadian, A., Maksymets, O., Zhao, Y., Wijmans, E., Jain, B., Straub, J., Liu, J., Koltun, V., Malik, J., et al. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00943 · Cited by 1,237
“Datasets have been a key driver of progress in computer vision, NLP, and other areas of AI [10, 18, 4, 1].”
BackgroundAnderson, P., Wu, Q., Teney, D., Bruce, J., Johnson, M., Sunderhauf, N., Reid, I., Gould, S., & van den Hengel, A. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00387 · Cited by 1,187
Gibson Env: Real-World Perception for Embodied Agents
Xia, F., Zamir, A. R., He, Z., Sax, A., Malik, J., & Savarese, S. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00945 · Cited by 763
Cut, Paste and Learn: Surprisingly Easy Synthesis for Instance Detection
Dwibedi, D., Misra, I., & Hebert, M. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.146 · Cited by 651
Collaborative Multi-Robot Search and Rescue: Planning, Coordination, Perception, and Active Vision
Queralta, J. P., Taipalmaa, J., Can Pullinen, B., Sarker, V. K., Nguyen Gia, T., Tenhunen, H., Gabbouj, M., Raitoharju, J., & Westerlund, T. (2020) · IEEE Access · doi:10.1109/access.2020.3030190 · Cited by 526
Visual Representations for Semantic Target Driven Navigation
Mousavian, A., Toshev, A., Fiser, M., Kosecka, J., Wahid, A., & Davidson, J. (2019) · 2019 International Conference on Robotics and Automation (ICRA) · doi:10.1109/icra.2019.8793493 · Cited by 224
Cognitive Mapping and Planning for Visual Navigation
Gupta, S., Tolani, V., Davidson, J., Levine, S., Sukthankar, R., & Malik, J. (2020) · International Journal of Computer Vision · doi:10.1007/s11263-019-01236-7 · Cited by 225
SoundSpaces: Audio-Visual Navigation in 3D Environments
Chen, C., Jain, U., Schissler, C., Gari, S. V. A., Al-Halah, Z., Ithapu, V. K., Robinson, P., & Grauman, K. (2020) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-58539-6_2 · Cited by 202
“Their realistic meshes can be rendered from agent-selected viewpoints to train and test RL policies for navigation in a reproducible manner [3,13,104,53,7,83,10,103,59].”
BackgroundInteriorNet: Mega-scale Multi-sensor Photo-realistic Indoor Scenes Dataset
Li, W., Sajad Saeedi, G., McCormac, J., Clark, R., Tzoumanikas, D., Ye, Q., Huang, Y., Tang, R., & Leutenegger, S. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1809.00716 · Cited by 74
MapNet: An Allocentric Spatial Memory for Mapping Environments
Henriques, J. F., & Vedaldi, A. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00884 · Cited by 146
Recent Advances in Object Detection in the Age of Deep Convolutional Neural Networks
Agarwal, S., du Terrail, J. O., & Jurie, F. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1809.03193 · Cited by 107
A survey on human-aware robot navigation
Möller, R., Furnari, A., Battiato, S., Härmä, A., & Farinella, G. M. (2021) · Robotics and Autonomous Systems · doi:10.1016/j.robot.2021.103837 · Cited by 143
Unconstrained Scene Generation with Locally Conditioned Radiance Fields
DeVries, T., Bautista, M. Á., Srivastava, N., Taylor, G. W., & Susskind, J. M. (2021) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.01404 · Cited by 152
An Exploration of Embodied Visual Exploration
Ramakrishnan, S. K., Jayaraman, D., & Grauman, K. (2021) · International Journal of Computer Vision · doi:10.1007/s11263-021-01437-z · Cited by 102
Learning to Look Around: Intelligently Exploring Unseen Environments for Unknown Tasks
Jayaraman, D., & Grauman, K. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00135 · Cited by 86
Active Object Detection With Multistep Action Prediction Using Deep Q-Network
Han, X., Liu, H., Sun, F., & Zhang, X. (2019) · IEEE Transactions on Industrial Informatics · doi:10.1109/tii.2019.2890849 · Cited by 86
Vision-Language Navigation with Random Environmental Mixup
Liu, C., Zhu, F., Chang, X., Liang, X., Ge, Z., & Shen, Y.-D. (2021) · 2021 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.00167 · Cited by 80
“The Active Vision dataset [1] consists of dense scans of 16 different houses.”
BackgroundDeepMapping: Unsupervised Map Estimation From Multiple Point Clouds
Ding, L., & Feng, C. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00885 · Cited by 79
“We evaluate DeepMapping on two datasets: a simulated 2D Lidar point cloud dataset and a real 3D dataset called Active Vision Dataset (AVD) [4].”
MethodA brief survey on RGB-D semantic segmentation using deep learning
Wang, C., Wang, C., Li, W., & Wang, H. (2021) · Displays · doi:10.1016/j.displa.2021.102080 · Cited by 87
Taniguchi, T., Murata, S., Suzuki, M., Ognibene, D., Lanillos, P., Ugur, E., Jamone, L., Nakamura, T., Ciria, A., Lara, B., et al. (2023) · Advanced Robotics · doi:10.1080/01691864.2023.2225232 · Cited by 66
Recent advances in vision-based indoor navigation: A systematic literature review
Khan, D., Cheng, Z., Uchiyama, H., Ali, S., Asshad, M., & Kiyokawa, K. (2022) · Computers & Graphics · doi:10.1016/j.cag.2022.03.005 · Cited by 77
Semantic Curiosity for Active Visual Learning
Chaplot, D. S., Jiang, H., Gupta, S., & Gupta, A. (2020) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-58539-6_19 · Cited by 64
Lopes, A., de Souza, R. M., & Pedrini, H. (2022) · Computer Vision and Image Understanding · doi:10.1016/j.cviu.2022.103489 · Cited by 70
From screens to scenes: A survey of embodied AI in healthcare
Liu, Y., Cao, X., Chen, T., Jiang, Y., You, J., Wu, M., Wang, X., Feng, M., Jin, Y., & Chen, J. (2025) · Information Fusion · doi:10.1016/j.inffus.2025.103033 · Cited by 91
Embodied Amodal Recognition: Learning to Move to Perceive Objects
Yang, J., Ren, Z., Xu, M., Chen, X., Crandall, D., Parikh, D., & Batra, D. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00213 · Cited by 48
Li, Q., Taipalmaa, J., Queralta, J. P., Gia, T. N., Gabbouj, M., Tenhunen, H., Raitoharju, J., & Westerlund, T. (2020) · IEEE International Symposium on Safety, Security, and Rescue Robotics (SSRR) · doi:10.1109/ssrr50563.2020.9292596 · Cited by 52
Reinforcement Learning of Active Vision for Manipulating Objects under Occlusions
Cheng, R., Agarwal, A., & Fragkiadaki, K. (2018) · arXiv · doi:10.48550/arxiv.1811.08067 · Cited by 38
“Fewer methods have addressed camera view selection for a moving observer [20, 21, 22], e.”
MethodEmergence of exploratory look-around behaviors through active observation completion
Ramakrishnan, S. K., Jayaraman, D., & Grauman, K. (2019) · Science Robotics · doi:10.1126/scirobotics.aaw6326 · Cited by 36
Liu, S., Tian, G., Zhang, Y., Zhang, M., & Liu, S. (2021) · IEEE Transactions on Industrial Electronics · doi:10.1109/tie.2021.3090707 · Cited by 38
Recognizing Objects in-the-Wild: Where do we Stand?
Loghmani, M. R., Barbara Caputo, B., & Vincze, M. (2018) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra.2018.8460985 · Cited by 38
When Deep Learning Meets Data Alignment: A Review on Deep Registration Networks (DRNs)
Villena-Martínez, V., Oprea, S., Saval-Calvo, M., Azorín-López, J., Fuster-Guilló, A., & Fisher, R. B. (2020) · Applied Sciences · doi:10.3390/app10217524 · Cited by 41
Interactron: Embodied Adaptive Object Detection
Kotar, K., & Mottaghi, R. (2022) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52688.2022.01444 · Cited by 48
A Survey of Object Goal Navigation
Sun, J., Wu, J., Ji, Z., & Lai, Y. (2024) · IEEE Transactions on Automation Science and Engineering · doi:10.1109/tase.2024.3378010 · Cited by 86
Benchmarking Deep Learning Models for Instance Segmentation
Jung, S., Heo, H., Park, S., Jung, S.-U., & Lee, K. (2022) · Applied Sciences · doi:10.3390/app12178856 · Cited by 39
Kanezaki, A., Nitta, J., & Sasaki, Y. (2017) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2017.2783400 · Cited by 37
Naveed, K., Anjum, M. L., Hussain, W., & Lee, D. (2022) · Autonomous Robots · doi:10.1007/s10514-022-10046-9 · Cited by 33
Deep Reinforcement Learning for Active Human Pose Estimation
Gärtner, E., Pirinen, A., & Sminchisescu, C. (2020) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v34i07.6714 · Cited by 36
Interpretation of Emergent Communication in Heterogeneous Collaborative Embodied Agents
Patel, S., Wani, S., Jain, U., Schwing, A. G., Lazebnik, S., Savva, M., & Chang, A. X. (2021) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.01565 · Cited by 41
Embodied Visual Active Learning for Semantic Segmentation
Nilsson, D., Pirinen, A., Gärtner, E., & Sminchisescu, C. (2021) · AAAI Publications (The Association for the Advancement of Artificial Intelligence (AAAI)) · doi:10.1609/aaai.v35i3.16338 · Cited by 31
A Novel Active Object Detection Network Based on Historical Scenes and Movements
Ye, N., Wang, R., & Li, N. (2021) · International Journal of Computer Theory and Engineering · doi:10.7763/ijcte.2021.v13.1293 · Cited by 28
Collaborative Multi-Robot Systems for Search and Rescue: Coordination and Perception
Queralta, J. P., Taipalmaa, J., Pullinen, B. C., Sarker, V. K., Gia, T. N., Tenhunen, H., Gabbouj, M., Raitoharju, J., & Westerlund, T. (2020) · arXiv · doi:10.48550/arxiv.2008.12610 · Cited by 27
“A benchmark dataset [227] provides 9000 real indoor input images along with the information showing what would be seen next if a specific action is carried out when a specific image is seen.”
BackgroundLiu, S., Tian, G., Zhang, Y., & Duan, P. (2021) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2021.3080076 · Cited by 31
Sidekick Policy Learning for Active Visual Exploration
Ramakrishnan, S. K., & Grauman, K. L. (2018) · Lecture notes in computer science · doi:10.1007/978-3-030-01258-8_26 · Cited by 30
Uncertainty Aware Proposal Segmentation for Unknown Object Detection
Li, Y., & Košecká, J. (2022) · IEEE/CVF Winter Conference on Applications of Computer Vision Workshops (WACVW) · doi:10.1109/wacvw54805.2022.00030 · Cited by 27
Learning Heterogeneous Relation Graph and Value Regularization Policy for Visual Navigation
Zhou, K., Guo, C., Guo, W., & Zhang, H. (2023) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2023.3300888 · Cited by 26
Domes to Drones: Self-Supervised Active Triangulation for 3D Human Pose Reconstruction
Pirinen, A., Gärtner, E., & Sminchisescu, C. (2019) · Lund University Publications (Lund University) · Cited by 22
SEAL: Self-supervised embodied active learning using exploration and 3D consistency
Chaplot, D. S., Dalal, M., Gupta, S., Malik, J., & Salakhutdinov, R. (2021) · arXiv · doi:10.48550/arxiv.2112.01001 · Cited by 22
“More recently focus has been on learning a policy in an end-to-end fashion to directly improve metrics of interest [25, 55, 26, 3, 54].”
BackgroundMask-ToF: Learning Microlens Masks for Flying Pixel Correction in Time-of-Flight Imaging
Chugunov, I., Baek, S., Fu, Q., Heidrich, W., & Heide, F. (2021) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr46437.2021.00900 · Cited by 20
Object Pose Estimation using Mid-level Visual Representations
Nejatishahidin, N., Fayyazsanavi, P., & Košecká, J. (2022) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros47612.2022.9981452 · Cited by 20
Active 6D Multi-Object Pose Estimation in Cluttered Scenarios with Deep Reinforcement Learning
Sock, J., Garcia-Hernando, G., & Kim, T. (2020) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros45743.2020.9340842 · Cited by 22
Embodied Visual RecognitionPreprint
Yang, J., Ren, Z., Xu, M., Chen, X., Crandall, D., Parikh, D., & Batra, D. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1904.04404 · Cited by 29
Self-Supervised Reinforcement Learning for Active Object Detection
Fang, F., Liang, W., Wu, Y. J., Xu, Q., & Lim, J. (2022) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2022.3193019 · Cited by 21
Liu, S., Tian, G., Shao, X., & Liu, S. (2022) · IEEE Transactions on Robotics · doi:10.1109/tro.2022.3191745 · Cited by 23
GAPLE: Generalizable Approaching Policy LEarning for Robotic Object Searching in Indoor Environment
Ye, X., Lin, Z., Lee, J., Zhang, J., Zheng, S., & Yang, Y. (2019) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2019.2930426 · Cited by 24
Hu, Y.-T., Wang, J., Yeh, R. A., & Schwing, A. G. (2021) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr46437.2021.00147 · Cited by 39
Learning to View: Decision Transformers for Active Object Detection
Ding, W., Majcherczyk, N., Deshpande, M., Qi, X., Zhao, D. X., Madhivanan, R., & Sen, A. (2023) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra48891.2023.10160946 · Cited by 29
NeoNav: Improving the Generalization of Visual Navigation via Generating Next Expected Observations
Wu, Q., Manocha, D., Wang, J., & Xu, K. (2020) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v34i06.6556 · Cited by 23
A real 3d embodied dataset for robotic active visual learning
Zhao, Q., Zhang, L., Wu, L., Qiao, H., & Liu, Z. (2022) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2022.3157028 · Cited by 17
Long Range Neural Navigation Policies for the Real World
Wahid, A., Toshev, A., Fišer, M., & Lee, T.-W. E. (2019) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros40897.2019.8968004 · Cited by 19
EMPNet: Neural Localisation and Mapping Using Embedded Memory Points
Avraham, G., Zuo, Y., Dharmasiri, T., & Drummond, T. W. (2019) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00821 · Cited by 17
Audio-Visual Embodied Navigation.Preprint
Chen, C., Jain, U., Schissler, C., Garí, S. V. A., Al-Halah, Z., Ithapu, V. K., Robinson, P. W., & Grauman, K. L. (2019) · arXiv (Cornell University) · Cited by 22
What is the role of the next generation of cognitive robotics?
Shimoda, S., Jamone, L., Ognibene, D., Nagai, T., Sciutti, A., Costa‐García, Á., Oseki, Y., & Taniguchi, T. (2021) · Advanced Robotics · doi:10.1080/01691864.2021.2011780 · Cited by 24
Target Driven Instance DetectionPreprint
Ammirato, P., Fu, C.-Y., Shvets, M., Košecká, J., & Berg, A. C. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1803.04610 · Cited by 30
Self-citationCong, Y., & Mo, H. (2025) · International Journal of Intelligent Systems · doi:10.1155/int/5124400 · Cited by 27
Active perception based on deep reinforcement learning for autonomous robotic damage inspection
Tang, W., & Jahanshahi, M. R. (2024) · Machine Vision and Applications · doi:10.1007/s00138-024-01591-7 · Cited by 15
Active Vision in the Era of Convolutional Neural Networks
Gallos, D., & Ferrie, F. P. (2019) · Canadian Conference on Computer and Robot Vision · doi:10.1109/crv.2019.00019 · Cited by 14
VeREFINE: Integrating Object Pose Verification With Physics-Guided Iterative Refinement
Bauer, D., Patten, T., & Vincze, M. (2020) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2020.2996059 · Cited by 30
Motion planning for continuum reconfigurable incisionless surgical parallel robots
Kuntz, A., Mahoney, A. W., Peckman, N. E., Anderson, P. L., Maldonado, F., Webster, R. J., III, & Alterovitz, R. (2017) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros.2017.8206553 · Cited by 15
Evidential Active Recognition: Intelligent and Prudent Open-World Embodied Perception
Fan, L., Liang, M., Li, Y., Hua, G., & Wu, Y. N. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.01547 · Cited by 29
Simultaneous Mapping and Target Driven NavigationPreprint
Georgakis, G., Li, Y., & Košecká, J. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1911.07980 · Cited by 16
Schmid, J. F., Lauri, M., & Frintrop, S. (2019) · 2019 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros40897.2019.8967805 · Cited by 12
“We use real images collected by a robot from the active vision dataset [6].”
BackgroundMethodInfluentialLearning multimodal adaptive relation graph and action boost memory for visual navigation
Luo, J. J., Cai, B., Yu, Y., Ke, A., Zhou, K., & Zhang, J. Q. (2024) · Advanced Engineering Informatics · doi:10.1016/j.aei.2024.102678 · Cited by 13
Active Object Detection Using Double DQN and Prioritized Experience Replay
Han, X., Liu, H., Sun, F., & Yang, D. (2018) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn.2018.8489296 · Cited by 14
Liu, S., Tian, G., Cui, Y., & Shao, X. (2022) · Frontiers of Information Technology & Electronic Engineering · doi:10.1631/fitee.2200109 · Cited by 12
Active Vision Dataset Benchmark
Ammirato, P., Berg, A. C., & Košecká, J. (2018) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw.2018.00277 · Cited by 18
Self-citationPOMP++: Pomcp-based Active Visual Search in unknown indoor environments
Giuliari, F., Castellini, A., Berra, R., Bue, A. D., Farinelli, A., Cristani, M., Setti, F., & Wang, Y. (2021) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros51168.2021.9635866 · Cited by 18
Evaluation of Field of View Width in Stereo-vision-Based Visual Homing
Lyons, D. M., Barriage, B., & Signore, L. (2019) · Robotica · doi:10.1017/s0263574719001061 · Cited by 11
Leveraging Active Perception for Improving Embedding-based Deep Face Recognition
Passalis, N., & Tefas, A. (2020) · IEEE International Workshop on Multimedia Signal Processing (MMSP) · doi:10.1109/mmsp48831.2020.9287085 · Cited by 12
Cut-and-Paste Dataset Generation for Balancing Domain Gaps in Object Instance Detection
Yun, W., Kim, T., Lee, J., Kim, J., & Kim, J. (2021) · IEEE Access · doi:10.1109/access.2021.3051964 · Cited by 16
Towards Efficient Multiview Object Detection with Adaptive Action Prediction
Xu, Q., Fang, F., Gauthier, N., Liang, W., Wu, Y., Li, L., & Lim, J. (2021) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra48506.2021.9561388 · Cited by 12
Chen, T., Pu, T., Wu, H., Xie, Y., Liu, L., & Lin, L. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2008.00923 · Cited by 11
A systematic review on open-set segmentation
Nunes, I. M., Laranjeira, C., Oliveira, H., & dos Santos, J. A. (2023) · Computers & Graphics · doi:10.1016/j.cag.2023.06.026 · Cited by 14
POMP: Pomcp-based Online Motion Planning for active visual search in indoor environments
Wang, Y., Giuliari, F., Berra, R., Castellini, A., Bue, A. D., Farinelli, A., Cristani, M., & Setti, F. (2020) · British Machine Vision Conference (BMVC) · doi:10.5244/c.34.190 · Cited by 15
Frequency-Based Matcher for Long-Tailed Semantic Segmentation
Li, S., Yang, L., Cao, P., Li, L., & Ma, H. (2024) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2024.3407679 · Cited by 13
Yang, N., Lu, F., Tian, G., & Liu, J. (2024) · IEEE Transactions on Industrial Electronics · doi:10.1109/tie.2024.3468636 · Cited by 13
BenchBot: Evaluating Robotics Research in Photorealistic 3D Simulation and on Real RobotsPreprint
Talbot, B., Hall, D., Zhang, H., Bista, S. R., Smith, R., Dayoub, F., & Sünderhauf, N. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2008.00635 · Cited by 16
Leveraging control priors in deep reinforcement learning for robotics
Rana, K. (2023) · Queensland University of Technology · doi:10.5204/thesis.eprints.238632 · Cited by 9
Unsupervised Active Visual Search With Monte Carlo Planning Under Uncertain Detections
Taioli, F., Giuliari, F., Wang, Y., Berra, R., Castellini, A., Bue, A. D., Farinelli, A., Cristani, M., & Setti, F. (2024) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2024.3451994 · Cited by 8
“With respect to the standard protocol defined in the benchmark paper [9], this protocol provides results only using GT annotations for object detection, and on a limited number of scenes.”
BackgroundMethodInfluentialEnhancing Multi-Step Action Prediction for Active Object Detection
Fang, F., Xu, Q., Gauthier, N., Li, L., & Lim, J. (2021) · Proceedings - International Conference on Image Processing · doi:10.1109/icip42928.2021.9506078 · Cited by 10
Hu, Y.-T., Wang, J., Yeh, R. A., & Schwing, A. G. (2021) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw53098.2021.00375 · Cited by 11
Zou, Q., & Suzuki, E. (2024) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2023.3344880 · Cited by 8
A sketch is worth a thousand navigational instructions
Ahmad, H., Usama, S. M., Hussain, W., & Anjum, M. L. (2021) · Autonomous Robots · doi:10.1007/s10514-020-09965-2 · Cited by 7
FarSight: Long-Range Depth Estimation from Outdoor Images
Reza, M. A., Košecká, J., & David, P. (2018) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros.2018.8593971 · Cited by 9
Self-supervisory Signals for Object Discovery and DetectionPreprint
Pot, E., Toshev, A., & Košecká, J. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1806.03370 · Cited by 12
Choi, T., Guevara, D., Cheng, Z., Bandodkar, G., Wang, C., Bailey, B. N., Earles, J. M., & Liu, X. (2024) · IEEE International Conference on Automation Science and Engineering (CASE) · doi:10.1109/case59546.2024.10711368 · Cited by 9
S-AvE: Semantic Active Vision Exploration and Mapping of Indoor Environments for Mobile Robots
Suriani, V., Kaszuba, S., Sabbella, S. R., Riccio, F., & Nardi, D. (2021) · European Conference on Mobile Robots · doi:10.1109/ecmr50962.2021.9568806 · Cited by 6
Hall, D., Talbot, B., Bista, S. R., Zhang, H., Smith, R., Dayoub, F., & Sünderhauf, N. (2022) · The International Journal of Robotics Research · doi:10.1177/02783649211069404 · Cited by 9
The Robotic Vision Scene Understanding ChallengePreprint
Hall, D., Talbot, B., Bista, S. R., Zhang, H., Smith, R., Dayoub, F., & Sünderhauf, N. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2009.05246 · Cited by 21
Zhang, X., Liu, Y., Li, W., & Gong, C. (2022) · Sensors · doi:10.3390/s22207785 · Cited by 10
Towards real-world navigation with deep differentiable planners
Ishida, S., & Henriques, J. F. (2022) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52688.2022.01681 · Cited by 11
Metadata
- Authors
- Ammirato, P., Poirson, P., Park, E., Kosecka, J., & Berg, A. C.
- Affiliations
- University of North Carolina at Chapel Hill (US)
- ORCID
- Park, Eunbyung
- Venue
- 2017 IEEE International Conference on Robotics and Automation (ICRA)
- Publisher
- IEEE
- Published
- 2017-05
- Pages
- 1378-1385
- ISSN
- 1050-4729 (ISSN-L)
- OpenAlex
- W2593769898
- Cited by
- 187
- References
- 40
- Citations by year
- 2026: 3 · 2025: 24 · 2024: 22 · 2023: 12 · 2022: 21 · 2021: 28 · 2020: 27 · 2019: 26 · 2018: 21 · 2017: 3
- FWCI
- 6.16
- Type
- conference paper
- Language
- en
- Open access
- closed
- Locations
- Proceedings - IEEE International Conference on Robotics and Automation/Proceedings (publishedVersion)
- Topics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Neural Network Applications
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Visual Attention and Saliency Detection
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Vision and Imaging
- Keywords
- active vision, robot vision, RGB-D, object detection benchmark, reinforcement learning, occlusion, viewing direction, indoor environment, object classification
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.