The DOI matches its Crossref record; 25 of the 26 references it cites were found in a registry or an index.
REMODE: Probabilistic, monocular dense reconstruction in real time
Open accessAbstract
In this paper, we solve the problem of estimating dense and accurate depth maps from a single moving camera. A probabilistic depth measurement is carried out in real time on a per-pixel basis and the computed uncertainty is used to reject erroneous estimations and provide live feedback on the reconstruction progress. Our contribution is a novel approach to depth map computation that combines Bayesian estimation and recent development on convex optimization for image processing. We demonstrate that our method outperforms state-of-the-art techniques in terms of accuracy, while exhibiting high efficiency in memory usage and computing power. We call our approach REMODE (REgularized MOnocular Depth Estimation). Our CUDA-based implementation runs at 30Hz on a laptop computer and is released as open-source software.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“These representations have recently gained popularity in monocular SLAM, in conjunction with the use of direct methods [118, 184, 203], which estimate the trajectory of the robot and a 3D model directly from the intensity values of all the image pixels.”
From Past, Present, and Future of Simultaneous Localization and Mapping: Toward the Robust-Perception Age (2016) · cites this paper as [203]
Citations
Cites
Multiple View Geometry in Computer Vision
Hartley, R., & Zisserman, A. (2004) · doi:10.1017/cbo9780511811685 · Cited by 21,070
Nonlinear total variation based noise removal algorithms
Rudin, L. I., Osher, S., & Fatemi, E. (1992) · Physica D: Nonlinear Phenomena · doi:10.1016/0167-2789(92)90242-f · Cited by 15,704
A First-Order Primal-Dual Algorithm for Convex Problems with Applications to Imaging
Chambolle, A., & Pock, T. (2011) · Journal of Mathematical Imaging and Vision · doi:10.1007/s10851-010-0251-1 · Cited by 4,336
Accurate, Dense, and Robust Multiview Stereopsis
Furukawa, Y., & Ponce, J. (2010) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2009.161 · Cited by 3,019
A Comparison and Evaluation of Multi-View Stereo Reconstruction Algorithms
Seitz, S. M., Curless, B., Diebel, J., Scharstein, D., & Szeliski, R. (2006) · 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition - Volume 1 (CVPR'06) · doi:10.1109/cvpr.2006.19 · Cited by 2,457
SVO: Fast semi-direct monocular visual odometry
Forster, C., Pizzoli, M., & Scaramuzza, D. (2014) · 2014 IEEE International Conference on Robotics and Automation (ICRA) · doi:10.1109/icra.2014.6906584 · Cited by 2,205
Self-citationDTAM: Dense tracking and mapping in real-time
Newcombe, R. A., Lovegrove, S. J., & Davison, A. J. (2011) · 2011 International Conference on Computer Vision · doi:10.1109/iccv.2011.6126513 · Cited by 2,078 · cited 4×
“If, on one hand, estimating the depth independently for every pixel leads to efficient, parallel implementations, on the other hand the authors of [10], [11], [12] argued that, similar to other computer vision problems, such as image de-noising [13] and optical flow estimation [14], a smoothing step is required in ord…”
BackgroundMethodInfluentialReal-time simultaneous localisation and mapping with a single camera
Davison (2003) · Proceedings Ninth IEEE International Conference on Computer Vision · doi:10.1109/iccv.2003.1238654 · Cited by 1,733
Fast Global Minimization of the Active Contour/Snake Model
Bresson, X., Esedoḡlu, S., Vandergheynst, P., Thiran, J.-P., & Osher, S. (2007) · Journal of Mathematical Imaging and Vision · doi:10.1007/s10851-007-0002-0 · Cited by 857
Inverse Depth Parametrization for Monocular SLAM
Civera, J., Davison, A. J., & Montiel, J. (2008) · IEEE Transactions on Robotics · doi:10.1109/tro.2008.2003276 · Cited by 779
Research works printed but not linked: 1
- werlberger, 0, Motion estimation with nonlocal total variation regularization, Proc IEEE Conf on Computer Vision and Pattern Recognition 2010
Cited by
Items 101–200 of 330
Integration of UAVs in Urban Search and Rescue Missions
Surmann, H., Worst, R., Buschmann, T., Leinweber, A., Schmitz, A., Senkowski, G., & Goddemeier, N. (2019) · IEEE International Symposium on Safety, Security and Rescue Robotics · doi:10.1109/ssrr.2019.8848940 · Cited by 31
“, LDSO, ORB2 Slam or SVO / REMODE [22], [23], [24].”
3D mapping for multi hybrid robot cooperation
Surmann, H., Berninger, N., & Worst, R. (2017) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros.2017.8202217 · Cited by 32
“REMODE ([12]) is a method for the reconstruction of dense point clouds, which integrates a Bayesian estimate into the optimization process.”
MethodAdvanced Computing: An International Journal
Gaoussou, H., & Dewei, P. (2026) · Advanced Computing An International Journal · doi:10.5121/acij · Cited by 30
“Pizzoli et al. [22] solved the estimation problem to calculate a probabilistic, monocular and accurate dense 3D scene reconstruction observed by a single moving camera in real time.”
Application-oriented design space exploration for SLAM algorithms
Sajad Saeedi, G., Nardi, L., Johns, E., Bodin, B., Kelly, P. H. J., & Davison, A. J. (2017) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra.2017.7989673 · Cited by 31
Embedded real-time multi-baseline stereo
Honegger, D., Sattler, T., & Pollefeys, M. (2017) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra.2017.7989615 · Cited by 30
Zhang, T., Zhang, L., Chen, Y., & Zhou, Y. (2022) · IEEE Transactions on Image Processing · doi:10.1109/tip.2022.3213189 · Cited by 38
“As main competitors, the performance of ReMode [18] and VI-MEAN [21] were also tested.”
InfluentialPrior depth-based multi-view stereo network for online 3D model reconstruction
Song, S., Giang, K. T., Kim, D., & Jo, S. (2022) · Pattern Recognition · doi:10.1016/j.patcog.2022.109198 · Cited by 29
“Our method was compared with two state-of-the-art motion stereo methods: • REMODE [8] : This is a classic motion stereo method that uses handcrafted features for stereo matching.”
BackgroundMethodInfluentialXPose: Reinventing User Interaction with Flying Cameras
Lan, Z., Shridhar, M., Hsu, D., & Zhao, S. (2017) · Robotics: Science and Systems · doi:10.15607/rss.2017.xiii.006 · Cited by 28
“Unlike (semi-) dense SLAM algorithms ( e.g. , [12, 13, 32]), ORB-SLAM tracks a relatively sparse set of features, but it is sufficient for object tracking in our experience, provided, of course, enough feature points are extracted from the objects of interest.”
BackgroundDeep RGB-D Canonical Correlation Analysis For Sparse Depth CompletionPreprint
Zhong, Y., Wu, C.-Y., You, S. O., & Neumann, U. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1906.08967 · Cited by 28
“Sequence# CFCNet CNN-SLAM[1] Laina[47] Remode[48] ICL/office0 41.”
A SLAM-Based Mobile Augmented Reality Tracking Registration Algorithm
Liu, J., Xie, Y., Gu, S., & Chen, X. (2019) · International Journal of Pattern Recognition and Artificial Intelligence · doi:10.1142/s0218001420540051 · Cited by 29
Monocular Vision-Based Obstacle Detection and Avoidance for a Multicopter
Chen, H.-C. (2019) · IEEE Access · doi:10.1109/access.2019.2953954 · Cited by 29
“There are other studies that obtain depth based on geometric methods [12], [13], [14].”
BackgroundA Real-Time and Multi-Sensor-Based Landing Area Recognition System for UAVs
Liu, F., Shan, J., Xiong, B., & Fang, Z. (2022) · Drones · doi:10.3390/drones6050118 · Cited by 27
Efficient edge-aware surface mesh reconstruction for urban scenes
Bódis-Szomorú, A., Riemenschneider, H., & Gool, L. V. (2016) · Computer Vision and Image Understanding · doi:10.1016/j.cviu.2016.06.002 · Cited by 26
Marine locomotion: A tethered UAV-Buoy system with surge velocity control
Kourani, A., & Daher, N. A. (2021) · Robotics and Autonomous Systems · doi:10.1016/j.robot.2021.103858 · Cited by 26
Autonomous Exploration of Small Bodies Toward Greater Autonomy for Deep Space Missions
Nesnas, I., Hockman, B. J., Bandopadhyay, S., Morrell, B. J., Lubey, D. P., Villa, J., Bayard, D. S., Osmundson, A., Jarvis, B., Bersani, M., et al. (2021) · Frontiers in Robotics and AI · doi:10.3389/frobt.2021.650885 · Cited by 29
“(A) Down-sampled accumulation of point clouds from depth reconstruction using REMODE (Pizzoli et al., 2014).”
MethodRobust Depth-Aided RGBD-Inertial Odometry for Indoor Localization
Zhao, X., Li, Q., Wang, C., Dou, H., & Liu, B. (2023) · Measurement · doi:10.1016/j.measurement.2023.112487 · Cited by 25
Spacecraft Pose Estimation using Principal Component Analysis and a Monocular Camera
Shi, J.-F., Ulrich, S., & Ruel, S. (2017) · AIAA Guidance, Navigation, and Control Conference · doi:10.2514/6.2017-1034 · Cited by 25
Illumination Robust Monocular Direct Visual Odometry for Outdoor Environment Mapping
Wu, X., & Pradalier, C. (2019) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra.2019.8793607 · Cited by 25
“However, recent works have shown that the direct method [4] [5] [6] [7] could provide more accurate and robust motion estimation due to their high flexibility of image information usage in comparison of the indirect approaches using certain types of features.”
BackgroundQuadtree-Accelerated Real-Time Monocular Dense Mapping
Wang, K., Ding, W., & Shen, S. (2018) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros.2018.8594101 · Cited by 25
“23 sitting xyz ICL-NUIM kt0 ICL-NUIM kt1 ICL-NUIM kt2 ICL-NUIM kt3 density(%) error(%) density(%) error(%) density(%) error(%) density(%) error(%) density(%) error(%) REMODE [10] 30.”
BackgroundMethodResultInfluentialRGB-Fusion: Monocular 3D reconstruction with learned depth prediction
Duan, Z., Chen, Y., Yu, H., Hu, B., & Chen, C. (2021) · Displays · doi:10.1016/j.displa.2021.102100 · Cited by 25
Robust Monocular Visual Teach and Repeat Aided by Local Ground Planarity and Color‐constant Imagery
Clement, L., Kelly, J. W., & Barfoot, T. D. (2016) · Journal of Field Robotics · doi:10.1002/rob.21655 · Cited by 23
“Recently, dense photometric approaches to monocular SLAM have been developed that operate directly on per-pixel intensity measurements to produce maps with a higher spatial density than is typically achievable using sparse keypoint-based methods (Newcombe et al., 2011; Engel et al., 2014; Pizzoli et al., 2014).”
MethodReal-time local 3D reconstruction for aerial inspection using superpixel expansion
Teixeira, L., & Chli, M. (2017) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra.2017.7989530 · Cited by 23
“Aiming for GPU-enabled real-time denser scene reconstruction than traditional SLAM, Pizzoli et al. [11] proposed a GPU-based mapping using the tracker of Forster et al. [12].”
MethodDense monocular reconstruction using surface normals
Weerasekera, C. S., Latif, Y., Garg, R., & Reid, I. D. (2017) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra.2017.7989293 · Cited by 24
“Some of them include smoothness in disparity/depth priors [4], [11], [17] or Manhatton/piewise-planar priors [6], [18], [7], [19], [8].”
BackgroundOn the Accuracy of Dense Fisheye Stereo
Schneider, J., Stachniss, C., & Förstner, W. (2016) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2016.2516509 · Cited by 23
“[24] propose a dense reconstruction approach for UAVs.”
BackgroundEvent-based, 6-DOF Camera Tracking for High-Speed Applications.Preprint
Gallego, G., Lund, J. E. A., Mueggler, E., Rebecq, H., Delbrück, T., & Scaramuzza, D. (2016) · arXiv (Cornell University) · Cited by 23
Self-citationFlexible three-dimensional modeling of plants using low- resolution cameras and visual odometry
Santos, T. T., & Rodrigues, G. C. (2015) · Machine Vision and Applications · doi:10.1007/s00138-015-0729-3 · Cited by 22
“Recently, novel systems for dense three-dimensional reconstruction in real time were proposed [42,46].”
BackgroundSun, J., Song, J. W., Chen, H., Huang, X., & Liu, Y. (2020) · IEEE Transactions on Industrial Informatics · doi:10.1109/tii.2019.2958183 · Cited by 22
“D reconstruction REMODE [20] was run on a remote desktop with GPU-based assistance.”
MethodJoint Optimization of Depth and Ego-Motion for Intelligent Autonomous Vehicles
Gao, Y., Tian, F., Li, J., Fang, Z., Al–Rubaye, S., Song, W., & Yan, Y. (2022) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2022.3159275 · Cited by 23
“DTAM [6] and REMODE [12] generally create dense scenes by optimizing depth values.”
BackgroundMethodOverview obstacle maps for obstacle‐aware navigation of autonomous drones
Pestana, J., Maurer, M., Muschick, D., Hofer, M., & Fraundorfer, F. (2019) · Journal of Field Robotics · doi:10.1002/rob.21863 · Cited by 21
Drone mapping through multi-agent reinforcement learning
Zanol, R., Chiariotti, F., & Zanella, A. (2019) · IEEE Wireless Communications and Networking Conference · doi:10.1109/wcnc.2019.8885873 · Cited by 22
“It is also possible to build a probabilistic depth map in real time using a Bayesian technique [7] if the camera pose is known, even if there is no GPS availability [8].”
Dense point cloud map construction based on stereo VINS for mobile vehicles
Wen, S., Liu, X., Zhang, H., Sun, F., Sheng, M., & Fan, S. (2021) · ISPRS Journal of Photogrammetry and Remote Sensing · doi:10.1016/j.isprsjprs.2021.06.009 · Cited by 18
POCD: Probabilistic Object-Level Change Detection and Volumetric Mapping in Semi-Static Scenes
Qian, J., Chatrath, V., Yang, J., Servos, J., Schoellig, A. P., & Waslander, S. L. (2022) · Robotics: Science and Systems · doi:10.15607/rss.2022.xviii.013 · Cited by 27
Autonomous Safe Landing Site Detection for a Future Mars Science Helicopter
Brockers, R., Delaune, J. H., Proença, P. F., Schoppmann, P., Domnik, M., Kubiak, G., & Tzanetos, T. (2021) · IEEE Aerospace Conference (AERO) · doi:10.1109/aero50100.2021.9438289 · Cited by 18
“This is also the case for several component approaches which require a high-end GPU for near real-time execution [16], [14].”
BackgroundLanding Site Detection for Autonomous Rotor Wing UAVs Using Visual and Structural Information
Chatzikalymnios, E., & Μουστάκας, Κ. (2022) · Journal of Intelligent & Robotic Systems · doi:10.1007/s10846-021-01544-6 · Cited by 18
“Afterwards, they compute depth estimates with a modified version of the Regularized Modular Depth Estimation (REMODE) algorithm [20].”
Method“On-the-Spot Training” for Terrain Classification in Autonomous Air-Ground Collaborative Teams
Delmerico, J., Giusti, A., Mueggler, E., Gambardella, L. M., & Scaramuzza, D. (2017) · Springer proceedings in advanced robotics · doi:10.1007/978-3-319-50115-4_50 · Cited by 18
“The images from this camera are additionally used for terrain classification, and for elevation mapping using the keyframe-based monocular dense reconstruction pipeline REMODE [12].”
MethodSelf-citationUAV-based SLAM and 3D reconstruction system
Li, T., Hailes, S. M. V., Julier, S., & Liu, M. (2017) · IEEE International Conference on Robotics and Biomimetics (ROBIO) · doi:10.1109/robio.2017.8324795 · Cited by 19
“REMODE (REgularized MOnocular Depth Estimation) [16] is operating based on the camera poses which are given by the front or back ends.”
BackgroundSparse2Dense: From Direct Sparse Odometry to Dense 3-D Reconstruction
Tang, J., Folkesson, J. B., & Jensfelt, P. (2019) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2019.2891433 · Cited by 18
Monocular thermal SLAM with neural radiance fields for 3D scene reconstruction
Wu, Y., Wang, L., Zhang, L., Chen, M., Zhao, W., Zheng, D., & Cai, Y. (2024) · Neurocomputing · doi:10.1016/j.neucom.2024.129041 · Cited by 17
Realtime Edge Based Visual Inertial Odometry for MAV Teleoperation in Indoor Environments
Tarrio, J., & Pedre, S. (2017) · Journal of Intelligent & Robotic Systems · doi:10.1007/s10846-017-0670-y · Cited by 17
“Even though some of these algorithms are able to run in real time in modern cpu+gpu equipment [25, 27] their computational cost is still too high for embedded solutions.”
BackgroundMethodLoRa Backscatter Assisted State Estimator for Micro Aerial Vehicles with Online Initialization
Zhang, S., Wang, W., Zhang, N., & Jiang, T. (2021) · IEEE Transactions on Mobile Computing · doi:10.1109/tmc.2021.3063850 · Cited by 18
“Although vision-based direct methods [50], [51] that work with all the raw pixel information in images have better performance in dealing with textureless scenes, they require high computing power (GPUs) to achieve real-time processing, which is unavailable for payload-limited MAVs.”
Fast Visual Odometry for a Low-Cost Underwater Embedded Stereo System †
Nawaf, M. M., Merad, D., Royer, J., Boï, J.-M., Saccone, M., Ellefi, M. B., & Drap, P. (2018) · Sensors · doi:10.3390/s18072313 · Cited by 19
“Methods that deal with stereo cameras proceed by computing a dense depth estimation that is used to establish a relationship between objects within adjacent views [36], whereas monocular methods [37,38] use a variational approach for estimating pixel-wise depth.”
MethodAn Accurate, Robust Visual Odometry and Detail-Preserving Reconstruction System
Gong, X., Liu, Y., Wu, Q., Huang, J., Zong, H., & Wang, J. (2020) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2020.3017886 · Cited by 16
“We use raw images and the related poses obtained in Section IV-B to reconstruct spatial points via a modified version of REMODE which is REMODE-M [20] [50].”
Monocular-Vision-Based Moving Target Geolocation Using Unmanned Aerial Vehicle
Pan, T., Deng, B., Dong, H., Gui, J., & Zhao, B. (2023) · Drones · doi:10.3390/drones7020087 · Cited by 17
$$\pi $$Match: Monocular vSLAM and Piecewise Planar Reconstruction Using Fast Plane Correspondences
Raposo, C., & Barreto, J. P. (2016) · Lecture notes in computer science · doi:10.1007/978-3-319-46484-8_23 · Cited by 16
“On the other hand, direct methods such as [19, 20] compute dense depth maps using variational approaches which are computationally expensive and require powerful GPUs to achieve real-time performance.”
Spatial maps with working area limit line from images of crane's top-view camera
Wang, Y., Suzuki, H., & Ohtake, Y. (2022) · Automation in Construction · doi:10.1016/j.autcon.2022.104475 · Cited by 15
A Comparison of Monocular Visual SLAM and Visual Odometry Methods Applied to 3D Reconstruction
Herrera-Granda, E. P., Torres, J. C., Rosales, A., & Peluffo-Ordóñez, D. H. (2023) · Applied Sciences · doi:10.3390/app13158837 · Cited by 20
NeuralRecon: Real-Time Coherent 3D Scene Reconstruction From Monocular Video
Chen, X., Sun, J., Xie, Y., Bao, H., & Zhou, X. (2024) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2024.3393141 · Cited by 15
“Before the age of deep learning, many renowned works in monocular 3D reconstruction [4], [14], [15], [16] have achieved good performance with plane-sweeping stereo and depth filters under the assumption of photo-consistency.”
BackgroundMethodDigging into the multi-scale structure for a more refined depth map and 3D reconstruction
Ding, Y., Lin, L., Wang, L., Zhang, M., & Li, D. (2020) · Neural Computing and Applications · doi:10.1007/s00521-020-04702-3 · Cited by 15
“From the left to right is obtained by ground truth, REMODE [51], DPPTAM [52], and our method”
MethodInfluentialEfficient Parametric Multi-Fidelity Surface Mapping
Dhawale, A., & Michael, N. (2020) · Robotics: Science and Systems · doi:10.15607/rss.2020.xvi.073 · Cited by 15
INFORMATION-DRIVEN AUTONOMOUS EXPLORATION FOR A VISION-BASED MAV
Palazzolo, E., & Stachniss, C. (2017) · ISPRS annals of the photogrammetry, remote sensing and spatial information sciences · doi:10.5194/isprs-annals-iv-2-w3-59-2017 · Cited by 16
“The measurement uncertainty of a depth point from two images can be computed through x and x as in the REMODE approach (Pizzoli et al., 2014) for 3D reconstruction from monocular images.”
MethodInfluentialStructure-aware SLAM with planes and lines in man-made environment
Zhang, J., Zeng, G., & Zha, H. (2018) · Pattern Recognition Letters · doi:10.1016/j.patrec.2018.10.037 · Cited by 14
FMD Stereo SLAM: Fusing MVG and Direct Formulation Towards Accurate and Fast Stereo SLAM
Tang, F.-L., Li, H., & Wu, Y. (2019) · IEEE International Conference on Robotics and Automation · doi:10.1109/icra.2019.8793664 · Cited by 13
“SVO uses the depth filter [12] to estimate depth.”
BackgroundOnboard Real-Time Dense Reconstruction in Large Terrain Scene Using Embedded UAV Platform
Lai, Z., Liu, F., Guo, S., Meng, X., Han, S., & Li, W. (2021) · Remote Sensing · doi:10.3390/rs13142778 · Cited by 15
Robust Keyframe-based Dense SLAM with an RGB-D CameraPreprint
Liu, H., Li, C., Chen, G., Zhang, G., Kaess, M., & Bao, H. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1711.05166 · Cited by 19
“WeusetheBayesian depth filter proposed in [37], which has been successfully used in other SLAM systems like SVO [38] and REMODE [39].”
MethodCNN-MonoFusion: Online Monocular Dense Reconstruction Using Learned Depth from Single View
Wang, J., Liu, H., Cong, L., Xiahou, Z., & Wang, L. (2018) · IEEE International Symposium on Mixed and Augmented Reality Adjunct (ISMAR-Adjunct) · doi:10.1109/ismar-adjunct.2018.00034 · Cited by 14
GravityFusion: Real-time dense mapping without pose graph using deformation and orientation
Puri, P., Jia, D., & Kaess, M. (2017) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros.2017.8206559 · Cited by 14
“[14] as well as planar mapping 2017 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) September 24–28, 2017, Vancouver, BC, Canada”
BackgroundActive 3D Modeling via Online Multi-View Stereo
Song, S., Kim, D., & Jo, S. (2020) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra40945.2020.9197089 · Cited by 14
“The proposed online MVS system extends monocular mapping algorithms [11] [12] [13], which focus only on the local dense mapping, to be adaptable to constructing a large-scale model.”
BackgroundMethodInfluentialRTSDM: A Real-Time Semantic Dense Mapping System for UAVs
Li, Z., Zhao, J., Zhou, X. S., Wei, S., Li, P., & Shuang, F. (2022) · Machines · doi:10.3390/machines10040285 · Cited by 16
“Dense map building requires depth information for the image [48], and although monocular and binocular sensors can calculate depth values through triangulation, this consumes a great deal of computational resource and time [49,50].”
Human-Like Sensing for Robotic Remote Inspection and Analytics
Pal, A., Dasgupta, R., Saha, A., & Nandi, B. (2016) · Wireless Personal Communications · doi:10.1007/s11277-016-3239-3 · Cited by 13
“[8] proposed a solution by adapting a probabilistic approach in which depth map is computed by combining Bayesian estimation and convex optimization techniques.”
MethodDing, H., Cristofalo, E., Wang, J., Castañón, D. A., Montijano, E., Saligrama, V., & Schwager, M. (2016) · Proceedings of the ... American Control Conference/Proceedings of the American Control Conference · doi:10.1109/acc.2016.7525107 · Cited by 13
“D reconstructions from a series of images, such as exploiting the simple geometry of corresponding features in multiple images [6], finding solutions that minimize the least squares error between image patches [7], or by representing image depth as a probabilistic map [8].”
BackgroundLiu, C., Zhao, J., Sun, N., Yang, Q., & Wang, L. (2021) · Sensors · doi:10.3390/s21062025 · Cited by 12
“The authors of SVO describe each step of the depth filter [30].”
BackgroundMethodDepth estimation in still images and videos using a motionless monocular camera
Diamantas, S. C., Astaras, S., & Pnevmatikakis, A. (2016) · IEEE International Conference on Imaging Systems and Techniques (IST) · doi:10.1109/ist.2016.7738210 · Cited by 13
“In [3], [4] the authors exploit the motion of cameras to densely reconstruct objects and environments using multi-view geometry principles.”
BackgroundMeasurement-based real-time analysis of robotic software architectures
Gobillot, N., Guet, F., Doose, D., Grand, C., Lesire, C., & Santinelli, L. (2016) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros.2016.7759509 · Cited by 13
“They have only considered making some measures of computation time of the functions [3], [4], [5], [6] or response time over the network for distributed algorithms [7] for few runs, in order to evaluate timing properties of the systems.”
BackgroundReal-time dense map fusion for stereo SLAM
Pire, T., Baravalle, R., D'Alessandro, A., & Civera, J. (2018) · Robotica · doi:10.1017/s0263574718000528 · Cited by 15
Vision-Based Control for Fast 3-D Reconstruction With an Aerial Robot
Cristofalo, E., Montijano, E., & Schwager, M. (2019) · IEEE Transactions on Control Systems Technology · doi:10.1109/tcst.2019.2905227 · Cited by 15
“For example, in the former, there are solutions that minimize the error between reprojected image patches to estimate camera motion [4], or represent image pixel depth as a probabilistic map [5].”
BackgroundDetection and Reconstruction of Wires Using Cameras for Aircraft Safety Systems
Stambler, A., Sherwin, G., & Rowe, P. (2019) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra.2019.8793526 · Cited by 12
“Our inverse depth filter follows the formulation of [11].”
MethodTowards Dynamic Monocular Visual Odometry Based on an Event Camera and IMU Sensor
Mohamed, S. A. S., Haghbayan, M.-H., Rabah, M., Heikkonen, J., Tenhunen, H., & Plosila, J. (2020) · Lecture notes of the Institute for Computer Sciences, Social Informatics and Telecommunications Engineering · doi:10.1007/978-3-030-38822-5_17 · Cited by 12
A nonlinear optimization-based monocular dense mapping system of visual-inertial odometry
Fan, C., Hou, J., & Yu, L. (2021) · Measurement · doi:10.1016/j.measurement.2021.109533 · Cited by 12
Sequential Depth Completion With Confidence Estimation for 3D Model Reconstruction
Giang, K. T., Song, S., Kim, D., & Choi, S. (2020) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2020.3043172 · Cited by 12
“Furthermore, given that the sparse depth measurements are accurate, it is possible to produce a more accurate 3D model than that produced by existing image-based reconstruction approaches, like multi-view stereo [9] or motion stereo [10] methods.”
BackgroundMethodDeployment of Aerial Robots During the Flood Disaster in Erftstadt / Blessem in July 2021
Hartmut Surmann, A., Slomma, D., Grafe, R., & Grobelny, S. (2022) · International Conference on Automation, Robotics and Applications · doi:10.1109/icara55094.2022.9738529 · Cited by 12
“, LDSO, ORB2 Slam or SVO / REMODE [14]–[16].”
BackgroundLIV-LAM: LiDAR and Visual Localization and Mapping
Radmanesh, R., Wang, Z., Chipade, V. S., Tsechpenakis, G., & Panagou, D. (2020) · Proceedings of the ... American Control Conference/Proceedings of the American Control Conference · doi:10.23919/acc45564.2020.9148037 · Cited by 12
“However, in the case of a monocular camera, bootstrapping method and Graphics Processing Unit (GPU) are used to provide estimation for both a full-depth map and motion estimation [14].”
MethodA New Distributional Ranking Loss With Uncertainty: Illustrated in Relative Depth Estimation
Mertan, A., Şahin, Y. H., Duff, D. J., & Ünal, G. (2020) · International Conference on 3D Vision (3DV) · doi:10.1109/3dv50981.2020.00118 · Cited by 11
Real Time Complete Dense Depth Reconstruction for a Monocular Camera
Huang, X., Fan, L., Zhang, J., Wu, Q., & Yuan, C. (2016) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw.2016.89 · Cited by 11
“DTAM [10] and REMODE 978-1-5090-1437-8/16 $31.00 © 2016 IEEE DOI 10.1109/CVPRW.2016.89 674 [11] are typical examples of complete dense methods, however, the quality of recovered depth map in [10, 11] is tradeoff with completeness and very low when the depth map is complete.”
BackgroundMethodResultInfluentialReal-Time Monocular Visual SLAM by Combining Points and Lines
Wei, X., Huang, J., & Ma, X. (2019) · IEEE International Conference on Multimedia and Expo (ICME) · doi:10.1109/icme.2019.00026 · Cited by 11
“Existing monocular SLAM can be classified into two main categories with respect to the information which is used: feature-based methods [1, 2, 3, 4] and direct methods [5, 6, 7].”
BackgroundDense 3D surface reconstruction of large-scale streetscape from vehicle-borne imagery and LiDAR
Lin, X., Yang, B., Wang, F., Li, J., & Wang, X. (2020) · International Journal of Digital Earth · doi:10.1080/17538947.2020.1862318 · Cited by 11
“…al. 2018), accurate and efficient dense reconstruction of large-scale 3D streetscape is the fundamental ability for an autonomous driving vehicle to navigate and perform high-level tasks (Guizilini and Ramos 2016; Pizzoli, Forster, and Scaramuzza 2014; Se and Jasiobedzki 2008; Sung and Kim 2016).”
BackgroundAn evaluation of robust cost functions for RGB direct mapping
Concha, A., & Civera, J. (2015) · European Conference on Mobile Robots · doi:10.1109/ecmr.2015.7324174 · Cited by 11
“[2] [5] [6] [3] [1] [7] [8], [9] Photometric L(1) L(1) Huber L(1) L(1) L(2) NCC Depth Gradient Regularizer Huber Huber Huber L(1) L(1) Mean Huber Manhattan / Planar Regularizer – L(2) – – – – –”
A combined clustering and image mapping based point cloud segmentation for 3D object detection
Hu, F., Tian, Z. H., Li, Y., Huang, S., & Feng, M. (2018) · Chinese Control and Decision Conference (CCDC) · doi:10.1109/ccdc.2018.8407395 · Cited by 10
“For time optimization reasons, the method described in [20] was used.”
MethodiMODE:Real-Time Incremental Monocular Dense Mapping Using Neural Field
Matsuki, H., Sucar, E., Laidow, T., Wada, K., Scona, R., & Davison, A. J. (2023) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra48891.2023.10161538 · Cited by 10
“stereo algorithms with pure geometric formulation (Plane Sweep Stereo [26] and REMODE [25]), a learning-based multi-view dense reconstruction method (NeuralRecon [31]) and a single-view depth completion method (SparseToDense [32]).”
MethodInfluentialSemi-Direct Monocular Visual-Inertial Odometry Using Point and Line Features for IoV
Jiang, N., Huang, D., Chen, J., Wen, J., Zhang, H., & Chen, H. (2021) · ACM Transactions on Internet Technology · doi:10.1145/3432248 · Cited by 12
“Further, we can use SFM technology to obtain more accurate maps, which can enable us to acquire more meaningful information on the structure of the environment [12, 27].”
MethodEND-TO-END DEPTH FROM MOTION WITH STABILIZED MONOCULAR VIDEOS
Pinard, C., Chevalley, L., Antoine Manzanera, B., & Filliat, D. (2017) · ISPRS annals of the photogrammetry, remote sensing and spatial information sciences · doi:10.5194/isprs-annals-iv-2-w3-67-2017 · Cited by 9
Monocular Trail Detection and Tracking Aided by Visual SLAM for Small Unmanned Aerial Vehicles
Silva, A., Mendonça, R., & Santana, P. (2019) · Journal of Intelligent & Robotic Systems · doi:10.1007/s10846-019-01033-x · Cited by 11
“Other similar solutions are available for the acquisition of 3D information based on SLAM techniques, such as ORB-SLAM [22] and REMODE [23].”
MethodAggressive Quadrotor Flight through Narrow Gaps with Onboard Sensing and Computing.Preprint
Falanga, D., Mueggler, E., Faessler, M., & Scaramuzza, D. (2016) · arXiv (Cornell University) · Cited by 10
Self-citationSimpleMapping: Real-Time Visual-Inertial Dense Mapping with Deep Multi-View Stereo
Xin, Y., Zuo, X., Lu, D., & Leutenegger, S. (2023) · Proceedings - International Symposium on Mixed and Augmented Reality, ISMAR · doi:10.1109/ismar59233.2023.00042 · Cited by 10
“Traditional real-time monocular visual(-inertial) SLAM systems [12,29,32,34,39,62] perform (semi-)dense mapping by matching pixel observations of 3D points and refining their depth values a r X i v : 2306 .”
BackgroundDesign and implementation of a mini quadrotor control system in GPS denied environments
Liu, C., & Prior, S. D. (2015) · International Conference on Unmanned Aircraft Systems (ICUAS) · doi:10.1109/icuas.2015.7152324 · Cited by 9
Robust Vision-Based Autonomous Navigation, Mapping and Landing for MAVs at Night
Daftry, S., Das, M., Delaune, J. H., Sorice, C., Hewitt, R. A., Reddy, S., Lytle, D., Gu, E., & Matthies, L. H. (2020) · Springer proceedings in advanced robotics · doi:10.1007/978-3-030-33950-0_21 · Cited by 9
“Here, we use a dense approach based on the REMODE (REgularized MOnocular Depth Estimation) algorithm [22].”
MethodMulti-features visual odometry for indoor mapping of UAV
Wang, H., Wang, Z., Liu, Q., & Gao, Y. (2020) · IEEE International Conference on Unmanned Systems (ICUS) · doi:10.1109/icus50048.2020.9274825 · Cited by 7
Gaussian Mixture Models for Temporal Depth Fusion
Çığla, C., Brockers, R., & Matthies, L. H. (2017) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv.2017.104 · Cited by 8
Monocular Piecewise Depth Estimation in Dynamic Scenes by Exploiting Superpixel Relations
Di, Y., Morimitsu, H., Gao, S., & Ji, X. (2019) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00446 · Cited by 9
“Traditional structure-from-motion (SFM) methods [9, 23] fail to reconstruct moving objects due to the inherent RSA problem [16], as explained in Figure 2.”
BackgroundOutlier Detection Based on Residual Histogram Preference for Geometric Multi-Model Fitting
Zhao, X., Zhang, Y., Xie, S., Qin, Q., Wu, S., & Luo, B. (2020) · Sensors · doi:10.3390/s20113037 · Cited by 8
“Geometric model fitting attracts a lot of attention in the computer vision field, for example, in image registration and stitching [1–3], structure from motion [4–6], visual positioning [7–9], object recognition [10–12] and 3D reconstruction [13,14].”
Background3D reconstruction with auto-selected keyframes based on depth completion correction and pose fusion
Tian, F., Gao, Y., Fang, Z., Gu, J., & Yang, S. (2021) · Journal of Visual Communication and Image Representation · doi:10.1016/j.jvcir.2021.103199 · Cited by 8
Coarse Semantic-Based Motion Removal for Robust Mapping in Dynamic Environments
Wang, S., Lv, X., Li, J., & Ye, D. (2020) · IEEE Access · doi:10.1109/access.2020.2989317 · Cited by 9
“The point cloud model is often combined with a stereo camera or an RGB-D camera [6], [7].”
MethodRT-AIDE: A RTOS-Agnostic and Interoperable Development Environment for Real-Time Systems
Delgado, R., Jo, Y. H., & Choi, B. W. (2022) · IEEE Transactions on Industrial Informatics · doi:10.1109/tii.2022.3182790 · Cited by 7
“Aside from the algorithmic performance of control systems [21], [22], in practice, it is especially important to determine the RTOS with the best real-time performance according to application requirements.”
BackgroundImage-Based Visual Perception and Representation for Collision Avoidance
Çığla, C., Brockers, R., & Matthies, L. H. (2017) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw.2017.57 · Cited by 7
“This also can be achieved in a multi-view framework as in [15], with complex optimizations to merge consecutive depth maps.”
MethodPeng, S., Huang, F., Tao, J., Tie, B., Lu, J. Y., & Zhang, X. (2018) · IEEE International Geoscience and Remote Sensing Symposium (IGARSS) · doi:10.1109/igarss.2018.8517796 · Cited by 7
“We use the test dataset of REMODE [12] obtained by UA and Figure 5 shows the process of depth map estimation.”
MethodProbabilistic Dense Reconstruction from a Moving Camera
Ling, Y., Wang, K., & Shen, S. (2018) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros.2018.8593618 · Cited by 7
“The posterior update for case (b), however, is novel and not covered in [9] or [7].”
BackgroundMethodResultInfluentialEvaluation of the Visual Odometry Methods for Semi-Dense Real-Time
Gaoussou, H., & Dewei, P. (2018) · Advanced Computing An International Journal · doi:10.5121/acij.2018.9201 · Cited by 7
Mono-Stixels: Monocular Depth Reconstruction of Dynamic Street Scenes
Brickwedde, F., Abraham, S., & Mester, R. (2018) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra.2018.8460490 · Cited by 8
“Mentionable approaches are PMO [9], DTAM [10], LSD-SLAM [11], ORB-SLAM [12] or REMODE [13].”
MethodError Improvement in Visual Odometry Using Super-resolution
Jeong, W., Moon, J., & Lee, B.-H. (2019) · International Journal of Control Automation and Systems · doi:10.1007/s12555-019-0256-5 · Cited by 7
“DTAM [9] and REMODE [10] optimized the whole pixels to perform VO densely, thus they were hard to achieve the real-time execution except powerful GPU devices.”
MethodOverview of Visual SLAM for Mobile Robots
Chen, W. R. (2021) · International Journal of Frontiers in Engineering Technology · doi:10.25236/ijfet.2021.030701 · Cited by 7
FDA-SSD: Fast Depth-Assisted Single-Shot MultiBox Detector for 3D Tracking Based on Monocular Vision
Wang, Z., Yang, S., Shi, M., & Qin, K. (2022) · Applied Sciences · doi:10.3390/app12031164 · Cited by 8
Metadata
- Authors
- Pizzoli, M., Forster, C., & Scaramuzza, D.
- Affiliations
- University of Zurich (CH)
- ORCID
- Scaramuzza, Davide
- Venue
- 2014 IEEE International Conference on Robotics and Automation (ICRA)
- Publisher
- IEEE
- Published
- 2014-05
- Pages
- 2609-2616
- ISSN
- 1050-4729 (ISSN-L)
- OpenAlex
- W2093659073
- Cited by
- 330
- References
- 26
- Citations by year
- 2026: 3 · 2025: 11 · 2024: 10 · 2023: 16 · 2022: 26 · 2021: 33 · 2020: 36 · 2019: 48 · 2018: 39 · 2017: 47 · 2016: 33 · 2015: 20 · 2014: 8
- FWCI
- 19.36
- Type
- conference paper
- Language
- en
- Open access
- green
- www.zora.uzh.ch
- Licence
- other-oa
- Locations
- Proceedings - IEEE International Conference on Robotics and Automation/Proceedings (publishedVersion)
- Zurich Open Repository and Archive (University of Zurich) (acceptedVersion, other-oa)
- Infoscience (Ecole Polytechnique Fédérale de Lausanne) (submittedVersion)
- Infoscience (Ecole Polytechnique Fédérale de Lausanne) (submittedVersion, cc-by-nc-nd)
- Zurich Open Repository and Archive (University of Zurich) (submittedVersion, other-oa)
- Zurich Open Repository and Archive (University of Zurich)
- Topics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Vision and Imaging
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Robotics and Sensor-Based Localization
- Physical Sciences › Engineering › Media Technology › Image Processing Techniques and Applications
- Keywords
- monocular depth estimation, dense reconstruction, uncertainty estimation, Bayesian estimation, convex optimization, real-time depth estimation, CUDA
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.