The DOI matches its Crossref record; 36 of the 36 references it cites were found in a registry or an index.
Color-Guided Depth Recovery From RGB-D Data Using an Adaptive Autoregressive Model
Abstract
This paper proposes an adaptive color-guided autoregressive (AR) model for high quality depth recovery from low quality measurements captured by depth cameras. We observe and verify that the AR model tightly fits depth maps of generic scenes. The depth recovery task is formulated into a minimization of AR prediction errors subject to measurement consistency. The AR predictor for each pixel is constructed according to both the local correlation in the initial depth map and the nonlocal similarity in the accompanied high quality color image. We analyze the stability of our method from a linear system point of view, and design a parameter adaptation scheme to achieve stable and accurate depth recovery. Quantitative and qualitative evaluation compared with ten state-of-the-art schemes show the effectiveness and superiority of our method. Being able to handle various types of depth degradations, the proposed method is versatile for mainstream depth sensors, time-of-flight camera, and Kinect, as demonstrated by experiments on real systems.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Golub, G. (2012) · doi:10.56021/9781421407944 · Cited by 34,505
A Taxonomy and Evaluation of Dense Two-Frame Stereo Correspondence Algorithms
Scharstein, D., & Szeliski, R. (2002) · International Journal of Computer Vision · doi:10.1023/a:1014573219977 · Cited by 6,740
He, K., Sun, J., & Tang, X. (2010) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-15549-9_1 · Cited by 1,565
An Image Inpainting Technique Based on the Fast Marching Method
Telea, A. (2004) · Journal of Graphics Tools · doi:10.1080/10867651.2004.10487596 · Cited by 1,421
A large-scale hierarchical multi-view RGB-D object dataset
Lai, K., Bo, L., Ren, X., & Fox, D. (2011) · 2011 IEEE International Conference on Robotics and Automation · doi:10.1109/icra.2011.5980382 · Cited by 1,316
Szeliski, R., Zabih, R., Scharstein, D., Veksler, O., Kolmogorov, V., Agarwala, A., Tappen, M., & Rother, C. (2008) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2007.70844 · Cited by 966
Kopf, J., Cohen, M. F., Lischinski, D., & Uyttendaele, M. (2007) · ACM SIGGRAPH 2007 papers · doi:10.1145/1275808.1276497 · Cited by 872
Spatial-Depth Super Resolution for Range Images
Yang, Q., Yang, R., Davis, J., & Nister, D. (2007) · 2007 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2007.383211 · Cited by 745
Robust moving least-squares fitting with sharp features
Fleishman, S., Cohen-Or, D., & Silva, C. T. (2005) · ACM Transactions on Graphics · doi:10.1145/1073204.1073227 · Cited by 580
An Application of Markov Random Fields to Range Sensing
Diebel, J. R., & Thrun, S. (2005) · neural information processing systems · Cited by 533
Image Guided Depth Upsampling Using Anisotropic Total Generalized Variation
Ferstl, D., Reinbacher, C., Ranftl, R., Ruether, M., & Bischof, H. (2013) · 2013 IEEE International Conference on Computer Vision · doi:10.1109/iccv.2013.127 · Cited by 528
High quality depth map upsampling for 3D-TOF cameras
Park, J., Kim, H., Tai, Y.-W., Brown, M. S., & Kweon, I. (2011) · 2011 International Conference on Computer Vision · doi:10.1109/iccv.2011.6126423 · Cited by 510
Time‐of‐Flight Cameras in Computer Graphics
Kolb, A., Barth, E., Koch, R., & Larsen, R. (2010) · Computer Graphics Forum · doi:10.1111/j.1467-8659.2009.01583.x · Cited by 306
A Noise‐aware Filter for Real‐time Depth Upsampling
Chan, D. Y., Buisman, H., Theobalt, C., et al. (2008) · Cited by 247
Joint Geodesic Upsampling of Depth Images
Liu, M.-Y., Tuzel, O., & Taguchi, Y. (2013) · 2013 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2013.29 · Cited by 244
Depth Video Enhancement Based on Weighted Mode Filtering
Min, D., Lu, J., & Do, M. N. (2012) · IEEE Transactions on Image Processing · doi:10.1109/tip.2011.2163164 · Cited by 240
Patch Based Synthesis for Single Depth Image Super-Resolution
Mac Aodha, O., Campbell, N. D. F., Nair, A., & Brostow, G. J. (2012) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-33712-3_6 · Cited by 211
Maimone, A., & Fuchs, H. (2011) · 2011 10th IEEE International Symposium on Mixed and Augmented Reality · doi:10.1109/ismar.2011.6092379 · Cited by 202
Upsampling range data in dynamic environments
Dolson, J., Baek, J., Plagemann, C., & Thrun, S. (2010) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2010.5540086 · Cited by 168
Efficient spatio-temporal hole filling strategy for Kinect depth maps
Camplani, M., & Salgado, L. (2012) · Proceedings of SPIE, the International Society for Optical Engineering/Proceedings of SPIE · doi:10.1117/12.911909 · Cited by 165
Cross-based local multipoint filtering
Lu, J., Shi, K., Min, D., Lin, L., & Do, M. N. (2012) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2012.6247705 · Cited by 161
Temporal filtering for depth maps generated by Kinect depth camera
Matyunin, S., Vatolin, D. S., Berdnikov, Y., & Smirnov, M. (2011) · 3DTV-Conference: The True Vision - Capture, Transmission and Display of 3D Video · doi:10.1109/3dtv.2011.5877202 · Cited by 154
Reliability Fusion of Time-of-Flight Depth and Stereo Geometry for High Quality Depth Maps
Zhu, J., Wang, L., Yang, R., Davis, J., & Pan, Z. (2010) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2010.172 · Cited by 147
High-quality scanning using time-of-flight depth superresolution
Schuon, S., Theobalt, C., Davis, J., et al. (2008) · 2009 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops · doi:10.1109/cvprw.2008.4563171 · Cited by 133
Fusion of range and color images for denoising and resolution enhancement with a non-local filter
Huhle, B., Schairer, T., Jenke, P., & Straßer, W. (2010) · Computer Vision and Image Understanding · doi:10.1016/j.cviu.2009.11.004 · Cited by 116 · cited 1×
“In applications using depth cameras, these complex systematic errors are usually calibrated and compensated as a preprocessing step before subsequence processing [44], [45].”
MethodSpatial-Temporal Fusion for High Accuracy Depth Maps Using Dynamic MRFs
Zhu, J., Wang, L., Gao, J., & Yang, R. (2009) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2009.68 · Cited by 106
A revisit to MRF-based depth map super-resolution and enhancement
Lu, J., Min, D., Pahwa, R. S., & Do, M. N. (2011) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp.2011.5946571 · Cited by 95
Zomet, A., & Peleg, B. (2003) · Proceedings · doi:10.1109/acv.2002.1182150 · Cited by 82
Depth Recovery Using an Adaptive Color-Guided Auto-Regressive Model
Yang, J., Ye, X., Li, K., & Hou, C. (2012) · Lecture notes in computer science · doi:10.1007/978-3-642-33715-4_12 · Cited by 72
Self-citationMultistep joint bilateral depth upsampling
Riemens, A. K., Gangwal, O. P., Barenbrug, B., & Berretty, R.-P. (2008) · Proceedings of SPIE, the International Society for Optical Engineering/Proceedings of SPIE · doi:10.1117/12.805640 · Cited by 67
Fusion of active and passive sensors for fast 3D capture
Yang, Q., Tan, K.-H., Culbertson, B., & Apostolopoulos, J. (2010) · IEEE International Workshop on Multimedia Signal Processing (MMSP) · doi:10.1109/mmsp.2010.5661996 · Cited by 63
A hybrid camera for motion deblurring and depth map super-resolution
Li, F., Jingyi Yu, A., & Chai, J. (2008) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2008.4587574 · Cited by 60
Integrating 3D Time-of-Flight Camera Data and High Resolution Images for 3DTV Applications
Huhle, B., Fleck, S., & Schilling, A. (2007) · doi:10.1109/3dtv.2007.4379472 · Cited by 49
Adaptive spatio-temporal filter for low-cost camera depth maps
Camplani, M., & Salgado, L. (2012) · doi:10.1109/espa.2012.6152439 · Cited by 26
Increasing depth lateral resolution based on sensor fusion
Hannemann, W., Linarth, A. G., Liu, B., Kókai, G., & Jesorsky, O. (2008) · International Journal of Intelligent Systems Technologies and Applications · doi:10.1504/ijista.2008.021302 · Cited by 11
Joint Multilateral Filtering for Stereo Image Generation Using Depth Camera
Ho, Y., & Lee, S.-B. (2012) · Springer eBooks · doi:10.1007/978-1-4614-3501-3_31 · Cited by 6
Cited by
Depth Estimation via Affinity Learned with Convolutional Spatial Propagation Network
Cheng, X., Wang, P., & Yang, R. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-01270-0_7 · Cited by 357
Learning Depth with Convolutional Spatial Propagation Network
Cheng, X., Wang, P., & Yang, R. (2018) · arXiv · doi:10.48550/arxiv.1810.02695 · Cited by 345
“Recently, deep learning based enhancement yields impressive results on super resolution of both images [61], [62] and depths [63], [64], [65], [66].”
BackgroundDepth Map Super-Resolution by Deep Multi-Scale Guidance
Hui, T.-W., Loy, C. C., & Tang, X. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46487-9_22 · Cited by 343
Learning Depth with Convolutional Spatial Propagation Network
Cheng, X., Wang, P., & Yang, R. (2020) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2019.2947374 · Cited by 341
Metadata
- Authors
- Yang, J., Ye, X., Li, K., Hou, C., & Wang, Y.
- Venue
- IEEE Transactions on Image Processing
- Published
- 2014-08
- Volume
- 23
- Issue
- 8
- Pages
- 3443-3458
- ISSN
- 1057-7149 (ISSN-L)
- 1941-0042
- OpenAlex
- W1994184495
- Cited by
- 310
- References
- 36
- FWCI
- 26.71
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.