The DOI matches its Crossref record; 34 of the 34 references it cites were found in a registry or an index.
Learning to Calibrate Straight Lines for Fisheye Image Rectification
Open accessAbstract
This paper presents a new deep-learning based method to simultaneously calibrate the intrinsic parameters of fisheye lens and rectify the distorted images. Assuming that the distorted lines generated by fisheye projection should be straight after rectification, we propose a novel deep neural network to impose explicit geometry constraints onto processes of the fisheye lens calibration and the distorted image rectification. In addition, considering the nonlinearity of distortion distribution in fisheye images, the proposed network fully exploits multi-scale perception to equalize the rectification effects on the whole image. To train and evaluate the proposed model, we also create a new large-scale dataset labeled with corresponding distortion parameters and well-annotated distorted lines. Compared with the state-of-the-art methods, our model achieves the best published rectification quality and the most accurate estimation of distortion parameters on a large set of synthetic and real fisheye images.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Citations
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474
Stacked Hourglass Networks for Human Pose Estimation
Newell, A., Yang, K., & Deng, J. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46484-8_29 · Cited by 5,634
Holistically-Nested Edge Detection
Xie, S., & Tu, Z. (2015) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.164 · Cited by 3,401
Deeply-Supervised NetsPreprint
Lee, C., Xie, S., Gallagher, P., Zhang, Z., & Tu, Z. (2014) · arXiv (Cornell University) · doi:10.48550/arxiv.1409.5185 · Cited by 1,693
Semantic Scene Completion from a Single Depth Image
Song, S., Yu, F., Zeng, A., Chang, A. X., Savva, M., & Funkhouser, T. A. (2017) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2017.28 · Cited by 1,244
Fast Edge Detection Using Structured Forests
Dollár, P., & Zitnick, C. L. (2014) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2014.2377715 · Cited by 965
A generic camera model and calibration method for conventional, wide-angle, and fish-eye lenses
Kannala, J., & Brandt, S. S. (2006) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2006.153 · Cited by 954
Richer Convolutional Features for Edge Detection
Liu, Y., Cheng, M., Hu, X., Wang, K., & Bai, X. (2017) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2017.622 · Cited by 891
Creating full view panoramic image mosaics and environment maps
Szeliski, R., & Shum, H. (1997) · ACM SIGGRAPH Conference (SIGGRAPH) · doi:10.1145/258734.258861 · Cited by 882
Richer Convolutional Features for Edge Detection
Liu, Y., Cheng, M., Hu, X., Bian, J.-W., Zhang, L., Bai, X., & Tang, J. (2018) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2018.2878849 · Cited by 786
Straight lines have to be straight
Devernay, F., & Faugeras, O. D. (2001) · Machine Vision and Applications · doi:10.1007/pl00013269 · Cited by 701
DeepEdge: A multi-scale bifurcated deep network for top-down contour detection
Bertasius, G., Shi, J., & Torresani, L. (2015) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2015.7299067 · Cited by 549
Augmented Reality Meets Computer Vision: Efficient Data Generation for Urban Driving Scenes
Alhaija, H. A., Mustikovela, S. K., Mescheder, L., Geiger, A., & Rother, C. (2018) · International Journal of Computer Vision · doi:10.1007/s11263-018-1070-x · Cited by 447
Vision-based intelligent vehicles: State of the art and perspectives
Bertozzi, M., Broggi, A., & Fascioli, A. (2000) · Robotics and Autonomous Systems · doi:10.1016/s0921-8890(99)00125-6 · Cited by 440
A Flexible Technique for Accurate Omnidirectional Camera Calibration and Structure from Motion
Scaramuzza, D., Martinelli, A., & Siegwart, R. (2006) · International Conference on Computer Vision Systems · doi:10.1109/icvs.2006.3 · Cited by 425
A general imaging model and a method for finding its parameters
Grossberg, M. D., & Nayar, S. K. (2002) · IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2001.937611 · Cited by 276
Miyamoto, K. (1964) · Journal of the Optical Society of America · doi:10.1364/josa.54.001060 · Cited by 246
Learning to Parse Wireframes in Images of Man-Made Environments
Huang, K., Wang, Y., Zhou, Z., Ding, T., Gao, S., & Ma, Y. (2018) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2018.00072 · Cited by 227
A Generic Concept for Camera Calibration
Sturm, P. F., & Ramalingam, S. (2004) · Lecture notes in computer science · doi:10.1007/978-3-540-24671-8_1 · Cited by 190
Geometric properties of central catadioptric line images and their application in calibration
Barreto, J. P., & Araújo, H. J. (2005) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2005.163 · Cited by 182
6-DOF VR videos with a single 360-camera
Huang, J., Chen, Z., Ceylan, D., & Jin, H. (2017) · IEEE Conference on Virtual Reality and 3D User Interfaces (VR) · doi:10.1109/vr.2017.7892229 · Cited by 165
Alternative models for fish-eye lenses
Basu, A., & Licardie, S. (1995) · Pattern Recognition Letters · doi:10.1016/0167-8655(94)00115-j · Cited by 162
Automatic Radial Distortion Estimation from a Single Image
Bukhari, F., & Dailey, M. N. (2012) · Journal of Mathematical Imaging and Vision · doi:10.1007/s10851-012-0342-2 · Cited by 159
Creating image-based VR using a self-calibrating fisheye lens
Xiong, Y., & Turkowski, K. (2002) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.1997.609326 · Cited by 142
A new algorithm to correct fish-eye- and strong wide-angle-lens-distortion from single images
Bräuer-Burchardt, C., & Voss, K. (2002) · Proceedings - International Conference on Image Processing · doi:10.1109/icip.2001.958994 · Cited by 139
FishEyeRecNet: A Multi-context Collaborative Deep Network for Fisheye Image Rectification
Yin, X., Wang, X., Yu, J., et al. (2018) · Lecture notes in computer science · doi:10.1007/978-3-030-01249-6_29 · Cited by 129
Pixel-wise Deep Learning for Contour DetectionPreprint
Hwang, J.-J., & Liu, T.-L. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1504.01989 · Cited by 107
Rong, J., Huang, S., Shang, Z., & Ying, X. (2017) · Lecture notes in computer science · doi:10.1007/978-3-319-54187-7_3 · Cited by 102
Automatic Lens Distortion Correction Using One-Parameter Division Models
Alemán-Flores, M., Álvarez, L., Gómez, L., et al. (2014) · Image Processing On Line · doi:10.5201/ipol.2014.106 · Cited by 82
Accurate catadioptric calibration for real-time pose estimation in room-size environments
Aliaga, D. G. (2002) · IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2001.937508 · Cited by 80
Automatic Camera Calibration Applied to Medical Endoscopy
Barreto, J. P., Roquette, J., Sturm, P. F., et al. (2009) · British Machine Vision Conference (BMVC) · doi:10.5244/c.23.52 · Cited by 71
Line-based Multi-Label Energy Optimization for fisheye image rectification and calibration
Zhang, M., Yao, J., Xia, M., et al. (2015) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2015.7299041 · Cited by 57
Rectangle Extraction in Catadioptric Images
Bazin, J., Kweon, I.-S., Demonceaux, C., et al. (2007) · IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2007.4409208 · Cited by 25
A Unifying Omnidirectional Camera Model and its Applications
Toepfer, C., & Ehlgen, T. (2007) · IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2007.4409207 · Cited by 20
Flagged first, then by citations
Research works printed but not linked: 2
- melo, 2013, Unsupervised intrinsic calibration from a single frame using a, ICCV
- peter sturm, 2006, Self-calibration of a general radially symmetric, ECCV
Cited by
Sorted by citations
Zhang, J., & Tao, D. (2021) · IEEE Internet of Things Journal · doi:10.1109/jiot.2020.3039359 · Cited by 774
Metadata
- Authors
- Xue, Z., Xue, N., Xia, G.-S., & Shen, W.
- Affiliations
- Wuhan University (CN)
- Venue
- 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)
- Publisher
- IEEE
- Published
- 2019-06
- Pages
- 1643-1651
- ISSN
- 1063-6919 (ISSN-L)
- OpenAlex
- W2959131783
- Cited by
- 94
- References
- 34
- Citations by year
- 2026: 4 · 2025: 10 · 2024: 17 · 2023: 19 · 2022: 11 · 2021: 21 · 2020: 11 · 2019: 1
- FWCI
- 3.59
- Type
- conference paper
- Language
- en
- Open access
- green
- arxiv.org
- Locations
- IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings (publishedVersion)
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- Funders
- China Scholarship Council
- Topics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Vision and Imaging
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Optical measurement and interference techniques
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Image and Object Detection Techniques
- Keywords
- image rectification, intrinsic parameter estimation, geometric constraints, multi-scale perception, distortion parameter estimation, deep neural network
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
