The DOI matches its Crossref record; 33 of the 33 references it cites were found in a registry or an index.
Unsupervised Deep Image Stitching: Reconstructing Stitched Features to Images
Open accessAbstract
Traditional feature-based image stitching technologies rely heavily on feature detection quality, often failing to stitch images with few features or low resolution. The learning-based image stitching solutions are rarely studied due to the lack of labeled data, making the supervised methods unreliable. To address the above limitations, we propose an unsupervised deep image stitching framework consisting of two stages: unsupervised coarse image alignment and unsupervised image reconstruction. In the first stage, we design an ablation-based loss to constrain an unsupervised homography network, which is more suitable for large-baseline scenes. Moreover, a transformer layer is introduced to warp the input images in the stitching-domain space. In the second stage, motivated by the insight that the misalignments in pixel-level can be eliminated to a certain extent in feature-level, we design an unsupervised image reconstruction network to eliminate the artifacts from features to pixels. Specifically, the reconstruction network can be implemented by a low-resolution deformation branch and a high-resolution refined branch, learning the deformation rules of image stitching and enhancing the resolution simultaneously. To establish an evaluation benchmark and train the learning framework, a comprehensive real-world image dataset for unsupervised deep image stitching is presented and released. Extensive experiments well demonstrate the superiority of our method over other state-of-the-art solutions. Even compared with the supervised solutions, our image stitching quality is still preferred by users.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474
Distinctive Image Features from Scale-Invariant Keypoints
Lowe, D. G. (2004) · International Journal of Computer Vision · doi:10.1023/b:visi.0000029664.99615.94 · Cited by 55,589
Fischler, M. A., & Bolles, R. C. (1981) · Communications of the ACM · doi:10.1145/358669.358692 · Cited by 25,893
Perceptual Losses for Real-Time Style Transfer and Super-Resolution
Johnson, J., Alahi, A., & Fei-Fei, L. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46475-6_43 · Cited by 11,283
PWC-Net: CNNs for Optical Flow Using Pyramid, Warping, and Cost Volume
Sun, D., Yang, X., Liu, M.-Y., & Kautz, J. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00931 · Cited by 2,648
As-Projective-As-Possible Image Stitching with Moving DLT
Zaragoza, J., Chin, T.-J., Brown, M. S., & Suter, D. (2013) · 2013 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2013.303 · Cited by 492
Unsupervised Deep Homography: A Fast and Robust Homography Estimation Model
Nguyen, T., Chen, S. W., Shivakumar, S. S., Taylor, C. J., & Kumar, V. (2018) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2018.2809549 · Cited by 374
Adaptive as-natural-as-possible image stitching
Lin, C.-C., Pankanti, S. U., Ramamurthy, K. N., & Aravkin, A. Y. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298719 · Cited by 350
Self-citationParallax-Tolerant Image Stitching
Zhang, F., & Liu, F. (2014) · 2014 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2014.423 · Cited by 347
Shape-Preserving Half-Projective Warps for Image Stitching
Chang, C.-H., Sato, Y., & Chuang, Y.-Y. (2014) · 2014 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2014.422 · Cited by 346
Constructing image panoramas using dual-homography warping
Gao, J., Kim, S. J., & Brown, M. S. (2011) · CVPR 2011 · doi:10.1109/cvpr.2011.5995433 · Cited by 339
Parallax-Tolerant Image Stitching Based on Robust Elastic Warping
Li, J., Wang, Z., Lai, S., Zhai, Y., & Zhang, M. (2018) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2017.2777461 · Cited by 291
Smoothly varying affine stitching
Lin, W.-Y., Liu, S., Matsushita, Y., Ng, T.-T., & Cheong, L.-F. (2011) · CVPR 2011 · doi:10.1109/cvpr.2011.5995314 · Cited by 281
Self-citationNatural Image Stitching with the Global Similarity Prior
Chen, Y.-S., & Chuang, Y.-Y. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46454-1_12 · Cited by 233
Anderson, R., Gallup, D., Barron, J. T., Kontkanen, J., Snavely, N., Hernández, C., Agarwal, S., & Seitz, S. M. (2016) · ACM Transactions on Graphics · doi:10.1145/2980179.2980257 · Cited by 225
SEAGULL: Seam-Guided Local Alignment for Parallax-Tolerant Image Stitching
Lin, K., Jiang, N., Cheong, L.-F., Do, M., & Lu, J. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46487-9_23 · Cited by 215
Chalfoun, J., Majurski, M., Blattner, T., Bhadriraju, K., Keyrouz, W., Bajcsy, P., & Brady, M. (2017) · Scientific Reports · doi:10.1038/s41598-017-04567-y · Cited by 213
Interactive digital photomontage
Agarwala, A., Dontcheva, M., Agrawala, M., Drucker, S., Colburn, A., Curless, B., Salesin, D., & Cohen, M. (2004) · ACM SIGGRAPH 2004 Papers · doi:10.1145/1186562.1015718 · Cited by 212
Deep Virtual Reality Image Quality Assessment With Human Perception Guider for Omnidirectional Image
Kim, H. G., Lim, H.-T., & Ro, Y. M. (2020) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2019.2898732 · Cited by 203
Content-preserving warps for 3D video stabilization
Liu, F., Gleicher, M. L., Jin, H., & Agarwala, A. (2009) · ACM SIGGRAPH Conference (SIGGRAPH) · doi:10.1145/1576246.1531350 · Cited by 201
Deep Homography Estimation for Dynamic Scenes
Le, H. M., Liu, F., Zhang, S., & Agarwala, A. (2020) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr42600.2020.00767 · Cited by 162
Seamless Image Stitching of Scenes with Large Motions and Exposure Differences
Eden, A., Uyttendaele, M., & Szeliski, R. (2006) · 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition - Volume 2 (CVPR'06) · doi:10.1109/cvpr.2006.268 · Cited by 161
A view-free image stitching network based on global homography
Nie, L., Lin, C., Liao, K., Liu, M., & Zhao, Y. (2020) · Journal of Visual Communication and Image Representation · doi:10.1016/j.jvcir.2020.102950 · Cited by 161
Self-citationTiling in Interactive Panoramic Video: Approaches and Evaluation
Gaddam, V. R., Riegler, M., Eg, R., Griwodz, C., & Halvorsen, P. (2016) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2016.2586304 · Cited by 160
Warping Residual Based Image Stitching for Large Parallax
Lee, K.-Y., & Sim, J.-Y. (2020) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr42600.2020.00822 · Cited by 136
Local-Adaptive Image Alignment Based on Triangular Facet Approximation
Li, J., Deng, B., Tang, R., Wang, Z., & Ye, Y. (2019) · IEEE Transactions on Image Processing · doi:10.1109/tip.2019.2949424 · Cited by 70
Progressive Hard-Mining Network for Monocular Depth Estimation
Zhang, Z., Xu, C., Yang, J. J., Gao, J., & Cui, Z. (2018) · IEEE Transactions on Image Processing · doi:10.1109/tip.2018.2821979 · Cited by 67
Model-Free Distortion Rectification Framework Bridged by Distortion Distribution Map
Liao, K., Lin, C., Zhao, Y., & Xu, M. (2020) · IEEE Transactions on Image Processing · doi:10.1109/tip.2020.2964523 · Cited by 65
Self-citationUnsupervised Learning of Optical Flow With CNN-Based Non-Local Filtering
Tian, L., Tu, Z., Zhang, D., Liu, J., Li, B., & Yuan, J. (2020) · IEEE Transactions on Image Processing · doi:10.1109/tip.2020.3013168 · Cited by 51
Attentive Deep Stitching and Quality Assessment for 360$^{\circ }$ Omnidirectional Images
Li, J., Zhao, Y., Ye, W., Yu, K., & Ge, S. (2019) · IEEE Journal of Selected Topics in Signal Processing · doi:10.1109/jstsp.2019.2953950 · Cited by 50
Self-citationFast and robust seam estimation to seamless image stitching
Hejazifar, H., & Khotanlou, H. (2018) · Signal Image and Video Processing · doi:10.1007/s11760-017-1231-3 · Cited by 40
Deep Feature Extraction for Panoramic Image Stitching
Hoang, V.-D., Tran, D.-P., Nguyen, G. N., et al. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-42058-1_12 · Cited by 39
An Image Mosaic Method Based on Convolutional Neural Network Semantic Features Extraction
Shi, Z., Li, H., Cao, Q., Ren, H., & Fan, B. (2019) · Journal of Signal Processing Systems · doi:10.1007/s11265-019-01477-2 · Cited by 30
Metadata
- Authors
- Nie, L., Lin, C., Liao, K., Liu, S., & Zhao, Y.
- Venue
- IEEE Transactions on Image Processing
- Published
- 2021
- Volume
- 30
- Pages
- 6184-6197
- ISSN
- 1057-7149 (ISSN-L)
- 1941-0042
- OpenAlex
- W3175249881
- Cited by
- 297
- References
- 33
- FWCI
- 14.11
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.