CoChat

Image Inpainting for Irregular Holes Using Partial Convolutions

Liu, Guilin, Reda, Fitsum A., Shih, Kevin J., Wang, Ting-Chun, Tao, Andrew, Catanzaro, Bryan · 2018 · Lecture Notes in Computer Science

The DOI matches its Crossref record; 42 of the 45 references it cites were found in a registry or an index.

Abstract

Existing deep learning based image inpainting methods use a standard convolutional network over the corrupted image, using convolutional filter responses conditioned on both valid pixels as well as the substitute values in the masked holes (typically the mean value). This often leads to artifacts such as color discrepancy and blurriness. Post-processing is usually used to reduce such artifacts, but are expensive and may fail. We propose the use of partial convolutions, where the convolution is masked and renormalized to be conditioned on only valid pixels. We further include a mechanism to automatically generate an updated mask for the next layer as part of the forward pass. Our model outperforms other methods for irregular masks. We show qualitative and quantitative comparisons with other methods to validate our approach.

Overview

Integrity signals

Registry

Crossref · 10.1007/978-3-030-01252-6_6

Cites

42 of 42 references verified0 citation errors · 0 not checkable

Statistics

Recomputing p-values needs the paper’s full text.

Verification

Claims the paper makes

This paper’s full text isn’t openly available, so its claims and self-check weren’t run. The registry and citation checks still apply.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Citations

Cites

Show all 42 references

Cited by

  • Free-Form Image Inpainting With Gated Convolution

    Yu, J., Lin, Z., Yang, J., Shen, X., Lu, X., & Huang, T. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00457 · Cited by 1,928

    “Next, we compare our model with previous state-of-theart methods [15, 23, 49].”
    BackgroundMethodResultInfluential
  • Palette: Image-to-Image Diffusion Models

    Saharia, C., Chan, W., Chang, H., Lee, C., Ho, J., Salimans, T., Fleet, D., & Norouzi, M. (2022) · Special Interest Group on Computer Graphics and Interactive Techniques Conference Proceedings · doi:10.1145/3528233.3530757 · Cited by 1,717

    “While there are other important prior works on image inpainting, such as [Liu et al. 2018a, 2020; Zheng et al. 2019], we were not able to compare with all of them.”
    BackgroundMethodResultInfluential
  • RePaint: Inpainting using Denoising Diffusion Probabilistic Models

    Lugmayr, A., Danelljan, M., Romero, A., Yu, F., Timofte, R., & Van Gool, L. (2022) · 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52688.2022.01117 · Cited by 1,778

    “As image inpainting requires a high-level semantic context, and to explicitly include it in the generation pipeline, there exist hand-crafted architectural designs such as Dilated Convolutions [16, 44] to increase the receptive field, Partial Convolutions [19] and Gated Convolutions [47] to guide the convolution kerne…”
    Method
  • Resolution-robust Large Mask Inpainting with Fourier Convolutions

    Suvorov, R., Logacheva, E., Mashikhin, A., Remizova, A., Ashukha, A., Silvestrov, A., Kong, N., Goka, H., Park, K., & Lempitsky, V. (2022) · 2022 IEEE/CVF Winter Conference on Applications of Computer Vision (WACV) · doi:10.1109/wacv51458.2022.00323 · Cited by 1,123

    “The subject has been studied in pre-deep learning era [1, 5, 13], and the progress accelerated in recent years through the use of deep and wide neural networks [26, 30, 25] and adversarial learning [34, 18, 56, 44, 57, 32, 54, 61].”
    BackgroundMethodInfluential
  • MaskGAN: Towards Diverse and Interactive Facial Image Manipulation

    Lee, C.-H., Liu, Z., Wu, L., & Luo, P. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00559 · Cited by 1,130

See all 2,419

Metadata

Authors
Liu, G., Reda, F. A., Shih, K. J., Wang, T.-C., Tao, A., & Catanzaro, B.
Affiliations
Nvidia (United States) (US)
Corresponding author
Liu, Guilin
Venue
Lecture Notes in Computer Science
Published
2018
Pages
89-105
ISSN
  • 0302-9743 (ISSN-L)
  • 1611-3349
OpenAlex
W2798365772
Cited by
2,419
References
45
Citations by year
2026: 178 · 2025: 279 · 2024: 322 · 2023: 408 · 2022: 353 · 2021: 379 · 2020: 304 · 2019: 172 · 2018: 24
FWCI
66.24
Type
conference paper
Language
en
Open access
closed
Licence
Locations
Lecture notes in computer science (publishedVersion)
Topics
  • Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Generative Adversarial Networks and Image Synthesis
  • Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Image Processing Techniques
  • Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Neural Network Applications
Keywords
image inpainting, partial convolution

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: Image Inpainting for Irregular Holes Using Partial Convolutions. https://app.cochat.ai/papers/10.1007/978-3-030-01252-6_6
The paper
Liu, G., Reda, F. A., Shih, K. J., Wang, T.-C., Tao, A., & Catanzaro, B. (2018). Image Inpainting for Irregular Holes Using Partial Convolutions. Lecture Notes in Computer Science. https://doi.org/10.1007/978-3-030-01252-6_6

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.