Recaptured Screen Image Demoiréing
The DOI matches its Crossref record; 42 of the 43 references it cites were found in a registry or an index.
Abstract
In many situations, such as transferring data between devices and recording precious moments, we would like to capture the contents on screens using digital cameras for convenience. These recaptured screen images and videos suffer from a special type of degradation called “moiré pattern”, which is caused by the aliasing between the grid of display screen and the array of camera sensor. However, few works are proposed to tackle this problem. Considering the great success of convolutional neural networks (CNNs) in image restoration, we propose a CNN-based moiré removal method for recaptured screen images. There are mainly two contributions in this paper. First, for the generation of training data, we propose an image registration algorithm via global homography transform and local patch matching to compensate the significant viewpoint disparity between the recaptured screen image and the moiré-free image obtained via screenshot. We construct a moiré removal and brightness improvement (MRBI) database with aligned moiré-free and moiré images. Second, we propose a convolutional neural Network with Additive and Multiplicative modules (termed as AMNet) to transfer the low light moiré image to the bright moiré-free image. The proposed network is trained with pixel-wise loss, perceptual loss, and adversarial loss. Extensive experiments on 340 test images demonstrate that the proposed method outperforms state-of-the-art moiré removal methods.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Citations
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474
Very Deep Convolutional Networks for Large-Scale Image Recognition
Simonyan, K., & Zisserman, A. (2014) · arXiv · doi:10.48550/arxiv.1409.1556 · Cited by 114,148
U-Net: Convolutional Networks for Biomedical Image Segmentation
Ronneberger, O., Fischer, P., & Brox, T. (2015) · Lecture notes in computer science · doi:10.1007/978-3-319-24574-4_28 · Cited by 99,404
Adam: A Method for Stochastic Optimization
Kingma, D. P., & Ba, J. (2014) · arXiv · doi:10.48550/arxiv.1412.6980 · Cited by 98,946
ImageNet: A large-scale hierarchical image database
Deng, J., Dong, W., Socher, R., Li, L.-J., Li, K., & Fei-Fei, L. (2009) · 2009 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2009.5206848 · Cited by 65,333
Image quality assessment: from error visibility to structural similarity
Wang, Z., Bovik, A. C., Sheikh, H. R., & Simoncelli, E. P. (2004) · IEEE Transactions on Image Processing · doi:10.1109/tip.2003.819861 · Cited by 57,892
Distinctive Image Features from Scale-Invariant Keypoints
Lowe, D. G. (2004) · International Journal of Computer Vision · doi:10.1023/b:visi.0000029664.99615.94 · Cited by 55,589
Squeeze-and-Excitation Networks
Hu, J., Shen, L., & Sun, G. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00745 · Cited by 35,667
Fischler, M. A., & Bolles, R. C. (1981) · Communications of the ACM · doi:10.1145/358669.358692 · Cited by 25,893
Image-to-Image Translation with Conditional Adversarial Networks
Isola, P., Zhu, J.-Y., Zhou, T., & Efros, A. A. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.632 · Cited by 22,930 · cited 2×
“In this work, we utilize the adversarial loss function used in PatchGAN [37], which is stable in training.”
Method
Research works printed but not linked: 2
- 2019, Full Resolution Comparison Results for 340 Test Images
- borgefors, 2009, Theory of the Moiré Phenomenon
Cited by
FHDe2Net: Full High Definition Demoireing Network
He, B., Wang, C., Shi, B., & Duan, L.-Y. (2020) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-58542-6_43 · Cited by 62
“Generative and adversarial learning framework [8, 15, 34] and synthesized data [6] are also resorted to for removing moir´e patterns.”
MethodDoing More With Moiré Pattern Detection in Digital Photos
Yang, C., Yang, Z., Ke, Y., Chen, T., Grzegorzek, M., & See, J. (2023) · IEEE Transactions on Image Processing · doi:10.1109/tip.2022.3232232 · Cited by 42
“We also employ the demoiréing datasets FHDMi [43] and MRBI [68] in our experiments.”
BackgroundMethodInfluentialSeeing the Unseen: A Frequency Prompt Guided Transformer for Image Restoration
Zhou, S., Pan, J., Shi, J., Chen, D., Qu, L., & Yang, J. (2024) · Lecture notes in computer science · doi:10.1007/978-3-031-72640-8_14 · Cited by 68
Self-citationProgressive Moire Removal and Texture Complementation for Image Demoireing
Niu, Y., Lin, Z., Liu, W., & Guo, W. (2023) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2023.3237810 · Cited by 37
“The other strategy is to design multi-resolution networks [9], [11], [12], [13], [14], [15], [16], [17] which consist of multiple network streams to separately process the images of different resolutions or image scales that are downsampled from the same input image.”
BackgroundCoarse-to-fine Disentangling Demoiréing Framework for Recaptured Screen Images
Wang, C., He, B., Wu, S., Wan, R., Shi, B., & Duan, L.-Y. (2023) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2023.3243310 · Cited by 29
“The reason for the overall low numerical performances in Table IV (“Cross-domain”) mainly lies in that the global color shifts aggravate the difficulty of faithfully re-covering the screen contents, given the severely degraded inputs in MRBI [31] compared to reference images.”
BackgroundMethodInfluential
Metadata
- Authors
- Yue, H., Mao, Y., Liang, L., Xu, H., Hou, C., & Yang, J.
- Affiliations
- Tianjin University (CN)
- Duke University (US)
- Venue
- IEEE Transactions on Circuits and Systems for Video Technology
- Published
- 2021-01
- Volume
- 31
- Issue
- 1
- Pages
- 49-60
- ISSN
- 1051-8215 (ISSN-L)
- 1558-2205
- OpenAlex
- W3003321577
- Cited by
- 42
- References
- 43
- Citations by year
- 2026: 4 · 2025: 12 · 2024: 10 · 2023: 6 · 2022: 6 · 2021: 2
- FWCI
- 1.56
- Type
- journal article
- Language
- en
- Open access
- closed
- Licence
- Locations
- IEEE Transactions on Circuits and Systems for Video Technology (publishedVersion)
- Funders
- National Natural Science Foundation of China (61672378, 61771339, 61520106002)
- Elite Scholar Program of Tianjin University, Tianjin, China
- Topics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Image Processing Techniques
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Image Enhancement Techniques
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Image and Video Quality Assessment
- Keywords
- image registration, patch matching, training data generation, brightness enhancement, low-light image restoration, perceptual loss, adversarial loss, image restoration
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Recaptured Screen Image Demoiréing. https://app.cochat.ai/papers/10.1109/tcsvt.2020.2969984
- The paper
- Yue, H., Mao, Y., Liang, L., Xu, H., Hou, C., & Yang, J. (2021). Recaptured Screen Image Demoiréing. IEEE Transactions on Circuits and Systems for Video Technology. https://doi.org/10.1109/tcsvt.2020.2969984
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.