Recaptured Screen Image Demoiréing
The DOI matches its Crossref record; 42 of the 43 references it cites were found in a registry or an index.
Abstract
In many situations, such as transferring data between devices and recording precious moments, we would like to capture the contents on screens using digital cameras for convenience. These recaptured screen images and videos suffer from a special type of degradation called “moiré pattern”, which is caused by the aliasing between the grid of display screen and the array of camera sensor. However, few works are proposed to tackle this problem. Considering the great success of convolutional neural networks (CNNs) in image restoration, we propose a CNN-based moiré removal method for recaptured screen images. There are mainly two contributions in this paper. First, for the generation of training data, we propose an image registration algorithm via global homography transform and local patch matching to compensate the significant viewpoint disparity between the recaptured screen image and the moiré-free image obtained via screenshot. We construct a moiré removal and brightness improvement (MRBI) database with aligned moiré-free and moiré images. Second, we propose a convolutional neural Network with Additive and Multiplicative modules (termed as AMNet) to transfer the low light moiré image to the bright moiré-free image. The proposed network is trained with pixel-wise loss, perceptual loss, and adversarial loss. Extensive experiments on 340 test images demonstrate that the proposed method outperforms state-of-the-art moiré removal methods.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Citations
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474
Very Deep Convolutional Networks for Large-Scale Image Recognition
Simonyan, K., & Zisserman, A. (2014) · arXiv · doi:10.48550/arxiv.1409.1556 · Cited by 114,148
U-Net: Convolutional Networks for Biomedical Image Segmentation
Ronneberger, O., Fischer, P., & Brox, T. (2015) · Lecture notes in computer science · doi:10.1007/978-3-319-24574-4_28 · Cited by 99,404
Adam: A Method for Stochastic Optimization
Kingma, D. P., & Ba, J. (2014) · arXiv · doi:10.48550/arxiv.1412.6980 · Cited by 98,946
ImageNet: A large-scale hierarchical image database
Deng, J., Dong, W., Socher, R., Li, L.-J., Li, K., & Fei-Fei, L. (2009) · 2009 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2009.5206848 · Cited by 65,333
Image quality assessment: from error visibility to structural similarity
Wang, Z., Bovik, A. C., Sheikh, H. R., & Simoncelli, E. P. (2004) · IEEE Transactions on Image Processing · doi:10.1109/tip.2003.819861 · Cited by 57,892
Distinctive Image Features from Scale-Invariant Keypoints
Lowe, D. G. (2004) · International Journal of Computer Vision · doi:10.1023/b:visi.0000029664.99615.94 · Cited by 55,589
Squeeze-and-Excitation Networks
Hu, J., Shen, L., & Sun, G. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00745 · Cited by 35,667
Fischler, M. A., & Bolles, R. C. (1981) · Communications of the ACM · doi:10.1145/358669.358692 · Cited by 25,893
Image-to-Image Translation with Conditional Adversarial Networks
Isola, P., Zhu, J.-Y., Zhou, T., & Efros, A. A. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.632 · Cited by 22,930 · cited 2×
“In this work, we utilize the adversarial loss function used in PatchGAN [37], which is stable in training.”
Method
Research works printed but not linked: 2
- 2019, Full Resolution Comparison Results for 340 Test Images
- borgefors, 2009, Theory of the Moiré Phenomenon
Cited by
FHDe2Net: Full High Definition Demoireing Network
He, B., Wang, C., Shi, B., & Duan, L.-Y. (2020) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-58542-6_43 · Cited by 62
“Generative and adversarial learning framework [8, 15, 34] and synthesized data [6] are also resorted to for removing moir´e patterns.”
MethodDoing More With Moiré Pattern Detection in Digital Photos
Yang, C., Yang, Z., Ke, Y., Chen, T., Grzegorzek, M., & See, J. (2023) · IEEE Transactions on Image Processing · doi:10.1109/tip.2022.3232232 · Cited by 42
“We also employ the demoiréing datasets FHDMi [43] and MRBI [68] in our experiments.”
BackgroundMethodInfluentialSeeing the Unseen: A Frequency Prompt Guided Transformer for Image Restoration
Zhou, S., Pan, J., Shi, J., Chen, D., Qu, L., & Yang, J. (2024) · Lecture notes in computer science · doi:10.1007/978-3-031-72640-8_14 · Cited by 68
Self-citationProgressive Moire Removal and Texture Complementation for Image Demoireing
Niu, Y., Lin, Z., Liu, W., & Guo, W. (2023) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2023.3237810 · Cited by 37
“The other strategy is to design multi-resolution networks [9], [11], [12], [13], [14], [15], [16], [17] which consist of multiple network streams to separately process the images of different resolutions or image scales that are downsampled from the same input image.”
BackgroundCoarse-to-fine Disentangling Demoiréing Framework for Recaptured Screen Images
Wang, C., He, B., Wu, S., Wan, R., Shi, B., & Duan, L.-Y. (2023) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2023.3243310 · Cited by 29
“The reason for the overall low numerical performances in Table IV (“Cross-domain”) mainly lies in that the global color shifts aggravate the difficulty of faithfully re-covering the screen contents, given the severely degraded inputs in MRBI [31] compared to reference images.”
BackgroundMethodInfluentialUnsupervised moiré pattern removal for recaptured screen images
Yue, H., Cheng, Y., Liu, F., & Yang, J. (2021) · Neurocomputing · doi:10.1016/j.neucom.2021.05.099 · Cited by 33
Self-citationRecaptured screen image demoiréing in raw domain
Yue, H., Cheng, Y., Mao, Y., Cao, C., & Yang, J. (2023) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2022.3198333 · Cited by 26
Self-citationP-BiC: Ultra-High-Definition Image Moiré Patterns Removal via Patch Bilateral Compensation
Xiao, Z., Lu, Z., & Wang, X. (2024) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3664647.3681144 · Cited by 37
“Yue et al. [47] propose a multiplicative operation-based network that simultaneously removes moiré patterns and improves image brightness.”
Recaptured screen image identification based on vision transformer
Li, G., Yao, H., Le, Y., & Qin, C. (2022) · Journal of Visual Communication and Image Representation · doi:10.1016/j.jvcir.2022.103692 · Cited by 21
Multiscale Coarse-to-Fine Guided Screenshot Demoiréing
Nguyen, D. H., Lee, S.-H., & Lee, C. (2023) · IEEE Signal Processing Letters · doi:10.1109/lsp.2023.3296039 · Cited by 21
“Recently, deep learning-based approaches that employ convolutional neural networks (CNNs) [2], [3], [4], [5], [6], [7], [8], [9], [10], [11], [12], [13], [14] have been actively developed and achieved significant demoiréing performance.”
BackgroundMa, X., Zhao, J., Weng, Y., Fei, L., Zhang, H., Liu, J., & Zhao, D. (2022) · Journal of Cultural Heritage · doi:10.1016/j.culher.2022.11.007 · Cited by 17
Screen-shot and Demoiréd image identification based on DenseNet and DeepViT
Yao, H., Liu, T., Li, G., & Qin, C. (2023) · Expert Systems with Applications · doi:10.1016/j.eswa.2023.122580 · Cited by 15
Std-net: spatio-temporal decomposition network for video demoiréing with sparse transformers
Niu, Y., Xu, R., Lin, Z., & Liu, W. (2024) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2024.3386604 · Cited by 12
“With the booming development of deep learning, many methods [3], [4], [12], [13], [14], [15], [16] have used convolutional neural networks (CNNs) [17], [18], [19], [20], [21] for image demoiréing in recent years.”
BackgroundMethodNear-duplicate detection for LCD screen acquired images using edge histogram descriptor
Mehta, P., & Tripathi, R. K. (2022) · Multimedia Tools and Applications · doi:10.1007/s11042-022-12637-1 · Cited by 11
“In paper [12], a deep learning Convolutional Neural Networks (CNN) model is presented.”
BackgroundRecaptured image forensics based on normalized local ternary count histograms of residual maps
Zhu, N., Guo, Q., Cui, M., & Guo, X. (2021) · Signal Image and Video Processing · doi:10.1007/s11760-021-01974-7 · Cited by 10
“With the technological advances in digital image display and acquisition devices, recapturing high-resolution and highquality digital images has become very convenient and easy [28].”
BackgroundMUNet++: Multilevel wavelet nested UNet++ demoiréing residual network
Gao, G., Lai, H., & Jia, Z. (2024) · Displays · doi:10.1016/j.displa.2024.102741 · Cited by 10
Video Demoiréing With Deep Temporal Color Embedding and Video-Image Invertible Consistency
Liu, L., An, J., Yuan, S., Zhou, W., Li, H., Wang, Y., & Tian, Q. C. (2024) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2024.3366765 · Cited by 12
C3net: demoiréing network attentive in channel, color, and concatenation
Kim, S., Nam, H., Kim, J., & Jeong, J. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw50498.2020.00221 · Cited by 9
“MopNet also utilized Attribute-aware Classifier to categorize the types of moir´e patterns and the information of the types of patterns consequently helped to demoir´e. Yue et al. [42] proposed a convolutional neural Network with Additive and Multiplicative modules (AMNet) which has a U-net structure and uses residual…”
BackgroundMethodInfluentialUnpaired Screen-Shot Image Demoiréing With Cyclic Moiré Learning
Park, H., Vien, A. G., Kim, H., Koh, Y. J., & Lee, C. (2022) · IEEE Access · doi:10.1109/access.2022.3149478 · Cited by 11
“Qualitative of demoiréing results for the testing set in the MRBI dataset [49]: (a) moiré image, (b) ground-truth, and outputs of (c) CycleGAN [23], (d) CWR [24], (e) UID-Net [25], (f) ERRNet [27], (g) U-Net [26], (h) DMCNN [14], (i) MR-GAN [21], (j) Park et al .”
MethodPyramid Learnable Bandpass Filters for Ultra-High-Definition Image Demoiréing
Liu, Z., Zheng, B., Chen, Q., Zhang, Q., Jia, X., Zhang, J., & Yan, C. C. (2025) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2025.3545898 · Cited by 13
“D UE to the mismatch between the color filter array of the camera sensor and the sub-pixels of the screen or the interference between the color filter array (CFA) and high-frequency information, color interference with different colors and shapes often appears in the recaptured screen images [2].”
Eliminating Moiré Patterns Across Diverse Image Resolutions via DMMNet
Ma, Y., Qi, H., & Jin, Z. J. (2025) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2025.3535324 · Cited by 7
“[17]proposed AMNetwithadditiveandmultiplicativemodulestailoredfor removingmoirépatternsandimprovingbrightness.”
Spatial Adaptive Filter Network With Scale-Sharing Convolution for Image Demoiréing
Xu, Y., Wei, Z., Xu, R., Zhou, Z., & Yu, Z. (2024) · IEEE Signal Processing Letters · doi:10.1109/lsp.2024.3451948 · Cited by 5
“Yue et al. [24] integrated the Atrous Spatial Pyramid Pooling module into the skip-connections of the U-Net architecture, facilitating the capture of multi-scale information and subsequent fusion.”
BackgroundA Contrastive Learning Approach for Screenshot Demoiréing
Nguyen, D. H., & Lee, C. (2023) · Proceedings - International Conference on Image Processing · doi:10.1109/icip49359.2023.10222647 · Cited by 5
Domain generalized recaptured screen image identification using SWIN transformer
Mehta, P., Sagar, A., & Kumari, S. (2025) · Signal Image and Video Processing · doi:10.1007/s11760-025-04314-1 · Cited by 3
“Each stage progressively reduces the number of segmented feature maps and increases the feature dimension, producing a hierarchical representation akin to traditional convolutional networks like VGG and ResNet and vision transformer.”
Deep Learning for Screen-Shot Image Demoiréing: A Survey
Hou, S., Wanga, Y.-B., Li, K., Zhao, Y., Lu, B., & Fan, L. (2022) · IEEE Access · doi:10.1109/access.2022.3213025 · Cited by 3
“Therefore, Yue et al. [21] proposed an additive and multiplicative network (AMNet) as the generator to improve the image brightness while removing moiré.”
BackgroundMethodInfluentialVideo Demoireing Using Focused-Defocused Dual-Camera System
Xuan, D., Sun, X., Wang, X., Song, J., Li, Y., & Li, W. (2025) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2025.3596700 · Cited by 4
“Real datasets, such as [9], [20], [17], [18], and [15], are obtained by capturing moire-contaminated screen images/frames using a real camera and using a clean screenshot as the ground truth image/frame.”
Advances of low-level vision reconstruction in raw domain
Yue, H., Yang, W., Li, C., Yang, Y., Liu, W., & Yang, J. (2024) · Journal of Image and Graphics · doi:10.11834/jig.230794 · Cited by 1
Self-citationMulti-Scale Video Demoiréing Based on Selective Time-Domain Fusion
Fang, Y., Pan, X., Wang, Y., Zhou, D., & Ju, Z. (2025) · IEEE Signal Processing Letters · doi:10.1109/lsp.2025.3589887 · Cited by 1
“Furthermore,considering the difficulties and high costs associated with data collection for supervised training, some researchers have shifted their focus towards unsupervised algorithms [12], [13], [14], [15].”
MoCHA-former: Moiré-Conditioned Hybrid Adaptive Transformer for Video Demoiréing
Sung, J., Roh, C., Eom, C., & Oh, J. (2026) · Neurocomputing · doi:10.1016/j.neucom.2025.132477
Adaptive detail extraction network for moiré pattern removal in screen photography
Weimin, L., Tang, G., & Liu, X. (2024) · Applied Optics · doi:10.1364/ao.532529
Moiré Pattern Detection: Stability and Efficiency with Evaluated Loss Function
Li, Z., Shen, X., Luan, S., Guo, S., Boukhers, Z., Sui, W., Wang, Y., & Yang, C. (2024) · Lecture notes in computer science · doi:10.1007/978-3-031-78444-6_3
Character-interested binary-like image learning for text image demoiréing
Zhang, Z., Liang, B., Ren, T., Fan, C., Li, R., & Li, M. (2024) · Frontiers in Physics · doi:10.3389/fphy.2024.1526412
Frequency-Guided Wavelet Transformer for Effective Moiré Pattern Removal
Wang, H., Wang, W., Wang, X., Yuan, X., & Chen, M. (2025) · Communications in computer and information science · doi:10.1007/978-981-96-9949-0_32
A Yolov8-Based Object Detection Framework with Moiré Pattern Removal
Wang, Y., Cao, X. L., Shi, H., Mei, Z., Hu, R., & Zheng, L. (2025) · International Conference on Computer Engineering and Application (ICCEA) · doi:10.1109/iccea65460.2025.11103027
“Recent advances leverage frequency-domain filtering, including Qi et al.’s peak-filtering algorithm [7], and convolutional neural networks (CNNs), including Sun et al.’s DMCNN [8], Zheng et al.’s learnable bandpass filters [9], and Yue et al.’s AMNet [10].”
Forensicability Assessment: Not All Samples Qualify for Recapture Detection
Chen, Y., Zhao, L., Cai, R., Yu, Z., Chen, C., & Li, B. (2025) · IEEE International Conference on Multimedia and Expo (ICME) · doi:10.1109/icme59968.2025.11209848
Video Demoiréing With Spatial–Temporal Filtering in Frequency Domain
Liu, Z., Zheng, B., Chen, Q., Zhang, Q., Heng, J., Li, Q., Yin, J., Jia, X., & Zhang, J. (2025) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2025.3636874
“…image restoration methods [25], [26], [27], [28], [29], [30] have been widely adopted for low-level vision tasks, including image demoir´eing [9], [10], [11], [12], [13], [14], [15], [16], [17], [18], [31], [32], [33], enabling more e ff ective moir´e removal and image quality enhancement.”
Guan, H., Li, W., & Zhang, C. (2025) · Signal Image and Video Processing · doi:10.1007/s11760-025-04951-6
A Lightweight Convolutional Autoencoder for Moiré Pattern Removal with Enhanced Text Preservation
Wang, S. (2025) · International Conference on Intelligent Perception and Pattern Recognition (IPPR) · doi:10.1109/ippr66507.2025.11198233
“Conventional methods for moiré suppression, including frequency-domain filtering and wavelet-based approaches, generally rely on handcrafted features and fixed filtering schemes that tend to blur high-frequency components, thereby impairing text clarity and image fidelity [1] .”
Nguyen, D. H., Lee, S., & Lee, C. (2026) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2026.3681919
“…for screenshot demoir´eing [1], [10], [11], [12], [13], [14], [15], [16], [17], [18], [19], [20], [21], [22], [23], [24], [25], [26], [27], [28], [29], leveraging their Single-objective learning approaches use only ground truths, conventional CL adds negative samples to provide additional…”
Lightweight Recaptured Image Detection Model with Gradual Unfreezing and Structured Pruning
Feki, O., Karous, W., Hamrouni, A., Ghazzai, H., Feki, S., & Setti, G. (2026) · IEEE International Symposium on Circuits and Systems proceedings · doi:10.1109/iscas66217.2026.11562309
“Traditional recaptured image detection methods primarily rely on signal processing and handcrafted visual features to capture artifacts such as moir´e patterns [5], display-induced original and recaptured photographs.”
Dual-Field Recovery and Distortion Correct for Ultra-High-Definition Image Demoiré
Wang, H., Wang, W. M., Wang, X., Yuan, X., & Xu, X. H. (2026) · International Conference on Computer Supported Cooperative Work in Design (CSCWD) · doi:10.1109/cscwd68734.2026.11582354
“[4], [5] constructed paired moir´e pattern datasets in both the RAW and RGB domains.”
SFRNet: Ultra-high-definition moiré pattern detection
Xu, P., Chen, S., Zhang, Q., Xie, N., & Wang, H. (2026) · Expert Systems with Applications · doi:10.1016/j.eswa.2026.133519
Metadata
- Authors
- Yue, H., Mao, Y., Liang, L., Xu, H., Hou, C., & Yang, J.
- Affiliations
- Tianjin University (CN)
- Duke University (US)
- Venue
- IEEE Transactions on Circuits and Systems for Video Technology
- Published
- 2021-01
- Volume
- 31
- Issue
- 1
- Pages
- 49-60
- ISSN
- 1051-8215 (ISSN-L)
- 1558-2205
- OpenAlex
- W3003321577
- Cited by
- 42
- References
- 43
- Citations by year
- 2026: 4 · 2025: 12 · 2024: 10 · 2023: 6 · 2022: 6 · 2021: 2
- FWCI
- 1.56
- Type
- journal article
- Language
- en
- Open access
- closed
- Licence
- Locations
- IEEE Transactions on Circuits and Systems for Video Technology (publishedVersion)
- Funders
- National Natural Science Foundation of China (61672378, 61771339, 61520106002)
- Elite Scholar Program of Tianjin University, Tianjin, China
- Topics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Image Processing Techniques
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Image Enhancement Techniques
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Image and Video Quality Assessment
- Keywords
- image registration, patch matching, training data generation, brightness enhancement, low-light image restoration, perceptual loss, adversarial loss, image restoration
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.