STD-Net: Spatio-Temporal Decomposition Network for Video Demoiréing With Sparse Transformers
The DOI matches its Crossref record; 59 of the 59 references it cites were found in a registry or an index.
Abstract
The problem of video demoiréing is a new challenge in video restoration. Unlike image demoiréing, which involves removing static and uniform patterns, video demoiréing requires tackling dynamic and varied moiré patterns while maintaining video details, colors, and temporal consistency. It is particularly challenging to model moiré patterns for videos with camera or object motions, where separating moiré from the original video content across frames is extremely difficult. Nonetheless, we observe that the spatial distribution of moiré patterns is often sparse on each frame, and their long-range temporal correlation is not significant. To fully leverage this phenomenon, a sparsity-constrained spatial self-attention scheme is proposed to concentrate on removing sparse moiré efficiently for each frame without being distracted by dynamic video content. The frame-wise spatial features are then correlated and aggregated via the local temporal cross-frame-attention module to produce temporal-consistent high-quality moiré-free videos. The above decoupled spatial and temporal transformers constitute the Spatio-Temporal Decomposition Network, dubbed STD-Net. For evaluation, we present a large-scale video demoiréing benchmark featuring various real-life scenes, camera motions, and object motions. We demonstrate that our proposed model can effectively and efficiently achieve superior performance on video demoiréing and single image demoiréing tasks.The proposed dataset will be released after the paper is accepted.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“When applied directly to video sequences, they often introduce flickering artifacts due to the absence of temporal consistency mechanisms [16, 17, 18, 19, 26].”
From MoCHA-former: Moiré-Conditioned Hybrid Adaptive Transformer for Video Demoiréing (2026) · cites this paper as [19]
In the citing paper
“Although a transformer-based approach [25] has been explored in the video demoir´ eing domain to exploit global information [19], its sparse attention mechanism still results in heavier computational demand compared to CNN-based models [16, 17, 18].”
From MoCHA-former: Moiré-Conditioned Hybrid Adaptive Transformer for Video Demoiréing (2026) · cites this paper as [19]
Citations
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474
Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A. N., Kaiser, L., & Polosukhin, I. (2017) · arXiv · doi:10.48550/arxiv.1706.03762 · Cited by 120,404
Very Deep Convolutional Networks for Large-Scale Image Recognition
Simonyan, K., & Zisserman, A. (2014) · arXiv · doi:10.48550/arxiv.1409.1556 · Cited by 114,148
U-Net: Convolutional Networks for Biomedical Image Segmentation
Ronneberger, O., Fischer, P., & Brox, T. (2015) · Lecture notes in computer science · doi:10.1007/978-3-319-24574-4_28 · Cited by 99,404
Adam: A Method for Stochastic Optimization
Kingma, D. P., & Ba, J. (2014) · arXiv · doi:10.48550/arxiv.1412.6980 · Cited by 98,946
Exploiting Generative AI to Scale up Intelligent Tutoring Systems
Jakubův, J., Chvalovský, K., Goertzel, Z., Kaliszyk, C., Olšák, M., Piotrowski, B., Schulz, S., Suda, M., & Urban, J. (2023) · DROPS (Schloss Dagstuhl – Leibniz Center for Informatics) · doi:10.4230/lipics.itp.2023.19 · Cited by 76,658
Image quality assessment: from error visibility to structural similarity
Wang, Z., Bovik, A. C., Sheikh, H. R., & Simoncelli, E. P. (2004) · IEEE Transactions on Image Processing · doi:10.1109/tip.2003.819861 · Cited by 57,892
Densely Connected Convolutional Networks
Huang, G., Liu, Z., Van Der Maaten, L., & Weinberger, K. Q. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.243 · Cited by 48,566
An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale
Dosovitskiy, A., Beyer, L., Kolesnikov, A., Weissenborn, D., Zhai, X., Unterthiner, T., Dehghani, M., Minderer, M., Heigold, G., Gelly, S., et al. (2020) · arXiv · doi:10.48550/arxiv.2010.11929 · Cited by 47,472
Swin Transformer: Hierarchical Vision Transformer using Shifted Windows
Liu, Z., Lin, Y., Cao, Y., Hu, H., Wei, Y., Zhang, Z., Lin, S., & Guo, B. (2021) · 2021 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.00986 · Cited by 35,534
Rethinking the Inception Architecture for Computer Vision
Szegedy, C., Vanhoucke, V., Ioffe, S., Shlens, J., & Wojna, Z. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.308 · Cited by 32,138
End-to-End Object Detection with Transformers
Carion, N., Massa, F., Synnaeve, G., Usunier, N., Kirillov, A., & Zagoruyko, S. (2020) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-58452-8_13 · Cited by 18,285 · cited 1×
“5, different from the general [25], [35], [51], we first normalize the query and key embeddings separately when calculating the attention weights.”
BackgroundThe Unreasonable Effectiveness of Deep Features as a Perceptual Metric
Zhang, R., Isola, P., Efros, A. A., Shechtman, E., & Wang, O. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00068 · Cited by 14,623
Perceptual Losses for Real-Time Style Transfer and Super-Resolution
Johnson, J., Alahi, A., & Fei-Fei, L. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46475-6_43 · Cited by 11,283
Scope of validity of PSNR in image/video quality assessment
Huynh-Thu, Q., & Ghanbari, M. (2008) · Electronics Letters · doi:10.1049/el:20080522 · Cited by 2,959 · cited 1×
“We adopt the metrics PSNR [55], SSIM [56], and LPIPS [57] for evaluation.”
MethodPre-Trained Image Processing Transformer
Chen, H., Wang, Y., Guo, T., Xu, C., Deng, Y., Liu, Z., Ma, S., Xu, C., Xu, C., & Gao, W. (2021) · 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr46437.2021.01212 · Cited by 2,308 · cited 1×
“Transformer is a widely used model in both high-level [35], [36], [37], [38], [39], [40] and low-level vision tasks [41], [42], [43], [44], [45], [46].”
MethodGOT-10k: A Large High-Diversity Benchmark for Generic Object Tracking in the Wild
Huang, L., Zhao, X., & Huang, K. (2021) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2019.2957464 · Cited by 1,809 · cited 1×
“The clean videos are sourced from the visual tracking dataset GOT-10k [54], which features diverse Authorized licensed use limited to the terms of the applicable license agreement with IEEE.”
MethodImage Alignment and Stitching: A Tutorial
Szeliski, R. (2007) · Foundations and Trends in Computer Graphics and Vision · doi:10.1561/0600000009 · Cited by 1,593
Image denoising: Can plain neural networks compete with BM3D?
Burger, H. C., Schuler, C. J., & Harmeling, S. (2012) · 2012 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2012.6247952 · Cited by 1,325
Perceptual Losses for Real-Time Style Transfer and Super-ResolutionPreprint
Johnson, J. M., Alahi, A., & Fei-Fei, L. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1603.08155 · Cited by 1,180
L 1-Regularization Path Algorithm for Generalized Linear Models
Park, M. Y., & Hastie, T. (2007) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.1467-9868.2007.00607.x · Cited by 838
Transformers are RNNs: Fast Autoregressive Transformers with Linear Attention
Katharopoulos, A., Vyas, A., Pappas, N., & Fleuret, F. (2020) · arXiv · doi:10.48550/arxiv.2006.16236 · Cited by 827
Image Dehazing Transformer with Transmission-Aware 3D Position Embedding
Guo, C., Yan, Q., Anwar, S., Cong, R., Ren, W., & Li, C. (2022) · 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52688.2022.00572 · Cited by 552
Learning A Sparse Transformer Network for Effective Image Deraining
Chen, X., Li, H., Li, M., & Pan, J. (2023) · 2023 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52729.2023.00571 · Cited by 538
Adversarial Spatio-Temporal Learning for Video Deblurring
Zhang, K., Luo, W., Zhong, Y., Ma, L., Liu, W., & Li, H. (2019) · IEEE Transactions on Image Processing · doi:10.1109/tip.2018.2867733 · Cited by 380
Self-citationL2 Regularization for Learning Kernels
Cortes, C., Mohri, M., & Rostamizadeh, A. (2012) · arXiv (Cornell University) · doi:10.48550/arxiv.1205.2653 · Cited by 362
AO2-DETR: Arbitrary-Oriented Object Detection Transformer
Dai, L., Liu, H., Tang, H., Wu, Z., & Song, P. (2023) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2022.3222906 · Cited by 276
Efficient Attention: Attention with Linear Complexities
Zhuoran, S., Mingyuan, Z., Haiyu, Z., Shuai, Y., & Hongsheng, L. (2021) · 2021 IEEE Winter Conference on Applications of Computer Vision (WACV) · doi:10.1109/wacv48630.2021.00357 · Cited by 262
Enhanced Spatio-Temporal Interaction Learning for Video Deraining: Faster and Better
Zhang, K., Li, D., Luo, W., Ren, W., & Liu, W. (2023) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2022.3148707 · Cited by 220
Self-citationEfficient Spatio-Temporal Recurrent Neural Network for Video Deblurring
Zhong, Z., Gao, Y., Zheng, Y., & Zheng, B. R. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-58539-6_12 · Cited by 196
Color image demosaicking: An overview
Menon, D., & Calvagno, G. (2011) · Signal Processing: Image Communication · doi:10.1016/j.image.2011.04.003 · Cited by 187
Wavelet-Based Dual-Branch Network for Image Demoiréing
Liu, L., Liu, J., Yuan, S., Slabaugh, G., Leonardis, A., Zhou, W., & Tian, Q. C. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-58601-0_6 · Cited by 186
Moiré photo restoration using multiresolution convolutional neural networks
Sun, Y., Yu, Y., & Wang, W. (2018) · IEEE Transactions on Image Processing · doi:10.1109/tip.2018.2834737 · Cited by 162 · cited 9×
“3) Computational Efficiency Comparision: In Table III, we present the running time, parameters, and memory cost of our transformer-based model, as well as state-of-the-art CNN-based models, including DMCNN [3], MBCNN [12], ESDNet-L [14], and RBTC [6].”
BackgroundMethodInfluentialUnderstanding deformable alignment in video super-resolution
Chan, K. C. K., Wang, X., Yu, K., Dong, C., & Loy, C. C. (2021) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v35i2.16181 · Cited by 162
Multiscale Gradients-Based Color Filter Array Interpolation
Pekkucuksen, I., & Altunbasak, Y. (2013) · IEEE Transactions on Image Processing · doi:10.1109/tip.2012.2210726 · Cited by 128
Image Demoireing with Learnable Bandpass Filters
Zheng, B., Yuan, S., Slabaugh, G., & Leonardis, A. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00369 · Cited by 122
Learning Spatial-Frequency Transformer for Visual Object Tracking
Tang, C., Wang, X., Bai, Y., Wu, Z., Zhang, J., & Huang, Y. (2023) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2023.3249468 · Cited by 103
Flow-Guided Sparse Transformer for Video DeblurringPreprint
Lin, J., Cai, Y., Hu, X., Wang, H., Yan, Y., Zou, X., Ding, H., Zhang, Y., Timofte, R., & Gool, L. V. (2022) · arXiv (Cornell University) · doi:10.48550/arxiv.2201.01893 · Cited by 101
Mop moiré patterns using mopnet
He, B., Wang, C., Shi, B., & Duan, L. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00251 · Cited by 97 · cited 1×
“…on Image Demoiréing: We also compare our model without the temporal moiré removal module with several state-of-the-art image demoiréing models (including DMCNN [3], MDDM [58], WDNet [13], MopNet [59], MBCNN [12], MBCNN-v2 [22], FHDe 2 Net [4] and ESDNet-L [14]) on FHDMi and TIP2018 datasets.”
MethodTowards efficient and scale-robust ultra-high-definition image demoiréing
Yu, X., Dai, P., Li, W., Ma, L., Shen, J., Li, J., & Qi, X. (2022) · Lecture Notes in Computer Science · doi:10.1007/978-3-031-19797-0_37 · Cited by 93
VDTR: Video Deblurring With Transformer
Cao, M., Fan, Y., Zhang, Y., Wang, J., & Yang, Y. (2022) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2022.3201045 · Cited by 85
Learning Frequency Domain Priors for Image Demoireing
Zheng, B., Yuan, S., Yan, C., Tian, X., Zhang, J., Sun, Y., Liu, L., Leonardis, A., & Slabaugh, G. (2022) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2021.3115139 · Cited by 83
Polyp-Mixer: An Efficient Context-Aware MLP-Based Paradigm for Polyp Segmentation
Shi, J.-H., Zhang, Q., Tang, Y., & Zhang, Z.-Q. (2022) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2022.3197643 · Cited by 72
Spatio-Temporal Deformable Attention Network for Video Deblurring
Zhang, H., Xie, H., & Yao, H. (2022) · Lecture notes in computer science · doi:10.1007/978-3-031-19787-1_33 · Cited by 67
FHDe2Net: Full High Definition Demoireing Network
He, B., Wang, C., Shi, B., & Duan, L.-Y. (2020) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-58542-6_43 · Cited by 62
Low-Light Image Enhancement via Stage-Transformer-Guided Network
Jiang, N., Lin, J., Zhang, T., Zheng, H., & Zhao, T. (2023) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2023.3239511 · Cited by 58
Gated Spatio-Temporal Attention-Guided Video Deblurring
Suin, M., & Rajagopalan, A. N. (2021) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr46437.2021.00771 · Cited by 57
Multi-scale dynamic feature encoding network for image demoiréing
Cheng, X., Fu, Z., & Yang, J. (2019) · 2019 IEEE/CVF International Conference on Computer Vision Workshop (ICCVW) · doi:10.1109/iccvw.2019.00432 · Cited by 50
Revisiting Temporal Alignment for Video Restoration
Zhou, K., Li, W., Lu, L., Han, X., & Lu, J. (2022) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52688.2022.00596 · Cited by 48
Recaptured screen image demoiréing
Yue, H., Mao, Y., Liang, L., Xu, H., Hou, C., & Yang, J. (2021) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2020.2969984 · Cited by 42 · cited 2×
“With the booming development of deep learning, many methods [3], [4], [12], [13], [14], [15], [16] have used convolutional neural networks (CNNs) [17], [18], [19], [20], [21] for image demoiréing in recent years.”
BackgroundMethodProgressive Moire Removal and Texture Complementation for Image Demoireing
Niu, Y., Lin, Z., Liu, W., & Guo, W. (2023) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2023.3237810 · Cited by 37
Self-citationSub-Nyquist artefacts and sampling moiré effects
Amidror, I. (2015) · Royal Society Open Science · doi:10.1098/rsos.140550 · Cited by 36
Video quality assessment accounting for temporal visual masking of local flicker
Choi, L. K., & Bovik, A. C. (2018) · Signal Processing: Image Communication · doi:10.1016/j.image.2018.06.009 · Cited by 33
Coarse-to-fine Disentangling Demoiréing Framework for Recaptured Screen Images
Wang, C., He, B., Wu, S., Wan, R., Shi, B., & Duan, L.-Y. (2023) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2023.3243310 · Cited by 29
Dimensioning of optical birefringent anti-alias filters for digital cameras
Schoberl, M., Schnurrer, W., Oberdorster, A., Fossel, S., & Kaup, A. (2010) · 2010 IEEE International Conference on Image Processing · doi:10.1109/icip.2010.5651784 · Cited by 26
Recaptured screen image demoiréing in raw domain
Yue, H., Cheng, Y., Mao, Y., Cao, C., & Yang, J. (2023) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2022.3198333 · Cited by 26 · cited 1×
“Furthermore, Yue et al. [23] proceed to construct the well-aligned raw moiré image dataset by aligning each pixel between the recaptured images and the source images.”
BackgroundVideo demoiréing with relation-based temporal consistency
Dai, P., Yu, X., Ma, L., Zhang, B., Li, J., Li, W., Shen, J., & Qi, X. (2022) · 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52688.2022.01710 · Cited by 26 · cited 10×
“Dai et al. [6] attempt to model global moiré patterns through aligning and aggregating the cross-frame features.”
BackgroundMethodInfluentialLearning Spatio-Temporal Sharpness Map for Video Deblurring
Zhu, Q., Zheng, N., Huang, J., Zhou, M., Zhang, J., & Zhao, F. (2023) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2023.3325408 · Cited by 19
SiamTrans: Zero-Shot Multi-Frame Image Restoration with Pre-trained Siamese Transformers
Liu, L., Yuan, S., Liu, J., Guo, X., Yan, Y., & Tian, Q. C. (2022) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v36i2.20067 · Cited by 17
Research works printed but not linked: 3
- Bayer, 1976, Color imaging array
- Nishioka, 2000, Endoscope system provided with low-pass filter for moire removal
- Lei Ba, 2016, Layer normalization, arXiv:1607.06450 · arXiv
Cited by
P-BiC: Ultra-High-Definition Image Moiré Patterns Removal via Patch Bilateral Compensation
Xiao, Z., Lu, Z., & Wang, X. (2024) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3664647.3681144 · Cited by 37
Pyramid Learnable Bandpass Filters for Ultra-High-Definition Image Demoiréing
Liu, Z., Zheng, B., Chen, Q., Zhang, Q., Jia, X., Zhang, J., & Yan, C. C. (2025) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2025.3545898 · Cited by 13
Cheng, Y., Shao, M., Wan, Y., Qiao, Y., Zuo, W., & Meng, D. (2025) · Neural Networks · doi:10.1016/j.neunet.2025.107700 · Cited by 7
Alignment-free Raw Video DemoireingPreprint
Xu, S., Liu, X., Song, B., Chen, X., Chen, Q., & Zhou, J. (2024) · arXiv (Cornell University) · doi:10.48550/arxiv.2408.10679 · Cited by 7
Freqformer: Image-Demoiréing Transformer via Effective Frequency Decomposition
Liu, X., Qiu, B., Chen, Z., Zhu, L., Zhou, Z., Liu, K., Cao, J., & Zhang, Y. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-37083-9_4 · Cited by 5
Metadata
- Authors
- Niu, Y., Xu, R., Lin, Z., & Liu, W.
- Affiliations
- Fuzhou University (CN)
- Research Institute of Alipay Information Technology Company Ltd., Hangzhou, China
- Venue
- IEEE Transactions on Circuits and Systems for Video Technology
- Published
- 2024-09
- Volume
- 34
- Issue
- 9
- Pages
- 8562-8575
- ISSN
- 1051-8215 (ISSN-L)
- 1558-2205
- OpenAlex
- W4394627519
- Cited by
- 12
- References
- 58
- Citations by year
- 2026: 3 · 2025: 9
- FWCI
- 1.68
- Type
- journal article
- Language
- en
- Open access
- closed
- Licence
- Locations
- IEEE Transactions on Circuits and Systems for Video Technology (publishedVersion)
- Funders
- National Natural Science Foundation of China (62072110, 61972097, 62171134, U21A20472)
- Major Science and Technology Project of Fujian Province (2021HZ022007)
- Industry-Academy Cooperation Project (2021H6022)
- Natural Science Foundation of Fujian Province, China (2023J01067, 2020J01494)
- Topics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Image Processing Techniques
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Image Enhancement Techniques
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Image and Signal Denoising Methods
- Keywords
- video restoration, spatio-temporal decomposition, sparse self-attention, temporal coherence, camera movement, object motion
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.