The DOI matches its Crossref record; 62 of the 63 references it cites were found in a registry or an index.
Wavelet-Improved Score-Based Generative Model for Medical Imaging
Abstract
The score-based generative model (SGM) has demonstrated remarkable performance in addressing challenging under-determined inverse problems in medical imaging. However, acquiring high-quality training datasets for these models remains a formidable task, especially in medical image reconstructions. Prevalent noise perturbations or artifacts in low-dose Computed Tomography (CT) or under-sampled Magnetic Resonance Imaging (MRI) hinder the accurate estimation of data distribution gradients, thereby compromising the overall performance of SGMs when trained with these data. To alleviate this issue, we propose a wavelet-improved denoising technique to cooperate with the SGMs, ensuring effective and stable training. Specifically, the proposed method integrates a wavelet sub-network and the standard SGM sub-network into a unified framework, effectively alleviating inaccurate distribution of the data distribution gradient and enhancing the overall stability. The mutual feedback mechanism between the wavelet sub-network and the SGM sub-network empowers the neural network to learn accurate scores even when handling noisy samples. This combination results in a framework that exhibits superior stability during the learning process, leading to the generation of more precise and reliable reconstructed images. During the reconstruction process, we further enhance the robustness and quality of the reconstructed images by incorporating regularization constraint. Our experiments, which encompass various scenarios of low-dose and sparse-view CT, as well as MRI with varying under-sampling rates and masks, demonstrate the effectiveness of the proposed method by significantly enhanced the quality of the reconstructed images. Especially, our method with noisy training samples achieves comparable results to those obtained using clean data. Our code at https://zenodo.org/record/8266123.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Synthetic data generation using generative models can create realistic, diverse data sets that mimic real-world multimodal medical scenarios, thus expanding the training data set without compromising privacy or ethical standards [149-151].”
From Multimodal Large Language Models in Health Care: Applications, Challenges, and Future Outlook. (2024) · cites this paper as [149]
Citations
Cites
Advances in neural information processing systems 7
Cios, K. J., & Shields, M. E. (1997) · Neurocomputing · doi:10.1016/s0925-2312(97)90018-7 · Cited by 22,093
Daubechies, I. C., & Heil, C. (1992) · Computers in Physics · doi:10.1063/1.4823127 · Cited by 16,353
A Fast Iterative Shrinkage-Thresholding Algorithm for Linear Inverse Problems
Beck, A., & Teboulle, M. (2009) · SIAM Journal on Imaging Sciences · doi:10.1137/080716542 · Cited by 11,952
Denoising Diffusion Probabilistic Models
Ho, J., Jain, A., & Abbeel, P. (2020) · arXiv · doi:10.48550/arxiv.2006.11239 · Cited by 8,712
Enhanced Deep Residual Networks for Single Image Super-Resolution
Lim, B. O., Son, S., Kim, H., Nah, S., & Lee, K. M. (2017) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw.2017.151 · Cited by 8,117
The wavelet transform, time-frequency localization and signal analysis
Daubechies, I. (1990) · IEEE Transactions on Information Theory · doi:10.1109/18.57199 · Cited by 6,483
Adaptive wavelet thresholding for image denoising and compression
Chang, S.-F., Yu, B., & Vetterli, M. (2000) · IEEE Transactions on Image Processing · doi:10.1109/83.862633 · Cited by 2,927
Deep Convolutional Neural Network for Inverse Problems in Imaging
Jin, K. H., McCann, M. T., Froustey, E., & Unser, M. (2017) · IEEE Transactions on Image Processing · doi:10.1109/tip.2017.2713099 · Cited by 2,529
Diffusion Models in Vision: A Survey
Croitoru, F.-A., Hondru, V., Ionescu, R. T., & Shah, M. (2023) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2023.3261988 · Cited by 2,189
Lempitsky, V., Vedaldi, A., & Ulyanov, D. (2018) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2018.00984 · Cited by 2,090
Low-Dose CT With a Residual Encoder-Decoder Convolutional Neural Network
Chen, H., Zhang, Y., Kalra, M. K., Lin, F., Chen, Y., Liao, P., Zhou, J., & Wang, G. (2017) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2017.2715284 · Cited by 1,959
Self-citationScore-Based Generative Modeling through Stochastic Differential Equations
Song, Y., Sohl-Dickstein, J., Kingma, D. P., Kumar, A., Ermon, S., & Poole, B. (2020) · arXiv · doi:10.48550/arxiv.2011.13456 · Cited by 1,953
Stochastic Complexity in Statistical Inquiry
Rissanen, J. (1989) · World Scientific Series in Computer Science · doi:10.1142/0822 · Cited by 1,840
Image Super-Resolution Via Iterative Refinement
Saharia, C., Ho, J., Chan, W., Salimans, T., Fleet, D. J., & Norouzi, M. (2022) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2022.3204461 · Cited by 1,829
The Minimum Description Length Principle
Grünwald, P. D. (2007) · doi:10.7551/mitpress/4643.001.0001 · Cited by 1,644
Algorithm Unrolling: Interpretable, Efficient Deep Learning for Signal and Image Processing
Monga, V., Li, Y., & Eldar, Y. C. (2021) · IEEE Signal Processing Magazine · doi:10.1109/msp.2020.3016905 · Cited by 1,589
Generative Modeling by Estimating Gradients of the Data Distribution
Song, Y., & Ermon, S. (2019) · arXiv · doi:10.48550/arxiv.1907.05600 · Cited by 1,453
Learning to compare image patches via convolutional neural networks
Zagoruyko, S., & Komodakis, N. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7299064 · Cited by 1,140
A Connection Between Score Matching and Denoising Autoencoders
Vincent, P. (2011) · Neural Computation · doi:10.1162/neco_a_00142 · Cited by 1,011
(2005) · doi:10.5555/1046920.1088696 · Cited by 756
Langevin-dynamics study of the dynamical properties of small magnetic particles
García-Palacios, J. L., & Lázaro, F. J. (1998) · Physical review. B, Condensed matter · doi:10.1103/physrevb.58.14937 · Cited by 675
Convolutional Recurrent Neural Networks for Dynamic MR Image Reconstruction
Qin, C., Schlemper, J., Caballero, J., Price, A. N., Hajnal, J. V., & Rueckert, D. (2018) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2018.2863670 · Cited by 606
Ho, J., Salimans, T., Gritsenko, A. A., Chan, W., Norouzi, M., & Fleet, D. J. (2022) · neural information processing systems · doi:10.52202/068431-0628 · Cited by 603
Reverse-time diffusion equation models
Anderson, B. D. O. (1982) · Stochastic Processes and their Applications · doi:10.1016/0304-4149(82)90051-5 · Cited by 565
PixelDefend: Leveraging Generative Models to Understand and Defend against Adversarial Examples
Song, Y., Kim, T., Nowozin, S., Ermon, S., & Kushman, N. (2017) · arXiv · doi:10.48550/arxiv.1710.10766 · Cited by 562
Score-based diffusion models for accelerated MRI
Chung, H., & Ye, J. C. (2022) · Medical Image Analysis · doi:10.1016/j.media.2022.102479 · Cited by 488
Improved Techniques for Training Score-Based Generative Models
Song, Y., & Ermon, S. (2020) · arXiv · doi:10.48550/arxiv.2006.09011 · Cited by 482
Knöll, F., Žbontar, J., Sriram, A., Muckley, M. J., Bruno, M. T., Defazio, A., Parente, M., Geras, K. J., Katsnelson, J., Chandarana, H., et al. (2020) · Radiology Artificial Intelligence · doi:10.1148/ryai.2020190007 · Cited by 450
Solving Inverse Problems in Medical Imaging with Score-Based Generative ModelsPreprint
Song, Y. S., Shen, L., Xing, L., & Ermon, S. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2111.08005 · Cited by 442
First-order methods of smooth convex optimization with inexact oracle
Devolder, O., Glineur, F., & Nesterov, Y. E. (2013) · Mathematical Programming · doi:10.1007/s10107-013-0677-5 · Cited by 441
Numerical Treatment of Stochastic Differential Equations
Rüemelin, W. (1982) · SIAM Journal on Numerical Analysis · doi:10.1137/0719041 · Cited by 401
Multi-Level Wavelet Convolutional Neural Networks
Liu, P., Zhang, H., Lian, W., & Zuo, W. (2019) · IEEE Access · doi:10.1109/access.2019.2921451 · Cited by 347
On learning optimized reaction diffusion processes for effective image restoration
Chen, Y., Yu, W. B., & Pock, T. (2015) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2015.7299163 · Cited by 333
Chung, H., Sim, B., & Ye, J. C. (2022) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52688.2022.01209 · Cited by 329
Ho, J., Salimans, T., Gritsenko, A., Chan, W., Norouzi, M., & Fleet, D. J. (2022) · arXiv · doi:10.48550/arxiv.2204.03458 · Cited by 301
Sparse-view x-ray CT reconstruction via total generalized variation regularization
Niu, S., Gao, Y., Bian, Z., Huang, J., Chen, W., Yu, G., Liang, Z., & Ma, J. (2014) · Physics in Medicine and Biology · doi:10.1088/0031-9155/59/12/2997 · Cited by 293
Correlation functions and computer simulations
Parisi, G. (1981) · Nuclear Physics B · doi:10.1016/0550-3213(81)90056-0 · Cited by 243
DRONE: Dual-Domain Residual-based Optimization NEtwork for Sparse-View CT Reconstruction
Wu, W., Hu, D., Niu, C., Yu, H., Vardhanabhuti, V., & Wang, G. (2021) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2021.3078067 · Cited by 243
Self-citationImproving Diffusion Models for Inverse Problems Using Manifold Constraints
Chung, H., Sim, B., Ryu, D., & Ye, J. C. (2022) · neural information processing systems · doi:10.52202/068431-1862 · Cited by 223
Robust Compressed Sensing MRI with Deep Generative PriorsPreprint
Jalal, A., Arvinte, M., Daras, G., Price, E., Dimakis, A. G., & Tamir, J. I. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2108.01368 · Cited by 170
A Strictly Contractive Peaceman--Rachford Splitting Method for Convex Programming
He, B., Liu, H., Wang, Z., & Yuan, X. (2014) · SIAM Journal on Optimization · doi:10.1137/13090849x · Cited by 168
Noise2Inverse: Self-Supervised Deep Convolutional Denoising for Tomography
Hendriksen, A. A., Pelt, D. M., & Batenburg, K. J. (2020) · IEEE Transactions on Computational Imaging · doi:10.1109/tci.2020.3019647 · Cited by 162
WINNet: Wavelet-Inspired Invertible Network for Image Denoising
Huang, J., & Dragotti, P. L. (2022) · IEEE Transactions on Image Processing · doi:10.1109/tip.2022.3184845 · Cited by 147
Gal, R., Hochberg, D. C., Bermano, A. H., & Cohen‐Or, D. (2021) · ACM Transactions on Graphics · doi:10.1145/3450626.3459836 · Cited by 125
DeScoD-ECG: Deep Score-Based Diffusion Model for ECG Baseline Wander and Noise Removal
Li, H., Ditzler, G., Roveda, J. M., & Li, A. (2023) · IEEE Journal of Biomedical and Health Informatics · doi:10.1109/jbhi.2023.3237712 · Cited by 112
Improving Diffusion Models for Inverse Problems using Manifold ConstraintsPreprint
Chung, H., Sim, B., Ryu, D., et al. (2022) · arXiv (Cornell University) · doi:10.48550/arxiv.2206.00941 · Cited by 99
Better Diffusion Models Further Improve Adversarial TrainingPreprint
Wang, Z., Pang, T., Du, C., Lin, M., Liu, W., & Yan, S. (2023) · arXiv (Cornell University) · doi:10.48550/arxiv.2302.04638 · Cited by 90
Pitfalls in Estimating Jump-Diffusion ModelsPreprint
Honoré, P. (1998) · SSRN Electronic Journal · doi:10.2139/ssrn.61998 · Cited by 73
Stability of complex Langevin dynamics in effective models
Gert Aarts, A., James, F. A., Pawlowski, J. M., Seiler, E., Sexty, D., & Stamatescu, I.-O. (2013) · Journal of High Energy Physics · doi:10.1007/jhep03(2013)073 · Cited by 68
Adversarial purification with Score-based generative modelsPreprint
Yoon, J., Hwang, S. J., & Lee, J. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2106.06041 · Cited by 65
Generative Modeling in Sinogram Domain for Sparse-View CT Reconstruction
Guan, B., Yang, C., Zhang, L., Niu, S., Zhang, M., Wang, Y., Wu, W., & Liu, Q. (2023) · IEEE Transactions on Radiation and Plasma Medical Sciences · doi:10.1109/trpms.2023.3309474 · Cited by 58
Self-citationMulti scale pixel attention and feature extraction based neural network for image denoising
Thakur, R. K., & Maji, S. K. (2023) · Pattern Recognition · doi:10.1016/j.patcog.2023.109603 · Cited by 55
Diffusion Models for Medical Image Analysis: A Comprehensive SurveyPreprint
Kazerouni, A., Aghdam, E. K., Heidari, M., Azad, R., Fayyaz, M., Hacihaliloglu, I., & Merhof, D. (2022) · arXiv (Cornell University) · doi:10.48550/arxiv.2211.07804 · Cited by 50
Chen, M., Huang, K., Zhao, T., & Wang, M. (2023) · arXiv (Cornell University) · doi:10.48550/arxiv.2302.07194 · Cited by 50
Your diffusion model secretly knows the dimension of the data manifoldPreprint
Stanczuk, J., Batzolis, G., Deveney, T., & Schönlieb, C. (2022) · arXiv (Cornell University) · doi:10.48550/arxiv.2212.12611 · Cited by 42
Low‐dose CT reconstruction using spatially encoded nonlocal penalty
Kim, K., Fakhri, G. E., & Li, Q. (2017) · Medical Physics · doi:10.1002/mp.12523 · Cited by 36
One-Shot Generative Prior in Hankel-k-Space for Parallel Imaging Reconstruction
Peng, H., Jiang, C., Cheng, J., Zhang, M., Wang, S., Liang, D., & Liu, Q. (2023) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2023.3288219 · Cited by 26
Self-citationMulti-Scale Deep Compressive Imaging
Canh, T. N., & Jeon, B. (2020) · IEEE Transactions on Computational Imaging · doi:10.1109/tci.2020.3034433 · Cited by 25
Tang, Z., Deng, M., Xiao, C., & Yu, J. S. (2011) · Electronic and Mechanical Engineering and Information Technology · doi:10.1109/emeit.2011.6022950 · Cited by 23
Iterative Reconstruction for Low-Dose CT Using Deep Gradient Priors of Generative Model
He, Z., Zhang, Y., Guan, Y., Guan, B., Niu, S., Zhang, Y., Chen, Y., & Liu, Q. (2022) · IEEE Transactions on Radiation and Plasma Medical Sciences · doi:10.1109/trpms.2022.3148373 · Cited by 19
Self-citationWang, H., Zhang, P., & Pant, T. (2018) · Physics of Fluids · doi:10.1063/1.5053098 · Cited by 12
Denoising Score-Matching for Uncertainty Quantification in Inverse ProblemsPreprint
Ramzi, Z., Remy, B., Lanusse, F., Starck, J., & Ciuciu, P. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2011.08698 · Cited by 9
Research works printed but not linked: 1
- Batson, Noise2Self: Blind denoising by self-supervision, 524
Cited by
Sorted by citations
Multimodal Large Language Models in Health Care: Applications, Challenges, and Future Outlook.
AlSaad, R., Abd-alrazaq, A., Boughorbel, S., Ahmed, A., Renault, M.-A., Damseh, R., & Sheikh, J. (2024) · Journal of medical Internet research · doi:10.2196/59505 · Cited by 349
“Synthetic data generation using generative models can create realistic, diverse data sets that mimic real-world multimodal medical scenarios, thus expanding the training data set without compromising privacy or ethical standards [149-151].”
Iterative Residual Optimization Network for Limited-Angle Tomographic Reconstruction
Pan, J., Yu, H., Gao, Z., Wang, S., Zhang, H., & Wu, W. (2024) · IEEE Transactions on Image Processing · doi:10.1109/tip.2024.3351382 · Cited by 77
Self-citationStage-by-Stage Wavelet Optimization Refinement Diffusion Model for Sparse-View CT Reconstruction
Xu, K., Lu, S., Huang, B., Wu, W., & Liu, Q. (2024) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2024.3355455 · Cited by 62
Self-citationKorkmaz, C., Tekalp, A., & Doğan, Z. (2024) · Computer Vision and Pattern Recognition · doi:10.1109/cvpr52733.2024.00566 · Cited by 56
Multi-Channel Optimization Generative Model for Stable Ultra-Sparse-View CT Reconstruction
Wu, W., Pan, J., Wang, Y., Wang, S., & Zhang, J. (2024) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2024.3376414 · Cited by 55
Self-citation
Metadata
- Authors
- Wu, W., Wang, Y., Liu, Q., Wang, G., & Zhang, J.
- Affiliations
- Sun Yat-sen University (CN)
- Nanchang University (CN)
- Rensselaer Polytechnic Institute (US)
- Venue
- IEEE Transactions on Medical Imaging
- Published
- 2024-03
- Volume
- 43
- Issue
- 3
- Pages
- 966-979
- ISSN
- 0278-0062 (ISSN-L)
- 1558-254X
- OpenAlex
- W4387789684
- Cited by
- 105
- References
- 63
- Citations by year
- 2026: 23 · 2025: 32 · 2024: 45
- FWCI
- 9.53
- Type
- journal article
- Language
- en
- Open access
- closed
- Licence
- Locations
- IEEE Transactions on Medical Imaging (publishedVersion)
- PubMed (publishedVersion)
- Funders
- National Natural Science Foundation of China (62201628, 62122033, 62101611)
- National Key Research and Development Program of China (2022YFA1204201)
- National Cancer Institute (NCI) of the National Institutes of Health (R01HL151561, R01EB031102, R01EB032716)
- Basic and Applied Basic Research Foundation of Guangdong Province (2022A1515011375, 2023A1515012278, 2023A1515011780)
- Shenzhen Science and Technology Program (JCYJ20220530145411027, JCYJ20220818102414031)
- Key Research and Development Program of Jianxi Province (20210BBE53001)
- Topics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Image and Signal Denoising Methods
- Health Sciences › Medicine › Radiology, Nuclear Medicine and Imaging › Medical Imaging Techniques and Applications
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Generative Adversarial Networks and Image Synthesis
- Keywords
- score-based generative models, wavelet denoising, medical image reconstruction, low-dose CT, sparse-view CT, noisy training data, training stability, regularization, inverse problems
- MeSH terms
- Algorithms, Image Processing, Computer-Assisted, Magnetic Resonance Imaging, Tomography, X-Ray Computed, Artifacts, Neural Networks, Computer, Signal-To-Noise Ratio
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review