LEDNet: a multimodal foundation model for robust deepfake detection
The DOI matches its Crossref record; 58 of the 58 references it cites were found in a registry or an index.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Citations
Cites
Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A. N., Kaiser, L., & Polosukhin, I. (2017) · arXiv · doi:10.48550/arxiv.1706.03762 · Cited by 120,404
Learning Transferable Visual Models From Natural Language Supervision
Radford, A., Kim, J. W., Hallacy, C., Ramesh, A., Goh, G., Agarwal, S., Sastry, G., Askell, A., Mishkin, P., Clark, J., et al. (2021) · arXiv · doi:10.48550/arxiv.2103.00020 · Cited by 15,293 · cited 3×
“Since research on multi-modality has achieved astonishing progress, particularly CLIP [30], Refs.”
Proceedings of the 19th International Joint Conference on Artificial Intelligence
Pujol, J. M., Delgado, J., Ramon Sangüesa, A., & Flache, A. (2005) · International Joint Conference on Artificial Intelligence · Cited by 5,771
Proceedings European Conference on Computer Vision 2002
Heyden, A., Sparr, G., Nielsen, M., & Johansen, P. (2002) · Lund University Publications (Lund University) · Cited by 5,153
Progressive Growing of GANs for Improved Quality, Stability, and Variation
Karras, T., Aila, T., Laine, S., & Lehtinen, J. (2017) · arXiv · doi:10.48550/arxiv.1710.10196 · Cited by 4,727
Learning to Prompt for Vision-Language Models
Zhou, K., Yang, J., Loy, C. C., & Liu, Z. (2022) · International Journal of Computer Vision · doi:10.1007/s11263-022-01653-1 · Cited by 3,304 · cited 3×
“Recent efforts to enhance generalization also involve re-fining detection algorithms [18,19], augmenting datasets with more diverse images [20,21], and developing pre-trained models [13].”
Livescu, K., Bezman, A., Borges, N., Yung, L.-Y., Çetin, Ö., Frankel, J., King, S., Magimai.-Doss, M., Chi, X., & Lavoie, L. (2007) · Edinburgh Research Explorer (University of Edinburgh) · Cited by 2,145
Conditional Prompt Learning for Vision-Language Models
Zhou, K., Yang, J., Loy, C. C., & Liu, Z. (2022) · 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52688.2022.01631 · Cited by 1,796
LSUN: Construction of a Large-scale Image Dataset using Deep Learning with Humans in the Loop
Yu, F., Seff, A., Zhang, Y., Song, S., Funkhouser, T., & Xiao, J. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1506.03365 · Cited by 1,245
CNN-Generated Images Are Surprisingly Easy to Spot… for Now
Wang, S.-Y., Wang, O., Zhang, R., Owens, A., & Efros, A. A. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00872 · Cited by 1,210
Thinking in Frequency: Face Forgery Detection by Mining Frequency-Aware Clues
Qian, Y., Yin, G., Sheng, L., Chen, Z., & Shao, J. (2020) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-58610-2_6 · Cited by 1,058
Detecting and Simulating Artifacts in GAN Fake Images
Zhang, X., Karaman, S., & Chang, S.-F. (2019) · 2019 IEEE International Workshop on Information Forensics and Security (WIFS) · doi:10.1109/wifs47025.2019.9035107 · Cited by 567 · cited 2×
“[16] simulated frequency artifacts to enable the detector to distinguish a deepfake of unknown source.”
Detecting Deepfakes with Self-Blended Images
Shiohara, K., & Yamasaki, T. (2022) · 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52688.2022.01816 · Cited by 503
Leveraging Frequency Analysis for Deep Fake Image Recognition
Frank, J., Eisenhofer, T., Schönherr, L., Fischer, A., Kolossa, D., & Holz, T. (2020) · arXiv · doi:10.48550/arxiv.2003.08685 · Cited by 390 · cited 1×
“The work in [24] focused on efficiently utilizing both local and global image information.”
What Makes Fake Images Detectable? Understanding Properties that Generalize
Chai, L., Bau, D., Lim, S.-N., & Isola, P. (2020) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-58574-7_7 · Cited by 357
DIRE for Diffusion-Generated Image Detection
Wang, Z., Bao, J., Zhou, W., Wang, W., Hu, H., Chen, H., & Li, H. (2023) · 2023 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.02051 · Cited by 354 · cited 1×
“The additional nine datasets come from GANGen-Detection [45], comprising images generated by nine different GANs.”
Self-citationOn The Detection of Synthetic Images Generated by Diffusion Models
Corvi, R., Cozzolino, D., Zingarini, G., Poggi, G., Nagano, K., & Verdoliva, L. (2023) · ICASSP 2023 - 2023 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) · doi:10.1109/icassp49357.2023.10095167 · Cited by 304
Detecting Generated Images by Real Images
Liu, B., Yang, F., Bi, X., Xiao, B., Li, W., & Gao, X. (2022) · Lecture notes in computer science · doi:10.1007/978-3-031-19781-9_6 · Cited by 205
Learning on Gradients: Generalized Artifacts Representation for GAN-Generated Images Detection
Tan, C., Zhao, Y., Wei, S., Gu, G., & Wei, Y. (2023) · 2023 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52729.2023.01165 · Cited by 203
Self-citationISTVT: Interpretable Spatial-Temporal Video Transformer for Deepfake Detection
Zhao, C., Wang, C., Hu, G., Chen, H., Liu, C., & Tang, J. (2023) · IEEE Transactions on Information Forensics and Security · doi:10.1109/tifs.2023.3239223 · Cited by 184
DE-FAKE: Detection and Attribution of Fake Images Generated by Text-to-Image Generation Models
Sha, Z., Li, Z., Yu, N., & Zhang, Y. (2023) · Proceedings of the 2023 ACM SIGSAC Conference on Computer and Communications Security · doi:10.1145/3576915.3616588 · Cited by 175 · cited 1×
“[31,32] introduced additional text information to assist the model in learning intricate artifacts, which shows the powerful potential of the vision-text model.”
TMG-GAN: Generative Adversarial Networks-Based Imbalanced Learning for Network Intrusion Detection
Ding, H., Sun, Y., Huang, N., Shen, Z., & Cui, X. (2023) · IEEE Transactions on Information Forensics and Security · doi:10.1109/tifs.2023.3331240 · Cited by 162
Incremental learning for the detection and classification of GAN-generated images
Marra, F., Saltori, C., Boato, G., & Verdoliva, L. (2019) · 2019 IEEE International Workshop on Information Forensics and Security (WIFS) · doi:10.1109/wifs47025.2019.9035099 · Cited by 154
Towards the Detection of Diffusion Model DeepfakesPreprint
Ricker, J., Damm, S., Holz, T., & Fischer, A. (2022) · arXiv (Cornell University) · doi:10.48550/arxiv.2210.14571 · Cited by 154
FrePGAN: Robust Deepfake Detection Using Frequency-Level Perturbations
Jeong, Y., Kim, D., Ro, Y., & Choi, J. (2022) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v36i1.19990 · Cited by 137
Fighting Deepfakes by Detecting GAN DCT Anomalies
Giudice, O., Guarnera, L., & Battiato, S. (2021) · Journal of Imaging · doi:10.3390/jimaging7080128 · Cited by 118
Detecting Gan-Generated Images by Orthogonal Training of Multiple CNNs
Mandelli, S., Bonettini, N., Bestagini, P., & Tubaro, S. (2022) · Proceedings - International Conference on Image Processing · doi:10.1109/icip46576.2022.9897310 · Cited by 115
BiHPF: Bilateral High-Pass Filters for Robust Deepfake Detection
Jeong, Y., Kim, D., Min, S., Joe, S., Gwon, Y., & Choi, J. (2022) · 2022 IEEE/CVF Winter Conference on Applications of Computer Vision (WACV) · doi:10.1109/wacv51458.2022.00293 · Cited by 106
Reinforcement Learning Solution for Cyber-Physical Systems Security Against Replay Attacks
Yu, Y., Yang, W. D., Ding, W., et al. (2023) · IEEE Transactions on Information Forensics and Security · doi:10.1109/tifs.2023.3268532 · Cited by 105
Towards Discovery and Attribution of Open-world GAN Generated Images
Girish, S., Suri, S., Rambhatla, S. S., & Shrivastava, A. (2021) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.01383 · Cited by 94
Fusing Global and Local Features for Generalized AI-Synthesized Image Detection
Ju, Y., Jia, S., Ke, L., Xue, H., Nagano, K., & Lyu, S. (2022) · 2022 IEEE International Conference on Image Processing (ICIP) · doi:10.1109/icip46576.2022.9897820 · Cited by 94
Generative Steganography via Auto-Generation of Semantic Object Contours
Zhou, Z., Dong, X., Meng, R., Wang, M., Yan, H., Yu, K., & Choo, K. R. (2023) · IEEE Transactions on Information Forensics and Security · doi:10.1109/tifs.2023.3268843 · Cited by 91
Conditional Prompt Learning for Vision-Language ModelsPreprint
Zhou, K., Yang, J., Loy, C. C., et al. (2022) · arXiv (Cornell University) · doi:10.48550/arxiv.2203.05557 · Cited by 73
Beyond the Spectrum: Detecting Deepfakes via Re-Synthesis
He, Y., Yu, N., Keuper, M., & Fritz, M. (2021) · Proceedings of the Thirtieth International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2021/349 · Cited by 70
Think Twice Before Detecting GAN-generated Fake Images from their Spectral Domain Imprints
Dong, C., Kumar, A., & Liu, E. (2022) · 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52688.2022.00771 · Cited by 69
BAGM: A Backdoor Attack for Manipulating Text-to-Image Generative Models
Vice, J., Akhtar, N., Hartley, R. I., & Mian, A. S. (2024) · IEEE Transactions on Information Forensics and Security · doi:10.1109/tifs.2024.3386058 · Cited by 67
Reverse Engineering of Generative Models: Inferring Model Hyperparameters From Generated Images
Asnani, V., Yin, X., Hassner, T., & Liu, X. (2023) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2023.3301451 · Cited by 62
Zhang, S., Yang, Y., Zhou, Z., Sun, Z. Y., & Lin, Y. (2024) · IEEE Transactions on Information Forensics and Security · doi:10.1109/tifs.2024.3372798 · Cited by 51
Discovering Transferable Forensic Features for CNN-Generated Images Detection
Chandrasegaran, K., Tran, N.-T., Binder, A., & Cheung, N. M. (2022) · Lecture notes in computer science · doi:10.1007/978-3-031-19784-0_39 · Cited by 50
FingerprintNet: Synthesized Fingerprints for Generated Image Detection
Jeong, Y., Kim, D., Ro, Y., Kim, P., & Choi, J. (2022) · Lecture notes in computer science · doi:10.1007/978-3-031-19781-9_5 · Cited by 49
CNN-generated images are surprisingly easy to spot... for nowPreprint
Wang, S.-Y., Wang, O., Zhang, R., et al. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1912.11035 · Cited by 44
Discovering Transferable Forensic Features for CNN-generated Images DetectionPreprint
Chandrasegaran, K., Tran, N.-T., Binder, A., & Cheung, N.-M. (2022) · European Conference on Computer Vision · doi:10.48550/arxiv.2208.11342 · Cited by 44
Frequency-Aware Attentional Feature Fusion for Deepfake Detection
Tian, C., Luo, Z., Shi, G., & Li, S. (2023) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp49357.2023.10094654 · Cited by 43
Thinking in Frequency: Face Forgery Detection by Mining Frequency-aware CluesPreprint
Qian, Y.-Y., Yin, G., Sheng, L., et al. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2007.09355 · Cited by 42
Improving GAN-Generated Image Detection Generalization Using Unsupervised Domain Adaptation
Zhang, M., Wang, H., He, P., Malik, A., & Liu, H. (2022) · IEEE International Conference on Multimedia and Expo (ICME) · doi:10.1109/icme52920.2022.9859763 · Cited by 37
Toward Secure and Robust Steganography for Black-Box Generated Images
Zeng, K., Chen, K., Zhang, J., Zhang, W., & Yu, N. (2024) · IEEE Transactions on Information Forensics and Security · doi:10.1109/tifs.2024.3361220 · Cited by 32
Durall, R., Keuper, M., & Keuper, J. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00791 · Cited by 26
What makes fake images detectable? Understanding properties that generalizePreprint
Chai, L., Bau, D. A., Lim, S.-N., et al. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2008.10588 · Cited by 13
OST: Improving Generalization of DeepFake Detection Via One-Shot Test-Time Training
Chen, L., Zhang, Y., Song, Y., Wang, J., & Liu, L. (2022) · Advances in Neural Information Processing Systems 35 · doi:10.52202/068431-1786 · Cited by 12
On the detection of synthetic images generated by diffusion modelsPreprint
Corvi, R., Cozzolino, D., Zingarini, G., et al. (2022) · arXiv (Cornell University) · doi:10.48550/arxiv.2211.00680 · Cited by 10
Encrypted and Compressed Key-Value Store With Pattern-Analysis Security in Cloud Systems
Zhang, C., Ming, Y., Wang, M., et al. (2023) · IEEE Transactions on Information Forensics and Security · doi:10.1109/tifs.2023.3320612 · Cited by 8
DE-FAKE: Detection and Attribution of Fake Images Generated by Text-to-Image Generation ModelsPreprint
Sha, Z., Li, Z., Yu, N., et al. (2022) · arXiv (Cornell University) · doi:10.48550/arxiv.2210.06998 · Cited by 7
Generalizable Synthetic Image Detection via Language-guided Contrastive LearningPreprint
Wu, H., Zhou, J., & Zhang, S. (2023) · arXiv (Cornell University) · doi:10.48550/arxiv.2305.13800 · Cited by 7
Beyond the Spectrum: Detecting Deepfakes via Re-SynthesisPreprint
He, Y., Yu, N., Keuper, M., & Fritz, M. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2105.14376 · Cited by 6
Intriguing properties of synthetic images: from generative adversarial networks to diffusion modelsPreprint
Corvi, R., Cozzolino, D., Poggi, G., et al. (2023) · arXiv (Cornell University) · doi:10.48550/arxiv.2304.06408 · Cited by 3
Detecting GAN-generated Images by Orthogonal Training of Multiple CNNsPreprint
Mandelli, S., Bonettini, N., Bestagini, P., et al. (2022) · arXiv (Cornell University) · doi:10.48550/arxiv.2203.02246 · Cited by 2
Fusing Global and Local Features for Generalized AI-Synthesized Image DetectionPreprint
Ju, Y., Jia, S., Ke, L., et al. (2022) · arXiv (Cornell University) · doi:10.48550/arxiv.2203.13964 · Cited by 1
Research works printed but not linked: 4
- Ojha U, Li Y, Lee Y J. Towards universal fake image detectors that generalize across generative models. In: Proceedings of CVPR, 2023. 24480–24489
- Dzanic T, Shah K, Witherden F. Fourier spectrum discrepancies in deep network generated images. In: Proceedings of Advances in Neural Information Processing Systems, 2020. 33: 3022–3032
- Dosovitskiy A, Beyer L, Kolesnikov A, et al. An image is worth 16×16 words: transformers for image recognition at scale. In: Proceedings of ICLR, 2021
- Kingma D P, Ba J. Adam: a method for stochastic optimization. In: Proceedings of ICLR, 2015
Cited by
He, Z., Guo, Z., Wang, L., Yang, G., Diao, Y., & Ma, D. (2025) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2025.3628951 · Cited by 20
“Lightweight video feature modeling methods have also been proposed to boost detection efficiency while maintaining high accuracy [12].”
jadhav, S., & Bartere, M. M. (2025) · International Journal of Information Technology · doi:10.1007/s41870-025-02978-z · Cited by 4
Domain-Adaptive Representation Learning for Multimodal Deepfake Detection
Haq, I. U., & Malik, K. M. (2025) · IEEE Transactions on Computational Social Systems · doi:10.1109/tcss.2025.3637242 · Cited by 3
“LEDNet [56] introduces language-enhanced detection by combining visual features with linguistic cues (e.g., subtitles), leveraging pretrained vision-language models to achieve strong performance across 25 benchmarks.”
Research on Structured Big Data Processing and Analysis Based on Improved GAN and EKF
Yang, Z. (2025) · International Conference on Artificial Intelligence and Computer Engineering (ICAICE) · doi:10.1109/icaice68195.2025.11382345
“Unlike traditional image data, structured tabular data typically contains continuous variables, discrete categorical variables, and possible timestamp information, which presents special challenges for generative models due to their mixed nature [3] [4] [5].”
Deepfake Detection Using a Hybrid Physiofreqformer Framework with Transfer Learning
Kaur, J., & Chopra, S. (2026) · International Conference on Signal, Systems, and Computing for Next-Gen Automation (ICSSCNA) · doi:10.1109/icsscna68616.2026.11546823
“On the same note, LEDNet integrates visual and linguistic features based on a multimodal structure to enhance the robustness of detection at cross datasets [8].”
Metadata
- Authors
- Tao, R., Tang, S., Qin, H., Wang, W., Wei, Y., & Zhao, Y.
- Affiliations
- Beijing Jiaotong University (CN)
- ETH Zurich (CH)
- Corresponding author
- Qin, Haotong
- Venue
- Science China Information Sciences
- Published
- 2025-05-20
- Volume
- 68
- Issue
- 6
- ISSN
- 1869-1919 (ISSN-L)
- 1674-733X
- OpenAlex
- W4410703587
- Semantic Scholar
- 79996c631dd849407a1744581be253036694d8a4
- Cited by
- 9
- References
- 44
- Citations by year
- 2026: 5 · 2025: 4
- FWCI
- 3.23
- Type
- journal article
- Language
- en
- Open access
- closed
- Licence
- www.springernature.com/gp/researchers/text-and-data-mining (tdm)
- www.springernature.com/gp/researchers/text-and-data-mining (vor)
- Locations
- Science China Information Sciences (publishedVersion)
- Topics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Digital Media Forensic Detection
- Social Sciences › Sociology and Political Science › Misinformation and Its Impacts
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Generative Adversarial Networks and Image Synthesis
- Keywords
- deepfake detection, multimodal foundation models, vision-language models, pre-trained model fine-tuning, generative adversarial networks, diffusion models, AI-generated content, misinformation
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.