The DOI matches its Crossref record; 56 of the 56 references it cites were found in a registry or an index.
FiLM: Visual Reasoning with a General Conditioning Layer
Open accessAbstract
We introduce a general-purpose conditioning method for neural networks called FiLM: Feature-wise Linear Modulation. FiLM layers influence neural network computation via a simple, feature-wise affine transformation based on conditioning information. We show that FiLM layers are highly effective for visual reasoning - answering image-related questions which require a multi-step, high-level process - a task which has proven difficult for standard deep learning methods that do not explicitly model reasoning. Specifically, we show on visual reasoning tasks that FiLM layers 1) halve state-of-the-art error for the CLEVR benchmark, 2) modulate features in a coherent manner, 3) are robust to ablations and architectural modifications, and 4) generalize well to challenging, new data from few examples or even zero-shot.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source doesn’t support the claim as written.
In the citing paper
“While MI-VECTOR (i.e., diagonal parameters in a MI layer which results in a vector output) corresponds to the most basic implementation of FILM, the original FILM layer uses multiple non-linear layers instead of a single linear transformation in MI-VECTOR which has been shown to improve performance [120].”
From MultiBench: Multiscale Benchmarks for Multimodal Representation Learning (2021) · cites this paper as [120]
Checked by a reasoning model — may be wrong.
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“By appropriately constraining the rank and structure of these parameters, MI recovers HyperNetworks [61] (unconstrained parameters resulting in a matrix output), Feature-wise linear modulation (FiLM) [120, 188] (diagonal parameters resulting in vector output), and Sigmoid units [37] (scalar parameters resulting in scalar output).”
From MultiBench: Multiscale Benchmarks for Multimodal Representation Learning (2021) · cites this paper as [120]
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474
Hochreiter, S., & Schmidhuber, J. (1997) · Neural Computation · doi:10.1162/neco.1997.9.8.1735 · Cited by 102,318
Adam: A Method for Stochastic Optimization
Kingma, D. P., & Ba, J. (2014) · arXiv · doi:10.48550/arxiv.1412.6980 · Cited by 98,946
ImageNet Large Scale Visual Recognition Challenge
Russakovsky, O., Deng, J., Su, H., Krause, J., Satheesh, S., Ma, S., Huang, Z., Karpathy, A., Khosla, A., Bernstein, M., et al. (2015) · International Journal of Computer Vision · doi:10.1007/s11263-015-0816-y · Cited by 39,380
Squeeze-and-Excitation NetworksPreprint
Hu, J., Shen, L., & Sun, G. (2017) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.48550/arxiv.1709.01507 · Cited by 37,845
Squeeze-and-Excitation Networks
Hu, J., Shen, L., & Sun, G. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00745 · Cited by 35,667
(2008) · Journal of Machine Learning Research · Cited by 33,051
Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift
Ioffe, S., & Szegedy, C. (2015) · arXiv · doi:10.48550/arxiv.1502.03167 · Cited by 27,818
Distributed Representations of Words and Phrases and their Compositionality
Mikolov, T., Sutskever, I., Chen, K., Corrado, G., & Dean, J. (2013) · arXiv · doi:10.48550/arxiv.1310.4546 · Cited by 24,533
Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate ShiftPreprint
Ioffe, S. (2024) · arXiv (Cornell University) · doi:10.57702/o9raffed · Cited by 15,273
Flagged first, then by citations
Research works printed but not linked: 3
- [1][1] A. Krizhevsky, I. Sutskever, and G. E. Hinton, 'Imagenet classification with deep convolutional neural networks,' in Proc. of NIPS , 2012. -
- [4][4] I. Sutskever, O. Vinyals, and Q. V. Le, 'Sequence to sequence learning with neural networks,' in Proc. of NIPS , 2014. -
- [33][33] S. Reed, A. van den Oord, N. Kalchbrenner, V. Bapst, M. Botvinick, and N. de Freitas, 'Generating interpretable images with controllable structure,' in Proc. of ICLR , 2017.
Cited by
Sorted by citations
Items 201–300 of 1,007
Spatially-Adaptive Pixelwise Networks for Fast Image Translation
Shaham, T. R., Gharbi, M., Zhang, R., Shechtman, E., & Michaeli, T. (2021) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr46437.2021.01464 · Cited by 80
Pix2NeRF: Unsupervised Conditional $\pi$-GAN for Single Image to Neural Radiance Fields Translation
Cai, S., Obukhov, A., Dai, D., & Gool, L. V. (2022) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52688.2022.00395 · Cited by 80
Relating EEG to continuous speech using deep neural networks: a review
Puffay, C., Accou, B., Bollens, L., Monesi, M. J., Vanthornhout, J., hamme, H. V., & Francart, T. (2023) · Journal of Neural Engineering · doi:10.1088/1741-2552/ace73f · Cited by 80
Adaptation Algorithms for Neural Network-Based Speech Recognition: An Overview
Bell, P., Fainberg, J., Klejch, O., Li, J., Renals, S. J., & Świętojański, P. (2020) · IEEE Open Journal of Signal Processing · doi:10.1109/ojsp.2020.3045349 · Cited by 97
Multi-Modality Sensing and Data Fusion for Multi-Vehicle Detection
Roy, D., Li, Y., Jian, T., Tian, P., Chowdhury, K. R., & Ioannidis, S. (2022) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2022.3145663 · Cited by 85
Geo-Aware Networks for Fine-Grained Recognition
Chu, G., Potetz, B. R., Wang, W., Howard, A., Song, Y., Brücher, F., Leung, T., & Adam, H. (2019) · IEEE International Conference on Computer Vision Workshops · doi:10.1109/iccvw.2019.00033 · Cited by 76
CLE Diffusion: Controllable Light Enhancement Diffusion Model
Yin, Y., Xu, D., Tan, C., Liu, P., Zhao, Y., & Wei, Y. (2023) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3581783.3612145 · Cited by 80
GAN Memory with No ForgettingPreprint
Cong, Y., Zhao, M., Li, J., Wang, S., & Carin, L. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2006.07543 · Cited by 77
Deep Mixture of Experts via Shallow EmbeddingPreprint
Wang, X., Yu, F., Dunlap, L., Ma, Y.-A., Wang, R., Mirhoseini, A., Darrell, T., & Gonzalez, J. E. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1806.01531 · Cited by 77
Polysemy Deciphering Network for Human-Object Interaction Detection
Zhong, X., Ding, C., Qu, X., & Tao, D. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-58565-5_5 · Cited by 75
Spatial Broadcast Decoder: A Simple Architecture for Learning Disentangled Representations in VAEsPreprint
Watters, N., Matthey, L., Burgess, C., & Lerchner, A. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1901.07017 · Cited by 152
Span-based Semantic Parsing for Compositional Generalization
Herzig, J., & Berant, J. (2021) · doi:10.18653/v1/2021.acl-long.74 · Cited by 82
Real-world robot applications of foundation models: a review
Kawaharazuka, K., Matsushima, T., Gambardella, A., Guo, J., Paxton, C., & Zeng, A. (2024) · Advanced Robotics · doi:10.1080/01691864.2024.2408593 · Cited by 117
Learning Joint Visual Semantic Matching Embeddings for Language-Guided Retrieval
Chen, Y., & Bazzani, L. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-58542-6_9 · Cited by 74
Mason, I., Starke, S., & Komura, T. (2022) · Proceedings of the ACM on Computer Graphics and Interactive Techniques · doi:10.1145/3522618 · Cited by 105
CIPS-3D: A 3D-Aware Generator of GANs Based on Conditionally-Independent Pixel SynthesisPreprint
Zhou, P., Xie, L., Ni, B., & Tian, Q. C. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2110.09788 · Cited by 74
Task-Conditioned Domain Adaptation for Pedestrian Detection in Thermal Imagery
Kieu, M., Bagdanov, A. D., Bertini, M., & Bimbo, A. D. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-58542-6_33 · Cited by 73
Comprehensive Linguistic-Visual Composition Network for Image Retrieval
Wen, H., Song, X., Yang, X., Zhan, Y., & Nie, L. (2021) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/3404835.3462967 · Cited by 76
Symbolic Music Generation with Diffusion ModelsPreprint
Mittal, G., Engel, J., Hawthorne, C., & Simon, I. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2103.16091 · Cited by 173
Self-Adaptive Neural Module Transformer for Visual Question Answering
Zhong, H., Chen, J., Shen, C., Zhang, H., Huang, J., & Hua, X. (2020) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2020.2995278 · Cited by 73
Disentangle, Align and Fuse for Multimodal and Semi-Supervised Image Segmentation
Chartsias, A., Papanastasiou, G., Wang, C., Semple, S., Newby, D. E., Dharmakumar, R., & Tsaftaris, S. A. (2020) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2020.3036584 · Cited by 72
Instance and Panoptic Segmentation Using Conditional Convolutions
Tian, Z., Zhang, B., Chen, H., & Shen, C. (2022) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2022.3145407 · Cited by 76
Attribute-Guided Feature Learning for Few-Shot Image Recognition
Zhu, Y., Min, W., & Jiang, S. (2020) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2020.2993952 · Cited by 71
Multimodal feature fusion by relational reasoning and attention for visual question answering
Zhang, W., Yu, J., Hu, H., Hu, H., & Qin, Z. (2019) · Information Fusion · doi:10.1016/j.inffus.2019.08.009 · Cited by 70
Zhang, W., Yu, J., Zhao, W., & Ran, C. (2021) · Information Fusion · doi:10.1016/j.inffus.2021.02.006 · Cited by 70
Enhancing Few-Shot Image Classification with Unlabelled Examples
Bateni, P., Barber, J., van de Meent, J.-W., & Wood, F. (2022) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv51458.2022.00166 · Cited by 69
Multimodal Representation Learning by Alternating Unimodal Adaptation
Zhang, X., Yoon, J., Bansal, M., & Yao, H. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.02592 · Cited by 72
From Language to Goals: Inverse Reinforcement Learning for Vision-Based Instruction FollowingPreprint
Fu, J., Balan, A. K., Levine, S., & Guadarrama, S. (2019) · International Conference on Learning Representations · doi:10.48550/arxiv.1902.07742 · Cited by 147
(2020) · International Conference on Learning Representations · Cited by 68
Combining 3D Image and Tabular Data via the Dynamic Affine Feature Map Transform
Pölsterl, S., Wolf, T. N., & Wachinger, C. (2021) · Lecture notes in computer science · doi:10.1007/978-3-030-87240-3_66 · Cited by 68
Recent Advances of Continual Learning in Computer Vision: An Overview
Qu, H., Rahmani, H., Xu, L., Williams, B. M., & Liu, J. (2025) · IET Computer Vision · doi:10.1049/cvi2.70013 · Cited by 122
Multi-Modality Latent Interaction Network for Visual Question Answering
Gao, P., You, H., Zhang, Z., Wang, X., & Li, H. (2019) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00592 · Cited by 87
Meta Module Network for Compositional Visual Reasoning
Chen, W., Gan, Z., Li, L., Cheng, Y., Wang, W. Y., & Liu, J. (2021) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv48630.2021.00070 · Cited by 69
Towards Lightweight Transformer Via Group-Wise Transformation for Vision-and-Language Tasks
Luo, G., Zhou, Y., Sun, X., Wang, Y., Cao, L., Wu, Y., Huang, F., & Ji, R. (2022) · IEEE Transactions on Image Processing · doi:10.1109/tip.2021.3139234 · Cited by 67
A Survey of Deep Learning for Mathematical Reasoning
Lu, P., Qiu, L., Yu, W., Welleck, S., & Chang, K.-W. (2023) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2023.acl-long.817 · Cited by 145
Automated Relational Meta-learningPreprint
Yao, H., Wu, X., Tao, Z., Li, Y., Ding, B., Li, Z., & Li, Z. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2001.00745 · Cited by 66
Learning to synthesise the ageing brain without longitudinal data
Xia, T., Chartsias, A., Wang, C., & Tsaftaris, S. A. (2021) · Medical Image Analysis · doi:10.1016/j.media.2021.102169 · Cited by 74
Misra, I., Girshick, R., Fergus, R., Hebert, M., Gupta, A., & van der Maaten, L. J. P. (2018) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2018.00009 · Cited by 66
Systematic Generalization: What Is Required and Can It Be Learned?Preprint
Bahdanau, D., Murty, S., Noukhovitch, M., Nguyen, T. H., de Vries, H., & Courville, A. C. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1811.12889 · Cited by 114
Self-citationBoosting Multi-modal Model Performance with Adaptive Gradient Modulation
Li, H., Li, X., Hu, P., Lei, Y., Li, C., & Zhou, Y. (2023) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.02030 · Cited by 64
Li, R., Zhang, Y.-X., Zhang, Y., Zhang, H., Guo, J., Zhang, Y. T., Liu, Y., & Li, X. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.00151 · Cited by 77
Generative Question Answering: Learning to Answer the Whole Question.
Lewis, M., & Fan, A. (2018) · International Conference on Learning Representations · Cited by 60
No Gestures Left Behind: Learning Relationships between Spoken Language and Freeform Gestures
Ahuja, C., Lee, D. W., Ishii, R., & Morency, L. (2020) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2020.findings-emnlp.170 · Cited by 65
Dynamically Adjust Word Representations Using Unaligned Multimodal Information
Guo, J., Tang, J., Dai, W., Ding, Y., & Kong, W. (2022) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3503161.3548137 · Cited by 65
Medical Visual Question Answering via Conditional Reasoning and Contrastive Learning
Liu, B., Zhan, L.-M., Xu, L., & Wu, X.-M. (2022) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2022.3232411 · Cited by 63
PEM: Prototype-Based Efficient MaskFormer for Image Segmentation
Cavagnero, N., Rosi, G., Cuttano, C., Pistilli, F., Ciccone, M., Averta, G., & Cermelli, F. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.01496 · Cited by 73
PFCNN: Convolutional Neural Networks on 3D Surfaces Using Parallel Frames
Yang, Y., Liu, S., Pan, H., Liu, Y., & Tong, X. (2020) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr42600.2020.01359 · Cited by 64
Generalized end-to-end detection of spoofing attacks to automatic speaker recognizers
Monteiro, J., Alam, J., & Falk, T. H. (2020) · Computer Speech & Language · doi:10.1016/j.csl.2020.101096 · Cited by 65
Node-Feature Convolution for Graph Convolutional Networks
Zhang, L., Song, H., Αλέτρας, Ν., & Lu, H. (2022) · Pattern Recognition · doi:10.1016/j.patcog.2022.108661 · Cited by 61
Generating Instance-level Prompts for Rehearsal-free Continual Learning
Jung, D., Han, D., Bang, J., & Song, H. (2023) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.01088 · Cited by 69
RapidBrachyDL: Rapid Radiation Dose Calculations in Brachytherapy Via Deep Learning
Mao, X., Pineau, J., Keyes, R., & Enger, S. A. (2020) · International Journal of Radiation Oncology*Biology*Physics · doi:10.1016/j.ijrobp.2020.04.045 · Cited by 62
Dynamic Routing Transformer Network for Multimodal Sarcasm Detection
Tian, Y., Xu, N., Zhang, R., & Mao, W. (2023) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2023.acl-long.139 · Cited by 66
Temporal Link Prediction: A Unified Framework, Taxonomy, and Review
Qin, M., & Yeung, D. (2023) · ACM Computing Surveys · doi:10.1145/3625820 · Cited by 69
Learning to Color from Language
Manjunatha, V., Iyyer, M., Boyd-Graber, J. L., & Davis, L. S. (2018) · Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT) · doi:10.18653/v1/n18-2120 · Cited by 69
Polysemy Deciphering Network for Robust Human–Object Interaction Detection
Zhong, X., Ding, C., Qu, X., & Tao, D. (2021) · International Journal of Computer Vision · doi:10.1007/s11263-021-01458-8 · Cited by 59
Breaking medical data sharing boundaries by using synthesized radiographs
Han, T., Nebelung, S., Haarburger, C., Horst, N., Reinartz, S. D., Merhof, D., Kiessling, F. M., Schulz, V., & Truhn, D. (2020) · Science Advances · doi:10.1126/sciadv.abb7973 · Cited by 67
Multi-Stage Feature Fusion Network for Video Super-Resolution
Song, H., Xu, W., Liu, D., Лю, Б., Liu, Q., & Metaxas, D. (2021) · IEEE Transactions on Image Processing · doi:10.1109/tip.2021.3056868 · Cited by 60
Exploring Diffusion Models for Unsupervised Video Anomaly Detection
Tur, A. O., Dall’Asen, N., Beyan, C., & Ricci, E. (2023) · Proceedings - International Conference on Image Processing · doi:10.1109/icip49359.2023.10222594 · Cited by 72
MWFormer: Multi-Weather Image Restoration Using Degradation-Aware Transformers
Zhu, R., Tu, Z., Liu, J., Bovik, A. C., & Fan, Y. (2024) · IEEE Transactions on Image Processing · doi:10.1109/tip.2024.3501855 · Cited by 67
A Joint Modeling of Vision-Language-Action for Target-oriented Grasping in Clutter
Xu, K., Zhao, S., Zhou, Z., Li, Z., Pi, H., Zhu, Y., Wang, Y., & Xiong, R. (2023) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra48891.2023.10161041 · Cited by 72
Explore Multi-Step Reasoning in Video Question Answering
Song, X., Shi, Y., Chen, X., & Han, Y. (2018) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3240508.3240563 · Cited by 58
Neural Pose Transfer by Spatially Adaptive Instance Normalization
Wang, J., Wen, C., Fu, Y., Lin, H., Zou, T., Xue, X., & Zhang, Y. (2020) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr42600.2020.00587 · Cited by 59
Multi-Task Reinforcement Learning with Context-based RepresentationsPreprint
Sodhani, S., Zhang, A., & Pineau, J. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2102.06177 · Cited by 58
Interpretable Visual Question Answering by Reasoning on Dependency Trees
Cao, Q., Liang, X., Li, B., & Lin, L. (2019) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2019.2943456 · Cited by 58
VIDM: Video Implicit Diffusion Models
Mei, K., & Patel, V. M. (2023) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v37i8.26094 · Cited by 70
MetaPortrait: Identity-Preserving Talking Head Generation with Fast Personalized Adaptation
Zhang, B., Qi, C., Zhang, P., Zhang, B., Wu, H., Chen, D., Chen, Q., Wang, Y., & Wen, F. (2023) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52729.2023.02116 · Cited by 58
DiffiT: Diffusion Vision Transformers for Image Generation
Hatamizadeh, A., Song, J., Liu, G., Kautz, J., & Vahdat, A. (2024) · Lecture notes in computer science · doi:10.1007/978-3-031-73242-3_3 · Cited by 102
Quarteroni, A. M., Gervasio, P., & Regazzoni, F. (2025) · Mathematical Models and Methods in Applied Sciences · doi:10.1142/s0218202525500125 · Cited by 88
Probabilistic Neural-symbolic Models for Interpretable Visual Question AnsweringPreprint
Vedantam, R., Desai, K., Lee, S., Rohrbach, M., Batra, D., & Parikh, D. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1902.07864 · Cited by 59
SASV 2022: The First Spoofing-Aware Speaker Verification Challenge
Jung, J.-W., Tak, H., Shim, H.-J., Heo, H.-S., Lee, B.-J., Chung, S.-W., Yu, H.-J., Evans, N., & Kinnunen, T. (2022) · Interspeech 2022 · doi:10.21437/interspeech.2022-11270 · Cited by 56
You Only Train Once: Loss-Conditional Training of Deep Networks
Dosovitskiy, A., & Djolonga, J. (2020) · International Conference on Learning Representations · Cited by 55
Bi-directional Training for Composed Image Retrieval via Text Prompt Learning
Liu, Z., Sun, W., Hong, Y., Teney, D., & Gould, S. J. (2024) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv57701.2024.00565 · Cited by 57
Yang, L., Li, X., Song, R., Zhao, B., Tao, J., Zhou, S., Liang, J., & Yang, J. J. (2022) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52688.2022.01067 · Cited by 55
Barakat, H. M., Türk, O., & Demiroğlu, C. (2024) · EURASIP Journal on Audio Speech and Music Processing · doi:10.1186/s13636-024-00329-7 · Cited by 70
C3: High-Performance and Low-Complexity Neural Compression from a Single Image or Video
Kim, H., Bauer, M., Theis, L., Schwarz, J. R., & Dupont, E. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.00893 · Cited by 55
Multi-modality Latent Interaction Network for Visual Question AnsweringPreprint
Gao, P., You, H., Zhang, Z., Wang, X., & Li, H. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1908.04289 · Cited by 55
Temporal FiLM: Capturing Long-Range Sequence Dependencies with Feature-Wise ModulationsPreprint
Birnbaum, S., Kuleshov, V., Enam, Z., Koh, P. W., & Ermon, S. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1909.06628 · Cited by 55
Progressive Language-Customized Visual Feature Learning for One-Stage Visual Grounding
Liao, Y., Zhang, A., Chen, Z., Hui, T., & Liu, S. (2022) · IEEE Transactions on Image Processing · doi:10.1109/tip.2022.3181516 · Cited by 54
C 2 KD: Bridging the Modality Gap for Cross-Modal Knowledge Distillation
Huo, F., Xu, W., Guo, J., Wang, H., & Guo, S. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.01515 · Cited by 69
FSPool: Learning Set Representations with Featurewise Sort PoolingPreprint
Zhang, Y., Hare, J. S., & Prügel‐Bennett, A. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1906.02795 · Cited by 54
CLOSURE: Assessing Systematic Generalization of CLEVR Models
Bahdanau, D., de Vries, H., O'Donnell, T. J., Murty, S., Beaudoin, P., Bengio, Y., & Courville, A. (2019) · arXiv · doi:10.48550/arxiv.1912.05783 · Cited by 96
Self-citationMulti-Modal Image Fusion via Deep Laplacian Pyramid Hybrid Network
Luo, X., Fu, G., Yang, J., Cao, Y., & Cao, Y. (2023) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2023.3281462 · Cited by 53
Applications of AI in multi-modal imaging for cardiovascular disease
Milosevic, M., Jin, Q., Singh, A., & Amal, S. (2024) · Frontiers in Radiology · doi:10.3389/fradi.2023.1294068 · Cited by 56
Answering Questions about Data Visualizations using Efficient Bimodal Fusion
Kafle, K., Shrestha, R., Price, B. L., Cohen, S. D., & Kanan, C. (2020) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv45572.2020.9093494 · Cited by 56
Pilault, J., Elhattami, A., & Pal, C. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2009.09139 · Cited by 75
A survey on generative adversarial network-based text-to-image synthesis
Zhou, R. H., Jiang, C. F., & Xu, Q. (2021) · Neurocomputing · doi:10.1016/j.neucom.2021.04.069 · Cited by 56
DAFT: A universal module to interweave tabular data and 3D images in CNNs
Wolf, T. N., Pölsterl, S., & Wachinger, C. (2022) · NeuroImage · doi:10.1016/j.neuroimage.2022.119505 · Cited by 52
Text FCG: Fusing Contextual Information via Graph Learning for text classification
Wang, Y., Wang, C., Zhan, J., Ma, W., & Jiang, Y. (2023) · Expert Systems with Applications · doi:10.1016/j.eswa.2023.119658 · Cited by 52
Learning the Pareto Front with HypernetworksPreprint
Navon, A., Shamsian, A., Chechik, G., & Fetaya, E. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2010.04104 · Cited by 120
Temporal Reasoning via Audio Question Answering
Fayek, H. M., & Johnson, J. (2020) · IEEE/ACM Transactions on Audio Speech and Language Processing · doi:10.1109/taslp.2020.3010650 · Cited by 57
Solving Audio Inverse Problems with a Diffusion Model
Moliner, E., Lehtinen, J., & Välimäki, V. (2023) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp49357.2023.10095637 · Cited by 65
UniGeo: Unifying Geometry Logical Reasoning via Reformulating Mathematical Expression
Chen, J., Li, T., Qin, J., Lu, P., Lin, L., Chen, C., & Liang, X. (2022) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2022.emnlp-main.218 · Cited by 143
FaceTalk: Audio-Driven Motion Diffusion for Neural Parametric Head Models
Aneja, S., Thies, J., Dai, A., & NieBner, M. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.02009 · Cited by 62
Preserving and combining knowledge in robotic lifelong reinforcement learning
Meng, Y., Bing, Z., Yao, X., Chen, K., Huang, K., Gao, Y., Sun, F., & Knoll, A. (2025) · Nature Machine Intelligence · doi:10.1038/s42256-025-00983-2 · Cited by 59
Application of Yolo on Mask Detection Task
Ren, L., & Ren, Z. (2021) · International Conference on Computer Research and Development · doi:10.1109/iccrd51685.2021.9386366 · Cited by 50
Multimodal Attentive Fusion Network for audio-visual event recognition
Brousmiche, M., Rouat, J., & Dupont, S. (2022) · Information Fusion · doi:10.1016/j.inffus.2022.03.001 · Cited by 50
Adaptive Siamese Tracking with a Compact Latent Network
Dong, X., Shen, J., Porikli, F., Luo, J., & Shao, L. (2022) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2022.3230064 · Cited by 50
Ak, K. E., Lim, J., Tham, J. Y., & Kassim, A. A. (2020) · Pattern Recognition Letters · doi:10.1016/j.patrec.2020.02.030 · Cited by 49
SAC: Semantic Attention Composition for Text-Conditioned Image Retrieval
Jandial, S., Badjatiya, P., Chawla, P., Chopra, A., Sarkar, M., & Krishnamurthy, B. (2022) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv51458.2022.00067 · Cited by 64
Metadata
- Authors
- Perez, E., Strub, F., De Vries, H., Dumoulin, V., & Courville, A.
- Affiliations
- Université de Montréal (CA)
- Centre National de la Recherche Scientifique (FR)
- Mila - Quebec Artificial Intelligence Institute (CA)
- Venue
- Proceedings of the AAAI Conference on Artificial Intelligence
- Published
- 2018-04-29
- Volume
- 32
- Issue
- 1
- ISSN
- 2159-5399 (ISSN-L)
- 2374-3468
- OpenAlex
- W2760103357
- Cited by
- 2,490
- References
- 55
- Citations by year
- 2026: 823 · 2025: 412 · 2024: 280 · 2023: 221 · 2022: 158 · 2021: 244 · 2020: 179 · 2019: 120 · 2018: 52
- FWCI
- 44.92
- Type
- conference paper
- Language
- en
- Open access
- diamond
- doi.org
- Locations
- Proceedings of the AAAI Conference on Artificial Intelligence (publishedVersion)
- arXiv (Cornell University) (submittedVersion)
- AAAI Publications (The Association for the Advancement of Artificial Intelligence (AAAI)) (submittedVersion)
- Funders
- Nvidia
- Fonds de recherche du Québec – Nature et technologies
- CHIST-ERA
- Topics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Multimodal Machine Learning Applications
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Neural Network Applications
- Physical Sciences › Computer Science › Artificial Intelligence › Domain Adaptation and Few-Shot Learning
- Keywords
- cinema, feature-wise linear modulation, visual reasoning, visual question answering, feature modulation, zero-shot generalization, few-shot learning
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
