The DOI matches its Crossref record; 56 of the 56 references it cites were found in a registry or an index.
FiLM: Visual Reasoning with a General Conditioning Layer
Open accessAbstract
We introduce a general-purpose conditioning method for neural networks called FiLM: Feature-wise Linear Modulation. FiLM layers influence neural network computation via a simple, feature-wise affine transformation based on conditioning information. We show that FiLM layers are highly effective for visual reasoning - answering image-related questions which require a multi-step, high-level process - a task which has proven difficult for standard deep learning methods that do not explicitly model reasoning. Specifically, we show on visual reasoning tasks that FiLM layers 1) halve state-of-the-art error for the CLEVR benchmark, 2) modulate features in a coherent manner, 3) are robust to ablations and architectural modifications, and 4) generalize well to challenging, new data from few examples or even zero-shot.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source doesn’t support the claim as written.
In the citing paper
“While MI-VECTOR (i.e., diagonal parameters in a MI layer which results in a vector output) corresponds to the most basic implementation of FILM, the original FILM layer uses multiple non-linear layers instead of a single linear transformation in MI-VECTOR which has been shown to improve performance [120].”
From MultiBench: Multiscale Benchmarks for Multimodal Representation Learning (2021) · cites this paper as [120]
Checked by a reasoning model — may be wrong.
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“By appropriately constraining the rank and structure of these parameters, MI recovers HyperNetworks [61] (unconstrained parameters resulting in a matrix output), Feature-wise linear modulation (FiLM) [120, 188] (diagonal parameters resulting in vector output), and Sigmoid units [37] (scalar parameters resulting in scalar output).”
From MultiBench: Multiscale Benchmarks for Multimodal Representation Learning (2021) · cites this paper as [120]
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474
Hochreiter, S., & Schmidhuber, J. (1997) · Neural Computation · doi:10.1162/neco.1997.9.8.1735 · Cited by 102,318
Adam: A Method for Stochastic Optimization
Kingma, D. P., & Ba, J. (2014) · arXiv · doi:10.48550/arxiv.1412.6980 · Cited by 98,946
ImageNet Large Scale Visual Recognition Challenge
Russakovsky, O., Deng, J., Su, H., Krause, J., Satheesh, S., Ma, S., Huang, Z., Karpathy, A., Khosla, A., Bernstein, M., et al. (2015) · International Journal of Computer Vision · doi:10.1007/s11263-015-0816-y · Cited by 39,380
Squeeze-and-Excitation NetworksPreprint
Hu, J., Shen, L., & Sun, G. (2017) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.48550/arxiv.1709.01507 · Cited by 37,845
Squeeze-and-Excitation Networks
Hu, J., Shen, L., & Sun, G. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00745 · Cited by 35,667
(2008) · Journal of Machine Learning Research · Cited by 33,051
Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift
Ioffe, S., & Szegedy, C. (2015) · arXiv · doi:10.48550/arxiv.1502.03167 · Cited by 27,818
Distributed Representations of Words and Phrases and their Compositionality
Mikolov, T., Sutskever, I., Chen, K., Corrado, G., & Dean, J. (2013) · arXiv · doi:10.48550/arxiv.1310.4546 · Cited by 24,533
Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate ShiftPreprint
Ioffe, S. (2024) · arXiv (Cornell University) · doi:10.57702/o9raffed · Cited by 15,273
Flagged first, then by citations
Research works printed but not linked: 3
- [1][1] A. Krizhevsky, I. Sutskever, and G. E. Hinton, 'Imagenet classification with deep convolutional neural networks,' in Proc. of NIPS , 2012. -
- [4][4] I. Sutskever, O. Vinyals, and Q. V. Le, 'Sequence to sequence learning with neural networks,' in Proc. of NIPS , 2014. -
- [33][33] S. Reed, A. van den Oord, N. Kalchbrenner, V. Bapst, M. Botvinick, and N. de Freitas, 'Generating interpretable images with controllable structure,' in Proc. of ICLR , 2017.
Cited by
Sorted by citations
Items 401–500 of 1,007
Revisiting Unsupervised Meta-Learning via the Characteristics of Few-Shot Tasks
Ye, H.-J., Han, L., & Zhan, D. (2022) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2022.3179368 · Cited by 31
Probabilistic Compositional Embeddings for Multimodal Image Retrieval
Neculai, A., Chen, Y., & Akata, Z. (2022) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw56347.2022.00501 · Cited by 33
Multi-Grained Attention Network With Mutual Exclusion for Composed Query-Based Image Retrieval
Li, S., Xu, X., Jiang, X., Shen, F., Liu, X., & Shen, H. T. (2023) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2023.3306738 · Cited by 32
Ratajczak, F., Joblin, M., Hildebrandt, M. E., Ringsquandl, M., Falter‐Braun, P., & Heinig, M. (2023) · Nature Communications · doi:10.1038/s41467-023-42975-z · Cited by 30
First Session Adaptation: A Strong Replay-Free Baseline for Class-Incremental Learning
Panos, A., Kobe, Y., Reino, D. O., Aljundi, R., & Turner, R. E. (2023) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.01725 · Cited by 33
Language Guided Fashion Image Manipulation with Feature-wise TransformationsPreprint
Günel, M., Erdem, E., & Erdem, A. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1808.04000 · Cited by 33
Generalized Variational Continual LearningPreprint
Loo, N., Swaroop, S., & Turner, R. E. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2011.12328 · Cited by 31
A Shading-Guided Generative Implicit Model for Shape-Accurate 3D-Aware Image SynthesisPreprint
Pan, X., Xu, X., Loy, C. C., Theobalt, C., & Dai, B. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2110.15678 · Cited by 31
GeneCIS: A Benchmark for General Conditional Image Similarity
Vaze, S., Carion, N., & Misra, I. (2023) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52729.2023.00663 · Cited by 35
Flexible image denoising model with multi-layer conditional feature modulation
Du, J., Qiao, X., Yan, Z., Zhang, H., & Zuo, W. (2024) · Pattern Recognition · doi:10.1016/j.patcog.2024.110372 · Cited by 32
NeuroHeed: Neuro-Steered Speaker Extraction Using EEG Signals
Pan, Z., Borsdorf, M., Cai, S., Schultz, T., & Li, H. (2024) · IEEE/ACM Transactions on Audio Speech and Language Processing · doi:10.1109/taslp.2024.3463498 · Cited by 30
On-the-Fly Modulation for Balanced Multimodal Learning
Wei, Y., Hu, D., Du, H., & Wen, J.-R. (2024) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2024.3468315 · Cited by 30
Wang, S., Chen, Z., Lee, K. A., Qian, Y., & Li, H. (2024) · IEEE/ACM Transactions on Audio Speech and Language Processing · doi:10.1109/taslp.2024.3492793 · Cited by 36
MMAudio: Taming Multimodal Joint Training for High-Quality Video-to-Audio Synthesis
Cheng, H. K., Ishii, M., Hayakawa, A., Shibuya, T., Schwing, A. G., & Mitsufuji, Y. (2025) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52734.2025.02691 · Cited by 95
A multi-agentic framework for real-time, autonomous freeform metasurface design
Lupoiu, R. C., Shao, Y., Dai, T., Mao, C., Edée, K., & Fan, J. A. (2025) · Science Advances · doi:10.1126/sciadv.adx8006 · Cited by 40
Ambient Sound Helps: Audiovisual Crowd Counting in Extreme Conditions
Hu, D., Mou, L., Wang, Q., Gao, J., Hua, Y., Dou, D., & Zhu, X. X. (2020) · elib (German Aerospace Center) · doi:10.48550/arxiv.2005.07097 · Cited by 34
One-Shot Conditional Audio Filtering of Arbitrary Sounds
Gfeller, B., Roblek, D., & Tagliasacchi, M. (2021) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp39728.2021.9414003 · Cited by 30
Progressive Localization Networks for Language-Based Moment Localization
Zheng, Q., Dong, J., Qu, X., Yang, X., Wang, Y., Zhou, P., Liu, B., & Wang, X. (2022) · ACM Transactions on Multimedia Computing Communications and Applications · doi:10.1145/3543857 · Cited by 30
ContraReg: Contrastive Learning of Multi-modality Unsupervised Deformable Image Registration
Dey, N., Schlemper, J., Salehi, S. S. M., Zhou, B., Gerig, G., & Sofka, M. (2022) · Lecture notes in computer science · doi:10.1007/978-3-031-16446-0_7 · Cited by 30
Sem2NeRF: Converting Single-View Semantic Masks to Neural Radiance Fields
Chen, Y., Wu, Q., Zheng, C., Cham, T., & Cai, J. (2022) · Lecture notes in computer science · doi:10.1007/978-3-031-19781-9_42 · Cited by 30
Adapting Self-Supervised Models to Multi-Talker Speech Recognition Using Speaker Embeddings
Huang, Z., Raj, D., Garcia, L. P., & Khudanpur, S. P. (2023) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp49357.2023.10097139 · Cited by 33
Rosenfeld, A., Biparva, M., & Tsotsos, J. K. (2018) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw.2018.00270 · Cited by 29
Cross-modal guiding and reweighting network for multi-modal RSVP-based target detection
Mao, J., Qiu, S., Wei, W., & He, H. (2023) · Neural Networks · doi:10.1016/j.neunet.2023.01.009 · Cited by 29
Self-Supervised Geometry-Aware Encoder for Style-Based 3D GAN Inversion
Lan, Y., Meng, X., Yang, S., Loy, C. C., & Dai, B. (2023) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52729.2023.02006 · Cited by 29
A Multi-Mode Modulator for Multi-Domain Few-Shot Classification
Liu, Y., Lee, J., Zhu, L., Chen, L., Shi, H., & Yang, Y. (2021) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.00834 · Cited by 30
Towards Language-Guided Visual Recognition via Dynamic Convolutions
Luo, G., Zhou, Y., Sun, X., Wu, Y., Gao, Y., & Ji, R. (2023) · International Journal of Computer Vision · doi:10.1007/s11263-023-01871-1 · Cited by 31
Visual Relationship Detection: A Survey
Cheng, J., Wang, L., Wu, J., Hu, X., Jeon, G., Tao, D., & Zhou, M. (2022) · IEEE Transactions on Cybernetics · doi:10.1109/tcyb.2022.3142013 · Cited by 30
Reaungamornrat, S., Sari, H., Catana, C., & Kamen, A. (2022) · Medical Image Analysis · doi:10.1016/j.media.2022.102514 · Cited by 29
Optimizing Reusable Knowledge for Continual Learning via MetalearningPreprint
Hurtado, J., Raymond-Sáez, A., & Soto, Á. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2106.05390 · Cited by 29
Fu, B., Chu, W., Gu, C., & Liu, Y. (2024) · IEEE Journal of Biomedical and Health Informatics · doi:10.1109/jbhi.2024.3419043 · Cited by 28
Learning Joint 2-D and 3-D Graph Diffusion Models for Complete Molecule Generation
Huang, H. K., Sun, L., Du, B., & Lyu, W. (2024) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2024.3416328 · Cited by 69
Feedback Adversarial Learning: Spatial Feedback for Improving Generative Adversarial Networks
Huh, M., Sun, S.-H., & Zhang, N. (2019) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2019.00157 · Cited by 28
AQuA: ASP-Based Visual Question Answering
Basu, K., Shakerin, F., & Gupta, G. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-39197-3_4 · Cited by 28
Fine-Grained Image-to-Image Transformation Towards Visual Recognition
Xiong, W., He, Y., Zhang, Y., Luo, W., Ma, L., & Luo, J. (2020) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr42600.2020.00588 · Cited by 28
Text as Neural Operator:Image Manipulation by Text Instruction
Zhang, T., Tseng, H.-Y., Jiang, L., Yang, W., Lee, H., & Essa, I. A. (2021) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3474085.3475343 · Cited by 29
Squiers, J. J., Thatcher, J. E., Bastawros, D. S., Applewhite, A. J., Baxter, R. D., Yi, F., Quan, P., Yu, S., DiMaio, J. M., & Gable, D. R. (2021) · Journal of Vascular Surgery · doi:10.1016/j.jvs.2021.06.478 · Cited by 29
Multistage linguistic conditioning of convolutional layers for speech emotion recognition
Triantafyllopoulos, A., Reichel, U. D., Liu, S., Huber, S., Eyben, F., & Schuller, B. W. (2023) · Frontiers in Computer Science · doi:10.3389/fcomp.2023.1072479 · Cited by 29
A Semantic Feature-Wise Transformation Relation Network for Automatic Short Answer Grading
Li, Z., Tomar, Y., & Passonneau, R. J. (2021) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2021.emnlp-main.487 · Cited by 31
Gui, D., Chen, K., Ding, H., & Huo, Q. (2023) · Lecture notes in computer science · doi:10.1007/978-3-031-41679-8_20 · Cited by 30
RAVEN: A Dataset for Relational and Analogical Visual rEasoNingPreprint
Zhang, C., Gao, F., Jia, B., Zhu, Y., & Zhu, S. C. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1903.02741 · Cited by 28
XtarNet: Learning to Extract Task-Adaptive Representation for Incremental Few-Shot LearningPreprint
Yoon, S. W., Kim, D.-Y., Seo, J. S., & Moon, J. J. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2003.08561 · Cited by 28
Super-CLEVR: A Virtual Benchmark to Diagnose Domain Robustness in Visual Reasoning
Li, Z., Wong, X., Stengel-Eskin, E., Kortylewski, A., Ma, W., Durme, B. V., & Yuille, A. (2023) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52729.2023.01437 · Cited by 37
Koizumi, Y., Zen, H., Karita, S., Ding, Y., Yatabe, K., Morioka, N., Zhang, Y., Han, W., Bapna, A., & Bacchiani, M. (2023) · IEEE Workshop on Applications of Signal Processing to Audio and Acoustics (WASPAA) · doi:10.1109/waspaa58266.2023.10248089 · Cited by 26
Dance with You: The Diversity Controllable Dancer Generation via Diffusion Models
Yao, S., Sun, M., Li, B., Yang, F., Wang, J., & Zhang, R. (2023) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3581783.3612046 · Cited by 31
Multimodal graph attention network for COVID-19 outcome prediction
Keicher, M., Burwinkel, H., Bani-Harouni, D., Paschali, M., Czempiel, T., Burian, E., Makowski, M. R., Braren, R., Navab, N., & Wendler, T. (2023) · Scientific Reports · doi:10.1038/s41598-023-46625-8 · Cited by 27
Visual Question Answering: A Survey of Methods, Datasets, Evaluation, and Challenges
Kim, B. S., Kim, J., Lee, D., & Jang, B. (2025) · ACM Computing Surveys · doi:10.1145/3728635 · Cited by 38
FigureNet : A Deep Learning model for Question-Answering on Scientific Plots
Reddy, R., Ramesh, R., Deshpande, A., & Khapra, M. M. (2019) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn.2019.8851830 · Cited by 29
Hierarchical Conditional Relation Networks for Multimodal Video Question Answering
Le, T. M., Le, V., Venkatesh, S., & Tran, T. (2021) · International Journal of Computer Vision · doi:10.1007/s11263-021-01514-3 · Cited by 27
Edge-Conditioned Feature Transform Network for Hyperspectral and Multispectral Image Fusion
Zheng, Y., Li, J., Li, Y., Guo, J., Wu, X., Shi, Y., & Chanussot, J. (2021) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2021.3108122 · Cited by 27
Pang, H., Giunchiglia, F., Li, X., Guan, R., & Feng, X. (2022) · International World Wide Web Conference (WWW) · doi:10.1145/3485447.3511963 · Cited by 27
SPACE: Speech-driven Portrait Animation with Controllable Expression
Gururani, S., Mallya, A., Wang, T.-C., Valle, R., & Liu, M.-Y. (2023) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.01912 · Cited by 29
Mao, X., Chen, Y., Li, Y., Xiong, T., He, Y., & Xue, H. (2019) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp.2019.8683008 · Cited by 27
TRRNet: Tiered Relation Reasoning for Compositional Visual Question Answering
Yang, X., Lin, G., Lv, F., & Liu, F. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-58589-1_25 · Cited by 26
DDRprog: A CLEVR Differentiable Dynamic Reasoning ProgrammerPreprint
Suárez, J., Johnson, J., & Fei-Fei, L. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1803.11361 · Cited by 32
Fully Test-time Adaptation by Entropy MinimizationPreprint
Wang, D., Shelhamer, E., Liu, S., Olshausen, B. A., & Darrell, T. (2020) · arXiv (Cornell University) · Cited by 27
FMB: A functional manipulation benchmark for generalizable robotic learning
Luo, J., Xu, C., Liu, F., Tan, L., Lin, Z., Wu, J., Abbeel, P., & Levine, S. (2024) · The International Journal of Robotics Research · doi:10.1177/02783649241276017 · Cited by 68
Exploring Embodied Multimodal Large Models: Development, datasets, and future directions
Chen, S., Wu, Z., Zhang, K., Li, C., Zhang, B., Ma, F., Yu, F. R., & Li, Q. (2025) · Information Fusion · doi:10.1016/j.inffus.2025.103198 · Cited by 39
Visual Reasoning with Multi-hop Feature Modulation
Strub, F., Seurin, M., Perez, E., de Vries, H., Mary, J., Preux, P., Courville, A. C., & Pietquin, O. (2018) · Lecture notes in computer science · doi:10.1007/978-3-030-01228-1_48 · Cited by 25
Self-citationRTFM: Generalising to Novel Environment Dynamics via ReadingPreprint
Zhong, V., Rocktäschel, T., & Grefenstette, E. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1910.08210 · Cited by 57
Visual Tracking by TridentAlign and Context Embedding
Choi, J., Kwon, J., & Lee, K. M. (2021) · Lecture notes in computer science · doi:10.1007/978-3-030-69532-3_31 · Cited by 26
Geometry Sensitive Cross-Modal Reasoning for Composed Query Based Image Retrieval
Zhang, F., Xu, M., & Xu, C. (2021) · IEEE Transactions on Image Processing · doi:10.1109/tip.2021.3138302 · Cited by 26
Li, M., & Moens, M. (2022) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v36i10.21346 · Cited by 29
Actor-critic multi-objective reinforcement learning for non-linear utility functions
Reymond, M., Hayes, C. F., Steckelmacher, D., Roijers, D. M., & Nowé, A. (2023) · Autonomous Agents and Multi-Agent Systems · doi:10.1007/s10458-023-09604-x · Cited by 26
Wybo, W. A. M., Tsai, M. C., Tran, V. A., Illing, B., Jordan, J., Morrison, A., & Senn, W. (2023) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.2300558120 · Cited by 27
Guide Me: Interacting with Deep Networks
Rupprecht, C., Laina, I., Navab, N., Hager, G. D., & Tombari, F. (2018) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2018.00892 · Cited by 26
No Press Diplomacy: Modeling Multi-Agent GameplayPreprint
Paquette, P., Lu, Y., Bocco, S., Smith, M., Ortiz-Gagné, S., Kummerfeld, J. K., Singh, S. P., Pineau, J., & Courville, A. C. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1909.02128 · Cited by 33
Self-citationUnnatural Language Processing: Bridging the Gap Between Synthetic and Natural Language DataPreprint
Marzoev, A., Madden, S. R., Kaashoek, M. F., Cafarella, M., & Andreas, J. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2004.13645 · Cited by 30
Geometry-Consistent Neural Shape Representation with Implicit Displacement FieldsPreprint
Wang, Y., Rahmann, L., & Sorkine‐Hornung, O. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2106.05187 · Cited by 35
Few-Shot Single-View 3-D Object Reconstruction with Compositional Priors
Michalkiewicz, M., Parisot, S., Tsogkas, S., Baktashmotlagh, M., Eriksson, A. P., & Belilovsky, E. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-58595-2_37 · Cited by 26
Can audio-visual integration strengthen robustness under multimodal attacks?
Tian, Y., & Xu, C. (2021) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr46437.2021.00555 · Cited by 25
Feng, X., Chen, C., Li, D., Zhao, M., Hao, J., & Wang, Y.-X. (2021) · ACM International Conference on Information and Knowledge Management (CIKM) · doi:10.1145/3459637.3482241 · Cited by 25
O'Malley, T., Narayanan, A., Wang, Q., Park, A., Walker, J., & Howard, N. (2021) · IEEE Workshop on Automatic Speech Recognition and Understanding (ASRU) · doi:10.1109/asru51503.2021.9687942 · Cited by 25
An Adaptive Graph Pre-training Framework for Localized Collaborative Filtering
Wang, Y., Li, C., Liu, Z., Li, M., Tang, J., Xie, X., Chen, L., & Yu, P. S. (2022) · ACM Transactions on Information Systems · doi:10.1145/3555372 · Cited by 27
Pretrain, Self-train, Distill: A simple recipe for Supersizing 3D Reconstruction
Alwala, K. V., Gupta, A. K., & Tulsiani, S. (2022) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52688.2022.00375 · Cited by 29
Tur, A. O., Dall’Asen, N., Beyan, C., & Ricci, E. (2023) · Lecture notes in computer science · doi:10.1007/978-3-031-43153-1_5 · Cited by 25
Gul, S., & Khan, M. S. (2023) · IEEE Access · doi:10.1109/access.2023.3344813 · Cited by 26
Embodied Multimodal Multitask Learning
Chaplot, D. S., Lee, L., Salakhutdinov, R., Parikh, D., & Batra, D. (2020) · International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2020/338 · Cited by 35
Embedded adaptive cross-modulation neural network for few-shot learning
Wang, P., Cheng, J. S., Hao, F., Wang, L., & Feng, W. (2019) · Neural Computing and Applications · doi:10.1007/s00521-019-04605-y · Cited by 25
Multi-Grained Gradual Inference Model for Multimedia Event Extraction
Liu, Y., Liu, F., Jiao, L., Bao, Q., Sun, L., Li, S., Li, L., & Liu, X. (2024) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2024.3402242 · Cited by 26
When Multitask Learning Meets Partial Supervision: A Computer Vision Review
Fontana, M., Spratling, M., & Shi, M. (2024) · Proceedings of the IEEE · doi:10.1109/jproc.2024.3435012 · Cited by 27
VQA and Visual Reasoning: An overview of approaches, datasets, and future direction
Zakari, R. Y., Owusu, J. W., Qin, K., Wang, H., Lawal, Z. K., & He, T. (2025) · Neurocomputing · doi:10.1016/j.neucom.2025.129345 · Cited by 27
Semantic-Driven Face Hallucination Based on Residual Network
Yu, X., Zhang, L., & Xie, W. C. (2021) · IEEE Transactions on Biometrics Behavior and Identity Science · doi:10.1109/tbiom.2021.3051268 · Cited by 23
Conditional Multi-Task learning for Plant Disease Identification
Lee, S. H., Goëau, H., Bonnet, P., & Joly, A. (2021) · Proceedings - International Conference on Pattern Recognition/Proceedings/International Conference on Pattern Recognition · doi:10.1109/icpr48806.2021.9412643 · Cited by 25
Zhang, K., Wu, Y., Dong, M., Лю, Б., Liu, D., & Liu, Q. (2022) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2022.3198848 · Cited by 25
The Costs and Benefits of Goal-Directed Attention in Deep Convolutional Neural Networks
Luo, X., Roads, B. D., & Love, B. C. (2021) · Computational Brain & Behavior · doi:10.1007/s42113-021-00098-y · Cited by 25
A Survey on Machine Learning from Few SamplesPreprint
Lu, J., Gong, P., Ye, J., Zhang, J., & Zhang, C. (2020) · arXiv (Cornell University) · doi:10.4230/oasics.dx.2025.10 · Cited by 24
From FiLM to Video: Multi-turn Question Answering with Multi-modal ContextPreprint
Nguyen, D. T., Sharma, S., Schulz, H., & Asri, L. E. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1812.07023 · Cited by 30
Dynamic Spatio-Temporal Graph Reasoning for VideoQA With Self-Supervised Event Recognition
Nie, J., Wang, X. Y., Hou, R., Li, G., Chen, H., & Zhu, W. (2024) · IEEE Transactions on Image Processing · doi:10.1109/tip.2024.3411448 · Cited by 27
WCG-VMamba: A multi-modal classification model for corn disease
Wang, H., He, M.-F., Zhu, M., & Liu, G.-H. (2025) · Computers and Electronics in Agriculture · doi:10.1016/j.compag.2024.109835 · Cited by 24
Behrendt, F., Bhattacharya, D., Mieling, R., Maack, L., Krüger, J., Opfer, R., & Schlaefer, A. (2025) · Computers in Biology and Medicine · doi:10.1016/j.compbiomed.2025.109660 · Cited by 31
Motion Planning Diffusion: Learning and Adapting Robot Motion Planning With Diffusion Models
Carvalho, J., Le, A. T., Kicki, P., Koert, D., & Peters, J. (2025) · IEEE Transactions on Robotics · doi:10.1109/tro.2025.3593109 · Cited by 44
Broadcasting Convolutional Network for Visual Relational Reasoning
Chang, S., Yang, J., Park, S., & Kwak, N. (2018) · Lecture notes in computer science · doi:10.1007/978-3-030-01267-0_46 · Cited by 22
A text-based visual context modulation neural model for multimodal machine translation
Kwon, S., Go, B.-H., & Lee, J.-H. (2020) · Pattern Recognition Letters · doi:10.1016/j.patrec.2020.06.010 · Cited by 23
A Competence-Aware Curriculum for Visual Concepts Learning via Question Answering
Li, Q., Huang, S., Hong, Y., & Zhu, S. C. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-58536-5_9 · Cited by 25
HIGhER: Improving instruction following with Hindsight Generation for Experience Replay
Cideron, G., Seurin, M., Strub, F., & Pietquin, O. (2020) · IEEE Symposium Series on Computational Intelligence (SSCI) · doi:10.1109/ssci47803.2020.9308603 · Cited by 24
Self-citationAIFS-DATASET for Few-Shot Aerial Image Scene Classification
Li, L., Yao, X., Cheng, G., & Han, J. (2022) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2022.3149507 · Cited by 23
Rethinking and Improving Feature Pyramids for One-Stage Referring Expression Comprehension
Suo, W., Sun, M., Wang, P., Zhang, Y., & Wu, Q. (2022) · IEEE Transactions on Image Processing · doi:10.1109/tip.2022.3227466 · Cited by 23
FS-BAN: Born-Again Networks for Domain Generalization Few-Shot Classification
Zhao, Y., & Cheung, N. M. (2023) · IEEE Transactions on Image Processing · doi:10.1109/tip.2023.3266172 · Cited by 24
Ding, H., Luan, B., Gui, D., Chen, K., & Huo, Q. (2023) · Lecture notes in computer science · doi:10.1007/978-3-031-41685-9_2 · Cited by 23
Go with the Flows: Mixtures of Normalizing Flows for Point Cloud Generation and Reconstruction
Postels, J., Liu, M., Spezialetti, R., Gool, L. V., & Tombari, F. (2021) · International Conference on 3D Vision (3DV) · doi:10.1109/3dv53792.2021.00132 · Cited by 25
Metadata
- Authors
- Perez, E., Strub, F., De Vries, H., Dumoulin, V., & Courville, A.
- Affiliations
- Université de Montréal (CA)
- Centre National de la Recherche Scientifique (FR)
- Mila - Quebec Artificial Intelligence Institute (CA)
- Venue
- Proceedings of the AAAI Conference on Artificial Intelligence
- Published
- 2018-04-29
- Volume
- 32
- Issue
- 1
- ISSN
- 2159-5399 (ISSN-L)
- 2374-3468
- OpenAlex
- W2760103357
- Cited by
- 2,490
- References
- 55
- Citations by year
- 2026: 823 · 2025: 412 · 2024: 280 · 2023: 221 · 2022: 158 · 2021: 244 · 2020: 179 · 2019: 120 · 2018: 52
- FWCI
- 44.92
- Type
- conference paper
- Language
- en
- Open access
- diamond
- doi.org
- Locations
- Proceedings of the AAAI Conference on Artificial Intelligence (publishedVersion)
- arXiv (Cornell University) (submittedVersion)
- AAAI Publications (The Association for the Advancement of Artificial Intelligence (AAAI)) (submittedVersion)
- Funders
- Nvidia
- Fonds de recherche du Québec – Nature et technologies
- CHIST-ERA
- Topics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Multimodal Machine Learning Applications
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Neural Network Applications
- Physical Sciences › Computer Science › Artificial Intelligence › Domain Adaptation and Few-Shot Learning
- Keywords
- cinema, feature-wise linear modulation, visual reasoning, visual question answering, feature modulation, zero-shot generalization, few-shot learning
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review