Film: Visual reasoning with a general conditioning layer
Open accessAbstract
We introduce a general-purpose conditioning method for neural networks called FiLM: Feature-wise Linear Modulation. FiLM layers influence neural network computation via a simple, feature-wise affine transformation based on conditioning information. We show that FiLM layers are highly effective for visual reasoning - answering image-related questions which require a multi-step, high-level process - a task which has proven difficult for standard deep learning methods that do not explicitly model reasoning. Specifically, we show on visual reasoning tasks that FiLM layers 1) halve state-of-the-art error for the CLEVR benchmark, 2) modulate features in a coherent manner, 3) are robust to ablations and architectural modifications, and 4) generalize well to challenging, new data from few examples or even zero-shot.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The original FILM layer uses multiple non-linear layers instead of a single linear transformation in MI-VECTOR, which has been shown to improve performance.
“While MI-VECTOR (i.e., diagonal parameters in a MI layer which results in a vector output) corresponds to the most basic implementation of FILM, the original FILM layer uses multiple non-linear layers instead of a single linear transformation in MI-VECTOR which has been shown to improve performance [120].”
From MultiBench: Multiscale Benchmarks for Multimodal Representation Learning (2021) · cites this paper as [120]
Section 2.2 (p. 2) says the model predicts its conditioning parameters from the question embedding by linear projection with a weight matrix and bias, contrary to the claim that it uses multiple nonlinear layers instead of a single linear transformation. The cited passages do not report a performance improvement from making that substitution. (LLM, conf=0.87)
Checked by a reasoning model — may be wrong.
Experimental — accuracy not yet measuredBy appropriately constraining the rank and structure of MI parameters, MI recovers HyperNetworks, FiLM, and Sigmoid units.
“By appropriately constraining the rank and structure of these parameters, MI recovers HyperNetworks [61] (unconstrained parameters resulting in a matrix output), Feature-wise linear modulation (FiLM) [120, 188] (diagonal parameters resulting in vector output), and Sigmoid units [37] (scalar parameters resulting in scalar output).”
From MultiBench: Multiscale Benchmarks for Multimodal Representation Learning (2021) · cites this paper as [120]
The Related Work section (p. 4) describes feature-wise affine conditioning through scaling and shifting, which supports the feature-wise modulation aspect of the cited FiLM example. Our copy does not state that constraining MI parameters to a diagonal form recovers FiLM or yields a vector output. (LLM, conf=0.76)
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474 · see citing works
Hochreiter, S., & Schmidhuber, J. (1997) · Neural Computation · doi:10.1162/neco.1997.9.8.1735 · Cited by 102,318 · see citing works
Adam: A Method for Stochastic Optimization
Kingma, D. P., & Ba, J. (2014) · arXiv · doi:10.48550/arxiv.1412.6980 · Cited by 98,946 · see citing works
ImageNet Large Scale Visual Recognition Challenge
Russakovsky, O., Deng, J., Su, H., Krause, J., Satheesh, S., Ma, S., Huang, Z., Karpathy, A., Khosla, A., Bernstein, M., et al. (2015) · International Journal of Computer Vision · doi:10.1007/s11263-015-0816-y · Cited by 39,380 · see citing works
Squeeze-and-Excitation NetworksPreprint
Hu, J., Shen, L., & Sun, G. (2017) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.48550/arxiv.1709.01507 · Cited by 37,845 · see citing works
Squeeze-and-Excitation Networks
Hu, J., Shen, L., & Sun, G. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00745 · Cited by 35,667 · see citing works
(2008) · Journal of Machine Learning Research · Cited by 33,051 · see citing works
Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift
Ioffe, S., & Szegedy, C. (2015) · arXiv · doi:10.48550/arxiv.1502.03167 · Cited by 27,818 · see citing works
Distributed Representations of Words and Phrases and their Compositionality
Mikolov, T., Sutskever, I., Chen, K., Corrado, G., & Dean, J. (2013) · arXiv · doi:10.48550/arxiv.1310.4546 · Cited by 24,533 · see citing works
Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate ShiftPreprint
Ioffe, S. (2024) · arXiv (Cornell University) · doi:10.57702/o9raffed · Cited by 15,273 · see citing works
Unsupervised representation learning with deep convolutional generative adversarial networks
Radford, A., Metz, L., & Chintala, S. (2015) · arXiv · doi:10.48550/arxiv.1511.06434 · Cited by 12,235 · see citing works
Empirical Evaluation of Gated Recurrent Neural Networks on Sequence Modeling
Chung, J., Gulcehre, C., Cho, K., & Bengio, Y. (2014) · arXiv · doi:10.48550/arxiv.1412.3555 · Cited by 11,008 · see citing works
Overcoming catastrophic forgetting in neural networks
Kirkpatrick, J., Pascanu, R., Rabinowitz, N., Veness, J., Desjardins, G., Rusu, A. A., Milan, K., Quan, J., Ramalho, T., Grabska-Barwinska, A., et al. (2017) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1611835114 · Cited by 7,899 · see citing works
(2013) · Cited by 5,726 · see citing works
FiLM: Visual Reasoning with a General Conditioning LayerPreprint
Perez, E., Strub, F., de Vries, H., Dumoulin, V., & Courville, A. C. (2017) · AAAI Conference on Artificial Intelligence · doi:10.48550/arxiv.1709.07871 · Cited by 5,313 · see citing works
Self-citationArbitrary Style Transfer in Real-Time with Adaptive Instance Normalization
Huang, X., & Belongie, S. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.167 · Cited by 5,076 · see citing works
WaveNet: a generative model for raw audio
Oord, A. V. D., Dieleman, S., Zen, H., Simonyan, K., Vinyals, O., Graves, A., Kalchbrenner, N., Senior, A., & Kavukcuoglu, K. (2016) · arXiv · doi:10.48550/arxiv.1609.03499 · Cited by 4,911 · see citing works
VQA: Visual Question Answering
Antol, S., Agrawal, A., Lu, J., Mitchell, M., Batra, D., Zitnick, C. L., & Parikh, D. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.279 · Cited by 4,487 · see citing works
Learning Phrase Representations using RNN Encoder-Decoder for Statistical Machine Translation
Cho, K., van Merrienboer, B., Gulcehre, C., Bahdanau, D., Bougares, F., Schwenk, H., & Bengio, Y. (2014) · arXiv · doi:10.48550/arxiv.1406.1078 · Cited by 3,317 · see citing works
Conditional Image Generation with PixelCNN DecodersPreprint
van den Oord, A., Kalchbrenner, N., Vinyals, O., Espeholt, L., Graves, A., & Kavukcuoglu, K. (2016) · Neural Information Processing Systems · doi:10.48550/arxiv.1606.05328 · Cited by 3,066 · see citing works
Convolutional Sequence to Sequence Learning
Gehring, J., Auli, M., Grangier, D., Yarats, D., & Dauphin, Y. N. (2017) · arXiv · doi:10.48550/arxiv.1705.03122 · Cited by 2,850 · see citing works
Hierarchical Mixtures of Experts and the EM Algorithm
Jordan, M. I., & Jacobs, R. A. (1994) · Neural Computation · doi:10.1162/neco.1994.6.2.181 · Cited by 2,730 · see citing works
Making the V in VQA Matter: Elevating the Role of Image Understanding in Visual Question Answering
Goyal, Y., Khot, T., Summers-Stay, D., Batra, D., & Parikh, D. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.670 · Cited by 2,287 · see citing works
Stacked Attention Networks for Image Question Answering
Yang, Z., He, X., Gao, J., Deng, L., & Smola, A. J. (2016) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2016.10 · Cited by 2,036 · see citing works
CLEVR: A Diagnostic Dataset for Compositional Language and Elementary Visual Reasoning
Johnson, J., Hariharan, B., van der Maaten, L., Fei-Fei, L., Zitnick, C. L., & Girshick, R. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.215 · Cited by 1,781 · see citing works
Hierarchical Question-Image Co-Attention for Visual Question AnsweringPreprint
Lu, J., Yang, J., Batra, D., & Parikh, D. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1606.00061 · Cited by 1,303 · see citing works
A simple neural network module for relational reasoning
Santoro, A., Raposo, D., Barrett, D. G. T., Malinowski, M., Pascanu, R., Battaglia, P., & Lillicrap, T. (2017) · arXiv · doi:10.48550/arxiv.1706.01427 · Cited by 1,281 · see citing works
A Learned Representation For Artistic StylePreprint
Dumoulin, V., Shlens, J., & Kudlur, M. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1610.07629 · Cited by 1,033 · see citing works
Self-citationVQA: Visual Question AnsweringPreprint
Agrawal, A., Lu, J., Antol, S., Mitchell, M., Zitnick, C. L., Batra, D., & Parikh, D. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1505.00468 · Cited by 968 · see citing works
Andreas, J., Rohrbach, M., Darrell, T., & Klein, D. (2016) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2016.12 · Cited by 933 · see citing works
Outrageously Large Neural Networks: The Sparsely-Gated Mixture-of-Experts Layer
Shazeer, N., Mirhoseini, A., Maziarz, K., Davis, A., Le, Q., Hinton, G., & Dean, J. (2017) · arXiv · doi:10.48550/arxiv.1701.06538 · Cited by 933 · see citing works
Ask Your Neurons: A Neural-Based Approach to Answering Questions about Images
Malinowski, M., Rohrbach, M., & Fritz, M. (2015) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.9 · Cited by 633 · see citing works
Learning to Reason: End-to-End Module Networks for Visual Question Answering
Hu, R., Andreas, J., Rohrbach, M., Darrell, T., & Saenko, K. (2017) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.93 · Cited by 523 · see citing works
Inferring and Executing Programs for Visual Reasoning
Johnson, J., Hariharan, B., van der Maaten, L., Hoffman, J., Fei-Fei, L., Zitnick, C. L., & Girshick, R. (2017) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.325 · Cited by 487 · see citing works
Making the V in VQA Matter: Elevating the Role of Image Understanding in Visual Question Answering
Goyal, Y., Khot, T., Agrawal, A., Summers-Stay, D., Batra, D., & Parikh, D. (2019) · International Journal of Computer Vision · doi:10.1007/s11263-018-1116-0 · Cited by 487 · see citing works
Learning to Compose Neural Networks for Question Answering
Andreas, J., Rohrbach, M., Darrell, T., & Klein, D. (2016) · Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT) · doi:10.18653/v1/n16-1181 · Cited by 450 · see citing works
A Multi-World Approach to Question Answering about Real-World Scenes based on Uncertain InputPreprint
Malinowski, M., & Fritz, M. (2014) · arXiv (Cornell University) · doi:10.48550/arxiv.1410.0210 · Cited by 432 · see citing works
GuessWhat?! Visual Object Discovery through Multi-modal Dialogue
de Vries, H., Strub, F., Chandar, S., Pietquin, O., Larochelle, H., & Courville, A. C. (2017) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2017.475 · Cited by 378 · see citing works
Self-citationModulating early visual processing by languagePreprint
de Vries, H., Strub, F., Mary, J., Larochelle, H., Pietquin, O., & Courville, A. C. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1707.00683 · Cited by 368 · see citing works
Self-citationVisual Turing test for computer vision systems
Geman, D., Geman, S., Hallonquist, N., & Laurent Younes, B. (2015) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1422953112 · Cited by 323 · see citing works
Traversing Knowledge Graphs in Vector Space
Guu, K., Miller, J., & Liang, P. (2015) · Proceedings of the 2015 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d15-1038 · Cited by 319 · see citing works
Exploring the structure of a real-time, arbitrary neural artistic stylization network
Ghiasi, G., Lee, H., Kudlur, M., Dumoulin, V., & Shlens, J. (2017) · Procedings of the British Machine Vision Conference 2017 · doi:10.5244/c.31.114 · Cited by 306 · see citing works
Self-citationZero-Shot Task Generalization with Multi-Task Deep Reinforcement LearningPreprint
Oh, J., Singh, S., Lee, H., & Kohli, P. (2017) · International Conference on Machine Learning · doi:10.48550/arxiv.1706.05064 · Cited by 292 · see citing works
Bottom-Up and Top-Down Attention for Image Captioning and VQA.Preprint
Anderson, P., He, X., Buehler, C., Teney, D., Johnson, M., Gould, S. J., & Zhang, L. (2017) · arXiv (Cornell University) · Cited by 252 · see citing works
Parallel Multiscale Autoregressive Density EstimationPreprint
Reed, S. E., van den Oord, A., Kalchbrenner, N., Colmenarejo, S. G., Wang, Z.-Y., Chen, Y., Belov, D., & de Freitas, N. (2017) · International Conference on Machine Learning · doi:10.48550/arxiv.1703.03664 · Cited by 223 · see citing works
Arbitrary Style Transfer in Real-time with Adaptive Instance NormalizationPreprint
Huang, X., & Belongie, S. (2017) · arXiv (Cornell University) · Cited by 205 · see citing works
Learning Factored Representations in a Deep Mixture of ExpertsPreprint
Eigen, D., Ranzato, M., & Sutskever, I. (2013) · arXiv (Cornell University) · doi:10.48550/arxiv.1312.4314 · Cited by 134 · see citing works
Learning to Reason: End-to-End Module Networks for Visual Question AnsweringPreprint
Hu, R., Andreas, J., Rohrbach, M., et al. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1704.05526 · Cited by 109 · see citing works
Learning to Compose Neural Networks for Question AnsweringPreprint
Andreas, J., Rohrbach, M., Darrell, T., & Klein, D. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1601.01705 · Cited by 100 · see citing works
Dynamic Layer Normalization for Adaptive Neural Acoustic Modeling in Speech Recognition
Kim, T., Song, I., & Bengio, Y. (2017) · Interspeech (USB) · doi:10.21437/interspeech.2017-556 · Cited by 73 · see citing works
Visual Interaction NetworksPreprint
Watters, N., Tacchetti, A., Weber, T., Pascanu, R., Battaglia, P., & Zoran, D. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1706.01433 · Cited by 59 · see citing works
Learning Visual Reasoning Without Strong Priors
Perez, E., de Vries, H., Strub, F., Dumoulin, V., & Courville, A. C. (2017) · HAL · doi:10.48550/arxiv.1707.03017 · Cited by 28 · see citing works
Self-citationHierarchical Mixtures of Experts and the EM Algorithm
Jordan, M. I., & Jacobs, R. A. (2001) · The MIT Press eBooks · doi:10.7551/mitpress/3349.003.0014 · Cited by 10 · see citing works
Inferring and Executing Programs for Visual Reasoning
Johnson, J., Hariharan, B., van der Maaten, L., Hoffman, J., Fei-Fei, L., Zitnick, C. L., & Girshick, R. (2017) · arXiv · doi:10.48550/arxiv.1705.03633
Exploring the structure of a real-time, arbitrary neural artistic stylization network
Ghiasi, G., Lee, H., Kudlur, M., Dumoulin, V., & Shlens, J. (2017) · arXiv · doi:10.48550/arxiv.1705.06830
Self-citation
Flagged first, then by citations
Research works printed but not linked: 3
- [1][1] A. Krizhevsky, I. Sutskever, and G. E. Hinton, 'Imagenet classification with deep convolutional neural networks,' in Proc. of NIPS , 2012. -
- [4][4] I. Sutskever, O. Vinyals, and Q. V. Le, 'Sequence to sequence learning with neural networks,' in Proc. of NIPS , 2014. -
- [33][33] S. Reed, A. van den Oord, N. Kalchbrenner, V. Bapst, M. Botvinick, and N. de Freitas, 'Generating interpretable images with controllable structure,' in Proc. of ICLR , 2017.
Cited by
Sorted by citations
Large Scale GAN Training for High Fidelity Natural Image Synthesis
Brock, A., Donahue, J., & Simonyan, K. (2018) · arXiv · doi:10.48550/arxiv.1809.11096 · Cited by 3,717 · see citing works
Grandmaster level in StarCraft II using multi-agent reinforcement learning
Vinyals, O., Babuschkin, I., Czarnecki, W. M., Mathieu, M., Dudzik, A., Chung, J., Choi, D. H., Powell, R., Ewalds, T., Georgiev, P., et al. (2019) · Nature · doi:10.1038/s41586-019-1724-z · Cited by 3,455 · see citing works
Diffusion Models Beat GANs on Image Synthesis
Dhariwal, P., & Nichol, A. (2021) · arXiv · doi:10.48550/arxiv.2105.05233 · Cited by 3,362 · see citing works
LXMERT: Learning Cross-Modality Encoder Representations from Transformers
Tan, H., & Bansal, M. (2019) · Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP) · doi:10.18653/v1/d19-1514 · Cited by 2,319 · see citing works
Scalable Diffusion Models with Transformers
Peebles, W., & Xie, S. (2023) · 2023 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.00387 · Cited by 2,284 · see citing works
Parameter-efficient transfer learning for NLP
Houlsby, N., Giurgiu, A., Jastrzebski, S., Morrone, B., de Laroussilhe, Q., Gesmundo, A., Attariyan, M., & Gelly, S. (2019) · arXiv · doi:10.48550/arxiv.1902.00751 · Cited by 2,270 · see citing works
Image Super-Resolution Via Iterative Refinement
Saharia, C., Ho, J., Chan, W., Salimans, T., Fleet, D. J., & Norouzi, M. (2022) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2022.3204461 · Cited by 1,829 · see citing works
Rethinking Spatiotemporal Feature Learning: Speed-Accuracy Trade-offs in Video Classification
Xie, S., Sun, C., Huang, J., Tu, Z., & Murphy, K. P. (2018) · Lecture notes in computer science · doi:10.1007/978-3-030-01267-0_19 · Cited by 1,494 · see citing works
Lin, T., Wang, Y., Liu, X., & Qiu, X. (2022) · AI Open · doi:10.1016/j.aiopen.2022.10.001 · Cited by 1,422 · see citing works
Meta-Transfer Learning for Few-Shot Learning
Sun, Q., Liu, Y., Chua, T., & Schiele, B. (2019) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2019.00049 · Cited by 1,366 · see citing works
Recovering Realistic Texture in Image Super-Resolution by Deep Spatial Feature Transform
Wang, X., Yu, K., Dong, C., & Loy, C. C. (2018) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2018.00070 · Cited by 1,217 · see citing works
Parameter-efficient fine-tuning of large-scale pre-trained language models
Ding, N., Qin, Y., Yang, G., Wei, F., Yang, Z., Su, Y., Hu, S., Chen, Y., Chan, C.-M., Chen, W., et al. (2023) · Nature Machine Intelligence · doi:10.1038/s42256-023-00626-4 · Cited by 1,191 · see citing works
A Comprehensive Survey of Continual Learning: Theory, Method and Application
Wang, L., Zhang, X., Su, H., & Zhu, J. (2024) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2024.3367329 · Cited by 1,113 · see citing works
TADAM: Task dependent adaptive metric for improved few-shot learningPreprint
Oreshkin, B. N., Rodríguez, P., & Lacoste, A. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1805.10123 · Cited by 1,094 · see citing works
ViLT: Vision-and-Language Transformer Without Convolution or Region Supervision
Kim, W., Son, B., & Kim, I. (2021) · arXiv · doi:10.48550/arxiv.2102.03334 · Cited by 951 · see citing works
Dynamic Neural Networks: A Survey
Han, Y., Huang, G., Song, S., Yang, L., Wang, H., & Wang, Y. (2022) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2021.3117837 · Cited by 848 · see citing works
Conditional Convolutions for Instance Segmentation
Tian, Z., Shen, C., & Chen, H. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-58452-8_17 · Cited by 783 · see citing works
MDETR - Modulated Detection for End-to-End Multi-Modal Understanding
Kamath, A., Singh, M., LeCun, Y., Synnaeve, G., Misra, I., & Carion, N. (2021) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.00180 · Cited by 761 · see citing works
pi-GAN: Periodic Implicit Generative Adversarial Networks for 3D-Aware Image Synthesis
Chan, E. R., Monteiro, M., Kellnhofer, P., Wu, J., & Wetzstein, G. (2021) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr46437.2021.00574 · Cited by 697 · see citing works
MAXIM: Multi-Axis MLP for Image Processing
Tu, Z., Talebi, H., Zhang, H., Yang, F., Milanfar, P., Bovik, A. C., & Li, Y. (2022) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52688.2022.00568 · Cited by 659 · see citing works
(2022) · doi:10.15607/rss.2023.xix.025 · Cited by 916 · see citing works
SoundStream: An End-to-End Neural Audio Codec
Zeghidour, N., Luebs, A., Omran, A., Skoglund, J., & Tagliasacchi, M. (2021) · IEEE/ACM Transactions on Audio Speech and Language Processing · doi:10.1109/taslp.2021.3129994 · Cited by 637 · see citing works
Diffusion policy: Visuomotor policy learning via action diffusion
Chi, C., Xu, Z., Feng, S., Cousineau, E., Du, Y., Burchfiel, B., Tedrake, R., & Song, S. (2025) · The International Journal of Robotics Research · doi:10.1177/02783649241273668 · Cited by 613 · see citing works
“b) In the CNN-based Diffusion Policy, FiLM (Feature-wise Linear Modulation) [35] conditioning of the observation feature Ot is applied to every convolution layer, channel-wise.”
MethodInfluentialDiffusion Policy: Visuomotor Policy Learning via Action Diffusion
Chi, C., Feng, S., Du, Y., Xu, Z., Cousineau, E., Burchfiel, B., & Song, S. (2023) · Robotics: Science and Systems XIX · doi:10.15607/rss.2023.xix.026 · Cited by 530 · see citing works
Multimodal intelligence: Representation learning, information fusion, and applications
Zhang, C., Yang, Z., He, X., & Deng, L. (2020) · IEEE Journal of Selected Topics in Signal Processing · doi:10.1109/jstsp.2020.2987728 · Cited by 511 · see citing works
Tent: Fully Test-time Adaptation by Entropy MinimizationPreprint
Wang, D., Shelhamer, E., Liu, S., Olshausen, B. A., & Darrell, T. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2006.10726 · Cited by 648 · see citing works
A Corpus for Reasoning about Natural Language Grounded in Photographs
Suhr, A., Zhou, S., Zhang, A. Q., Zhang, I., Bai, H., & Artzi, Y. (2019) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/p19-1644 · Cited by 487 · see citing works
Mao, J., Gan, C., Kohli, P., Tenenbaum, J. B., & Wu, J. (2019) · arXiv · doi:10.48550/arxiv.1904.12584 · Cited by 444 · see citing works
Multi-Task Learning with Deep Neural Networks: A Survey
Crawshaw, M. (2020) · arXiv · doi:10.48550/arxiv.2009.09796 · Cited by 428 · see citing works
Composing Text and Image for Image Retrieval - an Empirical Odyssey
Vo, N., Jiang, L., Sun, C., Murphy, K. P., Li, L.-J., Fei-Fei, L., & Hays, J. H. (2019) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2019.00660 · Cited by 411 · see citing works
C2AE: Class Conditioned Auto-Encoder for Open-Set Recognition
Oza, P., & Patel, V. M. (2019) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2019.00241 · Cited by 407 · see citing works
Slimmable Neural NetworksPreprint
Yu, J., Yang, L., Xu, N., Yang, J., & Huang, T. S. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1812.08928 · Cited by 403 · see citing works
Neural-Symbolic VQA: Disentangling Reasoning from Vision and Language UnderstandingPreprint
Yi, K., Wu, J., Gan, C., Torralba, A. B., Kohli, P., & Tenenbaum, J. B. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1810.02338 · Cited by 388 · see citing works
In Defense of Grid Features for Visual Question Answering
Jiang, H., Misra, I., Rohrbach, M., Miller, E. G., & Chen, X. (2020) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr42600.2020.01028 · Cited by 379 · see citing works
DyTox: Transformers for Continual Learning with DYnamic TOken eXpansion
Douillard, A., Ramé, A., Couairon, G., & Cord, M. (2022) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52688.2022.00907 · Cited by 379 · see citing works
Balanced Multimodal Learning via On-the-fly Gradient Modulation
Peng, X., Wei, Y., Deng, A., Wang, D., & Hu, D. (2022) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52688.2022.00806 · Cited by 374 · see citing works
Tewari, A., Thies, J., Mildenhall, B., Srinivasan, P. P., Tretschk, E., Yifan, W., Lassner, C., Sitzmann, V., Martin-Brualla, R., Lombardi, S., et al. (2022) · Computer Graphics Forum · doi:10.1111/cgf.14507 · Cited by 366 · see citing works
Attentional ShapeContextNet for Point Cloud Recognition
Xie, S., Liu, S., Chen, Z., & Tu, Z. (2018) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2018.00484 · Cited by 362 · see citing works
Augmented CycleGAN: Learning Many-to-Many Mappings from Unpaired DataPreprint
Almahairi, A., Rajeswar, S., Sordoni, A., Bachman, P., & Courville, A. C. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1802.10151 · Cited by 356 · see citing works
Self-citationCompositional Attention Networks for Machine ReasoningPreprint
Hudson, D. A., & Manning, C. D. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1803.03067 · Cited by 341 · see citing works
DF-GAN: A Simple and Effective Baseline for Text-to-Image Synthesis
Tao, M., Tang, H., Wu, F., Jing, X., Bao, B., & Xu, C. (2022) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52688.2022.01602 · Cited by 399 · see citing works
MUREL: Multimodal Relational Reasoning for Visual Question Answering
Cadene, R., Ben-younes, H., Cord, M., & Thome, N. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00209 · Cited by 330 · see citing works
Mnemonics Training: Multi-Class Incremental Learning Without Forgetting
Liu, Y., Su, Y., Liu, A.-A., Schiele, B., & Sun, Q. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.01226 · Cited by 309 · see citing works
ImVoteNet: Boosting 3D Object Detection in Point Clouds With Image Votes
Qi, C. R., Chen, X., Litany, O., & Guibas, L. J. (2020) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr42600.2020.00446 · Cited by 296 · see citing works
ManiGAN: Text-Guided Image Manipulation
Li, B., Qi, X., Lukasiewicz, T., & Torr, P. H. S. (2020) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr42600.2020.00790 · Cited by 287 · see citing works
Mnemonics Training: Multi-Class Incremental Learning Without Forgetting
LIU, Y., SU, Y., LIU, A.-A., Schiele, B., & SUN, Q. (2020) · Singapore Management University Institutional Knowledge (InK) (Singapore Management University) · Cited by 278 · see citing works
Hierarchical motor control in mammals and machines
Merel, J., Botvinick, M., & Wayne, G. (2019) · Nature Communications · doi:10.1038/s41467-019-13239-6 · Cited by 274 · see citing works
Improving One-Stage Visual Grounding by Recursive Sub-query Construction
Yang, Z., Chen, T., Wang, L., & Luo, J. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-58568-6_23 · Cited by 270 · see citing works
Learn to Match: Automatic Matching Network Design for Visual Tracking
Zhang, Z., Liu, Y., Wang, X., Li, B., & Hu, W. (2021) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.01309 · Cited by 269 · see citing works
Wavesplit: End-to-End Speech Separation by Speaker Clustering
Zeghidour, N., & Grangier, D. (2021) · IEEE/ACM Transactions on Audio Speech and Language Processing · doi:10.1109/taslp.2021.3099291 · Cited by 268 · see citing works
Harvey, F. G., Yurick, M., Nowrouzezahrai, D., & Pal, C. (2020) · ACM Transactions on Graphics · doi:10.1145/3386569.3392480 · Cited by 269 · see citing works
EDGE: Editable Dance Generation From Music
Tseng, J., Castellon, R., & Liu, C. K. (2023) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52729.2023.00051 · Cited by 275 · see citing works
Hierarchical Conditional Relation Networks for Video Question Answering
Le, T. M., Le, V., Venkatesh, S., & Tran, T. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00999 · Cited by 260 · see citing works
Deep learning for twelve hour precipitation forecasts
Espeholt, L., Agrawal, S., Sønderby, C. K., Kumar, M., Heek, J., Bromberg, C., Gazen, C., Carver, R. W., Andrychowicz, M., Hickey, J. J., et al. (2022) · Nature Communications · doi:10.1038/s41467-022-32483-x · Cited by 258 · see citing works
CLEVRER: CoLlision Events for Video REpresentation and ReasoningPreprint
Yi, K., Gan, C., Li, Y., Kohli, P., Wu, J., Torralba, A. B., & Tenenbaum, J. B. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1910.01442 · Cited by 283 · see citing works
CrossTransformers: spatially-aware few-shot transferPreprint
Doersch, C., Gupta, A., & Zisserman, A. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2007.11498 · Cited by 255 · see citing works
Improved Few-Shot Visual Classification
Bateni, P., Goyal, R., Masrani, V., Wood, F., & Sigal, L. (2020) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr42600.2020.01450 · Cited by 248 · see citing works
BatchEnsemble: An Alternative Approach to Efficient Ensemble and Lifelong LearningPreprint
Wen, Y., Tran, D., & Ba, J. L. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2002.06715 · Cited by 271 · see citing works
Image Retrieval on Real-life Images with Pre-trained Vision-and-Language Models
Liu, Z., Rodriguez-Opazo, C., Teney, D., & Gould, S. (2021) · 2021 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.00213 · Cited by 238 · see citing works
Explainable and Explicit Visual Reasoning Over Scene Graphs
Shi, J., Zhang, H., & Li, J. (2019) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2019.00857 · Cited by 234 · see citing works
Fast Context Adaptation via Meta-LearningPreprint
Zintgraf, L., Shiarlis, K., Kurin, V., Hofmann, K., & Whiteson, S. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1810.03642 · Cited by 234 · see citing works
Deep multimodal fusion of image and non-image data in disease diagnosis and prognosis: a review
Cui, C., Yang, H., Wang, Y., Zhao, S., Asad, Z., Coburn, L. A., Wilson, K. T., Landman, B. A., & Huo, Y. (2023) · Progress in Biomedical Engineering · doi:10.1088/2516-1091/acc2fe · Cited by 239 · see citing works
O’Neill, A., Rehman, A., Maddukuri, A., Gupta, A., Padalkar, A., Lee, A., Pooley, A., Gupta, A., Mandlekar, A., Jain, A., et al. (2024) · 2024 IEEE International Conference on Robotics and Automation (ICRA) · doi:10.1109/icra57147.2024.10611477 · Cited by 210 · see citing works
LXMERT: Learning Cross-Modality Encoder Representations from TransformersPreprint
Tan, H. X., & Bansal, M. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1908.07490 · Cited by 433 · see citing works
Zhao, H., Gan, C., Ma, W.-C., & Torralba, A. B. (2019) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00182 · Cited by 218 · see citing works
Long-Term Cloth-Changing Person Re-identification
Qian, X., Wang, W., Zhang, L., Zhu, F., Fu, Y., Xiang, T., Jiang, Y., & Xue, X. (2021) · Lecture notes in computer science · doi:10.1007/978-3-030-69535-4_5 · Cited by 224 · see citing works
Explainable AI for clinical and remote health applications: A survey on tabular and time series data
Di Martino, F., & Delmastro, F. (2023) · Artificial Intelligence Review · doi:10.1007/s10462-022-10304-3 · Cited by 216 · see citing works
Rethinking Spatiotemporal Feature Learning For Video Understanding.
Xie, S., Sun, C., Huang, J., Tu, Z., & Murphy, K. P. (2017) · Cited by 205 · see citing works
Attention-based deep meta-transfer learning for few-shot fine-grained fault diagnosis
Li, C., Li, S., Wang, H., Gu, F., & Ball, A. D. (2023) · Knowledge-Based Systems · doi:10.1016/j.knosys.2023.110345 · Cited by 211 · see citing works
TapNet: Neural Network Augmented with Task-Adaptive Projection for Few-Shot LearningPreprint
Yoon, S. W., Seo, J. S., & Moon, J. J. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1905.06549 · Cited by 208 · see citing works
Attentive Single-Tasking of Multiple Tasks
Maninis, K.-K., Radosavovic, I., & Kokkinos, I. (2019) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2019.00195 · Cited by 204 · see citing works
Park, D. H., Darrell, T., & Rohrbach, A. (2019) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00472 · Cited by 201 · see citing works
Wang, K., Lin, Y.-A., Weissmann, B., Savva, M., Chang, A. X., & Ritchie, D. (2019) · ACM Transactions on Graphics · doi:10.1145/3306346.3322941 · Cited by 200 · see citing works
XingGAN for Person Image Generation
Tang, H., Bai, S., Zhang, L., Torr, P. H. S., & Sebe, N. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-58595-2_43 · Cited by 199 · see citing works
Li, C., Liu, L., Lu, A., Ji, Q., & Tang, J. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-58542-6_14 · Cited by 198 · see citing works
Listen, Denoise, Action! Audio-Driven Motion Synthesis with Diffusion Models
Alexanderson, S., Nagy, R., Beskow, J., & Henter, G. E. (2023) · ACM Transactions on Graphics · doi:10.1145/3592458 · Cited by 206 · see citing works
Music Gesture for Visual Sound Separation
Gan, C., Huang, D. Y., Zhao, H., Tenenbaum, J. B., & Torralba, A. B. (2020) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr42600.2020.01049 · Cited by 197 · see citing works
Disentangled representation learning in cardiac image analysis
Chartsias, A., Joyce, T., Papanastasiou, G., Semple, S. I. K., Williams, M. C., Newby, D. E., Dharmakumar, R., & Tsaftaris, S. A. (2019) · Medical Image Analysis · doi:10.1016/j.media.2019.101535 · Cited by 195 · see citing works
Learning to Count Objects in Natural Images for Visual Question Answering
Zhang, Y., Hare, J. S., & Prügel‐Bennett, A. (2018) · ePrints Soton (University of Southampton) · doi:10.48550/arxiv.1802.05766 · Cited by 194 · see citing works
Gesticulator: A framework for semantically-aware speech-driven gesture generation
Kucherenko, T., Jonell, P., van Waveren, S., Henter, G. E., Alexanderson, S., Leite, I., & Kjellström, H. (2020) · INTERNATIONAL CONFERENCE ON MULTIMODAL INTERACTION · doi:10.1145/3382507.3418815 · Cited by 191 · see citing works
Image Search With Text Feedback by Visiolinguistic Attention Learning
Chen, Y., Gong, S., & Bazzani, L. (2020) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr42600.2020.00307 · Cited by 191 · see citing works
Side-Tuning: A Baseline for Network Adaptation via Additive Side Networks
Zhang, J. O., (Sasha), A. S., Zamir, A., Guibas, L. J., & Malik, J. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-58580-8_41 · Cited by 190 · see citing works
RAVEN: A Dataset for Relational and Analogical Visual REasoNing
Zhang, C., Gao, F., Jia, B., Zhu, Y., & Zhu, S. C. (2019) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2019.00546 · Cited by 189 · see citing works
Splatter Image: Ultra-Fast Single-View 3D Reconstruction
Szymanowicz, S., Rupprecht, C., & Vedaldi, A. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.00972 · Cited by 190 · see citing works
Explainable Neural Computation via Stack Neural Module Networks
Hu, R., Andreas, J., Darrell, T., & Saenko, K. (2018) · Lecture notes in computer science · doi:10.1007/978-3-030-01234-2_4 · Cited by 175 · see citing works
Supervised Multimodal Bitransformers for Classifying Images and TextPreprint
Kiela, D., Bhooshan, S., Firooz, H., Perez, E., & Testuggine, D. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1909.02950 · Cited by 271 · see citing works
Self-citationDuality-Gated Mutual Condition Network for RGBT Tracking
Lu, A., Qian, C., Li, C., Tang, J., & Wang, L. (2022) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2022.3157594 · Cited by 172 · see citing works
Gao, Q., Li, Z., Zhang, J., Zhang, Y., & Shan, H. (2023) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2023.3320812 · Cited by 172 · see citing works
Language-Conditioned Graph Networks for Relational Reasoning
Hu, R., Rohrbach, A., Darrell, T., & Saenko, K. (2019) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.01039 · Cited by 167 · see citing works
Few-Shot Named Entity Recognition via Meta-Learning
Li, J., Chiu, B., Feng, S., & Wang, H. (2020) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2020.3038670 · Cited by 167 · see citing works
BC-Z: Zero-Shot Task Generalization with Robotic Imitation Learning
Jang, E., Irpan, A., Khansari, M., Kappler, D., Ebert, F., Lynch, C., Levine, S., & Finn, C. (2022) · arXiv · doi:10.48550/arxiv.2202.02005 · Cited by 167 · see citing works
Dumoulin, V., Perez, E., Schucher, N., Strub, F., de Vries, H., Courville, A. C., & Bengio, Y. (2018) · Distill · doi:10.23915/distill.00011 · Cited by 166 · see citing works
Self-citationMedical Visual Question Answering via Conditional Reasoning
Zhan, L.-M., Liu, B., Fan, L., Chen, J., & Wu, X.-M. (2020) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3394171.3413761 · Cited by 166 · see citing works
PMR: Prototypical Modal Rebalance for Multimodal Learning
Fan, Y., Xu, W., Wang, H., Wang, J., & Guo, S. (2023) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52729.2023.01918 · Cited by 166 · see citing works
Cycle-Consistency for Robust Visual Question Answering
Shah, M., Chen, X., Rohrbach, M., & Parikh, D. (2019) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2019.00681 · Cited by 165 · see citing works
Segmenting Objects in Day and Night: Edge-Conditioned CNN for Thermal Image Semantic Segmentation
Li, C., Xia, W., Yan, Y., Luo, B., & Tang, J. (2020) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2020.3009373 · Cited by 164 · see citing works
Meta-Learning with Task-Adaptive Loss Function for Few-Shot Learning
Baik, S., Choi, J., Kim, H., Cho, D., Min, J., & Lee, K. M. (2021) · 2021 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.00933 · Cited by 163 · see citing works
Task-Driven Modular Networks for Zero-Shot Compositional Learning
Purushwalkam, S., Nickel, M., Gupta, A., & Ranzato, M. (2019) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00369 · Cited by 163 · see citing works
RGB-D Salient Object Detection with Cross-Modality Modulation and Selection
Li, C., Cong, R., Piao, Y., Xu, Q., & Loy, C. C. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-58598-3_14 · Cited by 160 · see citing works
Feng, J., Rong, C., Sun, F., Guo, D., & Li, Y. (2020) · Proceedings of the ACM on Interactive Mobile Wearable and Ubiquitous Technologies · doi:10.1145/3381006 · Cited by 158 · see citing works
- Authors
- Perez, E., Strub, F., De Vries, H., Dumoulin, V., & Courville, A.
- Affiliations
- Université de Montréal (CA)
- Centre National de la Recherche Scientifique (FR)
- Mila - Quebec Artificial Intelligence Institute (CA)
- Venue
- Proceedings of the AAAI Conference on Artificial Intelligence
- Published
- 2018-04-29
- Volume
- 32
- Issue
- 1
- ISSN
- 2159-5399 (ISSN-L)
- 2374-3468
- OpenAlex
- W2760103357
- Cited by
- 2,490
- References
- 55
- Citations by year
- 2026: 823 · 2025: 412 · 2024: 280 · 2023: 221 · 2022: 158 · 2021: 244 · 2020: 179 · 2019: 120 · 2018: 52 · 2017: 1
- FWCI
- 44.92
- Type
- conference paper
- Language
- en
- Open access
- diamond
- doi.org
- Locations
- Proceedings of the AAAI Conference on Artificial Intelligence (publishedVersion)
- arXiv (Cornell University) (submittedVersion)
- AAAI Publications (The Association for the Advancement of Artificial Intelligence (AAAI)) (submittedVersion)
- Funders
- Nvidia
- Fonds de recherche du Québec – Nature et technologies
- CHIST-ERA
- Topics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Multimodal Machine Learning Applications
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Neural Network Applications
- Physical Sciences › Computer Science › Artificial Intelligence › Domain Adaptation and Few-Shot Learning
- Keywords
- cinema, feature-wise linear modulation, visual reasoning, visual question answering, feature modulation, zero-shot generalization, few-shot learning
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
