Multimodal Intelligence: Representation Learning, Information Fusion, and Applications

Cites (288)

Items 201–288 of 288

1. Select-additive learning: Improving generalization in multimodal sentiment analysis
   Haohan Wang, Aaksha Meghawat, Louis‐Philippe Morency, Eric P. Xing · 2017 · IEEE International Conference on Multimedia and Expo (ICME)
2. Image Generation From Layout
   Bo Zhao, Lili Meng, Weidong Yin, Leonid Sigal · 2019 · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings
3. Visual Madlibs: Fill in the Blank Description Generation and Question Answering
   Licheng Yu, Eunbyung Park, Alexander C. Berg, Tamara L. Berg · 2015 · IEEE/CVF International Conference on Computer Vision (ICCV)
4. Multimodal Deep Learning
   Amirreza Shaban, Safoora Yousefi · 2024 · Springer optimization and its applications
5. Transparency by Design: Closing the Gap Between Performance and Interpretability in Visual Reasoning
   Mascharka, David, Tran, Philip, Soklaski, Ryan, Majumdar, Arjun · 2018 · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition
6. Self-Monitoring Navigation Agent via Auxiliary Progress Estimation
   Ma, Chih-Yao, Lu, Jiasen, Wu, Zuxuan, AlRegib, Ghassan, Kira, Zsolt, Socher, Richard, Xiong, Caiming · 2019 · arXiv
7. Learning to Count Objects in Natural Images for Visual Question Answering
   Yan Zhang, Jonathon S. Hare, Adam Prügel‐Bennett · 2018 · ePrints Soton (University of Southampton)
8. Robust late fusion with rank minimization
   Guangnan Ye, Dong Liu, I‐Hong Jhuo, Shih-Fu Chang · 2012 · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings
9. MFAS: Multimodal Fusion Architecture Search
   Perez-Rua, Juan-Manuel, Vielzeuf, Valentin, Pateux, Stephane, Baccouche, Moez, Jurie, Frederic · 2019 · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)
10. Improving DNN speaker independence with I-vector inputs
    Andrew Senior, Ignacio López Moreno · 2014 · IEEE International Conference on Acoustics Speech and Signal Processing
11. Roles of Pre-Training and Fine-Tuning in Context-Dependent DBN-HMMs for Real-World Speech Recognition
    Dong Yu, Li Deng, George E. Dahl · 2010 · neural information processing systems
12. Fusion of Detected Objects in Text for Visual Question Answering
    Chris Alberti, Jeffrey Ling, Michael Collins, David Reitter · 2019 · Conference on Empirical Methods in Natural Language Processing (EMNLP)
13. Large vocabulary continuous speech recognition with context-dependent DBN-HMMS
    George E. Dahl, Dong Yu, Li Deng, Alex Acero · 2011 · IEEE International Conference on Acoustics Speech and Signal Processing
14. Ask Your Neurons: A Neural-based Approach to Answering Questions about Images
    Mateusz Malinowski, Marcus Rohrbach, Mario Fritz · 2015 · arXiv (Cornell University)
15. Multimodal feature fusion for robust event detection in web videos
    Prem Natarajan, Shuang Wu, Shiv Naga Prasad Vitaladevuni, Xiaodan Zhuang, Stavros Tsakalidis, Unsang Park, R. Prasad, Prem Natarajan · 2012 · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings
16. Explainable Neural Computation via Stack Neural Module Networks
    Ronghang Hu, Jacob Andreas, Trevor Darrell, Kate Saenko · 2018 · Lecture notes in computer science
17. Cycle-Consistency for Robust Visual Question Answering
    Meet Shah, Xinlei Chen, Marcus Rohrbach, Devi Parikh · 2019 · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings
18. Fuzzy commonsense reasoning for multimodal sentiment analysis
    Iti Chaturvedi, Ranjan Satapathy, Sandro Cavallari, Erik Cambria · 2019 · Pattern Recognition Letters
19. Text-Adaptive Generative Adversarial Networks: Manipulating Images with Natural Language
    Seonghyeon Nam, Yunji Kim, Seon Joo Kim · 2018 · arXiv (Cornell University)
20. CentralNet: A Multilayer Approach for Multimodal Fusion
    Vielzeuf, Valentin, Lechervy, Alexis, Pateux, Stéphane, Jurie, Frédéric · 2019 · Lecture Notes in Computer Science
21. Unified Visual-Semantic Embeddings: Bridging Vision and Language With Structured Meaning Representations
    Hao Wu, Jiayuan Mao, Yufeng Zhang, Yuning Jiang, Lei Li, Weiwei Sun, Wei‐Ying Ma · 2019 · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings
22. Learning Robust Visual-Semantic Embeddings
    Yao-Hung Hubert Tsai, Liang-Kang Huang, Ruslan Salakhutdinov · 2017 · IEEE/CVF International Conference on Computer Vision (ICCV)
23. Fast, Diverse and Accurate Image Captioning Guided by Part-Of-Speech
    Aditya Deshpande, J. Aneja, Liwei Wang, A. Schwing, D. Forsyth · 2018 · Computer Vision and Pattern Recognition
24. From Language to Goals: Inverse Reinforcement Learning for Vision-Based Instruction Following
    Justin Fu, Anoop Korattikara Balan, S. Levine, S. Guadarrama · 2019 · International Conference on Learning Representations
25. TAC-GAN - Text Conditioned Auxiliary Classifier Generative Adversarial Network
    Ayushman Dash, John Cristian Borges Gamboa, Sheraz Ahmed, Marcus Liwicki, Muhammad Zeshan Afzal · 2017 · arXiv (Cornell University)
26. Deep Compositional Question Answering with Neural Module Networks
    Jacob Andreas, Marcus Rohrbach, Trevor Darrell, Dan Klein · 2015 · arXiv (Cornell University)
27. Preserving privacy in speaker and speech characterisation
    Andreas Nautsch, Abelino Jiménez, Amos Treiber, Jascha Kolberg, Catherine Jasserand, Els J. Kindt, Héctor Delgado, Massimiliano Todisco, Mohamed Amine Hmani, Aymen Mtibaa et al. · 2019 · Computer Speech & Language
28. Creativity: Generating Diverse Questions Using Variational Autoencoders
    Unnat Jain, Ziyu Zhang, Alexander Gerhard Schwing · 2017 · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings
29. Emotion Identification from Raw Speech Signals Using DNNs
    Mousmita Sarma, Pegah Ghahremani, Daniel Povey, Nagendra Kumar Goel, Kandarpa Kumar Sarma, Najim Dehak · 2018 · Interspeech (USB)
30. Are You Talking to Me? Reasoned Visual Dialog Generation Through Adversarial Learning
    Qi Wu, Peng Wang, Chunhua Shen, Ian D. Reid, Anton van den Hengel · 2018 · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings
31. Conditional GAN with Discriminative Filter Generation for Text-to-Video Synthesis
    Yogesh Balaji, Martin Renqiang Min, Bing Bai, Rama Chellappa, Hans Peter Graf · 2019 · International Joint Conference on Artificial Intelligence
32. Deep Learning for Image-to-Text Generation: A Technical Overview
    Xiaodong He, Li Deng · 2017 · IEEE Signal Processing Magazine
33. Audio-Visual Speaker Diarization Based on Spatiotemporal Bayesian Fusion
    Israel D. Gebru, Silèye Ba, Xiaofei Li · 2017 · IEEE Transactions on Pattern Analysis and Machine Intelligence
34. Time Domain Audio Visual Speech Separation
    Jian Wu, Yong Xu, Shixiong Zhang, Lianwu Chen, Meng Yu, Lei Xie, Dong Yu · 2019 · IEEE Workshop on Automatic Speech Recognition and Understanding (ASRU)
35. Multilayer and Multimodal Fusion of Deep Neural Networks for Video Classification
    Xiaodong Yang, Pavlo A. Molchanov, Jan Kautz · 2016 · ACM International Conference on Multimedia (ACM MM)
36. Unicoder-VL: A Universal Encoder for Vision and Language by Cross-modal Pre-training
    Gen Li, Nan Duan, Yuejian Fang · 2019 · arXiv (Cornell University)
37. X-Vectors Meet Emotions: A Study On Dependencies Between Emotion and Speaker Recognition
    Raghavendra Reddy Pappagari, Tianzi Wang, Jesús Villalba, Nanxin Chen, Najim Dehak · 2020 · IEEE International Conference on Acoustics Speech and Signal Processing
38. Rich Image Captioning in the Wild
    Kenneth Tran, Xiaodong He, Lei Zhang, Jian Zhong Sun · 2016 · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW)
39. Deep Multimodal Representation Learning from Temporal Data
    Xitong Yang, Palghat S. Ramesh, Radha Chitta, Sriganesh Madhvanath, Edgar A. Bernal, Jiebo Luo · 2017 · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings
40. Tell, Draw, and Repeat: Generating and Modifying Images Based on Continual Linguistic Instruction
    Alaaeldin El-Nouby, Shikhar Sharma, Hannes Schulz, Devon Hjelm, Layla El Asri, Samira Ebrahimi Kahou, Yoshua Bengio, Graham W. Taylor · 2019 · IEEE/CVF International Conference on Computer Vision (ICCV)
41. ChatPainter: Improving Text to Image Generation using Dialogue
    Shikhar Sharma, Dendi Suhubdy, Vincent Michalski, Samira Ebrahimi Kahou, Yoshua Bengio · 2018 · arXiv (Cornell University)
42. Listening test materials for "A study of speaker adaptation for DNN-based speech synthesis"
    Zhizheng Wu · 2015 · Edinburgh Research Explorer (University of Edinburgh)
43. Text2Scene: Generating Compositional Scenes From Textual Descriptions
    Fuwen Tan, Song Feng, Vicente Ordóñez · 2019 · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings
44. iVector-based discriminative adaptation for automatic speech recognition
    Martin Karafiát, Lukáš Burget, Pavel Matějka · 2011 · IEEE Workshop on Automatic Speech Recognition and Understanding (ASRU)
45. Co-Attending Free-Form Regions and Detections With Multi-Modal Multiplicative Feature Embedding for Visual Question Answering
    Pan Lu, Hongsheng Li, Wei Zhang, Jianyong Wang, Xiaogang Wang · 2018 · Proceedings of the AAAI Conference on Artificial Intelligence
46. High-Order Attention Models for Visual Question Answering
    Idan Schwartz, Alexander Gerhard Schwing, Tamir Hazan · 2017 · arXiv (Cornell University)
47. VisualWord2Vec (Vis-W2V): Learning Visually Grounded Word Embeddings Using Abstract Scenes
    Satwik Kottur, Ramakrishna Vedantam, José M. F. Moura, Devi Parikh · 2016 · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings
48. CoDraw: Collaborative Drawing as a Testbed for Grounded Goal-driven Communication
    Jin-Hwa Kim, Nikita Kitaev, Xinlei Chen, Marcus Rohrbach, Byoung‐Tak Zhang, Yuandong Tian, Dhruv Batra, Devi Parikh · 2019 · Proceedings of the conference - Association for Computational Linguistics. Meeting
49. Learning by Asking Questions
    Ishan Misra, Ross Girshick, Rob Fergus, Martial Hebert, Abhinav Gupta, Laurens J. P. van der Maaten · 2018 · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings
50. EmoBed: Strengthening Monomodal Emotion Recognition via Training with Crossmodal Emotion Embeddings
    Jing Han, Zixing Zhang, Zhao Xu Ren, Bjorn Schuller · 2019 · IEEE Transactions on Affective Computing
51. Deep Learning for Natural Language Processing
    Jiajun Zhang, Chengqing Zong · 2019 · Cognitive computation trends
52. A study of speaker adaptation for DNN-based speech synthesis
    Zhizheng Wu, Paweł Świętojański, Christophe Veaux · 2015 · Interspeech (USB)
53. Multi-level Fusion of Audio and Visual Features for Speaker Identification
    Zhiyong Wu, Lianhong Cai, Helen M. L. Meng · 2005 · Lecture notes in computer science
54. Probabilistic Neural-symbolic Models for Interpretable Visual Question Answering
    Ramakrishna Vedantam, Karan Desai, Stefan Lee, Marcus Rohrbach, Dhruv Batra, Devi Parikh · 2019 · arXiv (Cornell University)
55. DRAU: Dual Recurrent Attention Units for Visual Question Answering
    Ahmed Osman, Wojciech Samek · 2019 · Computer Vision and Image Understanding
56. Multi-Task Learning of Hierarchical Vision-Language Representation
    Duy-Kien Nguyen, Takayuki Okatani · 2019 · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings
57. Adversarial Learning of Semantic Relevance in Text to Image Synthesis
    Miriam Cha, Youngjune Gwon, H. T. Kung · 2019 · Proceedings of the AAAI Conference on Artificial Intelligence
58. OmniNet: A unified architecture for multi-modal multi-task learning
    Subhojeet Pramanik, Priyanka Agrawal, Aman Hussain · 2019 · arXiv (Cornell University)
59. Generating Diverse and Accurate Visual Captions by Comparative Adversarial Learning
    Dianqi Li, Qiuyuan Huang, Xiao-Dong He, Lei Zhang, Ming-Ting Sun · 2018 · arXiv.org
60. An Overview of Deep-Structured Learning for Information Processing
    Li Deng · 2011
61. Stacked Latent Attention for Multimodal Reasoning
    Haoqi Fan, Jiatong Zhou · 2018 · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings
62. Efficient Progressive Neural Architecture Search
    Juan-Manuel Pérez-Rúa, Moez Baccouche, Stéphane Pateux · 2018 · arXiv (Cornell University)
63. Dual Adversarial Inference for Text-to-Image Synthesis
    Qicheng Lao, Mohammad Havaei, Ahmad Pesaranghader, Francis Dutil, Lisa Di Jorio, Thomas Fevens · 2019 · IEEE/CVF International Conference on Computer Vision (ICCV)
64. Active Learning for Visual Question Answering: An Empirical Study
    Xiaoyu Lin, Devi Parikh · 2017 · arXiv.org
65. Creativity: Generating Diverse Questions using Variational Autoencoders
    Unnat Jain, Ziyu Zhang, Alexander Gerhard Schwing · 2017 · arXiv (Cornell University)
66. Who Said That?: Audio-Visual Speaker Diarisation of Real-World Meetings
    Joon Son Chung, Bong‐Jin Lee, Icksang Han · 2019 · Interspeech (USB)
67. Audio-visual speaker recognition for video broadcast news: some fusion techniques
    Benoit Maison, C. Neti, A. Senior · 1999 · IEEE Workshop on Multimedia Signal Processing (MMSP)
68. Rich Image Captioning in the Wild
    Tran, Kenneth, Xiaodong He, Zhang, Lei, Jian Sun, Cornelia Carapcea, Chris Thrasher, Chris Buehler, Chris Sienkiewicz · 2016 · arXiv (Cornell University)
69. What really matters — An information gain analysis of questions and reactions in automated PTSD screenings
    Torsten Wörtwein, Stefan J. Scherer · 2017 · International Conference on Affective Computing and Intelligent Interaction and workshops
70. Speaker Diarisation Using 2D Self-attentive Combination of Embeddings
    Guangzhi Sun, Chengyue Zhang, Philip C. Woodland · 2019 · IEEE International Conference on Acoustics Speech and Signal Processing
71. Sequential Attention GAN for Interactive Image Editing via Dialogue.
    Yu Cheng, Zhe Gan, Yitong Li, Jingjing Liu, Jianfeng Gao · 2018 · arXiv (Cornell University)
72. DBN-ivector Framework for Acoustic Emotion Recognition
    Rui Xia, Yang Liu · 2016 · Interspeech (USB)
73. Neural Language Modeling with Visual Features
    Antonios Anastasopoulos, Shankar Kumar, Hank Liao · 2019 · arXiv (Cornell University)
74. A comparison of neural network feature transforms for speaker diarization
    Sree Harsha Yella, Andreas Stolcke · 2015 · Interspeech (USB)
75. ViCo: Word Embeddings From Visual Co-Occurrences
    Tanmay Gupta, Alexander Gerhard Schwing, Derek Hoiem · 2019 · IEEE/CVF International Conference on Computer Vision (ICCV)
76. ChatPainter: Improving Text to Image Generation Using Dialogue
    Shikhar Sharma, Dendi Suhubdy, Vincent Michalski · 2018 · arXiv (Cornell University)
77. Speaker adaptation by modeling the speaker variation in a continuous speech recognition system
    Nikko Ström · 2002 · International Conference on Spoken Language Processing (ICSLP)
78. Do Neural Network Cross-Modal Mappings Really Bridge Modalities?
    Guillem Collell, Marie‐Francine Moens · 2018 · Annual Meeting of the Association for Computational Linguistics (ACL)
79. Deep Bayesian Active Learning for Multiple Correct Outputs
    Khaled Jedoui, Ranjay Krishna, Michael S. Bernstein, Li Fei-Fei · 2019 · arXiv (Cornell University)
80. Secure binary embeddings of front-end factor analysis for privacy preserving speaker verification
    José Portêlo, Alberto Abad, Bhiksha Raj · 2013 · Interspeech (USB)
81. Heuristics for Image Generation from Scene Graphs
    Subarna Tripathi, Anahita Bhiwandiwalla, Alexei Bastidas · 2019
82. Are You Looking? Grounding to Multiple Modalities in Vision-and-Language Navigation
    Ronghang Hu, Daniel Fried, Anna Rohrbach · 2019 · arXiv (Cornell University)
83. Tactical Rewind: Self-Correction via Backtracking in Vision-and-Language Navigation
    Liyiming Ke, Xiujun Li, Yonatan Bisk · 2019 · arXiv (Cornell University)
84. Integrated speaker-adaptive speech synthesis
    Moquan Wan, Gilles Degottex, Mark Gales · 2017 · IEEE Automatic Speech Recognition and Understanding Workshop (ASRU)
85. Leveraging Pretrained Image Classifiers for Language-Based Segmentation
    David Golub, Ahmed El-Kishky, Roberto Martín-Martín · 2020 · IEEE Winter Conference on Applications of Computer Vision
86. Chat-crowd: A Dialog-based Platform for Visual Layout Composition
    Paola Cascante-Bonilla, Xuwang Yin, Vicente Ordóñez · 2019
87. Perspectives on predictive power of multimodal deep learning: surprises and future directions
    Samy Bengio A, Li Deng, Louis‐Philippe Morency, Björn Wolfgang Schuller · 2018 · ACM eBooks
88. Speaker adaptation by modeling the speaker variation in a continuous speech recognition system
    Nikko Ström · 1996 · International Conference on Spoken Language Processing (ICSLP)