Learning with Side Information through Modality Hallucination

Hoffman, Judy, Gupta, Saurabh, Darrell, Trevor·2016·2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR)
DOI 10.1109/cvpr.2016.96

Cited by (207)

Items 101–200 of 207

  1. Dealing with Missing Modalities in the Visual Question Answer-Difference Prediction Task through Knowledge Distillation
    Jae Won Cho, Dong-Jin Kim, Jinsoo Choi, YunJae Jung, In So Kweon · 2021 · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW)
  2. An efficient model-level fusion approach for continuous affect recognition from audiovisual signals
    Ercheng Pei, Dongmei Jiang, Hichem Sahli B · 2019 · Neurocomputing
  3. HalluciNet-ing Spatiotemporal Representations Using a 2D-CNN
    Paritosh Parmar, Brendan Morris · 2021 · Signals
  4. Robust 3D Object Detection from LiDAR-Radar Point Clouds via Cross-Modal Feature Augmentation
    Jianning Deng, Gabriel Chan, Hantao Zhong, Chris Xiaoxuan Lu · 2024 · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings
  5. ACP++: Action Co-Occurrence Priors for Human-Object Interaction Detection
    Dong-Jin Kim, Xiao Na Sun, Jinsoo Choi, Stephen Ching-Feng Lin, In So Kweon · 2021 · IEEE Transactions on Image Processing
  6. Partially Generative Neural Networks for Gang Crime Classification with Partial Information
    Seo, Sungyong, Chan, Hau, Brantingham, P. Jeffrey, Leap, Jorja, Vayanos, Phebe, Tambe, Milind, Liu, Yan · 2018 · Proceedings of the 2018 AAAI/ACM Conference on AI, Ethics, and Society
  7. Illumination-Aware Hallucination-Based Domain Adaptation for Thermal Pedestrian Detection
    Qian Xie, Ta-Ying Cheng, Zhuangzhuang Dai, Vu Tran, Niki Trigoni, Andrew Markham · 2023 · IEEE Transactions on Intelligent Transportation Systems
  8. Zero-shot Deep Domain Adaptation with Common Representation Learning
    Mohammed Kutbi, Kuan–Chuan Peng, Ziyan Wu · 2021 · IEEE Transactions on Pattern Analysis and Machine Intelligence
  9. Classifying low-resolution images by integrating privileged information in deep CNNs
    Marion Chevalier, Nicolas Thome, Gilles Hénaff, Matthieu Cord · 2018 · Pattern Recognition Letters
  10. Deep Learning for Multimodal Data Fusion
    Asako Kanezaki, Ryohei Kuga, Yusuke Sugano, Yasuyuki Matsushita · 2019 · Elsevier eBooks
  11. Enhanced Multimodal Representation Learning with Cross-modal KD
    Mengxi Chen, Linyu Xing, Yu Wang, Xa Zhang · 2023 · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings
  12. Robust Multi-Modal Sensor Fusion: An Adversarial Approach
    Siddharth Roheda, Hamid Krim, Benjamin S. Riggan · 2020 · IEEE Sensors Journal
  13. RGB-based 3D Hand Pose Estimation via Privileged Learning with Depth Images
    Shanxin Yuan, Björn Stenger, Tae‐Kyun Kim · 2018 · arXiv (Cornell University)
  14. Privileged Modality Learning via Multimodal Hallucination
    Shicai Wei, Chunbo Luo, Yang Luo, Jialang Xu · 2023 · IEEE Transactions on Multimedia
  15. Classifier Ensemble by Exploring Supplementary Ordering Information
    Ou Wu · 2018 · IEEE Transactions on Knowledge and Data Engineering
  16. OIDC-Net: Omnidirectional Image Distortion Correction via Coarse-to-Fine Region Attention
    Kang Liao, Chunyu Lin, Yao Zhao, Moncef Gabbouj, Yang Zheng · 2019 · IEEE Journal of Selected Topics in Signal Processing
  17. Learning Common Representation From RGB and Depth Images
    Giorgio Giannone, Boris Chidlovskii · 2019 · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW)
  18. Fusion of color and hallucinated depth features for enhanced multimodal deep learning-based damage segmentation
    Tarutal Ghosh Mondal, Mohammad R. Jahanshahi · 2023 · Earthquake Engineering and Engineering Vibration
  19. Sensor Fusion of Intensity and Depth Cues using the ChiNet for Semantic Segmentation of Road Scenes
    Vijay John, M. K. Nithilan, S. Mita, Hossein Tehrani, M. Konishi, Kazuhisa Ishimaru, T. Oishi · 2018 · IEEE Intelligent Vehicles Symposium
  20. Cross-Modality Personalization for Retrieval
    Nils Murrugarra-Llerena, Adriana Kovashka · 2019 · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings
  21. Capturing fine-grained details for video-based automation of suturing skills assessment
    Andrew J. Hung, Richard Bao, Idris O. Sunmola, De-An Huang, Jessica H. Nguyen, Animashree Anandkumar · 2022 · International Journal of Computer Assisted Radiology and Surgery
  22. Adaptive Feature Attention Module for Robust Visual–LiDAR Fusion-Based Object Detection in Adverse Weather Conditions
    Taek-Lim Kim, Saba Arshad, Tae-Hyoung Park · 2023 · Remote Sensing
  23. Learning sequential slice representation with an attention-embedding network for 3D shape recognition and retrieval in MLS point clouds
    Zhipeng Luo, Di Liu, Jonathan Li, Yiping Chen, Zhenlong Xiao, José Marcato, Wesley Nunes Gonçalves, Cheng Wang · 2020 · ISPRS Journal of Photogrammetry and Remote Sensing
  24. BLT: Balancing Long-Tailed Datasets with Adversarially-Perturbed Images
    Jedrzej Kozerawski, Victor Fragoso, Nikolaos Karianakis, Gaurav Mittal, Matthew Turk, Mei Chen · 2021 · Lecture notes in computer science
  25. Batch Entropy Supervised Convolutional Neural Networks for Feature Extraction and Harmonizing for Action Recognition
    Md. Imtiaz Hossain, Ashraf Siddique, Md Alamgir Hossain, Md. Delowar Hossain, Eui‐Nam Huh · 2020 · IEEE Access
  26. DiPCAN: Distilling Privileged Information for Crowd-Aware Navigation
    Gianluca Monaci, Michel Aractingi, Tomi Silander · 2022 · Robotics: Science and Systems
  27. Efficient Water Segmentation with Transformer and Knowledge Distillation for USVs
    Jingting Zhang, Jiantao Gao, Jinshuo Liang, Yiqiang Wu, Bin Li, Yang Zhai, Xiaomao Li · 2023 · Journal of Marine Science and Engineering
  28. Redundancy-Adaptive Multimodal Learning for imperfect data
    Mengxi Chen, Jiangchao Yao, Linyu Xing, Yu Wang, Ya Zhang, Yanfeng Wang · 2025 · Neural Networks
  29. HalluciDet: Hallucinating RGB Modality for Person Detection Through Privileged Information
    Heitor R. Medeiros, Fidel A. Guerrero Peña, Masih Aminbeidokhti, Thomas Dubail, Éric Granger, Marco Pedersoli · 2024 · IEEE Winter Conference on Applications of Computer Vision
  30. Urban land cover classification with missing data using deep convolutional neural networks
    Michael Kampffmeyer, Arnt-Børre Salberg, Robert Jenssen · 2017 · IEEE International Geoscience and Remote Sensing Symposium (IGARSS)
  31. Leveraging Acoustic Images for Effective Self-supervised Audio Representation Learning
    Valentina Sanguineti, Pietro Morerio, Niccolò Pozzetti, Danilo Greco, Marco Cristani, Vittorio Murino · 2020 · Lecture notes in computer science
  32. Linguistic Hallucination for Text-Based Video Retrieval
    Sheng Fang, Tiantian Dang, Shuhui Wang, Qingming Huang · 2024 · IEEE Transactions on Circuits and Systems for Video Technology
  33. Multispectral-to-RGB Knowledge Distillation for Remote Sensing Image Scene Classification
    Hong-Kyu Shin, Kwang-Hyun Uhm, Seung‐Won Jung, Sung-Jea Ko · 2023 · IEEE Geoscience and Remote Sensing Letters
  34. Mix and Match Networks: Cross-Modal Alignment for Zero-Pair Image-to-Image Translation
    Yaxing Wang, Luis Herranz, Joost van de Weijer · 2020 · International Journal of Computer Vision
  35. Collaborative multimodal feature learning for RGB-D action recognition
    Jun Kong, Tianshan Liu, Min Jiang · 2019 · Journal of Visual Communication and Image Representation
  36. Input Dropout for Spatially Aligned Modalities
    Sébastien de Blois, Mathieu Garon, Christian Gagné, Jean‐François Lalonde · 2020 · Proceedings - International Conference on Image Processing
  37. Face Parsing from RGB and Depth Using Cross-Domain Mutual Learning
    Ji–Hyun Lee, Binod Bhattarai, Tae‐Kyun Kim · 2021 · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW)
  38. Boosting Weakly Supervised Object Detection using Fusion and Priors from Hallucinated Depth
    Cagri Gungor, Adriana Kovashka · 2024 · IEEE Winter Conference on Applications of Computer Vision
  39. Conquering the CNN Over-Parameterization Dilemma: A Volterra Filtering Approach for Action Recognition
    Siddharth Roheda, Hamid Krim · 2020 · Proceedings of the AAAI Conference on Artificial Intelligence
  40. Coral Classification Using DenseNet and Cross-modality Transfer Learning
    Lian Xu, Mohammed Bennamoun, Farid Boussaïd, Senjian An, Ferdous Ahmed Sohel · 2019 · International Joint Conference on Neural Networks (IJCNN)
  41. Cloth-Imbalanced Gait Recognition via Hallucination
    Saihui Hou, Panjian Huang, Xu Liu, Chunshui Cao, Yongzhen Huang · 2024 · IEEE Transactions on Circuits and Systems for Video Technology
  42. Fine-Grained Species Recognition With Privileged Pooling: Better Sample Efficiency Through Supervised Attention
    Andrés C. Rodríguez, Stefano D’Aronco, Konrad Schindler, Jan Dirk Wegner · 2023 · IEEE Transactions on Pattern Analysis and Machine Intelligence
  43. StructVPR++: Distill Structural and Semantic Knowledge With Weighting Samples for Visual Place Recognition
    Yanqing Shen, Sanping Zhou, Jingwen Fu, Ruotong Wang, Shitao Chen, Nanning Zheng · 2025 · IEEE Transactions on Pattern Analysis and Machine Intelligence
  44. Depth Privileged Scene Recognition via Dual Attention Hallucination
    Junjie Chen, Li Niu, Liqing Zhang · 2021 · IEEE Transactions on Image Processing
  45. Depth Privileged Object Detection in Indoor Scenes via Deformation Hallucination
    Zhijie Zhang, Yan Liu, Junjie Chen, Li Niu, Liqing Zhang · 2021 · Proceedings of the AAAI Conference on Artificial Intelligence
  46. Learning to see colours: generating biologically relevant fluorescent labels from bright-field images
    Håkan Wieslander, Ankit Gupta, Ebba Bergman, Erik Hallström, Philip John Harrison · 2021 · bioRxiv (Cold Spring Harbor Laboratory)
  47. Predicting Visual Political Bias Using Webly Supervised Data and an Auxiliary Task
    Christopher Thomas, Adriana Kovashka · 2021 · International Journal of Computer Vision
  48. Multimodal Localization for Embedded Systems: A Survey
    Imane Salhi, Martyna Porêba, Erwan Piriou, Valérie Gouet-Brunet, Maroun Ojail · 2019 · Elsevier eBooks
  49. Hallucinating Saliency Maps for Fine-grained Image Classification for Limited Data Domains
    Carola Figueroa-Flores, Bogdan Raducanu, David Berga, Joost van de Weijer · 2021 · International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications (VISIGRAPP)
  50. Lightweight Audio-Visual Wake Word Spotting With Diverse Acoustic Knowledge Distillation
    Ke-Wei Li, Hang Chen, Jun Du, Hengshun Zhou, Sabato Marco Siniscalchi, Shutong Niu, Shi-Fu Xiong · 2025 · IEEE Transactions on Circuits and Systems for Video Technology
  51. Toward Robust Tropical Cyclone Wind Radii Estimation With Multimodality Fusion and Missing-Modality Distillation
    Yongjun Jin, Jia Liu, Kaijun Ren, Xiang Wang, Kefeng Deng, Zhiqiang Fan, Chongjiu Deng, Yinlei Yue · 2024 · IEEE Transactions on Geoscience and Remote Sensing
  52. Using Cross-Model EgoSupervision to Learn Cooperative Basketball Intention
    Jianbo Shi, Gedas Bertasius · 2017 · IEEE International Conference on Computer Vision Workshops
  53. Depth-Based Privileged Information for Boosting 3D Human Pose Estimation on RGB
    Alessandro Simoni, Francesco Marchetti, Guido Borghi, Federico Becattini, Davide Davoli, Lorenzo Garattoni, Gianpiero Francesca, Lorenzo Seidenari, Roberto Vezzani · 2025 · Lecture notes in computer science
  54. Sequential Minimal Optimization Algorithm for One-Class Support Vector Machines With Privileged Information
    Andrey Lange, Dmitry Smolyakov, Evgeny Vladimirovich Burnaev · 2023 · IEEE Access
  55. Beyond Fusion: Modality Hallucination-based Multispectral Fusion for Pedestrian Detection
    Qian Xie, Ta-Ying Cheng, Jia-Xing Zhong, Kaichen Zhou, Andrew Markham, Niki Trigoni · 2024 · IEEE Winter Conference on Applications of Computer Vision
  56. Learning to transfer microscopy image modalities
    Han Liang, Zhaozheng Yin · 2018 · Machine Vision and Applications
  57. Self-TIO: Thermal-Inertial Odometry via Self-Supervised 16-Bit Feature Extractor and Tracker
    Junwoon Lee, Taisei Ando, Mitsuru Shinozaki, Toshihiro Kitajima, Qi An, Atsushi Yamashita · 2024 · IEEE Robotics and Automation Letters
  58. Car Damage Detection Based on Multi-View Fusion and Alignment: Dataset and Method
    Jinbo Peng, Shoubin Dong, Hua Yuan, Xiaorou Zheng · 2025 · IEEE Transactions on Intelligent Transportation Systems
  59. GENERALIZED KNOWLEDGE DISTILLATION FOR MULTI-SENSOR REMOTE SENSING CLASSIFICATION: AN APPLICATION TO LAND COVER MAPPING
    Dino Ienco, Yawogan Jean Eudes Gbodjo, Raffaele Gaetano, Roberto Interdonato · 2020 · ISPRS annals of the photogrammetry, remote sensing and spatial information sciences
  60. Exploring Compositional Image Retrieval with Hybrid Compositional Learning and Heuristic Negative Mining
    Chao Wang, Ehsan Nezhadarya, Tanmana Sadhu, Shengdong Zhang · 2022 · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP)
  61. Cross-modal Learning by Hallucinating Missing Modalities in RGB-D Vision
    Nuno C. Garcia, Pietro Morerio, Vittorio Murino · 2019 · Elsevier eBooks
  62. A Novel Interactive Fusion Method with Images and Point Clouds for 3D Object Detection
    Kai Xu, Zhile Yang, Yangjie Xu, Liangbing Feng · 2019 · Applied Sciences
  63. Low to High Dimensional Modality Hallucination Using Aggregated Fields of View
    Kausic Gunasekar, Qiang Qiu, Yezhou Yang · 2020 · IEEE Robotics and Automation Letters
  64. Stereo Confidence Estimation via Locally Adaptive Fusion and Knowledge Distillation
    Sunok Kim, Seungryong Kim, Dongbo Min, Pascal Frossard B, Kwanghoon Sohn · 2022 · IEEE Transactions on Pattern Analysis and Machine Intelligence
  65. Hard Pixels Mining: Learning Using Privileged Information for Semantic Segmentation.
    Zhangxuan Gu, Li Niu, Liqing Zhang · 2019 · arXiv (Cornell University)
  66. Privacy-Safe Action Recognition via Cross-Modality Distillation
    Yuhyun Kim, Jinwook Jung, Hyeoncheol Noh, Byungtae Ahn, Junghye Kwon, Dong‐Geol Choi · 2024 · IEEE Access
  67. MSP: A Multi-level Structures-based Framework with Multi-level Pre-training for Protein-Ligand Binding Affinity Prediction
    Ruikang Li, Jiaxian Yan, Kai Zhang · 2024 · International Conference on Computational Linguistics and Natural Language Processing (CLNLP)
  68. Multi-stream Convolutional Networks for Indoor Scene Recognition
    Rao Muhammad Anwer, Fahad Shahbaz Khan, Jorma T. Laaksonen, Nazar Zaki · 2019 · Lecture notes in computer science
  69. Demand Forecasting in the Presence of Privileged Information
    Mozhdeh Ariannezhad, Sebastian Schelter, Maarten de Rijke · 2020 · Lecture notes in computer science
  70. Uncertainty Aware Review Hallucination for Science Article Classification
    Korbinian Friedl, Georgios Rizos, Lukas Stappen, Madina Hasan, Lucia Specia, Thomas Hain, Björn Wolfgang Schuller · 2021 · Findings of the Association for Computational Linguistics: ACL (Findings of ACL)
  71. Sign Spotting via Multi-modal Fusion and Testing Time Transferring
    Hongyu Fu, Chen Liu, Xingqun Qi, Beibei Lin, Lincheng Li, Li Zhang, Xin Yu · 2023 · Lecture notes in computer science
  72. Small-shot Multi-modal Distillation for Vision-based Autonomous Steering
    Yu Shen, Luyu Yang, Xijun Wang, Ming C. Lin · 2023 · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings
  73. Class Attention Map Distillation for Efficient Semantic Segmentation
    Nader Karimi Bavandpour, Shohreh Kasaei B · 2020 · Iranian Conference on Machine Vision and Image Processing
  74. Feature-Supervised Action Modality Transfer
    Fida Mohammad Thoker, Cees G. M. Snoek · 2021 · Proceedings - International Conference on Pattern Recognition/Proceedings/International Conference on Pattern Recognition
  75. Generative Information Fusion
    Kenneth Tran, Wesam Sakla, Hamid Krim · 2021 · IEEE International Conference on Acoustics Speech and Signal Processing
  76. Depth Privileged Object Detection with Depth-Enhanced DCN
    Yan Liu, Zhijie Zhang, Liqing Zhang · 2021 · Communications in computer and information science
  77. Neglected Free Lunch – Learning Image Classifiers Using Annotation Byproducts
    Dongyoon Han, Junsuk Choe, Se-Young Chun, John Joon Young Chung, Minsuk Chang, Sangdoo Yun, Jean Y. Song, Seong Joon Oh · 2023 · IEEE International Conference on Computer Vision
  78. Commuting Conditional GANS for Multi-Modal Fusion
    Siddharth Roheda, Hamid Krim, Benjamin S. Riggan · 2020 · IEEE International Conference on Acoustics Speech and Signal Processing
  79. A Memory-Assisted Knowledge Transferring Framework with Curriculum Anticipation for Weakly Supervised Online Activity Detection
    Tianshan Liu, Kin‐Man Lam, Bing-Kun Bao · 2024 · International Journal of Computer Vision
  80. Feature Hallucination via Privileged Information for Neuromorphic Face Analysis
    Lorenzo Berlincioni, Luca Cultrera, Gabriele Magrini, Federico Becattini, Pietro Pala, Alberto Del Bimbo · 2025 · Lecture notes in computer science
  81. Optical and SAR Cross-Modal Hallucination Collaborative Learning for Remote Sensing Missing-Modality Building Footprint Extraction
    Tianyu Wei, He Chen, Wenchao Liu, Liang Chen, Panzhe Gu, Jue Wang · 2025 · IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing
  82. Multimodal Contrastive Learning for Unpaired and Depth-privileged Semantic Segmentation
    Xiaobo Yang, Danning Ke, Xiaojin Gong · 2023 · International Conference on Wireless Communications and Signal Processing (WCSP)
  83. Using Cross-Model EgoSupervision to Learn Cooperative Basketball Intention
    Gedas Bertasius, Jianbo Shi · 2017 · arXiv (Cornell University)
  84. Privileged Pooling: Better Sample Efficiency Through Supervised Attention
    Andrés C. Rodríguez, Stefano D’Aronco, Konrad Schindler, Jan Dirk Wegner · 2020 · arXiv (Cornell University)
  85. Look at here : Utilizing supervision to attend subtle key regions
    Changhwan Lee, Kim, Yeesuk, Lee, Bong Gun, Doo-Sup Kim, Jongseong Jang · 2021 · arXiv (Cornell University)
  86. Volterra Neural Networks (Vnns)
    Hamid Krim, Siddharth Roheda · 2025 · SSRN Electronic Journal
  87. cvpaper.challenge in 2016: Futuristic Computer Vision through 1,600 Papers Survey
    Hirokatsu Kataoka, Soma Shirakabe, He, Yun, Shunya Ueta, Teppei Suzuki, Kaori Abe, Asako Kanezaki, Morita, Shin'ichiro, Toshiyuki Yabe, Yoshihiro Kanehara et al. · 2017 · arXiv (Cornell University)
  88. Weakly Supervised Collective Feature Learning From Curated Media
    Yusuke Mukuta, Akisato Kimura, David Adrian, Zoubin Ghahramani A · 2018 · Proceedings of the AAAI Conference on Artificial Intelligence
  89. An Encoder Generative Adversarial Network for Multi-modality Image Recognition
    Yu Chen, Chunling Yang, Min Zhu, Shiyan Yang · 2018 · Annual Conference of the IEEE Industrial Electronics Society (IECON)
  90. Learning to see across Domains and Modalities
    Fabio Maria Carlucci · 2019 · arXiv (Cornell University)
  91. Commuting Conditional GANs for Robust Multi-Modal Fusion.
    Siddharth Roheda, Hamid Krim, Benjamin S. Riggan · 2019 · arXiv (Cornell University)
  92. Learning visual attributes from contextual explanations
    Nils Murrugarra-Llerena · 2019 · D-Scholarship@Pitt (University of Pittsburgh)
  93. Car Pose in Context: Accurate Pose Estimation with Ground Plane Constraints
    Pengfei Li, Weichao Qiu, Michael Peven, Gregory D. Hager, Alan Yuille · 2019 · arXiv (Cornell University)
  94. MirrorGen Wearable Gesture Recognition using Synthetic Videos
    Arun Srivatsa Ramesh · 2018
  95. Domain Adaptation and Privileged Information for Visual Recognition
    Saeid Motiian · 2019
  96. Deep Learning Architectures for Heterogeneous Face Recognition
    Seyed Mehdi Iranmanesh · 2021
  97. Feature-Supervised Action Modality Transfer
    Fida Mohammad Thoker, Cees G. M. Snoek · 2021 · arXiv (Cornell University)
  98. Correlation discovery for multi-view and multi-label learning
    Lichen Wang · 2021
  99. Improving Person Re-identification with Semantically Aligned Appearance Transformer
    Hui Li, Yinglin Zheng, Zhaodong Tan, Wenjin Deng · 2022 · International Joint Conference on Neural Networks (IJCNN)
  100. Lung Cancer Risk Prediction Model Trained with Multi-source Data
    Shijie Sun, Hanyue Liu, Ye Wang, Yu Hong · 2024 · Lecture notes in computer science