Gao, Jianfeng

MS-Celeb-1M: A Dataset and Benchmark for Large-Scale Face Recognition

Guo, Y., Zhang, L., Hu, Y., He, X., & Gao, J. (2016) · Lecture Notes in Computer Science

Face recognition and analysisFace and Expression Recognition

Cited by 2,122

A Persona-Based Neural Conversation Model

Li, J., Galley, M., Brockett, C., Spithourakis, G., Gao, J., & Dolan, B. (2016) · Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)

Speech and dialogue systemsAI in Service Interactions

Cited by 898

Unified Vision-Language Pre-Training for Image Captioning and VQA

Zhou, L., Palangi, H., Zhang, L., Hu, H., Corso, J., & Gao, J. (2020) · Proceedings of the AAAI Conference on Artificial Intelligence

Multimodal Machine Learning ApplicationsTopic Modeling

Cited by 864

Reinforced Cross-Modal Matching and Self-Supervised Imitation Learning for Vision-Language Navigation

Wang, X., Huang, Q., Celikyilmaz, A., Gao, J., Shen, D., Wang, Y.-F., Wang, W. Y., & Zhang, L. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)

Multimodal Machine Learning ApplicationsReinforcement Learning in Robotics

Cited by 522

Florence: A New Foundation Model for Computer Vision

Yuan, L., Chen, D., Chen, Y.-L., Codella, N., Dai, X., Gao, J., Hu, H., Huang, X., Li, B., Li, C., et al. (2021) · arXiv

Multimodal Machine Learning ApplicationsAdvanced Neural Network Applications

Cited by 389

Towards Learning a Generic Agent for Vision-and-Language Navigation via Pre-Training

Hao, W., Li, C., Li, X., Carin, L., & Gao, J. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)

Multimodal Machine Learning ApplicationsReinforcement Learning in Robotics

Cited by 264

Vision-Language Pre-Training: Basics, Recent Advances, and Future Trends

Gan, Z., Li, L., Li, C., Wang, L., Liu, Z., & Gao, J. (2022) · Foundations and Trends® in Computer Graphics and Vision

Multimodal Machine Learning ApplicationsDomain Adaptation and Few-Shot Learning

Cited by 155

KAT: A Knowledge Augmented Transformer for Vision-and-Language

Gui, L., Wang, B., Huang, Q., Hauptmann, A., Bisk, Y., & Gao, J. (2022) · Proceedings of the 2022 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies

Multimodal Machine Learning ApplicationsTopic Modeling

Cited by 130

TACo: Token-aware Cascade Contrastive Learning for Video-Text Alignment

Yang, J., Bisk, Y., & Gao, J. (2021) · 2021 IEEE/CVF International Conference on Computer Vision (ICCV)

Multimodal Machine Learning ApplicationsHuman Pose and Action Recognition

Cited by 115

Agent AI: Surveying the Horizons of Multimodal Interaction

Durante, Z., Huang, Q., Wake, N., Gong, R., Park, J. S., Sarkar, B., Taori, R., Noda, Y., Terzopoulos, D., Choi, Y., et al. (2024) · arXiv

Multimodal Machine Learning ApplicationsSpeech and dialogue systems

Cited by 75

Learning Via-Point Movement Primitives with Inter- and Extrapolation Capabilities

Zhou, Y., Gao, J., & Asfour, T. (2019) · 2019 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS)

Reinforcement Learning in RoboticsRobot Manipulation and Learning

Cited by 61

TIGEr: Text-to-Image Grounding for Image Caption Evaluation

Jiang, M., Huang, Q., Zhang, L., Wang, X., Zhang, P., Gan, Z., Diesner, J., & Gao, J. (2019) · Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP)

Multimodal Machine Learning ApplicationsNatural Language Processing Techniques

Cited by 59

A clinically accessible small multimodal radiology model and evaluation metric for chest X-ray findings

Zambrano Chaves, J. M., Huang, S.-C., Xu, Y., Xu, H., Usuyama, N., Zhang, S., Wang, F., Xie, Y., Khademi, M., Yang, Z., et al. (2025) · Nature Communications

Multimodal Machine Learning ApplicationsArtificial Intelligence in Healthcare and Education

Cited by 45

Set-of-Mark Prompting Unleashes Extraordinary Visual Grounding in GPT-4V

Yang, J., Zhang, H., Li, F., Zou, X., Li, C., & Gao, J. (2023) · arXiv

Multimodal Machine Learning ApplicationsAdvanced Neural Network Applications

Cited by 25

Tensor Programs V: Tuning Large Neural Networks via Zero-Shot Hyperparameter Transfer

Yang, G., Hu, E. J., Babuschkin, I., Sidor, S., Liu, X., Farhi, D., Ryder, N., Pachocki, J., Chen, W., & Gao, J. (2022) · arXiv

Machine Learning and Data ClassificationDomain Adaptation and Few-Shot Learning

Cited by 23

MathVista: Evaluating Mathematical Reasoning of Foundation Models in Visual Contexts

Lu, P., Bansal, H., Xia, T., Liu, J., Li, C., Hajishirzi, H., Cheng, H., Chang, K.-W., Galley, M., & Gao, J. (2023) · arXiv

Multimodal Machine Learning ApplicationsMathematics, Computing, and Information Processing

Cited by 12

CodeExp: Explanatory Code Document Generation

Cui, H., Wang, C., Huang, J., Inala, J. P., Mytkowicz, T., Wang, B., Gao, J., & Duan, N. (2022) · arXiv

Software Engineering ResearchTopic Modeling

Cited by 2