Unified Language Model Pre-training for Natural Language Understanding and Generation
Dong, Li, Yang, Nan, Wang, Wenhui, Wei, Furu, Liu, Xiaodong, Wang, Yu, Gao, Jianfeng, Zhou, Ming +1 more·2019·arXiv
Cited by (1,008)
Items 801–900 of 1,008
- XDoc: Unified Pre-training for Cross-Format Document UnderstandingJingye Chen, Tengchao Lv, Lei Cui, Cha Zhang, Furu Wei · 2022 · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP)
- Bridging the Gap between Pre-Training and Fine-Tuning for Commonsense GenerationHaoran Yang, Yan Wang, Piji Li, Wei Bi, Wai Pang Lam, Chen Xu · 2023 · Findings of the Association for Computational Linguistics: EACL
- Distantly Supervised Relation Extraction via Contextual Information Interaction and Relation EmbeddingsHuixin Yin, Shengquan Liu, Zhaorui Jian · 2023 · Symmetry
- A Two-Stage Chinese Medical Video Retrieval Framework with LLMNingjie Lei, Jinxiang Cai, Yixin Qian, Zhilong Zheng, Chao Han, Zhiyue Liu, Qingbao Huang · 2023 · Lecture notes in computer science
- Improving Multi-Stage Long Document Summarization with Enhanced Coarse SummarizerJinhyeong Lim, Hyun-Je Song · 2023 · Workshop on New Frontiers in Summarization (NewSum)
- A Legal News Summarisation Model Based on RoBERTa, T5 and Dilated Gated CNNWeijian Qin, Xudong Luo · 2023 · IEEE International Conference on Tools with Artificial Intelligence (ICTAI)
- Semantic-Aware Autoregressive Image Modeling for Visual Representation LearningKaiyou Song, Shan Zhang, Tong Wang · 2024 · Proceedings of the AAAI Conference on Artificial Intelligence
- RoUIE: A Method for Constructing Knowledge Graph of Power Equipment Based on Improved Universal Information ExtractionZhenhao Ye, Donglian Qi, Hanlin Liu, Yunfeng Yan, Qihao Chen, Xiayu Liu · 2024 · Energies
- A Generative Text Summarization Method Based on mT5 and Large Language ModelsFeng Liu, Caiquan Xiong · 2023 · International Conference on Advanced Cloud and Big Data
- Foundation models in molecular biologyYunda Si, Jiawei Zou, Yicheng Gao, Guohui Chuai, Qi Liu, Luonan Chen · 2024 · Biophysics Reports
- RLANET: An EEG denoising network for judgemental removal of long- and short-term distribution artefactsFengjie Wu, Jisen Yang, Jiarui Liu, Zhaolong Lin, Yan He, Lihan Zhang · 2025 · Biomedical Signal Processing and Control
- TextBlockV2: Towards Precise-Detection-Free Scene Text Spotting with Pre-trained Language ModelJiahao Lyu, Wei Jin, Gangyan Zeng, Li Zeng, Enze Xie, Wei Wang, Can Ma, Yu Zhou · 2025 · ACM Transactions on Multimedia Computing Communications and Applications
- Language-Agnostic and Language-Aware Multilingual Natural Language Understanding for Large-Scale Intelligent Voice Assistant ApplicationDaniel Yue Zhang, Jonathan Hueser, Yao Li, Sarah Campbell · 2021 · IEEE International Conference on Big Data (BigData)
- GRAM: Fast Fine-tuning of Pre-trained Language Models for Content-based Collaborative FilteringYoonseok Yang, Kyu Seok Kim, Minsam Kim, Juneyoung Park · 2022 · Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT)
- Neural Label Search for Zero-Shot Multi-Lingual Extractive SummarizationRuipeng Jia, Xingxing Zhang, Yanan Cao, Zheng Lin, Shi Wang, Furu Wei · 2022 · Proceedings of the conference - Association for Computational Linguistics. Meeting
- Context-Aware Coherent Speaking Style Prediction with Hierarchical Transformers for Audiobook Speech SynthesisShun Lei, Yixuan Zhou, Liyang Chen, Zhiyong Wu, Shiyin Kang, Helen M. L. Meng · 2023 · IEEE International Conference on Acoustics Speech and Signal Processing
- Forging Multiple Training Objectives for Pre-trained Language Models via Meta-LearningHongqiu Wu, Ruixue Ding, Hai Yan Zhao, Boli Chen, Pengjun Xie, Fei Huang, Min Zhang · 2022 · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP)
- Denoising based Sequence-to-Sequence Pre-training for Text GenerationLiang Wang, Wei Zhao, Ruoyu Jia, Sujian Li, Jingming Liu · 2019 · arXiv (Cornell University)
- Scaling Distributed Training with Adaptive SummationSaeed Maleki, Madanlal Musuvathi, Todd Mytkowicz, Olli Saarikivi, Tianju Xu, Vadim Eksarevskiy, Jaliya Ekanayake, Emad Barsoum · 2020 · arXiv (Cornell University)
- Knowledge-Grounded Dialogue Generation with Pre-trained Language ModelsXueliang Zhao, Wei Wu, Can Xu, Chongyang Tao, Dong-Yan Zhao, Rui Yan · 2020 · Conference on Empirical Methods in Natural Language Processing
- Generalized Conditioned Dialogue Generation Based on Pre-trained Language Model.Yan Zeng, Jian‐Yun Nie · 2020 · arXiv (Cornell University)
- Outline to Story: Fine-grained Controllable Story Generation from Cascaded EventsLe Fang, Tao Zeng, Chaochun Liu, Liefeng Bo, Wen Dong, Changyou Chen · 2021 · arXiv (Cornell University)
- LOGO, a contextualized pre-trained language model of human genome flexibly adapts to various downstream tasks by fine-tuningMeng Yang, Haiping Huang, Lichao Huang, Nan Zhang, Jihong Wu, Huanming Yang, Feng Mu · 2021 · Research Square
- It is AI's Turn to Ask Human a Question: Question and Answer Pair Generation for Children Storybooks in FairytaleQA Dataset.Bingsheng Yao, Dakuo Wang, Tongshuang Wu, Tran Manh Hoang, Branda Sun, Toby Jia-Jun Li, Mo Yu, Ying Xu · 2021 · arXiv (Cornell University)
- I Do Not Understand What I Cannot Define: Automatic Question Generation With Pedagogically-Driven Content SelectionTim Steuer, Anna Filighera, Tobias Meuser, Christoph Rensing · 2021 · arXiv (Cornell University)
- Twitter Sentiment Analysis Tweets Using Hugging Face Harnessing NLP for Social Media InsightsV. Jayalakshmi, M. Lakshmi · 2024 · Communications in computer and information science
- From Large to Tiny: Distilling and Refining Mathematical Expertise for Math Word Problems with Weakly SupervisionQingwen Lin, Boyan Xu, Zhengting Huang, Ruichu Cai · 2024 · Lecture notes in computer science
- Modeling radiologists’ cognitive processes using a digital gaze twin to enhance radiology trainingAkash Awasthi, Anh Mai Vu, Ngan Le, Zhigang Deng, Supratik Maulik, Rishi Agrawal, Carol C. Wu, Hien Van Nguyen · 2025 · Scientific Reports
- Smoothing Dialogue States for Open Conversational Machine ReadingZhuosheng Zhang, Siru Ouyang, Hai Zhao, Masao Utiyama, Eiichiro Sumita · 2021 · Conference on Empirical Methods in Natural Language Processing (EMNLP)
- Reference Matters: Benchmarking Factual Error Correction for Dialogue Summarization with Fine-grained Evaluation FrameworkMingqi Gao, Xiaojun Wan, Jia Su, Zhefeng Wang, Baoxing Huai · 2023 · Proceedings of the conference - Association for Computational Linguistics. Meeting
- In-sample Curriculum Learning by Sequence Completion for Natural Language GenerationQi Fen Jia, Yizhu Liu, Haifeng Tang, Kenny Qili Zhu · 2023 · Proceedings of the conference - Association for Computational Linguistics. Meeting
- Global Structure Knowledge-Guided Relation Extraction Method for Visually-Rich DocumentXiangnan Chen, Qian Xiao, Juncheng Li, Duo Dong, Jun Lin, Xiaozhong Liu, Siliang Tang · 2023 · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP)
- Beyond Segmentation: Road Network Generation with Multi-modal LLMsSumedh Rasal, Sanjay K. Boddhu · 2024 · Lecture notes in networks and systems
- SATS: simplification aware text summarization of scientific documentsFarooq Zaman, Faisal Kamiran, Matthew Shardlow, Saeed‐Ul Hassan, Asim Karim, Naif Radi Aljohani · 2024 · Frontiers in Artificial Intelligence
- Optimizing pipeline task-oriented dialogue systems using post-processing networksAtsumoto Ohashi, Ryuichiro Higashinaka · 2024 · Computer Speech & Language
- Attributing ChatGPT-Generated Source CodesSoohyeon Choi, Aziz Mohaisen · 2025 · IEEE Transactions on Dependable and Secure Computing
- Optimized Biomedical Question-Answering Services with LLM and Multi-BERT IntegrationCheng Qian, Xianglong Shi, Shanshan Yao, Yichen Liu, Fengming Zhou, Zishu Zhang, Junaid Akram, Ali Braytee, Ali Anaissi · 2024 · IEEE ... International Conference on Data Mining workshops
- MIHNet: Combining N-gram, Sequential and Global Information for Text ClassificationYingxin Song · 2020 · Journal of Physics Conference Series
- Real-Time Cognitive Evaluation of Online Learners through Automatically Generated QuestionsRitu Gala, Revathi Vijayaraghavan, Valmik B. Nikam, Arvind W. Kiwelekar · 2021 · IEEE International Conference on Cognitive Informatics & Cognitive Computing (ICCI*CC)
- CCMC: Code Completion with a Memory Mechanism and a Copy MechanismHao Yang, Li Kuang · 2021 · International Conference on Evaluation and Assessment in Software Engineering (EASE)
- Women’s Mental Health Chatbot Using Seq2seq With AttentionEt. al. Dr. S. Prabakeran · 2021 · Türk bilgisayar ve matematik eğitimi dergisi
- Building the Directed Semantic Graph for Coherent Long Text GenerationZiao Wang, Xiaofeng Zhang, Hongwei Du · 2021 · Conference on Empirical Methods in Natural Language Processing (EMNLP)
- A Background Knowledge Revising and Incorporating Dialogue ModelXinyan Zhao, Xiao Feng, Huanhuan Chen · 2021 · IEEE Transactions on Neural Networks and Learning Systems
- AUTOMATIC QUESTION GENERATION THROUGH WORD VECTOR SYNCHRONIZATION USING LAMMAKhushbu Khandait, Sohel A. Bhura, Suresh S. Asole · 2022 · Indian Journal of Computer Science and Engineering
- Neural Question Generation for the Portuguese Language: A Preliminary StudyBernardo Leite, Henrique Lopes Cardoso · 2022 · Lecture notes in computer science
- Ensemble Model of Visual Transformer and CNN Helps BA Diagnosis for Doctors in Underdeveloped AreasZhenghao Wei · 2023 · Lecture notes in computer science
- Zero-Shot Generalizable End-to-End Task-Oriented Dialog System using Context Summarization and Domain SchemaAdib Mosharrof, M. H. Maqbool, A. B. Siddique · 2023 · Proceedings of the ... International Florida Artificial Intelligence Research Society Conference
- Semantic Simplification for Sentiment ClassificationXiaotong Jiang, Zhongqing Wang, Guodong Zhou · 2022 · Conference on Empirical Methods in Natural Language Processing (EMNLP)
- ZRIGF: An Innovative Multimodal Framework for Zero-Resource Image-Grounded Dialogue GenerationBo Zhang, Jian Wang, Hui Ma, Bo Xu, Hongfei Lin · 2023 · ACM International Conference on Multimedia (ACM MM)
- Mutually improved response generation and dialogue summarization for multi-domain task-oriented dialogue systemsMeng Zhao, Lifang Wang, Hongru Ji, Zejun Jiang, Ronghan Li, Xinyu Lu, Zhongtian Hu · 2023 · Knowledge-Based Systems
- ReSee: Responding through Seeing Fine-grained Visual Knowledge in Open-domain DialogueHaoqin Tu, Yitong Li, Fei Mi, Zhongliang Yang · 2023 · Conference on Empirical Methods in Natural Language Processing (EMNLP)
- Enhancing Abstractive Dialogue Summarization with Internal KnowledgeShaolei Wang, Hanhan Ma, Yunxiang Zhang, Jing Ma, Liang Ju He · 2024 · International Joint Conference on Neural Networks (IJCNN)
- Graph-Structured Context Understanding for Knowledge-grounded Response GenerationYanran Li, Wenjie Li, Zhitao Wang · 2021 · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR)
- Multi-Lingual Question Generation with Language Agnostic Language ModelBingning Wang, Ting Yao, Weipeng Chen, Jingfang Xu, Xiaochuan Wang · 2021 · Findings of the Association for Computational Linguistics: ACL (Findings of ACL)
- CUSTOM: Aspect-Oriented Product Summarization for E-CommerceJiahui Liang, Junwei Bao, Yifan Wang, Youzheng Wu, Xiaodong He, Bowen Zhou · 2021 · Lecture notes in computer science
- Capturing Speaker Incorrectness: Speaker-Focused Post-Correction for Abstractive Dialogue SummarizationDongyub Lee, Jungwoo Lim, Taesun Whang, Chanhee Lee, Seungwoo Cho, Mingun Park, Heuiseok Lim · 2021 · Workshop on New Frontiers in Summarization (NewSum)
- COVID-19 Knowledge Graph for Drug and Vaccine DevelopmentLan Huang, Hongrui Guan, Yanchun Liang, Renchu Guan, Xiaoyue Feng · 2021 · IEEE International Conference on Bioinformatics and Biomedicine (BIBM)
- Combining Temporal Event Relations and Pre-Trained Language Models for Text SummarizationDivyanshu Daiya · 2020 · International Conference on Machine Learning and Applications
- Generation of English Question Answer Exercises from Texts using Transformers based ModelsGonzalo Berger, Tatiana Rischewski, Luis Chiruzzo, Aiala Rosá · 2022 · IEEE Latin American Conference on Computational Intelligence (LA-CCI)
- Train and You'll Miss It: Interactive Model Iteration with Weak Supervision and Pre-Trained EmbeddingsMayee F. Chen, Daniel Y. Fu, Frédéric Sala, Sen Wu, Ravi Teja Mullapudi, Fait Poms, Kayvon Fatahalian, Christopher Ré · 2020 · arXiv (Cornell University)
- Generating Fact Checking BriefsAngela Fan, Aleksandra Piktus, Fabio Petroni, Guillaume Wenzek, Marzieh Saeidi, Andreas Vlachos, Antoine Bordes, Sebastian Riedel · 2020 · arXiv (Cornell University)
- LOREN: Logic Enhanced Neural Reasoning for Fact Verification.Jiangjie Chen, Qiaoben Bao, Jiaze Chen, Changzhi Sun, Hao Zhou, Yanghua Xiao, Lei Li · 2020 · arXiv (Cornell University)
- Learning to Retrieve Entity-Aware Knowledge and Generate Responses with Copy Mechanism for Task-Oriented Dialogue SystemsChao-Hong Tan, Xiaoyu Yang, Zi’ou Zheng, Tianda Li, Yufei Feng, Jia-Chen Gu, Quan Liu, Dan Liu, Zhen-Hua Ling, Xiaodan Zhu · 2020 · arXiv (Cornell University)
- A Unified Pre-training Framework for Conversational AISiqi Bao, B. J. Chen, He Huang, Xin Tian, Han Zhou, Fan Wang, Hua Ren Wu, Haifeng Wang, Wenquan Wu, Yingzhan Lin · 2021 · arXiv (Cornell University)
- Long Text Generation by Modeling Sentence-Level and Discourse-Level CoherenceGuan, Jian, Xiaoxi Mao, Changjie Fan, Zitao Liu, Wenbiao Ding, Minlie Huang · 2021 · arXiv (Cornell University)
- Improving Factual Consistency of Abstractive Summarization via Question AnsweringNan, Feng, Cícero Nogueira dos Santos, Henghui Zhu, Ng, Patrick, Kathleen R. McKeown, Ramesh M. Nallapati, Dejiao Zhang, Zhiguo Wang, Andrew O. Arnold, Bing Xiang · 2021 · arXiv (Cornell University)
- BASS: Boosting Abstractive Summarization with Unified Semantic GraphWenhao Wu, Wei Li, Xinyan Xiao, Jiachen Liu, Ziqiang Cao, Sujian Li, Hua Ren Wu, Haifeng Wang · 2021 · arXiv (Cornell University)
- Improving Controllability of Educational Question Generation by Keyword ProvisionYing-Hong Chan, Ho-Lam Chung, Yao-Chung Fan · 2021 · arXiv (Cornell University)
- Effective transfer learning for low-resource natural language understandingZihan Liu · 2022
- Proceedings of the 5th Workshop on NLP for Conversational AI (NLP4ConvAI 2023)2023
- Improving neural machine translation of languages with little data and rich morphologyPrajit Dhar · 2024
- OSTOD: One-Step Task-Oriented Dialogue with activated state and retelling responseHeyan Huang, Puhai Yang, Wei Wei, Shumin Shi, Xian-Ling Mao · 2024 · Knowledge-Based Systems
- Deep learning-based modified transformer model for automated news article summarizationB. Srinivas, Lavanya Bagadi, Naresh K. Darimireddy, P. Surya Prasad, Sivaji Satrasupalli, B. Anil Kumar · 2024 · Facta universitatis - series Electronics and Energetics
- A Transformer-Based Approach for Efficient Geometric Feature Extraction from Vector Shape DataLongfei Cui, Xinyu Niu, Haizhong Qian, Xiao Wang, Junkui Xu · 2025 · Applied Sciences
- ScIRGen: Synthesize Realistic and Large-Scale RAG Dataset for Scientific ResearchJunyong Lin, Lu Dai, Ruiqian Han, Yijie Sui, R. Wang, Xingliang Sun, Qinglin Wu, Min Feng, Hao Liu, Hui Xiong · 2025 · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD)
- Efficient Fusion and Task Guided Embedding for End-to-End Autonomous DrivingYipin Guo, Yilin Lang, Qinyuan Ren · 2024 · IEEE Data Driven Control and Learning Systems Conference (DDCLS)
- A multi-cycle recursive clustering algorithm for the analysis of social media data streamsAyodeji O. Ayorinde, John Panneerselvam, Bo Yuan, Lu Liu · 2024 · Peer-to-Peer Networking and Applications
- Text similarity based on two independent channels: Siamese Convolutional Neural Networks and Siamese Recurrent Neural NetworksZhengfang He · 2025 · Neurocomputing
- Question Generation from Code Snippets and Programming Error MessagesBolun Yao, Wei Chen, Yeyun Gong, Bartuer Zhou, Jin Xie, Zhongyu Wei, Biao Cheng, Nan Duan · 2021 · Lecture notes in computer science
- Chinese Math Word Problems Generation NetworkJunjian Huang, Ming Ze Xu, Hengyi Zheng, Qian Shang · 2021 · Journal of Physics Conference Series
- Two-phase Multi-document Event Summarization on Core Event GraphsZengjian Chen, Jin Xu, Meng Liao, Tong Xue, Kun He · 2022 · Journal of Artificial Intelligence Research
- Deep Sentiment Analysis of the Feelings Expressed by Tourists Based on BERT ModelMing Wang, Ying Yu · 2022 · International Conference on Culture-oriented Science & Technology (ICCST)
- A BERT-Based Pre-Training Model for Solving Math Application ProblemsYuhao Jia, Pingheng Wang, Zhen Zhang, Cheng Chi, Zhifei Li, Xinguo Yu · 2022 · International Conference on Intelligent Education and Intelligent Research (IEIR)
- An information theoretic score for learning hierarchical conceptsOmid Madani · 2023 · Frontiers in Computational Neuroscience
- Context Aware Automatic Subjective and Objective Question Generation using Fast Text to Text Transfer LearningArpit Agrawal, Pragya Shukla · 2023 · International Journal of Advanced Computer Science and Applications
- HVCMM: A Hybrid-View Abstractive Model of Automatic Summary Generation for TeachingHao Zhang, Sannyuya Liu, Yaopeng Li, Wang Ren, Hang Tong, Jiaheng Cao, Qiankun Zhou · 2023 · IEEE Transactions on Neural Networks and Learning Systems
- Dialog-Post: Multi-Level Self-Supervised Objectives and Hierarchical Model for Dialogue Post-TrainingZhenyu Zhang, Lei Shen, Yuming Zhao, Meng Chen, Xiaodong He · 2023 · Proceedings of the conference - Association for Computational Linguistics. Meeting
- Dynamic and Efficient Inference for Text Generation via BERT FamilyXiaobo Liang, Juntao Li, Lijun Wu, Ziqiang Cao, Min Zhang · 2023 · Proceedings of the conference - Association for Computational Linguistics. Meeting
- Is Prompt the Future?Zhu Zhen, Liting Wang, Dongmei Gu, Hong King Wu, Behrooz Janfada, Behrouz Minaei Bidgoli · 2023 · International Journal of Information Technologies and Systems Approach
- Structure-Aware Dialogue Modeling Methods for Conversational Semantic Role LabelingHan Wu, Kun Xu, Linqi Song · 2023 · IEEE/ACM Transactions on Audio Speech and Language Processing
- Evaluating and Enhancing the Robustness of Code Pre-trained Models through Structure-Aware Adversarial Samples GenerationNuo Chen, Qiushi Sun, Jianing Wang, Ming Yu Gao, Xiaoli Li, Xiang Li · 2023 · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP)
- DocumentNet: Bridging the Data Gap in Document Pre-trainingLijun Yu, Miao Jin, Xiaoyu Sun, Jiayi Chen, Alexander G. Hauptmann, Hanjun Dai, Wei Wei · 2023 · Conference on Empirical Methods in Natural Language Processing (EMNLP)
- Towards Low-Resource Automatic Program Repair with Meta-Learning and Pretrained Language ModelsWeishi Wang, Yue Wang, Steven C. H. Hoi, Shafiq Joty · 2023 · Conference on Empirical Methods in Natural Language Processing (EMNLP)
- TLM: Token-Level Masking for TransformersYangjun Wu, Kebin Fang, Dongxiang Zhang, Han Wang, Hao Zhang, Gang Chen · 2023 · Conference on Empirical Methods in Natural Language Processing (EMNLP)
- Unsupervised question-retrieval approach based on topic keywords filtering and multi-task learningShang Aiguo, Xinjuan Zhu, Michael Danner, Matthias Rätsch · 2024 · Computer Speech & Language
- Cross-biased contrastive learning for answer selection with dual-tower structureXingnan Jin, Yongping Du, Binrui Wang, Qi Zhang · 2024 · Neurocomputing
- Adaptive Multidocument Summarization Via Graph Representation LearningGui-Huang Zeng, Yanqin Liu, Chun-Yang Zhang, Hai-Chun Cai, C. L. Philip Chen · 2024 · IEEE Transactions on Cognitive and Developmental Systems
- BD2TSumm: A Benchmark Dataset for Abstractive Disaster Tweet SummarizationPiyush Kumar Garg, Roshni Chakraborty, Sourav Kumar Dandapat · 2025 · Online Social Networks and Media
- Knowledge-Aligned Domain Shift Tuning for Efficient Adaptation in Large Language ModelsNoriaki Kawamae · 2025 · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD)
- Rethinking visual prompt learning as masked visual token modelingNing Liao, Bowen Shi, Xiaopeng Zhang, Min Cao, Junchi Yan, Qi Chuan Tian · 2025 · Artificial Intelligence