Unified Language Model Pre-training for Natural Language Understanding and Generation
Dong, Li, Yang, Nan, Wang, Wenhui, Wei, Furu, Liu, Xiaodong, Wang, Yu, Gao, Jianfeng, Zhou, Ming +1 more·2019·arXiv
Cited by (1,008)
Items 701–800 of 1,008
- Improving Non-autoregressive Generation with Mixup TrainingJiang, Ting, Shaohan Huang, Zihan Zhang, Deqing Wang, Fuzhen Zhuang, Furu Wei, Haizhen Huang, Liang‐Jie Zhang, Qi Zhang · 2021 · arXiv (Cornell University)
- Proceedings of the 4th Clinical Natural Language Processing Workshop2022
- Diversify Question Generation with Retrieval-Augmented Style TransferGou, Qi, Xia, Zehua, Yu, Bowen, Yu, Haiyang, Huang, Fei, Li, Yongbin, Cam-Tu, Nguyen · 2023 · arXiv
- MedT2T: An adaptive pointer constrain generating method for a new medical text-to-table taskWang Zhao, Dongxiao Gu, Xuejie Yang, Meihuizi Jia, Changyong Liang, Xiaoyu Wang, Олег Золотарев · 2024 · Future Generation Computer Systems
- Integrating Topic-Aware Heterogeneous Graph Neural Network With Transformer Model for Medical Scientific Document Abstractive SummarizationAyesha Khaliq, Atif Khan, Salman Afsar Awan, Salman Jan, Muhammad Umair, Megat F. Zuhairi · 2024 · IEEE Access
- Leveraging Large Language Models for Wireless Symbol Detection via In-Context LearningMomin Abbas, Koushik Kar, Tianyi Chen · 2024 · Globecom
- Enhance Incomplete Utterance Restoration by Joint Learning Token Extraction and Text GenerationShumpei Inoue, Tsungwei Liu, Son Nguyen, Minh-Tien Nguyen · 2022 · Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT)
- Unified Contextual Query RewritingYingxue Zhou, Jie Hao, Mukund Rungta, Yang Liu, Eunah Cho, Xing Fan, Yanbin Lu, Vishal Vasudevan, Kellen Gillespie, Zeynab Raeesy · 2023 · Proceedings of the conference - Association for Computational Linguistics. Meeting
- Generating Information-Seeking Conversations from Unlabeled DocumentsGangwoo Kim, Sungdong Kim, Kang Min Yoo, Jaewoo Kang · 2022 · Conference on Empirical Methods in Natural Language Processing (EMNLP)
- TSGP: Two-Stage Generative Prompting for Unsupervised Commonsense Question AnsweringYueqing Sun, Yu Zhang, Le Qi, Qi Shi · 2022 · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP)
- GO2Sum: generating human-readable functional summary of proteins from GO termsSwagarika Jaharlal Giri, Nabil Ibtehaz, Daisuke Kihara · 2024 · npj Systems Biology and Applications
- Unified extractive-abstractive summarization: a hybrid approach utilizing BERT and transformer models for enhanced document summarizationS. Divya, N. Sripriya, J. Andrew, Manuel Mazzara · 2024 · PeerJ Computer Science
- An Investigation of Suitability of Pre-Trained Language Models for Dialogue Generation – Avoiding DiscrepanciesYan Zeng, Jian‐Yun Nie · 2021 · Findings of the Association for Computational Linguistics: ACL (Findings of ACL)
- Text Embedding Augmentation Based on Retraining With Pseudo-Labeled Adversarial EmbeddingMyeongsup Kim, Pilsung Kang · 2022 · IEEE Access
- VU-BERT: A Unified Framework for Visual DialogTong Ye, Shijing Si, Jianzong Wang, Rui Wang, Ning Cheng, Jing Zhong Xiao · 2022 · IEEE International Conference on Acoustics Speech and Signal Processing
- ElitePLM: An Empirical Study on General Language Ability Evaluation of Pretrained Language ModelsJunyi Li, Tianyi Tang, Zheng Gong, Lixin Yang, Zhuohao Yu, Zhipeng Chen, Jingyuan Wang, Xin Wayne Zhao, Ji-Rong Wen · 2022 · Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT)
- Should We Trust This Summary? Bayesian Abstractive Summarization to The RescueAlexios Gidiotis, Grigorios Tsoumakas · 2022 · Findings of the Association for Computational Linguistics: ACL (Findings of ACL)
- qaAskeR$$^+$$: a novel testing method for question answering software via asking recursive questionsXiaoyuan Xie, Shuo Jin, Songqiang Chen · 2023 · Automated Software Engineering
- CapOnImage: Context-driven Dense-Captioning on ImageYiqi Gao, Xinglin Hou, Yuanmeng Zhang, Tiezheng Ge, Yuning Jiang, Peng Wang · 2022 · Conference on Empirical Methods in Natural Language Processing (EMNLP)
- Confidence-based Syntax encoding network for better ancient Chinese understandingShitou Zhang, Ping Wang, Zuchao Li, Jingrui Hou, Qibiao Hu · 2023 · Information Processing & Management
- Dialogue for Prompting: A Policy-Gradient-Based Discrete Prompt Generation for Few-Shot LearningChengzhengxu Li, Xiaoming Liu, Yichen Wang, Duyi Li, Yu Lan, Chao Qun Shen · 2024 · Proceedings of the AAAI Conference on Artificial Intelligence
- Exploring Artificial Jabbering for Automatic Text Comprehension Question GenerationTim Steuer, Anna Filighera, Christoph Rensing · 2020 · Lecture notes in computer science
- Generating Long Financial Report using Conditional Variational Autoencoders with Knowledge DistillationYunpeng Ren, Ziao Wang, Yiyuan Wang, Xiaofeng Zhang · 2021 · Proceedings of the AAAI Conference on Artificial Intelligence
- Dimsum @LaySumm 20Tiezheng Yu, Dan Su, Wenliang Dai, Pascale Fung · 2020 · Workshop on Scholarly Document Processing (SDP)
- Diverse Pretrained Context Encodings Improve Document TranslationDomenic Donato, Lei Yu, Chris Dyer · 2021
- Relational Structure-Aware Knowledge Graph Representation in Complex SpaceKe Sun, Shuo Yu, Ciyuan Peng, Yueru Wang, Osama Alfarraj, Amr Kamal Rabea Tolba, Feng Xia · 2022 · Mathematics
- Solving Geometry Problems via Feature Learning and Contrastive Learning of Multimodal DataPengpeng Jian, Fucheng Guo, Yanli Wang, Yang Li · 2023 · Computer Modeling in Engineering & Sciences
- Commonsense Evidence Generation and Injection in Reading ComprehensionYe Liu, Tao Yang, Zeyu You, Wei Fan, Philip S. Yu · 2020 · Annual Meeting of the Special Interest Group on Discourse and Dialogue
- CohEval: Benchmarking Coherence ModelsTasnim Mohiuddin, Prathyusha Jwalapuram, Xiang Lin, Shafiq Joty · 2020 · arXiv (Cornell University)
- ChineseBERT: Chinese Pretraining Enhanced by Glyph and Pinyin InformationZijun Sun, Xiaoya Li, Xiaofei Sun, Yuxian Meng, Guoyin Wang, Xiang Ao, Qing He, Fei Wu, Jiwei Li · 2021 · arXiv (Cornell University)
- From outputs to insights: a survey of rationalization approaches for explainable text classificationErick Mendez Guzman, Viktor Schlegel, Riza Batista-Navarro · 2024 · Frontiers in Artificial Intelligence
- SSAP: Storylines and Sentiment Aware Pre-Trained Model for Story Ending GenerationYongkang Liu, Qingbao Huang, Jing Li, Linzhang Mo, Yi Cai, Qing Li · 2022 · IEEE/ACM Transactions on Audio Speech and Language Processing
- DIONYSUS: A Pre-trained Model for Low-Resource Dialogue SummarizationYu Li, Baolin Peng, Pengcheng He, Michel Galley, Yu Zhou, Jianfeng Gao · 2023 · Proceedings of the conference - Association for Computational Linguistics. Meeting
- ContraCLM: Contrastive Learning For Causal Language ModelNihal Jain, Dejiao Zhang, Wasi Uddin Ahmad, Zijian Wang, Feng Nan, Xiaopeng Li, Ming Tan, Ramesh M. Nallapati, Baishakhi Ray, Parminder Bhatia et al. · 2023 · Proceedings of the conference - Association for Computational Linguistics. Meeting
- Mutual Information Guided Financial Report Generation With Domain AdaptionZiao Wang, Xiaofeng Zhang, Hongwei Du · 2023 · IEEE Transactions on Emerging Topics in Computational Intelligence
- Dependency-based BERT for Chinese Event Argument ExtractionDai-Yi Li, Li Yan, Zong-Min Ma · 2023 · ACM Trans. Asian Low Resour. Lang. Inf. Process.
- Localize, Retrieve and Fuse: A Generalized Framework for Free-Form Question Answering over TablesWenting Zhao, Ye Liu, Yao Wan, Yibo Wang, Zhongfen Deng, Philip S. Yu · 2023
- Deep Learning Classification of Traffic-Related Tweets: An Advanced Framework Using Deep Learning for Contextual Understanding and Traffic-Related Short Text ClassificationWasen Yahya Melhem, Asad Abdi, Farid Meziane · 2024 · Applied Sciences
- Comprehend Then Predict: Prompting Large Language Models for Recommendation with Semantic and Collaborative DataZhiang Dong, Liya Hu, Jingyuan Chen, Zhihua Wang, Fei Qing Wu · 2025 · ACM Transactions on Information Systems
- Evaluating the Efficacy of Summarization Evaluation across LanguagesFajri Koto, Jey Han Lau, Timothy Baldwin · 2021 · Findings of the Association for Computational Linguistics: ACL (Findings of ACL)
- Towards Few-shot Entity Recognition in Document Images: A Label-aware Sequence-to-Sequence FrameworkZilong Wang, Jingbo Shang · 2022 · Findings of the Association for Computational Linguistics: ACL (Findings of ACL)
- KGR4: Retrieval, Retrospect, Refine and Rethink for Commonsense GenerationXin Liu, Dayiheng Liu, Baosong Yang, Haibo Zhang, Junwei Ding, Wenqing Yao, Weihua Luo, Haiying Zhang, Jinsong Su · 2022 · Proceedings of the AAAI Conference on Artificial Intelligence
- Enhancing Biomedical Scientific Reviews Summarization with Graph-based Factual Evidence Extracted from PapersGiacomo Frisoni, Paolo Italiani, Francesco Boschi, Gianluca Moro · 2022 · International Conference on Data Science, Technology and Applications (DATA)
- Capturing Conversational Interaction for Question Answering via Global History ReasoningJin Qian, Bowei Zou, Mengxing Dong, Xiao Li, Ai Ti Aw, Hong Zhi Yu · 2022 · Findings of the Association for Computational Linguistics: NAACL
- Unsupervised Domain Adaptation for Question Generation with DomainData Selection and Self-trainingPeide Zhu, Claudia Hauff · 2022 · Findings of the Association for Computational Linguistics: NAACL
- AttractionDetailsQA: An Attraction Details Focused on Chinese Question Answering DatasetWeiming Huang, Shiting Xu, Yuhan Wang, Fan Jin, Qingling Chang · 2022 · IEEE Access
- Enhancing Ancient Chinese Understanding with Derived Noisy Syntax TreesPing Wang, Shitou Zhang, Zuchao Li, Jingrui Hou · 2023 · Proceedings of the conference - Association for Computational Linguistics. Meeting
- Anchor-Enhanced Geographical Entity Representation LearningRenyao Chen, Junye Lei, Hong Liang Yao, Tailong Li, Shengwen Li · 2023 · IEEE Transactions on Neural Networks and Learning Systems
- Winnie: Task-Oriented Dialog System with Structure-Aware Contrastive Learning and Enhanced Policy PlanningKaizhi Gao, Tianyu Wang, Zhongjing Ma, Suli Zou · 2024 · Proceedings of the AAAI Conference on Artificial Intelligence
- CHIME: Cross-passage Hierarchical Memory Network for Generative Review Question AnsweringJunru Lu, Gabriele Pergola, Lin Gui, Binyang Li, Yulan He · 2020 · International Conference on Computational Linguistics
- Learning to Sample Replacements for ELECTRA Pre-TrainingYaru Hao, Li Dong, Hangbo Bao, Ke Xu, Furu Wei · 2021 · Findings of the Association for Computational Linguistics: ACL (Findings of ACL)
- Generating Answer Candidates for Quizzes and Answer-Aware Question GeneratorsKristiyan Vachev, Momchil Hardalov, Georgi Karadzhov, Georgi Georgiev, Releva AI, Sofia, Bulgaria, Ivan Kolev Koychev, Preslav Nakov · 2021 · Student Research Workshop .../Proceedings of the Student Research Workshop ...
- Less Is More: Domain Adaptation with Lottery Ticket for Reading ComprehensionHaichao Zhu, Zekun Wang, Heng Zhang, Ming Liu, Sendong Zhao, Bing Qin · 2021 · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP)
- Visual-Text Reference Pretraining Model for Image CaptioningPengfei Li, Min Zhang, Peijie Lin, Jian Wan, Ming Jiang · 2022 · Computational Intelligence and Neuroscience
- Zero-shot Cross-lingual Conversational Semantic Role LabelingHan Wu, Haochen Tan, Kun Xu, Shuqi Liu, Lianwei Wu, Linqi Song · 2022 · Findings of the Association for Computational Linguistics: NAACL
- Pruner to Predictor: An Efficient Pruning Method for Neural Networks CompressionJiaxin Li, Xuan Rao, Songyi Xiao, Bo Zhao, Derong Liu · 2022 · International Conference on Advanced Computational Intelligence (ICACI)
- LOGEN: Few-Shot Logical Knowledge-Conditioned Text Generation With Self-TrainingShumin Deng, Jiacheng Yang, Hongbin Ye, Chuanqi Tan, Mosha Chen, Songfang Huang, Fei Huang, Huajun Chen, Ningyu Zhang · 2023 · IEEE/ACM Transactions on Audio Speech and Language Processing
- Joint Generator-Ranker Learning for Natural Language GenerationWeizhou Shen, Yeyun Gong, Yelong Shen, Song Wang, Xiaojun Quan, Nan Duan, Weizhu Chen · 2023 · Findings of the Association for Computational Linguistics: ACL (Findings of ACL)
- Generating Deep Questions with Commonsense Reasoning Ability from the Text by Disentangled Adversarial InferenceJianxing Yu, Shiqi Wang, Libin Zheng, Qinliang Su, Wei Liu, Baoquan Zhao, Jian Yin · 2023 · Findings of the Association for Computational Linguistics: ACL (Findings of ACL)
- Sentence RepresentationZhiyuan Liu, Yankai Lin, Maosong Sun · 2020 · Springer eBooks
- Unsupervised Pre-training for Natural Language Generation: A Literature ReviewYuanxin Liu, Zheng Lin · 2019 · arXiv (Cornell University)
- Discern: Discourse-Aware Entailment Reasoning Network for Conversational Machine ReadingYifan Gao, Chien-Sheng Wu, Jingjing Li, Shafiq Joty, Steven C. H. Hoi, Caiming Xiong, Irwin King, Michael Rung-Tsong Lyu · 2020 · arXiv (Cornell University)
- Sensitivity of BLANC to human-scored qualities of text summariesOleg Vasilyev, Vedant Dharnidharka, Nicholas Egan, Charlene Chambliss, Bohannon, John · 2020 · arXiv (Cornell University)
- Stronger Transformers for Neural Multi-Hop Question GenerationDevendra Singh Sachan, Lingfei Wu, Mrinmaya Sachan, William L. Hamilton · 2020 · arXiv (Cornell University)
- Lexically-constrained Text Generation through Commonsense Knowledge Extraction and InjectionYikang Li, Pulkit Goel, Varsha Kuppur Rajendra, Har Simrat Singh, Jonathan Francis, Kaixin Ma, Eric Nyberg, Alessandro Oltramari · 2020 · arXiv (Cornell University)
- RADDLE: An Evaluation Benchmark and Analysis Platform for Robust Task-oriented Dialog SystemsBaolin Peng, Chunyuan Li, Zhu Zhang, Chenguang Zhu, Li, Jinchao, Jianfeng Gao · 2020 · arXiv (Cornell University)
- Simplifying Paragraph-level Question Generation via Transformer Language ModelsLuis Enrico Lopez, Diane Kathryn Cruz, Jan Christian Blaise Cruz, Charibeth Cheng · 2020 · arXiv (Cornell University)
- RecInDial: A Unified Framework for Conversational Recommendation with Pretrained Language ModelsLingzhi Wang, Hu, Huang, Lei Sha, Can Xu, Kam‐Fai Wong, Daxin Jiang · 2021 · arXiv (Cornell University)
- Proceedings of The 4th Workshop on e-Commerce and NLP2021
- Proceedings of the Fourth Workshop on Neural Generation and Translation2020
- Note-Level Singing Melody Transcription for Time-Aligned Musical Score GenerationLeekyung Kim, Sungwook Jeon, Wan Heo, Jonghun Park · 2025 · IEEE Transactions on Audio Speech and Language Processing
- Dongba Machine Translation with Transfer Learning: Leveraging Pre-trained Ancient Chinese ModelsXinchen Ma, Man Lan, Wenbo Hu, Yue Lu · 2025 · ACM Transactions on Asian and Low-Resource Language Information Processing
- Multi-task prompt adapter for vision-language modelZhong Wei, Jiabao Han, Cheng Ding, Cheng Wang, Luwei Luo · 2025 · Applied Soft Computing
- Automatic Detection for Machine-generated Texts is EasyMingyang Lyu, Chenlong Bao, Jintao Tang, Ting Wang, Peilei Liu · 2022 · IEEE Smart World Congress (SWC)
- PUNR: Pre-training with User Behavior Modeling for News RecommendationGuangyuan Ma, Hongtao Liu, Xing W, Wanhui Qian, Zhepeng Lv, Qing H. Yang, Songlin Hu · 2023 · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP)
- A Quantitative Analysis of Noise Impact on Document RankingEdward Giamphy, Kevin Sanchis, Gohar Dashyan, Jean‐Loup Guillaume, Ahmed Hamdi, Lilian Sanselme, Antoine Doucet · 2023 · Conference proceedings/Conference proceedings - IEEE International Conference on Systems, Man, and Cybernetics
- C2B: A Semantic Source Code Retrieval Model Using CodeT5 and Bi-LSTMNazia Bibi, Ayesha Maqbool, Tauseef Ahmad Rana, Farkhanda Afzal, Adnan Ahmed Khan · 2024 · Applied Sciences
- VL-MFER: A Vision-Language Multimodal Pretrained Model With Multiway-Fuzzy-Experts Bidirectional Retention NetworkChen Guo, Xinran Li, Jiaman Ma, Yimeng Li, Yuefan Liu, Haiying Qi, Li Zhang, Yuhan Jin · 2024 · IEEE Transactions on Fuzzy Systems
- Augmented dialectal speech recognition for AI-based neuropsychological scale assessment in Alzheimer’s diseaseMeiwei Zhang, Qiushi Cui, Wenyuan Li, Weihua Yu, Lihua Chen, Wenjie Li, Chenzhe Zhu, Yang Lü · 2024 · Biomedical Signal Processing and Control
- Candidate Evaluation with Multimodal Data-Driven for RecruitmentXing Cai Wu, Kehong Liu, Jianjia Wang, Junfeng Yao, Bin Deng, Rongqi Lv, Jun Song · 2024 · Lecture notes in computer science
- Investigating Large Language Models for Prompt-Based Open-Ended Question Generation in the Technical DomainSubhankar Maity, Aniket Deroy, Sudeshna Sarkar · 2024 · SN Computer Science
- Context Example Selection for LLM Generated Relevance AssessmentsJack McKechnie, Graham McDonald, Craig Macdonald · 2025 · Lecture notes in computer science
- NUT-RC: Noisy User-generated Text-oriented Reading ComprehensionRongtao Huang, Bowei Zou, Yu Hong, Wei Zhang, Ai Ti Aw, Guodong Zhou · 2020 · International Conference on Computational Linguistics
- Quinductor: A multilingual data-driven method for generating reading-comprehension questions using Universal DependenciesDmytro Kalpakchi, Johan Boye · 2021 · Natural Language Engineering
- A Semantic Supervision Method for Abstractive SummarizationSunqiang Hu, Xiaoyu Li, Yu Deng, Peng Yu, Bin Lin, Shan Yang · 2021 · Computers, materials & continua/Computers, materials & continua (Print)
- Towards Semantics-Enhanced Pre-Training: Can Lexicon Definitions Help Learning Sentence Meanings?Xuancheng Ren, Xu Sun, Houfeng Wang, Qun Liu · 2021 · Proceedings of the AAAI Conference on Artificial Intelligence
- A Knowledge-Enhanced Dialogue Model Based on Multi-Hop Information with Graph AttentionZhongqin Bi, Shiyang Wang, Yan Chen, Yongbin Li, Jungyoon Kim · 2021 · Computer Modeling in Engineering & Sciences
- Improving Factual Consistency of Abstractive Summarization on Customer FeedbackYang Liu, Yifei Sun, Vincent Gao · 2021 · Workshop on e-Commerce and NLP (ECNLP)
- BioCopy: A Plug-And-Play Span Copy Mechanism in Seq2Seq ModelsYi Liu, Guoan Zhang, Puning Yu, Jianlin Su, Shengfeng Pan · 2021 · Workshop on Simple and Efficient Natural Language Processing (SustaiNLP)
- Gradient-Based Adversarial Factual Consistency Evaluation for Abstractive SummarizationZhiyuan Zeng, Jiaze Chen, Weiran Xu, Lei Li · 2021 · Conference on Empirical Methods in Natural Language Processing (EMNLP)
- Math Word Problem Solver Based on Text-to-Text Transformer ModelChuanzhi Yang, Runze Huang, Xinguo Yu, Rao Peng · 2021 · IEEE International Conference on Teaching, Assessment, and Learning for Engineering
- Jointly Learning Guidance Induction and Faithful Summary Generation via Conditional Variational AutoencodersXu Wang, Tiejun Zhao · 2022 · Findings of the Association for Computational Linguistics: NAACL
- Switch-BERT: Learning to Model Multimodal Interactions by Switching Attention and InputQingpei Guo, Kaisheng Yao, Wei Chu · 2022 · Lecture notes in computer science
- A Multi-tasking and Multi-stage Chinese Minority Pre-trained Language ModelBin Li, Yixuan Weng, Bin Sun, Shutao Li A · 2022 · Communications in computer and information science
- Fine-Grained Sentiment-Controlled Text Generation Approach Based on Pre-Trained Language ModelLinan Zhu, Yifei Xu, Zhechao Zhu, Yinwei Bao, Xiangjie Kong · 2022 · Applied Sciences
- A Survey of Full-Cycle Cross-Modal Retrieval: From a Representation Learning PerspectiveSuping Wang, Ligu Zhu, Lei Shi, Hao Mo, Songfu Tan · 2023 · Applied Sciences
- FuFaction: Fuzzy Factual Inconsistency Correction on Crowdsourced Documents With Hybrid-Mask at the Hidden-State LevelHuan Rong, Gongchi Chen, Tinghuai Ma, Victor S. Sheng, Elisa Bertino · 2023 · IEEE Transactions on Knowledge and Data Engineering
- Graph-Enhanced Biomedical Abstractive Summarization Via Factual Evidence ExtractionGiacomo Frisoni, Paolo Italiani, Gianluca Moro, Ilaria Bartolini A, Marco Antonio Boschetti, Antonella Carbonaro · 2023 · SN Computer Science
- UniEX: An Effective and Efficient Framework for Unified Information Extraction via a Span-extractive PerspectivePing Yang, JunYu Lu, Ruyi Gan, Junjie Wang, Yuxiang Zhang, Pingjian Zhang, Jiaxing Zhang · 2023 · Proceedings of the conference - Association for Computational Linguistics. Meeting
- Residual Learning of Neural Text Generation with n-gram Language ModelHuayang Li, Deng Cai, Jin Xu, Taro Watanabe · 2022 · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP)