The DOI matches its Crossref record; 313 of the 313 references it cites were found in a registry or an index.
A comprehensive survey on pretrained foundation models: a history from BERT to ChatGPT
Open accessOverview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Items 201–313 of 313
Self-Supervised Video Representation Learning with Space-Time Cubic Puzzles
Kim, D., Cho, D., & Kweon, I. S. (2019) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v33i01.33018545 · Cited by 319
Context Autoencoder for Self-supervised Representation Learning
Chen, X., Ding, M., Wang, X., Xin, Y., Mo, S., Wang, Y., Han, S., Luo, P., Zeng, G., & Wang, J. (2024) · International Journal of Computer Vision · doi:10.1007/s11263-023-01852-4 · Cited by 319
Text Level Graph Neural Network for Text Classification
Huang, L., Ma, D., Li, S., Zhang, X., & Wang, H. (2019) · Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP) · doi:10.18653/v1/d19-1345 · Cited by 314
A general framework for information extraction using dynamic span graphs
Luan, Y., Wadden, D., He, L., Shah, A., Ostendorf, M., & Hajishirzi, H. (2019) · Proceedings of the 2019 Conference of the North · doi:10.18653/v1/n19-1308 · Cited by 311
Self-citationBirdsnap: Large-Scale Fine-Grained Visual Categorization of Birds
Berg, T., Liu, J., Lee, S. W., Alexander, M. L., Jacobs, D. W., & Belhumeur, P. N. (2014) · 2014 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2014.259 · Cited by 304
Combining Knowledge with Deep Convolutional Neural Networks for Short Text Classification
Wang, J., Wang, Z., Zhang, D., & Yan, J. (2017) · Proceedings of the Twenty-Sixth International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2017/406 · Cited by 303
Compressing BERT: Studying the Effects of Weight Pruning on Transfer Learning
Gordon, M., Duh, K., & Andrews, N. (2020) · Proceedings of the 5th Workshop on Representation Learning for NLP · doi:10.18653/v1/2020.repl4nlp-1.18 · Cited by 303
Reinforcement Learning with Augmented Data
Laskin, M., Lee, K., Stooke, A., Pinto, L., Abbeel, P., & Srinivas, A. (2020) · arXiv · doi:10.48550/arxiv.2004.14990 · Cited by 299
Unsupervised Attributed Multiplex Network Embedding
Park, C., Kim, D., Han, J., & Yu, H. (2020) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v34i04.5985 · Cited by 286
Cross-Task Generalization via Natural Language Crowdsourcing Instructions
Mishra, S., Khashabi, D., Baral, C., & Hajishirzi, H. (2022) · Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.18653/v1/2022.acl-long.244 · Cited by 269
Image Augmentation Is All You Need: Regularizing Deep Reinforcement Learning from Pixels
Kostrikov, I., Yarats, D., & Fergus, R. (2020) · arXiv · doi:10.48550/arxiv.2004.13649 · Cited by 267
Graves, A. (2012) · Studies in Computational Intelligence · doi:10.1007/978-3-642-24797-2_3 · Cited by 265
FastBERT: a Self-distilling BERT with Adaptive Inference Time
Liu, W., Zhou, P., Wang, Z., Zhao, Z., Deng, H., & JU, Q. (2020) · Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics · doi:10.18653/v1/2020.acl-main.537 · Cited by 263
Pop Music Transformer: Beat-based Modeling and Generation of Expressive Pop Piano Compositions
Huang, Y.-S., & Yang, Y.-H. (2020) · Proceedings of the 28th ACM International Conference on Multimedia · doi:10.1145/3394171.3413671 · Cited by 261
Discourse-Aware Neural Extractive Text Summarization
Xu, J., Gan, Z., Cheng, Y., & Liu, J. (2020) · Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics · doi:10.18653/v1/2020.acl-main.451 · Cited by 260
MiniLMv2: Multi-Head Self-Attention Relation Distillation for Compressing Pretrained Transformers
Wang, W., Bao, H., Huang, S., Dong, L., & Wei, F. (2021) · Findings of the Association for Computational Linguistics: ACL-IJCNLP 2021 · doi:10.18653/v1/2021.findings-acl.188 · Cited by 257
Super-NaturalInstructions: Generalization via Declarative Instructions on 1600+ NLP Tasks
Wang, Y., Mishra, S., Alipoormolabashi, P., Kordi, Y., Mirzaei, A., Naik, A., Ashok, A., Dhanasekaran, A. S., Arunkumar, A., Stap, D., et al. (2022) · Proceedings of the 2022 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/2022.emnlp-main.340 · Cited by 247
Mastering Atari with Discrete World Models
Hafner, D., Lillicrap, T., Norouzi, M., & Ba, J. (2020) · arXiv · doi:10.48550/arxiv.2010.02193 · Cited by 247
Nested Named Entity Recognition Revisited
Katiyar, A., & Cardie, C. (2018) · Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long Papers) · doi:10.18653/v1/n18-1079 · Cited by 239
Sun, K., Lin, Z., & Zhu, Z. (2020) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v34i04.6048 · Cited by 237
TOD-BERT: Pre-trained Natural Language Understanding for Task-Oriented Dialogue
Wu, C.-S., Hoi, S. C. H., Socher, R., & Xiong, C. (2020) · Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2020.emnlp-main.66 · Cited by 237
Self-citationRobBERT: a Dutch RoBERTa-based Language Model
Delobelle, P., Winters, T., & Berendt, B. (2020) · Findings of the Association for Computational Linguistics: EMNLP 2020 · doi:10.18653/v1/2020.findings-emnlp.292 · Cited by 235
Pretrained Language Model for Text Generation: A Survey
Li, J., Tang, T., Zhao, W. X., & Wen, J.-R. (2021) · International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2021/612 · Cited by 235
Self-citationUNIMO: Towards Unified-Modal Understanding and Generation via Cross-Modal Contrastive Learning
Li, W., Gao, C., Niu, G., Xiao, X., Liu, H., Liu, J., Wu, H., & Wang, H. (2021) · Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing (Volume 1: Long Papers) · doi:10.18653/v1/2021.acl-long.202 · Cited by 231
Sub-Graph Contrast for Scalable Self-Supervised Graph Representation Learning
Jiao, Y., Xiong, Y., Zhang, J., Zhang, Y., Zhang, T., & Zhu, Y. (2020) · Proceedings · doi:10.1109/icdm50108.2020.00031 · Cited by 230
Multi-Scale Contrastive Siamese Networks for Self-Supervised Graph Representation Learning
Jin, M., Zheng, Y., Li, Y.-F., Gong, C., Zhou, C. D., & Pan, S. (2021) · International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2021/204 · Cited by 219
Self-citationDarla Improving zero-shot transfer in reinforcement learning
Higgins, I., Pal, A., Rusu, A. A., Matthey, L., Burgess, C. P., Pritzel, A., Botvinick, M., Blundell, C., & Lerchner, A. (2017) · arXiv · doi:10.48550/arxiv.1707.08475 · Cited by 219
Sentiment Analysis by Capsules
Wang, Y., Sun, A., Han, J., Liu, Y., & Zhu, X. (2018) · Proceedings of the 2018 World Wide Web Conference on World Wide Web - WWW '18 · doi:10.1145/3178876.3186015 · Cited by 210
Self-citationTrick Me If You Can: Human-in-the-Loop Generation of Adversarial Examples for Question Answering
Wallace, E., Rodríguez, P., Feng, S., Yamada, I., & Boyd-Graber, J. L. (2019) · Transactions of the Association for Computational Linguistics · doi:10.1162/tacl_a_00279 · Cited by 208
M3DETR: Multi-representation, Multi-scale, Mutual-relation 3D Object Detection with Transformers
Guan, T., Wang, J., Lan, S., Chandra, R., Wu, Z., Davis, L. S., & Manocha, D. (2022) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv51458.2022.00235 · Cited by 206
AET vs. AED: Unsupervised Representation Learning by Auto-Encoding Transformations Rather Than Data
Zhang, L., Qi, G.-J., Wang, L., & Luo, J. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00265 · Cited by 200
Word-level Textual Adversarial Attacking as Combinatorial Optimization
Zang, Y., Qi, F., Yang, C., Liu, Z., Zhang, M., Liu, Q., & Sun, M. (2020) · Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics · doi:10.18653/v1/2020.acl-main.540 · Cited by 195
Self-citationContrastive Self-supervised Learning for Graph Classification
Zeng, J., & Xie, P. (2021) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v35i12.17293 · Cited by 194
Self-citationCross-Domain Self-Supervised Multi-task Feature Learning Using Synthetic Imagery
Ren, Z., & Lee, Y. J. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00086 · Cited by 190
Contrastive and Generative Graph Convolutional Networks for Graph-based Semi-Supervised Learning
Wan, S., Pan, S., Yang, J. J., & Gong, C. (2021) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v35i11.17206 · Cited by 190
Ha, D., & Schmidhuber, J. (2018) · Zenodo · doi:10.5281/zenodo.1207631 · Cited by 187
CoLAKE: Contextualized Language and Knowledge Embedding
Sun, T., Shao, Y., Qiu, X., Guo, Q., Hu, Y., Huang, X., & Zhang, Z. (2020) · Proceedings of the 28th International Conference on Computational Linguistics · doi:10.18653/v1/2020.coling-main.327 · Cited by 185
Nested Named Entity Recognition via Second-best Sequence Learning and Decoding
Shibuya, T., & Hovy, E. H. (2020) · Transactions of the Association for Computational Linguistics · doi:10.1162/tacl_a_00334 · Cited by 179
Automatic Dialog Act Segmentation and Classification in Multiparty Meetings
Ang, J., Liu, Y., & Shriberg, E. (2006) · Proceedings. (ICASSP '05). IEEE International Conference on Acoustics, Speech, and Signal Processing, 2005. · doi:10.1109/icassp.2005.1415300 · Cited by 178
Self-citationSurvey on reinforcement learning for language processing
Uc-Cetina, V., Navarro-Guerrero, N., Martin-Gonzalez, A., Weber, C., & Wermter, S. (2023) · Artificial Intelligence Review · doi:10.1007/s10462-022-10205-5 · Cited by 177
Generative Adversarial Network for Abstractive Text Summarization
Liu, L., Lu, Y., Yang, M., Qu, Q., Zhu, J., & Li, H. (2018) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v32i1.12141 · Cited by 177
Multi-Timescale Long Short-Term Memory Neural Network for Modelling Sentences and Documents
Liu, P., Qiu, X., Chen, X., Wu, S., & Huang, X. (2015) · Proceedings of the 2015 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d15-1280 · Cited by 174
Learning Image Representations by Completing Damaged Jigsaw Puzzles
Kim, D., Cho, D., Yoo, D., & Kweon, I. S. (2018) · 2018 IEEE Winter Conference on Applications of Computer Vision (WACV) · doi:10.1109/wacv.2018.00092 · Cited by 172
ZEN: Pre-training Chinese Text Encoder Enhanced by N-gram Representations
Diao, S., Bai, J., Song, Y., Zhang, T., & Wang, Y. (2020) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2020.findings-emnlp.425 · Cited by 172
MusicBERT: Symbolic Music Understanding with Large-Scale Pre-Training
Zeng, M., Tan, X., Wang, R., Ju, Z., Qin, T., & Liu, T. (2021) · Findings of the Association for Computational Linguistics: ACL (Findings of ACL) · doi:10.18653/v1/2021.findings-acl.70 · Cited by 171
Neural Segmental Hypergraphs for Overlapping Mention Recognition
Wang, B., & Lu, W. (2018) · Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d18-1019 · Cited by 169
Benchmarking Large Language Models for Automated Verilog RTL Code Generation
Thakur, S., Ahmad, B., Fan, Z., Pearce, H., Tan, B., Karri, R., Dolan-Gavitt, B., & Garg, S. (2023) · 2023 Design, Automation & Test in Europe Conference & Exhibition (DATE) · doi:10.23919/date56975.2023.10137086 · Cited by 169
Cross-Lingual Natural Language Generation via Pre-Training
Chi, Z., Li, D., Wei, F., Wang, W., Mao, X.-L., & Huang, H. (2020) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v34i05.6256 · Cited by 166
Zhu, X., Zhu, J., Li, H., Wu, X., Li, H., Wang, X., & Dai, J. (2022) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52688.2022.01630 · Cited by 164
Improving Abstraction in Text Summarization
Kryściński, W., Paulus, R., Xiong, C., & Socher, R. (2018) · Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d18-1207 · Cited by 163
Self-citationWei, C., Xie, L., Ren, X., Xia, Y., Su, C., Liu, J., Tian, Q., & Yuille, A. (2019) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2019.00201 · Cited by 163
Sun, Q., Li, J., Peng, H., Wu, J., Ning, Y., Yu, P. S., & He, L. (2021) · Proceedings of the Web Conference 2021 · doi:10.1145/3442381.3449822 · Cited by 162
Self-citationBipartite Graph Embedding via Mutual Information Maximization
Cao, J., Lin, X., Guo, S., Liu, L., Liu, T., & Wang, B. (2021) · ACM International Conference on Web Search and Data Mining (WSDM) · doi:10.1145/3437963.3441783 · Cited by 161
Unicoder: A Universal Language Encoder by Pre-training with Multiple Cross-lingual Tasks
Huang, H., Liang, Y., Duan, N., Gong, M., Shou, L., Jiang, D., & Zhou, M. (2019) · Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP) · doi:10.18653/v1/d19-1252 · Cited by 160
Generative Pre-Training for Speech with Autoregressive Predictive Coding
Chung, Y.-A., & Glass, J. (2020) · ICASSP 2020 - 2020 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) · doi:10.1109/icassp40776.2020.9054438 · Cited by 157
Pre-training Multilingual Neural Machine Translation by Leveraging Alignment Information
Lin, Z., Pan, X., Wang, M., Qiu, X., Feng, J., Zhou, H., & Li, L. (2020) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2020.emnlp-main.210 · Cited by 156
Sánchez, S., Romero, H., & Morales, A. D. (2020) · IOP Conference Series Materials Science and Engineering · doi:10.1088/1757-899x/844/1/012024 · Cited by 155
Multi-Fact Correction in Abstractive Text Summarization
Dong, Y., Wang, S., Gan, Z., Cheng, Y., Cheung, J. C. K., & Liu, J. (2020) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2020.emnlp-main.749 · Cited by 153
Dialogue Act Classification with Context-Aware Self-Attention
Raheja, V., & Tetreault, J. (2019) · Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT) · doi:10.18653/v1/n19-1373 · Cited by 150
Prototypical Graph Contrastive Learning
Lin, S., Liu, C., Zhou, P., Hu, Z.-Y., Wang, S., Zhao, R., Zheng, Y., Lin, L., Xing, E. P., & Liang, X. (2022) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2022.3191086 · Cited by 150
Re-evaluating Evaluation in Text Summarization
Bhandari, M., Gour, P. N., Ashfaq, A., Liu, P., & Neubig, G. (2020) · Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2020.emnlp-main.751 · Cited by 148
ClusterFit: Improving Generalization of Visual Representations
Yan, X., Misra, I., Gupta, A. K., Ghadiyaram, D., & Mahajan, D. K. (2020) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr42600.2020.00654 · Cited by 146
Surprise-Based Intrinsic Motivation for Deep Reinforcement Learning
Achiam, J., & Sastry, S. (2017) · arXiv · doi:10.48550/arxiv.1703.01732 · Cited by 139
Video Jigsaw: Unsupervised Learning of Spatiotemporal Context for Video Action Recognition
Ahsan, U., Madhok, R., & Essa, I. A. (2019) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv.2019.00025 · Cited by 136
Selection of the optimal parameter value for the Isomap algorithm
Samko, O., Marshall, A. D., & Rosin, P. L. (2006) · Pattern Recognition Letters · doi:10.1016/j.patrec.2005.11.017 · Cited by 135
BERT-MK: Integrating Graph Contextualized Knowledge into Pre-trained Language Models
He, B., Zhou, D., Xiao, J., Jiang, X., Liu, Q., Yuan, N. J., & Xu, T. (2020) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2020.findings-emnlp.207 · Cited by 135
Improving alignment of dialogue agents via targeted human judgements
Glaese, A., McAleese, N., Trębacz, M., Aslanides, J., Firoiu, V., Ewalds, T., Rauh, M., Weidinger, L., Chadwick, M., Thacker, P., et al. (2022) · arXiv · doi:10.48550/arxiv.2209.14375 · Cited by 134
The Fourth Dialog State Tracking Challenge
Kim, S., D’Haro, L. F., Banchs, R. E., Williams, J. D., & Henderson, M. (2016) · Lecture notes in electrical engineering · doi:10.1007/978-981-10-2585-3_36 · Cited by 131
Self-supervised Video Representation Learning Using Inter-intra Contrastive Framework
Li, T., Wang, X., & Yamasaki, T. (2020) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3394171.3413694 · Cited by 130
Kang, U., Tong, H., & Sun, J. (2012) · Proceedings of the 2012 SIAM International Conference on Data Mining · doi:10.1137/1.9781611972825.71 · Cited by 127
SeCo: Exploring Sequence Supervision for Unsupervised Representation Learning
Yao, T., Zhang, Y., Qiu, Z., Pan, Y., & Mei, T. (2021) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v35i12.17274 · Cited by 127
Human-centric dialog training via offline reinforcement learning
Jaques, N., Shen, J. H., Ghandeharioun, A., Ferguson, C., Lapedriza, À., Jones, N. C., Gu, S., & Picard, R. W. (2020) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2020.emnlp-main.327 · Cited by 124
Sequence-to-Nuggets: Nested Entity Mention Detection via Anchor-Region Networks
Lin, H., Lu, Y., Han, X., & Sun, L. (2019) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/p19-1511 · Cited by 121
Self-citationSmall and Practical BERT Models for Sequence Labeling
Tsai, H., Riesa, J., Johnson, M., Arivazhagan, N., Li, X., & Archer, A. (2019) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/d19-1374 · Cited by 120
MultiFiT: Efficient Multi-lingual Language Model Fine-tuning
Eisenschlos, J. M., Ruder, S., Czapla, P., Kadras, M., Gugger, S., & Howard, J. (2019) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/d19-1572 · Cited by 111
Graph InfoClust: Maximizing Coarse-Grain Mutual Information in Graphs
Mavromatis, C., & Karypis, G. (2021) · Lecture notes in computer science · doi:10.1007/978-3-030-75762-5_43 · Cited by 109
Semi-supervised Training for Improving Data Efficiency in End-to-end Speech Synthesis
Chung, Y.-A., Wang, Y., Hsu, W.-N., Zhang, Y., & Skerry-Ryan, R. (2019) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp.2019.8683862 · Cited by 106
Enhancing Machine Translation with Dependency-Aware Self-Attention
Bugliarello, E., & Okazaki, N. (2020) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2020.acl-main.147 · Cited by 99
What Have We Achieved on Text Summarization?
Huang, D., Cui, L., Yang, S., Bao, G., Wang, K., Xie, J., & Zhang, Y. (2020) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2020.emnlp-main.33 · Cited by 93
Zero-Shot Transfer Learning with Synthesized Data for Multi-Domain Dialogue State Tracking
Campagna, G., Foryciarz, A., Moradshahi, M., & Lam, M. S. (2020) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2020.acl-main.12 · Cited by 90
Interpretable Multi-dataset Evaluation for Named Entity Recognition
Fu, J., Liu, P., & Neubig, G. (2020) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2020.emnlp-main.489 · Cited by 89
SPLAT: Speech-Language Joint Pre-Training for Spoken Language Understanding
Chung, Y.-A., Zhu, C., & Zeng, M. (2021) · Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT) · doi:10.18653/v1/2021.naacl-main.152 · Cited by 88
XLM-E: Cross-lingual Language Model Pre-training via ELECTRA
Chi, Z., Huang, S., Dong, L., Ma, S., Zheng, B., Singhal, S., Bajaj, P., Song, X., Mao, X.-L., Huang, H., et al. (2022) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2022.acl-long.427 · Cited by 86
In Neural Machine Translation, What Does Transfer Learning Transfer?
Aji, A. F., Bogoychev, N., Heafield, K., & Sennrich, R. (2020) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2020.acl-main.688 · Cited by 78
Cross and learn: Cross-modal self-supervision
Sayed, N., Brattoli, B., & Ommer, B. (2019) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-12939-2_17 · Cited by 76
Self-Supervised Learning of Contextual Embeddings for Link Prediction in Heterogeneous Networks
Wang, P., Agarwal, K., Ham, C., Choudhury, S., & Reddy, C. K. A. (2021) · International World Wide Web Conference (WWW) · doi:10.1145/3442381.3450060 · Cited by 76
YFCC100M: The New Data in Multimedia Research
Thomee, B., Shamma, D. A., Friedland, G., Elizalde, B., Ni, K., Poland, D., Borth, D., & Li, L.-J. (2015) · arXiv · doi:10.48550/arxiv.1503.01817 · Cited by 69
Exploiting Structured Knowledge in Text via Graph-Guided Representation Learning
Shen, T., Mao, Y., He, P., Long, G., Trischler, A., & Chen, W. (2020) · Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2020.emnlp-main.722 · Cited by 63
Reed, S., Zolna, K., Parisotto, E., Colmenarejo, S. G., Novikov, A., Barth-Maron, G., Gimenez, M., Sulsky, Y., Kay, J., Springenberg, J. T., et al. (2022) · arXiv · doi:10.48550/arxiv.2205.06175 · Cited by 63
Unsupervised Learning from Video to Detect Foreground Objects in Single Images
Croitoru, I., Bogolin, S.-V., & Leordeanu, M. (2017) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.465 · Cited by 60
Temporal Contrastive Pretraining for Video Action Recognition
Lorre, G., Rabarisoa, J., Orcesi, A., Aïnouz, S., & Canu, S. (2020) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv45572.2020.9093278 · Cited by 60
Speech-XLNet: Unsupervised Acoustic Model Pretraining for Self-Attention Networks
Song, X., Wang, G., Huang, Y., Wu, Z., Su, D., & Meng, H. M. L. (2020) · Interspeech (USB) · doi:10.21437/interspeech.2020-1511 · Cited by 60
Self-citationApplication of Principal Component Analysis to Multikey Searching
Lee, R. C. T., Chin, Y. H., & Chang, S.-K. (1976) · IEEE Transactions on Software Engineering · doi:10.1109/tse.1976.225946 · Cited by 57
Ramamurthy, R., Ammanabrolu, P., Brantley, K., Hessel, J., Sifa, R., Bauckhage, C., Hajishirzi, H., & Choi, Y. (2022) · arXiv · doi:10.48550/arxiv.2210.01241 · Cited by 56
Pre-training for Abstractive Document Summarization by Reinstating Source Text
Zou, Y., Zhang, X., Lu, W., Wei, F., & Zhou, M. (2020) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2020.emnlp-main.297 · Cited by 51
Revisiting the Weaknesses of Reinforcement Learning for Neural Machine Translation
Kiegeland, S., & Kreutzer, J. (2021) · Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT) · doi:10.18653/v1/2021.naacl-main.133 · Cited by 48
Humpty Dumpty: Controlling Word Meanings via Corpus Poisoning
Schuster, R., Schuster, T., Meri, Y., & Shmatikov, V. (2020) · IEEE Symposium on Security and Privacy (S&P) · doi:10.1109/sp40000.2020.00115 · Cited by 46
Abstractive Text Summarization Based on Deep Learning and Semantic Content Generalization
Kouris, P., Alexandridis, G., & Stafylopatis, A. (2019) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/p19-1501 · Cited by 45
Zhang, Z., Li, Y., Wang, J., Liu, B., Li, D., Guo, Y., Chen, X., & Liu, Y. (2022) · ACM/IEEE International Conference on Software Engineering: Companion Proceedings (ICSE-Companion) · doi:10.1145/3510003.3510191 · Cited by 40
Self-citationDenisov, P., & Vu, N. T. (2020) · Interspeech (USB) · doi:10.21437/interspeech.2020-2456 · Cited by 39
Pretraining the Noisy Channel Model for Task-Oriented Dialogue
Liu, Q., Yu, L., Rimell, L., & Blunsom, P. (2021) · Transactions of the Association for Computational Linguistics · doi:10.1162/tacl_a_00390 · Cited by 31
Exploring Human-Like Reading Strategy for Abstractive Text Summarization
Yang, M., Qu, Q., Tu, W., Shen, Y., Zhao, Z., & Chen, X. (2019) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v33i01.33017362 · Cited by 29
Bao, R., Wang, J., & Zhao, H. (2021) · Findings of the Association for Computational Linguistics: ACL (Findings of ACL) · doi:10.18653/v1/2021.findings-acl.287 · Cited by 29
Content Word Aware Neural Machine Translation
Chen, K., Wang, R., Utiyama, M., et al. (2020) · Annual Meeting of the Association for Computational Linguistics (ACL) · doi:10.18653/v1/2020.acl-main.34 · Cited by 28
Named Entity Recognition Only from Word Embeddings
Luo, Y., Zhao, H., & Zhan, J. (2020) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2020.emnlp-main.723 · Cited by 26
DirectQE: Direct Pretraining for Machine Translation Quality Estimation
Cui, Q., Huang, S., Li, J., Geng, X., Zheng, Z., Huang, G., & Chen, J. (2021) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v35i14.17506 · Cited by 26
Self-citationFederated IoT Interaction Vulnerability Analysis
Wang, G., Guo, H., Li, A., Liu, X., & Yan, Q. (2023) · IEEE International Conference on Data Engineering (ICDE) · doi:10.1109/icde55515.2023.00120 · Cited by 23
Self-citationExploring and evaluating personalized models for code generation
Zlotchevski, A., Drain, D., Svyatkovskiy, A., Clement, C. B., Sundaresan, N., & Tufano, M. (2022) · ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering (ESEC/FSE) · doi:10.1145/3540250.3558959 · Cited by 17
Constrained Decoding for Computationally Efficient Named Entity Recognition Taggers
Lester, B., Pressel, D., Hemmeter, A., Choudhury, S. R., & Bangalore, S. (2020) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2020.findings-emnlp.166 · Cited by 16
Graph Learning for Interactive Threat Detection in Heterogeneous Smart Home Rule Data
Wang, G., Ivanov, N., Chen, B., Wang, Q., Nguyen, T. H., & Yan, Q. (2023) · Proceedings of the ACM on Management of Data · doi:10.1145/3588956 · Cited by 12
Self-citationImproved Dynamic Memory Network for Dialogue Act Classification with Adversarial Training
Wan, Y., Yan, W., Gao, J., Zhao, Z., Wu, J. F., & Yu, P. S. (2018) · IEEE International Conference on Big Data (BigData) · doi:10.1109/bigdata.2018.8622245 · Cited by 10
Self-citationSocialite: Social Activity Mining and Friend Auto-labeling
Wang, G., Zhang, L., Yang, Z., & Li, X. (2018) · IEEE International Performance, Computing, and Communications Conference · doi:10.1109/pccc.2018.8710834 · Cited by 10
Self-citationSHAD: Privacy-Friendly Shared Activity Detection and Data Sharing
Han, F., Zhang, L., You, X., Wang, G., & Li, X. (2019) · IEEE International Conference on Mobile Ad-Hoc and Sensor Systems (MASS) · doi:10.1109/mass.2019.00022 · Cited by 7
Self-citation
Cited by
Ray, P. P. (2023) · Internet of Things and Cyber-Physical Systems · doi:10.1016/j.iotcps.2023.04.003 · Cited by 2,463
A Comprehensive Overview of Large Language Models
Naveed, H., Khan, A. U., Qiu, S., Saqib, M., Anwar, S., Usman, M., Akhtar, N., Barnes, N., & Mian, A. (2023) · arXiv · doi:10.48550/arxiv.2307.06435 · Cited by 1,259
A Comprehensive Overview of Large Language Models
Naveed, H., Khan, A. U., Qiu, S., Saqib, M., Anwar, S., Usman, M., Akhtar, N., Barnes, N., & Mian, A. (2025) · ACM Transactions on Intelligent Systems and Technology · doi:10.1145/3744746 · Cited by 1,257
Segment anything model for medical image analysis: An experimental study
Mazurowski, M. A., Dong, H., Gu, H., Yang, J., Konz, N., & Zhang, Y. (2023) · Medical Image Analysis · doi:10.1016/j.media.2023.102918 · Cited by 802
A Categorical Archive of ChatGPT Failures
Borji, A. (2023) · doi:10.21203/rs.3.rs-2895792/v1 · Cited by 514
Metadata
- Authors
- Zhou, C., Li, Q., Li, C., Yu, J., Liu, Y., Wang, G., Zhang, K., Ji, C., Yan, Q., He, L., Peng, H., Li, J., Wu, J., Liu, Z., Xie, P., Xiong, C., Pei, J., Yu, P. S., & Sun, L.
- Venue
- International Journal of Machine Learning and Cybernetics
- Published
- 2024-11-24
- Volume
- 16
- Issue
- 12
- Pages
- 9851-9915
- ISSN
- 1868-8071 (ISSN-L)
- 1868-808X
- OpenAlex
- W4404658388
- Cited by
- 557
- References
- 313
- FWCI
- 70.39
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.