Deep Learning for Source Code Modeling and Generation: Models, Applications, and Challenges
Open accessThe DOI matches its Crossref record; 40 of the 40 references it cites were found in a registry or an index.
Abstract
Deep Learning (DL) techniques for Natural Language Processing have been evolving remarkably fast. Recently, the DL advances in language modeling, machine translation, and paragraph understanding are so prominent that the potential of DL in Software Engineering cannot be overlooked, especially in the field of program learning. To facilitate further research and applications of DL in this field, we provide a comprehensive review to categorize and investigate existing DL methods for source code modeling and generation. To address the limitations of the traditional source code models, we formulate common program learning tasks under an encoder-decoder framework. After that, we introduce recent DL mechanisms suitable to solve such problems. Then, we present the state-of-the-art practices and discuss their challenges with some recommendations for practitioners and researchers as well.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474
Hochreiter, S., & Schmidhuber, J. (1997) · Neural Computation · doi:10.1162/neco.1997.9.8.1735 · Cited by 102,318
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (2018) · arXiv · doi:10.48550/arxiv.1810.04805 · Cited by 73,173
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (2019) · Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers) · doi:10.18653/v1/n19-1423 · Cited by 54,325
Efficient Estimation of Word Representations in Vector Space
Mikolov, T., Chen, K., Corrado, G., & Dean, J. (2013) · arXiv · doi:10.48550/arxiv.1301.3781 · Cited by 26,568
Image-to-Image Translation with Conditional Adversarial Networks
Isola, P., Zhu, J.-Y., Zhou, T., & Efros, A. A. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.632 · Cited by 22,930
The perceptron: A probabilistic model for information storage and organization in the brain.
Rosenblatt, F. (1958) · Psychological Review · doi:10.1037/h0042519 · Cited by 12,280
Empirical Evaluation of Gated Recurrent Neural Networks on Sequence Modeling
Chung, J., Gulcehre, C., Cho, K., & Bengio, Y. (2014) · arXiv · doi:10.48550/arxiv.1412.3555 · Cited by 11,008
Enriching Word Vectors with Subword Information
Bojanowski, P., Grave, E., Joulin, A., & Mikolov, T. (2017) · Transactions of the Association for Computational Linguistics · doi:10.1162/tacl_a_00051 · Cited by 9,645 · cited 1×
“For NLP tasks, it is a common practice to use general-purpose pre-trained word vectors on large corpora such as word2vec [175], GloVe [207] and fastText [28].”
MethodDeepFool: A Simple and Accurate Method to Fool Deep Neural Networks
Moosavi-Dezfooli, S.-M., Fawzi, A., & Frossard, P. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.282 · Cited by 5,317 · cited 1×
“rging to point out the vulnerability in the DL models that may result in bad consequences, namely adversarial DL. For instance, an image can be perturbed to change the output of a DL model completely [184, 190], but a human cannot distinguish such a subtle change. Later, the idea of adversarial DL was also adapted to…”
MethodGet To The Point: Summarization with Pointer-Generator Networks
See, A., Liu, P. J., & Manning, C. D. (2017) · Proceedings of the 55th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.18653/v1/p17-1099 · Cited by 3,775
Categorical Reparameterization with Gumbel-Softmax
Jang, E., Gu, S., & Poole, B. (2016) · arXiv · doi:10.48550/arxiv.1611.01144 · Cited by 3,616
A Convolutional Neural Network for Modelling Sentences
Kalchbrenner, N., Grefenstette, E., & Blunsom, P. (2014) · Proceedings of the 52nd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.3115/v1/p14-1062 · Cited by 3,601
Deep Neural Networks are Easily Fooled: High Confidence Predictions for Unrecognizable Images
Nguyen, A., Yosinski, J., & Clune, J. (2014) · arXiv · doi:10.48550/arxiv.1412.1897 · Cited by 3,258
Convolutional Sequence to Sequence Learning
Gehring, J., Auli, M., Grangier, D., Yarats, D., & Dauphin, Y. N. (2017) · arXiv · doi:10.48550/arxiv.1705.03122 · Cited by 2,850 · cited 1×
“[73] proposed ConvS2S that brought skip connection [95] and attention [16] (cf.”
BackgroundNeural Discrete Representation Learning
Oord, A. V. D., Vinyals, O., & Kavukcuoglu, K. (2017) · arXiv · doi:10.48550/arxiv.1711.00937 · Cited by 2,729
Character-Aware Neural Language Models
Kim, Y., Jernite, Y., Sontag, D., & Rush, A. M. (2015) · arXiv · doi:10.48550/arxiv.1508.06615 · Cited by 1,530
Hybrid computing using a neural network with dynamic external memory
Graves, A., Wayne, G., Reynolds, M., Harley, T., Danihelka, I., Grabska-Barwińska, A., Colmenarejo, S. G., Grefenstette, E., Ramalho, T., Agapiou, J., et al. (2016) · Nature · doi:10.1038/nature20101 · Cited by 1,412 · cited 2×
“Besides program learning, this type of model has also been used in other domains such as question answering [80, 217], finding the shortest path [80], navigation in 3D simulation [204], querying a database for entity relations [80], and one-shot recognition [217].”
MethodSukhbaatar, S., Szlam, A., Weston, J., & Fergus, R. (2015) · arXiv · doi:10.48550/arxiv.1503.08895 · Cited by 1,345
Graves, A., Wayne, G., & Danihelka, I. (2014) · arXiv · doi:10.48550/arxiv.1410.5401 · Cited by 1,058
Srivastava, R. K., Greff, K., & Schmidhuber, J. (2015) · arXiv · doi:10.48550/arxiv.1505.00387 · Cited by 912
Unsupervised Learning for Physical Interaction through Video Prediction
Finn, C., Goodfellow, I., & Levine, S. (2016) · arXiv · doi:10.48550/arxiv.1605.07157 · Cited by 759
Language to Logical Form with Neural Attention
Dong, L., & Lapata, M. (2016) · Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.18653/v1/p16-1004 · Cited by 700
Towards AI-Complete Question Answering: A Set of Prerequisite Toy Tasks
Weston, J., Bordes, A., Chopra, S., Rush, A. M., van Merriënboer, B., Joulin, A., & Mikolov, T. (2015) · arXiv · doi:10.48550/arxiv.1502.05698 · Cited by 670 · cited 1×
“This kind of model is evaluated on various tasks such as basic reasoning on twenty bAbI tasks [264], reading children’s books [100], understanding real dialogues from movies [60].”
MethodImportance Weighted Autoencoders
Burda, Y., Grosse, R., & Salakhutdinov, R. (2015) · arXiv · doi:10.48550/arxiv.1509.00519 · Cited by 644
A Syntactic Neural Model for General-Purpose Code Generation
Yin, P., & Neubig, G. (2017) · Proceedings of the 55th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.18653/v1/p17-1041 · Cited by 623
A Syntactic Neural Model for General-Purpose Code Generation
Yin, P., & Neubig, G. (2017) · arXiv · doi:10.48550/arxiv.1704.01696 · Cited by 585
Unsupervised Machine Translation Using Monolingual Corpora Only
Lample, G., Conneau, A., Denoyer, L., & Ranzato, M. (2017) · arXiv · doi:10.48550/arxiv.1711.00043 · Cited by 584
Gated Feedback Recurrent Neural Networks
Chung, J., Gulcehre, C., Cho, K., & Bengio, Y. (2015) · arXiv · doi:10.48550/arxiv.1502.02367 · Cited by 583 · cited 1×
“The gated feedback RNNs [47] allow the network to learn its own clock rates by using additional gates.”
BackgroundCode completion with statistical language models
Raychev, V., Vechev, M., & Yahav, E. (2014) · Proceedings of the 35th ACM SIGPLAN Conference on Programming Language Design and Implementation · doi:10.1145/2594291.2594321 · Cited by 555
Learning Explanatory Rules from Noisy Data
Evans, R., & Grefenstette, E. (2018) · Journal of Artificial Intelligence Research · doi:10.1613/jair.5714 · Cited by 426
DeepFix: Fixing Common C Language Errors by Deep Learning
Gupta, R., Pal, S., Kanade, A., & Shevade, S. (2017) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v31i1.10742 · Cited by 426
On the naturalness of software
Hindle, A., Barr, E. T., Su, Z., Gabel, M., & Devanbu, P. (2012) · 2012 34th International Conference on Software Engineering (ICSE) · doi:10.1109/icse.2012.6227135 · Cited by 425
Markov Chains: From Theory to Implementation and Experimentation
Gagniuc, P. A. (2017) · doi:10.1002/9781119387596 · Cited by 415 · cited 1×
“Different from the statistical construction of language models [22, 77], where the probability distribution of transition states of a Markov model [68] is learned, grammar inference determines an explicit representation of a programming language.”
BackgroundNeural Machine Translation in Linear Time
Kalchbrenner, N., Espeholt, L., Simonyan, K., Oord, A. V. D., Graves, A., & Kavukcuoglu, K. (2016) · arXiv · doi:10.48550/arxiv.1610.10099 · Cited by 414 · cited 1×
“Masked convolution layers are used as the decoder in a neural machine translation system [122].”
MethodNeural Programmer-Interpreters
Reed, S., & de Freitas, N. (2015) · arXiv · doi:10.48550/arxiv.1511.06279 · Cited by 347
On the computational power of neural nets
Siegelmann, H. T., & Sontag, E. D. (1992) · Proceedings of the fifth annual workshop on Computational learning theory · doi:10.1145/130385.130432 · Cited by 238
A Retrieve-and-Edit Framework for Predicting Structured Outputs
Hashimoto, T. B., Guu, K., Oren, Y., & Liang, P. (2018) · arXiv · doi:10.48550/arxiv.1812.01194 · Cited by 126
Scaling Memory-Augmented Neural Networks with Sparse Reads and Writes
Rae, J. W., Hunt, J. J., Harley, T., Danihelka, I., Senior, A., Wayne, G., Graves, A., & Lillicrap, T. P. (2016) · arXiv · doi:10.48550/arxiv.1610.09027 · Cited by 89
Using machine translation for converting Python 2 to Python 3 code
Aggarwal, K., Salameh, M., & Hindle, A. (2015) · doi:10.7287/peerj.preprints.1459v1 · Cited by 20
Research works printed but not linked: 248
- Simon Aebersold , Krzysztof Kryszczuk , Sergio Paganoni , Bernhard Tellenbach , and Timothy Trowbridge . 2016 . Detecting obfuscated JavaScripts using machine learning . In Proceedings of the 11th International Conference on Internet Monitoring and Protection (ICIMP’16) . IARIA. Simon Aebersold, Krzysztof Kryszczuk, Sergio Paganoni, Bernhard Tellenbach, and Timothy Trowbridge. 2016. Detecting obfuscated JavaScripts using machine learning. In Proceedings of the 11th International Conference on Internet Monitoring and Protection (ICIMP’16). IARIA.
- 10.1145/2635868.2635883 · DOI · Paper page
- 10.1145/2786805.2786849 · DOI · Paper page
- Miltiadis Allamanis , Earl T. Barr , Premkumar Devanbu , and Charles Sutton . 2018. A survey of machine learning for big code and naturalness. ACM Comput. Surv. 51, 4 , Article 81 (July 2018 ). Miltiadis Allamanis, Earl T. Barr, Premkumar Devanbu, and Charles Sutton. 2018. A survey of machine learning for big code and naturalness. ACM Comput. Surv. 51, 4, Article 81 (July 2018).
- Miltiadis Allamanis , Marc Brockschmidt , and Mahmoud Khademi . 2018 . Learning to represent programs with graphs . In Proceedings of the International Conference on Learning Representations (ICLR’18) . Miltiadis Allamanis, Marc Brockschmidt, and Mahmoud Khademi. 2018. Learning to represent programs with graphs. In Proceedings of the International Conference on Learning Representations (ICLR’18).
- 10.5555/2487085.2487127 · doi:10.5555/2487085.2487127
- 10.1145/2635868.2635901 · DOI
- Miltos Allamanis , Daniel Tarlow , Andrew Gordon , and Yi Wei . 2015 . Bimodal modelling of source code and natural language . In Proceedings of the 32nd International Conference on Machine Learning (ICML’15) . 2123--2132. Miltos Allamanis, Daniel Tarlow, Andrew Gordon, and Yi Wei. 2015. Bimodal modelling of source code and natural language. In Proceedings of the 32nd International Conference on Machine Learning (ICML’15). 2123--2132.
- Uri Alon , Shaked Brody , Omer Levy , and Eran Yahav . 2018. code2seq: Generating sequences from structured representations of code. arXiv preprint arXiv:1808.01400 ( 2018 ). Uri Alon, Shaked Brody, Omer Levy, and Eran Yahav. 2018. code2seq: Generating sequences from structured representations of code. arXiv preprint arXiv:1808.01400 (2018). · arXiv
- 10.1145/3290353 · DOI · Paper page
- Matthew Amodio , Swarat Chaudhuri , and Thomas Reps . 2017. Neural attribute machines for program generation. arXiv preprint arXiv:1705.09231 ( 2017 ). Matthew Amodio, Swarat Chaudhuri, and Thomas Reps. 2017. Neural attribute machines for program generation. arXiv preprint arXiv:1705.09231 (2017). · arXiv
- Martin Arjovsky , Amar Shah , and Yoshua Bengio . 2016 . Unitary evolution recurrent neural networks . In Proceedings of the International Conference on Machine Learning. 1120--1128 . Martin Arjovsky, Amar Shah, and Yoshua Bengio. 2016. Unitary evolution recurrent neural networks. In Proceedings of the International Conference on Machine Learning. 1120--1128.
- Jimmy Ba , Geoffrey E. Hinton , Volodymyr Mnih , Joel Z. Leibo , and Catalin Ionescu . 2016 . Using fast weights to attend to the recent past . In Proceedings of the Conference on Advances in Neural Information Processing Systems. 4331--4339 . Jimmy Ba, Geoffrey E. Hinton, Volodymyr Mnih, Joel Z. Leibo, and Catalin Ionescu. 2016. Using fast weights to attend to the recent past. In Proceedings of the Conference on Advances in Neural Information Processing Systems. 4331--4339.
- Jimmy Lei Ba , Jamie Ryan Kiros, and Geoffrey E. Hinton . 2016 . Layer normalization. arXiv preprint arXiv:1607.06450 (2016). Jimmy Lei Ba, Jamie Ryan Kiros, and Geoffrey E. Hinton. 2016. Layer normalization. arXiv preprint arXiv:1607.06450 (2016). · arXiv
- Dzmitry Bahdanau , Kyunghyun Cho , and Yoshua Bengio . 2014. Neural machine translation by jointly learning to align and translate. arXiv preprint arXiv:1409.0473 ( 2014 ). Dzmitry Bahdanau, Kyunghyun Cho, and Yoshua Bengio. 2014. Neural machine translation by jointly learning to align and translate. arXiv preprint arXiv:1409.0473 (2014). · arXiv
- David Balduzzi and Muhammad Ghifary . 2016. Strongly-typed recurrent neural networks. arXiv preprint arXiv:1602.02218 ( 2016 ). David Balduzzi and Muhammad Ghifary. 2016. Strongly-typed recurrent neural networks. arXiv preprint arXiv:1602.02218 (2016). · arXiv
- Matej Balog , Alexander L. Gaunt , Marc Brockschmidt , Sebastian Nowozin , and Daniel Tarlow . 2016 . Deepcoder: Learning to write programs. arXiv preprint arXiv:1611.01989 (2016). Matej Balog, Alexander L. Gaunt, Marc Brockschmidt, Sebastian Nowozin, and Daniel Tarlow. 2016. Deepcoder: Learning to write programs. arXiv preprint arXiv:1611.01989 (2016). · arXiv
- Antonio Valerio Miceli Barone and Rico Sennrich . 2017. A parallel corpus of Python functions and documentation strings for automated code documentation and code generation. arXiv preprint arXiv:1707.02275 ( 2017 ). Antonio Valerio Miceli Barone and Rico Sennrich. 2017. A parallel corpus of Python functions and documentation strings for automated code documentation and code generation. arXiv preprint arXiv:1707.02275 (2017). · arXiv
- Rohan Bavishi , Michael Pradel , and Koushik Sen . 2018. Context2Name: A deep learning-based approach to infer natural variable names from usage contexts. arXiv preprint arXiv:1809.05193 ( 2018 ). Rohan Bavishi, Michael Pradel, and Koushik Sen. 2018. Context2Name: A deep learning-based approach to infer natural variable names from usage contexts. arXiv preprint arXiv:1809.05193 (2018). · arXiv
- Tony Beltramelli . 2017. pix2code: Generating code from a graphical user interface screenshot. arXiv preprint arXiv:1705.07962 ( 2017 ). Tony Beltramelli. 2017. pix2code: Generating code from a graphical user interface screenshot. arXiv preprint arXiv:1705.07962 (2017). · arXiv
- Yoshua Bengio , Réjean Ducharme , Pascal Vincent , and Christian Jauvin . 2003 . A neural probabilistic language model . J. Mach. Learn. Res. 3 , Feb. (2003), 1137 -- 1155 . Yoshua Bengio, Réjean Ducharme, Pascal Vincent, and Christian Jauvin. 2003. A neural probabilistic language model. J. Mach. Learn. Res. 3, Feb. (2003), 1137--1155.
- Sahil Bhatia and Rishabh Singh . 2016. Automated correction for syntax errors in programming assignments using recurrent neural networks. arXiv preprint arXiv:1603.06129 ( 2016 ). Sahil Bhatia and Rishabh Singh. 2016. Automated correction for syntax errors in programming assignments using recurrent neural networks. arXiv preprint arXiv:1603.06129 (2016). · arXiv
- Avishkar Bhoopchand , Tim Rocktäschel , Earl Barr , and Sebastian Riedel . 2016. Learning Python code suggestion with a sparse pointer network. arXiv preprint arXiv:1611.08307 ( 2016 ). Avishkar Bhoopchand, Tim Rocktäschel, Earl Barr, and Sebastian Riedel. 2016. Learning Python code suggestion with a sparse pointer network. arXiv preprint arXiv:1611.08307 (2016). · arXiv
- Pavol Bielik , Veselin Raychev , and Martin Vechev . 2016 . PHOG: Probabilistic model for code . In Proceedings of the International Conference on Machine Learning. 2933--2942 . Pavol Bielik, Veselin Raychev, and Martin Vechev. 2016. PHOG: Probabilistic model for code. In Proceedings of the International Conference on Machine Learning. 2933--2942.
- Pavol Bielik , Veselin Raychev , and Martin Vechev . 2016 . Program synthesis for character level language modeling . In Proceedings of the International Conference on Learning Representations (ICLR’16) . Pavol Bielik, Veselin Raychev, and Martin Vechev. 2016. Program synthesis for character level language modeling. In Proceedings of the International Conference on Learning Representations (ICLR’16).
- Jörg Bornschein and Yoshua Bengio . 2014. Reweighted wake-sleep. arXiv preprint arXiv:1406.2751 ( 2014 ). Jörg Bornschein and Yoshua Bengio. 2014. Reweighted wake-sleep. arXiv preprint arXiv:1406.2751 (2014). · arXiv
- Jörg Bornschein , Andriy Mnih , Daniel Zoran , and Danilo Jimenez Rezende . 2017 . Variational memory addressing in generative models . In Proceedings of the Conference on Advances in Neural Information Processing Systems. 3921--3930 . Jörg Bornschein, Andriy Mnih, Daniel Zoran, and Danilo Jimenez Rezende. 2017. Variational memory addressing in generative models. In Proceedings of the Conference on Advances in Neural Information Processing Systems. 3921--3930.
- James Bradbury , Stephen Merity , Caiming Xiong , and Richard Socher . 2016. Quasi-recurrent neural networks. arXiv preprint arXiv:1611.01576 ( 2016 ). James Bradbury, Stephen Merity, Caiming Xiong, and Richard Socher. 2016. Quasi-recurrent neural networks. arXiv preprint arXiv:1611.01576 (2016). · arXiv
- Marc Brockschmidt , Miltiadis Allamanis , Alexander L. Gaunt , and Oleksandr Polozov . 2018. Generative code modeling with graphs. arXiv preprint arXiv:1805.08490 ( 2018 ). Marc Brockschmidt, Miltiadis Allamanis, Alexander L. Gaunt, and Oleksandr Polozov. 2018. Generative code modeling with graphs. arXiv preprint arXiv:1805.08490 (2018). · arXiv
- 10.1145/2538862.2538924 · DOI · Paper page
- Jonathon Cai , Richard Shin , and Dawn Song . 2017. Making neural programming architectures generalize via recursion. arXiv preprint arXiv:1704.06611 ( 2017 ). Jonathon Cai, Richard Shin, and Dawn Song. 2017. Making neural programming architectures generalize via recursion. arXiv preprint arXiv:1704.06611 (2017). · arXiv
- 10.1145/2597073.2597102 · DOI · Paper page
- 10.1109/SCAM.2013.6648197 · DOI
- Tantithamthavorn Chakkrit . 2016. Towards a Better Understanding of the Impact of Experimental Components on Defect Prediction Models. Ph . D. NARA Institute of Science and Technology . Tantithamthavorn Chakkrit. 2016. Towards a Better Understanding of the Impact of Experimental Components on Defect Prediction Models. Ph.D. NARA Institute of Science and Technology.
- 10.1109/ICSME.2016.17 · DOI
- 10.1109/ICSE.2017.48 · DOI
- 10.1145/3238147.3240471 · DOI · Paper page
- Zimin Chen , Steve Kommrusch , Michele Tufano , Louis-Noël Pouchet , Denys Poshyvanyk , and Martin Monperrus . 2018 . Sequencer: Sequence-to-sequence learning for end-to-end program repair. arXiv preprint arXiv:1901.01808 (2018). Zimin Chen, Steve Kommrusch, Michele Tufano, Louis-Noël Pouchet, Denys Poshyvanyk, and Martin Monperrus. 2018. Sequencer: Sequence-to-sequence learning for end-to-end program repair. arXiv preprint arXiv:1901.01808 (2018). · arXiv
- Zimin Chen and Martin Monperrus . 2019. A literature study of embeddings on source code. arXiv preprint arXiv:1904.03061 ( 2019 ). Zimin Chen and Martin Monperrus. 2019. A literature study of embeddings on source code. arXiv preprint arXiv:1904.03061 (2019). · arXiv
- Kyunghyun Cho , Bart Van Merriënboer , Caglar Gulcehre, Dzmitry Bahdanau, Fethi Bougares, Holger Schwenk, and Yoshua Bengio. 2014 . Learning phrase representations using RNN encoder-decoder for statistical machine translation. arXiv preprint arXiv:1406.1078 (2014). Kyunghyun Cho, Bart Van Merriënboer, Caglar Gulcehre, Dzmitry Bahdanau, Fethi Bougares, Holger Schwenk, and Yoshua Bengio. 2014. Learning phrase representations using RNN encoder-decoder for statistical machine translation. arXiv preprint arXiv:1406.1078 (2014). · arXiv
- Jan K. Chorowski , Dzmitry Bahdanau , Dmitriy Serdyuk , Kyunghyun Cho , and Yoshua Bengio . 2015 . Attention-based models for speech recognition . In Proceedings of the Conference on Advances in Neural Information Processing Systems. 577--585 . Jan K. Chorowski, Dzmitry Bahdanau, Dmitriy Serdyuk, Kyunghyun Cho, and Yoshua Bengio. 2015. Attention-based models for speech recognition. In Proceedings of the Conference on Advances in Neural Information Processing Systems. 577--585.
- 10.1145/2771284.2771286 · doi:10.1145/2771284.2771286
- Trevor Cohn , Phil Blunsom , and Sharon Goldwater . 2010 . Inducing tree-substitution grammars . J. Mach. Learn. Res. 11 , Nov. (2010), 3053 -- 3096 . Trevor Cohn, Phil Blunsom, and Sharon Goldwater. 2010. Inducing tree-substitution grammars. J. Mach. Learn. Res. 11, Nov. (2010), 3053--3096.
- Tim Cooijmans , Nicolas Ballas , César Laurent , Çağlar Gülçehre , and Aaron Courville . 2016. Recurrent batch normalization. arXiv preprint arXiv:1603.09025 ( 2016 ). Tim Cooijmans, Nicolas Ballas, César Laurent, Çağlar Gülçehre, and Aaron Courville. 2016. Recurrent batch normalization. arXiv preprint arXiv:1603.09025 (2016). · arXiv
- Balázs Csanád Csáji . 2001 . Approximation with Artificial Neural Networks. Master’s thesis. Faculty of Sciences, Etvs Lornd University , Hungary 24 (2001), 48 . Balázs Csanád Csáji. 2001. Approximation with Artificial Neural Networks. Master’s thesis. Faculty of Sciences, Etvs Lornd University, Hungary 24 (2001), 48.
- Milan Cvitkovic , Badal Singh , and Anima Anandkumar . 2018. Open vocabulary learning on source code with a graph-structured cache. arXiv preprint arXiv:1810.08305 ( 2018 ). Milan Cvitkovic, Badal Singh, and Anima Anandkumar. 2018. Open vocabulary learning on source code with a graph-structured cache. arXiv preprint arXiv:1810.08305 (2018). · arXiv
- Zihang Dai , Zhilin Yang , Yiming Yang , Jaime Carbonell , Quoc V. Le , and Ruslan Salakhutdinov . 2019 . Transformer-xl: Attentive language models beyond a fixed-length context. arXiv preprint arXiv:1901.02860 (2019). Zihang Dai, Zhilin Yang, Yiming Yang, Jaime Carbonell, Quoc V. Le, and Ruslan Salakhutdinov. 2019. Transformer-xl: Attentive language models beyond a fixed-length context. arXiv preprint arXiv:1901.02860 (2019). · arXiv
- Hoa Khanh Dam , Truyen Tran , and Trang Pham . 2016. A deep language model for software code. arXiv preprint arXiv:1608.02715 ( 2016 ). Hoa Khanh Dam, Truyen Tran, and Trang Pham. 2016. A deep language model for software code. arXiv preprint arXiv:1608.02715 (2016). · arXiv
- Rumen Dangovski , Li Jing , and Marin Soljacic . 2017. Rotational unit of memory. arXiv preprint arXiv:1710.09537 ( 2017 ). Rumen Dangovski, Li Jing, and Marin Soljacic. 2017. Rotational unit of memory. arXiv preprint arXiv:1710.09537 (2017). · arXiv
- 10.1017/CBO9781139194655 · DOI · Paper page
- Leonardo De Moura and Nikolaj Bjørner . 2008. Z3: An efficient SMT solver . In Tools and Algorithms for the Construction and Analysis of Systems . Springer , 337--340. Leonardo De Moura and Nikolaj Bjørner. 2008. Z3: An efficient SMT solver. In Tools and Algorithms for the Construction and Analysis of Systems. Springer, 337--340.
- Jesse Dodge , Andreea Gane , Xiang Zhang , Antoine Bordes , Sumit Chopra , Alexander Miller , Arthur Szlam , and Jason Weston . 2015. Evaluating prerequisite qualities for learning end-to-end dialog systems. arXiv preprint arXiv:1511.06931 ( 2015 ). Jesse Dodge, Andreea Gane, Xiang Zhang, Antoine Bordes, Sumit Chopra, Alexander Miller, Arthur Szlam, and Jason Weston. 2015. Evaluating prerequisite qualities for learning end-to-end dialog systems. arXiv preprint arXiv:1511.06931 (2015). · arXiv
- Li Dong , Nan Yang , Wenhui Wang , Furu Wei , Xiaodong Liu , Yu Wang , Jianfeng Gao , Ming Zhou , and Hsiao-Wuen Hon . 2019 . Unified language model pre-training for natural language understanding and generation . In Proceedings of the Conference on Advances in Neural Information Processing Systems. 13042--13054 . Li Dong, Nan Yang, Wenhui Wang, Furu Wei, Xiaodong Liu, Yu Wang, Jianfeng Gao, Ming Zhou, and Hsiao-Wuen Hon. 2019. Unified language model pre-training for natural language understanding and generation. In Proceedings of the Conference on Advances in Neural Information Processing Systems. 13042--13054.
- Kevin Ellis , Daniel Ritchie , Armando Solar-Lezama , and Joshua B . Tenenbaum . 2017 . Learning to infer graphics programs from hand-drawn images. arXiv preprint arXiv:1707.09627 (2017). Kevin Ellis, Daniel Ritchie, Armando Solar-Lezama, and Joshua B. Tenenbaum. 2017. Learning to infer graphics programs from hand-drawn images. arXiv preprint arXiv:1707.09627 (2017). · arXiv
- John K. Feser , Marc Brockschmidt , Alexander L. Gaunt , and Daniel Tarlow . 2016. Differentiable functional program interpreters. arXiv preprint arXiv:1611.01988 ( 2016 ). John K. Feser, Marc Brockschmidt, Alexander L. Gaunt, and Daniel Tarlow. 2016. Differentiable functional program interpreters. arXiv preprint arXiv:1611.01988 (2016). · arXiv
- Philip Gage . 1994 . A new algorithm for data compression . C Users J. 12 , 2 (1994), 23 -- 38 . Philip Gage. 1994. A new algorithm for data compression. C Users J. 12, 2 (1994), 23--38.
- Yarin Gal and Zoubin Ghahramani . 2016 . A theoretically grounded application of dropout in recurrent neural networks . In Proceedings of the Conference on Advances in Neural Information Processing Systems. 1019--1027 . Yarin Gal and Zoubin Ghahramani. 2016. A theoretically grounded application of dropout in recurrent neural networks. In Proceedings of the Conference on Advances in Neural Information Processing Systems. 1019--1027.
- Yaroslav Ganin , Evgeniya Ustinova , Hana Ajakan , Pascal Germain , Hugo Larochelle , François Laviolette , Mario Marchand , and Victor Lempitsky . 2016 . Domain-adversarial training of neural networks . J. Mach. Learn. Res. 17 , 59 (2016), 1 -- 35 . Yaroslav Ganin, Evgeniya Ustinova, Hana Ajakan, Pascal Germain, Hugo Larochelle, François Laviolette, Mario Marchand, and Victor Lempitsky. 2016. Domain-adversarial training of neural networks. J. Mach. Learn. Res. 17, 59 (2016), 1--35.
- Ravi Ganti and Alexander G . Gray . 2013 . Building bridges: Viewing active learning from the multi-armed bandit lens. arXiv preprint arXiv:1309.6830 (2013). Ravi Ganti and Alexander G. Gray. 2013. Building bridges: Viewing active learning from the multi-armed bandit lens. arXiv preprint arXiv:1309.6830 (2013). · arXiv
- Alexander L. Gaunt , Marc Brockschmidt , Rishabh Singh , Nate Kushman , Pushmeet Kohli , Jonathan Taylor , and Daniel Tarlow . 2016 . Terpret: A probabilistic programming language for program induction. arXiv preprint arXiv:1608.04428 (2016). Alexander L. Gaunt, Marc Brockschmidt, Rishabh Singh, Nate Kushman, Pushmeet Kohli, Jonathan Taylor, and Daniel Tarlow. 2016. Terpret: A probabilistic programming language for program induction. arXiv preprint arXiv:1608.04428 (2016). · arXiv
- 10.1145/3092566 · DOI · Paper page
- Ian Goodfellow , Yoshua Bengio , Aaron Courville , and Yoshua Bengio . 2016. Deep Learning . Vol. 1 . The MIT Press , Cambridge, MA . Ian Goodfellow, Yoshua Bengio, Aaron Courville, and Yoshua Bengio. 2016. Deep Learning. Vol. 1. The MIT Press, Cambridge, MA.
- Ian Goodfellow , Jean Pouget-Abadie , Mehdi Mirza , Bing Xu , David Warde-Farley , Sherjil Ozair , Aaron Courville , and Yoshua Bengio . 2014 . Generative adversarial nets . In Proceedings of the Conference on Advances in Neural Information Processing Systems. 2672--2680 . Ian Goodfellow, Jean Pouget-Abadie, Mehdi Mirza, Bing Xu, David Warde-Farley, Sherjil Ozair, Aaron Courville, and Yoshua Bengio. 2014. Generative adversarial nets. In Proceedings of the Conference on Advances in Neural Information Processing Systems. 2672--2680.
- 10.1006/csla.2001.0174 · DOI · Paper page
- Edouard Grave , Moustapha M. Cisse , and Armand Joulin . 2017 . Unbounded cache model for online language modeling with open vocabulary . In Proceedings of the Conference on Advances in Neural Information Processing Systems. 6042--6052 . Edouard Grave, Moustapha M. Cisse, and Armand Joulin. 2017. Unbounded cache model for online language modeling with open vocabulary. In Proceedings of the Conference on Advances in Neural Information Processing Systems. 6042--6052.
- Edward Grefenstette , Karl Moritz Hermann , Mustafa Suleyman , and Phil Blunsom . 2015 . Learning to transduce with unbounded memory . In Proceedings of the Conference on Advances in Neural Information Processing Systems. 1828--1836 . Edward Grefenstette, Karl Moritz Hermann, Mustafa Suleyman, and Phil Blunsom. 2015. Learning to transduce with unbounded memory. In Proceedings of the Conference on Advances in Neural Information Processing Systems. 1828--1836.
- Karol Gregor , Frederic Besse , Danilo Jimenez Rezende , Ivo Danihelka , and Daan Wierstra . 2016 . Towards conceptual compression . In Proceedings of the Conference on Advances in Neural Information Processing Systems. 3549--3557 . Karol Gregor, Frederic Besse, Danilo Jimenez Rezende, Ivo Danihelka, and Daan Wierstra. 2016. Towards conceptual compression. In Proceedings of the Conference on Advances in Neural Information Processing Systems. 3549--3557.
- Jiatao Gu , James Bradbury , Caiming Xiong , Victor O. K. Li , and Richard Socher . 2017. Non-autoregressive neural machine translation. arXiv preprint arXiv:1711.02281 ( 2017 ). Jiatao Gu, James Bradbury, Caiming Xiong, Victor O. K. Li, and Richard Socher. 2017. Non-autoregressive neural machine translation. arXiv preprint arXiv:1711.02281 (2017). · arXiv
- 10.1145/3180155.3180167 · DOI · Paper page
- 10.1145/2950290.2950334 · DOI · Paper page
- Xiaodong Gu , Hongyu Zhang , Dongmei Zhang , and Sunghun Kim . 2017. DeepAM: Migrate APIs with multi-modal sequence to sequence learning. arXiv preprint arXiv:1704.07734 ( 2017 ). Xiaodong Gu, Hongyu Zhang, Dongmei Zhang, and Sunghun Kim. 2017. DeepAM: Migrate APIs with multi-modal sequence to sequence learning. arXiv preprint arXiv:1704.07734 (2017). · arXiv
- 10.1145/1836089.1836091 · DOI · Paper page
- Anshul Gupta and Neel Sundaresan . 2018 . Intelligent code reviews using deep learning . In Proceedings of the 24th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining (KDD’18) Deep Learning Day. Anshul Gupta and Neel Sundaresan. 2018. Intelligent code reviews using deep learning. In Proceedings of the 24th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining (KDD’18) Deep Learning Day.
- Rahul Gupta , Aditya Kanade , and Shirish Shevade . 2018. Deep reinforcement learning for programming language correction. arXiv preprint arXiv:1801.10467 ( 2018 ). Rahul Gupta, Aditya Kanade, and Shirish Shevade. 2018. Deep reinforcement learning for programming language correction. arXiv preprint arXiv:1801.10467 (2018). · arXiv
- Kelvin Guu , Panupong Pasupat , Evan Zheran Liu, and Percy Liang . 2017 . From language to programs: Bridging reinforcement learning and maximum marginal likelihood. arXiv preprint arXiv:1704.07926 (2017). Kelvin Guu, Panupong Pasupat, Evan Zheran Liu, and Percy Liang. 2017. From language to programs: Bridging reinforcement learning and maximum marginal likelihood. arXiv preprint arXiv:1704.07926 (2017). · arXiv
- 10.1145/2491956.2462192 · DOI · Paper page
- Jacob Harer , Onur Ozdemir , Tomo Lazovich , Christopher Reale , Rebecca Russell , Louis Kim , et al. 2018 . Learning to repair software vulnerabilities with generative adversarial networks . In Proceedings of the Conference on Advances in Neural Information Processing Systems. 7933--7943 . Jacob Harer, Onur Ozdemir, Tomo Lazovich, Christopher Reale, Rebecca Russell, Louis Kim, et al. 2018. Learning to repair software vulnerabilities with generative adversarial networks. In Proceedings of the Conference on Advances in Neural Information Processing Systems. 7933--7943.
- 10.18653/v1/P17-1044 · DOI · Paper page
- Zhen He , Shaobing Gao , Liang Xiao , and David Barber . 2017 . Wider and deeper, cheaper and faster: Tensorized LSTMs for sequence learning . In Proceedings of the Conference on Advances in Neural Information Processing Systems. 1--11 . Zhen He, Shaobing Gao, Liang Xiao, and David Barber. 2017. Wider and deeper, cheaper and faster: Tensorized LSTMs for sequence learning. In Proceedings of the Conference on Advances in Neural Information Processing Systems. 1--11.
- Vincent J. Hellendoorn and Premkumar Devanbu. 2017. Are deep neural networks the best choice for modeling source code? In Proceedings of the 11th Joint Meeting on Foundations of Software Engineering. ACM, 763--773 . Vincent J. Hellendoorn and Premkumar Devanbu. 2017. Are deep neural networks the best choice for modeling source code? In Proceedings of the 11th Joint Meeting on Foundations of Software Engineering. ACM, 763--773.
- Mikael Henaff , Jason Weston , Arthur Szlam , Antoine Bordes , and Yann LeCun . 2016. Tracking the world state with recurrent entity networks. arXiv preprint arXiv:1612.03969 ( 2016 ). Mikael Henaff, Jason Weston, Arthur Szlam, Antoine Bordes, and Yann LeCun. 2016. Tracking the world state with recurrent entity networks. arXiv preprint arXiv:1612.03969 (2016). · arXiv
- Felix Hill , Antoine Bordes , Sumit Chopra , and Jason Weston . 2015. The Goldilocks principle: Reading children’s books with explicit memory representations. arXiv preprint arXiv:1511.02301 ( 2015 ). Felix Hill, Antoine Bordes, Sumit Chopra, and Jason Weston. 2015. The Goldilocks principle: Reading children’s books with explicit memory representations. arXiv preprint arXiv:1511.02301 (2015). · arXiv
- 10.5555/2337223.2337322 · doi:10.5555/2337223.2337322
- John E. Hopcroft. 2008. Introduction to Automata Theory Languages and Computation. Pearson Education India. 77--106. John E. Hopcroft. 2008. Introduction to Automata Theory Languages and Computation. Pearson Education India. 77--106.
- 10.1145/2660193.2660226 · DOI
- 10.1145/3196321.3196334 · DOI · Paper page
- 10.24963/ijcai.2018/314 · DOI · Paper page
- Hakan Inan , Khashayar Khosravi , and Richard Socher . 2016. Tying word vectors and word classifiers: A loss framework for language modeling. arXiv preprint arXiv:1611.01462 ( 2016 ). Hakan Inan, Khashayar Khosravi, and Richard Socher. 2016. Tying word vectors and word classifiers: A loss framework for language modeling. arXiv preprint arXiv:1611.01462 (2016). · arXiv
- Sergey Ioffe and Christian Szegedy . 2015 . Batch normalization: Accelerating deep network training by reducing internal covariate shift . In Proceedings of the International Conference on Machine Learning. 448--456 . Sergey Ioffe and Christian Szegedy. 2015. Batch normalization: Accelerating deep network training by reducing internal covariate shift. In Proceedings of the International Conference on Machine Learning. 448--456.
- 10.18653/v1/P16-1195 · DOI · Paper page
- 10.1162/0899766053630350 · DOI · Paper page
- 10.1162/neco.2006.18.9.2211 · DOI
- Max Jaderberg , Karen Simonyan , Andrew Zisserman , et al. 2015 . Spatial transformer networks . In Proceedings of the Conference on Advances in Neural Information Processing Systems. 2017--2025 . Max Jaderberg, Karen Simonyan, Andrew Zisserman, et al. 2015. Spatial transformer networks. In Proceedings of the Conference on Advances in Neural Information Processing Systems. 2017--2025.
- 10.1145/1806799.1806833 · DOI · Paper page
- Melvin Johnson , Mike Schuster , Quoc V. Le , Maxim Krikun , Yonghui Wu , Zhifeng Chen , Nikhil Thorat , Fernanda Viégas , Martin Wattenberg , Greg Corrado , et al . 2016 . Google’s multilingual neural machine translation system: Enabling zero-shot translation. arXiv preprint arXiv:1611.04558 (2016). Melvin Johnson, Mike Schuster, Quoc V. Le, Maxim Krikun, Yonghui Wu, Zhifeng Chen, Nikhil Thorat, Fernanda Viégas, Martin Wattenberg, Greg Corrado, et al. 2016. Google’s multilingual neural machine translation system: Enabling zero-shot translation. arXiv preprint arXiv:1611.04558 (2016). · arXiv
- Aravind Joshi and Owen Rambow . 2003 . A formalism for dependency grammar based on tree adjoining grammar . In Proceedings of the Conference on Meaning-text Theory. 207--216 . Aravind Joshi and Owen Rambow. 2003. A formalism for dependency grammar based on tree adjoining grammar. In Proceedings of the Conference on Meaning-text Theory. 207--216.
- Armand Joulin and Tomas Mikolov . 2015 . Inferring algorithmic patterns with stack-augmented recurrent nets . In Proceedings of the Conference on Advances in Neural Information Processing Systems. 190--198 . Armand Joulin and Tomas Mikolov. 2015. Inferring algorithmic patterns with stack-augmented recurrent nets. In Proceedings of the Conference on Advances in Neural Information Processing Systems. 190--198.
- René Just , Darioush Jalali , and Michael D. Ernst . 2014. Defects4J: A database of existing faults to enable controlled testing studies for Java programs . In Proceedings of the International Symposium on Software Testing and Analysis. ACM, 437--440 . René Just, Darioush Jalali, and Michael D. Ernst. 2014. Defects4J: A database of existing faults to enable controlled testing studies for Java programs. In Proceedings of the International Symposium on Software Testing and Analysis. ACM, 437--440.
- Łukasz Kaiser and Ilya Sutskever . 2016 . Neural GPUs learn algorithms . In Proceedings of the International Conference on Learning Representations (ICLR’16) . Łukasz Kaiser and Ilya Sutskever. 2016. Neural GPUs learn algorithms. In Proceedings of the International Conference on Learning Representations (ICLR’16).
- Nal Kalchbrenner and Phil Blunsom . 2013 . Recurrent continuous translation models . In Proceedings of the Conference on Empirical Methods in Natural Language Processing , Vol. 3 . 413. Nal Kalchbrenner and Phil Blunsom. 2013. Recurrent continuous translation models. In Proceedings of the Conference on Empirical Methods in Natural Language Processing, Vol. 3. 413.
- Nal Kalchbrenner , Aaron van den Oord , Karen Simonyan , Ivo Danihelka , Oriol Vinyals , Alex Graves , and Koray Kavukcuoglu . 2016. Video pixel networks. arXiv preprint arXiv:1610.00527 ( 2016 ). Nal Kalchbrenner, Aaron van den Oord, Karen Simonyan, Ivo Danihelka, Oriol Vinyals, Alex Graves, and Koray Kavukcuoglu. 2016. Video pixel networks. arXiv preprint arXiv:1610.00527 (2016). · arXiv
- Rafael-Michael Karampatsis and Charles Sutton . 2019. Maybe deep neural networks are the best choice for modeling source code. arXiv preprint arXiv:1903.05734 ( 2019 ). Rafael-Michael Karampatsis and Charles Sutton. 2019. Maybe deep neural networks are the best choice for modeling source code. arXiv preprint arXiv:1903.05734 (2019). · arXiv
- Tero Karras , Timo Aila , Samuli Laine , and Jaakko Lehtinen . 2017. Progressive growing of GANs for improved quality, stability, and variation. arXiv preprint arXiv:1710.10196 ( 2017 ). Tero Karras, Timo Aila, Samuli Laine, and Jaakko Lehtinen. 2017. Progressive growing of GANs for improved quality, stability, and variation. arXiv preprint arXiv:1710.10196 (2017). · arXiv
- Hoa Khanh Dam , Truyen Tran , and Trang Pham . 2016. A deep language model for software code. arXiv preprint arXiv:1608.02715 ( 2016 ). Hoa Khanh Dam, Truyen Tran, and Trang Pham. 2016. A deep language model for software code. arXiv preprint arXiv:1608.02715 (2016). · arXiv
- Diederik P. Kingma and Jimmy Ba . 2014 . Adam : A method for stochastic optimization. arXiv preprint arXiv:1412.6980 (2014). Diederik P. Kingma and Jimmy Ba. 2014. Adam: A method for stochastic optimization. arXiv preprint arXiv:1412.6980 (2014). · arXiv
- Diederik P. Kingma , Tim Salimans , Rafal Jozefowicz , Xi Chen , Ilya Sutskever , and Max Welling . 2016 . Improved variational inference with inverse autoregressive flow . In Proceedings of the Conference on Advances in Neural Information Processing Systems. 4743--4751 . Diederik P. Kingma, Tim Salimans, Rafal Jozefowicz, Xi Chen, Ilya Sutskever, and Max Welling. 2016. Improved variational inference with inverse autoregressive flow. In Proceedings of the Conference on Advances in Neural Information Processing Systems. 4743--4751.
- Diederik P. Kingma and Max Welling . 2013 . Auto-encoding variational Bayes . arXiv preprint arXiv:1312.6114 (2013). Diederik P. Kingma and Max Welling. 2013. Auto-encoding variational Bayes. arXiv preprint arXiv:1312.6114 (2013). · arXiv
- 10.1007/BF01692511 · DOI · Paper page
- 10.5555/1557769.1557821 · doi:10.5555/1557769.1557821
- Philipp Koehn and Rebecca Knowles . 2017. Six challenges for neural machine translation. arXiv preprint arXiv:1706.03872 ( 2017 ). Philipp Koehn and Rebecca Knowles. 2017. Six challenges for neural machine translation. arXiv preprint arXiv:1706.03872 (2017). · arXiv
- John F. Kolen . 1994 . Fool’s gold: Extracting finite state machines from recurrent network dynamics . In Proceedings of the Conference on Advances in Neural Information Processing Systems. 501--508 . John F. Kolen. 1994. Fool’s gold: Extracting finite state machines from recurrent network dynamics. In Proceedings of the Conference on Advances in Neural Information Processing Systems. 501--508.
- Ksenia Konyushkova , Raphael Sznitman , and Pascal Fua . 2017 . Learning active learning from data . In Proceedings of the Conference on Advances in Neural Information Processing Systems. 4226--4236 . Ksenia Konyushkova, Raphael Sznitman, and Pascal Fua. 2017. Learning active learning from data. In Proceedings of the Conference on Advances in Neural Information Processing Systems. 4226--4236.
- Jan Koutnik , Klaus Greff , Faustino Gomez , and Juergen Schmidhuber . 2014 . A clockwork RNN . In Proceedings of the International Conference on Machine Learning. 1863--1871 . Jan Koutnik, Klaus Greff, Faustino Gomez, and Juergen Schmidhuber. 2014. A clockwork RNN. In Proceedings of the International Conference on Machine Learning. 1863--1871.
- Ben Krause , Emmanuel Kahembwe , Iain Murray , and Steve Renals . 2017. Dynamic evaluation of neural sequence models. arXiv preprint arXiv:1709.07432 ( 2017 ). Ben Krause, Emmanuel Kahembwe, Iain Murray, and Steve Renals. 2017. Dynamic evaluation of neural sequence models. arXiv preprint arXiv:1709.07432 (2017). · arXiv
- David Krueger , Tegan Maharaj , János Kramár , Mohammad Pezeshki , Nicolas Ballas , Nan Rosemary Ke , Anirudh Goyal, Yoshua Bengio, Aaron Courville, and Chris Pal. 2016 . Zoneout : Regularizing RNNs by randomly preserving hidden activations. arXiv preprint arXiv:1606.01305 (2016). David Krueger, Tegan Maharaj, János Kramár, Mohammad Pezeshki, Nicolas Ballas, Nan Rosemary Ke, Anirudh Goyal, Yoshua Bengio, Aaron Courville, and Chris Pal. 2016. Zoneout: Regularizing RNNs by randomly preserving hidden activations. arXiv preprint arXiv:1606.01305 (2016). · arXiv
- Karol Kurach , Marcin Andrychowicz , and Ilya Sutskever . 2015. Neural random-access machines. arXiv preprint arXiv:1511.06392 ( 2015 ). Karol Kurach, Marcin Andrychowicz, and Ilya Sutskever. 2015. Neural random-access machines. arXiv preprint arXiv:1511.06392 (2015). · arXiv
- Thomas Laengle , Tim C. Lueth , Eva Stopp , Gerd Herzog , and Gjertrud Kamstrup . 1995 . KANTRA-A natural language interface for intelligent robots . In Proceedings of the Conference on Intelligent Autonomous Systems (IAS’95) . 357--364. Thomas Laengle, Tim C. Lueth, Eva Stopp, Gerd Herzog, and Gjertrud Kamstrup. 1995. KANTRA-A natural language interface for intelligent robots. In Proceedings of the Conference on Intelligent Autonomous Systems (IAS’95). 357--364.
- An Ngoc Lam , Anh Tuan Nguyen , Hoan Anh Nguyen , and Tien N. Nguyen . 2017. Bug localization with combination of deep learning and information retrieval . In Proceedings of the IEEE/ACM 25th International Conference on Program Comprehension (ICPC’17) . IEEE, 218--229. An Ngoc Lam, Anh Tuan Nguyen, Hoan Anh Nguyen, and Tien N. Nguyen. 2017. Bug localization with combination of deep learning and information retrieval. In Proceedings of the IEEE/ACM 25th International Conference on Program Comprehension (ICPC’17). IEEE, 218--229.
- 10.5555/2487085.2487125 · doi:10.5555/2487085.2487125
- 10.1145/2786805.2786880 · DOI · Paper page
- Triet Huynh Minh Le , Bushra Sabir , and Muhammad Ali Babar . 2019 . Automated software vulnerability assessment with concept drift . In Proceedings of the IEEE/ACM 16th International Conference on Mining Software Repositories (MSR’19) . IEEE, 371--382. Triet Huynh Minh Le, Bushra Sabir, and Muhammad Ali Babar. 2019. Automated software vulnerability assessment with concept drift. In Proceedings of the IEEE/ACM 16th International Conference on Mining Software Repositories (MSR’19). IEEE, 371--382.
- Christian Ledig , Lucas Theis , Ferenc Huszár , Jose Caballero , Andrew Cunningham , Alejandro Acosta , Andrew Aitken , Alykhan Tejani , Johannes Totz , Zehan Wang , et al . 2016 . Photo-realistic single image super-resolution using a generative adversarial network. arXiv preprint arXiv:1609.04802 (2016). Christian Ledig, Lucas Theis, Ferenc Huszár, Jose Caballero, Andrew Cunningham, Alejandro Acosta, Andrew Aitken, Alykhan Tejani, Johannes Totz, Zehan Wang, et al. 2016. Photo-realistic single image super-resolution using a generative adversarial network. arXiv preprint arXiv:1609.04802 (2016). · arXiv
- Tao Lei and Yu Zhang . 2017. Training RNNs as fast as CNNs. arXiv preprint arXiv:1709.02755 ( 2017 ). Tao Lei and Yu Zhang. 2017. Training RNNs as fast as CNNs. arXiv preprint arXiv:1709.02755 (2017). · arXiv
- Chengtao Li , Daniel Tarlow , Alexander L. Gaunt , Marc Brockschmidt , and Nate Kushman . 2017 . Neural program lattices . In Proceedings of the International Conference on Learning Representations (ICLR’17) . Chengtao Li, Daniel Tarlow, Alexander L. Gaunt, Marc Brockschmidt, and Nate Kushman. 2017. Neural program lattices. In Proceedings of the International Conference on Learning Representations (ICLR’17).
- Jian Li , Yue Wang , Irwin King , and Michael R . Lyu . 2017 . Code completion with neural attention and pointer networks. arXiv preprint arXiv:1711.09573 (2017). Jian Li, Yue Wang, Irwin King, and Michael R. Lyu. 2017. Code completion with neural attention and pointer networks. arXiv preprint arXiv:1711.09573 (2017). · arXiv
- Yujia Li , Daniel Tarlow , Marc Brockschmidt , and Richard Zemel . 2015. Gated graph sequence neural networks. arXiv preprint arXiv:1511.05493 ( 2015 ). Yujia Li, Daniel Tarlow, Marc Brockschmidt, and Richard Zemel. 2015. Gated graph sequence neural networks. arXiv preprint arXiv:1511.05493 (2015). · arXiv
- Zhen Li , Deqing Zou , Shouhuai Xu , Xinyu Ou , Hai Jin , Sujuan Wang , Zhijun Deng , and Yuyi Zhong . 2018. VulDeePecker: A deep learning-based system for vulnerability detection. arXiv preprint arXiv:1801.01681 ( 2018 ). Zhen Li, Deqing Zou, Shouhuai Xu, Xinyu Ou, Hai Jin, Sujuan Wang, Zhijun Deng, and Yuyi Zhong. 2018. VulDeePecker: A deep learning-based system for vulnerability detection. arXiv preprint arXiv:1801.01681 (2018). · arXiv
- Chen Liang , Jonathan Berant , Quoc Le , Kenneth D. Forbus , and Ni Lao . 2016. Neural symbolic machines: Learning semantic parsers on freebase with weak supervision. arXiv preprint arXiv:1611.00020 ( 2016 ). Chen Liang, Jonathan Berant, Quoc Le, Kenneth D. Forbus, and Ni Lao. 2016. Neural symbolic machines: Learning semantic parsers on freebase with weak supervision. arXiv preprint arXiv:1611.00020 (2016). · arXiv
- Chin-Yew Lin . 2004 . ROUGE: A package for automatic evaluation of summaries. In Text Summarization Branches out: Proceedings of the ACL-04 Workshop , Vol. 8 . Chin-Yew Lin. 2004. ROUGE: A package for automatic evaluation of summaries. In Text Summarization Branches out: Proceedings of the ACL-04 Workshop, Vol. 8.
- Wang Ling , Edward Grefenstette , Karl Moritz Hermann , Tomáš Kočiskỳ, Andrew Senior, Fumin Wang, and Phil Blunsom. 2016 . Latent predictor networks for code generation. arXiv preprint arXiv:1603.06744 (2016). Wang Ling, Edward Grefenstette, Karl Moritz Hermann, Tomáš Kočiskỳ, Andrew Senior, Fumin Wang, and Phil Blunsom. 2016. Latent predictor networks for code generation. arXiv preprint arXiv:1603.06744 (2016). · arXiv
- Wang Ling , Tiago Luís , Luís Marujo , Ramón Fernandez Astudillo , Silvio Amir, Chris Dyer, Alan W. Black, and Isabel Trancoso. 2015 . Finding function in form: Compositional character models for open vocabulary word representation. arXiv preprint arXiv:1508.02096 (2015). Wang Ling, Tiago Luís, Luís Marujo, Ramón Fernandez Astudillo, Silvio Amir, Chris Dyer, Alan W. Black, and Isabel Trancoso. 2015. Finding function in form: Compositional character models for open vocabulary word representation. arXiv preprint arXiv:1508.02096 (2015). · arXiv
- Chang Liu , Xinyun Chen , Eui Chul Shin , Mingcheng Chen , and Dawn Song . 2016 . Latent attention for if-then program synthesis . In Proceedings of the Conference on Advances in Neural Information Processing Systems. 4574--4582 . Chang Liu, Xinyun Chen, Eui Chul Shin, Mingcheng Chen, and Dawn Song. 2016. Latent attention for if-then program synthesis. In Proceedings of the Conference on Advances in Neural Information Processing Systems. 4574--4582.
- Chang Liu Xin Wang Richard Shin Joseph E. Gonzalez and Dawn Song. 2016. Neural code completion. OpenReview. Retrieved from: https://openreview.net/pdf?id=rJbPBt9lg. Chang Liu Xin Wang Richard Shin Joseph E. Gonzalez and Dawn Song. 2016. Neural code completion. OpenReview. Retrieved from: https://openreview.net/pdf?id=rJbPBt9lg.
- Chia-Wei Liu , Ryan Lowe , Iulian V. Serban , Michael Noseworthy , Laurent Charlin , and Joelle Pineau . 2016. How NOT to evaluate your dialogue system: An empirical study of unsupervised evaluation metrics for dialogue response generation. arXiv preprint arXiv:1603.08023 ( 2016 ). Chia-Wei Liu, Ryan Lowe, Iulian V. Serban, Michael Noseworthy, Laurent Charlin, and Joelle Pineau. 2016. How NOT to evaluate your dialogue system: An empirical study of unsupervised evaluation metrics for dialogue response generation. arXiv preprint arXiv:1603.08023 (2016). · arXiv
- 10.1145/2889160.2891040 · DOI
- 10.1109/ASE.2015.42 · DOI · Paper page
- Haoyu Ma , Xinjie Ma , Weijie Liu , Zhipeng Huang , Debin Gao , and Chunfu Jia . 2014 . Control flow obfuscation using neural network to fight concolic testing . In Proceedings of the International Conference on Security and Privacy in Communication Networks (SecureComm’14) . Haoyu Ma, Xinjie Ma, Weijie Liu, Zhipeng Huang, Debin Gao, and Chunfu Jia. 2014. Control flow obfuscation using neural network to fight concolic testing. In Proceedings of the International Conference on Security and Privacy in Communication Networks (SecureComm’14).
- Chris Maddison and Daniel Tarlow . 2014 . Structured generative models of natural source code . In Proceedings of the 31st International Conference on Machine Learning (ICML’14) . 649--657. Chris Maddison and Daniel Tarlow. 2014. Structured generative models of natural source code. In Proceedings of the 31st International Conference on Machine Learning (ICML’14). 649--657.
- Chris J. Maddison , Andriy Mnih , and Yee Whye Teh . 2016. The concrete distribution: A continuous relaxation of discrete random variables. arXiv preprint arXiv:1611.00712 ( 2016 ). Chris J. Maddison, Andriy Mnih, and Yee Whye Teh. 2016. The concrete distribution: A continuous relaxation of discrete random variables. arXiv preprint arXiv:1611.00712 (2016). · arXiv
- 10.1145/3133910 · DOI
- Stephan Mandt , Matthew D. Hoffman , and David M . Blei . 2017 . Stochastic gradient descent as approximate Bayesian inference. arXiv preprint arXiv:1704.04289 (2017). Stephan Mandt, Matthew D. Hoffman, and David M. Blei. 2017. Stochastic gradient descent as approximate Bayesian inference. arXiv preprint arXiv:1704.04289 (2017). · arXiv
- Bryan McCann , James Bradbury , Caiming Xiong , and Richard Socher . 2017. Learned in translation: Contextualized word vectors. arXiv preprint arXiv:1708.00107 ( 2017 ). Bryan McCann, James Bradbury, Caiming Xiong, and Richard Socher. 2017. Learned in translation: Contextualized word vectors. arXiv preprint arXiv:1708.00107 (2017). · arXiv
- Richard McPherson , Reza Shokri , and Vitaly Shmatikov . 2016. Defeating image obfuscation with deep learning. arXiv preprint arXiv:1609.00408 ( 2016 ). Richard McPherson, Reza Shokri, and Vitaly Shmatikov. 2016. Defeating image obfuscation with deep learning. arXiv preprint arXiv:1609.00408 (2016). · arXiv
- Soroush Mehri , Kundan Kumar , Ishaan Gulrajani , Rithesh Kumar , Shubham Jain , Jose Sotelo , Aaron Courville , and Yoshua Bengio . 2016. SampleRNN: An unconditional end-to-end neural audio generation model. arXiv preprint arXiv:1612.07837 ( 2016 ). Soroush Mehri, Kundan Kumar, Ishaan Gulrajani, Rithesh Kumar, Shubham Jain, Jose Sotelo, Aaron Courville, and Yoshua Bengio. 2016. SampleRNN: An unconditional end-to-end neural audio generation model. arXiv preprint arXiv:1612.07837 (2016). · arXiv
- Gábor Melis , Chris Dyer , and Phil Blunsom . 2017. On the state of the art of evaluation in neural language models. arXiv preprint arXiv:1707.05589 ( 2017 ). Gábor Melis, Chris Dyer, and Phil Blunsom. 2017. On the state of the art of evaluation in neural language models. arXiv preprint arXiv:1707.05589 (2017). · arXiv
- Stephen Merity , Nitish Shirish Keskar, and Richard Socher . 2017 . Regularizing and optimizing LSTM language models. arXiv preprint arXiv:1708.02182 (2017). Stephen Merity, Nitish Shirish Keskar, and Richard Socher. 2017. Regularizing and optimizing LSTM language models. arXiv preprint arXiv:1708.02182 (2017). · arXiv
- Stephen Merity , Bryan McCann , and Richard Socher . 2017. Revisiting activation regularization for language RNNs. arXiv preprint arXiv:1708.01009 ( 2017 ). Stephen Merity, Bryan McCann, and Richard Socher. 2017. Revisiting activation regularization for language RNNs. arXiv preprint arXiv:1708.01009 (2017). · arXiv
- Tomas Mikolov , Armand Joulin , and Marco Baroni . 2015. A roadmap towards machine intelligence. arXiv preprint arXiv:1511.08130 ( 2015 ). Tomas Mikolov, Armand Joulin, and Marco Baroni. 2015. A roadmap towards machine intelligence. arXiv preprint arXiv:1511.08130 (2015). · arXiv
- Tomas Mikolov , Ilya Sutskever , Kai Chen , Greg S. Corrado , and Jeff Dean . 2013 . Distributed representations of words and phrases and their compositionality . In Proceedings of the Conference on Advances in Neural Information Processing Systems. 3111--3119 . Tomas Mikolov, Ilya Sutskever, Kai Chen, Greg S. Corrado, and Jeff Dean. 2013. Distributed representations of words and phrases and their compositionality. In Proceedings of the Conference on Advances in Neural Information Processing Systems. 3111--3119.
- Alexander Miller , Adam Fisch , Jesse Dodge , Amir-Hossein Karimi , Antoine Bordes , and Jason Weston . 2016. Key-value memory networks for directly reading documents. arXiv preprint arXiv:1606.03126 ( 2016 ). Alexander Miller, Adam Fisch, Jesse Dodge, Amir-Hossein Karimi, Antoine Bordes, and Jason Weston. 2016. Key-value memory networks for directly reading documents. arXiv preprint arXiv:1606.03126 (2016). · arXiv
- Nikhil Mishra , Mostafa Rohaninejad , Xi Chen , and Pieter Abbeel . 2017. Meta-learning with temporal convolutions. arXiv preprint arXiv:1707.03141 ( 2017 ). Nikhil Mishra, Mostafa Rohaninejad, Xi Chen, and Pieter Abbeel. 2017. Meta-learning with temporal convolutions. arXiv preprint arXiv:1707.03141 (2017). · arXiv
- Ishan Misra , Ross Girshick , Rob Fergus , Martial Hebert , Abhinav Gupta , and Laurens van der Maaten . 2017. Learning by asking questions. arXiv preprint arXiv:1712.01238 ( 2017 ). Ishan Misra, Ross Girshick, Rob Fergus, Martial Hebert, Abhinav Gupta, and Laurens van der Maaten. 2017. Learning by asking questions. arXiv preprint arXiv:1712.01238 (2017). · arXiv
- Takeru Miyato , Toshiki Kataoka , Masanori Koyama , and Yuichi Yoshida . 2018. Spectral normalization for generative adversarial networks. arXiv preprint arXiv:1802.05957 ( 2018 ). Takeru Miyato, Toshiki Kataoka, Masanori Koyama, and Yuichi Yoshida. 2018. Spectral normalization for generative adversarial networks. arXiv preprint arXiv:1802.05957 (2018). · arXiv
- Andriy Mnih and Karol Gregor . 2014. Neural variational inference and learning in belief networks. arXiv preprint arXiv:1402.0030 ( 2014 ). Andriy Mnih and Karol Gregor. 2014. Neural variational inference and learning in belief networks. arXiv preprint arXiv:1402.0030 (2014). · arXiv
- 10.1145/1273496.1273577 · DOI · Paper page
- Andriy Mnih and Geoffrey E. Hinton . 2009. A scalable hierarchical distributed language model . In Proceedings of the Conference on Advances in Neural Information Processing Systems. 1081--1088 . Andriy Mnih and Geoffrey E. Hinton. 2009. A scalable hierarchical distributed language model. In Proceedings of the Conference on Advances in Neural Information Processing Systems. 1081--1088.
- 10.1145/3105906 · DOI · Paper page
- Lili Mou , Ge Li , Lu Zhang , Tao Wang , and Zhi Jin . 2016 . Convolutional neural networks over tree structures for programming language processing . In Proceedings of the 30th AAAI Conference on Artificial Intelligence. Lili Mou, Ge Li, Lu Zhang, Tao Wang, and Zhi Jin. 2016. Convolutional neural networks over tree structures for programming language processing. In Proceedings of the 30th AAAI Conference on Artificial Intelligence.
- 10.1016/0743-1066(94)90035-3 · DOI · Paper page
- Asier Mujika , Florian Meier , and Angelika Steger . 2017. Fast-slow recurrent neural networks. arXiv preprint arXiv:1705.08639 ( 2017 ). Asier Mujika, Florian Meier, and Angelika Steger. 2017. Fast-slow recurrent neural networks. arXiv preprint arXiv:1705.08639 (2017). · arXiv
- Kant Neel . 2018. Recent advances in neural program synthesis. arXiv preprint arXiv:1802.02353 ( 2018 ). Kant Neel. 2018. Recent advances in neural program synthesis. arXiv preprint arXiv:1802.02353 (2018). · arXiv
- Arvind Neelakantan , Quoc V. Le , and Ilya Sutskever . 2015. Neural programmer: Inducing latent programs with gradient descent. arXiv preprint arXiv:1511.04834 ( 2015 ). Arvind Neelakantan, Quoc V. Le, and Ilya Sutskever. 2015. Neural programmer: Inducing latent programs with gradient descent. arXiv preprint arXiv:1511.04834 (2015). · arXiv
- 10.1109/CVPR.2015.7298640 · DOI · Paper page
- Anh Tuan Nguyen and Tien N. Nguyen . 2015. Graph-based statistical language model for code . In Proceedings of the IEEE/ACM 37th IEEE International Conference on Software Engineering (ICSE’15) , Vol. 1 . IEEE, 858--868. Anh Tuan Nguyen and Tien N. Nguyen. 2015. Graph-based statistical language model for code. In Proceedings of the IEEE/ACM 37th IEEE International Conference on Software Engineering (ICSE’15), Vol. 1. IEEE, 858--868.
- Trong Duc Nguyen , Anh Tuan Nguyen , Hung Dang Phan , and Tien N. Nguyen . 2017. Exploring API embedding for API usages and applications . In Proceedings of the IEEE/ACM 39th International Conference on Software Engineering (ICSE’17) . IEEE, 438--449. Trong Duc Nguyen, Anh Tuan Nguyen, Hung Dang Phan, and Tien N. Nguyen. 2017. Exploring API embedding for API usages and applications. In Proceedings of the IEEE/ACM 39th International Conference on Software Engineering (ICSE’17). IEEE, 438--449.
- Tung Thanh Nguyen , Anh Tuan Nguyen , Hoan Anh Nguyen , and Tien N. Nguyen . 2013. A statistical semantic language model for source code . In Proceedings of the 9th Joint Meeting on Foundations of Software Engineering. ACM, 532--542 . Tung Thanh Nguyen, Anh Tuan Nguyen, Hoan Anh Nguyen, and Tien N. Nguyen. 2013. A statistical semantic language model for source code. In Proceedings of the 9th Joint Meeting on Foundations of Software Engineering. ACM, 532--542.
- 10.1109/ASE.2015.36 · DOI · Paper page
- Aaron van den Oord , Sander Dieleman , Heiga Zen , Karen Simonyan , Oriol Vinyals , Alex Graves , Nal Kalchbrenner , Andrew Senior , and Koray Kavukcuoglu . 2016. WaveNet: A generative model for raw audio. arXiv preprint arXiv:1609.03499 ( 2016 ). Aaron van den Oord, Sander Dieleman, Heiga Zen, Karen Simonyan, Oriol Vinyals, Alex Graves, Nal Kalchbrenner, Andrew Senior, and Koray Kavukcuoglu. 2016. WaveNet: A generative model for raw audio. arXiv preprint arXiv:1609.03499 (2016). · arXiv
- Aaron van den Oord , Yazhe Li , Igor Babuschkin , Karen Simonyan , Oriol Vinyals , and Koray Kavukcuoglu . 2017. Parallel WaveNet: Fast high-fidelity speech synthesis. arXiv preprint arXiv:1711.10433 ( 2017 ). Aaron van den Oord, Yazhe Li, Igor Babuschkin, Karen Simonyan, Oriol Vinyals, and Koray Kavukcuoglu. 2017. Parallel WaveNet: Fast high-fidelity speech synthesis. arXiv preprint arXiv:1711.10433 (2017). · arXiv
- 10.1145/3196398.3196402 · DOI
- 10.1145/3196321.3196359 · DOI
- 10.1109/MILCOM.2016.7795300 · DOI · Paper page
- Kishore Papineni , Salim Roukos , Todd Ward , and Wei-Jing Zhu . 2002 . BLEU: A method for automatic evaluation of machine translation . In Proceedings of the 40th Annual Meeting on Association for Computational Linguistics. Association for Computational Linguistics, 311--318 . Kishore Papineni, Salim Roukos, Todd Ward, and Wei-Jing Zhu. 2002. BLEU: A method for automatic evaluation of machine translation. In Proceedings of the 40th Annual Meeting on Association for Computational Linguistics. Association for Computational Linguistics, 311--318.
- Emilio Parisotto , Abdel-rahman Mohamed, Rishabh Singh , Lihong Li , Dengyong Zhou , and Pushmeet Kohli . 2016. Neuro-symbolic program synthesis. arXiv preprint arXiv:1611.01855 ( 2016 ). Emilio Parisotto, Abdel-rahman Mohamed, Rishabh Singh, Lihong Li, Dengyong Zhou, and Pushmeet Kohli. 2016. Neuro-symbolic program synthesis. arXiv preprint arXiv:1611.01855 (2016). · arXiv
- Emilio Parisotto and Ruslan Salakhutdinov . 2017. Neural map: Structured memory for deep reinforcement learning. arXiv preprint arXiv:1702.08360 ( 2017 ). Emilio Parisotto and Ruslan Salakhutdinov. 2017. Neural map: Structured memory for deep reinforcement learning. arXiv preprint arXiv:1702.08360 (2017). · arXiv
- Razvan Pascanu , Caglar Gulcehre , Kyunghyun Cho , and Yoshua Bengio . 2013. How to construct deep recurrent neural networks. arXiv preprint arXiv:1312.6026 ( 2013 ). Razvan Pascanu, Caglar Gulcehre, Kyunghyun Cho, and Yoshua Bengio. 2013. How to construct deep recurrent neural networks. arXiv preprint arXiv:1312.6026 (2013). · arXiv
- Razvan Pascanu , Tomas Mikolov , and Yoshua Bengio . 2013 . On the difficulty of training recurrent neural networks . In Proceedings of the International Conference on Machine Learning. 1310--1318 . Razvan Pascanu, Tomas Mikolov, and Yoshua Bengio. 2013. On the difficulty of training recurrent neural networks. In Proceedings of the International Conference on Machine Learning. 1310--1318.
- Jeffrey Pennington , Richard Socher , and Christopher D. Manning . 2014. GloVe: Global vectors for word representation . In Proceedings of the Conference on Empirical Methods in Natural Language Processing (EMNLP’14) . 1532--1543. Jeffrey Pennington, Richard Socher, and Christopher D. Manning. 2014. GloVe: Global vectors for word representation. In Proceedings of the Conference on Empirical Methods in Natural Language Processing (EMNLP’14). 1532--1543.
- 10.1109/MIS.2001.1183338 · DOI · Paper page
- Matthew E. Peters , Waleed Ammar , Chandra Bhagavatula , and Russell Power . 2017. Semi-supervised sequence tagging with bidirectional language models. arXiv preprint arXiv:1705.00108 ( 2017 ). Matthew E. Peters, Waleed Ammar, Chandra Bhagavatula, and Russell Power. 2017. Semi-supervised sequence tagging with bidirectional language models. arXiv preprint arXiv:1705.00108 (2017). · arXiv
- Illia Polosukhin and Alexander Skidanov . 2018. Neural program search: Solving programming tasks from description and examples. arXiv preprint arXiv:1802.04335 ( 2018 ). Illia Polosukhin and Alexander Skidanov. 2018. Neural program search: Solving programming tasks from description and examples. arXiv preprint arXiv:1802.04335 (2018). · arXiv
- 10.1145/2889160.2889172 · DOI
- Samira Pouyanfar , Saad Sadiq , Yilin Yan , Haiman Tian , Yudong Tao , Maria Presa Reyes , Mei-Ling Shyu , Shu-Ching Chen , and S. S. Iyengar . 2018 . A survey on deep learning: Algorithms, techniques, and applications . ACM Comput. Surv. 51 , 5 (2018), 92 . Samira Pouyanfar, Saad Sadiq, Yilin Yan, Haiman Tian, Yudong Tao, Maria Presa Reyes, Mei-Ling Shyu, Shu-Ching Chen, and S. S. Iyengar. 2018. A survey on deep learning: Algorithms, techniques, and applications. ACM Comput. Surv. 51, 5 (2018), 92.
- Michael Pradel and Koushik Sen . 2018. DeepBugs: A learning approach to name-based bug detection. arXiv preprint arXiv:1805.11683 ( 2018 ). Michael Pradel and Koushik Sen. 2018. DeepBugs: A learning approach to name-based bug detection. arXiv preprint arXiv:1805.11683 (2018). · arXiv
- Yewen Pu , Zachery Miranda , Armando Solar-Lezama , and Leslie Pack Kaelbling . 2017. Learning to select examples for program synthesis. arXiv preprint arXiv:1711.03243 ( 2017 ). Yewen Pu, Zachery Miranda, Armando Solar-Lezama, and Leslie Pack Kaelbling. 2017. Learning to select examples for program synthesis. arXiv preprint arXiv:1711.03243 (2017). · arXiv
- 10.3115/v1/P15-1085 · DOI · Paper page
- Maxim Rabinovich , Mitchell Stern , and Dan Klein . 2017. Abstract syntax networks for code generation and semantic parsing. arXiv preprint arXiv:1704.07535 ( 2017 ). Maxim Rabinovich, Mitchell Stern, and Dan Klein. 2017. Abstract syntax networks for code generation and semantic parsing. arXiv preprint arXiv:1704.07535 (2017). · arXiv
- Antti Rasmus , Mathias Berglund , Mikko Honkala , Harri Valpola , and Tapani Raiko . 2015 . Semi-supervised learning with ladder networks . In Proceedings of the Conference on Advances in Neural Information Processing Systems. 3546--3554 . Antti Rasmus, Mathias Berglund, Mikko Honkala, Harri Valpola, and Tapani Raiko. 2015. Semi-supervised learning with ladder networks. In Proceedings of the Conference on Advances in Neural Information Processing Systems. 3546--3554.
- 10.1145/2983990.2984041 · DOI · Paper page
- 10.1145/2676726.2677009 · DOI · Paper page
- 10.1145/2666356.2594321 · DOI · Paper page
- Zhou Ren , Xiaoyu Wang , Ning Zhang , Xutao Lv , and Li-Jia Li. 2017. Deep reinforcement learning-based image captioning with embedding reward. arXiv preprint arXiv:1704.03899 ( 2017 ). Zhou Ren, Xiaoyu Wang, Ning Zhang, Xutao Lv, and Li-Jia Li. 2017. Deep reinforcement learning-based image captioning with embedding reward. arXiv preprint arXiv:1704.03899 (2017). · arXiv
- Sebastian Riedel , Matko Bosnjak , and Tim Rocktäschel . 2016. Programming with a differentiable forth interpreter. arXiv preprint arXiv:1605.06640 ( 2016 ). Sebastian Riedel, Matko Bosnjak, and Tim Rocktäschel. 2016. Programming with a differentiable forth interpreter. arXiv preprint arXiv:1605.06640 (2016). · arXiv
- Anselm Rothe , Brenden M. Lake , and Todd Gureckis . 2017 . Question asking as program generation . In Proceedings of the Conference on Advances in Neural Information Processing Systems 30 , I. Guyon, U. V. Luxburg, S. Bengio, H. Wallach, R. Fergus, S. Vishwanathan, and R. Garnett (Eds.). Curran Associates, Inc., 1046--1055. Anselm Rothe, Brenden M. Lake, and Todd Gureckis. 2017. Question asking as program generation. In Proceedings of the Conference on Advances in Neural Information Processing Systems 30, I. Guyon, U. V. Luxburg, S. Bengio, H. Wallach, R. Fergus, S. Vishwanathan, and R. Garnett (Eds.). Curran Associates, Inc., 1046--1055.
- Alexander M. Rush , Sumit Chopra , and Jason Weston . 2015. A neural attention model for abstractive sentence summarization. arXiv preprint arXiv:1509.00685 ( 2015 ). Alexander M. Rush, Sumit Chopra, and Jason Weston. 2015. A neural attention model for abstractive sentence summarization. arXiv preprint arXiv:1509.00685 (2015). · arXiv
- Tim Salimans and Diederik P. Kingma . 2016. Weight normalization: A simple reparameterization to accelerate training of deep neural networks . In Proceedings of the Conference on Advances in Neural Information Processing Systems. 901--909 . Tim Salimans and Diederik P. Kingma. 2016. Weight normalization: A simple reparameterization to accelerate training of deep neural networks. In Proceedings of the Conference on Advances in Neural Information Processing Systems. 901--909.
- 10.1109/SANER.2018.8330219 · DOI · Paper page
- 10.1023/B:MACH.0000015880.99707.b2 · DOI · Paper page
- Holger Schwenk and Jean-Luc Gauvain . 2002 . Connectionist language modeling for large vocabulary continuous speech recognition . In Proceedings of the IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP’02) , Vol. 1 . IEEE, I--765. Holger Schwenk and Jean-Luc Gauvain. 2002. Connectionist language modeling for large vocabulary continuous speech recognition. In Proceedings of the IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP’02), Vol. 1. IEEE, I--765.
- Stanislau Semeniuta , Aliaksei Severyn , and Erhardt Barth . 2016. Recurrent dropout without memory loss. arXiv preprint arXiv:1603.05118 ( 2016 ). Stanislau Semeniuta, Aliaksei Severyn, and Erhardt Barth. 2016. Recurrent dropout without memory loss. arXiv preprint arXiv:1603.05118 (2016). · arXiv
200 of 248 shown
Cited by
Multi-task Learning based Pre-trained Language Model for Code Completion
Liu, F., Li, G., Zhao, Y., & Jin, Z. (2020) · Proceedings of the 35th IEEE/ACM International Conference on Automated Software Engineering · doi:10.1145/3324884.3416591 · Cited by 188
Retrieval-Based Prompt Selection for Code-Related Few-Shot Learning
Nashid, N., Sintaha, M., & Mesbah, A. (2023) · 2023 IEEE/ACM 45th International Conference on Software Engineering (ICSE) · doi:10.1109/icse48619.2023.00205 · Cited by 178
No Need to Lift a Finger Anymore? Assessing the Quality of Code Generation by ChatGPT
Liu, Z., Tang, Y., Luo, X., Zhou, Y., & Zhang, L. F. (2024) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2024.3392499 · Cited by 128
Is GitHub’s Copilot as bad as humans at introducing vulnerabilities in code?
Asare, O., Nagappan, M., & Asokan, N. (2023) · Empirical Software Engineering · doi:10.1007/s10664-023-10380-1 · Cited by 128
Design2Code: Benchmarking Multimodal Code Generation for Automated Front-End Engineering
Si, C., Zhang, Y., Li, R., Yang, Z., Liu, R., & Yang, D. (2025) · Proceedings of the 2025 Conference of the Nations of the Americas Chapter of the Association for Computational Linguistics: Human Language Technologies (Volume 1: Long Papers) · doi:10.18653/v1/2025.naacl-long.199 · Cited by 17
“While code generation from natural language instructions has advanced rapidly in recent years (Yin and Neubig, 2017; Le et al., 2020; Li et al., 2023), generating code implementation from user interface (UI) design has not received much attention due to a wide range of challenges, such as diversity…”
Metadata
- Authors
- Le, T. H. M., Chen, H., & Babar, M. A.
- Venue
- ACM Computing Surveys
- Published
- 2020-06-12
- Volume
- 53
- Issue
- 3
- Pages
- 1-38
- ISSN
- 0360-0300 (ISSN-L)
- 1557-7341
- OpenAlex
- W3126095862
- Cited by
- 170
- References
- 40
- FWCI
- 19.06
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.