DyNet: The Dynamic Neural Network Toolkit
Open accessThe DOI matches its OpenAlex record; 43 of the 43 references it cites were found in a registry or an index.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Hochreiter, S., & Schmidhuber, J. (1997) · Neural Computation · doi:10.1162/neco.1997.9.8.1735 · Cited by 102,318
Adam: A Method for Stochastic Optimization
Kingma, D. P., & Ba, J. (2014) · arXiv · doi:10.48550/arxiv.1412.6980 · Cited by 98,946
Human-level control through deep reinforcement learning
Mnih, V., Kavukcuoglu, K., Silver, D., Rusu, A. A., Veness, J., Bellemare, M. G., Graves, A., Riedmiller, M., Fidjeland, A. K., Ostrovski, G., et al. (2015) · Nature · doi:10.1038/nature14236 · Cited by 30,357 · cited 1×
“Deep neural networks are now an indispensable tool in the machine learning practitioner’s toolbox, powering applications from image understanding [39], speech recognition and synthesis [29, 65], game playing [45, 54], language modeling and analysis [6, 14], and more.”
MethodNeural Machine Translation by Jointly Learning to Align and Translate
Bahdanau, D., Cho, K., & Bengio, Y. (2014) · arXiv · doi:10.48550/arxiv.1409.0473 · Cited by 16,213
Mastering the game of Go with deep neural networks and tree search
Silver, D., Huang, A., Maddison, C. J., Guez, A., Sifre, L., van den Driessche, G., Schrittwieser, J., Antonoglou, I., Panneershelvam, V., Lanctot, M., et al. (2016) · Nature · doi:10.1038/nature16961 · Cited by 15,612 · cited 1×
“Deep neural networks are now an indispensable tool in the machine learning practitioner’s toolbox, powering applications from image understanding [39], speech recognition and synthesis [29, 65], game playing [45, 54], language modeling and analysis [6, 14], and more.”
MethodElman, J. L. (1990) · Cognitive Science · doi:10.1207/s15516709cog1402_1 · Cited by 11,212
Empirical Evaluation of Gated Recurrent Neural Networks on Sequence Modeling
Chung, J., Gulcehre, C., Cho, K., & Bengio, Y. (2014) · arXiv · doi:10.48550/arxiv.1412.3555 · Cited by 11,008
Hinton, G., Deng, L., Yu, D., Dahl, G., Mohamed, A.-R., Jaitly, N., Senior, A., Vanhoucke, V., Nguyen, P., Sainath, T., et al. (2012) · IEEE Signal Processing Magazine · doi:10.1109/msp.2012.2205597 · Cited by 10,260
TensorFlow: Large-Scale Machine Learning on Heterogeneous Distributed Systems
Abadi, M., Agarwal, A., Barham, P., Brevdo, E., Chen, Z., Citro, C., Corrado, G. S., Davis, A., Dean, J., Devin, M., et al. (2016) · arXiv · doi:10.48550/arxiv.1603.04467 · Cited by 9,408 · cited 7×
“Second, the static computation graph can be used to schedule computation across a pool of computational devices [1].”
MethodInfluential(2010) · Cited by 8,261
Graves, A., Fernández, S., Gomez, F., & Schmidhuber, J. (2006) · Proceedings of the 23rd international conference on Machine learning - ICML '06 · doi:10.1145/1143844.1143891 · Cited by 5,370
Neural Architectures for Named Entity Recognition
Lample, G., Ballesteros, M., Subramanian, S., Kawakami, K., & Dyer, C. (2016) · Proceedings of the 2016 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies · doi:10.18653/v1/n16-1030 · Cited by 4,401 · cited 1×
“Tagging: DyNet was used in development of methods for named entity recognition [40] ( https://github.com/clab/stack-lstm-ner ), POS-tagging [49], semantic role labeling [60] ( https://github.com/clab/joint-lstm-parser ), punctuation prediction [5] (…”
MethodSelf-citationImproved Semantic Representations From Tree-Structured Long Short-Term Memory Networks
Tai, K. S., Socher, R., & Manning, C. D. (2015) · Proceedings of the 53rd Annual Meeting of the Association for Computational Linguistics and the 7th International Joint Conference on Natural Language Processing (Volume 1: Long Papers) · doi:10.3115/v1/p15-1150 · Cited by 3,081
LSTM neural networks for language modeling
Sundermeyer, M., Schlüter, R., & Ney, H. (2012) · Interspeech 2012 · doi:10.21437/interspeech.2012-65 · Cited by 1,963 · cited 1×
“Recurrent Neural Network Language Model: Similarly to [58], we train a recurrent neural network language model using LSTM units.”
MethodMXNet: A Flexible and Efficient Machine Learning Library for Heterogeneous Distributed Systems
Chen, T., Li, M., Li, Y., Lin, M., Wang, N., Wang, M., Xiao, T., Xu, B., Zhang, C., & Zhang, Z. (2015) · arXiv · doi:10.48550/arxiv.1512.01274 · Cited by 1,819
(2000) · CrossRef Listing of Deleted DOIs · doi:10.1162/153244303322533223 · Cited by 1,566
Pegasos: primal estimated sub-gradient solver for SVM
Shalev-Shwartz, S., Singer, Y., Srebro, N., & Cotter, A. (2011) · Mathematical Programming · doi:10.1007/s10107-010-0420-4 · Cited by 1,477
Hogwild: A Lock-Free Approach to Parallelizing Stochastic Gradient Descent
Niu, F., Recht, B., Re, C., & Wright, S. J. (2011) · arXiv · doi:10.48550/arxiv.1106.5730 · Cited by 1,211 · cited 1×
“Though lockless optimization methods compute only approximate gradients due to overlapping parameter reads and writes, in practice they show virtually no degradation in performance versus fully serial or lock-based methods [50, 57]. paper.”
Method(2011) · Cited by 1,192
Statistical parametric speech synthesis using deep neural networks
Zen, H., Senior, A., & Schuster, M. (2013) · 2013 IEEE International Conference on Acoustics, Speech and Signal Processing · doi:10.1109/icassp.2013.6639215 · Cited by 809
Simple and Accurate Dependency Parsing Using Bidirectional LSTM Feature Representations
Kiperwasser, E., & Goldberg, Y. (2016) · Transactions of the Association for Computational Linguistics · doi:10.1162/tacl_a_00101 · Cited by 615
Self-citationRecurrent Neural Network Grammars
Dyer, C., Kuncoro, A., Ballesteros, M., & Smith, N. A. (2016) · Proceedings of the 2016 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies · doi:10.18653/v1/n16-1024 · Cited by 517 · cited 2×
“Language Modeling: DyNet has been used in the development of hybrid neural/ n -gram language models [47] ( https://github.com/neubig/modlm ), and generative syntactic language models [18] ( https://github.com/clab/rnng ).”
BackgroundMethodSelf-citationTransition-Based Dependency Parsing with Stack Long Short-Term Memory
Dyer, C., Ballesteros, M., Ling, W., Matthews, A., & Smith, N. A. (2015) · RECERCAT (Consorci de Serveis Universitaris de Catalunya) · doi:10.48550/arxiv.1505.08075 · Cited by 470
Self-citationDeep multi-task learning with low level tasks supervised at lower layers
Søgaard, A., & Goldberg, Y. (2016) · Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics (Volume 2: Short Papers) · doi:10.18653/v1/p16-2038 · Cited by 445 · cited 1×
“…), punctuation prediction [5] ( https://github.com/miguelballesteros/LSTM-punctuation ), and multi-task learning for sequence processing [37, 56], as well as creation of new architectures such as segmental recurrent neural networks [38]( https://github.com/clab/dynet/tree/…”
BackgroundSelf-citationTorch: a modular machine learning software library
Collobert, R., Samy Bengio, A., & Mariéthoz, J. (2002) · Infoscience (Ecole Polytechnique Fédérale de Lausanne) · Cited by 435
A simple automatic derivative evaluation program
Wengert, R. E. (1964) · Communications of the ACM · doi:10.1145/355586.364791 · Cited by 384
Learning multilingual named entity recognition from Wikipedia
Nothman, J., Ringland, N., Radford, W., Murphy, T., & Curran, J. R. (2013) · Artificial Intelligence · doi:10.1016/j.artint.2012.03.006 · Cited by 360
Semantic Object Parsing with Graph LSTM
Liang, X., Shen, X., Feng, J., Lin, L., & Yan, S. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46448-0_8 · Cited by 352
Classes for fast maximum entropy training
Goodman, J. (2002) · 2001 IEEE International Conference on Acoustics, Speech, and Signal Processing. Proceedings (Cat. No.01CH37221) · doi:10.1109/icassp.2001.940893 · Cited by 219
Improving Hypernymy Detection with an Integrated Path-based and Distributional Method
Shwartz, V., Goldberg, Y., & Dagan, I. (2016) · Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.18653/v1/p16-1226 · Cited by 210
Self-citationCharacter-based Neural Machine Translation
Ling, W., Trancoso, I. M., Dyer, C., & Black, A. W. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1511.04586 · Cited by 179
Self-citationMorphological Inflection Generation Using Character Sequence to Sequence Learning
Faruqui, M., Tsvetkov, Y., Neubig, G., & Dyer, C. (2016) · Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT) · doi:10.18653/v1/n16-1077 · Cited by 152
Self-citationSegmental Recurrent Neural NetworksPreprint
Kong, L., Dyer, C., & Smith, N. A. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1511.06018 · Cited by 113
Self-citationLearning to Compose Neural Networks for Question Answering
Andreas, J., Rohrbach, M., Darrell, T. J., & Klein, D. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1601.01705 · Cited by 100
Deep Learning with Dynamic Computation Graphs
Looks, M., Herreshoff, M., Hutchins, D. S., & Norvig, P. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1702.02181 · Cited by 82
Greedy, Joint Syntactic-Semantic Parsing with Stack LSTMs
Swayamdipta, S., Ballesteros, M., Dyer, C., & Smith, N. A. (2016) · Conference on Computational Natural Language Learning · doi:10.18653/v1/k16-1019 · Cited by 65
Self-citationAharoni, R., Goldberg, Y., & Belinkov, Y. (2016) · SIGMORPHON Workshop on Computational Research in Phonetics, Phonology, and Morphology (SIGMORPHON) · doi:10.18653/v1/w16-2007 · Cited by 38
Self-citationGeneralizing and Hybridizing Count-based and Neural Language Models
Neubig, G., & Dyer, C. (2016) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/d16-1124 · Cited by 33
Self-citationApproximation-Aware Dependency Parsing by Belief Propagation
Gormley, M. R., Dredze, M. H., & Eisner, J. M. (2015) · Transactions of the Association for Computational Linguistics · doi:10.1162/tacl_a_00153 · Cited by 25
A Neural Network for Coordination Boundary Prediction
Ficler, J., & Goldberg, Y. (2016) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/d16-1003 · Cited by 22
Self-citationSemi Supervised Preposition-Sense Disambiguation using Multilingual DataPreprint
Gonen, H., & Goldberg, Y. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1611.08813 · Cited by 14
Self-citationA Neural Network Architecture for Multilingual Punctuation Generation
Ballesteros, M., & Wanner, L. (2016) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/d16-1111 · Cited by 14
Self-citation(2015) · doi:10.4230/oasics.slate.2021.8 · Cited by 1 · cited 1×
“Bi-directional LSTM Named Entity Tagger: Similarly to the BI-LSTM model of Huang et al. [32], we train a tagger that uses a bi-directional LSTM to extract features from the input sentence, which are then passed through a multi-layer perceptron to predict the tag of the word.”
Method
Cited by
Larian Studios Dev Team (2024) · doi:10.1145/3292500.3330701 · Cited by 8,618
“Because of their di ffi culty of programming, the define-and-run style deep learning frameworks are quickly being replaced by define-by-run style deep learning frameworks like Chainer [13], DyNet [14], PyTorch [15], eager-mode TensorFlow [16], and Gluon .”
MethodAllenNLP: A Deep Semantic Natural Language Processing Platform
Gardner, M., Grus, J., Neumann, M., Tafjord, O., Dasigi, P., Liu, N. F., Peters, M., Schmitz, M., & Zettlemoyer, L. (2018) · Proceedings of Workshop for NLP Open Source Software (NLP-OSS) · doi:10.18653/v1/w18-2501 · Cited by 1,252
A hybrid method of exponential smoothing and recurrent neural networks for time series forecasting
Smyl, S. (2020) · International Journal of Forecasting · doi:10.1016/j.ijforecast.2019.03.017 · Cited by 761
Raschka, S., Patterson, J., & Nolet, C. (2020) · Information · doi:10.3390/info11040193 · Cited by 703
Metadata
- Authors
- Neubig, G., Dyer, C., Goldberg, Y., Matthews, A., Ammar, W., Anastasopoulos, A., Ballesteros, M., Chiang, D., Clothiaux, D., Cohn, T., Duh, K., Faruqui, M., Gan, C., Garrette, D., Ji, Y., Kong, L., Kuncoro, A., Gaurav, K., Malaviya, C., Michel, P., Oda, Y., Richardson, M., Saphra, N., Swayamdipta, S., & Yin, P.
- Venue
- arXiv (Cornell University)
- Publisher
- Cornell University
- Published
- 2017-01-15
- ISSN
- 2331-8422 (ISSN-L)
- arXiv
- 1701.03980
- OpenAlex
- W2577255746
- Cited by
- 302
- References
- 43
- Type
- posted content
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.