The DOI matches its DataCite record; 54 of the 58 references it cites were found in a registry or an index.
Hierarchical Multiscale Recurrent Neural Networks
Open accessAbstract
Learning both hierarchical and temporal representation has been among the long-standing challenges of recurrent neural networks. Multiscale recurrent neural networks have been considered as a promising approach to resolve this issue, yet there has been a lack of empirical evidence showing that this type of models can actually capture the temporal dependencies by discovering the latent hierarchical structure of the sequence. In this paper, we propose a novel multiscale approach, called the hierarchical multiscale recurrent neural networks, which can capture the latent hierarchical structure in the sequence by encoding the temporal dependencies with different timescales using a novel update mechanism. We show some evidence that our proposed multiscale architecture can discover underlying hierarchical structure in the sequences without using explicit boundary information. We evaluate our proposed model on character-level language modelling and handwriting sequence modelling.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Hochreiter, S., & Schmidhuber, J. (1997) · Neural Computation · doi:10.1162/neco.1997.9.8.1735 · Cited by 102,318
Adam: A Method for Stochastic Optimization
Kingma, D. P., & Ba, J. (2014) · arXiv · doi:10.48550/arxiv.1412.6980 · Cited by 98,946
LeCun, Y., Bengio, Y., & Hinton, G. (2015) · Nature · doi:10.1038/nature14539 · Cited by 84,126
Self-citation(2014) · Cited by 33,419
Human-level control through deep reinforcement learning
Mnih, V., Kavukcuoglu, K., Silver, D., Rusu, A. A., Veness, J., Bellemare, M. G., Graves, A., Riedmiller, M., Fidjeland, A. K., Ostrovski, G., et al. (2015) · Nature · doi:10.1038/nature14236 · Cited by 30,357
Learning Phrase Representations using RNN Encoder–Decoder for Statistical Machine Translation
Cho, K., van Merrienboer, B., Gulcehre, C., Bahdanau, D., Bougares, F., Schwenk, H., & Bengio, Y. (2014) · Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.3115/v1/d14-1179 · Cited by 25,545
Self-citationAuto-Encoding Variational Bayes
Kingma, D. P., & Welling, M. (2013) · arXiv · doi:10.48550/arxiv.1312.6114 · Cited by 20,067
Deep learning in neural networks: an overview
Schmidhuber, J. (2015) · Neural Networks · doi:10.1016/j.neunet.2014.09.003 · Cited by 18,570
Sequence to Sequence Learning with Neural Networks
Sutskever, I., Vinyals, O., & Le, Q. V. (2014) · arXiv · doi:10.48550/arxiv.1409.3215 · Cited by 17,766
Mastering the game of Go with deep neural networks and tree search
Silver, D., Huang, A., Maddison, C. J., Guez, A., Sifre, L., van den Driessche, G., Schrittwieser, J., Antonoglou, I., Panneershelvam, V., Lanctot, M., et al. (2016) · Nature · doi:10.1038/nature16961 · Cited by 15,612
Cited by
Sorted by citations
Items 301–383 of 383
Semi-Blindly Enhancing Extremely Noisy Videos With Recurrent Spatio-Temporal Large-Span Network
Chen, X., Hu, X., & Yue, T. (2023) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2023.3234026 · Cited by 2
Lovas, R., Rigó, E., Unyi, D., & Gyires-Tóth, B. (2023) · IEEE Access · doi:10.1109/access.2023.3243201 · Cited by 4
Hierarchical Latent Dynamics Model with Multiple Timescales for Learning Long-Horizon Tasks
Fujii, K., & Murata, S. (2023) · IEEE International Conference on Development and Learning (ICDL) · doi:10.1109/icdl55364.2023.10364442 · Cited by 2
Experimental Setup: Visual and Text Sentiment Analysis Through Hierarchical Deep Learning Networks
Chaudhuri, A. (2019) · SpringerBriefs in computer science · doi:10.1007/978-981-13-7474-6_6 · Cited by 2
ARMIN: Towards a More Efficient and Light-weight Recurrent Memory Network
Li, Z., Zhong, J.-X., Huang, J., Zhang, T., Li, T., & Li, G. (2019) · International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2019/408 · Cited by 3
Ahmed, M., & Mercer, R. E. (2020) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v34i05.6230 · Cited by 2
Hybrid Approaches to Fine-Grained Emotion Detection in Social Media Data
Schoene, A. M. (2020) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v34i10.7138 · Cited by 2
Stochastic Sequential Neural Networks with Structured InferencePreprint
Liu, H., Bai, H., He, L., & Xu, Z. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1705.08695 · Cited by 3
Rotational Unit of MemoryPreprint
Dangovski, R., Jing, L., & Marin Soljacic, A. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1710.09537 · Cited by 2
Meta-Learning a Dynamical Language ModelPreprint
Wolf, T., Chaumond, J., & Delangue, C. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1803.10631 · Cited by 4
Zhang, Y., Chow, K. H., & Chan, S.-H. G. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1903.02082 · Cited by 3
One Size Does Not Fit All: Multi-Scale, Cascaded RNNs for Radar ClassificationPreprint
Roy, D., Srivastava, S., Kusupati, A., Jain, P., Varma, M., & Arora, A. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1909.03082 · Cited by 2
Encoding-based Memory Modules for Recurrent Neural NetworksPreprint
Carta, A., Sperduti, A., & Bacciu, D. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2001.11771 · Cited by 2
Hidayanto, N. A., Prahara, A., & Puriyanto, R. D. (2021) · Jurnal Informatika · doi:10.26555/jifo.v15i1.a20106 · Cited by 1
A Lightweight Model for Driver Distraction Classification
Khadraoui, A., Zemmouri, E. M., & Taki, Y. (2023) · International Conference on Advances in Artificial Intelligence (ICAAI) · doi:10.1145/3633598.3633618 · Cited by 1
Multi‐Source Adaptive‐Fusion Transfer Learning for Streamflow Forecasting in Data‐Scarce Catchments
Gao, Y., Liang, D., Borgomeo, E., & Zhang, H. (2026) · Water Resources Research · doi:10.1029/2025wr042495 · Cited by 1
The CMU entry to blizzard machine learning challenge
Baljekar, P. N., Rallabandi, S. K., & Black, A. W. (2017) · IEEE Workshop on Automatic Speech Recognition and Understanding (ASRU) · doi:10.1109/asru.2017.8268997 · Cited by 1
On the use of binary stochastic autoencoders for multi-label classification under the zero-one loss
Lecoeuche, D., Aussem, A., & Gasse, M. (2018) · Procedia Computer Science · doi:10.1016/j.procs.2018.10.506 · Cited by 1
Learning to Selectively Update State Neurons in Recurrent Networks
Hartvigsen, T., Şen, C., Kong, X., & Rundensteiner, E. A. (2020) · ACM International Conference on Information and Knowledge Management (CIKM) · doi:10.1145/3340531.3412018 · Cited by 1
DMMLN: A deep multi-task and metric learning based network for video classification
Zhi, H., Yu, H., Li, S., & Gao, C. (2017) · IEEE Symposium Series on Computational Intelligence (SSCI) · doi:10.1109/ssci.2017.8285296 · Cited by 1
Modified VS3-NET for Reading Comprehension and Question Answering with No-Answers
Park, C., & Lee, C. (2019) · IEEE International Conference on Big Data and Smart Computing (BigComp) · doi:10.1109/bigcomp.2019.8679299 · Cited by 1
Metcalf, K., & Leake, D. B. (2019) · International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2019/436 · Cited by 1
Multi-Zone Unit for Recurrent Neural Networks
Meng, F., Zhang, J., Liu, Y., & Zhou, J. (2020) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v34i04.5958 · Cited by 1
Empirical Research on Futures Trading Strategy Based on Time Series Algorithm
Yao, S., Yan, H., Siping, Y., Chen, C., & Su, Q. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-56725-5_9 · Cited by 1
Методи та компоненти обробки природної мови
Iosifova, O., Iosifov, I., & Rolik, O. (2020) · Адаптивні системи автоматичного управління · doi:10.20535/1560-8956.36.2020.209780 · Cited by 2
Language Revitalization: A Benchmark for Akan-to-English Machine Translation
Acheampong, K. N., & Sackey, N. N. O. (2020) · Advances in intelligent systems and computing · doi:10.1007/978-3-030-55187-2_20 · Cited by 1
Stability and Synchronization of Switched Multi-Rate Recurrent Neural Networks
Ruiz-Parrado, V., Aranda‐Escolástico, E., Salt, J. J., & Dormido, S. (2021) · IEEE Access · doi:10.1109/access.2021.3067452 · Cited by 1
Options Discovery with Budgeted Reinforcement LearningPreprint
Léon, A., & Denoyer, L. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1611.06824 · Cited by 4
Training a Subsampling Mechanism in ExpectationPreprint
Raffel, C., & Lawson, D. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1702.06914 · Cited by 2
Learning Simpler Language Models with the Differential State FrameworkPreprint
Ororbia, A. G., Mikolov, T., & Reitter, D. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1703.08864 · Cited by 1
Machine learning-based approaches for large-scale temporal data analytics
Seyed, A. M. Z. (2018) · doi:10.32657/10220/47870 · Cited by 1
Perception-Prediction-Reaction Agents for Deep Reinforcement LearningPreprint
Stooke, A., Dalibard, V., Jayakumar, S. M., Czarnecki, W. M., & Jaderberg, M. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2006.15223 · Cited by 1
Recursive Top-Down Production for Sentence Generation with Latent TreesPreprint
Tan, S., Shen, Y., O’Donnell, T. J., Sordoni, A., & Courville, A. C. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2010.04704 · Cited by 3
Recurrent Neural Networks with Mixed Hierarchical Structures for Natural Language ProcessingPreprint
Luo, Z., & Zhu, M. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2106.02562 · Cited by 1
Soft Actor-Critic With Integer ActionsPreprint
Fan, T.-H., & Wang, Y. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2109.08512 · Cited by 1
Advanced Language Understanding with Syntax-Enhanced TransformerPreprint
Rine, W., Patel, R., & Steve, N. (2023) · Preprints.org · doi:10.20944/preprints202312.1673.v1 · Cited by 1
Optimally Segmenting Inputs for NMT Shows Preference for Character-Level ProcessingPreprint
Kreutzer, J., & Sokolov, A. (2018) · arXiv (Cornell University)
Budgeted Hierarchical Reinforcement Learning
Léon, A., & Denoyer, L. (2018) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn.2018.8489459 · Cited by 1
Livezey, J. A., Hwang, A., & Bouchard, K. E. (2019) · arXiv (Cornell University)
Solving Large-Scale 0-1 Knapsack Problems and its Application to Point Cloud ResamplingPreprint
Li, D., Liu, J., Park, N., Lee, D., Ramachandran, G. K., Seyedmazloom, A., Lee, K., Feng, C., Sokolov, V., & Ganesan, R. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1906.05929
CommNets: Communicating Neural Network Architectures for Resource Constrained Systems
Abudu, P. (2019) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v33i01.33019909
An Automated Framework for Explaining Facts Extracted From Mobility Datasets
Tahir, A., Sun, Y., & Sarwat, M. (2019) · IEEE International Conference on Mobile Data Management (MDM) · doi:10.1109/mdm.2019.00-48
Linguistic Versus Latent Relations for Modeling Coherent Flow in ParagraphsPreprint
Kang, D., Hayashi, H., Black, A. W., & Hovy, E. H. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1908.11790
Learning Adaptive Weight Masking for Adversarial Examples
Kubo, Y., Traynor, M., Trappenberg, T. P., & Oore, S. (2019) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn.2019.8852298
Decoupling Hierarchical Recurrent Neural Networks With Locally Computable LossesPreprint
Mujika, A., Weissenberger, F., & Steger, A. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1910.05245 · Cited by 1
Neural architectures for natural language understanding
Tay, Y. (2019) · DR-NTU (Nanyang Technological University) · doi:10.32657/10356/83291
A memory enhanced LSTM for modeling complex temporal dependenciesPreprint
Aenugu, S. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1910.12388
Compact and Robust Models for Japanese-English Character-level Machine Translation
Dai, J., & Yamaguchi, K. (2019) · Workshop on Asian Translation (WAT) · doi:10.18653/v1/d19-5202
Lee, J. H., Yun, J., Hwang, S. J., & Yang, E. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1911.12990
Representational dynamics across multiple timescales in human cortical networks
Wen, T. (2019) · Apollo (University of Cambridge) · doi:10.17863/cam.47653
Static power analysis of cryptographic devices
Xu, J. (2019) · Memorial University Research Repository (Memorial University)
A Hierarchical Transformer for Unsupervised ParsingPreprint
Thillaisundaram, A. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2003.13841
Analysis of memory in LSTM-RNNs for source separationPreprint
Zegers, J., & hamme, H. V. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2009.00551
Learning Personalized Codebook for TDD Non-Antenna Switching System
Miao, H., Han, S., Li, Y., & Yang, C. (2020) · International Conference on Signal Processing · doi:10.1109/icsp48669.2020.9320967
Deep learning that scales: leveraging compute and data
Camúñez, V. C. (2020) · UPCommons institutional repository (Universitat Politècnica de Catalunya) · doi:10.5821/dissertation-2117-335426
A Framework for Measuring Compositional Inductive Bias.Preprint
Perkins, H. (2021) · arXiv (Cornell University)
Toward Human-Level Artificial IntelligencePreprint
Park, D. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2108.03793 · Cited by 1
Enhancing Transformer with Horizontal and Vertical Guiding Mechanisms for Neural Language Modeling
Qu, A., Niu, J., & Mo, S. (2021) · International Conference on Communications · doi:10.1109/icc42927.2021.9500450
When in Doubt, Summon the Titans: Efficient Inference with Large ModelsPreprint
Rawat, A. S., Zaheer, M., Menon, A. K., Ahmed, A. A., & Kumar, S. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2110.10305 · Cited by 6
Human Gesture Recognition with Wi-Fi
Yang, Z., Qian, K., Wu, C., & Zhang, Y. (2021) · Springer eBooks · doi:10.1007/978-981-16-5658-3_9
ZoomNet for Topic-Oriented Fragment Recognition in Long Documents
Yan, Y., Zheng, D., Lu, Z., & Song, S. (2022) · IEEE Access · doi:10.1109/access.2022.3166235
A Decentralized Algorithm for Deep Echo State Networks
Qiu, W., & Ai, W. (2021) · China Automation Congress (CAC) · doi:10.1109/cac53003.2021.9728101
Plaat, A. (2022) · Springer eBooks · doi:10.1007/978-981-19-0638-1_10
Parthipan, R., Christensen, H. M., Hosking, J. S., et al. (2022) · doi:10.5194/egusphere-2022-912-rc1
Hyperspherical Quantization: Toward Smaller and More Accurate Models
Liu, D., Chen, X., Ma, C., & Liu, X. (2023) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv56688.2023.00523 · Cited by 1
Parthipan, R., Christensen, H. M., Hosking, J. S., et al. (2023) · doi:10.5194/egusphere-2022-912-rc2
Parthipan, R. (2023) · doi:10.5194/egusphere-2022-912-ac1
Liao, N., Wang, J., Deng, Q., & Guan, J. (2023) · SSRN Electronic Journal · doi:10.2139/ssrn.4457365
Neural Model-Applying Network (Neuman): A New Basis for Computational Cognition
Roth, F. (2023) · Advanced Computational Intelligence An International Journal (ACII) · doi:10.5121/acii.2023.10301
Jo, M., Lee, S.-R., Kim, B., Lee, K.-H., & Jung, I.-J. (2023) · IEEE Vehicular Technology Conference · doi:10.1109/vtc2023-spring57618.2023.10200685
Research on Scrabble Prediction Based on Neural Network Model
Jiang, X., Chen, X., Li, W., & Ma, Y. (2023) · IEEE International Conference on Sensors, Electronics and Computer Engineering (ICSECE) · doi:10.1109/icsece58870.2023.10263558
Reinforcement learning and meta-decision makingPreprint
Verbeke, P., & Verguts, T. (2023) · doi:10.31234/osf.io/uvfhe
Progressive Multi-scale Self-supervised Learning for Speech Recognition
Wan, G., Chen, H., Liu, T., Wang, C., Pan, J., & Ye, Z. (2023) · Asia-Pacific Signal and Information Processing Association Annual Summit and Conference (APSIPA ASC) · doi:10.1109/apsipaasc58517.2023.10317133
Learning to Abstract with Nonparametric Variational Information Bottleneck
Behjati, M., Fehr, F., & Henderson, J. (2023) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2023.findings-emnlp.106
(2024) · International Research Journal of Modernization in Engineering Technology and Science · doi:10.56726/irjmets54679
Future Frontiers in Deep Learning: From Static to Dynamic Neural Network TechnologiesPreprint
Verma, P. R., Singh, N. P., Pantola, D., & Cheng, X. (2024) · SSRN Electronic Journal · doi:10.2139/ssrn.4832892
Li, J., Wang, Q., Zhou, Q., Lu, Y., Shen, Y., Huang, S., Wang, S., Liina Pylkkänen, A., & Huang, Z. (2026) · eLife · doi:10.7554/elife.100056.4
Li, J., Wang, Q., Zhou, Q., Yang, L., Shen, Y., Huang, S., Wang, S., Liina Pylkkänen, A., & Huang, Z. (2024) · eLife · doi:10.7554/elife.100056 · Cited by 1
Li, J., Wang, Q., Zhou, Q., Yang, L., Shen, Y., Huang, S., Wang, S., Liina Pylkkänen, A., & Huang, Z. (2025) · eLife · doi:10.7554/elife.100056.2
Comparison of Independently Learnable Hierarchical Models for Time Series Data
Konosu, M., Inami, K., Yamane, K., Masuya, N., Sato, H., & Sakaino, S. (2025) · Journal of the Robotics Society of Japan · doi:10.7210/jrsj.43.615
An Empirical Evaluation of Generic Convolutional and Recurrent Networks for Sequence Modeling
Bai, S., Kolter, J. Z., & Koltun, V. (2018) · arXiv · doi:10.48550/arxiv.1803.01271 · Cited by 4,655
Metadata
- Authors
- Chung, J., Ahn, S., & Bengio, Y.
- Affiliations
- Université de Montréal (CA)
- Venue
- arXiv
- Publisher
- arXiv
- Published
- 2016
- ISSN
- 2331-8422 (ISSN-L)
- arXiv
- 1609.01704
- OpenAlex
- W2510842514
- Cited by
- 386
- References
- 58
- Citations by year
- 2026: 2 · 2025: 4 · 2024: 16 · 2023: 30 · 2022: 24 · 2021: 58 · 2020: 68 · 2019: 83 · 2018: 60 · 2017: 35 · 2016: 6
- Type
- posted content
- Language
- en
- Open access
- green
- arxiv.org
- Locations
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Neural Networks and Applications
- Physical Sciences › Computer Science › Artificial Intelligence › Topic Modeling
- Physical Sciences › Computer Science › Signal Processing › Time Series Analysis and Forecasting
- Keywords
- hierarchical representation, temporal dependencies
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
