The DOI matches its DataCite record; 19 of the 25 references it cites were found in a registry or an index.
Can recurrent neural networks warp time?
Open accessAbstract
Successful recurrent models such as long short-term memories (LSTMs) and gated recurrent units (GRUs) use ad hoc gating mechanisms. Empirically these models have been found to improve the learning of medium to long term temporal dependencies and to help with vanishing gradient issues. We prove that learnable gates in a recurrent model formally provide quasi- invariance to general time transformations in the input data. We recover part of the LSTM architecture from a simple axiomatic approach. This result leads to a new way of initializing gate biases in LSTMs and GRUs. Ex- perimentally, this new chrono initialization is shown to greatly improve learning of long term dependencies, with minimal implementation effort.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Instead, we view it as most closely related to the gating mechanism of traditional RNNs, which is a special case (Theorem 1) and also has a deeper history of connections to SSMs through variable (input-dependent) discretization of Δ (Funahashi and Nakamura 1993; Gu, Dao, et al. 2020; Tallec and Ollivier 2018).”
From Mamba: Linear-Time Sequence Modeling with Selective State Spaces (2023) · cites this paper as Tallec and Ollivier 2018
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“It also has connections to gating mechanisms of RNNs (Gu, Gulcehre, et al. 2020; Tallec and Ollivier 2018) which we will revisit in Section 3.5.”
From Mamba: Linear-Time Sequence Modeling with Selective State Spaces (2023) · cites this paper as Tallec and Ollivier 2018
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Hochreiter, S., & Schmidhuber, J. (1997) · Neural Computation · doi:10.1162/neco.1997.9.8.1735 · Cited by 102,318
Adam: A Method for Stochastic Optimization
Kingma, D. P., & Ba, J. (2014) · arXiv · doi:10.48550/arxiv.1412.6980 · Cited by 98,946
Empirical Evaluation of Gated Recurrent Neural Networks on Sequence Modeling
Chung, J., Gulcehre, C., Cho, K., & Bengio, Y. (2014) · arXiv · doi:10.48550/arxiv.1412.3555 · Cited by 11,008
Learning long-term dependencies with gradient descent is difficult
Bengio, Y., Simard, P., & Frasconi, P. (1994) · IEEE Transactions on Neural Networks · doi:10.1109/72.279181 · Cited by 8,542
Neural Architectures for Named Entity Recognition
Lample, G., Ballesteros, M., Subramanian, S., Kawakami, K., & Dyer, C. (2016) · Proceedings of the 2016 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies · doi:10.18653/v1/n16-1030 · Cited by 4,401
On the difficulty of training recurrent neural networks
Pascanu, R., Mikolov, T., & Bengio, Y. (2012) · arXiv · doi:10.48550/arxiv.1211.5063 · Cited by 4,310
Learning to forget: continual prediction with LSTM
Gers, F. A. (1999) · International Conference on Artificial Neural Networks · doi:10.1049/cp:19991218 · Cited by 2,467
An Empirical Exploration of Recurrent Network Architectures
Józefowicz, R., Zaremba, W., & Sutskever, I. (2015) · Cited by 1,459
Graves, A., Wayne, G., & Danihelka, I. (2014) · arXiv · doi:10.48550/arxiv.1410.5401 · Cited by 1,058
Exact solutions to the nonlinear dynamics of learning in deep linear neural networksPreprint
Saxe, A., McClelland, J. L., & Ganguli, S. (2013) · arXiv (Cornell University) · doi:10.48550/arxiv.1312.6120 · Cited by 1,010
Research works printed but not linked: 8
- Martin Arjovsky, Amar Shah, and Yoshua Bengio. Unitary evolution recurrent neural networks. In International Conference on Machine Learning, pp. 1120-1128, 2016.
- Alex Graves, Abdel-rahman Mohamed, and Geoffrey Hinton. Speech recognition with deep recur- rent neural networks. In Acoustics, speech and signal processing (icassp), 2013 ieee international conference on, pp. 6645-6649. IEEE, 2013.
- Mikael Henaff, Arthur Szlam, and Yann LeCun. Recurrent orthogonal networks and long-memory tasks. In International Conference on Machine Learning, pp. 2034-2042, 2016.
- S. Hochreiter. Untersuchungen zu dynamischen neuronalen Netzen. Diploma thesis, Institut für Informatik, Lehrstuhl Prof. Brauer, Technische Universität München, 1991.
- Yann LeCun, Patrick Haffner, Léon Bottou, and Yoshua Bengio. Object recognition with gradient- based learning. Shape, contour and grouping in computer vision, pp. 823-823, 1999.
- Tomáš Mikolov, Ilya Sutskever, Anoop Deoras, Hai-Son Le, Stefan Kombrink, and Jan Cer- nocky. Subword language modeling with neural networks. preprint (http://www. fit. vutbr. cz/imikolov/rnnlm/char. pdf), 2012.
- Michael C Mozer. Induction of multiscale temporal structure. In Advances in neural information processing systems, pp. 275-282, 1992.
- Tijmen Tieleman and Geoffrey Hinton. Lecture 6.5-rmsprop: Divide the gradient by a running average of its recent magnitude. COURSERA: Neural networks for machine learning, 4(2):26- 31, 2012.
Cited by
Sorted by citations
Geometric Deep Learning: Grids, Groups, Graphs, Geodesics, and GaugesPreprint
Bronstein, M. M., Bruna, J., Cohen, T., & Veličković, P. (2021) · arXiv (Cornell University) · doi:10.4230/oasics.dx.2026.1 · Cited by 2,094
Mamba: Linear-Time Sequence Modeling with Selective State Spaces
Gu, A., & Dao, T. (2023) · arXiv · doi:10.48550/arxiv.2312.00752 · Cited by 1,579
Hyperbolic Neural NetworksPreprint
Ganea, O.-E., Bécigneul, G., & Hofmann, T. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1805.09112 · Cited by 347
Combining Recurrent, Convolutional, and Continuous-time Models with Linear State-Space LayersPreprint
Gu, A., Johnson, I., Goel, K., Saab, K. K., Dao, T., Rudra, A., & Ré, C. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2110.13985 · Cited by 337
HiPPO: Recurrent Memory with Optimal Polynomial ProjectionsPreprint
Gu, A., Dao, T., Ermon, S., Rudra, A., & Ré, C. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2008.07669 · Cited by 292
Time2Vec: Learning a Vector Representation of Time
Kazemi, S. M., Goel, R., Eghbali, S., Ramanan, J., Sahota, J., Thakur, S., Wu, S., Smyth, C., Poupart, P., & Brubaker, M. (2019) · arXiv · doi:10.48550/arxiv.1907.05321 · Cited by 206
AntisymmetricRNN: A Dynamical System View on Recurrent Neural NetworksPreprint
Chang, B., Chen, M., Haber, E., & Ed, H. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1902.09689 · Cited by 182
The unreasonable effectiveness of the forget gatePreprint
van der Westhuizen, J., & Lasenby, J. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1804.04849 · Cited by 107
Learning long-range spatial dependencies with horizontal gated-recurrent units
Linsley, D. A., Kim, J., Veerabadran, V., & Serre, T. (2018) · Conference on Cognitive Computational Neuroscience (CCN) · doi:10.32470/ccn.2018.1116-0 · Cited by 91
Chen, M., Pennington, J., & Schoenholz, S. S. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1806.05394 · Cited by 89
Gating Revisited: Deep Multi-layer RNNs That Can Be Trained
Türkoglu, M. Ö., D’Aronco, S., Wegner, J. D., & Konrad Schindler, B. (2021) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2021.3064878 · Cited by 83
Kirchgässner, W., Wallscheid, O., & Böcker, J. (2019) · IEEE International Electric Machines & Drives Conference (IEMDC) · doi:10.1109/iemdc.2019.8785109 · Cited by 70
A Multi-recurrent Network for Crude Oil Price Prediction
Orojo, O., Tepper, J. A., McGinnity, T. M., & Mahmud, M. (2019) · IEEE Symposium Series on Computational Intelligence (SSCI) · doi:10.1109/ssci44817.2019.9002841 · Cited by 69
Improving the Gating Mechanism of Recurrent Neural NetworksPreprint
Gu, A., Gülçehre, Ç., Paine, T., Hoffman, M. D., & Pascanu, R. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1910.09890 · Cited by 66
Temporal Transformer Networks: Joint Learning of Invariant and Discriminative Time Warping
Lohit, S., Wang, Q., & Turaga, P. K. (2019) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2019.01271 · Cited by 65
Towards Non-Saturating Recurrent Units for Modelling Long-Term Dependencies
Chandar, S., Sankar, C., Vorontsov, E., Kahou, S. E., & Bengio, Y. (2019) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v33i01.33013280 · Cited by 57
Heeger, D. J., & Mackey, W. E. (2019) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1911633116 · Cited by 55
Making Deep Q-learning methods robust to time discretization
Tallec, C., Blier, L., & Ollivier, Y. (2019) · HAL · doi:10.48550/arxiv.1901.09732 · Cited by 54
Self-citationTemporal Deep Learning for Drone Micro-Doppler Classification
Brooks, D., Schwander, O., Barbaresco, F., Schneider, J.-Y., & Cord, M. (2018) · International Radar Symposium · doi:10.23919/irs.2018.8447963 · Cited by 52
A Hybrid Prognostics Deep Learning Model for Remaining Useful Life Prediction
Xie, Z., Du, S., Lv, J., Deng, Y., & Jia, S. (2020) · Electronics · doi:10.3390/electronics10010039 · Cited by 52
Interpreting Recurrent Neural Networks Behaviour via Excitable Network Attractors
Ceni, A., Ashwin, P., & Livi, L. (2019) · Cognitive Computation · doi:10.1007/s12559-019-09634-2 · Cited by 51
State-space models are accurate and efficient neural operators for dynamical systems
Hu, Z., Daryakenari, N. A., Shen, Q., Kawaguchi, K., & Karniadakis, G. E. (2025) · Neural Networks · doi:10.1016/j.neunet.2025.108496 · Cited by 48
Probabilistic, Recurrent, Fuzzy Neural Network for Processing Noisy Time-Series Data
Li, Y., Gault, R., & McGinnity, T. M. (2021) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2021.3061432 · Cited by 45
Disentangling neural mechanisms for perceptual grouping
Kim, J., Linsley, D. A., Thakkar, K., & Serre, T. (2019) · Conference on Cognitive Computational Neuroscience (CCN) · doi:10.32470/ccn.2019.1130-0 · Cited by 44
Kobal, T., & Zhu, A. (2022) · IEEE Transactions on Microwave Theory and Techniques · doi:10.1109/tmtt.2022.3209658 · Cited by 41
NAIS-Net: Stable Deep Networks from Non-Autonomous Differential EquationsPreprint
Ciccone, M., Gallieri, M., Masci, J., Osendorfer, C., & Gomez, F. J. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1804.07209 · Cited by 40
Path sampling of recurrent neural networks by incorporating known physics
Tsai, S.-T., Fields, E., Xu, Y., Kuo, E.-J., & Tiwary, P. (2022) · Nature Communications · doi:10.1038/s41467-022-34780-x · Cited by 37
Kerg, G., Goyette, K., Touzel, M. P., Gidel, G., Vorontsov, E., Bengio, Y., & Lajoie, G. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1905.12080 · Cited by 37
Block-Oriented Recurrent Neural Network for Digital Predistortion of RF Power Amplifiers
Zhang, Q., Jiang, C., Yang, G., Han, R., & Liu, F. (2023) · IEEE Transactions on Microwave Theory and Techniques · doi:10.1109/tmtt.2023.3337939 · Cited by 32
Few-Shot Generalization Across Dialogue TasksPreprint
Vlasov, V., Drissner-Schmid, A., & Nichol, A. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1811.11707 · Cited by 31
Recurrent neural circuits for contour detectionPreprint
Linsley, D. A., Kim, J., Ashok, A. K., & Serre, T. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2010.15314 · Cited by 31
Interpretable multi-timescale models for predicting fMRI responses to continuous natural speechPreprint
Jain, S., Mahto, S., Turek, J. S., Vo, V. A., LeBel, A., & Huth, A. G. (2020) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2020.10.02.324392 · Cited by 30
The echo index and multistability in input-driven recurrent neural networks
Ceni, A., Ashwin, P., Livi, L., & Postlethwaite, C. (2020) · Physica D Nonlinear Phenomena · doi:10.1016/j.physd.2020.132609 · Cited by 29
NeuralWarp: Time-Series Similarity with Warping NetworksPreprint
Grabocka, J., & Schmidt-Thieme, L. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1812.08306 · Cited by 26
Su, Y. P., Fu, J., Lin, C., Lai, X., Zhiming, Z., Lin, Y., & He, Q. (2025) · Expert Systems with Applications · doi:10.1016/j.eswa.2025.126624 · Cited by 23
Slower is Better: Revisiting the Forgetting Mechanism in LSTM for Slower Information DecayPreprint
Chien, H.-Y. S., Turek, J. S., Beckage, N., Vo, V. A., Honey, C. J., & Willke, T. L. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2105.05944 · Cited by 23
Multivariate Time Series Prediction for Loss of Coolant Accidents With a Zigmoid-Based LSTM
Gong, S., Yang, S., She, J., Li, W., & Lu, S. (2022) · Frontiers in Energy Research · doi:10.3389/fenrg.2022.852349 · Cited by 22
A hybrid stock prediction method based on periodic/non-periodic features analyses
Zhao, C., Cai, J., & Yang, S. (2025) · EPJ Data Science · doi:10.1140/epjds/s13688-024-00517-7 · Cited by 21
Ohno, K., & Kumagai, A. (2021) · IEEE International Conference on Big Knowledge (ICBK) · doi:10.1109/ickg52313.2021.00033 · Cited by 18
Crabbé, J., & Schaar, M. V. D. (2023) · neural information processing systems · doi:10.52202/075280-3127 · Cited by 17
Input-to-State Representation in Linear Reservoirs Dynamics
Verzelli, P., Alippi, C., Livi, L., & Peter Tiňo, B. (2021) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2021.3059389 · Cited by 17
Multi-timescale Representation Learning in LSTM Language ModelsPreprint
Mahto, S., Vo, V. A., Turek, J. S., & Huth, A. G. (2020) · arXiv (Cornell University) · doi:10.26153/tsw/43665 · Cited by 16
Álvarez-Tuñón, O., Brodskiy, Y., & Kayacan, E. (2023) · IEEE Transactions on Artificial Intelligence · doi:10.1109/tai.2023.3321032 · Cited by 15
Rate-Invariant Autoencoding of Time-Series
Koneripalli, K., Lohit, S., Anirudh, R., & Turaga, P. K. (2020) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp40776.2020.9053983 · Cited by 15
Linsley, D. A., Kim, J., Berson, D. M., & Serre, T. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1811.11356 · Cited by 15
Gating creates slow modes and controls phase-space complexity in GRUs and LSTMsPreprint
Can, T., Krishnamurthy, K., & Schwab, D. J. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2002.00025 · Cited by 14
Automated well-to-seismic tie using deep neural networks
Nivlet, P., Smith, R., & AlBinHassan, N. M. (2020) · Second International Meeting for Applied Geoscience & Energy · doi:10.1190/segam2020-3422495.1 · Cited by 13
Noether Networks: Meta-Learning Useful Conserved QuantitiesPreprint
Alet, F., Doblar, D., Zhou, A., Tenenbaum, J. B., Kawaguchi, K., & Finn, C. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2112.03321 · Cited by 13
Mind the Remainder: Taylor’s Theorem View on Recurrent Neural Networks
Guan, X., Yang, Y., Li, J., Xu, X., & Shen, H. T. (2021) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2020.3042537 · Cited by 12
Spatio-temporal warping for myoelectric control: an offline, feasibility study
Jabbari, M., Khushaba, R. N., & Nazarpour, K. (2021) · Journal of Neural Engineering · doi:10.1088/1741-2552/ac387f · Cited by 11
End-to-End Amp Modeling: from Data to Controllable Guitar Amplifier Models
Juvela, L., Damskägg, E.-P., Peussa, A., Mäkinen, J., Sherson, T., Mimilakis, S. I., Rauhanen, K., & Gotsopoulos, A. (2023) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp49357.2023.10094769 · Cited by 11
Chrono Initialized LSTM Networks With Layer Normalization
Tolic, A., Boshkoska, B. M., & Skansi, S. (2024) · IEEE Access · doi:10.1109/access.2024.3445329 · Cited by 11
The Nonlinearity Coefficient - A Practical Guide to Neural Architecture DesignPreprint
Philipp, G. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2105.12210 · Cited by 10
Learnable Commutative Monoids for Graph Neural NetworksPreprint
Ong, E., & Veličković, P. (2022) · arXiv (Cornell University) · doi:10.48550/arxiv.2212.08541 · Cited by 10
Warming up recurrent neural networks to maximise reachable multistability greatly improves learning
Lambrechts, G., Geeter, F. D., Vecoven, N., Ernst, D., & Drion, G. (2023) · Neural Networks · doi:10.1016/j.neunet.2023.07.023 · Cited by 9
RNNs Evolving on an Equilibrium Manifold: A Panacea for Vanishing and Exploding Gradients?
Kag, A., Zhang, Z., & Saligrama, V. (2019) · OpenBU (Boston University) · doi:10.48550/arxiv.1908.08574 · Cited by 9
Forecasting high-dimensional spatio-temporal systems from sparse measurements
Song, J., Song, Z., Ren, P., Erichson, N. B., Mahoney, M. W., & Li, X. S. (2024) · Machine Learning Science and Technology · doi:10.1088/2632-2153/ad9883 · Cited by 8
Yin, J. Y., Ma, R. Q., & Ge, S. (2025) · Frontiers of Engineering Management · doi:10.1007/s42524-025-4030-5 · Cited by 8
RETRACTED: Research on group behavior model based on neural network computing
Wei, J., Tian, Y., & Geng, J. (2020) · Computational Intelligence · doi:10.1111/coin.12403 · Cited by 8
RetractedTime-warping invariant quantum recurrent neural networks via quantum-classical adaptive gating
Nikoloska, I., Simeone, O., Banchi, L., & Veličković, P. (2023) · Machine Learning Science and Technology · doi:10.1088/2632-2153/acff39 · Cited by 8
Towards Non-saturating Recurrent Units for Modelling Long-term DependenciesPreprint
Chandar, S., Sankar, C., Vorontsov, E., Kahou, S. E., & Bengio, Y. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1902.06704 · Cited by 9
Rough Transformers: Lightweight and Continuous Time Series Modelling through Signature Patching
Moreno-Pino, F., Arroyo, Á., Waldon, H., Dong, X., & Cartea, Á. (2024) · neural information processing systems · doi:10.52202/079017-3371 · Cited by 7
Input representation in recurrent neural networks dynamics.
Verzelli, P., Alippi, C., Livi, L., & Peter Tiňo, B. (2020) · Cited by 7
Ling, S., Murphy, A., & Fyshe, A. (2024) · Computational Linguistics · doi:10.1162/coli_a_00533 · Cited by 6
Shan, D., Jing, Z., & Luo, Y. (2025) · Applied Soft Computing · doi:10.1016/j.asoc.2025.113448 · Cited by 6
Spontaneous Temporal Grouping Neural Network for Long-Term Memory Modeling
Shan, D., Zhang, X., & Zhang, C. (2021) · IEEE Transactions on Cognitive and Developmental Systems · doi:10.1109/tcds.2021.3050759 · Cited by 6
Attention to Warp: Deep Metric Learning for Multivariate Time Series
Matsuo, S., Wu, X., Atarsaikhan, G., Kimura, A., Kashino, K., Iwana, B. K., & Uchida, S. (2021) · Lecture notes in computer science · doi:10.1007/978-3-030-86334-0_23 · Cited by 6
Feature Programming for Multivariate Time Series PredictionPreprint
Reneau, A., Hu, J. Y.-C., Xu, C., Li, W., Gilani, A., & Liu, H. (2023) · arXiv (Cornell University) · doi:10.48550/arxiv.2306.06252 · Cited by 6
Probable Object Location (POLo) Score Estimation for Efficient Object Goal Navigation
Wang, J., & Soh, H. (2024) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra57147.2024.10610671 · Cited by 5
Ntakaris, A., Gabbouj, M., & Kanniainen, J. (2025) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2025.3611887 · Cited by 5
Stochastic Convolutional Recurrent Networks
Chien, J., & Huang, Y. (2020) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn48605.2020.9206970 · Cited by 5
Khajehabdollahi, S., Zeraati, R., Giannakakis, E., Schäfer, T. J., Martius, G., & Levina, A. (2023) · arXiv (Cornell University) · doi:10.48550/arxiv.2309.12927 · Cited by 5
Xigmoid: An Approach to Improve the Gating Mechanism of RNN
She, J., Gong, S., Yang, S., Yang, H., & Lu, S. (2022) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn55064.2022.9892346 · Cited by 4
Alhamayani, A. D., Sun, Q., & Hallinan, K. P. (2022) · Clean Technologies · doi:10.3390/cleantechnol4020024 · Cited by 4
Kernel-Based Approaches for Sequence Modeling: Connections to Neural MethodsPreprint
Liang, K. J., Wang, G., Li, Y., Henao, R., & Carin, L. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1910.04233 · Cited by 4
An optimization scheme for segmented-memory neural network
Shan, D., Zhang, C., & Nian, Y. (2021) · Neurocomputing · doi:10.1016/j.neucom.2021.07.076 · Cited by 3
Light-weight behavior-based continuous authentication for personalized mobile robot
Kobayashi, T., Mabuchi, T., & Kosaka, M. (2022) · International Journal of Intelligent Robotics and Applications · doi:10.1007/s41315-022-00243-1 · Cited by 3
Zhou, Y., Yu, X., López‐Benítez, M., Yu, L., & Yue, Y. (2024) · IEEE Sensors Journal · doi:10.1109/jsen.2024.3459085 · Cited by 3
A Recurrent Neural Circuit Mechanism of Temporal-scaling Equivariant Representation
Zuo, J., Liu, X., Wu, Y. N., Wu, S., & Zhang, W. (2023) · neural information processing systems · doi:10.52202/075280-2737 · Cited by 3
RECURRENT NEURAL NETWORKS WITH FLEXIBLE GATES USING KERNEL ACTIVATION FUNCTIONS
Scardapane, S., Vaerenbergh, S. V., Comminiello, D., Totaro, S., & Uncini, A. (2018) · Machine learning for signal processing ... · doi:10.1109/mlsp.2018.8516994 · Cited by 3
Speech Enhancement Method Based on Modified Encoder-Decoder Pyramid Transformer
Лепендин, А. А., Nasretdinov, R., & Ilyashenko, I. (2022) · Proceedings of the Institute for System Programming of RAS · doi:10.15514/ispras-2022-34(4)-10 · Cited by 3
Modeling the Role of Contour Integration in Visual Inference
Khan, S., Wong, A. K. C., & Tripp, B. (2023) · Neural Computation · doi:10.1162/neco_a_01625 · Cited by 3
Task-Synchronized Recurrent Neural NetworksPreprint
Lukoševičius, M., & Uselis, A. (2022) · arXiv (Cornell University) · doi:10.48550/arxiv.2204.05192 · Cited by 3
KOSLM: A Kalman-Optimal Hybrid State-Space Memory Network for Long-Term Time Series Forecasting
Tan, X., Wang, L., Wang, M., & Zhang, Y. (2025) · Applied Sciences · doi:10.3390/app152312684 · Cited by 2
An efficient training method to learn a model of turbulence
Noto, D., Allauzen, A., & Chibbaro, S. (2024) · The European Physical Journal Plus · doi:10.1140/epjp/s13360-024-05056-8 · Cited by 2
Towards Automated Emotional Conversation Generation with Implicit and Explicit Affective Strategy
Gu, X., Xu, W., & Li, S. (2019) · International Symposium on Signal Processing Systems (SSPS) · doi:10.1145/3364908.3365288 · Cited by 2
Shan, D., & Li, D. (2022) · Applied Soft Computing · doi:10.1016/j.asoc.2022.109618 · Cited by 2
A novel recurrent neural network of gated unit based on Euler's method and application
Meng, P., Wang, L., Yin, W., & Zhou, L. (2023) · Communications on Analysis and Computation · doi:10.3934/cac.2023007 · Cited by 2
RNNs Evolving in Equilibrium: A Solution to the Vanishing and Exploding GradientsPreprint
Kag, A., Zhang, Z., & Saligrama, V. (2019) · arXiv (Cornell University) · Cited by 2
Online Stochastic Gradient Descent Learns Linear Dynamical Systems from A Single TrajectoryPreprint
Reyhanian, N., & Haupt, J. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2102.11822 · Cited by 2
Capture Timing-Attention of Events in Clinical Time SeriesPreprint
Li, J., Hou, Y., & Zhang, R. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2602.10385 · Cited by 2
Modular Growth of Hierarchical Networks: Efficient, General, and Robust Curriculum Learning
Hamidi, M., Khajehabdollahi, S., Giannakakis, E., Schäfer, T. J., Levina, A., & Wu, C. M. (2024) · Conference on Artificial Life (ALIFE) · doi:10.1162/isal_a_00780 · Cited by 1
Improving Minimal Gated Unit for Sequential Data
Takamura, K., & Yamane, S. (2019) · IEEE Global Conference on Consumer Electronics (GCCE) · doi:10.1109/gcce46687.2019.9015461 · Cited by 1
Linear Dynamical Systems as a Core Computational Primitive
Kaul, S. (2020) · neural information processing systems · Cited by 1
Long Short-Term Memory with Slower Information Decay
Chien, H.-Y. S., Turek, J. S., Beckage, N., Vo, V. A., Honey, C. J., & Willke, T. (2022) · LatinX in AI at International Conference on Machine Learning (LXAI) · doi:10.52591/2021072418 · Cited by 1
Fast Saturating Gate for Learning Long Time Scales with Recurrent Neural Networks
Ohno, K., Kanai, S., & Ida, Y. (2023) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v37i8.26117 · Cited by 1
Least Redundant Gated Recurrent Neural Network
Neumann, Ł., Lepak, Ł., & Wawrzyński, P. (2023) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn54540.2023.10191895 · Cited by 1
Transitions in echo index and dependence on input repetitions
Ashwin, P., & Ceni, A. (2024) · Physica D Nonlinear Phenomena · doi:10.1016/j.physd.2024.134277 · Cited by 1
Deep Learning on Attributed Graphs: A Journey from Graphs to Their Embeddings and BackPreprint
Simonovsky, M. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1901.08296 · Cited by 1
FACTS: A Factored State-Space Framework For World ModellingPreprint
Li, N., Laakom, F., Xu, Y. C., Wang, W., & Schmidhuber, J. (2024) · arXiv (Cornell University) · doi:10.48550/arxiv.2410.20922 · Cited by 1
Metadata
- Authors
- Tallec, C., & Ollivier, Y.
- Affiliations
- Université Paris-Sud (FR)
- Meta (United States) (US)
- ORCID
- Tallec, Corentin
- Venue
- arXiv
- Publisher
- arXiv
- Published
- 2018
- ISSN
- 2331-8422 (ISSN-L)
- arXiv
- 1804.11188
- OpenAlex
- W2786406400
- Cited by
- 120
- References
- 25
- Citations by year
- 2026: 8 · 2025: 10 · 2024: 12 · 2023: 13 · 2022: 13 · 2021: 18 · 2020: 13 · 2019: 22 · 2018: 11
- Type
- posted content
- Language
- en
- Open access
- green
- arxiv.org
- Locations
- arXiv (Cornell University) (submittedVersion)
- HAL (submittedVersion, other-oa)
- arXiv (Cornell University)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Neural Networks and Applications
- Physical Sciences › Environmental Science › Environmental Engineering › Hydrological Forecasting Using AI
- Physical Sciences › Computer Science › Artificial Intelligence › Topic Modeling
- Keywords
- recurrent neural networks, long short-term memory, gated recurrent unit, time invariance, time transformation, axiomatic method, long-range dependencies, gradient vanishing
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
