The DOI matches its Crossref record; 41 of the 41 references it cites were found in a registry or an index.
Adaptive stock trading strategies with deep reinforcement learning methods
Abstract
The increasing complexity and dynamical property in stock markets are key challenges of the financial industry, in which inflexible trading strategies designed by experienced financial practitioners fail to achieve satisfactory performance in all market conditions. To meet this challenge, adaptive stock trading strategies with deep reinforcement learning methods are proposed. For the time-series nature of stock market data, the Gated Recurrent Unit (GRU) is applied to extract informative financial features, which can represent the intrinsic characteristics of the stock market for adaptive trading decisions. Furthermore, with the tailored design of state and action spaces, two trading strategies with reinforcement learning methods are proposed as GDQN (Gated Deep Q-learning trading strategy) and GDPG (Gated Deterministic Policy Gradient trading strategy). To verify the robustness and effectiveness of GDQN and GDPG, they are tested both in the trending and in the volatile stock market from different countries. Experimental results show that the proposed GDQN and GDPG not only outperform the Turtle trading strategy but also achieve more stable returns than a state-of-the-art direct reinforcement learning method, DRL trading strategy, in the volatile stock market. As far as the GDQN and the GDPG are compared, experimental results demonstrate that the GDPG with an actor-critic framework is more stable than the GDQN with a critic-only framework in the ever-evolving stock market.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474
Proceedings of IEEE Conference on Computer Vision and Pattern Recognition
(1993) · doi:10.1109/cvpr.1993 · Cited by 17,667
Proceedings of IEEE International Conference on Computer Vision
(1995) · Proceedings of IEEE International Conference on Computer Vision · doi:10.1109/iccv.1995.466933 · Cited by 12,860
Mastering the game of Go without human knowledge
Silver, D., Schrittwieser, J., Simonyan, K., Antonoglou, I., Huang, A., Guez, A., Hubert, T., Baker, L., Lai, M., Bolton, A., et al. (2017) · Nature · doi:10.1038/nature24270 · Cited by 9,084
A general reinforcement learning algorithm that masters chess, shogi, and Go through self-play
Silver, D., Hubert, T., Schrittwieser, J., Antonoglou, I., Lai, M., Guez, A., Lanctot, M., Sifre, L., Kumaran, D., Graepel, T., et al. (2018) · Science · doi:10.1126/science.aar6404 · Cited by 3,562
Deep Reinforcement Learning with Double Q-Learning
Van Hasselt, H., Guez, A., & Silver, D. (2016) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v30i1.10295 · Cited by 3,318
Recent Trends in Deep Learning Based Natural Language Processing [Review Article]
Young, T., Hazarika, D., Poria, S., & Cambria, E. (2018) · IEEE Computational Intelligence Magazine · doi:10.1109/mci.2018.2840738 · Cited by 2,921
Deep learning with long short-term memory networks for financial market predictions
Fischer, T., & Krauss, C. (2018) · European Journal of Operational Research · doi:10.1016/j.ejor.2017.11.054 · Cited by 2,785
Recurrent Neural Networks for Multivariate Time Series with Missing Values
Che, Z., Purushotham, S., Cho, K., Sontag, D., & Liu, Y. (2018) · Scientific Reports · doi:10.1038/s41598-018-24271-9 · Cited by 2,370
Deep Speech 2: End-to-End Speech Recognition in English and Mandarin
Amodei, D., Anubhai, R., Battenberg, E., Case, C. T., Casper, J., Catanzaro, B., Chen, J., Chrzanowski, M., Coates, A., Diamos, G., et al. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1512.02595 · Cited by 2,110
Recent Trends in Deep Learning Based Natural Language Processing
Young, T., Hazarika, D., Poria, S., & Cambria, E. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1708.02709 · Cited by 1,192
Bao, W., Yue, J., & Rao, Y. (2017) · PLOS ONE · doi:10.1371/journal.pone.0180944 · Cited by 1,124
Learning Multi-attention Convolutional Neural Network for Fine-Grained Image Recognition
Zheng, H., Fu, J., Mei, T., & Luo, J. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.557 · Cited by 1,045
Ask Me Anything: Dynamic Memory Networks for Natural Language Processing
Kumar, A., Irsoy, O., Ondruska, P., Iyyer, M., Bradbury, J., Gulrajani, I., Zhong, V., Paulus, R., & Socher, R. (2015) · arXiv · doi:10.48550/arxiv.1506.07285 · Cited by 1,020
Zhu, W., Lan, C., Xing, J., Zeng, W., Li, Y., Shen, L., & Xie, X. (2016) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v30i1.10451 · Cited by 915
Deep Direct Reinforcement Learning for Financial Signal Representation and Trading
Deng, Y., Bao, F., Kong, Y., Ren, Z., & Dai, Q. (2017) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2016.2522401 · Cited by 822
Playing FPS Games with Deep Reinforcement Learning
Lample, G., & Chaplot, D. S. (2017) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v31i1.10827 · Cited by 452
Forecasting daily stock market return using dimensionality reduction
Zhong, X., & Enke, D. (2017) · Expert Systems with Applications · doi:10.1016/j.eswa.2016.09.027 · Cited by 394
Sun, J., Li, H., Fujita, H., Fu, B., & Ai, W. (2020) · Information Fusion · doi:10.1016/j.inffus.2019.07.006 · Cited by 362
Self-citationRobust Multi-Agent Reinforcement Learning via Minimax Deep Deterministic Policy Gradient
Li, S., Wu, Y., Cui, X., Dong, H., Fang, F., & Russell, S. (2019) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v33i01.33014213 · Cited by 290
Qiu, M., Song, Y., & Akagi, F. (2016) · Chaos, Solitons & Fractals · doi:10.1016/j.chaos.2016.01.004 · Cited by 229
Policy Gradient Adaptive Dynamic Programming for Data-Based Optimal Control
Luo, B., Liu, D., Wu, H.-N., Wang, D., & Lewis, F. L. (2017) · IEEE Transactions on Cybernetics · doi:10.1109/tcyb.2016.2623859 · Cited by 222
Cellular Network Traffic Scheduling With Deep Reinforcement Learning
Chinchali, S., Hu, P., Chu, T., Sharma, M., Bansal, M., Misra, R., Pavone, M., & Katti, S. (2018) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v32i1.11339 · Cited by 218
Sun, J., Fujita, H., Chen, P., & Li, H. (2017) · Knowledge-Based Systems · doi:10.1016/j.knosys.2016.12.019 · Cited by 173
Self-citationData-driven dynamic resource scheduling for network slicing: A Deep reinforcement learning approach
Wang, H., Wu, Y., Min, G., Xu, J., & Tang, P. (2019) · Information Sciences · doi:10.1016/j.ins.2019.05.012 · Cited by 160
Wu, X., Chen, H., Chen, C., Zhong, M., Xie, S., Guo, Y., & Fujita, H. (2020) · Knowledge-Based Systems · doi:10.1016/j.knosys.2019.105201 · Cited by 158
Self-citationLearning how to drive in a real world simulation with deep Q-Networks
Wolf, P., Hubschneider, C., Weber, M., Bauer, A., Hartl, J., Dürr, F., & Zöllner, J. M. (2017) · IEEE Intelligent Vehicles Symposium · doi:10.1109/ivs.2017.7995727 · Cited by 150
Huang, B., Huan, Y., Xu, L. D., Zheng, L., & Zou, Z. (2018) · Enterprise Information Systems · doi:10.1080/17517575.2018.1493145 · Cited by 140
Reinforcement learning applied to Forex trading
Carapuço, J., Neves, R. F., & Horta, N. C. G. (2018) · Applied Soft Computing · doi:10.1016/j.asoc.2018.09.017 · Cited by 136
A New Model for Stock Price Movements Prediction Using Deep Neural Network
Huynh, H. D., Dang, L. M., & Duong, D. M. (2017) · International Symposium on Information and Communication Technology · doi:10.1145/3155133.3155202 · Cited by 112
Replicating a Trading Strategy by Means of LSTM for Financial Industry Applications
Troiano, L., Mejuto-Villa, E., & Loia, V. (2018) · IEEE Transactions on Industrial Informatics · doi:10.1109/tii.2018.2811377 · Cited by 95
Self-citationMohan, V., Singh, J. G., & Ongsakul, W. (2016) · IEEE Transactions on Sustainable Energy · doi:10.1109/tste.2016.2593713 · Cited by 88
A novel multi-step Q-learning method to improve data efficiency for deep reinforcement learning
Yuan, Y., Yu, Z. L., Gu, Z., Yeboah, Y., Wu, W., Deng, X., Li, J., & Li, Y. (2019) · Knowledge-Based Systems · doi:10.1016/j.knosys.2019.03.018 · Cited by 61
Complex Gated Recurrent Neural NetworksPreprint
Wolter, M., & Yao, A. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1806.08267 · Cited by 55
Sparse Coding-Inspired Optimal Trading System for HFT Industry
Deng, Y. C., Kong, Y., Bao, F., & Dai, Q. (2015) · IEEE Transactions on Industrial Informatics · doi:10.1109/tii.2015.2404299 · Cited by 50
Small bowel motility assessment based on fully convolutional networks and long short-term memory
Pei, M., Wu, X., Guo, Y., & Fujita, H. (2017) · Knowledge-Based Systems · doi:10.1016/j.knosys.2017.01.023 · Cited by 40
Self-citationForecasting Stock Price Index Volatility with LSTM Deep Neural Network
Shui-Ling, Y. U., & Li, Z. (2018) · Springer proceedings in business and economics · doi:10.1007/978-3-319-72745-5_29 · Cited by 36
Adaptive early classification of temporal sequences using deep reinforcement learning
Martinez, C., Ramasso, E., Perrin, G., & Rombaut, M. (2019) · Knowledge-Based Systems · doi:10.1016/j.knosys.2019.105290 · Cited by 33
Reinforcement learning for trading systems and portfolios
Moody, J. E., & Saffell, M. (1998) · Cited by 18
Cited by
Reinforcement learning algorithms: A brief survey
Shakya, A. K., Pillai, G., & Chakrabarty, S. (2023) · Expert Systems with Applications · doi:10.1016/j.eswa.2023.120495 · Cited by 656
AI in Finance: Challenges, Techniques, and Opportunities
Cao, L. (2023) · ACM Computing Surveys · doi:10.1145/3502289 · Cited by 366
Metadata
- Authors
- Wu, X., Chen, H., Wang, J., Troiano, L., Loia, V., & Fujita, H.
- Venue
- Information Sciences
- Publisher
- Elsevier BV
- Published
- 2020-10
- Volume
- 538
- Pages
- 142-158
- ISSN
- 0020-0255 (ISSN-L)
- OpenAlex
- W3035574064
- Cited by
- 263
- References
- 41
- FWCI
- 21.83
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.