Deep Reinforcement Learning for Quantitative Trading: Challenges and Opportunities
The DOI matches its Crossref record; 15 of the 16 references it cites were found in a registry or an index.
Abstract
Quantitative trading (QT) has been a popular topic in both academia and the financial industry since the 1970s. In the last decade, deep reinforcement learning (DRL) has garnered significant research interest with stellar performance in solving complex sequential decision-making problems, such as Go and video games. The impact of DRL is pervasive, recently demonstrating its ability to conquer some challenging QT tasks. In this article, we outline several key challenges and opportunities that manifest in DRL-based QT to shed light on future research in this field.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Reinforcement learningbased systems [2] demonstrate enhanced adaptability but encounter substantial obstacles, such as the need for extensive training data and the inexplainability of decision-making processes.”
From A Multimodal Foundation Agent for Financial Trading: Tool-Augmented, Diversified, and Generalist (2024) · cites this paper as [2]
Citations
Cites
Returns to Buying Winners and Selling Losers: Implications for Stock Market Efficiency
JEGADEESH, N., & TITMAN, S. (1993) · The Journal of Finance · doi:10.1111/j.1540-6261.1993.tb04702.x · Cited by 11,584
A Comprehensive Survey on Graph Neural Networks
Wu, Z., Pan, S., Chen, F., Long, G., Zhang, C., & Yu, P. S. (2021) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2020.2978386 · Cited by 11,000 · cited 1×
“Third, graph learning 12 achieves promising results in modeling the interrelationship between stocks in prediction-based meth-ods.”
BackgroundLightGBM: A Highly Efficient Gradient Boosting Decision Tree
(2017) · HAL · Cited by 10,512
Moskowitz, T. J., Ooi, Y. H., & Pedersen, L. H. (2012) · Journal of Financial Economics · doi:10.1016/j.jfineco.2011.11.003 · Cited by 1,431
Stock Movement Prediction from Tweets and Historical Prices
Xu, Y., & Cohen, S. B. (2018) · Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.18653/v1/p18-1183 · Cited by 434 · cited 1×
“3,4 However, due to the high volatility and noisy nature of the fi nancial market, their performance is not stable and highly dependent on market conditions.”
BackgroundWang, Z., Huang, B., Tu, S., Zhang, K., & Xu, L. (2021) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v35i1.16144 · Cited by 152
Reinforcement Learning for Quantitative Trading
Sun, S., Wang, R., & An, B. (2023) · ACM Transactions on Intelligent Systems and Technology · doi:10.1145/3582560 · Cited by 148
Self-citationAdaptive Quantitative Trading: An Imitative Deep Reinforcement Learning Approach
Liu, Y., Liu, Q., Zhao, H., Pan, Z., & Liu, C. (2020) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v34i02.5587 · Cited by 141
Reinforcement Learning for Quantitative TradingPreprint
Sun, S., Wang, R., & An, B. (2021) · ACM Transactions on Intelligent Systems and Technology · doi:10.48550/arxiv.2109.13851 · Cited by 103
Self-citationExploring the Scale-Free Nature of Stock Markets: Hyperbolic Graph Learning for Algorithmic Trading
Sawhney, R., Agarwal, S., Wadhwa, A., & Shah, R. R. (2021) · International World Wide Web Conference (WWW) · doi:10.1145/3442381.3450095 · Cited by 62
Robust Market Making via Adversarial Reinforcement Learning
Spooner, T., & Savani, R. (2020) · Adaptive Agents and Multi-Agents Systems · doi:10.24963/ijcai.2020/633 · Cited by 59
Universal Trading for Order Execution with Oracle Policy Distillation
Fang, Y., Ren, K., Liu, W., Zhou, D. X., Zhang, W., Bian, J., Yu, Y. H., & Liu, T. (2021) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v35i1.16083 · Cited by 59
Model-based Deep Reinforcement Learning for Dynamic Portfolio Optimization
Yu, P., Sern, L. J., Kulyatin, I., Shi, Z., & Dasgupta, S. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1901.08740 · Cited by 58
Commission Fee is not Enough: A Hierarchical Reinforced Framework for Portfolio Management
Wang, R., Wei, H., An, B., Feng, Z., & Yao, J. (2021) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v35i1.16142 · Cited by 45
Self-citationGet Real: Realism Metrics for Robust Limit Order Book Market SimulationsPreprint
Vyetrenko, S., Byrd, D., Petosa, N., Mahfouz, M., Dervovic, D., Veloso, M., & Balch, T. H. (2019) · RePEc: Research Papers in Economics · doi:10.48550/arxiv.1912.04941 · Cited by 25
Cited by
Reinforcement Learning for Quantitative Trading
Sun, S., Wang, R., & An, B. (2023) · ACM Transactions on Intelligent Systems and Technology · doi:10.1145/3582560 · Cited by 148
Self-citationA Multimodal Foundation Agent for Financial Trading: Tool-Augmented, Diversified, and Generalist
Zhang, W., Zhao, L., Xia, H., Sun, S., Sun, J., Qin, M., Li, X., Zhao, Y., Zhao, Y., Cai, X., et al. (2024) · Proceedings of the 30th ACM SIGKDD Conference on Knowledge Discovery and Data Mining · doi:10.1145/3637528.3671801 · Cited by 74
Self-citationSun, S., Xue, W., Wang, R., He, X., Zhu, J., Li, J., & An, B. (2022) · ACM International Conference on Information and Knowledge Management (CIKM) · doi:10.1145/3511808.3557283 · Cited by 58
“Recent years have witnessed significant development of quantitative trading [1], due to its instant and accurate order execution, and capability of analyzing and processing large amount of temporal financial data.”
BackgroundSelf-citationNew reinforcement learning based on representation transfer for portfolio management
Jiang, W., Liu, M., Xu, M., Chen, S., Shi, K., Liu, P., Zhang, C., & Zhao, F. (2024) · Knowledge-Based Systems · doi:10.1016/j.knosys.2024.111697 · Cited by 14
Temporal Implicit Multimodal Networks for Investment and Risk Management
Ang, G., & Lim, E. (2024) · ACM Transactions on Intelligent Systems and Technology · doi:10.1145/3643855 · Cited by 18
Metadata
- Authors
- An, B., Sun, S., & Wang, R.
- Affiliations
- Nanyang Technological University (SG)
- Venue
- IEEE Intelligent Systems
- Published
- 2022-03-01
- Volume
- 37
- Issue
- 2
- Pages
- 23-26
- ISSN
- 1541-1672 (ISSN-L)
- 1941-1294
- OpenAlex
- W4281393001
- Cited by
- 22
- References
- 16
- Citations by year
- 2026: 2 · 2025: 1 · 2024: 11 · 2023: 6 · 2022: 2
- FWCI
- 3.06
- Type
- journal article
- Language
- en
- Open access
- closed
- Licence
- Locations
- IEEE Intelligent Systems (publishedVersion)
- DR-NTU (Nanyang Technological University) (submittedVersion)
- Topics
- Social Sciences › Decision Sciences › Management Science and Operations Research › Stock Market Forecasting Methods
- Social Sciences › Economics, Econometrics and Finance › Finance › Financial Markets and Investment Strategies
- Physical Sciences › Computer Science › Artificial Intelligence › Reinforcement Learning in Robotics
- Keywords
- deep reinforcement learning, quantitative trading, trading strategies, sequential decision making, algorithmic trading, financial decision-making
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.