The DOI matches its Crossref record; 30 of the 33 references it cites were found in a registry or an index.
Adaptive Quantitative Trading: An Imitative Deep Reinforcement Learning Approach
Open accessAbstract
In recent years, considerable efforts have been devoted to developing AI techniques for finance research and applications. For instance, AI techniques (e.g., machine learning) can help traders in quantitative trading (QT) by automating two tasks: market condition recognition and trading strategies execution. However, existing methods in QT face challenges such as representing noisy high-frequent financial data and finding the balance between exploration and exploitation of the trading agent with AI techniques. To address the challenges, we propose an adaptive trading model, namely iRDPG, to automatically develop QT strategies by an intelligent trading agent. Our model is enhanced by deep reinforcement learning (DRL) and imitation learning techniques. Specifically, considering the noisy financial data, we formulate the QT process as a Partially Observable Markov Decision Process (POMDP). Also, we introduce imitation learning to leverage classical trading strategies useful to balance between exploration and exploitation. For better simulation, we train our trading agent in the real financial market using minute-frequent data. Experimental results demonstrate that our model can extract robust market features and be adaptive in different markets.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Human-level control through deep reinforcement learning
Mnih, V., Kavukcuoglu, K., Silver, D., Rusu, A. A., Veness, J., Bellemare, M. G., Graves, A., Riedmiller, M., Fidjeland, A. K., Ostrovski, G., et al. (2015) · Nature · doi:10.1038/nature14236 · Cited by 30,357
Reinforcement Learning: An Introduction
Sutton, R. S., & Barto, A. G. (1998) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.1998.712192 · Cited by 27,225
EFFICIENT CAPITAL MARKETS: A REVIEW OF THEORY AND EMPIRICAL WORK*
Malkiel, B. G., & Fama, E. F. (1970) · The Journal of Finance · doi:10.1111/j.1540-6261.1970.tb00518.x · Cited by 24,478
Continuous control with deep reinforcement learning
Lillicrap, T. P., Hunt, J. J., Pritzel, A., Heess, N., Erez, T., Tassa, Y., Silver, D., & Wierstra, D. (2015) · arXiv · doi:10.48550/arxiv.1509.02971 · Cited by 10,782
Reinforcement Learning: A Survey
Kaelbling, L. P., Littman, M. L., & Moore, A. W. (1996) · Journal of Artificial Intelligence Research · doi:10.1613/jair.301 · Cited by 8,972
(1999) · Cited by 5,147
Planning and acting in partially observable stochastic domains
Kaelbling, L. P., Littman, M. L., & Cassandra, A. R. (1998) · Artificial Intelligence · doi:10.1016/s0004-3702(98)00023-x · Cited by 4,149
Sharpe, W. F. (1966) · The Journal of Business · doi:10.1086/294846 · Cited by 3,937
Deterministic Policy Gradient Algorithms
Silver, D., Lever, G., Heess, N., Degris, T., Wierstra, D., & Riedmiller, M. (2014) · HAL · Cited by 3,275
Schaul, T., Quan, J., Antonoglou, I., & Silver, D. (2015) · arXiv · doi:10.48550/arxiv.1511.05952 · Cited by 3,120
Flagged first, then by citations
3 of the 33 references couldn’t be matched to a known paper.
Research works printed but not linked: 2
- Magdon-Ismail, M., and Atiya, A. F. 2004. Maximum drawdown. Risk Magazine 17(10):99-102.
- Pruitt, G., and Hill, J. R. 2012. Building Winning Trading Systems with Tradestation,+ Website , volume 542. John Wiley & Sons.
Cited by
Sorted by citations
Items 101–142 of 142
Probabilistic Offline Policy Ranking with Approximate Bayesian Computation
Da, L., Jenkins, P., Schwantes, T., Dotson, J. P., & Wei, H. (2024) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v38i18.30019 · Cited by 2
Reinforcement learning application in portfolio optimization: a comprehensive literature review
Mortaji, M., Khiat, A., & Houad, M. B. (2024) · International Conference on Intelligent Systems and Computer Vision (ISCV) · doi:10.1109/iscv60512.2024.10620129 · Cited by 2
Wang, G., Fu, T., Zheng, R., Zhao, X., Zhu, J., & Zhang, M. (2025) · Complex & Intelligent Systems · doi:10.1007/s40747-024-01757-w · Cited by 2
MOT: A Mixture of Actors Reinforcement Learning Method by Optimal Transport for Algorithmic Trading
Cheng, X., Zhang, J., Zeng, Y., & Xue, W. (2024) · Lecture notes in computer science · doi:10.1007/978-981-97-2238-9_3 · Cited by 2
On CVaR-Based Reinforcement Learning in Quantitative InvestmentPreprint
Alameer, A., & Alshehri, K. A. (2022) · doi:10.36227/techrxiv.19961525.v1 · Cited by 2
Feature Enrichment Imitative Reinforcement Learning for High-Frequency TradingPreprint
Han, F., Ling, Q.-H., Lu, S., & Han, H. (2025) · SSRN Electronic Journal · doi:10.1016/j.eswa.2025.129043 · Cited by 3
The Important Role of Global State for Multi-Agent Reinforcement Learning
Li, S., Zhang, W., Leng, Y., & Wang, X. (2021) · Future Internet · doi:10.3390/fi14010017 · Cited by 1
Mohl, V., Frey, S., Leyland, R., Li, K., Nigmatulin, G., Cucuringu, M., Zohren, S., Foerster, J., & Calinescu, A. (2025) · ACM International Conference on AI in Finance (ICAIF) · doi:10.1145/3768292.3770416 · Cited by 1
Contextual Online Imitation Learning (COIL): Using Guide Policies in Reinforcement Learning
Hill, A., Groefsema, M., Sabatelli, M., Carloni, R., & Grzegorczyk, M. A. (2024) · International Conference on Agents and Artificial Intelligence (ICAART) · doi:10.5220/0012312700003636 · Cited by 1
Enhancing Financial Investment Decision-Making With Deep Learning Model
Wang, X., & Lu, B. (2024) · Journal of Organizational and End User Computing · doi:10.4018/joeuc.344454 · Cited by 1
An LSTM-based optimization algorithm for enhancing quantitative arbitrage trading
Han, G., & Li, H. (2024) · PeerJ Computer Science · doi:10.7717/peerj-cs.2164 · Cited by 1
Ensemble Deep Reinforcement Learning for Financial Trading
Vishal, M., Ravi, V., & Lal, R. (2024) · Intelligent systems reference library · doi:10.1007/978-3-031-61037-0_9 · Cited by 1
Integrating Textual and Financial Time Series Data for Enhanced Forecasting*
Mou, S., Xue, Q., Zhang, W., Kinkyo, T., Hamori, S., Chen, J., Takiguchi, T., & Ariki, Y. (2024) · IIAI International Congress on Advanced Applied Informatics (IIAI-AAI) · doi:10.1109/iiai-aai63651.2024.00103 · Cited by 1
A Study of Quantitative Modeling and Capital Market Efficiency Enhancement in High Frequency Trading
Li, Z. (2024) · Applied Mathematics and Nonlinear Sciences · doi:10.2478/amns-2024-3449 · Cited by 2
QuantBench: benchmarking AI methods for quantitative investment from a full pipeline perspective
Wang, S., Kong, H., Guo, J., Hua, F., Qi, Y., Zhou, W., Zheng, J., Wang, X., Ni, L. M.-S., & Guo, J. (2025) · Frontiers of Information Technology & Electronic Engineering · doi:10.1631/fitee.2500280 · Cited by 1
A REVIEW ON ROLE OF AI IN DAMAGE ASSESSMENT INLAMINATED COMPOSITE STRUCTURES
Singh, A. P., Asgar, M. E., Ranjan, R., Kaushik, Y., Reji, J. K., Tyagi, T., & HMRITM (2023) · International Journal of Engineering Applied Sciences and Technology · doi:10.33564/ijeast.2023.v08i02.034 · Cited by 1
A Deep Reinforcement Learning Approach to Automated Stock Trading, using xLSTM Networks
Sarlakifar, F., Asl, M. M., Khaledi, S. R., & Salimi-Badr, A. (2025) · arXiv · doi:10.48550/arxiv.2503.09655 · Cited by 5
“In this study, the trading process is formulated as a partially observable Markov decision process (POMDP) to account for the noisy nature of financial data [4].”
An Improved Reinforcement Learning Model Based on Sentiment Analysis
Li, Y., Salam, Z. A., Xiong, H., & Zhou, P. (2025) · International Journal of Academic Research in Business and Social Sciences · doi:10.6007/ijarbss/v15-i4/25162
On CVaR-Based Reinforcement Learning in Quantitative InvestmentPreprint
Alameer, A., & Alshehri, K. A. (2022) · doi:10.36227/techrxiv.19961525
Research on Model Decision-making Method Based on ARIMA and LSTM Sequence Analysis
Zong, Y., Huang, Y., & Yang, H. (2022) · International Conference on Data Analytics, Computing and Artificial Intelligence (ICDACAI) · doi:10.1109/icdacai57211.2022.00008
A-share Trading Strategy Based on MTL-DDPG
Deng, W., Chen, J., Li, Z., Wang, W., & Cai, Z. (2023) · doi:10.1145/3638584.3638600
The Composite Multi-Level Prediction Model for Stock Market Time Series
Chang, Z., & Zhang, Z. (2024) · Frontiers in artificial intelligence and applications · doi:10.3233/faia240150
Enabling An Informed Contextual Multi-Armed Bandit Framework For Stock Trading With Neuroevolution
Kar, D., Lyu, Z., Ororbia, A. G., Desell, T., & Krutz, D. E. (2024) · Genetic and Evolutionary Computation Conference Companion (GECCO Companion) · doi:10.1145/3638530.3664145
Wang, G., & Guo, G. (2024) · IEEE Data Driven Control and Learning Systems Conference (DDCLS) · doi:10.1109/ddcls61622.2024.10606876
Leveraging Heterogeneous Text Data for Reinforcement Learning-Based Stock Trading Strategies
Fukuda, K., & Ma, Q. (2024) · Lecture notes in computer science · doi:10.1007/978-3-031-68309-1_2
Felizardo, L. K. (2024) · Digital Library of Theses and Dissertations (Universidade de São Paulo) · doi:10.11606/t.3.2024.tde-26082024-093343
An investigation for recent reinforcement learning implementation on quantitative trading
Shing, L. K., & Miao, Z. (2024) · AIP conference proceedings · doi:10.1063/5.0223683
Robot See, Robot Do: Imitation Reward for Noisy Financial Environments
Goluža, S., Kovačević, T., Begušić, S., & Kostanjčar, Z. (2024) · IEEE International Conference on Big Data (BigData) · doi:10.1109/bigdata62323.2024.10825427
Reinforcement Learning for Industrial Control: From Toolkit Development to Practical Applications
Duan, J., Wang, W., Lyu, Y., Zhang, X., Song, X., Xiao, L., & Li, S. E. (2025) · Elsevier eBooks · doi:10.1016/b978-0-443-14081-5.00026-x
Jayakody, I. H., Bandara, M., & Bandaranayake, A. U. (2025) · Communications in computer and information science · doi:10.1007/978-3-031-89813-6_9
Comparative Analysis of Reinforcement Learning Algorithms for Decision Making in Algorithmic Trading
Mody, U., Mehta, M., Mody, U., Shah, S., Patel, D., & Kelkar, K. (2025) · Lecture notes in networks and systems · doi:10.1007/978-981-96-2179-8_31
FinD 3 : A Dual 3D State Space Model with Dynamic Hypergraph for Financial Stock Prediction
Mei, J., Tian, J., Xu, R., Wei, H., Guo, C., & Yang, B. (2025) · ACM International Conference on Information and Knowledge Management (CIKM) · doi:10.1145/3746252.3761239
Robust dual-path spatio-temporal graph neural networks for stock price prediction
Zhang, X., Zhou, H., Zhang, L., Yang, X., & Liu, Z. (2026) · Pattern Recognition · doi:10.1016/j.patcog.2026.114780
BED-RL: Bagging-Based Encoder–Decoder Reinforcement Learning for Dynamic Portfolio Management
Zhang, Z. (2026) · IEEE Access · doi:10.1109/access.2025.3623226
Wang, C.-A., Huang, S.-H., Chen, C.-T., & Fang, Y.-T. (2026) · Decision Support Systems · doi:10.1016/j.dss.2026.114624
Se, W., Li, Z., & Wu, G. (2025) · International Conference on Big Data and Information Analytics (BigDIA) · doi:10.1109/bigdia68682.2025.11382737
Model-based versus model-free reinforcement learning in quantitative asset management
Saltiel, D. (2022) · theses.fr (ABES) · doi:10.70675/6baf1f83z39c0z4252z8227z5fa57024ebe9
The Future of AI-Banking in the Kingdom of Bahrain
Jumaan, F., & Samuel, E. (2026) · Studies in systems, decision and control · doi:10.1007/978-3-032-04378-8_52
Gu, J., Du, W., Zhao, X., Rahman, A. M. M., & Wang, G. (2026) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2026.3701681
Mukherjee, T., & Sarkar, A. (2026) · International Journal of Innovations in Science Engineering and Management. · doi:10.69968/ijisem.2026v5i3260-276
ADM-QT: An Accelerated Diffusion Model for Quantitative Trading via Multiscale SDE Simulation
Liu, X., Chen, J., & Pan, J. (2026) · IEEE Access · doi:10.1109/access.2026.3738270
Metadata
- Authors
- Liu, Y., Liu, Q., Zhao, H., Pan, Z., & Liu, C.
- Affiliations
- University of Science and Technology of China (CN)
- Tianjin University (CN)
- University of Tennessee at Knoxville (US)
- Venue
- Proceedings of the AAAI Conference on Artificial Intelligence
- Published
- 2020-04-03
- Volume
- 34
- Issue
- 02
- Pages
- 2128-2135
- ISSN
- 2159-5399 (ISSN-L)
- 2374-3468
- OpenAlex
- W2997874851
- Cited by
- 141
- References
- 33
- Citations by year
- 2026: 10 · 2025: 21 · 2024: 39 · 2023: 26 · 2022: 25 · 2021: 19 · 2020: 1
- FWCI
- 24.10
- Type
- conference paper
- Language
- en
- Open access
- diamond
- doi.org
- Licence
- www.aaai.org/ (unspecified)
- Locations
- Proceedings of the AAAI Conference on Artificial Intelligence (publishedVersion)
- AAAI Publications (The Association for the Advancement of Artificial Intelligence (AAAI)) (submittedVersion)
- Funders
- National Natural Science Foundation of China (61922073, 71790594, U1605251, 61672483)
- Youth Innovation Promotion Association
- Topics
- Social Sciences › Decision Sciences › Management Science and Operations Research › Stock Market Forecasting Methods
- Social Sciences › Economics, Econometrics and Finance › Finance › Financial Markets and Investment Strategies
- Social Sciences › Business, Management and Accounting › Management Information Systems › FinTech, Crowdfunding, Digital Finance
- Keywords
- quantitative trading, deep reinforcement learning, imitation learning, partially observable Markov decision processes, exploration-exploitation balance, high-frequency financial data
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
