Deep reinforcement learning for automated stock trading: an ensemble strategy
The DOI matches its Crossref record, with a small difference in title or year; 47 of the 47 references it cites were found in a registry or an index.
Abstract
Stock trading strategies play a critical role in investment. However, it is challenging to design a profitable strategy in a complex and dynamic stock market. In this paper, we propose an ensemble strategy that employs deep reinforcement schemes to learn a stock trading strategy by maximizing investment return. We train a deep reinforcement learning agent and obtain an ensemble trading strategy using three actor-critic based algorithms: Proximal Policy Optimization (PPO), Advantage Actor Critic (A2C), and Deep Deterministic Policy Gradient (DDPG). The ensemble strategy inherits and integrates the best features of the three algorithms, thereby robustly adjusting to different market situations. In order to avoid the large memory consumption in training networks with continuous action space, we employ a load-on-demand technique for processing very large data. We test our algorithms on the 30 Dow Jones stocks that have adequate liquidity. The performance of the trading agent with different reinforcement learning algorithms is evaluated and compared with both the Dow Jones Industrial Average index and the traditional min-variance portfolio allocation strategy. The proposed deep ensemble strategy is shown to outperform the three individual algorithms and two baselines in terms of the risk-adjusted return measured by the Sharpe ratio.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Deep reinforcement learning (DRL), that balances exploration (of uncharted territory) and exploitation (of current knowledge), is a promising approach to automate trading in quantitative finance [50][51][47][54][21][13].”
From FinRL: Deep Reinforcement Learning Framework to Automate Trading in Quantitative Finance (2021) · cites this paper as [51]
In the citing paper
“Therefore, the backtesting performance demonstrates that FinRL successfully reproduces the ensemble strategy [51].”
From FinRL: Deep Reinforcement Learning Framework to Automate Trading in Quantitative Finance (2021) · cites this paper as [51]
In the citing paper
“The ensemble strategy [51] combines three DRL algorithms (PPO [42], A2C [32] and DDPG [26]) to improve the robustness.”
From FinRL: Deep Reinforcement Learning Framework to Automate Trading in Quantitative Finance (2021) · cites this paper as [51]
In the citing paper
“Explainable DRL for portfolio management [17] and DRL ensemble strategy for stock trading [50, 51] are also implemented.”
From FinRL: Deep Reinforcement Learning Framework to Automate Trading in Quantitative Finance (2021) · cites this paper as [51]
In the citing paper
“The performance in terms of multiple metrics is consistent with the results reported in [51] and [50], and here we show results in a recent trading period.”
From FinRL: Deep Reinforcement Learning Framework to Automate Trading in Quantitative Finance (2021) · cites this paper as [51]
7 more claims about this paper
Create a free account to see every claim other papers make about this one.
Citations
Cites
Reinforcement Learning: An Introduction
(2005) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.2004.842673 · Cited by 24,496
Continuous control with deep reinforcement learning
Lillicrap, T. P., Hunt, J. J., Pritzel, A., Heess, N., Erez, T., Tassa, Y., Silver, D., & Wierstra, D. (2015) · arXiv · doi:10.48550/arxiv.1509.02971 · Cited by 10,782 · cited 12×
“DDPG performs similar but not as good as PPO, it can be used as a complementary strategy to PPO in a bullish market.”
InfluentialProximal Policy Optimization Algorithms
Schulman, J., Wolski, F., Dhariwal, P., Radford, A., & Klimov, O. (2017) · arXiv · doi:10.48550/arxiv.1707.06347 · Cited by 10,625 · cited 3×
“The three actor-critic algorithms [24] are Proximal Policy Optimization (PPO) [28, 37], Advantage Actor Critic (A2C) [32, 48], and Deep Deterministic Policy Gradient (DDPG) [28, 29, 44].”
BackgroundMethod(1995) · Cited by 10,558
Asynchronous Methods for Deep Reinforcement Learning
Mnih, V., Badia, A. P., Mirza, M., Graves, A., Lillicrap, T. P., Harley, T., Silver, D., & Kavukcuoglu, K. (2016) · arXiv · doi:10.48550/arxiv.1602.01783 · Cited by 7,132 · cited 2×
“A2C [32] is a typical actor-critic algorithm and we use it a component in the ensemble strategy.”
BackgroundMethodMarkowitz, H. (1952) · The Journal of Finance · doi:10.1111/j.1540-6261.1952.tb01525.x · Cited by 5,641
(1999) · Cited by 5,147
Sharpe, W. F. (1994) · The Journal of Portfolio Management · doi:10.3905/jpm.1994.409501 · Cited by 2,534
Konda, V. R., & Tsitsiklis, J. N. (2002) · Cited by 2,202
International Journal of Economics and Financial Issues
(2021) · International Journal of Economics and Financial Issues · doi:10.32479/ijefi · Cited by 2,008
Research works printed but not linked: 4
- Zhipeng Liang , Kangkang Jiang , Hao Chen , Junhao Zhu , and Yanran Li. 2018. Adversarial deep reinforcement learning in portfolio management. arXiv: Portfolio Management ( 2018 ). Zhipeng Liang, Kangkang Jiang, Hao Chen, Junhao Zhu, and Yanran Li. 2018. Adversarial deep reinforcement learning in portfolio management. arXiv: Portfolio Management (2018).
- John Schulman , Sergey Levine , Philipp Moritz , Michael Jordan , and Pieter Abbeel . 2015 . Trust region policy optimization . In The 31st International Conference on Machine Learning. John Schulman, Sergey Levine, Philipp Moritz, Michael Jordan, and Pieter Abbeel. 2015. Trust region policy optimization. In The 31st International Conference on Machine Learning.
- 10.5555/551283 · doi:10.5555/551283
- Zihao Zhang . 2019. Deep reinforcement learning for trading. ArXiv 2019 (11 2019 ). Zihao Zhang. 2019. Deep reinforcement learning for trading. ArXiv 2019 (11 2019).
Cited by
Ensemble deep learning: A review
Ganaie, M. A., Hu, M., Malik, A. K., Tanveer, M., & Suganthan, P. N. (2022) · Engineering Applications of Artificial Intelligence · doi:10.1016/j.engappai.2022.105151 · Cited by 2,143
“2020 Deep reinforcement learning for automated stock trading: An ensemble strategy[171] Reinforcement learning Stock trading agency”
MethodDeep deterministic policy gradient algorithm: A systematic review
Sumiea, E. H., Abdulkadir, S. J., Alhussian, H. S., Al-Selwi, S. M., Alqushaibi, A., Ragab, M. G., & Fati, S. M. (2024) · Heliyon · doi:10.1016/j.heliyon.2024.e30697 · Cited by 229
Sahu, S. K., Mokhade, A., & Bokde, N. D. (2023) · Applied Sciences · doi:10.3390/app13031956 · Cited by 208
Lim, T. (2024) · Artificial Intelligence Review · doi:10.1007/s10462-024-10708-3 · Cited by 172
FinRL: A Deep Reinforcement Learning Library for Automated Stock Trading in Quantitative Finance
Liu, X.-Y. (2020) · SSRN Electronic Journal · doi:10.2139/ssrn.3737257 · Cited by 90
Self-citationZou, J., Lou, J., Wang, B., & Liu, S. (2024) · Expert Systems with Applications · doi:10.1016/j.eswa.2023.122801 · Cited by 89
Liu, X.-Y., Yang, H., Gao, J., & Wang, C. D. (2021) · Proceedings of the Second ACM International Conference on AI in Finance · doi:10.1145/3490354.3494366 · Cited by 87
“Explainable DRL for portfolio management [17] and DRL ensemble strategy for stock trading [50, 51] are also implemented.”
BackgroundMethodResultInfluentialSelf-citationStock Market Prediction Using Deep Reinforcement Learning
Awad, A. L., Elkaffas, S. M., & Fakhr, M. W. (2023) · Applied System Innovation · doi:10.3390/asi6060106 · Cited by 74
Ensemble reinforcement learning: A survey
Song, Y., Suganthan, P. N., Witold Pedrycz, C., Ou, J., He, Y., Chen, Y., & Wu, Y. (2023) · Applied Soft Computing · doi:10.1016/j.asoc.2023.110975 · Cited by 88
FNSPID: A Comprehensive Financial News Dataset in Time Series
Dong, Z., Xinyu, F., & Peng, Z. (2024) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/3637528.3671629 · Cited by 117
A novel deep reinforcement learning framework with BiLSTM-Attention networks for algorithmic trading
Huang, Y., Wan, X., Zhang, L., & Lu, X. (2023) · Expert Systems with Applications · doi:10.1016/j.eswa.2023.122581 · Cited by 70
FinRL: A Deep Reinforcement Learning Library for Automated Stock Trading in Quantitative Finance
Liu, X.-Y., Yang, H., Chen, Q., Zhang, R., Yang, L., Xiao, B., & Wang, C. (2025) · doi:10.2139/ssrn.3737859 · Cited by 53
Self-citationA Deep Reinforcement Learning-Based Decision Support System for Automated Stock Market Trading
Ansari, Y., Yasmin, S., Naz, S., Zaffar, H., Ali, Z., Moon, J., & Rho, S. (2022) · IEEE Access · doi:10.1109/access.2022.3226629 · Cited by 69
“strategy of a reinforcement learning algorithm for stock market trading [50].”
BackgroundDynamic datasets and market environments for financial reinforcement learning
Liu, X.-Y., Xia, Z., Yang, H., Gao, J., Zha, D., Zhu, M., Wang, C. D., Wang, Z., & Guo, J. (2024) · Machine Learning · doi:10.1007/s10994-023-06511-w · Cited by 70
“…have already applied various DRL algorithms in financial applications, including investigating market fragility (Raberto et al., 2001), designing profitable strategies (Liu et al., 2018; Yang et al., 2020; Zhang et al., 2020), and assessing portfolio risk (Lussange et al., 2021; Bao & Liu, 2019).”
InfluentialSelf-citationFinRL: Deep Reinforcement Learning Framework to Automate Trading in Quantitative Finance
Liu, X.-Y., Yang, H., Gao, J., & Wang, C. (2021) · doi:10.2139/ssrn.3955949 · Cited by 46
Self-citationApplying Artificial Intelligence in Cryptocurrency Markets: A Survey
Amirzadeh, R., Nazari, A., & Thiruvady, D. (2022) · Algorithms · doi:10.3390/a15110428 · Cited by 72
“It is hence a considerable challenge to discover all influencing factors and extract intelligent trading rules from the dynamic financial markets environment [65,66].”
BackgroundShaikh, T. A., Rasool, T., Verma, P., & Mir, W. A. (2024) · Annals of Operations Research · doi:10.1007/s10479-024-06444-0 · Cited by 72
MCI-GRU: Stock prediction model based on multi-head cross-attention and improved GRU
Zhu, P. F., Li, Y., Hu, Y., Xiang, S., Liu, Q., Cheng, D., & Liang, Y. (2025) · Neurocomputing · doi:10.1016/j.neucom.2025.130168 · Cited by 52
Deep Reinforcement Learning Model for Stock Portfolio Management Based on Data Fusion
Li, H., Wu, R., & Hai, M. (2024) · Neural Processing Letters · doi:10.1007/s11063-024-11582-4 · Cited by 40
Algorithmic trading using continuous action space deep reinforcement learning
Majidi, N., Shamsi, M., & Marvasti, F. (2023) · Expert Systems with Applications · doi:10.1016/j.eswa.2023.121245 · Cited by 42
Security and Privacy Issues in Deep Reinforcement Learning: Threats and Countermeasures
Mo, K., Ye, P.-G., Ren, X., Wang, S., Li, W., & Li, J. (2024) · ACM Computing Surveys · doi:10.1145/3640312 · Cited by 45
QADQN: Quantum Attention Deep Q-Network for Financial Market Prediction
Dutta, S., Innan, N., Marchisio, A., Yahia, S. B., & Shafique, M. (2024) · IEEE International Conference on Quantum Computing and Engineering (QCE) · doi:10.1109/qce60285.2024.10303 · Cited by 53
“Financial statement data, alongside information extracted from business news, can be integrated with advanced ML algorithms to generate investment signals or predict a company’s future performance [5].”
FinRL-podracer: high performance and scalable deep reinforcement learning for quantitative finance
Li, Z., Liu, X.-Y., Zheng, J., Wang, Z., Walid, A., & Guo, J. (2021) · Proceedings of the Second ACM International Conference on AI in Finance · doi:10.1145/3490354.3494413 · Cited by 28
“Our setup follows a similar setting in [26, 44].”
MethodSelf-citationDeep Reinforcement Learning in Quantitative Algorithmic Trading: A ReviewPreprint
Pricope, T.-V. (2021) · RePEc: Research Papers in Economics · doi:10.48550/arxiv.2106.00123 · Cited by 104
“Deep Reinforcement Learning for Automated Stock Trading: An Ensemble Strategy [58].”
Deep Reinforcement Learning for Active High Frequency TradingPreprint
Briola, A., Turiel, J., Marcaccioli, R., Cauderan, A., & Aste, T. (2021) · RePEc: Research Papers in Economics · doi:10.48550/arxiv.2101.07107 · Cited by 76
“Other works focused on a variety of tasks such as multi-asset allocation [38]–[40] or portfolio management in general [41].”
BackgroundResilient multi-agent RL: introducing DQ-RTS for distributed environments with data loss
Canese, L., Cardarilli, G. C., Nunzio, L. D., Fazzolari, R., Re, M., & Spanò, S. (2024) · Scientific Reports · doi:10.1038/s41598-023-48767-1 · Cited by 27
FinMem: A Performance-Enhanced LLM Trading Agent With Layered Memory and Character Design
Yu, Y., Li, H., Chen, Z., Jiang, Y., Li, Y., Suchow, J. W., Zhang, D., & Khashanah, K. (2025) · IEEE Transactions on Big Data · doi:10.1109/tbdata.2025.3593370 · Cited by 23
“Experiments show that F IN M EM evolves its knowledge base from past trades and ongoing market interactions, maintaining robustness in complex environments.”
BackgroundNeural network-based blended ensemble learning for speech emotion recognition
Yalamanchili, B., Kumar, S. S., & Anne, K. R. (2022) · Multidimensional Systems and Signal Processing · doi:10.1007/s11045-022-00845-9 · Cited by 24
“…like medical diagnosis (Ozcift & Gulten, 2011), bioinformatics (Cao et al., 2020), fraud detection (Randhawa et al., 2018), stock trading (Yang et al., 2020), and speech recognition (Deng and Platt, 2014), etc. Schuller et al. (2005) have implemented stacking ensemble classification using…”
Empirical Analysis of Automated Stock Trading Using Deep Reinforcement Learning
Kong, M., & So, J. (2023) · Applied Sciences · doi:10.3390/app13010633 · Cited by 28
Park, J.-H., Kim, J., & Huh, J. (2024) · IEEE Access · doi:10.1109/access.2024.3361035 · Cited by 28
Synthetic Data Augmentation for Deep Reinforcement Learning in Financial Trading
Liu, C., Ventre, C., & Polukarov, M. (2022) · ACM International Conference on AI in Finance (ICAIF) · doi:10.1145/3533271.3561704 · Cited by 26
“Due to the inherent stochastic nature of dynamic financial markets, asset prices are everchanging and difficult to predict [30].”
BackgroundDeep reinforcement learning for dynamic strategy interchange in financial markets
Zhong, X., Wei, J., Li, S., & Xu, Q. (2024) · Applied Intelligence · doi:10.1007/s10489-024-05965-2 · Cited by 15
A Novel Anti-Risk Method for Portfolio Trading Using Deep Reinforcement Learning
Han, Y., Liu, J., Tian, D., & Zhang, Q. (2022) · Electronics · doi:10.3390/electronics11091506 · Cited by 19
Multi-Agent Deep Reinforcement Learning With Progressive Negative Reward for Cryptocurrency Trading
Kumlungmak, K., & Vateekul, P. (2023) · IEEE Access · doi:10.1109/access.2023.3289844 · Cited by 18
“[25] observed a turbulence index instead of CVIX for their stock trading.”
BackgroundZhou, C., Huang, Y., Kong, Y., & Lu, X. (2025) · Expert Systems with Applications · doi:10.1016/j.eswa.2025.128297 · Cited by 15
Deep Reinforcement Learning Ensemble for Detecting Anomaly in Telemetry Water Level Data
Khampuengson, T., & Wang, W. (2022) · Water · doi:10.3390/w14162492 · Cited by 11
“The ensemble approach that utilises DRL schemes to maximise investment in stock trading was developed in [21].”
MethodPortfolio construction using explainable reinforcement learning
Cortés, D. G., Onieva, E., Pastor-López, I., Trinchera, L., & Wu, J. L. (2024) · Expert Systems · doi:10.1111/exsy.13667 · Cited by 16
Han, Y., Liu, J., & Zhang, Q. (2022) · Systems · doi:10.3390/systems10050146 · Cited by 15
Smart Robotic Strategies and Advice for Stock Trading Using Deep Transformer Reinforcement Learning
Malibari, N., Katib, I. A., & Mehmood, R. (2022) · Applied Sciences · doi:10.3390/app122412526 · Cited by 12
Interpretable trading pattern designed for machine learning applications
Sokolovsky, A., Arnaboldi, L., Bacardit, J., & Groß, T. (2023) · Machine Learning with Applications · doi:10.1016/j.mlwa.2023.100448 · Cited by 17
High-Dimensional Stock Portfolio Trading with Deep Reinforcement Learning
Pigorsch, U., & Schäfer, S. (2022) · IEEE Conference on Computational Intelligence for Financial Engineering & Economics · doi:10.1109/cifer52523.2022.9776121 · Cited by 23
Supervised actor-critic reinforcement learning with action feedback for algorithmic trading
Sun, Q., & Si, Y. (2022) · Applied Intelligence · doi:10.1007/s10489-022-04322-5 · Cited by 12
Deep reinforcement learning portfolio model based on mixture of experts
Wei, Z., Chen, D., Zhang, Y., Wen, D., Nie, X., & Xie, L. (2025) · Applied Intelligence · doi:10.1007/s10489-025-06242-6 · Cited by 14
Automated Cryptocurrency Trading Bot Implementing DRL
Peng, A., Ang, S. L., & Lim, C. Y. (2022) · Pertanika journal of science & technology · doi:10.47836/pjst.30.4.22 · Cited by 14
“Hence, the stability provided by the characteristics of the actor-critic framework makes it a great model for the financial trading environment (Yang, 2020).”
BackgroundPankwaen, K., Thongkairat, S., & Saijai, W. (2025) · Mathematics · doi:10.3390/math13081317 · Cited by 13
Deep reinforcement learning with positional context for intraday trading
Goluža, S., Kovačević, T., Bauman, T., & Kostanjčar, Z. (2024) · Evolving Systems · doi:10.1007/s12530-024-09593-6 · Cited by 9
“A study conducted in (Liu et al. 2020) proposes the imi-tative recurrent deterministic policy gradient model which combines imitation learning (Goluža et al. 2023) with a deterministic policy gradient, and operates on a 15-min-ute frequency.”
Achieving Mean–Variance Efficiency by Continuous-Time Reinforcement Learning
Huang, Y., Jia, Y., & Zhou, X. (2022) · ACM International Conference on AI in Finance (ICAIF) · doi:10.1145/3533271.3561760 · Cited by 12
“More recently, deep neural networks are introduced to incorporate high-dimensional stock-level features to learn policies for trading and hedging [4, 16, 19, 41, 43, 43].”
BackgroundMulti-step reward ensemble methods for adaptive stock trading
Zeng, Z., Ma, C., & Chang, X. (2023) · Expert Systems with Applications · doi:10.1016/j.eswa.2023.120547 · Cited by 9
R-DDQN: Optimizing Algorithmic Trading Strategies Using a Reward Network in a Double DQN
Zhou, C., Huang, Y., Cui, K., & Lu, X. (2024) · Mathematics · doi:10.3390/math12111621 · Cited by 10
A Deep Reinforcement Learning Approach for Portfolio Management in Non‐Short‐Selling Market
Su, R., Chi, C., Tu, S., & Xu, L. (2024) · IET Signal Processing · doi:10.1049/2024/5399392 · Cited by 8
Gu, F., Jiang, Z., García‐Fernández, Á. F., Stefanidis, A., Su, J., & Li, H. (2025) · Communications in computer and information science · doi:10.1007/978-981-95-4094-5_27 · Cited by 8
Dynamic Portfolio Optimization via Augmented DDPG with Quantum Price Levels-Based Trading Strategy
Lin, R., Xing, Z., Ma, M., & Lee, R. S. T. (2023) · IEEE International Joint Conference on Neural Network · doi:10.1109/ijcnn54540.2023.10191785 · Cited by 6
“Based on the basic DRL algorithms, [12] proposed an integrated strategy that integrates PPO, A2C, and DDPG to dynamically select models for portfolio allocation based on the performance of their Sharpe ratios.”
MethodGu, J., Du, W., Rahman, A. M. M. M., & Wang, G. (2023) · International Conference on AI in Finance · doi:10.1145/3604237.3626906 · Cited by 12
“In contrast to conventional investment strategies, DRL-based approaches have demonstrated considerable potential in adapting to dynamic market conditions and attaining superior returns [12, 25, 33, 36].”
ResultAn asset subset-constrained minimax optimization framework for online portfolio selection
Yin, J., Zhong, A., Xiao, X., Wang, R., & Huang, J. Z. (2024) · Expert Systems with Applications · doi:10.1016/j.eswa.2024.124299 · Cited by 8
Objective Driven Portfolio Construction Using Reinforcement Learning
Wang, T. R., Pradeep, J., & Chen, J. Z. (2022) · ACM International Conference on AI in Finance (ICAIF) · doi:10.1145/3533271.3561764 · Cited by 7
“Recent advances in computing power have enabled the seamless integration of deep learning and RL for practical solutions, which expands the universe of solvable multi-period decision-making problems [29, 30].”
BackgroundLearning to Manipulate a Financial Benchmark
Shearer, M., Rauterberg, G. V., & Wellman, M. P. (2023) · ACM International Conference on AI in Finance (ICAIF) · doi:10.1145/3604237.3626847 · Cited by 14
“Most employ DRL with a discrete or continuous observation space and discrete action space [10, 20, 27– 29, 36, 45, 49], but some recent work considers continuous observation and action spaces [22, 30, 45, 46, 48].”
MethodA Deep Reinforcement Learning Model for Portfolio Management based on Weight Adjustment
Wang, J., Hai, M., & Li, H. (2024) · Procedia Computer Science · doi:10.1016/j.procs.2024.08.174 · Cited by 14
Belyakov, B., & Sizykh, D. (2024) · IEEE Access · doi:10.1109/access.2024.3515039 · Cited by 11
Christodoulaki, E., Kampouridis, M., & Kyropoulou, M. (2025) · Knowledge-Based Systems · doi:10.1016/j.knosys.2025.113054 · Cited by 8
Artificial intelligence methods for financial market prediction: A systematic review
Noormohammadzadehmaleki, D., Abbaskhani, S., Farhadi, A., & Zamanifar, A. (2026) · Computers & Electrical Engineering · doi:10.1016/j.compeleceng.2026.111110 · Cited by 17
Reinforcement Learning Review: Past Acts, Present Facts and Future Prospects
Kommey, B., Isaac, O. J., Tamakloe, E., & Opoku, D. (2024) · IT JOURNAL RESEARCH AND DEVELOPMENT · doi:10.25299/itjrd.2023.13474 · Cited by 10
Deep Reinforcement Learning for Automated Stock Trading: Inclusion of Short Selling
Asodekar, E., Nookala, A., Ayre, S., & Nimkar, A. V. (2022) · Lecture notes in computer science · doi:10.1007/978-3-031-16564-1_18 · Cited by 8
Enhancement of power quality in three-phase GC solar photovoltaics
Singh, S., & Rai, J. N. (2024) · Electrical Engineering · doi:10.1007/s00202-024-02304-z · Cited by 6
Dynamic Reinforced Ensemble using Bayesian Optimization for Stock Trading
Orra, A., Bhambu, A., Choudhary, H., & Thakur, M. (2024) · ACM International Conference on AI in Finance (ICAIF) · doi:10.1145/3677052.3698595 · Cited by 7
“Yang et al. [38] proposed an ensemble approach that retrains three DRL agents, namely, Ad-vantage Actor-Critic (A2C) [21], DDPG, and PPO for a window of three months, and then select the best agent stemming from the Sharpe ratio to trade for the following quarter.”
A Futures Quantitative Trading Strategy Based on a Deep Reinforcement Learning Algorithm
Chen, X., & Guo, H. (2023) · IEEE International Conference on Big Data Analytics (ICBDA) · doi:10.1109/icbda57405.2023.10104902 · Cited by 6
“The trading strategy is made by the agent, and the state, action, and return are defined below [13] .”
BackgroundDay Ahead Load Forecasting using Random Forest method with meteorological variables
Vaish, J., Siddiqui, K. M., Maheshwari, Z., Kumar, A., & Shrivastava, S. (2023) · IEEE Conference on Technologies for Sustainability · doi:10.1109/sustech57309.2023.10129542 · Cited by 6
“By eliminating variation in each process, it combines several algorithms to enhance predictions [10]-[11].”
MethodVision-Based DRL Autonomous Driving Agent with Sim2Real Transfer
Li, D., & Okhrin, O. (2023) · IEEE International Conference on Intelligent Transportation Systems (ITSC) · doi:10.1109/itsc57777.2023.10422677 · Cited by 7
“In recent years, DRL has garnered significant attention from researchers as a powerful method to solve complex con-trol problems across various fields, including Robotics [1]– [4], Game playing [5]–[9], Finance [10], [11], and Natural language processing [12], [13].”
MethodLussange, J., Vrizzi, S., Palminteri, S., & Gutkin, B. S. (2024) · PLoS ONE · doi:10.1371/journal.pone.0301141 · Cited by 10
Orra, A., Choudhary, H., Sharma, A., & Thakur, M. (2025) · Knowledge and Information Systems · doi:10.1007/s10115-025-02562-8 · Cited by 10
“Other DRL algorithms that have been widely employed in the literature to design automated financial trading frameworks are Advantage Actor-Critic (A2C) [23, 31], DDPG [24, 32], and Proximal Policy Optimization (PPO) [25, 31].”
A Hybrid SVR-Based Framework for Cryptocurrency Price Forecasting and Strategy Backtesting
Wang, S.-W., & Huang, C.-Y. (2026) · Applied Artificial Intelligence · doi:10.1080/08839514.2026.2612793 · Cited by 5
Crowd Panic Behavior Simulation Using Multi-Agent Modeling
Dumitrescu, C. M., Radu, V., Gheorghe, R., Tăbîrcă, A. I., Ștefan, M. C., & Manea, L. (2024) · Electronics · doi:10.3390/electronics13183622 · Cited by 8
Nguyen, H.-T. N., Mac, B.-N. N., Tran, A.-D., Nguyen, N.-T., & Pham, D.-T. (2022) · RIVF International Conference on Computing and Communication Technologies (RIVF) · doi:10.1109/rivf55975.2022.10013836 · Cited by 5
Analysis of Frequent Trading Effects of Various Machine Learning Models
Chen, J., Li, X., & Du, J. (2024) · Computational Economics · doi:10.1007/s10614-024-10611-7 · Cited by 5
“And, high-frequency trading (HFT) has become increasingly popular in the financial market, with traders using algorithms to execute orders at high speeds and frequencies[11, 12].”
Risk Sensitive Distributional Soft Actor Critic for Portfolio Management
Liu, J., Wang, Y., Huang, S., & Sun, D. D. (2024) · IEEE International Conference on Big Data Analytics (ICBDA) · doi:10.1109/icbda61153.2024.10607182 · Cited by 4
Application-Aware Real-Time Network Resource Allocation for Industry 5.0
Sardar, A. A., Rao, A. S., Alpcan, T., Das, G., Routray, P. K., Manivannan, M., & Palaniswami, M. S. (2024) · IEEE Transactions on Cognitive Communications and Networking · doi:10.1109/tccn.2024.3504474 · Cited by 4
CNN- DRL with Shuffled Features in Finance
Montazeri, S., Mirzaeinia, A., & Mirzaeinia, A. (2023) · International Conference on Computational Science and Computational Intelligence (CSCI) · doi:10.1109/csci62032.2023.00055 · Cited by 4
Trading Strategy of the Cryptocurrency Market Based on Deep Q-Learning Agents
Huang, C. S. J., & Su, Y.-S. (2024) · Applied Artificial Intelligence · doi:10.1080/08839514.2024.2381165 · Cited by 8
“Yang et al. (2020) also proposed a trading algorithm that uses the PPO method to generate buy or sell orders, and their results showed that the PPO method outperforms other algorithms in stock trading.”
Huang, Z., Duan, J., Zhang, C., & Gong, W. (2025) · Expert Systems with Applications · doi:10.1016/j.eswa.2025.126822 · Cited by 4
Yang, M., Hu, Y., & Wang, J. (2024) · International Conference on Identification, Information and Knowledge in the Internet of Things (IIKI) · doi:10.1109/iiki65561.2024.00036 · Cited by 4
“[7] developed an ensemble strategy combining PPO, A2C, and DDPG algorithms to select the optimal trading agent for maximizing the Sharpe ratio.”
Kumar, D., & Kumar, A. (2025) · Energy Systems · doi:10.1007/s12667-025-00729-4 · Cited by 4
Deep Reinforcement Learning for Bitcoin Trading
Akraoui, B. E., & Daoui, C. (2022) · Lecture notes in business information processing · doi:10.1007/978-3-031-06458-6_7 · Cited by 7
Link-Adaptation for Improved Quality-of-Service in V2V Communication using Reinforcement Learning
Banerjee, S., Bose, J., Puthepurakel, S. P., Uppuluri, P. K., Bandyopadhyay, S., Reddy, Y. S. K., & Ranjani, H. G. (2022) · International Conference on AI-ML Systems (AIMLSystems) · doi:10.1145/3564121.3564122 · Cited by 4
“• CQI information is unreliable: The current V2V communication solutions [3-6] estimate the CSI using CQI, which is inconsistent and not always correct [4, 13-15] because of the inherent stochasticity of the channel, which varies non-linearly with factors such as load, interference, fading, mobility, etc.”
Kumar, R. P., Venkatraman, K., Bandaru, S. C., Gorantla, S., Swathi, G., Katragadda, H., & Mandadi, A. R. (2023) · International Conference on Recent Trends in Advance Computing (ICRTAC) · doi:10.1109/icrtac59277.2023.10480823 · Cited by 8
“The paper[8] employed an ensemble strategy that combines three deep reinforcement learning algorithms (PPO, Actor Critic, DDPG) to create a stock trading strategy that out-performed individual algorithms and traditional investment strategies when tested on Dow Jones stocks.”
MethodA Deep Reinforcement Learning Framework for Strategic Indian NIFTY 50 Index Trading
Mishra, R. G., Sharma, D., Gadhavi, M. Y., Pant, S., & Kumar, A. (2025) · AI · doi:10.3390/ai6080183 · Cited by 5
AutoRL X: Automated Reinforcement Learning on the Web
Franke, L., Weidele, D. K. I., Dehmamy, N., Ning, L., & Haehn, D. (2024) · ACM Transactions on Interactive Intelligent Systems · doi:10.1145/3670692 · Cited by 5
Large Language Model for Dynamic Strategy Interchange in Financial Markets
Zhong, X., Zhao, Z., Yan, B., & Xu, Q. (2024) · International Conference on Cloud Computing and Big Data Analytics (ICCCBDA) · doi:10.1109/icccbda61447.2024.10569928 · Cited by 3
Deep Reinforcement Learning for Financial Forecasting in Static and Streaming Cases
Ram, A. A., Yadav, S., Vivek, Y., & Ravi, V. (2024) · Journal of Information & Knowledge Management · doi:10.1142/s0219649224500801 · Cited by 3
Reinforcement Learning in Algorithmic Trading: An Overview
Czuba, P. (2024) · Communications in computer and information science · doi:10.1007/978-3-031-62843-6_8 · Cited by 3
Algorithmic Trading: Financial Markets Using Artificial Intelligence
Chanda, S., Chib, S., Bose, S. S., R, L. S., Zabiullah, B. I., & Samal, A. (2024) · International Conference on Communication, Computer Sciences and Engineering (IC3SE) · doi:10.1109/ic3se62002.2024.10593357 · Cited by 3
“In order to optimize investment return in stock trading, this [17] suggest an ensemble technique utilizing deep reinforcement schemes.”
MethodAn Ensemble Method of Deep Reinforcement Learning for Automated Cryptocurrency Trading
Wang, S., & Klabjan, D. (2024) · IEEE International Conference on Blockchain and Cryptocurrency (ICBC) · doi:10.1109/icbc59979.2024.10634436 · Cited by 8
“[33] design an ensemble method that combines models trained by three DRL algorithms to find optimal trading strategies, which incurs high computational cost of training multiple models.”
BackgroundMethodShahsafi, S., & Naderkhani, F. (2024) · International Conference on Information Fusion (FUSION) · doi:10.23919/fusion59988.2024.10706354 · Cited by 3
Hong, Z. (2025) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2024.3524882 · Cited by 4
“…have proposed hierarchical domain adaption upon ensemble control theory, thus finding the optimum under the worst disturbances [42] by constructing multiple components of systematic uncertainties, such as maximum Q-learning [43], ensemble policy [44], [45], [46], and generative environment [47].”
Lower Risks, Better Choices: Stock Correlation Based Portfolio Selection in Stock Markets
Luo, D., Liao, W., & Yan, R. (2023) · International World Wide Web Conference (WWW) · doi:10.1145/3543873.3587298 · Cited by 3
Deep Reinforcement Learning for Stock Trading with Behavioral Finance Strategy
Deng, S., Zheng, Z., He, H., & Shao, J. (2023) · Lecture notes in computer science · doi:10.1007/978-3-031-46664-9_36 · Cited by 5
Forecasting Digital Asset Return: An Application of Machine Learning Model
Ciciretti, V., Pallotta, A., Lodh, S., Senyo, P. K., & Nandy, M. (2024) · International Journal of Finance & Economics · doi:10.1002/ijfe.3062 · Cited by 4
FinRL Contests: Data‐Driven Financial Reinforcement Learning Agents for Stock and Crypto Trading
Wang, K., Holzer, N., Xia, Z., Cao, Y., Gao, J., Walid, A., Xiao, K., & Yanglet, X.-Y. L. (2025) · Artificial Intelligence for Engineering · doi:10.1049/aie2.12004 · Cited by 12
Self-citationA Novel Deep Reinforcement Learning-based Automatic Stock Trading Method and a Case Study
He, Y., Yang, Y., Yihe, L., & Sun, P. (2022) · IEEE Global Emerging Technology Blockchain Forum: Blockchain & Beyond (iGETblockchain) · doi:10.1109/igetblockchain56591.2022.10087066 · Cited by 8
Exploring Leading Practices in Algorithmic Trading
Singh, P. (2025) · Advances in finance, accounting, and economics book series · doi:10.4018/979-8-3693-8186-1.ch006 · Cited by 2
Veisi, M., Berangi, S., Khojasteh, M. S., & Salimi-Badr, A. (2024) · International Conference on Computer and Knowledge Engineering · doi:10.1109/iccke65377.2024.10874515 · Cited by 2
Hybrids of Reinforcement Learning and Evolutionary Computation in Finance: A Survey
Yadav, S., Ravi, V., & Kalyanakrishnan, S. (2025) · ACM Computing Surveys · doi:10.1145/3728634 · Cited by 4
Metadata
- Authors
- Yang, H., Liu, X.-Y., Zhong, S., & Walid, A.
- Affiliations
- Columbia University (US)
- Wormpex AI Research
- Nokia-Bell Labs
- Venue
- Proceedings of the First ACM International Conference on AI in Finance
- Publisher
- ACM
- Published
- 2020-10-15
- Pages
- 1-8
- OpenAlex
- W3203680104
- Cited by
- 196
- References
- 47
- Citations by year
- 2026: 38 · 2025: 40 · 2024: 51 · 2023: 32 · 2022: 24 · 2021: 10 · 2020: 1
- FWCI
- 22.74
- Type
- conference paper
- Language
- en
- Open access
- closed
- Locations
- ACM International Conference on AI in Finance (ICAIF) (publishedVersion)
- Topics
- Social Sciences › Decision Sciences › Management Science and Operations Research › Stock Market Forecasting Methods
- Social Sciences › Economics, Econometrics and Finance › Finance › Financial Markets and Investment Strategies
- Social Sciences › Economics, Econometrics and Finance › Finance › Stochastic processes and financial applications
- Keywords
- automated stock trading, deep reinforcement learning, actor-critic algorithms, proximal policy optimization, Advantage Actor-Critic, deep deterministic policy gradient, continuous action spaces, Sharpe ratio
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.