The DOI matches its Crossref record, with a small difference in title or year; 47 of the 47 references it cites were found in a registry or an index.
Deep reinforcement learning for automated stock trading: an ensemble strategy
Abstract
Stock trading strategies play a critical role in investment. However, it is challenging to design a profitable strategy in a complex and dynamic stock market. In this paper, we propose an ensemble strategy that employs deep reinforcement schemes to learn a stock trading strategy by maximizing investment return. We train a deep reinforcement learning agent and obtain an ensemble trading strategy using three actor-critic based algorithms: Proximal Policy Optimization (PPO), Advantage Actor Critic (A2C), and Deep Deterministic Policy Gradient (DDPG). The ensemble strategy inherits and integrates the best features of the three algorithms, thereby robustly adjusting to different market situations. In order to avoid the large memory consumption in training networks with continuous action space, we employ a load-on-demand technique for processing very large data. We test our algorithms on the 30 Dow Jones stocks that have adequate liquidity. The performance of the trading agent with different reinforcement learning algorithms is evaluated and compared with both the Dow Jones Industrial Average index and the traditional min-variance portfolio allocation strategy. The proposed deep ensemble strategy is shown to outperform the three individual algorithms and two baselines in terms of the risk-adjusted return measured by the Sharpe ratio.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Deep reinforcement learning (DRL), that balances exploration (of uncharted territory) and exploitation (of current knowledge), is a promising approach to automate trading in quantitative finance [50][51][47][54][21][13].”
From FinRL: Deep Reinforcement Learning Framework to Automate Trading in Quantitative Finance (2021) · cites this paper as [51]
In the citing paper
“Therefore, the backtesting performance demonstrates that FinRL successfully reproduces the ensemble strategy [51].”
From FinRL: Deep Reinforcement Learning Framework to Automate Trading in Quantitative Finance (2021) · cites this paper as [51]
In the citing paper
“The ensemble strategy [51] combines three DRL algorithms (PPO [42], A2C [32] and DDPG [26]) to improve the robustness.”
From FinRL: Deep Reinforcement Learning Framework to Automate Trading in Quantitative Finance (2021) · cites this paper as [51]
In the citing paper
“Explainable DRL for portfolio management [17] and DRL ensemble strategy for stock trading [50, 51] are also implemented.”
From FinRL: Deep Reinforcement Learning Framework to Automate Trading in Quantitative Finance (2021) · cites this paper as [51]
In the citing paper
“The performance in terms of multiple metrics is consistent with the results reported in [51] and [50], and here we show results in a recent trading period.”
From FinRL: Deep Reinforcement Learning Framework to Automate Trading in Quantitative Finance (2021) · cites this paper as [51]
7 more claims about this paper
Create a free account to see every claim other papers make about this one.
Citations
Cites
Reinforcement Learning: An Introduction
(2005) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.2004.842673 · Cited by 24,496
Continuous control with deep reinforcement learning
Lillicrap, T. P., Hunt, J. J., Pritzel, A., Heess, N., Erez, T., Tassa, Y., Silver, D., & Wierstra, D. (2015) · arXiv · doi:10.48550/arxiv.1509.02971 · Cited by 10,782 · cited 12×
“DDPG performs similar but not as good as PPO, it can be used as a complementary strategy to PPO in a bullish market.”
InfluentialProximal Policy Optimization Algorithms
Schulman, J., Wolski, F., Dhariwal, P., Radford, A., & Klimov, O. (2017) · arXiv · doi:10.48550/arxiv.1707.06347 · Cited by 10,625 · cited 3×
“The three actor-critic algorithms [24] are Proximal Policy Optimization (PPO) [28, 37], Advantage Actor Critic (A2C) [32, 48], and Deep Deterministic Policy Gradient (DDPG) [28, 29, 44].”
BackgroundMethod(1995) · Cited by 10,558
Asynchronous Methods for Deep Reinforcement Learning
Mnih, V., Badia, A. P., Mirza, M., Graves, A., Lillicrap, T. P., Harley, T., Silver, D., & Kavukcuoglu, K. (2016) · arXiv · doi:10.48550/arxiv.1602.01783 · Cited by 7,132 · cited 2×
“A2C [32] is a typical actor-critic algorithm and we use it a component in the ensemble strategy.”
BackgroundMethodMarkowitz, H. (1952) · The Journal of Finance · doi:10.1111/j.1540-6261.1952.tb01525.x · Cited by 5,641
(1999) · Cited by 5,147
Sharpe, W. F. (1994) · The Journal of Portfolio Management · doi:10.3905/jpm.1994.409501 · Cited by 2,534
Konda, V. R., & Tsitsiklis, J. N. (2002) · Cited by 2,202
International Journal of Economics and Financial Issues
(2021) · International Journal of Economics and Financial Issues · doi:10.32479/ijefi · Cited by 2,008
Research works printed but not linked: 4
- Zhipeng Liang , Kangkang Jiang , Hao Chen , Junhao Zhu , and Yanran Li. 2018. Adversarial deep reinforcement learning in portfolio management. arXiv: Portfolio Management ( 2018 ). Zhipeng Liang, Kangkang Jiang, Hao Chen, Junhao Zhu, and Yanran Li. 2018. Adversarial deep reinforcement learning in portfolio management. arXiv: Portfolio Management (2018).
- John Schulman , Sergey Levine , Philipp Moritz , Michael Jordan , and Pieter Abbeel . 2015 . Trust region policy optimization . In The 31st International Conference on Machine Learning. John Schulman, Sergey Levine, Philipp Moritz, Michael Jordan, and Pieter Abbeel. 2015. Trust region policy optimization. In The 31st International Conference on Machine Learning.
- 10.5555/551283 · doi:10.5555/551283
- Zihao Zhang . 2019. Deep reinforcement learning for trading. ArXiv 2019 (11 2019 ). Zihao Zhang. 2019. Deep reinforcement learning for trading. ArXiv 2019 (11 2019).
Cited by
Ensemble deep learning: A review
Ganaie, M. A., Hu, M., Malik, A. K., Tanveer, M., & Suganthan, P. N. (2022) · Engineering Applications of Artificial Intelligence · doi:10.1016/j.engappai.2022.105151 · Cited by 2,143
“2020 Deep reinforcement learning for automated stock trading: An ensemble strategy[171] Reinforcement learning Stock trading agency”
MethodDeep deterministic policy gradient algorithm: A systematic review
Sumiea, E. H., Abdulkadir, S. J., Alhussian, H. S., Al-Selwi, S. M., Alqushaibi, A., Ragab, M. G., & Fati, S. M. (2024) · Heliyon · doi:10.1016/j.heliyon.2024.e30697 · Cited by 229
Sahu, S. K., Mokhade, A., & Bokde, N. D. (2023) · Applied Sciences · doi:10.3390/app13031956 · Cited by 208
Lim, T. (2024) · Artificial Intelligence Review · doi:10.1007/s10462-024-10708-3 · Cited by 172
FinRL: A Deep Reinforcement Learning Library for Automated Stock Trading in Quantitative Finance
Liu, X.-Y. (2020) · SSRN Electronic Journal · doi:10.2139/ssrn.3737257 · Cited by 90
Self-citation
Metadata
- Authors
- Yang, H., Liu, X.-Y., Zhong, S., & Walid, A.
- Affiliations
- Columbia University (US)
- Wormpex AI Research
- Nokia-Bell Labs
- Venue
- Proceedings of the First ACM International Conference on AI in Finance
- Publisher
- ACM
- Published
- 2020-10-15
- Pages
- 1-8
- OpenAlex
- W3203680104
- Cited by
- 196
- References
- 47
- Citations by year
- 2026: 38 · 2025: 40 · 2024: 51 · 2023: 32 · 2022: 24 · 2021: 10 · 2020: 1
- FWCI
- 22.74
- Type
- conference paper
- Language
- en
- Open access
- closed
- Locations
- ACM International Conference on AI in Finance (ICAIF) (publishedVersion)
- Topics
- Social Sciences › Decision Sciences › Management Science and Operations Research › Stock Market Forecasting Methods
- Social Sciences › Economics, Econometrics and Finance › Finance › Financial Markets and Investment Strategies
- Social Sciences › Economics, Econometrics and Finance › Finance › Stochastic processes and financial applications
- Keywords
- automated stock trading, deep reinforcement learning, actor-critic algorithms, proximal policy optimization, Advantage Actor-Critic, deep deterministic policy gradient, continuous action spaces, Sharpe ratio
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Deep reinforcement learning for automated stock trading: an ensemble strategy. https://app.cochat.ai/papers/10.1145/3383455.3422540
- The paper
- Yang, H., Liu, X.-Y., Zhong, S., & Walid, A. (2020). Deep reinforcement learning for automated stock trading: an ensemble strategy. Proceedings of the First ACM International Conference on AI in Finance. https://doi.org/10.1145/3383455.3422540
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.