CoChat

Deep reinforcement learning for automated stock trading: an ensemble strategy

Yang, Hongyang, Liu, Xiao-Yang, Zhong, Shan, Walid, Anwar · 2020 · Proceedings of the First ACM International Conference on AI in Finance

The DOI matches its Crossref record, with a small difference in title or year; 47 of the 47 references it cites were found in a registry or an index.

Abstract

Stock trading strategies play a critical role in investment. However, it is challenging to design a profitable strategy in a complex and dynamic stock market. In this paper, we propose an ensemble strategy that employs deep reinforcement schemes to learn a stock trading strategy by maximizing investment return. We train a deep reinforcement learning agent and obtain an ensemble trading strategy using three actor-critic based algorithms: Proximal Policy Optimization (PPO), Advantage Actor Critic (A2C), and Deep Deterministic Policy Gradient (DDPG). The ensemble strategy inherits and integrates the best features of the three algorithms, thereby robustly adjusting to different market situations. In order to avoid the large memory consumption in training networks with continuous action space, we employ a load-on-demand technique for processing very large data. We test our algorithms on the 30 Dow Jones stocks that have adequate liquidity. The performance of the trading agent with different reinforcement learning algorithms is evaluated and compared with both the Dow Jones Industrial Average index and the traditional min-variance portfolio allocation strategy. The proposed deep ensemble strategy is shown to outperform the three individual algorithms and two baselines in terms of the risk-adjusted return measured by the Sharpe ratio.

Overview

Integrity signals

Registry

Crossref · 10.1145/3383455.3422540

Cites

47 of 47 references verified0 citation errors · 0 not checkable

Statistics

Recomputing p-values needs the paper’s full text.

Verification

Claims the paper makes

This paper’s full text isn’t openly available, so its claims and self-check weren’t run. The registry and citation checks still apply.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

7 more claims about this paper

Create a free account to see every claim other papers make about this one.

See all claims — free account

Citations

Cites

Research works printed but not linked: 4

  1. Zhipeng Liang , Kangkang Jiang , Hao Chen , Junhao Zhu , and Yanran Li. 2018. Adversarial deep reinforcement learning in portfolio management. arXiv: Portfolio Management ( 2018 ). Zhipeng Liang, Kangkang Jiang, Hao Chen, Junhao Zhu, and Yanran Li. 2018. Adversarial deep reinforcement learning in portfolio management. arXiv: Portfolio Management (2018).
  2. John Schulman , Sergey Levine , Philipp Moritz , Michael Jordan , and Pieter Abbeel . 2015 . Trust region policy optimization . In The 31st International Conference on Machine Learning. John Schulman, Sergey Levine, Philipp Moritz, Michael Jordan, and Pieter Abbeel. 2015. Trust region policy optimization. In The 31st International Conference on Machine Learning.
  3. 10.5555/551283 · doi:10.5555/551283
  4. Zihao Zhang . 2019. Deep reinforcement learning for trading. ArXiv 2019 (11 2019 ). Zihao Zhang. 2019. Deep reinforcement learning for trading. ArXiv 2019 (11 2019).

Cited by

See all 198

Metadata

Authors
Yang, H., Liu, X.-Y., Zhong, S., & Walid, A.
Affiliations
  • Columbia University (US)
  • Wormpex AI Research
  • Nokia-Bell Labs
Venue
Proceedings of the First ACM International Conference on AI in Finance
Publisher
ACM
Published
2020-10-15
Pages
1-8
OpenAlex
W3203680104
Cited by
196
References
47
Citations by year
2026: 38 · 2025: 40 · 2024: 51 · 2023: 32 · 2022: 24 · 2021: 10 · 2020: 1
FWCI
22.74
Type
conference paper
Language
en
Open access
closed
Locations
ACM International Conference on AI in Finance (ICAIF) (publishedVersion)
Topics
  • Social Sciences › Decision Sciences › Management Science and Operations Research › Stock Market Forecasting Methods
  • Social Sciences › Economics, Econometrics and Finance › Finance › Financial Markets and Investment Strategies
  • Social Sciences › Economics, Econometrics and Finance › Finance › Stochastic processes and financial applications
Keywords
automated stock trading, deep reinforcement learning, actor-critic algorithms, proximal policy optimization, Advantage Actor-Critic, deep deterministic policy gradient, continuous action spaces, Sharpe ratio

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.