A General Framework on Enhancing Portfolio Management with Reinforcement Learning
Open accessAbstract
Portfolio management is the art and science in fiance that concerns continuous reallocation of funds and assets across financial instruments to meet the desired returns to risk profile. Deep reinforcement learning (RL) has gained increasing interest in portfolio management, where RL agents are trained base on financial data to optimize the asset reallocation process. Though there are prior efforts in trying to combine RL and portfolio management, previous works did not consider practical aspects such as transaction costs or short selling restrictions, limiting their applicability. To address these limitations, we propose a general RL framework for asset management that enables continuous asset weights, short selling and making decisions with relevant features. We compare the performance of three different RL algorithms: Policy Gradient with Actor-Critic (PGAC), Proximal Policy Optimization (PPO), and Evolution Strategies (ES) and demonstrate their advantages in a simulated environment with transaction costs. Our work aims to provide more options for utilizing RL frameworks in real-life asset management scenarios and can benefit further research in financial applications.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Reinforcement Learning algorithms are increasingly popular in quantitative trading.
“Furthermore, Reinforcement Learning algorithm are increasingly popular in quantitative trading [25].”
From Large Language Model Agent in Financial Trading: A Survey (2026) · cites this paper as [25]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
No references could be resolved yet.
Research works printed but not linked: 15
- Yue Deng, Feng Bao, Youyong Kong, Zhiquan Ren, and Qionghai Dai. 2017. Deep Direct Reinforcement Learning for Financial Signal Representation and Trading. IEEE Transactions on Neural Networks and Learning Systems 28 (2017), 653-664.
- YiFeng Guo, XingYu Fu, Yuyan Shi, and MingWen Liu. 2018. Robust Log-Optimal Strategy with Reinforcement Learning. arXiv: Portfolio Management (2018).
- Zhengyao Jiang, Dixing Xu, and Jinjun Liang. 2017. A Deep Reinforcement Learning Framework for the Financial Portfolio Management Problem. https://doi.org/10.48550/ARXIV.1706.10059 · DOI · Paper page
- Bin Li and Steven C. H. Hoi. 2012. Online Portfolio Selection: A Survey. https://doi.org/10.48550/ARXIV.1212.2129 · DOI
- Volodymyr Mnih, Adrià Puigdomènech Badia, Mehdi Mirza, Alex Graves, Timothy P. Lillicrap, Tim Harley, David Silver, and Koray Kavukcuoglu. 2016. Asynchronous Methods for Deep Reinforcement Learning. CoRR abs/1602.01783 (2016). arXiv:1602.01783 http://arxiv.org/abs/1602.01783 · arXiv
- Ahmet Murat Ozbayoglu, Mehmet Ugur Gudelek, and Omer Berat Sezer. 2020. Deep Learning for Financial Applications : A Survey. https://doi.org/10.48550/ARXIV.2002.05786 · DOI
- I. Rechenberg. 1978. Evolutionsstrategien. In Simulationsmethoden in der Medizin und Biologie, Berthold Schneider and Ulrich Ranft (Eds.). Springer Berlin Heidelberg, Berlin, Heidelberg, 83-114.
- Tim Salimans, Jonathan Ho, Xi Chen, Szymon Sidor, and Ilya Sutskever. 2017. Evolution Strategies as a Scalable Alternative to Reinforcement Learning. https://doi.org/10.48550/ARXIV.1703.03864 · DOI · Paper page
- John Schulman, Sergey Levine, Philipp Moritz, Michael I. Jordan, and Pieter Abbeel. 2015. Trust Region Policy Optimization. https: //doi.org/10.48550/ARXIV.1502.05477 · DOI · Paper page
- John Schulman, Filip Wolski, Prafulla Dhariwal, Alec Radford, and Oleg Klimov. 2017. Proximal Policy Optimization Algorithms. https://doi.org/10.48550/ARXIV.1707.06347 · DOI · Paper page
- William F. Sharpe. 1994. The Sharpe Ratio. The Journal of Portfolio Management 21, 1 (1994), 49-58. https://doi.org/10.3905/jpm.1994. 409501 arXiv:https://jpm.pm-research.com/content/21/1/49.full.pdf · DOI
- Charalampos Stasinakis and Georgios Sermpinis. 2014. Financial Forecasting and Trading Strategies: A Survey. 22-39. https://doi.org/10. 4324/9780203084984 · DOI
- Alan L. Stuart and Harry M. Markowitz. 1959. Portfolio Selection: Efficient Diversification of Investments. A Quarterly Journal of Operations Research 10 (1959), 253.
- Richard S Sutton, David McAllester, Satinder Singh, and Yishay Mansour. 1999. Policy Gradient Methods for Reinforcement Learning with Function Approximation. In Advances in Neural Information Processing Systems, S. Solla, T. Leen, and K. Müller (Eds.), Vol. 12. MIT Press. https://proceedings.neurips.cc/paper/1999/file/464d828b85b0bed98e80ade0a5c43b0f-Paper.pdf
- Junfeng Wen, Saurabh Kumar, Ramki Gummadi, and Dale Schuurmans. 2021. Characterizing the Gap Between Actor-Critic and Policy Gradient. In International Conference on Machine Learning.
Cited by
Sorted by citations
Large Language Model Agent in Financial Trading: A Survey
Ding, H., Li, Y., Wang, J., Chen, H., Guo, D., & Zhang, Y. (2026) · Proceedings of the 2026 9th International Conference on Computers in Management and Business · doi:10.1145/3802463.3802475 · Cited by 10 · see citing works
Self-citation
- Authors
- Li, Y., Wang, J., & Cao, Y.
- Affiliations
- Columbia University (US)
- Venue
- arXiv
- Publisher
- arXiv
- Published
- 2019
- Pages
- 119-125
- arXiv
- 1911.11880
- OpenAlex
- W4396702006
- Cited by
- 3
- References
- 0
- Citations by year
- 2025: 2 · 2021: 1
- FWCI
- 1.36
- Type
- conference paper
- Language
- en
- Open access
- bronze
- doi.org
- Locations
- International Conference on Computers in Management and Business (ICCMB) (publishedVersion)
- RePEc: Research Papers in Economics (submittedVersion)
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- Topics
- Social Sciences › Decision Sciences › Management Science and Operations Research › Stock Market Forecasting Methods
- Social Sciences › Decision Sciences › Management Science and Operations Research › Risk and Portfolio Optimization
- Social Sciences › Economics, Econometrics and Finance › Finance › Financial Markets and Investment Strategies
- Keywords
- portfolio management, deep reinforcement learning, asset allocation, transaction costs, short selling, proximal policy optimization, evolution strategies
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
