The DOI matches its Crossref record; 51 of the 54 references it cites were found in a registry or an index; 1 of the 14 sources its claims cite were checked for support.
FinRL: A Deep Reinforcement Learning Library for Automated Stock Trading in Quantitative Finance
Open accessOverview
CoChat Summary
## TL;DR
FinRL is presented as an open-source, three-layer deep reinforcement learning library for automated stock trading, aimed at making quantitative finance workflows beginner-friendly, reproducible, and extensible. The paper demonstrates the library on three use cases and reports that several DRL strategies outperform benchmark indices or traditional allocation strategies on its test examples.
## Key findings
- FinRL organizes automated stock trading into a three-layer architecture: market environment, DRL agent, and trading applications, with modular components and reserved user-import interfaces.
- The library provides six standard trading environments based on representative listings: NASDAQ-100, DJIA, S&P 500, SSE 50, CSI 300, and HSI, plus one user-defined environment.
- In the single-stock example using PPO over 2019/01/01–2020/09/23, final portfolio values ranged from 127,044 to 192,031 versus 133,402 for the S&P 500; annualized returns ranged from 14.89% to 44.94% versus 17.81% for the S&P 500, and Sharpe ratios ranged from 1.10 to 1.49 versus 0.74 for the S&P 500.
- In the multiple-stock / portfolio-allocation example over DJIA constituents, TD3 and DDPG achieved Sharpe ratios above the DJIA and min-variance baseline: TD3 1.38 and 1.03, DDPG 1.28 and 0.98, versus 0.48 for DJIA and 0.44 for min-variance.
## Methods
- The paper introduces FinRL as a three-layer library: an environment layer built on OpenAI Gym time-driven trading simulators, an agent layer with fine-tuned DRL algorithms, and an application layer with trading use cases.
- The environment models stock trading as a Markov Decision Process and supports state variables such as balance, shares held, prices, volume, and technical indicators; actions include sell/hold/buy and can be defined over multiple shares.
- Evaluation follows a training-validation-testing flow, uses automated backtesting with Quantopian pyfolio, and reports standard metrics including final portfolio value, annualized return, annualized standard deviation, maximum drawdown, and Sharpe ratio.
## Limitations
- The paper does not report a formal experimental design with statistical significance testing, confidence intervals, or repeated-run variability for the reported performance numbers.
- It is not stated in the paper whether the reported case-study results generalize beyond the shown datasets, exchanges, time period, or chosen algorithms.
- Evident from the text: the paper is primarily a library/system description and demonstration paper, so the evaluation is limited to illustrative use cases rather than a comprehensive head-to-head benchmark across all methods and markets.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
1 Valid · 5 Not valid · 4 Not checked · 17 Own results and interpretations
A result the paper states — it cites no source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“FinRL uses five conventional strategies, namely passive buy-and-hold trading strategy [32], mean-variance strategy [1], and min-variance strategy [1], momentum trading strategy [15], and equal-weighted strategy”
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper states — it cites no source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“we demonstrate easily reproducible profitable strategies under different scenarios using FinRL”
boostedstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper states — it cites no source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“FinRL is an open source library specifically designed and implemented for quantitative finance.”
- Also stated in: § Abstract As deep reinforcement learning (DRL) has been recognized as an effective approach in quantitative finance, getting hands-on experiences is attractive to beginners. However, to train a practical DRL trading agent that decides where to trade, at what price, and what quantity involves error-prone and arduous development and debugging. In this paper, we introduce a DRL library FinRL that facilitates beginners to expose themselves to quantitative finance and to develop their own stock trading strategies. Along with easily-reproducible tutorials, FinRL library allows users to streamline their own developments and to compare with existing schemes easily. Within FinRL, virtual environments are configured with stock market datasets, trading agents are trained with neural networks, and extensive backtesting is analyzed via trading performance. Moreover, it incorporates important trading constraints such as transaction cost, market liquidity and the investor's degree of risk-aversion. FinRL is featured with completeness, hands-on tutorial and reproducibility that favors beginners: (i) at multiple levels of time granularity, FinRL simulates trading environments across various stock markets, including NASDAQ-100, DJIA, S&P 500, HSI, SSE 50, and CSI 300; (ii) organized in a layered architecture with modular structure, FinRL provides fine-tuned state-of-theart DRL algorithms (DQN, DDPG, PPO, SAC, A2C, TD3, etc.), commonly-used reward functions and standard evaluation baselines to alleviate the debugging workloads and promote the reproducibility, and (iii) being highly extendable, FinRL reserves a complete set of user-import interfaces. Furthermore, we incorporated three application demonstrations, namely single stock trading, multiple stock trading, and portfolio allocation. The FinRL library will be available on Github at link https://github.com/AI4Finance-LLC/FinRL-Library. · plain
“In this paper, we introduce a DRL library FinRL that facilitates beginners to expose themselves to quantitative finance and to develop their own stock trading strategies.”
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Rests on 2 assumptions not shown here.
- Also stated in: § Abstract As deep reinforcement learning (DRL) has been recognized as an effective approach in quantitative finance, getting hands-on experiences is attractive to beginners. However, to train a practical DRL trading agent that decides where to trade, at what price, and what quantity involves error-prone and arduous development and debugging. In this paper, we introduce a DRL library FinRL that facilitates beginners to expose themselves to quantitative finance and to develop their own stock trading strategies. Along with easily-reproducible tutorials, FinRL library allows users to streamline their own developments and to compare with existing schemes easily. Within FinRL, virtual environments are configured with stock market datasets, trading agents are trained with neural networks, and extensive backtesting is analyzed via trading performance. Moreover, it incorporates important trading constraints such as transaction cost, market liquidity and the investor's degree of risk-aversion. FinRL is featured with completeness, hands-on tutorial and reproducibility that favors beginners: (i) at multiple levels of time granularity, FinRL simulates trading environments across various stock markets, including NASDAQ-100, DJIA, S&P 500, HSI, SSE 50, and CSI 300; (ii) organized in a layered architecture with modular structure, FinRL provides fine-tuned state-of-theart DRL algorithms (DQN, DDPG, PPO, SAC, A2C, TD3, etc.), commonly-used reward functions and standard evaluation baselines to alleviate the debugging workloads and promote the reproducibility, and (iii) being highly extendable, FinRL reserves a complete set of user-import interfaces. Furthermore, we incorporated three application demonstrations, namely single stock trading, multiple stock trading, and portfolio allocation. The FinRL library will be available on Github at link https://github.com/AI4Finance-LLC/FinRL-Library. · plain
In the paper
“To control the risk in a worst-case scenario, such as financial crisis of 2007-2008, FinRL employs the financial turbulence index turbulence t that measures extreme asset price fluctuation [25]:”
What the sources say
- Not checked — no full text of the sourcecites [25] Mark Kritzman, 2010, Skulls, financial turbulence, and risk management, Financial Analysts Journal source
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper states — it cites no source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Moreover, it incorporates important trading constraints such as transaction cost, market liquidity and the investor's degree of risk-aversion.”
- Also stated in: § 3.1 Architecture of the FinRL Library · plain
“We build a trading simulator that replicates live stock market and provides backtesting support that incorporates important market frictions such as transaction cost, market liquidity and the investor's degree of risk-aversion.”
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Rests on 3 assumptions not shown here.
- Also stated in: § 3.1 Architecture of the FinRL Library · plain
3 more claims
Create a free account to see all 27 claims and to verify the 1 reference still open.
- It may state two separate claims as one. 10
- Probably not a substantial claim. 14
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
Each contradiction between two passages listed here was confirmed by an independent check.
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
§ 5 Conclusions
“As a walk-through tutorial in Jupyter notebook format, we demonstrate easily reproducible profitable strategies under different scenarios using FinRL: (i) single stock trading; (ii) multiple stock trading; (iii) incorporating the mechanism of stock information penetration.”
§ 1 Introduction
“The top layer includes applications in automated stock trading, where we demonstrate three use cases, namely single stock trading, multiple stock trading and portfolio allocation.”
Citations
Cites
Human-level control through deep reinforcement learning
Mnih, V., Kavukcuoglu, K., Silver, D., Rusu, A. A., Veness, J., Bellemare, M. G., Graves, A., Riedmiller, M., Fidjeland, A. K., Ostrovski, G., et al. (2015) · Nature · doi:10.1038/nature14236 · Cited by 30,357
Reinforcement Learning: An Introduction
Sutton, R. S., & Barto, A. G. (1998) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.1998.712192 · Cited by 27,225
Reinforcement Learning: An Introduction
(2005) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.2004.842673 · Cited by 24,496
Mastering the game of Go with deep neural networks and tree search
Silver, D., Huang, A., Maddison, C. J., Guez, A., Sifre, L., van den Driessche, G., Schrittwieser, J., Antonoglou, I., Panneershelvam, V., Lanctot, M., et al. (2016) · Nature · doi:10.1038/nature16961 · Cited by 15,612
Continuous control with deep reinforcement learning
Lillicrap, T. P., Hunt, J. J., Pritzel, A., Heess, N., Erez, T., Tassa, Y., Silver, D., & Wierstra, D. (2015) · arXiv · doi:10.48550/arxiv.1509.02971 · Cited by 10,782
Proximal Policy Optimization Algorithms
Schulman, J., Wolski, F., Dhariwal, P., Radford, A., & Klimov, O. (2017) · arXiv · doi:10.48550/arxiv.1707.06347 · Cited by 10,625
Asynchronous Methods for Deep Reinforcement Learning
Mnih, V., Badia, A. P., Mirza, M., Graves, A., Lillicrap, T. P., Harley, T., Silver, D., & Kavukcuoglu, K. (2016) · arXiv · doi:10.48550/arxiv.1602.01783 · Cited by 7,132
Soft actor-critic Off-policy maximum entropy deep reinforcement learning with a stochastic actor
Haarnoja, T., Zhou, A., Abbeel, P., & Levine, S. (2018) · arXiv · doi:10.48550/arxiv.1801.01290 · Cited by 5,594
“Options, Futures, and Other Derivatives”
(2016) · AMBER – ABBS Management Business and Entrepreneurship Review · doi:10.23874/amber/2016/v7/i1/121351 · Cited by 5,007
Multi-Agent Actor-Critic for Mixed Cooperative-Competitive Environments
Lowe, R., Wu, Y., Tamar, A., Harb, J., Abbeel, P., & Mordatch, I. (2017) · arXiv · doi:10.48550/arxiv.1706.02275 · Cited by 3,377
Research works printed but not linked: 6
- G Thomas, 2018, Reinforcement learning in financial markets -a survey. Fau discussion papers in economics
- Olivier Jin, 2016, Portfolio management using reinforcement learning
- Ryan Lowe, 2017, Multi-agent actorcritic for mixed cooperative-competitive environments, Advances in Neural Information Processing Systems, 6379
- David G Luenberger, 1997, Investment science
- Pg Nechchi, 2016, Reinforcement learning for automated trading, Mathematical EngineeringPolitecnico di Milano
- Quantopian, 2019, A toolkit for portfolio and risk analytics in python
Cited by
A survey on model-based reinforcement learning
Luo, F.-M., Xu, T., Lai, H., Chen, X., Zhang, W., & Yu, Y. (2024) · Science China Information Sciences · doi:10.1007/s11432-022-3696-5 · Cited by 259
A Multimodal Foundation Agent for Financial Trading: Tool-Augmented, Diversified, and Generalist
Zhang, W., Zhao, L., Xia, H., Sun, S., Sun, J., Qin, M., Li, X., Zhao, Y., Zhao, Y., Cai, X., et al. (2024) · Proceedings of the 30th ACM SIGKDD Conference on Knowledge Discovery and Data Mining · doi:10.1145/3637528.3671801 · Cited by 74
Dynamic datasets and market environments for financial reinforcement learning
Liu, X.-Y., Xia, Z., Yang, H., Gao, J., Zha, D., Zhu, M., Wang, C. D., Wang, Z., & Guo, J. (2024) · Machine Learning · doi:10.1007/s10994-023-06511-w · Cited by 70
Self-citationDynamic stock-decision ensemble strategy based on deep reinforcement learning
Yu, X., Wu, W., Liao, X., & Han, Y. (2022) · Applied Intelligence · doi:10.1007/s10489-022-03606-0 · Cited by 42
A Review of Reinforcement Learning in Financial Applications
Bai, Y., Gao, Y., Wan, R., Zhang, S., & Song, R. (2024) · Annual Review of Statistics and Its Application · doi:10.1146/annurev-statistics-112723-034423 · Cited by 59
Rezaei, M., & Nezamabadi–pour, H. (2025) · Artificial Intelligence Review · doi:10.1007/s10462-024-11066-w · Cited by 42
Offline Reinforcement Learning for Automated Stock Trading
Lee, N., & Moon, J. (2023) · IEEE Access · doi:10.1109/access.2023.3324458 · Cited by 23
Explainable post hoc portfolio management financial policy of a Deep Reinforcement Learning agent
Escudero, A. D. L. R., Garrido‐Merchán, E. C., & Vaca, M. C. (2025) · PLoS ONE · doi:10.1371/journal.pone.0315528 · Cited by 27
QuantFactor REINFORCE: Mining Steady Formulaic Alpha Factors With Variance-Bounded REINFORCE
Zhao, J., Zhang, C., Qin, M., & Yang, P. (2025) · IEEE Transactions on Signal Processing · doi:10.1109/tsp.2025.3576781 · Cited by 23
Management of investment portfolios employing reinforcement learning
Santos, G. C., Garruti, D. V. T., Barboza, F., de Souza, K. G., Domingos, J. C., & Veiga, A. C. P. (2023) · PeerJ Computer Science · doi:10.7717/peerj-cs.1695 · Cited by 9
Yu, H., Wang, Z., Wang, L., & Wang, L. (2024) · International Review of Economics & Finance · doi:10.1016/j.iref.2024.103728 · Cited by 12
Parallel Market Environments for FinRL Contests
Wang, K., Xiao, K., & Yanglet, X.-Y. L. (2025) · IEEE International Conference on Big Data Security on Cloud, IEEE International Conference on High Performance and Smart Computing, and IEEE International Conference on Intelligent Data and Security (BigDataSecurity/HPSC/IDS) · doi:10.1109/ids66066.2025.00021 · Cited by 7
Explainable Deep Reinforcement Learning for Portfolio Management: An Empirical ApproachPreprint
Guan, M., & Liu, X. (2022) · SSRN Electronic Journal · doi:10.2139/ssrn.4061958 · Cited by 8
Self-citationEnhancement of power quality in three-phase GC solar photovoltaics
Singh, S., & Rai, J. N. (2024) · Electrical Engineering · doi:10.1007/s00202-024-02304-z · Cited by 6
Deanseekeaw, A., Myint, K. P. Y., Khortsriwong, N., Boonraksa, P., Boonraksa, T., & Marungsri, B. (2024) · International Conference on Power, Energy and Innovations (ICPEI) · doi:10.1109/icpei61831.2024.10749009 · Cited by 6
Orra, A., Choudhary, H., Sharma, A., & Thakur, M. (2025) · Knowledge and Information Systems · doi:10.1007/s10115-025-02562-8 · Cited by 7
Yu, J., & Chang, K. (2025) · International Journal of Financial Studies · doi:10.3390/ijfs13040227 · Cited by 8
Optimal Cost Constrained Adversarial Attacks for Multiple Agent Systems
Lu, Z., Liu, G., Lai, L., & Xu, W. (2024) · Conference on Information Sciences and Systems · doi:10.1109/ciss59072.2024.10480189 · Cited by 5
Deep Reinforcement Learning and Convex Mean-Variance Optimisation for Portfolio ManagementPreprint
Pretorius, R., & van Zyl, T. L. (2022) · arXiv.org · doi:10.36227/techrxiv.19165745.v1 · Cited by 5
Large Language Model for Dynamic Strategy Interchange in Financial Markets
Zhong, X., Zhao, Z., Yan, B., & Xu, Q. (2024) · International Conference on Cloud Computing and Big Data Analytics (ICCCBDA) · doi:10.1109/icccbda61447.2024.10569928 · Cited by 3
Camouflage Adversarial Attacks on Multiple Agent Systems
Lu, Z., Liu, G., Lai, L., & Xu, W. (2024) · IEEE International Symposium on Information Theory (ISIT) · doi:10.1109/isit57864.2024.10619346 · Cited by 4
Wang, Y., Shi, E., Yang, X., et al. (2024) · Energies · doi:10.3390/en17215350 · Cited by 3
Garrido‐Merchán, E. C., Mora-Figueroa-Cruz-Guzmán, S., & Vaca, M. C. (2025) · Intelligent systems in accounting, finance and management/Intelligent systems in accounting, finance & management · doi:10.1002/isaf.70008 · Cited by 5
Deep Reinforcement Learning for Stock Trading with Behavioral Finance Strategy
Deng, S., Zheng, Z., He, H., & Shao, J. (2023) · Lecture notes in computer science · doi:10.1007/978-3-031-46664-9_36 · Cited by 5
ISLAMIC STOCK PORTFOLIO OPTIMIZATION USING DEEP REINFORCEMENT LEARNING
Faturohman, T., & Nugraha, T. (2022) · Journal of Islamic Monetary Economics and Finance · doi:10.21098/jimf.v8i2.1430 · Cited by 12
FinRL Contests: Data‐Driven Financial Reinforcement Learning Agents for Stock and Crypto Trading
Wang, K., Holzer, N., Xia, Z., Cao, Y., Gao, J., Walid, A., Xiao, K., & Yanglet, X.-Y. L. (2025) · Artificial Intelligence for Engineering · doi:10.1049/aie2.12004 · Cited by 12
Bratu, A., & Czibula, G. (2021) · Scientific Programming · doi:10.1155/2021/7877590 · Cited by 5
da Silva, R. F. (2021) · Digital Library of Theses and Dissertations (Universidade de São Paulo) · doi:10.11606/t.3.2021.tde-10082021-160557 · Cited by 3
Stock Market Intraday Trading Using Reinforcement Learning
Pandit, R. A., Nerkar, N. S., Walunj, P. M., Tank, R. K., & Kolhe, S. R. (2023) · Lecture notes in computer science · doi:10.1007/978-3-031-36402-0_35 · Cited by 2
Movassaghpour, S. S., Kargar, M., Bayani, A., Assadzadeh, A., & Khakzadi, A. (2024) · International Symposium on Telecommunications · doi:10.1109/ist64061.2024.10843551 · Cited by 3
Application of Multi-Armed Bandit Algorithm in Quantitative Finance
Chen, C., Liu, X., Ma, Y., et al. (2025) · ITM Web of Conferences · doi:10.1051/itmconf/20257301011 · Cited by 2
Self-citationA risk-aware approach to stock portfolio allocation based on Deep Q-Networks
Fior, J., & Cagliero, L. (2022) · IEEE International Conference on Application of Information and Communication Technologies (AICT) · doi:10.1109/aict55583.2022.10013578 · Cited by 3
Deep Reinforcement Learning and Convex Mean-Variance Optimisation for Portfolio ManagementPreprint
Pretorius, R., & van Zyl, T. L. (2022) · doi:10.36227/techrxiv.19165745 · Cited by 2
Trading Performance of an Improved PPO Algorithm in the Chinese Stock Market
Zhang, T., Ke, Z., Chen, L., Qiao, K., Jia, Y., & Zhang, Z. (2023) · International Conference on Big Data Economy and Information Management (BDEIM) · doi:10.1145/3659211.3659333 · Cited by 2
Enhancing Profit in TAIEX Futures Trading with a PPO-Based Framework
Kung, C.-T., Ali, Q., & Ullah, I. (2025) · International Symposium on Computer, Consumer and Control · doi:10.1109/is3c65361.2025.11131017 · Cited by 1
Toward Reliable Offline Reinforcement Learning via Lyapunov Uncertainty Control
Jiang, K., Li, Y., & Tan, X. (2025) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2025.3616159 · Cited by 1
Contextual reinforcement learning for market making via multi-task self-supervised learning
Wen, P.-Y., Huang, S.-H., Chen, C.-T., & Fang, Y.-T. (2025) · Engineering Applications of Artificial Intelligence · doi:10.1016/j.engappai.2025.113196 · Cited by 1
Automated Trading Framework Using LLM-Driven Features and Deep Reinforcement Learning
Botunac, I., Petković, T., & Bosna, J. (2025) · Big Data and Cognitive Computing · doi:10.3390/bdcc9120317 · Cited by 3
Priyanka, A., & Radhakrishnan, A. (2025) · International Conference on Ubiquitous Computing and Intelligent Information Systems (ICUIS) · doi:10.1109/icuis67429.2025.11377755 · Cited by 1
Khemlichi, F., Khamlichi, Y. I., & Ali, S. E. B. (2026) · Information · doi:10.3390/info17050476 · Cited by 1
Alkhafaji, M. A., Ameer, S. A., Alawadi, A. H., et al. (2023) · International Conference on Engineering Technology and its Applications (IICETA) · doi:10.1109/iiceta57613.2023.10351362 · Cited by 1
Dual Core Portfolio Strategy: A Deep RL & Multi-Agent Portfolio Strategy
Cui, X., Sun, R., Zhou, M., Su, J., Wang, C., & Jiang, Z. (2024) · International Conference on Mathematics and Machine Learning (ICMML) · doi:10.1145/3708360.3708384 · Cited by 1
Portfolio Management: A Deep Distributional RL ApproachPreprint
Aznar, D. P. (2023) · SSRN Electronic Journal · doi:10.2139/ssrn.4522084 · Cited by 1
Zeng, L., Wang, L., Niu, H., Li, J., Zhang, R., Dai, Z., Zhu, D., & Wang, L. (2021) · arXiv (Cornell University)
Showing Your Offline Reinforcement Learning Work: Online Evaluation Budget MattersPreprint
Kurenkov, V., & Kolesnikov, S. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2110.04156 · Cited by 7
Does Catastrophic Forgetting Negatively Affect Financial Predictions?
Zurli, A., Bertugli, A., & Credi, J. (2023) · Lecture notes in computer science · doi:10.1007/978-3-031-25599-1_37
Financial Crisis Prediction using Feature Subset Selection with Quantum Deep Neural Network
Balachander, T., Akhlaq, N., Bansal, R., et al. (2023) · International Conference on Electronics and Renewable Systems (ICEARS) · doi:10.1109/icears56392.2023.10085208
Deep Reinforcement Learning with Comprehensive Reward for Stock Trading
Zhou, Q., Qu, T., Han, Y., et al. (2023) · Communications in computer and information science · doi:10.1007/978-981-99-1648-1_44
Efficient Prediction of Annual Yield from Stocks Using Hybrid Deep Learning
Papanai, A. (2023) · Lecture notes in electrical engineering · doi:10.1007/978-981-99-0085-5_18
Asset Allocation Method Based on Sentiment Signals and Causal Information using Multi-asset Classes
Taguchi, R., Sakaji, H., Izumi, K., & Murayama, Y. (2023) · International Journal of Smart Computing and Artificial Intelligence · doi:10.52731/ijscai.v7.i2.827
Algorithmic trading on financial time series using Deep Reinforcement LearningPreprint
Asghari, A., & Mozayani, N. (2024) · Research Square · doi:10.21203/rs.3.rs-3910354/v1
A-share Trading Strategy Based on MTL-DDPG
Deng, W., Chen, J., Li, Z., Wang, W., & Cai, Z. (2023) · doi:10.1145/3638584.3638600
Christodoulaki, E., Kampouridis, M., & Kyropoulou, M. (2024) · SSRN Electronic Journal · doi:10.2139/ssrn.4901967
Stock market price prediction using neural networks (LSTM) and technical indicators
Penmatsa, K. K. V., Kanumuri, C., Devi, S. S., et al. (2024) · AIP conference proceedings · doi:10.1063/5.0229761
Risk Diversification Strategy with Moving Average Reversion for Automatic Portfolio Optimization
Hayashi, Y., & Nakamura, A. (2024) · IEEE International Conference on Big Data (BigData) · doi:10.1109/bigdata62323.2024.10825315
Optimizing Robotic Arm Learning: Curiosity-Driven Deep Deterministic Policy Gradient
Liu, J. (2025) · ITM Web of Conferences · doi:10.1051/itmconf/20257301007
Silva, R. D. C., & Rodrigues, C. A. (2024) · Escola Regional de Computação Bahia, Alagoas e Sergipe (ERBASE) · doi:10.5753/erbase.2024.4398
Deng, D., & Zhu, X. (2024) · International Conference on Computers and Artificial Intelligence Technology (CAIT) · doi:10.1109/cait64506.2024.10963276
Portfoliozero: A Stock Portfolio Model Based on Deep Reinforcement LearningPreprint
Li, H., & Hai, M. (2025) · SSRN Electronic Journal · doi:10.2139/ssrn.5239647
An Application of Markov Chains in Optimizing Stock Portfolios in the Vietnamese Stock Market
Nhung, D. T. K. (2025) · International Journal of Mathematics Trends and Technology · doi:10.14445/22315373/ijmtt-v71i4p101
Son, D. T. (2025) · International Journal of Mathematics Trends and Technology · doi:10.14445/22315373/ijmtt-v71i4p103
Option-Driven Sentiment in FinRL: a PPO Approach to Trading
Li, S., Yu, M., & Dossor, F. (2025) · IEEE International Conference on Big Data Security on Cloud, IEEE International Conference on High Performance and Smart Computing, and IEEE International Conference on Intelligent Data and Security (BigDataSecurity/HPSC/IDS) · doi:10.1109/ids66066.2025.00020
Fractional order actor critic and fractional order deep deterministic policy gradient algorithms
Jiang, W., Dong, J., & Dong, Y. (2025) · Communications on Analysis and Computation · doi:10.3934/cac.2025013
Feature Enrichment Imitative Reinforcement Learning for High-Frequency TradingPreprint
Han, F., Ling, Q.-H., Lu, S., & Han, H. (2025) · SSRN Electronic Journal · doi:10.1016/j.eswa.2025.129043 · Cited by 5
Generalized Fitted Q‐Iteration With Clustered Data
Hu, L., Wang, J., Wu, Z., & Shi, C. (2025) · Stat · doi:10.1002/sta4.70112
FinRL-DT: Financial Reinforcement Learning Using Decision Transformers
Liu, B., Wang, K., Walid, A., & Yanglet, X.-Y. L. (2025) · IEEE International Conference on Cyber Security and Cloud Computing (CSCloud) · doi:10.1109/cscloud66326.2025.00064
Camouflage Adversarial Attacks on Multi-Agent Reinforcement Learning Systems
Lu, Z., Liu, G., Lai, L., & Xu, W. (2025) · IEEE Transactions on Signal Processing · doi:10.1109/tsp.2025.3644869
Wang, K.-D., Li, P.-X., Hsieh, H.-P., & Peng, W.-C. (2026) · IEEE International Conference on Knowledge Innovation and Invention (ICKII) · doi:10.3390/engproc2025120011
Language Model Orchestrated Financial Agents: An Open-Source Framework
Gundimeda, R. T. (2025) · International Conference for Advancement in Technology (ICONAT) · doi:10.1109/iconat66879.2025.11362528
Shi, H., Zhang, X., Wu, D., Kocarev, L., & Luo, C. (2026) · Chaos An Interdisciplinary Journal of Nonlinear Science · doi:10.1063/5.0304091
Stock market prediction through deep reinforcement learning
Khan, M. A., Naveed, N., & Shah, S. Q. (2026) · International Journal of Financial Engineering · doi:10.1142/s2424786326500167
A Hierarchical Signal-to-Policy Learning Framework for Risk-Aware Portfolio Optimization
Yu, J., & Chang, K. (2026) · International Journal of Financial Studies · doi:10.3390/ijfs14030075 · Cited by 2
Dang, Q.-V., & Nguyen, N.-S.-A. (2026) · Communications in computer and information science · doi:10.1007/978-3-032-22062-2_7 · Cited by 2
Rauf, K., & Sutopo, J. (2026) · Cureus Journal of Computer Science. · doi:10.7759/s44389-026-00083-1
Deep Reinforcement Learning Framework for Automated Trading Decision Support Systems
Kaur, G., Saini, S., Rani, P., Khan, L., Avthankar, A., & Shelke, N. M. (2026) · International Conference on Connected Intelligence for Industrial Applications (CI2A) · doi:10.1109/ci2a69097.2026.11576883
Rout, A. K., Acharya, U. D., Aithal, P. K., & Sharma, A. (2026) · Discover Computing · doi:10.1007/s10791-026-10336-1 · Cited by 1
“This period is dominated by ensemble methods [22, 46] (which are present in 42% of studies), meta-learning methods (which are presented in 27% of studies), and foundation model integrations (which are presented in 31% of studies).”
Chen, Z., Zheng, J., Ye, P.-G., Shi, N., & Pan, L. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-16168-0_6
FinRL-X: An AI-Native Modular Infrastructure for Quantitative Trading
Yang, H., Zhang, B., Yang, S. Y., Liao, X., & Zhang, X. (2026) · Lecture notes in computer science · doi:10.1007/978-981-92-2014-4_23 · Cited by 1
Mohan, S., Nair, A. J., S., A., Datla, R. V., & Sarath, G. (2026) · 2026 6th International Conference on Intelligent Technologies (CONIT) · doi:10.1109/conit69683.2026.11621634
Multi-Strategy End-to-End Autonomous Racing Using Soft Actor-Critic
Tawfeek, Y., & Hamoud, A. (2026) · IEEE Intelligent Vehicles Symposium · doi:10.1109/iv66570.2026.11623852
“Once limited to delayed decision-making processes [2][3][4], RL now demonstrates capabilities in time-sensitive system deployments [5][6].”
Meryem, G., Boudri, I., & Abdelkamel, A. (2026) · Journal of risk and financial management · doi:10.3390/jrfm19080582
Crypto Trading Bot Using MetaTrader5
Yadav, A., Pavithra, G. S., Muniraju, U., & Pandey, C. (2026) · Lecture notes in networks and systems · doi:10.1007/978-3-032-23317-2_18
Yin, B., Liu, Y., & Zhang, B. (2026) · IEEE International Conference on Web Services (ICWS) · doi:10.1109/icws72778.2026.00073
Position Sizing as a Risk-Control Variable: A Closed-Loop GRPO Framework for LLM Trading
Li, D., & Chen, M. (2026) · IEEE International Conference on Information Reuse and Integration (IRI) · doi:10.1109/iri69576.2026.00106
“Deep RL has been widely applied to trading: DQN [1], PPO [7], A3C [8], and DDPG [9] cover value-based, on-policy, and continuous-control settings, with ensemble methods [10] selecting among them by Sharpe ratio and FinRL / FinRL-Meta [2], [11] providing standard environments.”
Uncertainty-Aware Forecast-Conditioned Reinforcement Learning for Multi-Asset Algorithmic Trading
Verma, A. A., Arti, M. K., & Kumar, S. (2026) · International Conference Computational Vision and Bio Inspired Computing · doi:10.1109/iccvbic71195.2026.11688423
“Continuous-control algorithms like PPO [8], SAC [10], and TD3 [9] have demonstrated strong financial performance [3], [4], [13], mirroring their success in managing environmental uncertainty in other engineering domains [14], [15], [16].”
Rodríguez-Cándido, N. P., Marx‐Gómez, J., & Espin-Andrade, R. A. (2026) · Progress in IS · doi:10.1007/978-3-032-14099-9_42
Metadata
- Authors
- Liu, X.-Y.
- Affiliations
- Columbia University (US)
- Corresponding author
- Liu, Xiao-Yang
- ORCID
- Liu, Xiao-Yang
- Venue
- SSRN Electronic Journal
- Publisher
- Elsevier BV
- Published
- 2020
- ISSN
- 1556-5068 (ISSN-L)
- OpenAlex
- W3106281374
- Cited by
- 90
- References
- 54
- Citations by year
- 2026: 19 · 2025: 25 · 2024: 21 · 2023: 13 · 2022: 7 · 2021: 5
- Type
- posted content
- Language
- en
- Open access
- green
- doi.org
- Locations
- SSRN Electronic Journal (publishedVersion)
- RePEc: Research Papers in Economics (submittedVersion)
- Topics
- Social Sciences › Decision Sciences › Management Science and Operations Research › Stock Market Forecasting Methods
- Social Sciences › Economics, Econometrics and Finance › Finance › Financial Markets and Investment Strategies
- Social Sciences › Business, Management and Accounting › Management Information Systems › FinTech, Crowdfunding, Digital Finance
- Keywords
- deep reinforcement learning, automated stock trading, quantitative trading, reward function, market frictions, asset allocation, cryptocurrency trading, trading constraints
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
The claim verdicts this report counts are experimental: their accuracy is not yet measured.
A language model drew the claims from the paper on 2026-10-11, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-10-11 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.