The DOI matches its Crossref record; 46 of the 46 references it cites were found in a registry or an index.
FinRL: A Deep Reinforcement Learning Library for Automated Stock Trading in Quantitative Finance
Open accessAbstract
As deep reinforcement learning (DRL) has been recognized as an effective approach in quantitative finance, getting hands-on experiences is attractive to beginners. However, to train a practical DRL trading agent that decides where to trade, at what price, and what quantity involves error-prone and arduous development and debugging. In this paper, we introduce a DRL library FinRL that facilitates beginners to expose themselves to quantitative finance and to develop their own stock trading strategies. Along with easily-reproducible tutorials, FinRL library allows users to streamline their own developments and to compare with existing schemes easily. Within FinRL, virtual environments are configured with stock market datasets, trading agents are trained with neural networks, and extensive backtesting is analyzed via trading performance. Moreover, it incorporates important trading constraints such as transaction cost, market liquidity and the investor's degree of risk-aversion. FinRL is featured with completeness, hands-on tutorial and reproducibility that favors beginners: (i) at multiple levels of time granularity, FinRL simulates trading environments across various stock markets, including NASDAQ-100, DJIA, S&P 500, HSI, SSE 50, and CSI 300; (ii) organized in a layered architecture with modular structure, FinRL provides fine-tuned state-of-the-art DRL algorithms (DQN, DDPG, PPO, SAC, A2C, TD3, etc.), commonly-used reward functions and standard evaluation baselines to alleviate the debugging workloads and promote the reproducibility, and (iii) being highly extendable, FinRL reserves a complete set of user-import interfaces. Furthermore, we incorporated three application demonstrations, namely single stock trading, multiple stock trading, and portfolio allocation. The FinRL library will be available on Github at link https://github.com/AI4Finance-Foundation/FinRL.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Most existing libraries [13, 19, 25, 26] send the gradients of learners by following a traditional synchronization approach on supervised learning.”
From FinRL-podracer: high performance and scalable deep reinforcement learning for quantitative finance (2021) · cites this paper as [25]
In the citing paper
“For DRL strategy design, existing works studied algorithmic trading on a daily time-frame [2, 25, 26, 42-45] or hourly time-frame [14], which is hard to fully capture the dynamics of a highly volatile market.”
From FinRL-podracer: high performance and scalable deep reinforcement learning for quantitative finance (2021) · cites this paper as [25]
In the citing paper
“both FinRL [25] and Stable Baseline 3 [9] do not support the training on multiple GPUs”
From FinRL-podracer: high performance and scalable deep reinforcement learning for quantitative finance (2021) · cites this paper as [25]
In the citing paper
“We evaluate the training time of three popular DRL libraries, FinRL [25, 26], RLlib [19] and Stable Baseline3 [9], on NASDAQ-100 constituent stocks with minutelevel data (described in Section 5.2) in Table 1, which shows that it is difficult for them to effectively train a profitable trading agent in a short cycle time.”
From FinRL-podracer: high performance and scalable deep reinforcement learning for quantitative finance (2021) · cites this paper as [25]
Citations
Cites
Human-level control through deep reinforcement learning
Mnih, V., Kavukcuoglu, K., Silver, D., Rusu, A. A., Veness, J., Bellemare, M. G., Graves, A., Riedmiller, M., Fidjeland, A. K., Ostrovski, G., et al. (2015) · Nature · doi:10.1038/nature14236 · Cited by 30,357 · cited 2×
“FinRL library includes fine-tuned standard DRL algorithms, namely, DQN [29][34], DDPG [29], Multi-Agent DDPG [30], PPO [40], SAC [18], A2C [33] and TD3 [11].”
Mastering the game of Go with deep neural networks and tree search
Silver, D., Huang, A., Maddison, C. J., Guez, A., Sifre, L., van den Driessche, G., Schrittwieser, J., Antonoglou, I., Panneershelvam, V., Lanctot, M., et al. (2016) · Nature · doi:10.1038/nature16961 · Cited by 15,612
Continuous control with deep reinforcement learning
Lillicrap, T. P., Hunt, J. J., Pritzel, A., Heess, N., Erez, T., Tassa, Y., Silver, D., & Wierstra, D. (2015) · arXiv · doi:10.48550/arxiv.1509.02971 · Cited by 10,782 · cited 6×
“In the middle is the agent layer that provides fine-tuned standard DRL algorithms (DQN [29][34], DDPG [29], Adaptive DDPG [27], Multi-Agent DDPG [30], PPO [40], SAC [18], A2C [33] and TD3 [11], etc.), commonly used reward functions and standard evaluation baselines to alleviate the debugging workloads and promote the r…”
InfluentialProximal Policy Optimization Algorithms
Schulman, J., Wolski, F., Dhariwal, P., Radford, A., & Klimov, O. (2017) · arXiv · doi:10.48550/arxiv.1707.06347 · Cited by 10,625
Reinforcement Learning: An Introduction
Johnson, J. D., Li, J., & Chen, Z. (2000) · Neurocomputing · doi:10.1016/s0925-2312(00)00324-6 · Cited by 8,414
Asynchronous Methods for Deep Reinforcement Learning
Mnih, V., Badia, A. P., Mirza, M., Graves, A., Lillicrap, T. P., Harley, T., Silver, D., & Kavukcuoglu, K. (2016) · arXiv · doi:10.48550/arxiv.1602.01783 · Cited by 7,132 · cited 4×
“In the middle is the agent layer that provides fine-tuned standard DRL algorithms (DQN [29][34], DDPG [29], Adaptive DDPG [27], Multi-Agent DDPG [30], PPO [40], SAC [18], A2C [33] and TD3 [11], etc.), commonly used reward functions and standard evaluation baselines to alleviate the debugging workloads and promote the r…”
InfluentialSoft actor-critic Off-policy maximum entropy deep reinforcement learning with a stochastic actor
Haarnoja, T., Zhou, A., Abbeel, P., & Levine, S. (2018) · arXiv · doi:10.48550/arxiv.1801.01290 · Cited by 5,594 · cited 4×
“In the middle is the agent layer that provides fine-tuned standard DRL algorithms (DQN [29][34], DDPG [29], Adaptive DDPG [27], Multi-Agent DDPG [30], PPO [40], SAC [18], A2C [33] and TD3 [11], etc.), commonly used reward functions and standard evaluation baselines to alleviate the debugging workloads and promote the r…”
InfluentialMulti-Agent Actor-Critic for Mixed Cooperative-Competitive Environments
Lowe, R., Wu, Y., Tamar, A., Harb, J., Abbeel, P., & Mordatch, I. (2017) · arXiv · doi:10.48550/arxiv.1706.02275 · Cited by 3,377 · cited 5×
“In the middle is the agent layer that provides fine-tuned standard DRL algorithms (DQN [29][34], DDPG [29], Adaptive DDPG [27], Multi-Agent DDPG [30], PPO [40], SAC [18], A2C [33] and TD3 [11], etc.”
BackgroundMethodInfluentialPortfolio theory and capital markets
Breen, W. J., & Sharpe, W. F. (1972) · The Journal of Finance · doi:10.2307/2978700 · Cited by 1,221 · cited 1×
“Investors usually have two objectives for their decisions: the highest possible profits and the lowest possible risks of uncertainty [41].”
Deep Direct Reinforcement Learning for Financial Signal Representation and Trading
Deng, Y., Bao, F., Kong, Y., Ren, Z., & Dai, Q. (2017) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2016.2522401 · Cited by 822 · cited 3×
“Deng et al. [12] showed that applying deep neural networks profits more.”
Research works printed but not linked: 7
- G Thomas, 2018, Reinforcement learning in financial markets -a survey. Fau discussion papers in economics
- John Hull, 2009, Options, futures and other derivatives/John C. Hull
- Olivier Jin, 2016, Portfolio management using reinforcement learning
- Ryan Lowe, 2017, Multi-agent actorcritic for mixed cooperative-competitive environments, Advances in Neural Information Processing Systems, 6379
- G David, 1997, Investment science
- Pg Nechchi, 2016, Reinforcement learning for automated trading, Mathematical EngineeringPolitecnico di Milano
- Quantopian, 2019, A toolkit for portfolio and risk analytics in python
Cited by
Huang, Y., Zhou, C., Cui, K., & Lu, X. (2023) · Expert Systems with Applications · doi:10.1016/j.eswa.2023.121502 · Cited by 104
GraphSAGE with deep reinforcement learning for financial portfolio optimization
Sun, Q., Wei, X., & Yang, X. (2023) · Expert Systems with Applications · doi:10.1016/j.eswa.2023.122027 · Cited by 78
A novel deep reinforcement learning framework with BiLSTM-Attention networks for algorithmic trading
Huang, Y., Wan, X., Zhang, L., & Lu, X. (2023) · Expert Systems with Applications · doi:10.1016/j.eswa.2023.122581 · Cited by 60
Dynamic datasets and market environments for financial reinforcement learning
Liu, X.-Y., Xia, Z., Yang, H., Gao, J., Zha, D., Zhu, M., Wang, C. D., Wang, Z., & Guo, J. (2024) · Machine Learning · doi:10.1007/s10994-023-06511-w · Cited by 70
“The first three are technological innovations: • FinRL (Liu et al., 2020, 2021) is the first framework to provide an automatic pipeline for financial reinforcement learning.”
InfluentialSelf-citationDeep reinforcement learning based on transformer and U-Net framework for stock trading
Yang, B., Liang, T., Xiong, J., & Zhong, C. (2022) · Knowledge-Based Systems · doi:10.1016/j.knosys.2022.110211 · Cited by 43
Metadata
- Authors
- Liu, X.-Y., Yang, H., Chen, Q., Zhang, R., Yang, L., Xiao, B., & Wang, C.
- Affiliations
- Columbia University (US)
- Imperial College London (GB)
- New York University (US)
- Corresponding author
- Yang, Hongyang
- Venue
- SSRN Electronic Journal
- Publisher
- Elsevier BV
- Published
- 2025
- ISSN
- 1556-5068 (ISSN-L)
- OpenAlex
- W3162607076
- Semantic Scholar
- 1fc643611860d9cb46df0251c35c2c55a941f3f2
- Cited by
- 53
- References
- 46
- Citations by year
- 2026: 1 · 2025: 11
- Type
- posted content
- Language
- en
- Open access
- green
- doi.org
- Locations
- SSRN Electronic Journal (submittedVersion)
- Topics
- Social Sciences › Decision Sciences › Management Science and Operations Research › Stock Market Forecasting Methods
- Social Sciences › Economics, Econometrics and Finance › Finance › Financial Markets and Investment Strategies
- Social Sciences › Business, Management and Accounting › Management Information Systems › FinTech, Crowdfunding, Digital Finance
- Keywords
- deep reinforcement learning, automated stock trading, financial mathematics, backtesting, transaction costs, market liquidity, risk aversion, asset allocation, deep Q-network, deep deterministic policy gradient, PPO, SAC, TD3, Advantage Actor-Critic, reward function, reproducibility
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: FinRL: A Deep Reinforcement Learning Library for Automated Stock Trading in Quantitative Finance. https://app.cochat.ai/papers/10.2139/ssrn.3737859
- The paper
- Liu, X.-Y., Yang, H., Chen, Q., Zhang, R., Yang, L., Xiao, B., & Wang, C. (2025). FinRL: A Deep Reinforcement Learning Library for Automated Stock Trading in Quantitative Finance. SSRN Electronic Journal. https://doi.org/10.2139/ssrn.3737859
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.