Student or educator? Sign up with your school email and get 6 months of Pro free.
CoChat

The DOI matches its Crossref record; 51 of the 54 references it cites were found in a registry or an index; 1 of the 14 sources its claims cite were checked for support.

FinRL: A Deep Reinforcement Learning Library for Automated Stock Trading in Quantitative Finance

Open access
Liu, Xiao-Yang · 2020 · SSRN Electronic Journal

Overview

CoChat Summary

## TL;DR

FinRL is presented as an open-source, three-layer deep reinforcement learning library for automated stock trading, aimed at making quantitative finance workflows beginner-friendly, reproducible, and extensible. The paper demonstrates the library on three use cases and reports that several DRL strategies outperform benchmark indices or traditional allocation strategies on its test examples.

## Key findings

  • FinRL organizes automated stock trading into a three-layer architecture: market environment, DRL agent, and trading applications, with modular components and reserved user-import interfaces.
  • The library provides six standard trading environments based on representative listings: NASDAQ-100, DJIA, S&P 500, SSE 50, CSI 300, and HSI, plus one user-defined environment.
  • In the single-stock example using PPO over 2019/01/01–2020/09/23, final portfolio values ranged from 127,044 to 192,031 versus 133,402 for the S&P 500; annualized returns ranged from 14.89% to 44.94% versus 17.81% for the S&P 500, and Sharpe ratios ranged from 1.10 to 1.49 versus 0.74 for the S&P 500.
  • In the multiple-stock / portfolio-allocation example over DJIA constituents, TD3 and DDPG achieved Sharpe ratios above the DJIA and min-variance baseline: TD3 1.38 and 1.03, DDPG 1.28 and 0.98, versus 0.48 for DJIA and 0.44 for min-variance.

## Methods

  • The paper introduces FinRL as a three-layer library: an environment layer built on OpenAI Gym time-driven trading simulators, an agent layer with fine-tuned DRL algorithms, and an application layer with trading use cases.
  • The environment models stock trading as a Markov Decision Process and supports state variables such as balance, shares held, prices, volume, and technical indicators; actions include sell/hold/buy and can be defined over multiple shares.
  • Evaluation follows a training-validation-testing flow, uses automated backtesting with Quantopian pyfolio, and reports standard metrics including final portfolio value, annualized return, annualized standard deviation, maximum drawdown, and Sharpe ratio.

## Limitations

  • The paper does not report a formal experimental design with statistical significance testing, confidence intervals, or repeated-run variability for the reported performance numbers.
  • It is not stated in the paper whether the reported case-study results generalize beyond the shown datasets, exchanges, time period, or chosen algorithms.
  • Evident from the text: the paper is primarily a library/system description and demonstration paper, so the evaluation is limited to illustrative use cases rather than a comprehensive head-to-head benchmark across all methods and markets.

Model-written summary. Check it against the paper before relying on it.

Integrity signals

Registry

Crossref · 10.2139/ssrn.3737257

Cites

51 of 51 references verified0 citation errors · 0 not checkable

Statistics

Nothing to recompute.

Verification

Claims the paper makes

1 Valid · 5 Not valid · 4 Not checked · 17 Own results and interpretations

3 more claims

Create a free account to see all 27 claims and to verify the 1 reference still open.

See all claims — free account
  • It may state two separate claims as one. 10
  • Probably not a substantial claim. 14

Create a free account to see these claims.

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

Each contradiction between two passages listed here was confirmed by an independent check.

1 of 1

Citations

Cites

Show all 54 references

Research works printed but not linked: 6

  1. G Thomas, 2018, Reinforcement learning in financial markets -a survey. Fau discussion papers in economics
  2. Olivier Jin, 2016, Portfolio management using reinforcement learning
  3. Ryan Lowe, 2017, Multi-agent actorcritic for mixed cooperative-competitive environments, Advances in Neural Information Processing Systems, 6379
  4. David G Luenberger, 1997, Investment science
  5. Pg Nechchi, 2016, Reinforcement learning for automated trading, Mathematical EngineeringPolitecnico di Milano
  6. Quantopian, 2019, A toolkit for portfolio and risk analytics in python

Cited by

Metadata

Authors
Liu, X.-Y.
Affiliations
Columbia University (US)
Corresponding author
Liu, Xiao-Yang
Venue
SSRN Electronic Journal
Publisher
Elsevier BV
Published
2020
ISSN
1556-5068 (ISSN-L)
OpenAlex
W3106281374
Cited by
90
References
54
Citations by year
2026: 19 · 2025: 25 · 2024: 21 · 2023: 13 · 2022: 7 · 2021: 5
Type
posted content
Language
en
Open access
Locations
  • SSRN Electronic Journal (publishedVersion)
  • RePEc: Research Papers in Economics (submittedVersion)
Topics
  • Social Sciences › Decision Sciences › Management Science and Operations Research › Stock Market Forecasting Methods
  • Social Sciences › Economics, Econometrics and Finance › Finance › Financial Markets and Investment Strategies
  • Social Sciences › Business, Management and Accounting › Management Information Systems › FinTech, Crowdfunding, Digital Finance
Keywords
deep reinforcement learning, automated stock trading, quantitative trading, reward function, market frictions, asset allocation, cryptocurrency trading, trading constraints

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

The claim verdicts this report counts are experimental: their accuracy is not yet measured.

A language model drew the claims from the paper on 2026-10-11, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).

A second model labelled each claim on 2026-10-11 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.