Sentiment and Knowledge Based Algorithmic Trading with Deep Reinforcement Learning
Open accessAbstract
Algorithmic trading, due to its inherent nature, is a difficult problem to tackle; there are too many variables involved in the real world which make it almost impossible to have reliable algorithms for automated stock trading. The lack of reliable labelled data that considers physical and physiological factors that dictate the ups and downs of the market, has hindered the supervised learning attempts for dependable predictions. To learn a good policy for trading, we formulate an approach using reinforcement learning which uses traditional time series stock price data and combines it with news headline sentiments, while leveraging knowledge graphs for exploiting news about implicit relationships.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
No references could be resolved yet.
Research works printed but not linked: 22
- [2]2. Atsalakis, G.S., Valavanis, K.P.: Surveying stock market forecasting techniques part ii: Soft computing methods. Expert Systems with Applications 36 (3), 59325941 (2009)
- [3]3. Braun, H., Chandler, J.S.: Predicting stock market behavior through rule induction: An application of the learning-from-example approach*. Decision Sciences 18 (3), 415-429 (1987)
- [4]4. Chen, K., Zhou, Y., Dai, F.: A lstm-based method for stock returns prediction: A case study of china stock market. In: 2015 IEEE International Conference on Big Data (Big Data). pp. 2823-2824 (2015)
- [5]5. Deng, Y., Bao, F., Kong, Y., Ren, Z., Dai, Q.: Deep direct reinforcement learning for financial signal representation and trading. IEEE Transactions on Neural Networks and Learning Systems 28 (3), 653-664 (2017)
- [7]7. Fisher, K.L., Statman, M.: Investor sentiment and stock returns. Financial Analysts Journal 56 (2), 16-23 (2000)
- [8]8. Godbole, N., Srinivasaiah, M., Skiena, S.: Large-scale sentiment analysis for news and blogs. Icwsm 7 (21), 219-222 (2007)
- [11]11. Jain, S., Kain, M.: rediction for stock marketing using machine learning. International Journal on Recent and Innovation Trends in Computing and Communication 6 (4), 131-135 (2018)
- [12]12. Kaelbling, L., Littman, M., Cassandra, A.: Planning and acting in partially observable stochastic domains. Artificial Intelligence 101 (12), 99-134 (1998)
- [13]13. Karazmodeh, M., Nasiri, S., Hashemi, S.M.: Stock price forecasting using support vector machines and improved particle swarm optimization. Journal of Automation and Control Engineering 1 (2) (2013)
- [14]14. Kingma, D.P., Ba, J.: Adam: A method for stochastic optimization. arXiv preprint arXiv:1412.6980 (2014) · arXiv
- [15]15. Kohara, K., Ishikawa, T., Fukuhara, Y., Nakamura, Y.: Stock price prediction using prior knowledge and neural networks. Intelligent Systems in Accounting, Finance and Management 6 (1), 11-22 (1997)
- [18]18. Mnih, V., Kavukcuoglu, K., Silver, D., Rusu, A.A., Veness, J., Bellemare, M.G., Graves, A., Riedmiller, M., Fidjeland, A.K., Ostrovski, G., et al.: Human-level control through deep reinforcement learning. Nature 518 (7540), 529 (2015)
- [19]19. Panigrahi, S., Mantri, J.: A text based decision tree model for stock market forecasting. In: 2015 International Conference on Green Computing and Internet of Things. IEEE (2015)
- [20]20. Sabherwal, S., Sarkar, S.K., Zhang, Y.: Do internet stock message boards influence trading? evidence from heavily discussed stocks with no fundamental news. Journal of Business Finance & Accounting 38 (910), 1209-1237 (2011)
- [21]21. Sharma, M.: Survey on stock market prediction and performance analysis. International Journal of Advanced Research in Computer Engineering & Technology 3 (1), 131-135 (2014)
- [22]22. Si, J., Mukherjee, A., Liu, B., Li, Q., Li, H., Deng, X.: Exploiting topic based twitter sentiment for stock prediction. In: Proceedings of the 51st Annual Meeting of the Association for Computational Linguistics (Volume 2: Short Papers). vol. 2, pp. 24-29 (2013)
- [23]23. Sprenger, T.O., Tumasjan, A., Sandner, P.G., Welpe, I.M.: Tweets and trades: The information content of stock microblogs. European Financial Management 20 (5), 926-957 (2014)
- [24]24. Sutton, R.S., Barto, A.G., et al.: Introduction to reinforcement learning, vol. 135. MIT press Cambridge (1998)
- [25]25. Tan, Z., Quek, C., Cheng, P.Y.: Stock trading with cycles: A financial application of anfis and reinforcement learning. Expert Systems with Applications 38 (5), 4741 - 4755 (2011)
- [26]26. Taran, C., Roy, D., Srinivasan, N.: Stock price prediction - a novel survey. International Journal of Applied Engineering Research 10 (4), 11375-11383 (2015)
- [28]28. Yaddolahi, A., Shahraki, A.G., Zaiane, O.R.: Current state of text sentiment analysis from opinion to emotion mining. ACM Computing Surveys 50 (2), 25:1-25:33 (2017)
- [29]29. str¨ om, K.: Optimal control of markov processes with incomplete state information. Journal of Mathematical Analysis and Applications 10 (1), 174 - 205 (1965)
Cited by
Sorted by citations
FinRL: A Deep Reinforcement Learning Library for Automated Stock Trading in Quantitative Finance
Liu, X.-Y. (2020) · SSRN Electronic Journal · doi:10.2139/ssrn.3737257 · Cited by 90 · see citing works
Liu, X.-Y., Yang, H., Gao, J., & Wang, C. D. (2021) · Proceedings of the Second ACM International Conference on AI in Finance · doi:10.1145/3490354.3494366 · Cited by 87 · see citing works
FinRL: A Deep Reinforcement Learning Library for Automated Stock Trading in Quantitative Finance
Liu, X.-Y., Yang, H., Chen, Q., Zhang, R., Yang, L., Xiao, B., & Wang, C. (2025) · doi:10.2139/ssrn.3737859 · Cited by 51 · see citing works
“News headline sentiments and knowledge graphs can also be combined with the time series stock data to train an optimal policy using DRL [37].”
FinRL: Deep Reinforcement Learning Framework to Automate Trading in Quantitative Finance
Liu, X.-Y., Yang, H., Gao, J., & Wang, C. (2021) · doi:10.2139/ssrn.3955949 · Cited by 46 · see citing works
- Authors
- Nan, A., Perumal, A., & Zaiane, O. R.
- Affiliations
- University of Alberta (CA)
- Venue
- arXiv
- Publisher
- arXiv
- Published
- 2020
- Pages
- 167-180
- ISSN
- 0302-9743 (ISSN-L)
- arXiv
- 2001.09403
- OpenAlex
- W3002348292
- Cited by
- 39
- References
- 0
- Citations by year
- 2026: 1 · 2025: 5 · 2024: 9 · 2023: 10 · 2022: 6 · 2021: 7 · 2020: 1
- FWCI
- 12.31
- Type
- conference paper
- Language
- en
- Open access
- green
- arxiv.org
- Locations
- Lecture notes in computer science (publishedVersion)
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- Topics
- Social Sciences › Decision Sciences › Management Science and Operations Research › Stock Market Forecasting Methods
- Social Sciences › Economics, Econometrics and Finance › Finance › Financial Markets and Investment Strategies
- Physical Sciences › Computer Science › Artificial Intelligence › Sentiment Analysis and Opinion Mining
- Keywords
- algorithmic trading, deep reinforcement learning, stock price prediction, news sentiment, knowledge graphs, financial time series
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review