PreprintCited by 39Stock Market Forecasting MethodsFinancial Markets and Investment StrategiesSentiment Analysis and Opinion Mining

Sentiment and Knowledge Based Algorithmic Trading with Deep Reinforcement Learning

Open access
Nan, Abhishek, Perumal, Anandh, Zaiane, Osmar R.·2020·arXiv

Abstract

Algorithmic trading, due to its inherent nature, is a difficult problem to tackle; there are too many variables involved in the real world which make it almost impossible to have reliable algorithms for automated stock trading. The lack of reliable labelled data that considers physical and physiological factors that dictate the ups and downs of the market, has hindered the supervised learning attempts for dependable predictions. To learn a good policy for trading, we formulate an approach using reinforcement learning which uses traditional time series stock price data and combines it with news headline sentiments, while leveraging knowledge graphs for exploiting news about implicit relationships.

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

DataCite · 10.48550/arxiv.2001.09403

Cites

Statistics

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Cites

No references could be resolved yet.

Research works printed but not linked: 22

  1. [2]2. Atsalakis, G.S., Valavanis, K.P.: Surveying stock market forecasting techniques part ii: Soft computing methods. Expert Systems with Applications 36 (3), 59325941 (2009)
  2. [3]3. Braun, H., Chandler, J.S.: Predicting stock market behavior through rule induction: An application of the learning-from-example approach*. Decision Sciences 18 (3), 415-429 (1987)
  3. [4]4. Chen, K., Zhou, Y., Dai, F.: A lstm-based method for stock returns prediction: A case study of china stock market. In: 2015 IEEE International Conference on Big Data (Big Data). pp. 2823-2824 (2015)
  4. [5]5. Deng, Y., Bao, F., Kong, Y., Ren, Z., Dai, Q.: Deep direct reinforcement learning for financial signal representation and trading. IEEE Transactions on Neural Networks and Learning Systems 28 (3), 653-664 (2017)
  5. [7]7. Fisher, K.L., Statman, M.: Investor sentiment and stock returns. Financial Analysts Journal 56 (2), 16-23 (2000)
  6. [8]8. Godbole, N., Srinivasaiah, M., Skiena, S.: Large-scale sentiment analysis for news and blogs. Icwsm 7 (21), 219-222 (2007)
  7. [11]11. Jain, S., Kain, M.: rediction for stock marketing using machine learning. International Journal on Recent and Innovation Trends in Computing and Communication 6 (4), 131-135 (2018)
  8. [12]12. Kaelbling, L., Littman, M., Cassandra, A.: Planning and acting in partially observable stochastic domains. Artificial Intelligence 101 (12), 99-134 (1998)
  9. [13]13. Karazmodeh, M., Nasiri, S., Hashemi, S.M.: Stock price forecasting using support vector machines and improved particle swarm optimization. Journal of Automation and Control Engineering 1 (2) (2013)
  10. [14]14. Kingma, D.P., Ba, J.: Adam: A method for stochastic optimization. arXiv preprint arXiv:1412.6980 (2014) · arXiv
  11. [15]15. Kohara, K., Ishikawa, T., Fukuhara, Y., Nakamura, Y.: Stock price prediction using prior knowledge and neural networks. Intelligent Systems in Accounting, Finance and Management 6 (1), 11-22 (1997)
  12. [18]18. Mnih, V., Kavukcuoglu, K., Silver, D., Rusu, A.A., Veness, J., Bellemare, M.G., Graves, A., Riedmiller, M., Fidjeland, A.K., Ostrovski, G., et al.: Human-level control through deep reinforcement learning. Nature 518 (7540), 529 (2015)
  13. [19]19. Panigrahi, S., Mantri, J.: A text based decision tree model for stock market forecasting. In: 2015 International Conference on Green Computing and Internet of Things. IEEE (2015)
  14. [20]20. Sabherwal, S., Sarkar, S.K., Zhang, Y.: Do internet stock message boards influence trading? evidence from heavily discussed stocks with no fundamental news. Journal of Business Finance & Accounting 38 (910), 1209-1237 (2011)
  15. [21]21. Sharma, M.: Survey on stock market prediction and performance analysis. International Journal of Advanced Research in Computer Engineering & Technology 3 (1), 131-135 (2014)
  16. [22]22. Si, J., Mukherjee, A., Liu, B., Li, Q., Li, H., Deng, X.: Exploiting topic based twitter sentiment for stock prediction. In: Proceedings of the 51st Annual Meeting of the Association for Computational Linguistics (Volume 2: Short Papers). vol. 2, pp. 24-29 (2013)
  17. [23]23. Sprenger, T.O., Tumasjan, A., Sandner, P.G., Welpe, I.M.: Tweets and trades: The information content of stock microblogs. European Financial Management 20 (5), 926-957 (2014)
  18. [24]24. Sutton, R.S., Barto, A.G., et al.: Introduction to reinforcement learning, vol. 135. MIT press Cambridge (1998)
  19. [25]25. Tan, Z., Quek, C., Cheng, P.Y.: Stock trading with cycles: A financial application of anfis and reinforcement learning. Expert Systems with Applications 38 (5), 4741 - 4755 (2011)
  20. [26]26. Taran, C., Roy, D., Srinivasan, N.: Stock price prediction - a novel survey. International Journal of Applied Engineering Research 10 (4), 11375-11383 (2015)
  21. [28]28. Yaddolahi, A., Shahraki, A.G., Zaiane, O.R.: Current state of text sentiment analysis from opinion to emotion mining. ACM Computing Surveys 50 (2), 25:1-25:33 (2017)
  22. [29]29. str¨ om, K.: Optimal control of markov processes with incomplete state information. Journal of Mathematical Analysis and Applications 10 (1), 174 - 205 (1965)

Cited by

Sorted by citations

Authors
Nan, A., Perumal, A., & Zaiane, O. R.
Affiliations
University of Alberta (CA)
Venue
arXiv
Publisher
arXiv
Published
2020
Pages
167-180
ISSN
0302-9743 (ISSN-L)
OpenAlex
W3002348292
Cited by
39
References
0
Citations by year
2026: 1 · 2025: 5 · 2024: 9 · 2023: 10 · 2022: 6 · 2021: 7 · 2020: 1
FWCI
12.31
Type
conference paper
Language
en
Open access
Locations
  • Lecture notes in computer science (publishedVersion)
  • arXiv (Cornell University) (submittedVersion)
  • arXiv (Cornell University)
Topics
  • Social Sciences › Decision Sciences › Management Science and Operations Research › Stock Market Forecasting Methods
  • Social Sciences › Economics, Econometrics and Finance › Finance › Financial Markets and Investment Strategies
  • Physical Sciences › Computer Science › Artificial Intelligence › Sentiment Analysis and Opinion Mining
Keywords
algorithmic trading, deep reinforcement learning, stock price prediction, news sentiment, knowledge graphs, financial time series

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review