The DOI matches its Crossref record; 62 of the 62 references it cites were found in a registry or an index.
Technical analysis and sentiment embeddings for market trend prediction
Abstract
Abstract Stock market prediction is one of the most challenging problems which has been distressing both researchers and financial analysts for more than half a century. To tackle this problem, two completely opposite approaches, namely technical and fundamental analysis, emerged. Technical analysis bases its predictions on mathematical indicators constructed on the stocks price, while fundamental analysis exploits the information retrieved from news, profitability, and macroeconomic factors. The competition between these schools of thought has led to many interesting achievements, however, to date, no satisfactory solution has been found. Our work aims to combine both technical and fundamental analysis through the application of data science and machine learning techniques. In this paper, the stock market prediction problem is mapped in a classification task of time series data. Indicators of technical analysis and the sentiment of news articles are both exploited as input. The outcome is a robust predictive model able to forecast the trend of a portfolio composed by the twenty most capitalized companies listed in the NASDAQ100 index. As a proof of real effectiveness of our approach, we exploit the predictions to run a high frequency trading simulation reaching more than 80% of annualized return. This project represents a step forward to combine technical and fundamental analysis and provides a starting point for developing new trading strategies.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
1 retracted
Application of Neural Network to Technical Analysis of Stock Market Prediction
Singh, A., Bhardwaj, G., Srivastava, A. P., et al. (2022) · International Conference on Intelligent Engineering and Management (ICIEM) · doi:10.1109/iciem54221.2022.9853162 · Cited by 97
RetractedAdam: A Method for Stochastic Optimization
Kingma, D. P., & Ba, J. (2014) · arXiv · doi:10.48550/arxiv.1412.6980 · Cited by 98,946
(2014) · Cited by 33,419
SMOTE synthetic minority over-sampling technique
Chawla, N. V., Bowyer, K. W., Hall, L. O., & Kegelmeyer, W. P. (2002) · Journal of Artificial Intelligence Research · doi:10.1613/jair.953 · Cited by 32,865
Learning representations by back-propagating errors
Rumelhart, D. E., Hinton, G. E., & Williams, R. J. (1986) · Nature · doi:10.1038/323533a0 · Cited by 31,892
Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift
Ioffe, S., & Szegedy, C. (2015) · arXiv · doi:10.48550/arxiv.1502.03167 · Cited by 27,818
Time Series Analysis: Forecasting and Control
Geurts, M., Box, G. E. P., & Jenkins, G. M. (1977) · Journal of Marketing Research · doi:10.2307/3150485 · Cited by 19,186
Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift
Ioffe, S. (2024) · arXiv (Cornell University) · doi:10.57702/o9raffed · Cited by 14,214
Approximation by superpositions of a sigmoidal function
Cybenko, G. (1989) · Mathematics of Control, Signals, and Systems · doi:10.1007/bf02551274 · Cited by 13,883
An Introduction to Support Vector Machines and Other Kernel-based Learning Methods
Cristianini, N., & Shawe-Taylor, J. (2000) · doi:10.1017/cbo9780511801389 · Cited by 13,855
Long-Term Storage Capacity of Reservoirs
Hurst, H. E. (1951) · Transactions of the American Society of Civil Engineers · doi:10.1061/taceat.0006518 · Cited by 6,212
When Is a Liability Not a Liability? Textual Analysis, Dictionaries, and 10‐Ks
LOUGHRAN, T., & MCDONALD, B. (2011) · The Journal of Finance · doi:10.1111/j.1540-6261.2010.01625.x · Cited by 6,015
FAMA, E. F. (1991) · The Journal of Finance · doi:10.1111/j.1540-6261.1991.tb04636.x · Cited by 5,350
Twitter mood predicts the stock market
Bollen, J., Mao, H., & Zeng, X. (2011) · Journal of Computational Science · doi:10.1016/j.jocs.2010.12.007 · Cited by 5,206
Time series forecasting using a hybrid ARIMA and neural network model
Zhang, G. P. (2003) · Neurocomputing · doi:10.1016/s0925-2312(01)00702-0 · Cited by 4,428
An Introduction to Support Vector Machines and Other Kernel‐based Learning Methods
(2001) · Kybernetes · doi:10.1108/k.2001.30.1.103.6 · Cited by 3,308
Advances in neural information processing systems 11
Peter Sollich, A. (1999) · Cited by 3,168
Time Series Analysis, Forecasting and Control.
Kendall, M. G., Box, G. E. P., & Jenkins, G. M. (1971) · Journal of the Royal Statistical Society. Series A (General) · doi:10.2307/2344246 · Cited by 2,771
Advances in Neural Information Processing Systems 18
Murray, I., Mackay, D., Zoubin Ghahramani, A., & Skilling, J. (2006) · Cited by 1,927
Improving predictive inference under covariate shift by weighting the log-likelihood function
Shimodaira, H. (2000) · Journal of Statistical Planning and Inference · doi:10.1016/s0378-3758(00)00115-4 · Cited by 1,678
The Adaptive Markets Hypothesis
Lo, A. W. (2004) · The Journal of Portfolio Management · doi:10.3905/jpm.2004.442611 · Cited by 1,670
A review of affective computing: From unimodal analysis to multimodal fusion
Poria, S., Cambria, E., Bajpai, R., & Hussain, A. (2017) · Information Fusion · doi:10.1016/j.inffus.2017.02.003 · Cited by 1,644
Self-citationNormalization: A Preprocessing Stage
Patro, S. G. K., & sahu, K. K. (2015) · IARJSET · doi:10.17148/iarjset.2015.2305 · Cited by 1,566
Application of support vector machines in financial time series forecasting
Tay, F. E. H., & Cao, L. (2001) · Omega · doi:10.1016/s0305-0483(01)00026-3 · Cited by 1,268
Forecasting stock market movement direction with support vector machine
Huang, W., Nakamori, Y., & Wang, S.-Y. (2005) · Computers & Operations Research · doi:10.1016/j.cor.2004.03.016 · Cited by 1,119
Maximum-Margin Matrix Factorization
Srebro, N., Rennie, J. D. M., & Jaakkola, T. (2004) · Cited by 962
IEEE 1988 International Conference on Neural Networks
(1988) · doi:10.1109/icnn.1988 · Cited by 890
The multilayer perceptron as an approximation to a Bayes optimal discriminant function
Ruck, D. W., Rogers, S. K., Kabrisky, M., Oxley, M. E., & Suter, B. W. (1990) · IEEE Transactions on Neural Networks · doi:10.1109/72.80266 · Cited by 834
Textual analysis of stock market prediction using breaking financial news: The AZFin text system
Schumaker, R. P., & Chen, H. (2009) · ACM Transactions on Information Systems · doi:10.1145/1462198.1462204 · Cited by 777
Kim, K.-J., & Han, I. (2000) · Expert Systems with Applications · doi:10.1016/s0957-4174(00)00027-0 · Cited by 757
International Conference on Information Systems
(2020) · doi:10.17705/4icis · Cited by 655
Data Mining: A Preprocessing Engine
Shalabi, L. A., Shaaban, Z., & Kasasbeh, B. (2006) · Journal of Computer Science · doi:10.3844/jcssp.2006.735.739 · Cited by 612
Targeted Aspect-Based Sentiment Analysis via Embedding Commonsense Knowledge into an Attentive LSTM
Ma, Y., Peng, H., & Cambria, E. (2018) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v32i1.12048 · Cited by 592
Self-citationRobust Image Sentiment Analysis Using Progressively Trained and Domain Transferred Deep Networks
You, Q., Luo, J., Jin, H., & Yang, J. (2015) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v29i1.9179 · Cited by 548
Abnormal returns to a fundamental analysis strategy.
Abarbanell, J. S., & Bushee, B. J. (1998) · The Accounting Review · doi:10.2308/tar-274315 · Cited by 509
News impact on stock price return via sentiment analysis
Li, X., Xie, H., Chen, L., Wang, J., & Deng, X. (2014) · Knowledge-Based Systems · doi:10.1016/j.knosys.2014.04.022 · Cited by 503
Conversational Memory Network for Emotion Recognition in Dyadic Dialogue Videos
Hazarika, D., Poria, S., Zadeh, A., Cambria, E., Morency, L.-P., & Zimmermann, R. (2018) · Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long Papers) · doi:10.18653/v1/n18-1193 · Cited by 463
Self-citationStock Movement Prediction from Tweets and Historical Prices
Xu, Y., & Cohen, S. B. (2018) · Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.18653/v1/p18-1183 · Cited by 434
Natural language based financial forecasting: a survey
Xing, F. Z., Cambria, E., & Welsch, R. E. (2018) · Artificial Intelligence Review · doi:10.1007/s10462-017-9588-9 · Cited by 398
Self-citation2019 IEEE Symposium Series on Computational Intelligence
(2019) · IEEE Computational Intelligence Magazine · doi:10.1109/mci.2018.2881650 · Cited by 371
Amin, A., Anwar, S., Adnan, A., Nawaz, M., Howard, N., Qadir, J., Hawalah, A., & Hussain, A. (2016) · IEEE Access · doi:10.1109/access.2016.2619719 · Cited by 310
Listening to Chaotic Whispers: A Deep Learning Framework for News-oriented Stock Trend Prediction
Hu, Z., Liu, W., Bian, J., Liu, X., & Liu, T.-Y. (2018) · Proceedings of the Eleventh ACM International Conference on Web Search and Data Mining · doi:10.1145/3159652.3159690 · Cited by 270
Forecasting Stock Index Movement: A Comparison of Support Vector Machines and Random Forest
Kumar, M., & Thenmozhi, M. (2006) · doi:10.2139/ssrn.876544 · Cited by 244
Class prediction for high-dimensional class-imbalanced data
Blagus, R., & Lusa, L. (2010) · BMC Bioinformatics · doi:10.1186/1471-2105-11-523 · Cited by 236
Predicting the direction of stock market prices using random forest
Khaidem, L., Saha, S., & Dey, S. R. (2016) · arXiv · doi:10.48550/arxiv.1605.00003 · Cited by 227
Oh, C., & Sheng, O. R. L. (2011) · AIS Electronic Library (AISeL) · Cited by 221
Fountain, T., & Lapata, M. (2012) · The Association for Computational Linguistics · Cited by 218
Exploiting Topic based Twitter Sentiment for Stock Prediction
Si, J., Mukherjee, A., Liu, B., Li, Q., Li, H., & Deng, X. (2013) · doi:10.13140/2.1.3604.7043 · Cited by 210
Analyzing Stock Market Movements Using Twitter Sentiment Analysis
Rao, T., & Srivastava, S. (2012) · Lincoln Repository (University of Lincoln) · doi:10.1109/asonam.2012.30 · Cited by 194
NEURAL NETWORKS FOR TECHNICAL ANALYSIS: A STUDY ON KLCI
YAO, J., TAN, C. L., & POH, H.-L. (1999) · International Journal of Theoretical and Applied Finance · doi:10.1142/s0219024999000145 · Cited by 193
AffectiveSpace 2: Enabling Affective Intuition for Concept-Level Sentiment Analysis
Cambria, E., Fu, J., Bisio, F., & Poria, S. (2015) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v29i1.9230 · Cited by 190
Self-citationA Hybrid Machine Learning System For Stock Market Forecasting
Choudhry, R., & Garg, K. (2008) · Zenodo (CERN European Organization for Nuclear Research) · doi:10.5281/zenodo.1071851 · Cited by 175
Application of wrapper approach and composite classifier to the stock trend prediction
HUANG, C., YANG, D., & CHUANG, Y. (2008) · Expert Systems with Applications · doi:10.1016/j.eswa.2007.05.035 · Cited by 167
Learning Word Representations for Sentiment Analysis
Li, Y., Pan, Q., Yang, T., Wang, S., Tang, J., & Cambria, E. (2017) · Cognitive Computation · doi:10.1007/s12559-017-9492-2 · Cited by 167
Self-citationPredicting abnormal returns from news using text classification
Luss, R., & d’Aspremont, A. (2012) · Quantitative Finance · doi:10.1080/14697688.2012.672762 · Cited by 145
Can blog communication dynamics be correlated with stock market activity?
Choudhury, M. D., Sundaram, H., John, A., & Seligmann, D. D. (2008) · ACM Conference on Hypertext and Social Media (HT) · doi:10.1145/1379092.1379106 · Cited by 143
Linear Hinge Loss and Average Margin
Gentile, C., & Warmuth, M. K. (1998) · Cited by 110
Forex-foreteller: currency trend modeling using news articles
Jin, F., Self, N., Saraf, P., Butler, P., Wang, W., & Ramakrishnan, N. (2013) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/2487575.2487710 · Cited by 65
Forecasting the KLSE index using neural networks
Yao, J., & Poh, H.-L. (2002) · IEEE International Conference on Neural Networks/IEEE ... International Conference on Neural Networks · doi:10.1109/icnn.1995.487559 · Cited by 40
Ensemble of Technical Analysis and Machine Learning for Market Trend Prediction
Ratto, A. P., Merello, S., Oneto, L., Ma, Y., Malandri, L., & Cambria, E. (2018) · IEEE Symposium Series on Computational Intelligence (SSCI) · doi:10.1109/ssci.2018.8628795 · Cited by 32
Self-citationPredicting Future Market Trends: Which Is the Optimal Window?
Merello, S., Ratto, A. P., Oneto, L., & Cambria, E. (2019) · Proceedings of the international neural networks society · doi:10.1007/978-3-030-16841-4_19 · Cited by 6
Self-citation
Cited by
A systematic review on affective computing: emotion models, databases, and recent advances
Wang, Y., Song, W., Tao, W., Liotta, A., Yang, D., Li, X., Gao, S., Sun, Y., Ge, W., Zhang, W., et al. (2022) · Information Fusion · doi:10.1016/j.inffus.2022.03.009 · Cited by 615
Machine learning techniques and data for stock market forecasting: A literature review
Kumbure, M. M., Lohrmann, C., Luukka, P., & Porras, J. (2022) · Expert Systems with Applications · doi:10.1016/j.eswa.2022.116659 · Cited by 535
Stock market index prediction using deep Transformer model
Wang, C., Chen, Y., Zhang, S., & Zhang, Q. (2022) · Expert Systems with Applications · doi:10.1016/j.eswa.2022.118128 · Cited by 367
A novel graph convolutional feature based convolutional neural network for stock trend prediction
Chen, W., Jiang, M., Zhang, W.-G., & Chen, Z. (2021) · Information Sciences · doi:10.1016/j.ins.2020.12.068 · Cited by 281
Stock Market Forecasting Using Deep Learning and Technical Analysis: A Systematic Review
Li, A. W., & Bastos, G. S. (2020) · IEEE Access · doi:10.1109/access.2020.3030226 · Cited by 186
Metadata
- Authors
- Picasso, A., Merello, S., Ma, Y., Oneto, L., & Cambria, E.
- Venue
- Expert Systems with Applications
- Publisher
- Elsevier BV
- Published
- 2019-11
- Volume
- 135
- Pages
- 60-70
- ISSN
- 0957-4174 (ISSN-L)
- OpenAlex
- W2949202718
- Cited by
- 291
- References
- 62
- FWCI
- 25.93
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.