Stock Movement Prediction from Tweets and Historical Prices
Open accessThe DOI matches its Crossref record; 24 of the 24 references it cites were found in a registry or an index.
Abstract
Stock movement prediction is a challenging problem: the market is highly stochastic, and we make temporally-dependent predictions from chaotic data. We treat these three complexities and present a novel deep generative model jointly exploiting text and price signals for this task. Unlike the case with discriminative or topic modeling, our model introduces recurrent, continuous latent variables for a better treatment of stochasticity, and uses neural variational inference to address the intractable posterior inference. We also provide a hybrid objective with temporal auxiliary to flexibly capture predictive dependencies. We demonstrate the state-of- the-art performance of our proposed model on a new stock movement prediction dataset which we collected.11https://github.com/yumoxu/stocknet-dataset
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Adam: A Method for Stochastic Optimization
Kingma, D. P., & Ba, J. (2014) · arXiv · doi:10.48550/arxiv.1412.6980 · Cited by 98,946 · cited 1×
“We train the model with an Adam optimizer (Kingma and Ba, 2014) with the initial learning rate of 0.001.”
InfluentialAuto-Encoding Variational Bayes
Kingma, D. P., & Welling, M. (2013) · arXiv · doi:10.48550/arxiv.1312.6114 · Cited by 20,067 · cited 2×
“Motivated by Variational Auto-Encoders (VAEs; Kingma and Welling, 2013; Rezende et al., 2014), we propose a novel decoder with a variational architecture and derive a recurrent variational lower bound for end-to-end training (Section 5.2).”
InfluentialTensorFlow: Large-Scale Machine Learning on Heterogeneous Distributed Systems
Abadi, M., Agarwal, A., Barham, P., Brevdo, E., Chen, Z., Citro, C., Corrado, G. S., Davis, A., Dean, J., Devin, M., et al. (2016) · arXiv · doi:10.48550/arxiv.1603.04467 · Cited by 9,408 · cited 1×
“Tensorflow (Abadi et al., 2016) is used to construct the computational graph of StockNet and hyper-parameters are tweaked on the development set.”
MethodTwitter mood predicts the stock market
Bollen, J., Mao, H., & Zeng, X. (2011) · Journal of Computational Science · doi:10.1016/j.jocs.2010.12.007 · Cited by 5,206 · cited 1×
“Stock movement prediction has long attracted both investors and researchers (Frankel, 1995; Edwards et al., 2007; Bollen et al., 2011; Hu et al., 2018).”
Distributed Representations of Sentences and Documents
Le, Q. V., & Mikolov, T. (2014) · arXiv (Cornell University) · doi:10.48550/arxiv.1405.4053 · Cited by 4,934 · cited 1×
“With the prevalence of deep neural networks (Le and Mikolov, 2014), event-driven approaches were studied with structured event representations (Ding et al., 2014, 2015).”
Stochastic Backpropagation and Approximate Inference in Deep Generative Models
Rezende, D. J., Mohamed, S., & Wierstra, D. (2014) · arXiv (Cornell University) · doi:10.48550/arxiv.1401.4082 · Cited by 2,405
Generating Sentences from a Continuous Space
Bowman, S. R., Vilnis, L., Vinyals, O., Dai, A., Jozefowicz, R., & Bengio, S. (2016) · Proceedings of The 20th SIGNLL Conference on Computational Natural Language Learning · doi:10.18653/v1/k16-1002 · Cited by 2,061 · cited 2×
“1976 where we adopt the KL term annealing trick (Bowman et al., 2016; Semeniuta et al., 2017) and add a linearly-increasing KL term weight λ ∈ (0, 1] to gradually release the KL regularization effect in the training procedure.”
Caruana, R. (1998) · Cited by 1,110
Smoothing, Forecasting and Prediction of Discrete Time Series.
Parzen, E., & Brown, R. G. (1964) · Journal of the American Statistical Association · doi:10.2307/2283122 · Cited by 968
Textual analysis of stock market prediction using breaking financial news: The AZFin text system
Schumaker, R. P., & Chen, H. (2009) · ACM Transactions on Information Systems · doi:10.1145/1462198.1462204 · Cited by 777 · cited 1×
“Among them, classic research relies heavily on feature engineering (Schumaker and Chen, 2009; Oliveira et al., 2013).”
BackgroundDeep learning for event-driven stock prediction
Ding, X., Zhang, Y., Liu, T., & Duan, J. (2015) · International Conference on Artificial Intelligence · Cited by 685
Sentiment analysis of Twitter data for predicting stock market movements
Pagolu, V. S., Reddy, K. N., Panda, G., & Majhi, B. (2016) · 2016 International Conference on Signal Processing, Communication, Power and Embedded System (SCOPES) · doi:10.1109/scopes.2016.7955659 · Cited by 464
Technical analysis of stock trends
(1997) · Choice Reviews Online · doi:10.5860/choice.35-2224 · Cited by 361
Using Structured Events to Predict Stock Price Movement: An Empirical Investigation
Ding, X., Zhang, Y., Liu, T., & Duan, J. (2014) · Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.3115/v1/d14-1148 · Cited by 273 · cited 1×
“With the prevalence of deep neural networks (Le and Mikolov, 2014), eventdriven approaches were studied with structured event representations (Ding et al., 2014, 2015).”
MethodListening to Chaotic Whispers: A Deep Learning Framework for News-oriented Stock Trend Prediction
Hu, Z., Liu, W., Bian, J., Liu, X., & Liu, T.-Y. (2018) · Proceedings of the Eleventh ACM International Conference on Web Search and Data Mining · doi:10.1145/3159652.3159690 · Cited by 270
Topic Modeling based Sentiment Analysis on Social Media for Stock Market Prediction
Nguyen, T. H., & Shirai, K. (2015) · Proceedings of the 53rd Annual Meeting of the Association for Computational Linguistics and the 7th International Joint Conference on Natural Language Processing (Volume 1: Long Papers) · doi:10.3115/v1/p15-1131 · Cited by 246
A random walk down Wall Street: including a life-cycle guide to personal investing
(1996) · Choice Reviews Online · doi:10.5860/choice.33-4629 · Cited by 231 · cited 1×
“However, stock movement prediction is widely considered difficult due to the high stochasticity of the market: stock prices are largely driven by new information, resulting in a random-walk pattern (Malkiel, 1999).”
Deep Recurrent Generative Decoder for Abstractive Text Summarization
Li, P., Lam, W., Bing, L., & Wang, Z. (2017) · Proceedings of the 2017 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d17-1222 · Cited by 219 · cited 1×
“(10), where the likelihood term (12) Li et al. (2017) also provide a lower bound for inferring directly-connected recurrent latent variables in text summarization.”
Exploiting Topic based Twitter Sentiment for Stock Prediction
Si, J., Mukherjee, A., Liu, B., Li, Q., Li, H., & Deng, X. (2013) · doi:10.13140/2.1.3604.7043 · Cited by 210
A Hybrid Convolutional Variational Autoencoder for Text Generation
Semeniuta, S., Severyn, A., & Barth, E. (2017) · Proceedings of the 2017 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d17-1066 · Cited by 210 · cited 4×
“1976 where we adopt the KL term annealing trick (Bowman et al., 2016; Semeniuta et al., 2017) and add a linearly-increasing KL term weight λ ∈ (0, 1] to gradually release the KL regularization effect in the training procedure.”
MethodResultInfluentialVariational Neural Machine Translation
Zhang, B., Xiong, D., su, J., Duan, H., & Zhang, M. (2016) · Proceedings of the 2016 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d16-1050 · Cited by 208 · cited 6×
“Following Zhang et al. (2016), we set zt = µ′t to take out the effects of the KL term.”
BackgroundMethodInfluentialSemantic Frames to Predict Stock Price MovementPreprint
Xie, B., Passonneau, R. J., Wu, L., & Creamer, G. G. (2013) · SSRN Electronic Journal · Cited by 168
Oliveira, N., Cortez, P. C., & Areal, N. M. D. P. B. D. C. (2013) · International Conference on Web Intelligence, Mining and Semantics · doi:10.1145/2479787.2479811 · Cited by 45
Financial Markets and Monetary Policy
(2008) · Harvard University Press eBooks · doi:10.2307/j.ctv1msswkk.16 · Cited by 33
Research works printed but not linked: 3
- Steven Bird, Ewan Klein, and Edward Loper. 2009. Natural language processing with Python: analyzing text with the natural language toolkit . O'Reilly Media, Inc.
- Ronny Luss and Alexandre d'Aspremont. 2015. Predicting abnormal returns from news using text classification. Quantitative Finance 15(6):999-1012.
- Navid Rekabsaz, Mihai Lupu, Artem Baklanov, Alexander D¨ ur, Linda Andersson, and Allan Hanbury. 2017. Volatility prediction using financial disclosures sentiments with word embedding-based ir models. In Proceedings of the 55th Annual Meeting of the Association for Computational Linguistics . Vancouver, Canada, volume 1, pages 1712-1721.
Cited by
Inequality: A New Zealand Crisis
(2013) · doi:10.7810/9781927131510 · Cited by 1,215
Applications of deep learning in stock market prediction: Recent progress
Jiang, W. (2021) · Expert Systems with Applications · doi:10.1016/j.eswa.2021.115537 · Cited by 714
“…Feng et al. (2019b); Kim et al. (2019); Sezer & Ozbayoglu (2018); Dingli & Fournier (2017); Sim et al. (2019); Song et al. (2019); Liu et al. (2019c); Xu & Cohen (2018); Eapen et al. (2019); Zhan et al. (2018); Huang et al. (2018); Fischer & Krauss (2018); Althelaya et al. (2018); Gao & Chai…”
BackgroundMethodInfluentialStock Market Analysis: A Review and Taxonomy of Prediction Techniques
Shah, D., Isah, H., & Zulkernine, F. (2019) · International Journal of Financial Studies · doi:10.3390/ijfs7020026 · Cited by 465
Financial time series forecasting with multi-modality graph neural network
Cheng, D., Yang, F., Xiang, S., & Liu, J. (2022) · Pattern Recognition · doi:10.1016/j.patcog.2021.108218 · Cited by 426
PIXIU: A Large Language Model, Instruction Data and Evaluation Benchmark for FinancePreprint
Xie, Q., Han, W., Xiao, Z., Lai, Y., Peng, M., Lopez-Lira, A., & Huang, J. (2023) · arXiv (Cornell University) · doi:10.48550/arxiv.2306.05443 · Cited by 397
“We adopt three commonly-used datasets: BigData22 (Soun et al., 2022), ACL18 (Xu and Cohen, 2018), and CIKM18 (Wu et al., 2018).”
Method
Metadata
- Authors
- Xu, Y., & Cohen, S. B.
- ORCID
- Cohen, Shay B.
- Venue
- Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)
- Published
- 2018
- Pages
- 1970-1979
- ISSN
- 0736-587X (ISSN-L)
- OpenAlex
- W2798413829
- Cited by
- 434
- References
- 23
- Citations by year
- 2026: 58 · 2025: 69 · 2024: 55 · 2023: 56 · 2022: 57 · 2021: 71 · 2020: 40 · 2019: 22 · 2018: 5
- FWCI
- 51.00
- Type
- conference paper
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- cc-by
- Locations
- Proceedings of the conference - Association for Computational Linguistics. Meeting (publishedVersion, cc-by)
- Edinburgh Research Explorer (University of Edinburgh) (submittedVersion, cc-by)
- Funders
- Horizon 2020 Framework Programme
- Topics
- Social Sciences › Decision Sciences › Management Science and Operations Research › Stock Market Forecasting Methods
- Social Sciences › Economics, Econometrics and Finance › Finance › Financial Markets and Investment Strategies
- Physical Sciences › Computer Science › Artificial Intelligence › Sentiment Analysis and Opinion Mining
- Keywords
- stock movement prediction, tweets, social media sentiment, historical stock prices, deep generative models, temporal dependencies, financial market forecasting
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.