The DOI matches its Crossref record; 89 of the 89 references it cites were found in a registry or an index.
Predicting short-term stock prices using ensemble methods and online data sources
Abstract
Abstract With the ubiquity of the Internet, platforms such as: Google, Wikipedia and the like can provide insights pertaining to firms’ financial performance as well as capture the collective interest of traders through search trends, number of web page visitors and/or financial news sentiment. Information emanating from these platforms can significantly affect, or be affected by, changes in the stock market. The overarching goal of this paper is to develop a financial expert system that incorporates these features to predict short term stock prices. Our expert system is comprised of two main modules: a knowledge base and an artificial intelligence (AI) platform. The “knowledge base” for our expert system captures: (a) historical stock prices; (b) several well-known technical indicators; (c) counts and sentiment scores of published news articles for a given stock; (d) trends in Google searches for the given stock ticker; and (e) number of unique visitors for pertinent Wikipedia pages. Once the data is collected, we use a structured approach for data preparation. Then, the AI platform trains four machine learning ensemble methods: (a) a neural network regression ensemble; (b) a support vector regression ensemble; (c) a boosted regression tree; and (d) a random forest regression. In the cross-validation phase, the AI platform picks the “best” ensemble for a given stock. To evaluate the efficacy of our expert system, we first present a case study based on the Citi Group stock ($C) with data collected from 01/01/2013 - 12/31/2016. We show the expert system can predict the 1-day ahead $C stock price with a mean absolute percent error (MAPE) ≤ 1.50% and the 1–10 day ahead with a MAPE ≤ 1.89%, which is better than the reported results in the literature. We show that the use of features extracted from online sources does not substitute the traditional financial metrics, but rather supplements them to improve upon the prediction performance of machine learning based methods. To highlight the utility and generalizability of our expert system, we predict the 1-day ahead price of 19 additional stocks from different industries, volatilities and growth patterns. We report an overall mean for the MAPE statistic of 1.07% across our five different machine learning models, including a MAPE of under 0.75% for 18 of the 19 stocks for the best ensemble (boosted regression tree).
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
R: A Language and Environment for Statistical Computing
R Core Team (2025) · doi:10.32614/r.manuals · Cited by 352,181
Breiman, L. (2001) · Machine Learning · doi:10.1023/a:1010933404324 · Cited by 133,538
LeCun, Y., Bengio, Y., & Hinton, G. (2015) · Nature · doi:10.1038/nature14539 · Cited by 84,126
Cortes, C., & Vapnik, V. (1995) · Machine Learning · doi:10.1007/bf00994018 · Cited by 59,421
The Elements of Statistical Learning
Hastie, T., Friedman, J., & Tibshirani, R. (2001) · Springer Series in Statistics · doi:10.1007/978-0-387-21606-5 · Cited by 24,162
A decision-theoretic generalization of on-line learning and an application to boosting
Freund, Y., & Schapire, R. E. (1997) · Journal of Computer and System Sciences · doi:10.1006/jcss.1997.1504 · Cited by 20,466
A logical calculus of the ideas immanent in nervous activity
McCulloch, W. S., & Pitts, W. (1943) · The Bulletin of Mathematical Biophysics · doi:10.1007/bf02478259 · Cited by 18,566
Learning Internal Representations by Error Propagation
Rumelhart, D. E., Hinton, G. E., & Williams, R. J. (1985) · doi:10.21236/ada164453 · Cited by 16,172
Advances in neural information processing systems 7
(1996) · Computers & Mathematics with Applications · doi:10.1016/s0898-1221(96)90463-0 · Cited by 14,281
A training algorithm for optimal margin classifiers
Boser, B. E., Guyon, I. M., & Vapnik, V. N. (1992) · Proceedings of the fifth annual workshop on Computational learning theory · doi:10.1145/130385.130401 · Cited by 11,992
(2016) · Cited by 11,679
Analysis of a complex of statistical variables into principal components.
Hotelling, H. (1933) · Journal of Educational Psychology · doi:10.1037/h0071325 · Cited by 9,633
The Behavior of Stock-Market Prices
Fama, E. F. (1965) · The Journal of Business · doi:10.1086/294743 · Cited by 8,664
Ensemble methods in machine learning
Dietterich, T. G. (2000) · Lecture Notes in Computer Science · doi:10.1007/3-540-45014-9_1 · Cited by 8,408
Hearst, M. A., Dumais, S. T., Osuna, E., Platt, J., & Scholkopf, B. (1998) · IEEE Intelligent Systems and their Applications · doi:10.1109/5254.708428 · Cited by 7,243
Twitter mood predicts the stock market
Bollen, J., Mao, H., & Zeng, X. (2011) · Journal of Computational Science · doi:10.1016/j.jocs.2010.12.007 · Cited by 5,206
Giving content to investor sentiment: The role of media in the stock market
TETLOCK, P. C. (2007) · The Journal of Finance · doi:10.1111/j.1540-6261.2007.01232.x · Cited by 4,827
Support Vector Regression Machines
Drucker, H., Burges, C. J. C., Kaufman, L., Smola, A. J., & Vapnik, V. N. (1996) · Cited by 4,658
The Strength of Weak Learnability
Schapire, R. E. (1990) · Machine Learning · doi:10.1007/bf00116037 · Cited by 4,600
MacKay, D. J. C. (1992) · Neural Computation · doi:10.1162/neco.1992.4.3.415 · Cited by 4,388
A survey of cross-validation procedures for model selection
Arlot, S., & Célisse, A. (2010) · LillOA (Université de Lille (University Of Lille)) · Cited by 3,669
The Adjustment of Stock Prices to New Information
Fama, E. F., Fisher, L., Jensen, M. C., & Roll, R. (1969) · International Economic Review · doi:10.2307/2525569 · Cited by 3,575
A survey of cross-validation procedures for model selection
Arlot, S., & Celisse, A. (2010) · Statistics Surveys · doi:10.1214/09-ss054 · Cited by 3,522
Valiant, L. G. (1984) · Communications of the ACM · doi:10.1145/1968.1972 · Cited by 3,279
The Adjustment of Stock Prices to New Information
Fama, E. F., Fisher, L., Jensen, M. C., & Roll, R. W. (2003) · SSRN Electronic Journal · doi:10.2139/ssrn.321524 · Cited by 3,063
Popular Ensemble Methods: An Empirical Study
Opitz, D., & Maclin, R. (1999) · Journal of Artificial Intelligence Research · doi:10.1613/jair.614 · Cited by 2,953
Dietterich, T. G. (2000) · Machine Learning · doi:10.1023/a:1007607513941 · Cited by 2,941
Beyond Regression : "New Tools for Prediction and Analysis in the Behavioral Sciences
Werbos, P. J. (1974) · Medical Entomology and Zoology · Cited by 2,789
The Efficient Market Hypothesis and Its Critics
Malkiel, B. G. (2003) · Journal of Economic Perspectives · doi:10.1257/089533003321164958 · Cited by 2,161
The Boosting Approach to Machine Learning: An Overview
Schapire, R. E. (2003) · Lecture Notes in Statistics · doi:10.1007/978-0-387-21579-2_9 · Cited by 2,003
Quinlan, J. R. (1996) · National Conference on Artificial Intelligence · Cited by 1,586
Gauss-Newton approximation to Bayesian learning
Dan Foresee, F., & Hagan, M. T. (2002) · Proceedings of International Conference on Neural Networks (ICNN'97) · doi:10.1109/icnn.1997.614194 · Cited by 1,390
Patel, J., Shah, S., Thakkar, P., & Kotecha, K. (2015) · Expert Systems with Applications · doi:10.1016/j.eswa.2014.07.040 · Cited by 1,141
A Survey of Dimension Reduction Techniques
Fodor, I. K. (2002) · doi:10.2172/15002155 · Cited by 1,116
Constructivist and Ecological Rationality in Economics
Smith, V. L. (2003) · American Economic Review · doi:10.1257/000282803322156954 · Cited by 960
Quantifying Trading Behavior in Financial Markets Using Google Trends
Preis, T., Moat, H. S., & Stanley, H. E. (2013) · Scientific Reports · doi:10.1038/srep01684 · Cited by 948
The Random Character of Stock Market Prices
Rosett, R. N., & Cootner, P. H. (1968) · Econometrica · doi:10.2307/1909613 · Cited by 926
Kara, Y., Acar Boyacioglu, M., & Baykan, Ö. K. (2011) · Expert Systems with Applications · doi:10.1016/j.eswa.2010.10.027 · Cited by 877
Chong, E., Han, C., & Park, F. C. (2017) · Expert Systems with Applications · doi:10.1016/j.eswa.2017.04.030 · Cited by 834
Using artificial neural network models in stock market index prediction
Guresen, E., Kayakutlu, G., & Daim, T. U. (2011) · Expert Systems with Applications · doi:10.1016/j.eswa.2011.02.068 · Cited by 786
Textual analysis of stock market prediction using breaking financial news: The AZFin text system
Schumaker, R. P., & Chen, H. (2009) · ACM Transactions on Information Systems · doi:10.1145/1462198.1462204 · Cited by 777
(1999) · Choice Reviews Online · doi:10.5860/choice.36-4016 · Cited by 771
Kim, K.-J., & Han, I. (2000) · Expert Systems with Applications · doi:10.1016/s0957-4174(00)00027-0 · Cited by 757
Wang, L., Zeng, Y., & Chen, T. (2015) · Expert Systems with Applications · doi:10.1016/j.eswa.2014.08.018 · Cited by 631
Sentiment analysis on social media for stock movement prediction
Nguyen, T. H., Shirai, K., & Velcin, J. (2015) · Expert Systems with Applications · doi:10.1016/j.eswa.2015.07.052 · Cited by 624
Evaluating multiple classifiers for stock price direction prediction
Ballings, M., Van den Poel, D., Hespeels, N., & Gryp, R. (2015) · Expert Systems with Applications · doi:10.1016/j.eswa.2015.05.013 · Cited by 611
Predicting stock market index using fusion of machine learning techniques
Patel, J., Shah, S., Thakkar, P., & Kotecha, K. (2015) · Expert Systems with Applications · doi:10.1016/j.eswa.2014.10.031 · Cited by 608
(1995) · Manufacturing Engineer · doi:10.1049/me:19950308 · Cited by 601
Proceedings of the fifth annual workshop on Computational learning theory
(1992) · doi:10.1145/130385 · Cited by 560
Social Mood and Financial Economics
Nofsinger, J. R. (2005) · Journal of Behavioral Finance · doi:10.1207/s15427579jpfm0603_4 · Cited by 533
A Bayesian regularized artificial neural network for stock market forecasting
Ticknor, J. L. (2013) · Expert Systems with Applications · doi:10.1016/j.eswa.2013.04.013 · Cited by 517
Recurrent neural network and a hybrid model for prediction of stock returns
Rather, A. M., Agarwal, A., & Sastry, V. N. (2015) · Expert Systems with Applications · doi:10.1016/j.eswa.2014.12.003 · Cited by 505
Forecasting stock indices with back propagation neural network
Wang, J.-Z., Wang, J.-J., Zhang, Z.-G., & Guo, S.-P. (2011) · Expert Systems with Applications · doi:10.1016/j.eswa.2011.04.222 · Cited by 487
A Theory of Pattern Recognition
Амари, Ш.-И. (1968) · Jidō seigyo/Jido seigyo · Cited by 443
Stock market prediction of S&P 500 via combination of improved BCO approach and BP neural network
Zhang, Y., & Wu, L. (2009) · Expert Systems with Applications · doi:10.1016/j.eswa.2008.11.028 · Cited by 423
Oliveira, N., Cortez, P., & Areal, N. (2017) · Expert Systems with Applications · doi:10.1016/j.eswa.2016.12.036 · Cited by 398
Nonlinear Estimation and Classification
(2003) · Lecture Notes in Statistics · doi:10.1007/978-0-387-21579-2 · Cited by 390
Chen, Y., & Hao, Y. (2017) · Expert Systems with Applications · doi:10.1016/j.eswa.2017.02.044 · Cited by 382
Tsai, C.-F., & Hsiao, Y.-C. (2010) · Decision Support Systems · doi:10.1016/j.dss.2010.08.028 · Cited by 377
Stock index forecasting based on a hybrid model
Wang, J.-J., Wang, J.-Z., Zhang, Z.-G., & Guo, S.-P. (2012) · Omega · doi:10.1016/j.omega.2011.07.008 · Cited by 376
A fusion model of HMM, ANN and GA for stock market forecasting
Hassan, M. R., Nath, B., & Kirley, M. (2007) · Expert Systems with Applications · doi:10.1016/j.eswa.2006.04.007 · Cited by 360
Integrating metaheuristics and Artificial Neural Networks for improved stock price prediction
Göçken, M., Özçalıcı, M., Boru, A., & Dosdoğru, A. T. (2016) · Expert Systems with Applications · doi:10.1016/j.eswa.2015.09.029 · Cited by 324
Khadjeh Nassirtoussi, A., Aghabozorgi, S., Ying Wah, T., & Ngo, D. C. L. (2015) · Expert Systems with Applications · doi:10.1016/j.eswa.2014.08.004 · Cited by 275
The Random Character of Stock Market Prices.
Markowitz, H. M., & Cootner, P. H. (1965) · Journal of the American Statistical Association · doi:10.2307/2283173 · Cited by 267
An empirical evaluation of bagging and boosting
Maclin, R., & Opitz, D. W. (1997) · Cited by 265
Stock market prediction with multiple classifiers
Qian, B., & Rasheed, K. (2007) · Applied Intelligence · doi:10.1007/s10489-006-0001-7 · Cited by 237
Stock market one-day ahead movement prediction using disparate data sources
Weng, B., Ahmed, M. A., & Megahed, F. M. (2017) · Expert Systems with Applications · doi:10.1016/j.eswa.2017.02.041 · Cited by 237
Self-citationShort-term stock price prediction based on echo state networks
Lin, X., Yang, Z., & Song, Y. (2009) · Expert Systems with Applications · doi:10.1016/j.eswa.2008.09.049 · Cited by 203
Bridging the divide in financial market forecasting: machine learners vs. financial economists
Hsu, M.-W., Lessmann, S., Sung, M.-C., Ma, T., & Johnson, J. E. V. (2016) · Expert Systems with Applications · doi:10.1016/j.eswa.2016.05.033 · Cited by 195
Volatility forecast using hybrid Neural Network models
Kristjanpoller, W., Fadic, A., & Minutolo, M. C. (2014) · Expert Systems with Applications · doi:10.1016/j.eswa.2013.09.043 · Cited by 181
Predicting stock returns by classifier ensembles
Tsai, C.-F., Lin, Y.-C., Yen, D. C., & Chen, Y.-M. (2011) · Applied Soft Computing · doi:10.1016/j.asoc.2010.10.001 · Cited by 169
Automated trading with performance weighted random forests and seasonality
Booth, A., Gerding, E., & McGroarty, F. (2014) · Expert Systems with Applications · doi:10.1016/j.eswa.2013.12.009 · Cited by 154
Geva, T., & Zahavi, J. (2013) · Decision Support Systems · doi:10.1016/j.dss.2013.09.013 · Cited by 139
Kao, L., Chiu, C., Lu, C.-J., & Yang, J.-L. (2012) · Neurocomputing · doi:10.1016/j.neucom.2012.06.037 · Cited by 138
Stock Price Prediction Using K-Nearest Neighbor (kNN) Algorithm
Al‐Khatib, K., Najadat, H., Hmeidi, I., & Shatnawi, M. K. A. (2013) · Cited by 132
The Financial/Economic Dichotomy in Social Behavioral Dynamics: The Socionomic Perspective
Prechter, R. R., & Parker, W. D. (2007) · Journal of Behavioral Finance · doi:10.1080/15427560701381028 · Cited by 131
Boosting a weak learning algorithm by majority
Freund, Y. (1990) · Conference on Learning Theory · doi:10.5555/92571.92640 · Cited by 130
Combining News and Technical Indicators in Daily Stock Price Trends Prediction
Zhai, Y., Hsu, A. L., & Halgamuge, S. K. (2007) · Lecture notes in computer science · doi:10.1007/978-3-540-72395-0_132 · Cited by 129
Flexible neural trees ensemble for stock index modeling
Chen, Y., Yang, B., & Abraham, A. (2007) · Neurocomputing · doi:10.1016/j.neucom.2006.10.005 · Cited by 121
Learning boolean formulae or finite automata is as hard as factoring
Kearns, M. J. (1988) · Medical Entomology and Zoology · Cited by 109
Developing an approach to evaluate stocks by forecasting effective features with data mining methods
Barak, S., & Modarres, M. (2014) · Expert Systems with Applications · doi:10.1016/j.eswa.2014.09.026 · Cited by 98
Predicting stock market price using support vector regression
Meesad, P., & Rasel, R. I. (2013) · International Conference on Informatics, Electronics & Vision (ICIEV) · doi:10.1109/iciev.2013.6572570 · Cited by 89
Statistical Perspectives on “Big Data”
Megahed, F. M., & Jones‐Farmer, L. A. (2015) · Springer eBooks · doi:10.1007/978-3-319-12355-4_3 · Cited by 63
Self-citationSpatial Sign Preprocessing: A Simple Way To Impart Moderate Robustness to Multivariate Estimators
Serneels, S., Nolf, E. D., & Espen, P. J. V. (2006) · Journal of Chemical Information and Modeling · doi:10.1021/ci050498u · Cited by 61
A hybrid model for high-frequency stock market forecasting
Araújo, R. D. A., Oliveira, A. L. I., & Meira, S. R. D. L. (2015) · Expert Systems with Applications · doi:10.1016/j.eswa.2015.01.004 · Cited by 52
Khansa, L., & Liginlal, D. (2011) · Decision Support Systems · doi:10.1016/j.dss.2011.01.010 · Cited by 42
Neural network ensemble for financial trend prediction
Abdullah, M. H. L., & Ganapathy, V. (2002) · doi:10.1109/tencon.2000.892242 · Cited by 27
Noise peeling methods to improve boosting algorithms
Martinez, W. G., & Gray, J. B. (2015) · Computational Statistics & Data Analysis · doi:10.1016/j.csda.2015.06.010 · Cited by 18
Self-citationValiant, L. G. (2026) · Foundations of Computation and Machine Learning · doi:10.1145/3749740.3749746
Cited by
Ribeiro, M. H. D. M., & dos Santos Coelho, L. (2020) · Applied Soft Computing · doi:10.1016/j.asoc.2019.105837 · Cited by 525
Short-term stock market price trend prediction using a comprehensive deep learning system
Shen, J., & Shafiq, M. O. (2020) · Journal of Big Data · doi:10.1186/s40537-020-00333-6 · Cited by 380
Portfolio optimization with return prediction using deep learning and machine learning
Ma, Y., Han, R., & Wang, W. (2021) · Expert Systems with Applications · doi:10.1016/j.eswa.2020.113973 · Cited by 297
Multi-output bus travel time prediction with convolutional LSTM neural network
Petersen, N. C., Rodrigues, F., & Pereira, F. C. (2019) · Expert Systems with Applications · doi:10.1016/j.eswa.2018.11.028 · Cited by 288
A Random Forests Approach to Predicting Clean Energy Stock Prices
Sadorsky, P. (2021) · Journal of Risk and Financial Management · doi:10.3390/jrfm14020048 · Cited by 138
Metadata
- Authors
- Weng, B., Lu, L., Wang, X., Megahed, F. M., & Martinez, W.
- Venue
- Expert Systems with Applications
- Publisher
- Elsevier BV
- Published
- 2018-12
- Volume
- 112
- Pages
- 258-273
- ISSN
- 0957-4174 (ISSN-L)
- OpenAlex
- W2808626748
- Cited by
- 278
- References
- 89
- FWCI
- 24.19
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.