A machine learning approximation of the 2015 Portuguese high school student grades: A hybrid approach
Open accessThe DOI matches its Crossref record; 12 of the 12 references it cites were found in a registry or an index.
Abstract
This article uses an anonymous 2014–15 school year dataset from the Directorate-General for Statistics of Education and Science (DGEEC) of the Portuguese Ministry of Education as a means to carry out a predictive power comparison between the classic multilinear regression model and a chosen set of machine learning algorithms. A multilinear regression model is used in parallel with random forest, support vector machine, artificial neural network and extreme gradient boosting machine stacking ensemble implementations. Designing a hybrid analysis is intended where classical statistical analysis and artificial intelligence algorithms are blended to augment the ability to retain valuable conclusions and well-supported results. The machine learning algorithms attain a higher level of predictive ability. In addition, the stacking appropriateness increases as the base learner output correlation matrix determinant increases and the random forest feature importance empirical distributions are correlated with the structure of p-values and the statistical significance test ascertains of the multiple linear model. An information system that supports the nationwide education system should be designed and further structured to collect meaningful and precise data about the full range of academic achievement antecedents. The article concludes that no evidence is found in favour of smaller classes.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Breiman, L. (2001) · Machine Learning · doi:10.1023/a:1010933404324 · Cited by 133,538
The perceptron: A probabilistic model for information storage and organization in the brain.
Rosenblatt, F. (1958) · Psychological Review · doi:10.1037/h0042519 · Cited by 12,280
Wolpert, D. H. (1992) · Neural Networks · doi:10.1016/s0893-6080(05)80023-1 · Cited by 7,951 · cited 1×
“Inthe stacking ensemble learning technique, the base level models are trained through a complete training set, and the meta-model is trained on the outputs of the base level models (Wolpert 1992).”
MethodSocioeconomic Status and Academic Achievement: A Meta-Analytic Review of Research
Sirin, S. R. (2005) · Review of Educational Research · doi:10.3102/00346543075003417 · Cited by 4,687 · cited 2×
“Indeed, the differences between publicly funded schools in terms of physical conditions and teacher capabilities are almost inexistent, decreasing the effect of school choice on AA that is typically driven by socio-economical differences (Sirin 2005).”
BackgroundTeachers, Schools, and Academic Achievement
Rivkin, S. G., Hanushek, E. A., & Kain, J. F. (2005) · Econometrica · doi:10.1111/j.1468-0262.2005.00584.x · Cited by 4,501
Parental Involvement and Students' Academic Achievement: A Meta-Analysis
Fan, X., & Chen, M. (2001) · Educational Psychology Review · doi:10.1023/a:1009048817385 · Cited by 2,648
The Impact of Individual Teachers on Student Achievement: Evidence from Panel Data
Rockoff, J. E. (2004) · American Economic Review · doi:10.1257/0002828041302244 · Cited by 2,432 · cited 1×
“Teacher quality, measured by teacher panel data fixed effects on student outcomes, has a positive relationship with AA (Aaronson et al. 2007; Rockoff 2004).”
BackgroundTeacher characteristics and student achievement gains: A review
Wayne, A. J., & Youngs, P. (2003) · Review of Educational Research · doi:10.3102/00346543073001089 · Cited by 1,282
Experimental Estimates of Education Production Functions
Krueger, A. B. (1999) · The Quarterly Journal of Economics · doi:10.1162/003355399556052 · Cited by 1,120
The Loss Surfaces of Multilayer Networks
Choromanska, A., Henaff, M., Mathieu, M., Arous, G. B., & LeCun, Y. (2014) · arXiv · doi:10.48550/arxiv.1412.0233 · Cited by 733
Research works printed but not linked: 57
- Aaronson, D., Barrow, L., & Sander, W. (2007). Teachers and student achievement in the Chicago public high schools. Journal of Labor Economics, 25, 95–135. · DOI · Paper page
- Amit, Y., & Geman, D. (1997). Shape quantization and recognition with randomized trees. Neural Computation, 9, 1545–1588. · DOI · Paper page
- Basheer, I. A., & Hajmeer, M. (2000). Artificial neural networks: Fundamentals, computing, design, and application. Journal of Microbiological Methods, 43, 3–31. · DOI · Paper page
- Becker, G. S. (1964). Human capital, a theoretical and empirical analysis with special reference to education. In General series (National Bureau of economic research) (vol. 80). New York: National Bureau of Economic Research : Distributed by Columbia University Press.
- Benner, A. D., Boyle, A. E., & Sadler, S. (2016). Parental involvement and adolescents’ educational success: The roles of prior achievement and socioeconomic status. Journal of Youth and Adolescence, 45, 1053–1064. · DOI · Paper page
- Bergstra, J., & Bengio, Y. (2012). Random search for hyper-parameter optimization. Journal of Machine Learning Research, 13, 281–305.
- Bishop, C. M. (2006). Pattern recognition and machine learning, Information Science and Statistics. Berlin: Springer.
- Breiman, L. (1996a). Bagging predictors. Machine Learning, 24, 123–140.
- Breiman, L. (1996b). Stacked regressions. Machine Learning, 24, 49–64.
- Briscoe, E., & Feldman, J. (2011). Conceptual complexity and the bias/variance tradeoff. Cognition, 118, 2–16. · DOI · Paper page
- Chang, C.-C., & Lin, C.-J. (2007). Libsvm: A library for support vector machines. ACM Transactions on Intelligent Systems and Technology, 2, Article No: 27.
- Chen, T., & Guestrin, C. (2016). XGBoost: A scalable tree boosting system. In Proceedings of the ACM SIGKDD International Conference on Knowledge Discovery and Data Mining August 2016 (pp. 785–794). · DOI · Paper page
- Cruz-Jesus, F., Castelli, M., Oliveira, T., Mendes, R., Nunes, C., Sa-Velho, M., & Rosa-Louro, A. (2020). Using artificial intelligence methods to assess academic achievement in public high schools of a European Union country. Heliyon, 6, e04081. · DOI · Paper page
- Di Fabio, A., & Busoni, L. (2007). Fluid intelligence, personality traits and scholastic success: Empirical evidence in a sample of Italian high school students. Personality and Individual Differences, 43, 2095–2104. · DOI
- Francis, B. (2005). Reassessing gender and achievement, Questioning contemporary key debates. New York: Routledge. · DOI · Paper page
- Friedman, J. H. (2001). Greedy function approximation: A gradient boosting machine. The Annals of Statistics, 29, 1189–1232. · DOI · Paper page
- Gilar-Corbi, R., Miñano, P., Veas, A., & Castejón, J. L. (2019). Testing for invariance in a structural model of academic achievement across underachieving and non-underachieving students. Contemporary Educational Psychology, 59, 101780. · DOI
- Hanushek, E. A., & Wößmann, L. (2010). Education and economic growth, international encyclopedia of education. Oxford: Elsevier.
- Hastie, T., Tibshirani, R., & Friedman, J. (2008). The elements of statistical learning: Data mining, inference, and prediction second editon. Springer.
- Haykin, S. (2009). Neural networks and learning machines third edition. Pearson.
- Hill, N. E., & Taylor, L. C. (2004). Parental school involvement and children’s academic achievement pragmatics and issues. Current Directions in Psychological Science, 13, 161–164. · DOI · Paper page
- Hoxby, C. M. (2000). The effects of class size on student achievement : New evidence from population variation. Quarterly Journal of Economics, 115, 1239–1285. · DOI · Paper page
- James, G., Witten, D., Hastie, T., & Tibshirani, R. (2013). An introduction to statistical learning with applications in R. Springer Texts in Statistics: Springer. · DOI · Paper page
- Jensen, A. R. (1998). The G factor: The science of mental ability. London: Praeger.
- King, R. B. (2016). Gender differences in motivation, engagement and achievement are related to students’ perceptions of peer—But not of parent or teacher—Attitudes toward school. Learning and Individual Differences, 52, 60–71. · DOI
- Kuhfeld, M., Gershoff, E., & Paschall, K. (2018). The development of racial/ethnic and socioeconomic achievement gaps during the school years. Journal of Applied Developmental Psychology, 57, 62–73. · DOI
- Lei, J., & Zhao, Y. (2007). Technology uses and student achievement: A longitudinal study. Computers in Education, 49, 284–296. · DOI · Paper page
- Leithwood, K., & Jantzi, D. (2009). A review of empirical evidence about school size effects : A policy perspective. Review of Educational Research, 79, 464–490. · DOI · Paper page
- Levels, M., Kraaykamp, G., & Dronkers, J. (2008). Immigrant children’s educational achievement in western countries: Origin, destination, and community effects on mathematical performance. American Sociological Review, 73, 835–853. · DOI · Paper page
- Lupart, J. L., Cannon, E., & Telfer, J. A. (2004). Gender differences in adolescent academic achievement, interests, values and life-role expectations. High Ability Studies, 15, 25–42. · doi:10.1080/1359813042000225320
- Mengash, H. A. (2020). Using data mining techniques to predict student performance to support decision making in university admission systems. IEEE Access, 8, 55462–55470. · DOI · Paper page
- Mensah, F. K., & Kiernan, K. E. (2010). Gender differences in educational attainment: Influences of the family environment. British Educational Research Journal, 36, 239–260. · DOI
- Miguéis, V. L., Freitas, A., Garcia, P. J. V., & Silva, A. (2018). Early segmentation of students according to their academic performance: A predictive modelling approach. Decision Support Systems, 115, 36–51. · DOI · Paper page
- Mohri, M., Rostamizadeh, A., & Talwalkar, A. (2018). Foundations of machine learning second edition. In F. Bach (Ed.), Adaptive computation and machine learning series. MIT Press.
- Murphy, K. P. (2012). Machine learning: A probabilistic perspective. Cambridge: MIT Press.
- Musso, M. F., Hernández, C. F. R., & Cascallar, E. C. (2020). Predicting key educational outcomes in academic trajectories: A machine-learning approach. Higher Education. · DOI · Paper page
- Nievergelt, J. (2000). Exhaustive search, combinatorial optimization and enumeration : Exploring the potential of raw computing power. In V. Hlaváč, K. G. Jeffery, & J. Wiedermann (Eds.), Lecture notes in computer science vol. 1963, SOFSEM 2000: Theory and practice of informatics - 27th Conference on Current Trends in Theory and Practice of Informatics Milovy, Czech Republic, November 25 – December 2, 2000 proceedings (pp. 18–35). Springer. · DOI
- OEDC. (2016). PISA 2015 volume I: Results excellence and equity in education. Paris: OECD Publishing.
- Opdenakker, M. C., & Van Damme, J. (2007). Do school context, student composition and school leadership affect school practice and outcomes in secondary education? British Educational Research Journal, 33, 179–206. · DOI · Paper page
- Pedregosa, F., Varoquaux, G., Gramfort, A., Michel, V., Thirion, B., Grisel, O., Blondel, M., Prettenhoffer, P., Weiss, R., Dubourg, V., Vanderplas, J., Passos, A., Cournapeau, D., Brucher, M., Perrot, M., & Duchesnay, É. (2011). Scikit-learn: Machine learning in Python. Journal of Machine Learning Research, 12, 2825–2830.
- Perreira, K. M., Harris, K. M., & Lee, D. (2006). Making it in America: High school completion by immigrant and native youth. Demography, 43, 511–536. · DOI · Paper page
- Ramchoun, H., Idrissi, M. A. J., Ghanou, Y., & Ettaouil, M. (2016). Multilayer perceptron: Architecture optimization and training. International Journal of Interactive Multimedia and Artificial Intelligence, 4, 26. · DOI · Paper page
- Rivas-Perea, P., Cota-Ruiz, J., Chaparro, D. G., Venzor, J. A. P., Carreón, A. Q., & Rosiles, J. G. (2013). Support vector Machines for Regression: A succinct review of large-scale and linear programming formulations. International Journal of Intelligent Science, 03, 5–14. · doi:10.4236/ijis.2013.31002
- Rohde, T. E., & Thompson, L. A. (2007). Predicting academic achievement with cognitive ability. Intelligence, 35, 83–92. · DOI · Paper page
- Rumelhart, D. E., Hinton, G. E., & Williams, R. J. (1986). Learning internal representations by error propagation, in: Parallel distributed processing: Explorations in the microstructure of cognition volume I: Foundations Institute for Cognitive Science University of California, San Diego. London: MIT Press.
- Salomon, A., & Ben-David Kolikant, Y. (2016). High-school students’ perceptions of the effects of non-academic usage of ICT on their academic achievements. Computers in Human Behavior, 64, 143–151. · DOI
- Schapire, R. E. (2003). The boosting approach to machine learning: An overview. In D. D. Denison, M. H. Hansen, C. C. Holmes, B. Mallick, & B. Yu (Eds.), Nonlinear estimation and classification. Lecture notes in statistics, vol 171 (pp. 149–171). New York: Springer. · DOI · Paper page
- Schwartz, A. E., Stiefel, L., & Wiswall, M. (2013). Do small schools improve performance in large, urban districts? Causal evidence from New York City. Journal of Urban Economics, 77, 27–40. · DOI
- Smola, A. J., & Scholkopf, B. (2004). A tutorial on support vector regression. Statistics and Computing, 199–222. · DOI · Paper page
- Sorensen, L. C. (2019). “Big data” in educational administration: An application for predicting school dropout risk. Educational Administration Quarterly, 55, 404–446. · DOI
- Steinmayr, R., Dinger, F. C., & Spinath, B. (2010). Parents’ education and Children’s achievement: The role of personality. European Journal of Personality, 24, 535–550. · DOI · Paper page
- Strenze, T. (2007). Intelligence and socioeconomic success: A meta-analytic review of longitudinal research. Intelligence, 35, 401–426. · DOI · Paper page
- Tesfagiorgis, M., Tsegai, S., Mengesha, T., Craft, J., & Tessema, M. (2020). The correlation between parental socioeconomic status (SES) and children’s academic achievement: The case of Eritrea. Children and Youth Services Review, 116, 105242. · DOI
- Tibshirani, R. (1997). The lasso method for variable selection in the cox model. Statistics in Medicine, 16, 385–395. · doi:10.1002/(sici)1097-0258(19970228)16:4<385::aid-sim380>3.0.co;2-3
- Tomul, E., & Savasci, H. S. (2012). Socioeconomic determinants of academic achievement. Educational Assessment, Evaluation and Accountability, 24, 175–187. · DOI
- Woolner, P., Hall, E., Higgins, S., McCaughey, C., & Wall, K. (2007). A sound foundation? What we know about the impact of environments on learning and the implications for Building Schools for the Future. Oxford Review of Education, 33, 47–70. · DOI · Paper page
- Wößmann, L., & West, M. (2006). Class-size effects in school systems around the world: Evidence from between-grade variation in TIMSS. European Economic Review, 50, 695–736. · DOI · Paper page
Cited by
A Review of Artificial Intelligence (AI) in Education from 2010 to 2020
Zhai, X., Chu, X., Chai, C. S., Jong, M. S. Y., Istenic, A., Spector, M., Liu, J.-B., Yuan, J., & Li, Y. (2021) · Complexity · doi:10.1155/2021/8812542 · Cited by 1,364
“[86] REA Multilinear regression model High school grades Educational data collection from preschool, primary, and high school EXP OUT+”
MethodChiu, T. K. F., Xia, Q., Zhou, X., Chai, C. S., & Cheng, M. (2023) · Computers and Education: Artificial Intelligence · doi:10.1016/j.caeai.2022.100118 · Cited by 1,181
Chiu, T. K. F. (2024) · Interactive Learning Environments · doi:10.1080/10494820.2023.2253861 · Cited by 852
Yağcı, M. (2022) · Smart Learning Environments · doi:10.1186/s40561-022-00192-z · Cited by 698
Future research recommendations for transforming higher education with generative AI
Chiu, T. K. F. (2024) · Computers and Education: Artificial Intelligence · doi:10.1016/j.caeai.2023.100197 · Cited by 511
Metadata
- Authors
- Costa-Mendes, R., Oliveira, T., Castelli, M., & Cruz-Jesus, F.
- Venue
- Education and Information Technologies
- Published
- 2020-09-05
- Volume
- 26
- Issue
- 2
- Pages
- 1527-1547
- ISSN
- 1360-2357 (ISSN-L)
- 1573-7608
- OpenAlex
- W3083548488
- Cited by
- 83
- References
- 12
- FWCI
- 9.78
- Type
- journal article
- Language
- en
- Open access
- hybrid
- Licence
- creativecommons.org/licenses/by/4.0 (tdm)
- creativecommons.org/licenses/by/4.0 (vor)
- Funders
- Fundação para a Ciência e a Tecnologia (DSAIPA/DS/0032/2018)
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: A machine learning approximation of the 2015 Portuguese high school student grades: A hybrid approach. https://app.cochat.ai/papers/10.1007/s10639-020-10316-y
- The paper
- Costa-Mendes, R., Oliveira, T., Castelli, M., & Cruz-Jesus, F. (2021). A machine learning approximation of the 2015 Portuguese high school student grades: A hybrid approach. Education and Information Technologies. https://doi.org/10.1007/s10639-020-10316-y
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.