CoChat

A machine learning approximation of the 2015 Portuguese high school student grades: A hybrid approach

Open access
Costa-Mendes, Ricardo, Oliveira, Tiago, Castelli, Mauro, Cruz-Jesus, Frederico · 2021 · Education and Information Technologies
Cited by 83

The DOI matches its Crossref record; 12 of the 12 references it cites were found in a registry or an index.

Abstract

This article uses an anonymous 2014–15 school year dataset from the Directorate-General for Statistics of Education and Science (DGEEC) of the Portuguese Ministry of Education as a means to carry out a predictive power comparison between the classic multilinear regression model and a chosen set of machine learning algorithms. A multilinear regression model is used in parallel with random forest, support vector machine, artificial neural network and extreme gradient boosting machine stacking ensemble implementations. Designing a hybrid analysis is intended where classical statistical analysis and artificial intelligence algorithms are blended to augment the ability to retain valuable conclusions and well-supported results. The machine learning algorithms attain a higher level of predictive ability. In addition, the stacking appropriateness increases as the base learner output correlation matrix determinant increases and the random forest feature importance empirical distributions are correlated with the structure of p-values and the statistical significance test ascertains of the multiple linear model. An information system that supports the nationwide education system should be designed and further structured to collect meaningful and precise data about the full range of academic achievement antecedents. The article concludes that no evidence is found in favour of smaller classes.

Overview

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1007/s10639-020-10316-y

Cites

12 of 12 references verified0 citation errors · 0 not checkable

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Show all 12 references

Research works printed but not linked: 57

  1. Aaronson, D., Barrow, L., & Sander, W. (2007). Teachers and student achievement in the Chicago public high schools. Journal of Labor Economics, 25, 95–135. · DOI · Paper page
  2. Amit, Y., & Geman, D. (1997). Shape quantization and recognition with randomized trees. Neural Computation, 9, 1545–1588. · DOI · Paper page
  3. Basheer, I. A., & Hajmeer, M. (2000). Artificial neural networks: Fundamentals, computing, design, and application. Journal of Microbiological Methods, 43, 3–31. · DOI · Paper page
  4. Becker, G. S. (1964). Human capital, a theoretical and empirical analysis with special reference to education. In General series (National Bureau of economic research) (vol. 80). New York: National Bureau of Economic Research : Distributed by Columbia University Press.
  5. Benner, A. D., Boyle, A. E., & Sadler, S. (2016). Parental involvement and adolescents’ educational success: The roles of prior achievement and socioeconomic status. Journal of Youth and Adolescence, 45, 1053–1064. · DOI · Paper page
  6. Bergstra, J., & Bengio, Y. (2012). Random search for hyper-parameter optimization. Journal of Machine Learning Research, 13, 281–305.
  7. Bishop, C. M. (2006). Pattern recognition and machine learning, Information Science and Statistics. Berlin: Springer.
  8. Breiman, L. (1996a). Bagging predictors. Machine Learning, 24, 123–140.
  9. Breiman, L. (1996b). Stacked regressions. Machine Learning, 24, 49–64.
  10. Briscoe, E., & Feldman, J. (2011). Conceptual complexity and the bias/variance tradeoff. Cognition, 118, 2–16. · DOI · Paper page
  11. Chang, C.-C., & Lin, C.-J. (2007). Libsvm: A library for support vector machines. ACM Transactions on Intelligent Systems and Technology, 2, Article No: 27.
  12. Chen, T., & Guestrin, C. (2016). XGBoost: A scalable tree boosting system. In Proceedings of the ACM SIGKDD International Conference on Knowledge Discovery and Data Mining August 2016 (pp. 785–794). · DOI · Paper page
  13. Cruz-Jesus, F., Castelli, M., Oliveira, T., Mendes, R., Nunes, C., Sa-Velho, M., & Rosa-Louro, A. (2020). Using artificial intelligence methods to assess academic achievement in public high schools of a European Union country. Heliyon, 6, e04081. · DOI · Paper page
  14. Di Fabio, A., & Busoni, L. (2007). Fluid intelligence, personality traits and scholastic success: Empirical evidence in a sample of Italian high school students. Personality and Individual Differences, 43, 2095–2104. · DOI
  15. Francis, B. (2005). Reassessing gender and achievement, Questioning contemporary key debates. New York: Routledge. · DOI · Paper page
  16. Friedman, J. H. (2001). Greedy function approximation: A gradient boosting machine. The Annals of Statistics, 29, 1189–1232. · DOI · Paper page
  17. Gilar-Corbi, R., Miñano, P., Veas, A., & Castejón, J. L. (2019). Testing for invariance in a structural model of academic achievement across underachieving and non-underachieving students. Contemporary Educational Psychology, 59, 101780. · DOI
  18. Hanushek, E. A., & Wößmann, L. (2010). Education and economic growth, international encyclopedia of education. Oxford: Elsevier.
  19. Hastie, T., Tibshirani, R., & Friedman, J. (2008). The elements of statistical learning: Data mining, inference, and prediction second editon. Springer.
  20. Haykin, S. (2009). Neural networks and learning machines third edition. Pearson.
  21. Hill, N. E., & Taylor, L. C. (2004). Parental school involvement and children’s academic achievement pragmatics and issues. Current Directions in Psychological Science, 13, 161–164. · DOI · Paper page
  22. Hoxby, C. M. (2000). The effects of class size on student achievement : New evidence from population variation. Quarterly Journal of Economics, 115, 1239–1285. · DOI · Paper page
  23. James, G., Witten, D., Hastie, T., & Tibshirani, R. (2013). An introduction to statistical learning with applications in R. Springer Texts in Statistics: Springer. · DOI · Paper page
  24. Jensen, A. R. (1998). The G factor: The science of mental ability. London: Praeger.
  25. King, R. B. (2016). Gender differences in motivation, engagement and achievement are related to students’ perceptions of peer—But not of parent or teacher—Attitudes toward school. Learning and Individual Differences, 52, 60–71. · DOI
  26. Kuhfeld, M., Gershoff, E., & Paschall, K. (2018). The development of racial/ethnic and socioeconomic achievement gaps during the school years. Journal of Applied Developmental Psychology, 57, 62–73. · DOI
  27. Lei, J., & Zhao, Y. (2007). Technology uses and student achievement: A longitudinal study. Computers in Education, 49, 284–296. · DOI · Paper page
  28. Leithwood, K., & Jantzi, D. (2009). A review of empirical evidence about school size effects : A policy perspective. Review of Educational Research, 79, 464–490. · DOI · Paper page
  29. Levels, M., Kraaykamp, G., & Dronkers, J. (2008). Immigrant children’s educational achievement in western countries: Origin, destination, and community effects on mathematical performance. American Sociological Review, 73, 835–853. · DOI · Paper page
  30. Lupart, J. L., Cannon, E., & Telfer, J. A. (2004). Gender differences in adolescent academic achievement, interests, values and life-role expectations. High Ability Studies, 15, 25–42. · doi:10.1080/1359813042000225320
  31. Mengash, H. A. (2020). Using data mining techniques to predict student performance to support decision making in university admission systems. IEEE Access, 8, 55462–55470. · DOI · Paper page
  32. Mensah, F. K., & Kiernan, K. E. (2010). Gender differences in educational attainment: Influences of the family environment. British Educational Research Journal, 36, 239–260. · DOI
  33. Miguéis, V. L., Freitas, A., Garcia, P. J. V., & Silva, A. (2018). Early segmentation of students according to their academic performance: A predictive modelling approach. Decision Support Systems, 115, 36–51. · DOI · Paper page
  34. Mohri, M., Rostamizadeh, A., & Talwalkar, A. (2018). Foundations of machine learning second edition. In F. Bach (Ed.), Adaptive computation and machine learning series. MIT Press.
  35. Murphy, K. P. (2012). Machine learning: A probabilistic perspective. Cambridge: MIT Press.
  36. Musso, M. F., Hernández, C. F. R., & Cascallar, E. C. (2020). Predicting key educational outcomes in academic trajectories: A machine-learning approach. Higher Education. · DOI · Paper page
  37. Nievergelt, J. (2000). Exhaustive search, combinatorial optimization and enumeration : Exploring the potential of raw computing power. In V. Hlaváč, K. G. Jeffery, & J. Wiedermann (Eds.), Lecture notes in computer science vol. 1963, SOFSEM 2000: Theory and practice of informatics - 27th Conference on Current Trends in Theory and Practice of Informatics Milovy, Czech Republic, November 25 – December 2, 2000 proceedings (pp. 18–35). Springer. · DOI
  38. OEDC. (2016). PISA 2015 volume I: Results excellence and equity in education. Paris: OECD Publishing.
  39. Opdenakker, M. C., & Van Damme, J. (2007). Do school context, student composition and school leadership affect school practice and outcomes in secondary education? British Educational Research Journal, 33, 179–206. · DOI · Paper page
  40. Pedregosa, F., Varoquaux, G., Gramfort, A., Michel, V., Thirion, B., Grisel, O., Blondel, M., Prettenhoffer, P., Weiss, R., Dubourg, V., Vanderplas, J., Passos, A., Cournapeau, D., Brucher, M., Perrot, M., & Duchesnay, É. (2011). Scikit-learn: Machine learning in Python. Journal of Machine Learning Research, 12, 2825–2830.
  41. Perreira, K. M., Harris, K. M., & Lee, D. (2006). Making it in America: High school completion by immigrant and native youth. Demography, 43, 511–536. · DOI · Paper page
  42. Ramchoun, H., Idrissi, M. A. J., Ghanou, Y., & Ettaouil, M. (2016). Multilayer perceptron: Architecture optimization and training. International Journal of Interactive Multimedia and Artificial Intelligence, 4, 26. · DOI · Paper page
  43. Rivas-Perea, P., Cota-Ruiz, J., Chaparro, D. G., Venzor, J. A. P., Carreón, A. Q., & Rosiles, J. G. (2013). Support vector Machines for Regression: A succinct review of large-scale and linear programming formulations. International Journal of Intelligent Science, 03, 5–14. · doi:10.4236/ijis.2013.31002
  44. Rohde, T. E., & Thompson, L. A. (2007). Predicting academic achievement with cognitive ability. Intelligence, 35, 83–92. · DOI · Paper page
  45. Rumelhart, D. E., Hinton, G. E., & Williams, R. J. (1986). Learning internal representations by error propagation, in: Parallel distributed processing: Explorations in the microstructure of cognition volume I: Foundations Institute for Cognitive Science University of California, San Diego. London: MIT Press.
  46. Salomon, A., & Ben-David Kolikant, Y. (2016). High-school students’ perceptions of the effects of non-academic usage of ICT on their academic achievements. Computers in Human Behavior, 64, 143–151. · DOI
  47. Schapire, R. E. (2003). The boosting approach to machine learning: An overview. In D. D. Denison, M. H. Hansen, C. C. Holmes, B. Mallick, & B. Yu (Eds.), Nonlinear estimation and classification. Lecture notes in statistics, vol 171 (pp. 149–171). New York: Springer. · DOI · Paper page
  48. Schwartz, A. E., Stiefel, L., & Wiswall, M. (2013). Do small schools improve performance in large, urban districts? Causal evidence from New York City. Journal of Urban Economics, 77, 27–40. · DOI
  49. Smola, A. J., & Scholkopf, B. (2004). A tutorial on support vector regression. Statistics and Computing, 199–222. · DOI · Paper page
  50. Sorensen, L. C. (2019). “Big data” in educational administration: An application for predicting school dropout risk. Educational Administration Quarterly, 55, 404–446. · DOI
  51. Steinmayr, R., Dinger, F. C., & Spinath, B. (2010). Parents’ education and Children’s achievement: The role of personality. European Journal of Personality, 24, 535–550. · DOI · Paper page
  52. Strenze, T. (2007). Intelligence and socioeconomic success: A meta-analytic review of longitudinal research. Intelligence, 35, 401–426. · DOI · Paper page
  53. Tesfagiorgis, M., Tsegai, S., Mengesha, T., Craft, J., & Tessema, M. (2020). The correlation between parental socioeconomic status (SES) and children’s academic achievement: The case of Eritrea. Children and Youth Services Review, 116, 105242. · DOI
  54. Tibshirani, R. (1997). The lasso method for variable selection in the cox model. Statistics in Medicine, 16, 385–395. · doi:10.1002/(sici)1097-0258(19970228)16:4<385::aid-sim380>3.0.co;2-3
  55. Tomul, E., & Savasci, H. S. (2012). Socioeconomic determinants of academic achievement. Educational Assessment, Evaluation and Accountability, 24, 175–187. · DOI
  56. Woolner, P., Hall, E., Higgins, S., McCaughey, C., & Wall, K. (2007). A sound foundation? What we know about the impact of environments on learning and the implications for Building Schools for the Future. Oxford Review of Education, 33, 47–70. · DOI · Paper page
  57. Wößmann, L., & West, M. (2006). Class-size effects in school systems around the world: Evidence from between-grade variation in TIMSS. European Economic Review, 50, 695–736. · DOI · Paper page

Cited by

See all 83

Metadata

Authors
Costa-Mendes, R., Oliveira, T., Castelli, M., & Cruz-Jesus, F.
Venue
Education and Information Technologies
Published
2020-09-05
Volume
26
Issue
2
Pages
1527-1547
ISSN
  • 1360-2357 (ISSN-L)
  • 1573-7608
OpenAlex
W3083548488
Cited by
83
References
12
FWCI
9.78
Type
journal article
Language
en
Open access
hybrid
Licence
Funders
Fundação para a Ciência e a Tecnologia (DSAIPA/DS/0032/2018)

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: A machine learning approximation of the 2015 Portuguese high school student grades: A hybrid approach. https://app.cochat.ai/papers/10.1007/s10639-020-10316-y
The paper
Costa-Mendes, R., Oliveira, T., Castelli, M., & Cruz-Jesus, F. (2021). A machine learning approximation of the 2015 Portuguese high school student grades: A hybrid approach. Education and Information Technologies. https://doi.org/10.1007/s10639-020-10316-y

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.