CoChat

Using supervised machine learning on large-scale online forums to classify course-related Facebook messages in predicting learning achievement within the personal learning environment

Wu, Jiun-Yu, Hsiao, Yi-Cheng, Nian, Mei-Wen · 2020 · Interactive Learning Environments
Cited by 88

The DOI matches its Crossref record; 10 of the 10 references it cites were found in a registry or an index.

Abstract

This paper demonstrated the use of the supervised Machine Learning (ML) for text classification to predict students’ final course grades in a hybrid Advanced Statistics course and exhibited the potential of using ML classified messages to identify students at risk of course failure. We built three classification models with training data of 76,936 posts from two large online forums and applied the models to classify messages into statistics-related and non-statistics-related posts in a private Facebook group. Three ML algorithms were compared in terms of classification effectiveness and congruency with human coding. Students with more messages endorsed by two or more ML algorithms as statistics-related had higher final course grades. Students who failed the course also had significantly fewer messages endorsed by all three ML algorithms than those who passed. Results suggest that ML can be used for identifying students in need of support within the personal learning environment and for quality control of the large-scale educational data.

Overview

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1080/10494820.2018.1515085

Cites

10 of 10 references verified0 citation errors · 0 not checkable

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Show all 10 references

Research works printed but not linked: 37

  1. 10.1016/j.compedu.2017.11.002 · DOI
  2. Anderson L. W., 2001, A taxonomy for learning, teaching and assessing: A revision of Bloom’s taxonomy of educational objectives
  3. 10.1080/10494820.2013.788035 · DOI
  4. 10.1080/1475939X.2017.1365753 · DOI
  5. Burges C. J., 1998, Data mining and knowledge discovery, 2, 121
  6. 10.5334/dsj-2015-002 · DOI · Paper page
  7. 10.1016/j.compedu.2016.02.006 · DOI · Paper page
  8. 10.1016/j.compedu.2010.07.024 · DOI · Paper page
  9. 10.1111/j.1467-8535.2005.00542.x · DOI · Paper page
  10. 10.1002/1097-0142(20010415)91:8+<1615::AID-CNCR1175>3.0.CO;2-L · DOI · Paper page
  11. 10.1016/j.patrec.2016.06.012 · DOI · Paper page
  12. 10.1061/(ASCE)0887-3801(2001)15:3(208) · doi:10.1061/(asce)0887-3801(2001)15:3(208
  13. 10.1162/153244303322753616 · DOI · Paper page
  14. Hair J. F., 2010, Multivariate data analysis
  15. 10.1109/101.8118 · DOI · Paper page
  16. 10.1109/ACCESS.2015.2490723 · DOI
  17. 10.1007/BFb0026683 · DOI · Paper page
  18. 10.1016/j.chb.2015.03.011 · DOI
  19. 10.1016/j.compedu.2015.05.004 · DOI
  20. 10.1080/10494820.2017.1372483 · DOI
  21. 10.1016/j.lindif.2012.01.007 · DOI
  22. 10.1016/j.compedu.2008.10.005 · DOI
  23. 10.1080/15391523.2006.10782479 · DOI
  24. 10.1016/j.compedu.2013.06.009 · DOI · Paper page
  25. 10.1145/505282.505283 · DOI · Paper page
  26. 10.1002/j.1538-7305.1948.tb01338.x · DOI · Paper page
  27. 10.1007/s41060-017-0087-5 · DOI
  28. 10.1108/eb026526 · DOI · Paper page
  29. 10.1007/978-1-4615-3618-5 · DOI · Paper page
  30. Tan P.-N., 2018, Introduction to data mining
  31. 10.1007/s10639-013-9279-3 · DOI
  32. 10.1145/3170358.3170403 · DOI
  33. 10.1145/2883851.2883916 · DOI · Paper page
  34. 10.1111/jcal.2014.30.issue-3 · doi:10.1111/jcal.2014.30.issue-3
  35. 10.1016/j.compedu.2018.08.016 · DOI
  36. 10.1016/j.chb.2018.07.008 · DOI
  37. 10.1016/j.knosys.2008.01.001 · DOI

Cited by

See all 88

Metadata

Authors
Wu, J.-Y., Hsiao, Y.-C., & Nian, M.-W.
Venue
Interactive Learning Environments
Published
2018-09-03
Volume
28
Issue
1
Pages
65-80
ISSN
  • 1049-4820 (ISSN-L)
  • 1744-5191
OpenAlex
W2890637277
Cited by
88
References
10
FWCI
12.06
Type
journal article
Language
en
Open access
closed
Funders
Ministry of Science and Technology (104-2628-H-009-001-SS3,105-2511-S-009-009-MY3)

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: Using supervised machine learning on large-scale online forums to classify course-related Facebook messages in predicting learning achievement within the personal learning environment. https://app.cochat.ai/papers/10.1080/10494820.2018.1515085
The paper
Wu, J.-Y., Hsiao, Y.-C., & Nian, M.-W. (2020). Using supervised machine learning on large-scale online forums to classify course-related Facebook messages in predicting learning achievement within the personal learning environment. Interactive Learning Environments. https://doi.org/10.1080/10494820.2018.1515085

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.