The Bias-Variance Tradeoff: How Data Science Can Inform Educational Debates
Open accessThe DOI matches its Crossref record; 11 of the 11 references it cites were found in a registry or an index.
Abstract
In addition to providing a set of techniques to analyze educational data, I claim that data science as a field can provide broader insights to education research. In particular, I show how the bias-variance tradeoff from machine learning can be formally generalized to be applicable to several prominent educational debates, including debates around learning theories (cognitivist vs. situativist and constructivist theories) and pedagogy (direct instruction vs. discovery learning). I then look to see how various data science techniques that have been proposed to navigate the bias-variance tradeoff can yield insights for productively navigating these educational debates going forward.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Situated Learning: Legitimate Peripheral Participation
Lave, J., & Wenger, E. (1991) · Cambridge University Press eBooks · doi:10.1017/cbo9780511815355 · Cited by 35,324
Mastering the game of Go with deep neural networks and tree search
Silver, D., Huang, A., Maddison, C. J., Guez, A., Sifre, L., van den Driessche, G., Schrittwieser, J., Antonoglou, I., Panneershelvam, V., Lanctot, M., et al. (2016) · Nature · doi:10.1038/nature16961 · Cited by 15,612
Situated Cognition and the Culture of Learning
Brown, J. S., Collins, A., & Duguid, P. (1989) · Educational Researcher · doi:10.3102/0013189x018001032 · Cited by 13,645 · cited 1×
“Situative theorists, on the other hand, claim that cognition happens in a particular sociocultural context and is thus context-dependent (J. S. Brown et al., 1989; Lave & Wenger, 1991).”
BackgroundMixed Methods Research: A Research Paradigm Whose Time Has Come
Johnson, R. B., & Onwuegbuzie, A. J. (2004) · Educational Researcher · doi:10.3102/0013189x033007014 · Cited by 11,170 · cited 2×
“The preceding discussion hints at how the bias-variance tradeoff can be extended to debates around methodology, such as quantitative versus qualitative 11 (Johnson & Onwuegbuzie, 2004) and reductionistic versus holistic (or elemental vs. systemic; Nathan & Sawyer, 2014; Salomon, 1991) methodologies.”
BackgroundKirschner, P. A., Sweller, J., & Clark, R. E. (2006) · Educational Psychologist · doi:10.1207/s15326985ep4102_1 · Cited by 7,776 · cited 2×
“The debate around direct instruction versus discovery learning has surfaced in various ways throughout the history of education (Bruner, 1961; Ray, 1961; Winch, 1913), and is still a topic of controversy in education research (Kirschner et al., 2006; Munter et al., 2015; Tobias & Duffy, 2009).”
BackgroundNeural Networks and the Bias/Variance Dilemma
Geman, S., Bienenstock, E., & Doursat, R. (1992) · Neural Computation · doi:10.1162/neco.1992.4.1.1 · Cited by 3,578 · cited 1×
“The bias-variance tradeoff was first formally introduced by Geman et al. (1992).”
BackgroundDesign Experiments in Educational Research
Cobb, P., Confrey, J., diSessa, A., Lehrer, R., & Schauble, L. (2003) · Educational Researcher · doi:10.3102/0013189x032001009 · Cited by 3,548
Grandmaster level in StarCraft II using multi-agent reinforcement learning
Vinyals, O., Babuschkin, I., Czarnecki, W. M., Mathieu, M., Dudzik, A., Chung, J., Choi, D. H., Powell, R., Ewalds, T., Georgiev, P., et al. (2019) · Nature · doi:10.1038/s41586-019-1724-z · Cited by 3,455 · cited 3×
“…experts at the ancient game of Go; Silver et al., 2016) and AlphaStar (an agent that has beaten experts at the popular computer game StarCraft II; Vinyals et al., 2019) not only beat humans but also do so by exhibiting new strategies to playing these games that humans can study and possibly…”
BackgroundDesign-based research: Putting a stake in the ground
Barab, S., & Squire, K. (2004) · Journal of the Learning Sciences · doi:10.1207/s15327809jls1301_1 · Cited by 2,642 · cited 2×
“Similarly, in education, cognitivists tend to advocate for experimental studies of what works (Anderson et al., 1998; Koedinger et al., 2013) while constructivist and situativist researchers tend to advocate for design-based research (Barab & Squire, 2004; Cobb et al., 2003; Papert, 1987a).”
BackgroundDoes discovery-based instruction enhance learning?
Alfieri, L., Brooks, P. J., Aldrich, N. J., & Tenenbaum, H. R. (2011) · Journal of Educational Psychology · doi:10.1037/a0021017 · Cited by 1,338 · cited 2×
“…many researchers have contended that these debates are often pre-mised on false dichotomies and admit that a moderate position is more warranted (Alfieri et al., 2011; A. L. Brown & Campione, 1994; Cobb, 2007; Doroudi et al., 2020; Greeno, 2015; Johnson & Onwuegbuzie, 2004; Kersh & Wittrock,…”
BackgroundHuman problem solving: The state of the theory in 1970.
Simon, H. A., & Newell, A. (1971) · American Psychologist · doi:10.1037/h0030806 · Cited by 635 · cited 2×
“Their later strategy for accounting for learning via production systems (Simon & Newell, 1971)—akin to expert systems in AI—was indeed a simple (high-bias) way to account for what Papert, Minsky, Schank, and others would see as a much more complex process.”
BackgroundMethod
Cited by
A Survey of Ensemble Learning: Concepts, Algorithms, Applications, and Prospects
Mienye, I. D., & Sun, Y. (2022) · IEEE Access · doi:10.1109/access.2022.3207287 · Cited by 1,298
Koçak, B., Ponsiglione, A., Stanzione, A., Bluethgen, C., Santinha, J., Ugga, L., Huisman, M., Klontzas, M. E., Cannella, R., & Cuocolo, R. (2024) · Diagnostic and Interventional Radiology · doi:10.4274/dir.2024.242854 · Cited by 168
“16 Interestingly, the concepts of bias and variance are not limited to the domain of statistical or ML modeling alone, but they also affect human learning and have been extensively studied in cognitive sciences.”
The intertwined histories of artificial intelligence and education
Doroudi, S. (2023) · International Journal of Artificial Intelligence in Education · doi:10.1007/s40593-022-00313-2 · Cited by 129
Self-citationThe Bias–Variance Tradeoff in Cognitive Science
Doroudi, S., & Rastegar, S. A. (2023) · Cognitive Science · doi:10.1111/cogs.13241 · Cited by 9
Self-citation
Metadata
- Authors
- Doroudi, S.
- Venue
- AERA Open
- Publisher
- SAGE Publications
- Published
- 2020-10
- Volume
- 6
- Issue
- 4
- ISSN
- 2332-8584 (ISSN-L)
- OpenAlex
- W3111869221
- Cited by
- 52
- References
- 11
- FWCI
- 6.14
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.