Cited by 256Online Learning and AnalyticsIntelligent Tutoring Systems and Adaptive LearningStatistics Education and Methodologies

Epistemic Network Analysis: A Worked Example of Theory-Based Learning Analytics

Open access
University of Wisconsin–Madison, USA, Shaffer, David Williamson, Ruis, A. R., University of Wisconsin–Madison, USA·2017·Handbook of Learning Analytics

Abstract

In this chapter, we look at the role of theory in learning analytics.Researchers who study learning are blessed with unprecedented quantities of data, whether information about staggeringly large numbers of individuals or data showing the microscopic, moment-by-moment actions in the learning process.It is a brave new world.We can look at second-by-second changes in where skills are effective by looking at thousands of students in a MOOC.of the Journal of Learning Analytics, however, it is dangerous to think that with enough information, the data can speak for themselves -that we can conduct analyses of learning without theories of learning.In fact, the opposite is true.With larger amounts of data, large enough so that random effects are normally distributed, but small enough to be obtained using traditional data collection techniques.Applying these techniques to datasets that are orders of magnitude larger in length and number of variables without a strong theoretical foundation is perilous at best.In what follows, we look at this question not by anatheoretical framework.What Wise and Shaffer suggest -and what the articles and commentaries in the special section of the Journal of Learning Analytics show -is that conducting theory-based learning analytics is challenging.As a result, our approach in what follows through the use of a worked example: the presentation of a problem along with a step-by-step description of In doing so, our aim is not to provide an ideal solution for others to emulate, nor to suggest that our particular use of theory in learning analytics is better than of a theory-based approach -as opposed to an atheoretical or data-driven approach -to the analysis of large educational datasets.We do so by presenting epistemic network analysis (ENA; Andrist, Collier, Chapter 15: Epistemic Network Analysis: A Worked Example of Theory-Based Learning AnalyticsDavid Williamson Shaffer and A. R. Ruis data-driven -approach.We do so by presenting 1) epistemic frame theory as an approach cational game design based on epistemic frame theory; and 3) epistemic network analysis of learning analytics.

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.18608/hla17.015

Cites

1 of 1 references verified0 citation errors · 0 not checkable

Statistics

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Cites

Flagged first, then by citations

Research works printed but not linked: 1

  1. Wired, 16(7). with epistemic network analysis. Frontiers in Psychology, 6 - neering design thinking with virtual internships and epistemic network analysis. International Journal of Engineering Education, 32(2), in press. Review of Educational Research, 70 game play. International Journal of Gaming and Computer-Mediated Simulations, 1 educational ethnography. Journal of Interactive Learning Research, 26 an epistemic game. Journal of Computer Assisted Learning, 31 Journal of Educational Data Mining, 1 thinking. Journal of Biomechanical Engineering, 137 Evolution of networks: From biological nets to the Internet and WWW An introduction to discourse analysis: Theory and method. London: Routledge. Frame analysis: An essay on the organization of experience. Cambridge, MA: Harvard Univer- American Anthropologist, 96 Proceedings of the Royal Society of Lon- don B: Biological Sciences, 268 Handbook of latent semantic analysis. Mah- Situated learning: Legitimate peripheral participation. Cambridge, MA: Cambridge Be- havior Research Methods, Instruments, & Computers, 28 Issues of structure and issues of scale in assessment from a situative/sociocultural perspec- tive Evidence-centered assessment design. Educational Testing - Handbook of Test Development - baum.

Cited by

Sorted by citations

Authors
University of Wisconsin–Madison, U., Shaffer, D. W., Ruis, A. R., & University of Wisconsin–Madison, U.
Affiliations
University of Wisconsin–Madison (US)
Venue
Handbook of Learning Analytics
Published
2017-05
Pages
175-187
OpenAlex
W2611007723
Cited by
255
References
1
Citations by year
2026: 30 · 2025: 45 · 2024: 47 · 2023: 34 · 2022: 31 · 2021: 25 · 2020: 15 · 2019: 16 · 2018: 9 · 2017: 3
FWCI
34.95
Type
book chapter
Language
en
Open access
Licence
cc-by
Locations
Society for Learning Analytics Research (SoLAR) eBooks (publishedVersion, cc-by)
Funders
  • John D. and Catherine T. MacArthur Foundation
  • Spencer Foundation
Topics
  • Physical Sciences › Computer Science › Computer Science Applications › Online Learning and Analytics
  • Physical Sciences › Computer Science › Artificial Intelligence › Intelligent Tutoring Systems and Adaptive Learning
  • Physical Sciences › Mathematics › Statistics and Probability › Statistics Education and Methodologies
Keywords
epistemic network analysis, educational game design, data-driven analysis, epistemic networks

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review