The DOI matches its Crossref record; 72 of the 72 references it cites were found in a registry or an index.
Epistemic Network Analysis: A Prototype for 21st-Century Assessment of Learning
Abstract
In this article we examine educational assessment in the 21st century. Digital learning environments emphasize learning in action. In such environments, assessments need to focus on performance in context rather than on tests of abstracted and isolated skills and knowledge. Digital learning environments also provide the potential to assess performance in context, because digital tools make it possible to record rich streams of data about learning in progress. But what assessment methods will use this data to measure mastery of complex problem solving—the kind of thinking in action that takes place in digital learning environments? Here we argue that one way to address this challenge is through evidence-centered design1—a framework for developing assessments by systematically linking models of understanding, observable actions, and evaluation rubrics to provide evidence of learning. We examine how evidence-centered design can address the challenge of assessment in new media learning environments by present...
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
The Reflective Practitioner: How Professionals Think in Action
Checkoway, B., & Schon, D. A. (1985) · Journal of Policy Analysis and Management · doi:10.2307/3324262 · Cited by 21,268
The reflective practitioner: How professionals think in action
Stewart, C. J. (1984) · Patient Education and Counseling · doi:10.1016/0738-3991(84)90022-3 · Cited by 19,752
Social Network Analysis: Methods and Applications
Wasserman, S. S., & Faust, K. (1994) · Cited by 17,993
Social Network Analysis: Methods and Applications
Wasserman, S., & Faust, K. (1994) · doi:10.1017/cbo9780511815478 · Cited by 17,557
Frame Analysis: An Essay on the Organization of Experience.
Gamson, W. A., & Goffman, E. (1975) · Contemporary Sociology · doi:10.2307/2064022 · Cited by 10,570
Kirschner, P. A., Sweller, J., & Clark, R. E. (2006) · Educational Psychologist · doi:10.1207/s15326985ep4102_1 · Cited by 7,776 · cited 1×
“However, simply turning students loose in such a virtual worldno matter how cleverly designedis a poor instructional strategy because learners are novices [and] leaving them to float in rich experiences with no support triggers the very real human penchant for finding creative but spurious patterns and generalizations…”
Background(1980) · Medical Entomology and Zoology · Cited by 7,534
(1987) · Cited by 6,910
What Video Games Have to Teach Us about Learning and Literacy
(2004) · Education + Training · doi:10.1108/et.2004.00446dae.002 · Cited by 6,674
Bruner, J. (1996) · doi:10.4159/9780674251083 · Cited by 6,231
Handbook of research on mathematics teaching and learning
(1992) · Choice Reviews Online · doi:10.5860/choice.30-2122 · Cited by 6,121
The World Is Flat: A Brief History of the Twenty-First Century
Ikenberry, G. J., & Friedman, T. L. (2005) · Foreign Affairs · doi:10.2307/20031715 · Cited by 4,210
Cognitive Psychology and Its Implications
Anderson, J. R. (2014) · Cited by 4,121
Frame Analysis: An Essay on the Organization of Experience
SCHNEIDER, I. (1975) · American Journal of Psychiatry · doi:10.1176/ajp.132.10.1093-a · Cited by 3,825
Mind over Machine: The Power of Human Intuition and Expertise in the Era of the Computer
Dreyfus, H. L., Drey-fus, S. E., & Zadeh, L. A. (1987) · IEEE Expert · doi:10.1109/mex.1987.4307079 · Cited by 3,172
An algorithm for drawing general undirected graphs
Kamada, T., & Kawai, S. (1989) · Information Processing Letters · doi:10.1016/0020-0190(89)90102-6 · Cited by 2,698
(1993) · Medical Entomology and Zoology · Cited by 1,882
Mindstorms: Children, Computers, and Powerful Ideas
Malraison, P. J., & Papert, S. (1981) · The Two-Year College Mathematics Journal · doi:10.2307/3027082 · Cited by 1,824
(1977) · CERN Document Server (European Organization for Nuclear Research) · Cited by 1,548
The interplay of evidence and consequences in the validation of performance assessments
Messick, S. (1994) · Educational Researcher · doi:10.3102/0013189x023002013 · Cited by 1,315
Barabási, A.-Ĺ. (2003) · Cited by 1,249
Video Games and the Future of Learning
Shaffer, D. W., Squire, K. R., Halverson, R., & Gee, J. P. (2005) · Phi Delta Kappan · doi:10.1177/003172170508700205 · Cited by 1,094
Self-citationHow Computer Games Help Children Learn
Shaffer, D. W. (2006) · Palgrave Macmillan US eBooks · doi:10.1057/9780230601994 · Cited by 1,019
Self-citationConstructionism in Practice: Designing, Thinking, and Learning in A Digital World
Kafai, Y. B., & Resnick, M. (1996) · Cited by 991
Turtles, termites, and traffic jams: explorations in massively parallel microworlds
(1995) · Choice Reviews Online · doi:10.5860/choice.32-3355 · Cited by 977
Gee, J. P., Hull, G., & Lankshear, C. (1996) · Cited by 845
Cognitive Psychology and Its Implications
West, A. N. (1981) · The Journal of mind and behavior · Cited by 824
Changing minds: computers, learning, and literacy
(2001) · Choice Reviews Online · doi:10.5860/choice.38-2855 · Cited by 816
Mind over machine: The power of human intuition and expertise in the era of the computer
Koschmann, T. D. (1987) · Artificial Intelligence · doi:10.1016/0004-3702(87)90056-7 · Cited by 800
Lane, S. (2015) · Routledge eBooks · doi:10.4324/9780203102961 · Cited by 728
The new work order: behind the language of the new capitalism
Smart, G. (2000) · English for Specific Purposes · doi:10.1016/s0889-4906(00)00003-x · Cited by 691
(2005) · Lecture Notes in Computer Science · doi:10.1007/b106453 · Cited by 636
Windows on Mathematical Meanings
Noss, R., & Hoyles, C. (1996) · Springer eBooks · doi:10.1007/978-94-009-1696-8 · Cited by 585
What video games have to teach us about learning and literacy
(2004) · Choice Reviews Online · doi:10.5860/choice.41-3564 · Cited by 575
Windows on mathematical meanings: learning cultures and computers
(1997) · Choice Reviews Online · doi:10.5860/choice.35-0959 · Cited by 543
Epistemic frames for epistemic games
Shaffer, D. W. (2006) · Computers & Education · doi:10.1016/j.compedu.2005.11.003 · Cited by 466
Self-citationExtracting, Representing, and Analyzing Mental Models
Carley, K. M., & Palmquist, M. (1992) · Social Forces · doi:10.1093/sf/70.3.601 · Cited by 464
Changing Minds: Computers, Learning, and Literacy
diSessa, A. (2000) · The MIT Press eBooks · doi:10.7551/mitpress/1786.001.0001 · Cited by 457
Technology and mathematics education
Konold, C., & Lehrer, R. (2015) · Handbook of International Research in Mathematics Education · doi:10.4324/9780203930236.ch4 · Cited by 448
(1986) · Medical Entomology and Zoology · Cited by 430
Koschützki, D., Lehmann, K. A., Peeters, L., Richter, S., Tenfelde-Podehl, D., & Zlotowski, O. (2005) · Lecture Notes in Computer Science · doi:10.1007/978-3-540-31955-9_3 · Cited by 286
Evolve!: succeeding in the digital culture of tomorrow
(2001) · Choice Reviews Online · doi:10.5860/choice.39-1660 · Cited by 239
(2009) · Serious Games · doi:10.4324/9780203891650-31 · Cited by 226
EVIDENCE AND INFERENCE IN EDUCATIONAL ASSESSMENT1,2
Mislevy, R. J. (1995) · ETS Research Report Series · doi:10.1002/j.2333-8504.1995.tb01643.x · Cited by 197
Self-citationPedagogical Praxis: The Professions as Models for Postindustrial Education
Shaffer, D. W. (2004) · Teachers College Record The Voice of Scholarship in Education · doi:10.1111/j.1467-9620.2004.00383.x · Cited by 191
Self-citationConstructing Virtual Worlds: Tracing the Historical Development of Learner Practices
Barab, S. A., Hay, K. E., Barnett, M., & Squire, K. (2001) · Cognition and Instruction · doi:10.1207/s1532690xci1901_2 · Cited by 187
Brown, J. S., & Hagel, J. (2005) · Cited by 168
Teaching and Learning with SimCity 2000
Adams, P. C. (1998) · Journal of Geography · doi:10.1080/00221349808978827 · Cited by 163
Markusen, J. R. (2005) · National Bureau of Economic Research · doi:10.3386/w11827 · Cited by 157
Computer Support for Collaborative Learning
Stahl, G. (2023) · Routledge eBooks · doi:10.4324/9781315045467 · Cited by 126
Delandshere, G. (2002) · Teachers College Record The Voice of Scholarship in Education · doi:10.1111/1467-9620.00210 · Cited by 115
Making Sense of Data From Complex Assessments
Mislevy, R. J., Steinberg, L. S., Breyer, F., Almond, R. G., & Johnson, L. A. (2002) · Applied Measurement in Education · doi:10.1207/s15324818ame1504_03 · Cited by 109
Self-citationEvidence-Centered Assessment Design
Mislevy, R. J., Haertel, G. D., Riconscente, M. M., Rutstein, D. W., & Ziker, C. (2017) · SpringerBriefs in statistics · doi:10.1007/978-3-319-52246-3_3 · Cited by 98
Self-citation(2018) · Symmetry Culture and Science · doi:10.26830/symmetry · Cited by 95
Rethinking the Microworld Idea
Hoyles, C., Noss, R., & Adamson, R. (2002) · Journal of Educational Computing Research · doi:10.2190/u6x9-0m6h-mu1q-v36x · Cited by 83
Epistemic frames and islands of expertise: learning from infusion experiences
Shaffer, D. W. (2004) · International Conference of Learning Sciences · doi:10.22318/icls2004.473 · Cited by 78
Self-citationAugmented by Reality: The Pedagogical Praxis of Urban Planning as a Pathway to Ecological Thinking
Beckett, K. L., & Shaffer, D. W. (2005) · Journal of Educational Computing Research · doi:10.2190/d5yq-mmw6-v0fr-rnjq · Cited by 75
Self-citationBalancing varied assessment functions to attain systemic validity: Three is the magic number
Hickey, D. T., Zuiker, S. J., Taasoobshirazi, G., Schafer, N. J., & Michael, M. A. (2006) · Studies In Educational Evaluation · doi:10.1016/j.stueduc.2006.08.006 · Cited by 73
Clauser, B. E., Margolis, M. J., Clyman, S. G., & Ross, L. P. (1997) · Journal of Educational Measurement · doi:10.1111/j.1745-3984.1997.tb00511.x · Cited by 71
Understanding models for learning and instruction : essays in honor of Norbert M. Seel
Ifenthaler, D., Pirnay-Dummer, P. N., & Spector, J. M. (2008) · Cited by 67
Outsourcing and Offshoring in the 21st Century: A Socio-Economic Perspective
Vita, G. D., & Wang, C. L. (2006) · IGI Global eBooks · doi:10.4018/978-1-59140-875-8 · Cited by 50
Learning mathematics through design: The anatomy of Escher's world
Shaffer, D. W. (1997) · The Journal of Mathematical Behavior · doi:10.1016/s0732-3123(97)90019-5 · Cited by 47
Self-citationSodaConstructing knowledge through exploratoids
Svarovsky, G., & Shaffer, D. W. (2006) · Journal of Research in Science Teaching · doi:10.1002/tea.20112 · Cited by 45
Self-citationDevelopments in the Call Centre Industry
Burgess, J., & Connell, J. (2006) · Routledge eBooks · doi:10.4324/9780203003008 · Cited by 33
Press play: designing an epistemic game engine for journalism
Hatfield, D., & Shaffer, D. W. (2006) · International Conference of Learning Sciences · doi:10.22318/icls2006.236 · Cited by 26
Self-citationUsing an Evidence-Based Approach to Assess Mental Models
Shute, V. J., & Zapata‐Rivera, D. (2008) · Springer eBooks · doi:10.1007/978-0-387-76898-4_2 · Cited by 25
Issues of Structure and Issues of Scale in Assessment from a Situative/Sociocultural Perspective
Mislevy, R. J. (2008) · Cambridge University Press eBooks · doi:10.1017/cbo9780511802157.012 · Cited by 20
Self-citationShaffer, D. W. (2009) · IGI Global eBooks · doi:10.4018/978-1-59904-808-6.ch033 · Cited by 11
Self-citationMultisubculturalism: Computers and the End of Progressive Education
Shaffer, D. W. (2005) · Cited by 10
Self-citationThe Pasteurization of Education
Shaffer, D. W., & Squire, K. D. (2006) · Advances in educational administration · doi:10.1016/s1479-3660(05)08004-2 · Cited by 10
Self-citationThe Indian Offshore Advantage: How Offshoring Is Changing the Face of HR
Hunter, I. (2006) · Cited by 8
Research works printed but not linked: 18
- Bejar I. I., 1999, Architectural simulations: From research to implementation.
- 10.1007/978-1-4302-0740-5 · doi:10.1007/978-1-4302-0740-5
- Bogost I., 2005, Journal of Media Literacy, 52, 32
- Csikszentmihalyi M., 1996, Creativity: Flow and the psychology of discovery and invention
- Goldenberg E. P., 1998, Designing learning environments for developing understanding of geometry and space, 351
- Harel I., 1991, Constructionism
- 10.1037/e652082011-001 · doi:10.1037/e652082011-001
- 10.1037/e645022011-001 · doi:10.1037/e645022011-001
- Mislevy R. J., 2003, A four-process architecture for assessment delivery, with connections to assessment design
- 10.1037/e649282011-001 · doi:10.1037/e649282011-001
- Rohde M., 2004, Association for Computing Machinery (ACM) SigGROUP Bulletin, 24, 19
- Serra M., 1997, Discovering geometry: An inductive approach
- Shaffer D. W., 2002, Computer support for collaborative learning 2, 197
- Shaffer D. W., 2004, Journal of Interactive Learning Research, 15, 101
- Shaffer D. W., Foundations for the future: The need for new mathematical understandings and abilities in the 21st century
- 10.1177/003172170508700205 · DOI · Paper page
- Shute V. J., The social science of serious games: Theories and applications
- Starr P., 1994, American Prospect, 5, 19
Cited by
Artificial intelligence for education: Knowledge and its assessment in AI-enabled learning ecologies
Cope, B., Kalantzis, M., & Searsmith, D. (2021) · Educational Philosophy and Theory · doi:10.1080/00131857.2020.1728732 · Cited by 518
“This extends a line of educational intervention and research in which learners use concept maps to diagram their thinking (Ca ~ nas et al., 2004; Kao, Chen, & Sun, 2010; Shaffer et al., 2009; Villalon & Calvo, 2011).”
BackgroundPredicting Student Performance from LMS Data: A Comparison of 17 Blended Courses Using Moodle LMS
Conijn, R., Snijders, C., Kleingeld, A., & Matzat, U. (2017) · IEEE Transactions on Learning Technologies · doi:10.1109/tlt.2016.2616312 · Cited by 371
Building a Conceptual Framework for Data Literacy
Gummer, E. S., & Mandinach, E. B. (2015) · Teachers College Record: The Voice of Scholarship in Education · doi:10.1177/016146811511700401 · Cited by 263
A Systematic Literature Review of Empirical Research on Epistemic Network Analysis in Education
Elmoazen, R., Saqr, M., Tedre, M., & Hirsto, L. (2022) · IEEE Access · doi:10.1109/access.2022.3149812 · Cited by 103
Chesler, N. C., Ruis, A. R., Collier, W., Swiecki, Z., Arastoopour, G., & Williamson Shaffer, D. (2015) · Journal of Biomechanical Engineering · doi:10.1115/1.4029235 · Cited by 76
Metadata
- Authors
- Shaffer, D. W., Hatfield, D., Svarovsky, G. N., Nash, P., Nulty, A., Bagley, E., Frank, K., Rupp, A. A., & Mislevy, R.
- Venue
- International Journal of Learning and Media
- Publisher
- Portico
- Published
- 2009-05
- Volume
- 1
- Issue
- 2
- Pages
- 33-53
- ISSN
- 1943-6068 (ISSN-L)
- OpenAlex
- W2128500216
- Cited by
- 386
- References
- 72
- FWCI
- 32.66
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.