The DOI matches its DataCite record; 108 of the 108 references it cites were found in a registry or an index.
Leveraging educational data mining for real-time performance assessment of scientific inquiry skills within microworlds.
Open accessAbstract
We present Science Assistments, an interactive environment, which assesses students' inquiry skills as they engage in inquiry using science microworlds. We frame our variables, tasks, assessments, and methods of analyzing data in terms of evidence-centered design. Specifically, we focus on the student model, the task model, and the evidence model in the conceptual assessment framework. In order to support both assessment and the provision of scaffolding, the environment makes inferences about student inquiry skills using models developed through a combination of text replay tagging [cf. Sao Pedro et al. 2011], a method for rapid manual coding of student log files, and educational data mining. Models were developed for multiple inquiry skills, with particular focus on detecting if students are testing their articulated hypotheses, and if they are designing controlled experiments. Student-level cross-validation was applied to validate that this approach can automatically and accurately identify these inquiry skills for new students. The resulting detectors also can be applied at run-time to drive scaffolding intervention.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Citations
Cites
A Coefficient of Agreement for Nominal Scales
Cohen, J. (1960) · Educational and Psychological Measurement · doi:10.1177/001316446002000104 · Cited by 42,398 · cited 2×
“They were validated using six-fold student-level cross validation and had their predictive goodness assessed using two metrics, A’ 1 [Hanley and McNeil 1982] and Cohen’s Kappa (κ) 2 [Cohen 1960].”
MethodData Mining: Practical Machine Learning Tools and Techniques
(2011) · Elsevier eBooks · doi:10.1016/c2009-0-19715-5 · Cited by 25,437
Artificial intelligence: a modern approach
(1995) · Choice Reviews Online · doi:10.5860/choice.33-1577 · Cited by 21,974
The meaning and use of the area under a receiver operating characteristic (ROC) curve.
Hanley, J. A., & McNeil, B. J. (1982) · Radiology · doi:10.1148/radiology.143.1.7063747 · Cited by 21,856 · cited 2×
“They were validated using six-fold student-level cross validation and had their predictive goodness assessed using two metrics, A’ 1 [Hanley and McNeil 1982] and Cohen’s Kappa (κ) 2 [Cohen 1960].”
MethodFast algorithms for mining association rules
Agrawal, R., & Srikant, R. (1998) · Cited by 11,307
Witten, I. H. (2008) · Cited by 9,143
National Science Education Standards
Shea, J. H. (1995) · Journal of Geological Education · doi:10.5408/0022-1368-43.2.102 · Cited by 7,888
Kirschner, P. A., Sweller, J., & Clark, R. E. (2006) · Educational Psychologist · doi:10.1207/s15326985ep4102_1 · Cited by 7,776 · cited 3×
“This scaffolding design lead to a guided system; that is, we aimed to strike a balance between openended and guided inquiry [cf., Kirschner et al. 2006; Hmelo-Silver et al. 2007] such that students can be assessed on inquiry skills and so that they are provided with support so they do not flounder…”
BackgroundAxten, N., Newell, A., & Simon, H. A. (1973) · Contemporary Sociology · doi:10.2307/2063712 · Cited by 6,834
Newell, A. (1972) · Cited by 6,222
Cited by
Challenges and Future Directions of Big Data and Artificial Intelligence in Education
Luan, H., Geczy, P., Lai, H., Gobert, J., Yang, S. J. H., Ogata, H., Baltes, J., Guerra, R., Li, P., & Tsai, C.-C. (2020) · Frontiers in Psychology · doi:10.3389/fpsyg.2020.580820 · Cited by 667
“With the availability of large quantity and high-quality input training data, machine learning processes can achieve accurate results and facilitate informed decision making (Manyika et al., 2011; Gobert et al., 2012, 2013; Gobert and Sao Pedro, 2017).”
BackgroundSelf-citationEducational data mining: A survey and a data mining-based analysis of recent works
Peña-Ayala, A. (2014) · Expert Systems with Applications · doi:10.1016/j.eswa.2013.08.042 · Cited by 660
“119 Gobert et al. (2012) Machine learning,, probability Predictive Classification”
BackgroundInfluentialAldowah, H., Al-Samarraie, H., & Fauzy, W. M. (2019) · Telematics and Informatics · doi:10.1016/j.tele.2019.01.007 · Cited by 564
Mining Big Data in Education: Affordances and Challenges
Fischer, C., Pardos, Z. A., Baker, R. S., Williams, J. J., Smyth, P., Yu, R., Slater, S., Baker, R., & Warschauer, M. (2020) · Review of Research in Education · doi:10.3102/0091732x20903304 · Cited by 412
“…strategies, affective states, or self-regulated learning (SRL) behaviors, and they are sometimes validated based on real-time observations of student actions (Botelho et al., 2017; DeFalco et al., 2018; Pardos et al., 2014) or retrospective hand coding of data subsets (Gobert et al., 2012).”
BackgroundSelf-citationAcademic and Administrative Role of Artificial Intelligence in Education
Ahmad, S. F., Alam, M. M., Rahmat, M. K., Mubarik, M. S., & Hyder, S. I. (2022) · Sustainability · doi:10.3390/su14031101 · Cited by 309
“Such tools automatically set criteria for the desired candidates and information gathering which provides guidelines for interviews, etc. [11].”
BackgroundWang, J., & Antonenko, P. D. (2017) · Computers in Human Behavior · doi:10.1016/j.chb.2017.01.049 · Cited by 250
Gobert, J. D., Sao Pedro, M., Raziuddin, J., & Baker, R. S. (2013) · Journal of the Learning Sciences · doi:10.1080/10508406.2013.837391 · Cited by 210
“…principles for distilling, parsing, and aggregating the large volumes of log data that are generated as students work in these environments (Gobert et al., 2012; Quellmalz et al., 2009) so that data can be interpreted in relation to pedagogical theories and in instructionally meaningful…”
BackgroundMethodInfluentialSelf-citationAndrews‐Todd, J., & Forsyth, C. M. (2018) · Computers in Human Behavior · doi:10.1016/j.chb.2018.10.025 · Cited by 200
Operationalizing and Detecting Disengagement Within Online Science Microworlds
Gobert, J. D., Baker, R. S., & Wixon, M. (2015) · Educational Psychologist · doi:10.1080/00461520.2014.999919 · Cited by 137
“…2013; Wixon, Baker, Gobert, Ocumpaugh, & Bachmann, 2012) in our online science learning environment, Inquiry Intelligent Tutoring System (Inq-ITS; Gobert et al., 2012; Gobert et al., 2013) We, in turn, describe our real-time detector of one form of disengaged behavior, Disengaged from Task Goal…”
BackgroundMethodInfluentialSelf-citationArtificial intelligence in higher education: a bibliometric analysis and topic modeling approach
Maphosa, V., & Maphosa, M. (2023) · Applied Artificial Intelligence · doi:10.1080/08839514.2023.2261730 · Cited by 151
“This aids decision-making, improving services and productivity (Gobert et al. 2012).”
BackgroundProficiency in Science: Assessment Challenges and Opportunities
Pellegrino, J. W. (2013) · Science · doi:10.1126/science.1232065 · Cited by 100
“Additional examples include the SimScientists (20, 21), Science ASSISTments (22), and BioKids projects (23).”
BackgroundKhan, M. A., Khojah, M., & Vivek, V. (2022) · Education Research International · doi:10.1155/2022/1263555 · Cited by 143
RetractedGrover, S., Basu, S., Bienkowski, M., Eagle, M., Diana, N., & Stamper, J. (2017) · ACM Transactions on Computing Education · doi:10.1145/3105910 · Cited by 93
“Such techniques have been used to assess student learning in the context of game-based environments for science and math learning [e.g., 17, 34, 40, 58, 61].”
BackgroundMethodBeggrow, E. P., Ha, M., Nehm, R. H., Pearl, D. K., & Boone, W. J. (2013) · Journal of Science Education and Technology · doi:10.1007/s10956-013-9461-9 · Cited by 79
“Research has begun exploring the utility of computer-based learning environments for both developing and evaluating students’ proficiency in constructing scientific explanations (e.g., Gobert et al. 2012; Woloshyn and Gallagher 2009).”
BackgroundInfluentialA system for formative assessment and monitoring of students' progress
Rodrigues, F., & Oliveira, P. (2014) · Computers & Education · doi:10.1016/j.compedu.2014.03.001 · Cited by 79
Gobert, J. D., Kim, Y. J., Pedro, M. S., Kennedy, M., & Betts, C. G. (2015) · Thinking Skills and Creativity · doi:10.1016/j.tsc.2015.04.008 · Cited by 73
Self-citationPsychometrics and Game-Based Assessment
Mislevy, R. J., Corrigan, S., Oranje, A., DiCerbo, K. E., Bauer, M. I., von Davier, A. A., & John, M. (2015) · Routledge eBooks · doi:10.4324/9781315871493-2 · Cited by 66
de Klerk, S., Veldkamp, B. P., & Eggen, T. J. H. M. (2015) · Computers & Education · doi:10.1016/j.compedu.2014.12.020 · Cited by 65
Wang, J., Antonenko, P., Keil, A., & Dawson, K. (2020) · Mind Brain and Education · doi:10.1111/mbe.12239 · Cited by 67
Application of Ontologies for Assessing Collaborative Problem Solving Skills
Andrews-Todd, J., & Kerr, D. (2019) · International Journal of Testing · doi:10.1080/15305058.2019.1573823 · Cited by 46
“…be identified and relevant features of individuals ’ performance must be extracted from log files with data at a fine grain size (e.g., clicks, drags); however, there are few guiding principles for parsing, aggregating, and analyzing such data (Gobert, Sao Pedro, Baker, Toto, & Montalvo, 2012).”
BackgroundTime series analysis method for assessing engineering design processes using a CAD tool
Xie, C., Zhang, Z., Nourian, S., Pallant, A., & Hazzard, E. (2014) · Cited by 45
How Developments in Psychology and Technology Challenge Validity Argumentation
Mislevy, R. J. (2016) · Journal of Educational Measurement · doi:10.1111/jedm.12117 · Cited by 56
Kubsch, M., Krist, C., & Rosenberg, J. M. (2022) · Journal of Research in Science Teaching · doi:10.1002/tea.21803 · Cited by 53
Human performance modeling for manufacturing based on an improved KNN algorithm
Li, N., Kong, H., Ma, Y., Gong, G., & Huai, W. (2016) · The International Journal of Advanced Manufacturing Technology · doi:10.1007/s00170-016-8418-6 · Cited by 41
“Gobert implemented an interactive environment to assess students’ scientific research ability with educational data mining technology [17].”
BackgroundImproving Construct Validity Yields Better Models of Systematic Inquiry, Even with Less Information
Pedro, M. S., Baker, R. S., & Gobert, J. D. (2012) · Lecture notes in computer science · doi:10.1007/978-3-642-31454-4_21 · Cited by 40
Self-citationPedro, M. S., Baker, R. S., & Gobert, J. D. (2013) · Cited by 39
Self-citationSensor-Free Affect Detection for a Simulation-Based Science Inquiry Learning Environment
Paquette, L., Baker, R. S., Pedro, M. S., Gobert, J. D., Rossi, L. M., Nakama, A., & Kauffman-Rogoff, Z. S. (2014) · Lecture notes in computer science · doi:10.1007/978-3-319-07221-0_1 · Cited by 38
“The Inq-ITS learning environment (formerly known as Science Assistments [13]) is a web-based environment in which students conduct inquiry with interactive simulations aligned to middle school Physical, Life, and Earth Science content described in the NGSS standards [16].”
BackgroundMethodInfluentialSelf-citationWang, K. D., Cock, J. M., Käser, T., & Bumbacher, E. W. (2022) · British Journal of Educational Technology · doi:10.1111/bjet.13289 · Cited by 48
Fratamico, L., Conati, C., Kardan, S., & Roll, I. (2017) · International Journal of Artificial Intelligence in Education · doi:10.1007/s40593-016-0131-y · Cited by 49
“This model could perform knowledge and skills assessment from the observed student interaction behaviors (Conati and Merten 2007; Gobert et al. 2012), which in turn, can drive adaptive interventions richer than the strictly behavioral suggestions supported by our current approach (e.”
BackgroundMethodInfluentialGobert, J. D., Moussavi, R., Li, H., Pedro, M. S., & Dickler, R. (2018) · Springer eBooks · doi:10.1007/978-3-319-76935-6_8 · Cited by 42
“These assessment algorithms were built and validated using student data (Sao Pedro et al. 2010, 2012a, 2013b, c, 2014; Gobert et al. 2012, 2013, 2015; Moussavi et al. 2015, 2016a).”
MethodSelf-citationScalise, K., & Clarke‐Midura, J. (2018) · Journal of Research in Science Teaching · doi:10.1002/tea.21464 · Cited by 43
Yang, X., Zhang, M., Zhao, Y., Wang, Q., & Hong, J. (2022) · Thinking Skills and Creativity · doi:10.1016/j.tsc.2022.101183 · Cited by 59
Deane, P., Sabatini, J., Feng, G., Sparks, J. R., Yi, S., Fowles, M. E., O’Reilly, T., Jueds, K., Krovetz, R., & Foley, C. (2015) · ETS Research Report Series · doi:10.1002/ets2.12063 · Cited by 43
Note-taking and science inquiry in an open-ended learning environment
Jiang, Y., Clarke‐Midura, J., Keller, B., Baker, R. S., Paquette, L., & Ocumpaugh, J. L. (2018) · Contemporary Educational Psychology · doi:10.1016/j.cedpsych.2018.08.004 · Cited by 37
Self-citationModeling Collaborative Interaction Patterns in a Simulation‐Based Task
Andrews‐Todd, J., Kerr, D., Mislevy, R. J., von Davier, A. A., Hao, J., & Liu, L. (2017) · Journal of Educational Measurement · doi:10.1111/jedm.12132 · Cited by 42
Investigating collaborative problem solving skills and outcomes across computer-based tasks
Andrews‐Todd, J., Jiang, Y., Steinberg, J., Pugh, S. L., & D’Mello, S. K. (2023) · Computers & Education · doi:10.1016/j.compedu.2023.104928 · Cited by 44
Psychometric and Evidentiary Advances, Opportunities, and Challenges for Simulation-Based Assessment
Levy, R. (2013) · Educational Assessment · doi:10.1080/10627197.2013.814517 · Cited by 33
“, 2012), intelligent tutoring systems (Gobert et al., 2012; Mislevy & Gitomer, 1996; VanLehn & Niu, 2001) and games (Behrens, Frezzo, Mislevy, Kroopnick, & Wise, 2008; Kerr, Chung, & Iseli, 2011; Shute, 2011; Shute et al.”
Omarchevska, Y., Lachner, A., Richter, J., & Scheiter, K. (2021) · Journal of the Learning Sciences · doi:10.1080/10508406.2021.1966633 · Cited by 44
“However, we argue that looking at scientific reasoning processes might be an informative alternative way of measuring students’ actual scientific reasoning abilities (Gobert et al., 2012).”
BackgroundThe Future of Assessment in Technology-Rich Environments: Psychometric Considerations
DiCerbo, K. E., Shute, V. J., & Kim, Y. J. (2016) · Springer eBooks · doi:10.1007/978-3-319-17727-4_66-1 · Cited by 38
Assessing students' performance using the learning analytics enriched rubrics
Dimopoulos, I., Πετροπούλου, Ο., & Retalis, S. (2013) · International Conference on Learning Analytics and Knowledge (LAK) · doi:10.1145/2460296.2460335 · Cited by 25
“So there is an imperative need for developing new assessment tools capable of providing the teachers and the students, the ability to effectively use the enriched rubrics smoothly and quickly throughout the educational process via a unified environment [27, 28].”
BackgroundPedro, M. S., Baker, R. S., & Gobert, J. D. (2013) · International Conference on Learning Analytics and Knowledge (LAK) · doi:10.1145/2460296.2460334 · Cited by 25
“The Phase Change activities [8] aim to promote unde rstanding about the melting and boiling properties of ice.”
BackgroundMethodInfluentialSelf-citationAutomated Scoring with Validity in Mind
Bejar, I. I., Mislevy, R. J., & Zhang, M. (2016) · John Wiley & Sons, Inc. eBooks · doi:10.1002/9781118956588.ch10 · Cited by 32
AI-Powered Gamified Scaffolding: Transforming Learning in Virtual Learning Environment
Jiang, X., Wang, R., Hoang, T. N., Ranaweera, C., Dong, C., & Myers, T. (2025) · Electronics · doi:10.3390/electronics14132732 · Cited by 32
The In-Task Assessment Framework for Behavioral Data
Kerr, D., Andrews‐Todd, J., & Mislevy, R. J. (2016) · John Wiley & Sons, Inc. eBooks · doi:10.1002/9781118956588.ch20 · Cited by 21
Intelligent tutoring systems: a history and an example of an ITS for science
Gobert, J. D., Pedro, M. S., Li, H., & Lott, C. (2022) · Elsevier eBooks · doi:10.1016/b978-0-12-818630-5.10058-2 · Cited by 25
Self-citationFukuda, M., Hajian, S., Jain, M., Liu, A. L., Obaid, T., Nesbit, J. C., & Winne, P. H. (2022) · International Journal of Science Education · doi:10.1080/09500693.2022.2062799 · Cited by 25
“…has developed individualised computer-based tutoring systems that offer interactive support depending on learners’ lack of inquiry skills (e.g. Gobert et al., 2012, 2015, 2018), systems that adapt guidance to learners’ inquiry tactics and understanding during the inquiry process have not…”
BackgroundMislevy, R. J., & Durán, R. P. (2014) · TESOL Quarterly · doi:10.1002/tesq.177 · Cited by 21
Developing and Validating Cognitive Models in Assessment
Keehner, M., Gorin, J. S., Feng, G., & Katz, I. R. (2016) · John Wiley & Sons, Inc. eBooks · doi:10.1002/9781118956588.ch4 · Cited by 21
Xue, X., Feng, J. H., Gao, Y. D., Liu, M., Zhang, W., Sun, X., Zhao, A., & Guo, S. (2019) · Entropy · doi:10.3390/e21121227 · Cited by 21
An Approachable Analytical Study on Big Educational Data Mining
Aghabozorgi, S. R., Mahroeian, H., Dutt, A., Wah, T. Y., & Herawan, T. (2014) · Lecture notes in computer science · doi:10.1007/978-3-319-09156-3_50 · Cited by 20
“Learning providers, institutes, universities, schools and colleges always had the ability to generate huge amounts of educational data [8].”
BackgroundVelasquez, N. F., Fields, D. A., Olsen, D. H., Martin, T., Shepherd, M. C., Strommer, A., & Kafai, Y. B. (2014) · Hawaii International Conference on System Sciences (HICSS) · doi:10.1109/hicss.2014.209 · Cited by 24
“For instance, such analyses have been applied to students’ semi-structured interviews about astronomy [30] and to inquiry-driven science education in online environments [15].”
BackgroundAndrews‐Todd, J., Steinberg, J., Flor, M., & Forsyth, C. M. (2022) · Journal of Intelligence · doi:10.3390/jintelligence10030039 · Cited by 22
Educational Neuroscience: Exploring Cognitive Processes that Underlie Learning
Antonenko, P. (2018) · Educational communications and technology: issues and innovations · doi:10.1007/978-3-030-02631-8_3 · Cited by 22
Enabling data mining of handwritten coursework
Stahovich, T. F., & Lin, H. (2016) · Computers & Graphics · doi:10.1016/j.cag.2016.01.002 · Cited by 19
Prognosis Essay Scoring and Article Relevancy Using Multi-Text Features and Machine Learning
Mehmood, A., On, B.-W., Lee, I., & Choi, G. S. (2017) · Symmetry · doi:10.3390/sym9010011 · Cited by 16
“An interactive environment called Science Assessments [38] is being developed to assess students’ inquiry skills as they engage in an inquiry using science micro-worlds.”
Evaluating the Transfer of Scaffolded Inquiry: What Sticks and Does It Last?
Li, H., Gobert, J. D., & Dickler, R. (2019) · Lecture notes in computer science · doi:10.1007/978-3-030-23207-8_31 · Cited by 18
Self-citationComparing Representations for Learner Models in Interactive Simulations
Conati, C., Fratamico, L., Kardan, S., & Roll, I. (2015) · Lecture notes in computer science · doi:10.1007/978-3-319-19773-9_8 · Cited by 14
“Some previous work has dealt with the challenge by limiting the exploratory nature of the interaction [4, 6].”
BackgroundDigital assessment environments for scientific inquiry practices
Gobert, J. D., & Sao Pedro, M. A. (2016) · The Handbook of Cognition and Assessment · doi:10.1002/9781118956588.ch21 · Cited by 14
Self-citationInq-ITS: Creating Rigorous Assessment and Real-Time Support of Science Learning
Gobert, J. D. (2023) · XRDS Crossroads The ACM Magazine for Students · doi:10.1145/3589647 · Cited by 14
“Lastly, key advancements leveraged by our system are the computational techniques, such as data mining, ena with widgets and other representational tools to elicit and “observe” their thinking, which in turn are used to assess their competencies reflected in their inquiry processes and products (see [3, 4] for more de…”
MethodSelf-citationNicolay, B., Krieger, F., Kuhn, J., Graesser, A. C., Ifenthaler, D., Baker, R. S., & Greiff, S. (2023) · Intelligence · doi:10.1016/j.intell.2023.101793 · Cited by 18
Self-citationAn open approach for learning educational data mining
Jormanainen, I., & Sutinen, E. (2013) · Koli Calling International Conference on Computing Education Research · doi:10.1145/2526968.2526997 · Cited by 13
“Most of the work in data mining in educational systems contributes to student assessment and course adaptation (for example [2] and [3]).”
The Usefulness of Log Based Clustering in a Complex Simulation Environment
Kardan, S., Roll, I., & Conati, C. (2014) · Lecture notes in computer science · doi:10.1007/978-3-319-07221-0_21 · Cited by 13
“simulations offer detailed scaffolding and explicit fe ools such as hypotheses builders [4, 12]).”
BackgroundUsing Technology to Address Individual Differences in Learning
Antonenko, P., Dawson, K., Cheng, L., & Wang, J. (2020) · Springer eBooks · doi:10.1007/978-3-030-36119-8_6 · Cited by 18
An efficient human resource management system model using web-based hybrid technique
Khan, S. (2022) · Problems and Perspectives in Management · doi:10.21511/ppm.20(2).2022.18 · Cited by 13
Estimating Student Knowledge from Paired Interaction Data.
Rafferty, A. N., Davenport, J. L., & Brunskill, E. (2013) · Cited by 11
Pedro, S., & Michael, A. (2013) · Cited by 11
Pedro, M. S., Gobert, J. D., & Betts, C. G. (2014) · Lecture notes in computer science · doi:10.1007/978-3-319-07221-0_75 · Cited by 10
“More specifically, students attempt to form a testable hypothesis using a pulldown menu-based sentence builder, collect data by changing the simulation’s variables and running trials (Figure 1), analyze their data using pulldown menus to construct a claim and by selecting trials as evidence, and communicate findings i…”
BackgroundMethodSelf-citationJaffal, Y., & Wloka, D. W. (2015) · DOAJ (DOAJ: Directory of Open Access Journals) · doi:10.20368/1971-8829/1063 · Cited by 9
“Science Assitment (Gobert et al., 2012) allows players to hypothesise by filling blanks in a dialogue box with drop down lists then provides them with a virtual lab or an exploration environment where they can practice data collection and test their hypothesis.”
BackgroundMoon, J., & Liu, Z. (2019) · Smart computing and intelligence · doi:10.1007/978-981-32-9335-9_2 · Cited by 9
Lord, T., Horwitz, P., Lee, H., Pallant, A., & Lore, C. (2024) · Journal of Science Education and Technology · doi:10.1007/s10956-024-10126-8 · Cited by 13
“Researchers have mined log data to determine if students were conducting controlled experiments (Gobert et al., 2012; Greiff et al., 2018; Scalise & Clarke-Midura, 2018), to investigate students’ strategies and classify use patterns (Greiff et al., 2018), and to discover if students were engaging…”
Investigating Epistemic Stances in Game Play with Data Mining
Martinez-Garza, M. M., & Clark, D. B. (2017) · International Journal of Gaming and Computer-Mediated Simulations · doi:10.4018/ijgcms.2017070101 · Cited by 9
Pedro, M. S., Jiang, Y., Paquette, L., Baker, R. S., & Gobert, J. D. (2014) · International Conference of Learning Sciences · Cited by 8
Self-citationAn event detection approach for identifying learning evidence in collaborative virtual environments
Felemban, S., Gardner, M., & Callaghan, V. (2016) · Computer Science and Electronic Engineering Conference · doi:10.1109/ceec.2016.7835886 · Cited by 7
“Secondly, the literature lacks the guidance to analyse and aggregate the data streams produced from students' using these environments in order to assess their performance [17].”
BackgroundTowards Observing and Assessing Collaborative Learning Activities in Immersive Environments
Felemban, S., Gardner, M., Callaghan, V., & Peña-Ríos, A. (2017) · Communications in computer and information science · doi:10.1007/978-3-319-60633-0_5 · Cited by 7
EĞİTSEL VERİ MADENCİLİĞİ İLE İLGİLİ 2006-2016 YILLARI ARASINDA YAPILAN ÇALIŞMALARIN İNCELENMESİ
TEKİN, A., & ÖZTEKİN, Z. (2018) · Eğitim Teknolojisi Kuram ve Uygulama · doi:10.17943/etku.351473 · Cited by 11
Using process features to investigate scientific problem-solving in large-scale assessments
Gong, T., Shuai, L., Jiang, Y., & Arslan, B. (2023) · Frontiers in Psychology · doi:10.3389/fpsyg.2023.1131019 · Cited by 6
“, 2015; Provasnik, 2021), all of which provide additional clues of students’ problem-solving behaviors (Kim et al., 2007; Ebenezer et al., 2011; Gobert et al., 2012).”
BackgroundWang, Y. J., Lee, S. W., Liu, C., Lin, P. C., & Wen, C. (2021) · Journal of Science Education and Technology · doi:10.1007/s10956-021-09916-1 · Cited by 7
“…have reported the benefits of using simulations for modeling-based learning, including developing an understanding of the nature of models, and developing an understanding of scientific concepts and modeling practices (Gobert et al., 2012; Mulder et al., 2016; Scalise & Clarke-Midura, 2018).”
Experimentierprozesse von Lehramtsstudierenden der Biologie. Eine Videostudie
Kambach, M. (2018) · Logos Verlag Berlin eBooks · doi:10.30819/4669 · Cited by 12
Testing the Robustness of Inquiry Practices Once Scaffolding Is Removed
Li, H., Gobert, J. D., & Dickler, R. (2019) · Lecture notes in computer science · doi:10.1007/978-3-030-22244-4_25 · Cited by 6
Self-citationTeig, N. (2020) · Thesis Commons (OSF Preprints) · doi:10.31237/osf.io/5xutk · Cited by 6
Assessment of collaborative problem solving skills
Andrews‐Todd, J., & Forsyth, C. M. (2022) · Elsevier eBooks · doi:10.1016/b978-0-12-818630-5.10062-4 · Cited by 8
Towards defining, assessing and modelling competency levels in stoichiometry
Krause, A., Polarz, S., Hoppe, A., Ewerth, R., & Nehring, A. (2025) · Chemistry Education Research and Practice · doi:10.1039/d5rp00077g · Cited by 6
AI and BDA impact on Stakeholders' Responses to Education Technology Adoption
Elshamly, A., & Gameel, Z. A. A. (2023) · MIGRATION LETTERS · doi:10.59670/ml.v20i8.5738 · Cited by 9
Sociocognitive and Argumentation Perspectives on Psychometric Modeling in Educational Assessment
Mislevy, R. J. (2024) · Psychometrika · doi:10.1007/s11336-024-09966-5 · Cited by 8
“(cid:129) A simulated science lab with theory-based investigations, affordances, and automated scoring procedures that generalize across tasks (Gobert et al., 2012) .”
BackgroundYang, L., Chen, F., Jin, H., Hoffman, M. D., & Estrin, D. L. (2018) · ACM Transactions on Intelligent Systems and Technology · doi:10.1145/3232231 · Cited by 5
Design, Development, and Evaluation of Scaffolds for Data Interpretation Practices during Inquiry
Moussavi-Aghdam, R. (2018) · Digital WPI · Cited by 6
The Future of Assessment in Technology-Rich Environments: Psychometric Considerations
DiCerbo, K. E., Shute, V. J., & Kim, Y. J. (2023) · Springer eBooks · doi:10.1007/978-3-319-17461-7_66 · Cited by 4
Kusuma, M., Wilujeng, İ., & Susongko, P. (2024) · International Journal of STEM Education for Sustainability · doi:10.53889/ijses.v4i1.332 · Cited by 6
Using Machine Learning to Understand Students' Learning Patterns in Simulations.
Jang, W., Francisco, J., Ranganathan, N., McCarroll, K. M., & Ryoo, K. (2020) · doi:10.22318/icls2020.2593 · Cited by 4
“For instance, students may run too few or too many trials when testing hypotheses (Gobert et al., 2012).”
BackgroundSupporting teachers in unpredictable robotics learning environments
Jormanainen, I. (2013) · UEF eRepo (University of Eastern Finland) · Cited by 4
Smith, A., Akşit, O., Min, W., Wiebe, E., Mott, B., & Lester, J. C. (2016) · Lecture notes in computer science · doi:10.1007/978-3-319-39583-8_16 · Cited by 3
“used ECD to create predictive models of student inquiry skills from action logs generated in a science microworld [15].”
MethodThe Impacts of Automatic Scaffolding on Students' Acquisition of Data Collection Inquiry Skills
Pedro, M. S., Gobert, J. D., & Baker, R. S. (2014) · Grantee Submission · Cited by 3
Self-citationHow does Bayesian knowledge tracing model emergence of knowledge about a mechanical system?
Lee, H., Gweon, G.-H., Dorsey, C., Tinker, R. F., Finzer, W., Damelin, D., Kimball, N., Pallant, A., & Lord, T. (2015) · International Conference on Learning Analytics and Knowledge (LAK) · doi:10.1145/2723576.2723587 · Cited by 3
“In order to investigate patterns of knowledge emergence during the ramp game, we applied the Monte Carlo Bayesian Knowledge Tracing (BKT) algorithm to 447 game segments produced by 64 student groups in two physics teachers' classrooms.”
MethodMeasuring the Level of Complexity of Scientific Inquiries: The LCSI Index.
Eilam, E. (2015) · Victoria University Research Repository (Victoria University) · doi:10.12973/ijese.2015.227a · Cited by 5
“For example the program ‘Science Assistments’ (Gobert, Heffernan, Ruiz & Ryung, 2007) was developed specifically for providing scalable, reliable performance-based assessment of authentic inquiry skills (Gobert et al., 2012).”
MethodSchimpf, C., Sleezer, R., & Xie, C. (2020) · ASEE Annual Conference & Exposition · doi:10.18260/1-2--31316 · Cited by 3
Carpenter, K. K. (2013) · ProQuest LLC eBooks · doi:10.7916/d8fr03tn · Cited by 2
Jiang, Y., Brockway, D., & Moon, J. A. (2022) · Journal of Research in Science Teaching · doi:10.1002/tea.21832 · Cited by 6
Towards Recognising Learning Evidence in Collaborative Virtual Environments: A Mixed Agents Approach
Felemban, S., Gardner, M., & Callaghan, V. (2017) · Computers · doi:10.3390/computers6030022 · Cited by 2
“In addition, there is a lack of guidance in the empirical literature for interpreting student data streams from these environments in order to monitor their performance [22].”
BackgroundWixon, M. (2013) · Digital WPI · Cited by 2
Antares: A Flexible Assessment Framework for Exploratory Immersive Environments
Maderer, J., & Gütl, C. (2020) · Intelligent systems reference library · doi:10.1007/978-981-15-9908-8_7 · Cited by 2
Metadata
- Authors
- Gobert, J. D., Sao Pedro, M. A., Baker, R. S. J. D., Toto, E., & Montalvo, O.
- Affiliations
- Worcester Polytechnic Institute (US)
- Worcester Polytechnic Institute
- Venue
- Zenodo
- Publisher
- Zenodo
- Published
- 2012-10-01
- Volume
- 4
- Issue
- 1
- Pages
- 111-143
- ISSN
- 2157-2100 (ISSN-L)
- OpenAlex
- W1485330246
- Cited by
- 122
- References
- 107
- Citations by year
- 2026: 2 · 2025: 2 · 2024: 5 · 2023: 9 · 2022: 11 · 2021: 7 · 2020: 9 · 2019: 7 · 2018: 11 · 2017: 8 · 2016: 12 · 2015: 11 · 2014: 10 · 2013: 16 · 2012: 2
- FWCI
- 12.28
- Type
- journal article
- Language
- en
- Open access
- Locations
- Journal of Educational Data Mining (publishedVersion)
- Zenodo (CERN European Organization for Nuclear Research) (submittedVersion, cc-by-nc-nd)
- Zenodo (CERN European Organization for Nuclear Research)
- Educational Data Mining
- Funders
- National Science Foundation (0742503, 0733286, 1008649)
- U.S. Department of Education
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Intelligent Tutoring Systems and Adaptive Learning
- Physical Sciences › Computer Science › Computer Science Applications › Online Learning and Analytics
- Social Sciences › Education › Science Education and Pedagogy
- Keywords
- scientific inquiry skills, evidence-centered design, student model, task modeling, evidence model, hypothesis testing, controlled experiments, scaffolding
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.