Subgoal-labeled instructional material improves performance and transfer in learning to develop mobile applications
The DOI matches its Crossref record; 27 of the 27 references it cites were found in a registry or an index.
Abstract
Mental models are mental representations of how an action changes a problem state. Creating a mental model early in the learning process is a strong predictor of success in computer science classes. One major problem in computer science education, however, is that novices have difficulty creating mental models perhaps because of the cognitive overload caused by traditional teaching methods. The present study employed subgoal-labeled instructional materials to promote the creation of mental models when teaching novices to program in Android App Inventor. Utilizing this and other well-established educational tools, such as scaffolding, to reduce cognitive load in computer science education improved the performance of participants on novel tasks when learning to develop mobile applications.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Prior research has shown that subgoallabeled instructional material reduces extraneous cognitive load imposed on novices learning programming by chunking problemsolving steps and promoting self-explanation [61].”
From Studying the effect of AI Code Generators on Supporting Novice Learners in Introductory Programming (2023) · cites this paper as [61]
Citations
Cites
Kirschner, P. A., Sweller, J., & Clark, R. E. (2006) · Educational Psychologist · doi:10.1207/s15326985ep4102_1 · Cited by 7,776 · cited 7×
“This reduction in extraneous cognitive load might have allowed students to learn faster because more of their mental resources were available for germane cognitive load which is responsible for creating mental models and storing information in long-term memory (Kirschner et al., 2006).”
BackgroundInfluentialResnick, M., Maloney, J., Monroy-Hernández, A., Rusk, N., Eastmond, E., Brennan, K., Millner, A., Rosenbaum, E., Silver, J., Silverman, B., et al. (2009) · Communications of the ACM · doi:10.1145/1592761.1592779 · Cited by 3,333
Element Interactivity and Intrinsic, Extraneous, and Germane Cognitive Load
Sweller, J. (2010) · Educational Psychology Review · doi:10.1007/s10648-010-9128-5 · Cited by 2,020
Some observations on mental models
Norman, D. A. (1983) · Medical Entomology and Zoology · Cited by 1,549
Pea, R. D. (2004) · Journal of the Learning Sciences · doi:10.1207/s15327809jls1303_6 · Cited by 1,047
Learning from Examples: Instructional Principles from the Worked Examples Research
Atkinson, R. K., Derry, S. J., Renkl, A., & Wortham, D. (2000) · Review of Educational Research · doi:10.2307/1170661 · Cited by 1,029 · cited 2×
“Additionally, worked examples provide a solution for a learner to study before the student is able to solve problems independently (Atkinson et al., 2000).”
BackgroundBlueprints for complex learning: The 4C/ID-model
van Merriënboer, J. J. G., Clark, R. E., & de Croock, M. B. M. (2002) · Educational Technology Research and Development · doi:10.1007/bf02504993 · Cited by 708
Bielaczyc, K., Pirolli, P. L., & Brown, A. L. (1995) · Cognition and Instruction · doi:10.1207/s1532690xci1302_3 · Cited by 422
ANDERSON, J., FARRELL, R., & SAUERS, R. (1984) · Cognitive Science · doi:10.1016/s0364-0213(84)80013-0 · Cited by 372
The subgoal learning model: Creating better examples so that students can solve novel problems.
Catrambone, R. (1998) · Journal of Experimental Psychology: General · doi:10.1037//0096-3445.127.4.355 · Cited by 327
Self-citation
Research works printed but not linked: 6
- 10.3102/00346543070002181 · doi:10.3102/00346543070002181 · Paper page
- 10.5555/1599503.1599529 · doi:10.5555/1599503.1599529
- 10.1037/0096-3445.127.4.355 · doi:10.1037/0096-3445.127.4.355 · Paper page
- Catrambone , R. , Gane , B. D. , Adams , A. E. , Bujak , K. R. , Kline , K. A. , & Eiriksdottir , E. 2012. Task Analysis by Problem Solving (TAPS): A Method for Uncovering Expert Knowledge. Unpublished manuscript , School of Psychology , Georgia Institute of Technology , Atlanta, GA . Catrambone, R., Gane, B. D., Adams, A. E., Bujak, K. R., Kline, K. A., & Eiriksdottir, E. 2012. Task Analysis by Problem Solving (TAPS): A Method for Uncovering Expert Knowledge. Unpublished manuscript, School of Psychology, Georgia Institute of Technology, Atlanta, GA.
- Davis , E. , Linn , M. , Mann , L. , & Clancy , M. 1993 . Mind your Ps and Qs: Using parentheses and quotes in LISP. In C. R. Cook, J. C. Scholtz, and J. C. Spohrer (Eds.) , Empirical Studies of Programmers: Fifth Workshop, (pp. 62--85) . Norwood, NJ: Ablex. 1993. Davis, E., Linn, M., Mann, L., & Clancy, M. 1993. Mind your Ps and Qs: Using parentheses and quotes in LISP. In C. R. Cook, J. C. Scholtz, and J. C. Spohrer (Eds.), Empirical Studies of Programmers: Fifth Workshop, (pp. 62--85). Norwood, NJ: Ablex. 1993.
- Trafton , J. G. , & Reiser , B. J. 1993 . The contributions of studying examples and solving problems to skill acquisition . In Proceedings of the Fifteenth Annual Conference of the Cognitive Science Society (pp. 1017--1022) . Boulder, CO. Trafton, J. G., & Reiser, B. J. 1993. The contributions of studying examples and solving problems to skill acquisition. In Proceedings of the Fifteenth Annual Conference of the Cognitive Science Society (pp. 1017--1022). Boulder, CO.
Cited by
Studying the effect of AI Code Generators on Supporting Novice Learners in Introductory Programming
Kazemitabaar, M., Chow, J., Ma, C. K. T., Ericson, B. J., Weintrop, D., & Grossman, T. (2023) · Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3544548.3580919 · Cited by 366
“Prior research has shown that subgoal-labeled instructional material reduces extraneous cognitive load imposed on novices learning programming by chunking problem-solving steps and promoting self-explanation [61].”
Kazemitabaar, M., Ye, R., Wang, X., Henley, A. Z., Denny, P., Craig, M., & Grossman, T. (2024) · Proceedings of the CHI Conference on Human Factors in Computing Systems · doi:10.1145/3613904.3642773 · Cited by 290
Learner-Centered Design of Computing Education: Research on Computing for Everyone
Guzdial, M. (2015) · Synthesis lectures on human-centered informatics · doi:10.2200/s00684ed1v01y201511hci033 · Cited by 244
Self-citationThe Cambridge Handbook of Computing Education Research
(2019) · Cambridge University Press eBooks · doi:10.1017/9781108654555 · Cited by 126
Novice Programmers and Introductory Programming
Robins, A. V. (2019) · The Cambridge Handbook of Computing Education Research · doi:10.1017/9781108654555.013 · Cited by 175
Subgoals, Context, and Worked Examples in Learning Computing Problem Solving
Morrison, B. B., Margulieux, L. E., & Guzdial, M. (2015) · Proceedings of the eleventh annual International Conference on International Computing Education Research · doi:10.1145/2787622.2787733 · Cited by 174
“While these cognitive load reducing techniques have been empirically tested in math and science disciplines, we have been the first to test these with computer science learning [15].”
BackgroundSelf-citationYildiz Durak, H. (2020) · Technology, Knowledge and Learning · doi:10.1007/s10758-018-9391-y · Cited by 159
“Margulieux et al. (2012) emphasizes that the difficulties in programming can be overcome by turning it into an easier and more enjoyable experience with the help of different programming environments.”
BackgroundSubgoals Help Students Solve Parsons Problems
Morrison, B. B., Margulieux, L. E., Ericson, B., & Guzdial, M. (2016) · Proceedings of the 47th ACM Technical Symposium on Computing Science Education · doi:10.1145/2839509.2844617 · Cited by 125
“While these cognitive load reducing techniques have been empirically tested in math and science disciplines, we have been the first to test these with computer science learning [17].”
BackgroundInfluentialSelf-citationMobile app design for teaching and learning: Educators’ experiences in an online graduate course
Hsu, Y.-C., & Ching, Y. (2013) · The International Review of Research in Open and Distributed Learning · doi:10.19173/irrodl.v14i4.1542 · Cited by 144
The Role of Self-Regulation in Programming Problem Solving Process and Success
Loksa, D., & Ko, A. J. (2016) · Proceedings of the 2016 ACM Conference on International Computing Education Research · doi:10.1145/2960310.2960334 · Cited by 143
“For example, recent studies have explored worked examples and the effect of sub-goal labels, finding that examples and sub-goal labels can promote greater problem solving success [20,22,23].”
ResultSolving parsons problems versus fixing and writing code
Ericson, B. J., Margulieux, L. E., & Rick, J. (2017) · Proceedings of the 17th Koli Calling International Conference on Computing Education Research · doi:10.1145/3141880.3141895 · Cited by 121
“3 Subgoal labeling is a method of teaching subgoal learning through worked examples [7, 29].”
MethodSelf-citationMargulieux, L. E., Morrison, B. B., & Decker, A. (2020) · International Journal of STEM Education · doi:10.1186/s40594-020-00222-7 · Cited by 85
Self-citationCurzon, P., Bell, T., Waite, J., & Dorling, M. (2019) · Cambridge University Press eBooks · doi:10.1017/9781108654555.018 · Cited by 115
Learnersourcing Subgoal Labels for How-to Videos
Weir, S., Kim, J., Gajos, K. Z., & Miller, R. C. (2015) · ACM Conference on Computer Supported Cooperative Work (CSCW) · doi:10.1145/2675133.2675219 · Cited by 111
“Previous research [20] has shown that people learn better from videos if they are simultaneously presented with the subgoals, which capture meaningful conceptual pieces of the procedure covered in the video (Figure 2).”
BackgroundResultMultimodal Pretraining for Dense Video Captioning
Huang, G., Pang, B., Zhu, Z., Rivera, C. E., & Soricut, R. (2020) · Conference of the Asia-Pacific Chapter of the Association for Computational Linguistics and the International Joint Conference on Natural Language Processing (AACL-IJCNLP) · doi:10.18653/v1/2020.aacl-main.48 · Cited by 94
Ten quick tips for teaching programming
Brown, N. C. C., & Wilson, G. (2018) · PLOS Computational Biology · doi:10.1371/journal.pcbi.1006023 · Cited by 89
Novice Programming Environments. Scratch & App Inventor: a first comparison
Papadakis, S., Kalogiannakis, M., Orfanakis, V., & Zaranis, N. (2014) · doi:10.1145/2643604.2643613 · Cited by 88
The History of Computing Education Research
Guzdial, M., & du Boulay, B. (2019) · Cambridge University Press eBooks · doi:10.1017/9781108654555.002 · Cited by 85
Self-citationIdentifying Design Principles for CS Teacher Ebooks through Design-Based Research
Ericson, B. J., Rogers, K., Parker, M., Morrison, B., & Guzdial, M. (2016) · Proceedings of the 2016 ACM Conference on International Computing Education Research · doi:10.1145/2960310.2960335 · Cited by 78
“As we started this project, a collaboration with Psychology professor Richard Catrambone and Ph.D. student Lauren Margulieux led to studies supporting the belief that subgoal labeling of worked examples facilitated student learning, retention, and transfer [24].”
BackgroundSelf-citationReviews in instructional video
van der Meij, H. (2017) · Computers & Education · doi:10.1016/j.compedu.2017.07.002 · Cited by 84
An evaluation of a professional learning network for computer science teachers
Cutts, Q. I., Robertson, J., Donaldson, P., & O’Donnell, L. (2017) · Computer Science Education · doi:10.1080/08993408.2017.1315958 · Cited by 76
Programming Paradigms and Beyond
Krishnamurthi, S., & Fisler, K. (2019) · Cambridge University Press eBooks · doi:10.1017/9781108654555.014 · Cited by 75
Horn, M., & Bers, M. U. (2019) · Cambridge University Press eBooks · doi:10.1017/9781108654555.023 · Cited by 72
Snodgrass, M. R., Israel, M., & Reese, G. C. (2016) · Computers & Education · doi:10.1016/j.compedu.2016.04.011 · Cited by 71
Papadakis, S., & Orfanakis, V. (2017) · International Journal of Technology Enhanced Learning · doi:10.1504/ijtel.2018.088333 · Cited by 67
Codepourri: Creating visual coding tutorials using a volunteer crowd of learners
Gordon, M., & Guo, P. J. (2015) · 2015 IEEE Symposium on Visual Languages and Human-Centric Computing (VL/HCC) · doi:10.1109/vlhcc.2015.7357193 · Cited by 60
“used worked examples to teach the Android App Inventor visual language [6].”
BackgroundMethodWorked examples in computer science
Skudder, B., & Luxton-Reilly, A. (2014) · ResearchSpace (University of Auckland) · doi:10.5555/2667490.2667497 · Cited by 59
Cognitive Sciences for Computing Education
Robins, A. V., Margulieux, L. E., & Morrison, B. B. (2019) · Cambridge University Press eBooks · doi:10.1017/9781108654555.010 · Cited by 59
Self-citationImproving problem solving with subgoal labels in expository text and worked examples
Margulieux, L. E., & Catrambone, R. (2015) · Learning and Instruction · doi:10.1016/j.learninstruc.2015.12.002 · Cited by 58
“Previous experiments using similar instructional materials found no statistical differences in scores between participants who had taken one course in computer science and those who had taken none (Margulieux et al., 2012).”
BackgroundMethodInfluentialSelf-citationMultimodal Pretraining for Dense Video CaptioningPreprint
Huang, G., Pang, B., Zhu, Z., Rivera, C. E., & Soricut, R. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2011.11760 · Cited by 57
“This effort echoes prior work in the literature showing how users of instructional videos can benefit from human-curated meta-data, such as a timeline pointing to the successive steps of a tutorial (Kim et al., 2014; Margulieux et al., 2012; Weir et al., 2015).”
BackgroundNovice Programmers and the Problem Description Effect
Bouvier, D., Lovellette, E., Matta, J., Alshaigy, B., Becker, B. A., Craig, M., Jackova, J., McCartney, R., Sanders, K., & Zarb, M. (2016) · Proceedings of the 2016 ITiCSE Working Group Reports · doi:10.1145/3024906.3024912 · Cited by 43
“This drawback has recently led to a line of work that revisits Soloway’s idea of teaching the underlying subgoals and task structure of programs [5, 6, 7, 11, 30, 36, 39].”
BackgroundAvoiding the Turing Tarpit: Learning Conversational Programming by Starting from Code’s Purpose
Cunningham, K. I., Ericson, B. J., Bejarano, R. A., & Guzdial, M. (2021) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3411764.3445571 · Cited by 54
“Evidence suggests that subgoal labels support self-explanation behavior, in that the labels give students the language to use when explaining the programs to themselves [39, 41, 44].”
BackgroundSelf-citationA Case Study on Combining ASR and Visual Features for Generating Instructional Video Captions
Hessel, J., Pang, B., Zhu, Z., & Soricut, R. (2019) · Conference on Computational Natural Language Learning · doi:10.18653/v1/k19-1039 · Cited by 51
Subgoal Labeled Worked Examples in K-3 Education
Joentausta, J., & Hellas, A. (2018) · ACM Technical Symposium on Computer Science Education (SIGCSE) · doi:10.1145/3159450.3159494 · Cited by 49
“While such studies have been conducted in higher education and teacher training [22, 23], studies on the topic in primary schools are rare.”
BackgroundApplying cognitive load theory to the redesign of a conventional database systems course
Mason, R., Seton, C., & Cooper, G. A. (2016) · Computer Science Education · doi:10.1080/08993408.2016.1160597 · Cited by 48
“Sub-goals have been used successfully to improve learning performance in some IT domains such as visual programming (Margulieux, Guzdial, & Catrambone, 2012).”
MethodComputing EducationLiterature Review and Voices from the Field
Blikstein, P., & Moghadam, S. H. (2019) · Cambridge University Press eBooks · doi:10.1017/9781108654555.004 · Cited by 47
Motivation, Attitudes, and Dispositions
Lishinski, A., & Yadav, A. K. (2019) · Cambridge University Press eBooks · doi:10.1017/9781108654555.029 · Cited by 46
Michaelis, J. E., & Weintrop, D. (2022) · ACM Transactions on Computing Education · doi:10.1145/3487054 · Cited by 44
“Providing worked examples with subgoal labels is another example of a strategy to scale the level of challenge, within a single activity, that has been found to be efective at helping novices learn to program [88, 97].”
BackgroundLearning Sciences for Computing Education
Margulieux, L. E., Dorn, B., & Searle, K. A. (2019) · Cambridge University Press eBooks · doi:10.1017/9781108654555.009 · Cited by 43
Self-citationFalkner, K. E. K., & Sheard, J. (2019) · Cambridge University Press eBooks · doi:10.1017/9781108654555.016 · Cited by 42
Lewis, C. M., Shah, N., & Falkner, K. E. K. (2019) · Cambridge University Press eBooks · doi:10.1017/9781108654555.017 · Cited by 43
Tamang, L. J., Alshaikh, Z., Khayi, N. A., Oli, P., & Rus, V. (2021) · Proceedings of the 52nd ACM Technical Symposium on Computer Science Education · doi:10.1145/3408877.3432423 · Cited by 24
“Indeed, a major challenge in CS education is the difficulty novice programmers face with constructing accurate mental models during key learning activities, such as source code comprehension [29, 37, 39, 49].”
BackgroundImprov: Teaching Programming at Scale via Live Coding
Chen, C. H., & Guo, P. J. (2019) · ACM Conference on Learning @ Scale (L@S) · doi:10.1145/3330430.3333627 · Cited by 38
“Subgoal labeling is a pedagogical best practice whereby the instructor adds a higher-level conceptual description for each group of steps in a tutorial; it has been shown to help improve learner comprehension in a variety of STEM domains [14, 24, 34].”
BackgroundHaden, P. (2019) · Cambridge University Press eBooks · doi:10.1017/9781108654555.006 · Cited by 36
Demonstration-based training (DBT) in the design of a video tutorial for software training
van der Meij, H., & van der Meij, J. (2016) · Instructional Science · doi:10.1007/s11251-016-9394-9 · Cited by 36
“Positive effects of segmentation on learning have likewise been reported in other empirical studies (e.g., Boltz 1992; Catrambone 1995, 1998; Margulieux et al. 2012; Schittek Janda et al. 2005; Schwan et al. 2000).”
ResultDesigning for learning during collaborative projects online: tools and takeaways
Sankaranarayanan, S., Kandimalla, S. R., Cao, M., Maronna, I., An, H., Bogart, C., Murray, R. C., Hilton, M. L., Sakr, M. F., & Rosé, C. P. (2020) · Information and Learning Sciences · doi:10.1108/ils-04-2020-0095 · Cited by 36
Complex software training: Harnessing and optimizing video instruction
Brar, J., & van der Meij, H. (2017) · Computers in Human Behavior · doi:10.1016/j.chb.2017.01.014 · Cited by 35
Providing students with agency to self-scaffold in a computational science and engineering course
Vieira, C., Magana, A. J., Roy, A., & Falk, M. L. (2020) · Journal of Computing in Higher Education · doi:10.1007/s12528-020-09267-7 · Cited by 35
“…includes approaches such as highlighting syntax errors, supporting the debugging process, sub-goal labelling, providing examples with visual representations of algorithms, and promoting journaling and self-assessment (Basu et al. 2016; Hwang et al. 2015; Kaplan and An 2005; Margulieux et al. 2012).”
EngageCSEdu: engaging and retaining CS1 and CS2 students
Monge, A. E., Fadjo, C. L., Quinn, B., & Barker, L. J. (2015) · ACM Inroads · doi:10.1145/2714569 · Cited by 31
“■ Worked Examples w/ Subgoals: Provides sufficient scaffolds to effectively guide students through an activity [22].”
When Wrong is Right: The Instructional Power of Multiple Conceptions
Margulieux, L. E., Denny, P. C., Cunningham, K. I., Deutsch, M., & Shapiro, B. R. (2021) · ACM Conference on International Computing Education Research (ICER) · doi:10.1145/3446871.3469750 · Cited by 30
“Similarly, if students are prompted to compare worked examples to inductively extrapolate concepts, such as in analogical reasoning or by using subgoal labels, they typically gain better retention and transfer than if they receive the same examples without a prompt to compare them [63, 73].”
BackgroundSelf-citationPauses and spacing in learning to program
Leppänen, L., Leinonen, J., & Hellas, A. (2016) · Koli Calling International Conference on Computing Education Research · doi:10.1145/2999541.2999549 · Cited by 30
“While previous research has shown that subgoals are ben-eficial in many ways [24], it also seems that for the writing process in general, flexible higher level plans are also important [15].”
ResultTeacher Learning and Professional Development
Fincher, S. A., Kolikant, Y. B., & Falkner, K. E. K. (2019) · Cambridge University Press eBooks · doi:10.1017/9781108654555.026 · Cited by 31
Fokides, E. (2017) · Journal of Information Technology Education Research · doi:10.28945/3893 · Cited by 28
Qualitative Methods for Computing Education
Tenenberg, J. (2019) · Cambridge University Press eBooks · doi:10.1017/9781108654555.008 · Cited by 27
Design and Pilot Testing of Subgoal Labeled Worked Examples for Five Core Concepts in CS1
Margulieux, L. E., Morrison, B. B., & Decker, A. (2019) · ACM Conference on Innovation and Technology in Computer Science Education (ITiCSE) · doi:10.1145/3304221.3319756 · Cited by 27
“programming education that improves novice problem-solving performance [3, 6, 7, 8, 9].”
BackgroundMethodSelf-citationComparing and contrasting different algorithms leads to increased student learning
Patitsas, E., Craig, M., & Easterbrook, S. (2013) · Proceedings of the ninth annual international ACM conference on International computing education research · doi:10.1145/2493394.2493409 · Cited by 26
Effect of a 2-week scratch intervention in CS1 on learners with varying prior knowledge
Mishra, S., Sudeesh, B., Iyer, S. R., & Murthy, S. (2014) · ACM Conference on Innovation and Technology in Computer Science Education (ITiCSE) · doi:10.1145/2591708.2591733 · Cited by 26
Computing for Other Disciplines
Guzdial, M. (2019) · Cambridge University Press eBooks · doi:10.1017/9781108654555.020 · Cited by 26
Self-citationUsing Learners' Self-Explanations of Subgoals to Guide Initial Problem Solving in App Inventor
Margulieux, L. E., & Catrambone, R. (2017) · ACM Conference on International Computing Education Research (ICER) · doi:10.1145/3105726.3106168 · Cited by 25
“To make subgoal learning more pervasive in computing, researchers have recently tried crowdsourcing subgoal identification [9, 10] and prompting learners to self-explain the subgoals of procedures [2, 3, 4, 5].”
BackgroundSelf-citationLee, C., Myung, J., Han, J., Jin, J., & Oh, A. H. (2023) · arXiv (Cornell University) · doi:10.48550/arxiv.2309.10419 · Cited by 25
“In the context of programming education, subgoal learning is known to be helpful in reducing the extraneous cognitive load of the learners, thereby enhancing their problem-solving performance [3, 24].”
BackgroundLearning Loops: A Replication Study Illuminates Impact of HS Courses
Morrison, B. B., Decker, A., & Margulieux, L. E. (2016) · ACM Conference on International Computing Education Research (ICER) · doi:10.1145/2960310.2960330 · Cited by 23
“It is believed that worked examples, when carefully designed, can accomplish both of these goals [24].”
Self-citationUsing the SOLO Taxonomy to Understand Subgoal Labels Effect in CS1
Decker, A., Margulieux, L. E., & Morrison, B. B. (2019) · ACM Conference on International Computing Education Research (ICER) · doi:10.1145/3291279.3339405 · Cited by 23
“subgoals of a procedure because they often do not recognize these functional pieces on their own [3, 4, 8, 13-15].”
BackgroundSelf-citationLearnersourcing subgoal labeling to support learning from how-to videos
Kim, J., Miller, R. C., & Gajos, K. Z. (2013) · CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA) · doi:10.1145/2468356.2468477 · Cited by 23
“Video tutorials; how-to videos; subgoal labeling; learnersourcing; mixed-initiative; learning support.”
Malmi, L., Utting, I., & Ko, A. J. (2019) · Cambridge University Press eBooks · doi:10.1017/9781108654555.022 · Cited by 23
Towards a Model of API Learning
Kelleher, C. L., & Ichinco, M. (2019) · IEEE Symposium on Visual Languages and Human-Centric Computing (VL/HCC) · doi:10.1109/vlhcc.2019.8818850 · Cited by 22
Learning Outside the Classroom
Begel, A., & Ko, A. J. (2019) · Cambridge University Press eBooks · doi:10.1017/9781108654555.027 · Cited by 20
Leveraging the Integrated Development Environment for Learning Analytics
Carter, A., Hundhausen, C. D., & Olivares, D. M. (2019) · Cambridge University Press eBooks · doi:10.1017/9781108654555.024 · Cited by 20
Flipped microlecture classes: satisfied learners and higher performance?
Scholtenhuis, L. O., Vahdatikhaki, F., & Rouwenhorst, C. (2020) · European Journal of Engineering Education · doi:10.1080/03043797.2020.1819961 · Cited by 20
“Each microlectures is furthermore segmented into a sequence of self-containing units, following segmentation principles in multimedia learning (Margulieux, Guzdial, and Catrambone 2012; Schittek Janda et al. 2005).”
MethodInfluentialHaden, P. (2019) · Cambridge University Press eBooks · doi:10.1017/9781108654555.007 · Cited by 20
Creating Crowdsourced Research Talks at Scale
Vaish, R., Goyal, S., Saberi, A., & Goel, S. (2018) · International World Wide Web Conference (WWW) · doi:10.1145/3178876.3186031 · Cited by 20
“[34] showed that instructions including both specic steps and subgoals resulted in improved learning and transfer compared to those with the specic steps alone.”
ResultDesigning introductory programming courses : the role of cognitive load
Mason, R. (2012) · Cross Connect (Southern Cross University) · Cited by 19
ATTARD, L., & Busuttil, L. (2020) · Informatics in Education · doi:10.15388/infedu.2020.24 · Cited by 17
“The MIT AI2 is a free software that uses a drag and drop feature to select commands that will control items on the screen (Hsu & Ching, 2013; Margulieux et al., 2012).”
MethodEngineering Education Research
Loui, M. C., & Borrego, M. J. (2019) · Cambridge University Press eBooks · doi:10.1017/9781108654555.012 · Cited by 17
Using Visualization to Reduce the Cognitive Load of Threshold Concepts in Computer Programming
Winter, V., Friend, M., Matthews, M., Love, B., & Vasireddy, S. (2019) · IEEE Frontiers in Education Conference (FIE) · doi:10.1109/fie43999.2019.9028612 · Cited by 16
“In [7] [6], subgoal labeling was shown to be an effective instructional strategy for the construction of mobile apps created using a drag-and-drop programming environment.”
BackgroundMargulieux, L. E., Morrison, B. B., Franke, B., & Ramilison, H. (2020) · ACM Transactions on Computing Education · doi:10.1145/3415594 · Cited by 16
“Subgoal learning was first applied to programming education in the context of an experimental laboratory with psychology undergrads as participants [15].”
BackgroundMethodSelf-citationA Hands-On Cross-Platform Mobile Programming Approach to Teaching OOP Concepts and Design Patterns
Muyan‐Özçelik, P. (2017) · IEEE/ACM International Workshop on Software Engineering Curricula for Millennials (SECM) · doi:10.1109/secm.2017.12 · Cited by 15
Vahrenhold, J., Cutts, Q. I., & Falkner, K. E. K. (2019) · Cambridge University Press eBooks · doi:10.1017/9781108654555.019 · Cited by 15
Lancaster, T., Robins, A. V., & Fincher, S. A. (2019) · Cambridge University Press eBooks · doi:10.1017/9781108654555.015 · Cited by 15
A Case Study of Qualitative Methods
Lewis, C. M. (2019) · Cambridge University Press eBooks · doi:10.1017/9781108654555.032 · Cited by 14
Teaching cyber-physical systems to computer scientists via modeling and verification
Damevski, K., Altayeb, B., Chen, H., & Walter, D. (2013) · ACM Technical Symposium on Computer Science Education (SIGCSE) · doi:10.1145/2445196.2445365 · Cited by 14
Teacher Knowledge for Inclusive Computing Learning
Goode, J., & Ryoo, J. J. (2019) · Cambridge University Press eBooks · doi:10.1017/9781108654555.025 · Cited by 14
Morning or Evening? An Examination of Circadian Rhythms of CS1 Students
Zavgorodniaia, A., Shrestha, R., Leinonen, J., Hellas, A., & Edwards, J. (2021) · 2021 IEEE/ACM 43rd International Conference on Software Engineering: Software Engineering Education and Training (ICSE-SEET) · doi:10.1109/icse-seet52601.2021.00036 · Cited by 13
Identifying learning-inductive content in programming discussion forums
Hsiao, I., & Naveed, F. (2015) · IEEE Frontiers in Education Conference (FIE) · doi:10.1109/fie.2015.7344105 · Cited by 13
“Multiple pieces of code can allow a novice construct patterns and schema [23], while even erroneous worked examples may assist learning in various levels [24].”
BackgroundMorrison, B. B. (2015) · ACM Conference on International Computing Education Research (ICER) · doi:10.1145/2787622.2787744 · Cited by 13
“While these cognitive load reducing techniques have been empirically tested in math and science disciplines, Margulieux et al. [5] were the first to test these with computer science learning, demonstrating learning benefits for subgoal labels with a drag-and-drop programming language.”
BackgroundDong, Y., Shabrina, P., Marwan, S., & Barnes, T. M. (2021) · ACM Conference on International Computing Education Research (ICER) · doi:10.1145/3446871.3469764 · Cited by 13
AlgoSolve: Supporting Subgoal Learning in Algorithmic Problem-Solving with Learnersourced Microtasks
Choi, K., Shin, H., Xia, M., & Kim, J. (2022) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3491102.3501917 · Cited by 13
Shabrina, P., Mostafavi, B., Abdelshiheed, M., Chi, M., & Barnes, T. M. (2023) · International Journal of Artificial Intelligence in Education · doi:10.1007/s40593-023-00338-1 · Cited by 13
“Also, research claims that making subgoals available during problem solving reduces students’ cognitive load 1 and helps them perform better (Margulieux et al., 2012) .”
InfluentialTeachers’ Views and Experiences on Teaching Second and Subsequent Programming Languages
Tshukudu, E., Cutts, Q. I., Goletti, O., Swidan, A., & Hermans, F. (2021) · ACM Conference on International Computing Education Research (ICER) · doi:10.1145/3446871.3469752 · Cited by 13
“Developing this more abstract comprehension can be done by high-lighting the main subgoals in the instructional material [21] or by comparing and contrasting worked examples [26].”
BackgroundSolveDeep: A System for Supporting Subgoal Learning in Online Math Problem Solving
Jin, H., Chang, M., & Kim, J. (2019) · CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA) · doi:10.1145/3290607.3312822 · Cited by 13
“The effect of subgoal learning through given labels has been investigated and applied in a wide range of problem solving domains in the context of both classrooms and online learning environments [3, 7, 8].”
BackgroundKazemitabaar, M., Chyhir, V., Weintrop, D., & Grossman, T. (2023) · ACM Technical Symposium on Computer Science Education (SIGCSE) · doi:10.1145/3545945.3569723 · Cited by 12
“For instance, subgoal labeled, worked examples [19] that display the Python and Scratch modality of the same code side-by-side, can provide a one-to-one mapping between the subgoals of each modality.”
BackgroundMorrison, B. B., Margulieux, L. E., & Decker, A. (2020) · Computer Science Education · doi:10.1080/08993408.2019.1707544 · Cited by 12
“Giving subgoal labels in worked examples improves learner performance while solving novel problems without increasing the amount of time learners spend studying instructions or working on problems (Margulieux et al., 2012).”
InfluentialSelf-citationMarwan, S., Shi, Y., Menezes, I., Chi, M., Barnes, T. M., & Price, T. (2021) · Educational Data Mining · Cited by 12
Plan Composition Using Higher-Order Functions
Rivera, E., Krishnamurthi, S., & Goldstone, R. L. (2022) · ACM Conference on International Computing Education Research (ICER) · doi:10.1145/3501385.3543965 · Cited by 12
“This process and its benefit to learners in certain contexts has been studied extensively, perhaps most notably by Morrison et al. [26, 27] and Margulieux et al. [24, 25].”
BackgroundTraining learners to self-explain: Designing instructions and examples to improve problem solving
Margulieux, L. E., Morrison, B. B., Guzdial, M., & Catrambone, R. (2016) · DigitalCommons@UNO · Cited by 11
Self-citationLeveling the playing field for international students in IT courses
Mason, R., & Seton, C. (2021) · Australasian Computing Education Conference · doi:10.1145/3441636.3442316 · Cited by 11
“CLT has more recently been applied to the instructional design of technical areas such as introductory programming [8, 14], introductory robotics [15], learning about databases [18] and mobile applications development [13, 16].”
MethodLooker, N. (2021) · ACM Conference on International Computing Education Research (ICER) · doi:10.1145/3446871.3469778 · Cited by 11
“Much of computing education research that explores CLT looks at the management of individual student’s cognitive load by studying the instructional effects provided by the theory([4][6] [8][7]).”
BackgroundWang, J., Zhang, J., Capizzano, J. N., Sigakis, M. J. G., Wang, X., & Popov, V. (2025) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3706598.3714015 · Cited by 10
Chick, J. C. (2025) · Education Sciences · doi:10.3390/educsci15111515 · Cited by 10
“This model’s emphasis on making expert thinking visible addresses the “invisible” nature of computational reasoning while supporting diverse learners through graduated scaffolding (Margulieux et al., 2016).”
CodeTree: A System for Learnersourcing Subgoal Hierarchies in Code Examples
Jin, H., & Kim, J. (2024) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3637308 · Cited by 10
“Margulieux and Catrambone found that subgoal-oriented instructional materials in programming improve learners’ problem-solving performance [35, 37].”
BackgroundStudent Knowledge and Misconceptions
Lewis, C. M., Clancy, M. J., & Vahrenhold, J. (2019) · Cambridge University Press eBooks · doi:10.1017/9781108654555.028 · Cited by 10
Metadata
- Authors
- Margulieux, L. E., Guzdial, M., & Catrambone, R.
- Affiliations
- Georgia Institute of Technology (US)
- Venue
- Proceedings of the ninth annual international conference on International computing education research
- Publisher
- ACM
- Published
- 2012-09-09
- Pages
- 71-78
- OpenAlex
- W2065907635
- Semantic Scholar
- a32496bc36a7a8673b0e04721ac0debd1caa04c1
- Cited by
- 149
- References
- 27
- Citations by year
- 2026: 8 · 2025: 3 · 2024: 5 · 2023: 6 · 2022: 8 · 2021: 13 · 2020: 13 · 2019: 42 · 2018: 6 · 2017: 8 · 2016: 16 · 2015: 10 · 2014: 5 · 2013: 6
- FWCI
- 4.63
- Type
- conference paper
- Language
- en
- Open access
- closed
- Locations
- ACM Conference on International Computing Education Research (ICER) (publishedVersion)
- Digital Archive @ GSU (submittedVersion)
- Topics
- Physical Sciences › Computer Science › Computer Science Applications › Teaching and Learning Programming
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Visual and Cognitive Learning Processes
- Social Sciences › Psychology › Developmental and Educational Psychology › Innovative Teaching and Learning Methods
- Keywords
- teaching materials, mental models, cognitive load, scaffolding, mobile application development, programming education, transfer of learning, novice programmers
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.