A Comparative Study of Free Self-Explanations and Socratic Tutoring Explanations for Source Code Comprehension
The DOI matches its Crossref record; 9 of the 9 references it cites were found in a registry or an index.
Abstract
We present in this paper the results of a randomized control trial experiment that compared the effectiveness of two instructional strategies that scaffold learners' code comprehension processes: eliciting Free Self-Explanation and a Socratic Method. Code comprehension, i.e., understanding source code, is a critical skill for both learners and professionals. Improving learners' code comprehension skills should result in improved learning which in turn should help with retention in intro-to-programming courses which are notorious for suffering from very high attrition rates due to the complexity of programming topics. To this end, the reported experiment is meant to explore the effectiveness of various strategies to elicit self-explanation as a way to improve comprehension and learning during complex code comprehension and learning activities in intro-to-programming courses. The experiment showed pre-/post-test learning gains of 30% (M = 0.30, SD = 0.47) for the Free Self-Explanation condition and learning gains of 59% (M = 0.59,SD = 0.39) for the Socratic method. Furthermore, we investigated the behavior of the two strategies as a function of students' prior knowledge which was measured using learners' pretest score. For the Free Self-Explanation condition, there was no significant difference in mean learning gains for low vs. high knowledge students. The magnitude of the difference in performance (mean difference= 0.02,95% CI: -0.34 to 0.39) was very small (eta squared = 0.006). Likewise, the Socratic method showed no significant difference in mean learning gains between low vs. high performing students. The magnitude of the performance difference (mean difference =-0.24,95% CI: -0.534 to 0.03) was large (eta squared = 0.10). These findings suggest that eliciting self-explanations can be used as an effective strategy and that guided self-explanations as in the Socratic method condition is more effective at inducing learning gains.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
New Effect Size Rules of Thumb
Sawilowsky, S. S. (2009) · Journal of Modern Applied Statistical Methods · doi:10.22237/jmasm/1257035100 · Cited by 3,254
Learning and Teaching Programming: A Review and Discussion
Robins, A., Rountree, J., & Rountree, N. (2003) · Computer Science Education · doi:10.1076/csed.13.2.137.14200 · Cited by 1,736 · cited 2×
“effort exploring effective instructional interventions that facilitate students for learning programming [22, 23, 36, 42, 45, 54].”
BackgroundAleven, V. A. W. M. M., & Koedinger, K. R. (2002) · Cognitive Science · doi:10.1207/s15516709cog2602_1 · Cited by 895
Eliciting Self‐Explanations Improves Understanding
Chi, M. T. H., De Leeuw, N., Chiu, M., & Lavancher, C. (1994) · Cognitive Science · doi:10.1207/s15516709cog1803_3 · Cited by 757
Bielaczyc, K., Pirolli, P. L., & Brown, A. L. (1995) · Cognition and Instruction · doi:10.1207/s1532690xci1302_3 · Cited by 422 · cited 4×
“A series of studies [9, 38, 40] found that self-explanations help”
BackgroundMethodInfluentialComputational analyses of multilevel discourse comprehension
Graesser, A. C., & McNamara, D. S. (2011) · Topics in Cognitive Science · doi:10.1111/j.1756-8765.2010.01081.x · Cited by 325 · cited 1×
“This challenge is not surprising given that constructing mental representations is considered a higher-level skill of comprehension, typically engendering a high cognitive load[20, 25, 48, 55].”
BackgroundThe Self-Explanation Principle in Multimedia Learning
Roy, M., & Chi, M. T. H. (2005) · The Cambridge Handbook of Multimedia Learning · doi:10.1017/cbo9780511816819.018 · Cited by 219
Subgoals, Context, and Worked Examples in Learning Computing Problem Solving
Morrison, B. B., Margulieux, L. E., & Guzdial, M. (2015) · Proceedings of the eleventh annual International Conference on International Computing Education Research · doi:10.1145/2787622.2787733 · Cited by 174 · cited 1×
“The primary reason that large number of students fail in CS1 and CS2 courses is the inherent complexity of CS concepts itself [33].”
BackgroundMargulieux, L. E., Guzdial, M., & Catrambone, R. (2012) · Proceedings of the ninth annual international conference on International computing education research · doi:10.1145/2361276.2361291 · Cited by 149 · cited 2×
“Indeed, a major challenge in CS education is the difficulty novice programmers face with constructing accurate mental models during key learning activities, such as source code comprehension [29, 37, 39, 49].”
Background
Cited by
Kazemitabaar, M., Ye, R., Wang, X., Henley, A. Z., Denny, P., Craig, M., & Grossman, T. (2024) · Proceedings of the CHI Conference on Human Factors in Computing Systems · doi:10.1145/3613904.3642773 · Cited by 290
Socratic Questioning of Novice Debuggers: A Benchmark Dataset and Preliminary Evaluations
Al-Hossami, E., Bunescu, R., Teehan, R., Powell, L., Mahajan, K., & Dorodchi, M. (2023) · Proceedings of the 18th Workshop on Innovative Use of NLP for Building Educational Applications (BEA 2023) · doi:10.18653/v1/2023.bea-1.57 · Cited by 23
“To remedy this, Tamang et al. (2021) showed that using the So-cratic method to guide students in explaining their code is effective at inducing learning gains in code comprehension tasks.”
MethodLee, H.-Y., Chen, P.-H., Lin, C.-J., Huang, Y.-M., & Wu, T.-T. (2025) · Education and Information Technologies · doi:10.1007/s10639-025-13733-z · Cited by 21
“Tamang et al. ( 2021 ) found that self-explanation prompts in a programming course improved students’ problem-solving skills and understanding of programming concepts.”
Lehtinen, T., Haaranen, L., & Leinonen, J. (2023) · Proceedings of the 25th Australasian Computing Education Conference · doi:10.1145/3576123.3576129 · Cited by 17
Metadata
- Authors
- Tamang, L. J., Alshaikh, Z., Khayi, N. A., Oli, P., & Rus, V.
- Venue
- Proceedings of the 52nd ACM Technical Symposium on Computer Science Education
- Publisher
- ACM
- Published
- 2021-03-03
- Pages
- 219-225
- OpenAlex
- W3134454768
- Cited by
- 24
- References
- 9
- FWCI
- 4.54
- Type
- conference paper
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: A Comparative Study of Free Self-Explanations and Socratic Tutoring Explanations for Source Code Comprehension. https://app.cochat.ai/papers/10.1145/3408877.3432423
- The paper
- Tamang, L. J., Alshaikh, Z., Khayi, N. A., Oli, P., & Rus, V. (2021). A Comparative Study of Free Self-Explanations and Socratic Tutoring Explanations for Source Code Comprehension. Proceedings of the 52nd ACM Technical Symposium on Computer Science Education. https://doi.org/10.1145/3408877.3432423
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.