Can computational talent be detected? Predictive validity of the Computational Thinking Test
Open accessThe DOI matches its Crossref record; 11 of the 11 references it cites were found in a registry or an index.
Abstract
Abstract Computational thinking (CT) is arising as a set of problem-solving skills that must be acquired by the new generations of students to fully understand and participate in our computer-based world. However, from a psychometric approach, we are still at an early stage regarding the definition and assessment of CT as a psychological variable. One way to advance in this area is to investigate whether ‘computationally talented’ students (i.e., ‘computational top thinkers’) can be detected even before learning to code; and, if so, how to teach them properly to fully develop their high-computational ability. This paper presents several empirical concatenated studies about the predictive validity of the Computational Thinking Test (CTt), which is administered on a sample of 314 middle school Spanish students ( n = 314 ). We report the predictive validity of the CTt, conducted at the beginning of the quarter, with respect to academic performance (Informatics, Mathematics, and Language) and learning analytics in a Code.org course collected at the end of the quarter. We also analyze the predictive validity of the CTt to early distinguish between ‘computational regular thinkers’ and ‘computational top thinkers’ (i.e., those who spontaneously accelerated from the ‘block-based’ programming environment of Code.org to the ‘text-based’ one of Khan Academy). Finally, we perform a case study over two of the students categorized as ‘computational top thinkers’, in which one of their coding products written in Processing JavaScript is described. Our results demonstrate that ‘computationally talented’ students can be detected in middle school, and that these subjects have the ability to accelerate in the Computer Science Education standards between 1 and 2 years compared to the regular learners. This could have major implications on the emerging computing curricula, which should take into account these individual differences in computational ability and ‘learning-how-to-code’ speed to ensure an appropriate progression for every student.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
The meaning and use of the area under a receiver operating characteristic (ROC) curve.
Hanley, J. A., & McNeil, B. J. (1982) · Radiology · doi:10.1148/radiology.143.1.7063747 · Cited by 21,856
Wing, J. M. (2006) · Communications of the ACM · doi:10.1145/1118178.1118215 · Cited by 8,102
Some Simple Economics of Open Source
Lerner, J., & Tirole, J. (2002) · The Journal of Industrial Economics · doi:10.1111/1467-6451.00174 · Cited by 2,355
Computational thinking and thinking about computing
Wing, J. M. (2008) · Philosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences · doi:10.1098/rsta.2008.0118 · Cited by 1,784
Demystifying computational thinking
Shute, V. J., Sun, C., & Asbell-Clarke, J. (2017) · Educational Research Review · doi:10.1016/j.edurev.2017.09.003 · Cited by 1,466
Lye, S. Y., & Koh, J. H. L. (2014) · Computers in Human Behavior · doi:10.1016/j.chb.2014.09.012 · Cited by 1,421
Best, J. R., Miller, P. H., & Naglieri, J. A. (2011) · Learning and Individual Differences · doi:10.1016/j.lindif.2011.01.007 · Cited by 1,294
Steenbergen-Hu, S., Makel, M. C., & Olszewski-Kubilius, P. (2016) · Review of Educational Research · doi:10.3102/0034654316675417 · Cited by 429
A Tool for Introducing Computer Science with Automatic Formative Assessment
Benotti, L., Martinez, M. C., & Schapachnik, F. (2018) · IEEE Transactions on Learning Technologies · doi:10.1109/tlt.2017.2682084 · Cited by 141
Grover, S., Basu, S., Bienkowski, M., Eagle, M., Diana, N., & Stamper, J. (2017) · ACM Transactions on Computing Education · doi:10.1145/3105910 · Cited by 93
Cited by
A systematic review of learning computational thinking through Scratch in K-9
Zhang, L., & Nouri, J. (2019) · Computers & Education · doi:10.1016/j.compedu.2019.103607 · Cited by 449
Sun, L., & Zhou, L. (2024) · Journal of Educational Computing Research · doi:10.1177/07356331241277937 · Cited by 129
“Tests are common in formal school curricula and are used to test learners ’ level of learning and mastery of the subject matter (Rom´an-Gonz´alez et al., 2018).”
Charitopoulos, A., Rangoussi, M., & Koulouriotis, D. (2020) · International Journal of Artificial Intelligence in Education · doi:10.1007/s40593-020-00200-8 · Cited by 89
The cognitive effects of computational thinking: a systematic review and meta-analytic study
Montuori, C., Gambarota, F., Altoé, G., & Arfé, B. (2024) · Computers & Education · doi:10.1016/j.compedu.2023.104961 · Cited by 76
Lin, P.-H., Huang, P.-S., Geng, Y., & Huang, Y.-M. (2024) · Education and Information Technologies · doi:10.1007/s10639-024-12661-8 · Cited by 8
Metadata
- Authors
- Román-González, M., Pérez-González, J.-C., Moreno-León, J., & Robles, G.
- Venue
- International Journal of Child-Computer Interaction
- Publisher
- Elsevier BV
- Published
- 2018-11
- Volume
- 18
- Pages
- 47-58
- ISSN
- 2212-8689 (ISSN-L)
- OpenAlex
- W2830776011
- Cited by
- 144
- References
- 11
- FWCI
- 16.50
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Can computational talent be detected? Predictive validity of the Computational Thinking Test. https://app.cochat.ai/papers/10.1016/j.ijcci.2018.06.004
- The paper
- Román-González, M., Pérez-González, J.-C., Moreno-León, J., & Robles, G. (2018). Can computational talent be detected? Predictive validity of the Computational Thinking Test. International Journal of Child-Computer Interaction. https://doi.org/10.1016/j.ijcci.2018.06.004
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.