Setting the Scope of Concept Inventories for Introductory Computing Subjects
The DOI matches its Crossref record; 4 of the 4 references it cites were found in a registry or an index.
Abstract
A concept inventory is a standardized assessment tool intended to evaluate a student’s understanding of the core concepts of a topic. In order to create a concept inventory it is necessary to accurately identify these core concepts. A Delphi process is a structured multi-step process that uses a group of experts to achieve a consensus opinion. We present the results of three Delphi processes to identify topics that are important and difficult in each of three introductory computing subjects: discrete mathematics, programming fundamentals, and logic design. The topic rankings can not only be used to guide the coverage of concept inventories, but can also be used by instructors to identify what topics merit special attention.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
The Discovery of Grounded Theory; Strategies for Qualitative Research
Glaser, B. G., Strauss, A. L., & Strutzel, E. (1968) · Nursing Research · doi:10.1097/00006199-196807000-00014 · Cited by 39,449
Hake, R. R. (1998) · American Journal of Physics · doi:10.1119/1.18809 · Cited by 6,072 · cited 2×
“The results of administrations of the FCI to thousands of students led physics instructors to develop and adopt “interactive engagement” pedagogies [Hake 1998].”
BackgroundAn Experimental Application of the DELPHI Method to the Use of Experts
Dalkey, N., & Helmer, O. (1963) · Management Science · doi:10.1287/mnsc.9.3.458 · Cited by 6,061
The Delphi method: Substance, context, a critique and an annotated bibliography
Pill, J. (1971) · Socio-Economic Planning Sciences · doi:10.1016/0038-0121(71)90041-3 · Cited by 579
Cited by
Students’ Misconceptions and Other Difficulties in Introductory Programming: A Literature Review
Qian, Y., & Lehman, J. (2018) · ACM Transactions on Computing Education · doi:10.1145/3077618 · Cited by 529
Replication, Validation, and Use of a Language Independent CS1 Knowledge Assessment
Parker, M. C., Guzdial, M., & Engleman, S. (2016) · Proceedings of the 2016 ACM Conference on International Computing Education Research · doi:10.1145/2960310.2960316 · Cited by 184
“They are standardized, multiple-choice, assessment tools to identify misconceptions, investigate learning, measure student understanding of core concepts, and, if desired, ascertain the pedagogical impact on the student’s achievement towards expert-level thinking [1, 10, 18].”
BackgroundMethodClosing the gender gap in an introductory programming course
Rubio, M. A., Romero-Zaliz, R., Mañoso, C., & de Madrid, A. P. (2015) · Computers & Education · doi:10.1016/j.compedu.2014.12.003 · Cited by 159
“Another promising line of work is the development of concept inventories for introductory programming (Goldman et al., 2010).”
BackgroundZhang, H., Perry, A., & Lee, I. (2025) · International Journal of Artificial Intelligence in Education · doi:10.1007/s40593-024-00398-x · Cited by 75
What Do CS1 Syllabi Reveal About Our Expectations of Introductory Programming Students?
Becker, B. A., & Fitzpatrick, T. (2019) · Proceedings of the 50th ACM Technical Symposium on Computer Science Education · doi:10.1145/3287324.3287485 · Cited by 63
“Their instrument drew concepts from [22] and [6] discussed above.”
BackgroundMethod
Metadata
- Authors
- Goldman, K., Gross, P., Heeren, C., Herman, G. L., Kaczmarczyk, L., Loui, M. C., & Zilles, C.
- Venue
- ACM Transactions on Computing Education
- Published
- 2010-06
- Volume
- 10
- Issue
- 2
- Pages
- 1-29
- ISSN
- 1946-6226 (ISSN-L)
- OpenAlex
- W2012669829
- Cited by
- 121
- References
- 4
- FWCI
- 9.36
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.