The DOI matches its Crossref record; 84 of the 84 references it cites were found in a registry or an index.
An Empirical Investigation into Programming Language Syntax
Abstract
Recent studies in the literature have shown that syntax remains a significant barrier to novice computer science students in the field. While this syntax barrier is known to exist, whether and how it varies across programming languages has not been carefully investigated. For this article, we conducted four empirical studies on programming language syntax as part of a larger analysis into the, so called, programming language wars. We first present two surveys conducted with students on the intuitiveness of syntax, which we used to garner formative clues on what words and symbols might be easy for novices to understand. We followed up with two studies on the accuracy rates of novices using a total of six programming languages: Ruby, Java, Perl, Python, Randomo, and Quorum. Randomo was designed by randomly choosing some keywords from the ASCII table (a metaphorical placebo). To our surprise, we found that languages using a more traditional C-style syntax (both Perl and Java) did not afford accuracy rates significantly higher than a language with randomly generated keywords, but that languages which deviate (Quorum, Python, and Ruby) did. These results, including the specifics of syntax that are particularly problematic for novices, may help teachers of introductory programming courses in choosing appropriate first languages and in helping students to overcome the challenges they face with syntax.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Instructors report that they spend a considerable amount of time helping novices with these often cryptic messages [15,31,32,37].”
From Using Large Language Models to Enhance Programming Error Messages (2023) · cites this paper as [37]
Citations
Cites
Kiczales, G. (1996) · ACM Computing Surveys · doi:10.1145/242224.242420 · Cited by 5,146
An Easy Guide to Factor Analysis
Kline, P. (2014) · Routledge eBooks · doi:10.4324/9781315788135 · Cited by 3,380
Resnick, M., Maloney, J., Monroy-Hernández, A., Rusk, N., Eastmond, E., Brennan, K., Millner, A., Rosenbaum, E., Silver, J., Silverman, B., et al. (2009) · Communications of the ACM · doi:10.1145/1592761.1592779 · Cited by 3,333
The Scratch Programming Language and Environment
Maloney, J. H., Resnick, M., Rusk, N., Silverman, B., & Eastmond, E. (2010) · ACM Transactions on Computing Education · doi:10.1145/1868358.1868363 · Cited by 1,423
Usability Analysis of Visual Programming Environments: A ‘Cognitive Dimensions’ Framework
Green, T. R. G., & Petre, M. (1996) · Journal of Visual Languages & Computing · doi:10.1006/jvlc.1996.0009 · Cited by 1,252
Pinker, S. A. (1991) · Science · doi:10.1126/science.1857983 · Cited by 1,061
Lowering the barriers to programming
Kelleher, C. L., & Pausch, R. F. (2005) · ACM Computing Surveys · doi:10.1145/1089733.1089734 · Cited by 887
The Cornell program synthesizer
Teitelbaum, T., & Reps, T. (1981) · Communications of the ACM · doi:10.1145/358746.358755 · Cited by 712
The state of the art in end-user software engineering
Ko, A. J., Abraham, R., Beckwith, L., Blackwell, A., Burnett, M., Erwig, M., Scaffidi, C., Lawrance, J., Lieberman, H., Myers, B., et al. (2011) · ACM Computing Surveys · doi:10.1145/1922649.1922658 · Cited by 633
A multi-national study of reading and tracing skills in novice programmers
Lister, R., Adams, E. S., Fitzgerald, S., Fone, W., Hamer, J., Lindholm, M., McCartney, R., Moström, J. E., Sanders, K., Seppälä, O., et al. (2004) · ACM SIGCSE Bulletin · doi:10.1145/1041624.1041673 · Cited by 575
Flagged first, then by citations
Research works printed but not linked: 9
- Binkley D., Proceedings of the IEEE 17th International Conference on Program Comprehension (ICPC’09)
- 10.5555/646147.679038 · DOI
- Brown M. H., Proceedings of the IEEE Workshop on Visual Languages (VL’91)
- Delorey D. P., 2009, Proceedings of the Psychology of Programming Interest Group Conference (PPIG
- Feigenspan J., Proceedings of the IEEE 20th International Conference on Program Comprehension (ICPC’12)
- Kleinschmager S., Proceedings of the IEEE 20th International Conference on Program Comprehension (ICPC’12)
- Pennington N., 1987, Empirical Studies of Programmers: Second Workshop, G. M. Olson, S. Sheppard, E. Soloway, and B. Shneiderman Eds., Greenwood Publishing Group Inc., 100--113
- Stefik A., Proceedings of the 17th IEEE International Conference on Program Comprehension (ICPC’09)
- Vogt W. P., Quantitative Research Methods for Professionals in Education and Other Fields
Cited by
Sorted by citations
Items 201–292 of 292
Robust programs with filtered iterators
Shen, J., & Rinard, M. (2017) · ACM SIGPLAN International Conference on Software Language Engineering (SLE) · doi:10.1145/3136014.3136030 · Cited by 4
Computational Thinking in Solving Engineering Problems – A Conceptual Model
Neo, C. H., Wong, J. K., Chai, V. C., Chua, Y. L., & Hoh, Y. H. (2021) · Asian Journal of Assessment in Teaching and Learning · doi:10.37134/ajatel.vol11.2.3.2021 · Cited by 3
Modeling with Gentleman: a web-based projectional editor
Lafontant, L.-E., & Syriani, E. (2024) · Software & Systems Modeling · doi:10.1007/s10270-024-01219-4 · Cited by 3
Stefik, A., Ladner, R. E., Allee, W., & Mealin, S. P. (2019) · ACM Inroads · doi:10.1145/3324894 · Cited by 3
Self-citationCheon, M., Ha, H., Lee, O., & Mun, C. (2022) · Mobile Information Systems · doi:10.1155/2022/3999868 · Cited by 3
An overview of computer programming languages: A fundamental piece of knowledge for humanity
Fathima, S. A., Gudipati, V., Keerthi, G., Taz, S. S., Pavani, P., Pallavi, N., & Geethanjali, C. (2022) · International Journal of Technology · doi:10.52711/2231-3915.2022.00003 · Cited by 3
A replication study on the intuitiveness of programming language syntax
Lappi, V., Tirronen, V., & Itkonen, J. (2023) · Software Quality Journal · doi:10.1007/s11219-023-09631-7 · Cited by 6
Supporting comprehension of unfamiliar programs by modeling cues
Kulkarni, N., & Varma, V. (2016) · Software Quality Journal · doi:10.1007/s11219-015-9303-5 · Cited by 3
Effects of a preliminary programming course on students' performance
Dümmel, N., Westfechtel, B., & Ehmann, M. (2018) · doi:10.1145/3209087.3209088 · Cited by 3
Kaijanaho, A.-J. (2014) · Jyväskylä University Digital Archive (University of Jyväskylä) · Cited by 3
Graceful Language Extensions and Interfaces
Homer, M. (2014) · doi:10.26686/wgtn.17008246 · Cited by 3
A Systematic Literature Review on the Impact of Formatting Elements on Program UnderstandabilityPreprint
Oliveira, D., Bruno, R., Madeiral, F., Masuhara, H., & Castor, F. (2022) · SSRN Electronic Journal · doi:10.2139/ssrn.4182156 · Cited by 3
A randomized controlled trial on the nomenclature of scientific computing
Kluthe, T., Stabler, H., McNamara, A. A., & Stefik, A. (2024) · Computer Science Education · doi:10.1080/08993408.2024.2403971 · Cited by 2
Self-citationThe Two Powers: How Pascal and Python Shaped Programming Education
Kohn, T., & Staub, J. (2024) · Informatics in Education · doi:10.15388/infedu.2024.30 · Cited by 4
Ehtesham-Ul-Haque, M., & Billah, S. M. (2025) · Designing Interactive Systems Conference · doi:10.1145/3715336.3735839 · Cited by 2
Learning Programming Languages as Shortcuts to Natural Language Token Replacements
Barmpoutis, A. (2018) · Koli Calling International Conference on Computing Education Research · doi:10.1145/3279720.3279721 · Cited by 2
Saqr, M., López‐Pernas, S., & Apiola, M. (2023) · Springer eBooks · doi:10.1007/978-3-031-25336-2_9 · Cited by 2
The Linguistics of Programming
Gordon, C. S. (2024) · ACM SIGPLAN International Symposium on New Ideas, New Paradigms, and Reflections on Programming and Software (Onward!) · doi:10.1145/3689492.3689806 · Cited by 3
Hints Help Finding and Fixing Bugs Differently in Python and Text-Based Program Representations
Rawal, R., Pădurean, V.-A., Apel, S., Singla, A. K., & Toneva, M. (2025) · ACM/IEEE International Conference on Software Engineering: Companion Proceedings (ICSE-Companion) · doi:10.1109/icse55347.2025.00192 · Cited by 2
Venticinque, S., Amato, A., Fusco, P., & Palmieri, F. (2025) · IEEE Access · doi:10.1109/access.2025.3586198 · Cited by 2
Intermediate Representation of Programs with Type Specification Based on Pattern Matching
Vasenin, V. А., & Krivchikov, M. A. (2020) · Programming and Computer Software · doi:10.1134/s0361768820010077 · Cited by 2
Considering Productivity Effects of Explicit Type Declarations
Coblenz, M. J., Aldrich, J., Myers, B. A., & Sunshine, J. (2014) · Evaluation and Usability of Programming Languages and Tools · doi:10.1145/2688204.2688218 · Cited by 2
Deep priority conflicts in the wild: a pilot study
Amorim, L. E. D. S., Steindorfer, M. J., & Eelco Visser, B. (2017) · ACM SIGPLAN International Conference on Software Language Engineering (SLE) · doi:10.1145/3136014.3136020 · Cited by 2
A Design for Bidirectional Conversion between Blocks and Text for App Inventor
Huang, R. L., & Turbak, F. A. (2019) · IEEE Blocks and Beyond Workshop (B&B) · doi:10.1109/bb48857.2019.8941197 · Cited by 2
Programmer Experience: A Systematic Mapping
Morales, J., Rusu, C., & Quiñones, D. (2020) · IEEE Latin America Transactions · doi:10.1109/tla.2020.9099749 · Cited by 2
Hsu, W. C., & Mimura, Y. (2017) · IEEE International Conference on Engineering Education (ICEED) · doi:10.1109/iceed.2017.8251165 · Cited by 2
Examining novice programmers' software design strategies through verbal protocol analysis
Yeh, M. K. ‐. (2018) · International journal of engineering education · Cited by 2
Combining reverse debugging and live programming towards visual thinking in computer programming
Coetzee, A. L. (2015) · SUNScholar (Stellenbosch University) · Cited by 2
Qian, Y., & Wu, Y. (2024) · IEEE Access · doi:10.1109/access.2024.3454643 · Cited by 1
A Randomized Controlled Trial of Syntax Exercises in an Introductory Python Course
Isenegger, K., Otmani, S. E., Edwards, J., & Lewis, C. M. (2025) · ACM Conference on International Computing Education Research (ICER) · doi:10.1145/3702652.3744230 · Cited by 1
Topical Analysis of Programming Education Research Literature
Malmi, L., López‐Pernas, S., Nguyen, H., Apiola, M., & Saqr, M. (2025) · ACM Transactions on Computing Education · doi:10.1145/3767734 · Cited by 1
Programming Education for Blind and Low Vision Users: Beyond Reading the Screen
Lock, J. G., Brown, N. C. C., & Kölling, M. (2025) · Koli Calling International Conference on Computing Education Research · doi:10.1145/3769994.3770018 · Cited by 1
Program Behavior Gaps: An Extension of the Rules of Program Behavior Framework
Hoobergs, J., Schrijvers, T., & Hermans, F. (2026) · ACM Transactions on Computing Education · doi:10.1145/3796523 · Cited by 1
Understanding the teaching context of first year ICT Education in Australia
Butler, M., Sheard, J., Morgan, M. J., Falkner, K. E. K., Simon, N. P., & Weerasinghe, A. (2015) · Monash University Research Portal (Monash University) · Cited by 1
Discount method for programming language evaluation
Kurtev, S., Christensen, T. A., & Thomsen, B. (2016) · doi:10.1145/3001878.3001879 · Cited by 1
Johnson, C., & Abundez-Arce, A. (2017) · IEEE Annual International Computer Software and Applications Conference (COMPSAC) · doi:10.1109/compsac.2017.244 · Cited by 1
Functional Baby Talk: Analysis of Code Fragments from Novice Haskell Programmers
Singer, J., & Archibald, B. (2018) · Electronic Proceedings in Theoretical Computer Science · doi:10.4204/eptcs.270.3 · Cited by 1
Activity During High-Repetition Practice of Syntax
Gonzales, S., Swanson, H., & Edwards, J. (2023) · Intermountain Engineering, Technology and Computing (IETC) · doi:10.1109/ietc57902.2023.10152277 · Cited by 1
Factors Affecting Compilable State at Each Keystroke in CS1
Scott, S., Hellas, A., Leinonen, J., & Edwards, J. (2023) · IEEE/ACM International Conference on Software Engineering: Software Engineering Education and Training (ICSE-SEET) · doi:10.1109/icse-seet58685.2023.00036 · Cited by 1
Predicting Success in Programming I
Wolfe, B., & Lowry, E. (2024) · ASEE Annual Conference & Exposition · doi:10.18260/1-2--40765 · Cited by 1
“C”ing the light – assessing code comprehension in novice programmers using C code patterns
Glasauer, C., Yeh, M. K. ‐., DeLong, L. A., Yu, Y., & Zhuang, Y. (2024) · Computer Science Education · doi:10.1080/08993408.2024.2317079 · Cited by 1
Hanenberg, S., Morzeck, J., & Gruhn, V. (2024) · Empirical Software Engineering · doi:10.1007/s10664-024-10531-y · Cited by 1
Topic Difficulty in a Python Data Structures Course: Student Perceptions and Performance
Layman, L. M., Pence, T. B., & Narayan, S. (2025) · ACM Southeast Regional Conference (ACMSE) · doi:10.1145/3696673.3723056 · Cited by 1
Correlation Analysis of Popularity and Interoperability in Open Source Projects
Shamsi, F. A., Bamatraf, S., Rahwan, T., Aung, Z., & Svetinović, D. (2018) · International Conference on Innovations in Information Technology · doi:10.1109/innovations.2018.8605970 · Cited by 1
How “Friendly” Integrated Development Environments Are?
Morales, J., Botella, F., Rusu, C., & Quiñones, D. (2019) · Lecture notes in computer science · doi:10.1007/978-3-030-21902-4_7 · Cited by 1
Reading logic as code or as natural language text
Rein, P. (2019) · International Conference on Art, Science, and Engineering of Programming (<Programming>) · doi:10.1145/3328433.3328464 · Cited by 1
Text to Code: Pseudo Code Generation
Din, A. U., & Adnan, A. (2019) · Lecture notes of the Institute for Computer Sciences, Social Informatics and Telecommunications Engineering · doi:10.1007/978-3-030-34365-1_3 · Cited by 1
Changpetch, C., Panjaburee, P., & Srisawasdi, N. (2021) · Journal of Computers in Education · doi:10.1007/s40692-021-00200-0 · Cited by 1
Saqr, M., López‐Pernas, S., & Apiola, M. (2022) · Research Square · doi:10.21203/rs.3.rs-1834232/v1 · Cited by 1
Zhang, W., Holtmann, J., Hebig, R., & Steghöfer, J.-P. (2023) · SSRN Electronic Journal · doi:10.2139/ssrn.4379232 · Cited by 1
Wu, M., & Ouyang, F. (2026) · Educational Psychology Review · doi:10.1007/s10648-026-10211-x
Park, T. H., & Forte, A. (2014) · iDEA - Drexel University Institutional Repository · doi:10.17918/etd-6098
Empirical Study of Concurrent Programming Paradigms
Daleiden, P. (2020) · Digital Scholarship - UNLV (University of Nevada Reno) · doi:10.34917/9112055
Quinn, R., Andriamanalimanana, B., Sengupta, S. R., & Spetka, S. R. (2018) · SUNY Digital Repository Support (State University of New York System)
Metamorphic Domain-Specific Languages: A Journey Into the Shapes of a LanguagePreprint
Acher, M., Combemale, B., & Collet, P. (2014) · arXiv (Cornell University) · doi:10.48550/arxiv.1404.6838
Peterson, C. S. (2020) · Lincoln (University of Nebraska)
On The Human Factors Impact of Polyglot Programming on Programmer Productivity
Uesbeck, P. M. (2020) · Digital Scholarship - UNLV (University of Nevada Reno) · doi:10.34917/18608807
Modernizing the Syntax of Regular Expressions
Andersson, A., & Hansson, L. (2020) · KTH Publication Database DiVA (KTH Royal Institute of Technology)
Toward Productivity Improvements in Programming Languages Through Behavioral Analytics
Daleiden, P. (2020) · Digital Scholarship - UNLV (University of Nevada Reno) · doi:10.34917/19412056
Aljaer, M. A. M., & Jaharadak, A. A. (2021) · European Journal of Economic and Financial Research · doi:10.46827/ejefr.v4i4.1024
Fincher, S. A., & Robins, A. V. (2019) · Cambridge University Press eBooks · doi:10.1017/9781108654555.033
Dialogo: A Controlled Portuguese for Developing Agroecological Information Systems
Jaffe, M., Lopes, D. M. M., & Reis, A. (2022) · Lecture notes in networks and systems · doi:10.1007/978-3-031-04819-7_34
Good Students are Good Students Student Achievement with Visual versus Textual Programming
Coffman, J., Hill, J. M., Beck, S., de Freitas, A. A., & Weingart, T. B. (2022) · IEEE Frontiers in Education Conference (FIE) · doi:10.1109/fie56618.2022.9962693
IMPACT OF EMBEDDED CLS ON EYE TRACKING REPLICATION
Setiawan, N. D., Sudirman, B., & Anggono, S. U. (2022) · Journal of Technology Informatics and Engineering · doi:10.51903/jtie.v1i3.148
Design und Entwicklung der MYOW-Plattform
Fröbel, F., Fricke, R., Stadler, P., Zahn, E. F., Gleiß, C., Albert, T., von Radziewsky, L., Prelle, B., Bibow, T., Krebs, F., et al. (2023) · Edition HMD · doi:10.1007/978-3-658-38813-3_6
Cursos de Análises de Dados Públicos com Python
Bíscaro, N. D. S., & Masanori, F. (2023) · Congresso Internacional de Mulheres em STEAM · doi:10.55592/icimesteam.2022.5332615
PENGARUH PERALIHAN BAHASA KOMPUTER PADA REPLIKASI EYE TRACKING
Wicaksono, Y. A., Sudirman, B., & Siswanto, E. (2023) · Informatika Jurnal Teknik Informatika dan Multimedia · doi:10.51903/informatika.v3i1.235
Oyunbat, G., & Hassanien, A. H. S. (2023) · Embedded Selforganising Systems · doi:10.14464/ess.v10i7.626
Computational Pipelines and Workflows in Bioinformatics
Milton, M. (2024) · Elsevier eBooks · doi:10.1016/b978-0-323-95502-7.00023-3
Assessing Python Style Guides: An Eye-Tracking Study with Novice Developers
de Oliveira, P. R. F., Gheyi, R., da Costa, J. A. S., & Ribeiro, M. (2024) · Simpósio Brasileiro de Engenharia de Software (SBES) · doi:10.5753/sbes.2024.3325
Mapping the Anatomy of Novice-Generated Mistakes in Learning Programming
Erdoğdu, F., & Gökoğlu, S. (2024) · Advances in educational technologies and instructional design book series · doi:10.4018/979-8-3693-4542-9.ch007
TQL: Towards Type-Driven Data Discovery
Kang, A., & Galhotra, S. (2024) · IEEE International Conference on Big Data (BigData) · doi:10.1109/bigdata62323.2024.10825227
Focus on Return: Terms Novices Use to Describe Functions in Java
Esche, S. (2025) · ACM Conference on Innovation and Technology in Computer Science Education (ITiCSE) · doi:10.1145/3724363.3729065
Kawulok, M., Maćkowska, S., Maćkowski, M., & Spińczyk, D. (2025) · ACM Conference on Innovation and Technology in Computer Science Education (ITiCSE) · doi:10.1145/3724363.3729098
Is “notDone” the Same as “!done”? The Effect of Different Ways for Expressing Negation
Baron, A., & Feitelson, D. G. (2025) · ACM Conference on International Computing Education Research (ICER) · doi:10.1145/3702652.3744213
Source Code Without Implicitness: Explicit Source Prose For Programming Education
Hoobergs, J., & Schrijvers, T. (2025) · Conference on United Kingdom & Ireland Computing Education Research (UKICER) · doi:10.1145/3754508.3754510
Continuations for All: Language Design Considerations for Accessible Continuations
Cong, Y., Strömbäck, F., & Ikemori, K. (2025) · ACM SIGPLAN International Symposium on SPLASH-E (SPLASH-E) · doi:10.1145/3758317.3759677
Mozgovoy, M., & Montero, C. S. (2026) · Computer Assisted Language Learning · doi:10.1080/09588221.2026.2615770
An empirical eye-tracking study of cross-lingual program comprehension and debugging
Mohammed, A., Albaghli, R., Alrushood, H., & Ghaddar, F. (2026) · Journal of Systems and Software · doi:10.1016/j.jss.2026.112793
Oguibe, G. F., Hernandez, L. C., Holloway, K., Ewoldt, K. B., Neely, L. C., Akter, T., & Wang, W. (2026) · ACM Technical Symposium on Computer Science Education (SIGCSE) · doi:10.1145/3770762.3772507
What Do Students Pay Attention to While Watching Others Code?
Rau, M., & Edwards, J. (2026) · Australasian Computing Education Conference · doi:10.1145/3786228.3786229
Weidmann, T. B., Thorgeirsson, S., Weidmann, K.-H., Wang, A. Y., & Su, Z. (2026) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3772318.3791667
AICodeDetect: A Pipeline for Systematic Detection and Analysis of AI-Generated Code
Vijayakumar, S., Negrin, P., & Faloutsos, C. (2026) · Lecture notes in networks and systems · doi:10.1007/978-3-032-20362-5_10
Muñoz, M. J. A., Rueda, C. J. Á., Escudero-Nahón, A., Magdaleno, S. L. C., Torres-Espriú, F. A., & Sánchez, R. C. (2026) · International Journal of Emerging Technologies in Learning (iJET) · doi:10.3991/ijet.v21i02.61361
АНАЛІЗ JAVA ТА KOTLIN ЯК ПЕРШОЇ МОВИ ПРОГРАМУВАННЯ ДЛЯ СТУДЕНТІВ
Ксенич, А. І. (2026) · ГРААЛЬ НАУКИ · doi:10.36074/grail-of-science.01.05.2026.081
Comparing Student Achievement, Attitudes, and Behaviors with RAPTOR and Python
Coffman, J., Kenworthy, L., Beck, S., Hill, J. M., de Freitas, A. A., & Weingart, T. B. (2026) · ACM Transactions on Computing Education · doi:10.1145/3815177
How to Determine the Educational Usability of Programming Tools? Teachers Perspectives
Weißenrieder, F., Lenzer, S., & Mühling, A. (2026) · Workshop in Primary and Secondary Computing Education · doi:10.1145/3801749.3801751
An Exploratory Comparison of C and an Extension with Uniform Function Call Syntax Added
Contaldi, Q., Dahl, J., Attallah, N., Dascalu, S. M., & Harris, F. C. (2026) · Advances in intelligent systems and computing · doi:10.1007/978-3-032-27214-0_53
A meta-analysis on educational programming tool effectiveness
Weißenrieder, F., Schmiegel, D., Altın, R., Lenzer, S., & Mühling, A. (2026) · Computers in Human Behavior Reports · doi:10.1016/j.chbr.2026.101369
Metadata
- Authors
- Stefik, A., & Siebert, S.
- Affiliations
- University of Nevada, Las Vegas (US)
- Washington University in St. Louis (US)
- ORCID
- Stefik, Andreas
- Venue
- ACM Transactions on Computing Education
- Published
- 2013-11
- Volume
- 13
- Issue
- 4
- Pages
- 1-40
- ISSN
- 1946-6226 (ISSN-L)
- OpenAlex
- W2157148654
- Cited by
- 295
- References
- 84
- Citations by year
- 2026: 14 · 2025: 13 · 2024: 21 · 2023: 19 · 2022: 19 · 2021: 19 · 2020: 34 · 2019: 60 · 2018: 23 · 2017: 22 · 2016: 17 · 2015: 16 · 2014: 15 · 2013: 2
- FWCI
- 25.18
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- ACM Transactions on Computing Education (publishedVersion)
- Funders
- Division of Computer and Network Systems (CNS-0940521)
- Topics
- Physical Sciences › Computer Science › Computer Science Applications › Teaching and Learning Programming
- Physical Sciences › Computer Science › Software › Logic, programming, and type systems
- Physical Sciences › Computer Science › Information Systems › Software Engineering Research
- Keywords
- programming language syntax, novice programmers, quorum, Python, ruby, Java, Perl, introductory programming
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review