CoChat

On the Suitability of Real-Time Assessment of Programming Proficiency using Gaze Properties

Open access
Liang, Calvin, Karolus, Jakob, Kosch, Thomas, Schmidt, Albrecht · 2018 · Proceedings of the 7th ACM International Symposium on Pervasive Displays

The DOI matches its Crossref record; 8 of the 8 references it cites were found in a registry or an index.

Abstract

Evaluating programming proficiency has become more relevant as the demand for coding skills has increased. Current methods, such as questionnaires or interviews, are methods that lack intuition, flexibility, and real-time capabilities. In our work, we investigate eye gaze behavior as an estimate for skill assessment. Specifically, we conducted a study (N=14) using an eye tracker to analyze the participants' abilities to understand source code by presenting them with a series of programs. We evaluated their eye movements based on common eye tracking metrics and identified mutual task-solving strategies among the participants. While we cannot relate these indicators to programming proficiency directly, this study serves as an evaluation of real-time methods for evaluating programming proficiency.

Overview

Integrity signals

Registry

Crossref · 10.1145/3205873.3210702

Cites

8 of 8 references verified0 citation errors · 0 not checkable

Statistics

Recomputing p-values needs the paper’s full text.

Verification

Claims the paper makes

We couldn’t retrieve this paper’s full text, so its claims and self-check weren’t run. The registry and citation checks still apply.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Citations

Cites

Show all 8 references

Cited by

See all 3

Metadata

Authors
Liang, C., Karolus, J., Kosch, T., & Schmidt, A.
Affiliations
  • Tufts University (US)
  • Ludwig-Maximilians-Universität München (DE)
Venue
Proceedings of the 7th ACM International Symposium on Pervasive Displays
Publisher
ACM
Published
2018-06-06
Pages
1-2
OpenAlex
W2804047300
Cited by
3
References
8
Citations by year
2024: 1 · 2023: 1 · 2020: 1
FWCI
0.20
Type
conference paper
Language
en
Open access
Locations
ACM International Symposium on Pervasive Displays (PerDis) (publishedVersion)
Funders
  • NSF (IRES)
  • BMBF (16SV7599K)
  • SFB (TRR 161)
Topics
  • Physical Sciences › Computer Science › Human-Computer Interaction › Gaze Tracking and Assistive Technology
  • Physical Sciences › Computer Science › Computer Science Applications › Teaching and Learning Programming
  • Physical Sciences › Computer Science › Information Systems › Software Engineering Research
Keywords
eye tracking, gaze behavior, source code comprehension, eye movement metrics, programming education

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: On the Suitability of Real-Time Assessment of Programming Proficiency using Gaze Properties. https://app.cochat.ai/papers/10.1145/3205873.3210702
The paper
Liang, C., Karolus, J., Kosch, T., & Schmidt, A. (2018). On the Suitability of Real-Time Assessment of Programming Proficiency using Gaze Properties. Proceedings of the 7th ACM International Symposium on Pervasive Displays. https://doi.org/10.1145/3205873.3210702

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.