The DOI matches its Crossref record; 14 of the 14 references it cites were found in a registry or an index.
Designing the whyline: a debugging interface for asking questions about program behavior
Abstract
Debugging is still among the most common and costly of programming activities. One reason is that current debugging tools do not directly support the inquisitive nature of the activity. Interrogative Debugging is a new debugging paradigm in which programmers can ask why did and even why didn't questions directly about their program's runtime failures. The Whyline is a prototype Interrogative Debugging interface for the Alice programming environment that visualizes answers in terms of runtime events directly relevant to a programmer's question. Comparisons of identical debugging scenarios from user tests with and without the Whyline showed that the Whyline reduced debugging time by nearly a factor of 8, and helped programmers complete 40% more tasks.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Contextual Design: Defining Customer-Centered Systems
Beyer, H. R., & Holtzblatt, K. (1997) · Cited by 2,748
Usability Analysis of Visual Programming Environments: A ‘Cognitive Dimensions’ Framework
Green, T. R. G., & Petre, M. (1996) · Journal of Visual Languages & Computing · doi:10.1006/jvlc.1996.0009 · Cited by 1,251
Cognitive dimensions of notations
Green, T. R. G. (1990) · Cited by 645
International Conference on Software Engineering
(2017) · IEEE Software · doi:10.1109/ms.2017.3571566 · Cited by 622
Isolating cause-effect chains from computer programs
Zeller, A. (2002) · Proceedings of the 10th ACM SIGSOFT symposium on Foundations of software engineering · doi:10.1145/587051.587053 · Cited by 530
Rethinking the evaluation of algorithm animations as learning aids: an observational study
KEHOE, C., STASKO, J., & TAYLOR, A. (2001) · International Journal of Human-Computer Studies · doi:10.1006/ijhc.2000.0409 · Cited by 200
Precise dynamic slicing algorithms
Zhang, X., Gupta, R., & Zhang, Y. (2003) · doi:10.5555/776816.776855 · Cited by 186
Models and theories of programming strategy
Davies, S. P. (1993) · International Journal of Man-Machine Studies · doi:10.1006/imms.1993.1061 · Cited by 173
Program understanding behavior during debugging of large scale software
von Mayrhauser, A., & Vans, A. M. (1997) · doi:10.1145/266399.266414 · Cited by 95
Development and evaluation of a model of programming errors
Ko, A. J., & Myers, B. A. (2003) · IEEE Symposium on Visual Languages and Human-Centric Computing (VL/HCC) · doi:10.1109/hcc.2003.1260196 · Cited by 78
Self-citation
Research works printed but not linked: 11
- 10.5555/786769.787013 · doi:10.5555/786769.787013
- 10.5555/795687.797807 · doi:10.5555/795687.797807
- 10.1145/230509.230513 · doi:10.1145/230509.230513
- Davies , S.P. Display-based problem solving strategies in computer programming, Empirical Studies of Programmers , 6th Workshop , 1996 , Washington, D.C., 59--76. Davies, S.P. Display-based problem solving strategies in computer programming, Empirical Studies of Programmers, 6th Workshop, 1996, Washington, D.C., 59--76.
- 10.5555/795687.797806 · doi:10.5555/795687.797806
- 10.5555/1153917.1153960 · doi:10.5555/1153917.1153960
- 10.1145/248448.248455 · doi:10.1145/248448.248455
- 10.1145/331960.331968 · doi:10.1145/331960.331968
- 10.1002/1099-1689(200006)10:2<77::AID-STVR197>3.0.CO;2-E · doi:10.1002/1099-1689(200006)10:2<77::aid-stvr197>3.0.co;2-e
- Tassey , G. , The economic impacts of inadequate infrastructure for software testing . National Institute of Standards and Technology , RTI Project Number 7007.011, 2002 . Tassey, G., The economic impacts of inadequate infrastructure for software testing. National Institute of Standards and Technology, RTI Project Number 7007.011, 2002.
- Tip , F. , A survey of programming slicing techniques . Journal of Programming Languages , 3 , 1995 , 121 -- 189 . Tip, F., A survey of programming slicing techniques. Journal of Programming Languages, 3, 1995, 121--189.
Cited by
Abdul, A., Vermeulen, J., Wang, D., Lim, B. Y., & Kankanhalli, M. (2018) · Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3173574.3174156 · Cited by 743
Ko, A. J., Myers, B. A., Coblenz, M. J., & Aung, H. H. (2006) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2006.116 · Cited by 685
Self-citationThe state of the art in end-user software engineering
Ko, A. J., Abraham, R., Beckwith, L., Blackwell, A., Burnett, M., Erwig, M., Scaffidi, C., Lawrance, J., Lieberman, H., Myers, B., et al. (2011) · ACM Computing Surveys · doi:10.1145/1922649.1922658 · Cited by 633
Self-citationWhy and why not explanations improve the intelligibility of context-aware intelligent systems
Lim, B. Y., Dey, A. K., & Avrahami, D. (2009) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/1518701.1519023 · Cited by 552
Six Learning Barriers in End-User Programming Systems
Ko, A. J., Myers, B. A., & Aung, H. H. (2004) · 2004 IEEE Symposium on Visual Languages - Human Centric Computing · doi:10.1109/vlhcc.2004.47 · Cited by 549
Self-citationMeasuring Program Comprehension: A Large-Scale Field Study with Professionals
Xia, X., Bao, L., Lo, D., Xing, Z., Hassan, A. E., & Li, S. (2018) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2017.2734091 · Cited by 326
Asking and Answering Questions during a Programming Change Task
Sillito, J., Murphy, G. C., & De Volder, K. (2008) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2008.26 · Cited by 319
Making mashups with marmite: towards end-user programming for the web
Wong, J., & Hong, J. I. (2007) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/1240624.1240842 · Cited by 313
Debugging reinvented: asking and answering why and why not questions about program behavior
Ko, A. J., & Myers, B. A. (2008) · Proceedings of the 30th international conference on Software engineering · doi:10.1145/1368088.1368130 · Cited by 296
Self-citationMethods and tools for exploring novice compilation behaviour
Jadud, M. C. (2006) · Proceedings of the second international workshop on Computing education research · doi:10.1145/1151588.1151600 · Cited by 295
Statistical Debugging: A Hypothesis Testing-Based Approach
Liu, C., Fei, L., Yan, X., Han, J., & Midkiff, S. P. (2006) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2006.105 · Cited by 288
Ashtari, N., Bunt, A., McGrenere, J., Nebeling, M., & Chilana, P. K. (2020) · Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3313831.3376722 · Cited by 273
MacNeil, S., Tran, A., Hellas, A., Kim, J., Sarsa, S., Denny, P., Bernstein, S., & Leinonen, J. (2023) · Proceedings of the 54th ACM Technical Symposium on Computer Science Education V. 1 · doi:10.1145/3545945.3569785 · Cited by 195
MacNeil, S., Tran, A., Hellas, A., Kim, J., Sarsa, S., Denny, P., Bernstein, S., & Leinonen, J. (2022) · arXiv · doi:10.48550/arxiv.2211.02265 · Cited by 195
On the Comprehension of Program Comprehension
Maalej, W., Tiarks, R., Roehm, T., & Koschke, R. (2014) · ACM Transactions on Software Engineering and Methodology · doi:10.1145/2622669 · Cited by 180
In-IDE Code Generation from Natural Language: Promise and Challenges
Xu, F. F., Vasilescu, B., & Neubig, G. (2022) · ACM Transactions on Software Engineering and Methodology · doi:10.1145/3487569 · Cited by 154
“Ko and Myers [53, 54] provides a debugging interface for asking questions about program behavior.”
BackgroundInfluentialFixing the program my computer learned: barriers for end users, challenges for the machine
Kulesza, T., Wong, W.-K., Stumpf, S., Perona, S., White, R., Burnett, M. M., Oberst, I., & Ko, A. J. (2009) · Proceedings of the 14th international conference on Intelligent user interfaces · doi:10.1145/1502650.1502678 · Cited by 83
Self-citationLemonAid: selection-based crowdsourced contextual help for web applications
Chilana, P. K., Ko, A. J., & Wobbrock, J. O. (2012) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/2207676.2208620 · Cited by 79
“, [5,14,18]), the novelty lies in providing a contextual help framework for end-users to resolve issues through crowdsourcing.”
Self-citationSpreadsheet Comprehension: Guesswork, Giving Up and Going Back to the Author
Srinivasa Ragavan, S., Sarkar, A., & Gordon, A. D. (2021) · Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3411764.3445634 · Cited by 67
“Such information seeking tangents also feature in program comprehension during maintenance activities [37, 31], where information seeking activities account for as much as 50% of programmers’ time during maintenance activities.”
BackgroundFactors Influencing Students' Help-Seeking Behavior while Programming with Human and Computer Tutors
Price, T. W., Liu, Z., Cateté, V., & Barnes, T. (2017) · Proceedings of the 2017 ACM Conference on International Computing Education Research · doi:10.1145/3105726.3106179 · Cited by 61
End-user debugging strategies: A sensemaking perspective
Grigoreanu, V., Burnett, M., Wiedenbeck, S., Cao, J., Rector, K., & Kwan, I. (2012) · ACM Transactions on Computer-Human Interaction · doi:10.1145/2147783.2147788 · Cited by 60
Xie, L., Zheng, C., Xia, H., Qu, H., & Zhu-Tian, C. (2024) · Proceedings of the 37th Annual ACM Symposium on User Interface Software and Technology · doi:10.1145/3654777.3676374 · Cited by 52
Kuttal, S. K., Ong, B., Kwasny, K., & Robe, P. (2021) · Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3411764.3445659 · Cited by 44
Kuttal, S. K., Myers, J., Gurka, S., Magar, D., Piorkowski, D., & Bellamy, R. (2020) · 2020 IEEE Symposium on Visual Languages and Human-Centric Computing (VL/HCC) · doi:10.1109/vl/hcc50065.2020.9127276 · Cited by 27
Visual Debugging Techniques for Reactive Data Visualization
Hoffswell, J., Satyanarayan, A., & Heer, J. (2016) · Computer Graphics Forum · doi:10.1111/cgf.12903 · Cited by 24
Requirements Are All You Need: The Final Frontier for End-User Software Engineering
Robinson, D., Cabrera, C., Gordon, A. D., Lawrence, N. D., & Mennen, L. (2025) · ACM Transactions on Software Engineering and Methodology · doi:10.1145/3708524 · Cited by 12
Metadata
- Authors
- Ko, A. J., & Myers, B. A.
- Venue
- Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
- Publisher
- ACM
- Published
- 2004-04-25
- Pages
- 151-158
- OpenAlex
- W2157922094
- Cited by
- 361
- References
- 14
- FWCI
- 13.33
- Type
- conference paper
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.