What help do developers seek, when and how?
The DOI matches its Crossref record; 45 of the 45 references it cites were found in a registry or an index.
Abstract
Software development often requires knowledge beyond what developers already possess. In such cases, developers have to seek help from different sources of information. As a metacognitive skill, help seeking influences software developers' efficiency and success in many situations. However, there has been little research to provide a systematic investigation of the general process of help seeking activities in software engineering and human and system factors affecting help seeking. This paper reports our empirical study aiming to fill this gap. Our study includes two human experiments, involving 24 developers and two typical software development tasks. Our study gathers empirical data that allows us to provide an in-depth analysis of help-seeking task structures, task strategies, information sources, process model, and developers' information needs and behaviors in seeking and using help information and in managing information during help seeking. Our study provides a detailed understanding of help seeking activities in software engineering, the challenges that software developers face, and the limitations of existing tool support. This can lead to the design and development of more efficient and usable help seeking support that helps developers become better help seekers.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Citations
Cites
Qualitative Data Analysis: An Expanded Sourcebook
(1994) · Journal of Environmental Psychology · doi:10.1016/s0272-4944(05)80231-2 · Cited by 48,420
Basics of Qualitative Research: Grounded Theory Procedures and Techniques.
Ellis, C., Strauss, A., & Corbin, J. (1992) · Contemporary Sociology · doi:10.2307/2074814 · Cited by 29,249
Brown, J. S., & Duguid, P. (1991) · Organization Science · doi:10.1287/orsc.2.1.40 · Cited by 8,390
The Think Aloud Method: A Practical Guide to Modelling Cognitive Processes
van Someren, M. (1994) · Cited by 1,730
The think aloud method: A practical guide to modelling cognitive processes
Solomon, P. (1995) · Information Processing & Management · doi:10.1016/0306-4573(95)90031-4 · Cited by 737
Maintaining mental models: a study of developer work habits
LaToza, T. D., Venolia, G., & DeLine, R. (2006) · Proceedings of the 28th international conference on Software engineering · doi:10.1145/1134285.1134355 · Cited by 628
Help Seeking and Help Design in Interactive Learning Environments
Aleven, V., Stahl, E., Schworm, S., Fischer, F., & Wallace, R. (2003) · Review of Educational Research · doi:10.3102/00346543073003277 · Cited by 609 · cited 4×
“Help seeking has been extensively studied in pedagogy and instructional design [22][10][1].”
BackgroundInfluentialFeature location in source code: a taxonomy and survey
Dit, B., Revelle, M., Gethers, M., & Poshyvanyk, D. (2013) · Journal of Software: Evolution and Process · doi:10.1002/smr.567 · Cited by 583
Information Needs in Collocated Software Development Teams
Ko, A. J., DeLine, R., & Venolia, G. (2007) · 29th International Conference on Software Engineering (ICSE'07) · doi:10.1109/icse.2007.45 · Cited by 499 · cited 2×
“In the context of software engineering, a significant amount of literature exists aiming to understand software developers’ information behavior and needs [15][29][30], cognitive process [16][23][8], work habit [9] in various types of software engineering tasks (e.”
BackgroundObject-Oriented Software Engineering Using UML, Patterns, and Java
Bruegge, B., & Dutoit, A. H. (2009) · Cited by 486
(2009) · doi:10.1145/1518701.1518944 · Cited by 447
How are Java software developers using the Eclipse IDE?
Murphy, G. C., Kersten, M., & Findlater, L. (2006) · IEEE Software · doi:10.1109/ms.2006.105 · Cited by 413 · cited 2×
“Researchers have investigated software developers’ information behavior and needs [25][18][29], cognitive process [10][31][21], work habit [19][11] in writing, changing and debugging software.”
BackgroundThe information-seeking practices of engineers: searching for documents as well as for people
Hertzum, M., & Pejtersen, A. M. (2000) · Information Processing & Management · doi:10.1016/s0306-4573(00)00011-x · Cited by 355
Cognitive processes in program comprehension
Letovsky, S. (1987) · Journal of Systems and Software · doi:10.1016/0164-1212(87)90032-x · Cited by 327
Example-centric programming: integrating web search into the development environment
Brandt, J., Dontcheva, M., Weskamp, M., & Klemmer, S. R. (2010) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/1753326.1753402 · Cited by 324 · cited 4×
“Several recent research efforts [3][2] propose to embed search tools in the development environments.”
BackgroundInfluentialHelp seeking, learning and contingent tutoring
Wood, H., & Wood, D. (1999) · Computers & Education · doi:10.1016/s0360-1315(99)00030-5 · Cited by 275
Help-Seeking Behavior in Learning
Gall, S. N.-L. (1985) · Review of Research in Education · doi:10.2307/1167146 · Cited by 237
Cognitive design elements to support the construction of a mental model during software exploration
Storey, M.-A. D., Fracchia, F. D., & Müller, H. A. (1999) · Journal of Systems and Software · doi:10.1016/s0164-1212(98)10055-9 · Cited by 237
Communication Patterns of Engineers
Tenopir, C., & King, D. W. (2003) · Wiley eBooks · doi:10.1002/0471683132 · Cited by 223
Newman, R. S. (1998) · Journal of Educational Psychology · doi:10.1037//0022-0663.90.4.644 · Cited by 180
(2012) · Routledge eBooks · doi:10.4324/9781410602701 · Cited by 175
The work breakdown structure in software project management
Tausworthe, R. C. (1979) · Journal of Systems and Software · doi:10.1016/0164-1212(79)90018-9 · Cited by 127
Easing Program Comprehension by Sharing Navigation Data
DeLine, R., Czerwinski, M., & Robertson, G. (2005) · 2005 IEEE Symposium on Visual Languages and Human-Centric Computing (VL/HCC'05) · doi:10.1109/vlhcc.2005.32 · Cited by 124
Help-seeking behavior in a problem-solving situation: Development of self-regulation
Puustinen, M. (1998) · European Journal of Psychology of Education · doi:10.1007/bf03173093 · Cited by 116 · cited 3×
“2) Task Strategy: Help seeking has been considered as a metacognitive skill [22] for knowing when and how to use particular strategies for learning or for problem solving.”
BackgroundCommunication Patterns of Engineers
Brammer, C. (2004) · IEEE Transactions on Professional Communication · doi:10.1109/tpc.2004.833702 · Cited by 103
Graph-based pattern-oriented, context-sensitive source code completion
Nguyen, A. T., Nguyen, T. T., Nguyen, H. A., Tamrawi, A., Nguyen, H. V., Al-Kofahi, J. M., & Nguyen, T. N. (2012) · doi:10.5555/2337223.2337232 · Cited by 102
Graph-based pattern-oriented, context-sensitive source code completion
Nguyen, A. T., Nguyen, T. T., Nguyen, H. A., Tamrawi, A., Nguyen, H. V., Al-Kofahi, J., & Nguyen, T. N. (2012) · 2012 34th International Conference on Software Engineering (ICSE) · doi:10.1109/icse.2012.6227205 · Cited by 91
Strathcona example recommendation tool
Holmes, R., Walker, R. J., & Murphy, G. C. (2005) · Proceedings of the 10th European software engineering conference held jointly with 13th ACM SIGSOFT international symposium on Foundations of software engineering · doi:10.1145/1081706.1081744 · Cited by 83
An Information Foraging Theory Perspective on Tools for Debugging, Refactoring, and Reuse Tasks
Fleming, S. D., Scaffidi, C., Piorkowski, D., Burnett, M., Bellamy, R., Lawrance, J., & Kwan, I. (2013) · ACM Transactions on Software Engineering and Methodology · doi:10.1145/2430545.2430551 · Cited by 79 · cited 2×
“In the context of software engineering, a significant amount of literature exists aiming to understand software developers’ information behavior and needs [15][29][30], cognitive process [16][23][8], work habit [9] in various types of software engineering tasks (e.”
BackgroundArchetypal Internet-Scale Source Code Searching
Umarji, M., Sim, S. E., & Lopes, C. V. (2008) · IFIP International Federation for Information Processing/IFIP · doi:10.1007/978-0-387-09684-1_21 · Cited by 75
(2012) · doi:10.5555/2666719.2666725 · Cited by 74
Archetypal Internet-Scale Source Code Searching
Umarji, M., & Sim, S. E. (2013) · Springer eBooks · doi:10.1007/978-1-4614-6596-6_3 · Cited by 74
Harnessing Stack Overflow for the IDE
Bacchelli, A., Ponzanelli, L., & Lanza, M. (2012) · 2012 Third International Workshop on Recommendation Systems for Software Engineering (RSSE) · doi:10.1109/rsse.2012.6233404 · Cited by 60
Speculative analysis of integrated development environment recommendations
Muşlu, K., Brun, Y., Holmes, R., Ernst, M. D., & Notkin, D. (2012) · Proceedings of the ACM international conference on Object oriented programming systems languages and applications · doi:10.1145/2384616.2384665 · Cited by 59
Modeling the information behaviour of software engineers using a work ‐ task framework
Freund, L., Toms, E. G., & Waterhouse, J. (2005) · Proceedings of the American Society for Information Science and Technology · doi:10.1002/meet.14504201181 · Cited by 54
Recommending source code for use in rapid software prototypes
McMillan, C., Hariri, N., Poshyvanyk, D., Cleland‐Huang, J., & Mobasher, B. (2012) · doi:10.5555/2337223.2337323 · Cited by 54
Wang, J., Peng, X., Xing, Z., & Zhao, W. (2011) · 2011 27th IEEE International Conference on Software Maintenance (ICSM) · doi:10.1109/icsm.2011.6080788 · Cited by 53
Self-citationImproving feature location practice with multi-faceted interactive exploration
Wang, J., Peng, X., Xing, Z., & Zhao, W. (2013) · ACM/IEEE International Conference on Software Engineering: Companion Proceedings (ICSE-Companion) · doi:10.1109/icse.2013.6606622 · Cited by 46
Self-citationSuade: Topology-Based Searches for Software Investigation
Warr, F. W., & Robillard, M. P. (2007) · ACM/IEEE International Conference on Software Engineering: Companion Proceedings (ICSE-Companion) · doi:10.1109/icse.2007.80 · Cited by 42
Programmer information needs after memory failure
Parnin, C., & Rugaber, S. (2012) · 2012 20th IEEE International Conference on Program Comprehension (ICPC) · doi:10.1109/icpc.2012.6240479 · Cited by 36
Improving feature location practice with multi-faceted interactive exploration
Wang, J., Peng, X., Xing, Z., et al. (2013) · doi:10.5555/2486788.2486888 · Cited by 35
Self-citationThe end-to-end use of source code examples: An exploratory study
Holmes, R., Cottrell, R., Walker, R. J., & Denzinger, J. (2009) · IEEE International Conference on Software Maintenance (ICSM) · doi:10.1109/icsm.2009.5306387 · Cited by 35
Reusing debugging knowledge via trace-based bug search
Gu, Z., Barr, E. T., Schleck, D., & Su, Z. (2012) · Conference on Object-Oriented Programming Systems, Languages, and Applications · doi:10.1145/2384616.2384684 · Cited by 19
Integrating code search into the development session
Lee, M.-W., Hwang, S.-W., & Kim, S. (2011) · IEEE International Conference on Data Engineering (ICDE) · doi:10.1109/icde.2011.5767948 · Cited by 10
Programming with everybody: tightening the copy-modify-publish feedback loop
Lieber, T., & Miller, R. C. (2012) · ACM Symposium on User Interface Software and Technology (UIST) · doi:10.1145/2380296.2380342 · Cited by 1
Research works printed but not linked: 1
- 0, Cloud9 IDE
Cited by
Using an LLM to Help With Code Understanding
Nam, D., Macvean, A., Hellendoorn, V., Vasilescu, B., & Myers, B. (2024) · Proceedings of the IEEE/ACM 46th International Conference on Software Engineering · doi:10.1145/3597503.3639187 · Cited by 487
“Therefore, researchers have studied to understand how developers learn and comprehend unfamiliar code and domains [30, 38, 51, 62], especially how they search for and acquire information, as developers need a variety of kinds of knowledge [43, 66, 68, 77].”
BackgroundWhat are mobile developers asking about? A large scale study using stack overflow
Rosen, C., & Shihab, E. (2015) · Empirical Software Engineering · doi:10.1007/s10664-015-9379-3 · Cited by 371
Subramanian, S., Inozemtseva, L., & Holmes, R. (2014) · Proceedings of the 36th International Conference on Software Engineering · doi:10.1145/2568225.2568313 · Cited by 239
How developers search for code: a case study
Sadowski, C., Stolee, K. T., & Elbaum, S. (2015) · Proceedings of the 2015 10th Joint Meeting on Foundations of Software Engineering · doi:10.1145/2786805.2786855 · Cited by 238
What Security Questions Do Developers Ask? A Large-Scale Study of Stack Overflow Posts
Yang, X.-L., Lo, D., Xia, X., Wan, Z.-Y., & Sun, J.-L. (2016) · Journal of Computer Science and Technology · doi:10.1007/s11390-016-1672-0 · Cited by 209
Metadata
- Authors
- Li, H., Xing, Z., Peng, X., & Zhao, W.
- Affiliations
- Fudan University (CN)
- Nanyang Technological University (SG)
- Venue
- 2013 20th Working Conference on Reverse Engineering (WCRE)
- Publisher
- IEEE
- Published
- 2013-10
- Pages
- 142-151
- ISSN
- 1095-1350 (ISSN-L)
- OpenAlex
- W2031289572
- Cited by
- 81
- References
- 45
- Citations by year
- 2026: 1 · 2025: 4 · 2024: 5 · 2023: 7 · 2022: 10 · 2021: 9 · 2020: 8 · 2019: 6 · 2018: 7 · 2017: 7 · 2016: 6 · 2015: 8 · 2014: 3
- FWCI
- 4.55
- Type
- conference paper
- Language
- en
- Open access
- closed
- Locations
- Working Conference on Reverse Engineering (WCRE) (publishedVersion)
- Topics
- Physical Sciences › Computer Science › Information Systems › Software Engineering Techniques and Practices
- Physical Sciences › Computer Science › Information Systems › Software Engineering Research
- Physical Sciences › Computer Science › Information Systems › Information Retrieval and Search Behavior
- Keywords
- help-seeking, software developers, information seeking, metacognition, information needs, information sources, task strategies, developer support tools, software engineering tasks
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.