The DOI matches its Crossref record; 1 of the 1 references it cites were found in a registry or an index.
Studying programmer behavior experimentally: the problems of proper methodology
Open accessAbstract
The application of behavioral or psychological techniques to the evaluation of programming languages and techniques is an approach which has found increased applicability over the past decade. In order to use this approach successfully, investigators must pay close attention to methodological issues, both in order to insure the generalizability of their findings and to defend the quality of their work to researchers in other fields. Three major areas of methodological concern, the selection of subjects, materials, and measures, are reviewed. The first two of these areas continue to present major difficulties for this type of research.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Chase, W. G., & Simon, H. A. (1973) · Cognitive Psychology · doi:10.1016/0010-0285(73)90004-2 · Cited by 4,479 · cited 1×
“The model Shneiderman used is based on analogy to the work of Chase and Simon [ 3 ] on chess.”
Research works printed but not linked: 23
- 10.1177/001872087401600307 · DOI
- 10.5555/800099.803210 · doi:10.5555/800099.803210
- Curtis B., 1979, Proc. 4th Internat. Conf. on Software Eng., IEEE, 356
- 10.1016/S0020-7373(76)80010-7 · doi:10.1016/s0020-7373(76)80010-7
- 10.1145/359763.359800 · doi:10.1145/359763.359800
- 10.1177/001872087401600308 · DOI
- 10.1016/S0020-7373(75)80005-8 · DOI · Paper page
- 10.1111/j.2044-8325.1977.tb00363.x · DOI
- Halstead M.H., 1977, Amer. Elsevier Pub. Co.
- 10.1002/spe.4380010203 · DOI · Paper page
- McCabe T.J. A complexity measure. 1EEE Trans. on Software Eng. SE-2 (1976) 308-320. McCabe T.J. A complexity measure. 1EEE Trans. on Software Eng. SE-2 (1976) 308-320. · DOI · Paper page
- Sackman H., 1970, Auerbach
- Sheppard S.B., 1978, Va.
- Sheppard S.B., 1979, Modern coding practices and programmer performance, Computer, 12
- 10.1145/359605.359610 · DOI · Paper page
- 10.1016/S0020-7373(77)80014-X · DOI
- 10.1016/S0020-7373(77)80046-1 · DOI
- 10.1016/S0020-7373(73)80011-2 · DOI
- 10.1016/S0020-7373(77)80045-X · DOI
- 10.1177/001872087401600108 · DOI
- Weissman L., 1974, Univ. of Toronto
- Winer B., 1971, McGraw- Hill
- 10.1016/S0020-7373(74)80027-1 · DOI
Cited by
Expertise in debugging computer programs: A process analysis
Vessey, I. (1985) · International Journal of Man-Machine Studies · doi:10.1016/s0020-7373(85)80054-7 · Cited by 359
A critique of cyclomatic complexity as a software metric
Shepperd, M. (1988) · Software Engineering Journal · doi:10.1049/sej.1988.0003 · Cited by 240
Understanding understanding source code with functional magnetic resonance imaging
Siegmund, J., Kästner, C., Apel, S., Parnin, C., Bethmann, A., Leich, T., Saake, G., & Brechmann, A. (2014) · Proceedings of the 36th International Conference on Software Engineering · doi:10.1145/2568225.2568252 · Cited by 219
Reading Between the Lines: Modeling User Behavior and Costs in AI-Assisted Programming
Mozannar, H., Bansal, G., Fourney, A., & Horvitz, E. (2024) · Proceedings of the CHI Conference on Human Factors in Computing Systems · doi:10.1145/3613904.3641936 · Cited by 114
Replicating software engineering experiments: a poisoned chalice or the Holy Grail
Miller, J. (2005) · Information and Software Technology · doi:10.1016/j.infsof.2004.08.005 · Cited by 84
Metadata
- Authors
- Brooks, R. E.
- Venue
- Communications of the ACM
- Published
- 1980-04
- Volume
- 23
- Issue
- 4
- Pages
- 207-213
- ISSN
- 0001-0782 (ISSN-L)
- 1557-7317
- OpenAlex
- W2074140696
- Cited by
- 208
- References
- 1
- FWCI
- 42.96
- Type
- journal article
- Language
- en
- Open access
- bronze
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Studying programmer behavior experimentally: the problems of proper methodology. https://app.cochat.ai/papers/10.1145/358841.358847
- The paper
- Brooks, R. E. (1980). Studying programmer behavior experimentally: the problems of proper methodology. Communications of the ACM. https://doi.org/10.1145/358841.358847
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.
