The DOI matches its Crossref record.
Writing good software engineering research papers
Abstract
Software engineering researchers solve problems of several different kinds. To do so, they produce several different kinds of results, and they should develop appropriate evidence to validate these results. They often report their research in conference papers. I analyzed the abstracts of research papers submitted to XSE 2002 in order to identify the types of research reported in the submitted and accepted papers, and I observed the program committee discussions about which papers to accept. This report presents the research paradigms of the papers, common concerns of the program committee, and statistics on success rates. This information should help researchers design better research projects and write papers that present their results to best advantage.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cited by
Collins, C., Dennehy, D., Conboy, K., & Mikalef, P. (2021) · International Journal of Information Management · doi:10.1016/j.ijinfomgt.2021.102383 · Cited by 783
A survey of controlled experiments in software engineering
Sjoeberg, D. I. K., Hannay, J. E., Hansen, O., Kampenes, V. B., Karahasanovic, A., Liborg, N.-K., & Rekdal, A. C. (2005) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2005.97 · Cited by 682
Software ecosystems – A systematic literature review
Manikas, K., & Hansen, K. M. (2013) · Journal of Systems and Software · doi:10.1016/j.jss.2012.12.026 · Cited by 467
Software development in startup companies: A systematic mapping study
Paternoster, N., Giardino, C., Unterkalmsteiner, M., Gorschek, T., & Abrahamsson, P. (2014) · Information and Software Technology · doi:10.1016/j.infsof.2014.04.014 · Cited by 451
Reporting Experiments in Software Engineering
Jedlitschka, A., Ciolkowski, M., & Pfahl, D. (2008) · Guide to Advanced Empirical Software Engineering · doi:10.1007/978-1-84800-044-5_8 · Cited by 331
Reporting guidelines for controlled experiments in software engineering
Jedlitschka, A., & Pfahl, D. (2005) · 2005 International Symposium on Empirical Software Engineering, 2005. · doi:10.1109/isese.2005.1541818 · Cited by 295
Revisiting software ecosystems Research: A longitudinal literature study
Manikas, K. (2016) · Journal of Systems and Software · doi:10.1016/j.jss.2016.02.003 · Cited by 259
The ABC of Software Engineering Research
Stol, K.-J., & Fitzgerald, B. (2018) · ACM Transactions on Software Engineering and Methodology · doi:10.1145/3241743 · Cited by 245
Using grounded theory to study the experience of software development
Adolph, S., Hall, W., & Kruchten, P. (2011) · Empirical Software Engineering · doi:10.1007/s10664-010-9152-6 · Cited by 235
Cico, O., Jaccheri, L., Nguyen-Duc, A., & Zhang, H. (2021) · Journal of Systems and Software · doi:10.1016/j.jss.2020.110736 · Cited by 195
Thirteen years of SysML: a systematic mapping study
Wolny, S., Mazak, A., Carpella, C., Geist, V., & Wimmer, M. (2020) · Software and Systems Modeling · doi:10.1007/s10270-019-00735-y · Cited by 140
A study on the prevalence of human values in software engineering publications, 2015 -- 2018
Perera, H., Hussain, W., Whittle, J., Nurwidyantoro, A., Mougouei, D., Shams, R. A., & Oliver, G. (2020) · Proceedings of the ACM/IEEE 42nd International Conference on Software Engineering · doi:10.1145/3377811.3380393 · Cited by 63
“used in similar classification studies in SE [4, 15, 34].”
BackgroundMethodInfluential
Metadata
- Authors
- Shaw, M.
- Venue
- 25th International Conference on Software Engineering, 2003. Proceedings.
- Publisher
- IEEE
- Published
- 2003
- Pages
- 726-736
- ISSN
- 0270-5257 (ISSN-L)
- OpenAlex
- W2142168034
- Cited by
- 213
- References
- 0
- FWCI
- 3.15
- Type
- conference paper
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.