The DOI matches its Crossref record; 45 of the 45 references it cites were found in a registry or an index.
Using mapping studies as the basis for further research – A participant-observer case study
Open accessAbstract
Context: We are strong advocates of evidence-based software engineering (EBSE) in general and systematic literature reviews (SLRs) in particular. We believe it is essential that the SLR methodology is used constructively to support software engineering research. Objective: This study aims to assess the value of mapping studies which are a form of SLR that aims to identify and categorise the available research on a broad software engineering topic. Method: We used a multi-case, participant-observer case study using five examples of studies that were based on preceding mapping studies. We also validated our results by contacting two other researchers who had undertaken studies based on preceding mapping studies and by assessing review comments related to our follow-on studies. Results: Our original case study identified 11 unique benefits that can accrue from basing research on a preceding mapping study of which only two were case specific. We also identified nine problems associated with using preceding mapping studies of which two were case specific. These results were consistent with the information obtained from the validation activities. We did not find an example of an independent research group making use of a mapping study produced by other researchers. Conclusion: Mapping studies can save time and effort for researchers and provide baselines to assist new research efforts. However, they must be of high quality in terms of completeness and rigour if they are to be a reliable basis for follow-on research.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
(1984) · Cited by 81,983
Case study research: Design and methods
McCorcle, M. D., & Bell, E. L. (1986) · Evaluation and Program Planning · doi:10.1016/0149-7189(86)90052-2 · Cited by 5,885
Systematic Literature Reviews in Software Engineering—A Systematic Literature Review
Kitchenham, B., Pearl Brereton, O., Budgen, D., Turner, M., Bailey, J., & Linkman, S. (2009) · Information and Software Technology · doi:10.1016/j.infsof.2008.09.009 · Cited by 4,537
Self-citationSystematic reviews in the social sciences: a practical guide
(2006) · Choice Reviews Online · doi:10.5860/choice.43-5664 · Cited by 4,089
Systematic Mapping Studies in Software Engineering
Petersen, K., Feldt, R., Mujtaba, S., & Mattsson, M. (2008) · Electronic Workshops in Computing · doi:10.14236/ewic/ease2008.8 · Cited by 3,239 · cited 3×
“Three recent papers have discussed the use of mapping studies in software engineering [9,13,31].”
BackgroundMethodInfluentialSystematic literature reviews in software engineering – A tertiary study
Kitchenham, B., Pretorius, R., Budgen, D., Pearl Brereton, O., Turner, M., Niazi, M., & Linkman, S. (2010) · Information and Software Technology · doi:10.1016/j.infsof.2010.03.006 · Cited by 1,230 · cited 3×
“In our experience , there are a relatively large number of mapping studies [10], but relatively little discussion of their value as a research tool (see Section 3).”
BackgroundResultInfluentialSelf-citationCase Study Research: Design and Methods, 3rd Edition
Yin, R. K. (2002) · Cited by 1,005
Requirements engineering paper classification and evaluation criteria: a proposal and a discussion
Wieringa, R., Maiden, N., Mead, N., & Rolland, C. (2006) · Requirements Engineering · doi:10.1007/s00766-005-0021-6 · Cited by 940
A systematic review of software development cost estimation studies
Jørgensen, M., & Shepperd, M. (2007) · Brunel University Research Archive (BURA) (Brunel University London) · doi:10.1109/tse.2007.3 · Cited by 742
A Systematic Review of Software Development Cost Estimation Studies
Jorgensen, M., & Shepperd, M. (2007) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2007.256943 · Cited by 729
Research works printed but not linked: 1
- Gómez, 2006, A systematic review measurement in software engineering: state-of-the-art in measures, ICSOFT 2006, CCIS, 10, 165
Cited by
Wohlin, C. (2014) · Proceedings of the 18th International Conference on Evaluation and Assessment in Software Engineering · doi:10.1145/2601248.2601268 · Cited by 4,234
Guidelines for conducting systematic mapping studies in software engineering: An update
Petersen, K., Vakkalanka, S., & Kuzniarz, L. (2015) · Information and Software Technology · doi:10.1016/j.infsof.2015.03.007 · Cited by 2,669
Synthesizing information systems knowledge: A typology of literature reviews
Paré, G., Trudel, M.-C., Jaana, M., & Kitsiou, S. (2015) · Information & Management · doi:10.1016/j.im.2014.08.008 · Cited by 1,987
Collins, C., Dennehy, D., Conboy, K., & Mikalef, P. (2021) · International Journal of Information Management · doi:10.1016/j.ijinfomgt.2021.102383 · Cited by 783
The maturity of maturity model research: A systematic mapping study
Wendler, R. (2012) · Information and Software Technology · doi:10.1016/j.infsof.2012.07.007 · Cited by 693
Khan, I. S., Ahmad, M. O., & Majava, J. (2021) · Journal of Cleaner Production · doi:10.1016/j.jclepro.2021.126655 · Cited by 489
Natural Language Processing for Requirements Engineering: A Systematic Mapping Study
Zhao, L., Alhoshan, W., Ferrari, A., Letsholo, K. J., Ajagbe, M. A., Chioasca, E.-V., & Batista-Navarro, R. T. (2022) · ACM Computing Surveys · doi:10.1145/3444689 · Cited by 322
Systematic reviews in sentiment analysis: a tertiary study
Ligthart, A., Catal, C., & Tekinerdogan, B. (2021) · Artificial Intelligence Review · doi:10.1007/s10462-021-09973-3 · Cited by 303
Weber, P., Carl, K. V., & Hinz, O. (2024) · Management Review Quarterly · doi:10.1007/s11301-023-00320-0 · Cited by 292
“Researchers benefit from a comprehensive overview of previous research and the developed future avenues for research, whereas practitioners can employ the derived overview as a guideline for their operations (Kitchenham et al. 2011; Snyder 2019).”
InfluentialMachine learning applied to software testing: A systematic mapping study
Durelli, V. H. S., Durelli, R. S., Borges, S. S., Endo, A. T., Eler, M. M., Dias, D. R. C., & Guimaraes, M. P. (2019) · IEEE Transactions on Reliability · doi:10.1109/tr.2019.2892517 · Cited by 207
Generative AI in education and research: A systematic mapping review
Yusuf, A., Pervin, N., Román‐González, M., & Noor, N. M. (2024) · Review of Education · doi:10.1002/rev3.3489 · Cited by 182
Thirteen years of SysML: a systematic mapping study
Wolny, S., Mazak, A., Carpella, C., Geist, V., & Wimmer, M. (2020) · Software and Systems Modeling · doi:10.1007/s10270-019-00735-y · Cited by 140
Cost, benefits and quality of software development documentation: A systematic mapping
Zhi, J., Garousi-Yusifoğlu, V., Sun, B., Garousi, G., Shahnewaz, S., & Ruhe, G. (2015) · Journal of Systems and Software · doi:10.1016/j.jss.2014.09.042 · Cited by 112
Model-based security engineering for cyber-physical systems: A systematic mapping study
Nguyen, P. H., Ali, S., & Yue, T. (2017) · Information and Software Technology · doi:10.1016/j.infsof.2016.11.004 · Cited by 107
Empirical Studies on Web Accessibility of Educational Websites: A Systematic Literature Review
Campoverde-Molina, M., Lujan-Mora, S., & Garcia, L. V. (2020) · IEEE Access · doi:10.1109/access.2020.2994288 · Cited by 94
Accessibility of university websites worldwide: a systematic literature review
Campoverde-Molina, M., Luján-Mora, S., & Valverde, L. (2023) · Universal Access in the Information Society · doi:10.1007/s10209-021-00825-z · Cited by 84
“The SLR methodology has been used to guide the research process [10].”
MethodA systematic literature mapping on secure identity management using blockchain technology
Rathee, T., & Singh, P. (2022) · Journal of King Saud University - Computer and Information Sciences · doi:10.1016/j.jksuci.2021.03.005 · Cited by 78
Descriptive theory of awareness for groupware development
Collazos, C. A., Gutiérrez, F. L., Gallardo, J., Ortega, M., Fardoun, H. M., & Molina, A. I. (2019) · Journal of Ambient Intelligence and Humanized Computing · doi:10.1007/s12652-018-1165-9 · Cited by 65
Tools to support systematic reviews in software engineering: a feature analysis
Marshall, C., Brereton, P., & Kitchenham, B. (2014) · Proceedings of the 18th International Conference on Evaluation and Assessment in Software Engineering · doi:10.1145/2601248.2601270 · Cited by 56
Self-citationA mapping study on documentation in Continuous Software Development
Theunissen, T., van Heesch, U., & Avgeriou, P. (2022) · Information and Software Technology · doi:10.1016/j.infsof.2021.106733 · Cited by 40
Understanding the social aspects of earthquake early warning: A literature review
Tan, M. L., Becker, J. S., Stock, K., Prasanna, R., Brown, A., Kenney, C., Cui, A., & Lambie, E. (2022) · Frontiers in Communication · doi:10.3389/fcomm.2022.939242 · Cited by 34
Perceptions of Creativity in Software Engineering Research and Practice
Mohanani, R., Ram, P., Lasisi, A., Ralph, P., & Turhan, B. (2017) · 2017 43rd Euromicro Conference on Software Engineering and Advanced Applications (SEAA) · doi:10.1109/seaa.2017.21 · Cited by 24
Metadata
- Authors
- Kitchenham, B. A., Budgen, D., & Pearl Brereton, O.
- Venue
- Information and Software Technology
- Publisher
- Elsevier BV
- Published
- 2011-06
- Volume
- 53
- Issue
- 6
- Pages
- 638-651
- ISSN
- 0950-5849 (ISSN-L)
- OpenAlex
- W2072668705
- Cited by
- 621
- References
- 45
- FWCI
- 43.37
- Type
- journal article
- Language
- en
- Open access
- green
- Licence
- www.elsevier.com/tdm/userlicense/1.0/ (tdm)
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.