The DOI matches its Crossref record; 37 of the 37 references it cites were found in a registry or an index.
A Visual Text Mining approach for Systematic Reviews
Abstract
The software engineering research community has been adopting systematic reviews as an unbiased and fair way to assess a research topic. Despite encouraging early results, a systematic review process can be time consuming and hard to conduct. Thus, tools that help on its planning or execution are needed. This article suggests the use of Visual Text Mining (VTM) to aid systematic reviews. A feasibility study was conducted comparing the proposed approach with a manual process. We observed that VTM can contribute to Systematic Review and we propose a new strategy called VTM-Based Systematic Review.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
(1984) · Cited by 81,983
The Measurement of Observer Agreement for Categorical Data
Landis, J. R., & Koch, G. G. (1977) · Biometrics · doi:10.2307/2529310 · Cited by 81,148
A Coefficient of Agreement for Nominal Scales
Cohen, J. (1960) · Educational and Psychological Measurement · doi:10.1177/001316446002000104 · Cited by 42,398
(1998) · Sage eBooks · Cited by 38,631
Term-weighting approaches in automatic text retrieval
Salton, G., & Buckley, C. (1988) · Information Processing & Management · doi:10.1016/0306-4573(88)90021-0 · Cited by 9,740
A vector space model for automatic indexing
Salton, G., Wong, A., & Yang, C. S. (1975) · Communications of the ACM · doi:10.1145/361219.361220 · Cited by 7,521 · cited 2×
“Finally, the similarity of two documents is computed as the cosine distance of their vectors [12].”
Method(2004) · Cited by 5,198
Systematic reviews in the social sciences: a practical guide
(2006) · Choice Reviews Online · doi:10.5860/choice.43-5664 · Cited by 4,089
Meta-Ethnography: Synthesizing Qualitative Studies
Noblit, G. W., & Hare, R. D. (1988) · Medical Entomology and Zoology · Cited by 2,191
Synthesising qualitative and quantitative evidence: A review of possible methods
Dixon-Woods, M., Agarwal, S., Jones, D., Young, B., & Sutton, A. (2005) · Journal of Health Services Research & Policy · doi:10.1177/135581960501000110 · Cited by 2,132
Cited by
Empirical studies of agile software development: A systematic review
Dybå, T., & Dingsøyr, T. (2008) · Information and Software Technology · doi:10.1016/j.infsof.2008.01.006 · Cited by 2,668
Guidelines for conducting systematic mapping studies in software engineering: An update
Petersen, K., Vakkalanka, S., & Kuzniarz, L. (2015) · Information and Software Technology · doi:10.1016/j.infsof.2015.03.007 · Cited by 2,669
Recommended Steps for Thematic Synthesis in Software Engineering
Cruzes, D. S., & Dyba, T. (2011) · 2011 International Symposium on Empirical Software Engineering and Measurement · doi:10.1109/esem.2011.36 · Cited by 960
A systematic review of open government data initiatives
Attard, J., Orlandi, F., Scerri, S., & Auer, S. (2015) · Government Information Quarterly · doi:10.1016/j.giq.2015.07.006 · Cited by 921
Identifying relevant studies in software engineering
Zhang, H., Babar, M. A., & Tell, P. (2011) · Information and Software Technology · doi:10.1016/j.infsof.2010.12.010 · Cited by 557
A systematic review of search-based testing for non-functional system properties
Afzal, W., Torkar, R., & Feldt, R. (2009) · Information and Software Technology · doi:10.1016/j.infsof.2008.12.005 · Cited by 447
Automation of systematic literature reviews: A systematic literature review
van Dinter, R., Tekinerdogan, B., & Catal, C. (2021) · Information and Software Technology · doi:10.1016/j.infsof.2021.106589 · Cited by 432
Bjørnson, F. O., & Dingsøyr, T. (2008) · Information and Software Technology · doi:10.1016/j.infsof.2008.03.006 · Cited by 360
Research synthesis in software engineering: A tertiary study
Cruzes, D. S., & Dybå, T. (2011) · Information and Software Technology · doi:10.1016/j.infsof.2011.01.004 · Cited by 346
A systematic review on regression test selection techniques
Engström, E., Runeson, P., & Skoglund, M. (2010) · Information and Software Technology · doi:10.1016/j.infsof.2009.07.001 · Cited by 311
A systematic review on the relationship between user involvement and system success
Bano, M., & Zowghi, D. (2015) · Information and Software Technology · doi:10.1016/j.infsof.2014.06.011 · Cited by 290
A method for evaluating rigor and industrial relevance of technology evaluations
Ivarsson, M., & Gorschek, T. (2011) · Empirical Software Engineering · doi:10.1007/s10664-010-9146-4 · Cited by 279
The effectiveness of pair programming: A meta-analysis
Hannay, J. E., Dybå, T., Arisholm, E., & Sjøberg, D. I. K. (2009) · Information and Software Technology · doi:10.1016/j.infsof.2009.02.001 · Cited by 268
Strength of evidence in systematic reviews in software engineering
Dybå, T., & Dingsøyr, T. (2008) · Proceedings of the Second ACM-IEEE international symposium on Empirical software engineering and measurement · doi:10.1145/1414004.1414034 · Cited by 261
Variability in Software Systems—A Systematic Literature Review
Galster, M., Weyns, D., Tofan, D., Michalik, B., & Avgeriou, P. (2014) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2013.56 · Cited by 259
Developing search strategies for detecting relevant experiments
Dieste, O., Grimán, A., & Juristo, N. (2009) · Empirical Software Engineering · doi:10.1007/s10664-008-9091-7 · Cited by 200
Towards an Evidence-Based Understanding of Electronic Data Sources
Chen, L., Babar, M. A., & Zhang, H. (2010) · Electronic Workshops in Computing · doi:10.14236/ewic/ease2010.17 · Cited by 191
Testing scientific software: A systematic literature review
Kanewala, U., & Bieman, J. M. (2014) · Information and Software Technology · doi:10.1016/j.infsof.2014.05.006 · Cited by 150
Measuring and predicting software productivity: A systematic map and review
Petersen, K. (2011) · Information and Software Technology · doi:10.1016/j.infsof.2010.12.001 · Cited by 128
Jabangwe, R., Börstler, J., Šmite, D., & Wohlin, C. (2015) · Empirical Software Engineering · doi:10.1007/s10664-013-9291-7 · Cited by 97
A systematic review of comparative evidence of aspect-oriented programming
Ali, M. S., Ali Babar, M., Chen, L., & Stol, K.-J. (2010) · Information and Software Technology · doi:10.1016/j.infsof.2010.05.003 · Cited by 89
Tools to Support Systematic Literature Reviews in Software Engineering: A Mapping Study
Marshall, C., & Brereton, P. (2013) · 2013 ACM / IEEE International Symposium on Empirical Software Engineering and Measurement · doi:10.1109/esem.2013.32 · Cited by 87
On using grey literature and google scholar in systematic literature reviews in software engineering
Yasin, A., Fatima, R., Wen, L., Afzal, W., Azhar, M., & Torkar, R. (2020) · IEEE Access · doi:10.1109/access.2020.2971712 · Cited by 85
Finding better active learners for faster literature reviews
Yu, Z., Kraft, N. A., & Menzies, T. (2018) · Empirical Software Engineering · doi:10.1007/s10664-017-9587-0 · Cited by 83
FAST2: An intelligent assistant for finding relevant papers
Yu, Z., & Menzies, T. (2019) · Expert Systems with Applications · doi:10.1016/j.eswa.2018.11.021 · Cited by 80
Bissi, W., Serra Seca Neto, A. G., & Emer, M. C. F. P. (2016) · Information and Software Technology · doi:10.1016/j.infsof.2016.02.004 · Cited by 76
Reference-based search strategies in systematic reviews
Skoglund, M., & Runeson, P. (2009) · Electronic Workshops in Computing · doi:10.14236/ewic/ease2009.4 · Cited by 71
A visual analysis approach to validate the selection review of primary studies in systematic reviews
Felizardo, K. R., Andery, G. F., Paulovich, F. V., Minghim, R., & Maldonado, J. C. (2012) · Information and Software Technology · doi:10.1016/j.infsof.2012.04.003 · Cited by 60
Self-citationPankowska, M. (2019) · Sustainability · doi:10.3390/su11051460 · Cited by 55
Tools to support systematic reviews in software engineering: a feature analysis
Marshall, C., Brereton, P., & Kitchenham, B. (2014) · Proceedings of the 18th International Conference on Evaluation and Assessment in Software Engineering · doi:10.1145/2601248.2601270 · Cited by 56
Olorisade, B. K., Brereton, P., & Andras, P. (2017) · Journal of Biomedical Informatics · doi:10.1016/j.jbi.2017.07.010 · Cited by 54
Olorisade, B. K., de Quincey, E., Brereton, P., & Andras, P. (2016) · Proceedings of the 20th International Conference on Evaluation and Assessment in Software Engineering · doi:10.1145/2915970.2915982 · Cited by 42
Codepori: Large-Scale System for Autonomous Software Development Using Multi-Agent Technology
Rasheed, Z., Malik, S., Kemell, K.-K., Muhammad, W., Saari, M., Systä, K., & Abrahamsson, P. (2024) · doi:10.2139/ssrn.4979510 · Cited by 27
Fabbri, S., Hernandes, E., Di Thommazo, A., Belgamo, A., Zamboni, A., & Silva, C. (2013) · Lecture Notes in Business Information Processing · doi:10.1007/978-3-642-40654-6_15 · Cited by 20
“Malheiros et al. (2007) proposed the use of a visualization tool, named PEx, to support the first step of studies selection.”
MethodUser Interface Evaluation Methods for Elderly: A Systematic Review
Postal, M. R. B., & Rieder, R. (2019) · 2019 21st Symposium on Virtual and Augmented Reality (SVR) · doi:10.1109/svr.2019.00029 · Cited by 5
Metadata
- Authors
- Malheiros, V., Hohn, E., Pinho, R., Mendonca, M., & Maldonado, J. C.
- Venue
- First International Symposium on Empirical Software Engineering and Measurement (ESEM 2007)
- Publisher
- IEEE
- Published
- 2007-09
- Pages
- 245-254
- ISSN
- 1938-6451 (ISSN-L)
- OpenAlex
- W2113035899
- Cited by
- 329
- References
- 37
- FWCI
- 3.77
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.