The DOI matches its Crossref record; 33 of the 33 references it cites were found in a registry or an index.
Software traceability with topic modeling
Abstract
Software traceability is a fundamentally important task in software engineering. The need for automated traceability increases as projects become more complex and as the number of artifacts increases. We propose an automated technique that combines traceability with a machine learning technique known as topic modeling. Our approach automatically records traceability links during the software development process and learns a probabilistic topic model over artifacts. The learned model allows for the semantic categorization of artifacts and the topical visualization of the software system. To test our approach, we have implemented several tools: an artifact search tool combining keyword-based search and topic modeling, a recording tool that performs prospective traceability, and a visualization tool that allows one to navigate the software architecture and view semantic topics associated with relevant artifacts and architectural components. We apply our approach to several data sets and discuss how topic modeling enhances software traceability, and vice versa. Categories and Subject Descriptors
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
(2003) · Journal of Machine Learning Research · doi:10.5555/944919.944937 · Cited by 32,337
Blei, D. M., & Lafferty, J. D. (2006) · Proceedings of the 23rd international conference on Machine learning - ICML '06 · doi:10.1145/1143844.1143859 · Cited by 3,173
Unsupervised Learning by Probabilistic Latent Semantic Analysis
Hofmann, T. (2001) · Machine Learning · doi:10.1023/a:1007617005950 · Cited by 2,456
Hierarchical Dirichlet Processes
Teh, Y. W., Jordan, M. I., Beal, M. J., & Blei, D. M. (2006) · Journal of the American Statistical Association · doi:10.1198/016214506000000302 · Cited by 2,120
The author-topic model for authors and documents
Rosen‐Zvi, M., Griffiths, T. L., Steyvers, M., & Smyth, P. (2004) · Uncertainty in Artificial Intelligence · doi:10.5555/1036843.1036902 · Cited by 1,280
LDA-based document models for ad-hoc retrieval
Wei, X., & Croft, W. B. (2006) · Proceedings of the 29th annual international ACM SIGIR conference on Research and development in information retrieval · doi:10.1145/1148170.1148204 · Cited by 1,075
Fast collapsed gibbs sampling for latent dirichlet allocation
Porteous, I., Newman, D., Ihler, A., Asuncion, A., Smyth, P., & Welling, M. (2008) · Proceedings of the 14th ACM SIGKDD international conference on Knowledge discovery and data mining · doi:10.1145/1401890.1401960 · Cited by 560
Self-citationAdvancing candidate link generation for requirements tracing: the study of methods
Hayes, J. H., Dekhtyar, A., & Sundaram, S. K. (2006) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2006.3 · Cited by 481
On Smoothing and Inference for Topic Models
Asuncion, A., Welling, M., Smyth, P., & Teh, Y. W. (2012) · arXiv (Cornell University) · doi:10.48550/arxiv.1205.2662 · Cited by 434
Self-citationUncertainty in Artificial Intelligence
(1990) · Machine Intelligence and Pattern Recognition · doi:10.1016/c2009-0-14501-4 · Cited by 423
Automatic labeling of multinomial topic models
Mei, Q., Shen, X., & Zhai, C. (2007) · Proceedings of the 13th ACM SIGKDD international conference on Knowledge discovery and data mining · doi:10.1145/1281192.1281246 · Cited by 384
Mylar: a degree-of-interest model for IDEs
Kersten, M., & Murphy, G. C. (2005) · Proceedings of the 4th international conference on Aspect-oriented software development · doi:10.1145/1052898.1052912 · Cited by 298
Provenance Collection Support in the Kepler Scientific Workflow System
Altintas, I., Barney, O., & Jaeger-Frank, E. (2006) · Lecture Notes in Computer Science · doi:10.1007/11890850_14 · Cited by 269
Distributed Inference for Latent Dirichlet Allocation
Newman, D. J., Smyth, P., Welling, M., & Asuncion, A. (2007) · Cited by 215
Self-citationBest Practices for Automated Traceability
Cleland-Huang, J., Berenbach, B., Clark, S., Settimi, R., & Romanova, E. (2007) · Computer · doi:10.1109/mc.2007.195 · Cited by 208
Conducting realistic experiments in software engineering
Sjoberg, D. I. K., Anda, B., Arisholm, E., Dyba, T., Jorgensen, M., Karahasanovic, A., Koren, E. F., & Vokac, M. (2003) · Proceedings International Symposium on Empirical Software Engineering · doi:10.1109/isese.2002.1166921 · Cited by 197
A comprehensive approach for the development of modular software architecture description languages
Dashofy, E. M., Hoek, A. V. D., & Taylor, R. N. (2005) · ACM Transactions on Software Engineering and Methodology · doi:10.1145/1061254.1061258 · Cited by 189
Self-citationAn object-oriented tool for tracing requirements
Pinheiro, F. A. C., & Goguen, J. A. (1996) · IEEE Software · doi:10.1109/52.506462 · Cited by 185
Adapting traceability environments to project-specific needs
Dömges, R., & Pohl, K. (1998) · Communications of the ACM · doi:10.1145/290133.290149 · Cited by 182
Using Latent Dirichlet Allocation for automatic categorization of software
Tian, K., Revelle, M., & Poshyvanyk, D. (2009) · 2009 6th IEEE International Working Conference on Mining Software Repositories · doi:10.1109/msr.2009.5069496 · Cited by 174
Mining business topics in source code using latent dirichlet allocation
Maskeri, G., Sarkar, S., & Heafield, K. (2008) · Proceedings of the 1st India software engineering conference · doi:10.1145/1342211.1342234 · Cited by 170
Statistical entity-topic models
Newman, D. J., Chemudugunta, C., & Smyth, P. (2006) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/1150402.1150487 · Cited by 147
Asynchronous Distributed Learning of Topic Models
Smyth, P., Welling, M., & Asuncion, A. (2008) · Cited by 138
Self-citationA theory of aspects as latent topics
Baldi, P., Lopes, C. V., Linstead, E. J., et al. (2008) · ACM SIGPLAN Conference on Object-Oriented Programming, Systems, Languages, and Applications (OOPSLA) · doi:10.1145/1449764.1449807 · Cited by 127
Combining Probabilistic Ranking and Latent Semantic Indexing for Feature Identification
Poshyvanyk, D., Marcus, A., Rajlich, V., Guéhéneuc, Y., & Antoniol, G. (2006) · IEEE International Conference on Program Comprehension (ICPC) · doi:10.1109/icpc.2006.17 · Cited by 127
Mining concepts from code with probabilistic topic models
Linstead, E. J., Rigor, P., Bajracharya, S. K., et al. (2007) · doi:10.1145/1321631.1321709 · Cited by 106
Assessing IR-based traceability recovery tools through controlled experiments
Lucia, A. D., Oliveto, R., & Tortora, G. (2008) · Empirical Software Engineering · doi:10.1007/s10664-008-9090-8 · Cited by 82
Recovering and using use-case-diagram-to-source-code traceability links
Grechanik, M., McKinley, K. S., & Perry, D. E. (2007) · doi:10.1145/1287624.1287640 · Cited by 71
On the role of the nouns in IR-based traceability recovery
Capobianco, G., Lucia, A. D., Oliveto, R., Panichella, A., & Panichella, S. (2009) · IEEE International Conference on Program Comprehension (ICPC) · doi:10.1109/icpc.2009.5090038 · Cited by 61
Bridging models across the software lifecycle
Medvidović, N., Grünbacher, P., Egyed, A. F., & BOEHM, B. W. (2003) · Journal of Systems and Software · doi:10.1016/s0164-1212(03)00063-3 · Cited by 50
ArchStudio 4: An Architecture-Based Meta-Modeling Environment
Dashofy, E. M., Asuncion, H., Hendrickson, S. A., Suryanarayana, G., Georgas, J. C., & Taylor, R. (2007) · ACM/IEEE International Conference on Software Engineering: Companion Proceedings (ICSE-Companion) · doi:10.1109/icsecompanion.2007.21 · Cited by 47
Self-citationAutomating Software Traceability in Very Small Companies: A Case Study and Lessons Learne
Neumuller, C., & Grünbacher, P. (2006) · IEEE/ACM International Conference on Automated Software Engineering (ASE) · doi:10.1109/ase.2006.25 · Cited by 39
Visual Support In Automated Tracing
Cleland‐Huang, J., & Habrat, R. (2007) · International Workshop on Requirements Engineering Visualization (REV) · doi:10.1109/rev.2007.7 · Cited by 29
Cited by
Latent Dirichlet allocation (LDA) and topic modeling: models, applications, a survey
Jelodar, H., Wang, Y., Yuan, C., Feng, X., Jiang, X., Li, Y., & Zhao, L. (2019) · Multimedia Tools and Applications · doi:10.1007/s11042-018-6894-4 · Cited by 1,961
Campbell, J. C., Hindle, A., & Stroulia, E. (2015) · The Art and Science of Analyzing Software Data · doi:10.1016/b978-0-12-411519-4.00006-9 · Cited by 344
Software traceability: trends and future directions
Cleland-Huang, J., Gotel, O. C. Z., Huffman Hayes, J., Mäder, P., & Zisman, A. (2014) · Future of Software Engineering Proceedings · doi:10.1145/2593882.2593891 · Cited by 309
“Latent Semantic Indexing [19] and Latent Dirichlet Allocation (LDA) [22, 6] were applied in an attempt to understand the semantics context of elements in the artifacts, thus leading to higher quality links.”
BackgroundMethodInfluentialA Neural Architecture for Generating Natural Language Descriptions from Source Code Changes
Loyola, P., Marrese-Taylor, E., & Matsuo, Y. (2017) · Proceedings of the 55th Annual Meeting of the Association for Computational Linguistics (Volume 2: Short Papers) · doi:10.18653/v1/p17-2045 · Cited by 128
Analyzing and mining a code search engine usage log
Bajracharya, S. K., & Lopes, C. V. (2012) · Empirical Software Engineering · doi:10.1007/s10664-010-9144-6 · Cited by 90
Metadata
- Authors
- Asuncion, H. U., Asuncion, A. U., & Taylor, R. N.
- Venue
- Proceedings of the 32nd ACM/IEEE International Conference on Software Engineering - Volume 1
- Publisher
- ACM
- Published
- 2010-05
- Pages
- 95-104
- OpenAlex
- W2140264852
- Cited by
- 321
- References
- 33
- FWCI
- 18.89
- Type
- conference paper
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.