The DOI matches its Crossref record; 43 of the 43 references it cites were found in a registry or an index.
How can i improve my app? Classifying user reviews for software maintenance and evolution
Open accessAbstract
App Stores, such as Google Play or the Apple Store, allow users to provide feedback on apps by posting review comments and giving star ratings. These platforms constitute a useful electronic mean in which application developers and users can productively exchange information about apps. Previous research showed that users feedback contains usage scenarios, bug reports and feature requests, that can help app developers to accomplish software maintenance and evolution tasks. However, in the case of the most popular apps, the large amount of received feedback, its unstructured nature and varying quality can make the identification of useful user feedback a very challenging task. In this paper we present a taxonomy to classify app reviews into categories relevant to software maintenance and evolution, as well as an approach that merges three techniques: (1) Natural Language Processing, (2) Text Analysis and (3) Sentiment Analysis to automatically classify app reviews into the proposed categories. We show that the combined use of these techniques allows to achieve better results (a precision of 75% and a recall of 74%) than results obtained using each technique individually (precision of 70% and a recall of 67%).
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
The Discovery of Grounded Theory: Strategies for Qualitative Research.
Wagner, H. R., Glaser, B. G., & Strauss, A. L. (1968) · Social Forces · doi:10.2307/2575405 · Cited by 46,361
(2003) · Journal of Machine Learning Research · doi:10.5555/944919.944937 · Cited by 32,337
Data Mining: Practical Machine Learning Tools and Techniques
(2011) · Elsevier eBooks · doi:10.1016/c2009-0-19715-5 · Cited by 25,437
Blei, D. M., Ng, A. Y., & Jordan, M. I. (2002) · Advances in Neural Information Processing Systems 14 · doi:10.7551/mitpress/1120.003.0082 · Cited by 12,223
Thumbs up?: sentiment classification using machine learning techniques
Pang, B., Lee, L., & Vaithyanathan, S. (2002) · Proceedings of the ACL-02 conference on Empirical methods in natural language processing - EMNLP '02 · doi:10.3115/1118693.1118704 · Cited by 7,024
Information Retrieval: Data Structures and Algorithms
Frakes, W. B., & Baeza-Yates, R. A. (1992) · Cited by 2,757
Generating Typed Dependency Parses from Phrase Structure Parses
de Marneffe, M.-C., MacCartney, B., & Manning, C. D. (2006) · Language Resources and Evaluation Conference (LREC) · doi:10.63317/3wtkaidk6ea8 · Cited by 2,258
A validation of object-oriented design metrics as quality indicators
Basili, V. R., Briand, L. C., & Melo, W. L. (1996) · IEEE Transactions on Software Engineering · doi:10.1109/32.544352 · Cited by 1,726
Statistical Comparisons of Classifiers over Multiple Data Sets
DemšarJanez (2006) · Journal of Machine Learning Research · doi:10.5555/1248547.1248548 · Cited by 1,074
How Do Users Like This Feature? A Fine Grained Sentiment Analysis of App Reviews
Guzman, E., & Maalej, W. (2014) · 2014 IEEE 22nd International Requirements Engineering Conference (RE) · doi:10.1109/re.2014.6912257 · Cited by 590
Self-citationRelEx—Relation extraction using dependency parse trees
Fundel, K., Küffner, R., & Zimmer, R. (2007) · Bioinformatics · doi:10.1093/bioinformatics/btl616 · Cited by 563
User feedback in the appstore: An empirical study
Pagano, D., & Maalej, W. (2013) · 2013 21st IEEE International Requirements Engineering Conference (RE) · doi:10.1109/re.2013.6636712 · Cited by 540
AR-miner: mining informative reviews for developers from mobile app marketplace
Chen, N., Lin, J., Hoi, S. C. H., Xiao, X., & Zhang, B. (2014) · Proceedings of the 36th International Conference on Software Engineering · doi:10.1145/2568225.2568263 · Cited by 517
What Do Mobile App Users Complain About?
Khalid, H., Shihab, E., Nagappan, M., & Hassan, A. E. (2015) · IEEE Software · doi:10.1109/ms.2014.50 · Cited by 414
Why people hate your app: making sense of user feedback in a mobile app store
Fu, B., Lin, J., Li, L., Faloutsos, C., Hong, J., & Sadeh, N. (2013) · Proceedings of the 19th ACM SIGKDD international conference on Knowledge discovery and data mining · doi:10.1145/2487575.2488202 · Cited by 370
Is it a bug or an enhancement?: a text-based approach to classify change requests
Antoniol, G., Ayari, K., Di Penta, M., Khomh, F., & Guéhéneuc, Y.-G. (2008) · Proceedings of the 2008 conference of the center for advanced studies on collaborative research meeting of minds - CASCON '08 · doi:10.1145/1463788.1463819 · Cited by 366
Retrieving and analyzing mobile apps feature requests from online reviews
Iacob, C., & Harrison, R. (2013) · 2013 10th Working Conference on Mining Software Repositories (MSR) · doi:10.1109/msr.2013.6624001 · Cited by 333
App store mining and analysis: MSR for app stores
Harman, M., Jia, Y., & Zhang, Y. (2012) · 2012 9th IEEE Working Conference on Mining Software Repositories (MSR) · doi:10.1109/msr.2012.6224306 · Cited by 254
App StoreMining and Analysis: MSR for App Stores
Harman, M., Jia, Y., & Zhang, Y. (2012) · Cited by 235
Analysis of user comments: An approach for software requirements evolution
Carreno, L. V. G., & Winbladh, K. (2013) · 2013 35th International Conference on Software Engineering (ICSE) · doi:10.1109/icse.2013.6606604 · Cited by 216
The Impact of API Change- and Fault-Proneness on the User Ratings of Android Apps
Bavota, G., Linares-Vasquez, M., Bernal-Cardenas, C. E., Penta, M. D., Oliveto, R., & Poshyvanyk, D. (2015) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2014.2367027 · Cited by 186
Inferring method specifications from natural language API descriptions
Pandita, R., Xiao, X., Zhong, H., Xie, T., Oney, S., & Paradkar, A. M. (2012) · ACM/IEEE International Conference on Software Engineering: Companion Proceedings (ICSE-Companion) · doi:10.1109/icse.2012.6227137 · Cited by 186
A large-scale sentiment analysis for Yahoo! answers
Küçüktunç, O., Cambazoglu, B. B., Weber, I. G., & Ferhatosmanoğlu, H. (2012) · ACM International Conference on Web Search and Data Mining (WSDM) · doi:10.1145/2124295.2124371 · Cited by 183
Combining text mining and data mining for bug report classification
Zhou, Y., Tong, Y., Gu, R., & Gall, H. (2016) · Journal of Software: Evolution and Process · doi:10.1002/smr.1770 · Cited by 169
Self-citationCommunication in open source software development mailing lists
Guzzi, A., Bacchelli, A., Lanza, M., Pinzger, M., & van Deursen, A. (2013) · International Conference on Mining Software Repositories (MSR) · doi:10.1109/msr.2013.6624039 · Cited by 163
Evolutionary Optimization of Software Quality Modeling with Multiple Repositories
Liu, Y., Khoshgoftaar, T. M., & Seliya, N. (2010) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2010.51 · Cited by 152
Parsing to Stanford Dependencies: Trade-offs between Speed and Accuracy
Cer, D. M., de Marneffe, M.-C., Jurafsky, D., & Manning, C. D. (2010) · Language Resources and Evaluation Conference (LREC) · doi:10.63317/3aixhxswiwe3 · Cited by 127
Inferring method specifications from natural language API descriptions
Pandita, R., Xiao, X., Zhong, H., et al. (2012) · doi:10.5555/2337223.2337319 · Cited by 116
Content classification of development emails
Bacchelli, A., Sasso, T. D., D’Ambros, M., & Lanza, M. (2012) · ACM/IEEE International Conference on Software Engineering: Companion Proceedings (ICSE-Companion) · doi:10.1109/icse.2012.6227177 · Cited by 102
Mining source code descriptions from developer communications
Panichella, S., Aponte, J., Penta, M. D., Marcus, A., & Canfora, G. (2012) · IEEE International Conference on Program Comprehension (ICPC) · doi:10.1109/icpc.2012.6240510 · Cited by 91
Self-citationIs it a bug or an enhancement?: a text-based approach to classify change requests
Guéhéneuc, Y. (2008) · Cited by 84
Software Defect Identification Using Machine Learning Techniques
Ceylan, E., Kutlubay, F. O., & Bener, A. (2006) · Euromicro Conference on Software Engineering and Advanced Applications (SEAA) · doi:10.1109/euromicro.2006.56 · Cited by 73
Content Classification of Development Emails
Bacchelli, A., Sasso, T. D., & Lanza, M. (2013) · Cited by 72
CODES: mining source code descriptions from developers discussions
Vassallo, C., Panichella, S., Penta, M. D., & Canfora, G. (2014) · International Conference on Program Comprehension · doi:10.1145/2597008.2597799 · Cited by 71
Self-citationRecommending reference API documentation
Robillard, M. P., & Chhetri, Y. B. (2014) · Empirical Software Engineering · doi:10.1007/s10664-014-9323-y · Cited by 68
Identifying spam in the iOS app store
Chandy, R., & Gu, H. (2012) · doi:10.1145/2184305.2184317 · Cited by 64
Predicting defects with program dependencies
Zimmermann, T., & Nagappan, N. (2009) · Proceedings of the ... ACM-IEEE International Symposium on Empirical Software Engineering and Measurement/International Symposium on Empirical Software Engineering and Measurement · doi:10.1109/esem.2009.5316024 · Cited by 55
Evaluation of Dependency Parsers on Unbounded Dependencies
Nivre, J., Rimell, L., McDonald, R., & Gómez‐Rodríguez, C. (2010) · Cited by 53
A user satisfaction analysis approach for software evolution
Li, H., Li, Z., Li, Z., & Shen, J. (2010) · IEEE International Conference on Progress in Informatics and Computing · doi:10.1109/pic.2010.5687999 · Cited by 53
Combining Text Mining and Data Mining for Bug Report Classification
Zhou, Y., Tong, Y., Gu, R., & Gall, H. C. (2014) · IEEE International Conference on Software Maintenance (ICSM) · doi:10.1109/icsme.2014.53 · Cited by 52
Self-citationNIRMAL: Automatic identification of software relevant tweets leveraging language model
Sharma, A. B., Tian, Y., & Lo, D. (2015) · IEEE International Conference on Software Analysis, Evolution and Reengineering (SANER) · doi:10.1109/saner.2015.7081855 · Cited by 36
A Constructive RBF Neural Network for Estimating the Probability of Defects in Software Modules
Bezerra, M. E. R., Oliveira, A. L. I., & Meira, S. R. L. (2007) · IEEE International Conference on Neural Networks/IEEE ... International Conference on Neural Networks · doi:10.1109/ijcnn.2007.4371415 · Cited by 27
Facilitating enterprise software developer communication with CARES
Guzzi, A., Begel, A., Miller, J. K., & Nareddy, K. (2012) · IEEE International Conference on Software Maintenance (ICSM) · doi:10.1109/icsm.2012.6405317 · Cited by 11
Cited by
A Survey of App Store Analysis for Software Engineering
Martin, W., Sarro, F., Jia, Y., Zhang, Y., & Harman, M. (2017) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2016.2630689 · Cited by 459
“[178] presented a system for automatically classifying user reviews based on a predetermined taxonomy, in order to support software maintenance and requirements evolution.”
MethodA systematic literature review: Opinion mining studies from mobile app store user reviews
Genc-Nayebi, N., & Abran, A. (2017) · Journal of Systems and Software · doi:10.1016/j.jss.2016.11.027 · Cited by 358
What would users change in my app? summarizing app reviews for recommending software changes
Di Sorbo, A., Panichella, S., Alexandru, C. V., Shimagaki, J., Visaggio, C. A., Canfora, G., & Gall, H. C. (2016) · Proceedings of the 2016 24th ACM SIGSOFT International Symposium on Foundations of Software Engineering · doi:10.1145/2950290.2950299 · Cited by 294
Self-citationRelease planning of mobile apps based on user reviews
Villarroel, L., Bavota, G., Russo, B., Oliveto, R., & Di Penta, M. (2016) · Proceedings of the 38th International Conference on Software Engineering · doi:10.1145/2884781.2884818 · Cited by 261
Ensemble Methods for App Review Classification: An Approach for Software Evolution (N)
Guzman, E., El-Haliby, M., & Bruegge, B. (2015) · 2015 30th IEEE/ACM International Conference on Automated Software Engineering (ASE) · doi:10.1109/ase.2015.88 · Cited by 143
Metadata
- Authors
- Panichella, S., Di Sorbo, A., Guzman, E., Visaggio, C. A., Canfora, G., & Gall, H. C.
- Venue
- 2015 IEEE International Conference on Software Maintenance and Evolution (ICSME)
- Publisher
- IEEE
- Published
- 2015-09
- Pages
- 281-290
- OpenAlex
- W2126574721
- Cited by
- 455
- References
- 43
- FWCI
- 30.99
- Type
- conference paper
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.