The DOI matches its Crossref record; 39 of the 39 references it cites were found in a registry or an index.
What would users change in my app? summarizing app reviews for recommending software changes
Abstract
Mobile app developers constantly monitor feedback in user reviews with the goal of improving their mobile apps and better meeting user expectations. Thus, automated approaches have been proposed in literature with the aim of reducing the effort required for analyzing feedback contained in user reviews via automatic classification/prioritization according to specific topics. In this paper, we introduce SURF (Summarizer of User Reviews Feedback), a novel approach to condense the enormous amount of information that developers of popular apps have to manage due to user feedback received on a daily basis. SURF relies on a conceptual model for capturing user needs useful for developers performing maintenance and evolution tasks. Then it uses sophisticated summarisation techniques for summarizing thousands of reviews and generating an interactive, structured and condensed agenda of recommended software changes. We performed an end-to-end evaluation of SURF on user reviews of 17 mobile apps (5 of them developed by Sony Mobile), involving 23 developers and researchers in total. Results demonstrate high accuracy of SURF in summarizing reviews and the usefulness of the recommended changes. In evaluating our approach we found that SURF helps developers in better understanding user needs, substantially reducing the time required by developers compared to manually analyzing user (change) requests and planning future software changes.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
WordNet: a lexical database for English
Miller, G. A. (1995) · Communications of the ACM · doi:10.1145/219717.219748 · Cited by 14,015 · cited 3×
“Once the dictionaries were enriched with WordNet synonyms, one of the authors and an external validator (a software engineer with more than 6 years of industrial experience) separately assigned each sentence in T test (described in Section 2.1) to one or more of the 12 defined concepts.”
MethodInfluentialBaeza-Yates, R. A., & Ribeiro-Neto, B. A. (1999) · Cited by 11,505
An algorithm for suffix stripping
Porter, M. F. (1980) · Program · doi:10.1108/eb046814 · Cited by 8,096 · cited 2×
“As first step we stemmed each sentence using the Snowball Stemmer Algorithm [34] to reduce words to their root form.”
MethodThumbs up?: sentiment classification using machine learning techniques
Pang, B., Lee, L., & Vaithyanathan, S. (2002) · Proceedings of the ACL-02 conference on Empirical methods in natural language processing - EMNLP '02 · doi:10.3115/1118693.1118704 · Cited by 7,024
Verbs semantics and lexical selection
Wu, Z., & Palmer, M. (1994) · Proceedings of the 32nd annual meeting on Association for Computational Linguistics - · doi:10.3115/981732.981751 · Cited by 3,136
How Do Users Like This Feature? A Fine Grained Sentiment Analysis of App Reviews
Guzman, E., & Maalej, W. (2014) · 2014 IEEE 22nd International Requirements Engineering Conference (RE) · doi:10.1109/re.2014.6912257 · Cited by 590
User feedback in the appstore: An empirical study
Pagano, D., & Maalej, W. (2013) · 2013 21st IEEE International Requirements Engineering Conference (RE) · doi:10.1109/re.2013.6636712 · Cited by 540
AR-miner: mining informative reviews for developers from mobile app marketplace
Chen, N., Lin, J., Hoi, S. C. H., Xiao, X., & Zhang, B. (2014) · Proceedings of the 36th International Conference on Software Engineering · doi:10.1145/2568225.2568263 · Cited by 517
Towards automatically generating summary comments for Java methods
Sridhara, G., Hill, E., Muppaneni, D., Pollock, L., & Vijay-Shanker, K. (2010) · Proceedings of the IEEE/ACM international conference on Automated software engineering · doi:10.1145/1858996.1859006 · Cited by 514
How can i improve my app? Classifying user reviews for software maintenance and evolution
Panichella, S., Di Sorbo, A., Guzman, E., Visaggio, C. A., Canfora, G., & Gall, H. C. (2015) · 2015 IEEE International Conference on Software Maintenance and Evolution (ICSME) · doi:10.1109/icsm.2015.7332474 · Cited by 455
Self-citationBug report, feature request, or simply praise? On automatically classifying app reviews
Maalej, W., & Nabil, H. (2015) · 2015 IEEE 23rd International Requirements Engineering Conference (RE) · doi:10.1109/re.2015.7320414 · Cited by 453
What Do Mobile App Users Complain About?
Khalid, H., Shihab, E., Nagappan, M., & Hassan, A. E. (2015) · IEEE Software · doi:10.1109/ms.2014.50 · Cited by 414
On the Use of Automated Text Summarization Techniques for Summarizing Source Code
Haiduc, S., Aponte, J., Moreno, L., & Marcus, A. (2010) · 2010 17th Working Conference on Reverse Engineering · doi:10.1109/wcre.2010.13 · Cited by 408
Why people hate your app: making sense of user feedback in a mobile app store
Fu, B., Lin, J., Li, L., Faloutsos, C., Hong, J., & Sadeh, N. (2013) · Proceedings of the 19th ACM SIGKDD international conference on Knowledge discovery and data mining · doi:10.1145/2487575.2488202 · Cited by 370
Retrieving and analyzing mobile apps feature requests from online reviews
Iacob, C., & Harrison, R. (2013) · 2013 10th Working Conference on Mining Software Repositories (MSR) · doi:10.1109/msr.2013.6624001 · Cited by 333
Automatic generation of natural language summaries for Java classes
Moreno, L., Aponte, J., Sridhara, G., Marcus, A., Pollock, L., & Vijay-Shanker, K. (2013) · 2013 21st International Conference on Program Comprehension (ICPC) · doi:10.1109/icpc.2013.6613830 · Cited by 331
App StoreMining and Analysis: MSR for App Stores
Harman, M., Jia, Y., & Zhang, Y. (2012) · Cited by 235
Automatic documentation generation via source code summarization of method context
McBurney, P. W., & McMillan, C. (2014) · Proceedings of the 22nd International Conference on Program Comprehension · doi:10.1145/2597008.2597149 · Cited by 220
Summarizing software artifacts: a case study of bug reports
Rastkar, S., Murphy, G. C., & Murray, G. (2010) · Proceedings of the 32nd ACM/IEEE International Conference on Software Engineering - Volume 1 · doi:10.1145/1806799.1806872 · Cited by 190
The Impact of API Change- and Fault-Proneness on the User Ratings of Android Apps
Bavota, G., Linares-Vasquez, M., Bernal-Cardenas, C. E., Penta, M. D., Oliveto, R., & Poshyvanyk, D. (2015) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2014.2367027 · Cited by 186
User reviews matter! Tracking crowdsourced reviews to support evolution of successful apps
Palomba, F., Linares-Vasquez, M., Bavota, G., Oliveto, R., Di Penta, M., Poshyvanyk, D., & De Lucia, A. (2015) · 2015 IEEE International Conference on Software Maintenance and Evolution (ICSME) · doi:10.1109/icsm.2015.7332475 · Cited by 186
Factors Influncing Quality of Mobile Apps: Role of Mobile App Development Life Cycle
Inukollu, V. N. R., Keshamon, D. D., Kang, T., & Inukollu, M. (2014) · International Journal of Software Engineering & Applications · doi:10.5121/ijsea.2014.5502 · Cited by 179
Automatic Summarization of Bug Reports
Rastkar, S., Murphy, G. C., & Murray, G. (2014) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2013.2297712 · Cited by 178
"What Parts of Your Apps are Loved by Users?" (T)
Gu, X., & Kim, S. (2015) · 2015 30th IEEE/ACM International Conference on Automated Software Engineering (ASE) · doi:10.1109/ase.2015.57 · Cited by 159
The impact of test case summaries on bug fixing performance: an empirical investigation
Panichella, S., Panichella, A., Beller, M., Zaidman, A., & Gall, H. C. (2016) · ACM/IEEE International Conference on Software Engineering: Companion Proceedings (ICSE-Companion) · doi:10.1145/2884781.2884847 · Cited by 137
Self-citationRambow, O., Shrestha, L., Chen, J., & Lauridsen, C. (2004) · Human Language Technology Conference of the North American Chapter of the Association for Computational Linguistics (HLT-NAACL) · doi:10.3115/1613984.1614011 · Cited by 105
Mining source code descriptions from developer communications
Panichella, S., Aponte, J., Penta, M. D., Marcus, A., & Canfora, G. (2012) · IEEE International Conference on Program Comprehension (ICPC) · doi:10.1109/icpc.2012.6240510 · Cited by 91
Self-citationCODES: mining source code descriptions from developers discussions
Vassallo, C., Panichella, S., Penta, M. D., & Canfora, G. (2014) · International Conference on Program Comprehension · doi:10.1145/2597008.2597799 · Cited by 71
Self-citationFeature lifecycles as they spread, migrate, remain, and die in App Stores
Sarro, F., Al-Subaihin, A. A., Harman, M., Jia, Y., Martin, W., & Zhang, Y. (2015) · IEEE International Requirements Engineering Conference (RE) · doi:10.1109/re.2015.7320410 · Cited by 67
Identifying spam in the iOS app store
Chandy, R., & Gu, H. (2012) · doi:10.1145/2184305.2184317 · Cited by 64
Lightweight structural summarization as an aid to software evolution
Murphy, G. C., & Borning, A. H. (1996) · Cited by 62
Do Android users write about electric sheep? Examining consumer reviews in Google Play
Ha, E., & Wagner, D. (2013) · IEEE Consumer Communications and Networking Conference · doi:10.1109/ccnc.2013.6488439 · Cited by 55
Labeling source code with information retrieval methods: an empirical study
Lucia, A. D., Penta, M. D., Oliveto, R., Panichella, A., & Panichella, S. (2013) · Empirical Software Engineering · doi:10.1007/s10664-013-9285-5 · Cited by 52
Self-citationOnline Reviews as First Class Artifacts in Mobile App Development
Iacob, C., Harrison, R., & Faily, S. (2014) · Lecture notes of the Institute for Computer Sciences, Social Informatics and Telecommunications Engineering · doi:10.1007/978-3-319-05452-0_4 · Cited by 45
Facilitating developer-user interactions with mobile app review digests
Oh, J., Kim, D., Lee, U., Lee, J.-G., & Song, J. (2013) · CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA) · doi:10.1145/2468356.2468681 · Cited by 44
NIRMAL: Automatic identification of software relevant tweets leveraging language model
Sharma, A. B., Tian, Y., & Lo, D. (2015) · IEEE International Conference on Software Analysis, Evolution and Reengineering (SANER) · doi:10.1109/saner.2015.7081855 · Cited by 36
Automatic generation of descriptive summary comments for methods in object-oriented programs
Shanker, V. K., Pollock, L., & Sridhara, G. (2012) · Cited by 29
On Satisfying the Android OS Community: User Feedback Still Central to Developers' Portfolios
Licorish, S. A., Tahir, A., Bosu, M. F., & MacDonell, S. G. (2015) · Australasian Software Engineering Conference (ASWEC) · doi:10.1109/aswec.2015.19 · Cited by 17
User Feedback in Mobile Development
Krusche, S., & Bruegge, B. (2014) · International Workshop on Mobile Development Lifecycle · doi:10.1145/2688412.2688420 · Cited by 16
Cited by
Software Documentation Issues Unveiled
Aghajani, E., Nagy, C., Vega-Marquez, O. L., Linares-Vasquez, M., Moreno, L., Bavota, G., & Lanza, M. (2019) · 2019 IEEE/ACM 41st International Conference on Software Engineering (ICSE) · doi:10.1109/icse.2019.00122 · Cited by 195
Nicholas, J., Fogarty, A. S., Boydell, K., & Christensen, H. (2017) · Journal of Medical Internet Research · doi:10.2196/jmir.7273 · Cited by 158
Accessibility in Software Practice: A Practitioner’s Perspective
Bi, T., Xia, X., Lo, D., Grundy, J., Zimmermann, T., & Ford, D. (2022) · ACM Transactions on Software Engineering and Methodology · doi:10.1145/3503508 · Cited by 109
Automated reporting of GUI design violations for mobile apps
Moran, K., Li, B., Bernal-Cárdenas, C., Jelf, D., & Poshyvanyk, D. (2018) · Proceedings of the 40th International Conference on Software Engineering · doi:10.1145/3180155.3180246 · Cited by 101
“quickly to improve app quality [19, 20, 40, 41], (iii) frequent platform updates and API instability [15, 27, 28, 33] including changes in UI/UX design paradigms inducing the need for GUI re-designs (e.”
BackgroundA Survey of Performance Optimization for Mobile Applications
Hort, M., Kechagia, M., Sarro, F., & Harman, M. (2022) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2021.3071193 · Cited by 91
Metadata
- Authors
- Di Sorbo, A., Panichella, S., Alexandru, C. V., Shimagaki, J., Visaggio, C. A., Canfora, G., & Gall, H. C.
- Venue
- Proceedings of the 2016 24th ACM SIGSOFT International Symposium on Foundations of Software Engineering
- Publisher
- ACM
- Published
- 2016-11
- Pages
- 499-510
- OpenAlex
- W2547513165
- Cited by
- 294
- References
- 39
- FWCI
- 29.92
- Type
- conference paper
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.