A Survey of App Store Analysis for Software Engineering
Open accessThe DOI matches its Crossref record; 247 of the 257 references it cites were found in a registry or an index.
Abstract
App Store Analysis studies information about applications obtained from app stores. App stores provide a wealth of information derived from users that would not exist had the applications been distributed via previous software deployment methods. App Store Analysis combines this non-technical information with technical information to learn trends and behaviours within these forms of software repositories. Findings from App Store Analysis have a direct and actionable impact on the software teams that develop software for app stores, and have led to techniques for requirements engineering, release planning, software design, security and testing. This survey describes and compares the areas of research that have been explored thus far, drawing out common aspects, trends and directions future research should take to address open problems and challenges.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“differently from iOS, accessibility work in Android apps is very limited (Martin et al. 2016; Yan and Ramachandran 2019)”
From The making of accessible Android applications: an empirical study on the state of the practice (2022) · cites this paper as Martin et al. 2016
Citations
Cites
Friedman, N., Geiger, D., & Goldszmidt, M. (1997) · Machine Learning · doi:10.1023/a:1007465528199 · Cited by 4,742 · cited 1×
“93 using the Bayesian TAN classifier [67].”
Wohlin, C. (2014) · Proceedings of the 18th International Conference on Evaluation and Assessment in Software Engineering · doi:10.1145/2601248.2601268 · Cited by 4,234 · cited 1×
“2, we also perform snowballing [244] on many of the included studies.”
Optimizing Semantic Coherence in Topic Models
Mimno, D., Wallach, H., Talley, E. M., Leenders, M., & McCallum, A. (2011) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · Cited by 2,492
Drebin: Effective and Explainable Detection of Android Malware in Your Pocket
Arp, D., Spreitzenbarth, M., Hübner, M., Gascon, H., & Rieck, K. (2014) · Proceedings 2014 Network and Distributed System Security Symposium · doi:10.14722/ndss.2014.23247 · Cited by 2,331
TaintDroid: an information-flow tracking system for realtime privacy monitoring on smartphones
Enck, W., Gilbert, P., Chun, B.-G., Cox, L. P., Jung, J., McDaniel, P. D., & Sheth, A. N. (2010) · doi:10.5555/1924943.1924971 · Cited by 2,238
Dissecting Android Malware: Characterization and Evolution
Zhou, Y., & Jiang, X. (2012) · 2012 IEEE Symposium on Security and Privacy · doi:10.1109/sp.2012.16 · Cited by 2,133
Understanding inverse document frequency: on theoretical arguments for IDF
Robertson, S. (2004) · Journal of Documentation · doi:10.1108/00220410410560582 · Cited by 1,541 · cited 1×
“They trained the classifier using a support vector machine for each of 50 classes, and used the BM25 weighting scheme [190] on the features.”
MethodArzt, S., Rasthofer, S., Fritz, C., Bodden, E., Bartel, A., Klein, J., Le Traon, Y., Octeau, D., & McDaniel, P. (2014) · Proceedings of the 35th ACM SIGPLAN Conference on Programming Language Design and Implementation · doi:10.1145/2594291.2594299 · Cited by 1,396 · cited 1×
“[1, 10) 19 [104, 105) 39 [10, 102) 21 [105, 106) 28 [102, 103) 31 ≥ 106 3”
One-class svms for document classification
Manevitz, L. M., & Yousef, M. (2002) · doi:10.5555/944790.944808 · Cited by 1,207
On lightweight mobile phone application certification
Enck, W., Ongtang, M., & McDaniel, P. (2009) · Proceedings of the 16th ACM conference on Computer and communications security · doi:10.1145/1653662.1653691 · Cited by 921 · cited 1×
“[60] introduced Kirin, an Android app certification tool for flagging potential malware using a set of rules.”
Method
Research works printed but not linked: 4
- mutchler, 2015, A large-scale study of mobile web app security, Proc Workshop Mobile Secur Technol (MoST), 1
- preuss, 2013, Mobile applications, function points and cost estimating, Proc Int Cost Estimation Anal Assoc Conf
- gibler, 2013, Adrob: Examining the landscape and impact of Android application plagiarism, Proc 11th Annu Int Conf Mobile Syst Appl Serv, 431
- galvis carreño, 2013, Analysis of user comments: An approach for software requirements evolution, Proc Int Conf Softw Eng, 582
Cited by
Large language models for software engineering: survey and open problems
Fan, A., Gokkaya, B., Harman, M., Lyubarskiy, M., Sengupta, S., Yoo, S., & Zhang, J. M. (2023) · 2023 IEEE/ACM International Conference on Software Engineering: Future of Software Engineering (ICSE-FoSE) · doi:10.1109/icse-fose59343.2023.00008 · Cited by 650
“The large amount of software artefact information publicly available online has stimulated the growth of scientific insights gained by Mining Software Repositories (MSR) [192], [193].”
BackgroundSelf-citationLarge Language Models for Software Engineering: Survey and Open Problems
Fan, A., Gokkaya, B., Harman, M., Lyubarskiy, M., Sengupta, S., Yoo, S., & Zhang, J. M. (2023) · arXiv · doi:10.48550/arxiv.2310.03533 · Cited by 523
“The large amount of software artefact information publicly available online has stimulated the growth of scientific insights gained by Mining Software Repositories (MSR) [192], [193].”
BackgroundSelf-citationA systematic literature review: Opinion mining studies from mobile app store user reviews
Genc-Nayebi, N., & Abran, A. (2017) · Journal of Systems and Software · doi:10.1016/j.jss.2016.11.027 · Cited by 358
Static analysis of android apps: A systematic literature review
Li, L., Bissyandé, T. F., Papadakis, M., Rasthofer, S., Bartel, A., Octeau, D., Klein, J., & Traon, L. (2017) · Information and Software Technology · doi:10.1016/j.infsof.2017.04.001 · Cited by 350
“[187] produced a technical report that reviews the state-of-the-art works on app store analysis in the software engineering field.”
BackgroundNatural Language Processing for Requirements Engineering: A Systematic Mapping Study
Zhao, L., Alhoshan, W., Ferrari, A., Letsholo, K. J., Ajagbe, M. A., Chioasca, E.-V., & Batista-Navarro, R. T. (2022) · ACM Computing Surveys · doi:10.1145/3444689 · Cited by 322
Ampatzoglou, A., Bibi, S., Avgeriou, P., Verbeek, M., & Chatzigeorgiou, A. (2019) · Information and Software Technology · doi:10.1016/j.infsof.2018.10.006 · Cited by 305
Marketing research on Mobile apps: past, present and future
Stocchi, L., Pourazad, N., Michaelidou, N., Tanusondjaja, A., & Harrigan, P. (2022) · Journal of the Academy of Marketing Science · doi:10.1007/s11747-021-00815-w · Cited by 243
Bias Mitigation for Machine Learning Classifiers: A Comprehensive Survey
Hort, M., Chen, Z., Zhang, J. M., Harman, M., & Sarro, F. (2022) · arXiv · doi:10.48550/arxiv.2207.07068 · Cited by 222
“To ensure that irrelevant publications are excluded from the search results, we manually check publications in three stages [251]:”
BackgroundSelf-citationBias Mitigation for Machine Learning Classifiers: A Comprehensive Survey
Hort, M., Chen, Z., Zhang, J. M., Harman, M., & Sarro, F. (2024) · ACM Journal on Responsible Computing · doi:10.1145/3631326 · Cited by 219
“To ensure that irrelevant publications are excluded from the search results, we manually check publications in three stages [251]:”
BackgroundSelf-citationAutomated Testing of Android Apps: A Systematic Literature Review
Kong, P., Li, L., Gao, J., Liu, K., Bissyande, T. F., & Klein, J. (2019) · IEEE Transactions on Reliability · doi:10.1109/tr.2018.2865733 · Cited by 218
Rise of the Planet of Serverless Computing: A Systematic Review
Wen, J., Chen, Z., Jin, X., & Liu, X. (2023) · ACM Transactions on Software Engineering and Methodology · doi:10.1145/3579643 · Cited by 188
“These can explain why almost all the recent surveys [133, 166, 184, 189, 200] also use manual construction.”
BackgroundAutomatic Classification of Non-Functional Requirements from Augmented App User Reviews
Lu, M., & Liang, P. (2017) · Proceedings of the 21st International Conference on Evaluation and Assessment in Software Engineering · doi:10.1145/3084226.3084241 · Cited by 177
“In recent years, App Store analysis has become a popular topic in software engineering [28], and users can easily submit their feedback about the Apps they used in App platforms.”
BackgroundQi, L., Lin, W., Zhang, X., Dou, W., Xu, X., & Chen, J. (2022) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2022.3168611 · Cited by 176
“In recent years, various Web APIs sharing communities are emerging rapidly (e.g., APP Store [19] and Google Code [20]), which significantly benefits Web APIs query, invocation and feedback.”
BackgroundSAFE: A Simple Approach for Feature Extraction from App Descriptions and App Reviews
Johann, T., Stanik, C., B., A. M. A., & Maalej, W. (2017) · IEEE International Requirements Engineering Conference (RE) · doi:10.1109/re.2017.71 · Cited by 175
“Martin et al. [22] conducted a systematic literature review on app store analysis.”
BackgroundMethodInfluentialAnalyzing reviews and code of mobile apps for better release planning
Ciurumelea, A., Schaufelbuhl, A., Panichella, S., & Gall, H. C. (2017) · IEEE International Conference on Software Analysis, Evolution and Reengineering (SANER) · doi:10.1109/saner.2017.7884612 · Cited by 185
“The ease of distribution and the large number of potential users, has made mobile applications development an attractive field for software engineers, but has also led to an increasing competition between developers [3] [4].”
BackgroundRecommending and Localizing Change Requests for Mobile Apps Based on User Reviews
Palomba, F., Salza, P., Ciurumelea, A., Panichella, S., Gall, H., Ferrucci, F., & de Lucia, A. (2017) · International Conference on Software Engineering · doi:10.1109/icse.2017.18 · Cited by 169
“The interested reader can find a comprehensive literature review in the work by Martin et al. [26].”
BackgroundFrom Start-ups to Scale-ups: Opportunities and Open Problems for Static and Dynamic Program Analysis
Harman, M., & O'Hearn, P. (2018) · 2018 IEEE 18th International Working Conference on Source Code Analysis and Manipulation (SCAM) · doi:10.1109/scam.2018.00009 · Cited by 151
“Many systems, such as those typically deployed through app stores, for example [94], have ample mechanisms for users to report bugs, and most practicing developers are typically overwhelmed by such lists; their most pressing problem is not simply finding more bugs; their problem is more nuanced.”
BackgroundSelf-citationDetecting missing information in bug descriptions
Chaparro, O., Lu, J. J., Zampetti, F., Moreno, L., Penta, M. D., Marcus, A., Bavota, G., & Ng, V. (2017) · ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering (ESEC/FSE) · doi:10.1145/3106237.3106285 · Cited by 160
“Similar approaches have been proposed to classify e-mails [27], app reviews [48], forums [75], explanations of APIs in tutorials [56], and, outside SE, discourse elements in essays [20, 21].”
BackgroundAn empirical study of game reviews on the Steam platform
Lin, D., Bezemer, C., Zou, Y., & Hassan, A. E. (2018) · Empirical Software Engineering · doi:10.1007/s10664-018-9627-4 · Cited by 160
“[32] surveyed the field of app store analysis for software engineering.”
BackgroundMobile applications in crisis informatics literature: A systematic review
Tan, M. L., Prasanna, R., Stock, K. M., Doyle, E. E. H., Leonard, G. S., & Johnston, D. M. (2017) · International Journal of Disaster Risk Reduction · doi:10.1016/j.ijdrr.2017.06.009 · Cited by 164
CiD: automating the detection of API-related compatibility issues in Android apps
Li, L., Bissyandé, T. F., Wang, H., & Klein, J. (2018) · ACM SIGSOFT International Symposium on Software Testing and Analysis (ISSTA) · doi:10.1145/3213846.3213857 · Cited by 166
“API evolution is an important aspect of software maintenance [24, 25].”
BackgroundArchetypes of incumbents’ strategic responses to digital innovation
D’Ippolito, B., Petruzzelli, A. M., & Panniello, U. (2019) · Journal of Intellectual Capital · doi:10.1108/jic-04-2019-0065 · Cited by 154
Towards understanding and detecting fake reviews in app stores
Martens, D., & Maalej, W. (2019) · Empirical Software Engineering · doi:10.1007/s10664-019-09706-9 · Cited by 137
Online app review analysis for identifying emerging issues
Gao, C., Zeng, J., Lyu, M. R.-T., & King, I. (2018) · ACM/IEEE International Conference on Software Engineering: Companion Proceedings (ICSE-Companion) · doi:10.1145/3180155.3180218 · Cited by 146
“Some previous work [12, 20] focuses on identifying users’ major concerns or preferences from app reviews [28].”
BackgroundAnalysing app reviews for software engineering: a systematic literature review
Dąbrowski, J., Letier, E., Perini, A., & Susi, A. (2022) · Empirical Software Engineering · doi:10.1007/s10664-021-10065-7 · Cited by 186
“4We identified papers from previous surveys on app store analysis (Martin et al. 2017).”
BackgroundMethodInfluentialTran, S., Smith, L., El-Den, S., & Carter, S. (2022) · JMIR mHealth and uHealth · doi:10.2196/30671 · Cited by 121
“More recently, with the increasing penetration rate of smartphones and digital literacy globally, there has been rapid progress by the public and private health sectors to take advantage of mobile apps to address public health concerns [5].”
BackgroundA Needle in a Haystack: What Do Twitter Users Say about Software?
Guzmán, E., Alkadhi, R., & Seyff, N. (2016) · IEEE International Requirements Engineering Conference (RE) · doi:10.1109/re.2016.67 · Cited by 140
A Little Bird Told Me: Mining Tweets for Requirements and Software Evolution
Guzmán, E., Ibrahim, M. H., & Glinz, M. (2017) · IEEE International Requirements Engineering Conference (RE) · doi:10.1109/re.2017.88 · Cited by 138
“[11] survey the most relevant work in the area.”
BackgroundARdoc: app reviews development oriented classifier
Panichella, S., Sorbo, A. D., Guzmán, E., Visaggio, C. A., Canfora, G., & Gall, H. C. (2016) · ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering (ESEC/FSE) · doi:10.1145/2950290.2983938 · Cited by 138
“…work [1–3] demonstrated that approximately one third of the information contained in user reviews is relevant to guide app developers in accomplishing software maintenance and evolution tasks (e.g. requests of implementation of new features, descriptions of bugs, users’ feedback about specific…”
BackgroundMining non-functional requirements from App store reviews
Jha, N. N., & Mahmoud, A. (2019) · Empirical Software Engineering · doi:10.1007/s10664-019-09716-7 · Cited by 130
“Both algorithms have been extensively used in related literature to extract and classify user reviews (Mcllroy et al. 2016; Panichella et al. 2015; Maalej and Nabil 2015; Jha and Mahmoud 2017a).”
BackgroundMethodInfluentialCatalog of energy patterns for mobile applications
Cruz, L., & Abreu, R. (2019) · Empirical Software Engineering · doi:10.1007/s10664-019-09682-0 · Cited by 128
“Based on previous guidelines for app store analyses (Martin et al., 2017), we describe ours as follows to help repeat the experimental procedure and reproduce the results:”
MethodInfluentialUnderstanding the quality, effectiveness and attributes of top-rated smartphone health apps
Wisniewski, H., Liu, G., Henson, P., Vaidyam, A., Hajratalli, N. K., Onnela, J.-P., & Torous, J. (2019) · Evidence Based Mental Health · doi:10.1136/ebmental-2018-300069 · Cited by 112
“14 This suggests that research collaboration between the healthcare and software engineering fields could help to further our knowledge of app functionality and effectiveness.”
Data-Driven Web APIs Recommendation for Building Web Applications
Qi, L., He, Q., Chen, F., Zhang, X., Dou, W., & Ni, Q. (2020) · IEEE Transactions on Big Data · doi:10.1109/tbdata.2020.2975587 · Cited by 121
“on software engineering since the appearance of centralized online software repositories, such as app stores [28], Source-”
BackgroundData-Driven Requirements Elicitation: A Systematic Literature Review
Lim, S., Henriksson, A., & Zdravković, J. (2021) · SN Computer Science · doi:10.1007/s42979-020-00416-4 · Cited by 111
Lightweight detection of Android-specific code smells: The aDoctor project
Palomba, F., Nucci, D. D., Panichella, A., Zaidman, A., & Lucia, A. D. (2017) · IEEE International Conference on Software Analysis, Evolution and Reengineering (SANER) · doi:10.1109/saner.2017.7884659 · Cited by 129
“In this context, a set of new peculiar bad programming practices of Android developers has been defined by Reimann et al. [18].”
BackgroundStudying the dialogue between users and developers of free apps in the Google Play Store
Hassan, S., Tantithamthavorn, C., Bezemer, C.-P., & Hassan, A. E. (2018) · Empirical Software Engineering · doi:10.1007/s10664-017-9538-9 · Cited by 100
App Store Effects on Software Engineering Practices
Al-Subaihin, A. A., Sarro, F., Black, S., Capra, L., & Harman, M. (2019) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2019.2891715 · Cited by 115
“problems for different software engineering activities [1].”
BackgroundSelf-citationToo Many User-Reviews! What Should App Developers Look at First?
Noei, E., Zhang, F., & Zou, Y. (2019) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2019.2893171 · Cited by 93
“reviews and classify them into meaningful groups [12].”
BackgroundOpinion Mining for Software Development: A Systematic Literature Review
Lin, B., Cassee, N., Serebrenik, A., Bavota, G., Novielli, N., & Lanza, M. (2022) · ACM Transactions on Software Engineering and Methodology · doi:10.1145/3490388 · Cited by 120
“While all these studies cover various topics of opinion mining in software development, they have a focus on very specific areas, such as emotions [184, 210], sentiment polarity [184], app review analysis [74, 158, 230], and requirements engineering [163, 240].”
BackgroundA Survey of Performance Optimization for Mobile Applications
Hort, M., Kechagia, M., Sarro, F., & Harman, M. (2022) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2021.3071193 · Cited by 91
“…assesses whether the publications satisfy our inclusion criteria, we manually examined every publication using the process adopted by Martin et al. [43], as follows: 1) Title: First, all those publications whose title clearly does not match our inclusion criteria are excluded; 2) Abstract: Second,…”
MethodSelf-citationApp store mining is not enough for app improvement
Nayebi, M., Cho, H., & Ruhe, G. (2018) · Empirical Software Engineering · doi:10.1007/s10664-018-9601-1 · Cited by 89
“The app store is used to collect reviews and user meta-data to analyze how to enhance the apps (Martin et al. 2016).”
InfluentialClustering Mobile Apps Based on Mined Textual Features
Al-Subaihin, A. A., Sarro, F., Black, S., Capra, L., Harman, M., Jia, Y., & Zhang, Y. (2016) · Proceedings of the ... ACM-IEEE International Symposium on Empirical Software Engineering and Measurement/International Symposium on Empirical Software Engineering and Measurement · doi:10.1145/2961111.2962600 · Cited by 98
Self-citationLarge Language Model Supply Chain: A Research Agenda
Wang, S., Zhao, Y., Hou, X., & Wang, H. (2025) · ACM Transactions on Software Engineering and Methodology · doi:10.1145/3708531 · Cited by 125
RE-BERT: automatic extraction of software requirements from app reviews using BERT language model
Araújo, A. F. D., & Marcacini, R. M. (2021) · ACM Symposium on Applied Computing · doi:10.1145/3412841.3442006 · Cited by 80
“ERS approaches, proposed to minimize these problems, explore opinion mining from app reviews to automatically extract software requirements [7, 8, 10, 17].”
BackgroundInfluentialFinkelstein, A., Harman, M., Jia, Y., Martin, W., Sarro, F., & Zhang, Y. (2017) · Information and Software Technology · doi:10.1016/j.infsof.2017.03.002 · Cited by 80
“Though there has been previous work on app store analysis [6] , Harman et al. [1] were the first to analyse the features extracted from app descriptions and their relationship to non-technical information.”
Self-citationGrey Literature in Software Engineering: A critical review
Kamei, F., Wiese, I., Lima, C., Polato, I., Nepomuceno, V., Ferreira, W., Ribeiro, M., Pena, C., Cartaxo, B., Pinto, G., et al. (2021) · Information and Software Technology · doi:10.1016/j.infsof.2021.106609 · Cited by 94
Diversified Third-Party Library Prediction for Mobile App Development
He, Q., Li, B., Chen, F., Grundy, J., Xia, X., & Yang, Y. J. (2020) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2020.2982154 · Cited by 89
Definition and Categorization of
Wang, Y. (2016) · RonPub -- Research Online Publishing (RonPub UG) · Cited by 78
Container Technologies for ARM Architecture: A Comprehensive Survey of the State-of-the-Art
Kaiser, S., Haq, M. S., Tosun, A. Ş., & Korkmaz, T. (2022) · IEEE Access · doi:10.1109/access.2022.3197151 · Cited by 75
An exploratory study of Twitter messages about software applications
Guzmán, E., Alkadhi, R., & Seyff, N. (2017) · Requirements Engineering · doi:10.1007/s00766-017-0274-x · Cited by 76
“[41] presented a survey in which they investigate the automatic analysis of user feedback present in mobile distribution platforms.”
BackgroundCausal impact analysis for app releases in google play
Martin, W., Sarro, F., & Harman, M. (2016) · Proceedings of the 2016 24th ACM SIGSOFT International Symposium on Foundations of Software Engineering · doi:10.1145/2950290.2950320 · Cited by 71
“For an overview of app store analysis literature, we point the reader to our survey on app store analysis for software engineering [26].”
MethodSelf-citationAndroid apps and user feedback: a dataset for software evolution and quality improvement
Grano, G., Sorbo, A. D., Mercaldo, F., Visaggio, C. A., Canfora, G., & Panichella, S. (2017) · doi:10.1145/3121264.3121266 · Cited by 69
“Mobile app stores, such as Google Play and Apple App Store, represent a rich source of information for software engineering researchers and developers interested in better understanding how mobile software is created and maintained [9], since these markets provide an open access to huge numbers of software application…”
BackgroundApproaches for prioritizing feature improvements extracted from app reviews
Keertipati, S., Savarimuthu, B. T. R., & Licorish, S. A. (2016) · International Conference on Evaluation and Assessment in Software Engineering (EASE) · doi:10.1145/2915970.2916003 · Cited by 67
“We constructed a dictionary containing the modal verb phrases for prohibitions and obligations respectively.”
MethodUnderstanding the Evolution of Android App Vulnerabilities
Gao, J., Li, L., Kong, P., Bissyandé, T. F., & Klein, J. (2019) · IEEE Transactions on Reliability · doi:10.1109/tr.2019.2956690 · Cited by 77
“Considering that many of the vulnerabilities described above have been, at some periods, trending topics in the research community [61], [62], [63], [64], [65], we investigate whether they actually correspond to isolated issues in time 10 .”
BackgroundGUIGAN: Learning to Generate GUI Designs Using Generative Adversarial Networks
Zhao, T., Chen, C., Liu, Y., & Zhu, X. (2021) · ACM/IEEE International Conference on Software Engineering: Companion Proceedings (ICSE-Companion) · doi:10.1109/icse43902.2021.00074 · Cited by 91
“Therefore, many researchers are working on assisting designers in the GUI design such as investigating the UI design patterns [45], color evolution [46], [47], Ul-related users’ review [48], [49], GUI code generation [13], website GUI generation [21], etc.”
BackgroundUnderstanding the Security Risks of Docker Hub
Liu, P., Ji, S., Fu, L., Lu, K., Zhang, X., Lee, W.-H., Lu, T., Chen, W., & Beyah, R. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-58951-6_13 · Cited by 63
Hadi, M. A., & Fard, F. H. (2023) · Empirical Software Engineering · doi:10.1007/s10664-023-10314-x · Cited by 71
“These models are selected as they are available and open source, adopted in other studies (Panichella et al. 2015; Villarroel et al. 2016; Di Sorbo et al. 2016; Bavota et al. 2015; Palomba et al. 2015, 2017; Bakiu and Guzman 2017; Martin et al. 2017; Guzman et al. 2016; Ciurumelea et al. 2017; Guzman et al. 2017b; Ali…”
MethodGiordan, L. B., Tong, H. L., Atherton, J. J., Ronto, R., Chau, J. Y., Kaye, D. M., Shaw, T. J., Chow, C. K., & Laranjo, L. (2022) · JMIR Cardio · doi:10.2196/33839 · Cited by 67
“The search was limited from 2008 onward as app stores were launched in that year [31].”
BackgroundPredicting Crashing Releases of Mobile Applications
Xia, X., Shihab, E., Kamei, Y., Lo, D., & Wang, X. (2016) · Proceedings of the ... ACM-IEEE International Symposium on Empirical Software Engineering and Measurement/International Symposium on Empirical Software Engineering and Measurement · doi:10.1145/2961111.2962606 · Cited by 68
“perform a comprehensive survey on app store analysis for software engineering [33].”
Tavakoli, M. A., Zhao, L., Heydari, A., & Nenadić, G. (2018) · Expert Systems with Applications · doi:10.1016/j.eswa.2018.05.037 · Cited by 72
How Should I Improve the UI of My App? A Study of User Reviews of Popular Apps in the Google Play
Chen, Q., Chen, C., Hassan, S., Xing, Z., Xia, X., & Hassan, A. E. (2021) · ACM Transactions on Software Engineering and Methodology · doi:10.1145/3447808 · Cited by 76
“Prior work analyzes user reviews to extract useful information such as complaints and feature requests [23, 35–37, 41–43, 54, 59, 60, 71, 87].”
MethodAccessing Inaccessible Android APIs: An Empirical Study
Li, L., Bissyandé, T. F., Traon, Y. L., & Klein, J. (2016) · IEEE International Conference on Software Maintenance (ICSM) · doi:10.1109/icsme.2016.35 · Cited by 73
An empirical study of early access games on the Steam platform
Lin, D., Bezemer, C., & Hassan, A. E. (2017) · Empirical Software Engineering · doi:10.1007/s10664-017-9531-3 · Cited by 60
“Martin et al. (2016) survey the field of app store analysis within a software engineering context.”
BackgroundCustomer Rating Reactions Can Be Predicted Purely using App Features
Sarro, F., Harman, M., Jia, Y., & Zhang, Y. (2018) · IEEE International Requirements Engineering Conference (RE) · doi:10.1109/re.2018.00018 · Cited by 60
“A comprehensive literature review of other work on App Store Analysis for Software Engineering can be found elsewhere [6].”
BackgroundSelf-citationExploring the integration of user feedback in automated testing of Android applications
Grano, G., Ciurumelea, A., Panichella, S., Palomba, F., & Gall, H. C. (2018) · IEEE International Conference on Software Analysis, Evolution and Reengineering (SANER) · doi:10.1109/saner.2018.8330198 · Cited by 59
“Mobile devices, such as smartphones and tablets, acquired more and more a central role in everyday life in recent years [31].”
BackgroundAn Empirical Study of Cross-Platform Mobile Development in Industry
Biørn-Hansen, A., Grønli, T., Ghinea, G., & Alouneh, S. (2019) · Wireless Communications and Mobile Computing · doi:10.1155/2019/5743892 · Cited by 58
“[50], and these libraries are found to request additional app”
BackgroundEmerging App Issue Identification from User Feedback: Experience on WeChat
Gao, C., Zheng, W., Deng, Y., Lo, D., Zeng, J., Lyu, M. R.-T., & King, I. (2019) · IEEE/ACM International Conference on Software Engineering: Software Engineering in Practice (ICSE-SEIP) · doi:10.1109/icse-seip.2019.00040 · Cited by 57
“There already exist many attempts on analyzing user intentions from user reviews, as summarized by Martin et al. [17].”
BackgroundModeling user concerns in Sharing Economy: the case of food delivery apps
Williams, G., Tushev, M., Ebrahimi, F., & Mahmoud, A. (2020) · Automated Software Engineering · doi:10.1007/s10515-020-00274-7 · Cited by 63
Recommending New Features from Mobile App Descriptions
Jiang, H., Zhang, J., Li, X., Ren, Z., Lo, D., Wu, X., & Luo, Z. (2019) · ACM Transactions on Software Engineering and Methodology · doi:10.1145/3344158 · Cited by 55
“, brief introductions of apps, disclaimers, and contact addresses (Berardi et al. 2015; Fan et al. 2018; Martin et al. 2017).”
BackgroundIdentifying Key Features from App User Reviews
Wu, H., Deng, W., Niu, X., & Nie, C. (2021) · ACM/IEEE International Conference on Software Engineering: Companion Proceedings (ICSE-Companion) · doi:10.1109/icse43902.2021.00088 · Cited by 69
“Such a communication channel not only facilitates users for selecting their favourable apps, but also provides app developers a rich source of information for assisting release plannings [6].”
BackgroundA study of the relation of mobile device attributes with the user-perceived quality of Android apps
Noei, E., Syer, M. D., Zou, Y., Hassan, A. E., & Keivanloo, I. (2017) · Empirical Software Engineering · doi:10.1007/s10664-017-9507-3 · Cited by 61
Studying the consistency of star ratings and reviews of popular free hybrid Android and iOS apps
Hu, H., Wang, S., Bezemer, C., & Hassan, A. E. (2018) · Empirical Software Engineering · doi:10.1007/s10664-018-9617-6 · Cited by 53
“Martin et al. (2016a) found that higher priced releases are more likely to have a positive impact on the success of an app.”
Nakamura, W. T., de Oliveira, E. C., Oliveira, E., Redmiles, D., & Conte, T. U. (2022) · Journal of Systems and Software · doi:10.1016/j.jss.2022.111462 · Cited by 62
Mobile app privacy in software engineering research: A systematic mapping study
Ebrahimi, F., Tushev, M., & Mahmoud, A. (2020) · Information and Software Technology · doi:10.1016/j.infsof.2020.106466 · Cited by 60
Mining user requirements to facilitate mobile app quality upgrades with big data
Chen, R., Wang, Q., & Xu, W. X. (2019) · Electronic Commerce Research and Applications · doi:10.1016/j.elerap.2019.100889 · Cited by 51
ReCDroid+: Automated End-to-End Crash Reproduction from Bug Reports for Android Apps
Zhao, Y., Su, T., Liu, Y., Zheng, W., Wu, X., Kavuluru, R., Halfond, W. G. J., & Yu, T. (2022) · ACM Transactions on Software Engineering and Methodology · doi:10.1145/3488244 · Cited by 60
“The competitive app marketplace [53] has also made these activities more important for an app’s success.”
BackgroundOn the use of evaluation measures for defect prediction studies
Moussa, R., & Sarro, F. (2022) · ACM SIGSOFT International Symposium on Software Testing and Analysis (ISSTA) · doi:10.1145/3533767.3534405 · Cited by 60
“a rigours procedure recommended and used in previous work to filter out irrelevant articles [22, 29].”
MethodSelf-citationWatanabe, T., Akiyama, M., Kanei, F., Shioji, E., Takata, Y., Sun, B., Ishii, Y., Shibahara, T., Yagi, T., & Mori, T. (2017) · International Conference on Mining Software Repositories (MSR) · doi:10.1109/msr.2017.23 · Cited by 56
Do developers update third-party libraries in mobile apps?
Salza, P., Palomba, F., Nucci, D. D., D'Uva, C., Lucia, A. D., & Ferrucci, F. (2018) · IEEE International Conference on Program Comprehension (ICPC) · doi:10.1145/3196321.3196341 · Cited by 48
“, change propagation or ripple effect) is a topic that has been studied in the context of both traditional applications [4, 11, 19, 25, 35, 36] and mobile apps [23, 24, 28, 30].”
BackgroundTo the attention of mobile software developers: guess what, test your app!
Cruz, L., Abreu, R., & Lo, D. (2019) · Empirical Software Engineering · doi:10.1007/s10664-019-09701-0 · Cited by 63
“Studies based on data collected from app stores have become a powerful source of information with a direct impact on mobile software teams (Martin et al. 2017).”
BackgroundMethodInfluentialAndroid security assessment: A review, taxonomy and research gap study
Garg, S., & Baliyan, N. (2020) · Computers & Security · doi:10.1016/j.cose.2020.102087 · Cited by 52
User feedback in the app store: a cross-cultural study
Guzmán, E., Oliveira, L., Steiner, Y., Wagner, L. C., & Glinz, M. (2018) · IEEE/ACM International Conference on Software Engineering: Software Engineering in Society (ICSE-SEIS) · doi:10.1145/3183428.3183436 · Cited by 54
“[31] surveyed the most relevant work in the area.”
BackgroundAutomating user-feedback driven requirements prioritization
Kifetew, F. M., Perini, A., Susi, A., Siena, A., Muñante, D., & Morales-Ramirez, I. (2021) · Information and Software Technology · doi:10.1016/j.infsof.2021.106635 · Cited by 45
Opinion mining for app reviews: an analysis of textual representation and predictive models
Araújo, A. F. D., Gôlo, M. P. S., & Marcacini, R. M. (2021) · Automated Software Engineering · doi:10.1007/s10515-021-00301-1 · Cited by 50
“However, recent studies comparing the performance of these models indicate that there are still significant open challenges for app review scenario Dabrowski et al. (2020), Martin et al. (2017).”
BackgroundUsing frame semantics for classifying and summarizing application store reviews
Jha, N. N., & Mahmoud, A. (2018) · Empirical Software Engineering · doi:10.1007/s10664-018-9605-x · Cited by 49
Speech-acts based analysis for requirements discovery from online discussions
Morales-Ramirez, I., Kifetew, F. M., & Perini, A. (2018) · Information Systems · doi:10.1016/j.is.2018.08.003 · Cited by 47
User Review-Based Change File Localization for Mobile Applications
Zhou, Y., Su, Y., Chen, T., Huang, Z., Gall, H. C., & Panichella, S. (2020) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2020.2967383 · Cited by 43
“Thus, a key and winning aspect of successful apps is related to the capability of developers to deliver high-quality apps and, at the same time, address user requests; this is crucial for the app to stay on the market and to keep gaining users [2], [10].”
BackgroundBuilding the perfect game – an empirical study of game modifications
Lee, D., Lin, D., Bezemer, C., & Hassan, A. E. (2020) · Empirical Software Engineering · doi:10.1007/s10664-019-09783-w · Cited by 43
“nalysis focused mostly on the Google Play store and Apple’s App Store. As a complete overview of prior work in this field is outside of the scope of this paper, we refer to the survey of Martin et al. [40] for such an overview. Several studies focused on release schedules of mobile apps. Hassan et al. [22] studied the…”
ResultMitigation and risk factor analysis of android applications
Sharma, K., & Gupta, B. B. (2018) · Computers & Electrical Engineering · doi:10.1016/j.compeleceng.2018.08.003 · Cited by 42
Fink, L., Shao, J., Lichtenstein, Y., & Haefliger, S. (2020) · Journal of Information Technology · doi:10.1177/0268396220936705 · Cited by 55
“…AppBrain are well-known tools in the relevant communities, and similar techniques have been reported in the literature (Greenstein and Nagle, 2014; Martin et al., 2017; Spinellis and Giannikas, 2012), the use of two independent tools with different baseline repositories and collection techniques…”
Hu, H., Bezemer, C., & Hassan, A. E. (2018) · Empirical Software Engineering · doi:10.1007/s10664-018-9604-y · Cited by 41
“[24] conduct a survey in app store analysis in which they describe and compare studies that focus on analyzing star ratings and user reviews.”
BackgroundStudying Bad Updates of Top Free-to-Download Apps in the Google Play Store
Hassan, S., Bezemer, C., & Hassan, A. E. (2018) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2018.2869395 · Cited by 41
“For a more thorough overview, we refer to Martin et al.’s [20] and Genc-Nayebi et al.’s [21] surveys.”
MethodEmbracing mobile app evolution via continuous ecosystem mining and characterization
Cai, H. (2020) · IEEE/ACM International Conference on Mobile Software Engineering and Systems (MOBILESoft) · doi:10.1145/3387905.3388612 · Cited by 40
“In addition, previous works mostly focused on malware only (e.g., [45, 51]) and/or coarse characteristics [40, 46].”
BackgroundThird-party libraries in mobile apps: When, how, and why developers update them
Salza, P., Palomba, F., Nucci, D. D., Lucia, A. D., & Ferrucci, F. (2019) · Empirical Software Engineering · doi:10.1007/s10664-019-09754-1 · Cited by 46
The impact of mobile applications on medication adherence: a systematic review
Ng, R., Carter, S. R., & El-Den, S. (2019) · Translational Behavioral Medicine · doi:10.1093/tbm/ibz125 · Cited by 31
PEVRM: Probabilistic Evolution Based Version Recommendation Model for Mobile Applications
Maheswari, M. V., Geetha, S., Kumar, S., Karuppiah, M., Samanta, D., & Park, Y. (2021) · IEEE Access · doi:10.1109/access.2021.3053583 · Cited by 39
“Martin et al. [39] depicted App Store Analysis and examines data about applications acquired from application stores.”
BackgroundMining and searching app reviews for requirements engineering: Evaluation and replication studies
Dąbrowski, J., Letier, E., Perini, A., & Susi, A. (2023) · Information Systems · doi:10.1016/j.is.2023.102181 · Cited by 39
“We selected GuMa and SAFE as they are state-of-the-135 art approaches widely known in RE community [1, 7, 21, 31].”
BackgroundMethodInfluentialAutomating App Review Response Generation
Gao, C., Zeng, J., Xia, X., Lo, D., Lyu, M. R.-T., & King, I. (2019) · IEEE/ACM International Conference on Automated Software Engineering (ASE) · doi:10.1109/ase.2019.00025 · Cited by 47
Mining User Opinions to Support Requirement Engineering: An Empirical Study
Dąbrowski, J., Letier, E., Perini, A., & Susi, A. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-49435-3_25 · Cited by 39
Where is Your App Frustrating Users?
Wang, Y., Wang, J.-J., Zhang, H.-Y., Ming, X., Shi, L., & Wang, Q. (2022) · International Conference on Software Engineering · doi:10.1145/3510003.3510189 · Cited by 36
“introduced the concept of app store mining by identifying correlations between the customer ratings and the download rank of a mobile app [21, 42].”
Background
Metadata
- Authors
- Martin, W., Sarro, F., Jia, Y., Zhang, Y., & Harman, M.
- Affiliations
- University College London (GB)
- Venue
- IEEE Transactions on Software Engineering
- Published
- 2017-09-01
- Volume
- 43
- Issue
- 9
- Pages
- 817-847
- ISSN
- 0098-5589 (ISSN-L)
- 1939-3520
- 2326-3881
- OpenAlex
- W2559490865
- Cited by
- 459
- References
- 257
- Citations by year
- 2026: 18 · 2025: 32 · 2024: 40 · 2023: 32 · 2022: 52 · 2021: 54 · 2020: 66 · 2019: 56 · 2018: 58 · 2017: 31
- FWCI
- 122.76
- Type
- journal article
- Language
- en
- Open access
- hybrid
- doi.org
- Locations
- IEEE Transactions on Software Engineering (publishedVersion, cc-by)
- UCL Discovery (University College London) (submittedVersion)
- Funders
- EPRSC (EP/J017515)
- Topics
- Physical Sciences › Computer Science › Information Systems › Software Engineering Research
- Physical Sciences › Computer Science › Information Systems › Software Engineering Techniques and Practices
- Physical Sciences › Computer Science › Information Systems › Mobile and Web Applications
- Keywords
- app store analysis, App Store, mobile application, user feedback, software repositories, requirements engineering, release planning, software design, software security, software testing, user behavior
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.