The DOI matches its Crossref record; 23 of the 23 references it cites were found in a registry or an index.
Automated Test Input Generation for Android: Are We There Yet? (E)
Abstract
Like all software, mobile applications ("apps") must be adequately tested to gain confidence that they behave correctly. Therefore, in recent years, researchers and practitioners alike have begun to investigate ways to automate apps testing. In particular, because of Android's open source nature and its large share of the market, a great deal of research has been performed on input generation techniques for apps that run on the Android operating systems. At this point in time, there are in fact a number of such techniques in the literature, which differ in the way they generate inputs, the strategy they use to explore the behavior of the app under test, and the specific heuristics they use. To better understand the strengths and weaknesses of these existing approaches, and get general insight on ways they could be made more effective, in this paper we perform a thorough comparison of the main existing test input generation tools for Android. In our comparison, we evaluate the effectiveness of these tools, and their corresponding techniques, according to four metrics: ease of use, ability to work on multiple platforms, code coverage, and ability to detect faults. Our results provide a clear picture of the state of the art in input generation for Android apps and identify future research directions that, if suitably investigated, could lead to more effective and efficient testing tools for Android.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
TaintDroid: an information-flow tracking system for realtime privacy monitoring on smartphones
Enck, W., Gilbert, P., Chun, B.-G., Cox, L. P., Jung, J., McDaniel, P. D., & Sheth, A. N. (2010) · doi:10.5555/1924943.1924971 · Cited by 2,238
Arzt, S., Rasthofer, S., Fritz, C., Bodden, E., Bartel, A., Klein, J., Le Traon, Y., Octeau, D., & McDaniel, P. (2014) · Proceedings of the 35th ACM SIGPLAN Conference on Programming Language Design and Implementation · doi:10.1145/2594291.2594299 · Cited by 1,396
Dynodroid: an input generation system for Android apps
Machiry, A., Tahiliani, R., & Naik, M. (2013) · Proceedings of the 2013 9th Joint Meeting on Foundations of Software Engineering · doi:10.1145/2491411.2491450 · Cited by 701
Using GUI ripping for automated testing of Android applications
Amalfitano, D., Fasolino, A. R., Tramontana, P., De Carmine, S., & Memon, A. M. (2012) · Proceedings of the 27th IEEE/ACM International Conference on Automated Software Engineering · doi:10.1145/2351676.2351717 · Cited by 514
Targeted and depth-first exploration for systematic testing of android apps
Azim, T., & Neamtiu, I. (2013) · doi:10.1145/2509136.2509549 · Cited by 422
Automated concolic testing of smartphone apps
Anand, S., Naik, M., Harrold, M. J., & Yang, H. (2012) · Proceedings of the ACM SIGSOFT 20th International Symposium on the Foundations of Software Engineering · doi:10.1145/2393596.2393666 · Cited by 401
Checking app behavior against app descriptions
Gorla, A., Tavecchia, I., Gross, F., & Zeller, A. (2014) · Proceedings of the 36th International Conference on Software Engineering · doi:10.1145/2568225.2568276 · Cited by 397
Self-citationGUI ripping: reverse engineering of graphical user interfaces for testing
Memon, A., Banerjee, I., & Nagarajan, A. (2004) · 10th Working Conference on Reverse Engineering, 2003. WCRE 2003. Proceedings. · doi:10.1109/wcre.2003.1287256 · Cited by 379
PUMA: programmable UI-automation for large-scale dynamic analysis of mobile apps
Hao, S., Liu, B., Nath, S., Halfond, W. G. J., & Govindan, R. (2014) · Proceedings of the 12th annual international conference on Mobile systems, applications, and services · doi:10.1145/2594368.2594390 · Cited by 340
Guided GUI testing of android apps with minimal restart and approximate learning
Choi, W., Necula, G., & Sen, K. (2013) · Proceedings of the 2013 ACM SIGPLAN international conference on Object oriented programming systems languages & applications · doi:10.1145/2509136.2509552 · Cited by 315
A Grey-Box Approach for Automated GUI-Model Generation of Mobile Applications
Yang, W., Prasad, M. R., & Xie, T. (2013) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-37057-1_19 · Cited by 313
Automating GUI testing for Android applications
Hu, C., & Neamtiu, I. (2011) · Proceedings of the 6th International Workshop on Automation of Software Test · doi:10.1145/1982595.1982612 · Cited by 308
Crawling Ajax-Based Web Applications through Dynamic Analysis of User Interface State Changes
Mesbah, A., van Deursen, A., & Lenselink, S. (2012) · ACM Transactions on the Web · doi:10.1145/2109205.2109208 · Cited by 296
Dexpler: converting Android Dalvik bytecode to Jimple for static analysis with Soot
Bartel, A., Klein, J., Le Traon, Y., & Monperrus, M. (2012) · Proceedings of the ACM SIGPLAN International Workshop on State of the Art in Java Program analysis · doi:10.1145/2259051.2259056 · Cited by 216
Mining Apps for Abnormal Usage of Sensitive Data
Avdiienko, V., Kuznetsov, K., Gorla, A., Zeller, A., Arzt, S., Rasthofer, S., & Bodden, E. (2015) · 2015 IEEE/ACM 37th IEEE International Conference on Software Engineering · doi:10.1109/icse.2015.61 · Cited by 189
Self-citationProfileDroid: multi-layer profiling of android applications
Wei, X., Gomez, L., Neamtiu, I., & Faloutsos, M. (2012) · Proceedings of the 18th annual international conference on Mobile computing and networking · doi:10.1145/2348543.2348563 · Cited by 181
X-PERT: Accurate identification of cross-browser issues in web applications
Choudhary, S. R., Prasad, M. R., & Orso, A. (2013) · ACM/IEEE International Conference on Software Engineering: Companion Proceedings (ICSE-Companion) · doi:10.1109/icse.2013.6606616 · Cited by 113
Self-citationAutomated Generation of Oracles for Testing User-Interaction Features of Mobile Apps
Zaeem, R. N., Prasad, M. R., & Sarfraz Khurshid, D. (2014) · IEEE International Conference on Software Testing, Verification and Validation (ICST) · doi:10.1109/icst.2014.31 · Cited by 109
AutoBlackTest: Automatic Black-Box Testing of Interactive Applications
Mariani, L., Pezzè, M., Riganelli, O., & Santoro, M. (2012) · IEEE International Conference on Software Testing, Verification and Validation (ICST) · doi:10.1109/icst.2012.88 · Cited by 102
MobiGUITAR - A Tool for Automated Model-Based Testing of Mobile Apps
Amalfitano, D., Fasolino, A. R., Tramontana, P., Ta, B. D., & Memon, A. M. (2014) · Cited by 54
A.: EXSYST: Search-based GUI testing
Groß, F., Fraser, G., & Zeller, A. (n.d.) · Cited by 35
EXSYST: Search-based GUI testing
Groß, F., Fraser, G., & Zeller, A. (2012) · ACM/IEEE International Conference on Software Engineering: Companion Proceedings (ICSE-Companion) · doi:10.1109/icse.2012.6227232 · Cited by 35
Charting the API minefield using software telemetry data
Kechagia, M., Mitropoulos, D., & Spinellis, D. D. (2014) · Empirical Software Engineering · doi:10.1007/s10664-014-9343-7 · Cited by 20
Cited by
Sapienz: multi-objective automated testing for Android applications
Mao, K., Harman, M., & Jia, Y. (2016) · Proceedings of the 25th International Symposium on Software Testing and Analysis · doi:10.1145/2931037.2931054 · Cited by 541
Guided, stochastic model-based GUI testing of Android apps
Su, T., Meng, G., Chen, Y., Wu, K., Yang, W., Yao, Y., Pu, G., Liu, Y., & Su, Z. (2017) · Proceedings of the 2017 11th Joint Meeting on Foundations of Software Engineering · doi:10.1145/3106237.3106298 · Cited by 371
Chen, C., Su, T., Meng, G., Xing, Z., & Liu, Y. (2018) · Proceedings of the 40th International Conference on Software Engineering · doi:10.1145/3180155.3180240 · Cited by 188
ReCon: Revealing and Controlling PII Leaks in Mobile Network Traffic
Ren, J., Rao, A., Lindorfer, M., Legout, A., & Choffnes, D. (2016) · Proceedings of the 14th Annual International Conference on Mobile Systems, Applications, and Services · doi:10.1145/2906388.2906392 · Cited by 132
Automated mobile UI test fragility: an exploratory assessment study on Android
Coppola, R., Raffero, E., & Torchiano, M. (2016) · Proceedings of the 2nd International Workshop on User Interface Test Automation · doi:10.1145/2945404.2945406 · Cited by 25
Metadata
- Authors
- Choudhary, S. R., Gorla, A., & Orso, A.
- Venue
- 2015 30th IEEE/ACM International Conference on Automated Software Engineering (ASE)
- Publisher
- IEEE
- Published
- 2015-11
- Pages
- 429-440
- OpenAlex
- W2227887088
- Cited by
- 463
- References
- 23
- FWCI
- 42.67
- Type
- conference paper
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.