The DOI matches its Crossref record; 22 of the 22 references it cites were found in a registry or an index.
Crawling Ajax-Based Web Applications through Dynamic Analysis of User Interface State Changes
Open accessAbstract
Using JavaScript and dynamic DOM manipulation on the client side of Web applications is becoming a widespread approach for achieving rich interactivity and responsiveness in modern Web applications. At the same time, such techniques---collectively known as Ajax ---shatter the concept of webpages with unique URLs, on which traditional Web crawlers are based. This article describes a novel technique for crawling Ajax -based applications through automatic dynamic analysis of user-interface-state changes in Web browsers. Our algorithm scans the DOM tree, spots candidate elements that are capable of changing the state, fires events on those candidate elements, and incrementally infers a state machine that models the various navigational paths and states within an Ajax application. This inferred model can be used in program comprehension and in analysis and testing of dynamic Web states, for instance, or for generating a static version of the application. In this article, we discuss our sequential and concurrent Ajax crawling algorithms. We present our open source tool called Crawljax , which implements the concepts and algorithms discussed in this article. Additionally, we report a number of empirical studies in which we apply our approach to a number of open-source and industrial Web applications and elaborate on the obtained results.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
A note on two problems in connexion with graphs
Dijkstra, E. W. (1959) · Numerische Mathematik · doi:10.1007/bf01386390 · Cited by 29,065
The anatomy of a large-scale hypertextual Web search engine
Brin, S., & Page, L. (1998) · Computer Networks and ISDN Systems · doi:10.1016/s0169-7552(98)00110-x · Cited by 16,004
Binary Codes capable of currecting deletions, insertions, and reversals
Levenshtein, V. I. (1965) · Soviet physics. Doklady · Cited by 14,807
Principled design of the modern Web architecture
Fielding, R. T., & Taylor, R. N. (2002) · ACM Transactions on Internet Technology · doi:10.1145/514183.514185 · Cited by 1,682
Ajax: A New Approach to Web Applications
Garrett, J. J. (2007) · Cited by 1,029
Designing Experiments and Analyzing Data: A Model Comparison Perspective, Third Edition
Maxwell, S. E., & Delaney, H. D. (1999) · Medical Entomology and Zoology · Cited by 975
Efficient crawling through URL ordering
Cho, J., Garcia-Molina, H., & Page, L. (1998) · Computer Networks and ISDN Systems · doi:10.1016/s0169-7552(98)00108-1 · Cited by 837
Mercator: A scalable, extensible Web crawler
Heydon, A., & Najork, M. (1999) · World Wide Web · doi:10.1023/a:1019213109274 · Cited by 582
UbiCrawler: a scalable fully distributed Web crawler
Boldi, P., Codenotti, B., Santini, M., & Vigna, S. (2004) · Software: Practice and Experience · doi:10.1002/spe.587 · Cited by 560
Change detection in hierarchically structured information
Chawathe, S. S., Rajaraman, A., Garcia-Molina, H., & Widom, J. (1996) · Proceedings of the 1996 ACM SIGMOD international conference on Management of data - SIGMOD '96 · doi:10.1145/233269.233366 · Cited by 484
GUI ripping: reverse engineering of graphical user interfaces for testing
Memon, A., Banerjee, I., & Nagarajan, A. (2004) · 10th Working Conference on Reverse Engineering, 2003. WCRE 2003. Proceedings. · doi:10.1109/wcre.2003.1287256 · Cited by 379
Designing Experiments and Analyzing Data: A Model Comparison Perspective
Maxwell, S. E., & Delaney, H. D. (2003) · Routledge eBooks · doi:10.4324/9781410609243 · Cited by 374
Cho, J., & Garcia-Molina, H. (2002) · Proceedings of the 11th international conference on World Wide Web · doi:10.1145/511446.511464 · Cited by 312
Finding What People Want : Experiences with the WebCrawler
Pinkerton, B. (1994) · Medical Entomology and Zoology · Cited by 266
Coverage criteria for GUI testing
Memon, A. M., Soffa, M. L., & Pollack, M. E. (2001) · Proceedings of the 8th European software engineering conference held jointly with 9th ACM SIGSOFT international symposium on Foundations of software engineering · doi:10.1145/503209.503244 · Cited by 229
Downloading textual hidden web content through keyword queries
Ntoulas, A., Zerfos, P., & Cho, J. (2005) · Proceedings of the 5th ACM/IEEE-CS joint conference on Digital libraries · doi:10.1145/1065385.1065407 · Cited by 206
Invariant-based automatic testing of AJAX user interfaces
Mesbah, A., & van Deursen, A. (2009) · 2009 IEEE 31st International Conference on Software Engineering · doi:10.1109/icse.2009.5070522 · Cited by 201
Self-citationCrawling AJAX by Inferring User Interface State Changes
Mesbah, A., Bozdag, E., & van Deursen, A. (2008) · 2008 Eighth International Conference on Web Engineering · doi:10.1109/icwe.2008.24 · Cited by 188
Self-citationAutomated cross-browser compatibility testing
Mesbah, A., & Prasad, M. R. (2011) · ACM/IEEE International Conference on Software Engineering: Companion Proceedings (ICSE-Companion) · doi:10.1145/1985793.1985870 · Cited by 154
Self-citationMigrating Multi-page Web Applications to Single-page AJAX Interfaces
Mesbah, A., & Arie Van Deursen, A. (2007) · Euromicro Conference on Software Maintenance and Reengineering (CSMR) · doi:10.1109/csmr.2007.33 · Cited by 123
Self-citationThe discoverability of the web
Dasgupta, A., Ghosh, A., Kumar, R., Olston, C., Pandey, S., & Tomkins, A. (2007) · International World Wide Web Conference (WWW) · doi:10.1145/1242572.1242630 · Cited by 84
AJAX Crawl: Making AJAX Applications Searchable
Duda, C., Frey, G., Kossmann, D., et al. (2009) · Proceedings - International Conference on Data Engineering · doi:10.1109/icde.2009.90 · Cited by 76
Cited by
Automated Test Input Generation for Android: Are We There Yet? (E)
Choudhary, S. R., Gorla, A., & Orso, A. (2015) · 2015 30th IEEE/ACM International Conference on Automated Software Engineering (ASE) · doi:10.1109/ase.2015.89 · Cited by 463
Guided GUI testing of android apps with minimal restart and approximate learning
Choi, W., Necula, G., & Sen, K. (2013) · Proceedings of the 2013 ACM SIGPLAN international conference on Object oriented programming systems languages & applications · doi:10.1145/2509136.2509552 · Cited by 315
A Grey-Box Approach for Automated GUI-Model Generation of Mobile Applications
Yang, W., Prasad, M. R., & Xie, T. (2013) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-37057-1_19 · Cited by 313
MobiGUITAR: Automated Model-Based Testing of Mobile Apps
Amalfitano, D., Fasolino, A. R., Tramontana, P., Ta, B. D., & Memon, A. M. (2015) · IEEE Software · doi:10.1109/ms.2014.55 · Cited by 278
Metadata
- Authors
- Mesbah, A., van Deursen, A., & Lenselink, S.
- Venue
- ACM Transactions on the Web
- Published
- 2012-03
- Volume
- 6
- Issue
- 1
- Pages
- 1-30
- ISSN
- 1559-1131 (ISSN-L)
- 1559-114X
- OpenAlex
- W2011539648
- Cited by
- 296
- References
- 22
- FWCI
- 104.84
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.