The DOI matches its Crossref record; 30 of the 30 references it cites were found in a registry or an index.
Making JavaScript Render Decisions to Optimize Security-Oriented Crawler Process
Open accessAbstract
The widespread use of web applications requires important changes in cybersecurity to protect online services and data. In the process of identifying security vulnerabilities in web applications, a systematic approach is employed to detect and mitigate cybersecurity risks. This approach utilizes web crawlers to identify attack vectors. Traditional web crawling methods are resource-intensive and often need to be more efficient in handling dynamic JavaScript-rich content. Addressing this crucial gap, our study introduces an innovative approach to predict the necessity of JavaScript rendering, thereby enhancing the effectiveness and efficiency of security-oriented web crawlers. This approach seeks to reduce computational requirements and quicken the security evaluation process through the use of machine learning algorithms. By utilizing a dataset containing the source code from the main pages of 17,160 websites, our experimental results demonstrate a 20% reduction in execution time compared to full JavaScript rendering, indicating an improvement in resource usage without any significant reduction in coverage. Our methodology significantly improves the efficiency of security-focused web crawlers and helps security scanners to detect security risks of web applications with fewer resources.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“This has catalysed the emergence of Development + Security + Operations (DevSecOps), which integrates security as a seamless and continuous element throughout the software lifecycle [11,12].”
From Evolution of DevSecOps and Its Influence on Application Security: A Systematic Literature Review (2025) · cites this paper as [12]
Citations
Cites
A Systematic Literature Review on the Cyber Security
Parwej, F., Abbas, S. Q., Dixit, J. P., Akhtar, N., & Jaiswal, A. K. (2021) · International Journal of Scientific Research and Management (IJSRM) · doi:10.18535/ijsrm/v9i12.ec04 · Cited by 245 · cited 1×
“…are highly targeted by attackers because they are easy to target, and their security is of great importance as possible information breaches can lead to devastating consequences such as financial loss, reputa-tional damage, regulatory penalties, and loss of customer trust [2], [3], [4], [5].”
BackgroundCybersecurity: Risk management framework and investment cost analysis
Lee, I. (2021) · Business Horizons · doi:10.1016/j.bushor.2021.02.022 · Cited by 190 · cited 1×
“Therefore, the significance of information security has immensely enhanced over the last couple of years [6], [7].”
BackgroundWeb application testing: A systematic literature review
Doğan, S., Betin-Can, A., & Garousi, V. (2014) · Journal of Systems and Software · doi:10.1016/j.jss.2014.01.010 · Cited by 136 · cited 1×
“Depending on the crawler’s capabilities, a larger or smaller portion of the web application will be automatically explored [15], [16].”
BackgroundAlazmi, S., & de Leon, D. C. (2022) · IEEE Access · doi:10.1109/access.2022.3161522 · Cited by 109 · cited 1×
“Web application security scanners are automated tools that check out websites or web applications for security vulnerabilities [12], [13].”
BackgroundSecurity testing of web applications: A systematic mapping of the literature
Aydos, M., ALDAN, C., Coşkun, E., & Soydan, A. (2021) · Journal of King Saud University - Computer and Information Sciences · doi:10.1016/j.jksuci.2021.09.018 · Cited by 86 · cited 1×
“These applications are used by enterprises and organizations to provide services from an organization to an individual for a wide variety of uses [1].”
A methodology for estimating the tangible cost of data breaches
Layton, R., & Watters, P. (2014) · Journal of Information Security and Applications · doi:10.1016/j.jisa.2014.10.012 · Cited by 63 · cited 1×
“…are highly targeted by attackers because they are easy to target, and their security is of great importance as possible information breaches can lead to devastating consequences such as financial loss, reputa-tional damage, regulatory penalties, and loss of customer trust [2], [3], [4], [5].”
BackgroundA survey on vulnerability assessment tools and databases for cloud-based web applications
Kritikos, K., Magoutis, K., Papoutsakis, M., & Ioannidis, S. (2019) · Array · doi:10.1016/j.array.2019.100011 · Cited by 57 · cited 1×
“These tools aim at finding problematic parts of an application or its system that make it vulnerable to security attacks [14].”
BackgroundLEARNING-based Focused WEB Crawler
Kumar, N., & Aggarwal, D. (2021) · IETE Journal of Research · doi:10.1080/03772063.2021.1885312 · Cited by 53 · cited 2×
“Kumar et al proposed a decision system to start a crawler for web applications [26].”
BackgroundA Review on Web Application Vulnerability Assessment and Penetration Testing
Ravindran, U., & Vamsi, P. R. (2022) · Review of Computer Engineering Studies · doi:10.18280/rces.090101 · Cited by 47 · cited 1×
“In addition to manual processes, web application security scanners and automated tools are employed to accelerate this procedure [11].”
MethodWEB DATA MINING FOR MONITORING BUSINESS EXPORT ORIENTATION
Blazquez-Soriano, A., & Domènech, J. (2017) · Technological and Economic Development of Economy · doi:10.3846/20294913.2016.1213193 · Cited by 39 · cited 1×
“Crawling operation purposes can be different in different cases [18], [19], [20], [21].”
BackgroundVulnerability Assessment for Applications Security Through Penetration Simulation and Testing
Lachkov, P., Tawalbeh, L., & Bhatt, S. (2022) · Journal of Web Engineering · doi:10.13052/jwe1540-9589.2178 · Cited by 35 · cited 1×
“Generally, vulnerability assessment, penetration testing, risk assessment, and the implementation and monitoring of security controls are some of the key activities that organizations undertake to secure their web applications [8], [9], [10].”
BackgroundTeodoro, N., & Serrão, C. (2011) · International Conference on Information Society · doi:10.1109/i-society18435.2011.5978496 · Cited by 34 · cited 1×
“…are highly targeted by attackers because they are easy to target, and their security is of great importance as possible information breaches can lead to devastating consequences such as financial loss, reputa-tional damage, regulatory penalties, and loss of customer trust [2], [3], [4], [5].”
BackgroundAutomated versus Manual Approach of Web Application Penetration Testing
Singh, N., Meherhomji, V., & Chandavarkar, B. R. (2020) · International Conference on Computing, Communication and Networking Technologies (ICCCNT) · doi:10.1109/icccnt49239.2020.9225385 · Cited by 34
Framework for Calculating Return on Security Investment (ROSI) for Security-Oriented Organizations
Yaqoob, T., Arshad, A., Abbas, H., Amjad, M. F., & Shafqat, N. (2019) · Future Generation Computer Systems · doi:10.1016/j.future.2018.12.033 · Cited by 27 · cited 1×
“Therefore, the significance of information security has immensely enhanced over the last couple of years [6], [7].”
BackgroundResearch on Web Application Security Vulnerability Scanning Technology
Wang, B., Liu, L., Li, F., Zhang, J., Чен, Т., & Zou, Z. (2019) · IEEE Advanced Information Technology, Electronic and Automation Control Conference (IAEAC) · doi:10.1109/iaeac47372.2019.8997964 · Cited by 27 · cited 1×
“The principle of the security scanner is that the scanner first starts a web crawler to crawl and analyze the URL of the target site, and tests the extracted content with the payloads to determine whether there is a vulnerability [31], [32], [33].”
BackgroundSoftware engineering for the web: the state of the practice
Nederlof, A., Mesbah, A., & Arie Van Deursen, A. (2014) · ACM/IEEE International Conference on Software Engineering: Companion Proceedings (ICSE-Companion) · doi:10.1145/2591062.2591170 · Cited by 26 · cited 1×
“Rendering is a significant process because in addition to providing responsive interfaces, JavaScript interacts with the DOM, allowing developers to not only change the layout of a page using the HTML elements, but also load extra stylesheet and script files at runtime [24].”
MethodEvaluation of Open Source Web Application Vulnerability Scanners
Abdullah, H. S. (2020) · Academic Journal of Nawroz University · doi:10.25007/ajnu.v9n1a532 · Cited by 23 · cited 1×
“Generally, vulnerability assessment, penetration testing, risk assessment, and the implementation and monitoring of security controls are some of the key activities that organizations undertake to secure their web applications [8], [9], [10].”
BackgroundA Survey of Modern Crawler Methods
Chang, Z. (2022) · International Conference on Control Engineering and Artificial Intelligence (CCEAI) · doi:10.1145/3522749.3523076 · Cited by 23 · cited 1×
“Researchers may use web crawlers for data mining, and big data analysis [23].”
MethodWeb Vulnerability Scanners: A Case StudyPreprint
Erturk, E., & Rajan, A. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1706.08017 · Cited by 16 · cited 1×
“Web application security scanners are automated tools that check out websites or web applications for security vulnerabilities [12], [13].”
BackgroundArchival Crawlers and JavaScript: Discover More Stuff but Crawl More Slowly
Brunelle, J. F., Weigle, M. C., & Nelson, M. L. (2017) · ACM/IEEE Joint Conference on Digital Libraries · doi:10.1109/jcdl.2017.7991554 · Cited by 15 · cited 2×
“For instance, Kumar and Aggarwal [26] and Brunella et al. [27] offer improvements in URL classification and client-side event handling.”
BackgroundWIVET—Benchmarking Coverage Qualities of Web Crawlers
Tatlı, E. İ., & Urgun, B. (2016) · The Computer Journal · doi:10.1093/comjnl/bxw072 · Cited by 10 · cited 1×
“Tatli et al proposed a new method for analyzing and comparing coverage qualities of crawler components of web application vulnerability scanners [30].”
MethodAn Efficient Focused Web Crawling Approach
Aggarwal, K. (2018) · Advances in intelligent systems and computing · doi:10.1007/978-981-10-8848-3_13 · Cited by 10
Improving Vulnerability Scanner Performance in Detecting AJAX Application Vulnerabilities
Koswara, K. J., & Asnar, Y. D. W. (2019) · International Conference on Data and Software Engineering · doi:10.1109/icodse48700.2019.9092613 · Cited by 10 · cited 1×
“The principle of the security scanner is that the scanner first starts a web crawler to crawl and analyze the URL of the target site, and tests the extracted content with the payloads to determine whether there is a vulnerability [31], [32], [33].”
BackgroundDeep Reinforcement Learning for Web Crawling
Avrachenkov, K. E., Borkar, V. S., & Patil, K. (2021) · Indian Control Conference · doi:10.1109/icc54714.2021.9703160 · Cited by 10 · cited 1×
“The primary purpose of this process is to ensure an efficient and up-to-date retrieval of information [22].”
BackgroundResearch on LDA Model Algorithm of News-oriented Web Crawler
Wang, Y., Hong, Z., & Shi, M. (2018) · IEEE/ACIS International Conference on Computer and Information Science (ICIS) · doi:10.1109/icis.2018.8466502 · Cited by 9 · cited 1×
“Crawling operation purposes can be different in different cases [18], [19], [20], [21].”
BackgroundAn Active Workflow Method for Entity-Oriented Data Collection
Guo, G. (2018) · Lecture notes in computer science · doi:10.1007/978-3-030-01391-2_15 · Cited by 5 · cited 1×
“Crawling operation purposes can be different in different cases [18], [19], [20], [21].”
BackgroundDesign and Implementation of Web Crawler Based on Coroutine Model
Ding, R., & Wang, M. (2018) · Lecture notes in computer science · doi:10.1007/978-3-030-00006-6_39 · Cited by 3 · cited 1×
“A discussion on optimization crawler processes at the operating system level was given by Ding et al [29].”
MethodSmartCrawler: A Personalized Web Search for Relevant Web Pages
Wardekar, A. A., & Gupta, P. (2018) · International Conference on Computing, Communication and Networking Technologies (ICCCNT) · doi:10.1109/icccnt.2018.8494148 · Cited by 2 · cited 1×
“Crawling operation purposes can be different in different cases [18], [19], [20], [21].”
BackgroundComparative Analysis of Web Crawling Algorithms for Improvement in Web CrawlerPreprint
Shrivastava, V., & Sahai, P. (2019) · SSRN Electronic Journal · doi:10.2139/ssrn.3356275 · Cited by 2 · cited 3×
“Chang et al classified crawlers as generic, focus, incremental, distributed, parallel, and IoT [25].”
BackgroundResultReview of modern web application cybersecurity risks and counter measures
Goyal, D., Lavania, G., & Sharma, G. (2023) · AIP conference proceedings · doi:10.1063/5.0154193 · Cited by 2
Research works printed but not linked: 5
- Qasaimeh, 2018, Black box evaluation of web application scanners: Standards mapping approach, J. Theor. Appl. Inf. Technol., 96, 4584
- Jain, 2013, The role and importance of search engine and search engine optimization, Int. J. Emerg. Trends Technol. Comput. Sci., 2, 99
- Joshi, 2016, Performance evaluation of web application security scanners for more effective defense, Int. J. Sci. Res. Publications, 6, 660
- 2023, Source Code Search Engine
- 2023, Katana
Cited by
Evolution of DevSecOps and Its Influence on Application Security: A Systematic Literature Review
Mohammed, K., Shanmugam, B., & El-Den, J. (2025) · Technologies · doi:10.3390/technologies13120548 · Cited by 8
SEO та кібератаки: дослідження захищеності веб ресурсів і методи захисту SEO-позицій
Onyshchuk, O. (2026) · Ukrainian Scientific Journal of Information Security · doi:10.18372/2225-5036.32.21655
Metadata
- Authors
- Aktas, O., & Can, A. B.
- Affiliations
- Bilkent University (TR)
- Hacettepe University (TR)
- Venue
- IEEE Access
- Published
- 2024
- Volume
- 12
- Pages
- 161688-161696
- ISSN
- 2169-3536 (ISSN-L)
- OpenAlex
- W4403446325
- Cited by
- 1
- References
- 30
- Citations by year
- 2025: 1
- FWCI
- 0.38
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Locations
- IEEE Access (publishedVersion, cc-by)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Topics
- Physical Sciences › Computer Science › Information Systems › Web Application Security Vulnerabilities
- Physical Sciences › Computer Science › Information Systems › Web Data Mining and Analysis
- Physical Sciences › Computer Science › Software › Software Testing and Debugging Techniques
- Keywords
- web crawler, web application security, vulnerability detection, dynamic content, resource efficiency, security scanners
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.