The DOI matches its Crossref record; 41 of the 41 references it cites were found in a registry or an index.
Design and Evaluation of a Real-Time URL Spam Filtering Service
Abstract
On the heels of the widespread adoption of web services such as social networks and URL shorteners, scams, phishing, and malware have become regular threats. Despite extensive research, email-based spam filtering techniques generally fall short for protecting other web services. To better address this need, we present Monarch, a real-time system that crawls URLs as they are submitted to web services and determines whether the URLs direct to spam. We evaluate the viability of Monarch and the fundamental challenges that arise due to the diversity of web service spam. We show that Monarch can provide accurate, real-time protection, but that the underlying characteristics of spam do not generalize across web services. In particular, we find that spam targeting email qualitatively differs in significant ways from spam campaigns targeting Twitter. We explore the distinctions between email and Twitter spam, including the abuse of public web hosting and redirector services. Finally, we demonstrate Monarch's scalability, showing our system could protect a service such as Twitter -- which needs to process 15 million URLs/day -- for a bit under $800/day.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
The Elements of Statistical Learning
Hastie, T., Tibshirani, R., & Friedman, J. (2009) · Springer Series in Statistics · doi:10.1007/978-0-387-84858-7 · Cited by 25,970
(2010) · Cited by 4,411
Feature hashing for large scale multitask learning
Weinberger, K., Dasgupta, A., Langford, J., Smola, A., & Attenberg, J. (2009) · Proceedings of the 26th Annual International Conference on Machine Learning · doi:10.1145/1553374.1553516 · Cited by 906
Dalvi, N., Domingos, P., Mausam, Sanghai, S., & Verma, D. (2004) · Proceedings of the tenth ACM SIGKDD international conference on Knowledge discovery and data mining · doi:10.1145/1014052.1014066 · Cited by 887
Can machine learning be secure?
Barreno, M., Nelson, B., Sears, R., Joseph, A. D., & Tygar, J. D. (2006) · Proceedings of the 2006 ACM Symposium on Information, computer and communications security · doi:10.1145/1128817.1128824 · Cited by 836
Beyond blacklists: learning to detect malicious web sites from suspicious URLs
Ma, J., Saul, L. K., Savage, S., & Voelker, G. M. (2009) · Proceedings of the 15th ACM SIGKDD international conference on Knowledge discovery and data mining · doi:10.1145/1557019.1557153 · Cited by 803
Self-citationDetecting spammers on social networks
Stringhini, G., Kruegel, C., & Vigna, G. (2010) · Proceedings of the 26th Annual Computer Security Applications Conference · doi:10.1145/1920261.1920263 · Cited by 791
Cantina: a content-based approach to detecting phishing web sites
Zhang, Y., Hong, J. I., & Cranor, L. F. (2007) · Proceedings of the 16th international conference on World Wide Web · doi:10.1145/1242572.1242659 · Cited by 757
How Unique Is Your Web Browser?
Eckersley, P. (2010) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-14527-8_1 · Cited by 756
Lowd, D., & Meek, C. (2005) · Proceedings of the eleventh ACM SIGKDD international conference on Knowledge discovery in data mining · doi:10.1145/1081870.1081950 · Cited by 755
Cost-sensitive learning by cost-proportionate example weighting
Zadrozny, B., Langford, J., & Abe, N. (2004) · Third IEEE International Conference on Data Mining · doi:10.1109/icdm.2003.1250950 · Cited by 680
Magno, G., Rodrigues, T., & Almeida, V. A. F. (2010) · Cited by 648
Uncovering social spammers: social honeypots + machine learning
Lee, K., Caverlee, J., & Webb, S. (2010) · Proceedings of the 33rd international ACM SIGIR conference on Research and development in information retrieval · doi:10.1145/1835449.1835522 · Cited by 619
Detecting spam web pages through content analysis
Ntoulas, A., Najork, M., Manasse, M., & Fetterly, D. (2006) · Proceedings of the 15th international conference on World Wide Web · doi:10.1145/1135777.1135794 · Cited by 608
You've been warned: an empirical study of the effectiveness of web browser phishing warnings
Egelman, S., Cranor, L. F., & Hong, J. (2008) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/1357054.1357219 · Cited by 607
Detection and analysis of drive-by-download attacks and malicious JavaScript code
Cova, M., Kruegel, C., & Vigna, G. (2010) · Proceedings of the 19th international conference on World wide web · doi:10.1145/1772690.1772720 · Cited by 580
@spam: the underground on 140 characters or less
Grier, C., Thomas, K., Paxson, V., & Zhang, M. (2010) · Proceedings of the 17th ACM conference on Computer and communications security · doi:10.1145/1866307.1866311 · Cited by 558
Self-citationDo security toolbars actually prevent phishing attacks?
Wu, M., Miller, R. C., & Garfinkel, S. L. (2006) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/1124772.1124863 · Cited by 557
So long, and no thanks for the externalities: the rational rejection of security advice by users
Herley, C. (2009) · Proceedings of the 2009 workshop on New security paradigms workshop · doi:10.1145/1719030.1719050 · Cited by 524
Efficient Online and Batch Learning Using Forward Backward Splitting
Duchi, J. C., & Singer, Y. (2009) · Cited by 517
Identifying suspicious URLs: an application of large-scale online learning
Ma, J., Saul, L. K., Savage, S., & Voelker, G. M. (2009) · Proceedings of the 26th Annual International Conference on Machine Learning · doi:10.1145/1553374.1553462 · Cited by 498
Self-citationA framework for detection and measurement of phishing attacks
Garera, S., Provos, N., Chew, M., & Rubin, A. D. (2007) · Proceedings of the 2007 ACM workshop on Recurring malcode · doi:10.1145/1314389.1314391 · Cited by 489
Provos, N., Mavrommatis, P., Rajab, M. A., Monrose, F., Google Inc, Mavrommatis, P., Abu, M., & Monrose, R. F. (2008) · Cited by 479
Detecting and characterizing social spam campaigns
Gao, H., Hu, J., Wilson, C., Li, Z., Chen, Y., & Zhao, B. Y. (2010) · Proceedings of the 10th ACM SIGCOMM conference on Internet measurement · doi:10.1145/1879141.1879147 · Cited by 385
Detecting algorithmically generated malicious domain names
Yadav, S., Reddy, A. K. K., Reddy, A. L. N., & Ranjan, S. (2010) · Proceedings of the 10th ACM SIGCOMM conference on Internet measurement · doi:10.1145/1879141.1879148 · Cited by 355
Wang, Y., Beck, D., Jiang, X., Roussev, R., Verbowski, C., Chen, S., & King, S. T. (2006) · Cited by 331
Measuring and Detecting Fast-Flux Service Networks
Holz, T., Gorecki, C., Rieck, K., & Freiling, F. (2008) · Cited by 321
Large-Scale Automatic Classification of Phishing Pages
Whittaker, C., Ryner, B., & Nazif, M. (2010) · Cited by 319
Filtering spam with behavioral blacklisting
Ramachandran, A., Feamster, N., & Vempala, S. (2007) · Proceedings of the 14th ACM conference on Computer and communications security · doi:10.1145/1315245.1315288 · Cited by 264
Distributed Training Strategies for the Structured Perceptron
McDonald, R., Hall, K., & Mann, G. (2010) · Cited by 262
Detecting and characterizing social spam campaigns
Gao, H., Hu, J., Wilson, C., Li, Z., Chen, Y., & Zhao, B. Y. (2010) · Proceedings of the 17th ACM conference on Computer and communications security · doi:10.1145/1866307.1866396 · Cited by 230
Behind phishing: an examination of phisher modi operandi
McGrath, D. K., & Gupta, M. (2008) · Cited by 212
Efficient Online and Batch Learning Using Forward Backward Splitting
DuchiJohn, & SingerYoram (2009) · Journal of Machine Learning Research · doi:10.5555/1577069.1755882 · Cited by 199
Spamscatter: characterizing internet scam hosting infrastructure
Anderson, D. S., Fleizach, C., Savage, S., & Voelker, G. M. (2007) · eScholarship (California Digital Library) · Cited by 179
On the Effectiveness of Techniques to Detect Phishing Sites
Ludl, C., McAllister, S., Kirda, E., & Kruegel, C. (2007) · Lecture Notes in Computer Science · doi:10.1007/978-3-540-73614-1_2 · Cited by 172
On the potential of proactive domain blacklisting
Félegyházi, M., Kreibich, C., & Paxson, V. (2010) · Cited by 138
Self-citationThe Koobface botnet and the rise of social malware
Thomas, K., & Nicol, D. M. (2010) · International Conference on Malicious and Unwanted Software · doi:10.1109/malware.2010.5665793 · Cited by 122
Self-citationShades of grey: On the effectiveness of reputation-based “blacklists”
Sinha, S., Bailey, M., & Jahanian, F. (2008) · International Conference on Malicious and Unwanted Software · doi:10.1109/malware.2008.4690858 · Cited by 110
Botnet Judo: Fighting Spam with Itself
Pitsillidis, A., Levchenko, K., Kreibich, C., et al. (2010) · Cited by 72
A taxonomy of JavaScript redirection spam
Chellapilla, K., & Maykov, A. (2007) · Adversarial Information Retrieval on the Web · doi:10.1145/1244408.1244423 · Cited by 62
Improving Spam Blacklisting Through Dynamic Thresholding and Speculative Aggregation.
Sinha, S., Bailey, M., & Jahanian, F. (2010) · Cited by 24
Cited by
Apache Spark: A unified engine for big data processing
Zaharia, M., Xin, R. S., Wendell, P., Das, T., Armbrust, M., Dave, A., Meng, X., Rosen, J., Venkataraman, S., Franklin, M. J., et al. (2016) · Communications of the ACM · doi:10.1145/2934664 · Cited by 2,757
Discretized streams: fault-tolerant streaming computation at scale
Zaharia, M., Das, T., Li, H., Hunter, T., Shenker, S., & Stoica, I. (2013) · Proceedings of the Twenty-Fourth ACM Symposium on Operating Systems Principles · doi:10.1145/2517349.2522737 · Cited by 982
Managing data transfers in computer clusters with orchestra
Chowdhury, M., Zaharia, M., Ma, J., Jordan, M. I., & Stoica, I. (2011) · Proceedings of the ACM SIGCOMM 2011 conference · doi:10.1145/2018436.2018448 · Cited by 543
Self-citationA Survey on Machine Learning Techniques for Cyber Security in the Last Decade
Shaukat, K., Luo, S., Varadharajan, V., Hameed, I. A., & Xu, M. (2020) · IEEE Access · doi:10.1109/access.2020.3041951 · Cited by 530
Fame for sale: Efficient detection of fake Twitter followers
Cresci, S., Di Pietro, R., Petrocchi, M., Spognardi, A., & Tesconi, M. (2015) · Decision Support Systems · doi:10.1016/j.dss.2015.09.003 · Cited by 475
Metadata
- Authors
- Thomas, K., Grier, C., Ma, J., Paxson, V., & Song, D.
- Venue
- 2011 IEEE Symposium on Security and Privacy
- Publisher
- IEEE
- Published
- 2011-05
- Pages
- 447-462
- ISSN
- 1081-6011 (ISSN-L)
- OpenAlex
- W2163764145
- Cited by
- 468
- References
- 41
- FWCI
- 28.60
- Type
- conference paper
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.