Crowd Fraud Detection in Internet Advertising
Abstract
The rise of crowdsourcing brings new types of malpractices in Internet advertising. One can easily hire web workers through malicious crowdsourcing platforms to attack other advertisers. Such human generated crowd frauds are hard to detect by conventional fraud detection methods. In this paper, we carefully examine the characteristics of the group behaviors of crowd fraud and identify three persistent patterns, which are moderateness, synchronicity and dispersivity. Then we propose an effective crowd fraud detection method for search engine advertising based on these patterns, which consists of a constructing stage, a clustering stage and a filtering stage. At the constructing stage, we remove irrelevant data and reorganize the click logs into a surfer-advertiser inverted list; At the clustering stage, we define the sync-similarity between surfers' click histories and transform the coalition detection to a clustering problem, solved by a nonparametric algorithm; and finally we build a dispersity filter to remove false alarm clusters. The nonparametric nature of our method ensures that we can find an unbounded number of coalitions with nearly no human interaction. We also provide a parallel solution to make the method scalable to Web data and conduct extensive experiments. The empirical results demonstrate that our method is accurate and scalable.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Identifying organic ASO activities is an open problem due to the ability of such workers to evade existing detection solutions.
“Identifying organic ASO activities is an open problem due to the ability of such workers to evade existing detection solutions, e.g., that leverage lockstep behaviors [32, 43, 51, 72, 73, 78, 85, 86, 89, 92, 93] or review bursts [27, 28, 35, 39, 40, 42, 44, 45, 50-53, 53, 5759, 65, 66, 84, 87, 88, 92].”
From RacketStore (2021) · cites this paper as [78]
Cites
MapReduce: simplified data processing on large clusters
Dean, J., & Ghemawat, S. (2008) · Communications of the ACM · doi:10.1145/1327452.1327492 · Cited by 18,476 · see citing works
Chandola, V., Banerjee, A., & Kumar, V. (2009) · ACM Computing Surveys · doi:10.1145/1541880.1541882 · Cited by 11,687 · see citing works
Mean shift, mode seeking, and clustering
Cheng, Y. (1995) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.400568 · Cited by 3,868 · see citing works
Mixtures of Dirichlet Processes with Applications to Bayesian Nonparametric Problems
Antoniak, C. E. (1974) · The Annals of Statistics · doi:10.1214/aos/1176342871 · Cited by 1,976 · see citing works
Cheap and fast---but is it good?: evaluating non-expert annotations for natural language tasks
Snow, R., O'Connor, B., Jurafsky, D., & Ng, A. Y. (2008) · Proceedings of the Conference on Empirical Methods in Natural Language Processing - EMNLP '08 · doi:10.3115/1613715.1613751 · Cited by 1,887 · see citing works
Crowdsourcing systems on the World-Wide Web
Doan, A., Ramakrishnan, R., & Halevy, A. Y. (2011) · Communications of the ACM · doi:10.1145/1924421.1924442 · Cited by 1,338 · see citing works
CopyCatch: stopping group attacks by spotting lockstep behavior in social networks
Beutel, A., Xu, W., Guruswami, V., Palow, C., & Faloutsos, C. (2013) · Proceedings of the 22nd international conference on World Wide Web · doi:10.1145/2488388.2488400 · Cited by 335 · see citing works
Combining human and machine intelligence in large-scale crowdsourcing
Kamar, E. S., Hacker, S., & Horvitz, E. (2012) · doi:10.5555/2343576.2343643 · Cited by 323 · see citing works
Revisiting k-means: New Algorithms via Bayesian NonparametricsPreprint
Kulis, B., & Jordan, M. I. (2011) · arXiv (Cornell University) · doi:10.48550/arxiv.1111.0352 · Cited by 264 · see citing works
Serf and turf: crowdturfing for fun and profit
Wang, G., Wilson, C., Zhao, X., Zhu, Y., Mohanlal, M., Zheng, H., & Zhao, B. Y. (2012) · Proceedings of the 21st international conference on World Wide Web · doi:10.1145/2187836.2187928 · Cited by 197 · see citing works
Metwally, A., Agrawal, D., & Abbadi, A. E. (2007) · International World Wide Web Conference (WWW) · doi:10.1145/1242572.1242606 · Cited by 123 · see citing works
Small-Variance Asymptotics for Exponential Family Dirichlet Process Mixture Models
Jiang, K., Kulis, B., & Jordan, M. I. (2012) · Cited by 72 · see citing works
Learning from crowds in the presence of schools of thought
Tian, Y., & Zhu, J. (2012) · ACM SIGKDD International Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/2339530.2339571 · Cited by 71 · see citing works
Self-citationDetecting click fraud in online advertising: a data mining approach
Oentaryo, R. J., Lim, E., Finegold, M., Lo, D., Zhu, F., Phua, C., Cheu, E.-Y., Yap, G.-E., Sim, K., Nguyen, M. N., et al. (2014) · Singapore Management University Institutional Knowledge (InK) (Singapore Management University) · Cited by 69 · see citing works
Search engine click spam detection based on bipartite graph propagation
Li, X. Y., Zhang, M., Liu, Y., et al. (2014) · ACM International Conference on Web Search and Data Mining (WSDM) · doi:10.1145/2556195.2556214 · Cited by 23 · see citing works
Small-Variance Asymptotics for Hidden Markov Models
Roychowdhury, A., Jiang, K., & Kulis, B. (2013) · neural information processing systems · Cited by 23 · see citing works
Optimistic Concurrency Control for Distributed Unsupervised LearningPreprint
Pan, X., Gonzalez, J. E., Jegelka, S., et al. (2013) · arXiv (Cornell University) · doi:10.48550/arxiv.1307.8049 · Cited by 14 · see citing works
Small-Variance Asymptotics for Dirichlet Process Mixtures of SVMs
Wang, Y., & Zhu, J. (2014) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v28i1.8959 · Cited by 13 · see citing works
Self-citationDetecting click fraud in online advertising
OentaryoRichard, LimEe-Peng, FinegoldMichael, et al. (2014) · Journal of Machine Learning Research · doi:10.5555/2627435.2627438 · Cited by 12 · see citing works
Fraudulent Support Telephone Number Identification Based on Co-Occurrence Information on the Web
Li, X. Y., Liu, Y., Zhang, M., et al. (2014) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v28i1.8702 · Cited by 4 · see citing works
Flagged first, then by citations
Cited by
Sorted by citations
The Art and Craft of Fraudulent App Promotion in Google Play
Rahman, M., Hernandez, N., Recabarren, R., Ahmed, S. I., & Carbunar, B. (2019) · Proceedings of the 2019 ACM SIGSAC Conference on Computer and Communications Security · doi:10.1145/3319535.3345658 · Cited by 24 · see citing works
Fraud De-Anonymization for Fun and Profit
Hernandez, N., Rahman, M., Recabarren, R., & Carbunar, B. (2018) · Proceedings of the 2018 ACM SIGSAC Conference on Computer and Communications Security · doi:10.1145/3243734.3243770 · Cited by 16 · see citing works
Hernandez, N., Recabarren, R., Carbunar, B., & Ahmed, S. I. (2021) · Proceedings of the 21st ACM Internet Measurement Conference · doi:10.1145/3487552.3487837 · Cited by 3 · see citing works
- Authors
- Tian, T., Zhu, J., Xia, F., Zhuang, X., & Zhang, T.
- Affiliations
- State Key Laboratory of Intelligent Technology and Systems (CN)
- Baidu (China) (CN)
- Venue
- Proceedings of the 24th International Conference on World Wide Web
- Published
- 2015-05-18
- Pages
- 1100-1110
- OpenAlex
- W2235660311
- Cited by
- 67
- References
- 20
- Citations by year
- 2025: 7 · 2024: 5 · 2023: 2 · 2022: 3 · 2021: 13 · 2020: 8 · 2019: 8 · 2018: 12 · 2017: 6 · 2016: 3
- FWCI
- 6.08
- Type
- conference paper
- Language
- en
- Open access
- closed
- Locations
- International World Wide Web Conference (WWW) (publishedVersion)
- Rare & Special e-Zone (The Hong Kong University of Science and Technology) (submittedVersion)
- Funders
- National Basic Research Program (973 Program) of China (2013CB329403)
- National Natural Science Foundation of China (61322308, 61332007)
- Tsinghua National Laboratory for Information Science and Technology Big Data Initiative
- Topics
- Physical Sciences › Computer Science › Information Systems › Spam and Phishing Detection
- Physical Sciences › Computer Science › Computer Science Applications › Mobile Crowdsensing and Crowdsourcing
- Physical Sciences › Computer Science › Information Systems › Web Data Mining and Analysis
- Keywords
- crowdsourcing, search engine advertising, click fraud, nonparametric clustering, parallel scalability
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review