Predicting clicks: estimating the click-through rate for new ads
The DOI matches its Crossref record; 16 of the 16 references it cites were found in a registry or an index.
Abstract
Search engine advertising has become a significant element of the Web browsing experience. Choosing the right ads for the query and the order in which they are displayed greatly affects the probability that a user will see and click on each ad. This ranking has a strong impact on the revenue the search engine receives from the ads. Further, showing the user an ad that they prefer to click on improves user satisfaction. For these reasons, it is important to be able to accurately estimate the click-through rate of ads in the system. For ads that have been displayed repeatedly, this is empirically measurable, but for new ads, other means must be used. We show that we can use features of ads, terms, and advertisers to learn a model that accurately predicts the click-though rate for new ads. We also show that using our model improves the convergence and performance of an advertising system. As a result, our model increases both revenue and user satisfaction.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Citations
Cites
Greedy function approximation: A gradient boosting machine
Friedman, J. H. (2001) · The Annals of Statistics · doi:10.1214/aos/1013203451 · Cited by 30,731
The Elements of Statistical Learning
Hastie, T., Friedman, J., & Tibshirani, R. (2001) · Springer Series in Statistics · doi:10.1007/978-0-387-21606-5 · Cited by 24,162
On Information and Sufficiency
Kullback, S., & Leibler, R. A. (1951) · The Annals of Mathematical Statistics · doi:10.1214/aoms/1177729694 · Cited by 20,193
(2021) · A First Course in Statistical Programming with R · doi:10.1017/9781108993456.011 · Cited by 13,724
(1999) · Springer Series in Operations Research and Financial Engineering · doi:10.1007/b98874 · Cited by 9,482
On the limited memory BFGS method for large scale optimization
Liu, D. C., & Nocedal, J. (1989) · Mathematical Programming · doi:10.1007/bf01589116 · Cited by 8,560
Accessibility of information on the web
Lawrence, S., & Giles, C. L. (1999) · Nature · doi:10.1038/21987 · Cited by 1,349
Improving web search ranking by incorporating user behavior information
Agichtein, E., Brill, E., & Dumais, S. (2006) · Proceedings of the 29th annual international ACM SIGIR conference on Research and development in information retrieval · doi:10.1145/1148170.1148177 · Cited by 1,041
Lawrence, S., & Giles, C. L. (1998) · Science · doi:10.1126/science.280.5360.98 · Cited by 969
Feng, J., Bhargava, H. K., & Pennock, D. M. (2007) · INFORMS Journal on Computing · doi:10.1287/ijoc.1050.0135 · Cited by 278
Research works printed but not linked: 2
- L. Baker , " Google vs. Yahoo: Earnings Reports Comparison ," In Search Engine Journal http://www.searchengine-journal.com/?p=3923. L. Baker, "Google vs. Yahoo: Earnings Reports Comparison," In Search Engine Journal http://www.searchengine-journal.com/?p=3923.
- K. Bartz , V. Murthi , S. Sebastian , "Logistic Regression and Collaborative Filtering for Sponsored Search Term Recommendation" , In Proceedings of the Second Workshop on Sponsored Search Auctions , 2006 . K. Bartz, V. Murthi, S. Sebastian, "Logistic Regression and Collaborative Filtering for Sponsored Search Term Recommendation", In Proceedings of the Second Workshop on Sponsored Search Auctions, 2006.
Cited by
LightGBM: A Highly Efficient Gradient Boosting Decision Tree
(2017) · HAL · Cited by 10,512
DeepFM: A Factorization-Machine based Neural Network for CTR Prediction
Guo, H., TANG, R., Ye, Y., Li, Z., & He, X. (2017) · Proceedings of the Twenty-Sixth International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2017/239 · Cited by 2,538
xDeepFM: Combining Explicit and Implicit Feature Interactions for Recommender Systems
Lian, J., Zhou, X., Zhang, F., Chen, Z., Xie, X., & Sun, G. (2018) · Proceedings of the 24th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining · doi:10.1145/3219819.3220023 · Cited by 1,040
Deep Neural Networks and Tabular Data: A Survey
Borisov, V., Leemann, T., Seßler, K., Haug, J., Pawelczyk, M., & Kasneci, G. (2024) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2022.3229161 · Cited by 1,025
Predicting the popularity of online content
Szabo, G., & Huberman, B. A. (2010) · Communications of the ACM · doi:10.1145/1787234.1787254 · Cited by 983
An experimental comparison of click position-bias models
Craswell, N., Zoeter, O., Taylor, M., & Ramsey, B. (2008) · Proceedings of the international conference on Web search and web data mining - WSDM '08 · doi:10.1145/1341531.1341545 · Cited by 942
Practical Lessons from Predicting Clicks on Ads at Facebook
He, X., Pan, J., Jin, O., Xu, T., Liu, B., Xu, T., Shi, Y., Atallah, A., Herbrich, R., Bowers, S., et al. (2014) · Proceedings of the Eighth International Workshop on Data Mining for Online Advertising · doi:10.1145/2648584.2648589 · Cited by 869
Ad click prediction: a view from the trenches
McMahan, H. B., Holt, G., Sculley, D., Young, M., Ebner, D., Grady, J., Nie, L., Phillips, T., Davydov, E., Golovin, D., et al. (2013) · Proceedings of the 19th ACM SIGKDD international conference on Knowledge discovery and data mining · doi:10.1145/2487575.2488200 · Cited by 867
Expected reciprocal rank for graded relevance
Chapelle, O., Metlzer, D., Zhang, Y., & Grinspan, P. (2009) · Proceedings of the 18th ACM conference on Information and knowledge management · doi:10.1145/1645953.1646033 · Cited by 832
AutoInt: Automatic Feature Interaction Learning via Self-Attentive Neural Networks
Song, W., Shi, C., Xiao, Z., Duan, Z., Xu, Y., Zhang, M., & Tang, J. (2019) · Proceedings of the 28th ACM International Conference on Information and Knowledge Management · doi:10.1145/3357384.3357925 · Cited by 814
Field-aware Factorization Machines for CTR Prediction
Juan, Y., Zhuang, Y., Chin, W.-S., & Lin, C.-J. (2016) · Proceedings of the 10th ACM Conference on Recommender Systems · doi:10.1145/2959100.2959134 · Cited by 712
Machine Learning for Survival Analysis: A Survey
Wang, P., Li, Y., & Reddy, C. K. (2019) · ACM Computing Surveys · doi:10.1145/3214306 · Cited by 691
Product-Based Neural Networks for User Response Prediction
Qu, Y., Cai, H., Ren, K., Zhang, W., Yu, Y., Wen, Y., & Wang, J. (2016) · 2016 IEEE 16th International Conference on Data Mining (ICDM) · doi:10.1109/icdm.2016.0151 · Cited by 670
Fairness of Exposure in Rankings
Singh, A., & Joachims, T. (2018) · Proceedings of the 24th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining · doi:10.1145/3219819.3220088 · Cited by 591
When Do Neural Nets Outperform Boosted Trees on Tabular Data?
McElfresh, D. C., Khandagale, S., Valverde, J., Vishak Prasad, C., Ramakrishnan, G., Goldblum, M., & White, C. (2023) · neural information processing systems · doi:10.52202/075280-3337 · Cited by 556
A dynamic bayesian network click model for web search ranking
Chapelle, O., & Zhang, Y. (2009) · Proceedings of the 18th international conference on World wide web · doi:10.1145/1526709.1526711 · Cited by 537
Unbiased Learning-to-Rank with Biased Feedback
Joachims, T., Swaminathan, A., & Schnabel, T. (2017) · Proceedings of the Tenth ACM International Conference on Web Search and Data Mining · doi:10.1145/3018661.3018699 · Cited by 531
RecBole: Towards a Unified, Comprehensive and Efficient Framework for Recommendation Algorithms
Zhao, W. X., Mu, S., Hou, Y., Lin, Z., Chen, Y., Pan, X., Li, K., Lu, Y., Wang, H., Tian, C., et al. (2021) · Proceedings of the 30th ACM International Conference on Information & Knowledge Management · doi:10.1145/3459637.3482016 · Cited by 455
Deep Learning over Multi-field Categorical Data
Zhang, W., Du, T., & Wang, J. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-30671-1_4 · Cited by 445
(2010) · Cited by 444
Chuklin, A., Markov, I., & de Rijke, M. (2015) · Synthesis Lectures on Information Concepts, Retrieval, and Services · doi:10.1007/978-3-031-02294-4 · Cited by 398
Sequential Click Prediction for Sponsored Search with Recurrent Neural Networks
Zhang, Y., Dai, H., Xu, C., Feng, J., Wang, T., Bian, J., Wang, B., & Liu, T.-Y. (2014) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v28i1.8917 · Cited by 337
Negativity drives online news consumption
Robertson, C. E., Pröllochs, N., Schwarzenegger, K., Pärnamets, P., Van Bavel, J. J., & Feuerriegel, S. (2023) · Nature Human Behaviour · doi:10.1038/s41562-023-01538-4 · Cited by 333
Simple and Scalable Response Prediction for Display Advertising
Chapelle, O., Manavoglu, E., & Rosales, R. (2015) · ACM Transactions on Intelligent Systems and Technology · doi:10.1145/2532128 · Cited by 318
Overlapping experiment infrastructure: more, better, faster experimentation
Tang, D., Agarwal, A., O'Brien, D., & Meyer, M. (2010) · Proceedings of the 16th ACM SIGKDD international conference on Knowledge discovery and data mining · doi:10.1145/1835804.1835810 · Cited by 312
Optimal real-time bidding for display advertising
Zhang, W., Yuan, S., & Wang, J. (2014) · Proceedings of the 20th ACM SIGKDD international conference on Knowledge discovery and data mining · doi:10.1145/2623330.2623633 · Cited by 305
Bias in Online Freelance Marketplaces: Evidence from TaskRabbit and Fiverr
Hannák, A., Wagner, C., Garcia, D., Mislove, A., Strohmaier, M., & Wilson, C. (2017) · Proceedings of the 2017 ACM Conference on Computer Supported Cooperative Work and Social Computing · doi:10.1145/2998181.2998327 · Cited by 286
Learning to Rank with Selection Bias in Personal Search
Wang, X., Bendersky, M., Metzler, D., & Najork, M. (2016) · Proceedings of the 39th International ACM SIGIR conference on Research and Development in Information Retrieval · doi:10.1145/2911451.2911537 · Cited by 284
Efficient multiple-click models in web search
Guo, F., Liu, C., & Wang, Y. M. (2009) · Proceedings of the Second ACM International Conference on Web Search and Data Mining · doi:10.1145/1498759.1498818 · Cited by 275
Position Bias Estimation for Unbiased Learning to Rank in Personal Search
Wang, X., Golbandi, N., Bendersky, M., Metzler, D., & Najork, M. (2018) · Proceedings of the Eleventh ACM International Conference on Web Search and Data Mining · doi:10.1145/3159652.3159732 · Cited by 268
Effective Headlines of Newspaper Articles in a Digital Environment
Kuiken, J., Schuth, A., Spitters, M., & Marx, M. (2017) · Digital Journalism · doi:10.1080/21670811.2017.1279978 · Cited by 254
Cascading Bandits: Learning to Rank in the Cascade ModelPreprint
Kveton, B., Szepesvári, C., Wen, Z., & Ashkan, A. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1502.02763 · Cited by 247
Open Benchmarking for Click-Through Rate Prediction
Zhu, J., Liu, J., Yang, S., Zhang, Q., & He, X. (2021) · ACM International Conference on Information and Knowledge Management (CIKM) · doi:10.1145/3459637.3482486 · Cited by 238
GBDT-MO: Gradient-Boosted Decision Trees for Multiple Outputs
Zhang, Z., & Jung, C. (2021) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2020.3009776 · Cited by 236
Click-through rate prediction in online advertising: A literature review
Yang, Y., & Zhai, P. (2022) · Information Processing & Management · doi:10.1016/j.ipm.2021.102853 · Cited by 227
Product-Based Neural Networks for User Response Prediction over Multi-Field Categorical Data
Qu, Y., Fang, B., Zhang, W., Tang, R., Niu, M., Guo, H., Yu, Y., & He, X. (2019) · ACM Transactions on Information Systems · doi:10.1145/3233770 · Cited by 220
Click chain model in web search
Guo, F., Liu, C., Kannan, A., Minka, T., Taylor, M., Wang, Y.-M., & Faloutsos, C. (2009) · Proceedings of the 18th international conference on World wide web · doi:10.1145/1526709.1526712 · Cited by 219
Cohen, M. C., Lobel, I., & Leme, R. P. (2020) · Management Science · doi:10.1287/mnsc.2019.3485 · Cited by 218
Practical Federated Gradient Boosting Decision Trees
Li, Q., Wen, Z., & He, B. (2020) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v34i04.5895 · Cited by 201
A Survey of Query Auto Completion in Information Retrieval
Cai, F., & de Rijke, M. (2016) · Foundations and Trends® in Information Retrieval · doi:10.1561/1500000055 · Cited by 201
Estimating conversion rate in display advertising from past erformance data
Lee, K.-C., Orten, B., Dasdan, A., & Li, W. (2012) · Proceedings of the 18th ACM SIGKDD international conference on Knowledge discovery and data mining · doi:10.1145/2339530.2339651 · Cited by 197
Feature Generation by Convolutional Neural Network for Click-Through Rate Prediction
Liu, B., Tang, R., Chen, Y., Yu, J., Guo, H., & Zhang, Y. (2019) · International World Wide Web Conference (WWW) · doi:10.1145/3308558.3313497 · Cited by 195
FinalMLP: An Enhanced Two-Stream MLP Model for CTR Prediction
Mao, K., Zhu, J., Su, L., Cai, G., Li, Y., & Dong, Z. (2023) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v37i4.25577 · Cited by 195
Banerjee, A., Alsan, M. M., Breza, E., Chandrasekhar, A. G., Chowdhury, A., Duflo, E., Goldsmith-Pinkham, P. S., & Olken, B. (2020) · National Bureau of Economic Research · doi:10.3386/w27496 · Cited by 195
Lalmas, M., O’Brien, H., & Yom-Tov, E. (2015) · Synthesis Lectures on Information Concepts, Retrieval, and Services · doi:10.1007/978-3-031-02289-0 · Cited by 192
BARS: Towards Open Benchmarking for Recommender Systems
Zhu, J., Dai, Q., Su, L., Ma, R., Liu, J., Cai, G., Xiao, X., & Zhang, R. (2022) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/3477495.3531723 · Cited by 190
Simrank++: query rewriting through link analysis of the click graph
Antonellis, I., Molina, H. G., & Chang, C. C. (2008) · Proceedings of the VLDB Endowment · doi:10.14778/1453856.1453903 · Cited by 187
Optimized Cost per Click in Taobao Display Advertising
Zhu, H., Jin, J., Tan, C., Pan, F., Zeng, Y., Li, H., & Gai, K. (2017) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/3097983.3098134 · Cited by 187
Learning Relaxed Belady for Content Distribution Network Caching
Song, Z., Berger, D. S., Li, K., & Lloyd, W. A. (2020) · Networked Systems Design and Implementation · Cited by 184
Deep CTR Prediction in Display Advertising
Chen, J., Sun, B., Li, H., Lu, H., & Hua, X. (2016) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/2964284.2964325 · Cited by 181
Field-weighted Factorization Machines for Click-Through Rate Prediction in Display Advertising
Pan, J., Xu, J., Ruiz, A. L., Zhao, W., Pan, S., Sun, Y., & Lu, Q. (2018) · Proceedings of the 2018 World Wide Web Conference on World Wide Web - WWW '18 · doi:10.1145/3178876.3186040 · Cited by 176
Estimating Position Bias without Intrusive Interventions
Agarwal, A., Zaitsev, I., Wang, X., Li, C., Najork, M., & Joachims, T. (2019) · Proceedings of the Twelfth ACM International Conference on Web Search and Data Mining · doi:10.1145/3289600.3291017 · Cited by 107
Balakrishnan, S., & Chopra, S. (2012) · ACM International Conference on Web Search and Data Mining (WSDM) · doi:10.1145/2124295.2124314 · Cited by 170
A Study of BFLOAT16 for Deep Learning Training
Kalamkar, D., Mudigere, D., Mellempudi, N., Das, D., Banerjee, K., Avancha, S., Vooturi, D. T., Jammalamadaka, N., Huang, J., Yuen, H., et al. (2019) · arXiv · doi:10.48550/arxiv.1905.12322 · Cited by 169
Ready to buy or just browsing? detecting web searcher goals from interaction data
Guo, Q., & Agichtein, E. (2010) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/1835449.1835473 · Cited by 168
Model Ensemble for Click Prediction in Bing Search Ads
Ling, X., Deng, W., Gu, C., Zhou, H., Li, C., & Sun, F. R. (2017) · International World Wide Web Conference (WWW) · doi:10.1145/3041021.3054192 · Cited by 168
Lalmas, M., O'Brien, H., & Yom‐Tov, E. (2014) · Synthesis lectures on information concepts, retrieval, and services · doi:10.2200/s00605ed1v01y201410icr038 · Cited by 168
Ranking Relevance in Yahoo Search
Yin, D., Hu, Y., Tang, J., Daly, T., Zhou, M., Ouyang, H. J., Chen, J., Kang, C., Deng, H., Nobata, C., et al. (2016) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/2939672.2939677 · Cited by 166
Modeling Interestingness with Deep Neural Networks
Gao, J., Pantel, P., Gamon, M., He, X., & Deng, L. (2014) · Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.3115/v1/d14-1002 · Cited by 165
Deep Learning for Click-Through Rate Estimation
Zhang, W., Qin, J., Guo, W., Tang, R., & He, X. (2021) · International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2021/636 · Cited by 165
Supporting Regularized Logistic Regression Privately and Efficiently
Li, W., Liu, H., Yang, P., & Xie, W. (2016) · PLOS ONE · doi:10.1371/journal.pone.0156479 · Cited by 162
Lifelong Sequential Modeling with Personalized Memorization for User Response Prediction
Ren, K., Qin, J., Fang, Y., Zhang, W., Zheng, L., Bian, W., Zhou, G., Xu, J., Yu, Y. H., Zhu, X., et al. (2019) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/3331184.3331230 · Cited by 160
Contextual advertising by combining relevance with click feedback
Chakrabarti, D., Agarwal, D., & Josifovski, V. (2008) · International World Wide Web Conference (WWW) · doi:10.1145/1367497.1367554 · Cited by 158
Spatio-temporal models for estimating click-through rate
Agarwal, D., Chen, B.-C., & Elango, P. (2009) · International World Wide Web Conference (WWW) · doi:10.1145/1526709.1526713 · Cited by 157
Response prediction using collaborative filtering with hierarchies and side-information
Menon, A. K., Chitrapura, K. P., Garg, S. K., Agarwal, D., & Kota, N. (2011) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/2020408.2020436 · Cited by 156
Investigating the Impact of Gender on Rank in Resume Search Engines
Chen, L., Ma, R., Hannák, A., & Wilson, C. (2018) · Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3173574.3174225 · Cited by 155
Diversifying web search results
Rafiei, D., Bharat, K. A., & Shukla, A. (2010) · International World Wide Web Conference (WWW) · doi:10.1145/1772690.1772770 · Cited by 155
Deconfounding Duration Bias in Watch-time Prediction for Video Recommendation
Zhan, R., Pei, C., Su, Q., Wen, J., Wang, X., Mu, G., Zheng, D., Jiang, P., & Gai, K. (2022) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/3534678.3539092 · Cited by 155
In-IDE Code Generation from Natural Language: Promise and Challenges
Xu, F. F., Vasilescu, B., & Neubig, G. (2022) · ACM Transactions on Software Engineering and Methodology · doi:10.1145/3487569 · Cited by 154
“Ordering effects have been reported in other domains [102] and could also play a role here.”
BackgroundFairness in Ranking, Part II: Learning-to-Rank and Recommender Systems
Zehlike, M., Yang, K., & Stoyanovich, J. (2022) · ACM Computing Surveys · doi:10.1145/3533380 · Cited by 154
A Convolutional Click Prediction Model
Liu, Q., Feng, Y. Z., Wu, S., & Wang, L. (2015) · ACM International Conference on Information and Knowledge Management (CIKM) · doi:10.1145/2806416.2806603 · Cited by 151
Feature Importance in Gradient Boosting Trees with Cross-Validation Feature Selection
Adler, A. I., & Painsky, A. (2022) · Entropy · doi:10.3390/e24050687 · Cited by 149
Real time bid optimization with smooth budget delivery in online advertising
Lee, K.-C., Jalali, A., & Dasdan, A. (2013) · doi:10.1145/2501040.2501979 · Cited by 146
Interpretable Click-Through Rate Prediction through Hierarchical Attention
Li, Z., Cheng, W., Chen, Y., Chen, H., & Wang, W. W. (2020) · ACM International Conference on Web Search and Data Mining (WSDM) · doi:10.1145/3336191.3371785 · Cited by 146
Correcting for Selection Bias in Learning-to-rank Systems
Ovaisi, Z., Ahsan, R., Zhang, Y., Vasilaky, K., & Zheleva, E. (2020) · International World Wide Web Conference (WWW) · doi:10.1145/3366423.3380255 · Cited by 146
Coupled Group Lasso for Web-Scale CTR Prediction in Display Advertising
Yan, L., Li, W.-J., Xue, G.-R., & Han, D. (2014) · International Conference on Machine Learning · Cited by 145
Click-through Prediction for Advertising in Twitter Timeline
Li, C., Lu, Y., Mei, Q., Wang, D., & Pandey, S. (2015) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/2783258.2788582 · Cited by 138
Real-Time Bidding Benchmarking with iPinYou DatasetPreprint
Zhang, W., Yuan, S., Wang, Y.-X., & Shen, X. (2014) · arXiv (Cornell University) · doi:10.48550/arxiv.1407.7073 · Cited by 137
A Closer Look at Deep Learning Methods on Tabular DatasetsPreprint
Ye, H.-J., Liu, S., Cai, H.-R., Zhou, Q.-L., & Zhan, D. (2024) · arXiv (Cornell University) · doi:10.48550/arxiv.2407.00956 · Cited by 137
Deep Learning for User Interest and Response Prediction in Online Display Advertising
Gharibshah, Z., Xingquan Zhu, A., Hainline, A., & Conway, M. A. (2020) · Data Science and Engineering · doi:10.1007/s41019-019-00115-y · Cited by 135
A Survey of Prediction Using Social MediaPreprint
Yu, S., & Kak, S. C. (2012) · arXiv (Cornell University) · doi:10.48550/arxiv.1203.1647 · Cited by 134
TWIN V2: Scaling Ultra-Long User Behavior Sequence Modeling for Enhanced CTR Prediction at Kuaishou
Si, Z., Guan, L., Sun, Z., Zang, X., Lu, J., Hui, Y., Cao, X., Yang, Z., Zheng, Y., Leng, D., et al. (2024) · ACM International Conference on Information and Knowledge Management (CIKM) · doi:10.1145/3627673.3680030 · Cited by 132
Learning to re-rank: query-dependent image re-ranking using click data
Jain, V., & Varma, M. (2011) · International World Wide Web Conference (WWW) · doi:10.1145/1963405.1963447 · Cited by 131
Predicting bounce rates in sponsored search advertisements
Sculley, D., Malkin, R. G., Basu, S., & Bayardo, R. J. (2009) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/1557019.1557161 · Cited by 129
Analyzing and Learning from User Interactions for Search Clarification
Zamani, H., Mitra, B., Chen, E., Lueck, G., Díaz, F., Bennett, P. N., Craswell, N., & Dumais, S. (2020) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/3397271.3401160 · Cited by 129
Online Models for Content Optimization
Agarwal, D., Chen, B.-C., Elango, P., Motgi, N., Park, S.-T., Ramakrishnan, R., Roy, S., & Zachariah, J. (2008) · neural information processing systems · Cited by 127
DCM Bandits: Learning to Rank with Multiple ClicksPreprint
Katariya, S., Kveton, B., Szepesvári, C., & Wen, Z. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1602.03146 · Cited by 127
Bid landscape forecasting in online ad exchange marketplace
Cui, Y. D., Zhang, R., Li, W., & Mao, J. (2011) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/2020408.2020454 · Cited by 125
User-click modeling for understanding and predicting search-behavior
Zhang, Y., Chen, W., Wang, D., & Yang, Q. (2011) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/2020408.2020613 · Cited by 123
Boosting Tree-Assisted Multitask Deep Learning for Small Scientific Datasets
Jian, J., Wang, R., Wang, M., Gao, K., Nguyen, D. D., & Wei, G. (2020) · Journal of Chemical Information and Modeling · doi:10.1021/acs.jcim.9b01184 · Cited by 123
Evaluating Search Engines by Modeling the Relationship Between Relevance and Clicks
Carterette, B., & Jones, R. (2007) · ScholarWorks@UMassAmherst (University of Massachusetts Amherst) · Cited by 122
Fairness in Ranking: A SurveyPreprint
Zehlike, M., Yang, K., & Stoyanovich, J. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2103.14000 · Cited by 122
Online Learning to Rank in Stochastic Click ModelsPreprint
Zoghi, M., Tunys, T., Ghavamzadeh, M., Kveton, B., Szepesvári, C., & Wen, Z. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1703.02527 · Cited by 121
Bidding Machine: Learning to Bid for Directly Optimizing Profits in Display Advertising
Ren, K., Zhang, W., Chang, K., Rong, Y., Yu, Y. H., & Wang, Y.-X. (2017) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2017.2775228 · Cited by 120
Evaluation of Advertising Campaigns on Social Media Networks
Raudeliūnienė, J., Davidavičienė, V., Tvaronavičienė, M., & Jonuška, L. (2018) · Sustainability · doi:10.3390/su10040973 · Cited by 120
An Introduction to Feature Selection
Kühn, M., & Johnson, K. (2013) · Springer eBooks · doi:10.1007/978-1-4614-6849-3_19 · Cited by 117
FM2: Field-matrixed Factorization Machines for Recommender Systems
Sun, Y., Pan, J., Zhang, A., & Flores, A. (2021) · International World Wide Web Conference (WWW) · doi:10.1145/3442381.3449930 · Cited by 117
Data Sketches for Disaggregated Subset Sum and Frequent Item Estimation
Ting, D. (2018) · ACM SIGMOD International Conference on Management of Data (SIGMOD) · doi:10.1145/3183713.3183759 · Cited by 115
User Response Prediction in Online Advertising
Gharibshah, Z., & Xingquan Zhu, A. (2021) · ACM Computing Surveys · doi:10.1145/3446662 · Cited by 112
Automatic ad format selection via contextual bandits
Tang, L., Rosales, R., Singh, A., & Agarwal, D. (2013) · Proceedings of the 22nd ACM international conference on Information & Knowledge Management · doi:10.1145/2505515.2514700 · Cited by 111
Metadata
- Authors
- Richardson, M., Dominowska, E., & Ragno, R.
- Affiliations
- Microsoft (United States) (US)
- Venue
- Proceedings of the 16th international conference on World Wide Web
- Publisher
- ACM
- Published
- 2007-05-08
- Pages
- 521-530
- OpenAlex
- W2090883204
- Cited by
- 1,049
- References
- 16
- Citations by year
- 2026: 35 · 2025: 54 · 2024: 64 · 2023: 74 · 2022: 73 · 2021: 71 · 2020: 90 · 2019: 66 · 2018: 55 · 2017: 71 · 2016: 47 · 2015: 51 · 2014: 56 · 2013: 43 · 2012: 42
- FWCI
- 27.83
- Type
- conference paper
- Language
- en
- Open access
- closed
- Locations
- International World Wide Web Conference (WWW) (publishedVersion)
- Topics
- Physical Sciences › Computer Science › Information Systems › Information Retrieval and Search Behavior
- Physical Sciences › Computer Science › Information Systems › Recommender Systems and Techniques
- Physical Sciences › Computer Science › Information Systems › Web Data Mining and Analysis
- Keywords
- search engine advertising, click-through rate prediction, ad ranking, advertising revenue, user satisfaction, online learning
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.