A Comparison of Approaches to Advertising Measurement: Evidence from Big Field Experiments at Facebook

The central role of the propensity score in observational studies for causal effects

ROSENBAUM, P. R., & RUBIN, D. B. (1983) · Biometrika · doi:10.1093/biomet/70.1.41 · Cited by 31,241 · see citing works

An introduction to ROC analysis

Fawcett, T. (2006) · Pattern Recognition Letters · doi:10.1016/j.patrec.2005.10.010 · Cited by 21,879 · see citing works

Data Analysis Using Regression and Multilevel/Hierarchical Models

Gelman, A., & Hill, J. (2006) · doi:10.1017/cbo9780511790942 · Cited by 13,597 · see citing works

Constructing a Control Group Using Multivariate Matched Sampling Methods That Incorporate the Propensity Score

Rosenbaum, P., & Rubin, D. (1985) · The American Statistician · doi:10.2307/2683903 · Cited by 6,854 · see citing works

SOME PRACTICAL GUIDANCE FOR THE IMPLEMENTATION OF PROPENSITY SCORE MATCHING

Caliendo, M., & Kopeinig, S. (2008) · Journal of Economic Surveys · doi:10.1111/j.1467-6419.2007.00527.x · Cited by 6,238 · see citing works

Matching Methods for Causal Inference: A Review and a Look Forward

Stuart, E. A. (2010) · Statistical Science · doi:10.1214/09-sts313 · Cited by 5,478 · see citing works

Recent Developments in the Econometrics of Program Evaluation

Imbens, G. W., & Wooldridge, J. M. (2009) · Journal of Economic Literature · doi:10.1257/jel.47.1.5 · Cited by 4,926 · see citing works

Propensity Score-Matching Methods for Nonexperimental Causal Studies

Dehejia, R., & Wahba, S. (2002) · The Review of Economics and Statistics · doi:10.1162/003465302317331982 · Cited by 4,777 · see citing works

Causal Inference for Statistics, Social, and Biomedical Sciences: An Introduction

Imbens, G. W., & Rubin, D. B. (2015) · doi:10.1017/cbo9781139025751 · Cited by 4,210 · see citing works

Identification and estimation of local average treatment effects

Imbens, G. W., & Angrist, J. D. (1994) · Econometrica · doi:10.2307/2951620 · Cited by 4,101 · see citing works

Selection on observed and unobserved variables: Assessing the effectiveness of Catholic schools

Altonji, J. G., Elder, T. E., & Taber, C. R. (2005) · Journal of Political Economy · doi:10.1086/426036 · Cited by 3,706 · see citing works

Nonparametric Estimation of Average Treatment Effects Under Exogeneity: A Review

Imbens, G. W. (2004) · Review of Economics and Statistics · doi:10.1162/003465304323023651 · Cited by 2,994 · see citing works

Efficient Estimation of Average Treatment Effects Using the Estimated Propensity Score

Hirano, K., Imbens, G. W., & Ridder, G. (2003) · Econometrica · doi:10.1111/1468-0262.00442 · Cited by 2,525 · see citing works

Bayesian inference for causal effects: The role of randomization

Rubin, D. B. (1978) · The Annals of Statistics · doi:10.1214/aos/1176344064 · Cited by 2,503 · see citing works

Using Propensity Scores to Help Design Observational Studies: Application to the Tobacco Litigation

Rubin, D. B. (2001) · Health Services and Outcomes Research Methodology · doi:10.1023/a:1020363010465 · Cited by 2,228 · see citing works

Covariate Balancing Propensity Score

Imai, K., & Ratkovic, M. (2013) · Journal of the Royal Statistical Society Series B (Statistical Methodology) · doi:10.1111/rssb.12027 · Cited by 1,330 · see citing works

Propensity score estimation with boosted regression for evaluating causal effects in observational studies

McCaffrey, D. F., Ridgeway, G., & Morral, A. R. (2004) · Psychological Methods · doi:10.1037/1082-989x.9.4.403 · Cited by 1,317 · see citing works

Inverse probability weighted estimation for general missing data problems

Wooldridge, J. M. (2007) · Journal of Econometrics · doi:10.1016/j.jeconom.2007.02.002 · Cited by 1,029 · see citing works

From Social to Sale: The Effects of Firm-Generated Content in Social Media on Customer Behavior

Kumar, A., Bezawada, R., Rishika, R., Janakiraman, R., & Kannan, P. K. (2015) · Journal of Marketing · doi:10.1509/jm.14.0249 · Cited by 1,006 · see citing works

Best Practices in Quantitative Methods

Osborne, J. W. (2008) · Sage eBooks · doi:10.4135/9781412995627 · Cited by 961 · see citing works

The Effectiveness of Adjustment by Subclassification in Removing Bias in Observational Studies

Cochran, W. G. (1968) · Biometrics · doi:10.2307/2528036 · Cited by 961 · see citing works

Matching on the Estimated Propensity Score

Abadie, A., & Imbens, G. W. (2016) · Econometrica · doi:10.3982/ecta11293 · Cited by 902 · see citing works

Sparse Models and Methods for Optimal Instruments With an Application to Eminent Domain

Belloni, A., Chen, D. L., Chernozhukov, V., & Hansen, C. (2012) · Econometrica · doi:10.3982/ecta9626 · Cited by 892 · see citing works

Online Display Advertising: Targeting and Obtrusiveness

Avi Goldfarb, B., & Tucker, C. E. (2011) · Marketing Science · doi:10.1287/mksc.1100.0583 · Cited by 801 · see citing works

On the Failure of the Bootstrap for Matching Estimators

Abadie, A., & Imbens, G. W. (2008) · Econometrica · doi:10.3982/ecta6474 · Cited by 800 · see citing works

Large Sample Confidence Regions Based on Subsamples under Minimal Assumptions

Politis, D. N., & Romano, J. P. (1994) · The Annals of Statistics · doi:10.1214/aos/1176325770 · Cited by 748 · see citing works

Comparison of Multivariate Matching Methods: Structures, Distances, and Algorithms

Gu, X. S., & Rosenbaum, P. R. (1993) · Journal of Computational and Graphical Statistics · doi:10.1080/10618600.1993.10474623 · Cited by 702 · cited 1× · see citing works

From temporary help jobs to permanent employment: what can we learn from matching estimators and their sensitivity?

Ichino, A., Mealli, F., & Nannicini, T. (2008) · Journal of Applied Econometrics · doi:10.1002/jae.998 · Cited by 601 · see citing works

Sensitivity to Exogeneity Assumptions in Program Evaluation

Imbens, G. W. (2003) · American Economic Review · doi:10.1257/000282803321946921 · Cited by 529 · see citing works

Propensity score estimation: neural networks, support vector machines, decision trees (CART), and meta-classifiers as alternatives to logistic regression

Westreich, D. J., Lessler, J., & Funk, M. J. (2010) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2009.11.020 · Cited by 505 · see citing works

Matching Methods in Practice: Three Examples

Imbens, G. W. (2015) · The Journal of Human Resources · doi:10.3368/jhr.50.2.373 · Cited by 473 · see citing works

Changing Names with Style: Mutual Fund Name Changes and Their Effects on Fund Flows

COOPER, M. J., GULEN, H., & RAU, P. R. (2005) · The Journal of Finance · doi:10.1111/j.1540-6261.2005.00818.x · Cited by 472 · see citing works

Stable weights that balance covariates for estimation with incomplete outcome data

Zubizarreta, J. R. (2015) · Journal of the American Statistical Association · doi:10.1080/01621459.2015.1023805 · Cited by 369 · cited 1× · see citing works

Consumer Heterogeneity and Paid Search Effectiveness: A Large-Scale Field Experiment

Blake, T., Nosko, C., & Tadelis, S. (2015) · Econometrica · doi:10.3982/ecta12423 · Cited by 356 · see citing works

Approximate Residual Balancing: Debiased Inference of Average Treatment Effects in High Dimensions

Athey, S. C., Imbens, G. W., & Wager, S. (2018) · Journal of the Royal Statistical Society Series B (Statistical Methodology) · doi:10.1111/rssb.12268 · Cited by 317 · see citing works

A Three-step Method for Choosing the Number of Bootstrap Repetitions

Andrews, D. W. K., & Buchinsky, M. (2000) · Econometrica · doi:10.1111/1468-0262.00092 · Cited by 309 · see citing works

Does alcohol advertising promote adolescent drinking? Results from a longitudinal assessment

Ellickson, P. L., Collins, R. L., Hambarsoomians, K., & McCaffrey, D. F. (2005) · Addiction · doi:10.1111/j.1360-0443.2005.00974.x · Cited by 295 · see citing works

The Unfavorable Economics of Measuring the Returns to Advertising *

Lewis, R. A., & Rao, J. M. (2015) · The Quarterly Journal of Economics · doi:10.1093/qje/qjv023 · Cited by 284 · see citing works

Optimal multivariate matching before randomization.

Greevy, R., Lu, B., Silber, J., & Rosenbaum, P. (2004) · Biostatistics · doi:10.1093/biostatistics/5.2.263 · Cited by 233 · see citing works

Using Mixed Integer Programming for Matching in an Observational Study of Kidney Failure After Surgery

Zubizarreta, J. R. (2012) · Journal of the American Statistical Association · doi:10.1080/01621459.2012.703874 · Cited by 219 · see citing works

Online ads and offline sales: measuring the effect of retail advertising via a controlled experiment on Yahoo!

Lewis, R. A., & Reiley, D. H. (2014) · Quantitative Marketing and Economics · doi:10.1007/s11129-014-9146-6 · Cited by 211 · see citing works

Efficiency Wages Reconsidered: Theory and Evidence

Murphy, K., & Topel, R. (1990) · Palgrave Macmillan UK eBooks · doi:10.1007/978-1-349-10688-2_8 · Cited by 197 · see citing works

Ghost Ads: Improving the Economics of Measuring Online Ad Effectiveness

Johnson, G. A., Lewis, R. A., & Nubbemeyer, E. (2017) · Journal of Marketing Research · doi:10.1509/jmr.15.0297 · Cited by 173 · see citing works

Here, there, and everywhere

Lewis, R. A., Rao, J. M., & Reiley, D. (2011) · International World Wide Web Conference (WWW) · doi:10.1145/1963405.1963431 · Cited by 108 · see citing works

Effect of temporal spacing between advertising exposures: Evidence from online field experiments

Sahni, N. S. (2015) · Quantitative Marketing and Economics · doi:10.1007/s11129-015-9159-9 · Cited by 103 · see citing works

Estimating the Causal Effects of Marketing Interventions Using Propensity Score Methodology

Rubin, D., & Waterman, R. P. (2006) · Statistical Science · doi:10.1214/088342306000000259 · Cited by 94 · see citing works

The performance of non-experimental designs in the evaluation of environmental programs: A design-replication study using a large-scale randomized experiment as a benchmark

Ferraro, P. J., & Miranda, J. J. (2014) · Journal of Economic Behavior & Organization · doi:10.1016/j.jebo.2014.03.008 · Cited by 83 · see citing works

Do Digital Video Recorders Influence Sales?

Bronnenberg, B. J., Dubé, J., & Mela, C. F. (2010) · Journal of Marketing Research · doi:10.1509/jmkr.47.6.998 · Cited by 79 · see citing works

When Less Is More: Data and Power in Advertising Experiments

Johnson, G. A., Lewis, R. A., & Reiley, D. (2016) · Marketing Science · doi:10.1287/mksc.2016.0998 · Cited by 79 · see citing works

EFFECTS OF COVARIATE OMISSION AND CATEGORIZATION WHEN ANALYSING RANDOMIZED TRIALS WITH THE COX MODEL

Schmoor, C., & Schumacher, M. C. (1997) · Statistics in Medicine · doi:10.1002/(sici)1097-0258(19970215)16:3 · Cited by 73 · see citing works

Estimating the causal effects of marketing interventions using propensity score methodologyPreprint

Rubin, D. B., & Waterman, R. P. (2006) · Cited by 69 · see citing works

Internet versus Television Advertising: A Brand-Building Comparison

Draganska, M., Hartmann, W. R., & Stanglein, G. (2013) · Journal of Marketing Research · doi:10.1509/jmr.13.0124 · Cited by 62 · see citing works

Cross channel effects of search engine advertising on brick & mortar retail sales: Meta analysis of large scale field experiments on Google.com

Kalyanam, K., McAteer, J., Marek, J., Hodges, J. S., & Lin, L. (2017) · Quantitative Marketing and Economics · doi:10.1007/s11129-017-9188-7 · Cited by 46 · see citing works

A Cautionary Note on the Use of Matching to Estimate Causal Effects: An Empirical Example Comparing Matching Estimates to an Experimental Benchmark

Arceneaux, K., Gerber, A. S., & GREEN, D. P. (2010) · Sociological Methods & Research · doi:10.1177/0049124110378098 · Cited by 43 · see citing works

El éxito seguro que fracasó

Zaltman, G., Zaltman, L., Sturgess, D. J., Lee, A., Fujikawa, Y., & Carbone, L. P. (2008) · Harvard business review · Cited by 17 · see citing works

The future of social media in marketing

Appel, G., Grewal, L., Hadi, R., & Stephen, A. T. (2020) · Journal of the Academy of Marketing Science · doi:10.1007/s11747-019-00695-1 · Cited by 1,893 · see citing works

Trustworthy Online Controlled Experiments: A Practical Guide to A/B Testing

Kohavi, R., Tang, D., & Xu, Y. (2020) · doi:10.1017/9781108653985 · Cited by 297 · see citing works

Online and offline retailing: What we know and directions for future research

Ratchford, B. T., Soysal, G., Zentner, A., & Gauri, D. K. (2022) · Journal of Retailing · doi:10.1016/j.jretai.2022.02.007 · Cited by 203 · see citing works

Online Display Advertising Markets: A Literature Review and Future Directions

Choi, H., Mela, C. F., Balseiro, S. R., & Leary, A. (2020) · Information Systems Research · doi:10.1287/isre.2019.0902 · Cited by 181 · see citing works

Inefficiencies in Digital Advertising Markets

Gordon, B. R., Jerath, K., Katona, Z., Narayanan, S., Shin, J., & Wilbur, K. C. (2020) · Journal of Marketing · doi:10.1177/0022242920913236 · Cited by 163 · see citing works

A Survey on Data Pricing: From Economics to Data Science

Pei, J. (2020) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2020.3045927 · Cited by 171 · see citing works

Sunny, Rainy, and Cloudy with a Chance of Mobile Promotion Effectiveness

Li, C., Luo, X., Zhang, C., & Wang, X. (2017) · Marketing Science · doi:10.1287/mksc.2017.1044 · Cited by 145 · see citing works

Causal Inference Methods for Combining Randomized Trials and Observational Studies: A Review

Colnet, B., Mayer, I., Chen, G., Dieng, A., Li, R., Varoquaux, G. P., Vert, J., Josse, J., & Yang, S. (2024) · Statistical Science · doi:10.1214/23-sts889 · Cited by 141 · see citing works

Text and Causal Inference: A Review of Using Text to Remove Confounding from Causal Estimates

Keith, K. A., Jensen, D. D., & O’Connor, B. (2020) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2020.acl-main.474 · Cited by 110 · see citing works

Encouraging pro-environmental behaviour through green identity labelling

Schwartz, D., Loewenstein, G. F., & Agüero-Gaete, L. (2020) · Nature Sustainability · doi:10.1038/s41893-020-0543-4 · Cited by 100 · see citing works

Words Meet Photos: When and Why Photos Increase Review Helpfulness

Ceylan, G., Diehl, K., & Proserpio, D. (2023) · Journal of Marketing Research · doi:10.1177/00222437231169711 · Cited by 104 · see citing works

Mega or Micro? Influencer Selection Using Follower Elasticity

Tian, Z., Dew, R., & Iyengar, R. (2023) · Journal of Marketing Research · doi:10.1177/00222437231210267 · Cited by 95 · see citing works

Challenges and Future Directions of Computational Advertising Measurement Systems

Yun, J. T., Segijn, C. M., Pearson, S., Malthouse, E. C., Konstan, J. A., & Shankar, V. (2020) · Journal of Advertising · doi:10.1080/00913367.2020.1795757 · Cited by 93 · see citing works

Close Enough? A Large-Scale Exploration of Non-Experimental Approaches to Advertising Measurement

Gordon, B. R., Moakler, R., & Zettelmeyer, F. (2022) · Marketing Science · doi:10.1287/mksc.2022.1413 · Cited by 108 · see citing works

Causal inference and data fusion in econometrics

Hünermund, P., & Bareinboim, E. (2023) · Econometrics Journal · doi:10.1093/ectj/utad008 · Cited by 82 · see citing works

How rich is too rich? Visual design elements in digital marketing communications

Bashirzadeh, Y., Mai, R., & Faure, C. (2021) · International Journal of Research in Marketing · doi:10.1016/j.ijresmar.2021.06.008 · Cited by 80 · see citing works

When Less Is More: Data and Power in Advertising Experiments

Johnson, G. A., Lewis, R. A., & Reiley, D. (2016) · Marketing Science · doi:10.1287/mksc.2016.0998 · Cited by 79 · see citing works

Evaluation Methods and Measures for Causal Learning Algorithms

Cheng, L., Guo, R., Moraffah, R., Sheth, P., Candan, K. S., & Liu, H. (2022) · IEEE Transactions on Artificial Intelligence · doi:10.1109/tai.2022.3150264 · Cited by 78 · see citing works

Crowdfunding a monthly income: an analysis of the membership platform Patreon

Regner, T. (2020) · Journal of Cultural Economics · doi:10.1007/s10824-020-09381-5 · Cited by 72 · see citing works

The Effectiveness of Triggered Email Marketing in Addressing Browse Abandonments

Goić, M., Rojas, A., & saavedra, I. (2021) · Journal of Interactive Marketing · doi:10.1016/j.intmar.2021.02.002 · Cited by 68 · see citing works

On the role of social media platforms in the creator economy

Bleier, A., Fossen, B. L., & Shapira, M. (2024) · International Journal of Research in Marketing · doi:10.1016/j.ijresmar.2024.06.006 · Cited by 84 · see citing works

Digital public health interventions at scale: The impact of social media advertising on beliefs and outcomes related to COVID vaccines

Athey, S. C., Grabarz, K., Luca, M., & Wernerfelt, N. (2023) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.2208110120 · Cited by 67 · see citing works

Field studies of psychologically targeted ads face threats to internal validity

Eckles, D., Gordon, B. R., & Johnson, G. A. (2018) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1805363115 · Cited by 66 · see citing works

Measuring Consumer Sensitivity to Audio Advertising: A Field Experiment on Pandora Internet RadioPreprint

Huang, J., Reiley, D., & Riabov, N. M. (2018) · SSRN Electronic Journal · doi:10.2139/ssrn.3166676 · Cited by 66 · see citing works

Estimating Marketing Component Effects: Double Machine Learning from Targeted Digital Promotions

Ellickson, P. B., Kar, W., & Reeder, J. C. (2022) · Marketing Science · doi:10.1287/mksc.2022.1401 · Cited by 63 · see citing works

The experimental evaluation of brand strength and brand value

He, J., & Calder, B. J. (2020) · Journal of Business Research · doi:10.1016/j.jbusres.2020.04.035 · Cited by 60 · see citing works

Evaluating Treatment Prioritization Rules via Rank-Weighted Average Treatment Effects

Yadlowsky, S., Fleming, S. L., Shah, N. H., Brunskill, E., & Wager, S. (2024) · Journal of the American Statistical Association · doi:10.1080/01621459.2024.2393466 · Cited by 61 · see citing works

Leveraging Digital Advertising Platforms for Consumer Research

Braun, M. I., de Langhe, B., Puntoni, S., & Schwartz, E. M. (2023) · Journal of Consumer Research · doi:10.1093/jcr/ucad058 · Cited by 54 · see citing works

Causal Decision Making and Causal Effect Estimation Are Not the Same…and Why It Matters

Fernández-Loría, C., & Provost, F. J. (2022) · INFORMS Journal on Data Science · doi:10.1287/ijds.2021.0006 · Cited by 52 · see citing works

Promoting new pro-environmental behaviors: The effect of combining encouraging and discouraging messages

Kronrod, A., Tchetchik, A., Grinstein, A., Turgeman, L., & Blass, V. D. (2022) · Journal of Environmental Psychology · doi:10.1016/j.jenvp.2022.101945 · Cited by 53 · see citing works

Digital Economics

Avi Goldfarb, B., & Tucker, C. E. (2017) · National Bureau of Economic Research · doi:10.3386/w23684 · Cited by 47 · see citing works

When Big Is Less than Small: Why dominant brands lack authenticity in their sustainability initiatives

Wallach, K. A., & Popovich, D. L. (2023) · Journal of Business Research · doi:10.1016/j.jbusres.2023.113694 · Cited by 44 · see citing works

Targeting for Long-Term Outcomes

Yang, J., Eckles, D., Dhillon, P. S., & Aral, S. (2023) · Management Science · doi:10.1287/mnsc.2023.4881 · Cited by 44 · see citing works

For Startups, Adaptability and Mentor Network Diversity Can be Pivotal: Evidence from a Randomized Experiment on a MOOC Platform

Eesley, C. E., & Wu, L. (2020) · MIS Quarterly · doi:10.25300/misq/2020/15138 · Cited by 43 · see citing works

Where A/B Testing Goes Wrong: How Divergent Delivery Affects What Online Experiments Cannot (and Can) Tell You About How Customers Respond to Advertising

Braun, M. I., & Schwartz, E. M. (2024) · Journal of Marketing · doi:10.1177/00222429241275886 · Cited by 45 · see citing works

Social media analytics for business-to-business marketing

Agnihotri, R., Bakeshloo, K. A., & Mani, S. (2023) · Industrial Marketing Management · doi:10.1016/j.indmarman.2023.09.012 · Cited by 43 · see citing works

Privacy-Centric Digital Advertising: Implications for Research

Johnson, G. A., Runge, J., & Seufert, E. B. (2022) · Customer Needs and Solutions · doi:10.1007/s40547-022-00125-4 · Cited by 38 · see citing works

How online advertising targets consumers: The uses of categories and algorithmic tools by audience planners

Beauvisage, T., Beuscart, J.-S., Coavoux, S., & Mellet, K. (2024) · New Media & Society · doi:10.1177/14614448221146174 · Cited by 37 · see citing works

The history of academic research in marketing and its implications for the future

Ratchford, B. T. (2020) · Spanish Journal of Marketing - ESIC · doi:10.1108/sjme-11-2019-0096 · Cited by 41 · see citing works

Minimax-Optimal Policy Learning Under Unobserved Confounding

Kallus, N., & Zhou, A. (2020) · Management Science · doi:10.1287/mnsc.2020.3699 · Cited by 37 · see citing works

Online Display Advertising Markets: A Literature Review and Future DirectionsPreprint

Choi, H., Mela, C. F., Balseiro, S., & Leary, A. (2019) · SSRN Electronic Journal · doi:10.2139/ssrn.3070706 · Cited by 38 · see citing works

Digital marketing

Avi Goldfarb, B., & Tucker, C. E. (2019) · Handbook of economics marketing · doi:10.1016/bs.hem.2019.04.004 · Cited by 40 · see citing works

A Near-Optimal Bidding Strategy for Real-Time Display Advertising Auctions

Tunuguntla, S., & Hoban, P. R. (2020) · Journal of Marketing Research · doi:10.1177/0022243720968547 · Cited by 33 · see citing works

Inferno: A Guide to Field Experiments in Online Display Advertising

Johnson, G. A. (2020) · Journal of Economics & Management Strategy · doi:10.1111/jems.12513 · Cited by 33 · see citing works

False Discovery in A/B Testing

Berman, R., & den Bulte, C. V. (2020) · Management Science · doi:10.1287/mnsc.2021.4207 · Cited by 34 · see citing works

Frontiers: Which Firms Gain from Digital Advertising? Evidence from a Field Experiment

Dai, W., Kim, H., & Luca, M. (2023) · Marketing Science · doi:10.1287/mksc.2023.1436 · Cited by 31 · see citing works

Evaluating the impact of storytelling in Facebook advertisements on wildlife conservation engagement: Lessons and challenges

Shreedhar, G. (2021) · Conservation Science and Practice · doi:10.1111/csp2.534 · Cited by 30 · see citing works

How Viewer Tuning, Presence, and Attention Respond to Ad Content and Predict Brand Search Lift

McGranaghan, M., Liaukonytė, J., & Wilbur, K. C. (2022) · Marketing Science · doi:10.1287/mksc.2021.1344 · Cited by 30 · see citing works

The Effects of Content Ephemerality on Information Processing

Barnea, U., Meyer, R. J., & Nave, G. (2020) · Journal of Marketing Research · doi:10.1177/00222437221131047 · Cited by 32 · see citing works

The one to watch: Heuristic Determinants of Viewership among Influential Twitch Streamers

Church, E. M. (2022) · Electronic Commerce Research · doi:10.1007/s10660-022-09589-x · Cited by 29 · see citing works

Add More Ads? Experimentally Measuring Incremental Purchases Due to Increased Frequency of Online Display AdvertisingPreprint

Johnson, G. A., Lewis, R. A., & Reiley, D. (2013) · SSRN Electronic Journal · doi:10.2139/ssrn.2268215 · Cited by 26 · see citing works

Think positive! Emotional response to assertiveness in positive and negative language promoting preventive health behaviors

Kronrod, A., Grinstein, A., & Shuval, K. (2021) · Psychology and Health · doi:10.1080/08870446.2021.1942876 · Cited by 25 · see citing works

Understanding cybercrime involvement: a quasi-experiment on engagement with money mule recruitment ads on Instagram

Bekkers, L. M. J., Moneva, A., & Leukfeldt, R. (2022) · Journal of Experimental Criminology · doi:10.1007/s11292-022-09537-7 · Cited by 25 · see citing works

Advertising and Brand Attitudes: Evidence from 575 Brands Over Five Years

Du, R. Y., Joo, M., & Wilbur, K. C. (2018) · Quantitative Marketing and Economics · doi:10.1007/s11129-018-9204-6 · Cited by 25 · see citing works

Estimating the Value of Offsite Tracking Data to Advertisers: Evidence from Meta

Wernerfelt, N., Tuchman, A. E., Shapiro, B. T., & Moakler, R. (2024) · Marketing Science · doi:10.1287/mksc.2023.0274 · Cited by 24 · see citing works

Estimating Causal Effects With Observational Data: Guidelines for Agricultural and Applied Economists

Henningsen, A., Low, G., Wuepper, D., Dalhaus, T., Storm, H., Belay, D., & Hirsch, S. (2025) · Journal of Agricultural Economics · doi:10.1111/1477-9552.70019 · Cited by 28 · see citing works

Guess What …?—How Guessed Norms Nudge Climate-Friendly Food Choices in Real-Life Settings

Griesoph, A., Hoffmann, S., Merk, C., Katrin Rehdanz, A., & Schmidt, U. (2021) · Sustainability · doi:10.3390/su13158669 · Cited by 22 · see citing works

Incentive Misalignments in Programmatic Advertising: Evidence from a Randomized Field Experiment

Frick, T. W., Belo, R., & Telang, R. (2022) · Management Science · doi:10.1287/mnsc.2022.4438 · Cited by 22 · see citing works

Spillovers from Mass Advertising: An Identification Strategy

Thomas, M. (2020) · Marketing Science · doi:10.1287/mksc.2019.1217 · Cited by 21 · see citing works

Targeting Advertising Spending and Price on the Hotelling Line

Moorthy, S., & Tehrani, S. S. (2023) · Marketing Science · doi:10.1287/mksc.2022.1422 · Cited by 21 · see citing works

Dude, Where’s My Treatment Effect? Errors in Administrative Data Linking and the Destruction of Statistical Power in Randomized Experiments

Tahamont, S., Jelveh, Z., Chalfin, A. J., Yan, S., & Hansen, B. (2020) · Journal of Quantitative Criminology · doi:10.1007/s10940-020-09461-x · Cited by 19 · see citing works

Understanding the differential effectiveness of marketer versus user-generated advertisements in closed social networking sites: an empirical study of WeChat

Teng, T., Li, H., Fang, Y., & Shen, L. (2022) · Internet Research · doi:10.1108/intr-04-2021-0268 · Cited by 20 · see citing works

Artificial intelligence and algorithmic bias? Field tests on social network with teens

Cecere, G., Jean, C., Guel, F. L., & Manant, M. (2024) · Technological Forecasting and Social Change · doi:10.1016/j.techfore.2023.123204 · Cited by 23 · see citing works

I Don't Know

Backus, M., & Little, A. T. (2018) · National Bureau of Economic Research · doi:10.3386/w24994 · Cited by 19 · see citing works

Online Advertising as Passive Search

Ursu, R. M., Simonov, A., & An, E. (2021) · Management Science · doi:10.1287/mnsc.2022.02154 · Cited by 18 · see citing works

Optimal Microtargeting of Advertising

Danaher, P. J. (2022) · Journal of Marketing Research · doi:10.1177/00222437221116034 · Cited by 18 · see citing works

No evidence for loss aversion disappearance and reversal in Walasek and Stewart (2015).

André, Q., & de Langhe, B. (2021) · Journal of Experimental Psychology General · doi:10.1037/xge0001052 · Cited by 18 · see citing works

Reply to Eckles et al.: Facebook’s optimization algorithms are highly unlikely to explain the effects of psychological targeting

Matz, S. C., Kosiński, M., Nave, G., & Stillwell, D. J. (2018) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1806854115 · Cited by 18 · see citing works

Who Should Be Given Incentives? Counterfactual Optimal Treatment Regimes Learning for Recommendation

Li, H., Zheng, C., Wu, P., Kuang, K., Liu, Y., & Cui, P. (2023) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/3580305.3599550 · Cited by 17 · see citing works

Emerging trend of big data analytics in bioinformatics: a literature review

Nagaraj, K., Sharvani, G. S., & Sridhar, A. (2017) · International Journal of Bioinformatics Research and Applications · doi:10.1504/ijbra.2018.10009206 · Cited by 29 · see citing works

Estimating Marketing Component Effects: Double Machine Learning from Targeted Digital PromotionsPreprint

Ellickson, P. B., Kar, W., & Reeder, J. C. (2022) · SSRN Electronic Journal · doi:10.2139/ssrn.4075261 · Cited by 16 · see citing works

Personalization and targeting: how to experiment, learn & optimize

Lemmens, A., Roos, J. M. T., Gabel, S., Ascarza, E., Bruno, H. A., Gordon, B. R., Israeli, A., Feit, E. M., Mela, C. F., & Netzer, O. (2025) · International Journal of Research in Marketing · doi:10.1016/j.ijresmar.2025.07.004 · Cited by 30 · see citing works

Effectiveness of digital marketing and its value in new ventures

Tarazona-Montoya, R., Devece, C., Llopis‐Albert, C., & Agreda, S. G. (2024) · International Entrepreneurship and Management Journal · doi:10.1007/s11365-024-00959-5 · Cited by 15 · see citing works

Advertising creativity and its effects: a meta-analysis of the moderating role of modality

Darley, W. K., & Lim, J. (2022) · Marketing Letters · doi:10.1007/s11002-022-09627-6 · Cited by 15 · see citing works

Does Sponsored Search Advertising Augment Organic Search? Evidence from an E-Commerce Platform

Moshary, S. (2025) · Management Science · doi:10.1287/mnsc.2024.04792 · Cited by 17 · see citing works

Addressing Exposure Bias in Uplift Modeling for Large-scale Online Advertising

Ke, W., Liu, C., Shi, X., Dai, Y., Yu, P. S., & Zhu, X. (2021) · Proceedings · doi:10.1109/icdm51629.2021.00138 · Cited by 13 · see citing works

The rise of empirical online platform research in the new millennium

Cheng, H. K., Sokol, D. D., & Zang, X. (2023) · Journal of Economics & Management Strategy · doi:10.1111/jems.12571 · Cited by 16 · see citing works

Uplift modeling for location-based online advertising

Kawanaka, S., & Moriwaki, D. (2019) · ACM SIGSPATIAL Workshop Recommendations for Location-based Services and Social Networks · doi:10.1145/3356994.3365505 · Cited by 13 · see citing works

Experimentation and performance in advertising: An observational survey of firm practices on Facebook

Runge, J., Geinitz, S., & Ejdemyr, S. (2020) · Expert Systems with Applications · doi:10.1016/j.eswa.2020.113554 · Cited by 12 · see citing works

Causal Machine Learning and Business Decision MakingPreprint

Hünermund, P., Kaminski, J., & Schmitt, C. (2021) · SSRN Electronic Journal · doi:10.2139/ssrn.3867326 · Cited by 13 · see citing works

Digital Public Health Interventions at Scale: The Impact of Social Media Advertising on Beliefs and Outcomes Related to COVID Vaccines

Athey, S. C., Grabarz, K., Luca, M., & Wernerfelt, N. (2022) · National Bureau of Economic Research · doi:10.3386/w30273 · Cited by 12 · see citing works

Does Concealing Gender Identity Help Women Win the Competition? An Empirical Investigation into Online Video Games

Chen, X., Zeng, X., & Zhang, C. (2022) · Marketing Science · doi:10.1287/mksc.2022.1393 · Cited by 12 · see citing works

Inefficiencies in Digital Advertising MarketsPreprint

Gordon, B. R., Jerath, K., Katona, Z., Narayanan, S., Shin, J., & Wilbur, K. C. (2019) · SSRN Electronic Journal · doi:10.2139/ssrn.3459199 · Cited by 11 · see citing works

What Cookie-Based Advertising Effectiveness Fails to Measure

Tian, M., Hoban, P. R., & Arora, N. (2023) · Marketing Science · doi:10.1287/mksc.2023.1453 · Cited by 10 · see citing works

What is the Value of Experimentation and Measurement?

Liu, C. H. B., Chamberlain, B. P., & McCoy, E. J. (2020) · Data Science and Engineering · doi:10.1007/s41019-020-00121-5 · Cited by 10 · see citing works

Increasing the effectiveness of display social media ads for startups: The role of different claims and executional characteristics

Hervet, G., & Guitart, I. A. (2022) · Journal of business research · doi:10.1016/j.jbusres.2022.08.052 · Cited by 9 · see citing works

Field Experiments in MarketingPreprint

Lambrecht, A., & Tucker, C. E. (2015) · SSRN Electronic Journal · doi:10.2139/ssrn.2630209 · Cited by 10 · see citing works

Digital platforms 2.0: Emerging topics, opportunities, and challenges

Banerjee, S., Chakraborty, I., Choi, H., Datta, H., Daviet, R., Farronato, C., Kim, M., Lambrecht, A., Manchanda, P., Öry, A., et al. (2026) · International Journal of Research in Marketing · doi:10.1016/j.ijresmar.2026.03.003 · Cited by 15 · see citing works

How digital platform changing people way to buy FMCG products

MULYAWAN, A., ALAMSYAH, Z., & Marimin, M. (2022) · IOP Conference Series Earth and Environmental Science · doi:10.1088/1755-1315/1063/1/012050 · Cited by 9 · see citing works

Predicting and optimizing marketing performance in dynamic markets

Guhl, D., Paetz, F., Wagner, U., & Wedel, M. (2024) · OR Spectrum · doi:10.1007/s00291-024-00755-1 · Cited by 9 · see citing works

Which Firms Gain from Digital Advertising? Evidence from a Field ExperimentPreprint

Dai, D., Kim, H., & Luca, M. (2016) · SSRN Electronic Journal · doi:10.2139/ssrn.2847084 · Cited by 11 · see citing works

Questioning Media Audience Engagement for Advertising Purposes and Content Creation

Medina, M., Portilla, I., & Pereira-Villazón, T. (2023) · Revista de Comunicación · doi:10.26441/rc22.2-2023-3159 · Cited by 8 · see citing works

Inter- and Intra-Similarity Preserved Counterfactual Incentive Effect Estimation for Recommendation Systems

Wang, F., Qi, L., Liu, W., Yu, B., Chen, J., & Xu, Y. (2025) · ACM Transactions on Information Systems · doi:10.1145/3722104 · Cited by 8 · see citing works

It’s time to close the experimentation gap in advertising: Confronting myths surrounding ad testing

Campbell, C., Runge, J., Bates, K., Haefele, S., & Jayaraman, N. (2021) · Business Horizons · doi:10.1016/j.bushor.2021.05.004 · Cited by 8 · see citing works

Observational Data for Heterogeneous Treatment Effects with Application to Recommender Systems

Lada, A., Peysakhovich, A., Aparicio, D., & Bailey, M. (2019) · ACM Conference on Economics and Computation (EC) · doi:10.1145/3328526.3329558 · Cited by 8 · see citing works

Commentary: Inefficiencies in Digital Advertising Markets: Evidence from the Field

Porter, J. (2020) · Journal of Marketing · doi:10.1177/0022242920970133 · Cited by 8 · see citing works

Estimating the Value of Offsite Tracking Data to Advertisers: Evidence from Meta

Wernerfelt, N., Tuchman, A. E., Shapiro, B. T., & Moakler, R. (2024) · National Bureau of Economic Research · doi:10.3386/w32765 · Cited by 8 · see citing works

Monetization could corrupt algorithmic explanations

Greene, T., Goethals, S., Martens, D., & Galit Shmueli, A. (2025) · AI & Society · doi:10.1007/s00146-025-02352-4 · Cited by 7 · see citing works

Economic Development and Environmental Conservation: Evidence from Ecotourism

Saavedra, S. (2024) · Economic Development and Cultural Change · doi:10.1086/730828 · Cited by 12 · see citing works

Incrementality Testing in Programmatic Advertising: Enhanced Precision with Double-Blind Designs

Barajas, J., & Bhamidipati, N. L. (2021) · International World Wide Web Conference (WWW) · doi:10.1145/3442381.3450106 · Cited by 7 · see citing works

Close Enough? A Large-Scale Exploration of Non-Experimental Approaches to Advertising MeasurementPreprint

Gordon, B. R., Moakler, R., & Zettelmeyer, F. (2022) · RePEc: Research Papers in Economics · doi:10.48550/arxiv.2201.07055 · Cited by 24 · see citing works

The Effectiveness of Online Ads: a Field ExperimentPreprint

Coppock, A., & Broockman, D. (2015) · doi:10.17605/osf.io/qm5b8

Measuring the E↵ects of Advertising: The Digital Frontier⇤

Lewis, R. A., Google Inc, Rao, J. M., Reiley, D., & Google Inc (2013)

Measuring Facebook’s Impact on Marketing

LaPointe, P. (2012) · Journal of Advertising Research · doi:10.2501/jar-52-3-286-287 · Cited by 50 · see citing works

Previous versions circulated under the name “On the Near Impossibility of Measuring Advertising Effectiveness. ” We especially thank David Reiley for his contributions to this work. He also

Lewis, R. A., Rao, J. M., Ch, A., Johnson, G. A., Lewis, C., Mcafee, P., Möbius, M., & Schwarz, M. (2013)