The DOI matches its Crossref record; 86 of the 90 references it cites were found in a registry or an index.
Advertising Content and Consumer Engagement on Social Media: Evidence from Facebook
Open accessAbstract
We describe the effect of social media advertising content on customer engagement using data from Facebook. We content-code 106,316 Facebook messages across 782 companies, using a combination of Amazon Mechanical Turk and natural language processing algorithms. We use this data set to study the association of various kinds of social media marketing content with user engagement—defined as Likes, comments, shares, and click-throughs—with the messages. We find that inclusion of widely used content related to brand personality—like humor and emotion—is associated with higher levels of consumer engagement (Likes, comments, shares) with a message. We find that directly informative content—like mentions of price and deals—is associated with lower levels of engagement when included in messages in isolation, but higher engagement levels when provided in combination with brand personality–related attributes. Also, certain directly informative content, such as deals and promotions, drive consumers’ path to conversion (click-throughs). These results persist after incorporating corrections for the nonrandom targeting of Facebook’s EdgeRank (News Feed) algorithm and so reflect more closely user reaction to content than Facebook’s behavioral targeting. Our results suggest that there are benefits to content engineering that combines informative characteristics that help in obtaining immediate leads (via improved click-throughs) with brand personality–related content that helps in maintaining future reach and branding on the social media site (via improved engagement). These results inform content design strategies. Separately, the methodology we apply to content-code text is useful for future studies utilizing unstructured data such as advertising content or product reviews. The online appendix is available at https://doi.org/10.1287/mnsc.2017.2902 . This paper was accepted by Chris Forman, information systems.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“The algorithms do this by monitoring the amount of time particular kinds of content keep the particular user engaged with the platform, and they use that data to continuously adjust the content so that the particular user remains engaged with the platform for ever lengthening periods of time”
From Ethics of the Attention Economy: The Problem of Social Media Addiction (2021) · cites this paper as Lee, Hosanagar, & Nair, 2018
Citations
Cites
LeCun, Y., Bengio, Y., & Hinton, G. (2015) · Nature · doi:10.1038/nature14539 · Cited by 84,126
The Elements of Statistical Learning
Hastie, T., Tibshirani, R., & Friedman, J. (2009) · Springer Series in Statistics · doi:10.1007/978-0-387-84858-7 · Cited by 25,970
Silhouettes: A graphical aid to the interpretation and validation of cluster analysis
Rousseeuw, P. J. (1987) · Journal of Computational and Applied Mathematics · doi:10.1016/0377-0427(87)90125-7 · Cited by 21,392
A decision-theoretic generalization of on-line learning and an application to boosting
Freund, Y., & Schapire, R. E. (1997) · Journal of Computer and System Sciences · doi:10.1006/jcss.1997.1504 · Cited by 20,466
Breiman, L. (1996) · Machine Learning · doi:10.1007/bf00058655 · Cited by 16,325
Conceptualizing, Measuring, and Managing Customer-Based Brand Equity
Keller, K. L. (1993) · Journal of Marketing · doi:10.2307/1252054 · Cited by 14,763
Generalized Additive Models: An Introduction with R
Wood, S. N. (2017) · doi:10.1201/9781315370279 · Cited by 13,852
Amazon's Mechanical Turk: A New Source of Inexpensive, Yet High-Quality, Data?
Buhrmester, M., Kwang, T., & Gosling, S. D. (2011) · Perspectives on Psychological Science · doi:10.1177/1745691610393980 · Cited by 9,996
Brown, R. A., Hastie, T. J., & Tibshirani, R. J. (1991) · Biometrics · doi:10.2307/2532174 · Cited by 8,263
Dimensions of Brand Personality
Aaker, J. L. (1997) · Journal of Marketing Research · doi:10.2307/3151897 · Cited by 7,843
Koyak, R. A., Hastie, T. J., & Tibshirani, R. J. (1991) · Journal of the American Statistical Association · doi:10.2307/2290538 · Cited by 7,717
Regression Analysis of Count Data
Cameron, A. C., & Trivedi, P. K. (2013) · doi:10.1017/cbo9781139013567 · Cited by 6,640
Wood, S. N. (2006) · doi:10.1201/9781420010404 · Cited by 4,953
Aaker, D. A. (1995) · Cited by 4,440
Speech and language processing
Politt, R., Pollock, J., & Waller, E. (2010) · Taylor & Francis eBooks · doi:10.4324/9780203461891_chapter_3 · Cited by 3,594
Influence : science and practice
Cialdini, R. B. (1985) · Cited by 3,581
Nelson, P. J. (1974) · Journal of Political Economy · doi:10.1086/260231 · Cited by 3,414
What Makes Online Content Viral?
Berger, J., & Milkman, K. L. (2012) · Journal of Marketing Research · doi:10.1509/jmr.10.0353 · Cited by 3,178 · cited 3×
“Also related are recent studies exploring the effect of content more generally (and not specifically ad content) including Berger and Milkman (2012) (effect of emotional content in New York Times articles on article sharing) and Gentzkow and Shapiro (2010) (effect of newspaper’s political content…”
Conducting behavioral research on Amazon’s Mechanical Turk
Mason, W., & Suri, S. (2012) · Behavior Research Methods · doi:10.3758/s13428-011-0124-6 · Cited by 3,172
Price and Advertising Signals of Product Quality
Milgrom, P., & Roberts, J. (1986) · Journal of Political Economy · doi:10.1086/261408 · Cited by 2,252
Methods of combining multiple classifiers and their applications to handwriting recognition
Xu, L., Krzyżak, A., & Suen, C. Y. (1992) · IEEE Transactions on Systems Man and Cybernetics · doi:10.1109/21.155943 · Cited by 2,192
Kapferer, J. (1996) · Journal of Brand Management · doi:10.1057/bm.1996.8 · Cited by 2,137
Cheap and fast---but is it good?: evaluating non-expert annotations for natural language tasks
Snow, R., O'Connor, B., Jurafsky, D., & Ng, A. Y. (2008) · Proceedings of the Conference on Empirical Methods in Natural Language Processing - EMNLP '08 · doi:10.3115/1613715.1613751 · Cited by 1,887
What Drives Media Slant? Evidence From U.S. Daily Newspapers
Gentzkow, M. A., & Shapiro, J. M. (2010) · Econometrica · doi:10.3982/ecta7195 · Cited by 1,559
Goh, K. Y., Heng, C. S., & Lin, Z. (2013) · Information Systems Research · doi:10.1287/isre.1120.0469 · Cited by 1,527
Word of mouth and interpersonal communication: A review and directions for future research
Berger, J. (2014) · Journal of Consumer Psychology · doi:10.1016/j.jcps.2014.05.002 · Cited by 1,469
How advertising works: what do we really know?
Vakratsas, D., & Ambler, T. (1999) · Journal of Marketing · doi:10.1177/002224299906300103 · Cited by 1,436
A Primer on Neural Network Models for Natural Language Processing
Goldberg, Y. (2016) · Journal of Artificial Intelligence Research · doi:10.1613/jair.4992 · Cited by 1,316
Transforming classifier scores into accurate multiclass probability estimates
Zadrozny, B., & Elkan, C. (2002) · Proceedings of the eighth ACM SIGKDD international conference on Knowledge discovery and data mining · doi:10.1145/775047.775151 · Cited by 1,280
Greene, W. H. (2004) · Econometrics Journal · doi:10.1111/j.1368-423x.2004.00123.x · Cited by 1,278
Get another label? improving data quality and data mining using multiple, noisy labelers
Sheng, V. S., Provost, F. J., & Ipeirotis, P. G. (2008) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/1401890.1401965 · Cited by 1,205
Equilibrium Distributions of Sales and Advertising Prices
Butters, G. R. (1977) · The Review of Economic Studies · doi:10.2307/2296902 · Cited by 1,002
Quality management on Amazon Mechanical Turk
Ipeirotis, P. G., Provost, F. J., & Wang, J. (2010) · doi:10.1145/1837885.1837906 · Cited by 996
Goh, K. Y., Heng, C. S., & Lin, Z. (2012) · SSRN Electronic Journal · doi:10.2139/ssrn.2048614 · Cited by 799
Strategic Manipulation of Internet Opinion Forums: Implications for Consumers and Firms
Dellarocas, C. N. (2006) · Management Science · doi:10.1287/mnsc.1060.0567 · Cited by 776
Informative Advertising with Differentiated Products
Grossman, G. M., & Shapiro, C. (1984) · The Review of Economic Studies · doi:10.2307/2297705 · Cited by 765
Mine Your Own Business: Market-Structure Surveillance Through Text Mining
Netzer, O., Feldman, R., Goldenberg, J., & Fresko, M. (2012) · Marketing Science · doi:10.1287/mksc.1120.0713 · Cited by 763
What Drives Immediate and Ongoing Word of Mouth?
Berger, J., & Schwartz, E. M. (2011) · Journal of Marketing Research · doi:10.1509/jmkr.48.5.869 · Cited by 663
Ghose, A., Ipeirotis, P. G., & Li, B. (2012) · Marketing Science · doi:10.1287/mksc.1110.0700 · Cited by 649
Social Networks and the Diffusion of User-Generated Content: Evidence from YouTube
Susarla, A., Oh, J., & Tan, Y. (2011) · Information Systems Research · doi:10.1287/isre.1100.0339 · Cited by 635
Social Media and Firm Equity Value
Luo, X., Zhang, J., & Duan, W. (2012) · Information Systems Research · doi:10.1287/isre.1120.0462 · Cited by 630
Kihlstrom, R. E., & Riordan, M. (1984) · Journal of Political Economy · doi:10.1086/261235 · Cited by 626
Arousal Increases Social Transmission of Information
Berger, J. (2011) · Psychological Science · doi:10.1177/0956797611413294 · Cited by 600
An Analysis of Information Content in Television Advertising
Resnik, A. J., & Stern, B. L. (1977) · Journal of Marketing · doi:10.1177/002224297704100107 · Cited by 587
Chapter 28 The Economic Analysis of Advertising
Bagwell, K. W. (2007) · Handbook of Industrial Organization · doi:10.1016/s1573-448x(06)03028-7 · Cited by 557
Rishika, R., Kumar, A., Janakiraman, R., & Bezawada, R. (2013) · Information systems research · doi:10.1287/isre.1120.0460 · Cited by 550
What's Advertising Content Worth? Evidence from a Consumer Credit Marketing Field Experiment*
Bertrand, M., Karlan, D., Mullainathan, S., Shafir, E. B., & Zinman, J. (2010) · The Quarterly Journal of Economics · doi:10.1162/qjec.2010.125.1.263 · Cited by 538
Amazon's Mechanical Turk: A new source of inexpensive, yet high-quality, data?
Buhrmester, M. D., Kwang, T., & Gosling, S. D. (2011) · PsycEXTRA Dataset · doi:10.1037/e527772014-223 · Cited by 534
Semiparametric estimation of censored selection models with a nonparametric selection mechanism
Ahn, H., & Powell, J. L. (1993) · Journal of Econometrics · doi:10.1016/0304-4076(93)90111-h · Cited by 434
Content or Community? A Digital Business Strategy for Content Providers in the Social Age1
Oestreicher-Singer, G., & Zalmanson, L. (2013) · MIS Quarterly · doi:10.25300/misq/2013/37.2.12 · Cited by 422
Whose and what chatter matters? The effect of tweets on movie sales
Rui, H., Liu, Y., & Whinston, A. B. (2013) · Decision Support Systems · doi:10.1016/j.dss.2012.12.022 · Cited by 372
Product personality and its influence on consumer preference
Govers, P. C. M., & Schoormans, J. P. L. (2005) · Journal of Consumer Marketing · doi:10.1108/07363760510605308 · Cited by 360
The Information Content of Advertising: A Meta-Analysis
Abernethy, A. M., & Franke, G. R. (1996) · Journal of Advertising · doi:10.1080/00913367.1996.10673496 · Cited by 346
Response Modeling with Nonrandom Marketing-Mix Variables
Manchanda, P., Rossi, P. E., & Chintagunta, P. K. (2004) · Journal of Marketing Research · doi:10.1509/jmkr.41.4.467.47005 · Cited by 324
What to Say When: Advertising Appeals in Evolving Markets
Chandy, R. K., Tellis, G. J., MacInnis, D. J., & Thaivanich, P. (2001) · Journal of Marketing Research · doi:10.1509/jmkr.38.4.399.18908 · Cited by 322
Heckman, J. J., & Robb, R. A. (1986) · Springer eBooks · doi:10.1007/978-1-4612-4976-4_7 · Cited by 290
From Subservient Chickens to Brawny Men
Lance, P., & Golan Guy, J. (2006) · Journal of Interactive Advertising · doi:10.1080/15252019.2006.10722116 · Cited by 285
Semiparametric Estimation Of Censored Selection Models With A Nonparametric Selection MechanismPreprint
Ahn, H., & Powell, J. L. (1990) · RePEc: Research Papers in Economics · Cited by 274
Anderson, S. P., & Renault, R. (2006) · American Economic Review · doi:10.1257/000282806776157632 · Cited by 244
Personalization in Email Marketing: The Role of Noninformative Advertising Content
Sahni, N. S., Wheeler, S. C., & Chintagunta, P. (2018) · Marketing Science · doi:10.1287/mksc.2017.1066 · Cited by 244
Generalized Additive Models: An Introduction with R
Wood, S. N. (2006) · Cited by 234
How Do Consumer Buzz and Traffic in Social Media Marketing Predict the Value of the Firm?
Luo, X., & Zhang, J. (2013) · Journal of Management Information Systems · doi:10.2753/mis0742-1222300208 · Cited by 227
Uninformative Advertising as an Invitation to Search
Mayzlin, D., & Shin, J. (2011) · Marketing Science · doi:10.1287/mksc.1110.0651 · Cited by 224
Hastie, T. J., & Tibshirani, R. J. (2017) · Routledge eBooks · doi:10.1201/9780203753781-6 · Cited by 204
Active Social Media Management: The Case of Health Care
Miller, A. R., & Tucker, C. E. (2012) · Information Systems Research · doi:10.1287/isre.1120.0466 · Cited by 185
Television Advertising and Online Shopping
Liaukonytė, J., Teixeira, T. S., & Wilbur, K. C. (2015) · Marketing Science · doi:10.1287/mksc.2014.0899 · Cited by 159
Anand, B. N., & Shachar, R. (2002) · The RAND Journal of Economics · doi:10.1111/j.1756-2171.2011.00131.x · Cited by 151
Armstrong, J. S. (2010) · Palgrave Macmillan UK eBooks · doi:10.1057/9780230285804 · Cited by 140
Transforming classifier scores into accurate multiclass probability estimates
Zadrozny, B., & Elkan, C. (2002) · ACM SIGKDD International Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/775107.775151 · Cited by 135
Geva, T., & Zahavi, J. (2013) · Decision Support Systems · doi:10.1016/j.dss.2013.09.013 · Cited by 124
Do Sympathy Biases Induce Charitable Giving? The Effects of Advertising Content
Sudhir, K., Roy, S., & Cherian, M. (2016) · Marketing Science · doi:10.1287/mksc.2016.0989 · Cited by 119
Targeted advertising as a signal
Anand, B. N., & Shachar, R. (2009) · Quantitative Marketing and Economics · doi:10.1007/s11129-009-9068-x · Cited by 115
How to Attract and Retain Readers in Enterprise Blogging?
Singh, P. V., Sahoo, N., & Mukhopadhyay, T. (2014) · Information Systems Research · doi:10.1287/isre.2013.0509 · Cited by 114
Leveraging Philanthropic Behavior for Customer Support: The Case of user Support Forums1
Jabr, W., Mookerjee, R. V., Tan, Y., & Mookerjee, V. S. (2014) · MIS Quarterly · doi:10.25300/misq/2014/38.1.09 · Cited by 113
The Reach and Persuasiveness of Viral Video Ads
Tucker, C. E. (2014) · Marketing Science · doi:10.1287/mksc.2014.0874 · Cited by 112
Blog, Blogger, and the Firm: Can Negative Employee Posts Lead to Positive Outcomes?
Aggarwal, R., Gopal, R. D., Sankaranarayanan, R., & Singh, P. V. (2011) · Information Systems Research · doi:10.1287/isre.1110.0360 · Cited by 110
Big Data and Marketing Analytics in Gaming: Combining Empirical Models and Field Experimentation
Nair, H. S., Misra, S., Hornbuckle, W. J., Mishra, R., & Acharya, A. (2017) · Marketing Science · doi:10.1287/mksc.2017.1039 · Cited by 59
Self-citationCheap-Talk Advertising and Misrepresentation in Vertically Differentiated Markets
Gardete, P. M. (2013) · Marketing Science · doi:10.1287/mksc.2013.0772 · Cited by 57
Personalization in Email Marketing: The Role of Non-Informative Advertising ContentPreprint
Sahni, N. S., Wheeler, S. C., & Chintagunta, P. K. (2016) · SSRN Electronic Journal · doi:10.2139/ssrn.2725251 · Cited by 52
Enriching interactions: Incorporating outcome data into static discrete games
Ellickson, P. B., & Misra, S. (2011) · Quantitative Marketing and Economics · doi:10.1007/s11129-011-9112-5 · Cited by 41
Li, X., & Wu, L. (2013) · Hawaii International Conference on System Sciences (HICSS) · doi:10.1109/hicss.2013.397 · Cited by 37
Social Advertising: How Advertising that Explicitly Promotes Social Influence Can BackfirePreprint
Tucker, C. E. (2011) · SSRN Electronic Journal · doi:10.2139/ssrn.1975897 · Cited by 36
Building reliable metaclassifiers for text learning
Carbonell, J., Lafferty, J., & Bennett, P. N. (2006) · Cited by 11
Cameron, A. C., & Trivedi, P. K. (2013) · Cambridge University Press eBooks · doi:10.1017/cbo9781139013567.007 · Cited by 9
Firm's Social Media Efforts, Consumer Behavior, and Firm Performance: Evidence from Facebook
Chung, S., Animesh, A., Han, K., & Pinsonneault, A. (2014) · Cited by 4
Use Social Media to Drive Word‐of‐Mouth Marketing
(2016) · Nonprofit Communications Report · doi:10.1002/npcr.30562 · Cited by 2
Flagged first, then by citations
4 of the 90 references couldn’t be matched to a known paper.
Research works printed but not linked: 10
- 10.1177/002224379703400304 · DOI
- Bagwell K, 2007, Handbook of Industrial Organization, 3, 1701
- Creamer M, 2012, AdAge.
- Ellickson PB, 2010, Quant. Marketing Econom., 10, 1
- 10.1177/002224299305700101 · DOI
- Liu X, Lee D, Srinivasan K (2017) Large scale cross category analysis of consumer review content on sales conversion leveraging deep learning. Working Paper 16-09, NET Institute, New York.
- Malik HH, 2011, Proc. 20th ACM Internat. Conf. Inform. Knowledge Management, 2497
- 10.2307/1250490 · DOI
- Terlep S, 2012, Wall Street Journal
- Weiss M, 2000, The Value of Brand Personalities: The Phenomenon of the Strategic Positioning of Brands
Cited by
Sorted by citations
Dwivedi, Y. K., Ismagilova, E., Hughes, D. L., Carlson, J., Filieri, R., Jacobson, J., Jain, V., Karjaluoto, H., Kefi, H., Krishen, A. S., et al. (2021) · International Journal of Information Management · doi:10.1016/j.ijinfomgt.2020.102168 · Cited by 4,608
“Chen and Lee (2018) investigated the use of Snapchat for social media marketing while targeting young consumers.”
BackgroundA strategic framework for artificial intelligence in marketing
Huang, M.-H., & Rust, R. T. (2021) · Journal of the Academy of Marketing Science · doi:10.1007/s11747-020-00749-9 · Cited by 2,059
“At the feeling level, more real-time and accurate emotion sensing from posted messages can better engage customers and provide a better interaction experience (Hartmann et al. 2019; Lee et al. 2018).”
BackgroundMethodEngaged to a Robot? The Role of AI in Service
Huang, M.-H., & Rust, R. T. (2021) · Journal of Service Research · doi:10.1177/1094670520902266 · Cited by 1,185
The Role of Social Media Content Format and Platform in Users’ Engagement Behavior
Shahbaznezhad, H., Dolan, R., & Rashidirad, M. (2021) · Journal of Interactive Marketing · doi:10.1016/j.intmar.2020.05.001 · Cited by 618
Integrating Marketing Communications: New Findings, New Lessons, and New Ideas
Batra, R., & Keller, K. L. (2016) · Journal of Marketing · doi:10.1509/jm.15.0419 · Cited by 836
Metadata
- Authors
- Lee, D., Hosanagar, K., & Nair, H. S.
- Affiliations
- Carnegie Mellon University (US)
- University of Pennsylvania (US)
- Stanford University (US)
- Venue
- Management Science
- Published
- 2018-11
- Volume
- 64
- Issue
- 11
- Pages
- 5105-5131
- ISSN
- 0025-1909 (ISSN-L)
- 1526-5501
- OpenAlex
- W3125510825
- Semantic Scholar
- 49ae2abdba289d0823cf3440b4320a76e9a580c0
- Cited by
- 1,069
- References
- 90
- Citations by year
- 2026: 109 · 2025: 141 · 2024: 155 · 2023: 138 · 2022: 158 · 2021: 146 · 2020: 87 · 2019: 69 · 2018: 29
- FWCI
- 131.60
- Type
- journal article
- Language
- en
- Open access
- green
- doi.org
- Locations
- Management Science (publishedVersion)
- SSRN Electronic Journal (publishedVersion)
- RePEc: Research Papers in Economics (submittedVersion)
- ScholarlyCommons (University of Pennsylvania) (submittedVersion)
- Topics
- Social Sciences › Business, Management and Accounting › Marketing › Digital Marketing and Social Media
- Social Sciences › Business, Management and Accounting › Marketing › Marketing and Advertising Strategies
- Social Sciences › Business, Management and Accounting › Marketing › Consumer Market Behavior and Pricing
- Keywords
- social media advertising, advertising content, customer engagement, Facebook, brand personality, humor, emotions, conversion, behavioral targeting, natural language processing
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review