Evaluation and decision making in social media marketing
The DOI matches its Crossref record; 60 of the 60 references it cites were found in a registry or an index.
Abstract
Purpose: As organisations are increasing their investment in social media marketing (SMM), evaluation of such techniques is becoming increasingly important. The purpose of this paper is to contribute to knowledge regarding SMM strategy by developing a stage model of SMM evaluation and uncovering the challenges in this process. Design/methodology/approach: Interviews were conducted with 18 key informants working for specialist SMM agencies. Such informants are a particularly rich source, since they manage social media campaigns for a wide range of clients. An exploratory research was conducted and thematic analysis surfaced the key components of the SMM evaluation process and associated challenges. Findings: The SMM evaluation framework is developed. This framework has the following six stages: setting evaluation objectives, identifying key performance indicators (KPIs), identifying metrics, data collection and analysis, report generation and management decision making. Challenges associated with each stage of the framework are identified, and discussed with a view to better understanding decision making associated with social media strategies. Two key challenges are the agency-client relationship and the available social analytics tools. Originality/value: Despite an increasing body of research on social media objectives, KPIs and metrics, no previous study has explored how these components are embedded in a marketing campaign planning process. The paper also offers insights in the factors that make SMM evaluation complex and challenging. Recommendations for further research and practice are offered.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Using thematic analysis in psychology
Braun, V., & Clarke, V. (2006) · Qualitative Research in Psychology · doi:10.1191/1478088706qp063oa · Cited by 194,414 · cited 1×
“Thematic analysis followed the six phases recommended by Braun and Clarke (2006): familiarisation with data, generating initial codes, searching for themes among codes, reviewing themes, defining and naming themes and producing the final account of the findings.”
MethodQualitative Data Analysis: An Expanded Sourcebook
(1994) · Journal of Environmental Psychology · doi:10.1016/s0272-4944(05)80231-2 · Cited by 48,420 · cited 1×
“The data were initially analysed interview transcript by transcript, before checking for verification across transcripts (Miles and Huberman, 1994).”
(1990) · Cited by 24,217
Research Methods for Business Students
Saunders, M. N. K., Lewis, P., & Thornhill, A. R. (2003) · Cited by 18,357
Users of the world, unite! The challenges and opportunities of Social Media
Kaplan, A. M., & Haenlein, M. (2010) · Business Horizons · doi:10.1016/j.bushor.2009.09.003 · Cited by 17,875 · cited 1×
“…that build on the ideological and technological foundations of Web 2.0 and that allow the creation and exchange of user-generated content” (Kaplan and Haenlein, 2010, p. 61), social media are impacting on a wide range of business processes, from marketing and operations to finance (Luo…”
BackgroundInfluentialBell, E., Bryman, A., & Harley, B. (2022) · Oxford University Press eBooks · doi:10.1093/hebz/9780198869443.001.0001 · Cited by 10,965
(2008) · Cited by 6,727
Opinion Mining and Sentiment Analysis
Pang, B., & Lee, L. (2008) · now publishers, Inc. eBooks · doi:10.1561/9781601981516 · Cited by 6,720
Social media: The new hybrid element of the promotion mix
Mangold, W. G., & Faulds, D. J. (2009) · Business Horizons · doi:10.1016/j.bushor.2009.03.002 · Cited by 4,111 · cited 1×
“As such, an on-going debate exists surrounding the extent to which social media metrics can be aligned with established digital and general marketing metrics (Hennig-Thurau et al., 2010; Mangold and Faulds, 2009; Weber, 2009).”
BackgroundKim, A. J., & Ko, E. (2012) · Journal of Business Research · doi:10.1016/j.jbusres.2011.10.014 · Cited by 2,449 · cited 3×
“Some offer insights into the wider aspects of the processes associated with evaluation of SMM in specific contexts (Kim and Ko, 2012; Michaelidou et al., 2011; Murdough, 2010; Töllinen et al., 2010), in addition, there has been significant activity on measurement frameworks and dashboards (Cvijikj et al.”
BackgroundQualitative Interviewing and Grounded Theory Analysis
Charmaz, K., & Belgrave, L. L. (2012) · The SAGE Handbook of Interview Research: The Complexity of the Craft · doi:10.4135/9781452218403.n25 · Cited by 1,997 · cited 1×
“Thematic analysis is appropriate in research such as this that adopts an inductive approach and seeks to construct theories that are grounded in the data (Charmaz and Belgrave, 2002).”
Better Stories and Better Constructs: The Case for Rigor and Comparative Logic
Eisenhardt, K. M. (1991) · The Academy of Management Review · doi:10.2307/258921 · Cited by 1,712
We’re all connected: The power of the social media ecosystem
Hanna, R., Rohm, A., & Crittenden, V. L. (2011) · Business Horizons · doi:10.1016/j.bushor.2011.01.007 · Cited by 1,650 · cited 3×
“, 2010) and as potentially heralding a paradigm shift in marketing (Hanna et al., 2011).”
BackgroundHandbook of Interview Research: Context and Method
Gubrium, J. F., & Holstein, J. A. (2001) · Medical Entomology and Zoology · Cited by 1,515
The Impact of New Media on Customer Relationships
Hennig-Thurau, T., Malthouse, E. C., Friege, C., Gensler, S., Lobschat, L., Rangaswamy, A., & Skiera, B. (2010) · Journal of Service Research · doi:10.1177/1094670510375460 · Cited by 1,406 · cited 3×
“As such, an on-going debate exists surrounding the extent to which social media metrics can be aligned with established digital and general marketing metrics (Hennig-Thurau et al., 2010; Mangold and Faulds, 2009; Weber, 2009).”
BackgroundUnderstanding Generation Y and their use of social media: a review and research agenda
Bolton, R. N., Parasuraman, A., Hoefnagels, A., Migchels, N., Kabadayi, S., Gruber, T., Komarova Loureiro, Y., & Solnet, D. (2013) · Journal of Service Management · doi:10.1108/09564231311326987 · Cited by 1,299 · cited 2×
“, 2013) and human resource management (Bolton, 2013).”
BackgroundInfluentialCan You Measure the ROI of Your Social Media MarketingPreprint
Hoffman, D. L., & Fodor, M. (2010) · SSRN Electronic Journal · Cited by 1,283
Goh, K.-Y., Heng, C.-S., & Lin, Z. (2013) · Information Systems Research · doi:10.1287/isre.1120.0469 · Cited by 1,228 · cited 1×
“For example, Goh et al. (2013) studied the relative impact of social media on firm profits and established that user-generated content had a greater impact on profits than firm-created content.”
BackgroundMichaelidou, N., Siamagka, N. T., & Christodoulides, G. (2011) · Industrial Marketing Management · doi:10.1016/j.indmarman.2011.09.009 · Cited by 1,004 · cited 5×
“For example, Michaelidou et al. (2011) found that most B2B organisations do not adopt any metrics to assess SMM effectiveness.”
BackgroundMethodInfluentialCustomer engagement in a Facebook brand community
Gummerus, J., Liljander, V., Weman, E., & Pihlström, M. (2012) · Management Research Review · doi:10.1108/01409171211256578 · Cited by 947 · cited 2×
“…their social media presence because they appreciate the need to engage in existing social media conversations in order to protect their corporate or brand reputation (Lee and Youn, 2009), increase customer engagement (Gummerus et al., 2012) or increase online sales (Tsimonis and Dimitriadis, 2014).”
BackgroundTrainor, K. J., Andzulis, J. (., Rapp, A., & Agnihotri, R. (2014) · Journal of Business Research · doi:10.1016/j.jbusres.2013.05.002 · Cited by 880
Goh, K. Y., Heng, C. S., & Lin, Z. (2012) · SSRN Electronic Journal · doi:10.2139/ssrn.2048614 · Cited by 799
Introduction to the Special Issue—Social Media and Business Transformation: A Framework for Research
Aral, S., Dellarocas, C., & Godes, D. (2013) · Information Systems Research · doi:10.1287/isre.1120.0470 · Cited by 784 · cited 1×
“Aral et al. (2013) argue that social media is “fundamentally changing the way we communicate, collaborate, consume, and create” (p. 3).”
BackgroundSocial media analytics: a survey of techniques, tools and platforms
Batrinca, B., & Treleaven, P. C. (2015) · AI & SOCIETY · doi:10.1007/s00146-014-0549-4 · Cited by 704
Electronic word of mouth (eWOM): How eWOM platforms influence consumer product judgement
Lee, M., & Youn, S. (2009) · International Journal of Advertising · doi:10.2501/s0265048709200709 · Cited by 662 · cited 1×
“…their social media presence because they appreciate the need to engage in existing social media conversations in order to protect their corporate or brand reputation (Lee and Youn, 2009), increase customer engagement (Gummerus et al., 2012) or increase online sales (Tsimonis and Dimitriadis, 2014).”
BackgroundSocial Media Metrics — A Framework and Guidelines for Managing Social Media
Peters, K., Chen, Y., Kaplan, A. M., Ognibeni, B., & Pauwels, K. (2013) · Journal of Interactive Marketing · doi:10.1016/j.intmar.2013.09.007 · Cited by 657 · cited 5×
“…2010), in addition, there has been significant activity on measurement frameworks and dashboards (Cvijikj et al., 2012; Marklein and Paine, 2013; Peters et al., 2013), and some discussion of the need to establish clearly defined goals, objectives and metrics related to the use of social media…”
BackgroundMethodInfluentialSocial Media and Firm Equity Value
Luo, X., Zhang, J., & Duan, W. (2013) · Information Systems Research · doi:10.1287/isre.1120.0462 · Cited by 627 · cited 4×
“Tirunillai and Tellis (2012) demonstrate that online reviews and “chatter” are indicators of stock market performance, whilst Luo et al. (2013) 16 MD 55,1 show that social media-based metrics are leading indicators of firm equity value.”
BackgroundInfluentialDoes Chatter Really Matter? Dynamics of User-Generated Content and Stock Performance
Tirunillai, S., & Tellis, G. J. (2012) · Marketing Science · doi:10.1287/mksc.1110.0682 · Cited by 623 · cited 2×
“Tirunillai and Tellis (2012) demonstrate that online reviews and “chatter” are indicators of stock market performance, whilst Luo et al. (2013) 16 MD 55,1 show that social media-based metrics are leading indicators of firm equity value.”
BackgroundThe power of social media analytics
Fan, W., & Gordon, M. D. (2014) · Communications of the ACM · doi:10.1145/2602574 · Cited by 620 · cited 1×
“Fan and Gordon (2014) and Töllinen et al. (2010) suggest that this is particularly appropriate in the context of SMM. Interestingly, there is indeed evidence of the adoption of approaches that involve collaboration in this study, as summarised in the final column in Table II.”
BackgroundBrand strategies in social media
Tsimonis, G., & Dimitriadis, S. (2014) · Marketing Intelligence & Planning · doi:10.1108/mip-04-2013-0056 · Cited by 560 · cited 3×
“, 2014), the drivers, activities and benefits associated with social media (Tsimonis and Dimitriadis, 2014), practitioner case studies using one organisation such as Finnair ( Jarvenpaa and Tuunainen, 2013), B2B companies adoption of social media (Michaelidou et al.”
BackgroundOpinion Mining and Sentiment Analysis
Liu, B. (2011) · Web Data Mining · doi:10.1007/978-3-642-19460-3_11 · Cited by 482
Marketing to the social Web: how digital customer communities build your business
(2007) · Choice Reviews Online · doi:10.5860/choice.45-1559 · Cited by 337
Avgerinos, T., Cha, S. K., Rebert, A., Schwartz, E. J., Woo, M., & Brumley, D. (2014) · Communications of the ACM · doi:10.1145/2560217.2560219 · Cited by 263
Dashboards as a Service: Why, What, How, and What Research Is Needed?
Pauwels, K., Ambler, T., Clark, B. H., LaPointe, P., Reibstein, D., Skiera, B., Wierenga, B., & Wiesel, T. (2009) · Journal of Service Research · doi:10.1177/1094670509344213 · Cited by 257 · cited 3×
“…and Barlow, prior research on SMM has largely centred on metrics, analytics, and dashboards, and largely ignored the embedding of such tools into marketing decision-making processes (Cvijikj et al., 2012; Heijnen et al., 2013; Marklein and Paine, 2013; Pauwels et al., 2009; Peters et al., 2013).”
BackgroundIncreasing the ROI of social media marketing
Kumar, V., & Mirchandani, R. (2013) · IEEE Engineering Management Review · doi:10.1109/emr.2013.6596535 · Cited by 237
Use and measurement of social media for SMEs
McCann, M., & Barlow, A. (2015) · Journal of Small Business and Enterprise Development · doi:10.1108/jsbed-08-2012-0096 · Cited by 236 · cited 10×
“One campaign that was specifically designed to support calculation of ROI was mentioned: We ran a Facebook offer, which we measured separately.”
BackgroundInfluentialSocial media utilization in business-to-business relationships of technology industry firms
Jussila, J. J., Kärkkäinen, H., & Aramo-Immonen, H. (2014) · Computers in Human Behavior · doi:10.1016/j.chb.2013.07.047 · Cited by 217
Social Media Measurement: It’s Not Impossible
Murdough, C. (2009) · Journal of Interactive Advertising · doi:10.1080/15252019.2009.10722165 · Cited by 202
Firm-to-Firm and Interpersonal Relationships: Perspectives from Advertising Agency Account Managers
Haytko, D. L. (2004) · Journal of the Academy of Marketing Science · doi:10.1177/0092070304264989 · Cited by 201 · cited 1×
“There is a longstanding literature on agency-client relationships that assesses the challenges in this relationship, how it can be best managed, and what happens when it fails (Haytko, 2004).”
BackgroundKohtamäki, M., & Partanen, J. (2016) · Journal of Business Research · doi:10.1016/j.jbusres.2016.02.019 · Cited by 184 · cited 1×
“Recent contributions to the agency-client relationship literature, suggest that collaborative planning and a co-creative approach are the best way forward (Kohtamäki and Partanen, 2016).”
BackgroundResearch on Ending Exchange Relationships: A Categorization, Assessment and Outlook
Tahtinen, J., & Halinen, A. (2002) · Marketing Theory · doi:10.1177/147059310222002 · Cited by 160
O’Sullivan, D., Abela, A. V., & Hutchinson, M. C. (2009) · European Journal of Marketing · doi:10.1108/03090560910947070 · Cited by 155 · cited 1×
“Yet, as O’Sullivan et al. (2009) demonstrate, marketing performance measurement ability or frequency is linked to firm performance.”
BackgroundBacile, T. J., Ye, C., & Swilley, E. (2014) · Journal of Interactive Marketing · doi:10.1016/j.intmar.2013.12.001 · Cited by 149 · cited 1×
“It is considered to be different to traditional marketing channels, and even other digital marketing channels, centring around a two-way conversation or exchange (Bacile et al., 2014; Shih, 2009).”
BackgroundUsing Twitter to engage with customers: a data mining approach
Okazaki, S., Díaz‐Martín, A. M., Suplet, M. R., & Menéndez, H. D. (2015) · Internet Research · doi:10.1108/intr-11-2013-0249 · Cited by 129
Balancing acts: Managing employees and reputation in social media
Rokka, J., Karlsson, K., & Tienari, J. (2014) · Journal of Marketing Management · doi:10.1080/0267257x.2013.813577 · Cited by 126 · cited 2×
“There is some research in this area on some specific aspects of strategy, such as reputation management (Rokka et al., 2014), the drivers, activities and benefits associated with social media (Tsimonis and Dimitriadis, 2014), practitioner case studies using one organisation such as Finnair ( Jarvenpaa and Tuunainen, 2…”
BackgroundToward a Deeper Understanding of Social Media
Hoffman, D. L., & Novak, T. P. (2012) · Journal of Interactive Marketing · doi:10.1016/j.intmar.2012.03.001 · Cited by 119 · cited 2×
“In the marketing context, social media is seen as essentially different to other forms of digital media (Hoffman and Novak, 2012; Hennig-Thurau et al., 2010) and as potentially heralding a paradigm shift in marketing (Hanna et al.”
BackgroundTHE VALUE OF SOCIAL MEDIA: TOWARD MEASURING SOCIAL MEDIA STRATEGIES
Larson, K., & Watson, R. T. (2011) · AIS Electronic Library (AISeL) · Cited by 115
Social media: is this the new organizational stepchild?
Choi, Y., & Thoeni, A. (2015) · European Business Review · doi:10.1108/ebr-05-2015-0048 · Cited by 79 · cited 3×
“Some studies mention evaluation but do not elaborate on it to any great extent (e.g. Choi and Thoeni, 2016; Hanna et al., 2011; Töllinen et al., 2012).”
BackgroundInfluentialMultichannel management gets “social”
Pozza, I. D. (2014) · European Journal of Marketing · doi:10.1108/ejm-10-2012-0598 · Cited by 77
Social Media Analytics as a Business Intelligence Practice:Current Landscape & Future Prospects
Ruhi, U. (2014) · Journal of Internet Social Networking and Virtual Communities · doi:10.5171/2014.920553 · Cited by 57 · cited 1×
“In general, then, as suggested by Ruhi (2014), there is a need for empirical investigations that explore the link between SMM analytics and the generation of business intelligence.”
BackgroundHow Finnair socialized customers for service co-creation with social media
Järvenpää, S. L., & Tuunainen, V. K. (2013) · Journal of the Association for Information Systems · Cited by 55
Developing an account‐management lifecycle for advertising agency‐client relationships
Waller, D. S. (2004) · Marketing Intelligence & Planning · doi:10.1108/02634500410516940 · Cited by 53 · cited 1×
“This literature suggests that a long terms relationship is optimal for both parties (Waller, 2004), but its focus on conflict and switching suggest that this is difficult to achieve (Davies and Prince, 2010).”
BackgroundEvaluation framework for social media brand presence
Cvijikj, I. P., Spiegler, E. D., & Michahelles, F. (2013) · Social Network Analysis and Mining · doi:10.1007/s13278-013-0131-y · Cited by 50 · cited 5×
“…and Barlow, prior research on SMM has largely centred on metrics, analytics, and dashboards, and largely ignored the embedding of such tools into marketing decision-making processes (Cvijikj et al., 2012; Heijnen et al., 2013; Marklein and Paine, 2013; Pauwels et al., 2009; Peters et al., 2013).”
BackgroundMethodInfluentialThe distinct roles of dedication-based and constraint-based mechanisms in social networking sites
Kim, B., & Min, J. (2015) · Internet Research · doi:10.1108/intr-11-2013-0253 · Cited by 49
Conflict and advertising planning: consequences of networking for advertising planning
Grant, I. C., McLeod, C., & Shaw, E. (2012) · European Journal of Marketing · doi:10.1108/03090561211189248 · Cited by 33 · cited 1×
“In terms of the contractual relationship between the agency and the client, both parties are therefore often inclined to feel vulnerable (Grant et al., 2012).”
BackgroundDavies, M. A. P., & Prince, M. (2010) · Journal of Current Issues & Research in Advertising · doi:10.1080/10641734.2010.10505272 · Cited by 28 · cited 1×
“This literature suggests that a long terms relationship is optimal for both parties (Waller, 2004), but its focus on conflict and switching suggest that this is difficult to achieve (Davies and Prince, 2010).”
BackgroundIntermediary roles in local mobile advertising: Findings from a Finnish study
Komulainen, H., Mainela, T., & Tähtinen, J. (2013) · Journal of Marketing Communications · doi:10.1080/13527266.2013.833540 · Cited by 17
Switching Costs and Ad Agency-Client Relationship Longevity: An Exploratory Study
Davies, M. A. P., & Prince, M. (2011) · Services Marketing Quarterly · doi:10.1080/15332969.2011.557609 · Cited by 12
Social Media Data Relevant for Measuring Key Performance Indicators? A Content Analysis Approach
Heijnen, J., de Reuver, M., Bouwman, H., Warnier, M., & Horlings, H. (2013) · Lecture notes in business information processing · doi:10.1007/978-3-642-39808-7_7 · Cited by 11 · cited 2×
“…and Barlow, prior research on SMM has largely centred on metrics, analytics, and dashboards, and largely ignored the embedding of such tools into marketing decision-making processes (Cvijikj et al., 2012; Heijnen et al., 2013; Marklein and Paine, 2013; Pauwels et al., 2009; Peters et al., 2013).”
BackgroundMethodSocial Media Monitoring in the industrial Business to Business Sector
Töllinen, A., Mero, J., & Karjaluoto, H. (2012) · Jyväskylä University Digital Archive (University of Jyväskylä) · Cited by 8
Cited by
Past, present, and future of customer engagement
Lim, W. M., Rasul, T., Kumar, S., & Ala, M. (2022) · Journal of Business Research · doi:10.1016/j.jbusres.2021.11.014 · Cited by 498
Metadata
- Authors
- Keegan, B. J., & Rowley, J.
- Venue
- Management Decision
- Publisher
- Emerald
- Published
- 2017-02-13
- Volume
- 55
- Issue
- 1
- Pages
- 15-31
- ISSN
- 0025-1747 (ISSN-L)
- OpenAlex
- W2564413358
- Cited by
- 172
- References
- 60
- FWCI
- 38.44
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.