CoChat

Enhancing Social Media Analysis with Visual Data Analytics: A Deep Learning Approach

Open access
Shin, Donghyuk, He, Shu, Lee, Gene Moo, Whinston, Andrew B., Cetintas, Suleyman, Lee, Kuang-Chih · 2020 · MIS Quarterly
Cited by 230

The DOI matches its Crossref record; 37 of the 37 references it cites were found in a registry or an index.

Abstract

This research methods article proposes a visual data analytics framework to enhance social media research using deep learning models. Drawing on the literature of information systems and marketing, complemented with data-driven methods, we propose a number of visual and textual content features including complexity, similarity, and consistency measures that can play important roles in the persuasiveness of social media content. We then employ state-of-the-art machine learning approaches such as deep learning and text mining to operationalize these new content features in a scalable and systematic manner. For the newly developed features, we validate them against human coders on Amazon Mechanical Turk. Furthermore, we conduct two case studies with a large social media dataset from Tumblr to show the effectiveness of the proposed content features. The first case study demonstrates that both theoretically motivated and data-driven features significantly improve the model’s power to predict the popularity of a post, and the second one highlights the relationships between content features and consumer evaluations of the corresponding posts. The proposed research framework illustrates how deep learning methods can enhance the analysis of unstructured visual and textual data for social media research.

Overview

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.25300/misq/2020/14870

Cites

37 of 37 references verified0 citation errors · 0 not checkable

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Research works printed but not linked: 60

  1. Adomavicius, 2015, Bundling Effects on Variety Seeking for Digital Information Goods, Journal of Management Information Systems, 31, 182, 10.1080/07421222.2014.1001266 · DOI
  2. Agrawal, 1995, The Economic Worth of Celebrity Endorsers: An Event Study Analysis, Journal of Marketing, 59, 56, 10.1177/002224299505900305 · DOI · Paper page
  3. Attneave, 1954, Some Informational Aspects of Visual Perception, Psychological Review, 61, 183, 10.1037/h0054663 · DOI · Paper page
  4. Bloch, 1995, Seeking the Ideal Form: Product Design and Consumer Response, Journal of Marketing, 59, 16, 10.1177/002224299505900302 · DOI · Paper page
  5. Cao, 2009, A Density-Based Method for Adaptive LDA Model Selection, Neurocomputing, 72, 1775, 10.1016/j.neucom.2008.06.011 · DOI · Paper page
  6. Childers, 1984, Conditions for a Picture-Superiority Effect on Consumer Memory, Journal of Consumer Research, 11, 643, 10.1086/209001 · DOI · Paper page
  7. Deng, 2010, Affect in Web Interfaces: A Study of the Impacts of Web Page Visual Complexity and Order, MIS Quarterly, 34, 711, 10.2307/25750702 · DOI · Paper page
  8. Donderi, 2006, An Information Theory Analysis of Visual Complexity and Dissimilarity, Perception, 35, 823, 10.1068/p5249 · doi:10.1068/p5249
  9. Donderi, 2006, Visual Complexity: A Review, Psychological Bulletin, 132, 73, 10.1037/0033-2909.132.1.73 · DOI · Paper page
  10. Donderi, 2005, Compressed File Length Predicts Search Time and Errors on Visual Displays, Displays, 26, 71, 10.1016/j.displa.2005.02.002 · DOI
  11. Edell, 1983, The Information Processing of Pictures in Print Advertisements, Journal of Consumer Research, 10, 45, 10.1086/208944 · DOI · Paper page
  12. Fong, 2017, How Targeting Affects Customer Search: A Field Experiment, Management Science, 63, 2353, 10.1287/mnsc.2016.2447 · DOI
  13. Forsythe, 2011, Predicting Beauty: Fractal Dimension and Visual Complexity in Art, British Journal of Psychology, 102, 49, 10.1348/000712610X498958 · DOI · Paper page
  14. Friedman, 1979, Endorser Effectiveness by Product Type, Journal of Advertising Research, 19, 63
  15. Geissler, 2006, The Influence of Home Page Complexity on Consumer Attention, Attitudes, and Purchase Intent, Journal of Advertising, 35, 69, 10.1080/00913367.2006.10639232 · DOI · Paper page
  16. Gong, 2018, Examining the Impact of Keyword Ambiguity on Search Advertising Performance: A Topic Model Approach, MIS Quarterly, 42, 805, 10.25300/MISQ/2018/14042 · DOI · Paper page
  17. Goodman, 1967, Reading: A Psycholinguistic Guessing Game, Literacy Research and Instruction, 6, 126
  18. Gough, 1972, One Second of Reading, Visible Language, 6, 291
  19. Gunning, 1952, The Technique of Clear Writing
  20. Huhmann, 2003, Visual Complexity in Banner Ads: The Role of Color, Photography, and Animation, Visual Communication Quarterly, 10, 10, 10.1080/15551390309363510 · DOI
  21. Jain, 2018, Call for Papers: Special Issue of Information Systems Research—Humans, Algorithms, and Augmented Intelligence: The Future of Work, Organizations, and Society, Information Systems Research, 29, 250, 10.1287/isre.2018.0784 · DOI
  22. Jiang, 2016, The Determinants and Impacts of Aesthetics in Users’ First Interaction with Websites, Journal of Management Information Systems, 33, 229, 10.1080/07421222.2016.1172443 · DOI · Paper page
  23. Johnson, 2019, Revisiting IS Research Practice in the Era of Big Data, Information and Organization, 29, 41, 10.1016/j.infoandorg.2019.01.001 · DOI
  24. Kamins, 1989, Celebrity and Noncelebrity Advertising in a Two-Sided Context, Journal of Advertising Research, 29, 34, 10.1080/00218499.1989.12467702 · DOI · Paper page
  25. Kelman, 1961, Processes of Opinion Change, Public Opinion Quarterly, 25, 57, 10.1086/266996 · DOI · Paper page
  26. Kim, 2008, The Effects of Visual and Verbal Information on Attitudes and Purchase Intentions in Internet Shopping, Psychology & Marketing, 25, 146, 10.1002/mar.20204 · DOI · Paper page
  27. Kosslyn, 1975, Information Representation in Visual Images, Cognitive Psychology, 7, 341, 10.1016/0010-0285(75)90015-8 · DOI · Paper page
  28. Kovashka, 2016, Crowdsourcing in Computer Vision, Foundations and Trends in Computer Graphics and Vision, 10, 177, 10.1561/0600000071 · DOI · Paper page
  29. Lane, 2000, The Impact of Ad Repetition and Ad Content on Consumer Perceptions of Incongruent Extensions, Journal of Marketing, 64, 80, 10.1509/jmkg.64.2.80.17996 · DOI · Paper page
  30. Lee, 2020, Matching Mobile Applications for Cross-Promotion, Information Systems Research, 31, 865, 10.1287/isre.2020.0921 · DOI
  31. Lee, 2016, A Friend Like Me: Modeling Network Formation in a Location-Based Social Network, Journal of Management Information Systems, 33, 1008, 10.1080/07421222.2016.1267523 · DOI
  32. Li, 2016, The Moderating Role of Information Load on Online Product Presentation, Information & Management, 53, 467, 10.1016/j.im.2015.11.002 · DOI
  33. Lien, 2001, Elaboration Likelihood Model in Consumer Research: A Review, 301
  34. Ma, 2015, The Squeaky Wheel Gets the Grease—An Empirical Analysis of Customer Voice and Firm Intervention on Twitter, Marketing Science, 34, 627, 10.1287/mksc.2015.0912 · DOI · Paper page
  35. Maass, 2018, Data-driven Meets Theory-Driven Research in the Era of Big Data: Opportunities and Challenges for Information Systems Research, Journal of the Association for Information Systems, 19, 1253, 10.17705/1jais.00526 · DOI · Paper page
  36. Machado, 2015, Computerized Measures of Visual Complexity, Acta Psychologica, 160, 43, 10.1016/j.actpsy.2015.06.005 · DOI
  37. MacInnis, 1987, The Role of Imagery in Information Processing: Review and Extensions, Journal of Consumer Research, 13, 473, 10.1086/209082 · DOI · Paper page
  38. McAlister, 1982, A Dynamic Attribute Satiation Model of Variety-Seeking Behavior, Journal of Consumer Research, 9, 141, 10.1086/208907 · DOI · Paper page
  39. Miniard, 1991, Picture-Based Persuasion Processes and the Moderating Role of Involvement, Journal of Consumer Research, 18, 92, 10.1086/209244 · DOI · Paper page
  40. Mitchell, 1986, The Effect of Verbal and Visual Components of Advertisements on Brand Attitudes and Attitude Toward the Advertisement, Journal of Consumer Research, 13, 12, 10.1086/209044 · DOI · Paper page
  41. Page, 2002, An Investigation of the Processes by Which Product Design and Brand Strength Interact to Determine Initial Affect and Quality Judgments, Journal of Consumer Psychology, 12, 133, 10.1207/S15327663JCP1202_06 · DOI · Paper page
  42. Palmer, 1999, Vision Science: Photons to Phenomenology
  43. Phillips, 2000, The Impact of Verbal Anchoring on Consumer Response to Image Ads, Journal of Advertising, 29, 15, 10.1080/00913367.2000.10673600 · DOI · Paper page
  44. Pieters, 2010, The Stopping Power of Advertising: Measures and Effects of Visual Complexity, Journal of Marketing, 74, 48, 10.1509/jmkg.74.5.048 · DOI · Paper page
  45. Pieters, 2007, Optimal Feature Advertising Design Under Competitive Clutter, Management Science, 53, 1815, 10.1287/mnsc.1070.0732 · DOI · Paper page
  46. Rai, 2016, Editor’s Comments: Synergies Between Big Data and Theory, MIS Quarterly, 40, iii, 10.25300/MISQ/2016/40.2.E0 · DOI
  47. Rosenholtz, 2007, Measuring Visual Clutter, Journal of Vision, 7, 17, 10.1167/7.2.17 · DOI · Paper page
  48. Russakovsky, 2015, ImageNet Large Scale Visual Recognition Challenge, International Journal of Computer Vision, 115, 211, 10.1007/s11263-015-0816-y · DOI · Paper page
  49. Severn, 1990, The Effects of Sexual and Non-sexual Advertising Appeals and Information Level on Cognitive Processing and Communication Effectiveness, Journal of Advertising, 19, 14, 10.1080/00913367.1990.10673176 · DOI · Paper page
  50. Shi, 2016, Toward a Better Measure of Business Proximity: Topic Modeling for Industry Intelligence, MIS Quarterly, 40, 1035, 10.25300/MISQ/2016/40.4.11 · DOI
  51. Simonson, 1990, The Effect of Purchase Quantity and Timing on Variety-Seeking Behavior, Journal of Marketing Research, 27, 150, 10.1177/002224379002700203 · DOI · Paper page
  52. Singh, 2014, How to Attract and Retain Readers in Enterprise Blogging?, Information Systems Research, 25, 35, 10.1287/isre.2013.0509 · DOI
  53. Smith, 1991, The Effects of Visual and Verbal Advertising Information on Consumers’ Inferences, Journal of Advertising, 20, 13, 10.1080/00913367.1991.10673351 · DOI
  54. Steadman, 1969, How Sexy Illustrations Affect Brand Recall, Journal of Advertising Research, 9, 15
  55. Strebe, 2016, Aesthetics on the Web: Effects on Approach and Avoidance Behaviour, Behaviour & Information Technology, 35, 4, 10.1080/0144929X.2015.1070202 · DOI
  56. Teixeira, 2012, Emotion-Induced Engagement in Internet Video Advertisements, Journal of Marketing Research, 49, 144, 10.1509/jmr.10.0207 · DOI · Paper page
  57. Tuch, 2009, Visual Complexity of Websites: Effects on Users’ Experience, Physiology, Performance, and Memory, International Journal of Human–Computer Studies, 67, 703, 10.1016/j.ijhcs.2009.04.002 · DOI · Paper page
  58. Unnava, 1991, An Imagery-Processing View of the Role of Pictures in Print Advertisements, Journal of Marketing Research, 28, 226, 10.1177/002224379102800210 · DOI · Paper page
  59. Wu, 2016, Complexity or Simplicity? Designing Product Pictures for Advertising in Online Marketplaces, Journal of Retailing and Consumer Services, 28, 17, 10.1016/j.jretconser.2015.08.009 · DOI
  60. Zadeh, 2014, Modeling Brand Post Popularity Dynamics in Online Social Networks, Decision Support Systems, 65, 59, 10.1016/j.dss.2014.05.003 · DOI

Cited by

See all 230

Metadata

Authors
Shin, D., He, S., Lee, G. M., Whinston, A. B., Cetintas, S., & Lee, K.-C.
Venue
MIS Quarterly
Publisher
MIS Quarterly
Published
2020-12-01
Volume
44
Issue
4
Pages
1459-1492
ISSN
  • 0276-7783 (ISSN-L)
  • 2162-9730
OpenAlex
W4241886362
Cited by
230
References
37
FWCI
28.42
Type
journal article
Language
en
Open access
green

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.