The DOI matches its Crossref record; 29 of the 29 references it cites were found in a registry or an index.
Enhancing Social Media Analysis with Visual Data Analytics: A Deep Learning Approach
Open accessAbstract
This research methods article proposes a visual data analytics framework to enhance social media research using deep learning models. Drawing on the literature of information systems and marketing, complemented with data-driven methods, we propose a number of visual and textual content features including complexity, similarity, and consistency measures that can play important roles in the persuasiveness of social media content. We then employ state-of-the-art machine learning approaches such as deep learning and text mining to operationalize these new content features in a scalable and systematic manner. For the newly developed features, we validate them against human coders on Amazon Mechanical Turk. Furthermore, we conduct two case studies with a large social media dataset from Tumblr to show the effectiveness of the proposed content features. The first case study demonstrates that both theoretically motivated and data-driven features significantly improve the model’s power to predict the popularity of a post, and the second one highlights the relationships between content features and consumer evaluations of the corresponding posts. The proposed research framework illustrates how deep learning methods can enhance the analysis of unstructured visual and textual data for social media research.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
ImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155
LeCun, Y., Bengio, Y., & Hinton, G. (2015) · Nature · doi:10.1038/nature14539 · Cited by 84,126
Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks
Ren, S., He, K., Girshick, R., & Sun, J. (2017) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2016.2577031 · Cited by 73,472
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (2018) · arXiv · doi:10.48550/arxiv.1810.04805 · Cited by 73,173
Self-citationDistinctive Image Features from Scale-Invariant Keypoints
Lowe, D. G. (2004) · International Journal of Computer Vision · doi:10.1023/b:visi.0000029664.99615.94 · Cited by 55,589
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (2019) · Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers) · doi:10.18653/v1/n19-1423 · Cited by 54,325
Self-citationRethinking the Inception Architecture for Computer Vision
Szegedy, C., Vanhoucke, V., Ioffe, S., Shlens, J., & Wojna, Z. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.308 · Cited by 32,138
Distributed Representations of Words and Phrases and their Compositionality
Mikolov, T., Sutskever, I., Chen, K., Corrado, G., & Dean, J. (2013) · arXiv · doi:10.48550/arxiv.1310.4546 · Cited by 24,533
Delving Deep into Rectifiers: Surpassing Human-Level Performance on ImageNet Classification
He, K., Zhang, X., Ren, S., & Sun, J. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.123 · Cited by 19,741
Hinton, G., Deng, L., Yu, D., Dahl, G., Mohamed, A.-R., Jaitly, N., Senior, A., Vanhoucke, V., Nguyen, P., Sainath, T., et al. (2012) · IEEE Signal Processing Magazine · doi:10.1109/msp.2012.2205597 · Cited by 10,260
Research works printed but not linked: 67
- Adomavicius, 2015, Bundling Effects on Variety Seeking for Digital Information Goods, Journal of Management Information Systems, 31, 182, 10.1080/07421222.2014.1001266 · DOI
- Agrawal, 1995, The Economic Worth of Celebrity Endorsers: An Event Study Analysis, Journal of Marketing, 59, 56, 10.1177/002224299505900305 · DOI · Paper page
- Attneave, 1954, Some Informational Aspects of Visual Perception, Psychological Review, 61, 183, 10.1037/h0054663 · DOI · Paper page
- Bengio, 2013, Representation Learning: A Review and New Perspectives, IEEE Transactions on Pattern Analysis and Machine Intelligence, 35, 1798, 10.1109/TPAMI.2013.50 · DOI · Paper page
- Blei, 2003, Latent Dirichlet Allocation, Journal of Machine Learning Research, 3, 993
- Bloch, 1995, Seeking the Ideal Form: Product Design and Consumer Response, Journal of Marketing, 59, 16, 10.1177/002224299505900302 · DOI · Paper page
- Cao, 2009, A Density-Based Method for Adaptive LDA Model Selection, Neurocomputing, 72, 1775, 10.1016/j.neucom.2008.06.011 · DOI · Paper page
- Chatfield, 2014, Return of the Devil in the Details: Delving Deep into Convolutional Nets, 10.5244/C.28.6 · DOI · Paper page
- Childers, 1984, Conditions for a Picture-Superiority Effect on Consumer Memory, Journal of Consumer Research, 11, 643, 10.1086/209001 · DOI · Paper page
- Deng, 2010, Affect in Web Interfaces: A Study of the Impacts of Web Page Visual Complexity and Order, MIS Quarterly, 34, 711, 10.2307/25750702 · DOI · Paper page
- Diakopoulos, 2016, Accountability in Algorithmic Decision Making, Communications of the ACM, 59, 56, 10.1145/2844110 · DOI · Paper page
- Donderi, 2006, An Information Theory Analysis of Visual Complexity and Dissimilarity, Perception, 35, 823, 10.1068/p5249 · doi:10.1068/p5249
- Donderi, 2006, Visual Complexity: A Review, Psychological Bulletin, 132, 73, 10.1037/0033-2909.132.1.73 · DOI · Paper page
- Donderi, 2005, Compressed File Length Predicts Search Time and Errors on Visual Displays, Displays, 26, 71, 10.1016/j.displa.2005.02.002 · DOI
- Edell, 1983, The Information Processing of Pictures in Print Advertisements, Journal of Consumer Research, 10, 45, 10.1086/208944 · DOI · Paper page
- Fong, 2017, How Targeting Affects Customer Search: A Field Experiment, Management Science, 63, 2353, 10.1287/mnsc.2016.2447 · DOI
- Forsythe, 2011, Predicting Beauty: Fractal Dimension and Visual Complexity in Art, British Journal of Psychology, 102, 49, 10.1348/000712610X498958 · DOI · Paper page
- Friedman, 1979, Endorser Effectiveness by Product Type, Journal of Advertising Research, 19, 63
- Geissler, 2006, The Influence of Home Page Complexity on Consumer Attention, Attitudes, and Purchase Intent, Journal of Advertising, 35, 69, 10.1080/00913367.2006.10639232 · DOI · Paper page
- Gong, 2018, Examining the Impact of Keyword Ambiguity on Search Advertising Performance: A Topic Model Approach, MIS Quarterly, 42, 805, 10.25300/MISQ/2018/14042 · DOI
- Goodman, 1967, Reading: A Psycholinguistic Guessing Game, Literacy Research and Instruction, 6, 126
- Gough, 1972, One Second of Reading, Visible Language, 6, 291
- Gunning, 1952, The Technique of Clear Writing
- Huhmann, 2003, Visual Complexity in Banner Ads: The Role of Color, Photography, and Animation, Visual Communication Quarterly, 10, 10, 10.1080/15551390309363510 · doi:10.1080/15551390309363510
- Jain, 2018, Call for Papers: Special Issue of Information Systems Research—Humans, Algorithms, and Augmented Intelligence: The Future of Work, Organizations, and Society, Information Systems Research, 29, 250, 10.1287/isre.2018.0784 · DOI
- Jiang, 2016, The Determinants and Impacts of Aesthetics in Users’ First Interaction with Websites, Journal of Management Information Systems, 33, 229, 10.1080/07421222.2016.1172443 · DOI
- Johnson, 2019, Revisiting IS Research Practice in the Era of Big Data, Information and Organization, 29, 41, 10.1016/j.infoandorg.2019.01.001 · DOI
- Kamins, 1989, Celebrity and Noncelebrity Advertising in a Two-Sided Context, Journal of Advertising Research, 29, 34, 10.1080/00218499.1989.12467702 · DOI · Paper page
- Kelman, 1961, Processes of Opinion Change, Public Opinion Quarterly, 25, 57, 10.1086/266996 · DOI · Paper page
- Kim, 2008, The Effects of Visual and Verbal Information on Attitudes and Purchase Intentions in Internet Shopping, Psychology & Marketing, 25, 146, 10.1002/mar.20204 · DOI · Paper page
- Kintsch, 1978, Toward a Model of Text Comprehension and Production, Psychological Review, 85, 363, 10.1037/0033-295X.85.5.363 · DOI · Paper page
- Kosslyn, 1975, Information Representation in Visual Images, Cognitive Psychology, 7, 341, 10.1016/0010-0285(75)90015-8 · DOI · Paper page
- Kovashka, 2016, Crowdsourcing in Computer Vision, Foundations and Trends in Computer Graphics and Vision, 10, 177, 10.1561/0600000071 · DOI
- Lane, 2000, The Impact of Ad Repetition and Ad Content on Consumer Perceptions of Incongruent Extensions, Journal of Marketing, 64, 80, 10.1509/jmkg.64.2.80.17996 · DOI · Paper page
- Lee, 2020, Matching Mobile Applications for Cross-Promotion, Information Systems Research, 31, 865, 10.1287/isre.2020.0921 · DOI
- Lee, 2016, A Friend Like Me: Modeling Network Formation in a Location-Based Social Network, Journal of Management Information Systems, 33, 1008, 10.1080/07421222.2016.1267523 · DOI
- Li, 2016, The Moderating Role of Information Load on Online Product Presentation, Information & Management, 53, 467, 10.1016/j.im.2015.11.002 · DOI
- Lien, 2001, Elaboration Likelihood Model in Consumer Research: A Review, 301
- Ma, 2015, The Squeaky Wheel Gets the Grease—An Empirical Analysis of Customer Voice and Firm Intervention on Twitter, Marketing Science, 34, 627, 10.1287/mksc.2015.0912 · DOI · Paper page
- Maass, 2018, Data-driven Meets Theory-Driven Research in the Era of Big Data: Opportunities and Challenges for Information Systems Research, Journal of the Association for Information Systems, 19, 1253, 10.17705/1jais.00526 · DOI
- Machado, 2015, Computerized Measures of Visual Complexity, Acta Psychologica, 160, 43, 10.1016/j.actpsy.2015.06.005 · DOI
- MacInnis, 1987, The Role of Imagery in Information Processing: Review and Extensions, Journal of Consumer Research, 13, 473, 10.1086/209082 · DOI · Paper page
- McAlister, 1982, A Dynamic Attribute Satiation Model of Variety-Seeking Behavior, Journal of Consumer Research, 9, 141, 10.1086/208907 · DOI · Paper page
- Miniard, 1991, Picture-Based Persuasion Processes and the Moderating Role of Involvement, Journal of Consumer Research, 18, 92, 10.1086/209244 · DOI · Paper page
- Mitchell, 1986, The Effect of Verbal and Visual Components of Advertisements on Brand Attitudes and Attitude Toward the Advertisement, Journal of Consumer Research, 13, 12, 10.1086/209044 · DOI · Paper page
- Page, 2002, An Investigation of the Processes by Which Product Design and Brand Strength Interact to Determine Initial Affect and Quality Judgments, Journal of Consumer Psychology, 12, 133, 10.1207/S15327663JCP1202_06 · DOI · Paper page
- Palmer, 1999, Vision Science: Photons to Phenomenology
- Petty, 1983, Central and Peripheral Routes to Advertising Effectiveness: The Moderating Role of Involvement, Journal of Consumer Research, 10, 135, 10.1086/208954 · DOI · Paper page
- Phillips, 2000, The Impact of Verbal Anchoring on Consumer Response to Image Ads, Journal of Advertising, 29, 15, 10.1080/00913367.2000.10673600 · DOI · Paper page
- Pieters, 2010, The Stopping Power of Advertising: Measures and Effects of Visual Complexity, Journal of Marketing, 74, 48, 10.1509/jmkg.74.5.048 · DOI · Paper page
- Pieters, 2007, Optimal Feature Advertising Design Under Competitive Clutter, Management Science, 53, 1815, 10.1287/mnsc.1070.0732 · DOI · Paper page
- Rai, 2016, Editor’s Comments: Synergies Between Big Data and Theory, MIS Quarterly, 40, iii, 10.25300/MISQ/2016/40.2.E0 · DOI
- Rosenholtz, 2007, Measuring Visual Clutter, Journal of Vision, 7, 17, 10.1167/7.2.17 · DOI · Paper page
- Russakovsky, 2015, ImageNet Large Scale Visual Recognition Challenge, International Journal of Computer Vision, 115, 211, 10.1007/s11263-015-0816-y · DOI · Paper page
- Severn, 1990, The Effects of Sexual and Non-sexual Advertising Appeals and Information Level on Cognitive Processing and Communication Effectiveness, Journal of Advertising, 19, 14, 10.1080/00913367.1990.10673176 · DOI · Paper page
- Shi, 2016, Toward a Better Measure of Business Proximity: Topic Modeling for Industry Intelligence, MIS Quarterly, 40, 1035, 10.25300/MISQ/2016/40.4.11 · DOI
- Shmueli, 2011, Predictive Analytics in Information Systems Research, MIS Quarterly, 35, 553, 10.2307/23042796 · DOI · Paper page
- Simonson, 1990, The Effect of Purchase Quantity and Timing on Variety-Seeking Behavior, Journal of Marketing Research, 27, 150, 10.1177/002224379002700203 · DOI · Paper page
- Singh, 2014, How to Attract and Retain Readers in Enterprise Blogging?, Information Systems Research, 25, 35, 10.1287/isre.2013.0509 · DOI
- Smith, 1991, The Effects of Visual and Verbal Advertising Information on Consumers’ Inferences, Journal of Advertising, 20, 13, 10.1080/00913367.1991.10673351 · DOI
- Steadman, 1969, How Sexy Illustrations Affect Brand Recall, Journal of Advertising Research, 9, 15
- Strebe, 2016, Aesthetics on the Web: Effects on Approach and Avoidance Behaviour, Behaviour & Information Technology, 35, 4, 10.1080/0144929X.2015.1070202 · DOI
- Teixeira, 2012, Emotion-Induced Engagement in Internet Video Advertisements, Journal of Marketing Research, 49, 144, 10.1509/jmr.10.0207 · DOI · Paper page
- Tuch, 2009, Visual Complexity of Websites: Effects on Users’ Experience, Physiology, Performance, and Memory, International Journal of Human–Computer Studies, 67, 703, 10.1016/j.ijhcs.2009.04.002 · DOI · Paper page
- Unnava, 1991, An Imagery-Processing View of the Role of Pictures in Print Advertisements, Journal of Marketing Research, 28, 226, 10.1177/002224379102800210 · DOI · Paper page
- Wu, 2016, Complexity or Simplicity? Designing Product Pictures for Advertising in Online Marketplaces, Journal of Retailing and Consumer Services, 28, 17, 10.1016/j.jretconser.2015.08.009 · DOI
- Zadeh, 2014, Modeling Brand Post Popularity Dynamics in Online Social Networks, Decision Support Systems, 65, 59, 10.1016/j.dss.2014.05.003 · DOI
Cited by
Song, F., Agarwal, A., & Wen, W. (2024) · SSRN Electronic Journal (preprint) · doi:10.2139/ssrn.4856935 · Cited by 30
Beyond Money: Incentive Effects of Tokenized Ownership on User Contribution in DAOs
Chen, K., Fan, Y., Fang, Y., & Luo, X. (. (2025) · Journal of Operations Management · doi:10.1002/joom.1351 · Cited by 12
Metadata
- Authors
- Shin, D., He, S., Lee, G. M., Whinston, A. B., Cetintas, S., & Lee, K.-C.
- Venue
- MIS Quarterly
- Publisher
- MIS Quarterly
- Published
- 2020-12-01
- Volume
- 44
- Issue
- 4
- Pages
- 1459-1492
- ISSN
- 0276-7783 (ISSN-L)
- 2162-9730
- OpenAlex
- W4241886362
- Cited by
- 230
- References
- 29
- FWCI
- 28.42
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Enhancing Social Media Analysis with Visual Data Analytics: A Deep Learning Approach. https://app.cochat.ai/papers/10.25300/misq/2020/14870
- The paper
- Shin, D., He, S., Lee, G. M., Whinston, A. B., Cetintas, S., & Lee, K.-C. (2020). Enhancing Social Media Analysis with Visual Data Analytics: A Deep Learning Approach. MIS Quarterly. https://doi.org/10.25300/misq/2020/14870
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.