Trick and Please. A Mixed-Method Study On User Assumptions About the TikTok Algorithm
Open accessThe DOI matches its Crossref record; 56 of the 56 references it cites were found in a registry or an index.
Abstract
The short-form video sharing app TikTok is characterized by content-based interactions that largely depend on individually customized video feeds curated by the app’s recommendation algorithm. Algorithms are generally invisible mechanisms within socio-technical systems that can influence how we perceive online and offline reality, and how we interact with each other. Based on experiences from consuming and creating videos, users develop assumptions about how the TikTok algorithm might work, and about how to trick and please the algorithm to make their videos trend so it pushes them to other users’ ‘for you’ pages. We conducted 28 qualitative interviews with TikTok users and identified three main criteria they assume influence the platform’s algorithm: video engagement, posting time, and adding and piling up hashtags. We then collected 300,617 videos from the TikTok trending section and performed a series of data exploration and analysis to test these user assumption by determining criteria for trending videos. Our data analysis confirms that higher video engagement through comments, likes, and shares leads to a higher chance of the algorithm pushing a video to the trending section. We also find that posting videos at certain times increases the chances of it trending and reaching higher popularity. In contrast, the highly common assumption that using trending hashtags, algorithm related hashtags (e.g. #fyp, #foryou), and piling up trending hashtags would significantly push videos to the trending section was found not applicable. Our results contribute to existing research on user understanding of social media algorithms using TikTok as an example for a short-video app that is explicitly built around algorithmic content recommendation. Our results provide a broader perspective on user beliefs and behavior in the context of socio-technical systems and social media content creation and consumption.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Citations
Cites
Designing and Conducting Mixed Methods Research
Robinson, P. (2007) · Australian and New Zealand Journal of Public Health · doi:10.1111/j.1753-6405.2007.00096.x · Cited by 23,258
Qualitative Inquiry and Research Design: Choosing Among Five Approaches
Lewis, S. (2015) · Health Promotion Practice · doi:10.1177/1524839915580941 · Cited by 22,105
Want to be on the top? Algorithmic power and the threat of invisibility on Facebook
Bucher, T. (2012) · New Media & Society · doi:10.1177/1461444812440159 · Cited by 1,289
McDonald, N., Schoenebeck, S., & Forte, A. (2019) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3359174 · Cited by 1,206
‘You have one identity’: performing the self on Facebook and LinkedIn
van Dijck, J. (2013) · Media, Culture & Society · doi:10.1177/0163443712468605 · Cited by 925
Shaping the Web: Why the Politics of Search Engines Matters
Introna, L. D. (2000) · The Information Society · doi:10.1080/01972240050133634 · Cited by 783
Shaping the Web: Why the Politics of Search Engines Matters
Introna, L. D., & Nissenbaum, H. (2017) · Computer Ethics · doi:10.4324/9781315259697-19 · Cited by 708
Eslami, M., Rickman, A., Vaccaro, K., Aleyasen, A., Vuong, A., Karahalios, K., Hamilton, K., & Sandvig, C. (2015) · Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems · doi:10.1145/2702123.2702556 · Cited by 627
Media Technologies: Essays on Communication, Materiality, and Society
(2014) · The MIT Press eBooks · doi:10.7551/mitpress/9780262525374.001.0001 · Cited by 580
Mapping Internet Celebrity on TikTok: Exploring Attention Economies and Visibility Labours
Abidin, C. (2020) · Cultural Science Journal · doi:10.5334/csci.140 · Cited by 564
Unequal Representation and Gender Stereotypes in Image Search Results for Occupations
Kay, M., Matuszek, C., & Munson, S. A. (2015) · Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems · doi:10.1145/2702123.2702520 · Cited by 509 · cited 1×
“However, algorithms can also present inherent biases by design and, for example, create and potentially reinforce social, political, or cultural stereotypes in our offline lifeworlds outside of digitally mediated contexts [14, 29].”
BackgroundFeed me: motivating newcomer contribution in social network sites
Burke, M., Marlow, C., & Lento, T. (2009) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/1518701.1518847 · Cited by 416
Media Technologies: Essays on Communication, Materiality, and Society.
Söderberg, J. (2014) · Canadian Journal of Communication · doi:10.22230/cjc.2014v39n4a2957 · Cited by 402
Understanding User Beliefs About Algorithmic Curation in the Facebook News Feed
Rader, E., & Gray, R. (2015) · Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems · doi:10.1145/2702123.2702174 · Cited by 386 · cited 1×
“Research on user theories about recommendation algorithms covers, for example, Facebook news feed curation [21, 22, 44], or Spotify music suggestions [49], and how user assumptions influence user engagement [15].”
BackgroundFirst I "like" it, then I hide it: Folk Theories of Social Feeds
Eslami, M., Karahalios, K., Sandvig, C., Vaccaro, K., Rickman, A., Hamilton, K., & Kirlik, A. (2016) · Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems · doi:10.1145/2858036.2858494 · Cited by 375
We Are Data: Algorithms and the Making of Our Digital Selves
Cheney-Lippold, J. (2020) · New York University Press eBooks · doi:10.18574/nyu/9781479888702.001.0001 · Cited by 336
We are data: algorithms and the making of our digital selves
Melanson, S. (2018) · Information, Communication & Society · doi:10.1080/1369118x.2017.1413124 · Cited by 319
Getting acquainted with social networks and apps: it is time to talk about TikTok
Anderson, K. E. (2020) · Library Hi Tech News · doi:10.1108/lhtn-01-2020-0001 · Cited by 297
Rieder, B., Matamoros-Fernández, A., & Coromina, Ò. (2018) · Convergence: The International Journal of Research into New Media Technologies · doi:10.1177/1354856517736982 · Cited by 285
Roulston, K. (2014) · Sage eBooks · doi:10.4135/9781446282243.n20 · Cited by 268
Anxiety, panic and self-optimization: Inequalities and the YouTube algorithm
Bishop, S. (2018) · Convergence: The International Journal of Research into New Media Technologies · doi:10.1177/1354856517736978 · Cited by 253
Basch, C. H., Hillyer, G. C., & Jaime, C. (2022) · International Journal of Adolescent Medicine and Health · doi:10.1515/ijamh-2020-0111 · Cited by 244 · cited 2×
“Adding hashtags to TikTok videos is a common user practice to ensure visibility and reach within user communities [6, 26, 42, 50].”
BackgroundMethodDeVito, M. A., Birnholtz, J., Hancock, J. T., French, M., & Liu, S. (2018) · Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3173574.3173694 · Cited by 244 · cited 1×
“This concerns, for example, results of search engines we use [23, 28], information we consume [4], and especially social interaction and self-presentation on social media platforms [20].”
BackgroundLet’s dance the news! How the news media are adapting to the logic of TikTok
Vázquez-Herrero, J., Negreira-Rey, M.-C., & López-García, X. (2022) · Journalism · doi:10.1177/1464884920969092 · Cited by 244
For You, or For"You"?: Everyday LGBTQ+ Encounters with TikTok
Simpson, E., & Semaan, B. (2021) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3432951 · Cited by 230
Siles, I., Segura-Castillo, A., Solís, R., & Sancho, M. (2020) · Big Data & Society · doi:10.1177/2053951720923377 · Cited by 211
Willson, M. (2017) · Information, Communication & Society · doi:10.1080/1369118x.2016.1200645 · Cited by 205
Burgess, J., & Matamoros-Fernández, A. (2016) · Communication Research and Practice · doi:10.1080/22041451.2016.1155338 · Cited by 188
Dancing to the Partisan Beat: A First Analysis of Political Communication on TikTok
Medina Serrano, J. C., Papakyriakopoulos, O., & Hegelich, S. (2020) · 12th ACM Conference on Web Science · doi:10.1145/3394231.3397916 · Cited by 180
Literat, I., & Kligler-Vilenchik, N. (2019) · New Media & Society · doi:10.1177/1461444819837571 · Cited by 178
User-Generated Short Video Content in Social Media. A Case Study of TikTok
Shutsko, A. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-49576-3_8 · Cited by 166
Lu, X., & Lu, Z. (2019) · Lecture notes in computer science · doi:10.1007/978-3-030-21902-4_17 · Cited by 160
Follow the algorithm: An exploratory investigation of music on YouTube
Airoldi, M., Beraldo, D., & Gandini, A. (2016) · Poetics · doi:10.1016/j.poetic.2016.05.001 · Cited by 145
Herrick, S. S. C., Hallward, L., & Duncan, L. R. (2021) · International Journal of Eating Disorders · doi:10.1002/eat.23463 · Cited by 141
The YouTube Algorithm and the Alt-Right Filter Bubble
Bryant, L. V. (2020) · Open Information Science · doi:10.1515/opis-2020-0007 · Cited by 139
Willson, M. (2019) · The Social Power of Algorithms · doi:10.4324/9781351200677-9 · Cited by 115
Share First, Save Later: Performance of Self through Snapchat Stories
McRoberts, S., Ma, H., Hall, A., & Yarosh, S. (2017) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3025453.3025771 · Cited by 107
Toward creating a fairer ranking in search engine results
Gao, R., & Shah, C. (2020) · Information Processing & Management · doi:10.1016/j.ipm.2019.102138 · Cited by 107
‘Networks that work too well’: intervening in algorithmic connections
van der Nagel, E. (2018) · Media International Australia · doi:10.1177/1329878x18783002 · Cited by 106
A study on the characteristics of douyin short videos and implications for edge caching
Chen, Z., He, Q., Mao, Z., Chung, H.-M., & Maharjan, S. (2019) · Proceedings of the ACM Turing Celebration Conference - China · doi:10.1145/3321408.3323082 · Cited by 94 · cited 1×
“Short-video apps are distinct from video-sharing platforms (e.g. YouTube) and social networking services (e.g. Facebook, Instagram) [42] because they are exclusively designed for people to interact with and through user-generated video content [16] rather than with each other around it.”
BackgroundTIKTOK AND THE “ALGORITHMIZED SELF”: A NEW MODEL OF ONLINE INTERACTION
Bhandari, A., & Bimo, S. (2020) · AoIR Selected Papers of Internet Research · doi:10.5210/spir.v2020i0.11172 · Cited by 94
Lustig, C., Pine, K., Nardi, B., Irani, L., Lee, M. K., Nafus, D., & Sandvig, C. (2016) · Proceedings of the 2016 CHI Conference Extended Abstracts on Human Factors in Computing Systems · doi:10.1145/2851581.2886426 · Cited by 83
#TulsaFlop: A Case Study of Algorithmically-Influenced Collective Action on TikTokPreprint
Bandy, J., & Diakopoulos, N. A. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2012.07716 · Cited by 82
Klug, D. (2020) · MediArXiv (OSF Preprints) · doi:10.33767/osf.io/j8u9v · Cited by 81
Self-citationReposting “till Albert Einstein is TikTok famous”: The Memetic Construction of Science on TikTokPreprint
Zeng, J., Schäfer, M. S., & Allgaier, J. (2020) · OSF Preprints (OSF Preprints) · doi:10.31219/osf.io/8tdvm · Cited by 80
Intensified Play: Cinematic study of TikTok mobile app
Kurzrock, E. (2019) · Cited by 72
Auditing News Curation Systems: A Case Study Examining Algorithmic and Editorial Logic in Apple News
Bandy, J., & Diakopoulos, N. (2020) · Proceedings of the International AAAI Conference on Web and Social Media · doi:10.1609/icwsm.v14i1.7277 · Cited by 64
Exploring TikTok Use and Non-use Practices and Experiences in China
Lu, X., Lu, Z., & Liu, C. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-49576-3_5 · Cited by 59
Bahujan girls’ anti-caste activism on TikTok
Subramanian, S. (2020) · Feminist Media Studies · doi:10.1080/14680777.2021.1864875 · Cited by 59
You Made This? I Made This:Practices of Authorship and (Mis)Attribution on TikTok
Kaye, D. B. V., Rodriguez, A., Langton, K., & Wikström, P. (2021) · Figshare · Cited by 49
The rise of mobile and social short-form video: an in-depth measurement study of vine
Vandersmissen, B., Godin, F., Tomar, A., Neve, W. D., & Walle, R. V. D. (2014) · Ghent University Academic Bibliography (Ghent University) · Cited by 31
Synching and performing : body (re)-presentation in the short video app TikTok
Khattab, M. (2020) · Osuva (University of Vaasa) · Cited by 30
Understand Instant Video Clip Sharing on Mobile Platforms
Zhang, L., Wang, F., & Liu, J. (2014) · International Workshop on Network and Operating Systems Support for Digital Audio and Video (NOSSDAV) · doi:10.1145/2578260.2578278 · Cited by 30
Understand Instant Video Clip Sharing on Mobile Platforms
Zhang, L., Wang, F., & Liu, J. (2014) · International Workshop on Network and Operating Systems Support for Digital Audio and Video (NOSSDAV) · doi:10.1145/2597176.2578278 · Cited by 24
YOU MADE THIS? I MADE THIS: CULTURES OF AUTOMATIC (MIS)ATTRIBUTION ON TIKTOK
Kaye, D., Rodriguez, A., & Wikström, P. (2020) · AoIR Selected Papers of Internet Research · doi:10.5210/spir.v2020i0.11354 · Cited by 18
Bruns, A. (2007) · Proceedings of the 6th ACM SIGCHI conference on Creativity & cognition - C&C '07 · doi:10.1145/1254960.1254975
Research works printed but not linked: 3
- danah boyd. 2010. Social network sites as networked publics: Affordances, dynamics, and implications. Networked self: Identity, community, and culture on social network sites (2010), 39–58.
- 10.5555/2500954 · doi:10.5555/2500954
- Robyn Longhurst. 2003. Semi-structured interviews and focus groups. Key methods in geography 3, 2 (2003), 143–156.
Cited by
An Empirical Investigation of Personalization Factors on TikTok
Boeker, M., & Urman, A. (2022) · International World Wide Web Conference (WWW) · doi:10.1145/3485447.3512102 · Cited by 284
What do we know about algorithmic literacy? The status quo and a research agenda for a growing field
Oeldorf-Hirsch, A., & Neubaum, G. (2023) · New Media & Society · doi:10.1177/14614448231182662 · Cited by 199
Violot, C., Elmas, T., Bilogrevic, I., & Humbert, M. (2024) · ACM Web Science Conference (WebSci) · doi:10.1145/3614419.3644023 · Cited by 171
Blurring Boundaries Between Journalists and Tiktokers: Journalistic Role Performance on TikTok
Negreira-Rey, M.-C., Vázquez-Herrero, J., & García, X. L. (2022) · Media and Communication · doi:10.17645/mac.v10i1.4699 · Cited by 135
The Algorithmic Crystal: Conceptualizing the Self through Algorithmic Personalization on TikTok
Lee, A. Y., Mieczkowski, H., Ellison, N. B., & Hancock, J. T. (2022) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3555601 · Cited by 132
Metadata
- Authors
- Klug, D., Qin, Y., Evans, M., & Kaufman, G.
- Affiliations
- Carnegie Mellon University (US)
- Venue
- 13th ACM Web Science Conference 2021
- Publisher
- ACM
- Published
- 2021-06-21
- Pages
- 84-92
- OpenAlex
- W3176799022
- Semantic Scholar
- ed740d6f7ab3d8053a646512c8c0dc99179f58f0
- Cited by
- 392
- References
- 54
- Citations by year
- 2026: 105 · 2025: 102 · 2024: 91 · 2023: 64 · 2022: 26 · 2021: 4
- FWCI
- 96.53
- Type
- conference paper
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- Locations
- ACM Web Science Conference (WebSci) (publishedVersion, cc-by)
- Topics
- Social Sciences › Communication › Media and Digital Communication
- Physical Sciences › Computer Science › Information Systems › Recommender Systems and Techniques
- Social Sciences › Communication › Social Media and Politics
- Keywords
- TikTok, recommendation algorithms, algorithmic transparency, short-form video, video engagement, posting time, hashtags, trending videos, content creation, socio-technical systems, user behavior
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.