Cited by 254Journalism and Media StudiesMedia Studies and CommunicationMisinformation and Its Impacts

Effective Headlines of Newspaper Articles in a Digital Environment

Open access
Kuiken, Jeffrey, Schuth, Anne, Spitters, Martijn, Marx, Maarten·2017·Digital Journalism

Abstract

We study the effect on click-through rates of applying textual and stylistic features often related to clickbait to headlines of newspaper articles which can be bought in a digital environment. Having a dataset consisting of triples—original headline, rewritten headline, CTR, where CTR is the click-through rate of the rewritten headline in a newsletter from the online kiosk Blendle—we can directly measure whether these “clickbait features” do what they are believed to do: entice readers to click on them. The main findings are as follows. First, the data shows that editors of Blendle indeed often use clickbait features when rewriting headlines. Second, most, but not all, of the clickbait features lead to a statistically significant increase in the number of clicks. Third, predicting the effectiveness of a headline only on the basis of its clickbait features is not possible. The data on which this article is based is publicly available online.

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1080/21670811.2017.1279978

Cites

1 of 1 references verified0 citation errors · 0 not checkable

Statistics

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

  • Some clickbait features can increase user interaction, and sensational features can be associated with engagement on social platforms.

    “It also aligns with research showing that some clickbait features can increase user interaction (Jung et al., 2022;Kuiken et al., 2017) and that sensational features can be associated with engagement on social platforms (Khawar & Boukes, 2025).”

    From Sensational Headlines, Engagement, and Credibility in Nepal’s Online News (2025) · cites this paper as Kuiken et al., 2017

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Cites

Flagged first, then by citations

Research works printed but not linked: 28

  1. Anderson, Chris W. 2011. "Between Creative and Quantified Audiences: Web Metrics and Changing Patterns of Newswork in Local US Newsrooms." Journalism 12 (5): 550-566.
  2. Atterer, Richard, Monika Wnuk, and Albrecht Schmidt. 2006. "Knowing the User's Every Move: User Activity Tracking for Website Usability Evaluation and Implicit Interaction." In Pro- ceedings of the 15th international conference on World Wide Web, 203-212, ACM.
  3. Baresch, Brian, Lewis Knight, Dustin Harp, and Carolyn Yaschur. 2011. "Friends Who Choose Your News: An Analysis of Content Links on Facebook." In ISOJ: The Official Research Journal of International Symposium on Online Journalism, Austin, TX 1: 1-24.
  4. Bell, Allan. 1991. The Language of News Media. Oxford: Blackwell.
  5. Blom, Jonas Nygaard, and Kenneth Reinecke Hansen. 2015. "Click Bait: Forward-Reference as Lure in Online News Headlines." Journal of Pragmatics 76: 87-100.
  6. Breiman, Leo. 2001. "Random Forests." Machine Learning 45 (1): 5-32.
  7. Chen, Yimin, Niall J Conroy, and Victoria L Rubin. 2015. "News in an Online World: The Need for an Automatic Crap Detector." In Proceedings of the 78th ASIS&T Annual Meeting: Information Science with Impact: Research in and for the Community, 81, American Society for Information Science.
  8. De Smedt, Tom, and Walter Daelemans. 2012. "Pattern for Python." The Journal of Machine Learning Research 13 (1): 2063-2067.
  9. Dick, Murray. 2011. "Search Engine Optimisation in UK News Production." Journalism Practice 5 (4): 462-477.
  10. Dor, Daniel. 2003. "On Newspaper Headlines as Relevance Optimizers." Journal of Pragmatics 35 (5): 695-721.
  11. Freund, Yoav, Robert Schapire, and N. Abe. 1999. "A Short Introduction to Boosting." Journal-Japanese Society for Artificial Intelligence 14 (771-780): 1612.
  12. Gray, Russell D., and Quentin D. Atkinson. 2003. "Language-Tree Divergence times Support the Anatolian Theory of Indo-European Origin." Nature 426 (6965): 435-439.
  13. Hermida, Alfred, Fred Fletcher, Darryl Korell, and Donna Logan. 2012. "Share, like, Recom- mend: Decoding the Social Media News Consumer." Journalism Studies 13 (5-6): 815-824.
  14. Holmqvist, Kenneth, Jana Holsanova, Maria Barthelson, and Daniel Lundqvist. 2003. "Reading or Scanning? A Study of Newspaper and Net Paper Reading." In The Mind's Eye: Cognitive and Applied Aspects of Eye Movement Research, edited by Jana Hyo ¨na ¨, Ralph Radach, and Heiner Deubel, 657-670. Amsterdam: Elsevier Science.
  15. Iarovici, Edith, and Rodica Amel. 1989. "The Strategy of the Headline." Semiotica 77 (4): 441-460.
  16. Ifantidou, Elly. 2009. "Newspaper Headlines and Relevance: Ad Hoc Concepts in Ad Hoc Con- texts." Journal of Pragmatics 41 (4): 699-720.
  17. Ko ¨nig, Arnd Christian, Michael Gamon, and Qiang Wu. 2009. "Click-through Prediction for News Queries." In Proceedings of the 32nd international ACM SIGIR conference on Research and development in information retrieval, 347-354, ACM.
  18. Lai, Linda, and Audun Farbrot. 2014. "What Makes You Click? The Effect of Question Headlines on Readership in Computer-Mediated Communication." Social Influence 9 (4): 289-299.
  19. Lee, Angela M., and Seth C. Lewis. 2012. "Audience Preference and Editorial Judgment: A Study of Time-Lagged Influence in Online News." In 13th International Symposium on Online Journalism, Austin, TX.
  20. Liaw, Andy, and Matthew Wiener. 2002. "Classification and Regression by RandomForest." R News 2 (3): 18-22.
  21. MacGregor, Phil. 2007. "Tracking the Online Audience: Metric Data Start a Subtle Revolution." Journalism Studies 8 (2): 280-298.
  22. Marcus, Mitchell P., Mary Ann Marcinkiewicz, and Beatrice Santorini. 1993. "Building a Large Annotated Corpus of English: The Penn Treebank." Computational Linguistics 19 (2): 313-330.
  23. Pedregosa, Fabian, Gae ¨l Varoquaux, Alexandre Gramfort, Vincent Michel, Bertrand Thirion, Olivier Grisel, Mathieu Blondel, Peter Prettenhofer, Ron Weiss, Vincent Dubourg, et al. 2011. "Scikit-Learn: Machine Learning in Python." The Journal of Machine Learning Research 12: 2825-2830.
  24. Richardson, Matthew, Ewa Dominowska, and Robert Ragno. 2007. "Predicting Clicks: Estimat- ing the Click-through Rate for New Ads." In Proceedings of the 16th international con- ference on World Wide Web, 521-530, ACM.
  25. Rowe, David. 2011. "Obituary for the Newspaper? Tracking the Tabloid." Journalism 12 (4): 449-466.
  26. Sperber, Dan, and Deirdre Wilson. 1986. Relevance: Communication and Cognition. vol. 142. Oxford: Blackwell.
  27. Tandoc, Edson C. 2014. "Journalism is Twerking? How Web Analytics is Changing the Process of Gatekeeping." New Media & Society 16 (4): 559-575.
  28. Tenenboim, Ori, and Akiba A. Cohen. 2015. "What Prompts Users to Click and Comment: A Longitudinal Study of Online News." Journalism 16 (2): 198-217.

Cited by

Sorted by citations

Authors
Kuiken, J., Schuth, A., Spitters, M., & Marx, M.
Affiliations
  • University of Amsterdam (NL)
  • Blendle , The Netherlands
Corresponding author
  • Kuiken, Jeffrey
  • Schuth, Anne
  • Spitters, Martijn
  • Marx, Maarten
Venue
Digital Journalism
Published
2017-02-02
Volume
5
Issue
10
Pages
1300-1314
ISSN
  • 2167-0811 (ISSN-L)
  • 2167-082X
OpenAlex
W2584762744
Cited by
254
References
1
Citations by year
2026: 21 · 2025: 35 · 2024: 30 · 2023: 34 · 2022: 28 · 2021: 37 · 2020: 38 · 2019: 24 · 2018: 6 · 2017: 1
FWCI
40.83
Type
journal article
Language
en
Open access
Locations
  • Digital Journalism (publishedVersion, cc-by-nc-nd)
  • Data Archiving and Networked Services (DANS) (submittedVersion, other-oa)
  • UvA-DARE (University of Amsterdam) (submittedVersion, cc-by-nc-nd)
Topics
  • Social Sciences › Communication › Journalism and Media Studies
  • Social Sciences › Communication › Media Studies and Communication
  • Social Sciences › Sociology and Political Science › Misinformation and Its Impacts
Keywords
clickbait, headlines, click-through rate, newspaper articles, online newsletters, online news, editorial practice

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review