Cited by 17Usability and User Interface DesignInnovative Human-Technology InteractionPersonal Information Management and User Behavior

Driven by notifications – exploring the effects of badge notifications on user experience

Open access
Bartoli, Nicola, Benedetto, Simone·2022·PLOS ONE

Abstract

Notification badges are an unexplored category of visual feedback to which we are continuously exposed. This study aims to deepen knowledge on the topic by measuring the behavioral effects of notification badges on a large sample of smartphone users. More precisely, the goal of the study is to observe if the presence of notification badges increases the frequency of clicks on apps. More than 1000 participants were involved in a remote between-subjects experiment, allocated into fifteen equinumerous groups of comparison. Each participant was presented with a smartphone screen displaying fifteen app icons and just one badge notification. Participants were asked to perform a remote user test called First Impression Click Test: a methodology that indicates where they would click first to accomplish a given task (i.e., Where would you click first on this screen?). Our results show a large increase in the number of clicks on apps with notification badges compared to those without notification badges and suggest the important ability of these small affordances to attract attention and stimulate action. Based on the evidence provided, our findings have practical implications for user experience design.

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1371/journal.pone.0270888

Cites

2 of 2 references verified0 citation errors · 0 not checkable

Statistics

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

  • Red notification badges normally evoke a sense of urgency to act upon the notification.

    “Moreover, grayscaling affects the color of noti fi cation badges (i.e., the red circle on the upper right corner of an app icon displaying the number of unread noti fi cations), of which the red color normally evokes a sense of urgency to act upon the noti fi cation (Bartoli & Benedetto, 2022; Kozyreva et al., 2020).”

    From Is life brighter when your phone is not? The efficacy of a grayscale smartphone intervention addressing digital well-being (2024) · cites this paper as Bartoli & Benedetto, 2022

    The Introduction describes notification badges as red circles and says they can trigger a sense of urgency and act as calls to action. The Discussion attributes urgency to the badges’ implicit meaning, while linking color to visual salience; it does not establish that the red color itself evokes urgency. No page numbers are available in our copy. (LLM, conf=0.88)

    Experimental — accuracy not yet measured

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Cites

Flagged first, then by citations

Research works printed but not linked: 19

  1. [1]Yoon S, Lee K-P. A study on notification system design of smartphone messenger considering the user’s stress. Arch Des Res. 2015; 28(2): 75.
  2. [2]Kahneman D., Slovic S. P., Slovic P., & Tversky A. Judgment under uncertainty: Heuristics and biases. Cambridge university press. 1982. 17835457
  3. [3]Gilovich T, Griffin D, Kahneman D, Cambridge University Press. Heuristics and biases: The psychology of intuitive judgment. Gilovich T, Griffin D, Kahneman D, editors. Cambridge, England: Cambridge University Press; 2002.
  4. [4]Bordalo P, Gennaioli N, Shleifer A. Salience theory of choice under risk. Q J Econ. 2012; 127(3): 1243– 85.
  5. [5]Kotter J. P., Kim W. C., & Mauborgne R. A. HBR’s 10 Must Reads on Change Management (including featured article" Leading Change," by John P. Kotter). Harvard Business Press; 2011.
  6. [6]Zhu M, Yang Y, Hsee CK. The mere urgency effect. J Consum Res [Internet]. 2018; Available from: 10.1093/jcr/ucy008 · DOI
  7. [7]Iqbal ST, Horvitz E. Notifications and awareness: A field study of alert usage and preferences. In: Proceedings of the 2010 ACM conference on Computer supported cooperative work—CSCW ‘10. New York, New York, USA: ACM Press; 2010.
  8. [11]Fischer JE, Yee N, Bellotti V, Good N, Benford S, Greenhalgh C. Effects of content and time of delivery on receptivity to mobile interruptions. In: Proceedings of the 12th international conference on Human computer interaction with mobile devices and services—MobileHCI ‘10. New York, New York, USA: ACM Press; 2010.
  9. [12]Fischer JE, Greenhalgh C, Benford S. Investigating episodes of mobile phone activity as indicators of opportune moments to deliver notifications. In: Proceedings of the 13th International Conference on Human Computer Interaction with Mobile Devices and Services—MobileHCI ‘11. New York, New York, USA: ACM Press; 2011.
  10. [13]Saket B, Prasojo C, Huang Y, Zhao S. Designing an effective vibration-based notification interface for mobile phones. In: Proceedings of the 2013 conference on Computer supported cooperative work—CSCW ‘13. New York, New York, USA: ACM Press; 2013.
  11. [14]Pielot M, Church K, de Oliveira R. An in-situ study of mobile phone notifications. In: Proceedings of the 16th international conference on Human-computer interaction with mobile devices & services—MobileHCI ‘14. New York, New York, USA: ACM Press; 2014.
  12. [16]Fitz N, Kushlev K, Jagannathan R, Lewis T, Paliwal D, Ariely D. Batching smartphone notifications can improve well-being. Comput Human Behav. 2019; 101: 84– 94.
  13. [17]Loid K, Täht K, Rozgonjuk D. Do pop-up notifications regarding smartphone use decrease screen time, phone checking behavior, and self-reported problematic smartphone use? Evidence from a two-month experimental study. Comput Human Behav. 2020; 102: 22– 30.
  14. [18]Mirhosseini S, Parnin C. Can automated pull requests encourage software developers to upgrade out-of-date dependencies? In: 2017 32nd IEEE/ACM International Conference on Automated Software Engineering (ASE). IEEE; 2017.
  15. [19]Lindgaard G, Fernandes G, Dudek C, Brown J. Attention web designers: You have 50 milliseconds to make a good first impression! Behav Inf Technol. 2006; 25(2): 115– 26.
  16. [20]Gronier G. Measuring the First Impression: Testing the Validity of the 5 Second Test. Journal of Usability Studies. 2016; 12(1).
  17. [22]Chen SX, Qin J, Tang CY. Mann-Whitney test with adjustments to pretreatment variables for missing values and observational study: Mann-Whitney Test with Adjustments to Pretreatment Variables. J R Stat Soc Series B Stat Methodol. 2013; 75(1): 81– 102.
  18. [23]Haselton MG, Nettle D, Murray DR. The evolution of cognitive bias. In: The Handbook of Evolutionary Psychology. Hoboken, NJ, USA: John Wiley & Sons, Inc.; 2015. p. 1– 20.
  19. [24]Orzan G, Zara IA, Purcarea VL. Neuromarketing techniques in pharmaceutical drugs advertising. A discussion and agenda for future research. J Med Life. 2012; 5(4): 428– 32. 23346245 PMC3539849

Cited by

Sorted by citations

Authors
Bartoli, N., & Benedetto, S.
Corresponding author
Benedetto, Simone
Venue
PLOS ONE
Published
2022-06-30
Volume
17
Issue
6
Pages
e0270888
ISSN
1932-6203 (ISSN-L)
OpenAlex
W4283729926
Cited by
17
References
2
Citations by year
2026: 5 · 2025: 4 · 2024: 5 · 2023: 3
FWCI
1.48
Type
journal article
Language
en
Open access
Locations
  • PLoS ONE (publishedVersion, cc-by)
  • PubMed Central (publishedVersion, cc-by)
  • PubMed (publishedVersion)
  • DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
Topics
  • Physical Sciences › Computer Science › Human-Computer Interaction › Usability and User Interface Design
  • Physical Sciences › Computer Science › Human-Computer Interaction › Innovative Human-Technology Interaction
  • Social Sciences › Decision Sciences › Information Systems and Management › Personal Information Management and User Behavior
Keywords
visual feedback, smartphone user experience, affordances, remote user testing
MeSH terms
Smartphone, Humans, Motivation, Mobile Applications

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review