CoChat

Impact of Voice Fidelity on Decision Making: A Potential Dark Pattern?

Open access
Dubiel, Mateusz, Sergeeva, Anastasia, Leiva, Luis A. · 2024 · Proceedings of the 29th International Conference on Intelligent User Interfaces

The DOI matches its Crossref record; 59 of the 59 references it cites were found in a registry or an index.

Abstract

Manipulative design in user interfaces (conceptualized as dark patterns) has emerged as a significant impediment to the ethical design of technology and a threat to user agency and freedom of choice. While previous research focused on exploring these patterns in the context of graphical user interfaces, the impact of speech has largely been overlooked. We conducted a listening test (N = 50) to elicit participants’ preferences regarding different synthetic voices that varied in terms of synthesis method (concatenative vs. neural) and prosodic qualities (speech pace and pitch variance), and then evaluated their impact in an online decision-making study (N = 101). Our results indicate a significant effect of voice qualities on the participant’s choices, independently from the content of the available options. Our results also indicate that the voice’s perceived engagement, ease of understanding, and domain fit directly translate to its impact on participants’ behavior in decision-making tasks.

Overview

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1145/3640543.3645202

Cites

59 of 59 references verified0 citation errors · 0 not checkable

Statistics

Figures

Figure 1 Modern synthetic voices may sound very natural to end users; therefore, they have the potential for persuasion and in turn, affect user behaviour. We believe that this could be an emerging dark pattern in conversational user interfaces.
Figure 1 Modern synthetic voices may sound very natural to end users; therefore, they have the potential for persuasion and in turn, affect user behaviour. We believe that this could be an emerging dark pattern in conversational user interfaces.CC-BY-NC-ND · From the PDF
Figure 2 Overview of Experimental Stages.
Figure 2 Overview of Experimental Stages.CC-BY-NC-ND · From the PDF
Figure 3 Prosodic qualities of selected voices: Standard TTS (baseline) and two Neural TTS voices. Error bars denote the standard deviation of pitch, based on acoustic analysis.
Figure 3 Prosodic qualities of selected voices: Standard TTS (baseline) and two Neural TTS voices. Error bars denote the standard deviation of pitch, based on acoustic analysis.CC-BY-NC-ND · From the PDF
Figure 4 Independent-Samples Kruskal-Wallis ranks for Standard TTS, Neural TTS1, and Neural TTS2 in terms of: Ease of understanding, Listening enjoyment, and Domain suitability. Note: '***' indicates p < .001
Figure 4 Independent-Samples Kruskal-Wallis ranks for Standard TTS, Neural TTS1, and Neural TTS2 in terms of: Ease of understanding, Listening enjoyment, and Domain suitability. Note: '***' indicates p < .001CC-BY-NC-ND · From the PDF
Figure 5 Proportion of selected options when presented by Neural TTS and Standard TTS. For example, the first purple bar on the left means that there were 2 participants who selected options presented by Neural TTS 0 out of 4 times.
Figure 5 Proportion of selected options when presented by Neural TTS and Standard TTS. For example, the first purple bar on the left means that there were 2 participants who selected options presented by Neural TTS 0 out of 4 times.CC-BY-NC-ND · From the PDF
Figure 6 Related-Samples Friedman's Two-Way Analysis of Variance by Ranks in experimental conditions.
Figure 6 Related-Samples Friedman's Two-Way Analysis of Variance by Ranks in experimental conditions.CC-BY-NC-ND · From the PDF

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Show all 59 references

Research works printed but not linked: 18

  1. Shlomo Benartzi, John Beshears, Katherine L Milkman, Cass R Sunstein, Richard H Thaler, Maya Shankar, Will Tucker-Ray, William J Congdon, and Steven Galing. 2017. Should governments invest more in nudging?Psychological science 28, 8 (2017), 1041–1055.
  2. Kerstin Bongard-Blanchy, Arianna Rossi, Salvador Rivas, Sophie Doublet, Vincent Koenig, and Gabriele Lenzini. 2021. ” I am Definitely Manipulated, Even When I am Aware of it. It’s Ridiculous!”-Dark Patterns from the End-User Perspective. In Designing Interactive Systems Conference 2021. 763–776.
  3. Akash Chaudhary, Jaivrat Saroha, Kyzyl Monteiro, Angus G Forbes, and Aman Parnami. 2022. “Are You Still Watching?”: Exploring Unintended User Behaviors and Dark Patterns on Video Streaming Platforms. In Designing Interactive Systems Conference. 776–791.
  4. Hengchen Dai, Silvia Saccardo, Maria A Han, Lily Roh, Naveen Raja, Sitaram Vangala, Hardikkumar Modi, Shital Pandya, Michael Sloyan, and Daniel M Croymans. 2021. Behavioural nudges increase COVID-19 vaccinations. Nature 597, 7876 (2021), 404–409.
  5. Elizabeth Dula, Andres Rosero, and Elizabeth Phillips. 2023. Identifying Dark Patterns in Social Robot Behavior. In 2023 Systems and Information Engineering Design Symposium (SIEDS). IEEE, 7–12.
  6. Bureau européen des unions de consommateurs. 2022. “Dark patterns” and the EU consumer law acquisition. https://www.beuc.eu/sites/default/files/publications/beuc-x-2022-013_dark_patters_paper.pdf Last accessed 9 January 2023.
  7. Colin M Gray, Lorena Sanchez Chamorro, Ike Obi, and Ja-Nae Duane. 2023. Mapping the Landscape of Dark Patterns Scholarship: A Systematic Literature Review. In Designing Interactive Systems Conference. 188–193.
  8. Lars Hornuf and Sonja Mangold. 2022. Digital dark nudges. In Diginomics Research Perspectives: The Role of Digitalization in Business and Society. Springer, 89–104.
  9. Luiza Jarovsky. 2022. Dark Patterns in Personal Data Collection: Definition, Taxonomy and Lawfulness. Taxonomy and Lawfulness (March 1, 2022) (2022).
  10. Mandy B Korpusik. 2019. Deep learning for spoken dialogue systems: application to nutrition. Ph. D. Dissertation. Massachusetts Institute of Technology.
  11. Cherie Lacey and Catherine Caudwell. 2019. Cuteness as a ‘dark pattern’in home robots. In 2019 14th ACM/IEEE International Conference on Human-Robot Interaction (HRI). IEEE, 374–381.
  12. Oksana Mont, Matthias Lehner, and Eva Heiskanen. 2014. Nudging: A tool for sustainable behaviour?Naturvårdsverket.
  13. Anna Oleszkiewicz, Katarzyna Pisanski, Kinga Lachowicz-Tabaczek, and Agnieszka Sorokowska. 2017. Voice-based assessments of trustworthiness, competence, and warmth in blind and sighted adults. Psychonomic bulletin & review 24 (2017), 856–862.
  14. Paul Slovic, Melissa L Finucane, Ellen Peters, and Donald G MacGregor. 2007. The affect heuristic. European journal of operational research 177, 3 (2007), 1333–1352.
  15. Anssi Tarkiainen and Sanna Sundqvist. 2009. Product involvement in organic food consumption: does ideology meet practice?Psychology & Marketing 26, 9 (2009), 844–863.
  16. Paul Taylor. 2009. Text-to-speech synthesis. Cambridge university press.
  17. Reha Tuncer, Anastasia Sergeeva, Kerstin Bongard-Blanchy, Verena Distler, Sophie Doublet, and Vincent Koenig. 2023. Running out of time (rs): effects of scarcity cues on perceived task load, perceived benevolence and user experience on e-commerce sites. Behaviour & Information Technology (2023), 1–19.
  18. Aarron Walter and Jared M Spool. 2011. Designing for emotion. Vol. 9. A book apart New York.

Cited by

See all 30

Metadata

Authors
Dubiel, M., Sergeeva, A., & Leiva, L. A.
Affiliations
University of Luxembourg (LU)
Venue
Proceedings of the 29th International Conference on Intelligent User Interfaces
Publisher
ACM
Published
2024-03-18
Pages
181-194
OpenAlex
W4393970546
Cited by
16
References
57
Citations by year
2026: 4 · 2025: 7 · 2024: 5
FWCI
5.16
Type
conference paper
Language
en
Open access
Locations
  • ACM International Conference on Intelligent User Interfaces (IUI) (publishedVersion, cc-by-nc-nd)
  • arXiv (Cornell University) (submittedVersion, cc-by-nc-nd)
  • Open Repository and Bibliography (University of Luxembourg) (submittedVersion, cc-by-nc-nd)
  • arXiv (Cornell University)
Funders
  • Horizon 2020 Framework Programme (BANANA, grant CHIST-ERA-20-BCI-001)
  • HORIZON EUROPE European Innovation Council (SYMBIOTIK, grant 101071147)
  • Luxembourg National Research Fund (FNR) (Decepticon (grant no.IS/14717072))
Topics
  • Physical Sciences › Computer Science › Human-Computer Interaction › Innovative Human-Technology Interaction
  • Physical Sciences › Computer Science › Human-Computer Interaction › Usability and User Interface Design
  • Social Sciences › Business, Management and Accounting › Marketing › AI in Service Interactions
Keywords
dark patterns, synthetic speech, manipulative design, decision-making, user agency, ethical design, speech synthesis, prosody, neural text-to-speech, concatenative synthesis, user preferences, listening tests

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: Impact of Voice Fidelity on Decision Making: A Potential Dark Pattern? https://app.cochat.ai/papers/10.1145/3640543.3645202
The paper
Dubiel, M., Sergeeva, A., & Leiva, L. A. (2024). Impact of Voice Fidelity on Decision Making: A Potential Dark Pattern? Proceedings of the 29th International Conference on Intelligent User Interfaces. https://doi.org/10.1145/3640543.3645202

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.