Impact of Voice Fidelity on Decision Making: A Potential Dark Pattern?
Open accessThe DOI matches its Crossref record; 59 of the 59 references it cites were found in a registry or an index.
Abstract
Manipulative design in user interfaces (conceptualized as dark patterns) has emerged as a significant impediment to the ethical design of technology and a threat to user agency and freedom of choice. While previous research focused on exploring these patterns in the context of graphical user interfaces, the impact of speech has largely been overlooked. We conducted a listening test (N = 50) to elicit participants’ preferences regarding different synthetic voices that varied in terms of synthesis method (concatenative vs. neural) and prosodic qualities (speech pace and pitch variance), and then evaluated their impact in an online decision-making study (N = 101). Our results indicate a significant effect of voice qualities on the participant’s choices, independently from the content of the available options. Our results also indicate that the voice’s perceived engagement, ease of understanding, and domain fit directly translate to its impact on participants’ behavior in decision-making tasks.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Figures






Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Given that prior research, such as Dubiel et al. [26, 27], has indicated that even minor variations in voice characteristics can significantly influence user perceptions, we decided to adopt a synthetic voice for the user role as well.”
From Examining Humanness as a Metaphor to Design Voice User Interfaces (2024) · cites this paper as [27]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Nudge: improving decisions about health, wealth, and happiness
(2008) · Choice Reviews Online · doi:10.5860/choice.46-0977 · Cited by 11,572
Baddeley, A. (1992) · Science · doi:10.1126/science.1736359 · Cited by 5,258
Principles of Voice Production
Titze, I. R., & Martin, D. W. (1998) · The Journal of the Acoustical Society of America · doi:10.1121/1.424266 · Cited by 1,643
Food Choice: A Conceptual Model of the Process
FURST, T., CONNORS, M., BISOGNI, C. A., SOBAL, J., & FALK, L. W. (1996) · Appetite · doi:10.1006/appe.1996.0019 · Cited by 1,230
Consumer experiences, attitude and behavioral intention toward online food delivery (OFD) services
Yeo, V. C. S., Goh, S.-K., & Rezaei, S. (2017) · Journal of Retailing and Consumer Services · doi:10.1016/j.jretconser.2016.12.013 · Cited by 956
The Dark (Patterns) Side of UX Design
Gray, C. M., Kou, Y., Battles, B., Hoggatt, J., & Toombs, A. L. (2018) · Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3173574.3174108 · Cited by 848
Dark Patterns at Scale: Findings from a Crawl of 11K Shopping Websites
Mathur, A., Acar, G., Friedman, M. J., Lucherini, E., Mayer, J., Chetty, M., & Narayanan, A. (2019) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3359183 · Cited by 816
Hansen, P. G., & Jespersen, A. M. (2013) · European Journal of Risk Regulation · doi:10.1017/s1867299x00002762 · Cited by 773
Harmon-Jones, E., & Mills, J. (2019) · Cognitive dissonance: Reexamining a pivotal theory in psychology (2nd ed.). · doi:10.1037/0000135-001 · Cited by 760
Learning to summarize from human feedback
Stiennon, N., Ouyang, L., Wu, J., Ziegler, D. M., Lowe, R., Voss, C., Radford, A., Amodei, D., & Christiano, P. (2020) · arXiv · doi:10.48550/arxiv.2009.01325 · Cited by 550
Shining a Light on Dark Patterns
Luguri, J., & Strahilevitz, L. J. (2021) · Journal of Legal Analysis · doi:10.1093/jla/laaa006 · Cited by 465
Scherer, K. R., Johnstone, & Klasmeyer, G. (2002) · Handbook of Affective Sciences · doi:10.1093/oso/9780195126013.003.0023 · Cited by 426
How Do You Say ‘Hello’? Personality Impressions from Brief Novel Voices
McAleer, P., Todorov, A., & Belin, P. (2014) · PLoS ONE · doi:10.1371/journal.pone.0090779 · Cited by 388
Music, Search, and IoT: How People (Really) Use Voice Assistants
Ammari, T., Kaye, J., Tsai, J. Y., & Bentley, F. (2019) · ACM Transactions on Computer-Human Interaction · doi:10.1145/3311956 · Cited by 356
Understanding Voice Perception
Belin, P., Bestelmeyer, P. E. G., Latinus, M., & Watson, R. (2011) · British Journal of Psychology · doi:10.1111/j.2044-8295.2011.02041.x · Cited by 342
Mathur, A., Kshirsagar, M., & Mayer, J. (2021) · Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3411764.3445610 · Cited by 331
Szaszi, B., Palinkas, A., Palfi, B., Szollosi, A., & Aczel, B. (2018) · Journal of Behavioral Decision Making · doi:10.1002/bdm.2035 · Cited by 322
Tales from the Dark Side: Privacy Dark Strategies and Privacy Dark Patterns
Bösch, C., Erb, B., Kargl, F., Kopp, H., & Pfattheicher, S. (2016) · Proceedings on Privacy Enhancing Technologies · doi:10.1515/popets-2016-0038 · Cited by 319
Okay, Google!: An empirical study on voice assistants on consumer engagement and loyalty
Moriuchi, E. (2019) · Psychology & Marketing · doi:10.1002/mar.21192 · Cited by 297
UI Dark Patterns and Where to Find Them: A Study on Mobile Applications and User Perception
Di Geronimo, L., Braz, L., Fregnan, E., Palomba, F., & Bacchelli, A. (2020) · Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3313831.3376600 · Cited by 267
Better speech synthesis through scalingPreprint
Betker, J. (2023) · arXiv (Cornell University) · doi:10.48550/arxiv.2305.07243 · Cited by 200
Sexual selection on male vocal fundamental frequency in humans and other anthropoids
Puts, D. A., Hill, A. K., Bailey, D. H., Walker, R. S., Rendall, D., Wheatley, J. R., Welling, L. L. M., Dawood, K., Cárdenas, R., Burriss, R. P., et al. (2016) · Proceedings of the Royal Society B: Biological Sciences · doi:10.1098/rspb.2015.2830 · Cited by 186
Nudged by a robot: Responses to agency and feedback
Tussyadiah, I., & Miller, G. (2019) · Annals of Tourism Research · doi:10.1016/j.annals.2019.102752 · Cited by 131
A Comparative Study of Dark Patterns Across Web and Mobile Modalities
Gunawan, J., Pradeep, A., Choffnes, D., Hartzog, W., & Wilson, C. (2021) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3479521 · Cited by 128
Danry, V., Pataranutaporn, P., Mao, Y., & Maes, P. (2023) · Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3544548.3580672 · Cited by 110 · cited 1×
“Alternatively, the system could offer more incentives for users to reassess their decisions, promoting deliberate and user-centred choices [18, 23].”
BackgroundTassiello, V., Tillotson, J. S., & Rome, A. S. (2021) · Psychology & Marketing · doi:10.1002/mar.21488 · Cited by 107
Voice as a Design Material: Sociophonetic Inspired Design Strategies in Human-Computer Interaction
Sutton, S. J., Foulkes, P., Kirk, D., & Lawson, S. (2019) · Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3290605.3300833 · Cited by 92
On The Foundations of Digital Games
Björk, S. L. (2013) · KTH Publication Database DiVA (KTH Royal Institute of Technology) · Cited by 90
Social perception of male and female computer synthesized speech
Mullennix, J. W., Stern, S. E., Wilson, S. J., & Dyson, C.-L. (2003) · Computers in Human Behavior · doi:10.1016/s0747-5632(02)00081-x · Cited by 87
Defining and Identifying Attention Capture Deceptive Designs in Digital Interfaces
Monge Roffarello, A., Lukoff, K., & De Russis, L. (2023) · Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3544548.3580729 · Cited by 84
The sound of trustworthiness: Acoustic-based modulation of perceived voice personality
Belin, P., Boehme, B., & McAleer, P. (2017) · PLOS ONE · doi:10.1371/journal.pone.0185651 · Cited by 82
Landais, L. L., Damman, O. C., Schoonmade, L. J., Timmermans, D. R. M., Verhagen, E. A. L. M., & Jelsma, J. G. M. (2020) · International Journal of Behavioral Nutrition and Physical Activity · doi:10.1186/s12966-020-00942-7 · Cited by 82
Construction Research Congress 2022
Jazizadeh, F., Shealy, T., & Garvin, M. J. (2022) · doi:10.1061/9780784483954 · Cited by 78
Eliciting and Analysing Users’ Envisioned Dialogues with Perfect Voice Assistants
Völkel, S. T., Buschek, D., Eiband, M., Cowan, B. R., & Hussmann, H. (2021) · Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3411764.3445536 · Cited by 76
Towards a Preliminary Ontology of Dark Patterns Knowledge
Gray, C. M., Santos, C. T., & Bielova, N. (2023) · CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA) · doi:10.1145/3544549.3585676 · Cited by 75
Exploring Deceptive Design Patterns in Voice Interfaces
Owens, K., Gunawan, J., Choffnes, D., Emami-Naeini, P., Kohno, T., & Roesner, F. (2022) · European Symposium on Usable Security (EuroUSEC) · doi:10.1145/3549015.3554213 · Cited by 69
The Dark Side of Augmented Reality: Exploring Manipulative Designs in AR
Wang, X., Lee, L., Bermejo, C., & Hui, P. (2023) · International Journal of Human-Computer Interaction · doi:10.1080/10447318.2023.2188799 · Cited by 69
Choice of Voices: A Large-Scale Evaluation of Text-to-Speech Voice Quality for Long-Form Content
Cambre, J., Colnago, J., Maddock, J., Tsai, J., & Kaye, J. (2020) · Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3313831.3376789 · Cited by 65
Vukovic, J., Jones, B. C., Feinberg, D. R., DeBruine, L. M., Smith, F. G., Welling, L. L. M., & Little, A. C. (2010) · British Journal of Psychology · doi:10.1348/000712610x498750 · Cited by 64
Commission Nationale de l'Informatique et des Libertés
Regaud, D. (2016) · Cited by 64
Understanding Dark Patterns in Home IoT Devices
Kowalczyk, M., Gunawan, J., Choffnes, D., Dubois, D. J., Hartzog, W., & Wilson, C. (2023) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3544548.3581432 · Cited by 62
Choi, D., Kwak, D., Cho, M., & Lee, S. (2020) · Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3313831.3376569 · Cited by 54
None of a CHInd: relationship counselling for HCI and speech technology
Aylett, M. P., Kristensson, P. O., Whittaker, S., & Vazquez-Alvarez, Y. (2014) · CHI '14 Extended Abstracts on Human Factors in Computing Systems · doi:10.1145/2559206.2578868 · Cited by 53
Influence of Speech Rate and Information Density on Recognition: The Moderate Dynamic Mechanism
Rodero, E. (2015) · Media Psychology · doi:10.1080/15213269.2014.1002942 · Cited by 44
Do, T. D., McMahan, R. P., & Wiśniewski, P. (2022) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3491102.3517564 · Cited by 42
Linking men's voice pitch to actual and perceived trustworthiness across domains
Schild, C., Stern, J., & Zettler, I. (2019) · Behavioral Ecology · doi:10.1093/beheco/arz173 · Cited by 41
NewsPod: Automatic and Interactive News Podcasts
Laban, P., Ye, E., Korlakunta, S., Canny, J., & Hearst, M. A. (2022) · ACM International Conference on Intelligent User Interfaces (IUI) · doi:10.1145/3490099.3511147 · Cited by 35
Multi-Agent Voice Assistants: An Investigation of User Experience
Zargham, N., Bonfert, M., Porzel, R., Döring, T., & Malaka, R. (2021) · International Conference on Mobile and Ubiquitous Multimedia (MUM) · doi:10.1145/3490632.3490662 · Cited by 31
Persuasive Synthetic Speech: Voice Perception and User Behaviour
Dubiel, M., Halvey, M., Gallegos, P. O., & King, S. (2020) · Proceedings of the 2nd Conference on Conversational User Interfaces · doi:10.1145/3405755.3406120 · Cited by 28
Self-citationConversational Agents Trust Calibration: A User-Centred Perspective to Design
Dubiel, M., Daronnat, S., & Leiva, L. A. (2022) · Proceedings of the 4th Conference on Conversational User Interfaces · doi:10.1145/3543829.3544518 · Cited by 27
Self-citationThe Expressive Balance Effect: Perception and Physiological Responses of Prosody and Gestures
Rodero, E., Larrea, O., Rodríguez‐de‐Dios, I., & Lucas, I. (2022) · Journal of Language and Social Psychology · doi:10.1177/0261927x221078317 · Cited by 25
Conca, S. D. (2023) · Computer law & security review · doi:10.1016/j.clsr.2023.105866 · Cited by 25
Shin, J. Y., & Huh-Yoo, J. (2020) · Proceedings of the 14th EAI International Conference on Pervasive Computing Technologies for Healthcare · doi:10.1145/3421937.3422024 · Cited by 18 · cited 1×
“In a recent study Do et al. [22] have investigated the impact of type of synthetic voice (concatenative vs. neural) on social perception of virtual agents and their persuasiveness.”
BackgroundGuiding Oral Conversations: How to Nudge Users Towards Asking Questions?
Gohsen, M., Kiesel, J., Korashi, M., Ehlers, J., & Stein, B. (2023) · Conference on Human Information Interaction and Retrieval · doi:10.1145/3576840.3578291 · Cited by 14
What's Up With These Conversational Health Agents? From Users' Critiques to Implications for Design
Maharjan, R., Doherty, K., Rohani, D. A., Bækgaard, P., & Bardram, J. E. (2022) · Frontiers in Digital Health · doi:10.3389/fdgth.2022.840232 · Cited by 10
Varghese, A. L., & Nilsen, E. S. (2019) · Journal of Language and Social Psychology · doi:10.1177/0261927x19871692 · Cited by 6
Are you sure you want to order that? On Appropriateness of Voice-only Proactive Feedback Strategies
Dubiel, M., Bongard-Blanchy, K., Leiva, L. A., & Sergeeva, A. (2023) · ACM Conference on Conversational User Interfaces (CUI) · doi:10.1145/3571884.3604312 · Cited by 5
Self-citationVoice Puppetry: Speech Synthesis Adventures in Human Centred AI
Aylett, M. P., & Vazquez-Alvarez, Y. (2020) · ACM International Conference on Intelligent User Interfaces (IUI) · doi:10.1145/3379336.3381478 · Cited by 4
Research works printed but not linked: 19
- Shlomo Benartzi, John Beshears, Katherine L Milkman, Cass R Sunstein, Richard H Thaler, Maya Shankar, Will Tucker-Ray, William J Congdon, and Steven Galing. 2017. Should governments invest more in nudging? Psychological science 28, 8 (2017), 1041-1055.
- Kerstin Bongard-Blanchy, Arianna Rossi, Salvador Rivas, Sophie Doublet, Vincent Koenig, and Gabriele Lenzini. 2021. " I am Definitely Manipulated, Even When I am Aware of it. It's Ridiculous!"-Dark Patterns from the End-User Perspective. In Designing Interactive Systems Conference 2021. 763-776.
- Akash Chaudhary, Jaivrat Saroha, Kyzyl Monteiro, Angus G Forbes, and Aman Parnami. 2022. "Are You Still Watching?": Exploring Unintended User Behaviors and Dark Patterns on Video Streaming Platforms. In Designing Interactive Systems Conference. 776-791.
- Hengchen Dai, Silvia Saccardo, Maria A Han, Lily Roh, Naveen Raja, Sitaram Vangala, Hardikkumar Modi, Shital Pandya, Michael Sloyan, and Daniel M Croy- mans. 2021. Behavioural nudges increase COVID-19 vaccinations. Nature 597, 7876 (2021), 404-409.
- Elizabeth Dula, Andres Rosero, and Elizabeth Phillips. 2023. Identifying Dark Patterns in Social Robot Behavior. In 2023 Systems and Information Engineering Design Symposium (SIEDS). IEEE, 7-12.
- Bureau européen des unions de consommateurs. 2022. "Dark patterns" and the EU consumer law acquisition. https://www.beuc.eu/sites/default/files/publications/ beuc-x-2022-013_dark_patters_paper.pdf Last accessed 9 January 2023.
- Colin M Gray, Lorena Sanchez Chamorro, Ike Obi, and Ja-Nae Duane. 2023. Mapping the Landscape of Dark Patterns Scholarship: A Systematic Literature Review. In Designing Interactive Systems Conference. 188-193.
- Tianzhi He and Farrokh Jazizadeh. 2022. Nudging Occupants for Energy-Saving through Voice-Based Proactive Virtual Assistants. In Construction Research Con- gress 2022. 402-411.
- Lars Hornuf and Sonja Mangold. 2022. Digital dark nudges. In Diginomics Research Perspectives: The Role of Digitalization in Business and Society. Springer, 89-104.
- Luiza Jarovsky. 2022. Dark Patterns in Personal Data Collection: Definition, Taxonomy and Lawfulness. Taxonomy and Lawfulness (March 1, 2022) (2022).
- Mandy B Korpusik. 2019. Deep learning for spoken dialogue systems: application to nutrition. Ph. D. Dissertation. Massachusetts Institute of Technology.
- Cherie Lacey and Catherine Caudwell. 2019. Cuteness as a 'dark pattern'in home robots. In 2019 14th ACM/IEEE International Conference on Human-Robot Interaction (HRI). IEEE, 374-381.
- Oksana Mont, Matthias Lehner, and Eva Heiskanen. 2014. Nudging: A tool for sustainable behaviour? Naturvårdsverket.
- Anna Oleszkiewicz, Katarzyna Pisanski, Kinga Lachowicz-Tabaczek, and Ag- nieszka Sorokowska. 2017. Voice-based assessments of trustworthiness, compe- tence, and warmth in blind and sighted adults. Psychonomic bulletin & review 24 (2017), 856-862.
- Paul Slovic, Melissa L Finucane, Ellen Peters, and Donald G MacGregor. 2007. The affect heuristic. European journal of operational research 177, 3 (2007), 1333-1352.
- Anssi Tarkiainen and Sanna Sundqvist. 2009. Product involvement in organic food consumption: does ideology meet practice? Psychology & Marketing 26, 9 (2009), 844-863.
- Paul Taylor. 2009. Text-to-speech synthesis. Cambridge university press.
- Reha Tuncer, Anastasia Sergeeva, Kerstin Bongard-Blanchy, Verena Distler, So- phie Doublet, and Vincent Koenig. 2023. Running out of time (rs): effects of scarcity cues on perceived task load, perceived benevolence and user experience on e-commerce sites. Behaviour & Information Technology (2023), 1-19.
- Aarron Walter and Jared M Spool. 2011. Designing for emotion. Vol. 9. A book apart New York.
Cited by
Examining Humanness as a Metaphor to Design Voice User Interfaces
Desai, S., Dubiel, M., & Leiva, L. A. (2024) · ACM Conversational User Interfaces 2024 · doi:10.1145/3640794.3665535 · Cited by 21
“Given that prior research, such as Dubiel et al. [26, 27], has indicated that even minor variations in voice characteristics can significantly influence user perceptions, we decided to adopt a synthetic voice for the user role as well.”
ResultSelf-citationIsola, C., & Esposito, F. (2025) · Computer law & security review · doi:10.1016/j.clsr.2025.106169 · Cited by 31
Dubiel, M., Leiva, L. A., Bongard-Blanchy, K., & Sergeeva, A. (2024) · ACM Transactions on Computer-Human Interaction · doi:10.1145/3685274 · Cited by 17
Self-citationToward Metaphor-Fluid Conversation Design for Voice User Interfaces
Desai, S., Chin, J., Wang, D., Cowan, B. R., & Twidale, M. B. (2026) · ACM Conference on Conversational User Interfaces (CUI) · doi:10.1145/3816046.3816223 · Cited by 16
A Comprehensive Study on Dark PatternsPreprint
Li, M., Wang, X., Nie, L., Li, C., Liu, Y., Zhao, Y., Xue, L., & Said, K. S. (2024) · arXiv (Cornell University) · doi:10.48550/arxiv.2412.09147 · Cited by 16
Metadata
- Authors
- Dubiel, M., Sergeeva, A., & Leiva, L. A.
- Affiliations
- University of Luxembourg (LU)
- Venue
- Proceedings of the 29th International Conference on Intelligent User Interfaces
- Publisher
- ACM
- Published
- 2024-03-18
- Pages
- 181-194
- OpenAlex
- W4393970546
- Cited by
- 16
- References
- 57
- Citations by year
- 2026: 4 · 2025: 7 · 2024: 5
- FWCI
- 5.16
- Type
- conference paper
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- Locations
- ACM International Conference on Intelligent User Interfaces (IUI) (publishedVersion, cc-by-nc-nd)
- arXiv (Cornell University) (submittedVersion, cc-by-nc-nd)
- Open Repository and Bibliography (University of Luxembourg) (submittedVersion, cc-by-nc-nd)
- arXiv (Cornell University)
- Funders
- Horizon 2020 Framework Programme (BANANA, grant CHIST-ERA-20-BCI-001)
- HORIZON EUROPE European Innovation Council (SYMBIOTIK, grant 101071147)
- Luxembourg National Research Fund (FNR) (Decepticon (grant no.IS/14717072))
- Topics
- Physical Sciences › Computer Science › Human-Computer Interaction › Innovative Human-Technology Interaction
- Physical Sciences › Computer Science › Human-Computer Interaction › Usability and User Interface Design
- Social Sciences › Business, Management and Accounting › Marketing › AI in Service Interactions
- Keywords
- dark patterns, synthetic speech, manipulative design, decision-making, user agency, ethical design, speech synthesis, prosody, neural text-to-speech, concatenative synthesis, user preferences, listening tests
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.