The Characteristics of Voice Search: Comparing Spoken with Typed-in Mobile Web Search Queries
The DOI matches its Crossref record; 65 of the 65 references it cites were found in a registry or an index.
Abstract
The growing popularity of mobile search and the advancement in voice recognition technologies have opened the door for web search users to speak their queries rather than type them. While this kind of voice search is still in its infancy, it is gradually becoming more widespread. In this article, we report a comprehensive voice search query log analysis of a commercial web search engine’s mobile application. We compare voice and text search by various aspects, with special focus on the semantic and syntactic characteristics of the queries. Our analysis suggests that voice queries focus more on audio-visual content and question answering and less on social networking and adult domains. In addition, voice queries are more commonly submitted on the go. We also conduct an empirical evaluation showing that the language of voice queries is closer to natural language than the language of text queries. Our analysis points out further differences between voice and text search. We discuss the implications of these differences for the design of future voice-enabled web search tools.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Citations
Cites
Hinton, G., Deng, L., Yu, D., Dahl, G., Mohamed, A.-R., Jaitly, N., Senior, A., Vanhoucke, V., Nguyen, P., Sainath, T., et al. (2012) · IEEE Signal Processing Magazine · doi:10.1109/msp.2012.2205597 · Cited by 10,260
Building a Large Annotated Corpus of English: The Penn Treebank
Marcus, M. (1993) · doi:10.21236/ada273556 · Cited by 7,405
Accurate unlexicalized parsing
Klein, D., & Manning, C. D. (2003) · Proceedings of the 41st Annual Meeting on Association for Computational Linguistics - ACL '03 · doi:10.3115/1075096.1075150 · Cited by 3,008
Feature-rich part-of-speech tagging with a cyclic dependency network
Toutanova, K., Klein, D., Manning, C. D., & Singer, Y. (2003) · Proceedings of the 2003 Conference of the North American Chapter of the Association for Computational Linguistics on Human Language Technology - NAACL '03 · doi:10.3115/1073445.1073478 · Cited by 2,844
Generating Typed Dependency Parses from Phrase Structure Parses
de Marneffe, M.-C., MacCartney, B., & Manning, C. D. (2006) · Language Resources and Evaluation Conference (LREC) · doi:10.63317/3wtkaidk6ea8 · Cited by 2,258
Listen, attend and spell: A neural network for large vocabulary conversational speech recognition
Chan, W., Jaitly, N., Le, Q., & Vinyals, O. (2016) · 2016 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) · doi:10.1109/icassp.2016.7472621 · Cited by 2,226
A Study of Smoothing Methods for Language Models Applied to Ad Hoc Information Retrieval
Zhai, C., & Lafferty, J. (2017) · ACM SIGIR Forum · doi:10.1145/3130348.3130377 · Cited by 1,537
A study of smoothing methods for language models applied to Ad Hoc information retrieval
Zhai, C., & Lafferty, J. (2001) · Proceedings of the 24th annual international ACM SIGIR conference on Research and development in information retrieval · doi:10.1145/383952.384019 · Cited by 889
Two decades of statistical language modeling: where do we go from here?
Rosenfeld, R. (2000) · Proceedings of the IEEE · doi:10.1109/5.880083 · Cited by 735
Knowledge sharing and yahoo answers: everyone knows something
Adamic, L. A., Zhang, J., Bakshy, E., & Ackerman, M. S. (2008) · Proceedings of the 17th international conference on World Wide Web · doi:10.1145/1367497.1367587 · Cited by 732
Information Retrieval as Statistical Translation
Berger, A., & Lafferty, J. (2017) · ACM SIGIR Forum · doi:10.1145/3130348.3130371 · Cited by 621
Building a Large Annotated Corpus of English: The
MarcusMitchell, P., Ann, M., & SantoriniBeatrice (1993) · Computational Linguistics · doi:10.5555/972470.972475 · Cited by 489
A Theoretical Framework for Conversational Search
Radlinski, F., & Craswell, N. (2017) · Proceedings of the 2017 Conference on Conference Human Information Interaction and Retrieval · doi:10.1145/3020165.3020183 · Cited by 439
Information retrieval as statistical translation
Berger, A., & Lafferty, J. (1999) · Proceedings of the 22nd annual international ACM SIGIR conference on Research and development in information retrieval · doi:10.1145/312624.312681 · Cited by 396
#TwitterSearch: a comparison of microblog search and web search
Teevan, J., Ramage, D., & Morris, M. R. (2011) · Proceedings of the fourth ACM international conference on Web search and data mining · doi:10.1145/1935826.1935842 · Cited by 365
A large scale study of wireless search behavior: Google mobile search
Kamvar, M., & Baluja, S. (2006) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/1124772.1124877 · Cited by 279
Privacy Concerns for Use of Voice Activated Personal Assistant in the Public Space
Easwara Moorthy, A., & Vu, K.-P. L. (2015) · International Journal of Human-Computer Interaction · doi:10.1080/10447318.2014.986642 · Cited by 250
“Your Word is my Command”: Google Search by Voice: A Case Study
Schalkwyk, J., Beeferman, D., Beaufays, F., Byrne, B., Chelba, C., Cohen, M., Kamvar, M., & Strope, B. (2010) · Advances in Speech Recognition · doi:10.1007/978-1-4419-5951-5_4 · Cited by 232
Kamvar, M., Kellar, M., Patel, R., & Xu, Y. (2009) · Proceedings of the 18th international conference on World wide web · doi:10.1145/1526709.1526817 · Cited by 182
Good abandonment in mobile and PC internet search
Li, J., Huffman, S., & Tokuda, A. (2009) · Proceedings of the 32nd international ACM SIGIR conference on Research and development in information retrieval · doi:10.1145/1571941.1571951 · Cited by 158
Understanding User Satisfaction with Intelligent Assistants
Kiseleva, J., Williams, K., Jiang, J., Hassan Awadallah, A., Crook, A. C., Zitouni, I., & Anastasakos, T. (2016) · Proceedings of the 2016 ACM on Conference on Human Information Interaction and Retrieval · doi:10.1145/2854946.2854961 · Cited by 150
Automatic Online Evaluation of Intelligent Assistants
Jiang, J., Hassan Awadallah, A., Jones, R., Ozertem, U., Zitouni, I., Gurunath Kulkarni, R., & Khan, O. Z. (2015) · Proceedings of the 24th International Conference on World Wide Web · doi:10.1145/2736277.2741669 · Cited by 148
Towards better measurement of attention and satisfaction in mobile search
Lagun, D., Hsieh, C.-H., Webster, D., & Navalpakkam, V. (2014) · Proceedings of the 37th international ACM SIGIR conference on Research & development in information retrieval · doi:10.1145/2600428.2609631 · Cited by 125
Deciphering mobile search patterns: a study of Yahoo! mobile search queries
Yi, J., Maghoul, F., & Pedersen, J. (2008) · International World Wide Web Conference (WWW) · doi:10.1145/1367497.1367533 · Cited by 119
DocChat: An Information Retrieval Approach for Chatbot Engines Using Unstructured Documents
Yan, Z., Duan, N., Bao, J., Chen, P., Zhou, M., Li, Z., & Zhou, J. (2016) · Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.18653/v1/p16-1049 · Cited by 118
Chalfonte, B. L., Fish, R., & Kraut, R. E. (1991) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/108844.108848 · Cited by 116
Song, Y., Ma, H., Wang, H., & Wang, K. (2013) · Proceedings of the 22nd international conference on World Wide Web · doi:10.1145/2488388.2488493 · Cited by 115
The linguistic structure of English web-search queries
Barr, C., Jones, R., & Regelson, M. (2008) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.3115/1613715.1613848 · Cited by 110
Predicting User Satisfaction with Intelligent Assistants
Kiseleva, J., Williams, K., Hassan Awadallah, A., Crook, A. C., Zitouni, I., & Anastasakos, T. (2016) · Proceedings of the 39th International ACM SIGIR conference on Research and Development in Information Retrieval · doi:10.1145/2911451.2911521 · Cited by 108
An introduction to voice search
Wang, Y., Yu, D., Ju, Y., & Acero, A. (2008) · IEEE Signal Processing Magazine · doi:10.1109/msp.2008.918411 · Cited by 93
Jiang, J., Jeng, W., & He, D. (2013) · Proceedings of the 36th international ACM SIGIR conference on Research and development in information retrieval · doi:10.1145/2484028.2484092 · Cited by 84
Live search for mobile:Web services by voice on the cellphone
Acero, A., Bernstein, N., Chambers, R., Ju, Y. C., Li, X., Odell, J., Nguyen, P., Scholz, O., & Zweig, G. (2008) · 2008 IEEE International Conference on Acoustics, Speech and Signal Processing · doi:10.1109/icassp.2008.4518845 · Cited by 68
A Study of Mobile Search Queries in Japan
Baeza-Yates, R. A., Dupret, G., & Velasco, J. A. A. (2007) · Cited by 66
Information Retrieval with Verbose Queries
Gupta, M., & Bendersky, M. (2015) · Foundations and Trends® in Information Retrieval · doi:10.1561/1500000050 · Cited by 64
Detecting Good Abandonment in Mobile Search
Williams, K., Kiseleva, J., Crook, A. C., Zitouni, I., Awadallah, A. H., & Khabsa, M. (2016) · International World Wide Web Conference (WWW) · doi:10.1145/2872427.2883074 · Cited by 60
Addressing people's information needs directly in a web search result page
Chilton, L. B., & Teevan, J. (2011) · Proceedings of the 20th international conference on World wide web · doi:10.1145/1963405.1963413 · Cited by 58
Questions vs. Queries in Informational Search Tasks
White, R. W., Richardson, M., & Yih, W.-T. (2015) · Proceedings of the 24th International Conference on World Wide Web · doi:10.1145/2740908.2742769 · Cited by 55
From Queries to Cards: Re-ranking Proactive Card Recommendations Based on Reactive Search History
Shokouhi, M., & Guo, Q. (2015) · Proceedings of the 38th International ACM SIGIR Conference on Research and Development in Information Retrieval · doi:10.1145/2766462.2767705 · Cited by 54
Montañez, G. D., White, R. W., & Huang, X. (2014) · ACM International Conference on Information and Knowledge Management (CIKM) · doi:10.1145/2661829.2661910 · Cited by 53
What is Your Organization 'Like'? A Study of Liking Activity in the Enterprise
Guy, I., Ronen, I., Zwerdling, N., Zuyev-Grabovitch, I., & Jacovi, M. (2016) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/2858036.2858540 · Cited by 42
Self-citationImproving Term Weighting for Community Question Answering Search Using Syntactic Analysis
Carmel, D., Mejer, A., Pinter, Y., & Szpektor, I. (2014) · ACM International Conference on Information and Knowledge Management (CIKM) · doi:10.1145/2661829.2661901 · Cited by 41
Advances in Speech Recognition: Mobile Environments, Call Centers and Clinics
Neustein, A. (2010) · Digital Access to Libraries (Université catholique de Louvain (UCL), l'Université de Namur (UNamur) and the Université Saint-Louis (USL-B)) · doi:10.1007/978-1-4419-5951-5 · Cited by 41
Identifying Web Queries with Question Intent
Tsur, G., Pinter, Y., Szpektor, I., & Carmel, D. (2016) · International World Wide Web Conference (WWW) · doi:10.1145/2872427.2883058 · Cited by 38
Mobile search pattern evolution: the trend and the impact of voice queries
Yi, J., & Maghoul, F. (2011) · Proceedings of the 20th international conference companion on World wide web · doi:10.1145/1963192.1963276 · Cited by 37
Shokouhi, M., Jones, R., Özertem, U., Raghunathan, K., & Díaz, F. (2014) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/2600428.2609497 · Cited by 35
Prediction of Prospective User Engagement with Intelligent Assistants
Sano, S., Kaji, N., & Sassano, M. (2016) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/p16-1114 · Cited by 27
Characterizing and Predicting Voice Query Reformulation
Awadallah, A. H., Kulkarni, R. G., Özertem, U., & Jones, R. (2015) · ACM International Conference on Information and Knowledge Management (CIKM) · doi:10.1145/2806416.2806491 · Cited by 26
Modelling Information Needs in Collaborative Search Conversations
Shiga, S., Joho, H., Blanco, R., Trippas, J. R., & Sanderson, M. (2017) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/3077136.3080787 · Cited by 26
Folksonomy-Based Term Extraction for Word Cloud Generation
Carmel, D., Uziel, E., Guy, I., Mass, Y., & Roitman, H. (2012) · ACM Transactions on Intelligent Systems and Technology · doi:10.1145/2337542.2337545 · Cited by 24
Self-citationSyntactic Parsing of Web Queries with Question Intent
Pinter, Y., Reichart, R., & Szpektor, I. (2016) · Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT) · doi:10.18653/v1/n16-1081 · Cited by 19
Paragraph retrieval for why -question answering
Verberne, S. (2007) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/1277741.1277991 · Cited by 18
Search by voice in Mandarin Chinese
Shan, J., Wu, G., Hu, Z., Tang, X., Jansche, M., & Moreno, P. J. (2010) · Interspeech (USB) · doi:10.21437/interspeech.2010-129 · Cited by 18
Did You Say U2 or YouTube? Inferring Implicit Transcripts from Voice Search Logs
Shokouhi, M., Özertem, U., & Craswell, N. (2016) · International World Wide Web Conference (WWW) · doi:10.1145/2872427.2882994 · Cited by 18
Automatic Question Generation from Queries
Lin, C.-Y. (2008) · Cited by 18
Personalizing model M for voice-search
Zweig, G., & Chang, S. (2011) · Interspeech (USB) · doi:10.21437/interspeech.2011-243 · Cited by 17
Quicklink selection for navigational query results
Chakrabarti, D., Kumar, R., & Punera, K. (2009) · International World Wide Web Conference (WWW) · doi:10.1145/1526709.1526762 · Cited by 17
Search-Oriented Conversational AI (SCAI)
Burtsev, M., Chuklin, A., Kiseleva, J., et al. (2017) · ACM SIGIR International Conference on Theory of Information Retrieval (ICTIR) · doi:10.1145/3121050.3121111 · Cited by 17
Islands in the Stream: A Study of Item Recommendation within an Enterprise Social Stream
Guy, I., Levin, R., Daniel, T., & Bolshinsky, E. (2015) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/2766462.2767746 · Cited by 16
Self-citationChelba, C. I., & Schalkwyk, J. (2012) · Springer eBooks · doi:10.1007/978-1-4614-6018-3_8 · Cited by 14
From query to question in one click
Dror, G., Maarek, Y., Mejer, A., & Szpektor, I. (2013) · International World Wide Web Conference (WWW) · doi:10.1145/2488388.2488423 · Cited by 13
One Query, Many Clicks: Analysis of Queries with Multiple Clicks by the Same User
Kravi, E., Guy, I., Mejer, A., Carmel, D., Maarek, Y., Pelleg, D., & Tsur, G. (2016) · ACM International Conference on Information and Knowledge Management (CIKM) · doi:10.1145/2983323.2983856 · Cited by 12
Self-citationSpoken Query Processing for Information Retrieval
Moreno-Daniel, A., Parthasarathy, S., Juang, B.-H., & Wilpon, J. G. (2007) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp.2007.367178 · Cited by 10
Geo-location for voice search language modeling
Chelba, C. I., Zhang, X., & Hall, K. (2015) · Interspeech (USB) · doi:10.21437/interspeech.2015-344 · Cited by 9
Detecting Retries of Voice Search Queries
Levitan, R., & Elson, D. K. (2014) · Annual Meeting of the Association for Computational Linguistics (ACL) · doi:10.3115/v1/p14-2038 · Cited by 7
Kravi, E., Agichtein, E., Guy, I., et al. (2015) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/2766462.2767782 · Cited by 6
Self-citation
Research works printed but not linked: 12
- Acero A., Proc. ICASSP. 5256--5259
- Baeza-Yates Ricardo, 2007, Query Log Analysis (WWW’07 Workshop).
- 10.5555/1613715.1613848 · doi:10.5555/1613715.1613848
- Chelba Ciprian, 2015, Proc. INTERSPEECH, 1438--1442
- 10.1002/asi.v57:7 · DOI
- De Marneffe Marie-Catherine, Proc. LREC. 449--454
- Lin Chin-Yew, 2008, Proc. Workshop on the Question Generation Shared Task. 156--164
- Moreno-Daniel A., Proc. ICASSP, 4
- Pinter Yuval, 2016, Proc. NAACL. 670--680
- Schalkwyk Johan, Advances in Speech Recognition
- Shan Jiulong, Proc. INTERSPEECH. 354--357
- Zweig Geoffrey, 2011, Proc. INTERSPEECH. 609--612
Cited by
A Mixed-Method Analysis of Text and Audio Search Interfaces with Varying Task Complexity
Vtyurina, A., Clarke, C. L. A., Law, E., Trippas, J. R., & Bota, H. (2020) · Proceedings of the 2020 ACM SIGIR on International Conference on Theory of Information Retrieval · doi:10.1145/3409256.3409822 · Cited by 29
Metadata
- Authors
- Guy, I.
- Affiliations
- Ben-Gurion University of the Negev (IL)
- Corresponding author
- Guy, Ido
- ORCID
- Guy, Ido
- Venue
- ACM Transactions on Information Systems
- Published
- 2018-03-13
- Volume
- 36
- Issue
- 3
- Pages
- 1-28
- ISSN
- 1046-8188 (ISSN-L)
- 1558-2868
- OpenAlex
- W2790894221
- Semantic Scholar
- a33062e7d3c52ec819bb2e53deb9cb7f2810fea3
- Cited by
- 71
- References
- 65
- Citations by year
- 2026: 2 · 2025: 1 · 2024: 26 · 2023: 3 · 2022: 8 · 2021: 14 · 2020: 11 · 2019: 5 · 2018: 1
- FWCI
- 12.50
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- ACM Transactions on Information Systems (publishedVersion)
- Topics
- Physical Sciences › Computer Science › Information Systems › Information Retrieval and Search Behavior
- Physical Sciences › Computer Science › Human-Computer Interaction › Usability and User Interface Design
- Physical Sciences › Computer Science › Artificial Intelligence › Speech and dialogue systems
- Keywords
- voice search, mobile search, query semantics, query syntax, audio-visual content, natural language queries
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.