A comparison of broad versus deep auditory menu structures
Open accessAbstract
OBJECTIVE: The primary purpose of this experiment was to gain a greater understanding of the utilization of working memory when interacting with a speech-enabled interactive voice response (IVR) system. BACKGROUND: A widely promoted guideline advises limiting IVR menus to five or fewer items because of constraints of the human memory system, commonly citing Miller's (1956) paper. The authors argue that Miller's paper does not, in fact, support this guideline. Furthermore, applying modern theories of working memory leads to the opposite conclusion--that reducing menu length by creating a deeper structure is actually more demanding of users' working memories and leads to poorer performance and satisfaction. METHOD: Participants took a working memory capacity test and then attempted to complete a series of e-mail tasks using one of two IVR designs (functionally equivalent, but one with a broad menu structure and the other with a deep structure). RESULTS: Users of the broad-structure IVR performed better and were more satisfied than users of the deep-structure IVR. Furthermore, this effect was more pronounced for those with low working memory capacity. CONCLUSION: Results indicate that creating a deeper structure is more demanding of working memory resource than the alternative of longer, shallower menus. APPLICATION: This experiment has important practical implications for all systems with auditory menus (particularly IVRs) because it provides empirical evidence refuting a widely promoted design practice.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
When the number of options was shortened, users with shorter spans actually performed worse than their counterparts with longer spans.
“When the number of options was shortened, users with shorter spans actually performed worse than their counterparts with longer spans.”
From Reducing working memory load in spoken dialogue systems (2009) · cites this paper as Commarford et al., 2008
If users do not have to remember all options, but only need to select the appropriate choice from a list, users with short working memory spans profit from longer lists of options.
“Commarfordetal.(2008)showedthatifusersdonothavetoremember all options, but only need to select the appropriate choice from a list, users with short working memory spans profit from longer lists of options.”
From Reducing working memory load in spoken dialogue systems (2009) · cites this paper as Commarford et al., 2008
Our results complement Commarford et al.'s (2008) finding that users with a lower WMS benefit from being presented with more options at a time, because at each step in the interaction, they are more likely to be presented with the correct choice.
“Thus, our results complement Commarford et al.'s (2008) finding that users with a lower WMS benefit from being presented with more options at a time, because at each step in the interaction, they are more likely to be presented with the correct choice.”
From Reducing working memory load in spoken dialogue systems (2009) · cites this paper as Commarford et al.'s (2008)
Cites
The magical number seven, plus or minus two: Some limits on our capacity for processing information.
Miller, G. A. (1956) · Psychological Review · doi:10.1037/h0043158 · Cited by 17,812 · see citing works
The magical number seven, plus or minus two: Some limits on our capacity for processing information.
Miller, G. A. (1994) · Psychological Review · doi:10.1037/0033-295x.101.2.343 · Cited by 17,469 · see citing works
Baddeley, A. D., & Hitch, G. (1974) · Psychology of Learning and Motivation · doi:10.1016/s0079-7421(08)60452-1 · Cited by 9,860 · see citing works
The episodic buffer: a new component of working memory?
Baddeley, A. (2000) · Trends in Cognitive Sciences · doi:10.1016/s1364-6613(00)01538-2 · Cited by 7,359 · see citing works
Human Memory: A Proposed System and its Control Processes
Atkinson, R. C., & Shiffrin, R. M. (1968) · Psychology of Learning and Motivation · doi:10.1016/s0079-7421(08)60422-3 · Cited by 7,216 · see citing works
Individual differences in working memory and reading
Daneman, M., & Carpenter, P. A. (1980) · Journal of Verbal Learning and Verbal Behavior · doi:10.1016/s0022-5371(80)90312-6 · Cited by 6,336 · see citing works
A capacity theory of comprehension: individual differences in working memory
Just, M. A., & Carpenter, P. A. (1992) · Psychological Review · doi:10.1037/0033-295x.99.1.122 · Cited by 4,153 · see citing works
Working memory, short-term memory, and general fluid intelligence: A latent-variable approach.
Engle, R. W., Tuholski, S. W., Laughlin, J. E., & Conway, A. R. A. (1999) · Journal of Experimental Psychology: General · doi:10.1037/0096-3445.128.3.309 · Cited by 3,078 · see citing works
IBM computer usability satisfaction questionnaires: Psychometric evaluation and instructions for use
Lewis, J. R. (1995) · International Journal of Human-Computer Interaction · doi:10.1080/10447319509526110 · Cited by 2,429 · see citing works
Self-citationIs working memory capacity task dependent?
Turner, M. L., & Engle, R. W. (1989) · Journal of Memory and Language · doi:10.1016/0749-596x(89)90040-5 · Cited by 2,299 · see citing works
Handbook of Human-Computer Interaction
(1988) · Elsevier eBooks · doi:10.1016/c2009-0-12113-x · Cited by 2,057 · see citing works
Kane, M. J., Hambrick, D. Z., Tuholski, S. W., Wilhelm, O., Payne, T. W., & Engle, R. W. (2004) · Journal of Experimental Psychology: General · doi:10.1037/0096-3445.133.2.189 · Cited by 1,679 · see citing works
A controlled-attention view of working-memory capacity.
Kane, M. J., Bleckley, M. K., Conway, A. R. A., & Engle, R. W. (2001) · Journal of Experimental Psychology: General · doi:10.1037/0096-3445.130.2.169 · Cited by 1,414 · see citing works
The Control of Short-Term Memory
Atkinson, R. C., & Shiffrin, R. M. (1971) · Scientific American · doi:10.1038/scientificamerican0871-82 · Cited by 1,261 · see citing works
Waugh, N. C., & Norman, D. A. (1965) · Psychological Review · doi:10.1037/h0021797 · Cited by 1,120 · see citing works
Is working memory still working?
Baddeley, A. (2001) · American Psychologist · doi:10.1037/0003-066x.56.11.851 · Cited by 1,011 · see citing works
Paine, T. (1984) · Cited by 992 · see citing works
Cowan, N. (2016) · Routledge eBooks · doi:10.4324/9781315625560 · Cited by 942 · see citing works
Shah, P., & Miyake, A. (1996) · Journal of Experimental Psychology General · doi:10.1037/0096-3445.125.1.4 · Cited by 913 · see citing works
Individual Differences in Working Memory Capacity and Dual-Process Theories of the Mind.
Barrett, L. F., Tugade, M. M., & Engle, R. W. (2004) · Psychological Bulletin · doi:10.1037/0033-2909.130.4.553 · Cited by 913 · see citing works
Psychometric Evaluation of the PSSUQ Using Data from Five Years of Usability Studies
Lewis, J. R. (2002) · International Journal of Human-Computer Interaction · doi:10.1080/10447318.2002.9669130 · Cited by 626 · see citing works
Baddeley, A., Logie, R. H., Nimmo‐Smith, I., & Brereton, N. (1985) · Journal of Memory and Language · doi:10.1016/0749-596x(85)90019-1 · Cited by 428 · see citing works
Cognition: Exploring the Science of the Mind
Reisberg, D. (1996) · Cited by 425 · see citing works
Compatibility and Resource Competition between Modalities of Input, Central Processing, and Output
Wickens, C. D., Sandry, D. L., & Vidulich, M. A. (1983) · Human Factors The Journal of the Human Factors and Ergonomics Society · doi:10.1177/001872088302500209 · Cited by 402 · see citing works
Movement and Working Memory: Patterns and Positions in Space
Smyth, M. M., Pearson, N. A., & Pendleton, L. R. (1988) · The Quarterly Journal of Experimental Psychology Section A · doi:10.1080/02724988843000041 · Cited by 217 · see citing works
Cohen, M., Giangola, J. P., & Balogh, J. (2004) · Cited by 211 · see citing works
Some variables influencing the rate of gain of information.
Brainard, R. W., Irby, T. S., Fitts, P. M., & Alluisi, E. A. (1962) · Journal of Experimental Psychology · doi:10.1037/h0045304 · Cited by 204 · see citing works
Peißner, M., & Biesterfeldt, J. (2004) · Usability Professionals · Cited by 169 · see citing works
SNOWBERRY, K., PARKINSON, S. R., & SISSON, N. (1983) · Ergonomics · doi:10.1080/00140138308963390 · Cited by 159 · see citing works
The 1984 Olympic Message System: a test of behavioral principles of system design
Gould, J. D., Boies, S. J., Levy, S. E., Richards, J. T., & Schoonard, J. (1987) · Communications of the ACM · doi:10.1145/30401.30402 · Cited by 131 · see citing works
Watkins, M. J. (1977) · Memory & Cognition · doi:10.3758/bf03197396 · Cited by 128 · see citing works
Is "working memory capacity" just another name for word knowledge?
Engle, R. W., Nations, J. K., & Cantor, J. (1990) · Journal of Educational Psychology · doi:10.1037/0022-0663.82.4.799 · Cited by 109 · see citing works
Wickens, C. D., Vidulich, M. A., & Sandry-Garza, D. L. (1984) · Human Factors The Journal of the Human Factors and Ergonomics Society · doi:10.1177/001872088402600505 · Cited by 108 · see citing works
Paap, K. R., & Cooke, N. J. (1997) · Elsevier eBooks · doi:10.1016/b978-044481862-1.50090-x · Cited by 96 · see citing works
Assimilation of Sequentially Encoded Information
Pollack, I. W. (1953) · The American Journal of Psychology · doi:10.2307/1418237 · Cited by 94 · see citing works
Can auditory memory for tone pitch be rehearsed?
Keller, T. A., Cowan, N., & Saults, J. S. (1995) · Journal of Experimental Psychology Learning Memory and Cognition · doi:10.1037//0278-7393.21.3.635 · Cited by 75 · see citing works
How to build a speech recognition application : a style guide for telephony dialogues
Balentine, B., & Morgan, D. P. (2001) · Medical Entomology and Zoology · Cited by 68 · see citing works
Can auditory memory for tone pitch be rehearsed?
Keller, T. A., Cowan, N., & Saults, J. S. (1995) · Journal of Experimental Psychology Learning Memory and Cognition · doi:10.1037/0278-7393.21.3.635 · Cited by 59 · see citing works
Optimizing the Structure of Database Menu Indexes: A Decision Model of Menu Search
MacGregor, J. B., Lee, E. W. M., & Lam, N. (1986) · Human Factors The Journal of the Human Factors and Ergonomics Society · doi:10.1177/001872088602800402 · Cited by 51 · see citing works
Schumacher, R. M., Hardzinski, M. L., & Schwartz, A. L. (1995) · Human Factors The Journal of the Human Factors and Ergonomics Society · doi:10.1518/001872095779064672 · Cited by 43 · see citing works
Working memory failure in phone-based interaction
Huguenard, B. R., Lerch, F. J., Junker, B. W., Patz, R. J., & Kass, R. E. (1997) · ACM Transactions on Computer-Human Interaction · doi:10.1145/254945.254947 · Cited by 34 · cited 1× · see citing works
“Huguenard, Lerch, Junker, Patz, and Kass (1997) investigated the effect of using a deeper versus a broader menu structure for touch-tone IVR systems.”
BackgroundDesigning Voice Menu Applications for Telephones
Marics, M. A., & Engelbeck, G. (1997) · Elsevier eBooks · doi:10.1016/b978-044481862-1.50111-4 · Cited by 25 · see citing works
Guidelines for Speech-Enabled IVR Application Design
Gardner-Bonneau, D. J. (1999) · Springer eBooks · doi:10.1007/978-1-4757-2980-1_7 · Cited by 13 · see citing works
Effects of Prompt Style when Navigating through Structured Data.
Vanhoucke, V., Neeley, W. L., Mortati, M., Sloan, M., & Nass, C. (2001) · International Conference on Human-Computer Interaction · Cited by 11 · see citing works
Telephone-Based Menus: Evidence that Broader is Better than Deeper
Virzi, R. A., & Huitema, J. S. (1997) · Proceedings of the Human Factors and Ergonomics Society Annual Meeting · doi:10.1177/107118139704100171 · Cited by 6 · see citing works
Flagged first, then by citations
Cited by
Sorted by citations
Reducing working memory load in spoken dialogue systems
Wolters, M., Georgila, K., Moore, J. D., Logie, R. H., MacPherson, S. E., & Watson, M. (2009) · Interacting with Computers · doi:10.1016/j.intcom.2009.05.009 · Cited by 61 · see citing works
“Apart from (Commarford et al., 2008), we are not aware of any formal experimental study that assesses the impact of systematically varying the number of options on the usability of a SDS for users with low WMS.”
BackgroundRevisiting breadth vs. depth in menu structures for blind users of screen readers
Hochheiser, H., & Lazar, J. (2010) · Interacting with Computers · doi:10.1016/j.intcom.2010.02.003 · Cited by 28 · see citing works
Lewis, J. R. (2010) · Encyclopedia of Software Engineering · doi:10.1081/e-ese-120044161 · Cited by 24 · see citing works
Investigating memory constraints on recall of options in interactive voice response system messages
Bigot, L. L., Caroux, L., Ros, C., Lacroix, A., & Botherel, V. (2013) · Behavior and Information Technology · doi:10.1080/0144929x.2011.563800 · Cited by 14 · see citing works
“(2004) or Suhm 2008, for a discussion, or Commarford et al .”
BackgroundResultInfluentialAge recognition for spoken dialogue systems: do we need it?
Wolters, M. K., Vipperla, R., & Renals, S. J. (2009) · Interspeech (USB) · doi:10.21437/interspeech.2009-440 · Cited by 15 · see citing works
“For example, the system can switch to different acoustic and language models [13, 14], change the number of options presented to accommodate lower working memory spans [15], or adapt dialogue management strategies [5].”
BackgroundDepth and Breadth of Pie Menus for Mid-air Gesture Interaction
Li, W., Wan, X., Shi, Y., Yao, N., Wang, C., & Gao, Z. (2020) · International Journal of Human-Computer Interaction · doi:10.1080/10447318.2020.1809245 · Cited by 14 · see citing works
The Relevance of Attention Control, Not Working Memory, in Human Factors
Pak, R., McLaughlin, A., & Engle, R. (2023) · Hum. Factors · doi:10.1177/00187208231159727 · Cited by 13 · see citing works
Charness, N. H., & Jastrzembski, T. S. (2008) · Springer eBooks · doi:10.1007/978-1-84800-385-9_1 · Cited by 13 · see citing works
How can I help you? Design principles for task-oriented speech dialog systems in customer service
Oesterreich, T. D., Anton, E., Schuir, J., Brehm, A., & Teuteberg, F. (2022) · Information Systems and e-Business Management · doi:10.1007/s10257-022-00570-7 · Cited by 9 · see citing works
Conversational strategies : impact on search performance in a goal-oriented task
Dubiel, M., Halvey, M. J., Azzopardi, L. A., Anderson, D., & Daronnat, S. (2020) · Strathprints: The University of Strathclyde institutional repository (University of Strathclyde) · Cited by 7 · see citing works
Lewis, J. R., Commarford, P. M., Kennedy, P. J., & Sadowski, W. J. (2008) · Reviews of Human Factors and Ergonomics · doi:10.1518/155723408x342880 · Cited by 6 · see citing works
Hierarchy or List?: Comparing Menu Navigation by Emergent Users
Padhi, D. R., Joshi, A., Shrivastava, A., & Tulaskar, R. (2018) · Proceedings of the 9th Indian Conference on Human-Computer Interaction · doi:10.1145/3297121.3297125 · Cited by 5 · see citing works
“Researchers have also tried different types of menu structures and menu positions [15,16,17,18].”
BackgroundEffects of visuals, menu depths, and menu positions on IVR usage by non-tech savvy users
Shrivastava, A., & Joshi, A. N. (2014) · Indian Conference on Human-Computer Interaction (IndiaHCI) · doi:10.1145/2676702.2676707 · Cited by 5 · see citing works
“A similar skepticism on the number of menu items is expressed by Commarford [6].”
BackgroundInfluentialA usability study of adaptive interfaces for interactive voice response system
Asthana, S., Singh, P., & Singh, A. (2013) · ACM Symposium on Computing for Development (ACM DEV) · doi:10.1145/2442882.2442922 · Cited by 4 · see citing works
“We could run Direct for two days only, but findings are consistent with literature that shows that broad IVR design perform tasks faster with greater satisfaction [1].”
ResultBias, R. G., Lewis, C., & Gillan, D. J. (2014) · Journal of Usability Studies archive · Cited by 3 · see citing works
Matias, A. C., & Seva, R. R. (2011) · Human-computer interaction series · doi:10.1007/978-0-85729-304-6_15 · Cited by 3 · see citing works
Creating Greater Synergy Between HCI Academia and Practice
Nah, F. F., Galletta, D. F., Knight, M. M., Lewis, J. R., Pruitt, J., Salvendy, G., Sheng, H., & Wichansky, A. M. (2015) · Lecture notes in computer science · doi:10.1007/978-3-319-20895-4_68 · Cited by 2 · see citing works
“Both interns conducted research that had strong industrial value while also accomplishing the research goals required for their doctorates [19, 20].”
BackgroundEarpod: efficient hierarchical eyes-free menu selection
Zhao, S. (2009) · TSpace (University of Toronto) · Cited by 2 · see citing works
Generating facets for phone-based navigation of structured data
Kummamuru, K., Jujjuru, A., & Duggirala, M. (2012) · ACM International Conference on Information and Knowledge Management (CIKM) · doi:10.1145/2396761.2398431 · Cited by 1 · see citing works
“Commarford P. M. et al. [11] compares broad and deep audio menus in IVRs.”
BackgroundInformation Architecture in Vehicle Infotainment Displays
Gran, E. (2018) · Cited by 1 · see citing works
8. Spoken Dialogue Interfaces for Older People
Ravichander, V., Maria, W., & Steve, R. (2012) · Assistive Technology Research Series · doi:10.3233/978-1-61499-127-4-118 · Cited by 15 · see citing works
“In this case, presenting more options at a time is better, especially for users with low working memory capacity [35].”
Background“Super-Natural” Language Dialogues: In Search of Integration
Balentine, B. (2012) · Springer eBooks · doi:10.1007/978-1-4614-6018-3_14
Combien d'options dans les messages vocaux?
Bigot, L. L., Caroux, L., Ros, C., Lacroix, A., & Botherel, V. (2010) · Conference on l'Interaction Homme-Machine (IHM) · doi:10.1145/1941007.1941011
“[6] ne s’appliquent pas dans le cas des dialogues utilisés dans l’expérimentation.”
BackgroundDubiel, M. (2020) · Strathprints: The University of Strathclyde institutional repository (University of Strathclyde) · doi:10.48730/vgfp-ah87
Fisk, A. D., Czaja, S. J., Rogers, W. A., Charness, N., Czaja, S. J., & Sharit, J. (2009) · Human factors & aging series · doi:10.1201/9781420080681-25
LLM as Agent: A Reinforcement Learning Framework for Interactive Voice Response SystemsPreprint
Zhe, F. U., Song, G., Chen, F. (., & Guo, M. (2025) · SSRN Electronic Journal · doi:10.2139/ssrn.5377612
- Authors
- Commarford, P. M., Lewis, J. R., Smither, J. A.-A., & Gentzler, M. D.
- Affiliations
- IBM (United States) (US)
- University of Central Florida (US)
- Corresponding author
- Commarford, Patrick M.
- ORCID
- Lewis, James R.
- Venue
- Human Factors The Journal of the Human Factors and Ergonomics Society
- Publisher
- SAGE Publications
- Published
- 2008-02
- Volume
- 50
- Issue
- 1
- Pages
- 77-89
- ISSN
- 0018-7208 (ISSN-L)
- 1547-8181
- OpenAlex
- W2049264818
- Cited by
- 26
- References
- 44
- Citations by year
- 2025: 1 · 2023: 1 · 2022: 1 · 2020: 3 · 2018: 2 · 2015: 1 · 2014: 2 · 2013: 1 · 2012: 3
- FWCI
- 8.96
- Type
- journal article
- Language
- en
- Open access
- Locations
- Human Factors The Journal of the Human Factors and Ergonomics Society (publishedVersion)
- PubMed (publishedVersion)
- Journal of International Crisis and Risk Communication Research (submittedVersion)
- Topics
- Physical Sciences › Computer Science › Human-Computer Interaction › Usability and User Interface Design
- Physical Sciences › Computer Science › Artificial Intelligence › Speech and dialogue systems
- Social Sciences › Psychology › Social Psychology › Human-Automation Interaction and Safety
- Keywords
- interactive voice response, menu depth, working memory capacity, Miller's law, user satisfaction, human-computer interaction design
- MeSH terms
- Adolescent, Adult, Florida, Humans, Software Design, Task Performance and Analysis, User-Computer Interface, Electronic Mail, Speech Recognition Software
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review