Working memory failure in phone-based interaction
Open accessAbstract
This article investigates working-memory (WM) failure in phone-based interaction (PBI). We used a computational model of phone-based interaction (PBI USER) to generate predictions about the impact of three factors on WM failure:PBI features (i.e. menu structure), individual differences (i.e., WM capacity), and task characteristics (i.e., number of tasks). Our computational model stipulates that both the storage and the processing of information contribute to WM failure. In practical terms the model and the empirical results indicate that, contrary to guidelines for the design of phone-based interfaces, deep menu hierarchies (no more than three options per menu) do not reduce WM error rates in PBI. At a more theoretical level, the study shows that the use of a computational model in HCI research provides a systematic approach for explaining complex empirical results.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The short-term advantage conferred by reducing the number of options was cancelled out by the long-term disadvantage of forgetting information that had been presented earlier in the interaction.
“Huguenard et al. (1997) found that the short-term advantage conferred by reducing the number of options was cancelled out by the long-term disadvantage of forgetting information that had been presented earlier in the interaction.”
From Reducing working memory load in spoken dialogue systems (2009) · cites this paper as Huguenard et al., 1997
The Results (§6.2.1; page unavailable) found no significant difference in information-loss errors between deep menus with fewer options per level and broad menus. The Discussion (§7; page unavailable) likewise says menu structure made no difference to information loss. Thus the paper does not find that a short-term advantage was cancelled out by greater forgetting of earlier information. (LLM, conf=0.87)
Checked by a reasoning model — may be wrong.
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
The magical number seven, plus or minus two: Some limits on our capacity for processing information.
Miller, G. A. (1956) · Psychological Review · doi:10.1037/h0043158 · Cited by 17,812 · see citing works
The magical number seven, plus or minus two: Some limits on our capacity for processing information.
Miller, G. A. (1994) · Psychological Review · doi:10.1037/0033-295x.101.2.343 · Cited by 17,469 · see citing works
Baddeley, A. D., & Hitch, G. (1974) · Psychology of Learning and Motivation · doi:10.1016/s0079-7421(08)60452-1 · Cited by 9,860 · see citing works
A spreading-activation theory of semantic processing.
Collins, A. M., & Loftus, E. F. (1975) · Psychological Review · doi:10.1037/0033-295x.82.6.407 · Cited by 8,141 · see citing works
Human Memory: A Proposed System and its Control Processes
Atkinson, R. C., & Shiffrin, R. M. (1968) · Psychology of Learning and Motivation · doi:10.1016/s0079-7421(08)60422-3 · Cited by 7,216 · see citing works
Probabilistic Models for Some Intelligence and Attainment Tests
Psychology, M. (1961) · Information and Control · doi:10.1016/s0019-9958(61)80061-2 · Cited by 6,936 · see citing works
Anderson, J. R. (2013) · doi:10.4324/9781315799438 · Cited by 6,761 · see citing works
Agresti, A. (2002) · Wiley Series in Probability and Statistics · doi:10.1002/0471249688 · Cited by 6,746 · see citing works
Individual differences in working memory and reading
Daneman, M., & Carpenter, P. A. (1980) · Journal of Verbal Learning and Verbal Behavior · doi:10.1016/s0022-5371(80)90312-6 · Cited by 6,336 · see citing works
The Psychology of Learning and Motivation: Advances in Research and Theory
(2010) · The Psychology of learning and motivation/The psychology of learning and motivation · doi:10.1016/c2009-0-62209-1 · Cited by 6,035 · see citing works
The Psychology of Learning and Motivation
(2021) · The Psychology of learning and motivation/The psychology of learning and motivation · doi:10.1016/s0079-7421(21)x0002-3 · Cited by 5,081 · see citing works
Lane, S. D. (2016) · Routledge eBooks · doi:10.4324/9781315506173-8 · Cited by 4,707 · see citing works
A capacity theory of comprehension: individual differences in working memory
Just, M. A., & Carpenter, P. A. (1992) · Psychological Review · doi:10.1037/0033-295x.99.1.122 · Cited by 4,153 · see citing works
Payne, J. W., Bettman, J. R., & Johnson, E. J. (1993) · doi:10.1017/cbo9781139173933 · Cited by 3,487 · see citing works
Leave, C., Payne, J. W., Bettman, J. R., & Johnson, E. J. (1994) · Journal of the Operational Research Society · doi:10.2307/2584298 · Cited by 3,315 · see citing works
Retrieval time from semantic memory
Collins, A. M., & Quillian, M. R. (1969) · Journal of Verbal Learning and Verbal Behavior · doi:10.1016/s0022-5371(69)80069-1 · Cited by 3,141 · see citing works
Short-term retention of individual verbal items.
Peterson, L., & Peterson, M. J. (1959) · Journal of Experimental Psychology · doi:10.1037/h0049234 · Cited by 2,939 · see citing works
The Adaptive Character of Thought
Massaro, D. W., Friedman, D., & Anderson, J. R. (1991) · The American Journal of Psychology · doi:10.2307/1423253 · Cited by 2,174 · see citing works
Probabilistic Models for some Intelligence and Attainment Tests.
Wolins, L., Wright, B. D., & Rasch, G. (1982) · Journal of the American Statistical Association · doi:10.2307/2287805 · Cited by 2,009 · see citing works
Adaptive strategy selection in decision making.
Payne, J. W., Bettman, J. R., & Johnson, E. J. (1988) · Journal of Experimental Psychology: Learning, Memory, and Cognition · doi:10.1037/0278-7393.14.3.534 · Cited by 1,955 · see citing works
Waugh, N. C., & Norman, D. A. (1965) · Psychological Review · doi:10.1037/h0021797 · Cited by 1,120 · see citing works
ECONOMETRIC ANALYSIS OF QUALITATIVE RESPONSE MODELSPreprint
McFadden, D. L. (1984) · RePEc: Research Papers in Economics · Cited by 750 · see citing works
Chapman, P. G., Griliches, Z., Intriligator, M. D., & Arrow, K. J. (1987) · Journal of the Royal Statistical Society Series A (General) · doi:10.2307/2982051 · Cited by 680 · see citing works
Just, M. A., & Carpenter, P. A. (1985) · Psychological Review · doi:10.1037/0033-295x.92.2.137 · Cited by 576 · see citing works
Just, M. A., & Carpenter, P. A. (1985) · Psychological Review · doi:10.1037//0033-295x.92.2.137 · Cited by 516 · see citing works
Sobel, M. E., & Agresti, A. (1993) · Contemporary Sociology A Journal of Reviews · doi:10.2307/2074579 · Cited by 417 · see citing works
Insights in Decision MakingPreprint
Hogarth, R. M. (1990) · RePEc: Research Papers in Economics · Cited by 334 · see citing works
An Empirical Investigation of Goodness-of-Fit Statistics for Sparse Multinomials
Koehler, K. J., & Larntz, K. (1980) · Journal of the American Statistical Association · doi:10.1080/01621459.1980.10477473 · Cited by 289 · see citing works
The depth/breadth trade-off in the design of menu-driven user interfaces
Kiger, J. I. (1984) · International Journal of Man-Machine Studies · doi:10.1016/s0020-7373(84)80018-8 · Cited by 208 · see citing works
Log-Linear Models and Frequency Tables with Small Expected Cell Counts
Haberman, S. J. (1977) · The Annals of Statistics · doi:10.1214/aos/1176344001 · Cited by 197 · see citing works
The Adaptive Decision-Maker: Effort and Accuracy in Choice
Payne, J. W., Bettman, J. R., & Johnson, E. J. (1989) · doi:10.21236/ada205750 · Cited by 191 · see citing works
A Model of the Time Course and Content of Reading*
Thibadeau, R. H., Just, M. A., & Carpenter, P. A. (1982) · Cognitive Science · doi:10.1207/s15516709cog0602_2 · Cited by 184 · see citing works
The Role of Working Memory in Language Comprehension
Carpenter, P. A., & Just, M. A. (1988) · doi:10.4324/9780203761618-7 · Cited by 145 · see citing works
Novice LISP Errors: Undetected Losses of Information from Working Memory
Anderson, J. R., & Jeffries, R. (1985) · Human-Computer Interaction · doi:10.1207/s15327051hci0102_2 · Cited by 131 · see citing works
Learning Flow of Control: Recursive and Iterative Procedures
Kessler, C. M., & Anderson, J. R. (1986) · Human-Computer Interaction · doi:10.1207/s15327051hci0202_2 · Cited by 90 · see citing works
Extensions of the Partial Credit Model
Glas, C. A. W., & Verhelst, N. D. (1989) · Psychometrika · doi:10.1007/bf02296401 · Cited by 75 · see citing works
Gould, J. D., & Boies, S. J. (1983) · ACM Transactions on Information Systems · doi:10.1145/357442.357443 · Cited by 72 · see citing works
An Extension of the Rating Scale Model with an Application to the Measurement of Change
Fischer, G., & Parzer, P. (1991) · Psychometrika · doi:10.1007/bf02294496 · Cited by 62 · see citing works
Optimizing the Structure of Database Menu Indexes: A Decision Model of Menu Search
MacGregor, J. B., Lee, E. W. M., & Lam, N. (1986) · Human Factors The Journal of the Human Factors and Ergonomics Society · doi:10.1177/001872088602800402 · Cited by 51 · see citing works
Skilled financial planning: the cost of translating ideas into action
Lerch, F. J., Mantei, M. M., & Olson, J. R. (1989) · doi:10.1145/67449.67474 · Cited by 43 · see citing works
Models for Uncertainty in Educational Testing
Longford, N. T. (1995) · Springer series in statistics · doi:10.1007/978-1-4613-8463-2 · Cited by 39 · see citing works
Models for Uncertainty in Educational Testing.
McDonald, R. P., & Longford, N. T. (1997) · Journal of the American Statistical Association · doi:10.2307/2291488 · Cited by 36 · see citing works
Describing categories of objects for menu retrieval systems
Dumais, S. T., & Landauer, T. K. (1984) · Behavior Research Methods, Instruments, &amp Computers · doi:10.3758/bf03202396 · Cited by 27 · see citing works
Predicting Working Memory Failure: A Subjective Bayesian Approach to Model Selection
Carlin, B. P., Kass, R. E., Lerch, F. J., & Huguenard, B. R. (1992) · Journal of the American Statistical Association · doi:10.1080/01621459.1992.10475211 · Cited by 21 · see citing works
Effects of breadth, depth and number of responses on computer menu search performance
Parkinson, S. R., Hill, M. D., Sisson, N., & Viera, C. (1988) · International Journal of Man-Machine Studies · doi:10.1016/s0020-7373(88)80068-3 · Cited by 21 · see citing works
Pierce, B. J., Parkinson, S. R., & Sisson, N. (1992) · International Journal of Man-Machine Studies · doi:10.1016/0020-7373(92)90027-i · Cited by 16 · see citing works
McKenna, E. (2020) · Routledge eBooks · doi:10.4324/9781315646312-7 · Cited by 11 · see citing works
Measuring learning strategies and understanding: A research framework
Pirolli, P. L. T., & Wilson, M. R. (1992) · Lecture notes in computer science · doi:10.1007/3-540-55606-0_64 · Cited by 6 · see citing works
Understanding user errors in database query
Smelcer, J. B. (1990) · Deep Blue (University of Michigan) · Cited by 6 · see citing works
Card, S. K. (1990) · Elsevier eBooks · doi:10.1016/b978-0-12-236530-0.50021-2 · Cited by 5 · see citing works
Multivariate Statistical Models
Ruppert, D., & Matteson, D. S. (2015) · Springer texts in statistics · doi:10.1007/978-1-4939-2614-5_7 · Cited by 4 · see citing works
Huguenard, B. R. (1993) · Carnegie Mellon University eBooks · Cited by 1 · see citing works
Flagged first, then by citations
4 of the 56 references couldn’t be matched to a known paper.
Research works printed but not linked: 2
- BADDELEY, A. D. 1986. Working Memory. Clarendon Press, Oxford, U.K.
- LERCH, F. J., MANTEI, M. M., AND OLSON, J. R. 1989. Translating ideas into action: Cognitive analysis of errors in spreadsheet formulas. In Proceedings of the CHI '89 Conference on Human Factors in Computing Systems. ACM, New York, 121-126.
Cited by
Sorted by citations
Junker, B. W., & Sijtsma, K. (2001) · Applied Psychological Measurement · doi:10.1177/01466210122032064 · Cited by 1,010 · see citing works
A Straightforward Approach to Markov Chain Monte Carlo Methods for Item Response Models
Patz, R. J., & Junker, B. W. (1999) · Journal of Educational and Behavioral Statistics · doi:10.3102/10769986024002146 · Cited by 476 · see citing works
“For some recent examples, see Carlin Kass, Lerch, and Huguenard (1992); DiBello, Stout, and Roussos (1995); Fischer and Ponony (1994); Huguenard, Lerch, Junker, Patz, and Kass (1997); Kelderman and Rijkes (1994); and Legler and Ryan (1997); in addition to the many examples in Fischer and Molenaar (1995) and van der Li…”
BackgroundJust, M. A., Carpenter, P. A., & Miyake, A. (2003) · Theoretical Issues in Ergonomics Science · doi:10.1080/14639220210159735 · Cited by 245 · see citing works
“The symbolic mechanisms consist of the condition–action rules that express procedural knowledge and the production-system control regimen.”
Just, M. A., & Varma, S. (2007) · Cognitive Affective & Behavioral Neuroscience · doi:10.3758/cabn.7.3.153 · Cited by 213 · see citing works
Aphasic Sentence Comprehension as a Resource Deficit: A Computational Approach
Haarmann, H. J., Just, M. A., & Carpenter, P. A. (1997) · Brain and Language · doi:10.1006/brln.1997.1814 · Cited by 178 · see citing works
A world survey of artificial brain projects, Part I: Large-scale brain simulations
de GARIS, H., Chen, S., Goertzel, B., & Lian, R. (2010) · Neurocomputing · doi:10.1016/j.neucom.2010.08.004 · Cited by 147 · see citing works
“mental rotation [131]; analogical problem solving [132]; discourse comprehension [136,129]; human–computer interaction [139,140]; Tower of Hanoi problem solving in normal subjects [137]; on patients with frontal lobe lesions [138]; sentence comprehension in normal readers [133]; and in aphasic readers [135].”
BackgroundCognitive Support for Real-Time Dynamic Decision Making
Lerch, F. J., & Harter, D. E. (2001) · Information Systems Research · doi:10.1287/isre.12.1.63.9717 · Cited by 113 · see citing works
The Nature and Processing of Errors in Interactive Behavior
Gray, W. D. (2000) · Cognitive Science · doi:10.1207/s15516709cog2402_2 · Cited by 109 · see citing works
“Seven years later, John and Kieras (1996) concluded that, “No methodology for predicting when and what errors users will make as a function of interface design has yet been developed and recognized as satisfactor y .”
BackgroundByrne, M. D. (2009) · CRC Press eBooks · doi:10.1201/b10368-11 · Cited by 100 · see citing works
Ritter, F. E., & Young, R. M. (2001) · International Journal of Human-Computer Studies · doi:10.1006/ijhc.2001.0471 · Cited by 81 · see citing works
Junker, B. W. (1999) · Cited by 64 · see citing works
A characterization of monotone unidimensional latent variable models
Junker, B. W., & Ellis, J. L. (1997) · The Annals of Statistics · doi:10.1214/aos/1069362751 · Cited by 63 · see citing works
Reducing working memory load in spoken dialogue systems
Wolters, M., Georgila, K., Moore, J. D., Logie, R. H., MacPherson, S. E., & Watson, M. (2009) · Interacting with Computers · doi:10.1016/j.intcom.2009.05.009 · Cited by 61 · see citing works
“Huguenard et al. (1997) found that the short-term advantage conferred by reducing the number of options was cancelled out by the long-term disadvantage of forgetting information that had been presented earlier in the interaction.”
BackgroundA comparison of broad versus deep auditory menu structures
Commarford, P. M., Lewis, J. R., Smither, J. A.-A., & Gentzler, M. D. (2008) · Human Factors The Journal of the Human Factors and Ergonomics Society · doi:10.1518/001872008x250665 · Cited by 26 · see citing works
“Huguenard, Lerch, Junker, Patz, and Kass (1997) investigated the effect of using a deeper versus a broader menu structure for touch-tone IVR systems.”
BackgroundOn the Interplay Between Nonparametric and Parametric IRT, with Some Thoughts About the Future
Junker, B. W. (2001) · Lecture notes in statistics · doi:10.1007/978-1-4613-0169-1_14 · Cited by 26 · see citing works
Erosheva, E. A., Fienberg, S. E., & Junker, B. W. (2002) · Annales de la faculté des sciences de Toulouse Mathématiques · doi:10.5802/afst.1035 · Cited by 22 · see citing works
Georgila, K., Wolters, M. K., Vasilis Karaiskos, B., Kronenthal, M., Logie, R. H., Mayo, N., Moore, J. D., & Watson, M. (2008) · Language Resources and Evaluation Conference (LREC) · doi:10.63317/3dkop5oo2odo · Cited by 17 · see citing works
“While some researchers advocate presenting fewer options (e.g. (Zajicek, 2004)) in order to ease the load on users’ working memory, others have found that reducing the number of options either does not help (Huguenard et al., 1997) or is harmful (Commarford, 2006).”
BackgroundThe MATCH corpus: a corpus of older and younger users’ interactions with spoken dialogue systems
Georgila, K., Wolters, M., Moore, J. D., & Logie, R. H. (2010) · Language Resources and Evaluation · doi:10.1007/s10579-010-9118-8 · Cited by 21 · see citing works
“While some researchers advocate presenting fewer options (e.g. Zajicek 2004) in order to ease the load on users’ working memory, others have found that reducing the number of options either does not help (Huguenard et al. 1997) or is harmful (Commarford 2006).”
BackgroundA computational model of tower of hanoi problem solving
McNamara, T. P., & Varma, S. (2006) · Cited by 7 · see citing works
Lewis, J. R., Commarford, P. M., Kennedy, P. J., & Sadowski, W. J. (2008) · Reviews of Human Factors and Ergonomics · doi:10.1518/155723408x342880 · Cited by 6 · see citing works
You May Feel Better Off Than You Are: Usefulness Evaluations of Cognitive Feedback
Huguenard, B. R., & Frolick, M. N. (2001) · Journal of the Association for Information Systems · Cited by 6 · see citing works
Toward the analysis of the interaction in the joint cognitive system
Cañas, J. J., Salmerón, L., & Fajardo, I. (2005) · Springer eBooks · doi:10.1007/1-84628-089-3_6 · Cited by 6 · see citing works
Resource management and security issues in mobile phone operating systems: A comparative analysisPreprint
Awan, K. M., Waqar, M., Faseeh, M., Ullah, F., & Saleem, M. Q. (2017) · doi:10.7287/peerj.preprints.3344v1 · Cited by 4 · see citing works
“In terms of background running of applications, iOS does it efficiently and without draining system resources or the battery life [38] [39].”
BackgroundSome topics in nonparametric and parametric IRT, with some thoughts about the future
Junker, B. W. (2000) · Cited by 3 · see citing works
Probabilistic Models of Student Learning and Forgetting
Lindsey, R. (2014) · CU Scholar (University of Colorado Boulder) · Cited by 2 · see citing works
An Infrastructure to Support Usability Problem Data Analysis
Howarth, J. R. (2004) · VTechWorks (Virginia Tech) · Cited by 2 · see citing works
Time Pressure in Real-Time Dynamic Decision Making
Lerch, J. F., Harter, D. E., & Gonzalvez, C. (1998) · Journal of the Association for Information Systems · Cited by 2 · see citing works
An aural user interface for ubiquitous computing
Borden, G. R. (2003) · International Symposium on Wearable Computers · doi:10.1109/iswc.2002.1167235 · Cited by 1 · see citing works
“The use of non-speech sounds to provide navigational cues[3], the advantages and disadvantages of various styles and designs[4], and the cognitive load on users have all been investigated[5].”
BackgroundInteraktionstechniken und Interaktionsstile
Preim, B., & Dachselt, R. (2010) · eXamen.press · doi:10.1007/978-3-642-05402-0_9 · Cited by 1 · see citing works
Modelos y teorías computacionales de la memoriahumana: un estado de la cuestión y análisis crítico
Figueiredo, R. G. (2010) · Revista Educación · doi:10.15517/revedu.v34i2.488
AIS Electronic Library (AISeL)
Lerch, J. F., Harter, D. E., & Gonzalvez, C. (1998)
Impact of Cognitive Architectures on Human-Computer Interaction
Smith, S. C. (2014) · doi:10.21236/ada610093
- Authors
- Huguenard, B. R., Lerch, F. J., Junker, B. W., Patz, R. J., & Kass, R. E.
- Affiliations
- University of Notre Dame (US)
- Carnegie Mellon University (US)
- ORCID
- Kass, Robert E.
- Venue
- ACM Transactions on Computer-Human Interaction
- Published
- 1997-06-15
- Volume
- 4
- Issue
- 2
- Pages
- 67-102
- ISSN
- 1073-0516 (ISSN-L)
- 1557-7325
- OpenAlex
- W2018753114
- Cited by
- 34
- References
- 56
- Citations by year
- 2019: 1 · 2017: 1 · 2014: 2
- FWCI
- 5.76
- Type
- journal article
- Language
- en
- Open access
- bronze
- doi.org
- Locations
- ACM Transactions on Computer-Human Interaction (publishedVersion)
- eScholarship (California Digital Library) (submittedVersion)
- Funders
- Office of Naval Research (N00014)
- Topics
- Physical Sciences › Computer Science › Human-Computer Interaction › Usability and User Interface Design
- Physical Sciences › Computer Science › Human-Computer Interaction › Interactive and Immersive Displays
- Social Sciences › Psychology › Social Psychology › Human-Automation Interaction and Safety
- Keywords
- working memory capacity, individual differences, task characteristics, mobile interface design, information storage and processing
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
