Evidence for an elders’ advantage in the naive product usability judgments of older and younger adults
Abstract
OBJECTIVE: To determine whose naive judgments of consumer product usability are more accurate--those of younger or older adults. Accuracy is here defined as judgments compatible with results from performance-based usability tests. BACKGROUND: Older adults may be better able to predict usability problems than younger adults, making them particularly good participants in studies contributing to the user-centered design of products. This advantage, if present, may stem from older adults' motivation for more usable products or from their experience adapting their own environments to meet their changing physical, cognitive, and sensory needs. METHOD: Sixty older participants (ages 65-75 years) and 60 younger ones (ages 18-22 years) evaluated illustrations of consumer products on specific criteria (e.g., readability, learnability, or error rates). They either rated a single design for each product or ranked six alternative designs. They also explained their choices, indicated which features were most critical for usability, and selected usability-enhancing modifications. RESULTS: Although there was no reliable age difference in the amount of usability information provided in the open-ended explanations, older adults were more accurate at ranking alternative designs, selecting the most usability-critical features, and selecting usability-enhancing modifications (all ps < .05). CONCLUSION: The usability judgments of older adults are more accurate than those of younger adults when these judgments are solicited in a fixed-alternative, but not open-ended, format. APPLICATION: Because older adults are more discerning about potential product usability problems, they may be particularly valuable as research participants in early-stage design research (prior to the availability of working prototypes).
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Older users tend to be more critical judges of usability than younger ones.
“However, in general, older users tend to be more critical judges of usability than younger ones (Stephens et al., 2006).”
From Reducing working memory load in spoken dialogue systems (2009) · cites this paper as Stephens et al., 2006
Cites
Handbook of the Psychology of Aging
Schaie, K. W., Willis, S. L., Knight, B. G., & Park, D. C. (2016) · Elsevier eBooks · doi:10.1016/c2012-0-07221-3 · Cited by 3,436 · see citing works
Ecology and the aging process.
Lawton, M. P., & Nahemow, L. (1973) · The psychology of adult development and aging. · doi:10.1037/10044-020 · Cited by 2,191 · see citing works
(1990) · Cambridge University Press eBooks · Cited by 1,411 · see citing works
Successful Aging: Perspectives from the Behavioral Sciences
(1990) · doi:10.1017/cbo9780511665684 · Cited by 1,362 · see citing works
Proceedings of the Human Factors and Ergonomics Society 54th Annual Meeting
Kluge, A., Badura, B., Urbas, L., & Burkolter, D. (2010) · Cited by 1,121 · see citing works
Theoretical Perspectives on Cognitive Aging
Salthouse, T. A. (2016) · Psychology Press eBooks · doi:10.4324/9781315785363 · Cited by 947 · see citing works
The psychology of adult development and aging.
Eisdorfer, C. (1973) · American Psychological Association eBooks · doi:10.1037/10044-000 · Cited by 810 · see citing works
Hasher, L., Stoltzfus, E. R., Zacks, R. T., & Rypma, B. (1991) · Journal of Experimental Psychology Learning Memory and Cognition · doi:10.1037//0278-7393.17.1.163 · Cited by 730 · see citing works
Park, D. C., & Schwarz, N. (1999) · Medical Entomology and Zoology · Cited by 654 · see citing works
Theoretical perspectives on cognitive aging
(1992) · Choice Reviews Online · doi:10.5860/choice.29-3013 · Cited by 558 · see citing works
Handbook of human factors and the older adult
(1998) · Geriatric Nursing · doi:10.1016/s0197-4572(98)90106-9 · Cited by 391 · see citing works
Hasher, L., Stoltzfus, E. R., Zacks, R. T., et al. (1991) · Journal of Experimental Psychology Learning Memory and Cognition · doi:10.1037/0278-7393.17.1.163 · Cited by 387 · see citing works
(1978) · Applied Ergonomics · doi:10.1016/0003-6870(78)90107-2 · Cited by 240 · see citing works
Usability problem identification using both low- and high-fidelity prototypes
Virzi, R. A., Sokolov, J. L., & Karis, D. (1996) · doi:10.1145/238386.238516 · Cited by 214 · see citing works
Major abilities and development in the adult period.
Horn, J. L., & Hofer, S. M. (1992) · Cited by 197 · see citing works
When Users Want What's not Best for Them
Andre, A. D., & Wickens, C. D. (1995) · Ergonomics in Design: The Quarterly of Human Factors Applications · doi:10.1177/106480469500300403 · Cited by 194 · see citing works
Shipley Institute of Living Scale
Carlozzi, N. E. (2017) · Springer eBooks · doi:10.1007/978-3-319-56782-2_1070-2 · Cited by 176 · see citing works
Cognitive psychology and self-reports: Models and methods
Jobe, J. B. (2003) · Quality of Life Research · doi:10.1023/a:1023279029852 · Cited by 159 · see citing works
Typographic Design: Form and Communication
Carter, R., Day, B., & Meggs, P. B. (1985) · Cited by 95 · see citing works
Attention and aging: Wendy A. Rogers
Park, D., & Schwarz, N. (2012) · Psychology Press eBooks · doi:10.4324/9780203727027-11 · Cited by 81 · see citing works
A Reaction Time Study of Four Control-Display Linkages
Chapanis, A., & Lindenbaum, L. E. (1959) · Human Factors The Journal of the Human Factors and Ergonomics Society · doi:10.1177/001872085900100401 · Cited by 80 · see citing works
Adult age differences in working memory.
Foos, P. W. (1989) · Psychology and Aging · doi:10.1037/0882-7974.4.3.269 · Cited by 72 · see citing works
Bailey, R. W. (1993) · Proceedings of the Human Factors and Ergonomics Society Annual Meeting · doi:10.1177/154193129303700406 · Cited by 70 · see citing works
Adult age differences in working memory.
Foos, P. W. (1989) · Psychology and Aging · doi:10.1037//0882-7974.4.3.269 · Cited by 61 · see citing works
Kinross, R. (1979) · Instructional Science · doi:10.1007/bf00055244 · Cited by 51 · see citing works
Organization and learnability in computer languages
Green, T. R. G., & Payne, S. J. (1984) · International Journal of Man-Machine Studies · doi:10.1016/s0020-7373(84)80035-8 · Cited by 41 · see citing works
Naive Judgments of Stimulus-Response Compatibility
Payne, S. J. (1995) · Human Factors The Journal of the Human Factors and Ergonomics Society · doi:10.1518/001872095779049309 · Cited by 39 · see citing works
Searching for newspaper headlines printed in capitals or lower-case letters.
Poulton, E. C. (1967) · Journal of Applied Psychology · doi:10.1037/h0025098 · Cited by 34 · see citing works
An analysis of domestic cooker control design
RAY, R. D., & Ray, W. D. (1979) · Ergonomics · doi:10.1080/00140137908924698 · Cited by 33 · see citing works
Cognitive Aspects of Statistical Mapping
Lh, Pickle, L. W., & Hermann, D. J. (1997) · Journal of the American Statistical Association · doi:10.2307/2965744 · Cited by 27 · see citing works
Mazlish, B. (2017) · Routledge eBooks · doi:10.4324/9780203788097-11 · Cited by 19 · see citing works
Nayak, U. S. (1995) · Ergonomics in Design The Quarterly of Human Factors Applications · doi:10.1177/106480469500300106 · Cited by 18 · see citing works
Everyday Products: Easy to Use … or Not?
Hancock, H. E., Fisk, A. D., & Rogers, W. A. (2001) · Ergonomics in Design The Quarterly of Human Factors Applications · doi:10.1177/106480460100900404 · Cited by 18 · see citing works
Using Sensor Lines to Show Control-Display Linkages on a Four Burner Stove
Osborne, D. W., & Ellingstad, V. S. (1987) · Proceedings of the Human Factors and Ergonomics Society Annual Meeting · doi:10.1177/154193128703100523 · Cited by 12 · see citing works
Kohl, G. A. (1983) · Bell System Technical Journal · doi:10.1002/j.1538-7305.1983.tb03508.x · Cited by 5 · see citing works
Stephens, E. C., Carswell, C. M., & Dallaire, J. (2000) · International Journal of Cognitive Ergonomics · doi:10.1207/s15327566ijce0403_1 · Cited by 4 · see citing works
How Knowledgeable are Salespeople About the Usability of Their Merchandise?
Carswell, C. M., Lio, C. H., & McNally, J. (2004) · Proceedings of the Human Factors and Ergonomics Society Annual Meeting · doi:10.1177/154193120404800615 · Cited by 3 · see citing works
Enhancing the Accuracy of Customers' Product Usability Judgments: Lessons from Blind Evaluators
Gregory, L., Carswell, C. M., Stephens, E. C., Waters, S. E., & Stevens, C. (2001) · Proceedings of the Human Factors and Ergonomics Society Annual Meeting · doi:10.1177/154193120104500706 · Cited by 2 · see citing works
Flagged first, then by citations
Cited by
Sorted by citations
Charness, N. (2008) · Human Factors: The Journal of the Human Factors and Ergonomics Society · doi:10.1518/001872008x312161 · Cited by 247 · see citing works
Reducing working memory load in spoken dialogue systems
Wolters, M., Georgila, K., Moore, J. D., Logie, R. H., MacPherson, S. E., & Watson, M. (2009) · Interacting with Computers · doi:10.1016/j.intcom.2009.05.009 · Cited by 61 · see citing works
Iconic Sign Comprehension in Older Adults: The Role of Cognitive Impairment and Text Enhancement
Scialfa, C. T., Spadafora, P., Klein, M., Lesnik, A., Dial, L., & Heinrich, A. (2008) · Canadian Journal on Aging / La Revue canadienne du vieillissement · doi:10.3138/cja.27.3.267 · Cited by 42 · see citing works
Entre les familles et les services formels, le désir des aînés ayant besoin d'aide
Bourgeois-Guérin, V., Guberman, N., Lavoie, J.-P., & Gagnon, É. (2008) · Canadian Journal on Aging / La Revue canadienne du vieillissement · doi:10.3138/cja.27.3.253 · Cited by 27 · see citing works
Motivating and Assisting Adult, Online Chemistry Students: A Review of the Literature
Bannier, B. J. (2009) · Journal of Science Education and Technology · doi:10.1007/s10956-009-9195-x · Cited by 16 · see citing works
Age recognition for spoken dialogue systems: do we need it?
Wolters, M. K., Vipperla, R., & Renals, S. J. (2009) · Interspeech (USB) · doi:10.21437/interspeech.2009-440 · Cited by 15 · see citing works
Prototyping and Prototype use in Participatory Design with older adults
Maartmann-Moe, H., & Joshi, S. G. (2022) · Participatory Design Conference · doi:10.1145/3536169.3537791 · Cited by 14 · see citing works
Jönsson, O., Haak, M., Tomsone, S., Iwarsson, S., Schmidt, S., Mårtensson, K., Svensson, T., & Slaug, B. (2016) · Lund University Publications (Lund University) · Cited by 7 · see citing works
Jönsson, O. (2013) · Lund University Publications (Lund University) · Cited by 6 · see citing works
A First Look at Identifying Strategies People Use in Making Predictions about Task Demand
Sublette, M., Carswell, C. M., & Seidelman, W. (2012) · Proceedings of the Human Factors and Ergonomics Society Annual Meeting · doi:10.1177/1071181312561376 · Cited by 4 · see citing works
A “White-Space” Effect in Users’ Anticipation of the Challenges Involved in Using Everyday Products
Sublette, M., Carswell, C. M., Seidelman, W., Seales, W. B., & Clarke, D. (2011) · Proceedings of the Human Factors and Ergonomics Society Annual Meeting · doi:10.1177/1071181311551273 · Cited by 4 · see citing works
Alternative approaches to the design of four-burner stoves
Hoffmann, E. R., & Chan, A. H. S. (2011) · Ergonomics · doi:10.1080/00140139.2011.597879 · Cited by 4 · see citing works
Matsumoto, T., Goto, M., Ishii, R., Watanabe, T., Yamada, T., & Imai, M. (2018) · ACM/IEEE International Conference on Human-Robot Interaction (HRI) · doi:10.1145/3171221.3171265 · Cited by 3 · see citing works
Avoiding the Buyer's Fallacy: Consumer Perceptions of Products Before Purchase.
Manzon, E. (2013) · Deep Blue (University of Michigan) · Cited by 1 · see citing works
Current awareness in geriatric psychiatry
(2007) · International Journal of Geriatric Psychiatry · doi:10.1002/gps.1629
- Authors
- Stephens, E. C., Carswell, C. M., & Schumacher, M. M.
- Affiliations
- University of Kentucky (US)
- Venue
- Human Factors The Journal of the Human Factors and Ergonomics Society
- Publisher
- SAGE Publications
- Published
- 2006-09
- Volume
- 48
- Issue
- 3
- Pages
- 422-433
- ISSN
- 0018-7208 (ISSN-L)
- 1547-8181
- OpenAlex
- W1970506521
- Cited by
- 15
- References
- 36
- Citations by year
- 2022: 1 · 2018: 1 · 2016: 1 · 2013: 2 · 2012: 1
- FWCI
- 6.57
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Human Factors The Journal of the Human Factors and Ergonomics Society (publishedVersion)
- PubMed (publishedVersion)
- Topics
- Social Sciences › Demography › Technology Use by Older Adults
- Physical Sciences › Computer Science › Human-Computer Interaction › Usability and User Interface Design
- Social Sciences › Psychology › Neuropsychology and Physiological Psychology › Aging and Gerontology Research
- Keywords
- older adults, age differences, user-centered design, usability criteria
- MeSH terms
- Adolescent, Adult, Age Factors, Aged, Choice Behavior, Commerce, Equipment Design, Female, Humans, Judgment, Kentucky, Male
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review