The DOI matches its Crossref record; 60 of the 60 references it cites were found in a registry or an index.
The Importance of User Involvement: A Systematic Review of Involving Older Users in Technology Design
Open accessAbstract
Background and Objectives: There is a lack of understanding of how older adults’ involvement and participation matters in actual design practice. This systematic literature review investigates existing empirical studies involving older users during the design of technologies and explores the nature and consequences of involving older people. Research Design and Methods: Our literature review is informed by the guidelines of the PRISMA statement. We examined the included studies by means of thematic content analysis to identify the nature of older users’ involvement and existing evidence on what consequences it has. Results: In total, 40 empirical studies published in the period 2014–2018 are included in the review. Most empirical studies involve older people from local networks, with underlying stereotypical images and at lower levels of participation. The results reveal three main consequences of involving older users: learning, adjusted design, and an increased sense of participation. Furthermore, we found that user involvement is a structured process whose outcomes are contingent on a range of premises. Discussion and Implications: Synthesizing the results, we develop the concept of user involvement and present an analytical framework. Our results have implications for researchers and policy makers, since they throw into question the widely held assumption that involving older people inevitably yields beneficial outcomes.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Using thematic analysis in psychology
Braun, V., & Clarke, V. (2006) · Qualitative Research in Psychology · doi:10.1191/1478088706qp063oa · Cited by 194,414
Preferred Reporting Items for Systematic Reviews and Meta-Analyses: the PRISMA statement
Moher, D., Liberati, A., Tetzlaff, J., Altman, D. G., & for the PRISMA Group (2009) · BMJ · doi:10.1136/bmj.b2535 · Cited by 83,823
Preferred reporting items for systematic reviews and meta-analyses: the PRISMA Statement.
(2009) · PubMed Central · Cited by 44,859
Preferred reporting items for systematic reviews and meta-analyses: The PRISMA statement
Moher, D., Liberati, A., Tetzlaff, J., Altman, D. G., & the PRISMA Group* (2009) · Annals of Internal Medicine · doi:10.7326/0003-4819-151-4-200908180-00135 · Cited by 37,554
A Ladder Of Citizen Participation
Arnstein, S. R. (1969) · Journal of the American Institute of Planners · doi:10.1080/01944366908977225 · Cited by 17,064
Co-creation and the new landscapes of design
Sanders, E. B.-N., & Stappers, P. J. (2008) · CoDesign · doi:10.1080/15710880701875068 · Cited by 5,561
User Centered System Design: New Perspectives on Human-computer Interaction
Norman, D. A., & Draper, S. W. (1986) · CRC Press eBooks · doi:10.1201/b15703 · Cited by 3,132
Designing for usability: key principles and what designers think
Gould, J. D., & Lewis, C. (1985) · Communications of the ACM · doi:10.1145/3166.3170 · Cited by 2,066
Participatory Design: Principles and Practices
(2017) · CRC Press eBooks · doi:10.1201/9780203744338 · Cited by 1,500
User Involvement and MIS Success: A Review of Research
Ives, B., & Olson, M. H. (1984) · Management Science · doi:10.1287/mnsc.30.5.586 · Cited by 1,318
(2005) · Texas ScholarWorks (Texas Digital Library) · Cited by 1,064
User involvement: A review of the benefits and challenges
Kujala, S. (2003) · Behaviour & Information Technology · doi:10.1080/01449290301782 · Cited by 943 · cited 2×
“There are several others (e.g., Bano & Zowghi, 2015; Ives & Olson, 1984; Kujala, 2003; Shah & Robinson, 2007).”
BackgroundThe snakes and ladders of user involvement: Moving beyond Arnstein
Tritter, J. Q., & McCallum, A. (2006) · Health Policy · doi:10.1016/j.healthpol.2005.05.008 · Cited by 794
Rethinking the Concept of User Involvement
Barki, H., & Hartwick, J. (1989) · MIS Quarterly · doi:10.2307/248700 · Cited by 612
Benefits of and barriers to involving users in medical device technology development and evaluation
Shah, S. G. S., & Robinson, I. (2007) · International Journal of Technology Assessment in Health Care · doi:10.1017/s0266462307051677 · Cited by 299
A systematic review on the relationship between user involvement and system success
Bano, M., & Zowghi, D. (2015) · Information and Software Technology · doi:10.1016/j.infsof.2014.06.011 · Cited by 290
Eisma, R., Dickinson, A., Goodman, J., Syme, A., Tiwari, L., & Newell, A. F. (2004) · Universal Access in the Information Society · doi:10.1007/s10209-004-0092-z · Cited by 278
Lee, H. R., Šabanović, S., Chang, W.-L., Nagata, S., Piatt, J., Bennett, C., & Hakken, D. (2017) · Proceedings of the 2017 ACM/IEEE International Conference on Human-Robot Interaction · doi:10.1145/2909824.3020237 · Cited by 212
Participatory Design in Gerontechnology: A Systematic Literature Review
Merkel, S., & Kucharski, A. (2019) · The Gerontologist · doi:10.1093/geront/gny034 · Cited by 209
Disentangling power and decision-making in participatory design
Bratteteig, T., & Wagner, I. (2012) · Proceedings of the 12th Participatory Design Conference: Research Papers - Volume 1 · doi:10.1145/2347635.2347642 · Cited by 198
Review: Seven Matters of Concern of Social Robots and Older People
Frennert, S., & Östlund, B. (2014) · International Journal of Social Robotics · doi:10.1007/s12369-013-0225-8 · Cited by 192
Self-citationRighi, V., Sayago, S., & Blat, J. (2017) · International Journal of Human-Computer Studies · doi:10.1016/j.ijhcs.2017.06.005 · Cited by 182
Peine, A., Faulkner, A., Jæger, B., & Moors, E. H. M. (2015) · Technological Forecasting and Social Change · doi:10.1016/j.techfore.2014.11.010 · Cited by 149
Self-citationHelping and hindering user involvement — a tale of everyday design
Wilson, S., Bekker, M. M., Johnson, P., & Johnson, H. (1997) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/258549.258699 · Cited by 144
Barros, A. C. D., Leitão, R., & Ribeiro, J. (2014) · Procedia Computer Science · doi:10.1016/j.procs.2014.02.041 · Cited by 136
Östlund, B., Olander, E., Jönsson, O., & Frennert, S. (2014) · Technological Forecasting and Social Change · doi:10.1016/j.techfore.2014.04.012 · Cited by 134
Self-citationAttitudes Toward Computers Across Adulthood From 1994 to 2013
Lee, C. C., Czaja, S. J., Moxley, J. H., Sharit, J., Boot, W. R., Charness, N. H., & Rogers, W. A. (2018) · The Gerontologist · doi:10.1093/geront/gny081 · Cited by 130
Socially Assistive Robots: A Comprehensive Approach to Extending Independent Living
Johnson, D. O., Cuijpers, R. H., Juola, J. F., Torta, E., Simonov, M., Frisiello, A., Bazzani, M., Yan, W., Weber, C., Wermter, S., et al. (2013) · International Journal of Social Robotics · doi:10.1007/s12369-013-0217-8 · Cited by 123
Compagna, D., & Kohlbacher, F. (2015) · Technological Forecasting and Social Change · doi:10.1016/j.techfore.2014.07.012 · Cited by 119
Technology and Aging: An Evolving Partnership
Pruchno, R. A. (2018) · The Gerontologist · doi:10.1093/geront/gny153 · Cited by 115
Harte, R., Quinlan, L. R., Glynn, L. G., Rodríguez‐Molinero, A., Baker, P. M. A., Scharf, T., & OLaighin, G. M. (2017) · JMIR mhealth and uhealth · doi:10.2196/mhealth.7046 · Cited by 110
Brox, E., Konstantinidis, S. T., & Evertsen, G. (2017) · JMIR Serious Games · doi:10.2196/games.6254 · Cited by 97
Laggards as Innovators? Old Users as Designers of New Services & Service Systems.
Essén, A., & Östlund, B. (2011) · Lund University Publications (Lund University) · Cited by 96
Self-citationDesigning a social and assistive robot for seniors
Eftring, H., & Frennert, S. (2016) · Zeitschrift für Gerontologie und Geriatrie · doi:10.1007/s00391-016-1064-7 · Cited by 60
Understanding Older Users' Acceptance of Wearable Interfaces for Sensor-based Fall Risk Assessment
Wu, A. Y., & Munteanu, C. (2018) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3173574.3173693 · Cited by 58
Willard, S., Cremers, G., Man, Y. P., van Rossum, E., Spreeuwenberg, M. D., & de Witte, L. (2018) · BMC Geriatrics · doi:10.1186/s12877-018-0774-7 · Cited by 58
Designing for Prolonged Mastery. On involving old people in Participatory Design
Joshi, S. G., & Bratteteig, T. (2016) · NORA - Norwegian Open Research Archives · Cited by 48
Mobility in Later Life: Appropriation of an Integrated Transportation Platform
Stein, M., Meurer, J., Boden, A., & Wulf, V. (2017) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3025453.3025672 · Cited by 45
Participatory Design: How to Engage Older Adults in Participatory Design Activities
Hakobyan, L., Lumsden, J., & O’Sullivan, D. M. (2015) · International Journal of Mobile Human Computer Interaction · doi:10.4018/ijmhci.2015070106 · Cited by 43
User participation and stakeholder involvement in health care innovation – does it matter?
Bjørkquist, C., Ramsdal, H., & Ramsdal, K. (2015) · European Journal of Innovation Management · doi:10.1108/ejim-08-2013-0081 · Cited by 43
Müller, C., Hornung, D., Hamm, T., & Wulf, V. (2015) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/2702123.2702449 · Cited by 43
Teixeira, A., Ferreira, F., Almeida, N., Silva, S., Rosa, A. F., Pereira, J. C., & Vieira, D. (2017) · Universal Access in the Information Society · doi:10.1007/s10209-016-0487-7 · Cited by 43
The Curse of the Smart Machine? Digitalisation and the children of the mainframe
Sørensen, C. (2016) · Scandinavian Journal of Information Systems · Cited by 42
Older adults and hackathons: a qualitative study
Kopeć, W., Balcerzak, B., Nielek, R., Kowalik, G., Wierzbicki, A., & Casati, F. (2018) · Empirical Software Engineering · doi:10.1007/s10664-017-9565-6 · Cited by 39
Value-based design for the elderly: An application in the field of mobility aids
Boerema, S., van Velsen, L., Vollenbroek-Hutten, M. M. R., & Hermens, H. J. (2016) · Assistive Technology · doi:10.1080/10400435.2016.1208303 · Cited by 38
Design of smart home sensor visualizations for older adults
Le, T., Reeder, B., Chung, J., Thompson, H. J., & Demiris, G. (2014) · Technology and Health Care · doi:10.3233/thc-140839 · Cited by 37
New Perspectives on User Participation in Technology Design Processes: An Interdisciplinary Approach
Grates, M. G., Heming, A.-C., Vukoman, M., Schabsky, P., & Sorgalla, J. (2019) · The Gerontologist · doi:10.1093/geront/gny112 · Cited by 37
User-Innovated eHealth Solutions for Service Delivery to Older Persons With Hearing Impairment
Nielsen, A. C., Rotger-Griful, S., Kanstrup, A. M., & Laplante-Lévesque, A. (2018) · American Journal of Audiology · doi:10.1044/2018_aja-imia3-18-0009 · Cited by 32
The Crucial Role of Cultural Probes in Participatory Design for and with Older Adults
Maaß, S., & Buchmüller, S. (2018) · i-com · doi:10.1515/icom-2018-0015 · Cited by 26
Why do few assistive technology systems make it to market? The case of the HandyHelper project
Haslwanter, J. D. H., & Fitzpatrick, G. (2016) · Universal Access in the Information Society · doi:10.1007/s10209-016-0499-3 · Cited by 21
Applications of Paper and Interactive Prototypes in Designing Telecare Services for Older Adults
Duh, E. S., Guna, J., Pogačnik, M., & Sodnik, J. (2016) · Journal of Medical Systems · doi:10.1007/s10916-016-0463-z · Cited by 17
Addressing medication adherence technology needs in an aging population
Pater, J., Owens, S., Farmer, S., Mynatt, E., & Fain, B. (2017) · Proceedings of the 11th EAI International Conference on Pervasive Computing Technologies for Healthcare · doi:10.1145/3154862.3154872 · Cited by 15
Co-designing a diversity of social media products with and for older people
Frohlich, D. M., Lim, C., & Ahmed, A. A. (2016) · International Conference on Software Development and Technologies for Enhancing Accessibility and Fighting Info-exclusion (DSAI) · doi:10.1145/3019943.3019990 · Cited by 15
Verhoeven, F., Cremers, A., Schoone-Harmsen, M. A., & van Dijk, J. (2016) · Gerontechnology · doi:10.4017/gt.2016.15.1.008.00 · Cited by 13
Alaoui, M., Ting, K. L. H., & Lewkowicz, M. (2014) · Procedia Computer Science · doi:10.1016/j.procs.2014.02.042 · Cited by 12
Embodied Conversational Interfaces for the Elderly User
Mehrotra, S., Motti, V. G., Frijns, H., Akkoc, T., Yengeç, S. B., Calik, O., Peeters, M. M. M., & Neerincx, M. A. (2016) · Proceedings of the 8th Indian Conference on Human-Computer Interaction · doi:10.1145/3014362.3014372 · Cited by 12
A Lead User Approach to Universal Design – Involving Older Adults in the Design Process
Raviselvam, S., Wood Kristin, L., Katja, H. O. L. A. O., Tam, V., & Kamya, N. (2016) · Studies in health technology and informatics · doi:10.3233/978-1-61499-684-2-131 · Cited by 9
ShopComm: Community-Supported Online Shopping for Older Adults
Gorkovenko, K., Tigwell, G. W., Norrie, C. S., Waite, M., & Herron, D. (2017) · Studies in health technology and informatics · doi:10.3233/978-1-61499-798-6-175 · Cited by 8
Don’t go in there! using the APEX framework in the design of ambient assisted living systems
Campos, J. C., Abade, T., Silva, J. L., & Harrison, M. D. (2017) · Journal of Ambient Intelligence and Humanized Computing · doi:10.1007/s12652-016-0444-6 · Cited by 6
Wallisch, A., Maccioni, L., Trautmann, L., Ostermeyer, E., Borgianni, Y., & Borg, J. C. (2018) · Proceedings of the ... International Design Conference/Design ... · doi:10.21278/idc.2018.0361 · Cited by 2
Cited by
“But at the age of 85? Forget it!”: Internalized ageism, a barrier to technology use
Köttl, H., Gallistl, V., Rohner, R., & Ayalon, L. (2021) · Journal of Aging Studies · doi:10.1016/j.jaging.2021.100971 · Cited by 170
Design Guidelines of Mobile Apps for Older Adults: Systematic Review and Thematic Analysis
Gomez-Hernandez, M., Ferre, X., Moral, C., & Villalba-Mora, E. (2023) · JMIR mHealth and uHealth · doi:10.2196/43186 · Cited by 161
Technology Used to Recognize Activities of Daily Living in Community-Dwelling Older Adults
Camp, N., Lewis, M., Hunter, K., Johnston, J., Zecca, M., Di Nuovo, A., & Magistro, D. (2020) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph18010163 · Cited by 74
Airola, E. (2021) · Journal of Medical Internet Research · doi:10.2196/23804 · Cited by 63
An Analysis of Usability Evaluation Practices and Contexts of Use in Wearable Robotics
Meyer, J. T., Gassert, R., & Lambercy, O. (2021) · Journal of NeuroEngineering and Rehabilitation · doi:10.1186/s12984-021-00963-8 · Cited by 58
“A solution to tackle and minimize usability limitations is user-centered design (UCD), which aims to involve the technology stakeholders throughout the device development to more successfully address and meet user needs [11–13].”
Background
Metadata
- Authors
- Fischer, B., Peine, A., & Östlund, B.
- Venue
- The Gerontologist
- Publisher
- Oxford University Press (OUP)
- Published
- 2019-11-27
- Volume
- 60
- Issue
- 7
- Pages
- e513-e523
- ISSN
- 0016-9013 (ISSN-L)
- 1758-5341
- OpenAlex
- W2990327199
- Cited by
- 253
- References
- 60
- FWCI
- 8.11
- Type
- journal article
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.