The impact of usage experience and input modality on trust experience and cognitive load in older adults
Open accessThe DOI matches its Crossref record; 52 of the 52 references it cites were found in a registry or an index; 4 of the 45 sources its claims cite were checked for support.
Abstract
Trust experience plays a pivotal role in human–computer interaction, particularly for older adults, where it serves as a critical psychological threshold for technology adoption and sustained usage. Against the backdrop of increasingly diverse intelligent interaction modalities, trust directly influences older adults’ initial acceptance and long-term reliance on technological systems. This study focuses on the interactive effects of users’ experience and input modality on trust experience and cognitive load in the elderly. Employing a 2 (prior experience: experienced vs. inexperienced) × 3 (input modality: touch, speech, eye control) mixed experimental design. Following each task, participants completed NASA-TLX scales and trust perception questionnaires, supplemented by eye-tracking data to quantify cognitive load and behavioral patterns. The results showed that (1) Experience-dependent divergence in trust perception: Experienced older adults exhibited higher trust in touch input, attributable to established press-response mental models from prior device usage, while inexperienced users preferred speech input due to its alignment with natural conversational paradigms. (2) Cognitive load mediation effect: Although voice input reduces the learning cost of user interfaces for inexperienced elderly users (NASA-TLX is 24% lower than touch), recognition errors can cause a sharp drop in trust; This study reveals that the trust experience of elderly users is influenced by both usage experience and input methods, with cognitive load being a key mediating factor. In terms of design, the touch physical metaphor should be retained for experienced elderly users, and the voice fault tolerance mechanism should be strengthened for inexperienced elderly users, while reducing technical anxiety by enhancing operational visibility.
Overview
CoChat Summary
## TL;DR
This mixed-design experiment found that both prior usage experience and input modality shaped older adults’ trust experience, cognitive load, eye movements, and task completion time. Across modalities, speech lowered cognitive load but produced the longest completion times, while touch generally produced the highest trust and shortest task times.
## Key findings
- The study used 40 older adults (20 experienced, 20 inexperienced) and compared 3 input modalities: touch, speech, and eye control.
- Input modality significantly affected trust experience: touch had higher trust than speech and eye control overall, with mean trust scores of 60.889 for touch, 58.667 for speech, and 27.333 for eye control.
- Prior experience significantly affected cognitive load: older adults with usage experience had lower NASA-TLX scores (M = 5.241) than those without usage experience (M = 9.119).
- Speech input produced the lowest cognitive load and the longest task completion time: NASA-TLX M = 5.794 for speech versus 7.522 for touch and 8.222 for eye control; task completion time was longest for speech (M = 84.088) versus touch (M = 53.553) and eye control (M = 57.514).
- Eye-tracking measures moved with cognitive load and trust: NASA-TLX was positively correlated with fixation duration (0.39, p < 0.01) and number of fixations (0.33, p < 0.001), while trust score was negatively correlated with fixation duration (-0.64, p < 0.05) and number of fixations (-0.48, p < 0.05).
## Methods
- Mixed-design experiment with a 3-level within-subjects factor (input modality: touch, speech, eye control) and a 2-level between-subjects factor (user type: experienced vs. inexperienced).
- Sample: 40 participants, aged 60 years and older (mean 64 ± 3.127), evenly split by gender (20 male, 20 female) and by experience (20 experienced, 20 inexperienced); all passed vision and hearing screening.
- Measures and analysis: trust questionnaire (12 items, 7-point Likert), NASA-TLX cognitive load, eye-tracking fixation duration and fixation count, and task completion time; data were analyzed using repeated-measures ANOVA and Pearson correlation in SPSS.
## Limitations
- The paper states that the sample may not be fully representative of all older populations, especially those with significant cognitive decline or limited access to technology.
- The paper states that the controlled experimental environment may not reflect real-world speech recognition conditions, such as environmental noise.
- Evident from the text: the study used a relatively small sample (n = 40) and a specific participant group (active or retired school employees), which may limit generalizability.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
1 Valid · 3 Not valid · 37 Not checked · 54 Own results and interpretations
At least one cited source doesn’t support this claim or points to a different paper, and none confirmed it — see the verdicts below.
In the paper
“As demonstrated by Bong etal. (2018), touch interfaces incorporate widely recognized graphical UI elements that enhance system accessibility and senior user acceptance.”
What the sources say
- Disputedcites Bong et al. (2018) sourceExperimental — accuracy not yet measured
Section 4.1 says older adults have problems using touch-gesture devices and explains that the review excluded mobile- and tablet-based interfaces in favor of interfaces using everyday physical objects. Section 2.2 distinguishes those tangible interfaces from graphical user interfaces. The paper does not describe familiar graphical elements as improving the accessibility or acceptance of touch interfaces for seniors. (LLM, conf=0.83)
Checked by a reasoning model — may be wrong.
boostedstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Disputed
The cited sources that could be checked couldn’t confirm or dispute this claim.
In the paper
“This preference stems from touch interaction being a more prevalent and familiar input method for elderly users.”
What the sources say
- Could not verifycites Bong et al. (2018) sourceExperimental — accuracy not yet measured
Section 4.1 discusses touch-gesture applications but says older adults can have problems using touch-gesture devices. Searches for trust, preference, familiarity, and prevalence found no passage saying touch input is more familiar or prevalent for older adults, or that this explains a preference for it. The reported difficulties do not establish the opposite preference, so the claim is not disputed. (LLM, conf=0.73)
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Rests on an assumption not shown here.
- Could not verify
The cited sources that could be checked couldn’t confirm or dispute this claim.
In the paper
“First, touch represents the most familiar interaction paradigm for older users, leveraging established mental models that enhance operational efficiency (Bong etal., 2018).”
What the sources say
- Could not verifycites Bong et al. (2018) sourceExperimental — accuracy not yet measured
Section 4.1 says older adults can have problems using touch-gesture devices, but it does not compare touch with other interaction paradigms for familiarity or task-completion time. The passages searched for familiarity, mental models, and task-completion time do not establish the claimed explanation for touch's efficiency. (LLM, conf=0.76)
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Could not verify
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Older adults with usage experience had significantly shorter fixation times and fewer fixations for speech input (M=4.247, SD=0.404) (M=13.786, SD=5.487) compared to touch input (M=6.553, SD=0.783) (M=26.819, SD=2.212) and eye-control input (M=17.426, SD=1.088) (M=47.069, SD=5.225).”
plainstates an association- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Experience of use ( F =33.172, p =0.000, η 2 =0.806) and input modality ( F =3.848, p =0.043, η 2 =0.325) had a differentially significant effect on cognitive load”
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
48 more claims
Create a free account to see all 95 claims and to verify the 1 reference still open.
- Probably not a substantial claim. 29
- It may state two separate claims as one. 21
- The quote only partly states this claim. 3
Citations
Cites
Convergent and discriminant validation by the multitrait-multimethod matrix.
Campbell, D. T., & Fiske, D. W. (1959) · Psychological Bulletin · doi:10.1037/h0046016 · Cited by 17,116
Development of NASA-TLX (Task Load Index): Results of Empirical and Theoretical Research
(1988) · Advances in Psychology · doi:10.1016/s0166-4115(08)62386-9 · Cited by 15,003
Trust and TAM in Online Shopping: An Integrated Model1
Gefen, D., Karahanna, E., & Straub, D. W. (2003) · MIS Quarterly · doi:10.2307/30036519 · Cited by 8,635
Trust in Automation: Designing for Appropriate Reliance
Lee, J. D., & See, K. A. (2004) · Human Factors: The Journal of the Human Factors and Ergonomics Society · doi:10.1518/hfes.46.1.50_30392 · Cited by 6,605
Working Memory: Theories, Models, and Controversies
Baddeley, A. (2012) · Annual Review of Psychology · doi:10.1146/annurev-psych-120710-100422 · Cited by 4,271
VII. Note on regression and inheritance in the case of two parents
Pearson, K. (1895) · Proceedings of the Royal Society of London · doi:10.1098/rspl.1895.0041 · Cited by 3,424
Trust in Automation: Integrating Empirical Evidence on Factors That Influence Trust
Hoff, K. A., & Bashir, M. (2015) · Human Factors: The Journal of the Human Factors and Ergonomics Society · doi:10.1177/0018720814547570 · Cited by 2,817
Foundations for an Empirically Determined Scale of Trust in Automated Systems
Jian, J.-Y., Bisantz, A. M., & Drury, C. G. (2000) · International Journal of Cognitive Ergonomics · doi:10.1207/s15327566ijce0401_04 · Cited by 1,799
Eye fixations and cognitive processes
Just, M. A., & Carpenter, P. A. (1976) · Cognitive Psychology · doi:10.1016/0010-0285(76)90015-3 · Cited by 1,730
Investigating the Importance of Trust on Adopting an Autonomous Vehicle
Choi, J. K., & Ji, Y. G. (2015) · International Journal of Human-Computer Interaction · doi:10.1080/10447318.2015.1070549 · Cited by 1,203
Eye tracking in HCI and usability research
Poole, A., & Ball, L. J. (2006) · Encyclopedia of Human Computer Interaction · doi:10.4018/978-1-59140-562-7.ch034 · Cited by 690
Beyond eye gaze: What else can eyetracking reveal about cognition and cognitive development?
Eckstein, M. K., Guerra-Carrillo, B., Miller Singley, A. T., & Bunge, S. A. (2017) · Developmental Cognitive Neuroscience · doi:10.1016/j.dcn.2016.11.001 · Cited by 686
Hengstler, M., Enkel, E., & Duelli, S. (2016) · Technological Forecasting and Social Change · doi:10.1016/j.techfore.2015.12.014 · Cited by 661
Extending the Technology Acceptance Model to assess automation
Ghazizadeh, M., Lee, J. D., & Boyle, L. N. (2012) · Cognition, Technology & Work · doi:10.1007/s10111-011-0194-3 · Cited by 495
Portet, F., Vacher, M., Golanski, C., Roux, C., & Meillon, B. (2013) · Personal and Ubiquitous Computing · doi:10.1007/s00779-011-0470-5 · Cited by 421
Designing for Older Adults: Principles and Creative Human Factors Approaches, Second Edition
Fisk, A. D., Czaja, S. J., Rogers, W. A., Charness, N., Czaja, S. J., & Sharit, J. (2018) · doi:10.1201/9781420080681 · Cited by 396
Chi, O. H., Denton, G., & Gursoy, D. (2020) · Journal of Hospitality Marketing & Management · doi:10.1080/19368623.2020.1721394 · Cited by 334
Prevalence of age-related hearing loss in Europe: a review
Roth, T. N., Hanebuth, D., & Probst, R. (2011) · European Archives of Oto-Rhino-Laryngology · doi:10.1007/s00405-011-1597-8 · Cited by 332
Designing automation for human use: empirical studies and quantitative models
Parasuraman, R. (2000) · Ergonomics · doi:10.1080/001401300409125 · Cited by 293
NASA-TLX Assessment of Surgeon Workload Variation Across Specialties
Lowndes, B. R., Forsyth, K. L., Blocker, R. C., Dean, P. G., Truty, M. J., Heller, S. F., Blackmon, S., Hallbeck, M. S., & Nelson, H. (2020) · Annals of Surgery · doi:10.1097/sla.0000000000003058 · Cited by 173
The Method of Constructing an Attitude Scale
Likert, R. (2017) · Scaling · doi:10.4324/9781315128948-23 · Cited by 150
An eye tracking computer user interface
Kaufman, A. E., Bandopadhay, A., & Shaviv, B. D. (1993) · doi:10.1109/vrais.1993.378254 · Cited by 115
ARtention: A design space for gaze-adaptive user interfaces in augmented reality
Pfeuffer, K., Abdrabou, Y., Esteves, A., Rivu, R., Abdelrahman, Y., Meitner, S., Saadi, A., & Alt, F. (2021) · Computers & Graphics · doi:10.1016/j.cag.2021.01.001 · Cited by 113
Individual Differences in the Calibration of Trust in Automation
Pop, V. L., Shrewsbury, A., & Durso, F. T. (2015) · Human Factors: The Journal of the Human Factors and Ergonomics Society · doi:10.1177/0018720814564422 · Cited by 109
Kim, J. C., Laine, T. H., & Åhlund, C. (2021) · Applied Sciences · doi:10.3390/app11041738 · Cited by 90
Very low-cost internet access using KioskNet
(2007) · doi:10.1145/1290168.1290181 · Cited by 86
Vildjiounaite, E., Mäkelä, S.-M., Lindholm, M., Riihimäki, R., Kyllönen, V., Mäntyjärvi, J., & Ailisto, H. J. (2006) · Lecture notes in computer science · doi:10.1007/11748625_12 · Cited by 85
Kaye, S.-A., Lewis, I. M., & Freeman, J. (2018) · Journal of Safety Research · doi:10.1016/j.jsr.2018.02.012 · Cited by 82
An exploratory study of a touch-based gestural interface for elderly
Leonardi, C., Albertini, A., Pianesi, F., & Zancanaro, M. (2010) · Proceedings of the 6th Nordic Conference on Human-Computer Interaction: Extending Boundaries · doi:10.1145/1868914.1869045 · Cited by 58
Input modality matters: A comparison of touch, speech, and gesture based in-vehicle interaction
Zhang, T., Liu, X., Zeng, W., Tao, D., Li, G., & Qu, X. (2022) · Applied Ergonomics · doi:10.1016/j.apergo.2022.103958 · Cited by 48
Tangible user interface for social interactions for the elderly: a review of literature
Bong, W. K., Chen, W., & Bergland, A. (2018) · Advances in Human-Computer Interaction · doi:10.1155/2018/7249378 · Cited by 48
Making touch-based kiosks accessible to blind users through simple gestures
Sandnes, F. E., Tan, T. B., Johansen, A., Sulic, E., Vesterhus, E., & Iversen, E. R. (2011) · Universal Access in the Information Society · doi:10.1007/s10209-011-0258-4 · Cited by 46
Research on visual representation of icon colour in eye-controlled systems
Niu, Y., Liu, J., Jia-qi, C., Yang, W., Zuo, H., He, J., Xiao, L., Jia-hao, W., Ma, G., Han, Z., et al. (2022) · Advanced Engineering Informatics · doi:10.1016/j.aei.2022.101570 · Cited by 45
Seaborn, K., Sekiguchi, T., Tokunaga, S., Miyake, N. P., & Otake-Matsuura, M. (2023) · International Journal of Social Robotics · doi:10.1007/s12369-022-00925-7 · Cited by 43
MATCHkiosk: A Multimodal Interactive City Guide
Johnston, M., & Bangalore, S. (2004) · Annual Meeting of the Association for Computational Linguistics · doi:10.3115/1219044.1219077 · Cited by 39
Interface adaptation to novice older adults’ mental models through concrete metaphors
Zhou, J., Chourasia, A., & Vanderheiden, G. (2017) · International Journal of Human–Computer Interaction · doi:10.1080/10447318.2016.1265827 · Cited by 32
Gliding and saccadic gaze gesture recognition in real time
Rozado, D., Agustin, J. S., Rodriguez, F. B., & Varona, P. (2012) · ACM Transactions on Interactive Intelligent Systems · doi:10.1145/2070719.2070723 · Cited by 32
Niu, Y., Gao, Y., Xue, C., et al. (2020) · Journal of Eye Movement Research · doi:10.16910/jemr.12.3.8 · Cited by 28
BingBee, an information kiosk for social enablement in marginalized communities
Thinyane, H., Wentworth, P., & Locke, J. (2006) · South African Institute of Computer Scientists and Information Technologists · doi:10.1145/1216262.1216274 · Cited by 26
What makes an automated teller machine usable by blind users?
Manzke, J. M., EGAN, D. H., Felix, D., & Krueger, H. (1998) · Ergonomics · doi:10.1080/001401398186540 · Cited by 23
A framework to evaluate video banking kiosks
(1998) · doi:10.1016/s0305-0483(97)00080-7 · Cited by 21
Claypoole, V. L., Schroeder, B. L., & Mishler, A. D. (2016) · Ergonomics in Design The Quarterly of Human Factors Applications · doi:10.1177/1064804615611271 · Cited by 16
Effects of Aging on Small Target Selection with Touch Input
Sultana, A., & Moffatt, K. (2019) · ACM Transactions on Accessible Computing · doi:10.1145/3300178 · Cited by 14
Multimodal interaction, interfaces, and analytics
Oviatt, S. (2022) · Handbook of Human Computer Interaction · doi:10.1007/978-3-319-27648-9_22-1 · Cited by 12
Ma, J., Zuo, Y., Du, H., Wang, Y., Tan, M., & Li, J. (2024) · International Journal of Human-Computer Interaction · doi:10.1080/10447318.2024.2375697 · Cited by 10
Audiometric Findings in Senior Adults of 80 Years and Older
Raedemaeker, K. D., Foulon, I., Azzopardi, R. V., Lichtert, E., Buyl, R., Topsakal, V., Beyer, I., Bautmans, I., Michel, O., & Gordts, F. (2022) · Frontiers in Psychology · doi:10.3389/fpsyg.2022.861555 · Cited by 10
Tactile Interaction for Novice User
Chêne, D., Pillot, V., & Chaumon, M.-É. B. (2016) · Lecture notes in computer science · doi:10.1007/978-3-319-39943-0_40 · Cited by 4
Research on the Design of Medical Self-service Terminal for the Elderly
Shang, H., Shi, X., & Wang, C. (2020) · Advances in intelligent systems and computing · doi:10.1007/978-3-030-50838-8_46 · Cited by 4
Trust-based controller for convoy string stability
Mikulski, D. G. (2014) · 2014 IEEE Symposium on Computational Intelligence in Vehicles and Transportation Systems (CIVTS) · doi:10.1109/civts.2014.7009480 · Cited by 2
Smart Digital Terminal Devices with Speech Recognition and Speech Control
Sajić, M., Bundalo, D., Vidović, Ž., Bundalo, Z., & Lalic, D. (2021) · Mediterranean Conference on Embedded Computing (MECO) · doi:10.1109/meco52532.2021.9460226 · Cited by 1
Shop-i: Gaze based Interaction in the Physical World for In-Store Social Shopping Experience
Kim, M., Lee, M. K., & Dabbish, L. (2015) · Proceedings of the 33rd Annual ACM Conference Extended Abstracts on Human Factors in Computing Systems · doi:10.1145/2702613.2732797
Research works printed but not linked: 4
- Hansen, 2001, Bringing gaze-based interaction back to basics, 325
- Lee, 2020, Literature review on accessibility guidelines for self-service terminals
- Norman, 2013, The Design of EverydayThings: Revised and Expanded Edition
- Olsen, 2012, The Tobii I-VT fixation filter: algorithm description, Tobii Technol., 21, 15
Cited by
Jin, S., Liu, B., & Tingyun, L. U. O. (2026) · Frontiers in Psychology · doi:10.3389/fpsyg.2026.1851466
Man, S. S., Wang, J., Liang, Z., Wang, Y., & Chan, A. H. S. (2026) · Ergonomics · doi:10.1080/00140139.2026.2736802
Effects of Interaction Modality on LLM-Based Information-Seeking
Lansche, J., & Draxler, F. (2026) · Mensch und Computer (MuC) · doi:10.1145/3820253.3820261
Zhu, Y., Yim, J., Ren, X.-C., & Guan, Y. (2026) · Healthcare · doi:10.3390/healthcare14111450
Yu, J., Chen, J., Ren, A., Duan, H., Meng, H., & Gao, Z. (2026) · Journal of Medical Internet Research · doi:10.2196/94140 · Cited by 1
Metadata
- Authors
- Huang, H., & Hou, G.
- Affiliations
- Children's Hospital of Chongqing Medical University (CN)
- Southeast University (CN)
- Corresponding author
- Huang, Hui
- Venue
- Frontiers in Computer Science
- Publisher
- Frontiers Media SA
- Published
- 2025-11-13
- Volume
- 7
- ISSN
- 2624-9898 (ISSN-L)
- OpenAlex
- W4416169207
- Semantic Scholar
- d1dcbe08ee1407d65971fec9ca540718397ea4aa
- Cited by
- 5
- References
- 40
- Citations by year
- 2026: 5
- FWCI
- 11.26
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- Locations
- Frontiers in Computer Science (publishedVersion, cc-by)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Topics
- Health Sciences › Medicine › Geriatrics and Gerontology › Technology Use by Older Adults
- Physical Sciences › Computer Science › Human-Computer Interaction › Innovative Human-Technology Interaction
- Physical Sciences › Computer Science › Human-Computer Interaction › Usability and User Interface Design
- Keywords
- trust in technology, older adults, input modality, touch input, speech input, cognitive load, technology acceptance, eye tracking, NASA-TLX
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
The claim verdicts this report counts are experimental: their accuracy is not yet measured.
A language model drew the claims from the paper on 2026-09-30, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-09-30 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Cited sources are checked with a language model’s help (gpt-6-sol).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.