The DOI matches its Crossref record; 44 of the 45 references it cites were found in a registry or an index; 4 of the 50 sources its claims cite were checked for support.
A field evaluation of an adaptable two-interface design for feature-rich software
Abstract
Two approaches for supporting personalization in complex software are system-controlled adaptive menus and user-controlled adaptable menus. We evaluate a novel interface design for feature-rich productivity software based on adaptable menus. The design allows the user to easily customize a personalized interface, and also supports quick access to the default interface with all of the standard features. This design was prototyped as a front-end to a commercial word processor. A field experiment investigated users' personalizing behavior and tested the effects of different interface designs on users' satisfaction and their perceived ability to navigate, control, and learn the software. There were two conditions: a commercial word processor with adaptive menus and our prototype with adaptable menus for the same word processor. Our evaluation shows: (1) when provided with a flexible, easy-to-use and easy-to-understand customization mechanism, the majority of users do effectively personalize their interface; and (2) user-controlled interface adaptation with our adaptable menus results in better navigation and learnability, and allows for the adoption of different personalization strategies, as compared to a particular system-controlled adaptive menu system that implements a single strategy. We report qualitative data obtained from interviews and questionnaires with participants in the evaluation in addition to quantitative data.
Overview
CoChat Summary
## TL;DR
This field evaluation compared an adaptable two-interface version of MS Word (“MSW Personal”) with Word 2000’s adaptive menus over 4 weeks of use by 20 experienced users. The adaptable design was preferred by most participants and was associated with better perceived navigation and learnability, while also supporting multiple personalization strategies.
## Key findings
- Of the 19 participants with complete logging data, 14 (74%) spent 50% or more of their word-processing time in their Personal Interface, and participants’ mean word-processing time during the 4 weeks was 596 minutes (SD 554).
- Personalization was strong and mostly additive: the initial trigger accounted for 372 of 485 function additions (76.70%), and the immediate-need trigger accounted for 43 (8.87%); only 7 functions were deleted in total.
- 13 of 20 participants (65%) ranked MSW Personal first in the three-way comparison, compared with 3 ranking the adaptive menus first; 7 participants (35%) had to be told that Word 2000’s short menus adapted to their use.
- Perceived navigation and learnability favored MSW Personal: navigation showed significant effects for MSW Personal over MSW2K (e.g., Q1 vs. Q6, F(1,18)=5.76, p=.027; Q6 vs. Q7, F(1,18)=8.02, p=.011), and learnability was also better for MSW Personal (Q1 vs. Q6, F(1,18)=4.13, p=.057; Q6 vs. Q7, F(1,18)=3.08, p=.096).
- Feature-shy participants especially benefited in satisfaction and control: satisfaction increased for feature-shy users on MSW Personal (Q1 vs. Q6, F(1,9)=3.65, p=.089), and control increased significantly for feature-shy users (F(1,9)=11.17, p=.009), while feature-keen users showed no significant change on those measures.
## Methods
- Field quasi-experiment with 20 experienced MS Word users over about 6 weeks: they used MSW2K before the study, MSW Personal for 4 weeks, then returned to MSW2K for 2 weeks.
- Participants were 10 feature-shy and 10 feature-keen users; 98 people completed the screening questionnaire, and the study sample was self-selected.
- Data came from logging plus eight questionnaires and a final semi-structured interview; analysis combined descriptive statistics with inferential tests including t-tests, ANOVAs, and chi-square tests.
## Limitations
- The paper states the study was a quasi-experimental field design with no control group and that counterbalancing was not possible; it also notes likely multiple-treatment interference, reactive effects, researcher interference, and selection bias.
- One participant’s logging data were partly lost, so some analyses use N=19 instead of N=20.
- The authors note the sample was not representative: there was no sampling frame, the participants were highly educated and long-term Word users, there were no administrative assistants, and no novice users were included.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
4 Valid · 3 Not valid · 41 Not checked · 247 Own results and interpretations
Every source the paper cites for this claim was checked and supports it.
In the paper
“Closer examination of their work shows, however, that a very broad notion of customization was used; for example, changing the zoom setting in a dropdown button on the toolbar was considered a customization.”
What the sources say
- Supportedcites Page, Johnsgard, Albert, & Allen, 1996 source
The General Preferences section (p. n/a) states that 'The "Zoom Percentage" controls the size of the text on the screen... Fifteen percent of the participants changed the zoom setting,' and this is reported as one of the customization changes, alongside 'Minutes Between Backups' — 86% made changes to general preference settings. The Procedure/Conclusions sections confirm the breadth of the construct: five categories of customization activities (functionality, access to interface tools, access to functionality, visual appearance, general preferences) yielding the headline claim that '92% of word processing users customize their software.' So the citing sentence's characterization (a very broad notion of customization that counts a zoom-setting change as a customization) is what our copy does. The only detail our copy does not specify is the control's location ('in a dropdown button on the toolbar'); the paper describes zoom purely as a general preference setting. (LLM, conf=0.82)
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Supported
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“user-controlled interface adaptation with our adaptable menus results in better navigation and learnability, and allows for the adoption of different personalization strategies, as compared to a particular system-controlled adaptive menu system that implements a single strategy.”
- Also stated in: § 1. INTRODUCTION · plain
“usercontrolled interface adaptation with our adaptable menus results in better navigation and learnability, and allows for the adoption of different personalization strategies, as compared to the particular system-controlled adaptive menu system in MSW2K, which implements a single strategy.”
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Rests on 2 assumptions not shown here.
- Also stated in: § 1. INTRODUCTION · plain
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“user-controlled interface adaptation with our adaptable menus results in better navigation and learnability, and allows for the adoption of different personalization strategies, as compared to a particular system-controlled adaptive menu system that implements a single strategy.”
- Also stated in: § 1. INTRODUCTION · plain
“usercontrolled interface adaptation with our adaptable menus results in better navigation and learnability, and allows for the adoption of different personalization strategies, as compared to the particular system-controlled adaptive menu system in MSW2K, which implements a single strategy.”
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Rests on 2 assumptions not shown here.
- Also stated in: § 1. INTRODUCTION · plain
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“when provided with a flexible, easy-to-use and easy-to-understand customization mechanism, the majority of users do effectively personalize their interface”
- Also stated in: § 1. INTRODUCTION · plain
“when provided with a flexible, easy-to-use customization mechanism, the majority of users do effectively personalize their interface”
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Rests on 2 assumptions not shown here.
- Also stated in: § 1. INTRODUCTION · plain
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Figure 7 shows that within the first 2 days that MSW Personal was used, 81% of all 485 functions had been added.”
plainn = 12- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
139 more claims
Create a free account to see all 295 claims and to verify the 3 references still open.
- Probably not a substantial claim. 87
- It may state two separate claims as one. 94
- The quote only partly states this claim. 1
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source says what the claim attributes to it.
In the citing paper
“Many interfaces allow access to extensive functionality, often including hundreds or thousands of commands [Hsi and Potts 2000;McGrenere et al. 2007], yet users typically know only a small subset.”
From Supporting Novice to Expert Transitions in User Interfaces (2015) · cites this paper as McGrenere et al. 2007
Statistics recomputed
Every reported test result, recomputed from its test statistic and degrees of freedom. A result shows as not adding up only once an independent check has confirmed it.
- Consistentt(18) = -2.04reported p = .056 · recomputed p = .056
“t(18) = -2.04, p = .056”
- Consistentt(18) = -2.72reported p = .014 · recomputed p = .014
“t(18) = -2.72, p = .014”
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
Self-check results appear here once an independent check has confirmed them.
Citations
Cites
(1963) · Medical Entomology and Zoology · Cited by 15,085
Designing the user interface: Strategies for effective human-computer interaction
(1993) · Applied Ergonomics · doi:10.1016/0003-6870(93)90471-k · Cited by 5,587
Designing the user interface strategies for effective human-computer interaction
Shneiderman, B. (1987) · ACM SIGBIO Newsletter · doi:10.1145/25065.950626 · Cited by 2,798
Principles of mixed-initiative user interfaces
Horvitz, E. (1999) · Proceedings of the SIGCHI conference on Human factors in computing systems the CHI is the limit - CHI '99 · doi:10.1145/302979.303030 · Cited by 1,490
Norman, D. A. (1998) · The MIT Press eBooks · Cited by 1,121
Direct manipulation vs. interface agents
Shneiderman, B., & Maes, P. (1997) · Interactions · doi:10.1145/267505.267514 · Cited by 518 · cited 1×
“…in the user interface design community between those who promote the use of arti.cial intelligence in the interface and those who promote comprehensible, predictable, and controllable interfaces that give users the sense of power, mastery, control and accomplishment [Shneiderman and Maes 1997].”
BackgroundUser-tailorable systems: pressing the issues with buttons
MacLean, A., Carter, K., Lövstrand, L., & Moran, T. (1990) · Proceedings of the SIGCHI conference on Human factors in computing systems Empowering people - CHI '90 · doi:10.1145/97243.97271 · Cited by 401
Triggers and barriers to customizing software
Mackay, W. E. (1991) · Proceedings of the SIGCHI conference on Human factors in computing systems Reaching through technology - CHI '91 · doi:10.1145/108844.108867 · Cited by 364 · cited 5×
“evaluation. Unlike previous work by Mackay [ Mackay, 1991 ], which showed that users”
BackgroundMethodResultInfluentialA comparison of static, adaptive, and adaptable menus
Findlater, L., & McGrenere, J. (2004) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/985692.985704 · Cited by 316
Self-citationSplit menus: effectively using selection frequency to organize menus
Sears, A., & Shneiderman, B. (1994) · ACM Transactions on Computer-Human Interaction · doi:10.1145/174630.174632 · Cited by 293 · cited 1×
“Findlater and McGrenere [2004] found that adaptive split menus [Sears and Shneiderman 1994] were slower than static split menus, and slower than adaptable split menus in most circumstances.”
Background
Research works printed but not linked: 2
- Dieterich , H. , Malinowski , U. , Kühme , T. , and Schneider-Hufschmidt , M. 1993. State of the art in adaptive user interfaces . In Adaptive User Interfaces: Principles and Practice , M. Schneider-Hufschmidt, T. Kuhme, and U. Malinowski, Eds., North Holland : Elsevier Science Publishers B.V. , Amsterdam, The Netherlands, 13--48. Dieterich, H., Malinowski, U., Kühme, T., and Schneider-Hufschmidt, M. 1993. State of the art in adaptive user interfaces. In Adaptive User Interfaces: Principles and Practice, M. Schneider-Hufschmidt, T. Kuhme, and U. Malinowski, Eds., North Holland: Elsevier Science Publishers B.V., Amsterdam, The Netherlands, 13--48.
- Schneider-Hufschmidt , M. , Kuhme , T. , and Malinowski , U . Eds . 1993 . Adaptive User Interfaces: Principles and Practice. North-Holland: Elsevier Science Publishers B.V. , Amsterdam, The Netherlands. Schneider-Hufschmidt, M., Kuhme, T., and Malinowski, U. Eds. 1993. Adaptive User Interfaces: Principles and Practice. North-Holland: Elsevier Science Publishers B.V., Amsterdam, The Netherlands.
Cited by
Automatically generating personalized user interfaces with Supple
Gajos, K. Z., Weld, D. S., & Wobbrock, J. O. (2010) · Artificial Intelligence · doi:10.1016/j.artint.2010.05.005 · Cited by 317
“We report both the average case values (the median across all trials) and the worst-case numbers.”
BackgroundSupporting Novice to Expert Transitions in User Interfaces
Cockburn, A., Gutwin, C., Scarr, J., & Malacria, S. (2015) · ACM Computing Surveys · doi:10.1145/2659796 · Cited by 193
“Many interfaces allow access to extensive functionality, often including hundreds or thousands of commands [Hsi and Potts 2000; McGrenere et al. 2007], yet users typically know only a small subset.”
BackgroundInfluentialAdaptive user interfaces and universal usability through plasticity of user interface design
Miraz, M. H., Ali, M., & Excell, P. S. (2021) · Computer Science Review · doi:10.1016/j.cosrev.2021.100363 · Cited by 158
CommunityCommands: command recommendations for software applications
Matejka, J., Li, W., Grossman, T., & Fitzmaurice, G. (2009) · Proceedings of the 22nd annual ACM symposium on User interface software and technology · doi:10.1145/1622176.1622214 · Cited by 125
Choice Architecture for Human-Computer Interaction
Jameson, A., Berendt, B., Gabrielli, S., Cena, F., Gena, C., Vernero, F., & Reinecke, K. (2014) · Foundations and Trends® in Human–Computer Interaction · doi:10.1561/1100000028 · Cited by 92
“Over the years, researchers have repeatedly found this type of problem to be challenging for most users (see, e.g., Mackay, 1991; McGrenere et al., 2007).”
Background
Metadata
- Authors
- McGrenere, J., Baecker, R. M., & Booth, K. S.
- Affiliations
- University of British Columbia (CA)
- University of Toronto (CA)
- Venue
- ACM Transactions on Computer-Human Interaction
- Published
- 2007-05
- Volume
- 14
- Issue
- 1
- Pages
- 3
- ISSN
- 1073-0516 (ISSN-L)
- 1557-7325
- OpenAlex
- W2015529899
- Cited by
- 52
- References
- 45
- Citations by year
- 2026: 2 · 2025: 3 · 2024: 1 · 2022: 1 · 2021: 3 · 2020: 1 · 2019: 3 · 2018: 3 · 2016: 1 · 2015: 2 · 2014: 5 · 2013: 3 · 2012: 4
- FWCI
- 10.80
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- ACM Transactions on Computer-Human Interaction (publishedVersion)
- Topics
- Physical Sciences › Computer Science › Human-Computer Interaction › Usability and User Interface Design
- Physical Sciences › Computer Science › Human-Computer Interaction › Interactive and Immersive Displays
- Physical Sciences › Computer Science › Information Systems › Recommender Systems and Techniques
- Keywords
- personalization, user interface customization, productivity tools, word processing software, learnability, navigation, user satisfaction, field experiments
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
A language model drew the claims from the paper on 2026-10-10, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-10-10 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Cited sources are checked with a language model’s help (qwen3.8-omni-flash).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: A field evaluation of an adaptable two-interface design for feature-rich software. https://app.cochat.ai/papers/10.1145/1229855.1229858
- The paper
- McGrenere, J., Baecker, R. M., & Booth, K. S. (2007). A field evaluation of an adaptable two-interface design for feature-rich software. ACM Transactions on Computer-Human Interaction. https://doi.org/10.1145/1229855.1229858
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.