CoChat

The DOI matches its Crossref record; 44 of the 45 references it cites were found in a registry or an index; 4 of the 50 sources its claims cite were checked for support.

A field evaluation of an adaptable two-interface design for feature-rich software

McGrenere, Joanna, Baecker, Ronald M., Booth, Kellogg S. · 2007 · ACM Transactions on Computer-Human Interaction

Abstract

Two approaches for supporting personalization in complex software are system-controlled adaptive menus and user-controlled adaptable menus. We evaluate a novel interface design for feature-rich productivity software based on adaptable menus. The design allows the user to easily customize a personalized interface, and also supports quick access to the default interface with all of the standard features. This design was prototyped as a front-end to a commercial word processor. A field experiment investigated users' personalizing behavior and tested the effects of different interface designs on users' satisfaction and their perceived ability to navigate, control, and learn the software. There were two conditions: a commercial word processor with adaptive menus and our prototype with adaptable menus for the same word processor. Our evaluation shows: (1) when provided with a flexible, easy-to-use and easy-to-understand customization mechanism, the majority of users do effectively personalize their interface; and (2) user-controlled interface adaptation with our adaptable menus results in better navigation and learnability, and allows for the adoption of different personalization strategies, as compared to a particular system-controlled adaptive menu system that implements a single strategy. We report qualitative data obtained from interviews and questionnaires with participants in the evaluation in addition to quantitative data.

Overview

CoChat Summary

## TL;DR

This field evaluation compared an adaptable two-interface version of MS Word (“MSW Personal”) with Word 2000’s adaptive menus over 4 weeks of use by 20 experienced users. The adaptable design was preferred by most participants and was associated with better perceived navigation and learnability, while also supporting multiple personalization strategies.

## Key findings

  • Of the 19 participants with complete logging data, 14 (74%) spent 50% or more of their word-processing time in their Personal Interface, and participants’ mean word-processing time during the 4 weeks was 596 minutes (SD 554).
  • Personalization was strong and mostly additive: the initial trigger accounted for 372 of 485 function additions (76.70%), and the immediate-need trigger accounted for 43 (8.87%); only 7 functions were deleted in total.
  • 13 of 20 participants (65%) ranked MSW Personal first in the three-way comparison, compared with 3 ranking the adaptive menus first; 7 participants (35%) had to be told that Word 2000’s short menus adapted to their use.
  • Perceived navigation and learnability favored MSW Personal: navigation showed significant effects for MSW Personal over MSW2K (e.g., Q1 vs. Q6, F(1,18)=5.76, p=.027; Q6 vs. Q7, F(1,18)=8.02, p=.011), and learnability was also better for MSW Personal (Q1 vs. Q6, F(1,18)=4.13, p=.057; Q6 vs. Q7, F(1,18)=3.08, p=.096).
  • Feature-shy participants especially benefited in satisfaction and control: satisfaction increased for feature-shy users on MSW Personal (Q1 vs. Q6, F(1,9)=3.65, p=.089), and control increased significantly for feature-shy users (F(1,9)=11.17, p=.009), while feature-keen users showed no significant change on those measures.

## Methods

  • Field quasi-experiment with 20 experienced MS Word users over about 6 weeks: they used MSW2K before the study, MSW Personal for 4 weeks, then returned to MSW2K for 2 weeks.
  • Participants were 10 feature-shy and 10 feature-keen users; 98 people completed the screening questionnaire, and the study sample was self-selected.
  • Data came from logging plus eight questionnaires and a final semi-structured interview; analysis combined descriptive statistics with inferential tests including t-tests, ANOVAs, and chi-square tests.

## Limitations

  • The paper states the study was a quasi-experimental field design with no control group and that counterbalancing was not possible; it also notes likely multiple-treatment interference, reactive effects, researcher interference, and selection bias.
  • One participant’s logging data were partly lost, so some analyses use N=19 instead of N=20.
  • The authors note the sample was not representative: there was no sampling frame, the participants were highly educated and long-term Word users, there were no administrative assistants, and no novice users were included.

Model-written summary. Check it against the paper before relying on it.

Integrity signals

Registry

Crossref · 10.1145/1229855.1229858

Cites

44 of 44 references verified0 citation errors · 0 not checkable

Statistics

Verification

Claims the paper makes

4 Valid · 3 Not valid · 41 Not checked · 247 Own results and interpretations

139 more claims

Create a free account to see all 295 claims and to verify the 3 references still open.

See all claims — free account
  • Probably not a substantial claim. 87
  • It may state two separate claims as one. 94
  • The quote only partly states this claim. 1

Create a free account to see these claims.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Statistics recomputed

Every reported test result, recomputed from its test statistic and degrees of freedom. A result shows as not adding up only once an independent check has confirmed it.

  • Consistentt(18) = -2.04reported p = .056 · recomputed p = .056

    “t(18) = -2.04, p = .056”

  • Consistentt(18) = -2.72reported p = .014 · recomputed p = .014

    “t(18) = -2.72, p = .014”

2 of 2

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

Self-check results appear here once an independent check has confirmed them.

Citations

Cites

Show all 45 references

Research works printed but not linked: 2

  1. Dieterich , H. , Malinowski , U. , Kühme , T. , and Schneider-Hufschmidt , M. 1993. State of the art in adaptive user interfaces . In Adaptive User Interfaces: Principles and Practice , M. Schneider-Hufschmidt, T. Kuhme, and U. Malinowski, Eds., North Holland : Elsevier Science Publishers B.V. , Amsterdam, The Netherlands, 13--48. Dieterich, H., Malinowski, U., Kühme, T., and Schneider-Hufschmidt, M. 1993. State of the art in adaptive user interfaces. In Adaptive User Interfaces: Principles and Practice, M. Schneider-Hufschmidt, T. Kuhme, and U. Malinowski, Eds., North Holland: Elsevier Science Publishers B.V., Amsterdam, The Netherlands, 13--48.
  2. Schneider-Hufschmidt , M. , Kuhme , T. , and Malinowski , U . Eds . 1993 . Adaptive User Interfaces: Principles and Practice. North-Holland: Elsevier Science Publishers B.V. , Amsterdam, The Netherlands. Schneider-Hufschmidt, M., Kuhme, T., and Malinowski, U. Eds. 1993. Adaptive User Interfaces: Principles and Practice. North-Holland: Elsevier Science Publishers B.V., Amsterdam, The Netherlands.

Cited by

See all 52

Metadata

Authors
McGrenere, J., Baecker, R. M., & Booth, K. S.
Affiliations
  • University of British Columbia (CA)
  • University of Toronto (CA)
Venue
ACM Transactions on Computer-Human Interaction
Published
2007-05
Volume
14
Issue
1
Pages
3
ISSN
  • 1073-0516 (ISSN-L)
  • 1557-7325
OpenAlex
W2015529899
Cited by
52
References
45
Citations by year
2026: 2 · 2025: 3 · 2024: 1 · 2022: 1 · 2021: 3 · 2020: 1 · 2019: 3 · 2018: 3 · 2016: 1 · 2015: 2 · 2014: 5 · 2013: 3 · 2012: 4
FWCI
10.80
Type
journal article
Language
en
Open access
closed
Locations
ACM Transactions on Computer-Human Interaction (publishedVersion)
Topics
  • Physical Sciences › Computer Science › Human-Computer Interaction › Usability and User Interface Design
  • Physical Sciences › Computer Science › Human-Computer Interaction › Interactive and Immersive Displays
  • Physical Sciences › Computer Science › Information Systems › Recommender Systems and Techniques
Keywords
personalization, user interface customization, productivity tools, word processing software, learnability, navigation, user satisfaction, field experiments

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

A language model drew the claims from the paper on 2026-10-10, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).

A second model labelled each claim on 2026-10-10 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).

Cited sources are checked with a language model’s help (qwen3.8-omni-flash).

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: A field evaluation of an adaptable two-interface design for feature-rich software. https://app.cochat.ai/papers/10.1145/1229855.1229858
The paper
McGrenere, J., Baecker, R. M., & Booth, K. S. (2007). A field evaluation of an adaptable two-interface design for feature-rich software. ACM Transactions on Computer-Human Interaction. https://doi.org/10.1145/1229855.1229858

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.