Cited by 193Usability and User Interface DesignData Visualization and AnalyticsInteractive and Immersive Displays

Supporting Novice to Expert Transitions in User Interfaces

Open access
Cockburn, Andy, Gutwin, Carl, Scarr, Joey, Malacria, Sylvain·2015·ACM Computing Surveys

Abstract

Interface design guidelines encourage designers to provide high-performance mechanisms for expert users. However, research shows that many expert interface components are seldom used and that there is a tendency for users to persistently fail to adopt faster methods for completing their work. This article summarizes and organizes research relevant to supporting users in making successful transitions to expert levels of performance. First, we provide a brief introduction to the underlying human factors of skill acquisition relevant to interaction with computer systems. We then present our focus, which is a review of the state of the art in user interfaces that promote expertise development. The review of interface research is based around four domains of performance improvement: intramodal improvement that occurs as a factor of repetition and practice with a single method of interaction; intermodal improvement that occurs when users switch from one method to another that has a higher performance ceiling; vocabulary extension , in which the user broadens his or her knowledge of the range of functions available; and task mapping , which examines the ways in which users perform their tasks. The review emphasizes the relationship between interface techniques and the human factors that explain their relative success.

Integrity signals

Registry

Crossref · 10.1145/2659796

Cites

175 of 175 references verified0 citation errors · 0 not checkable

Statistics

Nothing to recompute.

Claims the paper makes

7 of 128 cited sources checked · 6 supported · 1 flagged · accuracy not yet measured

  • Premisecitation

    Carroll and Carrithers exploited the effect of reducing displayed controls with Training Wheels interfaces, which intentionally reduced the number of commands displayed.

    “Carroll and Carrithers [1984] exploited this effect with their Training Wheels interfaces, which intentionally reduced the number of commands displayed.”
    Quote in the paperNot a substantial claim1 of 1 sources checked
    • cites Carroll and Carrithers [1984] source

      The Training Wheels Interface section says the authors made only basic menu choices accessible; selecting an advanced choice displayed a message that the function was unavailable. The Discussion says menus were kept identical between the training-wheels and complete interfaces. The paper therefore describes restricting which commands worked, not reducing the number displayed. (LLM, conf=0.88)

      Checked by a reasoning model — may be wrong.

      Experimental — accuracy not yet measured
  • Premisecitation

    Principles derived from the study of simple tasks do not generalize to more complex skills.

    “Wulf and Shea [2002] found that principles derived from the study of simple tasks do not generalize to more complex skills.”
    Quote in the paperSubstantial claim1 of 1 sources checked
    • cites Wulf and Shea [2002] source
  • Premisecitation

    Spaced practice sessions improve recall performance compared with continuous practice.

    “Cepeda et al. [2006] present a review of 184 papers studying verbal recall tasks, demonstrating that spaced (versus continuous) practice sessions improve recall performance.”
    Quote in the paperSubstantial claim1 of 1 sources checked
    • cites Cepeda et al. 2006 source
  • Premisecitation

    Several studies have shown important interactions between the effectiveness of training interventions, participants' skill level, and complexity of the skill conducted.

    “Several studies have shown important interactions between the effectiveness of training interventions, the participants' skill level, and the complexity of the skill conducted.”
    Quote in the paperSubstantial claim1 of 2 sources checked
    • cites Perkins-Ceccato et al. [2003] source
    • cites Wulf and Shea [2002] source
  • Premisecitation

    Scarr et al. found that users were able to quickly locate items in spatially stable views that had undergone a uniform spatial transformation.

    “Scarr et al. [2013] examined the robustness of users' spatial memory to various forms of spatial transformation (including scaling) and found that users were able to quickly locate items in spatially stable views that had undergone a uniform spatial transformation.”
    Quote in the paperNot a substantial claim1 of 1 sources checked
    • cites Scarr et al. [2013] source
  • Classified as probably not a substantial claim. 54
  • May combine two claims. 61
  • The quote only partly states this claim. 2
  • Classified as probably not a substantial claim. May combine two claims.

    Premisecitation

    When task demands are low, learners benefit from practice conditions that increase total cognitive load; when task demands are high, practice conditions with more manageable workload are beneficial.

    “They explained this effect with reference to the learner's total cognitive load: When task demands are low, learners benefit from practice conditions that increase total load, whereas when task demands are high, practice conditions with more manageable workload are beneficial.”
    Quote in the paperSubstantial claim1 of 1 sources checked
    • cites Wulf and Shea [2002] source
  • May combine two claims.

    Premisecitation

    Many interfaces allow access to extensive functionality, often including hundreds or thousands of commands, yet users typically know only a small subset.

    “Many interfaces allow access to extensive functionality, often including hundreds or thousands of commands [Hsi and Potts 2000;McGrenere et al. 2007], yet users typically know only a small subset.”
    Quote in the paperSubstantial claim1 of 2 sources checked
    • cites Hsi and Potts 2000 source
    • cites McGrenere et al. 2007 source
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation

    Learning and skill acquisition have been the focus of substantial research in the psychology literature.

    “Naturally, learning and skill acquisition have been the focus of substantial research in the psychology literature.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Premisenone given

    Interfaces explicitly designed for experts, such as keyboard shortcuts or command-line interaction, allow high levels of performance but only after extensive training.

    “interfaces explicitly designed for experts (e.g., keyboard shortcuts or command-line interaction) allow high levels of performance but only after extensive training”
    Quote in the paperSubstantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation

    Help and documentation is often the user's source of last resort.

    “often the user's source of last resort [Randall and Pedersen 1998]”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Randall and Pedersen 1998 source
  • Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based).

    Premisenone given

    Spatial and proprioceptive memory strongly influence the user's ability to rapidly acquire interface targets.

    “spatial and proprioceptive memory strongly influence the user's ability to rapidly acquire interface targets”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S4 (based).

    Interpretationreasoning

    The tendency for users to asymptote at mediocre performance has serious and enduring implications for the productivity of millions of office workers.

    “The tendency for users to asymptote at mediocre performance has serious and enduring implications for the productivity of millions of office workers.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Premisecitation

    Both production and assimilation biases lead users to continue with known methods of interaction, causing a tendency to miss opportunities for improvement.

    “Both biases lead users to continue with known methods of interaction, causing an associated tendency to miss opportunities for improvement.”
    Quote in the paperSubstantial claim0 of 1 sources checked
    • cites Carroll and Rossen 1987

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

  • Probably not a substantial claim: may not pass S4 (based).

    Premisenone given

    The problem of users failing to achieve expertise has been shown in many studies across a wide range of interactive tasks and contexts.

    “The problem of users failing to achieve expertise has been shown in many studies across a wide range of interactive tasks and contexts.”
    Quote in the paperNot a substantial claim
  • The quote only partly states this claim.

    Interpretationreasoning

    Productivity losses from inefficient command selection are multiplied across many commands, applications, days, and years, leading to substantial total productivity loss.

    “Although the productivity loss associated with each command selection is relatively small, these losses are multiplied across dozens of selections of each command per day”
    Quote in the paperSubstantial claim
  • Classified as probably not a substantial claim.

    Premisecitation

    Skills are developed through cognitive, associative, and autonomous phases.

    “It describes how skills are developed through cognitive, associative, and autonomous phases”
    Quote in the paperSubstantial claim0 of 1 sources checked
    • cites Fitts and Posner 1967

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisenone given

    During the cognitive phase, initial conceptions of the activity are formed, predominantly learning what activities are to be done.

    “During the cognitive phase, initial conceptions of the activity are formed, predominantly learning what activities are to be done.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation

    Fitts and Posner's three-stage model of psychomotor skill acquisition is particularly influential.

    “with Fitts and Posner's [1967] three-stage model being particularly influential”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Fitts and Posner 1967

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

  • Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based).

    Premisenone given

    The associative phase is enduring, with many tasks requiring years or decades of practice before transitioning to automaticity.

    “The associative phase is enduring, with many tasks requiring years or decades of practice before transitioning from the associative phase to automaticity.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisenone given

    The autonomous phase represents the ultimate level of psychomotor learning, attained after prolonged and extensive practice.

    “The autonomous phase represents the ultimate level of psychomotor learning, one that is attained after prolonged and extensive practice.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Interpretationreasoning

    The typical design of GUIs allows users to quickly learn suboptimal methods for task completion, which users tend to maintain for months, years, and decades.

    “The typical design of GUIs, therefore, allows users to quickly learn suboptimal methods for task completion (e.g., by pointing and clicking), which users tend to maintain for months, years, and decades of subsequent interaction.”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Interpretationreasoning

    Standard GUI mechanisms such as visual search and direct manipulation are easy to understand but force experienced users into relatively slow and laborious action.

    “standard GUI mechanisms such as visual search and direct manipulation, which are easy to understand but that force the experienced user into relatively slow and laborious action”
    Quote in the paperSubstantial claim
  • Probably not a substantial claim: may not pass S2 (checkable), S3 (load-bearing). May combine two claims.

    Premisecitation

    Human memory is the repository for human experiences and understanding, so anything that has been learned is encoded in some form of memory.

    “human memory is the repository for human experiences and understanding, so anything that has been learned is encoded in some form of memory”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Schmidt and Lee 2011

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

  • May combine two claims.

    Premisecitation

    Controlled interaction at the cognitive phase is slow, attention-demanding, serial, and strongly volitional.

    “Schneider and Shiffrin [1977] identified the following characteristics of controlled interaction: (1) It is slow; (2) it is attention-demanding, in that other similar tasks interfere with its execution; (3) it is serial in nature; and (4) it is strongly volitional, in that the activities can be avoided or immediately stopped.”
    Quote in the paperSubstantial claim0 of 1 sources checked
    • cites Schneider and Shiffrin 1977

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

  • Classified as probably not a substantial claim.

    Premisenone given

    Recently, there has been an increase in literature explicitly addressing how interfaces can be designed to promote and assist expert levels of performance.

    “Recently, however, there has been an increase in literature explicitly addressing the problem of how interfaces can be designed to promote and assist expert levels of performance.”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Premisecitation

    Autonomous actions are fast, not attention demanding, parallel, and not volitional.

    “Schneider and Shiffrin [1977] identified the following characteristics of autonomous actions: (1) They are fast; (2) they are not attention demanding, in that other verbal or cognitive operations do not interfere with their execution; (3) they are parallel in nature, with various operations possibly occurring together; and (4) they are not volitional, in that processing is often unavoidable.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Schneider and Shiffrin 1977

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

  • Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based).

    Premisenone given

    Task performance improvements are largest during the cognitive phase.

    “Despite this variance, task performance improvements are largest during the cognitive phase.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Premisenone given

    Once a suboptimal strategy has been learned and reproduced several times, it is likely to become habit, further reducing the likelihood of changing to faster alternative methods.

    “once a suboptimal strategy has been learned and reproduced several times, it is likely to become habit, further reducing the likelihood of changing to faster alternative methods”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Interpretationreasoning

    The need for different movements to a target dependent on varied initial cursor location may impair the ultimate performance ceiling and ability to attain autonomous levels of performance with mouse and cursor interaction.

    “the need for different movements to a target dependent on varied initial cursor location may impair the ultimate performance ceiling and ability to attain autonomous levels of performance with mouse and cursor interaction”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation

    The guidance hypothesis suggests that augmented feedback that improves early performance through guidance may impair retention of the performed skills once the guidance is removed.

    “the guidance hypothesis [Schmidt 1991] suggests that augmented feedback that improves early performance through guidance may impair retention of the performed skills once the guidance is removed.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Schmidt 1991 source
  • May combine two claims.

    Interpretationcitation

    The efficacy of certain training interventions interacts with individual and environmental factors, complicating determination of which training methods are most effective for different people in different settings.

    “The efficacy of certain training interventions has been demonstrated to interact with individual and environmental factors, which greatly complicates the process of determining which training methods are likely to be most effective for different people in different settings.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Premisecitation

    In an experiment on learning letter locations, the frost brushing condition was rated as more engaging and less frustrating than the normal interface; in an experiment on learning gesture shapes for entire words, it was less engaging and more frustrating than normal.

    “In an experiment on learning letter locations, the frost brushing condition was rated as more engaging and less frustrating than the normal interface; but an experiment involving the harder task of learning gesture shapes for entire words showed the frost brushing interface to be less engaging and more frustrating than normal.”
    Quote in the paperSubstantial claim0 of 1 sources checked
    • cites Cockburn et al. [2007]

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

  • May combine two claims.

    Premisecitation

    Personality differences such as introversion and extroversion result in different baselines of arousal, so the same stimulus effect may increase performance for an extrovert while decreasing performance for an introvert.

    “there is evidence that personality differences such as introversion and extroversion result in different baselines of arousal, and, consequently, the same stimulus effect may increase performance for an extrovert while decreasing performance for an introvert [Revelle et al. 1980;Bullock and Gilliland 1993].”
    Quote in the paperNot a substantial claim0 of 2 sources checked
    • cites Revelle et al. 1980 source
    • cites Bullock and Gilliland 1993 source
  • May combine two claims.

    Interpretationreasoning

    Making novice functionality visible often suppresses expert functions, reducing the likelihood that they will be discovered.

    “The notion that controls should be visible to be learned is also well expressed in most usability guidelines, but the corollary of making novice functionality visible is that expert functions are often suppressed, thus reducing the likelihood that they will be discovered.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Premisecitation

    Two key strategies for improving motivation are to make the task seem important and to use goal setting.

    “Two key strategies for improving motivation are to make the task seem important and to use goal setting [Schmidt and Lee 2011].”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Schmidt and Lee 2011

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

  • Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based). May combine two claims.

    Premisenone given

    Each method has associated performance characteristics, including a performance floor and ceiling, and each user will have attained performance ability somewhere between the floor and ceiling.

    “Each method has associated performance characteristics, including a performance floor and ceiling, and each user will have attained performance ability somewhere between the floor and ceiling.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Premisecitation

    Deliberate practice facilitates improving skills already attained and extending the reach and range of skills, and is further assisted through expert mediation such as skilled coaching.

    “Deliberate practice facilitates two kinds of learning: improving skills already attained and extending the reach and range of skills; it is further assisted through expert mediation, such as skilled coaching.”
    Quote in the paperSubstantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation

    Appropriate interface controls should be 'ready to hand': controls and feedback should be available for use but not obstruct task completion.

    “A related concept is that appropriate interface controls should be”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Karat et al. 2000 source
  • Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based).

    Premisenone given

    Positive motivation to learn and improve is a key determinant in whether a learner chooses to participate in practice.

    “Positive motivation to learn and improve is a key determinant in whether a learner chooses to participate in practice.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Premisecitation

    Low-skill golfers benefited more from instruction focused on internal motor aspects of actions than from instruction focused on external effects on the ball; highly skilled golfers benefited more from externally focused instructions.

    “Perkins-Ceccato et al. [2003] showed that low-skill golfers benefited more from instruction that focused attention on internal motor aspects of actions when compared to instructions that focused on external effects on the ball; conversely, highly skilled golfers benefited more from externally focused instructions.”
    Quote in the paperSubstantial claim0 of 1 sources checked
    • cites Perkins-Ceccato et al. [2003] source
  • May combine two claims.

    Premisecitation

    When an interface is spatially stable, users can make rapid decisions about the location of target items, but when stability is compromised users must resort to comparatively slow visual search.

    “When an interface is spatially stable, users can make rapid decisions about the location of target items, but when stability is compromised users must resort to comparatively slow visual search [Cockburn et al. 2007;Cockburn and Gutwin 2009].”
    Quote in the paperNot a substantial claim0 of 2 sources checked
    • cites Cockburn et al. 2007

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

    • cites Cockburn and Gutwin 2009 source
  • May combine two claims.

    Premisecitation

    Without prior experience, novice users are heavily reliant on visual search, and visual search time is a linear function of the number of candidate items that must be considered.

    “Without prior experience to draw on, novice users are heavily reliant on visual search, and the time for visual search is a linear function of the number of candidate items that must be considered [Hornof and Kieras 1997;Wolfe 1998;Cockburn et al. 2007;Cockburn and Gutwin 2009].”
    Quote in the paperSubstantial claim0 of 3 sources checked
    • cites Hornof and Kieras 1997 source
    • cites Wolfe 1998 source
    • cites Cockburn et al. 2007

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation

    Many computer games achieve availability without obstruction through 'calm messaging' using nonabrupt and nonintrusive means such as transient text, animation, and audio.

    “Dyck et al. [2003] observe that many computer games achieve the dual objectives of availability without obstruction through”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Dyck et al. [2003] source
  • May combine two claims.

    Premisecitation

    Rest periods between training sessions improve learning, with longer rest periods being more beneficial than short ones.

    “rest periods between sessions improve learning, with longer rest periods being more beneficial than short ones”
    Quote in the paperNot a substantial claim0 of 2 sources checked
    • cites Bourne and Archer 1956 source
    • cites Baddeley and Longman 1978 source
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation

    Performance generally follows an inverted U shape with level of arousal, deteriorating when a person is under- or overexcited.

    “although it is known that performance generally follows an inverted U shape with level of arousal (i.e., performance deteriorates when a person is under-or overexcited)”
    Quote in the paperNot a substantial claim0 of 2 sources checked
    • cites Revelle et al. 1980 source
    • cites Bullock and Gilliland 1993 source
  • May combine two claims.

    Interpretationown data

    There is a fine balance between engaging and frustrating users, and training interfaces should be neither too mundane nor too difficult.

    “The results suggest that there is a fine balance between engaging and frustrating users and that training interfaces should be neither too mundane nor too difficult.”
    Quote in the paperSubstantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Interpretationreasoning

    Automaticity allows the performer to think about higher level tasks during execution of the skill.

    “Importantly, automaticity allows the performer to think about higher level tasks during the execution of the skill.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based).

    Premisenone given

    Highly skilled task performance is characterized by automaticity, where physical actions are executed quickly, efficiently, and with minimal conscious deliberation.

    “Highly skilled task performance is characterized by automaticity, where the physical actions required for the task are executed quickly, efficiently, and with minimal conscious deliberation.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Premisecitation

    Elite performance requires deliberate practice to counteract automaticity during practice, with performers using mental representations to maintain the cognitive and associative phases.

    “he contends that elite performance require deliberate practice to counteract automaticity during practice, with performers using various forms of mental representations to maintain the cognitive and associative phases [Ericsson 2004]”
    Quote in the paperSubstantial claim0 of 1 sources checked
    • cites Ericsson 2004 source
  • Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based).

    Interpretationnone given

    Some factors assisting performance at one stage can impair performance at another.

    “including the observation that some factors assisting performance at one stage can impair performance at another.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Premisecitation

    For learning complex elbow movements, mechanical limb control resulted in precise movements during training but inaccurate reproduction once the controls were released.

    “Armstrong [1970] showed that for learning complex elbow movements, mechanical limb control resulted in precise movements during training but inaccurate reproduction once the controls were released.”
    Quote in the paperSubstantial claim0 of 1 sources checked
    • cites Armstrong 1970 source
  • Classified as probably not a substantial claim.

    Premisecitation

    The strength of a memory is a positive function of the depth to which the stimulus is analyzed.

    “They postulated that the strength of a memory is a positive function of the depth to which the stimulus is analyzed.”
    Quote in the paperSubstantial claim0 of 1 sources checked
    • cites Craik and Lockhart 1972 source
  • Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based).

    Premisenone given

    Several factors influence the rate at which performance increases after initial familiarization, including effort required during training and use of guidance to assist performance.

    “Several factors influence the rate at which performance increases after initial familiarization, including the effort required during training and the use of guidance to assist performance.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Interpretationreasoning

    Presenting different interfaces to novice and expert users risks confusing users when making a transition to the more advanced UI, introducing a performance dip.

    “However, by presenting different interfaces to novice and expert users, there are risks of confusing users when making a transition to the more advanced UI (introducing a”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Premisecitation

    The frost brushing condition improved users' memory of letter locations and of gesture shapes better compared to the traditional keyboard display.

    “brushing condition improved users' memory of letter locations and of gesture shapes better compared to the traditional keyboard display (memory for gesture shapes was measured by asking users to create word gestures on a blank keyboard, with gesture quality reported by a recognition engine score function).”
    Quote in the paperSubstantial claim0 of 1 sources checked
    • cites Cockburn et al. [2007]

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Premisecitation

    Gamification is typically used to increase the user's motivation to engage in an activity and to improve his or her performance at it, although other benefits such as increased collaboration and creative leadership may also occur.

    “Typically, gamification is used to increase the user's motivation to engage in an activity and to improve his or her performance at it, although other benefits such as increased collaboration and creative leadership may also occur [Reeves and Read 2009].”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Reeves and Read 2009

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation

    Users could locate unfamiliar commands in an interface much faster when using ShowMeHow.

    “An initial user study showed that users could locate unfamiliar commands in an interface much faster when using ShowMeHow”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Ramesh et al. 2011 source
  • May combine two claims.

    Premisecitation

    Users found gamified calibration procedures to be significantly more enjoyable without compromising the calibration outcomes.

    “their lab studies showed that users found gamified calibration procedures to be significantly more enjoyable without compromising the calibration outcomes.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Flatla et al. 2011 source
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation

    Marking menus were designed to adhere to design guidelines including revelation, guidance, and rehearsal.

    “Marking menus were designed to adhere to a set of design guidelines, including revelation, guidance, and rehearsal [Kurtenbach et al. 1994], as follows:”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Kurtenbach et al. 1994

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

  • May combine two claims.

    Premisecitation

    Users are biased toward procedures that are well-practiced and generic and composed of interactive components that are fast and incremental.

    “Their findings showed that users are biased toward procedures that are (1) well-practiced and generic and (2) composed of interactive components that are fast and incremental.”
    Quote in the paperSubstantial claim0 of 1 sources checked
    • cites Fu and Gray [2004]

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Interpretationreasoning

    The methods used for explicit task instruction could also be used to extend the user's vocabulary.

    “Similarly, the methods used for explicit task instruction (described in Section 7) could also be used to extend the user's vocabulary.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S2 (checkable). May combine two claims.

    Interpretationreasoning

    These results have important implications for the design of training systems because designers must understand whether their goal is to assist users in rapidly attaining high performance or whether learned outcomes and transfer are primary objectives.

    “These results have important implications for the design of training systems because designers must understand whether their goal is to assist users in rapidly attaining high performance or whether learned outcomes and the ability to transfer the learning to related interactions are primary objectives.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Interpretationreasoning

    The conceptual deterrents and barriers to vocabulary extension are similar to those described for intermodal improvement: users need to be aware of commands before using them, and they need to understand the magnitude of improvement that they will enable.

    “The conceptual deterrents and barriers to vocabulary extension are similar to those described for intermodal improvement: Users need to be aware of commands before using them, and they need to understand the magnitude of improvement that they will enable.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Premisecitation

    Keyboard shortcuts offer a higher performance ceiling than mouse selection, yet some participants did not use known hotkeys because they believed toolbar selections were faster.

    “Similarly, studies have consistently shown that keyboard shortcuts offer a higher performance ceiling than does mouse selection [Odell et al. 2004;Lane et al. 2005;Malacria et al. 2013], yet Tak et al. [2013] found that some participants did not use known hotkeys because they believed toolbar selections were faster.”
    Quote in the paperNot a substantial claim0 of 3 sources checked
    • cites Odell et al. 2004
    • cites Lane et al. 2005 source
    • cites Malacria et al. 2013

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

  • May combine two claims.

    Premisecitation

    OctoPocus was evaluated in comparison to traditional Help menus and marking menus and showed positive results.

    “OctoPocus was evaluated in comparison to traditional Help menus and marking menus and showed positive results.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Bau and Mackay 2008 source
  • May combine two claims.

    Premisecitation

    Grossman et al.'s results showed that forced use and audio feedback worked well, with 72.8% and 66.6% respectively of experimental selections completed with hotkeys, and no adverse subjective response.

    “Their results showed that forced use and audio feedback worked well, with 72.8% and 66.6% respectively of experimental selections completed with hotkeys, and no adverse subjective response.”
    Quote in the paperSubstantial claim0 of 1 sources checked
    • cites Grossman et al. [2007] source
  • May combine two claims.

    Interpretationcitation

    If deception is obvious, users will distrust the system and stop using it.

    “Adar et al. [2013] provide a general discussion of the role of”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Adar et al. [2013] source
  • May combine two claims.

    Premisecitation

    Task completion rates were higher and frustration lower when using FollowUs.

    “Task completion rates were higher and frustration lower when using FollowUs.”
    Quote in the paperSubstantial claim0 of 1 sources checked
    • cites Lafreniere et al. 2013 source
  • May combine two claims.

    Premisecitation

    Several studies have demonstrated that predicted and actual experience differ and that users can mistrust their abilities, leading to underestimates of potential benefit with the new modality.

    “Importantly, though, several studies have demonstrated that predicted and actual experience differ (e.g., Czerwinski et al. [2001]) and that users can mistrust their abilities, leading to underestimates of potential benefit with the new modality.”
    Quote in the paperSubstantial claim0 of 1 sources checked
    • cites Czerwinski et al. [2001]

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

  • Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based). May combine two claims.

    Interpretationnone given

    Although experiments showed forced use and audio feedback to be successful in increasing hotkey use, forced use of hotkeys and audio feedback may be unacceptable to users outside lab settings.

    “Although experiments showed these methods to be successful in increasing hotkey use, forced use of hotkeys and audio feedback may be unacceptable to users outside lab settings.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Premisecitation

    Although empirical results for CLI benefits over GUIs have been mixed, it is widely accepted that CLIs enable higher efficiency, and power users are strong advocates.

    “Although empirical results for CLI benefits over GUIs have been mixed (e.g., Whiteside et al. [1985]), it is widely accepted that CLIs enable higher efficiency, and power users are strong advocates (e.g., Barrett et al. [2004]).”
    Quote in the paperNot a substantial claim0 of 2 sources checked
    • cites Whiteside et al. [1985]

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

    • cites Barrett et al. [2004] source
  • May combine two claims.

    Premisecitation

    The conditions that maximized performance during training (static- and dynamic-tracing conditions) performed worst in retention tests and vice versa.

    “Their results confirmed the guidance hypothesis: The conditions that maximized performance during training (static-and dynamic-tracing conditions) performed the worst in the retention tests and vice versa.”
    Quote in the paperSubstantial claim0 of 1 sources checked
    • cites Anderson and Bischof [2013] source
  • May combine two claims.

    Interpretationcitation

    Navigating through interface partitions takes time, and there are potential performance benefits in flattening the command structure to make more items accessible at once.

    “Navigating through these partitions takes time, and, consequently, there are potential performance benefits in flattening the command structure to make more items accessible at once [Scarr et al. 2012].”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Scarr et al. 2012 source
  • May combine two claims.

    Interpretationcitation

    The existence of this performance dip is likely to deter users from switching to new methods for interaction, even though doing so may offer long-term productivity gains.

    “The existence of this performance dip is likely to deter users from switching to new methods for interaction, even though doing so may offer long-term productivity gains-the prospect of encountering a short-term productivity loss may cause users to postpone switching to the new method, possibly forever.”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Premisecitation

    Users' interactive behavior is often repetitive, and interfaces can aid efficiency by explicitly supporting command repetition.

    “Users' interactive behavior is often repetitive (e.g., command use [Greenberg and Witten 1993] and web navigation [Tauscher and Greenberg 1997]), and interfaces can aid efficiency by explicitly supporting command repetition.”
    Quote in the paperNot a substantial claim0 of 2 sources checked
    • cites Greenberg and Witten 1993 source
    • cites Tauscher and Greenberg 1997 source
  • The quote only partly states this claim.

    Premisecitation

    Tan et al.'s InfoCockpit results showed a 56% increase in object memory compared to standard desktop systems when items were displayed on multiple monitors wrapping around the user with spatial audio.

    “Spatial audio was included to assist memorization of place, and their results showed a 56% increase in object memory compared to standard desktop systems.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Tan et al. [2001] source
  • May combine two claims.

    Interpretationcitation

    These results reflect those generated by Cockburn et al.'s frost-brushing experiments, in which the frost-brushing condition slowed user performance during training but resulted in better results during subsequent testing conditions.

    “These results reflect those generated by Cockburn et al.'s [2007] frost-brushing experiments, in which the frost-brushing condition slowed user performance during training but resulted in better results during subsequent testing conditions.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Cockburn et al. [2007]

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

  • May combine two claims.

    Premiseown data

    Evaluation results of the CommunityCommands system suggest that an item-based collaborative filtering algorithm performs best, generating the highest number of useful recommendations, as well as the fewest number of unuseful ones.

    “Evaluation results of their Com-munityCommands system suggest that an item-based collaborative filtering algorithm performs best, generating the highest number of useful recommendations, as well as the fewest number of unuseful ones.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation

    Many factors influence skill acquisition.

    “Human factors literature, summarized in Section 2, shows that many factors influence skill acquisition.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Premisecitation

    Open source systems permit modifications that enable the longitudinal analysis of expert use, but for productivity applications, the user base is often smaller than for major commercial systems.

    “Open source systems permit modifications that enable the longitudinal analysis of expert use (e.g., Murphy et al.'s [2006] analysis of Java developers using the Eclipse IDE), but, for productivity applications, the user base is often smaller than for major commercial systems.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Murphy et al. 2006 source
  • Probably not a substantial claim: may not pass S2 (checkable), S4 (based).

    Premisenone given

    Interaction with computing systems introduces new and important factors that have not been extensively studied.

    “Interaction with computing systems introduces new and important factors that have not been extensively studied.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Premisecitation

    Focus-shifts cause only a brief attention switch and cause less disruption.

    “Focus-shifts cause only a brief attention switch and cause less disruption.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Bødker 1995

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

  • Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based). May combine two claims.

    Premisenone given

    These techniques have several limitations, including access to only a subset of controls, reduced system responsiveness, and increased frequency of software crashes, which make them impractical for studies of real use.

    “However, these techniques have several limitations, including access to only a subset of controls, reduced system responsiveness, and increased frequency of software crashes, which make them impractical for studies of real use.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation

    There are two types of task interruption: breakdowns and focus-shifts.

    “Research by Bødker [1995] suggests that there are two types of task interruption: breakdowns and focus-shifts.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Bødker 1995

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

  • Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based).

    Premisenone given

    These APIs typically form part of the accessibility framework that assists development of software for users with special needs.

    “Typically, these APIs form part of the accessibility framework that assists development of software for users with special needs.”
    Quote in the paperNot a substantial claim
  • Classified as probably not a substantial claim.

    Premisereasoning

    Unlike buttons, scrollbars, and other graphical widgets that afford a particular method for activation, gestural interactions need not be conducted with reference to specific graphical entities.

    “Unlike buttons, scrollbars, and other graphical widgets that afford a particular method for activation (clicking, dragging, etc.), gestural interactions need not be conducted with reference to specific graphical entities.”
    Quote in the paperSubstantial claim
  • Probably not a substantial claim: may not pass S2 (checkable), S4 (based).

    Interpretationnone given

    Generation mechanisms should produce recommendations that are both new to the user and useful given his or her current context and task.

    “Generation mechanisms should produce recommendations that are both new to the user and useful given his or her current context and task.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation

    Marking menus were designed to adhere to a set of design guidelines, including revelation, guidance, and rehearsal.

    “Marking menus were designed to adhere to a set of design guidelines, including revelation, guidance, and rehearsal[Kurtenbach et al. 1994], as follows:”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Kurtenbach et al. 1994

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

  • Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based).

    Premisenone given

    Encouraging users to reflect on their performance may assist in reducing the tendency to persistently maintain suboptimal methods.

    “Encouraging users to reflect on their performance may assist in reducing the tendency to persistently maintain suboptimal methods.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S4 (based). May combine two claims.

    Premisenone given

    Current interface guidelines attempt to account for novice learning and expertise by advocating for shortcut facilities, but this strategy is known to fail because few users make the transition to expert methods-instead, users maintain the adequate but inefficient strategies they learned first.

    “Current interface guidelines attempt to account for novice learning and expertise by advocating for shortcut facilities, but this strategy is known to fail because few users make the transition to expert methods-instead, users maintain the adequate but inefficient strategies they learned first.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S2 (checkable).

    Premisecitation

    The novice's motor actions should rehearse the expert's motor actions to assist the development of automaticity and muscle memory.

    “In other words, the novice's motor actions should rehearse the expert's motor actions to assist the development of automaticity and muscle memory.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Kurtenbach et al. 1994

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

  • May combine two claims.

    Premisereasoning

    Accuracy and the cost of errors are often critical to successful interaction, and they can vary substantially between interaction techniques.

    “Most of this review has focused on task performance time, but accuracy and the cost of errors are often critical to successful interaction, and they can vary substantially between interaction techniques.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based).

    Premisenone given

    GUIs have become the primary medium through which office work is conducted.

    “GUIs have become the primary medium through which office work is conducted.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Premisecitation

    Users who knew two methods for entering formulae into a spreadsheet were significantly slower than users who knew only one, and the time cost was attributed to the additional cognition required to plan and decide between methods.

    “For example, Olson and Nilsen [1988] showed that users who knew two methods for entering formulae into a spreadsheet were significantly slower than users who knew only one, and they attributed the time cost to the additional cognition required to plan and decide between methods.”
    Quote in the paperSubstantial claim0 of 1 sources checked
    • cites Olson and Nilsen 1988

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Premisecitation

    Kurtenbach et al.'s marking menu research was conducted in the early 1990s, with a focus on stylusbased input.

    “Kurtenbach et al.'s marking menu research was conducted in the early 1990s, with a focus on stylusbased input.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Kurtenbach 1993

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisereasoning

    Developing systems that can be used in field studies of real work is extremely difficult.

    “However, developing systems that can be used in field studies of real work is extremely difficult.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S2 (checkable), S4 (based). May combine two claims.

    Interpretationnone given

    The presentation of training information should fit within the user's current context and should avoid interruptions that break the flow of work.

    “The presentation of training information should fit within the user's current context and should avoid interruptions that break the flow of work.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based).

    Premisenone given

    Methods for intermodal improvement, such as keyboard accelerators, are already commonly used in state-of-the-art interfaces.

    “Methods for intermodal improvement, such as keyboard accelerators, are already commonly used in state-of-the-art interfaces.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Premisecitation

    In OctoPocus, as the user gestures upward and rightward, guidance for Paste is removed and Cut fades, leaving only the remaining guidance for Copy.

    “Initially (left), three alternative gesture commands are possible, but as the user gestures upward and rightward, guidance for Paste is removed and Cut fades, leaving only the remaining guidance for Copy.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Bau and Mackay 2008 source
  • May combine two claims.

    Premisenone given

    Gamification can increase engagement and performance.

    “gamification can increase engagement and performance”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S4 (based). May combine two claims.

    Premisenone given

    A primary factor contributing to the success of GUIs is the ease with which they can be learned-newcomers can quickly attain sufficient competence to adequately complete their work.

    “A primary factor contributing to their success is the ease with which they can be learnednewcomers can quickly attain sufficient competence to adequately complete their work.”
    Quote in the paperNot a substantial claim
  • Classified as probably not a substantial claim. May combine two claims.

    Premisenone given

    The software that people use for everyday office work is often proprietary, and the lack of access to source code constrains researchers' ability to modify system behavior and monitor its use.

    “The software that people use for everyday office work is often proprietary, and the lack of access to source code constrains researchers' ability to modify system behavior and monitor its use.”
    Quote in the paperSubstantial claim
  • Probably not a substantial claim: may not pass S2 (checkable), S4 (based). May combine two claims.

    Interpretationnone given

    Presentation should be dynamically updated to the user's context, should be continuously available to the user, and should be presented in an ambient manner that allows quick access without interrupting task execution.

    “Presentation should be dynamically updated to the user's context, should be continuously available to the user, and should be presented in an ambient manner that allows quick access without interrupting task execution.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisenone given

    When source code is unavailable, there are often Application Programming Interfaces (APIs) that allow limited control of software systems running on a particular platform.

    “When source code is unavailable, there are often Application Programming Interfaces (APIs) that allow limited control of software systems running on a particular platform.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation

    Patina uses a colored heatmap to recommend commands to users.

    “Patina uses a colored heatmap to recommend commands to users.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Matejka et al. 2013 source
  • May combine two claims.

    Interpretationnone given

    It is common for office workers to continue using substantially similar interfaces for months, years, and decades, so that optimizing designs for initial learnability rather than long-term efficiency can be counterproductive.

    “Although ease of learning is highly desirable, it is common for office workers to continue using substantially similar interfaces for months, years, and decades, so that optimizing designs for initial learnability rather than long-term efficiency can be counterproductive.”
    Quote in the paperNot a substantial claim
  • Classified as probably not a substantial claim. May combine two claims.

    Interpretationnone given

    Two important parts of vocabulary extension are the generation of good recommendations and the presentation of those recommendations in the interface.

    “Two important parts of vocabulary extension are the generation of good recommendations and the presentation of those recommendations in the interface.”
    Quote in the paperSubstantial claim
102 of 102
  • The paper relies on this without support.

    The design of interfaces that facilitate a transition from novice to expert performance is less well understood than the design of interfaces for novices or for experts.

    “Although the design of interfaces for novices or for experts has been well investigated, the design of interfaces that facilitate a transition from novice to expert performance is less well understood.”
  • The paper relies on this without support.

    Until recently, there has been relatively little research into interface methods that can promote and assist the transition to expertise.

    “until recently there has been relatively little research into interface methods that can promote and assist the transition to expertise”
  • The paper relies on this without support.

    There is a lack of clarity on how findings from the skill development literature can be applied in UIs to assist the development of user expertise.

    “there is a lack of clarity on how the findings can be applied in UIs to assist the development of user expertise”
  • The paper relies on this without support.

    Recent interface releases have tended to reduce the visibility of expert methods for interaction.

    “recent interface releases have tended to reduce the visibility of expert methods for interaction”
  • The paper relies on this without support.

    The extra effort required to discover a hotkey may deter users from doing so.

    “the extra effort required to discover the hotkey (e.g., a web search) may deter users from doing so”
  • The paper relies on this without support.

    The recent surge in popularity of finger-based gestural interaction on mobile devices has renewed interest in advanced techniques for easily learned and high-performance gestural interaction techniques.

    “The recent surge in popularity of finger-based gestural interaction on mobile devices has renewed interest in advanced techniques for easily learned and high-performance gestural interaction techniques.”
6 of 6

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

Each contradiction between two passages listed here was confirmed by an independent check.

  • Alternative methods are assigned to the wrong figure

    Minor

    The text points to Figure 2(b) for alternative methods of accessing a function, but it elsewhere identifies Figure 1(b) as showing those methods. The Figure 2 caption describes performance over time for a single method.

  • URL type-ahead is cross-referenced to the wrong section

    Minor

    The discussion directs readers to Section 4.2 for URL type-ahead, but the description of that feature appears under Section 4.3.3.

2 of 2

Cites

Flagged first, then by citations

Research works printed but not linked: 4

  1. M. Czerwinski , E. Horvitz , and E. Cuttrell . 2001. Subjective duration assessment: An impicit probe for software usability . In Proceedings of IHM-HCI. 167--170 . M. Czerwinski, E. Horvitz, and E. Cuttrell. 2001. Subjective duration assessment: An impicit probe for software usability. In Proceedings of IHM-HCI. 167--170.
  2. 10.1145/800045.801571 · DOI
  3. A. Rothstein and R. Arnold . 1976 . Bridging the gap: Application of research on videotape feedback and bowling . Motor Skills: Theory into Practice 1 , 35 -- 62 . A. Rothstein and R. Arnold. 1976. Bridging the gap: Application of research on videotape feedback and bowling. Motor Skills: Theory into Practice 1, 35--62.
  4. H. Simon . 1959 . Theories of decision-making in economics and behavioral science . The American Economic Review 49 , 3, 252 -- 283 . H. Simon. 1959. Theories of decision-making in economics and behavioral science. The American Economic Review 49, 3, 252--283.

Cited by

Sorted by citations

Authors
Cockburn, A., Gutwin, C., Scarr, J., & Malacria, S.
Affiliations
  • University of Canterbury (NZ)
  • University of Saskatchewan (CA)
Venue
ACM Computing Surveys
Published
2014-11-12
Volume
47
Issue
2
Pages
1-36
ISSN
  • 0360-0300 (ISSN-L)
  • 1557-7341
OpenAlex
W1986841213
Cited by
193
References
164
Citations by year
2026: 10 · 2025: 59 · 2024: 10 · 2023: 8 · 2022: 16 · 2021: 17 · 2020: 11 · 2019: 18 · 2018: 15 · 2017: 13 · 2016: 12 · 2015: 4
FWCI
18.70
Type
journal article
Language
en
Open access
Locations
  • ACM Computing Surveys (publishedVersion)
  • HAL (submittedVersion, other-oa)
Funders
Royal Society of New Zealand (10-UOC-020)
Topics
  • Physical Sciences › Computer Science › Human-Computer Interaction › Usability and User Interface Design
  • Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Data Visualization and Analytics
  • Physical Sciences › Computer Science › Human-Computer Interaction › Interactive and Immersive Displays
Keywords
novice to expert transition, user interface design, skill acquisition, expertise development, interface performance, human factors, vocabulary enrichment, task mapping

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Claims read by deepseek-v4.1-flash under definition version 3 (extract-v3) on 2026-10-10.

Classified by jev-1.13-20260917 (gold-guideline-v0.2) on 2026-10-10.

Cited sources are checked by gpt-6-sol.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review