Cited by 948Human-Automation Interaction and SafetyErgonomics and Human FactorsUsability and User Interface Design

State of science: mental workload in ergonomics

Open access
Young, Mark S., Brookhuis, Karel A., Wickens, Christopher D., Hancock, Peter A.·2015·Ergonomics

Abstract

Mental workload (MWL) is one of the most widely used concepts in ergonomics and human factors and represents a topic of increasing importance. Since modern technology in many working environments imposes ever more cognitive demands upon operators while physical demands diminish, understanding how MWL impinges on performance is increasingly critical. Yet, MWL is also one of the most nebulous concepts, with numerous definitions and dimensions associated with it. Moreover, MWL research has had a tendency to focus on complex, often safety-critical systems (e.g. transport, process control). Here we provide a general overview of the current state of affairs regarding the understanding, measurement and application of MWL in the design of complex systems over the last three decades. We conclude by discussing contemporary challenges for applied research, such as the interaction between cognitive workload and physical workload, and the quantification of workload 'redlines' which specify when operators are approaching or exceeding their performance tolerances.

AI snapshot

Written from the paper’s full text.

TL;DR

This state-of-science review traces mental workload (MWL) research in ergonomics from definition and measurement to application, arguing that MWL remains a multidimensional and still-nebulous construct. It highlights transport as the dominant applied domain and identifies neuroergonomics and the quantification of workload “redlines” as key future challenges.

Key findings

  • Ergo-Abs searches show MWL references rising from 58 hits in the 1980s to 140 in the 1990s and 191 in the 2000s; the 2000s decade-on-decade increase was 36% for “mental workload” versus 17% for “physical workload” and “workload.”
  • Applied MWL publications increased as a proportion of the field: 26% in the 1980s, 39% in the 1990s, and 46% in the 2000s; transport dominated, especially driving (40 total papers, including 28 in the 2000s), aviation (19), ATC (17), and rail (12).
  • Both overload and underload can degrade performance, with an optimum range of MWL; measurement typically uses primary/secondary task performance, subjective reports (e.g. NASA-TLX, SWAT, RSME), and physiological metrics (e.g. heart rate, heart rate variability, EEG, facial muscle activity, NIRS).
  • The paper reports approximate redlines such as working memory at roughly seven chunks, relational complexity at roughly three interacting relations, tracking bandwidth at roughly one cycle per second, and timeline analysis TR/TA, with Parks and Boucek suggesting errors begin around the 80% level rather than 100%.

Methods

  • Narrative state-of-science review, not an empirical study; no primary data collection or participants are reported.
  • Uses decade-by-decade searches of the Ergo-Abs database for “mental workload,” “physical workload,” and “workload,” plus a title-field search of “mental workload” categorized into broad application areas.
  • Synthesizes conceptual, measurement, and application literature across the 1980s, 1990s, and 2000s, with discussion of current and future challenges.

Limitations

  • Stated: the applied review “is not intended to be an exhaustive review”; application categorization was selective and based on the most obvious theme from title and abstract; database coverage grew over time, partly inflating later counts.
  • Stated: MWL remains “just as nebulous a concept today as it did three decades ago”; research has failed to provide absolute limits on human performance, and underload lacks a widely accepted theory, making its redline especially elusive.
  • Evident from the text: the review is narrative and selective rather than systematic, and the authors note that dissociation among workload measures complicates interpretation and that absolute workload prediction remains difficult.

Model-written summary. Check it against the paper before relying on it.

Integrity signals

Registry

Crossref · 10.1080/00140139.2014.956151

Cites

406 of 406 references verified0 citation errors · 0 not checkable

Statistics

Nothing to recompute.

Claims the paper makes

0 of 95 cited sources checked · 0 supported · 0 flagged

  • Findingown data
    § 1. Context · p. 2

    References to 'mental workload' in the Ergo-Abs database increased more than threefold since the 1980s.

    “A search of Ergo-Abs (the Ergonomics Abstracts online database, which covers international books, journals and conference proceedings across a variety of ergonomics-related fields) over the last three decades (which reflects the vast majority of sources indexed in the database) shows that references to 'mental workload' have increased more than threefold since the 1980s (see Table 1).”
    Quote in the paperNot a substantial claim
    • Rests on an assumption: The Ergo-Abs database search results are representative of the broader MWL literature.
  • Findingown data
    § 4. Applications · p. 6

    In thematic trends within MWL applications, there was a peak in software engineering and/or CAD in the 1980s.

    “In terms of thematic trends within the MWL applications themselves, it is interesting to note the peak in software engineering and/or computer-aided design (CAD) in the 1980s, but the clear dominance of transport-related applications (e.g. air traffic control, aviation, driving and rail) from the 1990s onwards.”
    Quote in the paperNot a substantial claim
    • Rests on an assumption: The categorisation of publications into application areas based on title and abstract is valid for identifying thematic trends.
  • Findingown data
    § 4. Applications · p. 6

    Transport-related applications (e.g. air traffic control, aviation, driving and rail) clearly dominated MWL applications from the 1990s onwards.

    “In terms of thematic trends within the MWL applications themselves, it is interesting to note the peak in software engineering and/or computer-aided design (CAD) in the 1980s, but the clear dominance of transport-related applications (e.g. air traffic control, aviation, driving and rail) from the 1990s onwards.”
    Quote in the paperNot a substantial claim
    • Rests on an assumption: The categorisation of publications into application areas based on title and abstract is valid for identifying thematic trends.
  • Findingown data
    § 4. Applications · p. 6

    Driving stands out as a particular focus area especially in the last decade.

    “Of these, driving stands out as a particular focus area especially in the last decade, although we should also note the rapid growth of MWL research in the rail industry, reflecting the resurgence in ergonomics and human factors interest within this domain (e.g. Wilson and Norris 2005).”
    Quote in the paperNot a substantial claim
    • Rests on an assumption: The categorisation of publications into application areas based on title and abstract is valid for identifying thematic trends.
  • Findingreasoning
    § 4. Applications · p. 6

    When taken with Table 1, the 87 application publications represent some 46% of the total publications in the field for that decade.

    “When taken in conjunction with the pattern of results observed in Table 1, this represents some 46% of the total publications in the field for that decade.”
    Quote in the paperSubstantial claim
  • Classified as probably not a substantial claim. 68
  • May combine two claims. 48
  • Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based). May combine two claims.

    Findingnone given
    § 1. Context · p. 2

    Research in the 1990s was also concerned with the proliferation of automation, and a significant body of work was directed at advanced physiological metrics of workload.

    “Research in the 1990s was also concerned with the proliferation of automation, and a significant body of work was directed at the emergence of more advanced physiological metrics of workload.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Findingown data
    § 1. Context · p. 2

    The relative decade-on-decade increase in hits for MWL in the 2000s was 36%, against 17% for 'physical workload' and 'workload'.

    “Nevertheless, the relative decade-on-decade increase in hits for MWL in the 2000s suggests a more recent prominence over the comparator terms - 36% for 'mental workload' against 17% for 'physical workload' and 'workload'.”
    Quote in the paperNot a substantial claim
    • Rests on an assumption: The relative increase in MWL hits over comparator terms indicates a genuine increase in prominence rather than only database coverage.
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Findingown data
    § 1. Context · p. 2

    The 1990s saw a shift towards theoretical developments and modelling efforts.

    “A cursory review of these search results indicates that the focus in the 1980s was much more on the measurement of MWL, while the 1990s saw a shift towards theoretical developments and modelling efforts.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Findingown data
    § 1. Context · p. 2

    The focus in the 1980s was much more on the measurement of MWL.

    “A cursory review of these search results indicates that the focus in the 1980s was much more on the measurement of MWL, while the 1990s saw a shift towards theoretical developments and modelling efforts.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Findingown data
    § 1. Context · p. 2

    The first decade of the twenty-first century has seen more examples of MWL applications coming to the fore.

    “Finally, the first decade of the twenty-first century has seen more examples of MWL applications coming to the fore.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Findingcitation
    § 4. Applications · p. 6

    There has been rapid growth of MWL research in the rail industry.

    “Of these, driving stands out as a particular focus area especially in the last decade, although we should also note the rapid growth of MWL research in the rail industry, reflecting the resurgence in ergonomics and human factors interest within this domain (e.g. Wilson and Norris 2005).”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Wilson and Norris 2005

      Not checked in the free run.

    • Rests on an assumption: The categorisation of publications into application areas based on title and abstract is valid for identifying thematic trends.
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Findingcitation
    § 4.4 Summary and observations · p. 9

    The impacts of skill (or experience) and age on MWL are an emerging theme.

    “Another theme emerging from this review surrounds the impacts of skill (or experience) and age on MWL, which can, more generally, be related to the still unsolved puzzle of individual differences (see Damos 1988; Szalma 2009).”
    Quote in the paperNot a substantial claim0 of 2 sources checked
    • cites Damos 1988

      Not checked in the free run.

    • cites Szalma 2009

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based).

    Findingnone given
    § 4.4 Summary and observations · p. 8

    The predominance of transport applications among MWL research over the last two decades cannot be ignored.

    “The predominance of transport applications among MWL research over the last two decades cannot be ignored.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Findingnone given
    § 4.1 1980s · p. 7

    The other key theme in the 1980s was adaptive interfaces.

    “The other key theme in the 1980s was on adaptive interfaces.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Findingreasoning
    § 5.1 Defining underload and overload - the elusive redline · p. 11

    The theoretical underload redline does exist, but identifying or quantifying it remains elusive.

    “The theoretical underload redline does exist and is illustrated on Figure 2, but identifying or quantifying it remains elusive.”
    Quote in the paperSubstantial claim
  • Probably not a substantial claim: may not pass S2 (checkable).

    Findingnone given
    § 6. Summary and conclusions · p. 12

    MWL looks to be just as nebulous a concept today as it did three decades ago.

    “We would certainly not wish to claim that progress in measurement or definition has ended; MWL looks to be just as nebulous a concept today as it did three decades ago, and researchers continue to debate over definitions to this day.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Findingnone given
    § 5.1 Defining underload and overload - the elusive redline · p. 11

    Underload is just as bad for performance as overload, and leads to the classic inverted-U curve.

    “But we know this is not the case; underload is just as bad for performance as overload, and leads to the classic inverted-U curve as illustrated in the figures.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Findingnone given
    § 6. Summary and conclusions · p. 12

    The field has developed from tackling the thorny issue of defining the concept, through the development of metrics of MWL, to the more recent focus on applied research.

    “The field has developed from tackling the thorny issue of defining the concept, through the development of metrics of MWL, to the more recent focus on applied research, which, in turn, reflects the technological and societal concerns of our times.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based). May combine two claims.

    Findingnone given
    § 6. Summary and conclusions · p. 12

    Technology progresses in areas such as transportation, which has already dominated the MWL scene in recent years.

    “This is particularly the case as technology progresses in areas such as transportation, which has already dominated the MWL scene in recent years.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S2 (checkable), S3 (load-bearing). May combine two claims.

    Findingreasoning
    § 5.1 Defining underload and overload - the elusive redline · p. 12

    This notion offers a neat hypothetical explanation of underload and overload, but it still does not let us quantify or predict these redlines in an applied setting.

    “While this notion offers a neat hypothetical explanation of underload and overload, it still does not let us quantify or predict these redlines in an applied setting.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S4 (based).

    Findingnone given
    § 6. Summary and conclusions · p. 12

    New neuroergonomics techniques are emerging as strong contenders for finally ascertaining the physiological correlates of mental demand.

    “Indeed, in measurement, new neuroergonomics techniques are emerging as strong contenders for finally ascertaining the physiological correlates of mental demand.”
    Quote in the paperNot a substantial claim
  • Classified as probably not a substantial claim.

    Findingreasoning
    § 6. Summary and conclusions · p. 12

    Research in this field has so far failed to provide absolute limits on human performance due to the complex nature of the subject and of the processes involved.

    “Research in this field has so far failed to provide absolute limits on human performance due to the complex nature of the subject and of the processes involved.”
    Quote in the paperSubstantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Findingnone given
    § 5.1 Defining underload and overload - the elusive redline · p. 10

    The promise of workload-based adaptive automation from the 1980s is yet to be fulfilled.

    “Earlier in the paper, we reviewed research from the 1980s promising workload-based adaptive automation. Some 25 years later, that promise is yet to be fulfilled.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation
    § 1. Context · p. 2

    Mental workload (MWL) is one of the most widely invoked concepts in ergonomics research and practice.

    “Mental workload (MWL) is one of the most widely invoked concepts in ergonomics research and practice (Flemisch and Onken 2002; Loft et al. 2007; Parasuraman and Hancock 2001; Tsang and Vidulich 2006; Wickens 2008).”
    Quote in the paperNot a substantial claim0 of 3 sources checked
    • cites Flemisch and Onken 2002

      Not checked in the free run.

    • cites Loft et al. 2007

      Not checked in the free run.

    • cites Parasuraman and Hancock 2001

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Premisecitation
    § 2. Concepts and definitions · p. 4

    Underload is not vigilance, since vigilant monitoring is actually a highly demanding task.

    “It is easier to state what underload is not: it is not vigilance (since the consensus has been for some time that vigilant monitoring is actually a highly demanding task; Warm, Dember, and Hancock 1996) nor is it boredom (usually it is about doing very little rather than doing nothing at all).”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Warm, Dember, and Hancock 1996

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S2 (checkable), S3 (load-bearing).

    Premisecitation
    § 2. Concepts and definitions · p. 4

    The current opinion is that there is an optimum range of MWL which is associated with best performance.

    “Indeed, the current opinion is that there is an optimum range of MWL which is associated with best performance (Hancock and Warm 1989; see also Figure 1).”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Hancock and Warm 1989

      Not checked in the free run.

  • Classified as probably not a substantial claim. May combine two claims.

    Premisecitation
    § 2. Concepts and definitions · p. 3

    Automatic processing is associated with expert performance and is characteristically fast, unconscious and almost completely liberated from attentional resource constraints.

    “Automatic processing is associated with expert performance and is characteristically fast, unconscious and almost completely liberated from attentional resource constraints.”
    Quote in the paperSubstantial claim0 of 1 sources checked
    • cites Schneider and Shiffrin 1977

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based). May combine two claims.

    Premisenone given
    § 2. Concepts and definitions · p. 3

    If demands begin to exceed capacity, skilled operators can either adjust their strategy to compensate or else performance necessarily degrades.

    “If demands begin to exceed capacity, skilled operators can either adjust their strategy to compensate or else performance necessarily degrades.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based).

    Interpretationnone given
    § 2. Concepts and definitions · p. 4

    It is not settled whether underload is distinct from other influences on performance such as automation-related complacency and supervisory control.

    “Nevertheless, it is probably fair to say that the jury is out as to whether underload is distinct from other influences on performance such as automation-related complacency and supervisory control.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based).

    Premisenone given
    § 2. Concepts and definitions · p. 3

    There may be different kinds of resources available, such as other team members or technological support, to cope with demand.

    “There may also be different kinds of resources available, as in other team members, or technological support to cope with demand.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Interpretationreasoning
    § 2. Concepts and definitions · p. 4

    There is no direct guarantee that simply reducing MWL improves performance, and the opposite may be true.

    “Therefore, there is no direct guarantee that simply reducing MWL improves performance, and in fact the opposite may be true.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Interpretationreasoning
    § 2. Concepts and definitions · p. 3

    Fixed resource models of workload have drawbacks: absolute capacity demands are illusive, and they do not directly consider nonattentional factors such as experience, learning, age, or willingness to invest effort.

    “Fixed resource models of workload are not without their drawbacks, though. For instance, absolute capacity demands are illusive; they do not directly consider nonattentional factors, such as experience, or more slowly changing variation in attentional resources due to learning or the reduction of capacity with age, or even the willingness to invest effort.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisenone given
    § 2. Concepts and definitions · p. 3

    There is no universal agreement between the numerous definitions of MWL.

    “Although numerous definitions have been offered, it is obvious that there is no universal agreement between these disparate statements.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S2 (checkable), S3 (load-bearing). May combine two claims.

    Premisenone given
    § 2. Concepts and definitions · p. 4

    Underload is not boredom; it is about doing very little rather than doing nothing at all.

    “It is easier to state what underload is not: it is not vigilance (since the consensus has been for some time that vigilant monitoring is actually a highly demanding task; Warm, Dember, and Hancock 1996) nor is it boredom (usually it is about doing very little rather than doing nothing at all).”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based).

    Premisenone given
    § 2. Concepts and definitions · p. 3

    Demands (stress) can have multiple facets, such as time pressure and task complexity.

    “Demands (stress) can have multiple facets, such as time pressure and task complexity.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Premisenone given
    § 2. Concepts and definitions · p. 3

    Controlled processing is the converse of automatic processing, and in the practical world these two elements lie on a continuum.

    “The converse is controlled processing, and in the practical world these two elements lie on a continuum.”
    Quote in the paperNot a substantial claim
  • Classified as probably not a substantial claim.

    Premisecitation
    § 2. Concepts and definitions · p. 3

    Suboptimal workload can mean either overload or underload.

    “Suboptimal workload can mean either overload or underload (Brookhuis and de Waard 2000).”
    Quote in the paperSubstantial claim0 of 1 sources checked
    • cites Brookhuis and de Waard 2000

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Interpretationreasoning
    § 1. Context · p. 2

    MWL has become a topic of increasing importance as modern technology imposes ever greater cognitive demands.

    “MWLhasthus become a topic of increasing importance as modern technology imposes ever greater cognitive demands.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Interpretationreasoning
    § 2. Concepts and definitions · p. 4

    Investing effort may be a positive adaptation in circumstances of underload but could be further detrimental when faced with overload.

    “Consequently, if effort is invested, then MWL will be increased (cf. Shaw et al. 2013) - which may be a positive adaptation in circumstances of underload, but could be further detrimental when faced with overload.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Interpretationreasoning
    § 2. Concepts and definitions · p. 3

    Automatic processing releases attentional resources for other tasks, with a resulting decrease in MWL.

    “This is consistent with the attentional resources approach, as automatic processing releases attentional resources for other tasks, with a resulting decrease in MWL.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Interpretationreasoning
    § 2. Concepts and definitions · p. 3

    MWL, as a multidimensional construct, is determined by characteristics of the task, of the operator and, to a degree, the environmental context in which performance occurs.

    “Thus, MWL as a multidimensional construct, is determined by characteristics of the task (e.g. demands, performance), of the operator (e.g. skill, attention) and, to a degree, the environmental context in which the performance occurs.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S2 (checkable), S3 (load-bearing), S4 (based). May combine two claims.

    Interpretationnone given
    § 2. Concepts and definitions · p. 4

    In the present authors' view, underload requires some engagement in the task, but such engagement is exceptionally low.

    “In the present authors' view, there has to be some engagement in the task, but such engagement is exceptionally low.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S2 (checkable), S3 (load-bearing).

    Premisenone given
    § 2. Concepts and definitions · p. 4

    Underload is a more nebulous term than MWL, as different researchers take it to mean different things.

    “Underload itself, while an intuitive concept, is in many ways a more nebulous term than MWL, as different researchers take it to mean different things.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Interpretationreasoning
    § 2. Concepts and definitions · p. 3

    MWL in real-world tasks is determined by the balance of automatic and controlled processing involved.

    “From this view, MWL in real-world tasks is determined by the balance of automatic and controlled processing involved.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Premisecitation
    § 2. Concepts and definitions · p. 4

    There is a strong consensus that mental underload can be just as detrimental to performance as mental overload, with both leading to performance degradation, attentional lapses and errors.

    “That said, there is a strong consensus that mental underload can be just as detrimental to performance as mental overload, with both leading to performance degradation, attentional lapses and errors (Wilson and Rajan 1995).”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Wilson and Rajan 1995

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisenone given
    § 2. Concepts and definitions · p. 3

    There are commonalities among the various interpretations of MWL.

    “There are, however, commonalities among the various interpretations, which do help to shed light here.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation
    § 2. Concepts and definitions · p. 3

    The international standard on MWL (ISO 10075, 2000) is heavily dependent on the stress/strain analogy for its terminology.

    “Although the stress/strain comparison has been criticised for being too simplistic (e.g. Bainbridge 1974), even the international standard on MWL (ISO 10075, 2000) is heavily dependent on the analogy for its terminology.”
    Quote in the paperNot a substantial claim0 of 2 sources checked
    • cites ISO 10075, 2000

      Not checked in the free run.

    • cites Bainbridge 1974

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S2 (checkable), S3 (load-bearing). May combine two claims.

    Premisecitation
    § 2. Concepts and definitions · p. 3

    MWL is a peculiar concept that has intuitive appeal but remains surprisingly difficult to define.

    “MWL is a peculiar concept that has intuitive appeal, but remains surprisingly difficult to define (see also situation awareness; Smith and Hancock 1995).”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Smith and Hancock 1995

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation
    § 2. Concepts and definitions · p. 3

    The trade-off between stress and strain may have different effects on the human, as measured by different objective and subjective metrics.

    “Finally, the trade-off between stress and strain may have different effects on the human - as measured by the different objective and subjective metrics which we describe later (see, e.g., Bevan and Macleod 1994).”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Bevan and Macleod 1994

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S2 (checkable), S3 (load-bearing).

    Premisecitation
    § 2. Concepts and definitions · p. 3

    MWL becomes a product of the resources available to meet task demands.

    “Resources, in this arena of discussion, often refer to attentional resources (e.g. Wickens 1980, 2002); thus, MWL becomes a product of the resources available to meet task demands (Welford 1978).”
    Quote in the paperNot a substantial claim0 of 2 sources checked
    • cites Welford 1978

      Not checked in the free run.

    • cites Wickens 1980, 2002

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation
    § 2. Concepts and definitions · p. 3

    An analogy is often made between mental and physical load, in that each expresses two components: stress (task demands) and strain (impact on the human).

    “An analogy is often made between mental and physical load, in that each expresses two components - stress (i.e. task demands) and strain (impact on the human; cf. Schlegel 1993).”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Schlegel 1993

      Not checked in the free run.

  • May combine two claims.

    Interpretationreasoning
    § 2. Concepts and definitions · p. 4

    Performance can be maintained at the cost of individual strain or vice versa.

    “Thus, performance can be maintained at the cost of individual strain or vice versa.”
    Quote in the paperSubstantial claim
  • Probably not a substantial claim: may not pass S2 (checkable), S3 (load-bearing).

    Premisenone given
    § 2. Concepts and definitions · p. 3

    Overload occurs when the operator is faced with more stimuli than they are able to handle while maintaining their own standards of performance.

    “Overload occurs, for instance, when the operator is faced with more stimuli than (s)he is able to handle while maintaining their own standards of performance.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Premisereasoning
    § 3. Measurement · p. 5

    As workload increases, the response time to, and the chance of missing, a signal increases.

    “As workload increases, the response time to, and the chance of missing, a signal increases.”
    Quote in the paperSubstantial claim
  • Classified as probably not a substantial claim. May combine two claims.

    Premisenone given
    § 3. Measurement · p. 5

    Visual perception is crucial for drivers, while concurrent execution of another in-vehicle visual task competes for visual attention with the primary driving task.

    “Visual perception is crucial for drivers while concurrent execution of another in-vehicle visual task (for instance, looking at a cell phone) competes for visual attention with the primary driving task.”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Premisecitation
    § 3. Measurement · p. 5

    MWL can increase heart rate and decrease heart rate variability at the same time.

    “MWL can increase heart rate and decrease heart rate variability at the same time.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S2 (checkable), S3 (load-bearing).

    Premisereasoning
    § 3. Measurement · p. 5

    Physiological measures are a natural type of workload index since work demands physiological activity by definition.

    “Physiological measures are a natural type of workload index since work demands physiological activity by definition.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Interpretationnone given
    § 3. Measurement · p. 6

    So far, NIRS and BCI methods have been restricted to laboratory conditions, and the equipment is extremely expensive to purchase and use.

    “So far, these methods have been restricted to laboratory conditions, and the equipment is extremely expensive to purchase and use.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Premisecitation
    § 3. Measurement · p. 6

    Posner (2012) illustrated that new methods to study human operators at work are gaining momentum, advancing our understanding of brain plasticity.

    “Recently, Posner (2012) illustrated that new methods to study human operators at work are gaining momentum, advancing our understanding of brain plasticity.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Posner 2012

      Not checked in the free run.

  • May combine two claims.

    Premisecitation
    § 3. Measurement · p. 5

    Brain activity and activity of certain facial muscles such as the corrugator supercilii are measures of interest for workload.

    “Other measures of interest are the activity of the brain (Brookhuis and de Waard 1993; de Waard and Brookhuis 1991) and of certain facial muscles, such as the corrugator supercilii (Hoogendoorn et al. 2010; Jessurun, Steyvers, and Brookhuis 1993).”
    Quote in the paperNot a substantial claim0 of 3 sources checked
    • cites Brookhuis and de Waard 1993

      Not checked in the free run.

    • cites de Waard and Brookhuis 1991

      Not checked in the free run.

    • cites Hoogendoorn et al. 2010

      Not checked in the free run.

  • May combine two claims.

    Premisecitation
    § 3. Measurement · p. 5

    Blood pressure is closely coupled to heart rate and sensitive to workload.

    “Closely coupled to heart rate and also sensitive to workload is blood pressure (Rau 2004).”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Rau 2004

      Not checked in the free run.

  • May combine two claims.

    Premisecitation
    § 3. Measurement · p. 5

    Suboptimal workload may emerge from disruptions in the operator's physiology, for instance when under stress, although other non-workload stressors can influence these indices.

    “Suboptimal workload may also emerge from disruptions in the operator's physiology, for instance when under stress (Hancock and Warm 1989), although other non-workload stressors (such as from the environment or sleep loss) can influence these indices.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Hancock and Warm 1989

      Not checked in the free run.

  • May combine two claims.

    Interpretationnone given
    § 2. Concepts and definitions · p. 4

    In complex, safety-critical systems where MWL research is usually most pertinent, both underload and overload are very real concerns.

    “In the complex, safety-critical systems where MWL research is usually most pertinent and/or most pursued (such as transport, as we shall see later), both underload and overload are very real concerns.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S2 (checkable).

    Interpretationreasoning
    § 3. Measurement · p. 6

    Operator conditions in fixed positions such as operating motor vehicles, trains and airplanes are suitable for the next generation of MWL field studies.

    “Operator conditions in fixed positions such as operating motor vehicles, trains and airplanes are suitable for this next generation of MWL field studies.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Interpretationcitation
    § 3. Measurement · p. 5

    While numerous physiological measures are now relatively easily measured in the operational environment, attention is less easily monitored in ambulant situations but not impossible.

    “While numerous physiological measures are now relatively easily measured in the operational environment, attention is less easily monitored in ambulant situations - but not impossible.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Premisecitation
    § 3. Measurement · p. 5

    MWL is a subjective state; people are able to express themselves in words or indications on scales in post-task responses.

    “MWLis a subjective state as well; people are able to express themselves in words or indications on scales in post-task responses (Zijlstra 1993).”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Zijlstra 1993

      Not checked in the free run.

  • May combine two claims.

    Premisenone given
    § 3. Measurement · p. 5

    Beta activity (12-30 Hz) is predominant when the participant is generally awake and alert; alpha activity (8-12 Hz) indicates developing drowsiness; theta activity (5-8 Hz) may lead to falling asleep.

    “Beta activity (1230 Hz) is predominant when the participant in the study is generally awake and alert, while the activity dropping to Alpha activity (8-12 Hz) indicates developing drowsiness, and going further down into the theta region (5-8 Hz) may even lead to falling asleep.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation
    § 3. Measurement · p. 5

    The multidimensional nature of MWL is reflected in the variety of workload metrics available.

    “As we have noted, the multidimensional nature of MWL is reflected in the variety of workload metrics available (see also, e.g. Gawron 2008).”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Gawron 2008

      Not checked in the free run.

  • May combine two claims.

    Interpretationreasoning
    § 2. Concepts and definitions · p. 4

    While both low and high MWL are basic precursors to errors, an exact relationship between MWL and accident causation is not easily established, let alone measured in practice.

    “But while both low and high MWL are undoubtedly basic precursors to errors, an exact relationship between MWL and accident causation is not easily established, let alone measured in practice.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Interpretationcitation
    § 3. Measurement · p. 5

    Neuroergonomics opens new windows to the study of MWL.

    “Modern integrated, wireless measurement facilities enable more easily accessible EEG measurement (e.g. Makeig et al. 2002), while more integrated approaches such as neuroergonomics, suggested by Parasuraman (2011), open new windows to the study of MWL.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Parasuraman 2011

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S4 (based).

    Premisenone given
    § 3. Measurement · p. 5

    The PDT is based on the premise that visual attention narrows as workload increases.

    “The PDT is based on the premise that visual attention narrows as workload increases.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Premisecitation
    § 3. Measurement · p. 5

    Driving on an urban road with traffic, traffic signs and traffic lights leads to increased workload according to heart rate measures (high heart rate, low variability), which immediately reverses when the driver stops if one of the lights turns red.

    “Driving on an urban road with traffic, traffic signs and traffic lights leads to increased workload according to these measures (high heart rate, low variability), which immediately reverses when the driver stops if one of the lights turns red.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites De Waard 1996

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation
    § 3. Measurement · p. 5

    Modern integrated, wireless measurement facilities enable more easily accessible EEG measurement.

    “Modern integrated, wireless measurement facilities enable more easily accessible EEG measurement (e.g. Makeig et al. 2002), while more integrated approaches such as neuroergonomics, suggested by Parasuraman (2011), open new windows to the study of MWL.”
    Quote in the paperNot a substantial claim0 of 2 sources checked
    • cites Makeig et al. 2002

      Not checked in the free run.

    • cites Parasuraman 2011

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Premisecitation
    § 2. Concepts and definitions · p. 4

    Brookhuis and de Waard discriminated between underload and overload by referring to error sources: underload leads to reduced alertness and lowered attention; overload leads to distraction, diverted attention and insufficient time for adequate information processing.

    “Brookhuis and de Waard (2000) discriminated between underload and overload by referring to error sources, the former leading to reduced alertness and lowered attention, the latter to distraction, diverted attention and insufficient time for adequate information processing.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Brookhuis and de Waard 2000

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation
    § 5. Current/future issues and challenges · p. 9

    Light physical activity could actually compensate for the deficits imposed by mental underload.

    “In fact, recent research has explored the interaction between physical and MWL across some of these metrics, espousing the idea that light physical activity could actually compensate for the deficits imposed by mental underload (Basahel, Young, and Ajovalasit 2010).”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Basahel, Young, and Ajovalasit 2010

      Not checked in the free run.

  • May combine two claims.

    Premisecitation
    § 5. Current/future issues and challenges · p. 9

    Both physical workload and MWL have a clear impact on heart rate, heart rate variability and respiration.

    “Both physical workload and MWL are well known to have a clear impact on heart rate, heart rate variability and respiration (Mulder 1992), and delineating the effects of one over the other can prove troublesome in applied research.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Mulder 1992

      Not checked in the free run.

  • May combine two claims.

    Premisereasoning
    § 3. Measurement · p. 6

    In the central region of the region model, workload gradually increases while performance is at its best, remaining relatively constant.

    “In the central region, workload gradually increases while performance is at its best, remaining relatively constant.”
    Quote in the paperSubstantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Interpretationreasoning
    § 4.1 1980s · p. 7

    Although the apparent concern in early adaptive interface work was more with overload than underload, issues of optimising workload and defining workload 'redlines' or thresholds have occupied researchers since some of the earliest work in this field.

    “Although the apparent concern is more with overload than underload, it is clear that issues of optimising workload and defining workload 'redlines' or thresholds have occupied researchers since some of the earliest work in this field.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Interpretationcitation
    § 3. Measurement · p. 6

    Higher task demand leading to increased MWL does not have to affect performance, and not all measures have to be strongly correlated.

    “Thus, higher task demand leading to increased MWL does not have to affect performance, and not all measures have to be strongly correlated.”
    Quote in the paperSubstantial claim0 of 1 sources checked
    • cites de Waard 1996

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation
    § 4.1 1980s · p. 7

    Hayashi examined the MWL of software engineers in programming tasks.

    “Also, Hayashi (1988; Hayashi and Kosugo 1987) examined the MWL of software engineers in programming tasks.”
    Quote in the paperNot a substantial claim0 of 2 sources checked
    • cites Hayashi 1988

      Not checked in the free run.

    • cites Hayashi and Kosugo 1987

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation
    § 3. Measurement · p. 6

    If one measure reflects an increase in workload and another measure does not, then measures are said to dissociate.

    “If one measure reflects an increase in workload and another measure does not, then measures are said to dissociate (see also Hancock 1996; Yeh and Wickens 1988).”
    Quote in the paperNot a substantial claim0 of 2 sources checked
    • cites Hancock 1996

      Not checked in the free run.

    • cites Yeh and Wickens 1988

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation
    § 5. Current/future issues and challenges · p. 9

    Mind and body cannot be separated in ergonomics research.

    “All of this chimes with recent suggestions that mind and body cannot be separated in ergonomics research (cf. Marras and Hancock 2014).”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Marras and Hancock 2014

      Not checked in the free run.

  • May combine two claims.

    Premisecitation
    § 4.1 1980s · p. 7

    Nowakowski was concerned with online MWL assessment for a knowledge-based adaptive system, with a particular focus on individual differences between users.

    “Similarly, Nowakowski (1987) was also concerned with online MWL assessment for a knowledge-based adaptive system, with a particular focus on individual differences between users.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Nowakowski 1987

      Not checked in the free run.

  • May combine two claims.

    Premisecitation
    § 4.4 Summary and observations · p. 8

    Glass cockpits in commercial aircraft have relieved workload in some areas such as reduced display clutter and more automated flight procedures, but have increased workload in other areas such as more decision options and confusion with operating modes.

    “For instance, glass cockpits in commercial aircraft have relieved workload in some areas, such as reduced display clutter and more automated flight procedures. However, the same systems have increased workload in other areas, such as more decision options in any given situation (Hilburn 1997), and confusion with respect to operating modes (Ferris, Wickens, and Sarter 2010; Sarter and Woods 1995).”
    Quote in the paperNot a substantial claim0 of 3 sources checked
    • cites Hilburn 1997

      Not checked in the free run.

    • cites Ferris, Wickens, and Sarter 2010

      Not checked in the free run.

    • cites Sarter and Woods 1995

      Not checked in the free run.

  • May combine two claims.

    Premisecitation
    § 4.4 Summary and observations · p. 8

    Some automation reduces workload when demand is low but problematically increases workload when demand is high.

    “The problem with some automation is that it reduces workload when demand is low but problematically increases workload when demand is high. This tendency is evident when the automation is 'dumb and dutiful' as Wiener (1989) cast it.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Wiener 1989

      Not checked in the free run.

  • May combine two claims.

    Premisecitation
    § 3. Measurement · p. 6

    Dissociation has usually been reported between self-reports and measures of performance, and sometimes between physiological and self-report measures.

    “Dissociation has usually been reported between self-reports and measures of performance, and sometimes between physiological and self-report measures (Myrtek et al. 1994).”
    Quote in the paperSubstantial claim0 of 1 sources checked
    • cites Myrtek et al. 1994

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S2 (checkable), S3 (load-bearing), S4 (based). May combine two claims.

    Premisereasoning
    § 5. Current/future issues and challenges · p. 9

    The measurement of mental work is founded on the science of psychology, which is comparatively an immature science compared to physics.

    “Notwithstanding the progress reported here, the measurement of mental work is founded on the science of psychology and comparatively speaking, psychology is an immature, if no less difficult, science.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Premisereasoning
    § 5.1 Defining underload and overload - the elusive redline · p. 11

    Count variables can be used to predict absolute workload values, both above and below the redline, but multitask interference models cannot easily do so at the current stage of their maturity.

    “Count variables can be used to predict absolute workload values, both above and below the redline, but multitask interference models cannot easily do so at the current stage of their maturity.”
    Quote in the paperSubstantial claim
  • Probably not a substantial claim: may not pass S2 (checkable), S4 (based).

    Premisenone given
    § 5.1 Defining underload and overload - the elusive redline · p. 10

    In any resource-limited system, the most relevant measure of demand is specified relative to the supply of available resources.

    “In any resource-limited system, the most relevant measure of demand is specified relative to the supply of available resources.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S2 (checkable), S4 (based). May combine two claims.

    Interpretationreasoning
    § 6. Summary and conclusions · p. 12

    These metrics suggest a resolution of the physical versus MWL question, and perhaps even augur the potential to quantify workload and those redlines of performance.

    “These metrics suggest a resolution of the physical versus MWL question, and perhaps even augur the potential to quantify workload and those redlines of performance.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S1 (asserted).

    Premisecitation
    § 5.1 Defining underload and overload - the elusive redline · p. 12

    Metrics of brain oxygenation could essentially represent a quantitative measure of attentional resources.

    “It has been suggested (Perrey, Thedon, and Rupp 2010; Shaw et al. 2013) that metrics of brain oxygenation could essentially represent a quantitative measure of attentional resources.”
    Quote in the paperNot a substantial claim0 of 2 sources checked
    • cites Perrey, Thedon, and Rupp 2010

      Not checked in the free run.

    • cites Shaw et al. 2013

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based).

    Premisenone given
    § 5.1 Defining underload and overload - the elusive redline · p. 11

    The redline for working memory is roughly seven chunks of information.

    “For example we have noted the redline for working memory at roughly seven chunks of information.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisereasoning
    § 5.1 Defining underload and overload - the elusive redline · p. 10

    The need to assess mental work is fuelled by the ever-present practical necessity to measure mental activity and allocate tasks in the modern electronic workplace.

    “However, alongside these evident scientific concerns, the need to assess mental work is also very much fuelled by the ever-present practical necessity to measure mental activity and allocate tasks in the modern electronic workplace.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation
    § 5.1 Defining underload and overload - the elusive redline · p. 12

    Low demands could be misperceived by the operator, leading to a mismatch in terms of effort invested to perform the task.

    “Alternatively, low demands could be misperceived by the operator, leading to a mismatch in terms of effort invested to perform the task (Matthews and Desmond 1997).”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Matthews and Desmond 1997

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based).

    Premisenone given
    § 5.1 Defining underload and overload - the elusive redline · p. 10

    Many of the measures are differentially sensitive in the different regions.

    “Many of the measures are also differentially sensitive in the different regions.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation
    § 5.1 Defining underload and overload - the elusive redline · p. 12

    Young and Stanton proposed a theory whereby attentional resources shrink in situations of low workload, thus leading to problems when demands suddenly increase.

    “Young and Stanton's research into vehicle automation led them to propose a theory whereby attentional resources shrink in situations of low workload, thus leading to problems when demands suddenly increase (see Young and Stanton 2002).”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Young and Stanton 2002

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisereasoning
    § 5.1 Defining underload and overload - the elusive redline · p. 12

    The redlines of both underload and overload coincide with the points where the demand and resource lines cross over.

    “The redlines of both underload and overload coincide with the points where the demand and resource lines cross over; performance degrades in both regions of underload and overload when demands exceed resources.”
    Quote in the paperNot a substantial claim
  • Classified as probably not a substantial claim. May combine two claims.

    Premisecitation
    § 5.1 Defining underload and overload - the elusive redline · p. 12

    Effort is voluntary and is related to resource investment.

    “As we have already seen earlier in this paper, effort is voluntary and is related to resource investment (cf. Shaw et al. 2013), so this could be compatible with Young and Stanton's (2002) idea.”
    Quote in the paperSubstantial claim0 of 1 sources checked
    • cites Shaw et al. 2013

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S2 (checkable), S3 (load-bearing).

    Interpretationreasoning
    § 6. Summary and conclusions · p. 12

    The applied problems will assume even greater prominence as we move forward.

    “Nevertheless, it is reasonable to suggest that the applied problems will assume even greater prominence as we move forward.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S2 (checkable), S3 (load-bearing), S4 (based).

    Interpretationnone given
    § 6. Summary and conclusions · p. 12

    Advances in mobile and wearable computing, augmented reality and similar technologies present great challenges for MWL research in the near future.

    “Advances in mobile and wearable computing, augmented reality and similar technologies no doubt present great challenges for MWL research in the near future.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based). May combine two claims.

    Premisenone given
    § 5.1 Defining underload and overload - the elusive redline · p. 12

    Resource supply (based on activation and/or effort) at first lags behind task demands in the underload region, then exceeds it until resources start to asymptote towards the upper capacity limit, and we reach overload.

    “This is reflected (albeit with some artistic licence) in Figure 2, as resource supply (based on activation and/or effort) at first lags behind task demands in the underload region, then exceeds it until resources start to asymptote towards the upper capacity limit, and we reach overload.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S2 (checkable), S3 (load-bearing).

    Interpretationreasoning
    § 6. Summary and conclusions · p. 12

    These advances reflect and further emphasise the role of mental work over physical work in the modern workplace.

    “These advances also reflect and further emphasise the role of mental work over physical work in the modern workplace.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Premisenone given
    § 5.1 Defining underload and overload - the elusive redline · p. 12

    In highly automated systems, very low workload is often coupled with fatigue and automation-related complacency, and then a sudden unexpected failure rapidly throws the operator into a highly stressful fault diagnosis and failure management mode, well above the redline, in such a way that the prior loss of situation awareness has rendered them unprepared.

    “Here, very low workload is often coupled with fatigue and automationrelated complacency. Then the sudden unexpected failure rapidly throws the operator into a highly stressful fault diagnosis and failure management mode, well above the redline, in such a way that the prior loss of situation awareness has rendered them unprepared.”
    Quote in the paperSubstantial claim
98 of 98
  • The paper relies on this without support.

    The Ergo-Abs database search results are representative of the broader MWL literature.

    “A search of Ergo-Abs (the Ergonomics Abstracts online database, which covers international books, journals and conference proceedings across a variety of ergonomics-related fields) over the last three decades (which reflects the vast majority of sources indexed in the database) shows that references to 'mental workload' have increased more than threefold since the 1980s (see Table 1).”
  • The paper relies on this without support.

    The categorisation of publications into application areas based on title and abstract is valid for identifying thematic trends.

    “There is an element of selectivity in this: the categorisation process being necessarily one of independent determination and based on the most obvious theme from the title and abstract of the publication and where the application was the main focus of the paper (as opposed to focusing on a workload metric albeit in a particular application).”
  • The paper relies on this without support.

    The relative increase in MWL hits over comparator terms indicates a genuine increase in prominence rather than only database coverage.

    “This increase no doubt partly reflects the growing coverage of the database in more recent years, as evidenced by equivalent searches for 'physical workload' and 'workload'. Nevertheless, the relative decade-on-decade increase in hits for MWL in the 2000s suggests a more recent prominence over the comparator terms - 36% for 'mental workload' against 17% for 'physical workload' and 'workload'.”
  • The authors state this as an assumption.

    Timeline analysis assumes that workload is proportional to the ratio of the time occupied performing tasks to total time available.

    “In a simplified but readily usable version, it assumes that workload is proportional to the ratio of the time occupied performing tasks to total time available.”
4 of 4

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

  • Assessing mental workload as a multidimensional context-dependent construct is generally done by a combination of self-report, performance, and physiological indicators rather than by any single measure alone.

    “Assessing mental workload as a multidimensional context-dependent construct is generally done by a combination of self-report, performance, and physiological indicators rather than by any single measure alone (Young et al., 2015; Longo et al., 2022; Hart and Staveland, 1988).”

    From Enhancement of modern defense capabilities by convergence of cognitive neuroscience and artificial intelligence (2026) · cites this paper as Young et al., 2015

    The paper describes mental workload as multidimensional and dependent in part on environmental context (Concepts and definitions, p. 3). It identifies performance, subjective-report and physiological measures as three categories (Measurement, p. 5), and says objective measures are often useful alongside self-reports (Measurement, p. 6). It does not establish that assessments are generally conducted using all three in combination rather than a single measure. (LLM, conf=0.84)

    Experimental — accuracy not yet measured

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

Each contradiction between two passages listed here was confirmed by an independent check.

  • Historical sequence of MWL research is reversed

    Minor

    The context section says MWL research progressed from measurement to definition to applications. The conclusion instead says it progressed from definition to measurement to applications.

1 of 1

Cites

Flagged first, then by citations

Research works printed but not linked: 21

  1. Aoyama, T., and M.Umemura. 1991. “An Examination of the Mental Workload of Design Work in Offices.” In Towards Human Work: Solutions to Problems in Occupational Health and Safety, edited by M.Kumashiro, and E. D.Megaw, 243–249. London: Taylor & Francis.
  2. Bainbridge L., 1974, Le Travail Humain, 37, 279
  3. Basahel, A. M., M. S.Young, and M.Ajovalasit. 2010. “Effects of Interaction between Physical and Mental Workload on Human Performance.” In Contemporary Ergonomics and Human Factors 2010, edited by M.Anderson, 598–601. London: Taylor & Francis.
  4. 2014, InProceedings of the HFES International Annual Meeting
  5. 2010, Chap. 5.7 in NASA Human Integration Design Handbook (HIDH), 190
  6. Hayashi Y., 1988, Journal of Science of Labour, 64, 257
  7. Hayashi Y., 1987, Journal of Science of Labour, 63, 351
  8. Jarvenpaa, E.1990. “Mental Workload in Different Phases of the Implementation of New Technology: The Implementation of Office Automation as an Example.” In Proceedings of the International Ergonomics Association Conference on Human Factors in Design for Manufacturability and Process Planning , 159–163.
  9. Kuriyagawa, Y., and I. Kageyama. 2003. “A Study on the Evaluation Model of Mental Workload for Drivers.” In Ergonomics in the Digital Age. Proceedings of the XVth Triennial Congress of the International Ergonomics Association and the 7th Joint Conference of the Ergonomics Society of Korea and the Japan Ergonomics Society .
  10. Lenior, T. M. J., and M. P.Gobel. 1997. “Predicting Mental Workload for Train Traffic Control Tasks.” In From Experience to Innovation - IEA ’97. Proceedings of the 13th Triennial Congress of the International Ergonomics Association, edited by P.Seppala, T.Luopajarvi, C. H.Nygard, and M.Mattila, 358–360. Finnish Institut.
  11. Loewenthal, A., M.Chignell, and P.Hancock. 1985. “Use of Mental Workload Measures in Interface Design.” In IEEE 1985 Proceedings of the International Conference on Cybernetics and Society, 624–626. New York: IEEE.
  12. Low, I.2003. “Assessment of the Impact on Mental Workload from Advanced Air Traffic Management Systems: A Diagnostic Tool.” In Ergonomics in the Digital Age. Proceedings of the XVth Triennial Congress of the International Ergonomics Association and the 7th Joint Conference of the Ergonomics Society of Korea and the Japan Ergonomics Society .
  13. Pickup, L., J.Wilson, and T.Clarke. 2003. “Mental Workload of the Railway Signaller.” In Contemporary Ergonomics, edited by P. T.McCabe, 397–402. London: Taylor & Francis.
  14. Schlegel, R. E.1993. “Driver Mental Workload.” In Automotive Ergonomics, edited by B.Peacock, and W.Karwowski, 359–382. London: Taylor & Francis.
  15. Wickens, C., T.Bagnall, M.Gosakan, and B.Walters. 2011. “Modeling Single Pilot Control of Multiple UAVs.” In Proceedings of the 16th International Symposium on Aviation Psychology, available in CD-ROM format edited by M.Vidulich, and P.Tsang. Dayton, OH: Wright State University.
  16. Wickens, C. D., and J. G.Hollands. 2000. Engineering Psychology and Human Performance. 3rd ed.Upper Saddle River, NJ: Pearson.
  17. Wilson, J. R., and J. A.Rajan. 1995. “Human-Machine Interfaces for Systems Control.” In Evaluation of Human Work: A Practical Ergonomics Methodology, edited by J. R.Wilson, and E. N.Corlett, 357–405. London: Taylor & Francis.
  18. Young M. S., 1997, International Journal of Cognitive Ergonomics, 1, 325
  19. Young, M., and N.Stanton. 1998. “What's Skill Got to Do with It? Vehicle Automation and Driver Mental Workload.” In Contemporary Ergonomics 1998, edited by M. A.Hanson, 436–440. London: Taylor & Francis.
  20. Young, M. S., and N. A.Stanton. 2005. “Mental workload.” In Handbook of Human Factors and Ergonomics Methods, edited by N. A.Stanton, A.Hedge, K.Brookhuis, E.Salas, and H. W.Hendrick. Chap. 39. London: Taylor & Francis.
  21. Zijlstra, F. R. H.1993. “Efficiency in Work Behavior. A Design Approach for Modern Tools.” PhD diss., Delft University of Technology. Delft: Delft University Press.

Cited by

Sorted by citations

Authors
Young, M. S., Brookhuis, K. A., Wickens, C. D., & Hancock, P. A.
Affiliations
  • Brunel University of London (GB)
  • University of Groningen (NL)
  • University of Central Florida (US)
Corresponding author
Young, Mark S.
Venue
Ergonomics
Published
2014-12-02
Volume
58
Issue
1
Pages
1-17
ISSN
  • 0014-0139 (ISSN-L)
  • 1366-5847
OpenAlex
W2076883103
Cited by
948
References
406
Citations by year
2026: 104 · 2025: 117 · 2024: 85 · 2023: 101 · 2022: 98 · 2021: 102 · 2020: 85 · 2019: 84 · 2018: 65 · 2017: 50 · 2016: 35 · 2015: 19 · 2013: 2
FWCI
4.95
Type
journal article
Language
en
Open access
Locations
  • Ergonomics (publishedVersion)
  • PubMed (publishedVersion)
  • Journal of International Crisis and Risk Communication Research (submittedVersion)
  • ePrints Soton (University of Southampton) (submittedVersion)
  • University of Groningen research database (University of Groningen / Centre for Information Technology) (submittedVersion, other-oa)
Funders
National Aeronautics and Space Administration
Topics
  • Social Sciences › Psychology › Social Psychology › Human-Automation Interaction and Safety
  • Physical Sciences › Engineering › Biomedical Engineering › Ergonomics and Human Factors
  • Physical Sciences › Computer Science › Human-Computer Interaction › Usability and User Interface Design
Keywords
mental workload, workload measurement, operator performance, complex system design, physical workload, safety-critical systems, human factors
MeSH terms
Cognition, Humans, Ergonomics, Task Performance and Analysis, Workload

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Claims read by deepseek-v4.1-flash under definition version 3 (extract-v3) on 2026-10-08.

Classified by jev-1.13-20260917 (gold-guideline-v0.2) on 2026-10-08.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review