Cited by 2,669Technology Adoption and User BehaviourElectronic Health Records SystemsInformation Systems Theories and Implementation

The Technology Acceptance Model: Its past and its future in health care

Open access
Holden, Richard J., Karsh, Ben-Tzion·2010·Journal of Biomedical Informatics

Abstract

Increasing interest in end users' reactions to health information technology (IT) has elevated the importance of theories that predict and explain health IT acceptance and use. This paper reviews the application of one such theory, the Technology Acceptance Model (TAM), to health care. We reviewed 16 data sets analyzed in over 20 studies of clinicians using health IT for patient care. Studies differed greatly in samples and settings, health ITs studied, research models, relationships tested, and construct operationalization. Certain TAM relationships were consistently found to be significant, whereas others were inconsistent. Several key relationships were infrequently assessed. Findings show that TAM predicts a substantial portion of the use or acceptance of health IT, but that the theory may benefit from several additions and modifications. Aside from improved study quality, standardization, and theoretically motivated additions to the model, an important future direction for TAM is to adapt the model specifically to the health care context, using beliefs elicitation methods.

AI snapshot

Written from the paper’s full text.

TL;DR

This review examines how the Technology Acceptance Model (TAM) has been applied to clinician use of health information technology, covering 16 datasets from 22 studies. It finds TAM predicts a meaningful share of acceptance/use, but the evidence is uneven and the model needs standardization, more complete testing, and healthcare-specific contextualization.

Key findings

  • Across 16 datasets, perceived usefulness was significantly related to intention/use in all 16 tests; perceived behavioral control was significant in all 5 tests; attitude-to-intention was significant in 5 of 6 tests; perceived ease of use-to-perceived usefulness in 10 of 12; perceived usefulness-to-attitude in 3 of 3; perceived ease of use-to-attitude in 1 of 2.
  • Some paths were inconsistent: perceived ease of use-to-intention was significant in only 7 of 13 tests, and subjective norm-to-intention in only 4 of 8. Only two studies tested intention-to-actual-use; one found a significant relationship, while the other found it for only one of two use behaviors.
  • TAM explained a substantial portion of variance in intention or use, but the authors did not pool estimates because studies differed greatly in samples, settings, technologies, models, construct definitions, and measures. No single study tested the same model.
  • The authors recommend contextualizing TAM for healthcare through beliefs elicitation, because generic definitions of usefulness, ease of use, and social influence may miss clinically relevant dimensions and actionable causes.

Methods

  • Critical review of quantitative studies testing TAM or closely related models (TAM2, UTAUT, TPB) in health care, published on or before July 2008, focused on clinician end users of health IT for direct patient care. Exclusions included qualitative studies, studies not testing TAM relationships, patient or non-medical users, organizational adoption, web-based learning, adverse event reporting, and unpublished dissertations.
  • Searches used PubMed/MEDLINE and ABI/INFORM Global with TAM/TAM2/UTAUT keywords plus health, physician, and nurse terms, followed by reference checking. The review included 16 datasets analyzed in 22 studies.
  • No meta-analysis was performed because of heterogeneity; the authors reported variance explained (R² or equivalent) descriptively and cautioned against overinterpreting it.

Limitations

  • Stated: heterogeneity in samples, technologies, models, and measures prevented meta-analysis and limits comparability; many relationships were infrequently assessed; actual use was rarely measured; longitudinal research was lacking; moderators were seldom tested; construct definitions and operationalizations were often mismatched or generic; some studies lacked formal definitions; profession effects were sometimes confounded with sex and age.
  • Stated: publication, language, and library-access restrictions applied, and excluded studies may still offer useful insight.
  • Evident from the text: the small evidence base of 16 datasets and non-standardized models mean conclusions about inconsistent paths, such as perceived ease of use and subjective norm, remain tentative, and no formal effect-size synthesis was possible.

Model-written summary. Check it against the paper before relying on it.

Integrity signals

Registry

Crossref · 10.1016/j.jbi.2009.07.002

Cites

160 of 160 references verified0 citation errors · 0 not checkable

Statistics

Nothing to recompute.

Claims the paper makes

0 of 140 cited sources checked · 0 supported · 0 flagged

  • Findingnone given

    The reviewed studies varied greatly in samples, settings, health ITs studied, research models, relationships tested, and construct operationalization.

    “Studies differed greatly in samples and settings, health ITs studied, research models, relationships tested, and construct operationalization.”
    Quote in the paperSubstantial claim
  • Findingcitation

    In one reviewed study, the relationship between behavioral intentions and actual use was significant.

    “In one study, the relationship was significant [110].”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites [110] Chen, 2007, Obstacles to the adoption of radio frequency identification technology in the emergency rooms of hospitals, Int J Electron Healthcare source

      Not checked in the free run.

  • Findingown data

    The effect of subjective norm on intention was significant in only four of eight tests.

    “The effect of subjective norm on intention was similarly questionable, significant in only four of eight tests.”
    Quote in the paperNot a substantial claim
  • Findingown data

    All 16 tests of the relationship between perceived usefulness and intention to use were significant.

    “Every one of the 16 tests of the relationship between PU and intention to use was significant.”
    Quote in the paperSubstantial claim
  • Findingown data

    The relationship between perceived ease of use and intention was significant in only seven of 13 tests.

    “The PEOU-intention relationship was much more inconsistent, significant in only seven of 13 tests.”
    Quote in the paperSubstantial claim
  • Classified as probably not a substantial claim. 28
  • May combine two claims. 41
  • The quote only partly states this claim. 2
  • Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based).

    Findingnone given

    Perceived usefulness was defined as health IT use leading to enhancement or gains in job performance.

    “Perceived usefulness (PU) was defined as health IT use leading to enhancement or gains in job performance.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Findingcitation

    The physician specialties covered in reviewed studies were endoscopy, pediatrics, disability care, and a mix of specialists and general practitioners.

    “The physician specialties covered were endoscopy [96], pediatrics [97], disability care [98], and some mix of specialists and general practitioners [32, 99-101].”
    Quote in the paperNot a substantial claim0 of 3 sources checked
    • cites [96] Barker, 2003, Evaluating a spoken dialogue system for recording clinical observations during an endoscopic examination, Med Inform Internet Med source

      Not checked in the free run.

    • cites [97] Chismar WG, Wiley-Patton S. Test of the technology acceptance model for the internet in pediatrics. In: Proceedings of the annual symposium of the American medical informatics association; 2002. p. 155–9.

      Not checked in the free run.

    • cites [98] Horan TA, Tulu B, Hilton B, Burton J. Use of online systems in clinical medical assessments: an analysis of physician acceptance of online disability evaluation systems. In: Proceedings of the 37th Hawaii international conference on system sciences; 2004. p. 1–10. source

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Findingcitation

    Some reviewed studies had participants who were nurses, physiotherapists, or occupational therapists.

    “In a few studies, participants were nurses [102, 103], and physio- [104] or occupational [105] therapists.”
    Quote in the paperNot a substantial claim0 of 3 sources checked
    • cites [102] Rawstorne P, Jayasuriya R, Caputi P. Issues in predicting and explaining usage behaviors with the technology acceptance model and the theory of planned behavior when usage is mandatory. In: Proceedings of the 21st international conference on information systems; 2000. p. 35–44.

      Not checked in the free run.

    • cites [103] Tung, 2008, An extension of trust and TAM model with IDT in the adoption of the electronic logistics information system in HIS in the medical industry, Int J Med Inform source

      Not checked in the free run.

    • cites [104] Van Schaik, 2002, Clinical acceptance of a low-cost portable system for postural assessment, Behav Inf Technol source

      Not checked in the free run.

  • May combine two claims.

    Findingown data

    Some TAM relationships were consistently significant across reviewed studies, while others were inconsistent.

    “Certain TAM relationships were consistently found to be significant, whereas others were inconsistent.”
    Quote in the paperSubstantial claim
  • The quote only partly states this claim.

    Findingnone given

    In total, 16 datasets have been analyzed using TAM and related models in health care.

    “In total, 16 datasets have been analyzed, and TAM has fared much better in later tests.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Findingown data

    Reviewed studies were set in Taiwan, Hong Kong, the UK, Australia, the mainland US, Hawaii, Belgium, Finland, and Quebec.

    “Several studies were set in Taiwan [103, 109, 110], Hong Kong [32, 48, 49], the UK [96, 104], Australia [102, 111], and the mainland US [98, 99, 106, 107] and Hawaii [97]. Others were set in Belgium [108], Finland [100], and Quebec [101].”
    Quote in the paperNot a substantial claim0 of 3 sources checked
    • cites [103] Tung, 2008, An extension of trust and TAM model with IDT in the adoption of the electronic logistics information system in HIS in the medical industry, Int J Med Inform source

      Not checked in the free run.

    • cites [109] Wu, 2007, Mobile computing acceptance factors in the healthcare industry: a structural equation model, Int J Med Inform source

      Not checked in the free run.

    • cites [110] Chen, 2007, Obstacles to the adoption of radio frequency identification technology in the emergency rooms of hospitals, Int J Electron Healthcare source

      Not checked in the free run.

  • May combine two claims.

    Findingcitation

    Only one set of reviewed studies focused on electronic medical records, and it evaluated only a trial system temporarily.

    “Surprisingly, only one set of studies focused on EMR [107], although it was only a trial system that was temporarily evaluated by study participants.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites [107] Liu, 2006, Perceived system performance: a test of an extended technology acceptance model, Database Adv Inform Syst source

      Not checked in the free run.

  • May combine two claims.

    Findingcitation

    The added variables in reviewed studies included perceived IT system characteristics, personal characteristics of users, organizational characteristics, and psychological variables such as ownership and trust.

    “The list of added variables includes various perceived IT system characteristics such as how well the system performs [96, 107, 112] and how relevant it is to one’s job [106], personal characteristics of users [98, 105, 106], characteristics of the organization such as readiness for IT or technical support [98, 105, 106, 109], and psychological variables such as ownership [101] and trust [103].”
    Quote in the paperNot a substantial claim0 of 3 sources checked
    • cites [96] Barker, 2003, Evaluating a spoken dialogue system for recording clinical observations during an endoscopic examination, Med Inform Internet Med source

      Not checked in the free run.

    • cites [107] Liu, 2006, Perceived system performance: a test of an extended technology acceptance model, Database Adv Inform Syst source

      Not checked in the free run.

    • cites [112] Liu, 2005, The impact of service level on the acceptance of application service oriented medical records, Inform Manag source

      Not checked in the free run.

  • May combine two claims.

    Findingcitation

    Perceived ease of use may not be as likely to affect acceptance, but it appears to correlate with perceived usefulness.

    “Whether the IT is perceived to be easy to use may not be as likely to affect acceptance, but it does appear to correlate with usefulness, perhaps reflecting the notion that IT that is difficult to use cannot possibly be perceived as useful [40].”
    Quote in the paperSubstantial claim0 of 1 sources checked
    • cites [40] Davis, 1989, User acceptance of computer technology: a comparison of 2 theoretical models, Manag Sci source

      Not checked in the free run.

  • May combine two claims.

    Findingcitation

    One reviewed study tested TAM2, two tested UTAUT, and two tested a hybrid of UTAUT, TAM, and TPB.

    “One study tested TAM2 [97], two tested UTAUT [108, 110], and two tested some hybrid of UTAUT, TAM and TPB [99, 105].”
    Quote in the paperNot a substantial claim0 of 3 sources checked
    • cites [97] Chismar WG, Wiley-Patton S. Test of the technology acceptance model for the internet in pediatrics. In: Proceedings of the annual symposium of the American medical informatics association; 2002. p. 155–9.

      Not checked in the free run.

    • cites [108] Duyck, 2008, User acceptance of a picture archiving and communication system. Applying the unified theory of acceptance and use of technology in a radiological setting, Methods Inf Med source

      Not checked in the free run.

    • cites [110] Chen, 2007, Obstacles to the adoption of radio frequency identification technology in the emergency rooms of hospitals, Int J Electron Healthcare source

      Not checked in the free run.

  • May combine two claims.

    Findingcitation

    Most reviewed studies began with TAM as a conceptual framework and either removed or added predictor variables.

    “Most studies began with TAM as a conceptual framework and removed [32, 102, 104] or added predictor variables [49, 96, 98, 100, 101, 103, 106, 107, 109].”
    Quote in the paperNot a substantial claim0 of 3 sources checked
    • cites [32] Hu, 1999, Examining the technology acceptance model using physician acceptance of telemedicine technology, J Manag Inform Syst source

      Not checked in the free run.

    • cites [102] Rawstorne P, Jayasuriya R, Caputi P. Issues in predicting and explaining usage behaviors with the technology acceptance model and the theory of planned behavior when usage is mandatory. In: Proceedings of the 21st international conference on information systems; 2000. p. 35–44.

      Not checked in the free run.

    • cites [104] Van Schaik, 2002, Clinical acceptance of a low-cost portable system for postural assessment, Behav Inf Technol source

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Findingcitation

    Five reviewed studies collected data from a mix of physicians, nurses, pharmacists, and medical technicians.

    “Five studies collected data from a mix of physicians, nurses, pharmacists, and medical technicians [106-110].”
    Quote in the paperNot a substantial claim0 of 5 sources checked
    • cites [106] Liang, 2003, PDA usage in healthcare professionals: testing an extended technology acceptance model, Int J Mobile Commun source

      Not checked in the free run.

    • cites [107] Liu, 2006, Perceived system performance: a test of an extended technology acceptance model, Database Adv Inform Syst source

      Not checked in the free run.

    • cites [108] Duyck, 2008, User acceptance of a picture archiving and communication system. Applying the unified theory of acceptance and use of technology in a radiological setting, Methods Inf Med source

      Not checked in the free run.

    • cites [109] Wu, 2007, Mobile computing acceptance factors in the healthcare industry: a structural equation model, Int J Med Inform source

      Not checked in the free run.

    • cites [110] Chen, 2007, Obstacles to the adoption of radio frequency identification technology in the emergency rooms of hospitals, Int J Electron Healthcare source

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Findingnone given

    Subjective norm was consistently defined with respect to the opinions of important others about an individual's use of health IT.

    “Subjective norm (SN), or social influence, was consistently defined with respect to the opinions of important others about an individual’s use of health IT.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Findingcitation

    Some reviewed studies compared TAM to another model, such as TPB.

    “Sometimes, the researchers compared TAM to another model, for example, TPB [48, 102].”
    Quote in the paperNot a substantial claim0 of 2 sources checked
    • cites [48] Chau, 2001, Information technology acceptance by individual professionals: a model comparison approach, Decision Sci source

      Not checked in the free run.

    • cites [102] Rawstorne P, Jayasuriya R, Caputi P. Issues in predicting and explaining usage behaviors with the technology acceptance model and the theory of planned behavior when usage is mandatory. In: Proceedings of the 21st international conference on information systems; 2000. p. 35–44.

      Not checked in the free run.

  • May combine two claims.

    Findingown data

    The measures of PU followed the conventional definition of PU as enhancing personal job performance, with productivity and effectiveness dimensions dominating over other outcomes such as efficiency and quality.

    “Those measures followed the conventional definition of PU as enhancing (personal) job performance, although the productivity and effectiveness dimensions dominated, compared to other useful health IT use outcomes that could be measured, such as efficiency, quality, and so on.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Findingown data

    Among the reviewed studies, voluntary IT use was more common in studies with non-significant SN effects, while mandatory IT use was more common in studies with significant SN effects.

    “In opposition to that hypothesis, in three of four studies with non-significant SN effects, IT use was voluntary [49,97] or was perceived to be voluntary [108], and IT use was mandatory in two of four studies with significant SN effects [102,110].”
    Quote in the paperNot a substantial claim0 of 5 sources checked
    • cites [49] Chau, 2002, Examining a model of information technology acceptance by individual professionals: an exploratory study, J Manag Inform Syst source

      Not checked in the free run.

    • cites [97] Chismar WG, Wiley-Patton S. Test of the technology acceptance model for the internet in pediatrics. In: Proceedings of the annual symposium of the American medical informatics association; 2002. p. 155–9.

      Not checked in the free run.

    • cites [108] Duyck, 2008, User acceptance of a picture archiving and communication system. Applying the unified theory of acceptance and use of technology in a radiological setting, Methods Inf Med source

      Not checked in the free run.

    • cites [102] Rawstorne P, Jayasuriya R, Caputi P. Issues in predicting and explaining usage behaviors with the technology acceptance model and the theory of planned behavior when usage is mandatory. In: Proceedings of the 21st international conference on information systems; 2000. p. 35–44.

      Not checked in the free run.

    • cites [110] Chen, 2007, Obstacles to the adoption of radio frequency identification technology in the emergency rooms of hospitals, Int J Electron Healthcare source

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Findingcitation

    Some PEOU dimensions reflect specific aspects of usability such as learnability and memorability.

    “It is notable that some of those dimensions reflect specific aspects of usability such as learnability and memorability [117].”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites [117] Nielsen, 1993

      Not checked in the free run.

  • May combine two claims.

    Findingcitation

    Definitions based on Davis's original TAM focused on personal performance, while those based on UTAUT did not, but neither explicitly referred to performance benefits for other care team members, referring specialists, or patients' families.

    “Whereas definitions based on those of Davis’s original TAM [39, 40] focused on personal performance, those based on UTAUT [51] did not, but they also did not explicitly refer to performance benefits for other members of the care team, referring specialists, or patients’ families.”
    Quote in the paperNot a substantial claim0 of 3 sources checked
    • cites [39] Davis, 1989, Perceived usefulness, perceived ease of use, and user acceptance of information technology, MIS Q source

      Not checked in the free run.

    • cites [40] Davis, 1989, User acceptance of computer technology: a comparison of 2 theoretical models, Manag Sci source

      Not checked in the free run.

    • cites [51] Venkatesh, 2003, User acceptance of information technology: toward a unified view, MIS Q source

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Findingnone given

    Perceived ease of use was defined either as the lack of physical or mental effort or simply as 'ease of use.'

    “Perceived ease of use (PEOU) was either defined as the lack of (physical or mental) effort or simply as “ease of use.””
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Findingcitation

    Some reviewed studies did not provide formal construct definitions, although all clearly referred to the original TAM or UTAUT and probably had similar definitions.

    “Some studies did not provide formal construct definitions [32, 97, 98, 102], although all clearly referred to the original TAM or UTAUT, and probably had definitions similar to the above.”
    Quote in the paperNot a substantial claim0 of 3 sources checked
    • cites [32] Hu, 1999, Examining the technology acceptance model using physician acceptance of telemedicine technology, J Manag Inform Syst source

      Not checked in the free run.

    • cites [97] Chismar WG, Wiley-Patton S. Test of the technology acceptance model for the internet in pediatrics. In: Proceedings of the annual symposium of the American medical informatics association; 2002. p. 155–9.

      Not checked in the free run.

    • cites [98] Horan TA, Tulu B, Hilton B, Burton J. Use of online systems in clinical medical assessments: an analysis of physician acceptance of online disability evaluation systems. In: Proceedings of the 37th Hawaii international conference on system sciences; 2004. p. 1–10. source

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Findingreasoning

    Some dimensions of usefulness referred to the process of performance, while others referred to the outcome.

    “Some of those dimensions of usefulness referred to the process of performance (e.g., easier work process) and others to the outcome (e.g., better quality of care).”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Findingown data

    The direct route of social influence was almost always the same, but the source of social influence varied in specificity and type.

    “Thus, the direct route of social influence—through others having an influential opinion about another’s health IT use—was almost always the same, but the source of social influence varied in specificity (e.g., “important others” versus “important other pediatricians”) and type (e.g., “colleagues” versus “subordinates”).”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Findingcitation

    It was unclear from the definitions whether usefulness referred to enhanced performance process or enhanced performance outcomes.

    “It was unclear from either definitions whether usefulness referred to enhanced performance process (e.g., fewer steps, more information for decision making) or enhanced performance outcomes (e.g., faster care, more accurate decisions) [116].”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites [116] Karsh, 2006, A human factors engineering paradigm for patient safety—designing to support the performance of the health care professional, Qual Saf Health Care source

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Findingown data

    Studies of TAM in health care have been conducted in a wide variety of countries.

    “Interestingly, studies of TAM in health care have been conducted in a wide variety of countries.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Findingnone given

    Each construct was typically assessed with four or five items.

    “Each construct was typically assessed with four or five items.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Findingcitation

    Perceived behavioral control was defined variously as perceptions of existing infrastructure, internal and external resource constraints, or skills, resources, and opportunities necessary to use the system.

    “Perceived behavioral control (PBC), or facilitating conditions, was defined variously as perceptions of existing (a) infrastructure, (b) internal and external resource constraints, or (c) skills, resources, and opportunities necessary to use the system.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Findingreasoning

    Many relationships specified by TAM have been repeatedly validated in health care settings, and fairly large proportions of variance in intention to use or actual use have been explained.

    “The recent increase in the use of TAM appears justified, with many of the relationships specified by TAM repeatedly validated in health care settings and fairly large proportions of variance explained in the dependent variable (be it intention to use or actual use).”
    Quote in the paperSubstantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Findingcitation

    The definitions of perceived ease of use were somewhat limited and generic, not accounting for difficulty of low-effort but highly repetitive tasks or specific components of usability.

    “As with PU, the definitions were somewhat limited (e.g., they do not account for the difficulty of low-effort but highly repetitive tasks) and generic (e.g., not referring to specific components of usability [117]).”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites [117] Nielsen, 1993

      Not checked in the free run.

  • May combine two claims.

    Findingcitation

    PBC measures varied, with some asking about availability of knowledge or technical assistance, others about being able to use the system at work or for patient care, and one using a question about controllability.

    “PBC measures varied as well. Some measures asked about the availability of knowledge or technical assistance for using the system. Others asked generally about being able to use the system at work or for patient care. One study used a question about the dimension of PBC referred to as controllability by psychological theorists [120], which in the case of IT refers to the degree to which using the”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites [120] Ajzen, 2002, Perceived behavioral control, self-efficacy, locus of control, and the theory of planned behavior, J Appl Soc Psychol source

      Not checked in the free run.

  • May combine two claims.

    Findingreasoning

    In some reviewed studies, added variables were treated as independent predictors of intention to use or actual use of health IT; in others, added variables were used to predict TAM variables such as PEOU and PU.

    “In some cases, added variables were treated as independent predictors of intention to use or actual use of health IT, and in other cases added variables were used to predict TAM variables such as PEOU and PU.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Findingcitation

    The two reviewed studies with relatively strong perceived ease of use effects both had young, mostly non-physician samples in Taiwanese medical centers who had hands-on experience with the IT.

    “Indeed, the two studies with relatively strong PEOU effects both had young, mostly non-physician samples in Taiwanese medical centers who had hands-on experience with the IT [103, 109].”
    Quote in the paperSubstantial claim0 of 2 sources checked
    • cites [103] Tung, 2008, An extension of trust and TAM model with IDT in the adoption of the electronic logistics information system in HIS in the medical industry, Int J Med Inform source

      Not checked in the free run.

    • cites [109] Wu, 2007, Mobile computing acceptance factors in the healthcare industry: a structural equation model, Int J Med Inform source

      Not checked in the free run.

  • May combine two claims.

    Findingreasoning

    Some relationships in the reviewed studies have been inconsistent or consistently weak, raising the possibility of moderating effects or other theoretically important differences between studies.

    “Some relationships have been inconsistent (or consistently weak), raising the possibility of moderating effects or other theoretically important differences between studies.”
    Quote in the paperSubstantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Findingnone given

    In the reviewed studies, language is not always standardized, with adoption and acceptance used interchangeably and incorrectly.

    “Even the language used in the reviewed studies is not always standardized, with the terms adoption and acceptance used interchangeably and incorrectly.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Findingcitation

    In some reviewed studies, the effect of perceived ease of use is as strong as that of perceived usefulness, or stronger.

    “Perhaps so, but in some studies, the effect of PEOU is as strong as that of PU [103], if not much stronger [109].”
    Quote in the paperNot a substantial claim0 of 2 sources checked
    • cites [103] Tung, 2008, An extension of trust and TAM model with IDT in the adoption of the electronic logistics information system in HIS in the medical industry, Int J Med Inform source

      Not checked in the free run.

    • cites [109] Wu, 2007, Mobile computing acceptance factors in the healthcare industry: a structural equation model, Int J Med Inform source

      Not checked in the free run.

  • May combine two claims.

    Findingcitation

    Many reviewed studies included a variety of health care professionals, and some compared the groups.

    “Many studies included a variety of health care professionals, and some compared the groups [108].”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites [108] Duyck, 2008, User acceptance of a picture archiving and communication system. Applying the unified theory of acceptance and use of technology in a radiological setting, Methods Inf Med source

      Not checked in the free run.

  • May combine two claims.

    Findingcitation

    The study by Yi et al. is one of few reviewed studies finding an effect of subjective norm, and it used three survey items referring to specific sources of social influence rather than general questions.

    “For example, the study of Yi et al [99] is one of few that find an effect of SN, and the authors used three survey items that referred to specific sources of social influence, colleagues, superiors, and subordinates rather than asking general questions (see Table 4).”
    Quote in the paperSubstantial claim0 of 1 sources checked
    • cites [99] Yi, 2006, Understanding information technology acceptance by individual professionals: toward an integrative view, Inform Manag source

      Not checked in the free run.

  • May combine two claims.

    Findingcitation

    Few studies have done beliefs elicitation work with respect to health IT, and none to the authors' knowledge have revised TAM based on such work.

    “Few have done this kind of beliefs elicitation work with respect to health IT [70, 72, 76, 96, 102], and none to our knowledge have revised TAM based on such work.”
    Quote in the paperSubstantial claim0 of 5 sources checked
    • cites [70] Van Schaik, 2004, The acceptance of a computerised decision-support system in primary care: a preliminary investigation, Behav Inf Technol source

      Not checked in the free run.

    • cites [72] Karsh, 2006, Toward a theoretical approach to medical error reporting system research and design, Appl Ergon source

      Not checked in the free run.

    • cites [76] Gagnon, 2003, An adaptation of the theory of interpersonal behaviour to the study of telemedicine adoption by physicians, Int J Med Inform source

      Not checked in the free run.

    • cites [96] Barker, 2003, Evaluating a spoken dialogue system for recording clinical observations during an endoscopic examination, Med Inform Internet Med source

      Not checked in the free run.

    • cites [102] Rawstorne P, Jayasuriya R, Caputi P. Issues in predicting and explaining usage behaviors with the technology acceptance model and the theory of planned behavior when usage is mandatory. In: Proceedings of the 21st international conference on information systems; 2000. p. 35–44.

      Not checked in the free run.

  • Classified as probably not a substantial claim.

    Interpretationreasoning

    Percentage variance explained values must be interpreted with caution because of substantial variability across studies.

    “Those values must be interpreted with caution, because of the substantial variability in studies.”
    Quote in the paperSubstantial claim
  • Probably not a substantial claim: may not pass S4 (based).

    Premisenone given

    TAM was not developed specifically in or for the health care context.

    “Yet, the TAM is not a model developed specifically in or for the health care context.”
    Quote in the paperNot a substantial claim
  • The quote only partly states this claim.

    Interpretationown data

    TAM has fared much better in later tests than in the initial Hong Kong studies.

    “In total, 16 datasets have been analyzed, and TAM has fared much better in later tests.”
    Quote in the paperSubstantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Interpretationcitation

    Definitions of perceived behavioral control differed, consistent with disagreement and variation in the psychological literature.

    “It is not surprising that definitions differed, given some of the disagreement and variation in how the construct is defined in the psychological literature [120, 121].”
    Quote in the paperNot a substantial claim0 of 2 sources checked
    • cites [120] Ajzen, 2002, Perceived behavioral control, self-efficacy, locus of control, and the theory of planned behavior, J Appl Soc Psychol source

      Not checked in the free run.

    • cites [121] Armitage, 1999, Distinguishing perceptions of control from self-efficacy: predicting consumption of a low-fat diet using the theory of planned behavior, J Appl Soc Psychol source

      Not checked in the free run.

  • Classified as probably not a substantial claim.

    Interpretationreasoning

    For physicians, social influence might come from patients, patient families, professional groups, regulatory agencies, employing organizations, insurance providers, fellow physicians, referring physicians, nurses, bosses, and others.

    “For a physician, social influence might come from patients, patient families, professional groups, regulatory agencies, employing organizations, insurance providers, fellow physicians, referring physicians, nurses, bosses, and others.”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Interpretationreasoning

    The generic definitions of TAM were differently interpreted in the reviewed studies, a potential sign of lacking theoretical explication of the constructs.

    “The generic definitions of TAM were differently interpreted, a potential sign of lacking theoretical explication of the constructs.”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Premisecitation

    TAM was developed outside of health care, and therefore some of its core concepts and measures may not appear relevant to health care investigators.

    “TAM was developed outside of health care, and therefore some of its core concepts and measures may not appear relevant to health care investigators [32].”
    Quote in the paperSubstantial claim0 of 1 sources checked
    • cites [32] Hu, 1999, Examining the technology acceptance model using physician acceptance of telemedicine technology, J Manag Inform Syst source

      Not checked in the free run.

  • May combine two claims.

    Interpretationreasoning

    The focus on personal productivity as a measure of usefulness may not be meaningful, and certainly not sufficient, in a health care context.

    “For example, the focus on personal productivity as a measure of usefulness may not be meaningful, and certainly not sufficient, in a health care context.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Premisecitation

    Davis and colleagues found that the two key beliefs were PEOU and PU, and defined them based on what was important to their test population of college students, such as defining PU in reference to personal productivity rather than patient outcomes.

    “They found out, based on this preliminary work, that the two key beliefs were PEOU and PU, and they defined those based on what was important to their test population; thus, for example, PU was defined in reference to improvements to personal productivity, as opposed to improvements in patient outcomes, because the participants in Davis’ study were college students, not clinicians.”
    Quote in the paperSubstantial claim0 of 1 sources checked
    • cites [40] Davis, 1989, User acceptance of computer technology: a comparison of 2 theoretical models, Manag Sci source

      Not checked in the free run.

  • May combine two claims.

    Interpretationreasoning

    TAM investigators in health care differently interpreted constructs defined the same way, suggesting lacking agreement or exposure.

    “At the very least, even if there are theoretic positions on and explanations of constructs, there may be lacking agreement or exposure, because TAM investigators in health care differently interpreted constructs defined the same way.”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Interpretationreasoning

    The sources and possibly the route of social influence may be different in health care compared to the other industries where TAM was developed and refined.

    “Similarly, the sources and maybe even the route of social influence may be different in health care compared to in the other industries where TAM was developed and refined.”
    Quote in the paperNot a substantial claim
  • Classified as probably not a substantial claim.

    Study design and conductreasoning

    Limited number of studies and missing information about measures in several studies make it difficult to formally assess the suspicion about poor match between construct operationalization and context.

    “It is difficult to formally assess our suspicion given the limited number of studies and missing information about measures in several studies.”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Study design and conductreasoning

    The variety in model specification across reviewed studies was so great that no single study tested the same model, and this greatly limits quantitative or qualitative comparison across studies.

    “At the same time, the variety in model specification—so great that not a single study tested the same model—greatly limits quantitative or qualitative comparison across studies.”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Study design and conductcitation

    Some reviewed studies aggregated data across professions, making comparisons possible but not carried out.

    “Although individual or profession-specific differences may not have been possible to study in homogeneous samples, such as those comprised of only young physicians [99, 109], all-females [103], or all-males [96], there were studies in which comparisons were possible but not carried out, such as the study aggregating data from physicians, nurses, and information systems department staff [110], one”
    Quote in the paperNot a substantial claim0 of 3 sources checked
    • cites [110] Chen, 2007, Obstacles to the adoption of radio frequency identification technology in the emergency rooms of hospitals, Int J Electron Healthcare source

      Not checked in the free run.

    • cites [106] Liang, 2003, PDA usage in healthcare professionals: testing an extended technology acceptance model, Int J Mobile Commun source

      Not checked in the free run.

    • cites [107] Liu, 2006, Perceived system performance: a test of an extended technology acceptance model, Database Adv Inform Syst source

      Not checked in the free run.

  • May combine two claims.

    Interpretationreasoning

    In different contexts, the variables needed to understand IT use and acceptance may differ, and the meaning of variables such as PU and PEOU may be drastically different.

    “In a different context, not only may there be differences in the variables needed to understand IT use and acceptance, but also the meaning of variables such as PU and PEOU may be drastically different.”
    Quote in the paperSubstantial claim
  • Classified as probably not a substantial claim. May combine two claims.

    Premisecitation

    Physicians and other health care providers differ from users of IT in other TAM studies, and the general health care context differs from the industries where TAM originated.

    “Those in health care who advocate the use of TAM commonly point out how different physicians and other health care providers are from the users of IT in other studies of TAM, and how the general health care context differs from that of the industries where TAM originated [30, 32, 58, 61, 96, 98, 100].”
    Quote in the paperSubstantial claim0 of 7 sources checked
    • cites [30] Yarbrough, 2007, Technology acceptance among physicians, Med Care Res Rev source

      Not checked in the free run.

    • cites [32] Hu, 1999, Examining the technology acceptance model using physician acceptance of telemedicine technology, J Manag Inform Syst source

      Not checked in the free run.

    • cites [58] Hennington, 2007, Information systems and healthcare XVI: physician adoption of electronic medical records: applying the UTAUT model in a healthcare context, Commun Assoc Inform Syst

      Not checked in the free run.

    • cites [61] Succi MJ, Walter ZD. Theory of user acceptance of information technologies: an examination of health care professionals. In: Proceedings of the 32nd Hawaii international conference on system sciences; 1999. p. 1–7. source

      Not checked in the free run.

    • cites [96] Barker, 2003, Evaluating a spoken dialogue system for recording clinical observations during an endoscopic examination, Med Inform Internet Med source

      Not checked in the free run.

    • cites [98] Horan TA, Tulu B, Hilton B, Burton J. Use of online systems in clinical medical assessments: an analysis of physician acceptance of online disability evaluation systems. In: Proceedings of the 37th Hawaii international conference on system sciences; 2004. p. 1–10. source

      Not checked in the free run.

    • cites [100] Han, 2005

      Not checked in the free run.

  • May combine two claims.

    Study design and conductnone given

    Reviewed studies tended to report psychometric properties of scale items, which were usually reasonable and did not differ substantially between studies.

    “Studies also tended to report the psychometric properties of scale items, which were usually reasonable and did not differ substantially between studies.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Premisecitation

    Over the life course of an IT, the relationships in TAM may change; for example, ease of use may be critical at first and less important as time goes by.

    “Studies of TAM have shown that over the life course of an IT, the relationships in the model may change; for example, ease of use may be critical at first and less important as time goes by [51, 100, 128].”
    Quote in the paperNot a substantial claim0 of 3 sources checked
    • cites [51] Venkatesh, 2003, User acceptance of information technology: toward a unified view, MIS Q source

      Not checked in the free run.

    • cites [100] Han, 2005

      Not checked in the free run.

    • cites [128] Agarwal, 1997, The role of innovation characteristics and perceived voluntariness in the acceptance of information technologies, Decision Sci source

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Interpretationreasoning

    A beliefs elicitation approach is compatible with the added variable approach because elicitation studies can suggest and support additional model variables.

    “Note that a beliefs elicitation approach is compatible with the added variable approach because elicitation studies can suggest and support additional model variables.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S2 (checkable).

    Interpretationcitation

    Empirical work may be necessary to determine whether new variables are relevant to health care and to contextualize them.

    “Although a purely theory-based approach—which might for instance add the compatibility variable from Rogers’ Innovation Diffusion Theory [63]—can be useful, empirical work may still be necessary to (a) determine whether those variables are relevant to health care, and (b) contextualize these new variables in order to determine, for example, what “compatibility” means in health care [57, 135].”
    Quote in the paperNot a substantial claim0 of 3 sources checked
    • cites [63] Rogers, 1995

      Not checked in the free run.

    • cites [57] Ammenwerth E, Iller C, Mahler C. IT-adoption and the interaction of task, technology and individuals: a fit framework and a case study. BMC Med Inform Decis Mak, 2006; 6. Available from: http://www.biomedcentral.com/1472-6947/6/3. source

      Not checked in the free run.

    • cites [135] Kaplan, 2001, Evaluating informatics applications—some alternative approaches: theory, social interactionism, and call for methodological pluralism, Int J Med Inform source

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S2 (checkable).

    Interpretationcitation

    Knowing the reasons for health IT use beliefs permits designers, policy makers, and others to take action and make changes.

    “This has practical implications because knowing the reasons for health IT use beliefs permits designers, policy makers, and others to take action and make changes, a benefit recognized by the authors of two studies reviewed here:”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S2 (checkable). May combine two claims.

    Interpretationnone given

    There is great interest in TAM in health care and ample opportunity for its success.

    “Overall, there is great interest in TAM in health care4 and ample opportunity for its success, but whether TAM evolves into a theory of health IT, as opposed to a theory for health IT, is still to be seen.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Interpretationreasoning

    TAM did a fair job predicting, and perhaps explaining, clinician end-user acceptance and use of health IT, but there is much room for improvement.

    “Although TAM did a fair job predicting, and perhaps explaining, clinician end-user acceptance and use of health IT, there is much room for improvement.”
    Quote in the paperSubstantial claim
  • Classified as probably not a substantial claim. May combine two claims.

    Interpretationreasoning

    Contextualization uncovers the specific and actionable meaning and causes of generic variables such as usefulness and ease of use, and helps determine the important others of subjective norms and the actual barriers and facilitators to IT use.

    “That is, contextualization uncovers the specific and, importantly, actionable meaning and causes of generic variables such as usefulness and ease of use, helps determine who are the “important others” of subjective norms and what are the actual barriers and facilitators to IT use.”
    Quote in the paperSubstantial claim
  • Classified as probably not a substantial claim.

    Interpretationreasoning

    Beliefs elicitation can develop an evolved model of health IT use and acceptance.

    “A final benefit of beliefs elicitation is its ability to develop what we call an evolved model of health IT use and acceptance.”
    Quote in the paperSubstantial claim
62 of 62
  • The paper relies on this without support.

    The 16 datasets analyzed in the review are representative of all studies of TAM in health care.

    “We reviewed 16 data sets analyzed in over 20 studies of clinicians using health IT for patient care.”
    “here we review a larger set of 16 data sets analyzed in 22 studies, including ones that were missed by the earlier review and ones that have been published since.”
  • The paper relies on this without support.

    The significance counts across reviewed studies are comparable enough to aggregate despite heterogeneity.

    “Table 5 summarizes which relationships specified by TAM and related models (Fig. 1) were significant and non-significant across the studies reviewed here.”
    “Certain TAM relationships were consistently found to be significant, whereas others were inconsistent.”
  • The paper relies on this without support.

    The reviewed studies' measures of TAM constructs are valid enough to test the theory.

    “How constructs were operationalized differed greatly between studies, as can be seen in Table 4.”
    “In general, it was not uncommon that a study’s definition for a construct did not match its operationalization.”
  • The paper relies on this without support.

    TAM is a well regarded theory of technology acceptance and use that has been widely researched outside of health care and has lately become an important theoretical tool for health IT research.

    “TAM is a well regarded theory of technology acceptance and use that has been widely researched outside of health care and has lately become an important theoretical tool for health IT research.”
  • The paper relies on this without support.

    TAM has a strong track record in numerous industries.

    “TAM has a strong track record in numerous industries; will it be a useful theoretical tool in health care?”
  • The paper relies on this without support.

    TAM was developed outside of health care.

    “TAM was developed outside of health care, and therefore some of its core concepts and measures may not appear relevant to health care investigators [32].”
6 of 6

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

  • Once healthcare professionals have a positive attitude towards the AI system, they are more likely to intend to use it.

    “Once healthcare professionals have a positive attitude towards the AI system, they are more likely to intend to use it.”

    From Generative AI in healthcare: an implementation science informed translational path on application, integration and governance (2024) · cites this paper as [57]

    Section 1.1 states that attitude toward using IT influences intention to use it, and Section 3.6 reports that this relationship was significant in five of six tests in the health-care studies reviewed. The paper addresses health IT generally, not AI systems specifically, so it does not establish the claim for that technology. (LLM, conf=0.88)

    Experimental — accuracy not yet measured
  • If healthcare professionals perceive the AI system as useful and easy to use, they are likely to develop a positive attitude towards using it.

    “If healthcare professionals perceive the AI system as useful and easy to use, they are likely to develop a positive attitude towards using it.”

    From Generative AI in healthcare: an implementation science informed translational path on application, integration and governance (2024) · cites this paper as [57]

    The Discussion (§4.1; page unavailable) finds strong evidence that perceived usefulness affects clinicians’ acceptance and use of health IT. It says ease of use is less likely to affect acceptance and does not establish that the two perceptions lead to a positive attitude toward an AI system specifically. (LLM, conf=0.88)

    Experimental — accuracy not yet measured
  • Clinician preferences were incorporated into Sepsis Watch to optimize ease of use and utility for end users.

    “Clinician preferences were incorporated to optimize the ease of use and utility for end users [39].”

    From Integrating a Machine Learning System Into Clinical Workflows: Qualitative Study (2020) · cites this paper as [39]

    The Discussion (§4.1; page not provided) recommends designing health IT to be useful and not difficult to use, supporting the stated design goal. It does not say that clinician preferences were incorporated into Sepsis Watch or establish that this design step occurred. (LLM, conf=0.84)

    Experimental — accuracy not yet measured
  • HOCOS is an evidence-based and theory-based psychosocial coping skills program based on CBT principles and the Technology Acceptance Model.

    “Hand Therapy Online Coping Skills (HOCOS) is an evidence-based and theory-based psychosocial coping skills program based on CBT principles [37] and the Technology Acceptance Model [54].”
  • External factors like social influence and facilitating conditions can influence the acceptance and use of a new technology.

    “In addition to these factors, the model also suggests that external factors like social influence and facilitating conditions can influence the acceptance and use of a new technology [57, 59].”

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

Each contradiction between two passages listed here was confirmed by an independent check.

  • Study 109 has incompatible descriptions of its sample

    Minor

    One passage groups study 109 with samples consisting only of young physicians; another describes its sample as mostly non-physicians.

  • Significant-study categories add up to nine, not eight

    Minor

    The listed categories contain 1 + 1 + 2 + 5 = 9 studies, although the sentence says there were eight.

    Reported 8 · recomputed 9

2 of 2

Cites

Flagged first, then by citations

Research works printed but not linked: 2

  1. Thompson, 2005, Computerized physician order entry, a factor in medication errors: descriptive analysis of events in the intensive care unit safety reporting system, J Clin Outcomes Manag, 12, 407
  2. Fisher ME. Using the technology acceptance model to measure pediatrician acceptance of practice management information systems. Doctoral dissertation. Fort Lauderdale-Davie, FL: Nova Southeastern University; 2002.

Cited by

Sorted by citations

Authors
Holden, R. J., & Karsh, B.-T.
Affiliations
University of Wisconsin–Madison (US)
Corresponding author
Holden, Richard J.
Venue
Journal of Biomedical Informatics
Publisher
Elsevier BV
Published
2010-02
Volume
43
Issue
1
Pages
159-172
ISSN
1532-0464 (ISSN-L)
OpenAlex
W2059146912
Cited by
2,669
References
160
Citations by year
2026: 289 · 2025: 312 · 2024: 226 · 2023: 221 · 2022: 223 · 2021: 192 · 2020: 171 · 2019: 182 · 2018: 145 · 2017: 160 · 2016: 123 · 2015: 113 · 2014: 92 · 2013: 90 · 2012: 64
FWCI
8.89
Type
journal article
Language
en
Open access
Locations
  • Journal of Biomedical Informatics (publishedVersion)
  • PubMed (publishedVersion)
  • Europe PMC (PubMed Central) (acceptedVersion)
  • PubMed Central (acceptedVersion)
Funders
  • University of Wisconsin-Madison
  • National Institutes of Health
  • Agency for Healthcare Research and Quality (R01 HS013610, T32 HS000083-11, HS000083)
  • U.S. National Library of Medicine (R01LM008923)
  • National Center for Research Resources (TL1RR025013)
Topics
  • Social Sciences › Decision Sciences › Information Systems and Management › Technology Adoption and User Behaviour
  • Health Sciences › Health Professions › Health Information Management › Electronic Health Records Systems
  • Social Sciences › Sociology and Political Science › Information Systems Theories and Implementation
Keywords
technology acceptance model, health information technology, health information technology adoption, end-user acceptance, health technology
MeSH terms
Algorithms, Attitude to Computers, Diffusion of Innovation, Health Services Research, Hospital Information Systems, Humans, Medical Informatics, Medical Laboratory Science, Medical Records Systems, Computerized, Biomedical Technology, PubMed

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Claims read by deepseek-v4.1-flash under definition version 3 (extract-v3) on 2026-09-28.

Classified by jev-1.13-20260917 (gold-guideline-v0.2) on 2026-09-28.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review