The DOI matches its Crossref record; 68 of the 68 references it cites were found in a registry or an index.
Reliability Generalization of Perceived Ease of Use, Perceived Usefulness, and Behavioral Intentions1
Abstract
A reliability generalization study (a meta-analysis of reliability coefficients) was conducted on three widely studied information systems constructs from the technology acceptance model (TAM): perceived ease of use, perceived usefulness, and behavioral intentions. This form of meta-analysis summarizes the reliability coefficients of the scores on a specified scale across studies and identifies the study characteristics that influence the reliability of these scores. Reliability is a critical issue in conducting empirical research as the reliability of the scores on well-established scales can vary with study characteristics, attenuating effect sizes. In conducting this study, an extensive literature search was conducted, with 380 articles reviewed and coded to perform reliability generalization. Study characteristics, including technology, sample, and measurement characteristics, for these articles were recorded along with effect size data for the relationships among these variables. After controlling for number of items, sample size, and sampling error, differences in reliability coefficients were found with several study characteristics for the three technology acceptance constructs. The reliability coefficients of PEOU and PU were lower in hedonic contexts than in utilitarian contexts, and were higher when the originally validated scales were used as compared to when other items were substituted. Only 27 percent of the studies that provided the measurement items used the original PEOU items, while 39 percent used the original PU items. Scales that were administered in English had higher reliability coefficients for PU and BI, with a marginal effect for PEOU. Reliability differences were also found for other study characteristics, including reliability type, subject experience, and gender composition. While average reliability coefficients were high, the results show that, on average, relationships among these constructs are attenuated by 12 percent with maximum attenuation in the range of 35 to 43 percent. Implications for technology acceptance research are discussed and suggestions for addressing variation in reliability coefficients across studies are provided.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Perceived usefulness, perceived ease of use, and user acceptance of information technology
Davis, F. D. (1989) · MIS Quarterly · doi:10.2307/249008 · Cited by 68,483
User Acceptance of Information Technology: Toward A Unified View1
Venkatesh, V., Morris, M. G., Davis, G. B., & Davis, F. D. (2003) · MIS Quarterly · doi:10.2307/30036540 · Cited by 45,035
Tversky, A., & Kahneman, D. (1974) · Science · doi:10.1126/science.185.4157.1124 · Cited by 28,810
User Acceptance of Computer Technology: A Comparison of Two Theoretical Models
Davis, F. D., Bagozzi, R. P., & Warshaw, P. R. (1989) · Management Science · doi:10.1287/mnsc.35.8.982 · Cited by 25,709 · cited 2×
“In the technology acceptance literature, the original scales proposed for PEOU and PU included six items (Davis 1989), but a concurrently published article supported the use of a four-item subset of these scales (Davis et al. 1989).”
BackgroundMethodMoore, G. C., & Benbasat, I. (1991) · Information Systems Research · doi:10.1287/isre.2.3.192 · Cited by 9,150
Understanding information technology usage: a test of competing models
Taylor, S., & Todd, P. A. (1995) · Information Systems Research · doi:10.1287/isre.6.2.144 · Cited by 8,815
What is coefficient alpha? An examination of theory and applications
Cortina, J. M. (1993) · Journal of Applied Psychology · doi:10.1037/0021-9010.78.1.98 · Cited by 8,810 · cited 1×
“In addition, a reliability coefficient will generally increase as the number of items increase and as the variance of the scores across subjects increase (Cortina 1983; Crocker and Algina 1986; Peter 1979), with low reliability coefficients shown to result from low score variance (e.”
BackgroundTrust and TAM in Online Shopping: An Integrated Model1
Gefen, D., Karahanna, E., & Straub, D. W. (2003) · MIS Quarterly · doi:10.2307/30036519 · Cited by 8,635
Technology Acceptance Model 3 and a Research Agenda on Interventions
Venkatesh, V., & Bala, H. (2008) · Decision Sciences · doi:10.1111/j.1540-5915.2008.00192.x · Cited by 8,159
Venkatesh, V. (2000) · Information Systems Research · doi:10.1287/isre.11.4.342.11872 · Cited by 6,664
Agarwal, R., & Karahanna, E. (2000) · MIS Quarterly · doi:10.2307/3250951 · Cited by 4,726
Why do people use information technology? A critical review of the technology acceptance model
Legris, P., Ingham, J., & Collerette, P. (2003) · Information & Management · doi:10.1016/s0378-7206(01)00143-4 · Cited by 4,250 · cited 1×
“IS research has recently reached the maturity level necessary for meaningful meta-analytic work, and thus we see metaanalytic studies in areas such as technology acceptance (King and He 2006; Legris et al. 2003; Ma and Liu 2004; Schepers and Wetzels 2007; Sharma et al. 2009; Wu and Lederer 2009), group support systems…”
BackgroundCohen, J. (1994) · American Psychologist · doi:10.1037/0003-066x.49.12.997 · Cited by 4,003
User Acceptance of Hedonic Information Systems1
van der Heijden, H. (2004) · MIS Quarterly · doi:10.2307/25148660 · Cited by 3,850
Hunter, J., & Schmidt, F. (2004) · doi:10.4135/9781412985031 · Cited by 3,023
Deci, E. L. (1975) · doi:10.1007/978-1-4613-4446-9 · Cited by 2,911
A Theoretical Integration of User Satisfaction and Technology Acceptance
Wixom, B. H., & Todd, P. A. (2005) · Information Systems Research · doi:10.1287/isre.1050.0042 · Cited by 2,835
Validation Guidelines for IS Positivist Research
Straub, D., & Gefen, D. (2004) · Communications of the Association for Information Systems · doi:10.17705/1cais.01324 · Cited by 2,797
Statistical methods in psychology journals: Guidelines and explanations.
Wilkinson, L., & Task Force on Statistical Inference (1999) · American Psychologist · doi:10.1037/0003-066x.54.8.594 · Cited by 2,791
The Technology Acceptance Model: Past, Present, and Future
Lee, Y., Kozar, K. A., & Larsen, K. R. T. (2003) · Communications of the Association for Information Systems · doi:10.17705/1cais.01250 · Cited by 2,572 · cited 1×
“Based on the growing maturity of the RG method (VachaHaase and Thompson 2011) and the wealth of empirical studies on technology acceptance (e.g., King and He 2006; Lee et al. 2003; Schepers and Wetzels 2007; Venkatesh et al. 2003; Wu and Lederer 2009), we proposed specific study characteristics, moderators, for which…”
MethodBuilding Effective Online Marketplaces with Institution-Based Trust
Pavlou, P. A., & Gefen, D. (2004) · Information Systems Research · doi:10.1287/isre.1040.0015 · Cited by 2,516
Wu, J.-H., & Wang, S.-C. (2005) · Information & Management · doi:10.1016/j.im.2004.07.001 · Cited by 2,284
Harrison McKnight, D., Choudhury, V., & Kacmar, C. (2002) · The Journal of Strategic Information Systems · doi:10.1016/s0963-8687(02)00020-3 · Cited by 2,164
Sears, D. O. (1986) · Journal of Personality and Social Psychology · doi:10.1037//0022-3514.51.3.515 · Cited by 2,119
Examining the technology acceptance model using physician acceptance of telemedicine technology
Hu, P. J., Chau, P. Y. K., Sheng, O. R. L., & Tam, K. Y. (1999) · Journal of Management Information Systems · doi:10.1080/07421222.1999.11518247 · Cited by 1,951
Empirical Evaluation of the Revised Technology Acceptance Model
Szajna, B. (1996) · Management Science · doi:10.1287/mnsc.42.1.85 · Cited by 1,656
Understanding e-learning continuance intention: An extension of the Technology Acceptance Model
Roca, J. C., Chiu, C.-M., & Martínez, F. J. (2006) · International Journal of Human-Computer Studies · doi:10.1016/j.ijhcs.2006.01.003 · Cited by 1,399
Testing the technology acceptance model across cultures: A three country study
Straub, D., Keil, M., & Brenner, W. (1997) · Information & Management · doi:10.1016/s0378-7206(97)00026-8 · Cited by 1,246
Venkatesh, V., Morris, M. G., & Ackerman, P. L. (2000) · Organizational Behavior and Human Decision Processes · doi:10.1006/obhd.2000.2896 · Cited by 1,237
Vijayasarathy, L. R. (2004) · Information & Management · doi:10.1016/j.im.2003.08.011 · Cited by 1,218
Acceptance of Internet-based learning medium: the role of extrinsic and intrinsic motivation
Lee, M. K. O., Cheung, C. M. K., & Chen, Z. (2005) · Information & Management · doi:10.1016/j.im.2003.10.007 · Cited by 1,184
The Role of Espoused National Cultural Values in Technology Acceptance1
Srite, M., & Karahanna, E. (2006) · MIS Quarterly · doi:10.2307/25148745 · Cited by 1,169
The development of initial trust in an online company by new customers
Koufaris, M., & Hampton-Sosa, W. (2004) · Information & Management · doi:10.1016/j.im.2003.08.004 · Cited by 1,114
Managing User Trust in B2C e-Services
Gefen, & Straub (2003) · e-Service Journal · doi:10.2979/esj.2003.2.2.7 · Cited by 1,074
Porter, C. E., & Donthu, N. (2006) · Journal of Business Research · doi:10.1016/j.jbusres.2006.06.003 · Cited by 1,066
Hassanein, K., & Head, M. (2007) · International Journal of Human-Computer Studies · doi:10.1016/j.ijhcs.2006.11.018 · Cited by 986
Inexperience and experience with online stores: the importance of TAM and trust
Gefen, D., Karahanna, E., & Straub, D. W. (2003) · IEEE Transactions on Engineering Management · doi:10.1109/tem.2003.817277 · Cited by 965
The acceptance and use of a virtual learning environment in China
van Raaij, E. M., & Schepers, J. J. L. (2008) · Computers & Education · doi:10.1016/j.compedu.2006.09.001 · Cited by 940
Wu, I.-L., & Chen, J.-L. (2005) · International Journal of Human-Computer Studies · doi:10.1016/j.ijhcs.2005.03.003 · Cited by 879
Gender differences in perceptions and relationships among dominants of e-learning acceptance
Ong, C.-S., & Lai, J.-Y. (2006) · Computers in Human Behavior · doi:10.1016/j.chb.2004.03.006 · Cited by 863
Hunter, J. E., & Schmidt, F. L. (2000) · International Journal of Selection and Assessment · doi:10.1111/1468-2389.00156 · Cited by 833 · cited 1×
“While every effort was made to identify all relevant articles, it is likely that some were missed, and thus a random-effects model(13) was employed for analysis (Hunter and Schmidt 2000).”
MethodHong, W., Thong, J. Y. L., Wong, W.-M., & Tam, K.-Y. (2002) · Journal of Management Information Systems · doi:10.1080/07421222.2002.11045692 · Cited by 827
Empirical examination of the adoption of WebCT using TAM
Ngai, E. W. T., Poon, J. K. L., & Chan, Y. H. C. (2007) · Computers & Education · doi:10.1016/j.compedu.2004.11.007 · Cited by 813
Roca, J. C., & Gagné, M. (2008) · Computers in Human Behavior · doi:10.1016/j.chb.2007.06.001 · Cited by 732
Chau, P. Y. K., & Hu, P. J. (2002) · Journal of Management Information Systems · doi:10.1080/07421222.2002.11045699 · Cited by 707
Information System Success: Individual and Organizational Determinants
Sabherwal, R., Jeyaraj, A., & Chowa, C. (2006) · Management Science · doi:10.1287/mnsc.1060.0583 · Cited by 685
The Technology Acceptance Model: A Meta-Analysis of Empirical Findings
Ma, Q., & Liu, L. (2004) · Journal of Organizational and End User Computing · doi:10.4018/joeuc.2004010104 · Cited by 660 · cited 1×
“IS research has recently reached the maturity level necessary for meaningful meta-analytic work, and thus we see metaanalytic studies in areas such as technology acceptance (King and He 2006; Legris et al. 2003; Ma and Liu 2004; Schepers and Wetzels 2007; Sharma et al. 2009; Wu and Lederer 2009), group support systems…”
BackgroundMobile computing acceptance factors in the healthcare industry: a structural equation model
Wu, J.-H., Wang, S.-C., & Lin, L.-M. (2007) · International Journal of Medical Informatics · doi:10.1016/j.ijmedinf.2006.06.006 · Cited by 603
Using Social Network Sites: The Effects of Playfulness, Critical Mass and Trust in a Hedonic Context
Sledgianowski, D., & Kulviwat, S. (2009) · Journal of Computer Information Systems · doi:10.1080/08874417.2009.11645342 · Cited by 568
What do data really mean? Research findings, meta-analysis, and cumulative knowledge in psychology.
Schmidt, F. L. (1992) · American Psychologist · doi:10.1037/0003-066x.47.10.1173 · Cited by 564 · cited 1×
“This aggregation enables us to control for sampling error, which typically accounts for much of the variance in individual study findings (Schmidt 1992), and demonstrates that the reliability of the scores for PEOU, PU, and BI do vary significantly across studies based on specific study characteristics.”
ResultTechnology use and performance: A field study of broker workstations
Lucas, H. C., & Spitler, V. K. (1999) · Decision Sciences · doi:10.1111/j.1540-5915.1999.tb01611.x · Cited by 561
What drives Malaysian m-commerce adoption? An empirical analysis
Tsu Wei, T., Marthandan, G., Yee‐Loong Chong, A., Ooi, K., & Arumugam, S. (2009) · Industrial Management & Data Systems · doi:10.1108/02635570910939399 · Cited by 550
Sharma, R., Yetton, P., & Crawford, J. (2009) · MIS Quarterly · doi:10.2307/20650305 · Cited by 496
Hsu, M.-H., Yen, C.-H., Chiu, C.-M., & Chang, C.-M. (2006) · International Journal of Human-Computer Studies · doi:10.1016/j.ijhcs.2006.04.004 · Cited by 490
TUNG, F., CHANG, S., & CHOU, C. (2008) · International Journal of Medical Informatics · doi:10.1016/j.ijmedinf.2007.06.006 · Cited by 476
Yoon, C. (2009) · Information & Management · doi:10.1016/j.im.2009.06.001 · Cited by 425
Kim, T. G., Lee, J. H., & Law, R. (2008) · Tourism Management · doi:10.1016/j.tourman.2007.05.016 · Cited by 369
The adoption of information technology in the sales force
Schillewaert, N., Ahearne, M. J., Frambach, R. T., & Moenaert, R. K. (2005) · Industrial Marketing Management · doi:10.1016/j.indmarman.2004.09.013 · Cited by 362
Schmidt, F. L., Le, H., & Ilies, R. (2003) · Psychological Methods · doi:10.1037/1082-989x.8.2.206 · Cited by 362 · cited 1×
“Some measurement error is always present and biases the estimated relationships among constructs (Schmidt et al. 2003), reducing or attenuating the observed correlation between two measured variables below the correlation of the true scores of the variables.”
BackgroundSenior citizens’ acceptance of information systems: A study in the context of e-government services
Phang, C. W., Sutanto, J., Kankanhalli, A., Li, Y., Tan, B. C. Y., & Teo, H.-H. (2006) · IEEE Transactions on Engineering Management · doi:10.1109/tem.2006.883710 · Cited by 331
Sharma, R., & Yetton, P. (2007) · MIS Quarterly · doi:10.2307/25148789 · Cited by 285
Those confounded moderators in meta-analysis: good, bad, and ugly
Lipsey, M. W. (2003) · The ANNALS of the American Academy of Political and Social Science · doi:10.1177/0002716202250791 · Cited by 283 · cited 1×
“Prior to conducting analyses, meta-analytic researchers need to consider whether moderators may be related to one another (Lipsey 2003), as correlations among moderators can confound results (Hunter and Schmidt 2004).”
MethodWu, J.-H., Shen, W.-S., Lin, L.-M., Greenes, R. A., & Bates, D. W. (2007) · International Journal for Quality in Health Care · doi:10.1093/intqhc/mzm074 · Cited by 235
Yin, P., & Fan, X. (2000) · Educational and Psychological Measurement · doi:10.1177/00131640021970466 · Cited by 197 · cited 7×
“Further, measurement characteristics such as scale version (Yin and Fan 2000) and reliability type (Capraro et al.”
BackgroundMethodInfluentialAnalyzing the past to prepare for the future
(2002) · MIS Quarterly · doi:10.5555/2017160.2017162 · Cited by 179
A model of user adoption of interface agents for email notification
Serenko, A. (2008) · Interacting with Computers · doi:10.1016/j.intcom.2008.04.004 · Cited by 92
Online Purchase Intentions: An Empirical Testing of a Multiple-Theory Model
Järveläinen, J. (2007) · Journal of Organizational Computing and Electronic Commerce · doi:10.1080/10919390701291000 · Cited by 86
Specifying Formative Constructs in Information Systems Research1
Petter, S., Straub, D., & Rai, A. (2007) · MIS Quarterly · doi:10.2307/25148814 · Cited by 32
Cited by
Morosan, C., & DeFranco, A. (2016) · International Journal of Hospitality Management · doi:10.1016/j.ijhm.2015.11.003 · Cited by 552
Amin, M., Rezaei, S., & Abolghasemi, M. (2014) · Nankai Business Review International · doi:10.1108/nbri-01-2014-0005 · Cited by 412
Mailizar, M., Burg, D., & Maulina, S. (2021) · Education and Information Technologies · doi:10.1007/s10639-021-10557-5 · Cited by 369
Hertzum (2017) · doi:10.1145/3127358 · Cited by 307
(2014) · Tuwhera (Auckland University of Technology) · Cited by 15
Metadata
- Authors
- Hess, T. J., McNab, A. L., & Basoglu, K. A.
- Venue
- MIS Quarterly
- Publisher
- MIS Quarterly
- Published
- 2014-03-01
- Volume
- 38
- Issue
- 1
- Pages
- 1-28
- ISSN
- 0276-7783 (ISSN-L)
- 2162-9730
- OpenAlex
- W1537795517
- Cited by
- 239
- References
- 68
- FWCI
- 51.41
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.