The DOI matches its Crossref record; 82 of the 82 references it cites were found in a registry or an index.
Web Site Usability, Design, and Performance Metrics
Abstract
Web sites provide the key interface for consumer use of the Internet. This research reports on a series of three studies that developand validate Web site usability, design and performance metrics, including download delay, navigability, site content, interactivity, and responsiveness. The performance metric that was developed includes the subconstructs user satisfaction, the likelihood of return, and the frequency of use. Data was collected in 1997, 1999, and 2000 from corporate Web sites via three methods, namely, a jury, third-party ratings, and a software agent. Significant associations between Web site design elements and Web site performance indicate that the constructs demonstrate good nomological validity. Together, the three studies provide a set of measures with acceptable validity and reliability. The findings also suggest lack of significant common methods biases across the jury-collected data, third-party data, and agent-collected data. Results suggest that Web site success is a first-order construct. Moreover, Web site success is significantly associated with Web site download delay (speed of access and display rate within the Web site), navigation (organization, arrangement, layout, and sequencing), content (amount and variety of product information), interactivity (customization and interactivity), and responsiveness (feedback options and FAQs).
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
The Measurement of Observer Agreement for Categorical Data
Landis, J. R., & Koch, G. G. (1977) · Biometrics · doi:10.2307/2529310 · Cited by 81,148
Coefficient Alpha and the Internal Structure of Tests
Cronbach, L. J. (1951) · Psychometrika · doi:10.1007/bf02310555 · Cited by 43,931
A Coefficient of Agreement for Nominal Scales
Cohen, J. (1960) · Educational and Psychological Measurement · doi:10.1177/001316446002000104 · Cited by 42,398
Structural equation modeling in practice: A review and recommended two-step approach
Anderson, J. C., & Gerbing, D. W. (1988) · Psychological Bulletin · doi:10.1037/0033-2909.103.3.411 · Cited by 41,941
Convergent and discriminant validation by the multitrait-multimethod matrix.
Campbell, D. T., & Fiske, D. W. (1959) · Psychological Bulletin · doi:10.1037/h0046016 · Cited by 17,116
A Paradigm for Developing Better Measures of Marketing Constructs
Churchill, G. A. (1979) · Journal of Marketing Research · doi:10.1177/002224377901600110 · Cited by 16,549
The Practice of Social Research
Neustadtl, A., & Babbie, E. (1989) · Teaching Sociology · doi:10.2307/1318433 · Cited by 14,398
Review of Psychometric theory (2nd ed.).
SITGREAVES, R. (1979) · Contemporary Psychology: A Journal of Reviews · doi:10.1037/018882 · Cited by 11,425
Applied Multivariate Statistical Analysis.
Johnson, A. R., & Wichern, D. W. (1988) · Biometrics · doi:10.2307/2531616 · Cited by 11,353
(1979) · Medical Entomology and Zoology · Cited by 11,252
Information Systems Success: The Quest for the Dependent Variable
DeLone, W. H., & McLean, E. R. (1992) · Information Systems Research · doi:10.1287/isre.3.1.60 · Cited by 10,697
(1993) · Cited by 9,879
Organizational Information Requirements, Media Richness and Structural Design
Daft, R. L., & Lengel, R. H. (1986) · Management Science · doi:10.1287/mnsc.32.5.554 · Cited by 9,868
The Practice of Social Research.
Williams, D. G., & Babbie, E. R. (1976) · Contemporary Sociology · doi:10.2307/2062956 · Cited by 7,194
Structural Equation Modeling and Regression: Guidelines for Research Practice
Gefen, D., Straub, D., & Boudreau, M.-C. (2000) · Communications of the Association for Information Systems · doi:10.17705/1cais.00407 · Cited by 6,416
Quasi-experimentation: Design and analysis issues for field settings
Shrout, P. E. (1980) · Evaluation and Program Planning · doi:10.1016/0149-7189(80)90063-4 · Cited by 6,010
Marketing in Hypermedia Computer-Mediated Environments: Conceptual Foundations
Hoffman, D. L., & Novak, T. P. (1996) · Journal of Marketing · doi:10.1177/002224299606000304 · Cited by 5,625
Perceived Usefulness, Ease of Use, and Usage of Information Technology: A Replication
Adams, D. A., Nelson, R. R., & Todd, P. A. (1992) · MIS Quarterly · doi:10.2307/249577 · Cited by 3,084
Sherry, J. F., & Sternthal, B. (1992) · Cited by 2,915
Designing the user interface strategies for effective human-computer interaction
Shneiderman, B. (1987) · ACM SIGBIO Newsletter · doi:10.1145/25065.950626 · Cited by 2,798
The Usability Engineering Lifecycle
NIELSEN, J. (1993) · Usability Engineering · doi:10.1016/b978-0-08-052029-2.50007-3 · Cited by 2,657
Validating Instruments in MIS Research1
Straub, D. W. (1989) · MIS Quarterly · doi:10.2307/248922 · Cited by 2,526
Message Equivocality, Media Selection, and Manager Performance: Implications for Information Systems
Daft, R. L., Lengel, R. H., & Trevino, L. K. (1987) · MIS Quarterly · doi:10.2307/248682 · Cited by 2,322
Information Privacy: Measuring Individuals’ Concerns About Organizational Practices1
Smith, H. J., Milberg, S. J., & Burke, S. J. (1996) · MIS Quarterly · doi:10.2307/249477 · Cited by 2,266
Alba, J., Lynch, J., Weitz, B., Janiszewski, C., Lutz, R., Sawyer, A., & Wood, S. (1997) · Journal of Marketing · doi:10.1177/002224299706100303 · Cited by 2,232
Nielsen, J. (1999) · University of Maribor digital library (University of Maribor) · Cited by 1,634
Consumer Reactions to Electronic Shopping on the World Wide Web
Jarvenpaa, S. L., & Todd, P. A. (1996) · International Journal of Electronic Commerce · doi:10.1080/10864415.1996.11518283 · Cited by 1,603
Applied Multivariate Statistical Analysis
Ziegel, E. R., Johnson, R. A., & Wichern, D. W. (1999) · Technometrics · doi:10.2307/1271011 · Cited by 1,547
Petty, R. E., & Cacioppo, J. T. (1979) · Journal of Personality and Social Psychology · doi:10.1037//0022-3514.37.10.1915 · Cited by 1,529
Measurement of Observer Agreement
Kundel, H. L., & Polansky, M. (2003) · Radiology · doi:10.1148/radiol.2282011860 · Cited by 1,492
CHANNEL EXPANSION THEORY AND THE EXPERIENTIAL NATURE OF MEDIA RICHNESS PERCEPTIONS.
Carlson, J. R., & Zmud, R. W. (1999) · Academy of Management Journal · doi:10.2307/257090 · Cited by 1,270
Electronic Mail as the Medium of Managerial Choice
Markus, M. L. (1994) · Organization Science · doi:10.1287/orsc.5.4.502 · Cited by 1,073
Testing Media Richness Theory in the New Media: The Effects of Cues, Feedback, and Task Equivocality
Dennis, A. R., & Kinney, S. T. (1998) · Information Systems Research · doi:10.1287/isre.9.3.256 · Cited by 1,018
Validation in Information Systems Research: A State-of-the-Art Assessment1
Boudreau, M.-C., Gefen, D., & Straub, D. W. (2001) · MIS Quarterly · doi:10.2307/3250956 · Cited by 959
Measuring System Usage: Implications for IS Theory Testing
Straub, D., Limayem, M., & Karahanna-Evaristo, E. (1995) · Management Science · doi:10.1287/mnsc.41.8.1328 · Cited by 958
Measuring User Participation, User Involvement, and User Attitude
Barki, H., & Hartwick, J. (1994) · MIS Quarterly · doi:10.2307/249610 · Cited by 897
TREVINO, L. K., LENGEL, R. H., & DAFT, R. L. (1987) · Communication Research · doi:10.1177/009365087014005006 · Cited by 888
Commercial Scenarios for the Web: Opportunities and Challenges
Hoffman, D. L., Novak, T. P., & Chatterjee, P. (2006) · Journal of Computer-Mediated Communication · doi:10.1111/j.1083-6101.1995.tb00165.x · Cited by 812
RICE, R. E. (1993) · Human Communication Research · doi:10.1111/j.1468-2958.1993.tb00309.x · Cited by 724
Task Analyzability, Use of New Media, and Effectiveness: A Multi-Site Exploration of Media Richness
Rice, R. E. (1992) · Organization Science · doi:10.1287/orsc.3.4.475 · Cited by 628
SCHMITZ, J., & FULK, J. (1991) · Communication Research · doi:10.1177/009365091018004003 · Cited by 576
The "Science of the Sophomore" Revisited: From Conjecture to Empiricism
Gordon, M. E., Slade, L. A., & Schmitt, N. (1986) · The Academy of Management Review · doi:10.2307/258340 · Cited by 574
Recommendations for APA test standards regarding construct, trait, or discriminant validity.
Campbell, D. T. (1960) · American Psychologist · doi:10.1037/h0048255 · Cited by 560
Software measurement: a necessary scientific basis
Fenton, N. (1994) · IEEE Transactions on Software Engineering · doi:10.1109/32.268921 · Cited by 501
Web Site Usability: A Designer's Guide
Spool, J. M., Scanlon, T., Snyder, C., Schroeder, W., & DeAngelo, T. (1997) · Medical Entomology and Zoology · Cited by 490
The Real Value of Online Communities
Armstrong, A., & Hagel, J. (2000) · Knowledge and Communities · doi:10.1016/b978-0-7506-7293-1.50009-3 · Cited by 383
Suh, K. S. (1999) · Information & Management · doi:10.1016/s0378-7206(98)00097-4 · Cited by 383
Straub, D., & Karahanna, E. (1998) · Organization Science · doi:10.1287/orsc.9.2.160 · Cited by 358
An Examination Of The Validity Of Two Models Of Attitude
Bagozzi, R. P. (1981) · Multivariate Behavioral Research · doi:10.1207/s15327906mbr1603_4 · Cited by 352
Research Commentary: Transformational Issues in Researching IS and Net-Enabled Organizations
Straub, D. W., & Watson, R. T. (2001) · Information Systems Research · doi:10.1287/isre.12.4.337.9706 · Cited by 280
Rice, R. E., & Shook, D. E. (1990) · Journal of Management Studies · doi:10.1111/j.1467-6486.1990.tb00760.x · Cited by 264
An emerging model of Web site design for marketing
Palmer, J. W., & Griffith, D. A. (1998) · Communications of the ACM · doi:10.1145/272287.272296 · Cited by 258
Self-citationVander Ark, S. D. (1973) · Journal of Music Therapy · doi:10.1093/jmt/10.3.167 · Cited by 258
Emerging trends in the WWW user population
Pitkow, J. E., & Kehoe, C. M. (1996) · Communications of the ACM · doi:10.1145/228503.228525 · Cited by 223
Current technological impediments to business-to-consumer electronic commerce
Rose, G. M., Khoo, H. M., & Straub, D. W. (1999) · Journal of the Association for Information Systems · doi:10.5555/374139.374140 · Cited by 201
Evaluating the World Wide Web: A Global Study of Commercial Sites
Ho, J. K. (2006) · Journal of Computer-Mediated Communication · doi:10.1111/j.1083-6101.1997.tb00066.x · Cited by 197
Formal methods in human-computer interaction
Harrison, M. D., & Thimbleby, H. (1990) · Cambridge University Press eBooks · Cited by 188
The Richness Imperative and Cognitive Style
Treviño, L. K., Lengel, R. H., Bodensteiner, W. D., Gerloff, E. A., & Muir, N. K. (1990) · Management Communication Quarterly · doi:10.1177/0893318990004002003 · Cited by 187
Griffith, D. A., Krampf, R. F., & Palmer, J. W. (2001) · International Journal of Electronic Commerce · doi:10.1080/10864415.2001.11044219 · Cited by 172
Self-citationA Holistic Methodology for Modeling Consumer Response to Innovation
Bagozzi, R. P. (1983) · Operations Research · doi:10.1287/opre.31.1.128 · Cited by 171
Cross-Cultural Comparison of Organizational Media Evaluation and Choice
Rice, R. E., D’Ambra, J. D., & More, E. (1998) · Journal of Communication · doi:10.1111/j.1460-2466.1998.tb02757.x · Cited by 129
The Effect of Download Time on Consumer Attitude Toward the e-Service Retailer
Rose, G. M., & Straub, D. W. (2001) · e-Service Journal · doi:10.2979/esj.2001.1.1.55 · Cited by 120
Selz, D., & Schubert, P. L. (1997) · Electronic Markets · doi:10.1080/10196789700000038 · Cited by 118
Marketing communication and the world wide web
Berthon, P. R., PITT, L. F., & Watson, R. T. (1996) · Business Horizons · doi:10.1016/s0007-6813(96)90063-4 · Cited by 117
Acceptance of communication media in organizations: richness or features?
El‐Shinnawy, M., & Markus, M. L. (1998) · IEEE Transactions on Professional Communication · doi:10.1109/47.735366 · Cited by 116
A heuristic evaluation of a World Wide Web prototype
Levi, M. D., & Conrad, F. G. (1996) · interactions · doi:10.1145/234813.234819 · Cited by 103
Approaches to the Interpretation of Relationships in the Multitrait-Multimethod Matrix
Alwin, D. F. (1973) · Sociological Methodology · doi:10.2307/270833 · Cited by 93
Dickson, P. R. (2000) · Journal of Consumer Research · doi:10.1086/314313 · Cited by 86
Schonberg, E., Cofino, T., Hoch, R., Podlaseck, M. E., & Spraragen, S. L. (2000) · Communications of the ACM · doi:10.1145/345124.345142 · Cited by 79
Cross-cultural comparison of organizational media evaluation and choice
Rice, R. E. (1998) · Journal of Communication · doi:10.1093/joc/48.3.3 · Cited by 79
The role of ease of use, usefulness and attitude in the prediction of World Wide Web usage
Lederer, A. L., Maupin, D. J., Sena, M. P., & Zhuang, Y. (1998) · ACM SIGCPR Conference on Computer Personnel Research (SIGCPR) · doi:10.1145/279179.279211 · Cited by 78
Rice, R. E., Hughes, D., & Love, G. (1989) · Office Technology and People · doi:10.1108/eum0000000003532 · Cited by 74
Leveraging the web for corporate success
Griffith, D. A., & Palmer, J. W. (1999) · Business Horizons · doi:10.1016/s0007-6813(99)80043-3 · Cited by 73
Self-citationInterjudge Agreement and the Maximum Value of Kappa
Umesh, U. N., Peterson, R. A., & Sauber, M. H. (1989) · Educational and Psychological Measurement · doi:10.1177/001316448904900407 · Cited by 67
Measuring the Efficiency of Web Site Traffic Generation
Alpar, P., Porembski, M., & Pickerodt, S. (2001) · International Journal of Electronic Commerce · doi:10.1080/10864415.2001.11044224 · Cited by 67
Ellsworth, J. H., & Ellsworth, M. V. (1994) · Cited by 55
The Effects of Argument Structure and Affective Tagging on Product Attitude Formation
Munch, J. M., Boller, G. W., & Swasy, J. L. (1993) · Journal of Consumer Research · doi:10.1086/209350 · Cited by 52
Can a lean e-mail medium be used for rich communication? A psychological perspective
Huang, W., Watson, R. T., & Wei, K. (1998) · European Journal of Information Systems · doi:10.1038/sj.ejis.3000302 · Cited by 42
Training Industry Trends 1997.
Bassi, L. J., Cheney, S., & Buren, M. V. (1997) · Training and development journal · Cited by 39
Task Characteristics, Managerial Socialization, and Media Selection
Donabedian, B., McKinnon, S. M., & Bruns, W. J. (1998) · Management Communication Quarterly · doi:10.1177/0893318998113002 · Cited by 37
D’Ambra, J. D., & Rice, R. E. (1994) · IEEE Transactions on Professional Communication · doi:10.1109/47.365170 · Cited by 37
Consumer strategies for the internet: four scenarios
Randall, D. (1997) · Long Range Planning · doi:10.1016/s0024-6301(96)00109-4 · Cited by 22
Research works printed but not linked: 38
- 10.2307/1251788 · DOI
- Alwin D., 1974, Sociological Methodology, 79
- Armstrong A., 1996, Harvard Bus. Rev., 74, 134
- Bagozzi R., 1980, Causal Methods in Marketing
- Barney D., 2000, Network World, 17, 56
- Berry J., 1999, Internetweek, 38
- Boling E., 1995, Seventh Annual Hypermedia Conf.
- Bort J., 1997, Software Magazine, 17, 65
- Buschke L., 1997, Training & Development, 51, 46
- Cohen J. B., 1997, Amer. Advertising, 13
- Evans P., 2000, Blown to Bits.
- Gefen D., 2000, Comm. AIS, 7, 1
- Gordon M., 1986, Acad. Management Rev., 11, 191
- 10.2307/1251841 · doi:10.2307/1251841 · Paper page
- 10.1057/palgrave.ejis.3000302 · doi:10.1057/palgrave.ejis.3000302
- Landis J., 1977, Biometrics, 22, 79
- Machlis S., 1998, Computerworld, 32
- Machlis S., 1998, Computerworld, 32, 43
- Messmer E., 1999, Network World, 16
- Neely A., 1998, Measuring Business Performance
- Niccolai J., 1997, Info World, 19, 62
- Nunnally J., 1967, Psychometric Theory
- Nunnally J., 1978, Psychometric Theory
- 10.1080/10196789700000029 · doi:10.1080/10196789700000029
- Pearrow M., 2000, Web Site Usability
- 10.1037/0022-3514.37.10.1915 · doi:10.1037/0022-3514.37.10.1915 · Paper page
- Picarille L., 1997, Comput. Reseller News, 757, 85
- Price M., 1997, Marketing News, 12
- Przystupa F., 1993, Interactive Interfaces and Human Networks, 85
- Radosevich L., 1997, Info World, 19, 81
- Rasmussen J., 1996, Comput. Canada, 22, 47
- Rose G., 1999, Comm. AIS, 1, 1
- Ross D., 2001, Amer. Bus. Rev., 19, 75
- Schubert P., 1998, Proc. 31st Hawaii Internat. Conf. Systems Sci.
- Shapiro C., 1999, Information Rules
- Spool J., 1997, Web Site Usability: A Designers Guide
- Stone M.L., 1999, Advertising Age's Bus. Marketing, 84, 19
- Wilson T., Internet week, 780
Cited by
The DeLone and McLean Model of Information Systems Success: A Ten-Year Update
(2003) · Journal of Management Information Systems · doi:10.1080/07421222.2003.11045748 · Cited by 11,791
Trust and TAM in Online Shopping: An Integrated Model1
Gefen, D., Karahanna, E., & Straub, D. W. (2003) · MIS Quarterly · doi:10.2307/30036519 · Cited by 8,635
Pavlou, P. A., & Fygenson, M. (2006) · MIS Quarterly · doi:10.2307/25148720 · Cited by 2,685
Inexperience and experience with online stores: the importance of TAM and trust
Gefen, D., Karahanna, E., & Straub, D. W. (2003) · IEEE Transactions on Engineering Management · doi:10.1109/tem.2003.817277 · Cited by 965
WebQual: An Instrument for Consumer Evaluation of Web Sites
Loiacono, E. T., Watson, R. T., & Goodhue, D. L. (2007) · International Journal of Electronic Commerce · doi:10.2753/jec1086-4415110302 · Cited by 812
Metadata
- Authors
- Palmer, J. W.
- Venue
- Information Systems Research
- Published
- 2002-06
- Volume
- 13
- Issue
- 2
- Pages
- 151-167
- ISSN
- 1047-7047 (ISSN-L)
- 1526-5536
- OpenAlex
- W2018668985
- Cited by
- 1,640
- References
- 82
- FWCI
- 65.54
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.