The DOI matches its Crossref record; 30 of the 32 references it cites were found in a registry or an index.
Determining Causes and Severity of End-User Frustration
Open accessAbstract
Although computers are beneficial to individuals and society, frequently users encounter frustrating experiences when using computers. This study represents an attempt to measure, in 111 participants, the frequency, the cause, and the level of severity of frustrating experiences. The data show that frustrating experiences happen on a frequent basis. The applications in which the frustrating experiences happened most frequently were Web browsing, e-mail, and word processing. The most-cited causes of frustrating experiences were error messages, dropped network connections, long download times, and hard-to-find features. The time lost due to frustrating experiences ranged from 47% to 53% of time spent on a computer, depending on the location and study method. After extreme cases were discarded, the time lost was still above 38%. These disturbing results should be a basis for future study.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source says what the claim attributes to it.
In the citing paper
“Thus, adding context to error messages to enable users to better understand the cause of the error may reduce frustration.63”
From A chatbot for hypertension self-management support: user-centered design, development, and usability testing (2023) · cites this paper as [63]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Designing the user interface: Strategies for effective human-computer interaction
(1993) · Applied Ergonomics · doi:10.1016/0003-6870(93)90471-k · Cited by 5,592
(1997) · Choice Reviews Online · doi:10.5860/choice.34-3702 · Cited by 4,872
Davis, F. D. (1993) · International Journal of Man-Machine Studies · doi:10.1006/imms.1993.1022 · Cited by 4,754
Dollard, J., Miller, N. E., Doob, L. W., Mowrer, O. H., & Sears, R. R. (1939) · Yale University Press eBooks · doi:10.1037/10022-000 · Cited by 3,920
Motivation through conscious goal setting
Locke, E. A. (1996) · Applied and Preventive Psychology · doi:10.1016/s0962-1849(96)80005-9 · Cited by 626
Shneiderman, B. (2000) · Communications of the ACM · doi:10.1145/332833.332843 · Cited by 622
Self-citationReliability and Factorial Validity of Computer Attitude Scales
Loyd, B. H., & Gressard, C. P. (1984) · Educational and Psychological Measurement · doi:10.1177/0013164484442033 · Cited by 615
Bias, R. G. (2005) · Elsevier eBooks · doi:10.1016/b978-012095811-5/50022-5 · Cited by 519
Development and Validation of the Computer Self-Efficacy Scale
Murphy, C. A., Coover, D., & Owen, S. V. (1989) · Educational and Psychological Measurement · doi:10.1177/001316448904900412 · Cited by 477
Design rules based on analyses of human error
Norman, D. A. (1983) · Communications of the ACM · doi:10.1145/2163.358092 · Cited by 461
(1989) · Health Care Management Review · doi:10.1097/00004010-198921000-00012 · Cited by 406
Training wheels in a user interface
Carroll, J. M., & Carrithers, C. (1984) · Communications of the ACM · doi:10.1145/358198.358218 · Cited by 345
The impact of computer anxiety and self‐efficacy upon performance
Brosnan, M. (1998) · Journal of Computer Assisted Learning · doi:10.1046/j.1365-2729.1998.143059.x · Cited by 290
Whatever Happened to the Frustration-Aggression Hypothesis?
Berkowitz, L. J. (1978) · American Behavioral Scientist · doi:10.1177/000276427802100505 · Cited by 194
A psychological investigation of long retrieval times on the World Wide Web
Ramsay, J. E., Barbesi, A., & Preece, J. J. (1998) · Interacting with Computers · doi:10.1016/s0953-5438(97)00019-2 · Cited by 164
Universal Usability: Pushing Human–Computer Interaction Research to Empower Every Citizen
Shneiderman, B. (2003) · Routledge eBooks · doi:10.4324/9781410609663-21 · Cited by 127
Self-citationA model of group satisfaction in computer-mediated communication and face-to-face meetings
Olaniran, B. A. (1996) · Behaviour and Information Technology · doi:10.1080/014492996120373 · Cited by 103
System response time and method of pay: Stress effects in computer‐based tasks
Schleifer, L. M., & Amick, B. C. (1989) · International Journal of Human-Computer Interaction · doi:10.1080/10447318909525955 · Cited by 92
The effect of network delay and media on user perceptions of web resources
Jacko, J. A., Sears, A., & Borella, M. S. (2000) · Behaviour and Information Technology · doi:10.1080/014492900750052688 · Cited by 88
Lazar, J. K. (2001) · Medical Entomology and Zoology · Cited by 65
Self-citationFrustrating the user on purpose
Riseberg, J., Klein, J., Fernandez, R., & Picard, R. W. (1998) · CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA) · doi:10.1145/286498.286715 · Cited by 56
An Examination of the Factor Structures of the Computer Attitude Scale
Nash, J. B., & Moroz, P. A. (1997) · Journal of Educational Computing Research · doi:10.2190/ngdu-h73e-xmr3-tg5j · Cited by 50
Reducing the gap between what users know and what they need to know
Baecker, R., Booth, K. S., Jovicic, S., McGrenere, J., & Moore, G. (2000) · Conference on Universal Usability · doi:10.1145/355460.355467 · Cited by 42
Navigation in Web applications
Shubin, H., & Meehan, M. M. (1997) · interactions · doi:10.1145/267505.267508 · Cited by 39
Sears, A., & Jacko, J. A. (2000) · Human-Computer Interaction · doi:10.1207/s15327051hci1501_02 · Cited by 25
Evaluating user satisfaction in a hospital environment: An exploratory study
Zviran, M. (1992) · Health Care Management Review · doi:10.1097/00004010-199201730-00007 · Cited by 24
Understanding Computer User Frustration: Measuring and Modeling the Disruption from Poor Designs
Bessière, K., Ceaparu, I., Lazar, J. K., Robinson, J. P., & Shneiderman, B. (2003) · Cited by 17
Self-citationA taxonomy of novice user perception of error on the Web
Lazar, J. K., Meiselwitz, G., & Norcio, A. F. (2004) · Universal Access in the Information Society · doi:10.1007/s10209-004-0095-9 · Cited by 12
Self-citationSystem and Training Design for End-User Error
Lazar, J. K., & Norcio, A. F. (2000) · IGI Global eBooks · doi:10.4018/978-1-878289-64-3.ch005 · Cited by 12
Self-citationPalanque, P. A., & Paternò, F. (1998) · Springer eBooks · doi:10.1007/978-1-4471-3425-1_13 · Cited by 6
Research works printed but not linked: 7
- Collins, C., Caputi, P., Rawstorne, P. & Jayasuriya, R. (1999). Correlates of end-user performance and satisfaction with the implementation of a statistical software package. In Proceedings of the 10th Australasian Conference on Information Systems (pp. 223-234).
- Compaq, Inc. (2001). Rage against the machine A Compaq survey. United Kingdom: Compaq Press Centre.
- Freud, S. (1958). Types of onset of neurosis. In J. Strachey (Ed.), The standard edition of the complete psychological works of Sigmund Freud (Vol. 12). London: Hogarth.
- Johnson, C. (1995). Time and the Web: Representing and reasoning about temporal properties of interaction with distributed systems time and space. Proceedings of the HCI '95 Conference on People and Computers (pp. 39-50). Cambridge, UK: Cambridge University Press.
- Lazar, J. & Huang, Y. (2003). Improved error message design in Web browsers. In J. Ratner (Ed.), Human factors and Web development (2nd ed., pp. 167-182). Mahwah, NJ: Lawrence Erlbaum Associates, Inc.
- Lazar, J. & Preece, J. (2001). Using electronic surveys to evaluate networked resources: From idea to implementation. In C. McClure & J. Bertot (Eds.), Evaluating networked information services: Techniques, policy, and issues (pp. 137-154). Medford, NJ: Information Today.
- Shneiderman, B. (1982). System message design: Guidelines and experimental results. In A. Badre & B. Shneiderman (Eds.), Directions in human/computer interaction (pp. 55-78). Norwood, NJ: Ablex.
Cited by
Sorted by citations
Understanding the impact of video quality on user engagement
Dobrian, F., Sekar, V., Awan, A., Stoica, I. G., Joseph, D. A., Ganjam, A., Zhan, J., & Zhang, H. (2011) · ACM SIGCOMM Conference (SIGCOMM) · doi:10.1145/2018436.2018478 · Cited by 674
Cheng, J., Bernstein, M. S., Danescu-Niculescu-Mizil, C., & Leskovec, J. (2017) · ACM Conference on Computer Supported Cooperative Work (CSCW) · doi:10.1145/2998181.2998213 · Cited by 499
Day, A., Paquet, S., Scott, N., & Hambley, L. (2012) · Journal of Occupational Health Psychology · doi:10.1037/a0029837 · Cited by 436
What Frustrates Screen Reader Users on the Web: A Study of 100 Blind Users
Lazar, J., Allen, A., Kleinman, J., & Malarkey, C. (2007) · International Journal of Human-Computer Interaction · doi:10.1080/10447310709336964 · Cited by 354
Self-citationHu, Y., Boyd-Graber, J. L., Satinoff, B., & Smith, A. (2013) · Machine Learning · doi:10.1007/s10994-013-5413-0 · Cited by 347
Metadata
- Authors
- Ceaparu, I., Lazar, J., Bessiere, K., Robinson, J., & Shneiderman, B.
- Affiliations
- University of Maryland, College Park (US)
- Towson University (US)
- Venue
- International Journal of Human-Computer Interaction
- Publisher
- Informa UK Limited
- Published
- 2004-09
- Volume
- 17
- Issue
- 3
- Pages
- 333-356
- ISSN
- 1044-7318 (ISSN-L)
- 1532-7590
- OpenAlex
- W2092207592
- Semantic Scholar
- 7eff871ce258420be2cdcaadf2f2aecf5df4330a
- Cited by
- 399
- References
- 32
- Citations by year
- 2026: 8 · 2025: 59 · 2024: 9 · 2023: 10 · 2022: 8 · 2021: 22 · 2020: 14 · 2019: 13 · 2018: 17 · 2017: 21 · 2016: 17 · 2015: 10 · 2014: 26 · 2013: 19 · 2012: 10
- FWCI
- 19.03
- Type
- journal article
- Language
- en
- Open access
- bronze
- doi.org
- Locations
- International Journal of Human-Computer Interaction (publishedVersion)
- University Libraries (University of Maryland) (submittedVersion)
- Funders
- National Science Foundation (0086143)
- Florida Institute of Technology
- Topics
- Physical Sciences › Computer Science › Human-Computer Interaction › Usability and User Interface Design
- Physical Sciences › Computer Science › Human-Computer Interaction › Innovative Human-Technology Interaction
- Social Sciences › Decision Sciences › Information Systems and Management › Technology Adoption and User Behaviour
- Keywords
- lost time, error messages, download time, web browsing, email, word processing, usability
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
