Cited by 399Usability and User Interface DesignInnovative Human-Technology InteractionTechnology Adoption and User Behaviour

Determining causes and severity of end-user frustration

Open access
Ceaparu, Irina, Lazar, Jonathan, Bessiere, Katie, Robinson, John, Shneiderman, Ben·2004·International Journal of Human-Computer Interaction

Abstract

Although computers are beneficial to individuals and society, frequently users encounter frustrating experiences when using computers. This study represents an attempt to measure, in 111 participants, the frequency, the cause, and the level of severity of frustrating experiences. The data show that frustrating experiences happen on a frequent basis. The applications in which the frustrating experiences happened most frequently were Web browsing, e-mail, and word processing. The most-cited causes of frustrating experiences were error messages, dropped network connections, long download times, and hard-to-find features. The time lost due to frustrating experiences ranged from 47% to 53% of time spent on a computer, depending on the location and study method. After extreme cases were discarded, the time lost was still above 38%. These disturbing results should be a basis for future study.

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1207/s15327590ijhc1703_3

Cites

30 of 30 references verified0 citation errors · 0 not checkable

Statistics

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Cites

Flagged first, then by citations

2 of the 32 references couldn’t be matched to a known paper.

Research works printed but not linked: 5

  1. [7]7. Collins, C., Caputi, P., Rawstorne, P., & Jayasuriya, R. (1999). Correlates of End-User Performance and Satisfaction with the Implementation of a Statistical Software Package. Proceedings of the 10 th Australasian Conference on Information Systems.
  2. [11]11. Freud, S. Types of Onset of Neurosis, in James Strachey, ed. (1958). The Standard Edition of the Complete Psychological Works of Sigmund Freud vol. 12. London: Hogarth Press.
  3. [13]13. Johnson, C. (1995). Time and the Web: Representing and Reasoning about Temporal Properties of Interaction with Distributed Systems Time and Space. Proceedings of the HCI'95 Conference on People and Computers, 39-50.
  4. [16]16. Lazar, J. and Huang, Y. (2003,in press). Improved Error Message Design in Web Browsers. In J. Ratner (ed.). Human Factors and Web Development (2 nd ed.). Mahwah, NJ: Lawrence Erlbaum Associates.
  5. [20]20. Lazar, J., & Preece, J. (2001). Using Electronic Surveys to Evaluate Networked Resources: From Idea to Implementation. In C. McClure & J. Bertot (Eds.), Evaluating Networked Information Services: Techniques, Policy, and Issues . Medford, NJ: Information Today, 137-154.

Cited by

Sorted by citations

Authors
Ceaparu, I., Lazar, J., Bessiere, K., Robinson, J., & Shneiderman, B.
Affiliations
  • University of Maryland, College Park (US)
  • Towson University (US)
Venue
International Journal of Human-Computer Interaction
Published
2004-09
Volume
17
Issue
3
Pages
333-356
ISSN
  • 1044-7318 (ISSN-L)
  • 1532-7590
OpenAlex
W2092207592
Cited by
399
References
32
Citations by year
2026: 8 · 2025: 59 · 2024: 9 · 2023: 10 · 2022: 8 · 2021: 22 · 2020: 14 · 2019: 13 · 2018: 17 · 2017: 21 · 2016: 17 · 2015: 10 · 2014: 26 · 2013: 19 · 2012: 10
FWCI
19.03
Type
journal article
Language
en
Open access
Locations
  • International Journal of Human-Computer Interaction (publishedVersion)
  • University Libraries (University of Maryland) (submittedVersion)
Funders
  • National Science Foundation (0086143)
  • Florida Institute of Technology
Topics
  • Physical Sciences › Computer Science › Human-Computer Interaction › Usability and User Interface Design
  • Physical Sciences › Computer Science › Human-Computer Interaction › Innovative Human-Technology Interaction
  • Social Sciences › Decision Sciences › Information Systems and Management › Technology Adoption and User Behaviour
Keywords
lost time, error messages, download time, web browsing, email, word processing, usability

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review