The DOI matches its Crossref record; 30 of the 32 references it cites were found in a registry or an index.
Determining Causes and Severity of End-User Frustration
Open accessAbstract
Although computers are beneficial to individuals and society, frequently users encounter frustrating experiences when using computers. This study represents an attempt to measure, in 111 participants, the frequency, the cause, and the level of severity of frustrating experiences. The data show that frustrating experiences happen on a frequent basis. The applications in which the frustrating experiences happened most frequently were Web browsing, e-mail, and word processing. The most-cited causes of frustrating experiences were error messages, dropped network connections, long download times, and hard-to-find features. The time lost due to frustrating experiences ranged from 47% to 53% of time spent on a computer, depending on the location and study method. After extreme cases were discarded, the time lost was still above 38%. These disturbing results should be a basis for future study.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source says what the claim attributes to it.
In the citing paper
“Thus, adding context to error messages to enable users to better understand the cause of the error may reduce frustration.63”
From A chatbot for hypertension self-management support: user-centered design, development, and usability testing (2023) · cites this paper as [63]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Designing the user interface: Strategies for effective human-computer interaction
(1993) · Applied Ergonomics · doi:10.1016/0003-6870(93)90471-k · Cited by 5,592
(1997) · Choice Reviews Online · doi:10.5860/choice.34-3702 · Cited by 4,872
Davis, F. D. (1993) · International Journal of Man-Machine Studies · doi:10.1006/imms.1993.1022 · Cited by 4,754
Dollard, J., Miller, N. E., Doob, L. W., Mowrer, O. H., & Sears, R. R. (1939) · Yale University Press eBooks · doi:10.1037/10022-000 · Cited by 3,920
Motivation through conscious goal setting
Locke, E. A. (1996) · Applied and Preventive Psychology · doi:10.1016/s0962-1849(96)80005-9 · Cited by 626
Shneiderman, B. (2000) · Communications of the ACM · doi:10.1145/332833.332843 · Cited by 622
Self-citationReliability and Factorial Validity of Computer Attitude Scales
Loyd, B. H., & Gressard, C. P. (1984) · Educational and Psychological Measurement · doi:10.1177/0013164484442033 · Cited by 615
Bias, R. G. (2005) · Elsevier eBooks · doi:10.1016/b978-012095811-5/50022-5 · Cited by 519
Development and Validation of the Computer Self-Efficacy Scale
Murphy, C. A., Coover, D., & Owen, S. V. (1989) · Educational and Psychological Measurement · doi:10.1177/001316448904900412 · Cited by 477
Design rules based on analyses of human error
Norman, D. A. (1983) · Communications of the ACM · doi:10.1145/2163.358092 · Cited by 461
Research works printed but not linked: 7
- Collins, C., Caputi, P., Rawstorne, P. & Jayasuriya, R. (1999). Correlates of end-user performance and satisfaction with the implementation of a statistical software package. In Proceedings of the 10th Australasian Conference on Information Systems (pp. 223-234).
- Compaq, Inc. (2001). Rage against the machine A Compaq survey. United Kingdom: Compaq Press Centre.
- Freud, S. (1958). Types of onset of neurosis. In J. Strachey (Ed.), The standard edition of the complete psychological works of Sigmund Freud (Vol. 12). London: Hogarth.
- Johnson, C. (1995). Time and the Web: Representing and reasoning about temporal properties of interaction with distributed systems time and space. Proceedings of the HCI '95 Conference on People and Computers (pp. 39-50). Cambridge, UK: Cambridge University Press.
- Lazar, J. & Huang, Y. (2003). Improved error message design in Web browsers. In J. Ratner (Ed.), Human factors and Web development (2nd ed., pp. 167-182). Mahwah, NJ: Lawrence Erlbaum Associates, Inc.
- Lazar, J. & Preece, J. (2001). Using electronic surveys to evaluate networked resources: From idea to implementation. In C. McClure & J. Bertot (Eds.), Evaluating networked information services: Techniques, policy, and issues (pp. 137-154). Medford, NJ: Information Today.
- Shneiderman, B. (1982). System message design: Guidelines and experimental results. In A. Badre & B. Shneiderman (Eds.), Directions in human/computer interaction (pp. 55-78). Norwood, NJ: Ablex.
Cited by
Sorted by citations
Items 301–399 of 399
Braman, J. (2009) · International Journal of Agent Technologies and Systems · doi:10.4018/jats.2009010105
Evaluating heuristic for EG portal design model
Mahmud, M., Hussin, A. R. C., Othman, N. K., & Dahlan, H. M. (2010) · International Symposium on Information Technology · doi:10.1109/itsim.2010.5561467
Exploring Privacy and Personalization in Information Retrieval Applications
Feild, H. A. (2019) · Scholarworks (University of Massachusetts Amherst) · doi:10.7275/x048-fw93
Designing Usable Websites with the Usability Engineering Approach
Daniel, A. O. (2010)
Gamification of Automotive User Interface Ex- ploration
Steinbach, E. G. (2013)
Citations for A Qualitative Research Project
Linton, N. J. (2009) · Illinois Digital Environment for Access to Learning and Scholarship (University of Illinois at Urbana-Champaign)
Effects of Big 5 Personality Traits on Outcomes for Error Encouragement and Error Avoidant Training
Leas, K. A. (2009) · OhioLink ETD Center (Ohio Library and Information Network)
An e-learning platform to support environmental compliance – part I: needs analysis and design
Brennan, A., Dimache, A., & Ersoy, N. (2007) · Research@THEA
Taming Webpage Complexity to Optimize User Experience on Mobile Devices
Butkiewicz, M. (2015) · eScholarship (California Digital Library)
Preventing denial-of-service attacks with packet symmetry
Wood, M. (2011) · cIRcle (University of British Columbia) · doi:10.14288/1.0052073
Jugoo, V. (2016) · ResearchSpace (University of KwaZulu-Natal)
Technology and ERP Documentation
Scott, J. E. (2008)
Braman, J. (2011) · IGI Global eBooks · doi:10.4018/978-1-60960-171-3.ch010
Gradient techniques for performance prediction and control in multitier systems
Sanders, W. H., & Chen, S. (2011)
Simmons, B. D. (2015) · NCSU Libraries Repository (North Carolina State University Libraries)
Okomgboeso, S. (2016) · Abu Dhabi International Petroleum Exhibition & Conference (ADIPEC) · doi:10.2118/183053-ms
Applying Statistical Process Control to Automate the Analysis of Performance Load Tests
Nguyen, T. (2017) · QSpace (Queen's University Library)
Take a Paws : Using cute media to alleviate computer frustration
Ku, D. T. (2017) · KTH Publication Database DiVA (KTH Royal Institute of Technology)
Jibb, L. (2016) · TSpace (University of Toronto)
Ye, Q. (2018) · UC Research Repository (University of Canterbury) · doi:10.26021/8248
Jagadish, H. V., Li, Q., & Nandi, A. (2015) · International Journal of Computational Science and Engineering · doi:10.1504/ijcse.2015.072651
Ordinary Search Engine Users Carrying Out Complex Search TasksPreprint
Singer, G., Norbisrath, U., & Lewandowski, D. (2012) · arXiv (Cornell University) · doi:10.48550/arxiv.1206.1492
iService: A Cloud-Based Scheduling Service for Efficient Usage of IoT Resources
Narayanan, A. S., Peng, Y., & Lagesse, B. (2019) · IEEE International Conference on Pervasive Computing and Communications Workshops (PerCom Workshops) · doi:10.1109/percomw.2019.8730800
Participatory Design of System Messages in Petroleum Fields Management Software
Ramos, P. A. T., dos Reis, J. C., dos Santos, A. A. D. S., & Schiozer, D. J. (2019) · Lecture notes in computer science · doi:10.1007/978-3-030-22636-7_35
Error Message Quality of Web Form: Assessment on Existing Parameters
Wiyono, B. S., & Rochimah, S. (2018) · International Seminar on Research of Information Technology and Intelligent Systems (ISRITI) · doi:10.1109/isriti.2018.8864256
UI sketching reskill for UX researchers
Hussein, I., Mahmud, M., Ibrahim, H., Ghazali, M., & Ahmad, A. A. (2019) · Asian CHI Symposium · doi:10.1145/3309700.3338461
A Reusable Approach to Software Support for Adaptive Navigation
Tao, Y. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-49713-2_19
Obremski, D., Wienrich, C., & Carolus, A. (2020) · Gesellschaft für Informatik (GI) · doi:10.18420/muc2020-ws105-377
Neuroergonomics Behind Culture: A Dynamic Causal Modeling (DCM) Study on Emotion
Pugh, Z. H., Huang, J., Lindquist, K. A., & Nam, C. S. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-60128-7_17
The Influence of Negative Emotion as Affective State on Conceptual Models Comprehension
Djurica, D., & Mendling, J. (2020) · Lecture notes in information systems and organisation · doi:10.1007/978-3-030-60073-0_16
Web-Based Homework versus Paper-Based Homework in United Arab Emirates Secondary Mathematics
Jenkins, S. E. (2021) · UCL Discovery (University College London)
Multi-dimensional optimization for cloud based multi-tier applications
Pu, C., & Jung, G. (2010) · ProQuest LLC eBooks
GestureMetrics - Optimizing the interpretation of FUSAMI data for usability analysis
Fernandes, A. C. C. S. (2014) · Portuguese National Funding Agency for Science, Research and Technology (RCAAP Project by FCT) · doi:10.34626/efnm-w453
Müller, J., Weinert, L., Svensson, L., Rivinius, R., Kreußer, M. M., & Heinze, O. (2021) · doi:10.2196/preprints.28871
Brough, P. A., O’Driscoll, M. P., Kalliath, T. J., Cooper, C. L., & Poelmans, S. (2009) · Edward Elgar Publishing eBooks · doi:10.4337/9781781952672.00019
Using Video Tutorials to Learn Maya 3D for Creative Outcomes
Wyeld, T. (2020) · IGI Global eBooks · doi:10.4018/978-1-7998-3016-0.ch077
(2009) · Elsevier eBooks · doi:10.1016/b978-1-84334-473-5.50016-1
Searcher Struggle Detection via the Reversal TheoryPreprint
Luo, J., Yang, Y. R., Nayak, V., & Yang, G. H. (2022) · Research Square · doi:10.21203/rs.3.rs-1762506/v1
Daday, J. K. (2019) · American Educational Research Association Annual Meeting (AERA) · doi:10.3102/1439465
Liu, W., Qiu, X., & Ma, K. (2025) · SSRN Electronic Journal · doi:10.2139/ssrn.5162783
Presidential assistants in higher education and their use of power, authority and influence
Sass, M. (2016) · Scholars Archive - University at Albany (University at Albany, State University of New York) · doi:10.54014/6y2b-cg7x
Hornbæk, K., Kristensson, P. O., & Oulasvirta, A. (2025) · Oxford University Press eBooks · doi:10.1093/oso/9780192864543.003.0005
Hornbæk, K., Kristensson, P. O., & Oulasvirta, A. (2025) · Oxford University Press eBooks · doi:10.1093/oso/9780192864543.003.0014
Hornbæk, K., Kristensson, P. O., & Oulasvirta, A. (2025) · Oxford University Press eBooks · doi:10.1093/oso/9780192864543.003.0024
Hornbæk, K., Kristensson, P. O., & Oulasvirta, A. (2025) · Oxford University Press eBooks · doi:10.1093/oso/9780192864543.003.0019
Hornbæk, K., Kristensson, P. O., & Oulasvirta, A. (2025) · Oxford University Press eBooks · doi:10.1093/oso/9780192864543.003.0032
Hornbæk, K., Kristensson, P. O., & Oulasvirta, A. (2025) · Oxford University Press eBooks · doi:10.1093/oso/9780192864543.003.0044
Hornbæk, K., Kristensson, P. O., & Oulasvirta, A. (2025) · Oxford University Press eBooks · doi:10.1093/oso/9780192864543.003.0041
Representations of user research
Hornbæk, K., Kristensson, P. O., & Oulasvirta, A. (2025) · Oxford University Press eBooks · doi:10.1093/oso/9780192864543.003.0015
Computational representations and models
Hornbæk, K., Kristensson, P. O., & Oulasvirta, A. (2025) · Oxford University Press eBooks · doi:10.1093/oso/9780192864543.003.0039
Hornbæk, K., Kristensson, P. O., & Oulasvirta, A. (2025) · Oxford University Press eBooks · doi:10.1093/oso/9780192864543.003.0034
Hornbæk, K., Kristensson, P. O., & Oulasvirta, A. (2025) · Oxford University Press eBooks · doi:10.1093/oso/9780192864543.003.0013 · Cited by 1
Hornbæk, K., Kristensson, P. O., & Oulasvirta, A. (2025) · Oxford University Press eBooks · doi:10.1093/oso/9780192864543.003.0022
Hornbæk, K., Kristensson, P. O., & Oulasvirta, A. (2025) · Oxford University Press eBooks · doi:10.1093/oso/9780192864543.003.0027
Hornbæk, K., Kristensson, P. O., & Oulasvirta, A. (2025) · Oxford University Press eBooks · doi:10.1093/oso/9780192864543.003.0009
Hornbæk, K., Kristensson, P. O., & Oulasvirta, A. (2025) · Oxford University Press eBooks · doi:10.1093/oso/9780192864543.003.0035
Hornbæk, K., Kristensson, P. O., & Oulasvirta, A. (2025) · Oxford University Press eBooks · doi:10.1093/oso/9780192864543.003.0036 · Cited by 1
Hornbæk, K., Kristensson, P. O., & Oulasvirta, A. (2025) · Oxford University Press eBooks · doi:10.1093/oso/9780192864543.003.0040
Hornbæk, K., Kristensson, P. O., & Oulasvirta, A. (2025) · Oxford University Press eBooks · doi:10.1093/oso/9780192864543.003.0031
Hornbæk, K., Kristensson, P. O., & Oulasvirta, A. (2025) · Oxford University Press eBooks · doi:10.1093/oso/9780192864543.003.0029
Growing into the HCI discipline
Hornbæk, K., Kristensson, P. O., & Oulasvirta, A. (2025) · Oxford University Press eBooks · doi:10.1093/oso/9780192864543.003.0045
Hornbæk, K., Kristensson, P. O., & Oulasvirta, A. (2025) · Oxford University Press eBooks · doi:10.1093/oso/9780192864543.003.0010
Hornbæk, K., Kristensson, P. O., & Oulasvirta, A. (2025) · Oxford University Press eBooks · doi:10.1093/oso/9780192864543.003.0016
Hornbæk, K., Kristensson, P. O., & Oulasvirta, A. (2025) · Oxford University Press eBooks · doi:10.1093/oso/9780192864543.003.0007
Hornbæk, K., Kristensson, P. O., & Oulasvirta, A. (2025) · Oxford University Press eBooks · doi:10.1093/oso/9780192864543.003.0026
Hornbæk, K., Kristensson, P. O., & Oulasvirta, A. (2025) · Oxford University Press eBooks · doi:10.1093/oso/9780192864543.003.0038
Hornbæk, K., Kristensson, P. O., & Oulasvirta, A. (2025) · Oxford University Press eBooks · doi:10.1093/oso/9780192864543.002.0003
Hornbæk, K., Kristensson, P. O., & Oulasvirta, A. (2025) · Oxford University Press eBooks · doi:10.1093/oso/9780192864543.003.0042
Hornbæk, K., Kristensson, P. O., & Oulasvirta, A. (2025) · Oxford University Press eBooks · doi:10.1093/oso/9780192864543.003.0043
Hornbæk, K., Kristensson, P. O., & Oulasvirta, A. (2025) · Oxford University Press eBooks · doi:10.1093/oso/9780192864543.003.0011
Hornbæk, K., Kristensson, P. O., & Oulasvirta, A. (2025) · Oxford University Press eBooks · doi:10.1093/oso/9780192864543.003.0008 · Cited by 1
Hornbæk, K., Kristensson, P. O., & Oulasvirta, A. (2025) · Oxford University Press eBooks · doi:10.1093/oso/9780192864543.003.0020
Hornbæk, K., Kristensson, P. O., & Oulasvirta, A. (2025) · Oxford University Press eBooks · doi:10.1093/oso/9780192864543.003.0006
Hornbæk, K., Kristensson, P. O., & Oulasvirta, A. (2025) · Oxford University Press eBooks · doi:10.1093/oso/9780192864543.003.0028 · Cited by 3
Hornbæk, K., Kristensson, P. O., & Oulasvirta, A. (2025) · Oxford University Press eBooks · doi:10.1093/oso/9780192864543.003.0004
Hornbæk, K., Kristensson, P. O., & Oulasvirta, A. (2025) · Oxford University Press eBooks · doi:10.1093/oso/9780192864543.003.0030
Hornbæk, K., Kristensson, P. O., & Oulasvirta, A. (2025) · Oxford University Press eBooks · doi:10.1093/oso/9780192864543.003.0033
Introduction to understanding people
Hornbæk, K., Kristensson, P. O., & Oulasvirta, A. (2025) · Oxford University Press eBooks · doi:10.1093/oso/9780192864543.003.0002
Hornbæk, K., Kristensson, P. O., & Oulasvirta, A. (2025) · Oxford University Press eBooks · doi:10.1093/oso/9780192864543.003.0025
Hornbæk, K., Kristensson, P. O., & Oulasvirta, A. (2025) · Oxford University Press eBooks · doi:10.1093/oso/9780192864543.003.0012
Hornbæk, K., Kristensson, P. O., & Oulasvirta, A. (2025) · Oxford University Press eBooks · doi:10.1093/oso/9780192864543.003.0021
Heuristic design for e-government portal
Othman, N. K. (2009)
About time : Temporality in interaction
Krampell, M. (2014) · KTH Publication Database DiVA (KTH Royal Institute of Technology)
Enabling direct manipulation of plain-text output for template programs
Zan, T., He, X., & Hu, Z. (2025) · Journal of Systems and Software · doi:10.1016/j.jss.2025.112754
Colombo, M. (2026) · Fuzzy management methods · doi:10.1007/978-3-031-98472-3_6
Lian, T., & Zhu, Q. (2026) · SSRN Electronic Journal · doi:10.2139/ssrn.6412575
Optimizing the use of SSVEP-based brain-computer interfaces for human-computer interaction
Évain, A. (2016) · theses.fr (ABES) · doi:10.70675/a2acdacdz2271z4334z9e1dz869ee8760420 · Cited by 1
Haulet, M. B. (2017) · theses.fr (ABES) · doi:10.70675/480e2382z954ez4bc2z975ezae06d6419ffa
Mining User Forums to Evaluate Quality-in-Use of Environmental Software
Hastings, Y. D., Carver, J. C., Muneza, A. R. M., Payn, R. A., Ewing, S. A., Warnat, S., & Reinhold, A. M. (2026) · IEEE SoutheastCon · doi:10.1109/southeastcon63549.2026.11476204
Li, Z., Zhen, Y., Hara, T., Wang, Y., & Ota, J. (2026) · Procedia CIRP · doi:10.1016/j.procir.2026.05.195
Lins, S., Greulich, M., Pienta, D., Thatcher, J. B., & Sunyaev, A. (2026) · Information Systems Research · doi:10.1287/isre.2023.0626
Chen, X., Liu, J., Chen, Q., & Li, L. (2026) · Frontiers in Psychology · doi:10.3389/fpsyg.2026.1870991
The Impact of Waiting Time Distributions on QoE of Task-Based Web Browsing Sessions
Islam, N., & Elepe, V. J. D. (2014)
Metadata
- Authors
- Ceaparu, I., Lazar, J., Bessiere, K., Robinson, J., & Shneiderman, B.
- Affiliations
- University of Maryland, College Park (US)
- Towson University (US)
- Venue
- International Journal of Human-Computer Interaction
- Publisher
- Informa UK Limited
- Published
- 2004-09
- Volume
- 17
- Issue
- 3
- Pages
- 333-356
- ISSN
- 1044-7318 (ISSN-L)
- 1532-7590
- OpenAlex
- W2092207592
- Semantic Scholar
- 7eff871ce258420be2cdcaadf2f2aecf5df4330a
- Cited by
- 399
- References
- 32
- Citations by year
- 2026: 8 · 2025: 59 · 2024: 9 · 2023: 10 · 2022: 8 · 2021: 22 · 2020: 14 · 2019: 13 · 2018: 17 · 2017: 21 · 2016: 17 · 2015: 10 · 2014: 26 · 2013: 19 · 2012: 10
- FWCI
- 19.03
- Type
- journal article
- Language
- en
- Open access
- bronze
- doi.org
- Locations
- International Journal of Human-Computer Interaction (publishedVersion)
- University Libraries (University of Maryland) (submittedVersion)
- Funders
- National Science Foundation (0086143)
- Florida Institute of Technology
- Topics
- Physical Sciences › Computer Science › Human-Computer Interaction › Usability and User Interface Design
- Physical Sciences › Computer Science › Human-Computer Interaction › Innovative Human-Technology Interaction
- Social Sciences › Decision Sciences › Information Systems and Management › Technology Adoption and User Behaviour
- Keywords
- lost time, error messages, download time, web browsing, email, word processing, usability
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review