Number of people required for usability evaluation: the 10±2 rule
The DOI matches its Crossref record; 11 of the 11 references it cites were found in a registry or an index.
Abstract
Introduction Usability evaluation is essential to make sure that software products newly released are easy to use, efficient, and effective to reach goals, and satisfactory to users. For example, when a software company wants to develop and sell a new product, the company needs to evaluate usability of the new product before launching it at a market to avoid the possibility that the new product may contain usability problems, which span from cosmetic problems to severe functional problems. Three widely used methods for usability evaluation are Think Aloud (TA), Heuristic Evaluation (HE) and Cognitive Walkthrough (CW). TA method is commonly employed with a lab-based user testing, while there are variants of TA methods, including thinking out aloud at user's workplace instead of at labs. What we discuss here is the TA method that is combined with a lab-based user testing, in which test users use products while simultaneously and continuously thinking out aloud, and experimenters record users' behaviors and verbal protocols in the laboratory. HE is a usability inspection method, in which a small number of evaluators find usability problems in a user interface design by examining an interface and judging its compliance with well-known usability principles, called heuristics. CW is a theory-based method, in which evaluators evaluate every step necessary to perform a scenario-based task, and look for usability problems that would interfere with learning by exploration. These three methods have their own advantages and disadvantages. For instance, TA method provides good qualitative data from a small number of test users, but laboratory environment may influence test user's behaviors. HE is a cheap, fast and easy-to-use method, while it often finds too specific and low-priority usability problems, including even not real problems. CW helps find mismatches between users' and designers' conceptualization of a task, but it needs extensive knowledge of cognitive psychology and technical details to apply. However, even though these advantages and disadvantages show overall characteristics of three major usability evaluation methods, we cannot compare them quantitatively and see their efficiency clearly. Because one of reasons why so-called discounted methods, such as HE and CW, were developed is to save costs of usability evaluation, cost-related criteria for comparing usability evaluation are meaningful to usability practitioners as well as usability researchers. One of the most disputable issues related to cost of usability evaluation is sample size. That is, how many users or evaluators are needed to achieve a targeted usability evaluation performance, for example, 80% of overall discovery rate? The sample size of usability evaluation is known to depend on an estimate of problem discovery rate across participants. The overall discovery rate is a common quantitative measure that is used to show the effectiveness of a specific usability evaluation method in most of usability evaluation studies. It is also called overall detection rate or thoroughness measure, which is the ratio of 'the sum of unique usability problems detected by all experiment participants' against 'the number of usability problems that exist in the evaluated systems', ranging between 0 and 1. The overall discovery rates were reported more than any other criterion measure in the usability evaluation experiments and also a key component for projecting required sample size for usability evaluation study. Thus, how many test users or evaluators participate in the usability evaluation is a critical issue, considering its cost-effectiveness.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“However, a sample size of 10±2 is sufficient for discovering 80 per cent of usability issues [55].”
From A user-centred design framework for mHealth (2020) · cites this paper as [55]
Citations
Cites
Heuristic evaluation of user interfaces
Nielsen, J., & Molich, R. (1990) · Proceedings of the SIGCHI conference on Human factors in computing systems Empowering people - CHI '90 · doi:10.1145/97243.97281 · Cited by 3,533
Refining the Test Phase of Usability Evaluation: How Many Subjects Is Enough?
Virzi, R. A. (1992) · Human Factors: The Journal of the Human Factors and Ergonomics Society · doi:10.1177/001872089203400407 · Cited by 1,190
Estimating the number of subjects needed for a thinking aloud test
Nielsen, J. (1994) · International Journal of Human-Computer Studies · doi:10.1006/ijhc.1994.1065 · Cited by 476
Sample sizes for usability studies: Additional considerations
Lewis, J. R. (1994) · Human Factors: The Journal of the Human Factors and Ergonomics Society · doi:10.1177/001872089403600215 · Cited by 341
What is gained and lost when using evaluation methods other than empirical testing
Desurvire, H., Kondziela, J. M., & Atwood, M. E. (1993) · Cited by 107
Relaxing the homogeneity assumption in usability testing
Caulton, D. A. (2001) · Behaviour & Information Technology · doi:10.1080/01449290010020648 · Cited by 90
Law, L.-C., & Hvannberg, E. Þ. (2002) · Nordic Conference on Human-Computer Interaction · doi:10.1145/572020.572030 · Cited by 87
Evaluation of Procedures for Adjusting Problem-Discovery Rates Estimated From Small Samples
Lewis, J. R. (2001) · International Journal of Human-Computer Interaction · doi:10.1207/s15327590ijhc1304_06 · Cited by 72
Analysis of combinatorial user effect in international usability tests
Law, E. L., & Hvannberg, E. Þ. (2004) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/985692.985694 · Cited by 63
Novice heuristic evaluations of a complex interface
Slavković, A., & Cross, K. (1999) · CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA) · doi:10.1145/632716.632902 · Cited by 31
Cited by
Items 201–300 of 563
Measuring the Performance of the Virtual Teams in Global Software Development Projects
Gheni, A. Y., Jusoh, Y. Y., Jabar, M. A., Ali, N. M., Shanmugam, M., & Yousif, H. A. (2019) · Journal of Information Technology Management · doi:10.22059/jitm.2019.73269 · Cited by 9
Why 3D Cameras are Not Popular: A Qualitative User Study on Stereoscopic Photography Acceptance
Hakala, J., Westman, S., Salmimaa, M., Pölönen, M., Järvenpää, T., & Häkkinen, J. P. (2014) · 3D Research · doi:10.1007/s13319-013-0004-1 · Cited by 9
Yalçın, Ö. N., Lallé, S., & Conati, C. (2023) · ACM Transactions on Interactive Intelligent Systems · doi:10.1145/3578523 · Cited by 9
User Experience Evaluation Using the Cognitive Walkthrough Method
Nandhi, C. P. M. W., Irianto, A. B. P., Nastiti, P., Marsella, E., & Wibisono, Y. P. (2022) · doi:10.1145/3535782.3535814 · Cited by 9
Fighting Against XSS Attacks. A Usability Evaluation of OWASP ESAPI Output Encoding
Wijayarathna, C., & Arachchilage, N. A. G. (2019) · Hawaii International Conference on System Sciences (HICSS) · doi:10.24251/hicss.2019.877 · Cited by 9
User experience of mobile devices: a three layer method of evaluation
Alshehri, F., & Freeman, M. B. (2014) · Tuwhera (Auckland University of Technology) · Cited by 8
Schoormann, T., Behrens, D., Michael Fellmann, M. A., & Knackstedt, R. (2018) · IEEE Conference on Business Informatics · doi:10.1109/cbi.2018.00020 · Cited by 8
Nikou, S. A., Guliya, A., Verma, S. V., & Chang, M. (2024) · Lecture notes in computer science · doi:10.1007/978-3-031-63028-6_27 · Cited by 8
Nikou, S. A., & Chang, M. (2023) · Lecture notes in computer science · doi:10.1007/978-3-031-32883-1_31 · Cited by 8
What instruments do researchers use to evaluate LXD? A systematic review study
Tawfik, A. A., Payne, L., Ketter, H., & James, J. (2024) · Technology Knowledge and Learning · doi:10.1007/s10758-024-09763-0 · Cited by 8
A Usability Inspection Method for Model-driven Web Development Processes
Martínez, A. F. (2012) · RiuNet (Universitat Politècnica de València) · doi:10.4995/thesis/10251/17845 · Cited by 8
Gagnon‐Roy, M., Pinard, S., Bottari, C. L., Morellec, F. L., Laliberté, C., Lagha, R. B., Yaddaden, A., Pigot, H., Giroux, S., & Bier, N. (2022) · JMIR Rehabilitation and Assistive Technologies · doi:10.2196/28701 · Cited by 8
Immersive Authoring of 360 Degree Interactive Applications
de Farias, F. M., Mattos, D. P. D., Ghinea, G., & Muchaluat-Saade, D. C. (2022) · IEEE Access · doi:10.1109/access.2022.3217799 · Cited by 8
Usability Testing Pada Situs Web UKK PUSBANGKI Menggunakan Metode Cognitive Walkthrough
Hidayah, N. A., & Malik, D. A. (2023) · Jurnal Teknologi Dan Sistem Informasi Bisnis · doi:10.47233/jteksis.v5i4.1046 · Cited by 8
DG Comics: Semi-Automatically Authoring Graph Comics for Dynamic Graphs
Kim, J., Lee, H., Nguyen, D. M., Shin, M., Kwon, B. C., Ko, S., & Elmqvist, N. (2025) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2024.3456340 · Cited by 7
“The number of participants is consistent with prior work [17,34,54], aligning with recommendations for usability testing.”
ResultVargas, G. F. (2015) · Gredos (University of Salamanca) · doi:10.14201/gredos.129759 · Cited by 7
Evaluating Representativeness of Qualitative Text Data in Identifying UX Issues
Rhie, Y. L., Lim, J. H., & Yun, M. H. (2017) · International Journal of Human-Computer Interaction · doi:10.1080/10447318.2017.1294337 · Cited by 7
Guided Proofreading of Automatic Segmentations for ConnectomicsPreprint
Haehn, D., Kaynig, V., Tompkin, J., Lichtman, J. W., & Pfister, H. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1704.00848 · Cited by 7
System for Evaluating Usability and User Experience by Analyzing Repeated Patterns
Kim, Y., Kang, S.-J., & Kim, C. (2013) · Lecture notes in computer science · doi:10.1007/978-3-642-39229-0_35 · Cited by 7
Usevalia: Managing Inspection-Based Usability Audits
Sobrino‐Duque, R., de Gea, J. M. C., Jiménez, J. J. L., Nicolás, J., & Fernández‐Alemán, J. L. (2022) · International Journal of Human-Computer Interaction · doi:10.1080/10447318.2022.2121879 · Cited by 7
A Comparative Heuristic Evaluation of Kadi4Mat Through Human Evaluators and GPT-4
Meinecke, A., Heidrich, D., Dworatzyk, K., & Theis, S. (2024) · Lecture notes in computer science · doi:10.1007/978-3-031-76821-7_8 · Cited by 7
Lazarou, I., Nikolopoulos, S., Georgiadis, K., Oikonomou, V. P., Mariakaki, A., & Kompatsiaris, I. Y. (2022) · Frontiers in Digital Health · doi:10.3389/fdgth.2022.846963 · Cited by 7
Evaluating a Prototype Clinical Decision Support Tool for Chronic Pain Treatment in Primary Care
Allen, K. S., Danielson, E. C., Downs, S. M., Mazurenko, O., Diiulio, J., Salloum, R. G., Mamlin, B. W., & Harle, C. A. (2022) · Applied Clinical Informatics · doi:10.1055/s-0042-1749332 · Cited by 7
NAISC: An Authoritative Linked Data Interlinking Approach for the Library Domain
McKenna, L., Debruyne, C., & O’Sullivan, D. (2019) · ACM/IEEE Joint Conference on Digital Libraries · doi:10.1109/jcdl.2019.00012 · Cited by 7
Optimizing Usability Studies by Complementary Evaluation Methods
Schmettow, M., Bach, C., & Scapin, D. L. (2014) · Electronic workshops in computing · doi:10.14236/ewic/hci2014.15 · Cited by 7
Heuristic evaluation of Malay Folktales Animated Courseware for childhood education
Ibrahim, N., Ahmad, W. F. W., & Shafic, A. (2014) · International Conference on User Science and Engineering · doi:10.1109/iuser.2014.7002690 · Cited by 7
Intelligent Biohazard Training Based on Real-Time Task Recognition
Prendinger, H., Álvarez, N., Sánchez‐Ruiz, A. A., Cavazza, M., Catarino, J., Oliveira, J., Prada, R., Fujimoto, S., & Shigematsu, M. (2016) · ACM Transactions on Interactive Intelligent Systems · doi:10.1145/2883617 · Cited by 7
Kukec, M., Ljubić, S., & Glavinić, V. (2011) · Lecture notes in computer science · doi:10.1007/978-3-642-25364-5_15 · Cited by 7
Perez, H. R., Nick, M. W., Mateo, K. F., Squires, A. P., Sherman, S. E., Kalet, A. L., & Jay, M. R. (2016) · BMC Medical Informatics and Decision Making · doi:10.1186/s12911-016-0368-2 · Cited by 7
Billestrup, J., Bruun, A., & Stage, J. (2016) · Lecture notes in computer science · doi:10.1007/978-3-319-44902-9_4 · Cited by 7
Usability testing on touchscreen based electronic kiosk machine in convenience store
Kusumawati, R. E., Muslim, E., & Nugroho, D. (2020) · AIP conference proceedings · doi:10.1063/5.0000982 · Cited by 7
The effect of personality in sample selection for usability testing
Vassar, A. (2012) · UNSWorks (UNSW Sydney) · doi:10.26190/unsworks/15747 · Cited by 7
Assessing AI Explainability: A Usability Study Using a Novel Framework Involving Clinicians
Kibria, M. G., Kucirka, L. M., & Mostafa, J. (2025) · IEEE International Conference on Healthcare Informatics (ICHI) · doi:10.1109/ichi64645.2025.00069 · Cited by 6
Kim, S. K., Hwang, H. R., Byun, K. S., Park, S., Moon, S. H., & Lee, H. (2025) · INQUIRY The Journal of Health Care Organization Provision and Financing · doi:10.1177/00469580251343785 · Cited by 6
Orellano-Colón, E. M., Fernández-Torres, A. M., Figueroa-Alvira, N., Ortiz-Vélez, B., Rivera-Rivera, N. L., Torres-Ferrer, G. A., & Martín‐Payo, R. (2024) · Disabilities · doi:10.3390/disabilities4020020 · Cited by 6
Moon, S.-H., & Cho, I. Y. (2023) · The Journal of Continuing Education in Nursing · doi:10.3928/00220124-20231030-05 · Cited by 6
Heart rate sensors acceptability: Data reliability vs. ease of use
Simonnet, M., & Gourvennec, B. (2016) · Wearable and Implantable Body Sensor Networks · doi:10.1109/bsn.2016.7516239 · Cited by 6
Kühnel, S., Trang, S. T.-N., & Lindner, S. (2019) · Lecture notes in computer science · doi:10.1007/978-3-030-33223-5_31 · Cited by 6
Santos, B. S., Silva, S., Ferreira, B. Q., & Dias, P. (2017) · Lecture notes in computer science · doi:10.1007/978-3-319-58071-5_28 · Cited by 6
Geeraerts, J., Pivodic, L., de Nooijer, K., Naert, E., Crombez, G., Ridder, M. D., & den Block, L. V. (2024) · BMJ Open · doi:10.1136/bmjopen-2023-075752 · Cited by 6
Kim, J., Kim, M., & Seo, Y. (2023) · European Journal of Oncology Nursing · doi:10.1016/j.ejon.2023.102276 · Cited by 6
Tan, X., Li, Z., Suo, X., Li, W., Bi, L., & Yao, F. (2025) · The Visual Computer · doi:10.1007/s00371-025-04089-z · Cited by 6
Geeraerts, J., Pivodic, L., Rosquin, L., Naert, E., Crombez, G., Ridder, M. D., & den Block, L. V. (2024) · JMIR Cancer · doi:10.2196/57510 · Cited by 6
Allison, R., Hayes, C. V., Young, V. L., & McNulty, C. A. M. (2020) · JMIR Formative Research · doi:10.2196/14504 · Cited by 6
Sample Size in the Application of System Usability Scale to Automotive Interfaces
Chandran, S. K., Forbes, J. W., Bittick, C., Allanson, K., & Brinda, F. (2017) · SAE technical papers on CD-ROM/SAE technical paper series · doi:10.4271/2017-01-1383 · Cited by 6
What sample sizes do we need? Part 2: formative studies
Sauro, J., & Lewis, J. R. (2016) · Elsevier eBooks · doi:10.1016/b978-0-12-802308-2.00007-2 · Cited by 6
Sauro, J., & Lewis, J. R. (2012) · Elsevier eBooks · doi:10.1016/b978-0-12-384968-7.00007-2 · Cited by 6
Kim, S. H., Jin, J., Sevinchan, M., & Davies, A. (2023) · International Journal of Medical Informatics · doi:10.1016/j.ijmedinf.2023.105067 · Cited by 6
Designing Coordinated Multiple Views of Information Space
McEwan, T., Igoniderigha, N. E., & Benyon, D. (2014) · Electronic workshops in computing · doi:10.14236/ewic/hci2014.12 · Cited by 6
Li, J., & Liu, S. (2023) · IET Software · doi:10.1049/sfw2.12126 · Cited by 6
Report Friendly: An Interface Design for an LLM-Empowered ESG Report Generation System
Yu, X., Zhou, X., Lyu, S., Wang, X., Chen, H., & Miao, C. (2025) · Lecture notes in computer science · doi:10.1007/978-3-031-93418-6_16 · Cited by 6
Artificial Haptic Cues as Assistance for Simplified Vehicle Operations in Advanced Air Mobility
Janetzko, D., Linner, S., Zintl, M., Fu, W.-D. H., & Bengler, K. J. (2024) · IEEE Intelligent Vehicles Symposium · doi:10.1109/iv55156.2024.10588465 · Cited by 6
Klemets, J., & Toussaint, P. J. (2015) · Studies in health technology and informatics · doi:10.3233/978-1-61499-564-7-103 · Cited by 6
Tamanho Ótimo de Amostra para Análise do Desempenho de Estudantes em Ambientes Educacionais Ubíquos
Brant-Ribeiro, T., & Cattelan, R. G. (2015) · Anais do ... Simpósio Brasileiro de Informática na Educação/Anais do Simpósio Brasileiro de Informática na Educação · doi:10.5753/cbie.sbie.2015.31 · Cited by 6
Wijareni, N., Muhimmah, I., & Rani, S. (2023) · AUTOMATA · Cited by 6
Automated usability analysis and visualisation of eye tracking data
de Bruin, D. S., & Adre, J. (2014) · UpSpace Institutional Repository (University of Pretoria) · Cited by 6
Böhmer, M., Massler, P., Kühnel, S., Damarowsky, J., & Sackmann, S. (2025) · Behaviour and Information Technology · doi:10.1080/0144929x.2025.2463578 · Cited by 5
AURA: A Diagnostic Framework for Tracking User Satisfaction of Interactive Planning Agents
Kim, T., Singh, J., Mehri, S., Acikgoz, E. C., Mukherjee, S., Bozdag, N. B., Shashidhar, S., Tür, G., & Hakkani-Tur, D. Z. (2026) · IEEE Transactions on Audio Speech and Language Processing · doi:10.1109/taslpro.2026.3695295 · Cited by 5
Rapp, A., & Boldi, A. (2025) · Lecture notes in computer science · doi:10.1007/978-3-031-93508-4_21 · Cited by 5
Punchoojit, L., & Hongwarittorrn, N. (2019) · International HCI and UX Conference in Indonesia (CHIuXiD) · doi:10.1145/3328243.3328251 · Cited by 5
Twist, Shift, or Stack? - Usability Analysis of Geospatial Interactions on a Tangible Tabletop
Jones, C. E., & Maquil, V. (2015) · International Conference on Geographical Information Systems Theory, Applications and Management (GISTAM) · doi:10.5220/0005377601700177 · Cited by 5
Wong, C. L., Rana, T., & Leung, Y. M. (2020) · CIN Computers Informatics Nursing · doi:10.1097/cin.0000000000000635 · Cited by 5
User Requirements in Developing a Novel Dietary Assessment Tool for Children: Mixed Methods Study
van der Heijden, Z. S., de Gooijer, F. J., Camps, G., Lucassen, D. A., Feskens, E. J. M., Lasschuijt, M. P., & Brouwer-Brolsma, E. M. (2024) · JMIR Formative Research · doi:10.2196/47850 · Cited by 5
Tokmak, H. S., Doğusoy, B., & BİLGİÇ, K. (2020) · Eğitim Teknolojisi Kuram ve Uygulama · doi:10.17943/etku.639383 · Cited by 5
Big Data Confidentiality: An Approach Toward Corporate Compliance Using a Rule-Based System
Vranopoulos, G., Clarke, N., & Atkinson, S. (2023) · Big Data · doi:10.1089/big.2022.0201 · Cited by 5
Moon, S.-H., Jeon, H.-G., & Choi, M. J. (2025) · Clinical Simulation in Nursing · doi:10.1016/j.ecns.2025.101759 · Cited by 5
Choong, Y., & Salvendy, G. (2021) · doi:10.6028/nist.ir.8340 · Cited by 5
Self-citationTowards Indicators for HCI Quality Evaluation Support
Assila, A., de Oliveira, K. M., & Ezzedine, H. (2014) · Lecture notes in computer science · doi:10.1007/978-3-319-12256-4_19 · Cited by 5
Monitor and Control Human-Computer Interface for Unmanned Surface Vehicle Fleets
Laso, P. M., Brosset, D., & Giraud, M.-A. (2019) · MTS/IEEE OCEANS Conference (OCEANS) · doi:10.1109/oceanse.2019.8867172 · Cited by 5
Usability Evaluation on Website Using the Cognitive Walkthrough Method
Sugiarti, Y., Hanifah, S. R., Anwas, O. M., Sumanto, S., Anwar, S., Permatasari, A. D., & Nurmiati, E. (2023) · International Conference on Cyber and IT Service Management (CITSM) · doi:10.1109/citsm60085.2023.10455564 · Cited by 5
A Preliminary Study to Evaluate Graphical Passwords for Older Adults
Jittibumrungrak, P., & Hongwarittorrn, N. (2019) · International HCI and UX Conference in Indonesia (CHIuXiD) · doi:10.1145/3328243.3328255 · Cited by 5
Remy, B. (2017) · Cited by 5
Empirically evaluating virtual reality’s effect on reservoir engineering tasks
Lawton, B., Wang, N., Samoil, S., Daeijavad, P., Xie, S., Chen, Z., & Maurer, F. (2023) · Visual Informatics · doi:10.1016/j.visinf.2023.11.002 · Cited by 4
Heuristic evaluation of stock exchange mobile application in Malaysia
Hussain, A., Barakat, M. M., & Zaaba, Z. F. (2020) · Universiti Utara Malaysia Institutional Repository (Universiti Utara Malaysia) · Cited by 4
Lazar, J. K., Feng, J. H., & Hochheiser, H. (2017) · Elsevier eBooks · doi:10.1016/b978-0-12-805390-4.00015-7 · Cited by 4
Classification of Heuristics for Components of e-Learning
Whale, A. M., Scholtz, B. M., & Calitz, A. P. (2015) · South African Institute of Computer Scientists and Information Technologists · doi:10.1145/2815782.2815794 · Cited by 4
The Qualities of Convivial Tools and Their Relevance to Music Software Accessibility
Lucas, A., Cunningham, J. P., Harrison, J., Schroeder, F., & McPherson, A. (2025) · ACM Transactions on Accessible Computing · doi:10.1145/3733606 · Cited by 4
The Impact of Image Synonyms in Graphical-Based Authentication Systems
Sparks, J. W. (2015) · NSUWorks (Nova Southeastern University) · Cited by 4
McMullan, C., Turner, G., Retzer, A., Belli, A., Davies, E. H., Nice, L., Flavell, L., Flavell, J., & Calvert, M. (2025) · JMIR Formative Research · doi:10.2196/58128 · Cited by 4
Jati, H., Nurkhamid, N., & Wardani, R. (2018) · Journal of Physics Conference Series · doi:10.1088/1742-6596/1140/1/012038 · Cited by 4
Feature recognition in multiple CNNs using sEMG images from a prototype comfort test
Fu, Y.-L., Song, W., Xu, W., Lin, J., & Nian, X. (2023) · Computer Methods and Programs in Biomedicine · doi:10.1016/j.cmpb.2023.107897 · Cited by 4
In what ways does user experience design improve printed educational materials?
Kealey, M. R., Urakami, J., Henderson, K., Chignell, M., & Straus, S. E. (2023) · Applied Ergonomics · doi:10.1016/j.apergo.2023.104081 · Cited by 4
Usability Test of Serious Game Robot App for Hospitalized Children
Jinmeiling, & Kim, J. (2019) · Journal of the Korea Academia-Industrial cooperation Society · doi:10.5762/kais.2019.20.2.228 · Cited by 4
Cong, J., Chen, C., Liu, C., Meng, Y., & Zheng, Z. (2019) · Lecture notes in computer science · doi:10.1007/978-3-030-23535-2_32 · Cited by 4
Evaluating the Effectiveness and Efficiency of A Website Using Cognitive Walkthrough Method
Haryanto, T., Sholihah, M., Yuniarto, D., Sopandi, A., Kaffah, F. M., & Subiyakto, A. (2023) · International Conference on Cyber and IT Service Management (CITSM) · doi:10.1109/citsm60085.2023.10455690 · Cited by 4
Evaluation tools through user participation techniques: Features, limitations, and new perspectives
Charfi, S., & Ezzedine, H. (2014) · International Conference on Advanced Logistics and Transport (ICALT) · doi:10.1109/icadlt.2014.6864074 · Cited by 4
Designer-driven Procedural Game Content Generation using Multi-agent Evolutionary Computation
Kruse, J. P. (2019) · Tuwhera (Auckland University of Technology) · Cited by 4
New Method for Museum Archiving: “Quantitative Analysis Meets Art History”
Kim, M. (2022) · Journal on Computing and Cultural Heritage · doi:10.1145/3531018 · Cited by 4
Evaluating Usability and User Experience Amid COVID-19: The Case of Innovative Digital Retailers
Samawi, G. A., Jraisat, L., Khlaif, F., Jreissat, M., Ta’Amnha, M. A., Alomari, S., & Khawajah, A. (2023) · International Journal of Technology and Human Interaction · doi:10.4018/ijthi.328090 · Cited by 4
What Happens When We Fail? Building Resilient Community-Based Research
Brizee, A. (2019) · Journal of Technical Writing and Communication · doi:10.1177/0047281619876292 · Cited by 4
User Experience and the Spectacles of the Small: On Mundane Change and Encounters
Sullivan, P. (2014) · ACM International Conference on Design of Communication (SIGDOC) · doi:10.1145/2666216.2692335 · Cited by 4
Tienaah, T., & Tienaah, T. (n.d.) · Cited by 4
Mandorli, F., & Otto, H. (2021) · Computer-Aided Design and Applications · doi:10.14733/cadaps.2022.534-560 · Cited by 4
Mustar, M. Y., Hartanto, R., & Santosa, P. I. (2025) · International Journal of Interactive Mobile Technologies (iJIM) · doi:10.3991/ijim.v19i06.52113 · Cited by 4
Humanoid Robotics: Guidelines for Usability Testing
Casiddu, N., Burlando, F., Porfirione, C., & Vacanti, A. (2020) · Advances in intelligent systems and computing · doi:10.1007/978-3-030-58282-1_17 · Cited by 4
Kivett, D. (2016) · TigerPrints (Clemson University) · Cited by 4
Evaluación heurística de la usabilidad en contextos específicos
Yáñez-Gómez, R. (2019) · Deposito de Investigacion Universidad de Sevilla (University of Seville) · Cited by 4
Faktor Evaluasi Usabilitas dalam Sistem e-learning dengan Panduan Tinjauan Sistematik PRISMA
Permatasari, I., Hutabarat, P. M., & Purnamasari, E. (2023) · J-ENSITEC · doi:10.31949/jensitec.v9i02.3662 · Cited by 4
Harna, T. G., Syaifurrahman, E., & Sunardi, S. (2022) · International Conference on Cyber and IT Service Management (CITSM) · doi:10.1109/citsm56380.2022.9935903 · Cited by 4
Designing Highly Usable Web Applications
Abrahão, S., Insfrán, E., & Fernandez, A. (2014) · Chapman & Hall/CRC eBooks · doi:10.1201/9780429171529-129 · Cited by 4
Metadata
- Authors
- Hwang, W., & Salvendy, G.
- Affiliations
- Soongsil University (KR)
- Purdue University West Lafayette (US)
- ORCID
- Hwang, Wonil
- Venue
- Communications of the ACM
- Published
- 2010-05
- Volume
- 53
- Issue
- 5
- Pages
- 130-133
- ISSN
- 0001-0782 (ISSN-L)
- 1557-7317
- OpenAlex
- W2016022053
- Cited by
- 410
- References
- 11
- Citations by year
- 2026: 40 · 2025: 36 · 2024: 26 · 2023: 43 · 2022: 27 · 2021: 21 · 2020: 29 · 2019: 30 · 2018: 22 · 2017: 24 · 2016: 23 · 2015: 15 · 2014: 24 · 2013: 17 · 2012: 17
- FWCI
- 31.16
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Communications of the ACM (publishedVersion)
- Topics
- Physical Sciences › Computer Science › Human-Computer Interaction › Usability and User Interface Design
- Physical Sciences › Computer Science › Information Systems › Software Engineering Techniques and Practices
- Social Sciences › Human Factors and Ergonomics › Human-Automation Interaction and Safety
- Keywords
- usability evaluation, sample size, think-aloud, heuristic evaluation, cognitive walkthrough, detection rate, evaluation costs, user interface design, verbal protocols, user testing
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.