Getting the right design and the design right
The DOI matches its Crossref record; 18 of the 18 references it cites were found in a registry or an index.
Abstract
We present a study comparing usability testing of a single interface versus three functionally equivalent but stylistically distinct designs. We found that when presented with a single design, users give significantly higher ratings and were more reluctant to criticize than when presented with the same design in a group of three. Our results imply that by presenting users with alternative design solutions, subjective ratings are less prone to inflation and give rise to more and stronger criticisms when appropriate. Contrary to our expectations, our results also suggest that usability testing by itself, even when multiple designs are presented, is not an effective vehicle for soliciting constructive suggestions about how to improve the design from end users. It is a means to identify problems, not provide solutions.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“and non-linear [13,87]: requires constant reconsideration of potential variations of existing text throughout the passage.”
From ABScribe: Rapid Exploration & Organization of Multiple Writing Variations in Human-AI Co-Writing Tasks using Large Language Models (2024) · cites this paper as [87]
In the citing paper
“Effective revision goes beyond minor editorial changes, and may help writers rework ideas, and powerfully affect their knowledge [23,87] as they explore alternative variations to find a line of argument [23].”
From ABScribe: Rapid Exploration & Organization of Multiple Writing Variations in Human-AI Co-Writing Tasks using Large Language Models (2024) · cites this paper as [87]
In the citing paper
“Professional writers often write and rewrite text hundreds of times [12,87] and recommend rewriting as a core strategy for writing well [12,101].”
From ABScribe: Rapid Exploration & Organization of Multiple Writing Variations in Human-AI Co-Writing Tasks using Large Language Models (2024) · cites this paper as [87]
In the citing paper
“Effective revision goes beyond minor editorial changes, and may help writers rework ideas, and powerfully affect their knowledge [23,87] as they explore alternative variations to find a line of argument [23].”
From ABScribe: Rapid Exploration & Organization of Multiple Writing Variations in Human-AI Co-Writing Tasks using Large Language Models (2024) · cites this paper as [87]
In the citing paper
“Recognizing that revision is inherently nonlinear-with writers often revisiting earlier sections of a passageand recursive, manifesting in repeated cycles throughout the writing process [23,87], we aimed to align our LLM integrations with this fluid, iterative nature of revision.”
From ABScribe: Rapid Exploration & Organization of Multiple Writing Variations in Human-AI Co-Writing Tasks using Large Language Models (2024) · cites this paper as [87]
4 more claims about this paper
Create a free account to see every claim other papers make about this one.
Citations
Cites
(1993) · Cited by 9,879
(1993) · Elsevier eBooks · doi:10.1016/c2009-0-21512-1 · Cited by 5,504
The Usability Engineering Lifecycle
NIELSEN, J. (1993) · Usability Engineering · doi:10.1016/b978-0-08-052029-2.50007-3 · Cited by 2,657
Paper Prototyping: The Fast and Easy Way to Design and Refine User Interfaces
Snyder, C. (2003) · Cited by 953
Rettig, M. (1994) · Communications of the ACM · doi:10.1145/175276.175288 · Cited by 440
Low vs. high-fidelity prototyping debate
Rudd, J., Stern, K., & Isensee, S. (1996) · Interactions · doi:10.1145/223500.223514 · Cited by 422
High-Fidelity or Low-Fidelity, Paper or Computer? Choosing Attributes when Testing Web Prototypes
Walker, M., Takayama, L., & Landay, J. A. (2002) · Proceedings of the Human Factors and Ergonomics Society Annual Meeting · doi:10.1177/154193120204600513 · Cited by 235
Sefelin, R., Tscheligi, M., & Giller, V. (2003) · CHI '03 extended abstracts on Human factors in computing systems - CHI '03 · doi:10.1145/765891.765986 · Cited by 209
Comparing usability problems and redesign proposals as input to practical systems development
Hornbæk, K., & Frøkjær, E. (2005) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/1054972.1055027 · Cited by 148 · cited 3×
“Consequently, if one agrees with the findings of [5], then our study emphasizes the need to adopt approaches beyond standard usability testing techniques in order to generate redesign proposals.”
BackgroundInfluentialNotes on design practice: stories and prototypes as catalysts for communication
Erickson, T. D. (1995) · John Wiley & Sons, Inc. eBooks · Cited by 136
Cited by
Items 101–200 of 269
Making the Right Thing: Bridging HCI and Responsible AI in Early-Stage AI Concept Selection
Jung, J.-Y., Saxena, D., Park, M., Kim, J., Forlizzi, J., Holstein, K., & Zimmerman, J. (2025) · Designing Interactive Systems Conference · doi:10.1145/3715336.3735745 · Cited by 14
“[18]” This approach underscores the necessity of evaluating concepts in parallel to determine their relative merits [30, 87].”
Prototyping Things: Reflecting on Unreported Objects of Design Research for IoT
Taylor, N., Rogers, J., Clarke, L., Skelly, M., Wallace, J., Thomas, P., George, B., Raj, R., Shorter, M., & Thorne, M. (2021) · Designing Interactive Systems Conference · doi:10.1145/3461778.3462037 · Cited by 14
“When sharing them with users, this helped to focus on the most relevant aspects of each prototype, while also freeing participants to be more critical of each concept (as suggested by Tohidi et al. [37]).”
BackgroundCross-Subject EEG Feedback for Implicit Image Generation
de la Torre‐Ortiz, C., Spapé, M., Ravaja, N., & Ruotsalo, T. (2024) · IEEE Transactions on Cybernetics · doi:10.1109/tcyb.2024.3406159 · Cited by 14
“Users can often provide diverse perception critiques of visual works, with advantages over peer feedback, such as avoiding an overly positive bias [65].”
BackgroundKumaran, S. R. K., Shi, W. W., & Bailey, B. P. (2021) · Creativity and Cognition · doi:10.1145/3450741.3465255 · Cited by 14
“For instance, sharing multiple alternatives of the prototype [40] and context about the changes made to a design”
BackgroundAutomatic web design refinements based on collective user behavior
Leiva, L. A. (2012) · CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA) · doi:10.1145/2212776.2223680 · Cited by 14
Usability Evaluation as Idea Generation
Hornbæk, K. (2007) · Human-computer interaction series · doi:10.1007/978-1-84628-941-5_12 · Cited by 14
“A recent study showed that usability testing with multiple designs may be better than testing with just one design, in that users give more and stronger critiques of the designs ( Tohidi, et al. 2006 ).”
Eardley, R., Mackinnon, S., Tonkin, E. L., Soubutts, E., Ayobi, A., Linington, J., Tourte, G. J. L., Gross, Z. B., Bailey, D. J., Knights, R., et al. (2022) · Proceedings of the ACM on Interactive Mobile Wearable and Ubiquitous Technologies · doi:10.1145/3534625 · Cited by 13
“All visual elements appeared in black and white to highlight that the designs were not final and encourage feedback [71].”
BackgroundDesigning a Simple Folder Structure for a Complex Domain
Clemmensen, T. (2011) · Human Technology · doi:10.17011/ht/urn.2011112211713 · Cited by 13
Coughlan, T., Brown, M. A., Lawson, G., Mortier, R., Houghton, R. J., & Goulden, M. (2013) · CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA) · doi:10.1145/2468356.2468417 · Cited by 13
Facilitating redesign with design cards: experiences with novice designers
Bornoe, N., Bruun, A., & Stage, J. (2016) · Australian Conference on Computer-Human Interaction (OzCHI) · doi:10.1145/3010915.3010921 · Cited by 13
“Usability evaluations are suitable for locating problems, but not for gathering redesign proposals (Tohidi et al. 2006), so methods are needed to utilize usability feedback (Smith & Dunckley 2002).”
MethodUnlocking digital twin planning for grazing industries with farmer centred design
Lee, T., Ramp, D., & Bless, A. (2025) · Agriculture and Human Values · doi:10.1007/s10460-025-10752-x · Cited by 12
“Prototypes allow researchers to give tangible form both to higher-level user goals and the specific tasks identified in support of such goals (Gulliksen et al. 2006; Marti and Bannon 2009; Savoia 2011; Sanders and Stappers 2014; Tohidi et al. 2006).”
Supporting teacher scripting with an ontological model of task-technique content knowledge
Vu, T. M. H., & Tchounikine, P. (2020) · Computers & Education · doi:10.1016/j.compedu.2020.104098 · Cited by 12
Interactive Parallel Coordinates for Parametric Design Space Exploration
Mohiuddin, A., & Woodbury, R. F. (2020) · CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA) · doi:10.1145/3334480.3383101 · Cited by 12
“Working with alternatives results in more diverse design outcomes and improves task self-confidence [10], more credible evaluation of design work and better problem identification [31].”
BackgroundLiving Spaces: A Participatory Design Process Model Drawing on the Use of Boundary Objects
Huybrechts, L., Coenen, T., Laureyssens, T., & Machils, P. (2009) · Lirias · Cited by 12
Dortheimer, J., Yang, S., Yang, Q., & Sprecher, A. (2023) · Buildings · doi:10.3390/buildings13010222 · Cited by 11
User-centered design (UCD) and technical communication: The inevitable marriage
LaRoche, C. S., & Traynor, B. (2010) · IEEE International Professional Communication Conference (ProComm) · doi:10.1109/ipcc.2010.5529821 · Cited by 11
“They match iteration in product development to a quality of information so that past decisions/evolutions can be recalled and team members can transition more effectively [11].”
BackgroundView Relations: An Exploratory Study on Between-View Meta-Visualizations
Knudsen, S., & Carpendale, S. (2016) · Nordic Conference on Human-Computer Interaction · doi:10.1145/2971485.2971566 · Cited by 11
Triangulating on Possible Futures: Conducting User Studies on Several Futures Instead of Only One
Salovaara, A., & Vahvelainen, L. (2025) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3706598.3713565 · Cited by 10
“In the title of a UI-testing paper published in 2006, Tohidi et al. [57] stated that ‘testing many is better than one’.”
The UX Factor: Using Comparative Peer Review to Evaluate Designs through User Preferences
Bawabe, S., Wilson, L. D., Zhou, T., Marks, E., & Huang, J. J. S. (2021) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3479863 · Cited by 10
“Left alone, this definition of average may differ significantly across individuals, leading to discrepancies in evaluation which can inflate the inherent subjectivity of ratings [38] and thus decrease the overall integrity of peer reviews.”
BackgroundLim, H., Choi, D., Choi, D., Nam, S., & Hong, H. (2025) · International Journal of Human-Computer Studies · doi:10.1016/j.ijhcs.2025.103687 · Cited by 9
Exploring the Role of Social Support When Integrating Generative AI in Small Business Workflows
Lauro, Q. R., Bigham, J. P., & Kotturi, Y. (2024) · ACM Conference on Computer Supported Cooperative Work (CSCW) · doi:10.1145/3678884.3681895 · Cited by 9
“The paper format of storyboards helped to convey malleability of the ideas and foster critical conversations with participants [38].”
How Can I Contribute? Citizen Engagement in the Development of Nanotechnology for Health
Jansma, S. R., Dijkstra, A. M., & de Jong, M. D. T. (2021) · NanoEthics · doi:10.1007/s11569-021-00403-w · Cited by 9
“This methodology included four phases of exploration, ideation, prototyping and reflection, which, together, foster creativity and promote integration of different types of knowledge [38, 39].”
MethodDesigning affective animations with children as design partners using role-playing
Girard, S., & Johnson, H. (2011) · Conference on l'Interaction Homme-Machine (IHM) · doi:10.1145/2044354.2044386 · Cited by 9
ProcessGallery: Contrasting Early and Late Iterations for Design Principle Learning
Yen, Y.-C. G., E, J. L., Jin, H., Li, M., Lin, G. H. C., Pan, I. Y., & Dow, S. P. (2024) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3637389 · Cited by 8
“Examples have also been shown to provide pedagogical values across domains as diverse as physics [26], design [93], and management [92].”
BackgroundThe Trade-off between Usability and Security in the Context of eGovernment: A Mapping Study
Alshamsi, A., Williams, N., & András, P. (2016) · Electronic workshops in computing · doi:10.14236/ewic/hci2016.36 · Cited by 8
An Exploration to User Experiance of Mobile Tablet Application Through Prototyping.
Gatsou, C., Politis, A. C., & Zevgolis, D. (2014) · International journal of computer science and applications · Cited by 8
“I Know It When I See It”: How Experts and Novices Recognize Good Design
Tanner, K., & Landay, J. A. (2018) · Understanding innovation · doi:10.1007/978-3-319-97082-0_13 · Cited by 8
Interactive Exploration of Large-Scale UI Datasets with Design Maps
Leiva, L. A., Hota, A., & Oulasvirta, A. (2020) · Interacting with Computers · doi:10.1093/iwcomp/iwab006 · Cited by 8
“Explorative visualizations in general can help ensure that designers do not fixate on one design idea but explore the space before intensifying effort around a design candidate (Tohidi et al., 2006).”
BackgroundFoong, E., Kim, J. O., Dontcheva, M., & Gerber, E. M. (2021) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3449096 · Cited by 8
“, asking reviewers to evaluate multiple projects as a group) could lead to more critical feedback due to the ability to compare works [28, 70].”
BackgroundRanney, M. L., Pittman, S. K., Riese, A., Ybarra, M. L., Huang, J. J. S., Spirito, A., & Rosen, R. K. (2018) · Hawaii International Conference on System Sciences (HICSS) · doi:10.24251/hicss.2018.422 · Cited by 7
“, “showing alternative designs” [57]), also helped with more concrete participants.”
BackgroundExtracting behavioral information from electronic storyboards
Forsyth, J. B., & Martin, T. L. (2014) · ACM SIGCHI Symposium on Engineering Interactive Computing Systems (EICS) · doi:10.1145/2607023.2607034 · Cited by 7
“This type of prototyping is important during the early stages of design when many ideas regarding form, function, and behavior are being evaluated [28].”
BackgroundHan, L., Gao, Y., Lu, X., Wang, B., Zhang, L., Wang, Z., & Yip, D. K. M. (2026) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3772318.3790720 · Cited by 6
“Despite rapid advances, current AI practices in CH still face notable limitations in balancing historical accuracy with algorithmic creativity [11, 50, 51, 60].”
E-Totem, Digital Locative Media to Support E-Participation in Cities
Furtado, V., Lima, L., Chagas, D. A., Pinheiro, V. C. M., Caminha, C., Furtado, E. S., & Mafra, M. L. P. (2019) · International Journal of Electronic Government Research · doi:10.4018/ijegr.2019070101 · Cited by 6
Design thinking as an organizational intervention for innovation
Miller, S. R. (2023) · Elsevier eBooks · doi:10.1016/b978-0-323-91841-1.00022-1 · Cited by 6
Paper Prototyping: The Surplus Merit of a Multi-Method Approach
Linek, S. B., & Tochtermann, K. (2015) · Forum qualitative Sozialforschung · doi:10.17169/fqs-16.3.2236 · Cited by 6
“Several practitioners reported about the reluctance of people to express critique and to verbalize negative thoughts (DICKS, 2002; TOHIDI, BUXTON, BAECKER & SELLEN, 2006a; WIKLUND, THURROTT & DUMAS, 1992).”
Svarre, T., Lunn, T. B. K., & Helle, T. (2016) · Scandinavian Journal of Occupational Therapy · doi:10.1080/11038128.2016.1255774 · Cited by 6
“At this step of a design process, we therefore recommend that different prototype apps are presented and evaluated simultaneously [35].”
BackgroundKong, H., Lee, J., & Karahalios, K. G. (2017) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3134694 · Cited by 6
Graphs of Models for Exploring Design Spaces in the engineering of Human Computer InteractionPreprint
Demeure, A., Masson, D. H., & Calvary, G. (2011) · HAL · Cited by 6
Comparing Fabrication Workflows in CAD to Support Design Reasoning
Feng, S., Wang, X., Shan, Y., Singh, K. U., Liu, B., Kwatra, A., Batra, R., Weinberg, T. M., & Roumen, T. J. (2026) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3772318.3790516 · Cited by 5
“Research in design education suggests that comparing alternatives enhances understanding and improves design outcomes [22, 92], yet fabrication tools, being tied to a machine or process, rarely support such comparison.”
Análise de alternativas de design de mapas para TV digital brasileira baseada em multicritérios
Chagas, D. A., Furtado, E. S., & Nobre, J. (2012) · doi:10.5555/2393536.2393584 · Cited by 5
Scout: Mixed-Initiative Exploration of Design Variations through High-Level Design Constraints
Swearngin, A., Ko, A. J., & Fogarty, J. A. (2018) · ACM Symposium on User Interface Software and Technology (UIST) · doi:10.1145/3266037.3271626 · Cited by 5
“When designers compare these alternatives, they provide stronger critiques and make better decisions [6, 16].”
BackgroundExploring Capturing Approaches in Shared Fabrication Workshops: Current Practice and Opportunities
Rigaud, C., Bailly, G., Avellino, I., & Jansen, Y. (2022) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3555116 · Cited by 5
“Multiplicity Increases Capture Opportunities.”
Towards Autocomplete Strategies for Visualization Construction
Wei, W., Huron, S., & Jansen, Y. (2023) · Visualization · doi:10.1109/vis54172.2023.00037 · Cited by 5
“Furthermore, the simplicity of tokens allows for early exploration of various design alternatives, making them a powerful tool for our preliminary exploration [28], and it is probably one of the earliest information processing tools human have used [26].”
BackgroundTowards Next-Generation Design Thinking II: Virtual Multi-user Software Prototypes
Gabrysiak, G., Giese, H., & Seibel, A. (2011) · Springer eBooks · doi:10.1007/978-3-642-21643-5_7 · Cited by 5
Examples galleries generated by interactive genetic algorithms
Masson, D. H., Demeure, A., & Calvary, G. (2011) · Network Conference on Creativity and Innovation in Design · doi:10.1145/2079216.2079225 · Cited by 5
The Relevance of UX Models and Measures.
Følstad, A. (2010) · Cited by 5
Training Computer Use Agents to Assess the Usability of Graphical User InterfacesPreprint
Gao, A., Tong, W., Vempati, R., Reinecke, K., Shapiro, R. B., Zhang, T., & Wu, J. H. Y. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2604.26020 · Cited by 5
“Feedback from this process can be used to evaluate the candidate interface [48], select between design alternatives [68], and guide iterative improvements [45].”
Shireen, N. (2020) · Summit (Simon Fraser University) · Cited by 4
Pimminger, S., Kurschl, W., Schönböck, J., Slabihoud, R., Froschauer, R., & Zwettler, G. A. (2024) · International Conference on PErvasive Technologies Related to Assistive Environments (PETRA) · doi:10.1145/3652037.3652073 · Cited by 4
“Its purpose (e.g., through prototyping [56]) is to foster a wide array of alternatives and solutions, and thus encourages exploration and creativity.”
BackgroundHevelius Report: Visualizing Web-Based Mobility Test Data For Clinical Decision and Learning Support
Lin, H., Han, T., Gajos, K. Z., & Gupta, A. S. (2024) · International ACM SIGACCESS Conference on Computers and Accessibility (ASSETS) · doi:10.1145/3663548.3688490 · Cited by 4
“Lastly, we presented multiple designs to solicit informal feedback in our weekly meetings with our clinician-engineer collaborator, following a Parallel Design principle [6, 30].”
Chakraborty, A. (2015) · Creativity and Cognition · doi:10.1145/2757226.2764557 · Cited by 4
“Echoing prior work [15, 16], participants reported that feedback helps them better understand what is or is not being communicated in the design, inform design choices, and remove creative blocks.”
BackgroundTools for interdisciplinary design of pervasive computing
Forsyth, J. B., & Martin, T. L. (2012) · International Journal of Pervasive Computing and Communications · doi:10.1108/17427371211245355 · Cited by 4
“1) Foam Prototypes: The more prototypes that are created, generally the better the design outcome [53].”
BackgroundAt the Cross-Roads between Human-Computer Interaction and Model Driven Engineering
Calvary, G., Déry-Pinna, A.-M., Occello, A., Renevier, P., & Riveill, M. (2014) · HAL · Cited by 4
Teaching about Personal Finance in HCS – Suggestions from a Design-Based Research Approach
Hernwall, P., & Söderberg, I. (2020) · Designs for Learning · doi:10.16993/dfl.142 · Cited by 4
Mobile Interface Design to suit the Algerian Culture: First initial design
Brahim, A., & Aziz, M. S. A. (2020) · International Journal on Perceptive and Cognitive Computing · doi:10.31436/ijpcc.v6i2.144 · Cited by 4
Virtual Multi-User Software Prototypes III
Gabrysiak, G., Giese, H., & Beyhl, T. (2012) · Springer eBooks · doi:10.1007/978-3-642-31991-4_15 · Cited by 4
Using Concrete and Realistic Data in Evaluating Initial Visualization Designs
Knudsen, S., Pedersen, J. G., Herdal, T., & Larsen, J. E. (2016) · doi:10.1145/2993901.2993917 · Cited by 4
Citizens@City Mobile Application for Urban Problem Reporting
Ribeiro, A. M., Costa, R. P. F. D., Marcelino, L., & Silva, C. (2011) · Communications in computer and information science · doi:10.1007/978-3-642-24355-4_15 · Cited by 4
SCRIPT: A Framework for Scenario-Driven Prototyping
Stangl, H. (2012) · mediaTUM (Technical University of Munich) · Cited by 4
ControlGUI: Guiding Generative GUI Exploration through Perceptual Visual FlowPreprint
Garg, A., Jiang, Y., & Oulasvirta, A. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2502.03330 · Cited by 5
“Doing so allows them to generate ideas, compare trade-offs, and spark creative solutions to complex design problems [10, 53].”
Bromark, K. (2024) · DiVA (Stockholm University) · Cited by 4
Bucalon, B., Williams, C., Conley, J., Rankin, D., Veysey, M. J., Shaw, T. J., & Kay, J. (2022) · Australian Conference on Human-Computer Interaction (OzCHI) · doi:10.1145/3572921.3572952 · Cited by 3
“This approach, modelled on the approach of [42], aimed to gain rich comments and critiques of diverse ways to present clinical indicator information.”
MethodCho, H., Kinny, D., & Lin, D. (2013) · International Conference on Culture and Computing · doi:10.1109/culturecomputing.2013.23 · Cited by 3
MAIS - A Model for the Multi-criteria Analysis of Interaction Solutions
Furtado, E. S., & Pinheiro, P. R. (2015) · Procedia Computer Science · doi:10.1016/j.procs.2015.07.131 · Cited by 3
Kim, K. G., Oertel, C., & Dillenbourg, P. (2021) · International Journal for Research in Vocational Education and Training · doi:10.13152/ijrvet.8.1.4 · Cited by 3
“Additional value is provided through the design process as people recognize and compare the alternatives (Tohidi et al., 2006).”
BackgroundAsPeer: Method to Self and Peer Assessment in Large Online Design Classes
Sankaran, H. K., Shanmugam, R., Shah, B. S., Ahmad, S., Abdeljaber, H. A. M., & Nazeer, J. (2023) · International Journal of Emerging Technologies in Learning (iJET) · doi:10.3991/ijet.v18i10.38617 · Cited by 3
Mobile Map Applications for Foldable Devices
Savino, G.-L., Wahls, J., & Schöning, J. (2024) · International Conference on Advanced Visual Interfaces (AVI) · doi:10.1145/3656650.3656655 · Cited by 3
“For each task we designed three alternative interfaces (visualisations of the interfaces can be found in the supplementary materials) [20].”
MethodEye, Robot: A Network Control System for Ophthalmologic Examination
Go, K., Kashiwagi, K., Ito, Y., Nakazawa, Y., & Arata, J. (2008) · Lecture notes in computer science · doi:10.1007/978-3-540-70585-7_6 · Cited by 3
Interaction Designers’ Conceptions of Design Quality for Interactive Artifacts
Arvola, M. (2010) · Proceedings of DRS · doi:10.21606/drs.2008.3 · Cited by 3
Designing Information Visualizations for Elite Soccer Children's Different Levels of Comprehension
Herdal, T., Pedersen, J. G., & Knudsen, S. (2016) · Nordic Conference on Human-Computer Interaction · doi:10.1145/2971485.2971546 · Cited by 3
“We evaluated alternatives to increase the quality and number of evaluation insights [20].”
MethodBlame the Scapegoat: How Creating an Easy Target Can Help Non-Designers Critique Designs
Reyes, B., Prstic, T., & Flores, R. (2017) · CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA) · doi:10.1145/3027063.3053184 · Cited by 3
Clemmensen, T. (2021) · Human-computer interaction series · doi:10.1007/978-3-030-71796-4_5 · Cited by 3
Vaugh, T., & Ryan, M. (2015) · doi:10.31880/10344/5862 · Cited by 3
Assessing the suitability of user centric design methods when applied in a developing world context
Maunder, A. (2010) · Open University of Cape Town (University of Cape Town) · Cited by 3
Surveying Wonderland for many more literature visualization techniquesPreprint
Brath, R. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2110.08584 · Cited by 3
“Tohidi indicates multiple designs facilitate design criticisms and help identify design problems [15].”
BackgroundParticipatory, not Punitive: Student-Driven AI Policy Recommendations in a Design Classroom
Seki, K., Vijay, M., & Kotturi, Y. (2026) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3772318.3790691 · Cited by 3
“Participants gravitated toward divergent thinking—the essential stage in design that focuses on generating many ideas before converging on a subset to pursue [120].”
The Systems Paper is Dead. Long Live the Systems Paper.
Hartmann, B. (2026) · ACM Symposium on User Interface Software and Technology (UIST) · doi:10.48550/arxiv.2608.25219 · Cited by 2
“Researchers have already shown the benefits of parallel prototyping [6], evaluation of multiple alternatives [16, 25], and structured thinking about design spaces [4].”
Segura, V., & Barbosa, S. D. J. (2012) · IEEE Symposium on Visual Languages and Human-Centric Computing (VL/HCC) · doi:10.1109/vlhcc.2012.6344479 · Cited by 2
“During the early user interface (UI) design phase, different design solutions should be explored and iteratively refined by the design team [22].”
BackgroundComparing text and visual annotation tools for design feedback
DeJong, A. J. (2017) · Illinois Digital Environment for Access to Learning and Scholarship (University of Illinois at Urbana-Champaign) · Cited by 2
What's the Point? How Scores Undermine Written Comments on Open-Ended Work
Crain, P. A., & Bailey, B. P. (2021) · ACM Conference on Learning @ Scale (L@S) · doi:10.1145/3430895.3460132 · Cited by 2
“A long history of work affirms the value of constructive comments in helping creators conceptualize problems with their work and make deep, thoughtful revisions [46, 55, 52, 24, 47, 21, 59].”
BackgroundHive: Collective Design Through Network Rotation
Salehi, N., & Bernstein, M. S. (2019) · Understanding innovation · doi:10.1007/978-3-030-28960-7_6 · Cited by 2
Beyond the Circadian Rhythm: Variable Cycles of Regularity Found in Long-Term Sleep Tracking
Chung, J. W., Yuan, R. K., Zitting, K., Chen, J., Xu, N. G., Daskalova, N., & Huang, J. J. S. (2025) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3706598.3713868 · Cited by 3
“To draw better critiques and make sure we are “getting the right design and the design right”, as Tohidi et al. suggests [100], we should re-evaluate our systems with users by providing them with alternative designs that accommodate their natural routines.”
A Review of Current Trends in Usability Evaluation Methods
Das, T., & Patil, S. (2014) · Cited by 2
Masson, D. H., Demeure, A., & Calvary, G. (2011) · Conference on l'Interaction Homme-Machine (IHM) · doi:10.1145/2044354.2044382 · Cited by 2
“Plus généralement, ces résultats peuvent être rapprochés de ceux obtenus par Tohidi [23].”
Design artefacts as service design concepts: a case study from a telecommunication domain
Kwiatkowska, J., Szostek, A. M., & Lamas, D. (2014) · Nordic Conference on Human-Computer Interaction · doi:10.1145/2639189.2639253 · Cited by 2
“We followed Tohidi et al. [8] argument stating that users are prone to assess an investigated design more equitably and give an appropriate critique when alternative design solutions are presented, • selecting two alternative design artefacts that enabled to test the offering with users (see: Fig.”
BackgroundEngaging Teens in Dialogue on Potential Technological Futures with User Enactments
Odom, W., Zimmerman, J., & Forlizzi, J. (2016) · Human-computer interaction series · doi:10.1007/978-3-319-33450-9_7 · Cited by 2
Encoding Design Process Using Interactive Data Visualization
Shireen, N., Erhan, H. I., & Woodbury, R. F. (2019) · Communications in computer and information science · doi:10.1007/978-981-13-8410-3_17 · Cited by 2
BloomGraph: Graph-Based Exploration of Bouquet Designs for Florist Apprentices
Kim, K. G., Oertel, C., & Dillenbourg, P. (2019) · Lecture notes in computer science · doi:10.1007/978-3-030-29736-7_76 · Cited by 2
User feedback in design for emerging markets : methods and influencing factors
Florentine, J. (2015) · DSpace@MIT (Massachusetts Institute of Technology) · Cited by 2
Inspirez ! Explorez ! Soutien à la créativité en conception d'interfaces homme-machine
Masson, D. H. (2014) · theses.fr (ABES) · doi:10.70675/e964eb7bz385ez4f41z979dz10eef728c1d1 · Cited by 2
Coulentianos, M. J. (2020) · Deep Blue (University of Michigan) · Cited by 2
Yen, Y.-C. (2021) · Illinois Digital Environment for Access to Learning and Scholarship (University of Illinois at Urbana-Champaign) · Cited by 2
WeChat Redesign for Foreigners Living in China from Culturally Adaptive Design Perspective
Zhang, Q. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-50267-6_33 · Cited by 1
Houzangbe, S., Fleury, S., Masson, D. H., Jáuregui, D. A. G., Legardeur, J., Couture, N., & Richir, S. (2023) · International Conference on Affective Computing and Intelligent Interaction and workshops · doi:10.1109/acii59096.2023.10388141 · Cited by 1
HCI/UX/UI Education Issues and Learning Challenges for Thai Undergraduate Students
Nuchitprasitchai, S., Chotirat, S., & Nimkoompai, A. (2024) · doi:10.1109/incit63192.2024.10810605 · Cited by 1
Chigozie-Okwum, C., & Baumer, E. P. S. (2025) · African Human Computer Interaction Conference (AfriCHI) · doi:10.1145/3757232.3757234 · Cited by 1
“In these stages, designers are more likely to employ high-fidelity prototypes [19, 35, 41], interactive mock-ups [25, 30], or other techniques that implicitly guide users away from high-level questions and toward low-level details to help get the “design right " [50].”
Metody ilościowe i jakościowe w dyscyplinie interakcja człowiek-komputer. Porównanie i zastosowania
Szostek, A. M. (2011) · Zeszyty Naukowe Politechniki Poznańskiej. Organizacja i Zarządzanie · Cited by 1
THE GENERATIVE SIMILARITIES OF DESIGNS, PROTOTYPES, AND SCENARIOS
Scaletsky, C. C., Ruecker, S., & Basapur, S. (2014) · Congresso Brasileiro de Pesquisa e Desenvolvimento em Design (P&D Design) · doi:10.5151/designpro-ped-00821 · Cited by 1
Traynor, B. (2012) · IEEE International Professional Communication Conference (ProComm) · doi:10.1109/ipcc.2012.6408618 · Cited by 1
“Tohidi [10] reports some success in soliciting input from test participants when multiple designs are presented in a single usability test.”
BackgroundVisualization Techniques of Trajectory Data: Challenges and Limitations.
Gonçalves, T., Afonso, A. P., & Martins, B. (2013) · Cited by 1
Metadata
- Authors
- Tohidi, M., Buxton, W., Baecker, R., & Sellen, A.
- Affiliations
- University of Toronto (CA)
- Microsoft Research, Toronto, Canada
- Microsoft Research (United Kingdom) (GB)
- Venue
- Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
- Publisher
- ACM
- Published
- 2006-04-22
- Pages
- 1243-1252
- OpenAlex
- W2073271971
- Cited by
- 211
- References
- 18
- Citations by year
- 2026: 6 · 2025: 13 · 2024: 10 · 2023: 11 · 2022: 4 · 2021: 20 · 2020: 12 · 2019: 9 · 2018: 15 · 2017: 9 · 2016: 10 · 2015: 15 · 2014: 10 · 2013: 13 · 2012: 12
- FWCI
- 5.26
- Type
- conference paper
- Language
- en
- Open access
- closed
- Locations
- CHI Conference on Human Factors in Computing Systems (publishedVersion)
- OCAD University Open Research Repository (OCAD University) (submittedVersion)
- Topics
- Physical Sciences › Computer Science › Human-Computer Interaction › Usability and User Interface Design
- Physical Sciences › Computer Science › Human-Computer Interaction › Innovative Human-Technology Interaction
- Physical Sciences › Computer Science › Human-Computer Interaction › Interactive and Immersive Displays
- Keywords
- usability testing, interface design, design alternatives, user ratings, rating inflation, user feedback, design improvement, user-centered design
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.