A Systematic Mapping Study of HCI Practice Research
Abstract
Human–computer interaction (HCI) practice has emerged as a research domain in the HCI field and is growing. The need to transfer HCI practices to the industry began significantly with the works of Nielsen on usability engineering. To date, methods and techniques for designing, evaluating, and implementing interactive systems for human use have continued to emerge. It is, therefore, justified to conduct a systematic mapping study to determine the landscape of HCI practice research. A Systematic Mapping Study method was used to map 142 studies according to research type, topic, and contribution. These were then analyzed to determine an overview of HCI practice research. The objective was to analyze studies on HCI practice and present prominent issues that characterize the HCI practice research landscape. Second, to identify pressing challenges regarding HCI practices in software/systems development companies. The results show that HCI practice research has steadily increased since 2012. The majority of the studies explored focused on evaluation research that largely contributed to the evaluation methods or processes. Most of the studies were on design tools and techniques, design methods and contexts, design work and organizational culture, and collaboration and team communication. Interviews, case studies, and survey methods have been prominently used as research methods. HCI techniques are mostly used during the initial phase of development and during evaluation. HCI practice challenges in companies are mostly process-related and on performance of usability and user experience activities. The major challenge seems to be to find a way to collect and incorporate user feedback in a timely manner, especially in agile processes. There are areas identified in this study as needing more research.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In human-computer interaction, action research has been considered a valuable approach to identifying issues of practice and providing insight on needs and challenges faced by practitioners.
“In human–computer interaction, action research has been considered a valuable approach to identifying issues of practice, providing insight on the needs and challenges faced by practitioners (Ogunyemi et al., 2019).”
From Designing learning technology collaboratively: analysis of a chatbot co-design (2023) · cites this paper as Ogunyemi et al., 2019
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
(1994) · Journal of the American Dietetic Association · doi:10.1016/0002-8223(94)92216-0 · Cited by 46,726 · see citing works
Mixed Methods Research: A Research Paradigm Whose Time Has Come
Johnson, R. B., & Onwuegbuzie, A. J. (2004) · Educational Researcher · doi:10.3102/0013189x033007014 · Cited by 11,170 · cited 1× · see citing works
“Mixed methods research is particularly relevant when aiming to deal with complex issues (Johnson & Onwuegbuzie, 2004).”
Method(1993) · Cited by 9,879 · see citing works
World Academy of Science, Engineering and Technology 62 2010
Moghiman, M., Javadi, M. A., مقیمان, ا. ر., & حسینی, س. ب. (2010) · Cited by 3,832 · see citing works
Systematic Mapping Studies in Software Engineering
Petersen, K., Feldt, R., Mujtaba, S., & Mattsson, M. (2008) · Electronic Workshops in Computing · doi:10.14236/ewic/ease2008.8 · Cited by 3,239 · cited 6× · see citing works
“We followed the concept of keywording of abstracts described by Petersen et al. (2008).”
BackgroundMethodInfluentialNorman, D. A., & DRAPER, S. W. (1986) · CRC Press eBooks · doi:10.1201/b15703 · Cited by 3,154 · see citing works
Guidelines for conducting systematic mapping studies in software engineering: An update
Petersen, K., Vakkalanka, S., & Kuzniarz, L. (2015) · Information and Software Technology · doi:10.1016/j.infsof.2015.03.007 · Cited by 2,669 · see citing works
Empirical studies of agile software development: A systematic review
Dybå, T., & Dingsøyr, T. (2008) · Information and Software Technology · doi:10.1016/j.infsof.2008.01.006 · Cited by 2,668 · see citing works
The Usability Engineering Lifecycle
NIELSEN, J. (1993) · Usability Engineering · doi:10.1016/b978-0-08-052029-2.50007-3 · Cited by 2,657 · see citing works
Change by design : how design thinking transforms organizations and inspires innovation
Brown, T., & Kātz, B. M. (2009) · Cited by 2,616 · see citing works
Rowe, P. G. (1987) · Cited by 2,481 · see citing works
Research through design as a method for interaction design research in HCI
Zimmerman, J., Forlizzi, J., & Evenson, S. (2007) · ACM SIGCHI Conference on Human Factors in Computing Systems (CHI) · doi:10.1145/1240624.1240704 · Cited by 2,300 · see citing works
User Centered System Design: New Perspectives on Human-Computer Interaction
Anderson, N. S., Norman, D. A., & Draper, S. W. (1988) · The American Journal of Psychology · doi:10.2307/1422802 · Cited by 1,851 · see citing works
Therapeutic Songwriting in Music Therapy
Baker, F. A., Wigram, T., Stott, D., & McFerran, K. S. (2008) · Nordic Journal of Music Therapy · doi:10.1080/08098130809478203 · Cited by 1,140 · see citing works
Requirements engineering paper classification and evaluation criteria: a proposal and a discussion
Wieringa, R., Maiden, N., Mead, N., & Rolland, C. (2006) · Requirements Engineering · doi:10.1007/s00766-005-0021-6 · Cited by 940 · see citing works
ACM SIGCHI Curricula for Human-Computer Interaction
Hewett, T., Baecker, R. M., Card, S. K., Carey, T., Gasen, J. B., Mantei, M. M., Perlman, G., Strong, G. W., & Verplank, W. L. (1992) · ACM eBooks · doi:10.1145/2594128 · Cited by 853 · see citing works
The maturity of maturity model research: A systematic mapping study
Wendler, R. (2012) · Information and Software Technology · doi:10.1016/j.infsof.2012.07.007 · Cited by 693 · see citing works
A systematic literature review on agile requirements engineering practices and challenges
Inayat, I., Salim, S. S., Marczak, S. D. S., Daneva, M., & Shamshirband, S. (2014) · Computers in Human Behavior · doi:10.1016/j.chb.2014.10.046 · Cited by 531 · see citing works
Usability evaluation methods for the web: A systematic mapping study
Fernandez, A., Insfrán, E., & Abrahão, S. (2011) · Information and Software Technology · doi:10.1016/j.infsof.2011.02.007 · Cited by 497 · see citing works
Survey on user interface programming
Myers, B. A., & Rosson, M. B. (1992) · ACM SIGCHI Conference on Human Factors in Computing Systems (CHI) · doi:10.1145/142750.142789 · Cited by 445 · see citing works
Software development in startup companies: A systematic mapping study
Paternoster, N., Giardino, C., Unterkalmsteiner, M., Gorschek, T., & Abrahamsson, P. (2014) · Information and Software Technology · doi:10.1016/j.infsof.2014.04.014 · Cited by 413 · see citing works
Students' Ways of Experiencing Human‐Centered Design
Zoltowski, C., Oakes, W. C., & Cardella, M. E. (2012) · Journal of Engineering Education · doi:10.1002/j.2168-9830.2012.tb00040.x · Cited by 305 · see citing works
Exploring principles of user-centered agile software development: A literature review
Brhel, M., Meth, H., Maedche, A., & Werder, K. (2015) · Information and Software Technology · doi:10.1016/j.infsof.2015.01.004 · Cited by 300 · see citing works
A systematic mapping study of software product lines testing
Neto, P. A. D. M. S., Machado, I., McGregor, J. D., de Almeida, E. S., & Meira, S. R. D. L. (2010) · Information and Software Technology · doi:10.1016/j.infsof.2010.12.003 · Cited by 219 · see citing works
Adapting usability investigations for agile user-centered design
Sy, D. (2007) · Cited by 213 · see citing works
Human–computer interaction: Interdisciplinary roots and trends
Hartson, H. R. (1998) · Journal of Systems and Software · doi:10.1016/s0164-1212(98)10026-2 · Cited by 182 · see citing works
Cockton, G. (2004) · Nordic Conference on Human-Computer Interaction · doi:10.1145/1028014.1028038 · Cited by 152 · see citing works
Investigating and promoting UX practice in industry: An experimental study
Ardito, C. A., Buono, P., Caivano, D., Costabile, M. F., & Lanzilotti, R. (2013) · International Journal of Human-Computer Studies · doi:10.1016/j.ijhcs.2013.10.004 · Cited by 148 · see citing works
Defining user experience goals to guide the design of industrial systems
Kaasinen, E., Roto, V., Hakulinen, J., Heimonen, T., Jokinen, J., Karvonen, H., Keskinen, T., Koskinen, H. M. K., Lu, Y., Saariluoma, P. O., et al. (2015) · Behaviour and Information Technology · doi:10.1080/0144929x.2015.1035335 · Cited by 130 · see citing works
The importance of design for firms׳ competitiveness: A review of the literature
D’Ippolito, B. (2014) · Technovation · doi:10.1016/j.technovation.2014.01.007 · Cited by 120 · see citing works
Winograd, T. (1997) · Springer eBooks · doi:10.1007/978-1-4612-0685-9_12 · Cited by 110 · see citing works
HCI and Societal Issues: A Framework for Engagement
Hochheiser, H., & Lazar, J. K. (2007) · International Journal of Human-Computer Interaction · doi:10.1080/10447310701702717 · Cited by 95 · see citing works
Ivarsson, M., & Gorschek, T. (2009) · Requirements Engineering · doi:10.1007/s00766-009-0080-1 · Cited by 94 · see citing works
Designing claims for reuse in interactive systems design
Sutcliffe, A., & Carroll, J. M. (1999) · International Journal of Human-Computer Studies · doi:10.1006/ijhc.1999.0245 · Cited by 89 · see citing works
Agile Human-Centered Software Engineering
Memmel, T., Gundelsweiler, F., & Reiterer, H. (2007) · Electronic workshops in computing · doi:10.14236/ewic/hci2007.17 · Cited by 88 · see citing works
Chilana, P. K., Ko, A. J., Wobbrock, J. O., Grossman, T., & Fitzmaurice, G. W. (2011) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/1978942.1979270 · Cited by 81 · see citing works
Use and Usefulness of HCI Methods: Results from an Exploratory Study among Nordic HCI Practitioners
Bark, I., Følstad, A., & Gulliksen, J. (2007) · Springer eBooks · doi:10.1007/1-84628-249-7_13 · Cited by 76 · see citing works
Molina, F., & Toval, A. (2009) · Advances in Engineering Software · doi:10.1016/j.advengsoft.2009.01.018 · Cited by 72 · see citing works
Knowing by Doing: Action Research as an Approach to HCI
Hayes, G. R. (2014) · Springer eBooks · doi:10.1007/978-1-4939-0378-8_3 · Cited by 71 · see citing works
Whose Experience Do We Care About? Analysis of the Fitness of Scrum and Kanban to User Experience
Law, E. L., & Larusdottir, M. K. (2015) · International Journal of Human-Computer Interaction · doi:10.1080/10447318.2015.1065693 · Cited by 66 · see citing works
From User-Centered to Adoption-Centered Design
Chilana, P. K., Ko, A. J., & Wobbrock, J. O. (2015) · doi:10.1145/2702123.2702412 · Cited by 59 · see citing works
Usability methods’ familiarity among map application developers
Nivala, A., Sarjakoski, L. T., & Sarjakoski, T. (2007) · International Journal of Human-Computer Studies · doi:10.1016/j.ijhcs.2007.04.002 · Cited by 47 · see citing works
A systematic review of usability techniques in agile methodologies
Salvador, C., Nakasone, A., & Pow-Sang, J. A. (2014) · Euro American Conference on Telematics and Information Systems · doi:10.1145/2590651.2590668 · Cited by 43 · see citing works
Using Human Factors Standards to Support User Experience and Agile Design
Maguire, M. C. (2013) · Lecture notes in computer science · doi:10.1007/978-3-642-39188-0_20 · Cited by 40 · see citing works
Identifying gaps between HCI, software engineering, and design, and boundary objects to bridge them
John, B. E., Bass, L., Kazman, R., & Chen, E. (2004) · CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA) · doi:10.1145/985921.986201 · Cited by 34 · see citing works
Group usability testing: evolution in usability techniques
Downey, L. L. (2007) · Cited by 34 · see citing works
RUPi - A Unified Process that Integrates Human-Computer Interaction and Software Engineering.
Sousa, K., & Furtado, E. S. (2003) · Cited by 31 · see citing works
Involving users in the wild—Participatory product development in and with online communities
Heß, J., Randall, D. W., Pipek, V., & Wulf, V. (2013) · International Journal of Human-Computer Studies · doi:10.1016/j.ijhcs.2013.01.003 · Cited by 27 · see citing works
Finding Boundary Objects in SE and HCI: An Approach Through Engineering-oriented Design Theories.
Walenstein, A. (2003) · Cited by 26 · see citing works
Agile Usability Patterns for UCD Early Stages
Bertholdo, A. P. O., da Silva, T. S., Melo, C. D. O., et al. (2014) · Lecture notes in computer science · doi:10.1007/978-3-319-07668-3_4 · Cited by 26 · see citing works
Concepts, Values, and Methods for Technical Human–Computer Interaction Research
Hudson, S. E., & Mankoff, J. C. (2014) · Springer eBooks · doi:10.1007/978-1-4939-0378-8_4 · Cited by 25 · see citing works
Designing for ephemerality and prototypicality
Bødker, S., & Christiansen, E. (2004) · ACM Conference on Designing Interactive Systems (DIS) · doi:10.1145/1013115.1013151 · Cited by 25 · see citing works
Rozanski, E. P., & Haake, A. R. (2003) · doi:10.1145/947121.947162 · Cited by 25 · see citing works
CLOSING THE GAPS: Software Engineering and Human-Computer Interaction
Harning, M. B., & Vanderdonckt, J. M. (2003) · Digital Access to Libraries · Cited by 21 · see citing works
The Impact of Human-Centred Design Workshops in Strategic Design Projects
Liem, A., & Sanders, E. (2011) · Lecture notes in computer science · doi:10.1007/978-3-642-21753-1_13 · Cited by 20 · see citing works
User evaluation of HCI concepts for defining product form
Şener, B., & Wormald, P. W. (2007) · Design Studies · doi:10.1016/j.destud.2007.06.003 · Cited by 20 · see citing works
Improving Software Engineering Practice with HCI Aspects
Ferré, X., Juristo, N., & Moreno, A. M. (2004) · Lecture notes in computer science · doi:10.1007/978-3-540-24675-6_27 · Cited by 19 · see citing works
User-Centred Systems Design as Organizational Change
Gulliksen, J., Cajander, Å., Sandblad, B., et al. (2009) · International Journal of Technology and Human Interaction · doi:10.4018/jthi.2009070102 · Cited by 18 · see citing works
Interplay between human-computer interaction and software engineering
Ogunyemi, A. A., & Lamas, D. (2014) · Iberian Conference on Information Systems and Technologies (CISTI) · doi:10.1109/cisti.2014.6877024 · Cited by 18 · see citing works
Self-citationHuman-Computer Interaction – INTERACT 2015
Abascal, J., Barbosa, S. D. J., Fetter, M., et al. (2015) · Lecture notes in computer science · doi:10.1007/978-3-319-22668-2 · Cited by 18 · see citing works
Directions in HCI education, research, and practice in Southern Africa
Kotzé, P. (2002) · CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA) · doi:10.1145/506443.506462 · Cited by 13 · see citing works
Integration of Usability and Agile Methodologies: A Systematic Review
Zapata, C. (2015) · Lecture notes in computer science · doi:10.1007/978-3-319-20886-2_35 · Cited by 12 · see citing works
Strengthening The Hci Approaches In The Software Development Process
Majid, R. A., Noor, N. L. M., & Adnan, W. A. W. (2012) · doi:10.5281/zenodo.1077840 · Cited by 9 · see citing works
Templates: A Key to Success When Training Developers to Perform UX Tasks
Øvad, T., & Larsen, L. B. (2016) · Human-computer interaction series · doi:10.1007/978-3-319-32165-3_3 · Cited by 9 · see citing works
HCI Practices in the Nigerian Software Industry
Ogunyemi, A. A., Lamas, D., Adagunodo, E. R., et al. (2015) · Lecture notes in computer science · doi:10.1007/978-3-319-22668-2_37 · Cited by 8 · see citing works
Self-citationUsability taxonomy and context-of-use taxonomy for usability analysis
Mosqueira-Rey, E., Alonso-Ríos, D., & Moret‐Bonillo, V. (2009) · Conference proceedings/Conference proceedings - IEEE International Conference on Systems, Man, and Cybernetics · doi:10.1109/icsmc.2009.5346929 · Cited by 8 · see citing works
How a Human-Centered Approach Impacts Software Development
Ferré, X., & Medinilla, N. (2007) · Springer eBooks · doi:10.1007/978-3-540-73105-4_8 · Cited by 7 · see citing works
Undergraduate Software Engineering Curriculum Enhancement via Human-Computer Interaction.
Ludi, S. A. (2003) · Cited by 6 · see citing works
Overcoming the Developer Mindset Barrier towards Usability Evaluations
Bruun, A., & Stage, J. (2012) · VBN Forskningsportal (Aalborg Universitet) · Cited by 6 · see citing works
An Autoethnographic Study of HCI Effort Estimation in Outsourced Software Development
Dighe, S., & Joshi, A. N. (2014) · Lecture notes in computer science · doi:10.1007/978-3-662-44811-3_2 · Cited by 5 · see citing works
Introducing the business of UX
Rosenberg, D. J. (2014) · interactions · doi:10.1145/2542115 · Cited by 5 · see citing works
Flagged first, then by citations
Research works printed but not linked: 4
- Kitchenham, B., & Charters, S. (2007). Guidelines for performing Systematic Literature Reviews in Software Engineering . Technical Report EBSE 2007-001 (Vol. 2). Durham.
- Majid, R. A., Noor, N. L. M., Adnan, W. A. W., & Mansor, S. (2009). A survey on HCI considerations in the software development life cycle. In Proceedings of the 2nd International Conference on Interaction Sciences Information Technology, Culture and Human -ICIS '09 (Vol. 403, pp. 21-24). http://doi.org/10.1145/1655925.1655929 · DOI
- Mcginley, C., & Macredie, R. (2011). Towards Diversity and Empathy in Design Development. zoonTechnica - the Journal of Redirective Design , (1), 1-10.
- Vermeeren, A., & Cockton, G. (2013). Facilitating the Take-up of New HCI Practices : A Diffusion of Innovations ' Perspective. In Proceedings of the Workshop Made for sharing: HCI Stories of Transfer, Triumph and Tragedy, CHI 2013 Conference (pp. 1-6). Paris, France: ACM.
Cited by
Sorted by citations
Designing learning technology collaboratively: analysis of a chatbot co-design
Durall Gazulla, E., Martins, L., & Fernández-Ferrer, M. (2023) · Education and Information Technologies · doi:10.1007/s10639-022-11162-w · Cited by 46 · see citing works
- Authors
- Ogunyemi, A. A., Lamas, D., Lárusdóttir, M. K., & Loizides, F.
- Affiliations
- Tallinn University (EE)
- School of Computer Science, Reykjavik University, Reykjavik, Iceland
- Cardiff University (GB)
- Corresponding author
- Ogunyemi, Abiodun Afolayan
- Venue
- International Journal of Human–Computer Interaction
- Publisher
- Informa UK Limited
- Published
- 2018-11-08
- Volume
- 35
- Issue
- 16
- Pages
- 1461-1486
- ISSN
- 1044-7318 (ISSN-L)
- 1532-7590
- OpenAlex
- W2900271353
- Cited by
- 82
- References
- 71
- Citations by year
- 2026: 1 · 2025: 55 · 2024: 5 · 2023: 4 · 2022: 7 · 2021: 4 · 2020: 3 · 2019: 3
- FWCI
- 2.50
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- International Journal of Human-Computer Interaction (publishedVersion)
- ORCA Online Research @Cardiff (Cardiff University) (acceptedVersion)
- ORCA Online Research @Cardiff (Cardiff University) (submittedVersion)
- Topics
- Physical Sciences › Computer Science › Human-Computer Interaction › Usability and User Interface Design
- Physical Sciences › Computer Science › Information Systems › Software Engineering Techniques and Practices
- Physical Sciences › Computer Science › Human-Computer Interaction › Innovative Human-Technology Interaction
- Keywords
- usability engineering, user feedback collection, agile software development, software companies
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
