The DOI matches its Crossref record; 43 of the 43 references it cites were found in a registry or an index.
An analysis and critique of Research through Design: towards a formalization of a research approach
Abstract
The field of HCI is experiencing a growing interest in Research through Design (RtD), a research approach that employs methods and processes from design practice as a legitimate method of inquiry. We are interested in expanding and formalizing this research approach, and understanding how knowledge, or theory, is generated from this type of design research. We conducted interviews with 12 leading HCI design researchers, asking them about design research, design theory, and RtD specifically. They were easily able to identify different types of design research and design theory from contemporary and historical design research efforts, and believed that RtD might be one of the most important contributions of design researchers to the larger research community. We further examined three historical RtD projects that were repeatedly mentioned in the interviews, and performed a critique of current RtD practices within the HCI research and interaction design communities. While our critique summarizes the problems, it also shows possible directions for further developments and refinements of the approach.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
The Reflective Practitioner: How Professionals Think in Action
Checkoway, B., & Schon, D. A. (1985) · Journal of Policy Analysis and Management · doi:10.2307/3324262 · Cited by 21,268
Dilemmas in a general theory of planning
Rittel, H. W. J., & Webber, M. M. (1973) · Policy Sciences · doi:10.1007/bf01405730 · Cited by 16,338 · cited 2×
“In an attempt to distinguish RtD as separate from science, Zimmerman et al [45], link RtD with Rittel’s concept of “Wicked Problems” [31, 3] that are by definition not approachable using scientific or engineering modes of inquiry.”
Method(2014) · The Reflective Practitioner in Professional Education · doi:10.1057/9781137399595.0007 · Cited by 8,325
Tangible bits: towards seamless interfaces between people, bits and atoms
Ishii, H., & Ullmer, B. (1997) · Proceedings of the ACM SIGCHI Conference on Human factors in computing systems · doi:10.1145/258549.258715 · Cited by 3,853 · cited 1×
“Participants mentioned work on tangible interaction, particularly Ishii’s work on the glass bottles [22, 23], and they mentioned the work on design for appropriation, a guiding philosophy about products that are designed without an intended use, allowing users to invent their own meanings and uses [33].”
BackgroundWicked Problems in Design Thinking
Buchanan, R. (1992) · Design Issues · doi:10.2307/1511637 · Cited by 3,539 · cited 2×
“In an attempt to distinguish RtD as separate from science, Zimmerman et al [45], link RtD with Rittel’s concept of “Wicked Problems” [31, 3] that are by definition not approachable using scientific or engineering modes of inquiry.”
MethodMethodological fit in management field research
Edmondson, A. C., & Mcmanus, S. E. (2007) · Academy of Management Review · doi:10.5465/amr.2007.26586086 · Cited by 3,227
Kemp, C. D., & Tufte, E. R. (1992) · Biometrics · doi:10.2307/2532323 · Cited by 2,713
Research through design as a method for interaction design research in HCI
Zimmerman, J., Forlizzi, J., & Evenson, S. (2007) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/1240624.1240704 · Cited by 2,304
Self-citationGaver, B., Dunne, T., & Pacenti, E. (1999) · Interactions · doi:10.1145/291224.291235 · Cited by 2,303
Theory Construction as Disciplined Imagination
Weick, K. E. (1989) · The Academy of Management Review · doi:10.2307/258556 · Cited by 2,134
Understanding experience in interactive systems
Forlizzi, J., & Battarbee, K. (2004) · Proceedings of the 5th conference on Designing interactive systems: processes, practices, methods, and techniques · doi:10.1145/1013115.1013152 · Cited by 925
Self-citationDourish, P. (2006) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/1124772.1124855 · Cited by 860
Thoughtful Interaction Design: A Design Perspective on Information Technology
Löwgren, J., & Stolterman, E. (2004) · The MIT Press eBooks · doi:10.7551/mitpress/6814.001.0001 · Cited by 700
Self-citationStaying open to interpretation: engaging multiple meanings in design and evaluation
Sengers, P., & Gaver, B. (2006) · Proceedings of the 6th conference on Designing Interactive systems · doi:10.1145/1142405.1142422 · Cited by 620 · cited 1×
“Participants mentioned work on tangible interaction, particularly Ishii’s work on the glass bottles [22, 23], and they mentioned the work on design for appropriation, a guiding philosophy about products that are designed without an intended use, allowing users to invent their own meanings and uses [33].”
Background(2008) · International journal of design · Cited by 582
Boehner, K., Vertesi, J., Sengers, P., & Dourish, P. (2007) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/1240624.1240789 · Cited by 525
Runes, D. D. (1962) · Medical Entomology and Zoology · Cited by 441
The drift table: designing for ludic engagement
Gaver, W. W., Bowers, J., Boucher, A., Gellerson, H., Pennington, S., Schmidt, A., Steed, A., Villars, N., & Walker, B. (2004) · CHI '04 Extended Abstracts on Human Factors in Computing Systems · doi:10.1145/985921.985947 · Cited by 439
Theory construction in design research: criteria: approaches, and methods
Friedman, K. (2003) · Design Studies · doi:10.1016/s0142-694x(03)00039-5 · Cited by 434
Action Research and the Practice of Design
Swann, C. (2002) · Design Issues · doi:10.1162/07479360252756287 · Cited by 349 · cited 6×
“The action research sequence of iteratively planning, acting, observing, and then reflecting makes the inquiry approach nearly identical, and both approaches involve interdisciplinary teams [36], or at least the integration of knowledge from several disciplines [45].”
BackgroundMethodInfluentialAlternatives: exploring information appliances through conceptual design proposals
Gaver, B., & Martin, H. (2000) · Proceedings of the SIGCHI conference on Human Factors in Computing Systems · doi:10.1145/332040.332433 · Cited by 280
Thoughtful Interaction Design: A Design Perspective on Information Technology
Poggenpohl, S. (2007) · Visible Language · Cited by 276
Herzig, A. H., & Tufte, E. R. (1991) · Journal of the American Statistical Association · doi:10.2307/2290606 · Cited by 267
Tangible products: redressing the balance between appearance and action
Djajadiningrat, T., Wensveen, S., Frens, J., & Overbeeke, K. (2004) · Personal and Ubiquitous Computing · doi:10.1007/s00779-004-0293-8 · Cited by 265
Dispelling "design" as the black art of CHI
Wolf, T. V., Rode, J. A., Sussman, J., & Kellogg, W. A. (2006) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/1124772.1124853 · Cited by 223
Taylor, A. S., & Swan, L. (2005) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/1054972.1055060 · Cited by 222
On the move with a magic thing: role playing in concept design of mobile services and devices
Iacucci, G., Kuutti, K., & Ranta, M. (2000) · Proceedings of the 3rd conference on Designing interactive systems: processes, practices, methods, and techniques · doi:10.1145/347642.347715 · Cited by 221
Wensveen, S. A. G., Djajadiningrat, J. P., & Overbeeke, C. J. (2004) · Proceedings of the 5th conference on Designing interactive systems: processes, practices, methods, and techniques · doi:10.1145/1013115.1013140 · Cited by 207
Email in personal information management
Whittaker, S., Bellotti, V., & Gwizdka, J. (2006) · Communications of the ACM · doi:10.1145/1107458.1107494 · Cited by 205
Artifact as theory-nexus: hermeneutics meets theory-based design
Carroll, J. M., & Kellogg, W. A. (1989) · Proceedings of the SIGCHI conference on Human factors in computing systems Wings for the mind - CHI '89 · doi:10.1145/67449.67452 · Cited by 188
Artifacts as psychological theories: the case of human-computer interaction
Carroll, J. M., & CAMPBELL, R. L. (1989) · Behaviour and Information Technology · doi:10.1080/01449298908914556 · Cited by 165
Ethnography considered harmful
Crabtree, A., Rodden, T. A., Tolmie, P., & Button, G. (2009) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/1518701.1518835 · Cited by 149
The Role of Design Artifacts in Design Theory Construction
Zimmerman, J., & Forlizzi, J. (2008) · Artifact · doi:10.1080/17493460802276893 · Cited by 146
Self-citationZimmerman, J. (2009) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/1518701.1518765 · Cited by 145
Self-citationThe Product Ecology: Understanding Social Product Use and Supporting Design Culture
Forlizzi, J. (2018) · Figshare · doi:10.1184/r1/6470531 · Cited by 141
Self-citationBottles as a minimal interface to access digital information
Ishii, H., Mazalek, A., & Lee, J. (2001) · CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA) · doi:10.1145/634067.634180 · Cited by 117
A sustainable identity: the creativity of an everyday designer
Wakkary, R., & Tanenbaum, K. (2009) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/1518701.1518761 · Cited by 104
Binder, T. M., & Redström, J. (2006) · Proceedings of DRS · doi:10.21606/drs.2006.56 · Cited by 90
UCPCD: user-centered product concept design
Kankainen, A. (2003) · Conference on Designing for User Experience · doi:10.1145/997078.997087 · Cited by 88
LAB, FIELD, GALLERY, AND BEYOND1
Koskinen, I., Binder, T. M., & Redström, J. (2008) · Artifact · doi:10.1080/17493460802303333 · Cited by 72
Why Research-oriented Design Isn’t Design-oriented Research
Fällman, D. (2005) · Nordic design research conference · doi:10.21606/nordes.2005.016 · Cited by 41
Giller, V., Tscheligi, M., Sefelin, R., Makela, A. M., Puskala, A., Karvonen, K., & Joseph, V. (1999) · interactions · doi:10.1145/319404.319407 · Cited by 12
User-Centered Product Concept Development
Mannonen, P., & Nieminen, M. P. (2006) · CRC Press eBooks · doi:10.1201/9780849375477.ch343 · Cited by 8
Cited by
What should we expect from research through design?
Gaver, W. (2012) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/2207676.2208538 · Cited by 1,123
Shape-changing interfaces: a review of the design space and open research questions
Rasmussen, M. K., Pedersen, E. W., Petersen, M. G., & Hornbæk, K. (2012) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/2207676.2207781 · Cited by 445
Baldassarre, B., Calabretta, G., Bocken, N. M. P., & Jaskiewicz, T. (2017) · Journal of Cleaner Production · doi:10.1016/j.jclepro.2017.01.081 · Cited by 425
Research Through Design in HCI
Zimmerman, J., & Forlizzi, J. (2014) · Ways of Knowing in HCI · doi:10.1007/978-1-4939-0378-8_8 · Cited by 348
Self-citationCritical design and critical theory: the challenge of designing for provocation
Bardzell, S., Bardzell, J., Forlizzi, J., Zimmerman, J., & Antanitis, J. (2012) · Proceedings of the Designing Interactive Systems Conference · doi:10.1145/2317956.2318001 · Cited by 264
Self-citation
Metadata
- Authors
- Zimmerman, J., Stolterman, E., & Forlizzi, J.
- Venue
- Proceedings of the 8th ACM Conference on Designing Interactive Systems
- Publisher
- ACM
- Published
- 2010-08-16
- Pages
- 310-319
- OpenAlex
- W2119170250
- Cited by
- 491
- References
- 43
- FWCI
- 12.25
- Type
- conference paper
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.