Listen to Others, Listen to Yourself: Combining Feedback Review and Reflection to Improve Iterative Design
The DOI matches its Crossref record; 10 of the 10 references it cites were found in a registry or an index.
Abstract
Feedback from diverse audiences can contain ambiguity and contradictions, making it difficult to interpret and act on. To promote deeper interpretation of feedback, we tested the effects of combining a reflection activity and reviewing external feedback for an iterative design task. Designers (N=90) created a design and revised it after a) performing a reflection activity before reviewing feedback, b) performing the reflection after reviewing feedback, c) performing the reflection only, or d) reviewing the feedback only. We measured design quality, depth of revision, perceived effort, and confidence; and categorized the content produced from the reflections. We found that performing reflection after feedback review led to the largest increase in perceived quality for the revised designs, and performing reflection and feedback review regardless of the order resulted in the most extensive revision. Our results also showed that performing the reflection alone yielded outcomes that were similar to when only reviewing feedback, and either activity led to better outcomes than the control condition (no feedback or reflection). Designers stated that the reflection helped them recall their goals, question their choices, and prioritize revisions. We argue that designers should perform a lightweight, explicit reflection to enhance their iterative process, and discuss implications for feedback platforms.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Hattie, J., & Timperley, H. (2007) · Review of Educational Research · doi:10.3102/003465430298487 · Cited by 12,905
Effective Reflective Practice: In Search of Meaning in Learning about Teaching
Loughran, J. J. (2002) · Journal of Teacher Education · doi:10.1177/0022487102053001004 · Cited by 1,231
Differing perceptions in the feedback process
Carless, D. (2006) · Studies in Higher Education · doi:10.1080/03075070600572132 · Cited by 1,102 · cited 1×
“However, the effectiveness of feedback on the design depends in large part on how well a person is able to interpret the content, learn from it, and formulate an effective action plan [5, 25, 33, 37].”
BackgroundFeedback : all that effort, but what is the effect?
Price, M., Handley, K., Millar, J., & O'Donovan, B. (2010) · Assessment & Evaluation in Higher Education · doi:10.1080/02602930903541007 · Cited by 735
Quantitative studies of student self-assessment in higher education: a critical analysis of findings
Boud, D., & Falchikov, N. (1989) · Higher Education · doi:10.1007/bf00138746 · Cited by 616 · cited 1×
“1 on 5-point scale), and prior work has shown that those with less expertise typically over-estimate the quality of their performance [4].”
BackgroundParallel prototyping leads to better design results, more divergence, and increased self-efficacy
Dow, S. P., Glassco, A., Kass, J., Schwarz, M., Schwartz, D. L., & Klemmer, S. R. (2010) · ACM Transactions on Computer-Human Interaction · doi:10.1145/1879831.1879836 · Cited by 367
Self-citationDesigning as reflective conversation with the materials of a design situation
Schon, D. A. (1992) · Research in Engineering Design · doi:10.1007/bf01580516 · Cited by 334
Reviewing reflection: on the use of reflection in interactive system design
Baumer, E. P. S., Khovanskaya, V., Matthews, M., Reynolds, L., Schwanda Sosik, V., & Gay, G. (2014) · Proceedings of the 2014 conference on Designing interactive systems · doi:10.1145/2598510.2598598 · Cited by 266
Getting the right design and the design right
Tohidi, M., Buxton, W., Baecker, R., & Sellen, A. (2006) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/1124772.1124960 · Cited by 211 · cited 1×
“It may therefore be most beneficial to perform the reflection activity before reviewing feedback during the early design stage when the focus is typically on conceptual issues and to perform it after reviewing feedback during the late stage when the focus is typically on improving aesthetics [44].”
BackgroundImproving the effectiveness of feedback by use of assessed reflections and withholding of grades
Jackson, M., & Marks, L. (2016) · Assessment & Evaluation in Higher Education · doi:10.1080/02602938.2015.1030588 · Cited by 36
Cited by
Critique Me: Exploring How Creators Publicly Request Feedback in an Online Critique Community
Cheng, R., Zeng, Z., Liu, M., & Dow, S. (2020) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3415232 · Cited by 33
“Not only do we observe a better community response, but also this strategy may help seekers interpret community feedback by instigating meta-cognitive thinking around the design space [59].”
BackgroundSelf-citationInterpretable Directed Diversity: Leveraging Model Explanations for Iterative Crowd Ideation
Wang, Y., Venkatesh, P., & Lim, B. Y. (2022) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3491102.3517551 · Cited by 21
Ask Me or Tell Me? Enhancing the Effectiveness of Crowdsourced Design Feedback
Lekschas, F., Ampanavos, S., Siangliulue, P., Pfister, H., & Gajos, K. Z. (2021) · Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3411764.3445507 · Cited by 14
“[54], we wanted the participants to think about the question-based feedback explicitly to encourage reflection.”
BackgroundInfluential
Metadata
- Authors
- Yen, Y.-C. G., Dow, S. P., Gerber, E., & Bailey, B. P.
- Venue
- Proceedings of the 2017 ACM SIGCHI Conference on Creativity and Cognition
- Publisher
- ACM
- Published
- 2017-06-22
- Pages
- 158-170
- OpenAlex
- W2656003588
- Cited by
- 40
- References
- 10
- FWCI
- 8.38
- Type
- conference paper
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Listen to Others, Listen to Yourself: Combining Feedback Review and Reflection to Improve Iterative Design. https://app.cochat.ai/papers/10.1145/3059454.3059468
- The paper
- Yen, Y.-C. G., Dow, S. P., Gerber, E., & Bailey, B. P. (2017). Listen to Others, Listen to Yourself: Combining Feedback Review and Reflection to Improve Iterative Design. Proceedings of the 2017 ACM SIGCHI Conference on Creativity and Cognition. https://doi.org/10.1145/3059454.3059468
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.