Interactive Guidance Techniques for Improving Creative Feedback
The DOI matches its Crossref record; 20 of the 20 references it cites were found in a registry or an index.
Abstract
Good feedback is critical to creativity and learning, yet rare. Many people do not know how to actually provide effective feedback. There is increasing demand for quality feedback -- and thus feedback givers -- in learning and professional settings. This paper contributes empirical evidence that two interactive techniques -- reusable suggestions and adaptive guidance -- can improve feedback on creative work. We present these techniques embodied in the CritiqueKit system to help reviewers give specific, actionable, and justified feedback. Two real-world deployment studies and two controlled experiments with CritiqueKit found that adaptively-presented suggestions improve the quality of feedback from novice reviewers. Reviewers also reported that suggestions and guidance helped them describe their thoughts and reminded them to provide effective feedback.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Hattie, J., & Timperley, H. (2007) · Review of Educational Research · doi:10.3102/003465430298487 · Cited by 12,905
Nicol, D. J., & Macfarlane‐Dick, D. (2006) · Studies in Higher Education · doi:10.1080/03075070600572090 · Cited by 5,846
Formative assessment and the design of instructional systems
Sadler, D. R. (1989) · Instructional Science · doi:10.1007/bf00117714 · Cited by 4,285 · cited 6×
“Simply pointing out a problem is not sufficient to help one improve [32,35,40,41].”
BackgroundInfluentialThe 2 Sigma Problem: The Search for Methods of Group Instruction as Effective as One-to-One Tutoring
BLOOM, B. S. (1984) · Educational Researcher · doi:10.3102/0013189x013006004 · Cited by 2,734 · cited 1×
“As physical and digital classrooms increase in size, the demand for feedback outgrows the ability to adopt the ideal learning model of one-to-one feedback [2].”
BackgroundPeer Assessment between Students in Colleges and Universities
Topping, K. (1998) · Review of Educational Research · doi:10.2307/1170598 · Cited by 2,173 · cited 1×
“Actionable feedback is often most helpful early in a project [4,43,46] because it may help people self-reflect and self-evaluate their work [8], prompting more revisions for improvement [6,42].”
BackgroundRamaprasad, A. (1983) · Behavioral Science · doi:10.1002/bs.3830280103 · Cited by 915 · cited 1×
“Simply pointing out a problem is not sufficient to help one improve [32,35,40,41].”
BackgroundHearst, M. A. (2009) · doi:10.1017/cbo9781139644082 · Cited by 797
Creativity support tools: accelerating discovery and innovation
Shneiderman, B. (2007) · Communications of the ACM · doi:10.1145/1323688.1323689 · Cited by 765
A comparative study of peer and teacher feedback in a Chinese EFL writing class
Yang, M., Badger, R., & Yu, Z. (2006) · Journal of Second Language Writing · doi:10.1016/j.jslw.2006.09.004 · Cited by 703
Improving the effectiveness of peer feedback for learning
Gielen, S., Peeters, E., Dochy, F., Onghena, P., & Struyven, K. (2010) · Learning and Instruction · doi:10.1016/j.learninstruc.2009.08.007 · Cited by 615 · cited 9×
“CritiqueKit features an interactive guidance panel with checkboxes that update based on which of three attribute categories the feedback fits: Is Specific [19,35,40,46], Is Ac-tionable [6,8,20,25,35,43], and Is Justified [9,19,28,46].”
BackgroundInfluential
Cited by
Mapping the Landscape of Creativity Support Tools in HCI
Frich, J., MacDonald Vermeulen, L., Remy, C., Biskjaer, M. M., & Dalsgaard, P. (2019) · Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3290605.3300619 · Cited by 410
“2018 [29, 30, 62, 73, 90, 111, 126, 162, 165, 171, 175, 184] 2017 [3, 7, 36, 43, 64, 82, 94, 98, 102, 118, 130, 134, 150, 158, 176, 183, 192] 2016 [9, 25, 35, 39, 57, 63, 66, 79, 81, 87, 101, 114, 117, 127, 129, 159, 167, 187] 2015 [38, 54, 89, 100, 123, 137, 160, 166, 168, 186] 2014 [14, 37, 55, 71, 83, 88, 97, 99, 1…”
Evaluating Creativity Support Tools in HCI Research
Remy, C., MacDonald Vermeulen, L., Frich, J., Biskjaer, M. M., & Dalsgaard, P. (2020) · Proceedings of the 2020 ACM Designing Interactive Systems Conference · doi:10.1145/3357236.3395474 · Cited by 96
“Furthermore, if we consider the work by Ngoon et al. on improving critique [115], the improvements to creativity might eventually be realized in the long-term, as the authors hint at themselves.”
Generating Automatic Feedback on UI Mockups with Large Language Models
Duan, P., Warner, J., Li, Y., & Hartmann, B. (2024) · Proceedings of the CHI Conference on Human Factors in Computing Systems · doi:10.1145/3613904.3642782 · Cited by 83
Artist Support Networks: Implications for Future Creativity Support Tools
Chung, J. J. Y., He, S., & Adar, E. (2022) · Designing Interactive Systems Conference · doi:10.1145/3532106.3533505 · Cited by 46
Critique Me: Exploring How Creators Publicly Request Feedback in an Online Critique Community
Cheng, R., Zeng, Z., Liu, M., & Dow, S. (2020) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3415232 · Cited by 33
“Peer feedback systems for classrooms and MOOCs have focused on scaffolding feedback providers with rubrics [40] and prompts [53], reusing feedback from experts [46], and having peers compare multiple submissions [6].”
Background
Metadata
- Authors
- Ngoon, T. J., Fraser, C. A., Weingarten, A. S., Dontcheva, M., & Klemmer, S.
- Venue
- Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems
- Publisher
- ACM
- Published
- 2018-04-19
- Pages
- 1-11
- OpenAlex
- W2796429764
- Cited by
- 52
- References
- 20
- FWCI
- 5.27
- Type
- conference paper
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Interactive Guidance Techniques for Improving Creative Feedback. https://app.cochat.ai/papers/10.1145/3173574.3173629
- The paper
- Ngoon, T. J., Fraser, C. A., Weingarten, A. S., Dontcheva, M., & Klemmer, S. (2018). Interactive Guidance Techniques for Improving Creative Feedback. Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems. https://doi.org/10.1145/3173574.3173629
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.