Paragon: An Online Gallery for Enhancing Design Feedback with Visual Examples
The DOI matches its Crossref record; 13 of the 13 references it cites were found in a registry or an index.
Abstract
Examples provide a source of inspiration for creating designs, but can they help improve the feedback process? Supplementing design feedback with examples could help recipients see issues clearly, identify concrete steps for improvement, and integrate novel ideas. Two online studies investigated how to support novices providing feedback on visual poster designs in an online context. Study One found that feedback providers select poster examples that complement their feedback and align with a provided rubric. Study Two shows that feedback providers give more specific, actionable, and novel input when using an example-centric approach, as opposed to text alone. To support this, we designed Paragon, an interface to efficiently browse examples using metadata. Finally, we discuss implications for collecting examples from the Web and structuring the design feedback process.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
A guideline of selecting and reporting intraclass correlation coefficients for reliability research
Koo, T. K., & Li, M. Y. (2016) · Journal of Chiropractic Medicine · doi:10.1016/j.jcm.2016.02.012 · Cited by 31,709
Intraclass correlations: Uses in assessing rater reliability.
Shrout, P. E., & Fleiss, J. L. (1979) · Psychological Bulletin · doi:10.1037/0033-2909.86.2.420 · Cited by 24,532
Formative assessment and the design of instructional systems
Sadler, D. R. (1989) · Instructional Science · doi:10.1007/bf00117714 · Cited by 4,285 · cited 2×
“The Conceptual (i.e. “possess a concept of the standard – or goal, or reference level – being aimed for” [40]) dimension was replaced with Novel to capture the value of examples as a source for inspiration.”
Schema induction and analogical transfer
Gick, M. L., & Holyoak, K. J. (1983) · Cognitive Psychology · doi:10.1016/0010-0285(83)90002-6 · Cited by 3,010 · cited 2×
“Pairing multiple representations also facilitates knowledge transfer [13]; a good analogy both reveals common structure between two situations and suggests further inferences [11].”
Boden, M. A. (2004) · doi:10.4324/9780203508527 · Cited by 2,775
The nature of feedback: How different types of peer feedback affect writing performance
Nelson, M. M., & Schunn, C. D. (2009) · Instructional Science · doi:10.1007/s11251-008-9053-x · Cited by 602 · cited 2×
“Along with other studies on reception and implementation of feedback (see, for example, [31, 33]), a particularly interesting issue for investigation is the design-fixation effect [36] While examples led to higher quality feedback in Study Two, participants also spent more time.”
(2009) · doi:10.1145/1518701.1518944 · Cited by 447
Sitemaps, storyboards, and specifications: a sketch of Web site design practice
Newman, M. W., & Landay, J. A. (2000) · Proceedings of the 3rd conference on Designing interactive systems: processes, practices, methods, and techniques · doi:10.1145/347642.347758 · Cited by 220 · cited 1×
“Designers often collect examples in early stages of the design process to form ideas and sketch a path forward [32, 18].”
Getting the right design and the design right
Tohidi, M., Buxton, W., Baecker, R., & Sellen, A. (2006) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/1124772.1124960 · Cited by 211 · cited 1×
“Recognizing and weighing alternatives provides value through the design process [44].”
Designing with interactive example galleries
Lee, B., Srivastava, S., Kumar, R., Brafman, R., & Klemmer, S. R. (2010) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/1753326.1753667 · Cited by 195 · cited 3×
“Examples can lower the barrier to entry for non-designers [28, 17].”
Cited by
IdeateRelate: An Examples Gallery That Helps Creators Explore Ideas in Relation to Their Own
Xu, X. (., Xiong, R., Wang, B., Min, D., & Dow, S. P. (2021) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3479496 · Cited by 21
“Paragon uses an interactive example gallery to compliment design feedback [39].”
BackgroundMethodSelf-citationAsk Me or Tell Me? Enhancing the Effectiveness of Crowdsourced Design Feedback
Lekschas, F., Ampanavos, S., Siangliulue, P., Pfister, H., & Gajos, K. Z. (2021) · Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3411764.3445507 · Cited by 14
“In the context of crowdsourcing, several studies [18, 23, 30, 32, 35, 51, 55] have evaluated the efects of structuring and scafolding feedback and found that an appropriate structure elicits more diverse and higher quality feedback.”
BackgroundConsidering Visualization Example Galleries
Yang, J., McNutt, A. M., & Battle, L. (2024) · 2024 IEEE Symposium on Visual Languages and Human-Centric Computing (VL/HCC) · doi:10.1109/vl/hcc60511.2024.00043 · Cited by 11
“Designers and artists look into examples as sources of inspiration [2], [30], [63] and as tools to communicate concrete feedback [27].”
Background
Metadata
- Authors
- Kang, H. B., Amoako, G., Sengupta, N., & Dow, S. P.
- Venue
- Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems
- Publisher
- ACM
- Published
- 2018-04-21
- Pages
- 1-13
- OpenAlex
- W2796266198
- Cited by
- 36
- References
- 13
- FWCI
- 2.43
- Type
- conference paper
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.