Fruitful Feedback: Positive Affective Language and Source Anonymity Improve Critique Reception and Work Outcomes
Open accessThe DOI matches its Crossref record; 17 of the 17 references it cites were found in a registry or an index.
Abstract
Feedback is information that can improve task performance. Online communities, educational forums, and crowd-based feedback platforms all support feedback exchange among a more diverse set of sources than ever before, with greater control over how to moderate this exchange. In this work, we study how the power relationship between the source and receiver and the tone of language influence the recep-tivity, effort, and work performance resulting from online feedback exchange. We conducted an online experiment manipulating affective language and source of feedback on a writing task. We found that critiques with positive affec-tive language increased positive emotions and reduced participants' annoyance and frustration, which led to an increase in work quality, compared to critiques without positive language. Feedback without positive affective language led to more edits, but not better work outcomes. Participants reacted more positively to feedback from an anonymous source than from a peer or an authority. Our findings provide design implications for platforms to support more fruitful feedback exchange.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Hattie, J., & Timperley, H. (2007) · Review of Educational Research · doi:10.3102/003465430298487 · Cited by 12,905
A social-cognitive approach to motivation and personality.
Dweck, C. S., & Leggett, E. L. (1988) · Psychological Review · doi:10.1037/0033-295x.95.2.256 · Cited by 9,745 · cited 1×
“Without the positive language, participants may have been more aroused and stressed than those who received feedback with positive language [9, 38].”
BackgroundAnswering the Call for a Standard Reliability Measure for Coding Data
Hayes, A. F., & Krippendorff, K. (2007) · Communication Methods and Measures · doi:10.1080/19312450709336664 · Cited by 4,225 · cited 1×
“For each article, as we employed 3 raters to rate on an ordinal scale from 1 to 7, we computed Krip-pendorff's α [15] to access interrater reliability.”
MethodRunning experiments on Amazon Mechanical Turk
Paolacci, G., Chandler, J., & Ipeirotis, P. G. (2010) · Judgment and Decision Making · doi:10.1017/s1930297500002205 · Cited by 3,767 · cited 1×
“According to several studies [16, 27, 32], Mturk workers in the US are more similar to the general US adult population than college students in US universities.”
BackgroundValidation of a New General Self-Efficacy Scale
Chen, G., Gully, S. M., & Eden, D. (2001) · Organizational Research Methods · doi:10.1177/109442810141004 · Cited by 3,542 · cited 1×
“We measured self-efficacy using a four-item scale adapted from Chen et al. [6] (Cronbach’s α .92).”
MethodConducting behavioral research on Amazon’s Mechanical Turk
Mason, W., & Suri, S. (2012) · Behavior Research Methods · doi:10.3758/s13428-011-0124-6 · Cited by 3,172 · cited 1×
“According to several studies [16, 27, 32], Mturk workers in the US are more similar to the general US adult population than college students in US universities.”
BackgroundMcEwen, B. S., & Sapolsky, R. M. (1995) · Current Opinion in Neurobiology · doi:10.1016/0959-4388(95)80028-x · Cited by 1,889
SELF-REGULATION FOR MANAGERIAL EFFECTIVENESS: THE ROLE OF ACTIVE FEEDBACK SEEKING.
Ashford, S. J., & Tsui, A. S. (1991) · Academy of Management Journal · doi:10.5465/256442 · Cited by 774
Pekrun, R. (1992) · Applied Psychology · doi:10.1111/j.1464-0597.1992.tb00712.x · Cited by 691 · cited 3×
“Negative reactions to feedback can lead to reduced effort during revisions [10, 17], decreased motivation and commitment to task goals [17], and hindered cognitive abilities [33, 39].”
BackgroundThe nature of feedback: How different types of peer feedback affect writing performance
Nelson, M. M., & Schunn, C. D. (2009) · Instructional Science · doi:10.1007/s11251-008-9053-x · Cited by 602
Parallel prototyping leads to better design results, more divergence, and increased self-efficacy
Dow, S. P., Glassco, A., Kass, J., Schwarz, M., Schwartz, D. L., & Klemmer, S. R. (2010) · ACM Transactions on Computer-Human Interaction · doi:10.1145/1879831.1879836 · Cited by 367
Self-citationShepherding the crowd yields better work
Dow, S., Kulkarni, A., Klemmer, S., & Hartmann, B. (2012) · Proceedings of the ACM 2012 conference on Computer Supported Cooperative Work · doi:10.1145/2145204.2145355 · Cited by 334 · cited 1×
“LD is commonly used in studies about writing feedback to measure changes between texts [e.g., 8, 36].”
Self-citationConsequences of Positive and Negative Feedback: The Impact on Emotions and Extra‐Role Behaviors
Belschak, F. D., & Den Hartog, D. N. (2009) · Applied Psychology · doi:10.1111/j.1464-0597.2008.00336.x · Cited by 307
On-line peer assessment and the role of the peer feedback: A study of high school computer course
Tseng, S.-C., & Tsai, C.-C. (2007) · Computers & Education · doi:10.1016/j.compedu.2006.01.007 · Cited by 293 · cited 1×
““Good effort!”) before listing the issues, people perceive the feedback source more positively, seeing them as more likeable with higher integrity [30], and improve their work more after feedback [29, 35].”
BackgroundThe nature, reception, and use of online peer feedback in higher education
van der Pol, J., van den Berg, B. A. M., Admiraal, W. F., & Simons, P. R. J. (2008) · Computers & Education · doi:10.1016/j.compedu.2008.06.001 · Cited by 230 · cited 2×
“Without the positive language, participants may have been more aroused and stressed than those who received feedback with positive language [9, 38].”
BackgroundMethodvan Duijvenvoorde, A. C. K., Zanolie, K., Rombouts, S. A. R. B., Raijmakers, M. E. J., & Crone, E. A. (2008) · The Journal of Neuroscience · doi:10.1523/jneurosci.1485-08.2008 · Cited by 211
PeerStudio: Rapid Peer Feedback Emphasizes Revision and Improves Performance
Kulkarni, C. E., Bernstein, M. S., & Klemmer, S. R. (2015) · Proceedings of the Second (2015) ACM Conference on Learning @ Scale · doi:10.1145/2724660.2724670 · Cited by 192
Cited by
Schiller, R., Fleckenstein, J., Mertens, U., Horbach, A., & Meyer, J. (2024) · Computers & Education · doi:10.1016/j.compedu.2024.105163 · Cited by 36
Zhang, M., He, Q., Du, J., Liu, F., & Huang, B. (2022) · Frontiers in Psychology · doi:10.3389/fpsyg.2022.973478 · Cited by 21
“Previous research (e.g., Guardado and Shi, 2007; Hamid et al., 2014; Yu and Lee, 2014; Nguyen et al., 2017; Yu and Hu, 2017; Lee and Evans, 2019) reported that PF have brought a variety of benefits to L2 learners, including improvement in language quality, reader awareness,”
MethodOn the role of engagement in automated feedback effectiveness: Insights from keystroke logging
Schiller, R., Fleckenstein, J., Höft, L., Horbach, A., & Meyer, J. (2025) · Computers & Education · doi:10.1016/j.compedu.2025.105386 · Cited by 14
Ask Me or Tell Me? Enhancing the Effectiveness of Crowdsourced Design Feedback
Lekschas, F., Ampanavos, S., Siangliulue, P., Pfister, H., & Gajos, K. Z. (2021) · Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3411764.3445507 · Cited by 14
“[33] studied feedback on writing tasks and found that positive tone in critical feedback leads to better work quality overall.”
BackgroundRothschild, A., Booker, J., Davoll, C., Hill, J., Ivey, V., DiSalvo, C., Rydal Shapiro, B., & DiSalvo, B. (2022) · CHI Conference on Human Factors in Computing Systems Extended Abstracts · doi:10.1145/3491101.3516384 · Cited by 5
Metadata
- Authors
- Nguyen, T. T. D. T., Garncarz, T., Ng, F., Dabbish, L. A., & Dow, S. P.
- Venue
- Proceedings of the 2017 ACM Conference on Computer Supported Cooperative Work and Social Computing
- Publisher
- ACM
- Published
- 2017-02-25
- Pages
- 1024-1034
- OpenAlex
- W2588905069
- Cited by
- 51
- References
- 17
- FWCI
- 3.34
- Type
- conference paper
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.