Crowd-Based Personalized Natural Language Explanations for Recommendations
The DOI matches its Crossref record; 3 of the 3 references it cites were found in a registry or an index.
Abstract
Explanations are important for users to make decisions on whether to take recommendations. However, algorithm generated explanations can be overly simplistic and unconvincing. We believe that humans can overcome these limitations. Inspired by how people explain word-of-mouth recommendations, we designed a process, combining crowdsourcing and computation, that generates personalized natural language explanations. We modeled key topical aspects of movies, asked crowdworkers to write explanations based on quotes from online movie reviews, and personalized the explanations presented to users based on their rating history. We evaluated the explanations by surveying 220 MovieLens users, finding that compared to personalized tag-based explanations, natural language explanations: 1) contain a more appropriate amount of information, 2) earn more trust from users, and 3) make users more satisfied. This paper contributes to the research literature by describing a scalable process for generating high quality and personalized natural language explanations, improving on state-of-the-art content-based explanations, and showing the feasibility and advantages of approaches that combine human wisdom with algorithmic processes.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Explaining collaborative filtering recommendations
Herlocker, J. L., Konstan, J. A., & Riedl, J. (2000) · Proceedings of the 2000 ACM conference on Computer supported cooperative work · doi:10.1145/358916.358995 · Cited by 1,731 · cited 5×
“When designing recommendation explanations, there are several “styles” [21] of explanations to choose from: casebased, collaborative-based [11], content-based [22], conversational [19], demographic-based, and knowledge-based [24].”
BackgroundMethodInfluentialSoylent: a word processor with a crowd inside
Bernstein, M. S., Little, G., Miller, R. C., Hartmann, B., Ackerman, M. S., Karger, D. R., Crowell, D., & Panovich, K. (2010) · Proceedings of the 23nd annual ACM symposium on User interface software and technology · doi:10.1145/1866029.1866078 · Cited by 686 · cited 1×
“Recent research on crowdsourcing shows that such mixed computation creates exciting new applications, such as Soylent, a crowd-powered word editor [2].”
BackgroundA Personalized System for Conversational Recommendations
Thompson, C. A., Goker, M. H., & Langley, P. (2004) · Journal of Artificial Intelligence Research · doi:10.1613/jair.1318 · Cited by 223
Cited by
Let Me Explain: Impact of Personal and Impersonal Explanations on Trust in Recommender Systems
Kunkel, J., Donkers, T., Michael, L., Barbu, C.-M., & Ziegler, J. (2019) · Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3290605.3300717 · Cited by 156
“We thus believe that combinations of different explanation styles lead to explanations with a higher perceived value, which is backed up by prior findings [5].”
BackgroundResultInfluentialA survey on XAI and natural language explanations
Cambria, E., Malandri, L., Mercorio, F., Mezzanzanica, M., & Nobani, N. (2023) · Information Processing & Management · doi:10.1016/j.ipm.2022.103111 · Cited by 131
Personalising Explainable Recommendations: Literature and Conceptualisation
Naiseh, M., Jiang, N., Ma, J., & Ali, R. (2020) · Advances in Intelligent Systems and Computing · doi:10.1007/978-3-030-45691-7_49 · Cited by 42
“In the literature, there are explanation models proposed and employed in the field of recommendation systems [45, 15, 43, 8], machine learning [47],decision support systems [11, 6] and robots [24].”
BackgroundRadensky, M., Séguin, J. A., Lim, J. S., Olson, K., & Geiger, R. (2023) · 2023 ACM Conference on Fairness Accountability and Transparency · doi:10.1145/3593013.3594043 · Cited by 14
“We measure reliance by taking final recommendation ratings as ground truth and compare those to initial ratings based on initial exposure to the recommendations, as in prior work [6, 10].”
MethodChen, Z., Jiang, Z., Yang, F., He, Z., Hou, Y., Cho, E., McAuley, J., Galstyan, A., Hu, X., & Yang, J. (2023) · Proceedings of the 32nd ACM International Conference on Information and Knowledge Management · doi:10.1145/3583780.3615314 · Cited by 5
Metadata
- Authors
- Chang, S., Harper, F. M., & Terveen, L. G.
- Venue
- Proceedings of the 10th ACM Conference on Recommender Systems
- Publisher
- ACM
- Published
- 2016-09-07
- Pages
- 175-182
- OpenAlex
- W2511352244
- Cited by
- 114
- References
- 3
- FWCI
- 10.26
- Type
- conference paper
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Crowd-Based Personalized Natural Language Explanations for Recommendations. https://app.cochat.ai/papers/10.1145/2959100.2959153
- The paper
- Chang, S., Harper, F. M., & Terveen, L. G. (2016). Crowd-Based Personalized Natural Language Explanations for Recommendations. Proceedings of the 10th ACM Conference on Recommender Systems. https://doi.org/10.1145/2959100.2959153
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.