Research Note—In CARSs We Trust: How Context-Aware Recommendations Affect Customers’ Trust and Other Business Performance Measures of Recommender Systems
The DOI matches its Crossref record; 16 of the 16 references it cites were found in a registry or an index.
Abstract
Most of the work on context-aware recommender systems has focused on demonstrating that the contextual information leads to more accurate recommendations. Little work has been done, however, on studying how much the contextual information affects the business performance. In this paper, we study how including context in recommendations affects customers’ trust, sales, and other crucial business-related performance measures. To do this, we delivered content-based and context-aware recommendations through a live controlled experiment with real customers of a commercial European online publisher. We measured the recommendations’ accuracy and diversification, how much customers spent purchasing products during the experiment, the quantity and price of their purchases, and the customers’ level of trust. We show that collecting and using contextual information in recommendations affects business-related performance measures, such as company sales, by improving the accuracy and diversification of recommendations, which in turn improves trust and, ultimately, business performance results.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Evaluating collaborative filtering recommender systems
Herlocker, J. L., Konstan, J. A., Terveen, L. G., & Riedl, J. T. (2004) · ACM Transactions on Information Systems · doi:10.1145/963770.963772 · Cited by 5,798 · cited 5×
“We decided to consider 3, 4, and 5 as “relevant” ratings instead of considering only 4 or 5, as discussed in Herlocker et al. (2004), since our rating scale was from 0 to 5 instead of 1 to 5, as in Herlocker et al. (2004).”
BackgroundMethodInfluentialDeveloping and validating trust measures for e-commerce: an integrative typology
McKnight, D. H., Choudhury, V., & Kacmar, C. (2002) · Information Systems Research · doi:10.1287/isre.13.3.334.81 · Cited by 5,550 · cited 4×
“Trust is a multidimensional concept studied by many researchers (McKnight et al. 2002, Schoorman et al. 2007).”
BackgroundInfluentialAn integrative model of organizational trust: past, present, and future
Schoorman, F. D., Mayer, R. C., & Davis, J. H. (2007) · Academy of Management Review · doi:10.5465/amr.2007.24348410 · Cited by 2,794 · cited 3×
“Schoorman et al. (2007) insist on the need to measure trust using all three aspects because all three factors can contribute to trust.”
BackgroundMethodPavlou, P. A., Liang, H., & Xue, Y. (2007) · MIS Quarterly · doi:10.2307/25148783 · Cited by 2,646 · cited 1×
“Several papers, including those in the information systems and e-commerce areas (Ganesan 1994, Jarvenpaa et al. 1998, Gefen et al. 2003, Wang and Benbasat 2005, Pavlou et al. 2007), have defined trust as a multidimensional variable embracing these concepts.”
BackgroundContent-Based Recommendation Systems
Pazzani, M. J., & Billsus, D. (2007) · Lecture Notes in Computer Science · doi:10.1007/978-3-540-72079-9_10 · Cited by 2,600 · cited 2×
“The content-based algorithm (Pazzani and Billsus 2007) uses characteristics of previously purchased or rated items to build customers’ preference profiles and uses these profiles to provide appropriate recommendations.”
MethodWhat we talk about when we talk about context
Dourish, P. (2004) · Personal and Ubiquitous Computing · doi:10.1007/s00779-003-0253-8 · Cited by 1,529
The Effects of Personalization and Familiarity on Trust and Adoption of Recommendation Agents1
Komiak, S. Y. X., & Benbasat, I. (2006) · MIS Quarterly · doi:10.2307/25148760 · Cited by 1,374
Predictive Analytics in Information Systems Research1
Shmueli, G., & Koppius, O. R. (2011) · MIS Quarterly · doi:10.2307/23042796 · Cited by 1,328
Context-Aware Recommender Systems
Adomavicius, G., & Tuzhilin, A. (2011) · Recommender Systems Handbook · doi:10.1007/978-0-387-85820-3_7 · Cited by 1,102 · cited 9×
“One of the important factors affecting performance of RSes is the contextual information (Adomavicius and Tuzhilin, 2011).”
BackgroundMethodInfluentialSelf-citationE-Commerce Product Recommendation Agents: Use, Characteristics, and Impact1
Xiao, B., & Benbasat, I. (2007) · MIS Quarterly · doi:10.2307/25148784 · Cited by 1,081
Cited by
Understanding the Effect of Accuracy on Trust in Machine Learning Models
Yin, M., Wortman Vaughan, J., & Wallach, H. (2019) · Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3290605.3300509 · Cited by 527
Let Me Explain: Impact of Personal and Impersonal Explanations on Trust in Recommender Systems
Kunkel, J., Donkers, T., Michael, L., Barbu, C.-M., & Ziegler, J. (2019) · Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3290605.3300717 · Cited by 156
Xiao, L., Lu, Q., & Guo, F. (2020) · Sustainability · doi:10.3390/su12073036 · Cited by 29
Metadata
- Authors
- Panniello, U., Gorgoglione, M., & Tuzhilin, A.
- Venue
- Information Systems Research
- Published
- 2016-03
- Volume
- 27
- Issue
- 1
- Pages
- 182-196
- ISSN
- 1047-7047 (ISSN-L)
- 1526-5536
- OpenAlex
- W3124956576
- Cited by
- 80
- References
- 16
- FWCI
- 18.58
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.