The effects of transparency on trust in and acceptance of a content-based art recommender
Open accessThe DOI matches its Crossref record; 85 of the 88 references it cites were found in a registry or an index.
Abstract
The increasing availability of (digital) cultural heritage artefacts offers great potential for increased access to art content, but also necessitates tools to help users deal with such abundance of information. User-adaptive art recommender systems aim to present their users with art content tailored to their interests. These systems try to adapt to the user based on feedback from the user on which artworks he or she finds interesting. Users need to be able to depend on the system to competently adapt to their feedback and find the artworks that are most interesting to them. This paper investigates the influence of transparency on user trust in and acceptance of content-based recommender systems. A between-subject experiment ( N = 60) evaluated interaction with three versions of a content-based art recommender in the cultural heritage domain. This recommender system provides users with artworks that are of interest to them, based on their ratings of other artworks. Version 1 was not transparent, version 2 explained to the user why a recommendation had been made and version 3 showed a rating of how certain the system was that a recommendation would be of interest to the user. Results show that explaining to the user why a recommendation was made increased acceptance of the recommendations. Trust in the system itself was not improved by transparency. Showing how certain the system was of a recommendation did not influence trust and acceptance. A number of guidelines for design of recommender systems in the cultural heritage domain have been derived from the study’s results.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Thus, our findings are in line with other research that provided mixed evidence regarding the effect of transparency on trust (Cramer et al., 2008; Nothdurft et al., 2013; Cheng et al., 2019; Ehsan et al., 2019; Zhang et al., 2020; Poursabzi-Sangdeh et al., 2021).”
From Exploring the effects of human-centered AI explanations on trust and reliance (2023) · cites this paper as Cramer et al., 2008
Citations
Cites
Perceived usefulness, perceived ease of use, and user acceptance of information technology
Davis, F. D. (1989) · MIS Quarterly · doi:10.2307/249008 · Cited by 68,483 · cited 3×
“Several authors have studied possible extensions to the Technology Acceptance Model (see e.g. Ndubisi et al. 2005; Ma and Liu 2004; Klopping and McKinney 2004; van der Heijden 2004). van der Heijden (2004), for example, showed that the purpose of a system plays an important role in determining the predictive importanc…”
BackgroundMethodUser Acceptance of Information Technology: Toward A Unified View1
Venkatesh, V., Morris, M. G., Davis, G. B., & Davis, F. D. (2003) · MIS Quarterly · doi:10.2307/30036540 · Cited by 45,035 · cited 7×
“According to the model (updated by Venkatesh et al. 2003), performance expectancy, effort expectancy (how much effort it will take to learn and use a system), social influence and facilitating conditions (whether the user has enough time and resources to use the technology) are expected to…”
BackgroundMethodResultInfluentialTrust and TAM in Online Shopping: An Integrated Model1
Gefen, D., Karahanna, E., & Straub, D. W. (2003) · MIS Quarterly · doi:10.2307/30036519 · Cited by 8,635 · cited 2×
“Trust has been shown to affect system acceptance and has been combined with the technology acceptance model, by such authors as Wu and Chen (2005); Wang and Benbasat (2007); Pavlou (2003) and Gefen et al. (2003).”
MethodPicard, R. W. (1997) · MIT Press · doi:10.7551/mitpress/1140.001.0001 · Cited by 7,382
Affect and Cognition Based Trust as Foundations for Interpersonal Cooperation in Organizations
McAllister, D. J. (1995) · Academy of Management Journal · doi:10.2307/256727 · Cited by 7,346 · cited 1×
“McAllister (1995), quoting Simmel (1964), notes that “the amount of knowledge necessary for trust is somewhere between total knowledge and total ignorance.”
BackgroundTrust in Automation: Designing for Appropriate Reliance
Lee, J. D., & See, K. A. (2004) · Human Factors: The Journal of the Human Factors and Ergonomics Society · doi:10.1518/hfes.46.1.50_30392 · Cited by 6,605 · cited 8×
“A similar definition is offered by Lee and See (2004), who define trust as “the attitude that an agent will help achieve an individual’s goals in a situation characterized by uncertainty and vulnerability”.”
BackgroundInfluentialEvaluating collaborative filtering recommender systems
Herlocker, J. L., Konstan, J. A., Terveen, L. G., & Riedl, J. T. (2004) · ACM Transactions on Information Systems · doi:10.1145/963770.963772 · Cited by 5,798
(2003) · International Journal of Electronic Commerce · doi:10.1080/10864415.2003.11044275 · Cited by 5,715 · cited 2×
“A decade ago, Picard (1997) identified the need for such personalisation of online museum collections.”
BackgroundMethod(1997) · Choice Reviews Online · doi:10.5860/choice.34-3702 · Cited by 4,887
Hybrid Recommender Systems: Survey and Experiments
Burke, R. (2002) · User Modeling and User-Adapted Interaction · doi:10.1023/a:1021240730564 · Cited by 3,871 · cited 2×
“These profiles can be based on either similarities between users (collaborative- or social-based filtering), content features of recommended items (content-based), or a hybrid of these approaches (Burke 2002).”
BackgroundUser Acceptance of Hedonic Information Systems1
van der Heijden, H. (2004) · MIS Quarterly · doi:10.2307/25148660 · Cited by 3,850 · cited 2×
“…to the Technology Acceptance Model (see e.g. Ndubisi et al. 2005; Ma and Liu 2004; Klopping and McKinney 2004; van der Heijden 2004). van der Heijden (2004), for example, showed that the purpose of a system plays an important role in determining the predictive importance of respective…”
BackgroundBrusilovsky, P. (2001) · User Modeling and User-Adapted Interaction · doi:10.1023/a:1011143116306 · Cited by 2,057
Methods and techniques of adaptive hypermedia
Brusilovsky, P. (1996) · User Modeling and User-Adapted Interaction · doi:10.1007/bf00143964 · Cited by 2,041 · cited 3×
“User-adaptive systems can adapt to the specific user’s needs and change with changing user interests (Benyon 1993; Brusilovsky 1996).”
BackgroundFoundations for an Empirically Determined Scale of Trust in Automated Systems
Jian, J.-Y., Bisantz, A. M., & Drury, C. G. (2000) · International Journal of Cognitive Ergonomics · doi:10.1207/s15327566ijce0401_04 · Cited by 1,799
Explaining collaborative filtering recommendations
Herlocker, J. L., Konstan, J. A., & Riedl, J. (2000) · Proceedings of the 2000 ACM conference on Computer supported cooperative work · doi:10.1145/358916.358995 · Cited by 1,731 · cited 6×
“Herlocker et al. (2000) found that poorly designed explanations can actually hinder the acceptance of individual recommendations.”
BackgroundInfluential(2013) · Choice Reviews Online · doi:10.5860/choice.50-3307 · Cited by 1,352
The role of trust in automation reliance
Dzindolet, M. T., Peterson, S. A., Pomranky, R. A., Pierce, L. G., & Beck, H. P. (2003) · International Journal of Human-Computer Studies · doi:10.1016/s1071-5819(03)00038-7 · Cited by 1,276 · cited 7×
“Trust is thought to be one of the important affective elements that play a role in human interaction with technology (Lee and See 2004; Dzindolet et al. 2003).”
BackgroundInfluentialMediating intimacy: designing technologies to support strong-tie relationships
Vetere, F., Gibbs, M. R., Kjeldskov, J., Howard, S., Mueller, F. '., Pedell, S., Mecoles, K., & Bunyan, M. (2005) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/1054972.1055038 · Cited by 1,047
MUIR, B. M., & MORAY, N. (1996) · Ergonomics · doi:10.1080/00140139608964474 · Cited by 993 · cited 3×
“Users may have a level of trust in a device, but also have a level of trust in the success of cooperation with the device (see also Muir 1994; Muir and Moray 1996).”
BackgroundTrust, self-confidence, and operators' adaptation to automation
Lee, J. D., & Moray, N. (1994) · International Journal of Human-Computer Studies · doi:10.1006/ijhc.1994.1007 · Cited by 932 · cited 1×
“Calibration refers to the correspondence between a person’s trust in a system and the system’s capabilities (see also Lee and Moray 1994; Muir 1994).”
BackgroundWu, I.-L., & Chen, J.-L. (2005) · International Journal of Human-Computer Studies · doi:10.1016/j.ijhcs.2005.03.003 · Cited by 879 · cited 2×
“Trust has been shown to affect system acceptance and has been combined with the technology acceptance model, by such authors as Wu and Chen (2005); Wang and Benbasat (2007); Pavlou (2003) and Gefen et al. (2003).”
BackgroundMethodMUIR, B. M. (1994) · Ergonomics · doi:10.1080/00140139408964957 · Cited by 873 · cited 3×
“Users may have a level of trust in a device, but also have a level of trust in the success of cooperation with the device (see also Muir 1994; Muir and Moray 1996).”
BackgroundTrust In and Adoption of Online Recommendation Agents
University of British Columbia, C., Benbasat, I., Wang, W., & University of British Columbia, C. (2005) · Journal of the Association for Information Systems · doi:10.17705/1jais.00065 · Cited by 841 · cited 1×
“Authors such as Wang and Benbasat (2005) and Xiao and Benbasat (2003) studied trust in online e-commerce recommender settings.”
BackgroundThe elements of computer credibility
Fogg, B. J., & Tseng, H. (1999) · Proceedings of the SIGCHI conference on Human factors in computing systems the CHI is the limit - CHI '99 · doi:10.1145/302979.303001 · Cited by 802 · cited 5×
“This is in line with previous literature where users who are familiar with the content are expected to be more critical of the system and perceive it as less dependable (Fogg and Tseng 1999).”
BackgroundResultInfluential(2003) · Choice Reviews Online · doi:10.5860/choice.40-4648 · Cited by 779
Privacy by Design - Principles of Privacy-Aware Ubiquitous Systems
Langheinrich, M. (2001) · Cited by 730
The Technology Acceptance Model: A Meta-Analysis of Empirical Findings
Ma, Q., & Liu, L. (2004) · Journal of Organizational and End User Computing · doi:10.4018/joeuc.2004010104 · Cited by 660 · cited 1×
“Several authors have studied possible extensions to the Technology Acceptance Model (see e.g. Ndubisi et al. 2005; Ma and Liu 2004; Klopping and McKinney 2004; van der Heijden 2004). van der Heijden (2004), for example, showed that the purpose of a system plays an important role in determining the…”
BackgroundPrivacy by Design — Principles of Privacy-Aware Ubiquitous Systems
Langheinrich, M. (2001) · Lecture Notes in Computer Science · doi:10.1007/3-540-45427-6_23 · Cited by 540 · cited 1×
“In some situations, trust may be a prerequisite to get the personal information needed to personalise a system, invoking privacy concerns (Langheinrich 2001).”
BackgroundExplanations From Intelligent Systems: Theoretical Foundations and Implications for Practice1
Gregor, S., & Benbasat, I. (1999) · MIS Quarterly · doi:10.2307/249487 · Cited by 535 · cited 1×
“Other prior studies also suggest that making adaptive systems more transparent to the user could lead to a more positive user attitude towards using a system and increases in system performance (e.g. Kay 2006; Höök et al. 1996; Höök 2000; Carmagnola et al. 2006; Gregor and Benbasat 1999).”
BackgroundDirect manipulation vs. interface agents
Shneiderman, B., & Maes, P. (1997) · Interactions · doi:10.1145/267505.267514 · Cited by 518 · cited 2×
“2.5 Transparency of user-adaptive systems and study hypotheses Maes (in a discussion between Shneiderman and Maes (2007)) states that one of the great interaction design challenges is how to achieve understanding and control in user-agent interaction.”
BackgroundInfluentialRecommendation Agents for Electronic Commerce: Effects of Explanation Facilities on Trusting Beliefs
Wang, W., & Benbasat, I. (2007) · Journal of Management Information Systems · doi:10.2753/mis0742-1222230410 · Cited by 498 · cited 2×
“Wang and Benbasat (2007) compared the effects of three types of explanations on user trust in an e-commerce recommender.”
BackgroundMethodThe role of transparency in recommender systems
Sinha, R., & Swearingen, K. (2002) · CHI '02 Extended Abstracts on Human Factors in Computing Systems · doi:10.1145/506443.506619 · Cited by 477 · cited 2×
“Sinha and Swearingen (2002) for instance, evaluated transparency and recommendations for five music recommender systems.”
BackgroundIntercoder Reliability for Validating Conclusions Drawn from Open-Ended Interview Data
Kurasaki, K. S. (2000) · Field Methods · doi:10.1177/1525822x0001200301 · Cited by 462 · cited 2×
“A similar procedure is followed in Kurasaki (2000). Interesting is that for the participants whose understanding was analysed, there was no significant correlation between how well participants thought they understood the system and their actual understanding (Spearman’s rho = .”
MethodInformation Filtering: Overview of Issues, Research and Systems
Hanani, U., Shapira, B., & Shoval, P. (2001) · User Modeling and User-Adapted Interaction · doi:10.1023/a:1011196000674 · Cited by 370
Prominence-interpretation theory: explaining how people assess credibility online
Fogg, B. J. (2003) · CHI '03 extended abstracts on Human factors in computing systems - CHI '03 · doi:10.1145/765891.765951 · Cited by 335
Explaining Recommendations: Satisfaction vs. Promotion
Bilgic, M., & Mooney, R. J. (2005) · Intelligent User Interfaces · Cited by 334
Steps to take before intelligent user interfaces become real
Höök, K. (2000) · Interacting with Computers · doi:10.1016/s0953-5438(99)00006-5 · Cited by 315 · cited 2×
“Other prior studies also suggest that making adaptive systems more transparent to the user could lead to a more positive user attitude towards using a system and increases in system performance (e.g. Kay 2006; Höök et al. 1996; Höök 2000; Carmagnola et al. 2006; Gregor and Benbasat 1999).”
BackgroundTrust and etiquette in high-criticality automated systems
Parasuraman, R., & Miller, C. A. (2004) · Communications of the ACM · doi:10.1145/975817.975844 · Cited by 311 · cited 6×
“Parasuraman and Miller (2004) state that trust is users’ willingness to believe information from a system or make use of its capabilities.”
BackgroundMethodInfluentialADAPTIVE INTERFACES AND AGENTS
(2007) · The Human-Computer Interaction Handbook · doi:10.1201/9781410615862-33 · Cited by 298
Analysing the Relationship between Risk and Trust
Jøsang, A., & Presti, S. L. (2004) · Lecture Notes in Computer Science · doi:10.1007/978-3-540-24747-0_11 · Cited by 248
Trust-inspiring explanation interfaces for recommender systems
Pu, P., & Chen, L. (2007) · Knowledge-Based Systems · doi:10.1016/j.knosys.2007.04.004 · Cited by 248 · cited 2×
“Pu and Chen (2007) have focused on trust in the recommender based on the user’s perception of its competence, and its ability to explain the recommended results.”
BackgroundGradual trust and distrust in recommender systems
Victor, P., Cornelis, C., De Cock, M., & Pinheiro da Silva, P. (2009) · Fuzzy Sets and Systems · doi:10.1016/j.fss.2008.11.014 · Cited by 210 · cited 2×
“Trust has been shown to affect system acceptance and has been combined with the technology acceptance model, by such authors as Wu and Chen (2005); Wang and Benbasat (2007); Pavlou (2003) and Gefen et al.”
BackgroundMethodAdaptive, intelligent presentation of information for the museum visitor in PEACH
Stock, O., Zancanaro, M., Busetta, P., Callaway, C., Krüger, A., Kruppa, M., Kuflik, T., Not, E., & Rocchi, C. (2007) · User Modeling and User-Adapted Interaction · doi:10.1007/s11257-007-9029-6 · Cited by 193 · cited 2×
“An evaluation with 110 museum visitors offered encouraging results, concluding that major components of their personalisation technology were suitable for use by the general museum public (Stock et al. 2007).”
BackgroundMuseumFinland—Finnish museums on the semantic web
Hyvönen, E., Mäkelä, E., Salminen, M., Valo, A., Viljanen, K., Saarela, S., Junnila, M., & Kettula, S. (2005) · Journal of Web Semantics · doi:10.1016/j.websem.2005.05.008 · Cited by 191
Explanation in Recommender Systems
Mcsherry, D. (2005) · Artificial Intelligence Review · doi:10.1007/s10462-005-4612-x · Cited by 182 · cited 1×
“McSherry (2005) discusses an approach to finding a fitting product recommendation by guiding the user through the features of the available products, which can for example help understanding the trade-offs and interdependencies between product features.”
BackgroundExploring the potential for social tagging and folksonomy in art museums: Proof of concept
Trant, J., & steve., W. T. P. I. T. (2006) · New Review of Hypermedia and Multimedia · doi:10.1080/13614560600802940 · Cited by 171 · cited 1×
“Trant (2006) for example describes how users can tag items and provide their own descriptions and keywords.”
BackgroundEffective explanations of recommendations: user-centered design
Tintarev, N., & Masthoff, J. (2007) · Proceedings of the 2007 ACM conference on Recommender systems · doi:10.1145/1297231.1297259 · Cited by 161 · cited 2×
“Tintarev and Masthoff (2007) provide a number of guidelines for recommender system explanations.”
BackgroundAdaptive systems: A solution to usability problems
Benyon, D. (1993) · User Modeling and User-Adapted Interaction · doi:10.1007/bf01099425 · Cited by 139
A glass box approach to adaptive hypermedia
Höök, K., Jussi Karlgren, C., Wærn, A., Dahlbäck, N., Jansson, C. G., Karlgren, K., & Lemaire, B. (1996) · User Modeling and User-Adapted Interaction · doi:10.1007/bf00143966 · Cited by 131 · cited 2×
“In spite of these potential problems, previous authors have emphasised the importance of transparency (Jameson 2003; Höök et al. 1996).”
BackgroundExplaining answers from the Semantic Web: the Inference Web approach
McGuinness, D. L., & da Silva, P. P. (2004) · Journal of Web Semantics · doi:10.1016/j.websem.2004.06.002 · Cited by 131
Trust and control: A dialectic link
Castelfranchi, C., & Falcone, R. (2000) · Applied Artificial Intelligence · doi:10.1080/08839510050127560 · Cited by 129 · cited 1×
“Authors such as Castelfranchi and Falcone (2000) and Jøsang and Lo Presti (2004) also note that even though a user might trust a system, he or she might not choose to rely on it when the user perceives the risks as too great.”
BackgroundLISTEN: a user-adaptive audio-augmented museum guide
Zimmermann, A., & Lorenz, A. (2008) · User Modeling and User-Adapted Interaction · doi:10.1007/s11257-008-9049-x · Cited by 126 · cited 3×
“Citation for published version (APA): Cramer, H., Evers, V., Ramlal, S., van Someren, M., Rutledge, L., Stash, N., ... Wielinga, B. (2008). The effects of transparency on trust in and acceptance of a content-based art recommender.”
BackgroundInfluentialA Nomadic Information System for Adaptive Exhibition Guidance
Oppermann, R., & Specht, M. M. (1999) · Archives and Museum Informatics · doi:10.1023/a:1016619506241 · Cited by 122 · cited 1×
“Another example of a mobile guide system is provided by Oppermann and Specht (1999).”
BackgroundThe role of intervening variables in driver–ACC cooperation
Rajaonah, B., Tricot, N., Anceaux, F., & Millot, P. (2007) · International Journal of Human-Computer Studies · doi:10.1016/j.ijhcs.2007.09.002 · Cited by 117
Rocchi, C., Stock, O., Zancanaro, M., Kruppa, M., & Krüger, A. (2004) · ACM International Conference on Intelligent User Interfaces (IUI) · doi:10.1145/964442.964517 · Cited by 116 · cited 2×
“Waern (2004) shows that users cannot always recognise good quality user profiles and cannot always improve them when given the opportunity.”
BackgroundShimazu, H. (2002) · Artificial Intelligence Review · doi:10.1023/a:1020757023711 · Cited by 107 · cited 1×
“Shimazu (2002) discusses a system mimicking the interaction between a customer and a store clerk to come to a final understandable product recommendation.”
BackgroundUser Attitudes Regarding a User-Adaptive eCommerce Web Site
Alpert, S. R., Karat, J., Karat, C.-M., Brodie, C., & Vergo, J. G. (2003) · User Modeling and User-Adapted Interaction · doi:10.1023/a:1026201108015 · Cited by 99
Evaluating the utility and usability of an adaptive hypermedia system
Höök, K. (1997) · Proceedings of the 2nd international conference on Intelligent user interfaces - IUI '97 · doi:10.1145/238218.238320 · Cited by 95 · cited 4×
“Höök (1997) notes that it is not necessarily desirable to have a system explain how it works in full detail because the full details might be alienating to a layman user.”
BackgroundInfluentialScrutable Adaptation: Because We Can and Must
Kay, J. (2006) · Lecture notes in computer science · doi:10.1007/11768012_2 · Cited by 93 · cited 1×
“Other prior studies also suggest that making adaptive systems more transparent to the user could lead to a more positive user attitude towards using a system and increases in system performance (e.g. Kay 2006; Höök et al. 1996; Höök 2000; Carmagnola et al. 2006; Gregor and Benbasat 1999).”
BackgroundTag-based user modeling for social multi-device adaptive guides
Carmagnola, F., Cena, F., Console, L., Cortassa, O., Gena, C., Goy, A., Torre, I., Toso, A., & Vernero, F. (2008) · User Modeling and User-Adapted Interaction · doi:10.1007/s11257-008-9052-2 · Cited by 91 · cited 2×
“Carmagnola et al. (2008) describe how these tags can also be exploited to improve recommender systems.”
BackgroundHow Convincing is Mr. Data's Smile: Affective Expressions of Machines
Bartneck, C. (2001) · User Modeling and User-Adapted Interaction · doi:10.1023/a:1011811315582 · Cited by 85
MultimediaN E-Culture Demonstrator
Guus Schreiber, A., Amin, A., van Assem, M., de Boer, V., Hardman, L., Hildebrand, M., Hollink, L., Huang, Z., van Kersen, J., de Niet, M., et al. (2006) · Lecture notes in computer science · doi:10.1007/11926078_70 · Cited by 85 · cited 1×
“Other authors who describe usage of Semantic Web technologies for adapted presentation of cultural heritage content include Schreiber et al. (2006) and Sinclair et al. (2006).”
BackgroundSelf-citationPersonalisation and Trust: A Reciprocal Relationship?
Briggs, P., Simpson, B., & Angeli, A. D. (2004) · Human-computer interaction series · doi:10.1007/1-4020-2148-8_4 · Cited by 83 · cited 1×
“Briggs et al. (2004) note that personalisation itself plays a role in trust formation.”
BackgroundNdubisi, N. O., Gupta, O. K., & Ndubisi, G. C. (2005) · Journal of Global Information Technology Management · doi:10.1080/1097198x.2005.10856389 · Cited by 82 · cited 2×
“Several authors have studied possible extensions to the Technology Acceptance Model (see e.g. Ndubisi et al. 2005; Ma and Liu 2004; Klopping and McKinney 2004; van der Heijden 2004). van der Heijden (2004), for example, showed that the purpose of a system plays an important role in determining the…”
BackgroundMethodCheverst, K., Byun, H. E., Fitton, D., Sas, C., Kray, C., & Villar, N. (2005) · User Modeling and User-Adapted Interaction · doi:10.1007/s11257-005-1269-8 · Cited by 81 · cited 1×
“Therefore, transparency and task performance can influence each other negatively (see also Cheverst et al. 2005).”
BackgroundArtequakt: Generating Tailored Biographies from Automatically Annotated Fragments from the Web
Kim, S., Alani, H., Hall, W., Lewis, P. H., Millard, D. E., Shadbolt, N. R., & Weal, M. J. (2002) · Open Research Online - ORO (The Open University) · Cited by 80
Pros and Cons of Controllability: An Empirical Study
Jameson, A., & Schwarzkopf, E. (2002) · Lecture Notes in Computer Science · doi:10.1007/3-540-47952-x_21 · Cited by 77 · cited 1×
“Jameson and Schwarzkopf (2002) investigated the level of controllability of a user-adaptive system, and performed a study in which users got to determine the nature and timing of adaptations.”
Supporting people in finding information : hybrid recommender systems and goal-based structuring
Setten, V. M. (2005) · University of Twente Research Information · Cited by 75
Trust and the use of adaptive cruise control: a study of a cut-in situation
Rajaonah, B., Anceaux, F., & Vienne, F. (2006) · Cognition Technology & Work · doi:10.1007/s10111-006-0030-3 · Cited by 75 · cited 1×
“Users need to adapt their levels of trust in order to optimise human-machine performance and benefit fully from the cooperation (Rajaonah et al. 2006a, b, 2008).”
BackgroundUser Involvement in Automatic Filtering: An Experimental Study
Wærn, A. (2004) · User Modeling and User-Adapted Interaction · doi:10.1023/b:user.0000028984.13876.9b · Cited by 65 · cited 6×
“Waern (2004) shows that users cannot always recognise good quality user profiles and cannot always improve them when given the opportunity.”
BackgroundMethodInfluentialInteractive User Modeling for Personalized Access to Museum Collections: The Rijksmuseum Case Study
Wang, Y., Aroyo, L. M., Stash, N. V., & Rutledge, L. (2007) · Lecture notes in computer science · doi:10.1007/978-3-540-73078-1_50 · Cited by 62
Self-citationGoren‐Bar, D., Graziola, I., Pianesi, F., & Zancanaro, M. (2006) · User Modeling and User-Adapted Interaction · doi:10.1007/s11257-006-9004-7 · Cited by 59 · cited 5×
“Specifically in the domain of user interaction with personalised museum guides, Goren-Bar et al. (2006) found that personality traits relating to the notion of control have a selective effect on the acceptance of the adaptivity dimensions. One of their findings was that users who feel less in control of their own beli…”
BackgroundMethodInfluentialThe State of the Art in Museum Handhelds in 2003.
Proctor, N., & Tellis, C. (2003) · Cited by 57
A stroll with Carletto: adaptation in drama-based tours with virtual characters
Damiano, R., Gena, C., Lombardo, V., Nunnari, F., & Pizzo, A. (2008) · User Modeling and User-Adapted Interaction · doi:10.1007/s11257-008-9053-1 · Cited by 51 · cited 2×
“Another promising evaluation of a virtual character guiding exhibition visitors is reported by Damiano et al. (2008). Beyond guiding the user through an exhibition, adaptation and context-awareness can”
BackgroundNückles, M., Winter, A., Wittwer, J., Herbert, M., & Hübner, S. (2006) · User Modeling and User-Adapted Interaction · doi:10.1007/s11257-006-9000-y · Cited by 50 · cited 2×
“In this study, the intraclass correlation coefficient produced a value of 0.808, which can be considered to be very good Nückles et al. (2006).”
BackgroundMethodInfluentialThe formation of trust and distrust in recommendation agents in repeated interactions
Xiao, S., & Benbasat, I. (2003) · International Conference on Electronic Commerce · doi:10.1145/948005.948043 · Cited by 41 · cited 1×
“Authors such as Wang and Benbasat (2005) and Xiao and Benbasat (2003) studied trust in online e-commerce recommender settings.”
BackgroundTintarev, N. (2007) · Lecture notes in computer science · doi:10.1007/978-3-540-73078-1_67 · Cited by 39
Measurement of human trust in a hybrid inspection system based on signal detection theory measures
Jiang, X., Khasawneh, M. T., Master, R., Bowling, S. R., Gramopadhye, A. K., Melloy, B. J., & Grimes, L. W. (2004) · International Journal of Industrial Ergonomics · doi:10.1016/j.ergon.2004.05.003 · Cited by 30
Study of driver trust during cooperation with adaptive cruise control
Rajaonah, B., Anceaux, F., & Vienne, F. (2006) · Le travail humain · doi:10.3917/th.692.0099 · Cited by 25 · cited 1×
“Users need to adapt their levels of trust in order to optimise human-machine performance and benefit fully from the cooperation (Rajaonah et al. 2006a, b, 2008).”
BackgroundThe effects of transparency on perceived and actual competence of a content-based recommender
Cramer, H., Wielinga, B. J., Ramlal, S., Evers, V., Someren, V. M., Rutledge, L., Stash, N. V., Degler, D., Schraefel, M. C., Golbeck, J. H., et al. (2008) · UvA-DARE (University of Amsterdam) · Cited by 15
Self-citationUser Interaction with User-Adaptive Information Filters
Cramer, H. S. M., Evers, V., van Someren, M., Wielinga, B. J., Besselink, S., Rutledge, L., Stash, N. V., & Aroyo, L. M. (2007) · Lecture notes in computer science · doi:10.1007/978-3-540-73289-1_38 · Cited by 9 · cited 1×
“An extensive discussion of the perceived competence of the recommender, its relation to actual competence and effects of transparency on this relation can be found in Cramer et al. (2008).”
BackgroundSelf-citationSemantic web integration of cultural heritage sources
Sinclair, P. A. S., Lewis, P. H., Martinez, K., Addis, M., & Prideaux, D. (2006) · International World Wide Web Conference (WWW) · doi:10.1145/1135777.1136008 · Cited by 7 · cited 3×
“Other authors who describe usage of Semantic Web technologies for adapted presentation of cultural heritage content include Schreiber et al. (2006) and Sinclair et al. (2006).”
BackgroundKey Issues in Interactive Problem Solving: An Empirical Investigation on Users Attitude
Cortellessa, G., Giuliani, M. V., Scopelliti, M., & Cesta, A. (2005) · Lecture notes in computer science · doi:10.1007/11555261_53 · Cited by 6 · cited 1×
“Cortellessa et al. (2005) also evaluated the importance of explanations in interactive problem solving systems and found that explanations are needed more when the system’s problem solving fails.”
BackgroundInteraction with user-adaptive information filters.
Cramer, H. S. M. (2007) · CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA) · doi:10.1145/1240866.1240870 · Cited by 5
Self-citationWubs, H., & Huysmans, F. (2006) · Data Archiving and Networked Services (DANS) · doi:10.48592/971 · Cited by 2
Research works printed but not linked: 7
- Aroyo L., Wang Y., Brussee R., Gorgels P., Rutledge L. and Stash N. (2007). Personalised Museum Experience: The Rijksmuseum Use Case. The International Museums and the Web Conference, San Francisco, USA
- Bowen, J.P., Filippini-Fantoni, S.: Personalization and the Web from a Museum Perspective. The International Museums and the Web Conference, pp. 63–78 (2004)
- Carmichael, D., Kay, J., Kummerfeld, B., Niu, W.: Why did you show/tell/hide that? The need for scrutability in ubiquitous personalisation. ECHISE Workshop Exploiting Context Histories in Smart Environments at UbiComp, Irvine, CA, USA (2006)
- Klopping I.M. and McKinney E. (2004). Extending the technology acceptance model and the task-technology fit model to consumer e-commerce. Inform. Technol. Learn. Perform. J. 22(1): 35–48
- McNee, S.M., Lam, S.K., Guetzlaff, C., Konstan, J.A., Riedl, J.: Confidence Metrics and Displays in Recommender Systems. Interact, pp. 176–183. Zurich, Switzerland (2003)
- Simmel, G.: In: Wolff, K.H. (ed.) The Sociology of George Simmel. Free Press, New York (1964)
- Wang Y. (2005). The Presentation of Media-rich Collections of Culture Heritage in the Age of Digital Reproduction. Vrije Universiteit, Amsterdam, The Netherlands
Cited by
Machine Learning Interpretability: A Survey on Methods and Metrics
Carvalho, D. V., Pereira, E. M., & Cardoso, J. S. (2019) · Electronics · doi:10.3390/electronics8080832 · Cited by 1,842
“With respect to interpretability itself, historically speaking, there has been sporadic interest in explanations of intelligent systems since the 1970s, beginning with attention on expert systems [11–13]; to, a decade after, neural networks [14]; and then to recommendation systems in the 2000s [15,16].”
BackgroundAli, S., Abuhmed, T., El-Sappagh, S., Muhammad, K., Alonso-Moral, J. M., Confalonieri, R., Guidotti, R., Del Ser, J., Díaz-Rodríguez, N., & Herrera, F. (2023) · Information Fusion · doi:10.1016/j.inffus.2023.101805 · Cited by 1,762
Shin, D. (2021) · International Journal of Human-Computer Studies · doi:10.1016/j.ijhcs.2020.102551 · Cited by 1,548
Evaluating Recommendation Systems
Shani, G., & Gunawardana, A. (2011) · Recommender Systems Handbook · doi:10.1007/978-0-387-85820-3_8 · Cited by 1,325
“whether the system recommendations are reasonable in a user study [22, 12, 11, 47].”
BackgroundExplaining the user experience of recommender systems
Knijnenburg, B. P., Willemsen, M. C., Gantner, Z., Soncu, H., & Newell, C. (2012) · User Modeling and User-Adapted Interaction · doi:10.1007/s11257-011-9118-4 · Cited by 799
Metadata
- Authors
- Cramer, H., Evers, V., Ramlal, S., van Someren, M., Rutledge, L., Stash, N., Aroyo, L., & Wielinga, B.
- Affiliations
- University of Amsterdam (NL)
- Centrum Wiskunde & Informatica (NL)
- Eindhoven University of Technology (NL)
- Corresponding author
- Cramer, Henriette
- Venue
- User Modeling and User-Adapted Interaction
- Published
- 2008-08-20
- Volume
- 18
- Issue
- 5
- Pages
- 455-496
- ISSN
- 0924-1868 (ISSN-L)
- 1573-1391
- OpenAlex
- W2096434649
- Cited by
- 448
- References
- 88
- Citations by year
- 2026: 33 · 2025: 40 · 2024: 36 · 2023: 50 · 2022: 42 · 2021: 41 · 2020: 35 · 2019: 37 · 2018: 21 · 2017: 8 · 2016: 14 · 2015: 15 · 2014: 8 · 2013: 9 · 2012: 18
- FWCI
- 42.32
- Type
- journal article
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- cc-by-nc
- Locations
- User Modeling and User-Adapted Interaction (publishedVersion, cc-by-nc)
- UvA-DARE (University of Amsterdam) (publishedVersion, other-oa)
- TU/e Research Portal (publishedVersion)
- VU Research Portal (publishedVersion, other-oa)
- Data Archiving and Networked Services (DANS) (submittedVersion, other-oa)
- TU/e Research Portal (submittedVersion)
- Digital Academic REpository of VU University Amsterdam (Vrije Universiteit Amsterdam) (submittedVersion)
- Funders
- Universiteit van Amsterdam
- Nederlandse Organisatie voor Wetenschappelijk Onderzoek
- Topics
- Physical Sciences › Computer Science › Information Systems › Recommender Systems and Techniques
- Physical Sciences › Computer Science › Artificial Intelligence › Explainable Artificial Intelligence (XAI)
- Physical Sciences › Computer Science › Human-Computer Interaction › Innovative Human-Technology Interaction
- Keywords
- user acceptance, content-based recommendation, cultural heritage, explainable recommendation, confidence ratings
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.