The DOI matches its Crossref record; 200 of the 201 references it cites were found in a registry or an index.
Layered evaluation of interactive adaptive systems: framework and formative methods
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“This is a well known issue in evaluating interactive adaptive systems (c.f. Paramythis et al., 2010).”
From Affective learning: Improving engagement and enhancing learning with affect-aware feedback (2017) · cites this paper as Paramythis et al., 2010
Citations
Cites
Data Mining: Practical Machine Learning Tools and Techniques
Witten, I. H., Frank, E., & Hall, M. A. (2011) · Elsevier eBooks · doi:10.1016/c2009-0-19715-5 · Cited by 25,543
Focus Groups: A Practical Guide for Applied Research
McQuarrie, E. F., & Krueger, R. A. (1989) · Journal of Marketing Research · doi:10.2307/3172912 · Cited by 15,489
A Study of Cross-Validation and Bootstrap for Accuracy Estimation and Model Selection
Kohavi, R. (1995) · Zenodo · doi:10.5281/zenodo.19712698 · Cited by 10,909
I.—COMPUTING MACHINERY AND INTELLIGENCE
TURING, A. M. (1950) · Mind · doi:10.1093/mind/lix.236.433 · Cited by 10,290 · cited 1×
“Note that this resembles a Turing test (Turing, 1950), in that we could say that our system performs well, if participants judge it as well as they judge human performance.”
Background(1993) · Cited by 9,879
Witten, I. H. (2008) · Cited by 9,143
Focus Groups: A Practical Guide for Applied Research
Billson, J. M. (1989) · Human Biology · Cited by 8,560
Ogata, K., & Brewer, J. W. (1971) · Journal of Dynamic Systems Measurement and Control · doi:10.1115/1.3426465 · Cited by 6,380
Computing Machinery and Intelligence (1950)
Turing, A. M. (2004) · doi:10.1093/oso/9780198250791.003.0017 · Cited by 6,120
Evaluating collaborative filtering recommender systems
Herlocker, J. L., Konstan, J. A., Terveen, L. G., & Riedl, J. T. (2004) · ACM Transactions on Information Systems · doi:10.1145/963770.963772 · Cited by 5,798
Flagged first, then by citations
1 of the 201 references couldn’t be matched to a known paper.
Research works printed but not linked: 10
- Albrecht D., Zuckerman I.: Statistical and probabilistic methods for user modeling. Special issue User Model. User-Adap. Inter. 17(1–2), 1–215 (2007)
- Dey, A.K., Abowd, G.D.: Towards a better understanding of context and context-awareness. In: Workshop on the What, Who, Where, When, and How of Context-Awareness at CHI 2000, pp. 304–307. The Hague, The Netherlands (2000)
- Hoppe, H., Tauber, M., Ziegler, J.: A survey of models and formal description methods in HCI with example applications. In: ESPRIT Project, vol. 385 (1986)
- Jameson A.: Systems that Adapt to their Users: An Integrative Perspective. Saarland University, Saarbrücken (2001)
- Ohene-Djan, J.: Ownership transfer via personalisation as a value-adding strategy for web-based education. In: Workshop on Adaptive Systems for Web-Based Education at AH2002, pp. 27–41. Málaga, Spain (2002)
- O’Malley, C.E., Draper, S.W., Riley, M.S.: Constructive interaction: A method for studying Human–Computer-human interaction. In: 1st International Conference on Human–Computer Interaction, pp. 269–274. Honolulu, HI (1984)
- Stary, C., Totter, A.: How to integrate concepts of the design and the evaluation of adaptable and adaptive user interfaces. In: 3rd ERCIM Workshop on User Interfaces for All, pp. 68–75. Obernai, France (1997)
- Tobar, C.M.: Yet another evaluation framework. In: Workshop on Empirical Evaluation of Adaptive Systems at UM2003, pp. 15–24. Johnstown, PA (2003)
- van Barneveld, J., van Setten, M.: Involving users in the design of user interfaces for TV recommender systems. In: 3rd Workshop on Personalization in Future TV at UM03, Johnstown, PA (2003)
- Weibelzahl, S.: Evaluation of adaptive systems. PhD Thesis, University of Trier, Germany (2003)
Cited by
Sorted by citations
Explaining the user experience of recommender systems
Knijnenburg, B. P., Willemsen, M. C., Gantner, Z., Soncu, H., & Newell, C. (2012) · User Modeling and User-Adapted Interaction · doi:10.1007/s11257-011-9118-4 · Cited by 878
Evaluating recommender systems from the user’s perspective: survey of the state of the art
Pu, P., Chen, L., & Hu, R. J. (2012) · User Modeling and User-Adapted Interaction · doi:10.1007/s11257-011-9115-7 · Cited by 377
“This method is called layered evaluation in Paramythis et al. (2010).”
MethodEvaluating the effectiveness of explanations for recommender systems
Tintarev, N., & Masthoff, J. (2012) · User Modeling and User-Adapted Interaction · doi:10.1007/s11257-011-9117-5 · Cited by 364
“We used the layered evaluation framework, which advocates that adaptation needs to be decomposed and assessed in layers in order to be evaluated effectively (Paramythis et al. 2010).”
MethodSelf-citationPersonalization in cultural heritage: the road travelled and the one ahead
Ardissono, L., Kuflik, T., & Petrelli, D. (2012) · User Modeling and User-Adapted Interaction · doi:10.1007/s11257-011-9104-x · Cited by 257
“As for all other aspects of personalization research, the system and user evaluation would benefit from a common effort and the creation of a shared understanding of which new systems should be evaluated, and how (Weibelzahl, 2002; Paramythis et al., 2010).”
BackgroundSusan Bull, A., & Kay, J. (2016) · International Journal of Artificial Intelligence in Education · doi:10.1007/s40593-015-0090-8 · Cited by 180
“…J paper is cited as indicated in Table 3, this has mostly been as a reference to the existence of the framework (e.g. Brusilovsky et al., 2011; Paramythis et al., 2010), as a detailed review and/or as giving examples of open learner models (e.g. Hsiao & Brusilovsky, 2012; Kump et al., 2012),…”
BackgroundMethod
Metadata
- Authors
- Paramythis, A., Weibelzahl, S., & Masthoff, J.
- Affiliations
- Johannes Kepler University of Linz (AT)
- National College of Ireland (IE)
- University of Aberdeen (GB)
- Corresponding author
- Paramythis, Alexandros
- Weibelzahl, Stephan
- Masthoff, Judith
- Venue
- User Modeling and User-Adapted Interaction
- Published
- 2010-11-28
- Volume
- 20
- Issue
- 5
- Pages
- 383-453
- ISSN
- 0924-1868 (ISSN-L)
- 1573-1391
- OpenAlex
- W2032468592
- Cited by
- 145
- References
- 201
- Citations by year
- 2026: 5 · 2025: 4 · 2024: 5 · 2023: 5 · 2022: 6 · 2021: 18 · 2020: 6 · 2019: 10 · 2018: 7 · 2017: 9 · 2016: 14 · 2015: 10 · 2014: 12 · 2013: 12 · 2012: 17
- FWCI
- 21.28
- Type
- journal article
- Language
- en
- Open access
- closed
- Licence
- www.springer.com/tdm (tdm)
- Locations
- User Modeling and User-Adapted Interaction (publishedVersion)
- Aberdeen University Research Archive (Aberdeen University) (submittedVersion)
- Topics
- Physical Sciences › Computer Science › Human-Computer Interaction › Usability and User Interface Design
- Physical Sciences › Computer Science › Artificial Intelligence › Intelligent Tutoring Systems and Adaptive Learning
- Physical Sciences › Computer Science › Software › Advanced Software Engineering Methodologies
- Keywords
- adaptive systems, interactive systems, development life cycle, user modeling
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
