Cited by 145Usability and User Interface DesignIntelligent Tutoring Systems and Adaptive LearningAdvanced Software Engineering Methodologies

The DOI matches its Crossref record; 200 of the 201 references it cites were found in a registry or an index.

Layered evaluation of interactive adaptive systems: framework and formative methods

Paramythis, Alexandros, Weibelzahl, Stephan, Masthoff, Judith·2010·User Modeling and User-Adapted Interaction

DOI 10.1007/s11257-010-9082-4

Open this paper in CoChat — free account

Integrity signals

Registry

Crossref · 10.1007/s11257-010-9082-4

Cites

200 of 200 references verified0 citation errors · 0 not checkable

Statistics

Recomputing p-values needs the paper’s full text.

Claims the paper makes

We couldn’t retrieve this paper’s full text, so its claims and self-check weren’t run. The registry and citation checks still apply.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Data Mining: Practical Machine Learning Tools and Techniques
Witten, I. H., Frank, E., & Hall, M. A. (2011) · Elsevier eBooks · doi:10.1016/c2009-0-19715-5 · Cited by 25,543
Focus Groups: A Practical Guide for Applied Research
McQuarrie, E. F., & Krueger, R. A. (1989) · Journal of Marketing Research · doi:10.2307/3172912 · Cited by 15,489
A Study of Cross-Validation and Bootstrap for Accuracy Estimation and Model Selection
Kohavi, R. (1995) · Zenodo · doi:10.5281/zenodo.19712698 · Cited by 10,909
I.—COMPUTING MACHINERY AND INTELLIGENCE
TURING, A. M. (1950) · Mind · doi:10.1093/mind/lix.236.433 · Cited by 10,290 · cited 1×
“Note that this resembles a Turing test (Turing, 1950), in that we could say that our system performs well, if participants judge it as well as they judge human performance.”
Background
Untitled work
(1993) · Cited by 9,879
Data Mining
Witten, I. H. (2008) · Cited by 9,143
Focus Groups: A Practical Guide for Applied Research
Billson, J. M. (1989) · Human Biology · Cited by 8,560
Modern Control Engineering
Ogata, K., & Brewer, J. W. (1971) · Journal of Dynamic Systems Measurement and Control · doi:10.1115/1.3426465 · Cited by 6,380
Computing Machinery and Intelligence (1950)
Turing, A. M. (2004) · doi:10.1093/oso/9780198250791.003.0017 · Cited by 6,120
Evaluating collaborative filtering recommender systems
Herlocker, J. L., Konstan, J. A., Terveen, L. G., & Riedl, J. T. (2004) · ACM Transactions on Information Systems · doi:10.1145/963770.963772 · Cited by 5,798
Designing the user interface: Strategies for effective human-computer interaction
(1993) · Applied Ergonomics · doi:10.1016/0003-6870(93)90471-k · Cited by 5,592
Human-Computer Interaction
Carayannis, E. G. (2013) · Springer eBooks · doi:10.1007/978-1-4614-3858-8_100431 · Cited by 4,819
Designing the user interface strategies for effective human-computer interaction
Shneiderman, B. (1998) · SIGB · doi:10.1145/25065.950626 · Cited by 4,680
Book Review: Protocol Analysis: Verbal Reports as Data
Venkatesan, M., Ericsson, K. A., & Simon, H. A. (1986) · Journal of Marketing Research · doi:10.2307/3151491 · Cited by 4,364
The Psychology of Human-Computer Interaction
Card, S. K., Moran, T. P., & Newell, A. (2018) · CRC Press eBooks · doi:10.1201/9780203736166 · Cited by 4,103
Protocol Analysis: Verbal Reports as Data
Ericsson, K. A., & Simon, H. A. (1993) · doi:10.7551/mitpress/5657.001.0001 · Cited by 3,537
Usability inspection methods
Nielsen, J. (1994) · Conference companion on Human factors in computing systems - CHI '94 · doi:10.1145/259963.260531 · Cited by 2,759
Contextual Design: Defining Customer-Centered Systems
Beyer, H. R., & Holtzblatt, K. (1997) · Cited by 2,748
Usability inspection methods
Nielsen, J. (1995) · Conference companion on Human factors in computing systems - CHI '95 · doi:10.1145/223355.223730 · Cited by 2,620
Modern Control Engineering
Singh, Y., Janardhanan, S., & Al, S. Y. E. (2010) · Cited by 2,176
Designing for usability---key principles and what designers think
Gould, J. D., & Lewis, C. (1983) · Communications of the ACM · doi:10.1145/3166.3170 · Cited by 2,166
Handbook of Human-Computer Interaction
(1988) · Elsevier eBooks · doi:10.1016/c2009-0-12113-x · Cited by 2,058
Adaptive hypermedia
Brusilovsky, P. (2001) · User Modeling and User-Adapted Interaction · doi:10.1023/a:1011143116306 · Cited by 2,057
Improving recommendation lists through topic diversification
Ziegler, C.-N., McNee, S. M., Konstan, J. A., & Lausen, G. (2005) · International World Wide Web Conference (WWW) · doi:10.1145/1060745.1060754 · Cited by 1,920
The Inmates are Running the Asylum
Cooper, A. (1999) · Berichte des German Chapter of the ACM · doi:10.1007/978-3-322-99786-9_1 · Cited by 1,855
Methods and metrics for cold-start recommendations
Schein, A. I., Popescul, A., Ungar, L., & Pennock, D. M. (2002) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/564376.564421 · Cited by 1,805
Heuristic evaluation
Nielsen, J. (1994) · Cited by 1,778
The Adaptive Web, Methods and Strategies of Web Personalization
Brusilovsky, P., Kobsa, A., & Nejdl, W. (2007) · The Adaptive Web · doi:10.1007/978-3-540-72079-9 · Cited by 1,776
The Human-computer interaction handbook: fundamentals, evolving technologies, and emerging applications
Jacko, J. A., & Sears, A. (2013) · Choice Reviews Online · doi:10.5860/choice.50-3307 · Cited by 1,360
Human-Computer Interaction
(2003) · CRC Press eBooks · doi:10.1201/9780367804787 · Cited by 1,227
The psychology of human-computer interaction
Huesmann, L. R., Card, S. K., Moran, T. P., & Newell, A. (1984) · The American Journal of Psychology · doi:10.2307/1422176 · Cited by 1,177
Human–Computer Interaction
Cooperstock, J. R. (2009) · Wiley eBooks · doi:10.1002/9780470050118.ecse524 · Cited by 1,084
Being accurate is not enough
McNee, S. M., Riedl, J., & Konstan, J. A. (2006) · CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA) · doi:10.1145/1125451.1125659 · Cited by 1,076
Methods to support human-centred design
MAGUIRE, M. (2001) · International Journal of Human-Computer Studies · doi:10.1006/ijhc.2001.0503 · Cited by 1,057
Toward Reform of Program Evaluation
Gowin, D. B., Millman, J., Cronbach, L. J., Ambron, S., Dornbusch, S. M., Hess, R. D., Hornik, R., Phillips, D. C., Walker, D. F., & Weiner, S. S. (1981) · Educational Evaluation and Policy Analysis · doi:10.2307/1163707 · Cited by 802
The Human-computer interaction handbook: fundamentals, evolving technologies, and emerging applications
(2003) · Choice Reviews Online · doi:10.5860/choice.40-4648 · Cited by 783
The cognitive walkthrough method: a practitioner's guide
Wharton, C., Rieman, J., Lewis, C., & Polson, P. G. (1994) · John Wiley & Sons, Inc. eBooks · Cited by 713
Usability Engineering
Zhang, Z. (1995) · Information Processing & Management · doi:10.1016/0306-4573(95)80026-p · Cited by 673
Implicit interest indicators
Claypool, M. K., Le, P., Wased, M., & Brown, D. C. (2001) · ACM International Conference on Intelligent User Interfaces (IUI) · doi:10.1145/359784.359836 · Cited by 670
Retrospective vs. concurrent think-aloud protocols: Testing the usability of an online library catalogue
van den Haak, M. J., de Jong, M. D. T., & Schellens, P. J. (2003) · Behaviour and Information Technology · doi:10.1080/0044929031000 · Cited by 542
Privacy in e-commerce
Ackerman, M. S., Cranor, L. F., & Reagle, J. (1999) · ACM Conference on Electronic Commerce (EC) · doi:10.1145/336992.336995 · Cited by 536
Five reasons for scenario-based design
Carroll, J. M. (2000) · Interacting with Computers · doi:10.1016/s0953-5438(00)00023-0 · Cited by 520
Personas, Participatory Design and Product Development: An Infrastructure for Engagement
Grudin, J. T., & Pruitt, J. (2002) · Cited by 474
The effects of transparency on trust in and acceptance of a content-based art recommender
Cramer, H., Evers, V., Ramlal, S., van Someren, M., Rutledge, L., Stash, N., Aroyo, L., & Wielinga, B. (2008) · User Modeling and User-Adapted Interaction · doi:10.1007/s11257-008-9051-3 · Cited by 448
AHAM
Bra, P. M. D., Houben, G., & Wu, H. (1999) · ACM Conference on Hypertext and Social Media (HT) · doi:10.1145/294469.294508 · Cited by 428
Group Modeling: Selecting a Sequence of Television Items to Suit a Group of Viewers
Masthoff, J. (2003) · User Modeling and User-Adapted Interaction · doi:10.1023/b:user.0000010138.79319.fd · Cited by 404
Self-citation
Machine Learning for User Modeling
Webb, G. I., Pazzani, M. J., & Billsus, D. (2001) · User Modeling and User-Adapted Interaction · doi:10.1023/a:1011117102175 · Cited by 391
Human factors for informatics usability
(1992) · Applied Ergonomics · doi:10.1016/0003-6870(92)90090-i · Cited by 369
A Hybrid User Model for News Story Classification
Billsus, D., & Pazzani, M. J. (1999) · Courses and lectures · doi:10.1007/978-3-7091-2490-1_10 · Cited by 357
Automatic detection of learner’s affect from conversational cues
D’Mello, S. K., Craig, S. D., Witherspoon, A. M., McDaniel, B., & Graesser, A. C. (2007) · User Modeling and User-Adapted Interaction · doi:10.1007/s11257-007-9037-6 · Cited by 329
Data Mining for Web Personalization
Mobasher, B. (2007) · Springer eBooks · doi:10.1007/978-3-540-72079-9_3 · Cited by 329
Empirically Building and Evaluating a Probabilistic Model of User Affect
Conati, C., & Maclaren, H. (2009) · User Modeling and User-Adapted Interaction · doi:10.1007/s11257-009-9062-8 · Cited by 328
Steps to take before intelligent user interfaces become real
Höök, K. (2000) · Interacting with Computers · doi:10.1016/s0953-5438(99)00006-5 · Cited by 322
Human Computer Interaction
Waters, J., & Gasson, S. (1993) · Lecture notes in computer science · doi:10.1007/3-540-57312-7 · Cited by 320
Prototyping an intelligent agent through Wizard of Oz
Maulsby, D., Greenberg, S., & Mander, R. (1993) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/169059.169215 · Cited by 310
ADAPTIVE INTERFACES AND AGENTS
Jameson, A. (2007) · CRC Press eBooks · doi:10.1201/9781410615862-33 · Cited by 299
Enough Already about “Black Box” Experiments: Studying Mediation Is More Difficult than Most Scholars Suppose
GREEN, D. P., Ha, S. E., & Bullock, J. G. (2010) · The Annals of the American Academy of Political and Social Science · doi:10.1177/0002716209351526 · Cited by 299
User Modeling and Adaptive Navigation Support in WWW-Based Tutoring Systems
Weber, G., & Specht, M. M. (1997) · Springer eBooks · doi:10.1007/978-3-7091-2670-7_30 · Cited by 288
How might people interact with agents
Norman, D. A. (1994) · Communications of the ACM · doi:10.1145/176789.176796 · Cited by 287
The geometry tutor
Anderson, J. R., Boyle, C. F., & Yost, G. R. (1985) · International Joint Conference on Artificial Intelligence · Cited by 270
Student Models that Invite the Learner In: The SMILI:() Open Learner Modelling Framework
Susan Bull, A., & Kay, J. (2007) · International Journal of Artificial Intelligence in Education · doi:10.3233/irg-2007-17(2)02 · Cited by 256
Empirical Evaluation of User Models and User-Adapted Systems
Chin, D. N. (2001) · User Modeling and User-Adapted Interaction · doi:10.1023/a:1011127315884 · Cited by 234
Evaluation and Education: At Quarter Century
Smith, N. L., McLaughlin, M., & Phillips, D. C. (1992) · Educational Evaluation and Policy Analysis · doi:10.2307/1164531 · Cited by 225
Composing letters with a simulated listening typewriter
Gould, J. D., Conti, J., & Hovanyecz, T. (1983) · Communications of the ACM · doi:10.1145/2163.358100 · Cited by 225
AH 12 years later: a comprehensive survey of adaptive hypermedia methods and techniques
Knutov, E., Bra, P. M. D., & Pechenizkiy, M. (2009) · New Review of Hypermedia and Multimedia · doi:10.1080/13614560902801608 · Cited by 219
Human-computer interaction (2nd ed.)
Dix, A. J., Finley, J. L., Abowd, G. D., & Beale, R. (1998) · Prentice-Hall, Inc eBooks · Cited by 217
Mediation of user models for enhanced personalization in recommender systems
Berkovsky, S., Kuflik, T., & Ricci⋆, F. (2007) · User Modeling and User-Adapted Interaction · doi:10.1007/s11257-007-9042-9 · Cited by 209
Metadoc: An Adaptive Hypertext Reading System
Boyle, C., & Encarnacion, A. O. (1998) · Springer eBooks · doi:10.1007/978-94-017-0617-9_3 · Cited by 199
Adaptive User Interfaces
(1990) · Elsevier eBooks · doi:10.1016/c2009-0-21655-2 · Cited by 194
Adaptive, intelligent presentation of information for the museum visitor in PEACH
Stock, O., Zancanaro, M., Busetta, P., Callaway, C. B., Krüger, A., Kruppa, M., Kuflik, T., Not, E., & Rocchi, C. (2007) · User Modeling and User-Adapted Interaction · doi:10.1007/s11257-007-9029-6 · Cited by 193
Learner Control
Kay, J. (2001) · User Modeling and User-Adapted Interaction · doi:10.1023/a:1011194803800 · Cited by 193
Beyond Formative and Summative Evaluation
Scriven, M. (1991) · Teachers College Record The Voice of Scholarship in Education · Cited by 187
Learning users' interests by unobtrusively observing their normal behavior
Goecks, J., & SHAVLIK, J. W. (2000) · ACM International Conference on Intelligent User Interfaces (IUI) · doi:10.1145/325737.325806 · Cited by 183
Usability inspection methods
Mack, R. L., & Nielsen, J. (1993) · ACM SIGCHI Bulletin · doi:10.1145/157203.157207 · Cited by 177
Scrutinising usability evaluation: does thinking aloud affect behaviour and mental workload?
Hertzum, M., Hansen, K. D., & Andersen, H. H. K. (2009) · Behaviour and Information Technology · doi:10.1080/01449290701773842 · Cited by 177
User-centered evaluation of adaptive and adaptable systems: a literature review
van Velsen, L., van der Geest, T., Klaassen, R., & Steehouder, M. F. (2008) · The Knowledge Engineering Review · doi:10.1017/s0269888908001379 · Cited by 177
Types of evaluation and types of evaluator
Scriven, M. (1996) · Evaluation Practice · doi:10.1016/s0886-1633(96)90020-3 · Cited by 176
In pursuit of satisfaction and the prevention of embarrassment: affective state in group recommender systems
Masthoff, J., & Albert Gatt, A. (2006) · User Modeling and User-Adapted Interaction · doi:10.1007/s11257-006-9008-3 · Cited by 176
Self-citation
Effective explanations of recommendations
Tintarev, N., & Masthoff, J. (2007) · ACM Conference on Recommender Systems (RecSys) · doi:10.1145/1297231.1297259 · Cited by 169
Self-citation
Personalization and Context Management
Zimmermann, A., Specht, M. M., & Lorenz, A. (2005) · User Modeling and User-Adapted Interaction · doi:10.1007/s11257-005-1092-2 · Cited by 159
A content-collaborative recommender that exploits WordNet-based user profiles for neighborhood formation
de Gemmis, M., Lops, P., & Semeraro, G. M. (2007) · User Modeling and User-Adapted Interaction · doi:10.1007/s11257-006-9023-4 · Cited by 158
Adaptive Hypertext Navigation Based On User Goals and Context
Kaplan, C. A., Chen, J. M., & Fenwick, J. (1998) · Springer eBooks · doi:10.1007/978-94-017-0617-9_2 · Cited by 157
Privacy-Enhanced Web Personalization
Kobsa, A. (2007) · Lecture notes in computer science · doi:10.1007/978-3-540-72079-9_21 · Cited by 147
User-Centred Design of Flexible Hypermedia for a Mobile Guide: Reflections on the HyperAudio Experience
Petrelli, D., & Not, E. (2005) · User Modeling and User-Adapted Interaction · doi:10.1007/s11257-005-8816-1 · Cited by 146
Adaptively supported adaptability
Oppermann, R. (1994) · International Journal of Human-Computer Studies · doi:10.1006/ijhc.1994.1021 · Cited by 146
Stereotypes, Student Models and Scrutability
Kay, J. (2000) · Lecture notes in computer science · doi:10.1007/3-540-45108-0_5 · Cited by 137
Predicting Affective States expressed through an Emote-Aloud Procedure from AutoTutor's Mixed-Initiative Dialogue
D’Mello, S. K., Craig, S. D., Sullins, J., & Graesser, A. C. (2006) · doi:10.5555/1434940.1434942 · Cited by 136
A Study of User Model Based Link Annotation in Educational Hypermedia
Brusilovsky, P. L., & Eklund, J. (1998) · Zenodo (CERN European Organization for Nuclear Research) · doi:10.3217/jucs-004-04-0429 · Cited by 131
The Munich Reference Model for Adaptive Hypermedia Applications
de Koch, N. P., & Wirsing, M. (2002) · Lecture notes in computer science · doi:10.1007/3-540-47952-x_23 · Cited by 126
Employing think-aloud protocols and constructive interaction to test the usability of online library catalogues: a methodological comparison
van den Haak, M. J., de Jong, M. D. T., & Schellens, P. J. (2004) · Interacting with Computers · doi:10.1016/j.intcom.2004.07.007 · Cited by 126
Metadoc: An adaptive hypertext reading system
Boyle, C., & Encarnacion, A. O. (1994) · User Modeling and User-Adapted Interaction · doi:10.1007/bf01142355 · Cited by 126
Adaptive User Support
(2017) · CRC Press eBooks · doi:10.1201/9781315136660 · Cited by 124
Evaluation of Adaptive Systems
Weibelzahl, S., Paramythis, A., & Masthoff, J. (2020) · ACM Conference on User Modeling, Adaptation and Personalization (UMAP) · doi:10.1145/3340631.3398668 · Cited by 122
Self-citation
An evaluation of an intelligent home monitoring system
Sixsmith, A. J. (2000) · Journal of Telemedicine and Telecare · doi:10.1258/1357633001935059 · Cited by 115
Moderating Usability Tests: Principles and Practices for Interacting
Dumas, J. S., & Loring, B. A. (2008) · Cited by 115
Human-computer interaction
Butler, K. A., Jacob, R. J. K., & John, B. E. (1999) · CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA) · doi:10.1145/632716.632781 · Cited by 115
Methods and techniques for the evaluation of user-adaptive systems
Cristina Gena, A. (2005) · The Knowledge Engineering Review · doi:10.1017/s0269888905000299 · Cited by 113
LISTEN: a user-adaptive audio-augmented museum guide
Zimmermann, A., & Lorenz, A. (2008) · User Modeling and User-Adapted Interaction · doi:10.1007/s11257-008-9049-x · Cited by 111
Analyzing Museum Visitors’ Behavior Patterns
Zancanaro, M., Kuflik, T., Boger, Z., Goren‐Bar, D., & Goldwasser, D. (2007) · Lecture notes in computer science · doi:10.1007/978-3-540-73078-1_27 · Cited by 101
Private emotions versus social interaction: a data-driven approach towards analysing emotion in speech
Batliner, A. M., Steidl, S., Hacker, C., & Nöth, E. (2007) · User Modeling and User-Adapted Interaction · doi:10.1007/s11257-007-9039-4 · Cited by 98
Experiment, design and statistics in psychology
Robson, C. (1973) · Medical Entomology and Zoology · Cited by 97
A Comparison of Graphical and Textual Presentations of Time Series Data to Support Medical Decision Making in the Neonatal Intensive Care Unit
Law, A. S., Freer, Y., Jim Hunter, A., Logie, R. H., McIntosh, N., & Quinn, J. A. (2005) · Journal of Clinical Monitoring and Computing · doi:10.1007/s10877-005-0879-3 · Cited by 97
Adaptive hypertext navigation based on user goals and context
Kaplan, C. A., Fenwick, J., & Chen, J. M. (1993) · User Modeling and User-Adapted Interaction · doi:10.1007/bf01257889 · Cited by 97
A Bayesian Diagnostic Algorithm for Student Modeling and its Evaluation
Millán, E., & Pérez-de-la-Cruz, J.-L. (2002) · User Modeling and User-Adapted Interaction · doi:10.1023/a:1015027822614 · Cited by 95
Rapid Prototyping for User Interface Design
Wilson, J., & Rosenberg, D. J. (1988) · Elsevier eBooks · doi:10.1016/b978-0-444-70536-5.50044-0 · Cited by 94
A Comparison of HMMs and Dynamic Bayesian Networks for Recognizing Office Activities
Oliver, N., & Horvitz, E. (2005) · Lecture notes in computer science · doi:10.1007/11527886_26 · Cited by 92
Diagnosing and acting on student affect: the tutor’s perspective
Porayska‐Pomsta, K., Mavrikis, M., & Pain, H. (2007) · User Modeling and User-Adapted Interaction · doi:10.1007/s11257-007-9041-x · Cited by 89
Methods and metrics for cold-start recommendations
Schein, A. I., Popescul, A., Ungar, L., & Pennock, D. M. (2002) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/564418.564421 · Cited by 89
Integrating heterogeneous adaptation techniques to build a flexible and usable mobile tourist guide
Cena, F., Console, L., Cristina Gena, A., Goy, A., Torre, I., & Sonia Modeo, A. (2006) · Institutional Research Information System University of Turin (University of Turin) · Cited by 87
Evaluating Learning Style Personalization in Adaptive Systems: Quantitative Methods and Approaches
Brown, E., Brailsford, T. J., Fisher, T., & Moore, A. (2009) · IEEE Transactions on Learning Technologies · doi:10.1109/tlt.2009.11 · Cited by 86
Tag-based user modeling for social multi-device adaptive guides
Carmagnola, F., Cena, F., Console, L., Cortassa, O., Cristina Gena, A., Goy, A., Torre, I., Toso, A., & Vernero, F. (2008) · User Modeling and User-Adapted Interaction · doi:10.1007/s11257-008-9052-2 · Cited by 83
Evaluating the thinking-aloud technique for use by computer scientists
Nielsen, J. (1993) · Ablex Publishing Corp. eBooks · Cited by 81
The Benefits of Layered Evaluation of Adaptive Applications and Services
Brusilovsky, P. L., Karagiannidis, C., & Sampson, D. G. (2001) · Cited by 80
Pros and Cons of Controllability: An Empirical Study
Jameson, A., & Schwarzkopf, E. (2002) · Lecture Notes in Computer Science · doi:10.1007/3-540-47952-x_21 · Cited by 77
PEACH - Intelligent Interfaces for Museum Visits
Stock, O., & Zancanaro, M. (2007) · Cognitive technologies · doi:10.1007/3-540-68755-6 · Cited by 72
Student Modeling from Conventional Test Data: A Bayesian Approach without Priors
VanLehn, K. A., Niu, Z., Siler, S. A., & Gertner, A. S. (1998) · Lecture notes in computer science · doi:10.1007/3-540-68716-5_49 · Cited by 72
Usability Engineering for the Adaptive Web
Cristina Gena, A., & Weibelzahl, S. (2007) · Springer eBooks · doi:10.1007/978-3-540-72079-9_24 · Cited by 72
Self-citation
A comprehensive typology for program evaluation
Chen, H.-T. (1996) · Evaluation Practice · doi:10.1016/s0886-1633(96)90017-3 · Cited by 70
The relative impact of student affect on performance models in a spoken dialogue tutoring system
Forbes-Riley, K., Rotaru, M., & Litman, D. J. (2007) · User Modeling and User-Adapted Interaction · doi:10.1007/s11257-007-9038-5 · Cited by 69
Exploring Issues of User Model Transparency and Proactive Behaviour in an Office Environment Control System
Cheverst, K., Byun, H. E., Fitton, D., Sas, C., Kray, C., & Villar, N. (2005) · User Modeling and User-Adapted Interaction · doi:10.1007/s11257-005-1269-8 · Cited by 69
A hybrid approach for improving predictive accuracy of collaborative filtering algorithms
Lekakos, G. D., & Giaglis, G. M. (2007) · User Modeling and User-Adapted Interaction · doi:10.1007/s11257-006-9019-0 · Cited by 65
Modeling the progression of Alzheimer’s disease for cognitive assistance in smart homes
Serna, A., Pigot, H., & Rialle, V. (2007) · User Modeling and User-Adapted Interaction · doi:10.1007/s11257-007-9032-y · Cited by 65
Managing uncertainty in group recommending processes
de Campos, L. M., Fernández-Luna, J. M., Huete, J. F., & Rueda-Morales, M. A. (2008) · User Modeling and User-Adapted Interaction · doi:10.1007/s11257-008-9061-1 · Cited by 58
Search personalization through query and page topical analysis
Stamou, S., & Ntoulas, A. (2008) · User Modeling and User-Adapted Interaction · doi:10.1007/s11257-008-9056-y · Cited by 57
Modeling individual and collaborative problem-solving in medical problem-based learning
Suebnukarn, S., & Haddawy, P. (2006) · User Modeling and User-Adapted Interaction · doi:10.1007/s11257-006-9011-8 · Cited by 56
The influence of personality factors on visitor attitudes towards adaptivity dimensions for mobile museum guides
Goren‐Bar, D., Graziola, I., Pianesi, F., & Zancanaro, M. (2006) · User Modeling and User-Adapted Interaction · doi:10.1007/s11257-006-9004-7 · Cited by 55
New Techniques for Evaluation
Levin, H. M., & Smith, N. L. (1982) · Journal of Policy Analysis and Management · doi:10.2307/3324723 · Cited by 55
Layered Evaluation of Adaptive Applications and Services
Karagiannidis, C., & Sampson, D. G. (2000) · Lecture notes in computer science · doi:10.1007/3-540-44595-1_43 · Cited by 53
A comprehensive model of usability
Winter, S., Wagner, S., & Deissenboeck, F. (2008) · doi:10.18419/opus-8961 · Cited by 52
CTRL: A research framework for providing adaptive collaborative learning support
Walker, E., Rummel, N., & Koedinger, K. R. (2009) · User Modeling and User-Adapted Interaction · doi:10.1007/s11257-009-9069-1 · Cited by 51
Consistent Modelling of Users, Devices and Sensors in a Ubiquitous Computing Environment
Carmichael, D. J., Kay, J., & Kummerfeld, B. (2005) · User Modeling and User-Adapted Interaction · doi:10.1007/s11257-005-0001-z · Cited by 51
Understanding and Dealing With Usability Side Effects of Intelligent Processing
Jameson, A. (2009) · AI Magazine · doi:10.1609/aimag.v30i4.2274 · Cited by 48
Sensors Model Student Self Concept in the Classroom
Cooper, D. G., Arroyo, I., Woolf, B. P., Müldner, K., Burleson, W., & Christopherson, R. M. (2009) · Lecture notes in computer science · doi:10.1007/978-3-642-02247-0_6 · Cited by 48
A stroll with Carletto: adaptation in drama-based tours with virtual characters
Damiano, R., Cristina Gena, A., Lombardo, V., Nunnari, F., & Pizzo, A. (2008) · User Modeling and User-Adapted Interaction · doi:10.1007/s11257-008-9053-1 · Cited by 48
Composing letters with a simulated listening typewriter
Gould, J. D., Conti, J., & Hovanyecz, T. (1982) · ACM Conference on Human Factors in Computing Systems (CHI) · doi:10.1145/800049.801813 · Cited by 46
Improving command and control speech recognition on mobile devices: using predictive user models for language modeling
Paek, T., & Chickering, D. M. (2007) · User Modeling and User-Adapted Interaction · doi:10.1007/s11257-006-9021-6 · Cited by 45
A Decomposition Model for the Layered Evaluation of Interactive Adaptive Systems
Paramythis, A., & Weibelzahl, S. (2005) · Lecture notes in computer science · doi:10.1007/11527886_60 · Cited by 44
Self-citation
Evaluation of Adaptive Systems
Weibelzahl, S. (2001) · Lecture notes in computer science · doi:10.1007/3-540-44566-8_49 · Cited by 44
Self-citation
How do Experts Adapt their Explanations to a Layperson’s Knowledge in Asynchronous Communication? An Experimental Study
Nückles, M., Winter, A., Wittwer, J., Herbert, M., & Hübner, S. (2006) · User Modeling and User-Adapted Interaction · doi:10.1007/s11257-006-9000-y · Cited by 43
Adaptive feedback generation to support teachers in web-based distance education
Kosba, E., Dimitrova, V. G., & Boyle, R. (2007) · User Modeling and User-Adapted Interaction · doi:10.1007/s11257-007-9031-z · Cited by 42
The Effectiveness of Personalized Movie Explanations: An Experiment Using Commercial Meta-data
Tintarev, N., & Masthoff, J. (2008) · Lecture notes in computer science · doi:10.1007/978-3-540-70987-9_23 · Cited by 41
Self-citation
Adaptive testing for hierarchical student models
Guzmán, E., Conejo, R., & Pérez-de-la-Cruz, J.-L. (2006) · User Modeling and User-Adapted Interaction · doi:10.1007/s11257-006-9018-1 · Cited by 40
LS-Plan: An Effective Combination of Dynamic Courseware Generation and Learning Styles in Web-Based Education
Limongelli, C., Sciarrone, F., & Vaste, G. (2008) · Lecture notes in computer science · doi:10.1007/978-3-540-70987-9_16 · Cited by 39
Smart Indicators on Learning Interactions
Glahn, C., Specht, M. M., & Koper, R. (2007) · Lecture notes in computer science · doi:10.1007/978-3-540-75195-3_5 · Cited by 39
A Scrutable Adaptive Hypertext
Czarkowski, M., & Kay, J. (2002) · Lecture notes in computer science · doi:10.1007/3-540-47952-x_43 · Cited by 39
Evaluating the Inference Mechanism of Adaptive Learning Systems
Weibelzahl, S., & Weber, G. (2003) · Lecture notes in computer science · doi:10.1007/3-540-44963-9_21 · Cited by 37
Self-citation
PEACH - Intelligent Interfaces for Museum Visits (Cognitive Technologies)
Stock, O., & Zancanaro, M. (2007) · Springer eBooks · Cited by 36
Adaptive Evolutionary Information Systems
(2003) · IGI Global eBooks · doi:10.4018/978-1-59140-034-9 · Cited by 35
Configuration agents, control and privacy
Trewin, S. M. (2000) · Conference on Universal Usability · doi:10.1145/355460.355466 · Cited by 35
Logic-Based Representation and Reasoning for User Modeling Shell Systems
Pohl, W. (1999) · User Modeling and User-Adapted Interaction · doi:10.1023/a:1008325713804 · Cited by 34
A User Interface Integrating Adaptability and Adaptivity
Krogsæter, M., Oppermann, R., & Thomas, C. G. (2017) · CRC Press eBooks · doi:10.1201/9781315136660-4 · Cited by 34
A multifactor approach to student model evaluation
Yudelson, M. V., Medvedeva, O. P., & Crowley, R. S. (2008) · User Modeling and User-Adapted Interaction · doi:10.1007/s11257-007-9046-5 · Cited by 34
Human or Computer? AutoTutor in a Bystander Turing Test
The Tutoring Research Group, Person, N. K., & Graesser, A. C. (2002) · Lecture notes in computer science · doi:10.1007/3-540-47987-2_82 · Cited by 33
The Evaluation of Adaptive Systems
Totterdell, P., & Boyle, E. (1990) · Elsevier eBooks · doi:10.1016/b978-0-12-137755-7.50011-x · Cited by 33
The user as wizard: A method for early involvement in the design and evaluation of adaptive systems
Masthoff, J. (2006) · Cited by 32
Self-citation
Why Build Adaptive Systems?
Browne, D. P., Norman, M., & Riches, D. (1990) · Elsevier eBooks · doi:10.1016/b978-0-12-137755-7.50007-8 · Cited by 31
An Application-Independent Intelligent User Support System Exploiting Action-Sequence Based User Modelling
Encarnação, L. M., & Stoev, S. L. (1999) · Courses and lectures · doi:10.1007/978-3-7091-2490-1_24 · Cited by 31
A Comprehensive Typology for Program Evaluation
Chen, H.-T. (1996) · Evaluation Practice · doi:10.1177/109821409601700204 · Cited by 31
Formative Qualitative Evaluation for "Exploratory" ITS Research.
Murray, T. (1993) · Cited by 29
A Comprehensive Model of Usability
Winter, S., Wagner, S., & Deissenboeck, F. (2008) · Lecture notes in computer science · doi:10.1007/978-3-540-92698-6_7 · Cited by 28
Complementary computing: policies for transferring callers from dialog systems to human receptionists
Horvitz, E., & Paek, T. (2007) · User Modeling and User-Adapted Interaction · doi:10.1007/s11257-006-9026-1 · Cited by 27
Efficient and non-parametric reasoning over user preferences
Domshlak, C., & Joachims, T. (2007) · User Modeling and User-Adapted Interaction · doi:10.1007/s11257-006-9022-5 · Cited by 27
Adaptation as a Problem of Design
Totterdell, P., & Rautenbach, P. (1990) · Elsevier eBooks · doi:10.1016/b978-0-12-137755-7.50008-x · Cited by 26
Towards Inferring Sequential-Global Dimension of Learning Styles from Mouse Movement Patterns
Spada, D., Sánchez-Montañés, M. A., Paredes, P., & Carro, R. M. (2008) · Lecture notes in computer science · doi:10.1007/978-3-540-70987-9_48 · Cited by 23
Evaluating the Impact of Adaptation to Learning Styles in a Web-Based Educational System
Popescu, E. (2009) · Lecture notes in computer science · doi:10.1007/978-3-642-03426-8_41 · Cited by 23
The Continuous Empirical Evaluation Approach: Evaluating Adaptive Web-Based Courses
Ortigosa, Á., & Carro, R. M. (2003) · Lecture notes in computer science · doi:10.1007/3-540-44963-9_22 · Cited by 22
Utility-Based Evaluation of Adaptive Systems
Herder, E. (2003) · University of Twente Research Information · Cited by 22
The Evaluation of Adaptive Systems
Masthoff, J. (2003) · IGI Global eBooks · doi:10.4018/978-1-59140-034-9.ch015 · Cited by 21
Self-citation
When and Why Does Mastery Learning Work: Instructional Experiments with ACT-R “SimStudents”
MacLaren, B., & Koedinger, K. (2002) · Lecture Notes in Computer Science · doi:10.1007/3-540-47987-2_39 · Cited by 20
Tailoring Automatically Generated Hypertext
Bontcheva, K., & Wilks, Y. A. (2005) · User Modeling and User-Adapted Interaction · doi:10.1007/s11257-004-5637-6 · Cited by 19
On Evaluating Adaptive Systems for Education
Arruabarrena, R., Pérez, T. A., López-Cuadrado, J., Gutiérrez, J., & Vadillo, J. A. (2002) · Lecture notes in computer science · doi:10.1007/3-540-47952-x_38 · Cited by 17
Introduction to the special issue on statistical and probabilistic methods for user modeling
Albrecht, D. W., & Zukerman, I. (2007) · User Modeling and User-Adapted Interaction · doi:10.1007/s11257-006-9025-2 · Cited by 17
LaboUr - Machine Learning for User Modeling.
Pohl, W. (1997) · Cited by 16
Modelling a Receiver’s Position to Persuasive Arguments
Nguyen, H. P. N., Masthoff, J., & Edwards, P. J. (2007) · Lecture notes in computer science · doi:10.1007/978-3-540-77006-0_33 · Cited by 15
Self-citation
User Modeling Meets Usability Goals
Jameson, A. (2005) · Lecture notes in computer science · doi:10.1007/11527886_1 · Cited by 15
Personalizing influence diagrams: applying online learning strategies to dialogue management
Chickering, D. M., & Paek, T. (2006) · User Modeling and User-Adapted Interaction · doi:10.1007/s11257-006-9020-7 · Cited by 15
Designing and Redesigning an Affective Interface for an Adaptive Museum Guide
Goren‐Bar, D., Graziola, I., Rocchi, C., Pianesi, F., Stock, O., & Zancanaro, M. (2005) · Lecture notes in computer science · doi:10.1007/11573548_120 · Cited by 12
Moderating Usability Tests: Principles and Practices for Interacting: Principles and Practices for Interacting
Dumas, J. S., & Loring, B. A. (2008) · Cited by 11
Layered Evaluation of Adaptive Search
Brusilovsky, P. L., Farzan, R., & Ahn, J. (2006) · Cited by 10
Evaluating recommender explanations: Problems experienced and lessons learned for the evaluation of adaptive systems
Tintarev, N., & Masthoff, J. (2009) · Cited by 10
Self-citation
Persuasion Artifices to Promote Wellbeing
de Rosis, F., Mazzotta, I., Miceli, M., & Poggi, I. (2006) · Lecture notes in computer science · doi:10.1007/11755494_12 · Cited by 9
Preface to the special issue on data mining for personalization
Mobasher, B., & Tuzhilin, A. (2008) · User Modeling and User-Adapted Interaction · doi:10.1007/s11257-008-9060-2 · Cited by 9
Evaluating the Adaptation of a Learning System before the Prototype Is Ready: A Paper-Based Lab Study
Ley, T., Kump, B., Antonia, M., Maiden, N., & Albert, D. (2009) · Lecture notes in computer science · doi:10.1007/978-3-642-02247-0_32 · Cited by 9
Agent-Based Group Modelling for Ambient Intelligence
Masthoff, J., Vasconcelos, W. W., Aitken, C., & da Silva, F. S. C. (2007) · Cited by 9
Self-citation
Predicting time-sharing in mobile interaction
Miettinen, M., & Oulasvirta, A. (2007) · User Modeling and User-Adapted Interaction · doi:10.1007/s11257-007-9033-x · Cited by 8
What Do You Want to Know? Investigating the Information Requirements of Patient Supporters
Moncur, W., Masthoff, J., & Reiter, E. (2008) · IEEE International Symposium on Computer-Based Medical Systems (CBMS) · doi:10.1109/cbms.2008.36 · Cited by 8
Self-citation
Discovering stages in web navigation for problem-oriented navigation support
Hollink, V., van Someren, M., & Wielinga, B. J. (2006) · User Modeling and User-Adapted Interaction · doi:10.1007/s11257-006-9017-2 · Cited by 7
Adaptive Interface Techniques
Totterdell, P., Rautenbach, P., Wilkinson, A., & Anderson, S. O. (1990) · Elsevier eBooks · doi:10.1016/b978-0-12-137755-7.50010-8 · Cited by 7
AnAmeter: The First Steps to Evaluating Adaptation
Tarpin-Bernard, F., Marfisi-Schottman, I., & Habieb-Mammar, H. (2009) · HAL · Cited by 7
Developing Instrument for Handset Usability Evaluation: A Survey Study
Zhang, T., Rau, P. P., & Salvendy, G. (2007) · Springer eBooks · doi:10.1007/978-3-540-73105-4_73 · Cited by 6
Inferences, suppositions and explanatory extensions in argument interpretation
George, S., Zukerman, I., & Niemann, M. (2007) · User Modeling and User-Adapted Interaction · doi:10.1007/s11257-007-9034-9 · Cited by 6
Guiding Learners in Learning Management Systems through Recommendations
Santos, O. C., & Boticario, J. G. (2009) · Lecture notes in computer science · doi:10.1007/978-3-642-04636-0_54 · Cited by 5
Discovering Stages in Web Navigation
Hollink, V., van Someren, M., & ten Hagen, S. (2005) · Lecture notes in computer science · doi:10.1007/11527886_65 · Cited by 5
Parallel Presentations for Heterogenous User Groups – An Initial User Study
Kruppa, M., & Aslan, I. (2005) · Lecture notes in computer science · doi:10.1007/11590323_6 · Cited by 4
Assessing the Impact of Measurement Uncertainty on User Models in Spatial Domains
Schmidt, D. F., Zukerman, I., & Albrecht, D. W. (2009) · Lecture notes in computer science · doi:10.1007/978-3-642-02247-0_21 · Cited by 4
Evaluating the Adaptation of a Learning System before the Prototype Is Ready: A Paper−Based Lab Study
Ley, T., Kump, B., Antonia, M., Maiden, N., & Albert, D. (2009) · Cited by 4
An Evaluation of the Accuracy of Capturing User Intent for Information Retrieval.
Nguyen, H. P. N., & Santos, E. (2007) · Cited by 3
Intelligent Support to the Retrieval of Information About Hydric Resources
Gena, C., & Ardissono, L. (2004) · Lecture notes in computer science · doi:10.1007/978-3-540-27780-4_16 · Cited by 3
Formal models and techniques in human-computer interaction
Ziegler, J., & Bullinger, H. (1991) · Cited by 3
Assessment on the Adaptivity of Adaptive Systems
Yang, D., & Hongmei, H. (2008) · International Conference on Management of e-Commerce and e-Government · doi:10.1109/icmecg.2008.85 · Cited by 2

Research works printed but not linked: 10

Albrecht D., Zuckerman I.: Statistical and probabilistic methods for user modeling. Special issue User Model. User-Adap. Inter. 17(1–2), 1–215 (2007)
Dey, A.K., Abowd, G.D.: Towards a better understanding of context and context-awareness. In: Workshop on the What, Who, Where, When, and How of Context-Awareness at CHI 2000, pp. 304–307. The Hague, The Netherlands (2000)
Hoppe, H., Tauber, M., Ziegler, J.: A survey of models and formal description methods in HCI with example applications. In: ESPRIT Project, vol. 385 (1986)
Jameson A.: Systems that Adapt to their Users: An Integrative Perspective. Saarland University, Saarbrücken (2001)
Ohene-Djan, J.: Ownership transfer via personalisation as a value-adding strategy for web-based education. In: Workshop on Adaptive Systems for Web-Based Education at AH2002, pp. 27–41. Málaga, Spain (2002)
O’Malley, C.E., Draper, S.W., Riley, M.S.: Constructive interaction: A method for studying Human–Computer-human interaction. In: 1st International Conference on Human–Computer Interaction, pp. 269–274. Honolulu, HI (1984)
Stary, C., Totter, A.: How to integrate concepts of the design and the evaluation of adaptable and adaptive user interfaces. In: 3rd ERCIM Workshop on User Interfaces for All, pp. 68–75. Obernai, France (1997)
Tobar, C.M.: Yet another evaluation framework. In: Workshop on Empirical Evaluation of Adaptive Systems at UM2003, pp. 15–24. Johnstown, PA (2003)
van Barneveld, J., van Setten, M.: Involving users in the design of user interfaces for TV recommender systems. In: 3rd Workshop on Personalization in Future TV at UM03, Johnstown, PA (2003)
Weibelzahl, S.: Evaluation of adaptive systems. PhD Thesis, University of Trier, Germany (2003)

Sorted by citations

Explaining the user experience of recommender systems
Knijnenburg, B. P., Willemsen, M. C., Gantner, Z., Soncu, H., & Newell, C. (2012) · User Modeling and User-Adapted Interaction · doi:10.1007/s11257-011-9118-4 · Cited by 878
Evaluating recommender systems from the user’s perspective: survey of the state of the art
Pu, P., Chen, L., & Hu, R. J. (2012) · User Modeling and User-Adapted Interaction · doi:10.1007/s11257-011-9115-7 · Cited by 377
“This method is called layered evaluation in Paramythis et al. (2010).”
Method
Evaluating the effectiveness of explanations for recommender systems
Tintarev, N., & Masthoff, J. (2012) · User Modeling and User-Adapted Interaction · doi:10.1007/s11257-011-9117-5 · Cited by 364
“We used the layered evaluation framework, which advocates that adaptation needs to be decomposed and assessed in layers in order to be evaluated effectively (Paramythis et al. 2010).”
MethodSelf-citation
Personalization in cultural heritage: the road travelled and the one ahead
Ardissono, L., Kuflik, T., & Petrelli, D. (2012) · User Modeling and User-Adapted Interaction · doi:10.1007/s11257-011-9104-x · Cited by 257
“As for all other aspects of personalization research, the system and user evaluation would benefit from a common effort and the creation of a shared understanding of which new systems should be evaluated, and how (Weibelzahl, 2002; Paramythis et al., 2010).”
Background
SMILI☺: a Framework for Interfaces to Learning Data in Open Learner Models, Learning Analytics and Related Fields
Susan Bull, A., & Kay, J. (2016) · International Journal of Artificial Intelligence in Education · doi:10.1007/s40593-015-0090-8 · Cited by 180
“…J paper is cited as indicated in Table 3, this has mostly been as a reference to the existence of the framework (e.g. Brusilovsky et al., 2011; Paramythis et al., 2010), as a detailed review and/or as giving examples of open learner models (e.g. Hsiao & Brusilovsky, 2012; Kump et al., 2012),…”
BackgroundMethod

See all 145

Authors: Paramythis, A., Weibelzahl, S., & Masthoff, J.
Affiliations: Johannes Kepler University of Linz (AT)
National College of Ireland (IE)
University of Aberdeen (GB)
Corresponding author: Paramythis, Alexandros
Weibelzahl, Stephan
Masthoff, Judith
ORCID: Weibelzahl, Stephan
Masthoff, Judith
Venue: User Modeling and User-Adapted Interaction
Publisher: Springer Science and Business Media LLC
Published: 2010-11-28
Volume: 20
Issue: 5
Pages: 383-453
ISSN: 0924-1868 (ISSN-L)
1573-1391
DOI: 10.1007/s11257-010-9082-4
OpenAlex: W2032468592
Cited by: 145
References: 201
Citations by year: 2026: 5 · 2025: 4 · 2024: 5 · 2023: 5 · 2022: 6 · 2021: 18 · 2020: 6 · 2019: 10 · 2018: 7 · 2017: 9 · 2016: 14 · 2015: 10 · 2014: 12 · 2013: 12 · 2012: 17
FWCI: 21.28
Type: journal article
Language: en
Open access: closed
Licence: www.springer.com/tdm (tdm)
Locations: User Modeling and User-Adapted Interaction (publishedVersion)
Aberdeen University Research Archive (Aberdeen University) (submittedVersion)
Topics: Physical Sciences › Computer Science › Human-Computer Interaction › Usability and User Interface Design
Physical Sciences › Computer Science › Artificial Intelligence › Intelligent Tutoring Systems and Adaptive Learning
Physical Sciences › Computer Science › Software › Advanced Software Engineering Methodologies
Keywords: adaptive systems, interactive systems, development life cycle, user modeling

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Layered evaluation of interactive adaptive systems: framework and formative methods

Overview

Integrity signals

Verification

Claims the paper makes

Claims other papers make about this one

Citations

Cites

Cited by

Related

Metadata

Record

About these checks