The DOI matches its Crossref record; 22 of the 22 references it cites were found in a registry or an index.
On the retrospective assessment of users' experiences over time: memory or actuality?
Abstract
An alternative paradigm to longitudinal studies of user experience is proposed. We illustrate this paradigm through a number of recent tool-based methods. We conclude by raising a number of challenges that we need to address in order to establish this paradigm as a fruitful alternative to longitudinal studies.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Although it enabled us to gather an in-depth understanding of device use, the longitudinal nature of this study using a range of data sources made it practically difficult to obtain generalizable results-a limitation of using this method [36].”
From Use of Intelligent Voice Assistants by Older Adults with Low Technology Use (2020) · cites this paper as [36]
In the citing paper
“Like other in-depth qualitative work with a small sample size, we do not intend to obtain generalizable results [32,47].”
From "Phantom Friend" or "Just a Box with Information": Personification and Ontological Categorization of Smart Speaker-based Voice Assistants by Older Adults (2019) · cites this paper as [32]
Citations
Cites
(1904) · The American Journal of Psychology · doi:10.2307/1412635 · Cited by 4,187
A Survey Method for Characterizing Daily Life Experience: The Day Reconstruction Method
Kahneman, D., Krueger, A. B., Schkade, D. A., Schwarz, N., & Stone, A. A. (2004) · Science · doi:10.1126/science.1103572 · Cited by 3,422
Belief and feeling: Evidence for an accessibility model of emotional self-report.
Robinson, M. D., & Clore, G. L. (2002) · Psychological Bulletin · doi:10.1037/0033-2909.128.6.934 · Cited by 1,806
When More Pain Is Preferred to Less: Adding a Better End
Kahneman, D., Fredrickson, B. L., Schreiber, C. A., & Redelmeier, D. A. (1993) · Psychological Science · doi:10.1111/j.1467-9280.1993.tb00589.x · Cited by 1,502
Experience Sampling Method: Measuring the Quality of Everyday Life
Hektner, J. M., Schmidt, J. A., & Csíkszentmihályi, M. (2006) · Cited by 1,239
Hektner, J., Schmidt, J., & Csikszentmihalyi, M. (2007) · doi:10.4135/9781412984201 · Cited by 1,174
The Interplay of Beauty, Goodness, and Usability in Interactive Products
Hassenzahl, M. (2004) · Human-Computer Interaction · doi:10.1207/s15327051hci1904_2 · Cited by 1,083
Self-citationPsychological Science: The Consequences of Choosing Soft
Locurto, C. (2024) · SpringerBriefs in Psychology · doi:10.1007/978-3-031-69402-8 · Cited by 927
User experience over time: an initial framework
Karapanos, E., Zimmerman, J., Forlizzi, J., & Martens, J.-B. (2009) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/1518701.1518814 · Cited by 561
Self-citationShifts in sensory dominance between various stages of user–product interactions
Fenko, A., Schifferstein, H. N. J., & Hekkert, P. (2010) · Applied Ergonomics · doi:10.1016/j.apergo.2009.03.007 · Cited by 227
Research works printed but not linked: 2
- Minge , M. , Dynamics of User Experience , in Proceedings of the Nordichi '08 Workshop "Research Goals and Strategies for Studying User Experience and Emotion". 2008 . Minge, M., Dynamics of User Experience, in Proceedings of the Nordichi '08 Workshop "Research Goals and Strategies for Studying User Experience and Emotion". 2008.
- von Wilamowitz Moellendorff , M. , Hassenzahl , M. , and Platz , A ., Dynamics of user experience: How the perceived quality of mobile phones changes over time, in User Experience -- Towards a unified view , Workshop at the 4th Nordic Conference on Human-Computer Interaction. 2006 . von Wilamowitz Moellendorff, M., Hassenzahl, M., and Platz, A., Dynamics of user experience: How the perceived quality of mobile phones changes over time, in User Experience -- Towards a unified view, Workshop at the 4th Nordic Conference on Human-Computer Interaction. 2006.
Cited by
23 Ways to Nudge: A Review of Technology-Mediated Nudging in Human-Computer Interaction
Caraban, A., Karapanos, E., Gonçalves, D., & Campos, P. (2019) · Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3290605.3300733 · Cited by 475
Self-citationUX Curve: A method for evaluating long-term user experience
Kujala, S., Roto, V., Väänänen-Vainio-Mattila, K., Karapanos, E., & Sinnelä, A. (2011) · Interacting with Computers · doi:10.1016/j.intcom.2011.06.005 · Cited by 485
Self-citationUse of Intelligent Voice Assistants by Older Adults with Low Technology Use
Pradhan, A., Lazar, A., & Findlater, L. (2020) · ACM Transactions on Computer-Human Interaction · doi:10.1145/3373759 · Cited by 285
Pradhan, A., Findlater, L., & Lazar, A. (2019) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3359316 · Cited by 223
Using a brain-computer interface (BCI) in reducing math anxiety: Evidence from South Africa
Verkijika, S. F., & Wet, L. D. (2014) · Computers & Education · doi:10.1016/j.compedu.2014.10.002 · Cited by 87
An Empirical Study on User Experience Evaluation and Identification of Critical UX Issues
Feng, L., & Wei, W. (2019) · Sustainability · doi:10.3390/su11082432 · Cited by 80
Understanding Older Adults' Participation in Design Workshops
Pradhan, A., Jelen, B., Siek, K. A., Chan, J., & Lazar, A. (2020) · Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3313831.3376299 · Cited by 75
A Novel Sensor-Based Methodology for Learner's Motivation Analysis in Game-Based Learning
Ghergulescu, I., & Muntean, C. H. (2014) · Interacting with Computers · doi:10.1093/iwc/iwu013 · Cited by 57
Measuring the Quality of Service and Quality of Experience of multimodal human–machine interaction
Wechsung, I., Engelbrecht, K.-P., Kühnel, C., Möller, S., & Weiß, B. (2012) · Journal on Multimodal User Interfaces · doi:10.1007/s12193-011-0088-y · Cited by 56
Quantified UX: Towards a Common Organizational Understanding of User Experience
Lachner, F., Naegelein, P., Kowalski, R., Spann, M., & Butz, A. M. (2016) · Nordic Conference on Human-Computer Interaction · doi:10.1145/2971485.2971501 · Cited by 63
Longitudinal Studies in HCI Research: A Review of CHI Publications From 1982–2019
Kjærup, M., Skov, M. B., Nielsen, P. A., Kjeldskov, J., Gerken, J., & Reiterer, H. (2021) · Human-computer interaction series · doi:10.1007/978-3-030-67322-2_2 · Cited by 43
MemoLine: evaluating long-term UX with children
Vissers, J., Bot, L. D., & Zaman, B. (2013) · ACM International Conference on Interaction Design and Children (IDC) · doi:10.1145/2485760.2485836 · Cited by 41
Bruun, A., & Ahm, S. (2015) · Lecture notes in computer science · doi:10.1007/978-3-319-22701-6_17 · Cited by 38
How User Experience Changes over Time: A Case Study of Social Network Services
Kim, H. K., Han, S. H., Park, J., & Park, W. (2014) · Human Factors and Ergonomics in Manufacturing & Service Industries · doi:10.1002/hfm.20583 · Cited by 40
Which Instrument Should I Use? Supporting Decision-Making About the Evaluation of User Experience
Darin, T., Coelho, B., & Borges, B. (2019) · Lecture notes in computer science · doi:10.1007/978-3-030-23535-2_4 · Cited by 40
Theories, methods and case studies of longitudinal HCI research
Karapanos, E., Jain, J., & Hassenzahl, M. (2012) · CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA) · doi:10.1145/2212776.2212706 · Cited by 30
Self-citationLooking Back: Retrospective Study Methods for HCI
Russell, D. M., & Ed, H. (2014) · Springer eBooks · doi:10.1007/978-1-4939-0378-8_15 · Cited by 41
FizzyVis: designing for playful information browsing on a multitouch public display
Coutrix, C., Kuikkaniemi, K., Kurvinen, E., Jacucci, G., Avdouevski, I., & Mäkelä, R. (2011) · Conference on Designing Pleasurable Products and Interfaces (DPPI) · doi:10.1145/2347504.2347534 · Cited by 25
Predicting Final User Satisfaction Using Momentary UX Data and Machine Learning Techniques
Koonsanit, K., & Nishiuchi, N. (2021) · Journal of theoretical and applied electronic commerce research · doi:10.3390/jtaer16070171 · Cited by 24
Krapp, E., Neuhaus, R., Hassenzahl, M., & Laschke, M. (2024) · Nordic Conference on Human-Computer Interaction · doi:10.1145/3679318.3685501 · Cited by 19
Self-citationEslambolchilar, P., Stawarz, K., Verdezoto, N. X., McNarry, M. A., Crossley, S. G. M., Knowles, Z. R., & Mackintosh, K. A. (2022) · International Journal of Child-Computer Interaction · doi:10.1016/j.ijcci.2023.100565 · Cited by 16
Gelineck, S., & Serafin, S. (2012) · Journal of New Music Research · doi:10.1080/09298215.2012.697174 · Cited by 21
Using the MemoLine to capture changes in user experience over time with children
Sim, G., Nouwen, M., Vissers, J., Horton, M., Slegers, K., & Zaman, B. (2016) · International Journal of Child-Computer Interaction · doi:10.1016/j.ijcci.2016.07.001 · Cited by 18
Holistic User eXperience in Mobile Augmented Reality Using User eXperience Measurement Index
Satti, F. A., Hussain, J., Bilal, H. S. M., Khan, W. A., Khattak, A. M., Yeon, J. E., & Lee, S. (2019) · International Conference on Next Generation Computing Applications (NextComp) · doi:10.1109/nextcomp.2019.8883528 · Cited by 15
The Impact of Expectation and Disconfirmation on User Experience and Behavior Intention
Wang, X., Zhou, R., & Zhang, R. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-49713-2_32 · Cited by 14
A long-term study of user experience towards interaction designs that support behavior change
Lee, S., Lim, Y.-K., & Lee, K.-P. (2011) · CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA) · doi:10.1145/1979742.1979909 · Cited by 14
Integrating user experience into early phases of software development
Jääskeläinen, A. (2011) · LUTPub (LUT University) · Cited by 16
UX research in the software industry: an investigation of long-term UX practices
Martinelli, S., Lopes, L., & Zaina, L. A. M. (2022) · Brazilian Symposium on Human Factors in Computing Systems (IHC) · doi:10.1145/3554364.3559126 · Cited by 16
Using affect to evaluate user engagement
Hart, J., Sutcliffe, A., & Angeli, A. D. (2012) · CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA) · doi:10.1145/2212776.2223714 · Cited by 12
Aesthetics of Interaction Design: A Literature Review
Mõttus, M., & Lamas, D. (2015) · doi:10.1145/2814464.2814466 · Cited by 15
Xu, H., Lee, H., Ling, W., & Pan, Y. (2024) · Electronics · doi:10.3390/electronics13071375 · Cited by 11
Long-Term Video QoE Assessment Studies: A Systematic Review
Cieplińska, N., Janowski, L., Moor, K. D., & Wierzchoń, M. (2022) · IEEE Access · doi:10.1109/access.2022.3231747 · Cited by 9
Longitudinal user experience studies in the IoT domain: a brief panorama and challenges to overcome
Melo, B. M. D. S., Andrade, R. M. C., & Darin, T. (2022) · Brazilian Symposium on Human Factors in Computing Systems (IHC) · doi:10.1145/3554364.3559135 · Cited by 13
Case study: longitudinal comparative analysis for analyzing user behavior
Jain, J., & Boyce, S. J. (2012) · CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA) · doi:10.1145/2212776.2212852 · Cited by 8
Introduction to “Advances in Longitudinal HCI Research”
Karapanos, E., Gerken, J., Kjeldskov, J., & Skov, M. B. (2021) · Human-computer interaction series · doi:10.1007/978-3-030-67322-2_1 · Cited by 8
Self-citationPereira, E. J., Ayers-Glassey, S., Wammes, J. D., & Smilek, D. (2023) · Behavior Research Methods · doi:10.3758/s13428-023-02273-4 · Cited by 6
View from a distance: comparing online and retrospective ux-evaluations
Wechsung, I., Jepsen, K., Burkhardt, F., Köhler, A., & Schleicher, R. (2012) · International Conference on Human-Computer Interaction with Mobile Devices and Services Adjunct (MobileHCI Adjunct) · doi:10.1145/2371664.2371686 · Cited by 6
Short-term methodology for long-term usability
Novick, D., Santaella, B., Cervantes, A., & Andrade, C. (2012) · ACM International Conference on Design of Communication (SIGDOC) · doi:10.1145/2379057.2379097 · Cited by 6
UX Definitions: The Missing Components and the Need for the Context and Time of Use
Mkpojiogu, E. O. C., Okeke-Uzodike, O. E., Emmanuel, E. I., & Eze, C. (2022) · International Conference on Computing, Communication and Networking Technologies (ICCCNT) · doi:10.1109/icccnt54827.2022.9984406 · Cited by 4
The Emerging Use of GenAI for UX Research in Software Development: Challenges and OpportunitiesPreprint
Candello, H., Geyer, W., Kunde, S., Muller, M. J., Sarkar, D., He, J., Lanza, M. C., Rosemberg, C., Davison, G., & Pelletier, L. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2512.15944 · Cited by 5
Capturing prolonged interactive experiences: a review of visual approaches in user research
Huang, C., & Stolterman, E. (2013) · Conference on Designing Pleasurable Products and Interfaces (DPPI) · doi:10.1145/2513506.2513516 · Cited by 3
Meaningful Interactions in a Smart City
van Waart, P., & Mulder, I. J. (2014) · Lecture notes in computer science · doi:10.1007/978-3-319-07788-8_57 · Cited by 3
Implementation of Scrum Retrospective in the Process of Improving Logistics Organization
Rola, P., & Kuchta, D. (2019) · Advances in intelligent systems and computing · doi:10.1007/978-3-030-30443-0_15 · Cited by 3
Towards a comprehensive framework for automated testing of user experience
Couto, M., Prada, R., Fernandes, P. M., Lopes, M. C., Prandi, D., Prasetya, I. S. W. B., & Ansari, S. G. (2025) · Quality and User Experience · doi:10.1007/s41233-025-00073-6 · Cited by 2
Nurturing empathy between UX design teams and users in digitally-mediated user research
Lachner, F., Schneider, H., Simon, L., & Butz, A. M. (2018) · Nordic Conference on Human-Computer Interaction · doi:10.1145/3240167.3240182 · Cited by 2
Quality Assessment of Video Services in the Long Term
Cieplińska, N., Janowski, L., & Moor, K. D. (2023) · ACM International Conference on Interactive Media Experiences · doi:10.1145/3573381.3596509 · Cited by 1
Meet your Users in Situ Data Collection from within Apps in Large-Scale Deployments
Batalas, N., Quevedo-Fernández, J., Martens, J.-B., & Markopoulos, P. (2015) · International Journal of Handheld Computing Research · doi:10.4018/ijhcr.2015070102 · Cited by 1
Self-citationMemorable projects and aesthetic experiences in an industrial R&D lab
Ocnarescu, I., & Bouchard, C. (2017) · Society and Business Review · doi:10.1108/sbr-10-2016-0055 · Cited by 1
Tangibilité et engagement dans un comportement environnemental : Vers une étude longitudinale
Bouzékri, E., & Rivière, G. (2022) · doi:10.1145/3502178.3529110 · Cited by 1
A VR-Driven Experimental Platform for Human-UAV Interaction Studies
Chen, N., Jia, Q., & Zhu, Y. (2025) · Lecture notes in electrical engineering · doi:10.1007/978-981-96-1694-7_1
UX Research Models and Methods
Tang, R., & Herrli, G. (2025) · Synthesis lectures on information concepts, retrieval, and services · doi:10.1007/978-3-031-83529-2_3
Approche multimodale pour l'évaluation d'applications de communication innovantes
Rodio, F. (2016) · theses.fr (ABES) · doi:10.70675/894f027cz22e3z403ez96d9za6138cd5bd1b
Design et relations pérennes avec les objets du quotidien
Green, C. K. (2019) · theses.fr (ABES) · doi:10.70675/57b8ec85z6225z4d73z97f8z7626819bc30c
Approche de la dynamique du plaisir pour l’interaction humain-machine : le modèle HEPEI
Redet, J. (2020) · theses.fr (ABES) · doi:10.70675/c6e60aebz0e62z4482z83f6zc1ee1b6ec442 · Cited by 3
Uriu, D., & Arima, S. (2026) · Designing Interactive Systems Conference · doi:10.1145/3800645.3812896
Exploring the Design Space for Drivers’ In-Vehicle Experience in Automated Vehicles
Dai, G., Yuan, X., & Wu, Y. (2026) · Applied Sciences · doi:10.2139/ssrn.7292198
Learning to Live with Low-tech: User Experience of Self-Built Low-Tech Systems in the Home
Duhamel, R., Legardeur, J., & Lallemand, C. (2026) · ACM Transactions on Computer-Human Interaction · doi:10.1145/3858622
Metadata
- Authors
- Karapanos, E., Martens, J.-B., & Hassenzahl, M.
- Affiliations
- Eindhoven University of Technology (NL)
- Folkwang University of the Arts (DE)
- Venue
- CHI '10 Extended Abstracts on Human Factors in Computing Systems
- Publisher
- ACM
- Published
- 2010-04-10
- Pages
- 4075-4080
- OpenAlex
- W2114950600
- Cited by
- 55
- References
- 22
- Citations by year
- 2026: 2 · 2025: 3 · 2024: 2 · 2023: 2 · 2022: 6 · 2021: 3 · 2020: 4 · 2019: 7 · 2018: 1 · 2017: 1 · 2016: 2 · 2015: 3 · 2014: 5 · 2013: 3 · 2012: 7
- FWCI
- 3.42
- Type
- conference paper
- Language
- en
- Open access
- closed
- Locations
- CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA) (publishedVersion)
- Ktisis at Cyprus University of Technology (Cyprus University of Technology) (submittedVersion)
- TU/e Research Portal (submittedVersion)
- Topics
- Physical Sciences › Computer Science › Human-Computer Interaction › Innovative Human-Technology Interaction
- Physical Sciences › Computer Science › Human-Computer Interaction › Usability and User Interface Design
- Physical Sciences › Computer Science › Information Systems › Software Engineering Techniques and Practices
- Keywords
- user experience, retrospective evaluation, longitudinal study, alternative paradigms, user experience evaluation
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.