Eye-Tracking-Based Classification of Information Search Behavior Using Machine Learning: Evidence from Experiments in Physical Shops and Virtual Reality Shopping Environments
Open accessThe DOI matches its Crossref record; 19 of the 19 references it cites were found in a registry or an index.
Abstract
How can we tailor assistance systems, such as recommender systems or decision support systems, to consumers’ individual shopping motives? How can companies unobtrusively identify shopping motives without explicit user input? We demonstrate that eye movement data allow building reliable prediction models for identifying goal-directed and exploratory shopping motives. Our approach is validated in a real supermarket and in an immersive virtual reality supermarket. Several managerial implications of using gaze-based classification of information search behavior are discussed: First, the advent of virtual shopping environments makes using our approach straightforward as eye movement data are readily available in next-generation virtual reality devices. Virtual environments can be adapted to individual needs once shopping motives are identified and can be used to generate more emotionally engaging customer experiences. Second, identifying exploratory behavior offers opportunities for marketers to adapt marketing communication and interaction processes. Personalizing the shopping experience and profiling customers’ needs based on eye movement data promises to further increase conversion rates and customer satisfaction. Third, eye movement-based recommender systems do not need to interrupt consumers and thus do not take away attention from the purchase process. Finally, our paper outlines the technological basis of our approach and discusses the practical relevance of individual predictors.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Breiman, L. (2001) · Machine Learning · doi:10.1023/a:1010933404324 · Cited by 133,538
Design Science in Information Systems Research1
Hevner, A. R., March, S. T., Park, J., & Ram, S. (2004) · MIS Quarterly · doi:10.2307/25148625 · Cited by 10,707 · cited 3×
“” As such, our approach resembles the salient parts of the design science paradigm (Hevner et al. 2004, Peffers et al. 2007).”
BackgroundDesign science in information systems research
(2004) · Journal of the Association for Information Systems · doi:10.5555/2017212.2017217 · Cited by 8,254
Eye movements in reading and information processing: 20 years of research
Rayner, K. (1998) · Psychological Bulletin · doi:10.1037/0033-2909.124.3.372 · Cited by 7,979
A Design Science Research Methodology for Information Systems Research
Peffers, K., Tuunanen, T., Rothenberger, M. A., & Chatterjee, S. (2007) · Journal of Management Information Systems · doi:10.2753/mis0742-1222240302 · Cited by 7,832 · cited 1×
“” As such, our approach resembles the salient parts of the design science paradigm (Hevner et al. 2004, Peffers et al. 2007).”
Hedonic Consumption: Emerging Concepts, Methods and Propositions
Hirschman, E. C., & Holbrook, M. B. (1982) · Journal of Marketing · doi:10.1177/002224298204600314 · Cited by 5,616 · cited 1×
“Our research is based on the theory of shopping motivation that reaches back to Hirschman and Holbrook (1982), who saw shopping motives as important pre-cursors of consumer behavior.”
MethodDefining virtual reality: Dimensions determining telepresence
Steuer, J. (1992) · Journal of Communication · doi:10.1111/j.1460-2466.1992.tb00812.x · Cited by 5,459 · cited 1×
“Instead of this more technical description, VR has also been de fi ned according to its ability to allow users to feel telepresence (Steuer 1992) and its degree of immersion.”
BackgroundPopular Ensemble Methods: An Empirical Study
Opitz, D., & Maclin, R. (1999) · Journal of Artificial Intelligence Research · doi:10.1613/jair.614 · Cited by 2,953 · cited 1×
“The main idea of ensemble methods is to combine a set of models, each of which solves the same original task (we refer to Opitz and Maclin (1999) and Kuncheva (2004) for details on these concepts).”
MethodCacioppo, J. T., Petty, R. E., Feinstein, J. A., & Jarvis, W. B. G. (1996) · Psychological Bulletin · doi:10.1037/0033-2909.119.2.197 · Cited by 2,517 · cited 1×
“…of other measures, such as users ’ interaction with their hands and personal data (e.g., past purchases, pro fi le data, knowledge about the need for cognition (Cacioppo et al. 1996), or the need for cognitive closure (Webster and Kruglanski 1994) could further increase prediction accuracy.”
BackgroundIndividual differences in need for cognitive closure.
Webster, D. M., & Kruglanski, A. W. (1994) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.67.6.1049 · Cited by 2,494
Virtual Reality: How Much Immersion Is Enough?
Bowman, D. A., & McMahan, R. P. (2007) · Computer · doi:10.1109/mc.2007.257 · Cited by 1,375 · cited 2×
“Because immersion is objective and measurable (Slater 2003, Bowman and McMahan 2007), VR systems can be classi fi ed according to their degree of immersion (Gutiérrez Alonso et al. 2008, p. 130): from nonimmersive or semi-immersive to fully immersive systems.”
BackgroundPredictive Analytics in Information Systems Research1
Shmueli, G., & Koppius, O. R. (2011) · MIS Quarterly · doi:10.2307/23042796 · Cited by 1,328
Shopping online for freedom, control, and fun.
Wolfinbarger, M., & Gilly, M. C. (2001) · California Management Review · doi:10.2307/41166074 · Cited by 1,150 · cited 2×
“Wol fi nbarger and Gilly (2001, p. 35) use the terms “ for fun ” (exploratory) and “ for ef fi ciency ” (goal-directed) to describe and distinguish consumers ’ divergent orientations.”
BackgroundE-Commerce Product Recommendation Agents: Use, Characteristics, and Impact1
Xiao, B., & Benbasat, I. (2007) · MIS Quarterly · doi:10.2307/25148784 · Cited by 1,081
Gaze bias both reflects and influences preference
Shimojo, S., Simion, C., Shimojo, E., & Scheier, C. (2003) · Nature Neuroscience · doi:10.1038/nn1150 · Cited by 924 · cited 1×
“Shimojo et al. (2003) and Shi et al. (2013) found that the ultimately chosen products received more attention and that the likelihood of fi xating on the chosen alternative increases until the decision is made.”
BackgroundImmersive virtual environment technology as a basic research tool in psychology
Loomis, J. M., Blascovich, J. J., & Beall, A. C. (1999) · Behavior Research Methods, Instruments, & Computers · doi:10.3758/bf03200735 · Cited by 717 · cited 2×
“Interaction Technologies There are various hardware setups with which to implement visual virtual environments (Loomis et al. 1999): the primary two are head-mounted displays (HMDs) (Sutherland 1968), such as the HTC Vive Pro or Oculus Rift, which are glasses that provide a personal, fully…”
BackgroundMethodPredictive Analytics in Information Systems Research
Shmueli, G., & Koppius, O. (2010) · doi:10.2139/ssrn.1606674 · Cited by 676
Visual attention during brand choice: The impact of time pressure and task motivation
Pieters, R., & Warlop, L. (1999) · International Journal of Research in Marketing · doi:10.1016/s0167-8116(98)00022-6 · Cited by 603 · cited 3×
“Directing attention to relevant stimuli — that is, fi ltration — can be achieved with parafoveal and peripheral viewing during scanning (i.e., without looking directly at each product on the shelf) (Janiszewski 1998, Pieters and Warlop 1999).”
BackgroundDiaz, G., Cooper, J., Rothkopf, C., & Hayhoe, M. (2013) · Journal of Vision · doi:10.1167/13.1.20 · Cited by 196 · cited 3×
“Because eye-tracking data can be analyzed in real time in VR, it offers research opportunities in this field, particularly regarding interacting with VR simulations (Tanriverdi and Jacob 2000) to support communication in immersive teleconferencing (Duchowski et al. 2004). We build on prior research by following the cr…”
MethodInfluential
Cited by
Dincelli, E., & Yayla, A. (2022) · The Journal of Strategic Information Systems · doi:10.1016/j.jsis.2022.101717 · Cited by 490
Xi, N., Chen, J., Gama, F., Riar, M., & Hamari, J. (2022) · Information Systems Frontiers · doi:10.1007/s10796-022-10244-x · Cited by 423
Artificial intelligence in E-Commerce: a bibliometric study and literature review
Bawack, R. E., Wamba, S. F., Carillo, K. D. A., & Akter, S. (2022) · Electronic Markets · doi:10.1007/s12525-022-00537-z · Cited by 372
Eye Tracking in Virtual Reality: a Broad Review of Applications and Challenges
Adhanom, I. B., MacNeilage, P., & Folmer, E. (2023) · Virtual Reality · doi:10.1007/s10055-022-00738-z · Cited by 325
Better, Virtually: the Past, Present, and Future of Virtual Reality Cognitive Behavior Therapy
Lindner, P. (2021) · International Journal of Cognitive Therapy · doi:10.1007/s41811-020-00090-7 · Cited by 120
“Research on how this data can be used with machine learning (Pfeiffer et al. 2020) to, e.g., predict clinical outcomes will likely be another topic of interest in the years to come.”
Background
Metadata
- Authors
- Pfeiffer, J., Pfeiffer, T., Meißner, M., & Weiß, E.
- Venue
- Information Systems Research
- Published
- 2020-09
- Volume
- 31
- Issue
- 3
- Pages
- 675-691
- ISSN
- 1047-7047 (ISSN-L)
- 1526-5536
- OpenAlex
- W2997502107
- Cited by
- 131
- References
- 19
- FWCI
- 11.52
- Type
- journal article
- Language
- en
- Open access
- bronze
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.