The DOI matches its Crossref record; 4 of the 4 references it cites were found in a registry or an index.
Eye-tracking analysis of user behavior in WWW search
Abstract
We investigate how users interact with the results page of a WWW search engine using eye-tracking. The goal is to gain insight into how users browse the presented abstracts and how they select links for further exploration. Such understanding is valuable for improved interface design, as well as for more accurate interpretations of implicit feedback (e.g. clickthrough) for machine learning. The following presents initial results, focusing on the amount of time spent viewing the presented abstracts, the total number of abstract viewed, as well as measures of how thoroughly searchers evaluate their results set.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Eye movements in reading and information processing: 20 years of research
Rayner, K. (1998) · Psychological Bulletin · doi:10.1037/0033-2909.124.3.372 · Cited by 7,979
Optimizing search engines using clickthrough data
Joachims, T. (2002) · Proceedings of the eighth ACM SIGKDD international conference on Knowledge discovery and data mining · doi:10.1145/775047.775067 · Cited by 3,873
Self-citationBroder, A. (2002) · ACM SIGIR Forum · doi:10.1145/792550.792552 · Cited by 1,944
Can Relevance be Inferred from Eye Movements in Information Retrieval
Salojärvi, J., Kojo, I., Simola, J., & Samuel Kaski, A. (2003) · Cited by 47
Cited by
Accurately interpreting clickthrough data as implicit feedback
Joachims, T., Granka, L., Pan, B., Hembrooke, H., & Gay, G. (2005) · Proceedings of the 28th annual international ACM SIGIR conference on Research and development in information retrieval · doi:10.1145/1076034.1076063 · Cited by 1,408
Self-citationIn Google We Trust: Users’ Decisions on Rank, Position, and Relevance
Pan, B., Hembrooke, H., Joachims, T., Lorigo, L., Gay, G., & Granka, L. (2007) · Journal of Computer-Mediated Communication · doi:10.1111/j.1083-6101.2007.00351.x · Cited by 715
Self-citationEvaluating the accuracy of implicit feedback from clicks and query reformulations in Web search
Joachims, T., Granka, L., Pan, B., Hembrooke, H., Radlinski, F., & Gay, G. (2007) · ACM Transactions on Information Systems · doi:10.1145/1229179.1229181 · Cited by 677
Self-citationThe search engine manipulation effect (SEME) and its possible impact on the outcomes of elections
Epstein, R., & Robertson, R. E. (2015) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1419828112 · Cited by 577
Are automated debugging techniques actually helping programmers?
Parnin, C., & Orso, A. (2011) · Proceedings of the 2011 International Symposium on Software Testing and Analysis · doi:10.1145/2001420.2001445 · Cited by 576
Query chains: learning to rank from implicit feedback
Radlinski, F., & Joachims, T. (2005) · Proceedings of the eleventh ACM SIGKDD international conference on Knowledge discovery in data mining · doi:10.1145/1081870.1081899 · Cited by 476
Self-citationA user browsing model to predict search engine click data from past observations.
Dupret, G. E., & Piwowarski, B. (2008) · Proceedings of the 31st annual international ACM SIGIR conference on Research and development in information retrieval · doi:10.1145/1390334.1390392 · Cited by 442
Measuring personalization of web search
Hannak, A., Sapiezynski, P., Molavi Kakhki, A., Krishnamurthy, B., Lazer, D., Mislove, A., & Wilson, C. (2013) · Proceedings of the 22nd international conference on World Wide Web · doi:10.1145/2488388.2488435 · Cited by 396
An Introduction to Neural Information Retrieval
Mitra, B., & Craswell, N. (2018) · Foundations and Trends® in Information Retrieval · doi:10.1561/1500000061 · Cited by 317
Eye Tracking in User Experience Design
(2014) · Elsevier eBooks · doi:10.1016/c2012-0-06867-6 · Cited by 296
Information re-retrieval: repeat queries in Yahoo's logs
Teevan, J., Adar, E., Jones, R., & Potts, M. A. S. (2007) · Proceedings of the 30th annual international ACM SIGIR conference on Research and development in information retrieval · doi:10.1145/1277741.1277770 · Cited by 293
Accurately Interpreting Clickthrough Data as Implicit Feedback
Joachims, T., Granka, L., Pan, B., Hembrooke, H., & Gay, G. (2017) · ACM SIGIR Forum · doi:10.1145/3130332.3130334 · Cited by 212
Self-citationHow does search behavior change as search becomes more difficult?
Aula, A., Khan, R. M., & Guan, Z. (2010) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/1753326.1753333 · Cited by 209
Mining query logs: turning search usage data into knowledge
Silvestri, F. (2009) · Foundations and Trends® in Information Retrieval · doi:10.1561/1500000013 · Cited by 194
Problematic Machine Behavior: A Systematic Literature Review of Algorithm Audits
Bandy, J. (2021) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3449148 · Cited by 193
Investigating the Impact of Gender on Rank in Resume Search Engines
Chen, L., Ma, R., Hannák, A., & Wilson, C. (2018) · Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3173574.3174225 · Cited by 155
Asher, A. D., Duke, L. M., & Wilson, S. (2013) · College & Research Libraries · doi:10.5860/crl-374 · Cited by 150
The influence of caption features on clickthrough patterns in web search
Clarke, C. L. A., Agichtein, E., Dumais, S., & White, R. W. (2007) · Proceedings of the 30th annual international ACM SIGIR conference on Research and development in information retrieval · doi:10.1145/1277741.1277767 · Cited by 119
The effects of expertise and feedback on search term selection and subsequent learning
Hembrooke, H. A., Granka, L. A., Gay, G. K., & Liddy, E. D. (2005) · Journal of the American Society for Information Science and Technology · doi:10.1002/asi.20180 · Cited by 97
Self-citationQuantifying the Impact of User Attentionon Fair Group Representation in Ranked Lists
Sapiezynski, P., Zeng, W., E Robertson, R., Mislove, A., & Wilson, C. (2019) · Companion Proceedings of The 2019 World Wide Web Conference · doi:10.1145/3308560.3317595 · Cited by 92
Beyond Ranking: Optimizing Whole-Page Presentation
Wang, Y., Yin, D., Jie, L., Wang, P., Yamada, M., Chang, Y., & Mei, Q. (2016) · Proceedings of the Ninth ACM International Conference on Web Search and Data Mining · doi:10.1145/2835776.2835824 · Cited by 66
Balatsoukas, P., & Ruthven, I. (2012) · Journal of the American Society for Information Science and Technology · doi:10.1002/asi.22707 · Cited by 66
Toward a semantic granularity model for domain-specific information retrieval
Yan, X., Lau, R. Y. K., Song, D., Li, X., & Ma, J. (2011) · ACM Transactions on Information Systems · doi:10.1145/1993036.1993039 · Cited by 56
More Accounts, Fewer Links: How Algorithmic Curation Impacts Media Exposure in Twitter Timelines
Bandy, J., & Diakopoulos, N. (2021) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3449152 · Cited by 54
Prevalence and Impacts of Image-Based Sexual Abuse Victimization: A Multinational Study
Umbach, R., Henry, N., & Beard, G. (2025) · Proceedings of the 2025 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3706598.3713545 · Cited by 28
Crabb, M., & Hanson, V. L. (2016) · ACM Transactions on Accessible Computing · doi:10.1145/2856046 · Cited by 20
Detecting duplicate web documents using clickthrough data
Radlinski, F., Bennett, P. N., & Yilmaz, E. (2011) · Proceedings of the fourth ACM international conference on Web search and data mining · doi:10.1145/1935826.1935859 · Cited by 19
Investigation of students' use of online information in higher education using eye tracking
Kunz, A.-K., Zlatkin-Troitschanskaia, O., Schmidt, S., Nagel, M.-T., & Brückner, S. (2024) · Smart Learning Environments · doi:10.1186/s40561-024-00333-6 · Cited by 12
Metadata
- Authors
- Granka, L. A., Joachims, T., & Gay, G.
- Venue
- Proceedings of the 27th annual international ACM SIGIR conference on Research and development in information retrieval
- Publisher
- ACM
- Published
- 2004-07-25
- Pages
- 478-479
- OpenAlex
- W2151592910
- Cited by
- 696
- References
- 4
- FWCI
- 13.77
- Type
- conference paper
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.