Struggling or exploring?: disambiguating long search sessions
The DOI matches its Crossref record; 7 of the 7 references it cites were found in a registry or an index.
Abstract
Web searchers often exhibit directed search behaviors such as navigating to a particular Website. However, in many circumstances they exhibit different behaviors that involve issuing many queries and visiting many results. In such cases, it is not clear whether the user's rationale is to intentionally explore the results or whether they are struggling to find the information they seek. Being able to disambiguate between these types of long search sessions is important for search engines both in performing retrospective analysis to understand search success, and in developing real-time support to assist searchers. The difficulty of this challenge is amplified since many of the characteristics of exploration (e.g., multiple queries, long duration) are also observed in sessions where people are struggling. In this paper, we analyze struggling and exploring behavior in Web search using log data from a commercial search engine. We first compare and contrast search behaviors along a number dimensions, including query dynamics during the session. We then build classifiers that can accurately distinguish between exploring and struggling sessions using behavioral and topical features. Finally, we show that by considering the struggling/exploring prediction we can more accurately predict search satisfaction.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Friedman, J., Hastie, T., & Tibshirani, R. (2000) · The Annals of Statistics · doi:10.1214/aos/1016218223 · Cited by 6,884 · cited 1×
“We used 10-fold cross validation for all experiments and Multiple Additive Regression Trees (MART) for classification [10].”
MethodExploratory search: from finding to understanding
Marchionini, G. (2006) · Communications of the ACM · doi:10.1145/1121949.1121979 · Cited by 1,506
Accurately interpreting clickthrough data as implicit feedback
Joachims, T., Granka, L., Pan, B., Hembrooke, H., & Gay, G. (2005) · Proceedings of the 28th annual international ACM SIGIR conference on Research and development in information retrieval · doi:10.1145/1076034.1076063 · Cited by 1,408
Determining causes and severity of end-user frustration
Ceaparu, I., Lazar, J., Bessiere, K., Robinson, J., & Shneiderman, B. (2004) · International Journal of Human-Computer Interaction · doi:10.1207/s15327590ijhc1703_3 · Cited by 399 · cited 1×
“Searchers can ultimately satisfy their information need, but still be quite frustrated in the process [4].”
BackgroundHow does search behavior change as search becomes more difficult?
Aula, A., Khan, R. M., & Guan, Z. (2010) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/1753326.1753333 · Cited by 209 · cited 2×
“Keywords Exploratory search; Exploring vs. struggling.”
BackgroundExploratory Search: Beyond the Query—Response Paradigm
White, R. W., & Roth, R. A. (2009) · Synthesis Lectures on Information Concepts, Retrieval, and Services · doi:10.1007/978-3-031-02260-9 · Cited by 182
Self-citationThe influence of caption features on clickthrough patterns in web search
Clarke, C. L. A., Agichtein, E., Dumais, S., & White, R. W. (2007) · Proceedings of the 30th annual international ACM SIGIR conference on Research and development in information retrieval · doi:10.1145/1277741.1277767 · Cited by 119 · cited 1×
“As shown in previous work [16][17], people tend to click on highly ranked results even if they are not relevant (position bias) and on results with good captions (caption bias) [5][35].”
BackgroundSelf-citation
Cited by
Kelly, D., Arguello, J., Edwards, A., & Wu, W.-C. (2015) · Proceedings of the 2015 International Conference on The Theory of Information Retrieval · doi:10.1145/2808194.2809465 · Cited by 155
“Our results show the relative nature of interaction signals: in some situations a lot of interaction might indicate problems, while in other cases it represents satisfactory progress or positive experiences, which supports recent work on disambiguating interaction data [20].”
ResultAthukorala, K., Głowacka, D., Jacucci, G., Oulasvirta, A., & Vreeken, J. (2016) · Journal of the Association for Information Science and Technology · doi:10.1002/asi.23617 · Cited by 150
“We keep constant the values of two subjective measures—user knowledge, and subjective or perceived task difficulty because they are not necessary characteristics of either exploratory or lookup tasks, rather, both lookup and exploratory tasks are likely to be conducted in familiar and unfamiliar domains as well as per…”
BackgroundUnderstanding User Satisfaction with Intelligent Assistants
Kiseleva, J., Williams, K., Jiang, J., Hassan Awadallah, A., Crook, A. C., Zitouni, I., & Anastasakos, T. (2016) · Proceedings of the 2016 ACM on Conference on Human Information Interaction and Retrieval · doi:10.1145/2854946.2854961 · Cited by 150
Predicting User Satisfaction with Intelligent Assistants
Kiseleva, J., Williams, K., Hassan Awadallah, A., Crook, A. C., Zitouni, I., & Anastasakos, T. (2016) · Proceedings of the 39th International ACM SIGIR conference on Research and Development in Information Retrieval · doi:10.1145/2911451.2911521 · Cited by 108
Struggling and Success in Web Search
Odijk, D., White, R. W., Hassan Awadallah, A., & Dumais, S. T. (2015) · Proceedings of the 24th ACM International on Conference on Information and Knowledge Management · doi:10.1145/2806416.2806488 · Cited by 79
Self-citation
Metadata
- Authors
- Hassan, A., White, R. W., Dumais, S. T., & Wang, Y.-M.
- Venue
- Proceedings of the 7th ACM international conference on Web search and data mining
- Publisher
- ACM
- Published
- 2014-02-24
- Pages
- 53-62
- OpenAlex
- W2124063543
- Cited by
- 91
- References
- 7
- FWCI
- 11.40
- Type
- conference paper
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Struggling or exploring?: disambiguating long search sessions. https://app.cochat.ai/papers/10.1145/2556195.2556221
- The paper
- Hassan, A., White, R. W., Dumais, S. T., & Wang, Y.-M. (2014). Struggling or exploring?: disambiguating long search sessions. Proceedings of the 7th ACM international conference on Web search and data mining. https://doi.org/10.1145/2556195.2556221
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.