Development and Evaluation of Search Tasks for IIR Experiments using a Cognitive Complexity Framework
The DOI matches its Crossref record; 44 of the 51 references it cites were found in a registry or an index.
Abstract
One of the most challenging aspects of designing interactive information retrieval (IIR) experiments with users is the development of search tasks. We describe an evaluation of 20 search tasks that were designed for use in IIR experiments and developed using a cognitive complexity framework from educational theory. The search tasks represent five levels of cognitive complexity and four topical domains. The tasks were evaluated in the context of a laboratory IIR experiment with 48 participants. Behavioral and self-report data were used to characterize and understand differences among tasks. Results showed more cognitively complex tasks required significantly more search activity from participants (e.g., more queries, clicks, and time to complete). However, participants did not evaluate more cognitively complex tasks as more difficult and were equally satisfied with their performances across tasks. Our work makes four contributions: (1) it adds to what is known about the relationship among task, search behaviors and user experience; (2) it presents a framework for task creation and evaluation; (3) it provides tasks and questionnaires that can be reused by others and (4) it raises questions about findings and assumptions of many recent studies that only use behavioral signals from search logs as evidence for task difficulty and searcher satisfaction, as many of our results directly contradict these findings.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Search task complexity was shown to affect user behaviour [18].”
From A Mixed-Method Analysis of Text and Audio Search Interfaces with Varying Task Complexity (2020) · cites this paper as [18]
In the citing paper
“Prior research in visual text search has shown that more complex tasks lead to greater levels of search interactivity, for example, through increased clicks, queries, and time on task [18].”
From A Mixed-Method Analysis of Text and Audio Search Interfaces with Varying Task Complexity (2020) · cites this paper as [18]
Citations
Cites
(2001) · Cited by 13,930
Broder, A. (2002) · ACM SIGIR Forum · doi:10.1145/792550.792552 · Cited by 1,944 · cited 1×
“Broder’s [12] task classification was one of the first in the context of Web search and resulted in three categories of tasks: navigational, informational and transactional.”
BackgroundTask Complexity: A Review and Analysis
Campbell, D. J. (1988) · The Academy of Management Review · doi:10.5465/amr.1988.4306775 · Cited by 1,634 · cited 5×
“Using Campbell’s [15] conceptualization of objective task complexity, Remember tasks have the fewest solution paths, the fewest number of solutions or outcomes, the least amount of conflicting interdependencies between paths and the least amount of uncertainty regarding paths, while create tasks have the greatest numb…”
BackgroundMethodResultInfluentialTask complexity affects information seeking and use
Byström, K., & Järvelin, K. (1995) · Information Processing & Management · doi:10.1016/0306-4573(94)00041-z · Cited by 885 · cited 5×
“The tasks can also be related to Byström and Jӓrvelin’s [14] definition of task complexity in that the expected inputs, processes and outcomes become less certain as one moves from Remember to Create tasks.”
BackgroundMethodInfluentialMethods for Evaluating Interactive Information Retrieval Systems with Users
Kelly, D. (2009) · Foundations and Trends® in Information Retrieval · doi:10.1561/1500000012 · Cited by 633 · cited 2×
“Those studying IIR have used these collections in studies with research participants, although not without some challenges [23].”
BackgroundSelf-citationExploratory Search: Beyond the Query-Response Paradigm
White, R. W., & Roth, R. A. (2009) · Synthesis lectures on information concepts, retrieval, and services · doi:10.2200/s00174ed1v01y200901icr003 · Cited by 632 · cited 1×
“White and Roth [40] provide a discussion of these types of tasks and situate them in the context of other task types.”
BackgroundThe IIR evaluation model: a framework for evaluation of interactive information retrieval systems
Borlund, P. (2003) · DOAJ (DOAJ: Directory of Open Access Journals) · Cited by 403
Task‐based information searching
Vakkari, P. (2003) · Annual Review of Information Science and Technology · doi:10.1002/aris.1440370110 · Cited by 366 · cited 5×
“In one of the first reviews of task-based information seeking research, Vakkari [38] defines a task as an “activity to be performed in order to accomplish a goal” (p.”
BackgroundInfluentialA faceted approach to conceptualizing tasks in information seeking
Li, Y., & Belkin, N. J. (2008) · Information Processing & Management · doi:10.1016/j.ipm.2008.07.005 · Cited by 336 · cited 8×
“For example, Li and Belkin [28] found that objective task complexity was related to number of queries issued, mean query length, number of pages viewed, and number of sources consulted.”
BackgroundMethodResultInfluentialConceptual framework for tasks in information studies
Byström, K., & Hansen, P. (2005) · Journal of the American Society for Information Science and Technology · doi:10.1002/asi.20197 · Cited by 220 · cited 1×
“Byström and Hansen [13] distinguish between a work task and a search task, one or more of which might be conducted to address the work task.”
Background
Research works printed but not linked: 4
- 10.1002/asi.v56:10 · doi:10.1002/asi.v56:10
- 10.5555/2655780.2655902 · doi:10.5555/2655780.2655902
- Dumais , S. T. , & Belkin , N. J. ( 2005 ). The TREC Interactive Tracks: Putting the user into search . In E. M. Voorhees & D . K. Harman (Eds.) TREC: Experiment and Evaluation in Information Retrieval ( pp. 123 -- 153 ), Cambridge, MA : MIT Press . Dumais, S. T., & Belkin, N. J. (2005). The TREC Interactive Tracks: Putting the user into search. In E. M. Voorhees & D. K. Harman (Eds.) TREC: Experiment and Evaluation in Information Retrieval (pp. 123--153), Cambridge, MA: MIT Press.
- 10.5555/2655780.2655906 · doi:10.5555/2655780.2655906
Cited by
Items 101–183 of 183
Game over? a review of gamification in information retrieval
Medlar, A. J., & Głowacka, D. (2021) · ACM SIGIR Forum · doi:10.1145/3527546.3527551 · Cited by 6
“…information retrieval has the advantage that the experimental infrastructure already exists to (i) control task interest and task complexity [Kelly et al., 2015; Capra et al., 2017], and (ii) to distinguish between different task types, such as lookup and exploratory search [Athukorala et…”
BackgroundBetter Understanding Procedural Search Tasks: Perceptions, Behaviors, and Challenges
Choi, B., Casteel, S., Arguello, J., & Capra, R. (2023) · ACM Transactions on Information Systems · doi:10.1145/3630004 · Cited by 6
“Other studies that have manipulated tasks across multiple domains have also treated domain as a between-subjects factor (possibly for the same reason) [9, 26, 45, 46].”
BackgroundInfluentialSelf-citationInformation seeking in learning‐oriented search
Ghosh, S., & Shah, C. S. (2017) · Proceedings of the Association for Information Science and Technology · doi:10.1002/pra2.2017.14505401115 · Cited by 6
“We followed an approach similar to the search task development work by Wu et al. (2012) and Kelly et al. (2015).”
MethodAn Eye Tracking Study: Are AI Overviews Changing Search Behavior?
Lawati, S. F. D. A., McKay, D., Sanderson, M., Thomas, P., & Trippas, J. R. (2026) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/3805712.3809530 · Cited by 5
“This gap is important because eye-tracking is an established method in IR and IIR for studying search behavior [17].”
InfluentialA Qualitative Analysis of the Effects of Task Complexity on the Functional Role of Information
Choi, B., & Arguello, J. (2020) · Conference on Human Information Interaction and Retrieval · doi:10.1145/3343413.3377992 · Cited by 5
Self-citationWang, Y., & Shah, C. S. (2021) · Journal of the Association for Information Science and Technology · doi:10.1002/asi.24554 · Cited by 5
Schoegje, T., de Vries, A. P., & Pieters, T. (2022) · Lecture notes in computer science · doi:10.1007/978-3-031-15086-9_26 · Cited by 5
Rethinking the Cost of Information Search Behavior
Zhang, Y., & Jacek Gwizdka, A. (2016) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/2911451.2914742 · Cited by 5
“The tasks were designed based on prior work [16] to be at two complexity levels: simple and complex, shown in Table 2.”
MethodGenerating Tasks for Study of Struggling Search
Xu, L., & Zhou, X. (2019) · Conference on Human Information Interaction and Retrieval · doi:10.1145/3295750.3298949 · Cited by 5
“This is consistent with the findings about pre-and post-task difficulty in [6].”
MethodResultAdaptation in Information Search and Decision-Making under Time Pressure
Crescenzi, A. (2019) · Carolina Digital Repository (University of North Carolina at Chapel Hill) · doi:10.17615/yt6k-ac37 · Cited by 5
Designing Search-as-Learning Systems
Câmara, A. (2024) · Research Repository (Delft University of Technology) · doi:10.4233/uuid:0fe3a6bb-1bc1-40e2-86b0-ec3d3aef9c77 · Cited by 5
Classifying Term Variants in Query Formulation
Onq, N. A., Sanderson, M., & Scholer, F. (2025) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/3726302.3729924 · Cited by 4
“Jansen et al. [43] found notable differences in unique terms between analyze and remember tasks, while Kelly et al. [52] found that complexity affects both query diversity and the use of unique terms.”
Engagement in Information Search
Edwards, A., & Kelly, D. (2016) · Springer eBooks · doi:10.1007/978-3-319-27446-1_7 · Cited by 4
Self-citationSalton Award Keynote: Information Interaction in Context
Järvelin, K. (2019) · ACM SIGIR Forum · doi:10.1145/3308774.3308782 · Cited by 4
“[18]).”
Ghosh, S., & Shah, C. S. (2024) · Journal of the Association for Information Science and Technology · doi:10.1002/asi.24974 · Cited by 4
“Our tasks, which simulated naturalistic search behavior among experimental subjects, were adopted from the literature (Byström & Järvelin, 1995; Kelly et al., 2015; White et al., 2006; Wildemuth & Freund, 2012) and initiated a multi-turn conversation between the searcher and the intermediary.”
How does Domain Expertise Affect Users' Search Processes in Exploratory Searches?
Mao, J., Liu, Y., Zhang, M., & Ma, S. (2016) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · Cited by 4
Meier, F., & Elsweiler, D. (2018) · Conference on Human Information Interaction and Retrieval · doi:10.1145/3176349.3176392 · Cited by 4
“Appropriate task classifications are especially important during IIR experiments and evaluation scenarios as poorly or inadequately designed tasks can impact search behaviour in such studies, confound results or complicate the analysis [26].”
BackgroundInfluentialEvaluating interactive bibliographic information retrieval systems: A user‐centered approach
Zhu, Y., Kim, M. C., & Yan, E. (2018) · Proceedings of the Association for Information Science and Technology · doi:10.1002/pra2.2018.14505501068 · Cited by 5
Graph-based interactive bibliographic information retrieval systems
Zhu, Y., Yan, E., & Song, I. (2017) · iDEA - Drexel University Institutional Repository · doi:10.17918/etd-7224 · Cited by 4
Kaushik, A. (2021) · Dublin City University Open Access Institutional Repository (Dublin City University) · Cited by 4
Incorporating Cognitive Abilities into Web Search Re-ranking
Vuong, T., Das, P. K., & Ruotsalo, T. (2025) · ACM Transactions on Information Systems · doi:10.1145/3736401 · Cited by 3
“Rather than creating new tasks, we chose tasks that had been designed by other researchers and had been tested in many prior studies [13, 37].”
Health consumers' knowledge learning in online health information seeking
Chi, Y. (2021) · D-Scholarship@Pitt (University of Pittsburgh) · Cited by 3
Designing Search Tasks for Archive Search
Singh, J., & Anand, A. (2017) · Conference on Human Information Interaction and Retrieval · doi:10.1145/3020165.3022153 · Cited by 3
“This is different from lab based studies like [10] where participants are given fixed rewards and required to either copy-paste text from documents as evidence or write an explanation.”
BackgroundMethodInfluential“Can You Search for Me?”: Understanding and Improving User‐System Dialogues for Complex Search Tasks
Ghosh, S. (2021) · Proceedings of the Association for Information Science and Technology · doi:10.1002/pra2.446 · Cited by 3
“We closely followed the literature (White et al., 2006; Kelly et al., 2015; Byström & Järvelin, 1995; Wildemuth & Freund, 2012) to develop the three search tasks (as explained in Table 1).”
Undergraduate Students Experience Cognitive Complexity in Basic Elements of Library Research
Matas, E. (2024) · ASEE Annual Conference & Exposition · doi:10.18260/1-2--44532 · Cited by 3
Jung, Y. J., & Liu, J. (2024) · Aslib Journal of Information Management · doi:10.1108/ajim-01-2024-0041 · Cited by 3
Towards Nuanced System Evaluation Based on Implicit User Expectations
Thomas, P., Bailey, P., Moffat, A., & Scholer, F. (2015) · Lecture notes in computer science · doi:10.1007/978-3-319-28940-3_26 · Cited by 3
“[12] propose a hierarchy of complexity of search tasks, based on a taxonomy of learning [4].”
BackgroundLearning From the News: The Role of Topic, Multimedia and Interest in Knowledge Retention
O'Brien, H., McKay, J., & Vangeest, J. (2017) · Conference on Human Information Interaction and Retrieval · doi:10.1145/3020165.3020166 · Cited by 3
“Building on Jansen et al. [14], Kelly, Arguello, Edwards and Woo [15] categorized twenty tasks according to Bloom’s taxonomy and examined the relationship between learning tasks, cognitive complexity, and search behavior.”
BackgroundMethodEvaluation of Rich and Explicit Feedback for Exploratory Search
Sørig, E., Collignon, N., Fiebrink, R. A., & Kando, N. (2019) · Goldsmiths Research Online · Cited by 3
Using Trails to Support Users with Tasks of Varying Scope
Capra, R., & Arguello, J. (2019) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/3331184.3331290 · Cited by 3
Self-citationAssessing Realism in Simulated Work Tasks
Crescenzi, A., & Li, L. (2022) · Conference on Human Information Interaction and Retrieval · doi:10.1145/3498366.3505831 · Cited by 3
“, [10]) and/or found in repositories (e.”
Tasks, Time, and Tools: Quantifying Online Sensemaking Efforts Through a Survey-based StudyPreprint
Kuznetsov, A. V., Liu, M. X., & Kittur, A. (2024) · arXiv (Cornell University) · doi:10.48550/arxiv.2411.07206 · Cited by 3
“This is supported by more recent lab experiments, showing that people find it difficult to assess how close they are to completing an online search task, across a wide variety of tasks [93] [49].”
ResultLi, Y., & Capra, R. (2024) · Conference on Human Information Interaction and Retrieval · doi:10.1145/3627508.3638304 · Cited by 2
“Researchers in SAL have explored how these activities relate to the complexity levels of the information tasks as well as to the information people discovered during the search process [12, 20, 21, 37].”
BackgroundPeng, H., Liu, S., & Li, L. (2024) · Lecture notes in computer science · doi:10.1007/978-981-96-0865-2_17 · Cited by 2
Niwanputri, G. S., Tob-Ogu, A., & Hosseinzadeh, M. (2025) · ACM SIGIR International Conference on Theory of Information Retrieval (ICTIR) · doi:10.1145/3731120.3744615 · Cited by 2
“However, emerging perspectives also suggest that certain types of cognitive engagement — such as concentration and complexity — may actually enhance satisfaction, especially when the task is intellectually stimulating [17].”
Understanding and Modeling Heterogeneous Search Behavior
Onq, N. A., Ma, C., Sanderson, M., & Scholer, F. (2026) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/3805712.3809618 · Cited by 2
Session-based Search Behavior in Naturalistic Settings for Learning-related Tasks
Ghosh, S., & Shah, C. S. (2019) · ACM International Conference on Information and Knowledge Management (CIKM) · doi:10.1145/3357384.3358098 · Cited by 2
“Several research works ([15], [4], [12], [10], [9], [17]) focused on understanding search behavior in different task types and argued that different facets of a search task – task type, the task product, task complexity and task level (document vs segment) – strongly influence the search behavior…”
BackgroundMethodUsers' mental models of cross-device search under controlled and autonomous motivations
Dong, J., Duan, R., & Liang, S. (2022) · Aslib Journal of Information Management · doi:10.1108/ajim-02-2022-0057 · Cited by 2
Only forward? toward understanding human visual behaviour when examining search results
Buchanan, G. R., McKay, D., Velloso, E., Moffat, A., Turpin, A. H., & Scholer, F. (2017) · Australian Conference on Computer-Human Interaction (OzCHI) · doi:10.1145/3152771.3156165 · Cited by 2
“revealed that the cognitive complexity of the task also strongly influences searchers’ visual behaviour, both across result sets and within summaries [33].”
BackgroundExtracting the Implicit Search States from Explicit Behavioral Signals in Complex Search Tasks
Wang, B., & Liu, J. (2021) · Proceedings of the Association for Information Science and Technology · doi:10.1002/pra2.587 · Cited by 2
“A large body of IIR research focuses on users’ states during the search process and supporting them with problems occurring at each state (Asfari et al., 2009; Kelly et al., 2015; Li & Belkin, 2008).”
BackgroundYan, C., Fang, X., & Li, Y. (2022) · Journal of Information Science · doi:10.1177/01655515221133529 · Cited by 2
Vtyurina, A. (2021) · UWSpace (University of Waterloo) · Cited by 2
Investigating the Influence of Subgoals on Learning During Search
Urgo, K. (2023) · Carolina Digital Repository (University of North Carolina at Chapel Hill) · doi:10.17615/2yzf-1s98 · Cited by 2
Search or Chat? Comparing How We Learn About Debated TopicsPreprint
Yu, R., Rieger, A., Ersen, R. K., & Liu, J. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2608.14113 · Cited by 2
Exploring factors affecting renewal and stopping reasons in cross‐session search
Li, Y., & Capra, R. (2020) · Proceedings of the Association for Information Science and Technology · doi:10.1002/pra2.267 · Cited by 1
“Task factors can affect searchers' information needs and their search activities (Byström & Hansen, 2005; Kelly, Arguello, Edwards, & Wu, 2015).”
BackgroundInformaatiosta tiedon vuoksi — Informaatiotutkimuksen ilmiöitä ja uomia
Kumpulainen, S., & Sihvonen, M. (2025) · doi:10.58181/vp9789523972834 · Cited by 1
Zhang, W., Zhang, F., Mao, J., & Lu, W. P. (2026) · ACM Transactions on Information Systems · doi:10.1145/3787452 · Cited by 1
“Studies consistently demonstrate that more complex tasks are perceived as more difficult and demand greater search effort [3, 7, 13, 37, 43, 89].”
Beyond the Query: A Survey Design for Eliciting Underlying Motivations in Web Search
Lichtenegger, E., Urman, A., & Hannák, A. (2026) · Conference on Human Information Interaction and Retrieval · doi:10.1145/3786304.3787889 · Cited by 1
“Laboratory experiments enable detailed observation of interaction patterns but rely on artificial tasks that distort authentic motivations [19, 20].”
LISP – A Rich Interaction Dataset and Loggable Interactive Search Platform
Friese, J. I., Kruff, A. K., Schaer, P., Fuhr, N., & Ferro, N. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-21321-1_54 · Cited by 1
Dehghani, M., Jagfeld, G., Azarbonyad, H., Olieman, A., Kamps, J., & Marx, M. (2017) · ACM SIGIR International Conference on Theory of Information Retrieval (ICTIR) · doi:10.1145/3121050.3121105 · Cited by 1
“Aer each task, they lled out a post-search questionnaire to rate the diculty of the task and their satisfaction [8].”
MethodSalton Award Keynote: Information Interaction in Context
Järvelin, K. (2018) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/3209978.3210230 · Cited by 1
Kyprianos, K. (2018) · International Journal on Integrated Information Management · doi:10.18780/jiim.v3i1.4269 · Cited by 1
Akuma, S., & Jayne, C. (2019) · International Journal of Information Technology and Computer Science · doi:10.5815/ijitcs.2019.05.06 · Cited by 1
“Kelly et al [35] reported that the more cognitively complex the task, the more the searcher activity in terms of dwell time, mouse clicks and queries.”
BackgroundChen, Y., Lin, H., Zhang, J., & Zhao, Y. (2023) · Journal of Information Science · doi:10.1177/01655515231169961 · Cited by 1
“Social influences mainly emerge from culture and social norms [22], while situation-related factors are mostly associated with search task types, such as complexity [37], learning level [11] and health topics in the search task [10,38].”
Promoting user engagement and learning in search tasks by effective document representation
Arora, P. (2018) · Dublin City University Open Access Institutional Repository (Dublin City University) · Cited by 1
Brennan, K. P. J. (2018) · Carolina Digital Repository (University of North Carolina at Chapel Hill) · doi:10.17615/dkvv-yv68 · Cited by 1
Explainable Information Retrieval in the Audit DomainPreprint
Frummet, A., Slany, E., Amling, J., Lang, M., & Scheele, S. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2507.03479 · Cited by 1
An Integrated Model of Tasks and Uncertainties for Designing Task-aware Search Assistants
Sarkar, S. (2023) · ResearchWorks at the University of Washington (University of Washington) · Cited by 1
Ephemeral relevance and user activities in a search session
Jiang, J. (2017) · D-Scholarship@Pitt (University of Pittsburgh)
Analysis of Relevant Text Fragments for Different Search Task Types
Keyaki, A., & Miyazaki, J. (2018) · Lecture notes in computer science · doi:10.1007/978-3-030-03520-4_6
The Effect of Motivation on Web Search Behaviors of Health Consumers
Tahamtan, I. (2019) · Conference on Human Information Interaction and Retrieval · doi:10.1145/3295750.3298969
Turpin, L. (2015) · Carolina Digital Repository (University of North Carolina at Chapel Hill) · doi:10.17615/smt5-dj53
Understanding user search processes across varying cognitive levelsPreprint
Kalyani, R. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1909.04773
“[Kelly et al., 2015] provides a more detailed insight for the above study.”
How does Cognitive Ability impact the use of Query Reformulation Moves?
Moore, E. (2015) · Carolina Digital Repository (University of North Carolina at Chapel Hill) · doi:10.17615/zt60-yq04
Informaatiovuorovaikutus kontekstissa
Järvelin, K. (2019) · Informaatiotutkimus · doi:10.23978/inf.87043
Formally Modeling Users in Information Retrieval
Liu, J. (2023) · The information retrieval series · doi:10.1007/978-3-031-23229-9_2
أحمد, ح. إ. م., & مرسي, ع. ح. ف. (2022) · التربية (الأزهر) مجلة علمية محکمة للبحوث التربوية والنفسية والاجتماعية) · doi:10.21608/jsrep.2022.302941
Chen, J., Chen, H., Zhou, S., & Lu, Q. (2024) · Data and Information Management · doi:10.1016/j.dim.2024.100074
Unleashing the Value of Open Government Data: Examining the Influence of Platform and Task
Ma, X., & Wang, F. (2024) · Data Intelligence · doi:10.3724/2096-7004.di.2024.0050
“Kelly et al. (2015) [58] found that more complex tasks require more search activities from users (such as more clicks and task completion time), but have no significant influence on users’ satisfaction with task performance.”
BackgroundResultSchoegje, T. (2024) · Utrecht University Repository (Utrecht University) · doi:10.33540/2620
Silva, P. V. D. S., Nunes, E. H. D. C., & Monteiro, I. T. (2025) · Simpósio Brasileiro de Fatores Humanos em Sistemas Computacionais (IHC) · doi:10.5753/ihc.2025.12241
“The most frequent ones were: • To evaluate aspects related to usability and user experience of technologies proposed in the works (e.g. [Badam et al. 2014, Balata et al. 2014, Kelly et al. 2015, Birmingham et al. 2020]).”
Beyond Searching: Understanding How People Use Search to Support Their Creative Endeavors
Zhang, Y. (2020) · Carolina Digital Repository (University of North Carolina at Chapel Hill) · doi:10.17615/wzga-rk83
Search Timelines: Contextualized search history in support of exploratory search
Islam, M. N. (2024) · oURspace (University of Regina) · doi:10.82465/4173
Working memory in Search and Sensemaking: An Exploratory Study
Choi, B. (2025) · Carolina Digital Repository (University of North Carolina at Chapel Hill) · doi:10.17615/rhq7-j450
A Deep‐Learning Approach for Three‐Dimensional Confirmation Prediction in Data Retrieval
Hou, J., Peng, S., Li, Q., Li, Y., & Wang, P. (2025) · Proceedings of the Association for Information Science and Technology · doi:10.1002/pra2.1257
“Confirmation Scores : Researchers often employ self-reported questionnaires to gauge search experiences and expectations (Kelly et al., 2015; Lau & Coiera, 2008; Wang et al., 2000), quantifying confirmation by measuring gaps between them (Fu et al., 2018).”
Conversational search for image and video with augmented labelling
Potyagalova, A. (2025) · Dublin City University Open Access Institutional Repository (Dublin City University)
Nangraj, A. R. (2025) · SINDH UNIVERSITY RESEARCH JOURNAL -SCIENCE SERIES · doi:10.26692/surjss.v57i02.7672
Martin-Gomez, F. J. (2023) · theses.fr (ABES) · doi:10.70675/8827e91ezc1e6z41b9zb5cezaad6817446ed
Dosso, C. (2023) · theses.fr (ABES) · doi:10.70675/53d64fcbz058az4f71z8098zb4a2a755d02c
“From simply one search”: Exploring the effects of task complexity on the use of GenAI in search
Lynch, I. (2026) · Carolina Digital Repository (University of North Carolina at Chapel Hill) · doi:10.17615/a3sh-jn13
Azargoon, M., Shabani, A., CheshmehSohrabi, M., & Asemi, A. (2026) · Journal of Information Science · doi:10.1177/01655515261487153
Nangraj, A. R., Chandio, M. S., Malkani, Y. A., & Nizamani, Q. (2025) · University of Sindh Journal of Information and Communication Technology
Trapped by Expectations: Functional Fixedness in LLM-Enabled Chat Search
Liu, J., Karimnazarov, J., & White, R. W. (2025) · arXiv · doi:10.48550/arxiv.2504.02074
“In addition, inspired by prior interactive IR research and findings on task impacts [e.g., 11, 20, 47, 52, 54], this study investigated how participants’ interaction strategies varied across decision tasks of varying types, as task may serve as a key moderating factor on functional fixedness.”
Metadata
- Authors
- Kelly, D., Arguello, J., Edwards, A., & Wu, W.-C.
- Affiliations
- University of North Carolina at Chapel Hill (US)
- ORCID
- Arguello, Jaime
- Venue
- Proceedings of the 2015 International Conference on The Theory of Information Retrieval
- Publisher
- ACM
- Published
- 2015-09-27
- Pages
- 101-110
- OpenAlex
- W2069049590
- Cited by
- 155
- References
- 51
- Citations by year
- 2026: 6 · 2025: 8 · 2024: 14 · 2023: 8 · 2022: 16 · 2021: 17 · 2020: 19 · 2019: 27 · 2018: 12 · 2017: 19 · 2016: 8 · 2015: 1
- FWCI
- 11.59
- Type
- conference paper
- Language
- en
- Open access
- closed
- Locations
- ACM SIGIR International Conference on Theory of Information Retrieval (ICTIR) (publishedVersion)
- Topics
- Physical Sciences › Computer Science › Information Systems › Information Retrieval and Search Behavior
- Physical Sciences › Computer Science › Human-Computer Interaction › Usability and User Interface Design
- Physical Sciences › Computer Science › Information Systems › Recommender Systems and Techniques
- Keywords
- interactive information retrieval, task difficulty, user experience, search behavior, task evaluation, user satisfaction
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.