Reconsideration of the simulated work task situation: a context instrument for evaluation of information retrieval interaction
Open accessThe DOI matches its Crossref record; 108 of the 123 references it cites were found in a registry or an index.
Abstract
The present paper reports on the initial study and the preliminary findings of how the concept of simulated work task situation is reported used in the research literature. The overall objective of the study is in a systematic manner to learn how and for what types of evaluations the concept is applied. In particular we are interested to learn whether the recommendations for how to apply simulated work task situations are followed.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The text we found for this paper looks like another document, so the self-check wasn’t run.
Citations
Cites
(2005) · The Information Retrieval Series · doi:10.1007/1-4020-3851-8 · Cited by 864
Ingwersen, P., & Järvelin, K. (2005) · Springer eBooks · Cited by 758
Methods for Evaluating Interactive Information Retrieval Systems with Users
Kelly, D. (2009) · Foundations and Trends® in Information Retrieval · doi:10.1561/1500000012 · Cited by 633
The concept of relevance in IR
Borlund, P. (2003) · Journal of the American Society for Information Science and Technology · doi:10.1002/asi.10286 · Cited by 482
Self-citationThe IIR evaluation model: a framework for evaluation of interactive information retrieval systems
Borlund, P. (2003) · DOAJ (DOAJ: Directory of Open Access Journals) · Cited by 403
Self-citationHow many relevances in information retrieval?
Mizzaro, S. (1998) · Interacting with Computers · doi:10.1016/s0953-5438(98)00012-5 · Cited by 314
Experimental components for the evaluation of interactive information retrieval systems
Borlund, P. (2000) · Journal of Documentation · doi:10.1108/eum0000000007110 · Cited by 307
Self-citationThe development of a method for the evaluation of interactive information retrieval systems
Borlund, P., & Ingwersen, P. (1997) · Journal of Documentation · doi:10.1108/eum0000000007198 · Cited by 282
Self-citationAnnual Review of Information Science and Technology (ARIST)
Benito, C. (2003) · DOAJ (DOAJ: Directory of Open Access Journals) · Cited by 231
Display time as implicit feedback: understanding task effects
Kelly, D., & Belkin, N. J. (2004) · Proceedings of the 27th annual international ACM SIGIR conference on Research and development in information retrieval · doi:10.1145/1008992.1009057 · Cited by 228
Research works printed but not linked: 18
- Bell J.D., 2004, Proceeding of the 26th European Conference on Information Retrieval (ECIR 2004, 57
- Blomgren L., 2004, Proceedings of the 8th International European Conference on Research and Advanced Technology for Digital Libraries (ECDL 2004
- Borlund P., 1999, Draper, S.W., Dunlop, M.D., Ruthven, I. & van Rijsbergen
- 10.1002/asi.v56:10 · doi:10.1002/asi.v56:10
- Haggerty A., 2003, Proceedings of the 1st International Workshop on Adaptive Multimedia Retrieval, Hamburg (AMR 2003
- Harper D.J., 2003, Proceeding of the 25th European Conference on Information Retrieval (ECIR
- 10.1002/asi.v56:14 · doi:10.1002/asi.v56:14
- 10.1002/asi.v58:7 · doi:10.1002/asi.v58:7
- Karlgren J., 2002, Peters, C., Braschler,M., GonzaloJ. & Kluck, M. (eds.). Proceedings of the 3rd Workshop of the Cross-Language Evaluation Forum (CLEF
- 10.1002/asi.v58:7 · doi:10.1002/asi.v58:7
- Nielsen M.L., 2004, The Proceedings of the 67th ASIS&T Annual Meeting
- Petrelli D., 2002, Proceedings of the 3rd Workshop of the Cross-Language Evaluation Forum (CLEF 2002
- Ruthven I., 2002, The proceedings of the 4th International Conference on Conceptions of Library and Information Science (CoLIS 2002
- Skov M. (2009). The reinvented museum: Exploring information seeking behaviour in a digital museum context. Royal School of Library and Information Science Copenhagen. 2009. {Doctoral Thesis}. Skov M. (2009). The reinvented museum: Exploring information seeking behaviour in a digital museum context. Royal School of Library and Information Science Copenhagen. 2009. {Doctoral Thesis}. · DOI
- Szlavik Z., 2007, Proceedings the 29th European Conference on IR Research (ECIR 2007
- 10.1002/asi.v58:8 · doi:10.1002/asi.v58:8
- 10.1002/asi.v56:10 · doi:10.1002/asi.v56:10
- White R., 2001, Proceedings of the 12th International Conference on Database and Expert Systems Applications (DEXA 2001
Cited by
Assigning search tasks designed to elicit exploratory search behaviors
Wildemuth, B. M., & Freund, L. (2012) · doi:10.1145/2391224.2391228 · Cited by 140
Wildemuth, B., Freund, L., & G. Toms, E. (2014) · Journal of Documentation · doi:10.1108/jd-03-2014-0056 · Cited by 85
Liu, J. (2021) · Information Processing & Management · doi:10.1016/j.ipm.2021.102522 · Cited by 74
Modeling users' web search behavior and their cognitive styles
Kinley, K., Tjondronegoro, D., Partridge, H., & Edwards, S. L. (2014) · Journal of the Association for Information Science and Technology · doi:10.1002/asi.23053 · Cited by 62
Borlund, P. (2016) · Journal of Documentation · doi:10.1108/jd-06-2015-0068 · Cited by 60
Self-citationKules, B., & Capra, R. (2011) · Journal of the American Society for Information Science and Technology · doi:10.1002/asi.21647 · Cited by 56
Borlund, P., & Dreier, S. (2014) · Information Processing & Management · doi:10.1016/j.ipm.2014.03.001 · Cited by 45
Self-citationA Workflow Analysis Perspective to Scholarly Research Tasks
Koolen, M., Kumpulainen, S., & Estrada, L. M. M. (2020) · Conference on Human Information Interaction and Retrieval · doi:10.1145/3343413.3377969 · Cited by 36
Proactive Information Retrieval by Capturing Search Intent from Primary Task Context
Koskela, M., Luukkonen, P., Ruotsalo, T., Sjöberg, M., & Floréen, P. (2018) · ACM Transactions on Interactive Intelligent Systems · doi:10.1145/3150975 · Cited by 32
Evaluating the user experience in a digital library
Barifah, M. H., Landoni, M., & Eddakrouri, A. (2020) · Proceedings of the Association for Information Science and Technology · doi:10.1002/pra2.280 · Cited by 30
Wu, I., & Wu, C.-Y. (2011) · Journal of Information Science · doi:10.1177/0165551511400955 · Cited by 27
Urgo, K., & Arguello, J. (2022) · Information Processing & Management · doi:10.1016/j.ipm.2022.103158 · Cited by 25
Investigating users' query formulations for cognitive search intents
Kato, M. P., Yamamoto, T., Ohshima, H., & Tanaka, K. (2014) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/2600428.2609566 · Cited by 23
Reichenbacher, T., Sabbata, S. D., Purves, R. S., & Fabrikant, S. I. (2016) · Journal of the Association for Information Science and Technology · doi:10.1002/asi.23625 · Cited by 20
Automatic Resolution of Normative Conflicts in Supportive Technology Based on User Values
Kayal, A., Brinkman, W., Neerincx, M. A., & van Riemsdijk, M. B. (2018) · ACM Transactions on Internet Technology · doi:10.1145/3158371 · Cited by 20
Aliannejadi, M., Landoni, M., Huibers, T. W. C., Murgia, E., & Pera, M. S. (2021) · Conference on Human Information Interaction and Retrieval · doi:10.1145/3406522.3446058 · Cited by 17
personality and information behavior in web search
Schmidt, T., & Wolff, C. G. (2016) · Proceedings of the Association for Information Science and Technology · doi:10.1002/pra2.2016.14505301121 · Cited by 16
Wanting information: Uncertainty and its reduction through search engagement
van der Sluis, F. (2024) · Information Processing & Management · doi:10.1016/j.ipm.2024.103890 · Cited by 15
How does Interest in a Work Task Impact Search Behavior and Engagement?
Edwards, A., & Kelly, D. (2016) · Conference on Human Information Interaction and Retrieval · doi:10.1145/2854946.2855000 · Cited by 14
Kayal, A. (2017) · Research Repository (Delft University of Technology) · doi:10.4233/uuid:9280a620-e2a7-4280-8d7d-18aeb02b43c7 · Cited by 14
Bridging Gaps: Predicting User and Task Characteristics from Partial User Information
Mitsui, M. R., & Shah, C. S. (2019) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/3331184.3331221 · Cited by 13
Effects of relevance criteria and subjective factors on web image searching behaviour
Hamid, R. A., Thom, J. A., & Iskandar, D. N. F. A. (2016) · Journal of Information Science · doi:10.1177/0165551516666968 · Cited by 12
WNavis: Navigating Wikipedia semantically with an SNA-based summarization technique
Wu, I., & Lin, Y.-S. (2012) · Decision Support Systems · doi:10.1016/j.dss.2012.04.002 · Cited by 10
Geographic dimensions of relevance
Sabbata, S. D., Mizzaro, S., & Reichenbacher, T. (2015) · Journal of Documentation · doi:10.1108/jd-12-2013-0167 · Cited by 9
Simulating Information Retrieval Test Collections
Hawking, D., Billerbeck, B., Thomas, P., & Craswell, N. (2020) · Synthesis lectures on information concepts, retrieval, and services · doi:10.2200/s01043ed1v01y202008icr071 · Cited by 9
On intermediaries' inquiring minds, elicitation styles, and user satisfaction
Wu, M., & Liu, Y. (2011) · Journal of the American Society for Information Science and Technology · doi:10.1002/asi.21644 · Cited by 9
Evaluating the effectiveness of Google, Parsijoo, Rismoon, and Yooz to retrieve Persian documents
Tazehkandi, M. Z., & Nowkarizi, M. (2020) · Library Hi Tech · doi:10.1108/lht-11-2019-0229 · Cited by 9
Li, Y., & Hu, D. (2013) · Proceedings of the American Society for Information Science and Technology · doi:10.1002/meet.14505001092 · Cited by 8
Elbeshausen, S., Mandl, T., & Womser‐Hacker, C. (2015) · Computer supported cooperative work · doi:10.1007/978-3-319-18988-8_5 · Cited by 8
Impact of Task Types on Collaborative Information Seeking Behavior
Wu, D., Liang, S., Dong, J., & Qiu, J. (2018) · Libri · doi:10.1515/libri-2017-0051 · Cited by 8
A reference dependence approach to enhancing early prediction of session behavior and satisfaction
Brown, T., & Liu, J. (2022) · ACM/IEEE Joint Conference on Digital Libraries · doi:10.1145/3529372.3533294 · Cited by 7
Simulated work tasks: the case of professional users
Svarre, T., & Lykke, M. (2014) · Information Interaction in Context Symposium (IIiX) · doi:10.1145/2637002.2637027 · Cited by 6
Evaluating interactive bibliographic information retrieval systems: A user‐centered approach
Zhu, Y., Kim, M. C., & Yan, E. (2018) · Proceedings of the Association for Information Science and Technology · doi:10.1002/pra2.2018.14505501068 · Cited by 5
Situationsabhängige Rezeption von Information bei Verwendung der Wikipedia
Knäusl, H. (2014) · University of Regensburg Publication Server (University of Regensburg) · doi:10.5283/epub.31041 · Cited by 4
Graph-based interactive bibliographic information retrieval systems
Zhu, Y., Yan, E., & Song, I. (2017) · iDEA - Drexel University Institutional Repository · doi:10.17918/etd-7224 · Cited by 4
CollabSearch: A Study of User-LLM Collaboration in Task-Based Search
Batista, G. D. C., Jose, J. M., & Joho, H. (2026) · Conference on Human Information Interaction and Retrieval · doi:10.1145/3786304.3788848 · Cited by 2
Searching as thinking: The role of cues in query reformulation
Maidel, V. (2014) · Syracuse University Libraries (Syracuse University) · Cited by 2
Goodale, P. (2016) · Cited by 2
Schmidt, T. (2016) · University of Regensburg Publication Server (University of Regensburg) · doi:10.5283/epub.33886 · Cited by 2
From social tagging to polyrepresentation: a study of expert annotating behavior of moving images
Estrada, L. M. M. (2016) · e-Archivo (Carlos III University of Madrid) · Cited by 2
Alghamdi, E., Halvey, M. J., & Nicol, E. (2025) · Mensch und Computer (MuC) · doi:10.1145/3743049.3743050 · Cited by 1
Wang, A., Zhao, Y., & Ma, F. (2025) · Journal of the Association for Information Science and Technology · doi:10.1002/asi.70037 · Cited by 1
Katse kaunokirjallisuuteen. Kaunokirjallisuuden valinta verkkopalvelun avulla.
Pöntinen, J. (2013) · Tampere University Institutional Repository (Tampere University) · Cited by 1
What is the influence of genre during the perception of structured text for retrieval and search
Clark, M. (2014) · Open Access Institutional Repository at Robert Gordon University (Robert Gordon University)
A probabilistic approach for cluster based polyrepresentative information retrieval
Abbasi, M. K. (2015) · University of Bedfordshire Repository (University of Bedfordshire)
Cataloging Images in Library, Archive, and Museum
shakhsi, L. (2016) · Advances in library and information science (ALIS) book series · doi:10.4018/978-1-5225-1653-8.ch007
User Interactions with Search Systems
Liu, Y., Liu, C., & Bierig, R. (2018) · ACM SIGIR International Conference on Theory of Information Retrieval (ICTIR) · doi:10.1145/3234944.3234981
Support for Information-Seeking Strategies
Jordan, M. (2016) · DuEPublico (University of Duisburg-Essen)
Tazehkandi, M. Z., Nowkarizi, M., & Behzadi, H. (2020) · DOAJ (DOAJ: Directory of Open Access Journals)
How task frames affect the process and products of inquiry
Novin, A. (2023) · cIRcle (University of British Columbia) · doi:10.14288/1.0435870
Automatic Prediction of Health Literacy through an eye tracker
Ramos, E. D. (2019) · Portuguese National Funding Agency for Science, Research and Technology (RCAAP Project by FCT) · doi:10.34626/45nh-ze50
Individual reading types and the effects of automated annotation
Tuomela, M. S. (2020) · Illinois Digital Environment for Access to Learning and Scholarship (University of Illinois at Urbana-Champaign)
Exploring the Role of Culture in Online Searching Behavior from a Cognitive Perspective
Chizari, S. (2017) · Scholar Commons (University of South Carolina)
Working memory in Search and Sensemaking: An Exploratory Study
Choi, B. (2025) · Carolina Digital Repository (University of North Carolina at Chapel Hill) · doi:10.17615/rhq7-j450
Wang, Z., & Wang, J. (2026) · Information Processing & Management · doi:10.1016/j.ipm.2026.105049
Metadata
- Authors
- Borlund, P., & Schneider, J. W.
- Affiliations
- Aalborg University (DK)
- Venue
- Proceedings of the third symposium on Information interaction in context
- Publisher
- ACM
- Published
- 2010-08-18
- Pages
- 155-164
- OpenAlex
- W2003125260
- Cited by
- 55
- References
- 123
- Citations by year
- 2026: 2 · 2025: 3 · 2024: 1 · 2023: 1 · 2022: 2 · 2021: 2 · 2020: 6 · 2019: 2 · 2018: 5 · 2017: 3 · 2016: 10 · 2015: 3 · 2014: 8 · 2013: 2 · 2012: 2
- FWCI
- 12.66
- Type
- conference paper
- Language
- en
- Open access
- Locations
- Information Interaction in Context Symposium (IIiX) (publishedVersion)
- Research at the University of Copenhagen (University of Copenhagen) (publishedVersion, other-oa)
- Topics
- Social Sciences › Psychology › Applied Psychology › Human Resource Development and Performance Evaluation
- Social Sciences › Education › Vocational Education and Training
- Social Sciences › Human Factors and Ergonomics › Human-Automation Interaction and Safety
- Keywords
- simulated work tasks, research recommendations
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
A second model labelled each claim on 2026-11-18 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.