Student or educator? Sign up with your school email and get 6 months of Pro free.
CoChat

The DOI matches its Crossref record; 59 of the 62 references it cites were found in a registry or an index; none of the 63 sources its claims cite is checked for support yet.

Interactive Information Retrieval: An Introduction

Open access
Borlund, Pia · 2013 · Journal of Information Science Theory and Practice

Abstract

The paper introduces the research area of interactive information retrieval (IIR) from a historical point of view. Further, the focus here is on evaluation, because much research in IR deals with IR evaluation methodology due to the core research interest in IR performance, system interaction and satisfaction with retrieved information. In order to position IIR evaluation, the Cranfield model and the series of tests that led to the Cranfield model are outlined. Three iconic user-oriented studies and projects that all have contributed to how IIR is perceived and understood today are presented: The MEDLARS test, the Book House fiction retrieval system, and the OKAPI project. On this basis the call for alternative IIR evaluation approaches motivated by the three revolutions (the cognitive, the relevance, and the interactive revolutions) put forward by Robertson & Hancock-Beaulieu (1992) is presented. As a response to this call the ‘IIR evaluation model’ by Borlund (e.g., 2003a) is introduced. The objective of the IIR evaluation model is to facilitate IIR evaluation as close as possible to actual information searching and IR processes, though still in a relatively controlled evaluation environment, in which the test instrument of a simulated work task situation plays a central part.

Overview

CoChat Summary

TL;DR

This paper introduces interactive information retrieval (IIR) from a historical perspective, with a focus on evaluation. It traces the Cranfield model and three user-oriented projects, then presents the three revolutions and Borlund’s IIR evaluation model using simulated work task situations.

Key findings

  • The paper positions IIR as the user-oriented counterpart to system-oriented Cranfield/TREC-style evaluation. It outlines the Cranfield tests: ASTIA-Uniterm used 15,000 documents and 98 requests, with disagreement over relevance; Cranfield-Uniterm used 200 documents and 40 artificial requests; Cranfield I used 18,000 documents and 1,200 requests; Cranfield II used 1,400 documents, 211 generated requests, and 33 indexing languages.
  • Three iconic user-oriented studies are presented: the MEDLARS test evaluated an operational system with approximately 700,000 items and 302 real information requests, with relevance assessed as major, minor, or no value; the Book House fiction retrieval system developed fiction classification dimensions, a picture association thesaurus, and five search strategies (four implemented), and was evaluated over six months in 1988 with 2,850 search logs and 75 complete user observations; the OKAPI project built end-user test retrieval systems and participated in TREC.
  • Robertson and Hancock-Beaulieu’s three revolutions—cognitive, relevance, and interactive—call for alternative IIR evaluation because the Cranfield model treats information needs as static and relevance as binary and topical.
  • Borlund’s IIR evaluation model responds by involving potential users, applying dynamic and individual information needs, using multidimensional and dynamic relevance judgements, and employing simulated work task situations; the model has three parts and six requirements for simulated work task situations.

Methods

  • Design: historical and conceptual introduction/review, not an empirical study; no new experiment is reported.
  • Data or sample: draws on published IR evaluation literature and classic tests/projects, including ASTIA/Cranfield, MEDLARS, Book House, and OKAPI, plus theoretical work on the three revolutions and the IIR evaluation model.
  • Main analysis: narrative synthesis and historical positioning; no statistical analysis is presented.

Limitations

  • The paper states that more research is needed on IIR evaluation, especially the generalization of IIR evaluation results; it also notes Belkin’s point that the contradiction between realism and comparability/generalization has not yet been solved.
  • The paper states that the major challenge is the design of realistic and applicable simulated work task situations.
  • Evident from the text: as an introduction and historical overview, it does not present new empirical data or a systematic review, and its account is based on selected iconic studies and prior literature.

Model-written summary. Check it against the paper before relying on it.

Integrity signals

Registry

Crossref · 10.1633/jistap.2013.1.3.2

Cites

59 of 59 references verified0 citation errors · 0 not checkable

Statistics

Nothing to recompute.

Verification

Claims the paper makes

0 Valid · 4 Not valid · 51 Not checked · 68 Own results and interpretations

23 more claims

Create a free account to see all 123 claims and to verify the 39 references still open.

See all claims — free account
  • Probably not a substantial claim. 79
  • It may state two separate claims as one. 39

Create a free account to see these claims.

Citations

Cites

Research works printed but not linked: 5

  1. 1997, Annual Review of Information Science and Technology, 32, 3
  2. 2009, Foundations and Trends in Information Retrieval, 3, 1
  3. 2008, Annual Review of Information Science and Technology, 24, 43
  4. 1964, Journal of Documentation, 20, 170
  5. 2001, Annual Review of Information Science and Technology, 34, 53

Cited by

See all 63

Metadata

Authors
Borlund, P.
Affiliations
University of Copenhagen (DK)
Corresponding author
Borlund, Pia
Venue
Journal of Information Science Theory and Practice
Published
2013-09-30
Volume
1
Issue
3
Pages
12-32
ISSN
  • 2287-4577 (ISSN-L)
  • 2287-9099
OpenAlex
W2093162167
Cited by
63
References
62
Citations by year
2026: 2 · 2025: 5 · 2024: 20 · 2023: 6 · 2022: 5 · 2021: 6 · 2020: 5 · 2019: 4 · 2018: 1 · 2017: 5 · 2016: 1 · 2015: 1 · 2014: 2
FWCI
2.18
Type
journal article
Language
en
Open access
Licence
cc-by
Locations
  • Journal of Information Science Theory and Practice (publishedVersion, cc-by)
  • DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
  • Research at the University of Copenhagen (University of Copenhagen) (submittedVersion)
Topics
  • Physical Sciences › Computer Science › Information Systems › Information Retrieval and Search Behavior
  • Social Sciences › Library and Information Sciences › Library Science and Information Literacy
  • Physical Sciences › Computer Science › Human-Computer Interaction › Usability and User Interface Design
Keywords
interactive information retrieval, user-centered evaluation, simulated work tasks, information seeking, cognitive revolution

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

A language model drew the claims from the paper on 2026-11-18, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).

A second model labelled each claim on 2026-11-18 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.