The DOI matches its Crossref record.
TREC: Experiment and evaluation in information retrieval
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cited by
Preparing a collection of radiology examinations for distribution and retrieval
Demner-Fushman, D., Kohli, M. D., Rosenman, M. B., Shooshan, S. E., Rodriguez, L., Antani, S., Thoma, G. R., & McDonald, C. J. (2016) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocv080 · Cited by 1,164
Inverted files for text search engines
Zobel, J., & Moffat, A. (2006) · ACM Computing Surveys · doi:10.1145/1132956.1132959 · Cited by 1,081
Methods for Evaluating Interactive Information Retrieval Systems with Users
Kelly, D. (2009) · Foundations and Trends® in Information Retrieval · doi:10.1561/1500000012 · Cited by 633
Exploratory Search: Beyond the Query-Response Paradigm
White, R. W., & Roth, R. A. (2009) · Synthesis lectures on information concepts, retrieval, and services · doi:10.2200/s00174ed1v01y200901icr003 · Cited by 632
Test Collection Based Evaluation of Information Retrieval Systems
Sanderson, M. (2010) · Foundations and Trends® in Information Retrieval · doi:10.1561/1500000009 · Cited by 485
“References 131 [277] E. M. Voorhees and D. K. Harman, “Overview of the seventh text retrieval conference,” in Proceedings of the Seventh Text Retrieval Conference (TREC-7), pp. 1–24, NIST Special Publication, 1998.”
BackgroundMethodInfluentialLETOR: A benchmark collection for research on learning to rank for information retrieval
Qin, T., Liu, T.-Y., Xu, J., & Li, H. (2010) · Information Retrieval · doi:10.1007/s10791-009-9123-y · Cited by 461
LifeLogging: Personal Big Data
Gurrin, C., Smeaton, A. F., & Doherty, A. R. (2014) · Foundations and Trends® in Information Retrieval · doi:10.1561/1500000033 · Cited by 434
User performance versus precision measures for simple search tasks
Turpin, A., & Scholer, F. (2006) · Proceedings of the 29th annual international ACM SIGIR conference on Research and development in information retrieval · doi:10.1145/1148170.1148176 · Cited by 389
Automatic summarising: The state of the art
Spärck Jones, K. (2007) · Information Processing & Management · doi:10.1016/j.ipm.2007.03.009 · Cited by 353
Snoek, C. G. M., & Worring, M. (2007) · now publishers, Inc. eBooks · doi:10.1561/9781601982353 · Cited by 317
How does clickthrough data reflect retrieval quality?
Radlinski, F., Kurup, M., & Joachims, T. (2008) · Proceedings of the 17th ACM conference on Information and knowledge management · doi:10.1145/1458082.1458092 · Cited by 293
Geng, X., Liu, T.-Y., Qin, T., & Li, H. (2007) · Proceedings of the 30th annual international ACM SIGIR conference on Research and development in information retrieval · doi:10.1145/1277741.1277811 · Cited by 255
PubMed related articles: a probabilistic topic-based model for content similarity
Lin, J., & Wilbur, W. J. (2007) · BMC Bioinformatics · doi:10.1186/1471-2105-8-423 · Cited by 243
Jones, R., & Diaz, F. (2007) · ACM Transactions on Information Systems · doi:10.1145/1247715.1247720 · Cited by 147
Cognitive Biases in Crowdsourcing
Eickhoff, C. (2018) · Proceedings of the Eleventh ACM International Conference on Web Search and Data Mining · doi:10.1145/3159652.3159654 · Cited by 144
A quantitative model for linking two disparate sets of articles in MEDLINE
Torvik, V. I., & Smalheiser, N. R. (2007) · Bioinformatics · doi:10.1093/bioinformatics/btm161 · Cited by 75
A Machine Learning-based Method for Question Type Classification in Biomedical Question Answering
El Alaoui, S. O., & Sarrouti, M. (2017) · Methods of Information in Medicine · doi:10.3414/me16-01-0116 · Cited by 47
SciFact-Open: Towards open-domain scientific claim verification
Wadden, D., Lo, K., Kuehl, B., Cohan, A., Beltagy, I., Wang, L. L., & Hajishirzi, H. (2022) · arXiv · doi:10.48550/arxiv.2210.13777 · Cited by 35
Is Starnone Really the Author Behind Ferrante?
Savoy, J. (2018) · Digital Scholarship in the Humanities · doi:10.1093/llc/fqy016 · Cited by 32
SciFact-Open: Towards open-domain scientific claim verification
Wadden, D., Lo, K., Kuehl, B., Cohan, A., Beltagy, I., Wang, L. L., & Hajishirzi, H. (2022) · Findings of the Association for Computational Linguistics: EMNLP 2022 · doi:10.18653/v1/2022.findings-emnlp.347 · Cited by 35
How fresh do you want your search results?
Cheng, S., Arvanitis, A., & Hristidis, V. (2013) · Proceedings of the 22nd ACM international conference on Information & Knowledge Management · doi:10.1145/2505515.2505696 · Cited by 11
An Instruction-Response Perspective on Large Language Models in Information Retrieval Tasks
Joho, H., & Jose, J. M. (2025) · Proceedings of the 48th International ACM SIGIR Conference on Research and Development in Information Retrieval · doi:10.1145/3726302.3730346 · Cited by 3
Experimentation standards for crisis informatics
Diaz, F. (2014) · ACM SIGIR Forum · doi:10.1145/2701583.2701586 · Cited by 3
Search Arena: Analyzing Search-Augmented LLMs
Miroyan, M., Wu, T.-H., King, L., Li, T., Pan, J., Hu, X., Chiang, W.-L., Angelopoulos, A. N., Darrell, T., Norouzi, N., et al. (2025) · arXiv · doi:10.48550/arxiv.2506.05334 · Cited by 1
“In the IR field, several static benchmarks [54, 40] and large-scale web search datasets with user logs and preference signals [57, 13, 8] have enabled robust evaluation of retrieval systems and comprehensive studies on user behavior.”
Same Ranking, Different Winner: How Scoring Targets Shape LLM Memory Benchmarks
Panthi, S., & Abdelfattah, R. (2026) · arXiv · doi:10.48550/arxiv.2605.24060 · Cited by 4
“The closest analogy is classical IR work on evaluation sensitivity (Bailey et al., 2008; Yang et al., 2019; Craswell et al., 2020; Voorhees, 2001; Voorhees and Harman, 2005; Manning et al., 2008; Järvelin and Käkäläinen, 2002).”
Metadata
- Authors
- Vicedo, J. L., & Gómez, J.
- Venue
- Journal of the American Society for Information Science and Technology
- Publisher
- Wiley
- Published
- 2007-02-20
- Volume
- 58
- Issue
- 6
- Pages
- 910-911
- ISSN
- 1532-2882 (ISSN-L)
- 1532-2890
- OpenAlex
- W2037140704
- Cited by
- 837
- References
- 0
- FWCI
- 246.68
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.