Summary attributes and perceived search quality
The DOI matches its Crossref record; 2 of the 2 references it cites were found in a registry or an index.
Abstract
We conducted a series of experiments in which surveyed web search users answered questions about the quality of search results on the basis of the result summaries. Summaries shown to different groups of users were editorially constructed so that they differed in only one attribute, such as length. Some attributes had no effect on users' quality judgments, while in other cases, changing an attribute had a "halo effect" which caused seemingly unrelated dimensions of result quality to be rated higher by users.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Citations
Cites
Understanding user goals in web search
Rose, D. E., & Levinson, D. (2004) · Proceedings of the 13th international conference on World Wide Web · doi:10.1145/988672.988675 · Cited by 563
Self-citationAdvantages of query biased summaries in information retrieval
Tombros, A., & Sanderson, M. (1998) · Proceedings of the 21st annual international ACM SIGIR conference on Research and development in information retrieval · doi:10.1145/290941.290947 · Cited by 241
Cited by
Conversational Information Seeking
Zamani, H., Trippas, J. R., Dalton, J., & Radlinski, F. (2023) · Foundations and Trends® in Information Retrieval · doi:10.1561/1500000081 · Cited by 79
Predicting the readability of short web summaries
Kanungo, T., & Orr, D. (2009) · ACM International Conference on Web Search and Data Mining (WSDM) · doi:10.1145/1498759.1498827 · Cited by 107
Self-citationImproving Search Results Quality by Customizing Summary Lengths
Kaißer, M., Hearst, M. A., & Lowe, J. B. (2008) · Cited by 91
A Study of Snippet Length and Informativeness: Behaviour, Performance and User Experience
Maxwell, D., Azzopardi, L. A., & Moshfeghi, Y. (2017) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/3077136.3080824 · Cited by 75
The Case for Readability of Crisis Communications in Social Media
Temnikova, I., Vieweg, S. E., & Castillo, C. (2015) · International World Wide Web Conference (WWW) · doi:10.1145/2740908.2741718 · Cited by 49
Search Interface Design and Evaluation
Liu, C., Liu, Y., Liu, J., & Bierig, R. (2021) · Foundations and Trends® in Information Retrieval · doi:10.1561/1500000073 · Cited by 39
A Mixed-Method Analysis of Text and Audio Search Interfaces with Varying Task Complexity
Vtyurina, A., Clarke, C. L. A., Law, E., Trippas, J. R., & Bota, H. (2020) · Proceedings of the 2020 ACM SIGIR on International Conference on Theory of Information Retrieval · doi:10.1145/3409256.3409822 · Cited by 29
Search Engines in Learning Contexts: A Literature Review
Kameni, J. S. H., Batchakui, B., & Nkambou, R. (2022) · International Journal of Emerging Technologies in Learning (iJET) · doi:10.3991/ijet.v17i02.26217 · Cited by 22
Enhancing Document Snippets Using Temporal Information
Alonso, O., Gertz, M., & Baeza-Yates, R. A. (2011) · Lecture notes in computer science · doi:10.1007/978-3-642-24583-1_4 · Cited by 13
Gerjets, P. H., Kammerer, Y., Scheiter, K., & Wollny, E. (2009) · Proceedings of the Annual Meeting of the Cognitive Science Society · Cited by 12
Bridging the Gap between Intrinsic and Perceived Relevance in Snippet Generation
He, J., Duboue, P. A., & Nie, J. (2012) · International Conference on Computational Linguistics · Cited by 11
Query‐biased summary generation assisted by query expansion
Bando, L. L., Scholer, F., & Turpin, A. H. (2014) · Journal of the Association for Information Science and Technology · doi:10.1002/asi.23222 · Cited by 10
ReClose: web page summarization combining summary techniques
Wenerstrom, B., & Kantardzic, M. M. (2011) · International Journal of Web Information Systems · doi:10.1108/17440081111187547 · Cited by 4
Search Interface Design and Evaluation
Liu, C., Liu, Y., Liu, J., & Bierig, R. (2021) · doi:10.1561/9781680839234 · Cited by 3
Framing your concerns right: an analysis of air passengers' complaints during two time periods
Sharma, D., Vimalkumar, M., Gouda, S. K., Gupta, A., & Ilavarasan, V. (2023) · Journal of Service Theory and Practice · doi:10.1108/jstp-12-2022-0271 · Cited by 3
Modeling Perceived Relevance for Tail Queries without Click-Through DataPreprint
Kang, C., Lin, X., Wang, X., Chang, Y., & Tseng, B. L. (2011) · arXiv (Cornell University) · doi:10.48550/arxiv.1110.1112 · Cited by 3
Enhancing Snippet Visualizations to Improve Web Search
Taieb‐Maimon, M. (2025) · International Journal of Human-Computer Interaction · doi:10.1080/10447318.2024.2443267 · Cited by 2
Optimizing word search within documents by showing results in the context
Peng, C., Ge, T., & Wang, Y. (2022) · Journal of Visualization · doi:10.1007/s12650-022-00880-5 · Cited by 2
Vtyurina, A. (2021) · UWSpace (University of Waterloo) · Cited by 2
The Impact of Snippet Reliability on Misinformation in Online Health SearchPreprint
Hashavit, A., Stern, T., Wang, H., & Kraus, S. (2024) · arXiv (Cornell University) · doi:10.48550/arxiv.2401.15720 · Cited by 2
Enhanced web-based summary generation for search.
Wenerstrom, B. (2012) · ThinkIR: The University of Louisville's Institutional Repository (University of Louisville) · doi:10.18297/etd/1547
Sentence length, sentence fragment and images affecting presentation of search result pages
Xu, H. W., Jiang, Y., Wang, Y., Sun, Y.-W., & Li, X. (2015) · Joint International Mechanical, Electronic and Information Technology Conference (JIMET) · doi:10.2991/jimet-15.2015.12
McReynolds, A. M. (2015) · San José State University ScholarWorks (San Jose State University) · doi:10.31979/etd.rq8m-35zw
The Search Performance Evaluation and Prediction in Exploratory Search
Liu, F. (2016) · eScholarship (California Digital Library)
Snippet Generation Using Local Alignment for Information Retrieval (LAIR)
Yilmaz, M. A., & Çiçekli, N. K. (2024) · Engineering cyber-physical systems and critical infrastructures · doi:10.1007/978-3-031-56322-5_6
Effective summarisation for search engines
Bando, L. L. (2013) · RMIT Research Repository (RMIT University Library) · doi:10.25439/rmt.27586677
LAIR (Bilgi Alma için Yerel Hizalama) kullanarak pasaj oluşturma
Yılmaz, M. A. (2023) · OpenMETU (Middle East Technical University)
Metadata
- Authors
- Rose, D. E., Orr, D., & Kantamneni, R. G. P.
- Affiliations
- A9.com Inc., Palo Alto, CA
- Yahoo (United States) (US)
- Venue
- Proceedings of the 16th international conference on World Wide Web
- Publisher
- ACM
- Published
- 2007-05-08
- Pages
- 1201-1202
- OpenAlex
- W2150207221
- Semantic Scholar
- 5ec94a45641704109b267170f299724073d6cd6d
- Cited by
- 22
- References
- 2
- Citations by year
- 2025: 1 · 2024: 2 · 2023: 2 · 2022: 2 · 2021: 1 · 2020: 1 · 2017: 1 · 2015: 3 · 2014: 1 · 2012: 2
- FWCI
- 0.73
- Type
- conference paper
- Language
- en
- Open access
- closed
- Locations
- International World Wide Web Conference (WWW) (publishedVersion)
- Topics
- Physical Sciences › Computer Science › Information Systems › Information Retrieval and Search Behavior
- Physical Sciences › Computer Science › Human-Computer Interaction › Usability and User Interface Design
- Physical Sciences › Computer Science › Information Systems › Recommender Systems and Techniques
- Keywords
- search result quality, halo effect, summary length, web search
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.