Summary attributes and perceived search quality
The DOI matches its Crossref record; 2 of the 2 references it cites were found in a registry or an index.
Abstract
We conducted a series of experiments in which surveyed web search users answered questions about the quality of search results on the basis of the result summaries. Summaries shown to different groups of users were editorially constructed so that they differed in only one attribute, such as length. Some attributes had no effect on users' quality judgments, while in other cases, changing an attribute had a "halo effect" which caused seemingly unrelated dimensions of result quality to be rated higher by users.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Citations
Cites
Understanding user goals in web search
Rose, D. E., & Levinson, D. (2004) · Proceedings of the 13th international conference on World Wide Web · doi:10.1145/988672.988675 · Cited by 563
Self-citationAdvantages of query biased summaries in information retrieval
Tombros, A., & Sanderson, M. (1998) · Proceedings of the 21st annual international ACM SIGIR conference on Research and development in information retrieval · doi:10.1145/290941.290947 · Cited by 241
Cited by
Conversational Information Seeking
Zamani, H., Trippas, J. R., Dalton, J., & Radlinski, F. (2023) · Foundations and Trends® in Information Retrieval · doi:10.1561/1500000081 · Cited by 79
Predicting the readability of short web summaries
Kanungo, T., & Orr, D. (2009) · ACM International Conference on Web Search and Data Mining (WSDM) · doi:10.1145/1498759.1498827 · Cited by 107
Self-citationImproving Search Results Quality by Customizing Summary Lengths
Kaißer, M., Hearst, M. A., & Lowe, J. B. (2008) · Cited by 91
A Study of Snippet Length and Informativeness: Behaviour, Performance and User Experience
Maxwell, D., Azzopardi, L. A., & Moshfeghi, Y. (2017) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/3077136.3080824 · Cited by 75
The Case for Readability of Crisis Communications in Social Media
Temnikova, I., Vieweg, S. E., & Castillo, C. (2015) · International World Wide Web Conference (WWW) · doi:10.1145/2740908.2741718 · Cited by 49
Metadata
- Authors
- Rose, D. E., Orr, D., & Kantamneni, R. G. P.
- Affiliations
- A9.com Inc., Palo Alto, CA
- Yahoo (United States) (US)
- Venue
- Proceedings of the 16th international conference on World Wide Web
- Publisher
- ACM
- Published
- 2007-05-08
- Pages
- 1201-1202
- OpenAlex
- W2150207221
- Semantic Scholar
- 5ec94a45641704109b267170f299724073d6cd6d
- Cited by
- 22
- References
- 2
- Citations by year
- 2025: 1 · 2024: 2 · 2023: 2 · 2022: 2 · 2021: 1 · 2020: 1 · 2017: 1 · 2015: 3 · 2014: 1 · 2012: 2
- FWCI
- 0.73
- Type
- conference paper
- Language
- en
- Open access
- closed
- Locations
- International World Wide Web Conference (WWW) (publishedVersion)
- Topics
- Physical Sciences › Computer Science › Information Systems › Information Retrieval and Search Behavior
- Physical Sciences › Computer Science › Human-Computer Interaction › Usability and User Interface Design
- Physical Sciences › Computer Science › Information Systems › Recommender Systems and Techniques
- Keywords
- search result quality, halo effect, summary length, web search
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Summary attributes and perceived search quality. https://app.cochat.ai/papers/10.1145/1242572.1242765
- The paper
- Rose, D. E., Orr, D., & Kantamneni, R. G. P. (2007). Summary attributes and perceived search quality. Proceedings of the 16th international conference on World Wide Web. https://doi.org/10.1145/1242572.1242765
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.