The DOI matches its Crossref record; 26 of the 27 references it cites were found in a registry or an index.
Learning about the world through long-term query logs
Abstract
In this article, we demonstrate the value of long-term query logs. Most work on query logs to date considers only short-term (within-session) query information. In contrast, we show that long-term query logs can be used to learn about the world we live in. There are many applications of this that lead not only to improving the search engine for its users, but also potentially to advances in other disciplines such as medicine, sociology, economics, and more. In this article, we will show how long-term query logs can be used for these purposes, and that their potential is severely reduced if the logs are limited to short time horizons. We show that query effects are long-lasting, provide valuable information, and might be used to automatically make medical discoveries, build concept hierarchies, and generally learn about the sociological behavior of users. We believe these applications are only the beginning of what can be done with the information contained in long-term query logs, and see this work as a step toward unlocking their potential.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“The social web enables access to social traces at a scale and level of detail, both in breadth and depth, impractical with conventional data collection techniques, like surveys or user studies (Richardson, 2008; Lazer et al., 2009).”
From Social Data: Biases, Methodological Pitfalls, and Ethical Boundaries (2019) · cites this paper as Richardson, 2008
In the citing paper
“Others observed that long-term search logs (vs. short-term, within-session search information) provide richer insights into the evolution of users' interests, needs, or how their experiences unfold”
From Social Data: Biases, Methodological Pitfalls, and Ethical Boundaries (2019) · cites this paper as Richardson, 2008
Citations
Cites
On Information and Sufficiency
Kullback, S., & Leibler, R. A. (1951) · The Annals of Mathematical Statistics · doi:10.1214/aoms/1177729694 · Cited by 20,193 · cited 2×
“In Figure 2, we graph the KL-divergence [Kullback and Leibler 1951] between the query distribution among users who searched for a term, vs. all users.”
BackgroundMethodWordNet: An Electronic Lexical Database
Kilgarriff, A., & Fellbaum, C. (2000) · Language · doi:10.2307/417141 · Cited by 11,464 · cited 1×
“, applications using WordNet [Fellbaum 1998]).”
Privacy-preserving data mining
Agrawal, R., & Srikant, R. (2000) · ACM SIGMOD Record · doi:10.1145/335191.335438 · Cited by 2,961
Privacy-preserving data mining
Agrawal, R., & Srikant, R. (2000) · Proceedings of the 2000 ACM SIGMOD international conference on Management of data · doi:10.1145/342009.335438 · Cited by 1,719 · cited 1×
“As mentioned in Section 8.1, another approach is to enlist the use of privacy-preserving data mining [Blum et al. 2005; Agrawal and Srikant 2000].”
InfluentialFish Oil, Raynaud's Syndrome, and Undiscovered Public Knowledge
Swanson, D. R. (1986) · Perspectives in Biology and Medicine · doi:10.1353/pbm.1986.0087 · Cited by 866 · cited 1×
“We also include the scores for “caffeine” and “magnesium” (magnesium was hypothesized to be related to migraines in Swanson’s [1988] work on mining medical literature).”
Practical privacy: the SuLQ framework
Blum, A., Dwork, C., McSherry, F., & Nissim, K. (2005) · Proceedings of the twenty-fourth ACM SIGMOD-SIGACT-SIGART symposium on Principles of database systems · doi:10.1145/1065167.1065184 · Cited by 797
WordNet an electronic lexical database
Fellbaum, C. (n.d.) · Cited by 771
Agglomerative clustering of a search engine query log
Beeferman, D., & Berger, A. (2000) · Proceedings of the sixth ACM SIGKDD international conference on Knowledge discovery and data mining · doi:10.1145/347090.347176 · Cited by 768
Generating query substitutions
Jones, R., Rey, B., Madani, O., & Greiner, W. (2006) · Proceedings of the 15th international conference on World Wide Web · doi:10.1145/1135777.1135835 · Cited by 618
Measuring semantic similarity between words using web search engines
(2007) · Proceedings of the 16th international conference on World Wide Web · doi:10.1145/1242572.1242675 · Cited by 540
Research works printed but not linked: 1
- Rey , B. and Jhala , P . 2006. Mining associations from web query logs . In Proceedings of the Web Mining Workshop , Berlin, Germany. Rey, B. and Jhala, P. 2006. Mining associations from web query logs. In Proceedings of the Web Mining Workshop, Berlin, Germany.
Cited by
Social Data: Biases, Methodological Pitfalls, and Ethical Boundaries
Olteanu, A., Castillo, C., Diaz, F., & Kıcıman, E. (2019) · Frontiers in Big Data · doi:10.3389/fdata.2019.00013 · Cited by 763
“Examples include phenomena maintaining fairly constant patterns or evolving over long periods (Richardson, 2008; Crawford and Finn, 2014).”
BackgroundSocial Data: Biases, Methodological Pitfalls, and Ethical Boundaries
Olteanu, A., Castillo, C., Diaz, F., & Kiciman, E. (2016) · doi:10.2139/ssrn.2886526 · Cited by 763
Query suggestions using query-flow graphs
Boldi, P., Bonchi, F., Castillo, C., Donato, D., & Vigna, S. (2009) · doi:10.1145/1507509.1507518 · Cited by 138
“As a general observation, recent works have shown that not only the previous query, but the long-term interests of users, are important for understanding his/her information need [22, 25].”
BackgroundLarge scale query log analysis of re-finding
Tyler, S. K., & Teevan, J. B. (2010) · ACM International Conference on Web Search and Data Mining (WSDM) · doi:10.1145/1718487.1718512 · Cited by 125
“Query log analyses focusing on long term querying trends [17] have tended to deal with aggregate user populations.”
BackgroundAttentive Long Short-Term Preference Modeling for Personalized Product Search
Guo, Y., Cheng, Z., Nie, L., Wang, Y., Ma, J., & Kankanhalli, M. (2019) · ACM Transactions on Information Systems · doi:10.1145/3295822 · Cited by 120
“Richardson et al. [49] analyzed the long-term query logs to learn more about the user behavior.”
Background
Metadata
- Authors
- Richardson, M.
- Affiliations
- Microsoft (United States) (US)
- Corresponding author
- Richardson, Matthew
- ORCID
- Richardson, Matthew
- Venue
- ACM Transactions on the Web
- Published
- 2008-10
- Volume
- 2
- Issue
- 4
- Pages
- 1-27
- ISSN
- 1559-1131 (ISSN-L)
- 1559-114X
- OpenAlex
- W2136814520
- Cited by
- 77
- References
- 27
- Citations by year
- 2026: 1 · 2021: 2 · 2020: 2 · 2019: 5 · 2018: 3 · 2017: 9 · 2016: 8 · 2015: 8 · 2014: 8 · 2013: 6 · 2012: 3
- FWCI
- 22.76
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- ACM Transactions on the Web (publishedVersion)
- Topics
- Physical Sciences › Computer Science › Information Systems › Information Retrieval and Search Behavior
- Physical Sciences › Computer Science › Information Systems › Recommender Systems and Techniques
- Physical Sciences › Computer Science › Information Systems › Web Data Mining and Analysis
- Keywords
- search engine query logs, search behavior, concept hierarchy, medical discoveries, user behavior, time horizon
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Learning about the world through long-term query logs. https://app.cochat.ai/papers/10.1145/1409220.1409224
- The paper
- Richardson, M. (2008). Learning about the world through long-term query logs. ACM Transactions on the Web. https://doi.org/10.1145/1409220.1409224
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.