Cited by 196

The DOI matches its Crossref record; 1 of the 1 references it cites were found in a registry or an index.

Estimating frequency of change

Cho, Junghoo, Garcia-Molina, Hector·2003·ACM Transactions on Internet Technology

Abstract

Many online data sources are updated autonomously and independently. In this article, we make the case for estimating the change frequency of data to improve Web crawlers, Web caches and to help data mining. We first identify various scenarios, where different applications have different requirements on the accuracy of the estimated frequency. Then we develop several "frequency estimators" for the identified scenarios, showing analytically and experimentally how precise they are. In many cases, our proposed estimators predict change frequencies much more accurately and improve the effectiveness of applications. For example, a Web crawler could achieve 35% improvement in "freshness" simply by adopting our proposed estimator.

Overview

Integrity signals

Registry

Crossref · 10.1145/857166.857170

Cites

1 of 1 references verified0 citation errors · 0 not checkable

Statistics

Recomputing p-values needs the paper’s full text.

Verification

Claims the paper makes

This paper’s full text isn’t openly available, so its claims and self-check weren’t run. The registry and citation checks still apply.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

  • Overall, the results show that the web is constantly changing mainly due to the creation of more and more new pages and, to a lesser extent, the modification of the content of existing ones.

    “Overall, the results show that the web is constantly changing mainly due to the creation of more and more new pages and, to a lesser extent, the modification of the content of existing ones.”

    From Survey of Temporal Information Retrieval and Related Applications (2015) · cites this paper as Cho and Garcia-Molina 2003

Citations

Cites

Flagged first, then by citations

Research works printed but not linked: 23

  1. Baentsch M., 1997, World Wide Web caching: The application-level view of the internet, IEEE Commun., 35, 6, 10.1109/35.587725 · DOI
  2. Brewington B. E., Proceedings of the 9th World-Wide Web Conference.]]
  3. 10.1109/2.841784 · DOI
  4. Canavos G., 1972, A Bayesian approach to parameter and reliability estimation in the Poisson distribution, IEEE Trans. Reliab., 21, 52, 10.1109/TR.1972.5216172 · DOI
  5. Cho J., Proceedings of the 26th International Conference on Very Large Databases.]]
  6. Cho J., 2009, Proceedings of the 2000 ACM SIGMOD ACM
  7. Coffman Jr., E., 1998, Optimal robot scheduling for web search engines, J. Sched., 1, 1
  8. Courant R. and David H. 1989. Methods of mathematical physics 1st ed. Wiley New York.]] Courant R. and David H. 1989. Methods of mathematical physics 1st ed. Wiley New York.]] · DOI
  9. Douglis F., USENIX Symposium on Internetworking Technologies and Systems.]]
  10. Edwards J., 1920, Proceedings of the 10th World-Wide Web Conference
  11. Gwertzman J., Proceedings of USENIX 1996 Annual Technical Conference.]]
  12. Hammer J., 1995, The Stanford data warehousing project, IEEE Data Eng. Bull., 18, 2
  13. Harinarayan V., Proceedings of the 1996 ACM SIGMOD. ACM
  14. Lee P. M., 1997, Bayesian Statistics: An Introduction
  15. Misra P., 1975, Parameter estimation in Poisson processes, IEEE Trans. Inf. Theory IT-21, 87--90.]]
  16. Snyder D. L. 1975. Random Point Processes. Wiley New York.]] Snyder D. L. 1975. Random Point Processes. Wiley New York.]]
  17. Taylor H. M. and Karlin S. 1998. An Introduction to Stochastic Modeling 3rd ed. Academic Press Orlando Fla.]] Taylor H. M. and Karlin S. 1998. An Introduction to Stochastic Modeling 3rd ed. Academic Press Orlando Fla.]]
  18. Thomas Jr. G. B. 1969. Calculus and Analytic Geometry 4th ed. Addison-Wesley Reading Mass.]] Thomas Jr. G. B. 1969. Calculus and Analytic Geometry 4th ed. Addison-Wesley Reading Mass.]]
  19. Wills C. E., Proceedings of the 8th World-Wide Web Conference.]]
  20. Wolman A., 1915, Proceedings of the 17th ACM Symposium on Operating Systems Principles (SOSP '99)
  21. Yacout S., Proceedings of the 19th International Conference on Computers and Industrial Engineering.]]
  22. Yu H., Proceedings of the 1999 ACM SIGCOMM ACM
  23. Zhuge Y., Proceedings of the 1995 ACM SIGMOD ACM

Cited by

Sorted by citations

Metadata

Authors
Cho, J., & Garcia-Molina, H.
Affiliations
  • University of California, Los Angeles, CA
  • Stanford University, Stanford, CA
Venue
ACM Transactions on Internet Technology
Published
2003-08
Volume
3
Issue
3
Pages
256-290
ISSN
  • 1533-5399
  • 1557-6051
Cited by
196
References
1
Language
en

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review