The DOI matches its Crossref record; 26 of the 27 references it cites were found in a registry or an index.
Template detection via data mining and its applications
Abstract
We formulate and propose the template detection problem, and suggest a practical solution for it based on counting frequent item sets. We show that the use of templates is pervasive on the web. We describe three principles, which characterize the assumptions made by hypertext information retrieval (IR) and data mining (DM) systems, and show that templates are a major source of violation of these principles. As a consequence, basic "pure" implementations of simple search algorithms coupled with template detection and elimination show surprising increases in precision at all levels of recall.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Furthermore, intra-host linkage patterns are more regular and predictable than inter-host linkage patterns, due to the prevalent use of templates in Web sites (Bar-Yossef and Rajagopalan, 2002).”
From Efficient PageRank approximation via graph aggregation (2006) · cites this paper as Bar-Yossef and Rajagopalan, 2002
Citations
Cites
The anatomy of a large-scale hypertextual Web search engine
Brin, S., & Page, L. (1998) · Computer Networks and ISDN Systems · doi:10.1016/s0169-7552(98)00110-x · Cited by 16,004
(1999) · Cited by 12,854
Fast Algorithms for Mining Association Rules in Large Databases
Agrawal, R., & Srikant, R. (1994) · Very Large Data Bases · Cited by 9,454
Authoritative sources in a hyperlinked environment
Kleinberg, J. M. (1999) · Journal of the ACM · doi:10.1145/324133.324140 · Cited by 9,032
Co‐citation in the scientific literature: A new measure of the relationship between two documents
Small, H. (1973) · Journal of the American Society for Information Science · doi:10.1002/asi.4630240406 · Cited by 5,345
Bibliographic coupling between scientific papers
Kessler, M. M. (1963) · American Documentation · doi:10.1002/asi.5090140103 · Cited by 3,122
Bush, V. (1945) · Cited by 2,998
Garfield, E. (1972) · Science · doi:10.1126/science.178.4060.471 · Cited by 2,788
Focused crawling: a new approach to topic-specific Web resource discovery
Chakrabarti, S., van den Berg, M., & Dom, B. (1999) · Computer Networks · doi:10.1016/s1389-1286(99)00052-3 · Cited by 1,487
Syntactic clustering of the Web
Broder, A., Glassman, S. C., Manasse, M. S., & Zweig, G. (1997) · Computer Networks and ISDN Systems · doi:10.1016/s0169-7552(97)00031-7 · Cited by 1,348
Flagged first, then by citations
1 of the 27 references couldn’t be matched to a known paper.
Cited by
Sorted by citations
Items 201–271 of 271
Context Sensitive Reflow of HTML Objects
Choudhury, R. G., Kumar, A., Varshney, D., Jain, P., & Malhotra, V. (2013) · IEEE/WIC/ACM International Conference on Web Intelligence and Intelligent Agent Technology (WI-IAT) · doi:10.1109/wi-iat.2013.22 · Cited by 2
Discovering Informative Contents of Web Pages
Fan, Q., Yan, C., Huang, L., & Huang, L. (2014) · Lecture notes in computer science · doi:10.1007/978-3-319-08010-9_20 · Cited by 2
HybEx: A Hybrid Tool for Template Extraction
Alarte, J., & Silva, J. (2022) · International World Wide Web Conference (WWW) · doi:10.1145/3487553.3524242 · Cited by 2
HTML Pattern Generator--Automatic Data Extraction from Web Pages
Coşulschi, M., Giurca, A., Udrescu, B., Constantinescu, N., & Gabroveanu, M. (2006) · International Symposium on Symbolic and Numeric Algorithms for Scientific Computing (SYNASC) · doi:10.1109/synasc.2006.43 · Cited by 2
Assessing the Effort of Repairing the Accessibility of Web Sites
Fernandes, N., & Carriço, L. M. (2012) · Lecture notes in computer science · doi:10.1007/978-3-642-31522-0_60 · Cited by 1
Content extraction based on statistic and position relationship between title and content
Li, M., Xu, P., & Yang, C. (2014) · IEEE/CIC International Conference on Communications in China (ICCC) · doi:10.1109/iccchina.2014.7008295 · Cited by 1
Cleaning Web Pages for Relevant Text Extraction and Text Categorization
Chauhan, A., Uniyal, H., & Pant, B. (2013) · Cited by 1
Web informative content identification and filtering using machine learning technique
Narwal, N., & Sharma, S. K. (2016) · International Journal of Data Analysis Techniques and Strategies · doi:10.1504/ijdats.2016.081366 · Cited by 1
Discovering Informative Blocks from Web Pages for Efficient Information Extraction using DOM tree
Kohale, R. M., & Balbudhe, S. G. (2015) · International Journal of Computational and Electronic Aspects in Engineering · doi:10.26706/ijceae.1.1.20150108 · Cited by 1
Website Main Content Extraction Using Template-Based Approach and Naïve-Bayes Classification
Rakhmawati, N. A., & Kurniawan, F. (2023) · International Conference on Smart-Green Technology in Electrical and Information Systems (ICSGTEIS) · doi:10.1109/icsgteis60500.2023.10424080 · Cited by 1
Web Content Mining Based on Dom Intersection and Visual Features Concept
Shaikh, P., Atique, M., & Malik, G. (2015) · doi:10.6084/m9.figshare.1605578.v1 · Cited by 1
Wang, J., & Wang, J. (2015) · International Joint Conference on Knowledge Discovery, Knowledge Engineering and Knowledge Management · doi:10.5220/0005613603640371 · Cited by 1
Effective Blog Pages Extractor for Better UGC Accessing
Zhao, K., Wang, Y., Hu, X., & Wang, C. (2016) · International Conference on Information Science and Control Engineering · doi:10.1109/icisce.2016.86 · Cited by 1
Navigation objects extraction for better content structure understanding
Zhao, K., Li, B., Peng, Z., Bu, J., & Wang, C. (2017) · IEEE/WIC/ACM International Conference on Web Intelligence · doi:10.1145/3106426.3106437 · Cited by 1
Isolating Informative Blocks from Large Web Pages Using HTML Tag Priority Assignment Based Approach
Kabir, R., Kabir, S., & Amin, S. (2015) · Electrical & Computer Engineering An International Journal · doi:10.14810/ecij.2015.4305 · Cited by 1
Tripathy, A. K., & Singh, A. K. (2004) · IEEE International Conference on Computer and Information Technology (CIT) · doi:10.1109/cit.2004.1357323 · Cited by 1
RetractedDetecting the content related parts of Web pages
Li, Y., Gong, Z., & Ke, Q. (2005) · International Conference on Service Systems and Service Management · doi:10.1109/icsssm.2005.1500159 · Cited by 1
Semi-Automated Wrappers Using Rule Trees
Iasinschi, A., & Coşulschi, M. (2008) · International Symposium on Symbolic and Numeric Algorithms for Scientific Computing (SYNASC) · doi:10.1109/synasc.2008.67 · Cited by 1
Automatic extraction of bilingual word pairs using inductive chain learning in various languages
Echizen‐ya, H., Araki, K., & Momouchi, Y. (2006) · Information Processing & Management · doi:10.1016/j.ipm.2005.11.004 · Cited by 1
Echo: The Editor’s Wisdom with the Elegance of a MagazinePreprint
Hailpern, J. M., & Huberman, B. A. (2012) · SSRN Electronic Journal · doi:10.2139/ssrn.2150411 · Cited by 1
EXPERIENCES REGARDING AUTOMATIC DATA EXTRACTION FROM WEB PAGES
Udrescu, B., Constantinescu, N., & Gabroveanu, M. (2006)
Accessibility summarization & simplification in a template-based web transcoder
Parmanto, B., Saptono, A., Ferrydiansyah, R., Song, L., Sugiantara, I. W., & Hackett, S. (2006) · Journal of Web Engineering
Webpage Segments Classification with Incremental Knowledge Acquisition
Guo, W., Kim, Y. S., & Kang, B. H. (2010) · Communications in computer and information science · doi:10.1007/978-3-642-17644-9_9
Toward semantic annotation of Web page's segmentation blocks
Coşulschi, M. (2010) · Annals of the University of Craiova Mathematics and Computer Science Series · doi:10.52846/ami.v37i3.362
Template Extraction from Web Documents using Substring Amplification
野口, 龍., Noguchi, R., 山田, 泰., Yamada, Y., 池田, 大., Ikeda, D., 廣川, 佐., & Hirokawa, S. (2004)
Reliable Algorithm for Extracting Web Data
Satyanarayana, R. V. V., Chinnarao, M., varma raju, S., & Jagadesh, B. N. (2013)
Извлечение значимой информации из web-страниц для задач информационного поиска
Сергеевич, А. М., Вершинников, И. В., & Dobrov, B. V. (2005) · Electronic Archive of Ural Federal University (ELAR UrFU)
A Visual Based Page Segmentation for Deep Web Data Extraction
Palekar, V. R. (2012) · Advances in intelligent and soft computing · doi:10.1007/978-81-322-0491-6_72
A Configuration Tool for Caching Dynamic Pages
Chabbouh, I., & Makpangou, M. (2004) · Lecture notes in computer science · doi:10.1007/978-3-540-30471-5_17
Berger, P., Hennig, P., Petrick, D., Pursche, M., & Meinel, C. (2014) · IEEE/ACM International Conference on Advances in Social Networks Analysis and Mining (ASONAM) · doi:10.1109/asonam.2014.7092993
Extracting the semantic content of web pages via repeated structures
He, Z., Luo, H., Jianping Fan, B., & Liu, X. (2013) · IEEE International Conference on Multimedia and Expo workshops · doi:10.1109/icmew.2013.6618450
Template extraction from candidate template set generation
Su, H., & Mei, Q. (2005) · ACM Southeast Regional Conference (ACMSE) · doi:10.1145/1167253.1167303
Bulk loading large collections of hyperlinked resources
Rafiei, D. (2005) · ACM Conference on Hypertext and Social Media (HT) · doi:10.1145/1083356.1083413
The application of Link Structure Graphs in Web sites model research
Wang, Y., & Yang, J. (2010) · International Conference on Computer Application and System Modeling · doi:10.1109/iccasm.2010.5620492
Firdaus, R., Baizal, Z. K. A., & Yanuar Firdaus, A. (2010) · JUTI Jurnal Ilmiah Teknologi Informasi · doi:10.12962/j24068535.v8i1.a71
Gray Tunneling Based On Block Relevance for Focused Crawling
Luo, N., & WanLi, Z. (2007) · International Conference on Intelligent Systems and Knowledge Engineering (ISKE) · doi:10.2991/iske.2007.104
Yang, J., & Tang, Z. (2009) · International Conference on Management of e-Commerce and e-Government · doi:10.1109/icmecg.2009.66
RetractedUnderstanding web documents: finding pagelets for transformation using structural patterns
Ferrydiansyah, R., & Parmanto, B. (2008) · International Journal of Web Engineering and Technology · doi:10.1504/ijwet.2008.019537
Impact of template removal on Web search DOI 10.5752/P.2316-9451.2012v1n1p28
Wagner, K., de Moura, E. S., Fernandes, D., de Cristo, M. A. P., & da Silva, A. S. (2012) · Abakós · doi:10.5752/p.2316-9451.2012v1n1p28
Coping With Noise in a Real-World Weblog Crawler and Retrieval System
Lanagan, J., Ferguson, P., O’Hare, N., & Smeaton, A. F. (2010) · Proceedings of the International AAAI Conference on Web and Social Media · doi:10.1609/icwsm.v4i1.14040
Web informative content block detecting based on entropy and parent-child relationship in DOM
Ding, Y., Li, Q., Yan, Z., & Dong, Y. (2008) · IEEE International Conference on Information and Automation (ICIA) · doi:10.1109/icinfa.2008.4607991
Enhanced classification through exploitation of hierarchical structures
Ghosh, J., & Punera, K. (2007)
Template Independent Object extraction using MDL and MinHash Techniques
Babu, V. J., & Prasad, E. S. (2012)
A Culturally Aware Approach to Learning System Interface Design
Yu, H. H. (2015) · KU ScholarWorks (The University of Kansas)
Bashir, R., & Akbar, S. (2015) · Lecture notes in computer science · doi:10.1007/978-3-319-25660-3_19
Coloring for Pattern Detection
Yamada, Y., & Hirokawa, S. (2008) · Kyushu University Institutional Repository (QIR) (Kyushu University)
RoadRunner for Heterogeneous Web Pages Using Extended MinHash
Sureshbabu, A. (2012) · International Journal of Database Management Systems · doi:10.5121/ijdms.2012.4103
Performance growth for text(template extraction)
Sundar, G. N., Narmadha, D., & Haran, A. P. (2014) · International Conference on Electronics and Communication Systems (ICECS) · doi:10.1109/ecs.2014.6892798
Discovering roles and types from hierarchical information networks
Weninger, T. E. (2013) · Illinois Digital Environment for Access to Learning and Scholarship (University of Illinois at Urbana-Champaign)
WWW sivujen tietosis¨¨ louhiminen
Вуоринен, М., Blomqvist, K., Ahonen, V.-P., Tani, A., & Jokinen, S. (2007)
Accelerating the process of web page segmentation via template clustering
Zelený, J., & Burget, R. (2016) · International Journal of Intelligent Information and Database Systems · doi:10.1504/ijiids.2016.075424
Research and Porting of MIPSX Based Simulator
Feng, X. (2007) · Jisuanji gongcheng
An Effective Approach to Eliminating Noises in HTML Pages
Luo, C., Li, B., & Zhang, X. (2007) · Jisuanji gongcheng
AWS: Automatic webpage segmentation
Yadollahi, M. M., & Asadpour, M. (2016) · International Conference on Web Research (ICWR) · doi:10.1109/icwr.2016.7498442
Web Mining for Social Network Analysis: A Review, Direction and Future Vision
Manjula, V. G., & Singh, Y. J. (2016) · ADBU - journal of engineering and technology
Sequence-based Web page template detection
Wei, H. (2011) · Arizona State University Library Digital Repository (Arizona State University)
An Analytic Hierarchy Process Based Comparative Study of Web Data Extraction Approaches
Sadik, S., Belangour, A., & Marzak, A. (2018) · Advances in intelligent systems and computing · doi:10.1007/978-3-319-91337-7_10
Adaptive post recognition: combine feeds and linked html pages to generate blog templates
Berger, P., Hennig, P., Petrick, D., Pursche, M., & Meinel, C. (2014) · doi:10.5555/3191835.3191917
Design and Development of the Test-bed for High-horsepower Lubricating Oil Overflow Valve
(2022) · Journal of Research in Science and Engineering · doi:10.53469/jrse.2022.04(01).21
Clustering of Template-Generated Webpages Using DOM Tree Paths of URLs
Bagban, T. I., & Kulkarni, P. J. (2022) · International Journal of Software Innovation · doi:10.4018/ijsi.297994
Locating Product Information from the Web using Simhash Fingerprints
Anh, P. N. T., & Van, N. K. (2014) · Research and Development on Information and Communication Technology · doi:10.32913/mic-ict-research.v3.n11.303
A Survey on Domain Name Categorization Using Artificial Neural Networks
(2015) · International Journal of Science and Research (IJSR) · doi:10.21275/v4i11.nov151566
Waheed, A., Qunaibi, S., Barradas, D., & Weinberg, Z. (2022) · Workshop on Privacy in the Electronic Society · doi:10.1145/3559613.3563206
Information Retrieval Based on DOM Trees
Aleixandre, J. A. (2023) · doi:10.4995/thesis/10251/196679
On Intra-page and Inter-page Semantic Analysis of Web Pages
Wang, J., Wang, J., Wu, G., & Tsuda, H. (2003) · Waseda University Repository (Waseda University)
Fu, Y., Zhou, Z., Huang, C., Wang, J., Zeng, B., Dongke, H., Wang, X., Hong, W., & Fan, J. (2026) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/3770854.3783937
NSTS: A Neuro-Symbolic System for Webpage Validity Timestamp Determination
Lin, Y.-C., Liu, Z., & Shang, Y. (2026) · ACM/IEEE Joint Conference on Digital Libraries · doi:10.1145/3805696.3846014
Large-Scale Content Extraction from Heterogeneous Sources
Langkilde, D. (2015)
Chinese Web Content Extraction Based on Naïve Bayes Model
Jinbo, W., Lianzhi, W., Wanlin, G., Jian, Y., & Yuntao, C. (2014) · IFIP advances in information and communication technology · doi:10.1007/978-3-642-54341-8_42
Information Summarization and Transcoding of Biomedical Resources for Mobile Handheld Devices.
Parmanto, B., Saptono, A., & Song, L. (2006) · Journal of Multimedia · doi:10.5555/2010505.2010509
Metadata
- Authors
- Bar-Yossef, Z., & Rajagopalan, S.
- Affiliations
- University of California, Berkeley (US)
- IBM Research - Almaden (US)
- Venue
- Proceedings of the 11th international conference on World Wide Web
- Publisher
- ACM
- Published
- 2002-05-07
- Pages
- 580-591
- OpenAlex
- W2040075907
- Cited by
- 271
- References
- 27
- Citations by year
- 2026: 2 · 2025: 1 · 2023: 4 · 2022: 4 · 2021: 1 · 2020: 3 · 2019: 4 · 2018: 6 · 2017: 2 · 2016: 14 · 2015: 20 · 2014: 17 · 2013: 18 · 2012: 15
- FWCI
- 15.05
- Type
- conference paper
- Language
- en
- Open access
- closed
- Locations
- International World Wide Web Conference (WWW) (publishedVersion)
- Topics
- Physical Sciences › Computer Science › Information Systems › Web Data Mining and Analysis
- Physical Sciences › Computer Science › Information Systems › Information Retrieval and Search Behavior
- Physical Sciences › Computer Science › Information Systems › Data Mining Algorithms and Applications
- Keywords
- template detection, web templates, search precision, web search
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
