Trafilatura: A Web Scraping Library and Command-Line Tool for Text Discovery and Extraction
Open accessAbstract
Adrien Barbaresi. Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing: System Demonstrations. 2021.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Commonly used extractors often fail to preserve mathematics equations and code snippets embedded in webpages.
“However, we discover that commonly used extractors (Barbaresi, 2021) often fail to preserve mathematics equations and code snippets embedded in the webpage.”
From MiMo: Unlocking the Reasoning Potential of Language Model - From Pretraining to Posttraining (2025) · cites this paper as Barbaresi, 2021
Cites
The WaCky wide web: a collection of very large linguistically processed web-crawled corpora
Baroni, M., Bernardini, S., Ferraresi, A., & Zanchetta, E. (2009) · Language Resources and Evaluation · doi:10.1007/s10579-009-9081-4 · Cited by 1,220 · see citing works
RoadRunner: Towards Automatic Data Extraction from Large Web Sites
Valter Crescenzi, A., Mecca, G., & Paolo Merialdo, A. (2001) · Cited by 928 · see citing works
VIPS: a Vision-based Page Segmentation Algorithm
Cai, D., Yu, S., Wen, J.-R., & Ma, W. (2003) · Cited by 521 · see citing works
The Pile: An 800GB Dataset of Diverse Text for Language Modeling
Gao, L., Biderman, S., Black, S., Golding, L., Hoppe, T., Foster, C., Phang, J., He, H., Thite, A., Nabeshima, N., et al. (2021) · arXiv · doi:10.48550/arxiv.2101.00027 · Cited by 492 · see citing works
Boilerplate detection using shallow text features
Kohlschütter, C., Fankhauser, P., & Nejdl, W. (2010) · ACM International Conference on Web Search and Data Mining (WSDM) · doi:10.1145/1718487.1718542 · Cited by 478 · see citing works
Olston, C., & Najork, M. (2010) · Foundations and Trends® in Information Retrieval · doi:10.1561/1500000017 · Cited by 372 · see citing works
Eliminating noisy information in Web pages for data mining
Yi, L., Liu, B., & Li, X. (2003) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/956750.956785 · Cited by 347 · see citing works
Kilgarriff, A. (2007) · Computational Linguistics · doi:10.1162/coli.2007.33.1.147 · Cited by 288 · see citing works
Leave a Reply: An Analysis of Weblog Comments
Mishne, G., & Glance, N. (2006) · Cited by 287 · see citing works
Building Large Corpora from the Web Using a New Efficient Tool Chain
Schäfer, R., & Bildhauer, F. (2012) · Language Resources and Evaluation · Cited by 217 · see citing works
N-gram Counts and Language Models from the Common Crawl
Buck, C., Heafield, K., & van Ooyen, B. (2014) · Language Resources and Evaluation Conference (LREC) · doi:10.63317/3uyduafd26my · Cited by 154 · see citing works
BlogPulse: Automated trend discovery for weblogs
Glance, N., Hurst, M. F., & Tomokiyo, T. (2004) · Cited by 127 · see citing works
Weninger, T., Hsu, W. H., & Han, J. (2010) · International World Wide Web Conference (WWW) · doi:10.1145/1772690.1772789 · Cited by 116 · see citing works
Fact or Fiction: Content Classification for Digital Libraries.
Finn, A., Kushmerick, N., & Smyth, B. (2001) · Cited by 110 · see citing works
DOM based content extraction via text density
Sun, F., Song, D., & Liao, L. (2011) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/2009916.2009952 · Cited by 109 · see citing works
The PAISÀ Corpus of Italian Web Texts
Lyding, V., Stemle, E., Borghetti, C., Brunello, M., Castagnoli, S., Dell’Orletta⋄, F., Dittmann, H., Lenci, A., & Pirrelli, V. (2014) · Web as Corpus Workshop (WaC) · doi:10.3115/v1/w14-0406 · Cited by 106 · see citing works
Removing Boilerplate and Duplicate Content from Web Corpora
Pomikálek, J. (2011) · Cited by 99 · see citing works
The Crúbadán Project: Corpus building for under-resourced languages
Scannell, K. P. (2007) · Cited by 98 · see citing works
Extracting article text from the web with maximum subsequence segmentation
Pasternack, J., & Roth, D. (2009) · International World Wide Web Conference (WWW) · doi:10.1145/1526709.1526840 · Cited by 96 · see citing works
A fast and robust method for web page template detection and removal
Vieira, K., da Silva, A. S., Pinto, N., de Moura, E. S., Cavalcanti, J. M. B., & Freire, J. (2006) · ACM International Conference on Information and Knowledge Management (CIKM) · doi:10.1145/1183614.1183654 · Cited by 96 · see citing works
Cleaneval: a Competition for Cleaning Web Pages
Baroni, M., Chantree, F., Kilgarriff, A., & Sharoff, S. (2008) · Language Resources and Evaluation Conference (LREC) · doi:10.63317/4y7ib5ikczny · Cited by 91 · see citing works
Mining web informative structures and contents based on entropy analysis
Kao, H., Lin, S.-H., Ho, J.-M., & Chen⋆, M.-S. (2004) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2004.1264821 · Cited by 88 · see citing works
news-please: A Generic News Crawler and Extractor
Hamborg, F., Meuschke, N., Breitinger, C., & Gipp, B. (2017) · Zenodo (CERN European Organization for Nuclear Research) · doi:10.5281/zenodo.4120315 · Cited by 85 · see citing works
Automatically collecting, monitoring, and mining japanese weblogs
Nanno, T., Fujiki, T., Suzuki, Y., & Okumura, M. (2004) · International World Wide Web Conference (WWW) · doi:10.1145/1013367.1013455 · Cited by 58 · see citing works
Language ID in the Wild: Unexpected Challenges on the Path to a Thousand-Language Web Text Corpus
Caswell, I. R., Breiner, T., van Esch, D., & Bapna, A. (2020) · International Conference on Computational Linguistics · doi:10.18653/v1/2020.coling-main.579 · Cited by 47 · see citing works
Content extraction using diverse feature sets
Peters, M. E., & Lecocq, D. (2013) · International World Wide Web Conference (WWW) · doi:10.1145/2487788.2487828 · Cited by 42 · see citing works
Web2Text: Deep Structured Boilerplate Removal
Vogels, T., Ganea, O.-E., & Eickhoff, C. (2018) · Lecture notes in computer science · doi:10.1007/978-3-319-76941-7_13 · Cited by 40 · see citing works
Ziegler, C.-N., & Skubacz, M. (2007) · IEEE/WIC/ACM International Conference on Web Intelligence · doi:10.1109/wi.2007.137 · Cited by 38 · see citing works
Jacquemont, S., Jacquenet, F., & Sebban, M. (2007) · IEEE/WIC/ACM International Conference on Web Intelligence · doi:10.1109/wi.2007.38 · Cited by 36 · see citing works
C4Corpus: Multilingual Web-size Corpus with Free License
Habernal, I., Zayed, O., & Gurevych, I. (2016) · Proceedings of the Language Resources and Evaluation Conference · doi:10.63317/3iti4i8msr33 · Cited by 30 · see citing works
ECON: An Approach to Extract Content from Web News Page
Guo, Y., Tang, H., Song, L., Wang, Y., & Ding, G. (2010) · Asia-Pacific Web Conference · doi:10.1109/apweb.2010.11 · Cited by 28 · see citing works
Hybrid model of content extraction
Qureshi, P. A. R., & Memon, N. (2011) · Journal of Computer and System Sciences · doi:10.1016/j.jcss.2011.10.012 · Cited by 24 · see citing works
The Good, the Bad, and the Hazy: Design Decisions in Web Corpus Construction
Schäfer, R., Barbaresi, A., & Bildhauer, F. (2013) · HAL · Cited by 23 · see citing works
Self-citationSchäfer, R. (2016) · Language Resources and Evaluation Conference (LREC) · doi:10.63317/39e9qei8rcoe · Cited by 21 · see citing works
Accurate and efficient general-purpose boilerplate detection for crawled web corpora
Schäfer, R. (2016) · Language Resources and Evaluation · doi:10.1007/s10579-016-9359-2 · Cited by 21 · see citing works
News article extraction with template-independent wrapper
Wang, J., He, X., Wang, C., Pei, J., Bu, J., Chen, C., Guan, Z., & Lü, G. (2009) · International World Wide Web Conference (WWW) · doi:10.1145/1526709.1526868 · Cited by 20 · see citing works
Swiss-AL : a multilingual Swiss web corpus for applied linguistics
Krasselt, J., Dreesen, P., Fluor, M., Mahlow, C., Rothenhäusler, K., & Runte, M. (2020) · Zürcher Hochschule für Angewandte Wissenschaften digital collection (Zurich University of Applied Sciences) · doi:10.21256/zhaw-20044 · Cited by 19 · see citing works
Efficient construction of metadata-enhanced web corpora
Barbaresi, A. (2016) · Web as Corpus Workshop (WaC) · doi:10.18653/v1/w16-2602 · Cited by 17 · see citing works
Self-citationFor a fistful of blogs: Discovery and comparative benchmarking of republishable German content
Barbaresi, A., & Würzner, K.-M. (2014) · HilDok – Institutional Repository (Universität Hildesheim) · Cited by 17 · see citing works
Self-citationHTML web content extraction using paragraph tags
Carey, H. J., & Manic, M. (2016) · IEEE International Symposium on Industrial Electronics (ISIE) · doi:10.1109/isie.2016.7745047 · Cited by 16 · see citing works
Data Collection and IPR in Multilingual Parallel Corpora. Dutch Parallel Corpus
Clercq, O. D., & Perez, M. M. (2010) · Language Resources and Evaluation Conference (LREC) · doi:10.63317/54p45ohhda9x · Cited by 15 · see citing works
Ad hoc and general-purpose corpus construction from web sources
Barbaresi, A. (2015) · doi:10.70675/4b5812f9zf5bbz432eza1b7zc6103ab875d5 · Cited by 13 · see citing works
Self-citationSpeedReader: Reader Mode Made Fast and Private
Ghasemisharif, M., Snyder, P., Auçinas, A., & Livshits, B. (2019) · International World Wide Web Conference (WWW) · doi:10.1145/3308558.3313596 · Cited by 12 · see citing works
What Web Template Extractor Should I Use? A Benchmarking and Comparison for Five Template Extractors
Alarte, J., Silva, J., & Tamarit, S. (2019) · ACM Transactions on the Web · doi:10.1145/3316810 · Cited by 12 · see citing works
htmldate: A Python package to extract publication dates from web pages
Barbaresi, A. (2020) · The Journal of Open Source Software · doi:10.21105/joss.02439 · Cited by 12 · see citing works
Self-citationTwo Years of Aranea: Increasing Counts and Tuning the Pipeline
Бенко, В. (2016) · Language Resources and Evaluation Conference (LREC) · doi:10.63317/4d5zd657gudq · Cited by 11 · see citing works
Automatically collecting, monitoring, and mining japanese weblogs
Nanno, T., Fujiki, T., Suzuki, Y., & Okumura, M. (2004) · International World Wide Web Conference (WWW) · doi:10.1145/1010432.1010520 · Cited by 9 · see citing works
A New Proposal for Evaluating Web Page Cleaning Tools
Lejeune, G., & Zhu, L. (2018) · Computación y Sistemas · doi:10.13053/cys-22-4-3062 · Cited by 8 · see citing works
Out-of-the-Box and Into the Ditch? Multilingual Evaluation of Generic Text Extraction Tools
Barbaresi, A., & Lejeune, G. (2020) · HAL · Cited by 6 · see citing works
Self-citationFrom Web Crawl to Clean Register-Annotated Corpora
Laippala, V., Rönnqvist, S., Hellström, S., Luotolahti, J., Repo, L., Salmela, A., Skantsi, V., & Pyysalo, S. (2020) · Cited by 5 · see citing works
First Results of the TurkLang-7 Project: Creating Russian-Turkic Parallel Corpora and MT Systems.
Khusainov, A., Шевкетович, С. Д., Абрекович, Г. Р., Mınsafına, A., Kubedinova, L., & Abdurakhmonova, N. Z. (2020) · Cited by 4 · see citing works
Lejeune, G., & Barbaresi, A. (2020) · Cited by 1 · see citing works
Self-citation
Flagged first, then by citations
1 of the 53 references couldn’t be matched to a known paper.
Cited by
Sorted by citations
Jakub Piskorski, B., Stefanovitch, N., Martino, G. D. S., & Nakov, P. (2023) · International Workshop on Semantic Evaluation (SemEval) · doi:10.18653/v1/2023.semeval-1.317 · Cited by 87 · see citing works
Common vulnerability scoring system prediction based on open source intelligence information sources
Kühn, P., Relke, D. N., & Reuter, C. (2023) · Computers & Security · doi:10.1016/j.cose.2023.103286 · Cited by 64 · see citing works
NLP-based techniques for Cyber Threat Intelligence
Arazzi, M., Arikkat, D. R., Nicolazzo, S., Nocera, A., A., R. R. K., Vinod, P., & Conti, M. (2025) · Computer Science Review · doi:10.1016/j.cosrev.2025.100765 · Cited by 64 · see citing works
Sutter, T. S., Bozkır, A. S., Gehring, B., & Berlich, P. (2022) · IEEE Access · doi:10.1109/access.2022.3207272 · Cited by 43 · see citing works
SemEval-2022 Task 8: Multilingual news article similarity
Chen, X., Zeynali, A., Camargo, C. Q., Flöck, F., Gaffney, D., Grabowicz, P. A., Hale, S. A., Jurgens, D., & Samory, M. (2022) · International Workshop on Semantic Evaluation (SemEval) · doi:10.18653/v1/2022.semeval-1.155 · Cited by 32 · see citing works
Far, S. M. T., & Feyzi, F. (2025) · International Journal of Information Security · doi:10.1007/s10207-025-00992-7 · Cited by 34 · see citing works
A Big Data architecture for early identification and categorization of dark web sites
Pastor-Galindo, J., Sandlin, H.-Â., Mármol, F. G., Bovet, G., & Pérez, G. M. (2024) · Future Generation Computer Systems · doi:10.1016/j.future.2024.03.025 · Cited by 30 · see citing works
Rosie, a Health Education Question-and-Answer Chatbot for New Mothers: Randomized Pilot Study
Nguyen, Q. C., Aparicio, E. M., Jasczyński, M., Doig, A. C., Yue, X., Mane, H., Srikanth, N. P., Gutierrez, F. X. M., Delcid, N., He, X., et al. (2023) · JMIR Formative Research · doi:10.2196/51361 · Cited by 24 · see citing works
Razuvayevskaya, O., Wu, B., Leite, J. A., Heppell, F., Srba, I., Scarton, C., Bontcheva, K., & Song, X. (2024) · PLoS ONE · doi:10.1371/journal.pone.0301738 · Cited by 28 · see citing works
SECURE: Benchmarking Large Language Models for Cybersecurity
Bhusal, D., Alam, T., Nguyen, L., Mahara, A., Lightcap, Z., Frazier, R., Fieblinger, R., Torales, G. L., Blakely, B., & Rastogi, N. (2024) · Annual Computer Security Applications Conference · doi:10.1109/acsac63791.2024.00019 · Cited by 32 · see citing works
Gopalakrishnan, S., Chen, V. Z., Wenwen Dou, A., Hahn-Powell, G., Nedunuri, S., & Zadrozny, W. (2023) · Information · doi:10.3390/info14070367 · Cited by 18 · see citing works
Jakub Piskorski, B., Stefanovitch, N., Nikolaidis, N., Martino, G. D. S., & Nakov, P. (2023) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2023.acl-long.169 · Cited by 17 · see citing works
Decentralized News-Retrieval Architecture Using Blockchain Technology
Alexandrescu, A., & Buţincu, C. N. (2023) · Mathematics · doi:10.3390/math11214542 · Cited by 16 · see citing works
Hunter, S. B., Mathews, F., & Weeds, J. (2023) · Ecological Informatics · doi:10.1016/j.ecoinf.2023.102076 · Cited by 15 · see citing works
Beyond time delays: how web scraping distorts measures of online news consumption
Ulloa, R., Mangold, F., Schmidt, F., Gilsbach, J. M., & Stier, S. (2025) · Communication Methods and Measures · doi:10.1080/19312458.2025.2482538 · Cited by 16 · see citing works
An Empirical Comparison of Web Content Extraction Algorithms
Bevendorff, J., Gupta, S., Kiesel, J., & Stein, B. (2023) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/3539618.3591920 · Cited by 12 · see citing works
FinGPT: Large Generative Models for a Small Language
Luukkonen, R., Komulainen, V., Luoma, J., Eskelinen, A., Kanerva, J., Kupari, H.-M., Ginter, F., Laippala, V., Muennighoff, N., Piktus, A., et al. (2023) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2023.emnlp-main.164 · Cited by 21 · see citing works
Extracting the Main Content of Web Pages Using the First Impression Area
Jung, G., Han, S., Kim, H., Kim, K. K., & Cha, J. (2022) · IEEE Access · doi:10.1109/access.2022.3229080 · Cited by 8 · see citing works
CimpleKG: A Continuously Updated Knowledge Graph on Misinformation, Factors and Fact-Checks
Burel, G., Mensio, M., Peskine, Y., Raphaël Troncy, A., Papotti, P., & Alani, H. (2024) · Lecture notes in computer science · doi:10.1007/978-3-031-77847-6_6 · Cited by 7 · see citing works
Garbage in, garbage out: An analysis of HTML text extractors and their impact on NLP performance
Dumitru, V. C., Iorga, D., Ruşeţi, Ş., & Dascălu, M. (2023) · International Conference on Control Systems and Computer Science · doi:10.1109/cscs59211.2023.00070 · Cited by 7 · see citing works
Closed Domain Question-Answering Techniques in an Institutional Chatbot
Saad, M., & Qawaqneh, Z. (2024) · International Conference on Electrical, Computer, Communications and Mechatronics Engineering (ICECCME) · doi:10.1109/iceccme62383.2024.10796881 · Cited by 7 · see citing works
Piasta, K., & Kotas, R. (2025) · Applied Sciences · doi:10.3390/app15179559 · Cited by 5 · see citing works
Cesare, A.-M. D. (2024) · Lingue e culture dei media · doi:10.54103/2532-1803/22388 · Cited by 6 · see citing works
Hunter, S. B., Oedin, M., Weeds, J., & Mathews, F. (2024) · Conservation Biology · doi:10.1111/cobi.14242 · Cited by 5 · see citing works
Cesare, A.-M. D. (2024) · Lingue e culture dei media · doi:10.54103/2532-1803/24869 · Cited by 5 · see citing works
Platform regulation and “overblocking” – The NetzDG discourse in Germany
Pohlmann, J., Barbaresi, A., & Leinen, P. (2023) · Communications · doi:10.1515/commun-2022-0098 · Cited by 5 · see citing works
Self-citationA geolocated dataset of German news articles
Kriesch, L., & Losacker, S. (2025) · Scientific Data · doi:10.1038/s41597-025-05422-w · Cited by 5 · see citing works
How partisan news outlets frame vested interests in climate change
Adame, B. J., Corman, S. R., Endres, C., Farmer, R. D., & Awonuga, T. (2025) · Journal of Environmental Management · doi:10.1016/j.jenvman.2025.124159 · Cited by 5 · see citing works
Unraveling the Impact of Visual Complexity on Search as Learning
Gritz, W., Hoppe, A., & Ewerth, R. (2025) · Lecture notes in computer science · doi:10.1007/978-3-031-88714-7_2 · Cited by 4 · see citing works
Giovanni, M. D., Tasca, T., & Brambilla, M. (2022) · International Workshop on Semantic Evaluation (SemEval) · doi:10.18653/v1/2022.semeval-1.174 · Cited by 4 · see citing works
Yurtalan, G., & Arslan, S. (2025) · IEEE Access · doi:10.1109/access.2025.3562718 · Cited by 4 · see citing works
Generating a European Portuguese BERT Based Model Using Content from Arquivo.pt Archive
Miquelina, N., Quaresma, P., & Nogueira, V. (2022) · Lecture notes in computer science · doi:10.1007/978-3-031-21753-1_28 · Cited by 4 · see citing works
Treuillier, C., Castagnos, S., Dufraisse, E., Özgöbek, Ö., & Brun, A. (2026) · ACM Transactions on Recommender Systems · doi:10.1145/3790097 · Cited by 3 · see citing works
HIPPP: Health Information Portal for Patients and Public
Brandon, C., Doherty, A. J., Kelly, D., Leddin, D. J., & Margaria, T. (2023) · Applied Sciences · doi:10.3390/app13169453 · Cited by 3 · see citing works
Hartmann, S. (2024) · Studies in corpus linguistics · doi:10.1075/scl.118.06har · Cited by 4 · see citing works
Data-Prep-Kit: getting your data ready for LLM application development
Wood, D., Lublinsky, B., Roytman, A., Singh, S., Adam, C., Adebayo, A. A., An, S., Chang, Y. C., Dang, X. H., Desai, N. V., et al. (2024) · IEEE International Conference on Big Data (BigData) · doi:10.1109/bigdata62323.2024.10825085 · Cited by 4 · see citing works
A WebExtension framework for experimentation and evaluation of webpage segmentation methods
Jung, G., & Cha, J. (2023) · SoftwareX · doi:10.1016/j.softx.2023.101501 · Cited by 3 · see citing works
BrowseComp-Plus: A Fair and Disentangled Evaluation Benchmark for Deep Search Agents
Chen, Z., Ma, X., Zhuang, S., Nie, P., Zou, K., Sharifymoghaddam, S., Liu, A., Green, J., Patel, K., Meng, R., et al. (2026) · Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.18653/v1/2026.acl-long.1023 · Cited by 2 · see citing works
“For the remaining 1,142 pairs, we scrape the URLs cited as evidence using Selenium, 1 and parse them with Trafilatura (Barbaresi, 2021).”
Crummett, L. T., & Aslam, M. H. (2023) · Frontiers in Public Health · doi:10.3389/fpubh.2023.1159024 · Cited by 2 · see citing works
Data Void Exploits: Tracking & Mitigation Strategies
Mannino, M., Garcia, J. E., Hazim, R., Abouzied, A., & Papotti, P. (2024) · ACM International Conference on Information and Knowledge Management (CIKM) · doi:10.1145/3627673.3679781 · Cited by 2 · see citing works
Almeida, T. S., Nogueira, R. F., & Pedrini, H. (2025) · Journal of the Brazilian Computer Society · doi:10.5753/jbcs.2025.5788 · Cited by 4 · see citing works
Findings of the WMT 2023 Shared Task on Parallel Data Curation
Sloto, S., Thompson, B. J., Khayrallah, H., Domhan, T., Gowda, T., & Koehn, P. (2023) · Conference on Machine Translation (WMT) · doi:10.18653/v1/2023.wmt-1.5 · Cited by 2 · see citing works
MiMo: Unlocking the Reasoning Potential of Language Model - From Pretraining to Posttraining
Xiaomi, L.-C., :, Xia, B., Shen, B., Cici, Zhu, D., Zhang, D., Wang, G., Zhang, H., Liu, H., et al. (2025) · arXiv · doi:10.48550/arxiv.2505.07608 · Cited by 1 · see citing works
“However, we discover that commonly used extractors (Barbaresi, 2021) often fail to preserve mathematics equations and code snippets embedded in the webpage.”
Korpora in der germanistischen Sprachwissenschaft
Deppermann, A., Fandrych, C., Kupietz, M., & Schmidt, T. (2023) · De Gruyter eBooks · doi:10.1515/9783111085708 · Cited by 1 · see citing works
Automatic Generation of Web Censorship Probe Lists
Tang, J., Alvarez, L., Brar, A., Hoang, N. P., & Christin, N. (2024) · Proceedings on Privacy Enhancing Technologies · doi:10.56553/popets-2024-0106 · Cited by 1 · see citing works
Plitt, R. T. (2024) · Cultural linguistics · doi:10.1007/978-981-97-6192-0_15 · Cited by 1 · see citing works
Multilingual Evaluation of Main Content Extractors for Web Pages
Bournonville, A., Dias, G. H., Largillier, T., Marchand, E., Maurel, F., Pitel, G., & Rioult, F. (2025) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/3726302.3730234 · Cited by 1 · see citing works
Multimodal Large Language Model for Out-of-Context Problems in Fake News Detection
Hai, D. L. N., Vo, K. N. H., Le, M. N., & Thanh, T. Q. (2025) · International Conference on Knowledge and Systems Engineering/Proceedings · doi:10.1109/kse68178.2025.11309521 · Cited by 1 · see citing works
Cebeci, G., & Di̇ri̇, B. (2026) · IEEE Access · doi:10.1109/access.2026.3657977 · Cited by 1 · see citing works
Data Preparation for Large Language Models
Liang, H., Wong, Z. H., Liu, R., Wang, Y.-H., Qiang, M.-Y., Zhao, Z.-Y., Shen, C.-Y., He, C.-H., Zhang, W.-T., & Cui, B. (2026) · Journal of Computer Science and Technology · doi:10.1007/s11390-026-5948-8 · Cited by 2 · see citing works
OwlerLite: Scope- and Freshness-Aware Web Retrieval for LLM Assistants
Zerhoudi, S., Dinzinger, M., Granitzer, M., & Mitrović, J. (2026) · International World Wide Web Conference (WWW) · doi:10.1145/3774905.3793140 · Cited by 2 · see citing works
Evaluating ESG Impacts in African Cities through Topic-Level Sentiment Analysis
Naira, A. M., & Benelallam, I. (2023) · International Conference on Wireless Networks and Mobile Communications (WINCOM) · doi:10.1109/wincom59760.2023.10322894 · Cited by 1 · see citing works
AcawebAgent: A Large Language Model-Powered Assistant for Early Academic Research
Yang, Y., & Wang, X. (2024) · International Conference on Computer Engineering and Application (ICCEA) · doi:10.1109/iccea62105.2024.10603661 · Cited by 1 · see citing works
Linguistic variation beyond the Indo-European web
Erten-Johansson, S., Skantsi, V., Pyysalo, S., & Laippala, V. (2024) · Register Studies · doi:10.1075/rs.24002.ert · Cited by 1 · see citing works
SealQA: Raising the Bar for Reasoning in Search-Augmented Language Models
Pham, T., Nguyen, N., Zunjare, P., Chen, W., Tseng, Y.-M., & Vu, T. (2025) · arXiv · doi:10.48550/arxiv.2506.01062
Waheed, A., Qunaibi, S., Barradas, D., & Weinberg, Z. (2022) · Workshop on Privacy in the Electronic Society · doi:10.1145/3559613.3563206
Nolda, A., Barbaresi, A., & Geyken, A. (2023) · De Gruyter eBooks · doi:10.1515/9783111085708-003
Self-citationA Dataset for Information Extraction from News Web Pages
Varlamov, M., Galanin, D., Bedrin, P., Duda, S., Lazarev, V., & Yatskov, A. (2022) · Ivannikov ISPRAS Open Conference (ISPRAS) · doi:10.1109/ispras57371.2022.10076872
New Visual Features for HTML Main Content Extraction
Jung, G., & Cha, J. (2023) · Journal of Digital Contents Society · doi:10.9728/dcs.2023.24.4.691
Razuvayevskaya, O., Wu, B., Leite, J. A., Heppell, F., Srba, I., Scarton, C., Bontcheva, K., & Song, X. (2023) · White Rose Research Online (University of Leeds, The University of Sheffield, University of York) · doi:10.48550/arxiv.2308.07282
Hirschfeld, B. M. (2023) · Verlag Barbara Budrich eBooks · doi:10.3224/84742677
Speakit: A Text-to-Speech Based Podcast Generator for Italian TextsPreprint
Garifo, G., Sasso, S., Vetrò, A., & Martin, J. C. D. (2024) · SSRN Electronic Journal · doi:10.2139/ssrn.4715194
Pohlmann, J., Barbaresi, A., & Leinen, P. (2024) · Mediensymposium. · doi:10.1007/978-3-658-42478-7_12
Self-citationSpeakit: A Text-to-Speech Based Podcast Generator for Italian TextsPreprint
Garifo, G., Sasso, S., Vetrò, A., & Martin, J. C. D. (2024) · SSRN Electronic Journal · doi:10.2139/ssrn.4821549
Multimodality Web Page Analysis for Fake News Detection
Madbouly, M. E., Ahmed, Y. A., & Salem, M. A. ‐. (2023) · International Conference on Smart Cities 4.0 · doi:10.1109/smartcities4.056956.2023.10526163
Parallel and Distributed Architecture for Multilingual Open Source Intelligence Systems
Karamanlıoğlu, A., Yurtalan, G., & Karataş, Y. B. (2024) · Lecture notes in computer science · doi:10.1007/978-3-031-66326-0_27
Bella Turca: A Large-Scale Dataset of Diverse Text Sources for Turkish Language Modeling
Altinok, D. (2024) · Lecture notes in computer science · doi:10.1007/978-3-031-70563-2_16
Review of Di Cristofaro (2023): Corpus approaches to language in social media
Sevastianova, A. (2024) · International Journal of Corpus Linguistics · doi:10.1075/ijcl.00060.sev
Extraire des données textuelles pour l’analyse du discours : le Détricoteur
Dalodiere, R., & Jordan, M. (2025) · Corpus · doi:10.4000/1364y
Aroeira: A Curated Corpus for the Portuguese Language with a Large Number of Tokens
Lira, T., Cação, F. N., de Souza, C. A., Valentini, J. P. H., Bollis, E., Oliveira, O., Almeida, R., Magalhães, M. L. D., Poloni, K. M., Oliveira, A., et al. (2025) · Lecture notes in computer science · doi:10.1007/978-3-031-79029-4_13
GERMA: a comprehensive corpus of untrustworthy German news
Carrella, F., & Miani, A. (2025) · Linguistics Vanguard · doi:10.1515/lingvan-2024-0064
Parlar, K. (2025) · Springer eBooks · doi:10.1007/978-3-662-70351-9_3
Automatic Webpage Content Extraction Based on Structural and Semantic Features
Ekramifard, A., Mashayekhi, H., & Rahimi, M. (2025) · International Conference on Web Research (ICWR) · doi:10.1109/icwr65219.2025.11006249
Claim Verification Leveraging In-context Learning and Retrieval Augmented Generation
Fenza, G., Furno, D., Gallo, M., Loia, V., & Trotta, P. P. (2025) · Lecture notes in social networks · doi:10.1007/978-3-031-85386-9_2
61“Also ehrlich” – From adjectival use to interactive discourse marker
Lemnitzer, L., & Hamdi, A. (2025) · De Gruyter eBooks · doi:10.1515/9783111434018-003
Wang, B., Zhang, Z., Chen, L., & Li, H. (2025) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn64981.2025.11228563
FactCellar: An Evidence-based Dataset for Automated Fact-Checking
Dharmavaram, A., Rashid, F. B., & Hakak, S. (2025) · Conference on Privacy, Security and Trust · doi:10.1109/pst65910.2025.11268820
Brown, R., & Thompson, D. (2025) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.64898/2025.12.29.696866
Research Trends in Web Crawling, Machine Learning, and SDGs in the Context of the Impact
Putra, R. I., Soeprobowati, T. R., & Nugraheni, D. M. K. (2025) · International Conference on Information Technology, Information Systems and Electrical Engineering (ICITISEE) · doi:10.1109/icitisee68184.2025.11355033
Priorities in digital access: a comparative study of authentication in academic library consortia
Shang, R., & Huang, B. (2026) · International Journal on Digital Libraries · doi:10.1007/s00799-026-00442-2
Automatic News Analysis for Polarization Understanding
Dufraisse, E. (2024) · theses.fr (ABES) · doi:10.70675/29624c9cz4601z4ac8z85f6z0908edba32a3
Yang, H., Yang, L., Zhou, L., Ma, L., Wang, X., Jia, J., & Sang, A. (2026) · International World Wide Web Conference (WWW) · doi:10.1145/3774904.3792341
Using Knowledge Graph To Detect And Explain Misinformation Spread On The Web
Peskine, Y. (2025) · theses.fr (ABES) · doi:10.70675/efad38dcza422z419dz865ez1bc0e700ce2c
Unsupervised Boilerplate Removal Using N-gram Sequence Analysis
Vanapalli, K., Khan, S., & Shafiq, M. O. (2026) · IEEE International Conference on Semantic Computing (ICSC) · doi:10.1109/icsc67292.2026.00042
GARB: A Gaze-Aware Reading Aid for the Browser
Nyamekye, C., & Tregubov, T. (2026) · ACM Symposium on Eye Tracking Research and Applications (ETRA) · doi:10.1145/3797246.3806219
Giblett, M. J., Babikian, Y., Jhala, D. J., & Medland, S. E. (2026) · medRxiv · doi:10.64898/2026.05.27.26354169
СРАВНИТЕЛЬНАЯ ОЦЕНКА МЕТОДОВ АВТОМАТИЧЕСКОГО ИЗВЛЕЧЕНИЯ ОСНОВНОГО ТЕКСТОВОГО КОНТЕНТА ВЕБ-СТРАНИЦ
Косюра, Н. А., Eliseeva, V. D., & Шкарупа, А. Э. (2026) · CASPIAN JOURNAL Control and High Technologies · doi:10.54398/2074-1707.2026.73.1.004
Persuasion Technique Detection in Bulgarian
Ribin, N., Dimitrov, D., Koychev, I. K., & Nakov, P. (2026) · Proceedings of the international neural networks society · doi:10.1007/978-3-032-30153-6_2
Li, Z., Li, Z., Chi, C., Liu, J., & Zhan, P. (2026) · Discover Applied Sciences · doi:10.1007/s42452-026-09242-4
Fu, Y., Zhou, Z., Huang, C., Wang, J., Zeng, B., Dongke, H., Wang, X., Hong, W., & Fan, J. (2026) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/3770854.3783937
When numbers mislead: Data interpretation in fact-checked misinformation
Erokhin, D. V., & Komendantova, N. (2026) · Statistical Journal of the IAOS · doi:10.1177/18747655261480959
Mapping the Margins: Building a Cross-National Observatory for Alternative News Media Research
Henriksen, F. M. (2026) · Springer eBooks · doi:10.1007/978-3-032-22489-7_20
NSTS: A Neuro-Symbolic System for Webpage Validity Timestamp Determination
Lin, Y.-C., Liu, Z., & Shang, Y. (2026) · ACM/IEEE Joint Conference on Digital Libraries · doi:10.1145/3805696.3846014
- Authors
- Barbaresi, A.
- Affiliations
- Berlin-Brandenburg Academy of Sciences and Humanities (DE)
- Corresponding author
- Barbaresi, Adrien
- ORCID
- Barbaresi, Adrien
- Venue
- Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing: System Demonstrations
- Published
- 2021
- Pages
- 122-131
- OpenAlex
- W3177057043
- Cited by
- 90
- References
- 53
- Citations by year
- 2026: 16 · 2025: 23 · 2024: 22 · 2023: 22 · 2022: 7
- FWCI
- 10.58
- Type
- conference paper
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- cc-by
- Locations
- Annual Meeting of the Association for Computational Linguistics: System Demonstrations (ACL Demo) (publishedVersion, cc-by)
- Topics
- Physical Sciences › Computer Science › Information Systems › Web Data Mining and Analysis
- Social Sciences › General Social Sciences › Computational and Text Analysis Methods
- Physical Sciences › Computer Science › Artificial Intelligence › Natural Language Processing Techniques
- Keywords
- web scraping, text extraction, command-line tool, information retrieval
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review