Integrating Data Warehouses with Web Data: A Survey
Open accessThe DOI matches its Crossref record; 25 of the 25 references it cites were found in a registry or an index.
Abstract
This paper surveys the most relevant research on combining Data Warehouse (DW) and Web data. It studies the XML technologies that are currently being used to integrate, store, query and retrieve web data, and their application to DWs. The paper reviews different DW distributed architectures and the use of XML languages as an integration tool in these systems. It also introduces the problem of dealing with semi-structured data in a DW. It studies Web data repositories, the design of multidimensional databases for XML data sources and the XML extensions of On-Line Analytical Processing techniques. The paper addresses the application of information retrieval technology in a DW to exploit text-rich documents collections. The authors hope that the paper will help to discover the main limitations and opportunities that offer the combination of the DW and the Web fields, as well as, to identify open research lines.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Baeza-Yates, R. A., & Ribeiro-Neto, B. A. (1999) · Cited by 12,609
The Grid 2: Blueprint for a New Computing Infrastructure
Foster, I. T., & Kesselman, C. (1998) · Cited by 7,637
A vector space model for automatic indexing
Salton, G., Wong, A., & Yang, C. S. (1975) · Communications of the ACM · doi:10.1145/361219.361220 · Cited by 7,521
A Extensible Markup Language XML
(2009) · Foundations of Semantic Web Technologies · doi:10.1201/9781420090512-18 · Cited by 4,824
OWL Web ontology language overview
McGuinness, D. L. (2004) · Medical Entomology and Zoology · Cited by 3,757
Rainardi, V. (2008) · Apress eBooks · doi:10.1007/978-1-4302-0528-9 · Cited by 2,631
A Language Modeling Approach to Information Retrieval
Ponte, J. M., & Croft, W. B. (2017) · ACM SIGIR Forum · doi:10.1145/3130348.3130368 · Cited by 2,503
Federated database systems for managing distributed, heterogeneous, and autonomous databases
Sheth, A. P., & Larson, J. A. (1990) · ACM Computing Surveys · doi:10.1145/96602.96604 · Cited by 2,476 · cited 1×
“The architecture for integrated DWs proposed in [8] and [9] adapts a traditional architecture of federated databases [44].”
BackgroundAn overview of data warehousing and OLAP technology
Chaudhuri, S., & Dayal, U. (1997) · ACM SIGMOD Record · doi:10.1145/248603.248616 · Cited by 2,424 · cited 1×
“The interested reader can find an overview of DWs, OLAP, and multidimensional databases in [38] and [39].”
BackgroundA language modeling approach to information retrieval
Ponte, J. M., & Croft, W. B. (1998) · Proceedings of the 21st annual international ACM SIGIR conference on Research and development in information retrieval · doi:10.1145/290941.291008 · Cited by 1,821
Relevance-Based Language Models
Lavrenko, V., & Croft, W. B. (2017) · ACM SIGIR Forum · doi:10.1145/3130348.3130376 · Cited by 1,422 · cited 3×
“probabilities, and they have been shown to outperform basel ine tf-idf models in many cases [53, 21].”
BackgroundMethodInfluentialRelevance based language models
Lavrenko, V., & Croft, W. B. (2001) · Proceedings of the 24th annual international ACM SIGIR conference on Research and development in information retrieval · doi:10.1145/383952.383972 · Cited by 1,037
Grosz, M. (2010) · Handbook of Transnational Economic Governance Regimes · doi:10.1163/ej.9789004163300.i-1081.558 · Cited by 868
Pivoted Document Length Normalization
Singhal, A., Buckley, C., & Mitra, M. (2017) · ACM SIGIR Forum · doi:10.1145/3130348.3130365 · Cited by 848
Eddies: continuously adaptive query processing
Avnur, R., & Hellerstein, J. M. (2000) · ACM SIGMOD Record · doi:10.1145/335191.335420 · Cited by 798
Research problems in data warehousing
Widom, J. (1995) · ACM International Conference on Information and Knowledge Management (CIKM) · doi:10.1145/221270.221319 · Cited by 698 · cited 1×
“The main problems addressed by the DW technology, which make a DW different from traditional transactional database systems are surveyed in [36].”
BackgroundPivoted document length normalization
Singhal, A., Buckley, C., & Mitra, M. (1996) · Proceedings of the 19th annual international ACM SIGIR conference on Research and development in information retrieval - SIGIR '96 · doi:10.1145/243199.243206 · Cited by 551
Detecting changes in XML documents
Cobena, G., Abiteboul, S., & Marian, A. (2003) · Proceedings 18th International Conference on Data Engineering · doi:10.1109/icde.2002.994696 · Cited by 422 · cited 2×
“This approach is based on a versioning mechanism [26] and an algorithm to compute the difference between two consecutive versions of an XML document [8].”
BackgroundMethodEddies: continuously adaptive query processing
Avnur, R., & Hellerstein, J. M. (2000) · Proceedings of the 2000 ACM SIGMOD international conference on Management of data · doi:10.1145/342009.335420 · Cited by 381 · cited 1×
“In [53], an adaptive query processing technique for federated database environments was proposed.”
MethodA foundation for capturing and querying complex multidimensional data
Pedersen, T. B., Jensen, C. S., & Dyreson, C. E. (2001) · Information Systems · doi:10.1016/s0306-4379(01)00023-0 · Cited by 264 · cited 1×
“The data model and algebra for the R-cubes is described in [49] and ext ends the multidimensional model of [45].”
MethodSelf-citationJagadish, H. V., Lakshmanan, L. V. S., Srivastava, D., & Thompson, K. (2002) · Lecture Notes in Computer Science · doi:10.1007/3-540-46093-4_9 · Cited by 235 · cited 1×
“The authors of [67] propose a distinct grouping operator for XML, where the grouping dimensions are specified by means of tree patterns [68].”
BackgroundChange-Centric Management of Versions in an XML Warehouse
Marian, A., Abiteboul, S., Cobéna, G., & Mignet, L. (2000) · Cited by 189
DocCube: Multi‐dimensional visualisation and exploration of large document sets
Mothe, J., Chrisment, C., Dousset, B., & Alaux, J. (2003) · Journal of the American Society for Information Science and Technology · doi:10.1002/asi.10257 · Cited by 79 · cited 1×
“The benefits of implementing an IR system on a multidimension al database are also discussed in [30] together with a novel user interface for exploring document collections.”
MethodA relevance-extended multi-dimensional model for a data warehouse contextualized with documents
Pérez, J. M., Berlanga, R., Aramburu, M. J., & Pedersen, T. B. (2005) · ACM International Workshop on Data Warehousing and OLAP (DOLAP) · doi:10.1145/1097002.1097007 · Cited by 40
Self-citationA Document Model Based on Relevance Modeling Techniques for Semi-structured Information Warehouses
Pérez, J. M., Berlanga, R., & Aramburu, M. J. (2004) · Lecture notes in computer science · doi:10.1007/978-3-540-30075-5_31 · Cited by 8
Self-citation
Cited by
Textual aggregation approaches in OLAP context: A survey
Bouakkaz, M., Ouinten, Y., Loudcher, S., & Strekalova, Y. (2017) · International Journal of Information Management · doi:10.1016/j.ijinfomgt.2017.06.005 · Cited by 16
“The R-Cube: Perez, Berlanga, and Aramburu (2007), Perez, Berlanga, and Aramburu (2008a), Perez, Berlanga, and Aramburu (2008b), Perez, Berlanga, and Aramburu (2008c); focus on the task of integrating structured and textual data in the same data warehouse.”
Background
Metadata
- Authors
- Perez, J. M., Berlanga, R., Aramburu, M. J., & Pedersen, T. B.
- Venue
- IEEE Transactions on Knowledge and Data Engineering
- Published
- 2008-07
- Volume
- 20
- Issue
- 7
- Pages
- 940-955
- ISSN
- 1041-4347 (ISSN-L)
- OpenAlex
- W2134578292
- Cited by
- 164
- References
- 25
- FWCI
- 15.36
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.