The DOI matches its Crossref record; 35 of the 35 references it cites were found in a registry or an index.
Building efficient and effective metasearch engines
Abstract
Frequently a user's information needs are stored in the databases of multiple search engines. It is inconvenient and inefficient for an ordinary user to invoke multiple search engines and identify useful documents from the returned results. To support unified access to multiple search engines, a metasearch engine can be constructed. When a metasearch engine receives a query from a user, it invokes the underlying search engines to retrieve useful information for the user. Metasearch engines have other benefits as a search tool such as increasing the search coverage of the Web and improving the scalability of the search. In this article, we survey techniques that have been proposed to tackle several underlying challenges for building a good metasearch engine. Among the main challenges, the database selection problem is to identify search engines that are likely to return useful documents to a given query. The document selection problem is to determine what documents to retrieve from each identified search engine. The result merging problem is to combine the documents returned from multiple search engines. We will also point out some problems that need to be further researched.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
The anatomy of a large-scale hypertextual Web search engine
Brin, S., & Page, L. (1998) · Computer Networks and ISDN Systems · doi:10.1016/s0169-7552(98)00110-x · Cited by 16,004
Proceedings of the 24th international conference on Machine learning
(2007) · doi:10.1145/1273496 · Cited by 11,630
Introduction to Modern Information Retrieval
Salton, G., & McGill, M. J. (1983) · Virtual Defense Library (Ministerio de Defensa) · Cited by 11,392
Introduction to modern information retrieval
Dillon, M. (1983) · Information Processing & Management · doi:10.1016/0306-4573(83)90062-6 · Cited by 5,909
Introduction to WordNet: An On-line Lexical Database*
Miller, G. A., Beckwith, R., Fellbaum, C., Gross, D., & Miller, K. J. (1990) · International Journal of Lexicography · doi:10.1093/ijl/3.4.235 · Cited by 4,197
Automatic text processing: the transformation, analysis, and retrieval of information by computer
(1989) · Choice Reviews Online · doi:10.5860/choice.27-0351 · Cited by 3,188
GroupLens: applying collaborative filtering to Usenet news
Konstan, J. A., Miller, B. N., Maltz, D., Herlocker, J. L., Gordon, L. R., & Riedl, J. (1997) · Communications of the ACM · doi:10.1145/245108.245126 · Cited by 2,367
Authoritative sources in a hyperlinked environment
Kleinberg, J. M. (1998) · Symposium on Discrete Algorithms · doi:10.5555/314613.315045 · Cited by 1,814
Accessibility of information on the web
Lawrence, S., & Giles, C. L. (1999) · Nature · doi:10.1038/21987 · Cited by 1,349
Quary Expansion Using Local and Global Document Analysis
Xu, J., & Croft, W. B. (2017) · ACM SIGIR Forum · doi:10.1145/3130348.3130364 · Cited by 1,252
Pivoted Document Length Normalization
Singhal, A., Buckley, C., & Mitra, M. (2017) · ACM SIGIR Forum · doi:10.1145/3130348.3130365 · Cited by 848
Evaluation of an inference network-based retrieval model
Turtle, H. R., & Croft, W. B. (1991) · ACM Transactions on Information Systems · doi:10.1145/125187.125188 · Cited by 652
Real life information retrieval: a study of user queries on the Web
Jansen, B. J., Spink, A., Bateman, J., & Saracevic, T. (1998) · ACM SIGIR Forum · doi:10.1145/281250.281253 · Cited by 622
White Paper: The Deep Web: Surfacing Hidden Value
Bergman, M. K. (2001) · Journal of Electronic Publishing · doi:10.3998/3336451.0007.104 · Cited by 617
Searching Distributed Collections With Inference Networks
Callan, J. P., Lu, Z., & Croft, W. B. (2017) · ACM SIGIR Forum · doi:10.1145/3130348.3130363 · Cited by 608
Callan, J. P., Croft, W. B., & Harding, S. M. (1992) · Database and Expert Systems Applications · doi:10.1007/978-3-7091-7557-6_14 · Cited by 522
Mining the Web's link structure
Chakrabarti, S., Dom, B. E., Kumar, S. R., Raghavan, P., Rajagopalan, S., Tomkins, A., Gibson, D., & Kleinberg, J. (1999) · Computer · doi:10.1109/2.781636 · Cited by 501
Distributed Information Retrieval
Callan, J. (2005) · Kluwer Academic Publishers eBooks · doi:10.1007/0-306-47019-5_5 · Cited by 389
Okapi at TREC-7: Automatic Ad Hoc, Filtering, VLC and Interactive.
Robertson, S. E., Walker, S., & Hancock‐Beaulieu, M. (1998) · Text REtrieval Conference · Cited by 341
Fusion Via a Linear Combination of Scores
Vogt, C. C., & Cottrell, G. W. (1999) · Information Retrieval · doi:10.1023/a:1009980820262 · Cited by 311
Cluster-based language models for distributed retrieval
Xu, J., & Croft, W. B. (1999) · Proceedings of the 22nd annual international ACM SIGIR conference on Research and development in information retrieval · doi:10.1145/312624.312687 · Cited by 293
Automatic Combination of Multiple Ranked Retrieval Systems
Bartell, B. T., Cottrell, G. W., & Belew, R. K. (1994) · SIGIR ’94 · doi:10.1007/978-1-4471-2099-5_18 · Cited by 277
Combining Approaches to Information Retrieval
Croft, W. B. (2005) · The Information Retrieval Series · doi:10.1007/0-306-47019-5_1 · Cited by 203
Learning collection fusion strategies
Voorhees, E. M., Gupta, N. K., & Johnson-Laird, B. (1995) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/215206.215357 · Cited by 187
The effectiveness of GIOSS for the text database discovery problem
Gravano, L., García-Molina, H., & Tomasic, A. (1994) · Proceedings of the 1994 ACM SIGMOD international conference on Management of data · doi:10.1145/191839.191869 · Cited by 175
Server Ranking for Distributed Text Retrieval Systems on the Internet
Yuwono, B., & Lee, D. L. (1997) · Database Systems for Advanced Applications '97 · doi:10.1142/9789812819536_0005 · Cited by 166
Effective retrieval with distributed collections
Xu, J., & Callan, J. (1998) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/290941.290974 · Cited by 154
Ipeirotis, P. G., Gravano, L., & Sahami, M. (2001) · Proceedings - ACM-SIGMOD International Conference on Management of Data · doi:10.1145/375663.375671 · Cited by 152
A Machine Learning Architecture for Optimizing Web Search Engines
Boyan, J. A., & Freitag, D. (1999) · Cited by 130
Automatic Retrieval With Locality Information Using SMART.
Buckley, C., Salton, G., & Allan, J. (1992) · Text REtrieval Conference · Cited by 120
Methods for information server selection
Hawking, D., & Thistlewaite, P. B. (1999) · ACM Transactions on Information Systems · doi:10.1145/297117.297123 · Cited by 118
Lycos: design choices in an Internet search service
Mauldin, M. I. (1997) · IEEE Expert · doi:10.1109/64.577466 · Cited by 99
ALIWEB - Archie-like indexing in the WEB
de Koster, M. B. M. (1994) · Computer Networks and ISDN Systems · doi:10.1016/0169-7552(94)90131-7 · Cited by 93
A statistical method for estimating the usefulness of text databases
Liu, K.-L., Yu, C., Meng, W., et al. (2002) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2002.1047777 · Cited by 39
Self-citationAAAI-96 Workshop on Internet-Based Information Systems
Franz, A. (1997) · AI Magazine · Cited by 31
Cited by
A survey of Web clustering engines
Carpineto, C., Osiński, S., Romano, G., & Weiss, D. (2009) · ACM Computing Surveys · doi:10.1145/1541880.1541884 · Cited by 399
Information integration in the enterprise
Bernstein, P. A., & Haas, L. M. (2008) · Communications of the ACM · doi:10.1145/1378727.1378745 · Cited by 258
Enhancement of information seeking using an information needs radar model
Shih, C.-W., Chen, M.-Y., Chu, H.-C., & Chen, Y.-M. (2012) · Information Processing & Management · doi:10.1016/j.ipm.2011.08.010 · Cited by 12
Metadata
- Authors
- Meng, W., Yu, C., & Liu, K.-L.
- Venue
- ACM Computing Surveys
- Published
- 2002-03
- Volume
- 34
- Issue
- 1
- Pages
- 48-89
- ISSN
- 0360-0300 (ISSN-L)
- 1557-7341
- OpenAlex
- W2143079043
- Cited by
- 325
- References
- 35
- FWCI
- 71.81
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.