Hui Fang
ABSTRACT
A common limitation of many retrieval models, including the recently proposed axiomatic approaches, is that retrieval scores are solely based on exact (i.e., syntactic) matching of terms in the queries and documents, without allowing distinct but semantically related terms to match each other and contribute to the retrieval score. In this paper, we show that semantic term matching can be naturally incorporated into the axiomatic retrieval model through defining the primitive weighting function based on a semantic similarity function of terms. We define several desirable retrieval constraints for semantic term matching and use such constraints to extend the axiomatic model to directly support semantic term matching based on the mutual information of terms computed on some document set. We show that such extension can be efficiently implemented as query expansion. Experiment results on several representative data sets show that, with mutual information computed over the documents in either the target collection for retrieval or an external collection such as the Web, our semantic expansion consistently and substantially improves retrieval accuracy over the baseline axiomatic retrieval model. As a pseudo feedback method, our method also outperforms a state-of-the-art language modeling feedback method.
- M. Adriani. Using statistical term similarity for sense disambiguation in cross-language information retrieval. Information Retrieval 2:69--80,2000. Google Scholar
Digital Library
- J. Bai, D. Song, P. Bruza, J.-Y. Nie, and G. Cao. Query expansion using term relationships in language models for information retrieval. In Fourteenth International Conference on Information and Knowledge Management (CIKM 2005), 2005. Google ScholarDigital Library
- A. Berger and J. Lafferty. Information retrieval as statistical translation. In Proceedings of the 1999 ACM SIGIR Conference on Research and Development in Information Retrieval pages 222--229,1999. Google ScholarDigital Library
- G. Cao, J.-Y. Nie, and J. Bai. Integrating word relationships into language models. In Proceedings of the 2005 ACM SIGIR Conference on Research and Development in Information Retrieval 2005. Google ScholarDigital Library
- H. Fang, T. Tao, and C. Zhai. A formal study of information retrieval heuristics. In Proceedings of the 2004 ACM SIGIR Conference on Research and Development in Information Retrieval 2004. Google ScholarDigital Library
- H. Fang and C. Zhai. An exploration of axiomatic approaches to information retrieval. In Proceedings of the 2005 ACM SIGIR Conference on Research and Development in Information Retrieval 2005. Google ScholarDigital Library
- J. Gao, J.-Y. Nie, H. He, W. Chen, and M. Zhou. Resolving query translation ambiguity using decaying co-occurrence model and syntactic dependence relations. In Proceedings of the 2002 ACM SIGIR Conference on Research and Development in Information Retrieval 2002. Google ScholarDigital Library
- J. Gao, J.-Y. Nie, E. Xun, J. Zhang, M. Zhou, and C. Huang. Improving query translation for cross-language information retrieval using statistical models. In Proceedings of the 2001 ACM SIGIR Conference on Research and Development in Information Retrieval 2001. Google ScholarDigital Library
- M.-G. Jng, S. H. Myeng, and S. Y. Park. Usingmutul information to resolve query translation ambiguities nd query term weighting. In Proceedings of the 37th annual meeting of the association for computational linguistics 1999. Google ScholarDigital Library
- Y. Jing and W. B. Croft. An association thesaurus for information retreival. In Proceedings of RIAO 1994.Google Scholar
- M. Lesk. Word-word associations in document retrieval systems. American Documentation 20:27--38, 1969.Google ScholarCross Ref
- S. Liu, F. Liu, C. Yu, and W. Meng. An effective approach to document retrieval via utilizing wordnet and recognizing phrases. In Proceedings of the 2004 ACM SIGIR Conference on Research and Development in Information Retrieval 2004. Google ScholarDigital Library
- A. Maeda, F. Sadat, M. Yoshikawa, and S. Uemura. Query term disambigu tion for web cross-language information retrieval using search engine. In Proceedings of the fifth international workshop on information retrieval with Asian languages 2000. Google ScholarDigital Library
- R. Mandala, T. Tokunaga, H. Tanaka, A. Okumura, and K. Satoh. Ad hoc retrieval experiments using wordnet and automatically constructed thesauri.In Proceedings of the Seventh Text REtrieval Conference (TREC-7), pages 475--481, 1998.Google Scholar
- M. E. Maron and J. L. Kuhns. On relevance, probabilistic indexing and information retrieval. Journal of the ACM 7, 1960. Google ScholarDigital Library
- M. Mitra, A. Singhal, and C. Buckley. Improving automatic query expansion. In Proceedings of the 1998 ACM SIGIR Conference on Research and Development in Information Retrieval 1998. Google ScholarDigital Library
- D. Moldovan and A. Novischi. Lexical chains for question answering. In Proceedings of the 19th International Conference on Computational linguistics 2002. Google ScholarDigital Library
- H. J. Peat and P. Willett. The limitations of term co-occurence data for query expansion in document retrieval systems. Journal of the american society for information science 42(5): 378--383, 1991.Google Scholar
- J. Ponte nd W. B. Croft. A language modeling pproach to information retrieval. In Proceedings of the ACM SIGIR'98 pages 275--281, 1998. Google ScholarDigital Library
- Y. Qiu and H. Frei. Concept based query expansion. In Proceedings of the 1993 ACM SIGIR Conference on Research and Development in Information Retrieval 1993. Google ScholarDigital Library
- J. Rocchio. Relevance feedback in information retrieval. In The SMART Retrieval System: Experiments in Automatic Document Processing pages 313--323. Prentice-Hall Inc., 1971.Google ScholarDigital Library
- G. Salton and M. McGill. Introduction to Modern Information Retrieval McGraw-Hill, 1983. Google ScholarDigital Library
- H. Schutze and J. O. Pedersen. A co-occurrence based thesaurus and two applications to information retrieval. Information Processing and Management 33(3): 307--318, 1997. Google ScholarDigital Library
- A. F. Smeaton and C. J. van Rijsbergen. The retrieval effects of query expansion on feedback document retrieval system. The Computer Journal 26(3): 239--246, 1983.Google ScholarCross Ref
- C. J. Van Rijsbergen. Information Retrieval Butterworths, 1979. Google ScholarDigital Library
- E. M. Voorhees. Query expansion using lexical-semantic relations. In Proceedings of the 1994 ACM SIGIR Conference on Research and Development in Information Retrieval 1994. Google ScholarDigital Library
- E. M. Voorhees. Overview of the trec 2004 robust retrieval track. In Proceedings of the Thirteenth Text REtrieval Conference (TREC2004), 2005.Google ScholarCross Ref
- E. M. Voorhees. Overview of the trec 2005 robust retrieval track. In Proceedings of the Fourteenth Text REtrieval Conference (TREC2005), 2006.Google ScholarCross Ref
- J. Xu and W. B. Croft. Query expansion using local and global document analysis. In Proceedings of the 1996 ACM SIGIR Conference on Research and Development in Information Retrieval 1996. Google ScholarDigital Library
- C. Zhai and J. Lafferty. Model-based feedback in the KL-divergence retrieval model. In Tenth International Conference on Information and Knowledge Management (CIKM 2001), pages 403--410,2001. Google ScholarDigital Library
- C. Zhai and J. Lafferty. A study of smoothing methods for language models applied to ad hoc information retrieval. In Proceedings of SIGIR'01 pages 334--342, Sept 2001. Google ScholarDigital Library
Index Terms
- Semantic term matching in axiomatic approaches to information retrieval
Recommendations
An exploration of axiomatic approaches to information retrieval
SIGIR '05: Proceedings of the 28th annual international ACM SIGIR conference on Research and development in information retrievalExisting retrieval models generally do not offer any guarantee for optimal retrieval performance. Indeed, it is even difficult, if not impossible, to predict a model's empirical performance analytically. This limitation is at least partly caused by the ...
A formal study of information retrieval heuristics
SIGIR '04: Proceedings of the 27th annual international ACM SIGIR conference on Research and development in information retrievalEmpirical studies of information retrieval methods show that good retrieval performance is closely related to the use of various retrieval heuristics, such as TF-IDF weighting. One basic research question is thus what exactly are these "necessary" ...
Diagnostic Evaluation of Information Retrieval Models
Developing effective retrieval models is a long-standing central challenge in information retrieval research. In order to develop more effective models, it is necessary to understand the deficiencies of the current retrieval models and the relative ...
Comments