Copyright © 2007 Elsevier Ltd All rights reserved.
Query expansion and dimensionality reduction: Notions of optimality in Rocchio relevance feedback and latent semantic indexing
Received 4 September 2006;
References and further reading may be available for this article. To view references and further reading you must purchase this article.
Abstract
Rocchio relevance feedback and latent semantic indexing (LSI) are well-known extensions of the vector space model for information retrieval (IR). This paper analyzes the statistical relationship between these extensions. The analysis focuses on each method’s basis in least-squares optimization. Noting that LSI and Rocchio relevance feedback both alter the vector space model in a way that is in some sense least-squares optimal, we ask: what is the relationship between LSI’s and Rocchio’s notions of optimality? What does this relationship imply for IR? Using an analytical approach, we argue that Rocchio relevance feedback is optimal if we understand retrieval as a simplified classification problem. On the other hand, LSI’s motivation comes to the fore if we understand it as a biased regression technique, where projection onto a low-dimensional orthogonal subspace of the documents reduces model variance.
Keywords: Latent semantic indexing (LSI); Relevance feedback; Information retrieval
Article Outline
- 1. Introduction
- 2. Projection methods in IR
- 3. Least-squares projections for IR
- 4. Comparing projection methods
- 4.1. IR as classification
- 4.2. IR as regression
- 4.3. Colinearity in linear regression
- 4.4. Biased regression
- 4.5. An example
- 5. Discussion
- 6. Conclusion
- Acknowledgements
- References







E-mail Article
Add to my Quick Links

Cited By in Scopus (0)







