Lecture Notes in Computer Science, 2005, Volume 3314/2005, 711-717, DOI: 10.1007/978-3-540-30497-5_111

A Correlation Analysis on LSA and HAL Semantic Space Models

Xin Yan, Xue Li and Dawei Song

View Related Documents

Abstract

In this paper, we compare a well-known semantic spacemodel, Latent Semantic Analysis (LSA) with another model, Hyperspace Analogue to Language (HAL) which is widely used in different area, especially in automatic query refinement. We conduct this comparative analysis to prove our hypothesis that with respect to ability of extracting the lexical information from a corpus of text, LSA is quite similar to HAL. We regard HAL and LSA as black boxes. Through a Pearson’s correlation analysis to the outputs of these two black boxes, we conclude that LSA highly co-relates with HAL and thus there is a justification that LSA and HAL can potentially play a similar role in the area of facilitating automatic query refinement. This paper evaluates LSA in a new application area and contributes an effective way to compare different semantic space models.

Keywords  Correlation Analysis - Hyperspace Analogue to Language - Latent Semantic Indexing - Automatic Query Refinement

Fulltext Preview

Image of the first page of the fulltext document