Comparison of Latent Semantic Analysis and Probabilistic Latent Semantic Analysis for Documents Clustering

keywords: Document clustering, latent semantic analysis, probabilistic latent semantic analysis, natural language processing
In this paper we compare usefulness of statistical techniques of dimensionality reduction for improving clustering of documents in Polish. We start with partitional and agglomerative algorithms applied to Vector Space Model. Then we investigate two transformations: Latent Semantic Analysis and Probabilistic Latent Semantic Analysis. The obtained results showed advantage of Latent Semantic Analysis technique over probabilistic model. We also analyse time and memory consumption aspects of these transformations and present runtime details for IBM BladeCenter HS21 machine.
mathematics subject classification 2000: 68T50, 68T05, 68T35
reference: Vol. 33, 2014, No. 3, pp. 652–666