Text Segmentation Using Roget-Based Weighted Lexical Chains
keywords: Lexical chains, text segmentation, topic boundaries, Roget's thesaurus, segmentation evaluation
In this article we present a new method for text segmentation. The method relies on the number of lexical chains (LCs) which end in a sentence, which begin in the following sentence and which traverse the two successive sentences. The lexical chains are based on Roget's thesaurus (the 1987 and the 1911 version). We evaluate the method on ten texts from the DUC 2002 conference and on twenty texts from the CAST project corpus, using a manual segmentation as gold standard.
reference: Vol. 32, 2013, No. 2, pp. 393–410