Approaches to Samples Selection for Machine Learning Based Classification of Textual Data

keywords: Text classification, textual patterns, machine learning, natural language processing, text similarity, information retrieval
The paper focuses on the process of selecting representative sample documents written in a natural language that can be used as the basis for automatic selection or classification of textual documents. A method of selecting the examples from a larger set of candidate examples, called automatic biased sample selection, is compared to random and manual selection. The methods are evaluated by experiments carried out with real world data consisting of customer reviews, with different document representations and similarity measures. The presented approach, that provided satisfactory results, faces problems related to processing user created content and huge computational complexity and can be used as an alternative to manual selection and evaluation of textual samples.
mathematics subject classification 2000: 68U15, 68T50
reference: Vol. 32, 2013, No. 5, pp. 949–967