Abstract

The main goal of this work was to experimentally verify the methods for a challenging task of categorization and clustering Polish text. Supervised and unsupervised learning was employed respectively for the categorization and clustering. A profound examination of the employed methods was done for the custom-built corpus of Polish texts. The corpus was assembled by the authors from Internet resources. The corpus data was acquired from the news portal and, therefore, it was sorted by type by journalists according to their specialization. The presented algorithms employ Vector Space Model (VSM) and TF-IDF (Term Frequency-Inverse Document Frequency) weighing scheme. Series of experiments were conducted that revealed certain properties of algorithms and their accuracy. The accuracy of algorithms was elaborated regarding their ability to match human arrangement of the documents by the topic. For both the categorization and clustering, the authors used F-measure to assess the quality of allocation.

Keywords

Cite this article

@article{cai-2448,
  author  = {Maciej Wielgosz and Rafał Fraczek and Paweł Russek and Marcin Pietroń and Agnieszka Dabrowska-Boruch and Ernest Jamro and Kazimierz Wiatr},
  title   = {Experiment on Methods for Clustering and Categorization of Polish Text},
  journal = {Computing and Informatics},
  volume  = {36},
  number  = {1},
  pages   = {186--204},
  year    = {2017},
  issn    = {1335-9150},
  doi     = {10.4149/cai_2017_1_186}
}
Download .bib