An Intra and Inter-Topic Evaluation and Cleansing Method

Apply

An Intra and Inter-Topic Evaluation and Cleansing Method

Journal Title: Romanian Journal of Human - Computer Interaction - Year 2010, Vol 3, Issue 2

Abstract

Topic modeling is a growing research field and novel ways of interpreting and evaluating results are necessary. We propose a method for evaluating and improving the performance of topic models generating algorithms relying on WordNet data. We first propose a measure for determining a topic model’s fitness factoring in its broadness and redundancy. Then, for each individual topic, the amount of relevant information it provides, along with its most important words and related concepts are determined by defining a cohesion function based on the topic’s projection on WordNet concepts. The model as a whole is improved by eliminating each topic’s outliers with respect to the ontology projection. We define a inter topic ontology based distance and we further use it to investigate the impact of removing redundant topics from a model with regard to the overlap between topics’ ontological projections. Clustering similar topics into conceptually cohesive groups is tried as an alternative to pruning less relevant topics. Results show that evaluating and improving statistical models with WordNet is a promising research track that leads to more coherent topic models.

Authors and Affiliations

Claudiu Muşat, Marian-Andrei Rizoiu , Ştefan Trauşan-Matu

Keywords

Topic Modeling WordNet Ontology LDA Subtree Evaluation Improvement

EP ID EP28813
DOI -
Views 395
Downloads 10