A Biterm-based Dirichlet Process Topic Model for Short Texts
- DOI
- 10.2991/csss-14.2014.71How to use a DOI?
- Keywords
- Dirichlet Process; Clustering; Biterm; Short Texts; Topic Mining;
- Abstract
Topic models are prevalent in many fields (e.g. context analysis), which are applied to discovering the latent topics. In document modeling, conventional topic models (e.g. latent Dirichlet allocation and its variants) do well for normal documents. However, the severe data sparsity problem makes the topic modeling in short texts difficult and unreliable. To tackle this problem, an effective approach (biterm topic model) has been proposed recently which learns topics by directly modeling the generation of word co-occurrence patterns at corpus-level rather than at document-level. But it requires human intervention for determining the number of topics. In this paper, we propose a Dirichlet process based on word co-occurrence to make topic mining from short texts more automatically. Meanwhile, we design a Markov chain Monte Carlo sampling scheme for posterior inference in our model which is an extension of the sampling algorithm based on Chinese restaurant process. Finally, we conduct experiments on real data. The results show that our method outperforms the baseline on quality of topic and perplexity and it is more flexible.
- Copyright
- © 2014, the Authors. Published by Atlantis Press.
- Open Access
- This is an open access article distributed under the CC BY-NC license (http://creativecommons.org/licenses/by-nc/4.0/).
Cite this article
TY - CONF AU - Pan Yali AU - Yin Jian AU - Liu Shaopeng AU - Li Jing PY - 2014/06 DA - 2014/06 TI - A Biterm-based Dirichlet Process Topic Model for Short Texts BT - Proceedings of the 3rd International Conference on Computer Science and Service System PB - Atlantis Press SP - 301 EP - 304 SN - 1951-6851 UR - https://doi.org/10.2991/csss-14.2014.71 DO - 10.2991/csss-14.2014.71 ID - Yali2014/06 ER -