An Algorithm of Feature Selection in Text Categorization Based on Gini-index
Wei-Dong Zhu, Bo Wang, Yong-Min Lin
Available Online August 2015.
- https://doi.org/10.2991/msmi-15.2015.50How to use a DOI?
- Text categorization, Feature selection, Gini-index, Feature selection function.
- TWith the rapid development of World Wide Web, text categorization has played an important role in organizing and processing large amount of text data. The first and major problem of text categorization is how to select the best subset from the original high feature space in order to reduce the high dimensionality of the original feature space and improve the classification performance. Gini-Index is the principle of multi-attribute selection very early used for attribute selection in Decision Tree, which performs near state-of-the-art level. However, relatively little work has been done on applying Gini-Index to text feature selection. We use improved Gini-index for text feature selection, constructing the measure function based on Gini-Index. We compare it to other four feature selection measures using two kinds of classifiers on two different document corpus. The result of experiments shows that its performance is comparable with other text feature selection approaches. However, it is perfect in the time complexity of algorithm.
- Open Access
- This is an open access article distributed under the CC BY-NC license.
Cite this article
TY - CONF AU - Wei-Dong Zhu AU - Bo Wang AU - Yong-Min Lin PY - 2015/08 DA - 2015/08 TI - An Algorithm of Feature Selection in Text Categorization Based on Gini-index BT - 2015 International Conference on Management Science and Management Innovation (MSMI 2015) PB - Atlantis Press SN - 2352-5428 UR - https://doi.org/10.2991/msmi-15.2015.50 DO - https://doi.org/10.2991/msmi-15.2015.50 ID - Zhu2015/08 ER -