Proceedings of the 2nd International Conference on Computer Engineering, Information Science & Application Technology (ICCIA 2017)

Research on Vague soft clustering algorithm based on MapReduce

Authors
Wei Wang, Junsheng Wu, Zhixiang Zhu
Corresponding Author
Wei Wang
Available Online July 2016.
DOI
10.2991/iccia-17.2017.54How to use a DOI?
Keywords
Vague soft sets, clustering, MapReduce
Abstract

Aiming at the problems that traditional clustering algorithm based on Vague soft sets is difficult to deal with massive data, a parallel Vague soft clustering algorithm based on MapReduce is proposed. The algorithm calculate the similarity measure between Vague soft sets based on Map function and Reduce function of the MapReduce programming framework, and Vague similarity matrix is established as the basis for clustering at the same time. Secondly, the Vague matrix is partitioned according to the similarity matrix based on the idea of matrix partition, and we process the block matrix and merge the results based on MapReduce. Finally, the data items is clustered based on the similarity threshold. The contrast experiment between traditional Vague soft clustering algorithm and the new algorithm shows that the proposed algorithm has higher accuracy, it can not only achieve better speedup in large-scale data calculation but also divide project resources effectively and accurately.

Copyright
© 2017, the Authors. Published by Atlantis Press.
Open Access
This is an open access article distributed under the CC BY-NC license (http://creativecommons.org/licenses/by-nc/4.0/).

Download article (PDF)

Volume Title
Proceedings of the 2nd International Conference on Computer Engineering, Information Science & Application Technology (ICCIA 2017)
Series
Advances in Computer Science Research
Publication Date
July 2016
ISBN
10.2991/iccia-17.2017.54
ISSN
2352-538X
DOI
10.2991/iccia-17.2017.54How to use a DOI?
Copyright
© 2017, the Authors. Published by Atlantis Press.
Open Access
This is an open access article distributed under the CC BY-NC license (http://creativecommons.org/licenses/by-nc/4.0/).

Cite this article

TY  - CONF
AU  - Wei Wang
AU  - Junsheng Wu
AU  - Zhixiang Zhu
PY  - 2016/07
DA  - 2016/07
TI  - Research on Vague soft clustering algorithm based on MapReduce
BT  - Proceedings of the 2nd International Conference on Computer Engineering, Information Science & Application Technology (ICCIA 2017)
PB  - Atlantis Press
SP  - 317
EP  - 326
SN  - 2352-538X
UR  - https://doi.org/10.2991/iccia-17.2017.54
DO  - 10.2991/iccia-17.2017.54
ID  - Wang2016/07
ER  -