Proceedings of the 2nd International Conference on Computer Engineering, Information Science & Application Technology (ICCIA 2017)

Spark-based Parallel Collaborative Filtering Recommendation Algorithm

Authors
Yongli Yang, Fei Xue, Yongquan Cai, Zhenhu Ning
Corresponding Author
Yongli Yang
Available Online July 2016.
DOI
https://doi.org/10.2991/iccia-17.2017.179How to use a DOI?
Keywords
Collaborative Filtering Recommendation Algorithm, RLPSO, K-means, Spark.
Abstract
The rapid development of Internet information technology makes the problem of information overload become more and more serious, and recommendation system is one of the effective ways to solve this problem which is favored by people. However, for the massive data information, the recommended algorithm faces the bottleneck problem of processing speed and computing resources, so this paper proposed a parallel collaborative filtering recommendation algorithm based on Spark. The RLPSO algorithm is used to optimize the clustering factor of the K-means clustering algorithm by associating users with similar interests into a cluster and using the recommended algorithm for users to recommend is implemented on the Spark platform. The experimental results show that the improved algorithm has a significant improvement in the prediction accuracy, and has a higher speedup and stability compared with the traditional collaborative filtering recommendation algorithm.
Open Access
This is an open access article distributed under the CC BY-NC license.

Download article (PDF)

Proceedings
2nd International Conference on Computer Engineering, Information Science & Application Technology (ICCIA 2017)
Part of series
Advances in Computer Science Research
Publication Date
July 2016
ISBN
978-94-6252-361-6
ISSN
2352-538X
DOI
https://doi.org/10.2991/iccia-17.2017.179How to use a DOI?
Open Access
This is an open access article distributed under the CC BY-NC license.

Cite this article

TY  - CONF
AU  - Yongli Yang
AU  - Fei Xue
AU  - Yongquan Cai
AU  - Zhenhu Ning
PY  - 2016/07
DA  - 2016/07
TI  - Spark-based Parallel Collaborative Filtering Recommendation Algorithm
BT  - 2nd International Conference on Computer Engineering, Information Science & Application Technology (ICCIA 2017)
PB  - Atlantis Press
SN  - 2352-538X
UR  - https://doi.org/10.2991/iccia-17.2017.179
DO  - https://doi.org/10.2991/iccia-17.2017.179
ID  - Yang2016/07
ER  -