A fast and better hybrid recommender system based on spark

Jiali Wang*, Hang Zhuang, Changlong Li, Hang Chen, Bo Xu, Zhuocheng He, Xuehai Zhou

*Corresponding author for this work

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

1 Scopus citations

Abstract

With the rapid development of information technology, recommender systems have become critical components to solve information overload. As an important branch, weighted hybrid recommender systems are widely used in electronic commerce sites, social networks and video websites such as Amazon, Facebook and Netflix. In practice, developers typically set a weight for each recommendation algorithm by repeating experiments until obtaining better accuracy. Despite the method could improve accuracy, it overly depends on experience of developers and the improvements are poor. What worse, workload will be heavy if the number of algorithms rises. To further improve performance of recommender systems, we design an optimal hybrid recommender system on Spark. Experimental results show that the system can improve accuracy, reduce execution time and handle large-scale datasets. Accordingly, the hybrid recommender system balances accuracy and execution time.

Original languageEnglish
Title of host publicationNetwork and Parallel Computing - 13th IFIP WG 10.3 International Conference, NPC 2016, Proceedings
EditorsXinbo Gao, Barbara Chapman, Depei Qian, Wenguang Chen, Guang R. Gao
PublisherSpringer Verlag
Pages147-159
Number of pages13
ISBN (Print)9783319470986
DOIs
StatePublished - 2016
Externally publishedYes
Event13th IFIP WG 10.3 International Conference on Network and Parallel Computing, NPC 2016 - Xi’an, China
Duration: 28 Oct 201629 Oct 2016

Publication series

NameLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume9966 LNCS
ISSN (Print)0302-9743
ISSN (Electronic)1611-3349

Conference

Conference13th IFIP WG 10.3 International Conference on Network and Parallel Computing, NPC 2016
Country/TerritoryChina
CityXi’an
Period28/10/1629/10/16

Keywords

  • Hybrid
  • Recommender system
  • Spark
  • Weight

Fingerprint

Dive into the research topics of 'A fast and better hybrid recommender system based on spark'. Together they form a unique fingerprint.

Cite this