Big Data and Recommender Systems

Date of Submission: 
September 12, 2016
Report Number: 
16-034
Report PDF: 
Abstract: 

Recommender systems are ubiquitous in today's marketplace and have great commercial importance, as evidenced by the large number of companies that sell recommender systems solutions. Successful recommender systems use past product purchase and satisfaction data to make high quality personalized recommendations. The vast amounts of data available to recommender systems today forces a total re-evaluation of the methods used to compute recommendations. In this paper, we provide an overview of recommender systems in the era of Big Data.  We highlight prevailing recommendation algorithms and how they have been adapted to operate in parallel and distributed computing environments.  Within the recommender systems context, we focus our discussion on two specific challenges: how to scale up finding nearest neighbors and how to scale latent factor recommendation methods.