Suvarna Garge (Editor)

Item item collaborative filtering

Updated on
Edit
Like
Comment
Share on FacebookTweet on TwitterShare on LinkedInShare on Reddit

Item-item collaborative filtering, or item-based, or item-to-item, is a form of collaborative filtering for recommender systems based on the similarity between items calculated using people's ratings of those items.

Contents

Item-item collaborative filtering was invented and used by Amazon.com in 1998. It was first published in an academic conference in 2001. The authors of that paper, Badrul Sarwar, George Karypis, Joseph Konstan, and John Riedl, won the 2016 Test of Time Award for their paper Item-based collaborative filtering recommendation algorithms. The International World Wide Web Conference committee stated that "this outstanding paper has had a considerable real-world impact".

Earlier collaborative filtering systems based on rating similarity between users (known as user-user collaborative filtering) had several problems:

  • systems performed poorly when they had many items but comparatively few ratings
  • computing similarities between all pairs of users was expensive
  • user profiles changed quickly and the entire system model had to be recomputed
  • Item-item models resolve these problems in systems that have more users than items. Item-item models use rating distributions per item, not per user. With more users than items, each item tends to have more ratings than each user, so an item's average rating usually doesn't change quickly. This leads to more stable rating distributions in the model, so the model doesn't have to be rebuilt as often. When users consume and then rate an item, that item's similar items are picked from the existing system model and added to the user's recommendations.

    Method

    First, the system executes a model-building stage by finding the similarity between all pairs of items. This similarity function can take many forms, such as correlation between ratings or cosine of those rating vectors. As in user-user systems, similarity functions can use normalized ratings (correcting, for instance, for each user's average rating).

    Second, the system executes a recommendation stage. It uses the most similar items to a user's already-rated items to generate a list of recommendations. Usually this calculation is a weighted sum or linear regression. This form of recommendation is analogous to "people who rate item X highly, like you, also tend to rate item Y highly, and you haven't rated item Y yet, so you should try it".

    Results

    Item-item collaborative filtering had less error than user-user collaborative filtering. In addition, its less-dynamic model was computed less often and stored in a smaller matrix, so item-item system performance was better than user-user systems.

    Further research

    Slope One is a family of item-item collaborative filtering algorithms designed to reduce model overfitting problems.

    References

    Item-item collaborative filtering Wikipedia