PDF] PinnerFormer: Sequence Modeling for User Representation at Pinterest

PinnerFormer is introduced, a user representation trained to predict a users' future long-term engagement using a sequential model of a user's recent actions, and it is shown that by doing so, it significantly closes the gap between batch user embeddings that are generated once a day and realtime user embedDings generated whenever a user takes an action. Sequential models have become increasingly popular in powering personalized recommendation systems over the past several years. These approaches traditionally model a user's actions on a website as a sequence to predict the user's next action. While theoretically simplistic, these models are quite challenging to deploy in production, commonly requiring streaming infrastructure to reflect the latest user activity and potentially managing mutable data for encoding a user's hidden state. Here we introduce PinnerFormer, a user representation trained to predict a user's future long-term engagement using a sequential model of a user's recent actions. Unlike prior approaches, we adapt our modeling to a batch infrastructure via our new dense all-action loss, modeling long-term future actions instead of next action prediction. We show that by doing so, we significantly close the gap between batch user embeddings that are generated once a day and realtime user embeddings generated whenever a user takes an action. We describe our design decisions via extensive offline experimentation and ablations and validate the efficacy of our approach in A/B experiments showing substantial improvements in Pinterest's user retention and engagement when comparing PinnerFormer against our previous user representation. PinnerFormer is deployed in production as of Fall 2021.

How Pinterest Leverages Realtime User Actions in Recommendation to Boost Homefeed Engagement Volume, by Pinterest Engineering, Pinterest Engineering Blog

PDF] PinnerFormer: Sequence Modeling for User Representation at Pinterest

Large-scale User Sequences at Pinterest, by Pinterest Engineering, Pinterest Engineering Blog

Aman's AI Journal • Papers List

Large-scale User Sequences at Pinterest, by Pinterest Engineering, Pinterest Engineering Blog

PDF) Every Preference Changes Differently: Neural Multi-Interest Preference Model with Temporal Dynamics for Recommendation

PDF) adSformers: Personalization from Short-Term Sequences and Diversity of Representations in Ads

PDF] PinnerFormer: Sequence Modeling for User Representation at Pinterest

PDF) Rethinking Personalized Ranking at Pinterest: An End-to-End Approach

machinelearning #datascience #artificialintelligence - Damien Benveniste, PhD sa LinkedIn

PDF) Better Generalization with Semantic IDs: A case study in Ranking for Recommendations

PDF] PinnerFormer: Sequence Modeling for User Representation at Pinterest

PDF) ItemSage: Learning Product Embeddings for Shopping Recommendations at Pinterest

How Pinterest Leverages Realtime User Actions in Recommendation to Boost Homefeed Engagement Volume, by Pinterest Engineering, Pinterest Engineering Blog

PDF] PinnerFormer: Sequence Modeling for User Representation at Pinterest