Preprint

Using LLMs to Capture Users' Temporal Context for Recommendation

Authors:
Preprints and early-stage research may not have been peer reviewed yet.
To read the file of this research, you can request a copy directly from the authors.

Abstract

Effective recommender systems demand dynamic user understanding, especially in complex, evolving environments. Traditional user profiling often fails to capture the nuanced, temporal contextual factors of user preferences, such as transient short-term interests and enduring long-term tastes. This paper presents an assessment of Large Language Models (LLMs) for generating semantically rich, time-aware user profiles. We do not propose a novel end-to-end recommendation architecture; instead, the core contribution is a systematic investigation into the degree of LLM effectiveness in capturing the dynamics of user context by disentangling short-term and long-term preferences. This approach, framing temporal preferences as dynamic user contexts for recommendations, adaptively fuses these distinct contextual components into comprehensive user embeddings. The evaluation across Movies&TV and Video Games domains suggests that while LLM-generated profiles offer semantic depth and temporal structure, their effectiveness for context-aware recommendations is notably contingent on the richness of user interaction histories. Significant gains are observed in dense domains (e.g., Movies&TV), whereas improvements are less pronounced in sparse environments (e.g., Video Games). This work highlights LLMs' nuanced potential in enhancing user profiling for adaptive, context-aware recommendations, emphasizing the critical role of dataset characteristics for practical applicability.

No file available

Request Full-text Paper PDF

To read the file of this research,
you can request a copy directly from the authors.

ResearchGate has not been able to resolve any citations for this publication.
Article
In recent years, context-aware recommender systems (CARSs), which incorporate contextual information to achieve better recommendations, become a hot topic in the domain of recommender systems. Many context-aware recommendation methods have been proposed in the past decades. Some literatures provide survey of the research on CARSs. However, they mainly focus on context-aware recommendation methods and overlook the evaluation of them. The evaluation methods, evaluation properties and datasets of CARSs are different from those of traditional recommender systems where contexts are not considered. In this paper, we provide a review for evaluation of CARSs. We will introduce the basic concepts of CARSs, propose a new dataset partition method for each category of CARSs according to our classification of CARSs, summarize the evaluation method. Then we summarize the evaluation properties that CARSs pays attention to, which are different from the NCARSs. In addition, we also summarize the datasets specifically for CARSs, its applicable CARSs type and its evaluation dimensions and metrics. Based on our review, we draw some conclusions from evaluation perspective and point out future research directions.
Conference Paper
Modeling users' dynamic preferences from their historical behaviors is challenging and crucial for recommendation systems. Previous methods employ sequential neural networks to encode users' historical interactions from left to right into hidden representations for making recommendations. Despite their effectiveness, we argue that such left-to-right unidirectional models are sub-optimal due to the limitations including: \begin enumerate* [label=series\itshape\alph*\upshape)] \item unidirectional architectures restrict the power of hidden representation in users' behavior sequences; \item they often assume a rigidly ordered sequence which is not always practical. \end enumerate* To address these limitations, we proposed a sequential recommendation model called BERT4Rec, which employs the deep bidirectional self-attention to model user behavior sequences. To avoid the information leakage and efficiently train the bidirectional model, we adopt the Cloze objective to sequential recommendation, predicting the random masked items in the sequence by jointly conditioning on their left and right context. In this way, we learn a bidirectional representation model to make recommendations by allowing each item in user historical behaviors to fuse information from both left and right sides. Extensive experiments on four benchmark datasets show that our model outperforms various state-of-the-art sequential models consistently.
  • Josh Achiam
  • Steven Adler
  • Sandhini Agarwal
  • Lama Ahmad
  • Ilge Akkaya
  • Florencia Leoni Aleman
  • Diogo Almeida
  • Janko Altenschmidt
  • Sam Altman
Josh Achiam, Steven Adler, Sandhini Agarwal, Lama Ahmad, Ilge Akkaya, Florencia Leoni Aleman, Diogo Almeida, Janko Altenschmidt, Sam Altman, Shyamal Anadkat, et al. 2023. Gpt-4 technical report. arXiv preprint arXiv:2303.08774 (2023).
Improve temporal awareness of llms for sequential recommendation
  • Zhendong Chu
  • Zichao Wang
  • Ruiyi Zhang
  • Yangfeng Ji
  • Hongning Wang
  • Tong Sun
Zhendong Chu, Zichao Wang, Ruiyi Zhang, Yangfeng Ji, Hongning Wang, and Tong Sun. 2024. Improve temporal awareness of llms for sequential recommendation. arXiv preprint arXiv:2405.02778 (2024).
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
  • Jacob Devlin
  • Ming-Wei Chang
  • Kenton Lee
  • Kristina Toutanova
Jacob Devlin, Ming-Wei Chang, Kenton Lee, and Kristina Toutanova. 2019. BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding. In Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers), Jill Burstein, Christy Doran, and Thamar Solorio (Eds.). Association for Computational Linguistics, Minneapolis, Minnesota, 4171-4186. https://doi. org/10.18653/v1/N19-1423
  • Balázs Hidasi
  • Alexandros Karatzoglou
Balázs Hidasi, Alexandros Karatzoglou, Linas Baltrunas, and Domonkos Tikk. 2015. Session-based recommendations with recurrent neural networks. arXiv preprint arXiv:1511.06939 (2015).
Bridging language and items for retrieval and recommendation
  • Yupeng Hou
  • Jiacheng Li
  • Zhankui He
  • An Yan
  • Xiusi Chen
  • Julian Mcauley
Yupeng Hou, Jiacheng Li, Zhankui He, An Yan, Xiusi Chen, and Julian McAuley. 2024. Bridging language and items for retrieval and recommendation. arXiv preprint arXiv:2403.03952 (2024).
  • Yangqin Jiang
  • Yuhao Yang
  • Lianghao Xia
  • Da Luo
  • Kangyi Lin
  • Chao Huang
Yangqin Jiang, Yuhao Yang, Lianghao Xia, Da Luo, Kangyi Lin, and Chao Huang. 2024. RecLM: Recommendation Instruction Tuning. arXiv preprint arXiv:2412.19302 (2024).
  • Bo Dhruva Dixith Kurra
  • Ling
Dhruva Dixith Kurra, Bo Ling, Chun Zh, and Seyedshahin Ashrafzadeh. 2024. Handling Large-scale Cardinality in building recommendation systems. arXiv preprint arXiv:2401.09572 (2024).
Achiya Elyasaf, Bracha Shapira, and Lior Rokach. 2022. Evolving context-aware recommender systems with users in mind
  • Amit Livne
  • Shem Eliad
  • Adir Tov
  • Solomon
Amit Livne, Eliad Shem Tov, Adir Solomon, Achiya Elyasaf, Bracha Shapira, and Lior Rokach. 2022. Evolving context-aware recommender systems with users in mind. Expert Systems with Applications 189 (2022), 116042.
Introduction to recommender systems handbook
  • Francesco Ricci
  • Lior Rokach
  • Bracha Shapira
Francesco Ricci, Lior Rokach, and Bracha Shapira. 2011. Introduction to recommender systems handbook. In Recommender systems handbook. Springer, 1-35.
User modeling in the era of large language models
  • Zhaoxuan Tan
  • Meng Jiang
Zhaoxuan Tan and Meng Jiang. 2023. User modeling in the era of large language models: Current research and future directions. arXiv preprint arXiv:2312.11518 (2023).
SA-LSPL: Sequence-Aware Long-and Short-Term Preference Learning for next POI recommendation
  • Bin Wang
  • Yan Zhang
  • Yan Ma
  • Yaohui Jin
  • Yanyan Xu
Bin Wang, Yan Zhang, Yan Ma, Yaohui Jin, and Yanyan Xu. 2024. SA-LSPL: Sequence-Aware Long-and Short-Term Preference Learning for next POI recommendation. arXiv preprint arXiv:2404.00367 (2024).
Attention is all you need
  • A Waswani
  • Shazeer
  • J Parmar
  • Uszkoreit
  • Jones
  • Gomez
  • I Kaiser
  • Polosukhin
A Waswani, N Shazeer, N Parmar, J Uszkoreit, L Jones, A Gomez, L Kaiser, and I Polosukhin. 2017. Attention is all you need. In NIPS.
SPAR: Personalized Content-Based Recommendation via Long Engagement Attention
  • Chiyu Zhang
  • Yifei Sun
  • Jun Chen
  • Jie Lei
  • Muhammad Abdul-Mageed
  • Sinong Wang
  • Rong Jin
  • Sem Park
  • Ning Yao
  • Bo Long
Chiyu Zhang, Yifei Sun, Jun Chen, Jie Lei, Muhammad Abdul-Mageed, Sinong Wang, Rong Jin, Sem Park, Ning Yao, and Bo Long. 2024. SPAR: Personalized Content-Based Recommendation via Long Engagement Attention. arXiv preprint arXiv:2402.10555 (2024).
Denoising Long-and Shortterm Interests for Sequential Recommendation
  • Xinyu Zhang
  • Beibei Li
  • Beihong Jin
Xinyu Zhang, Beibei Li, and Beihong Jin. 2024. Denoising Long-and Shortterm Interests for Sequential Recommendation. In Proceedings of the 2024 SIAM International Conference on Data Mining (SDM). SIAM, 544-552.
  • Xiangyu Zhao
  • Maolin Wang
  • Xinjian Zhao
  • Jiansheng Li
  • Shucheng Zhou
  • Dawei Yin
  • Qing Li
Xiangyu Zhao, Maolin Wang, Xinjian Zhao, Jiansheng Li, Shucheng Zhou, Dawei Yin, Qing Li, Jiliang Tang, and Ruocheng Guo. 2023. Embedding in recommender systems: A survey. arXiv preprint arXiv:2310.18608 (2023).
  • Zihuai Zhao
  • Wenqi Fan
  • Jiatong Li
  • Yunqing Liu
  • Xiaowei Mei
  • Yiqi Wang
  • Zhen Wen
  • Fei Wang
  • Xiangyu Zhao
  • Jiliang Tang
Zihuai Zhao, Wenqi Fan, Jiatong Li, Yunqing Liu, Xiaowei Mei, Yiqi Wang, Zhen Wen, Fei Wang, Xiangyu Zhao, Jiliang Tang, et al. 2023. Recommender systems in the era of large language models (llms). arXiv preprint arXiv:2307.02046 (2023).