Reformulating Conversational Recommender Systems as Tri-Phase Offline Policy Learning

Abstract

Existing Conversational Recommender Systems (CRS) predominantly utilize user simulators for training and evaluating recommendation policies. These simulators often oversimplify the complexity of user interactions by focusing solely on static item attributes, neglecting the rich, evolving preferences that characterize real-world user behavior. This limitation frequently leads to models that perform well in simulated environments but falter in actual deployment. Addressing these challenges, this paper introduces the Tri-Phase Offline Policy Learning-based Conversational Recommender System (TCRS), which significantly reduces dependency on real-time interactions and mitigates overfitting issues prevalent in traditional approaches. TCRS integrates a model-based offline learning strategy with a controllable user simulation that dynamically aligns with both personalized and evolving user preferences. Through comprehensive experiments, TCRS demonstrates enhanced robustness, adaptability, and accuracy in recommendations, outperforming traditional CRS models in diverse user scenarios. This approach not only provides a more realistic evaluation environment but also facilitates a deeper understanding of user behavior dynamics, thereby refining the recommendation process.

@article{zhang2024reformulating,
  title={Reformulating Conversational Recommender Systems as Tri-Phase Offline Policy Learning},
  author={Zhang, Gangyi and Gao, Chongming and Pan, Hang and Teng, Runzhe and Li, Ruizhe},
  journal={arXiv preprint arXiv:2408.06809},
  year={2024}
}

Gangyi Zhang

张刚毅

Chongming Gao

高崇铭 博士后

Hang Pan

潘航