电信科学 ›› 2022, Vol. 38 ›› Issue (10): 89-97.doi: 10.11959/j.issn.1000-0801.2022266

• 研究与开发 • 上一篇    下一篇

基于艾宾浩斯遗忘曲线和注意力机制的推荐算法

金楠1, 王瑞琴1,2, 陆悦聪1   

  1. 1 湖州师范学院信息工程学院,浙江 湖州 313000
    2 浙江省现代农业资源智慧管理与应用研究重点实验室,浙江 湖州 313000
  • 修回日期:2022-09-28 出版日期:2022-10-20 发布日期:2022-10-01
  • 作者简介:金楠(1996- ),男,湖州师范学院信息工程学院硕士生,主要研究方向为深度学习、个性化推荐
    王瑞琴(1979- ),女,湖州师范学院信息工程学院教授、硕士生导师,主要研究方向为自然语言理解、数据挖掘、个性化推荐
    陆悦聪(1996- ),男,湖州师范学院信息工程学院硕士生,主要研究方向为机器学习与数据挖掘
  • 基金资助:
    浙江省自然科学基金资助项目(LY20F020006)

Ebbinghaus forgetting curve and attention mechanism based recommendation algorithm

Nan JIN1, Ruiqin WANG1,2, Yuecong LU1   

  1. 1 School of Information Engineering, Huzhou University, Huzhou 313000, China
    2 Zhejiang Province Key Laboratory of Smart Management &Application of Modern Agricultural Resources, Huzhou 313000, China
  • Revised:2022-09-28 Online:2022-10-20 Published:2022-10-01
  • Supported by:
    The Natural Science Foundation of Zhejiang Province(LY20F020006)

摘要:

传统基于注意力机制的推荐算法只利用位置嵌入对用户行为序列进行建模,忽略了具体的时间戳信息,导致推荐性能不佳和模型训练过拟合等问题。提出基于时间注意力的多任务矩阵分解推荐模型,利用注意力机制提取邻域信息对用户和物品进行嵌入编码,借助艾宾浩斯遗忘曲线描述用户兴趣随时间的变化特性,在模型训练过程中引入经验回放的强化学习策略模拟人类的记忆复习过程。真实数据集上的实验结果表明,该模型比现有推荐模型具有更好的推荐性能。

关键词: 艾宾浩斯遗忘曲线, 注意力机制, 强化学习, 经验回放

Abstract:

Traditional attention-based recommendation algorithms only use position embeddings to model user behavior sequences, however, ignore specific timestamp information, resulting in poor recommendation performance and overfitting of model training.The multi-task matrix factorization recommendation model based on time attention was proposed, which used the attention mechanism to extract the neighborhood information for the user and item embedding, and used the Ebbinghaus forgetting curve to describe the changing characteristics of user interests over time.The model training process introduced a reinforcement learning strategy of experience replay to simulate the human memory review process.Experimental results on real datasets show that the proposed model has better recommendation performance than existing recommendation models.

Key words: Ebbinghaus forgetting curve, attention mechanism, reinforcement learning, experience replay

中图分类号: 

No Suggested Reading articles found!