Skip to content

[arXiv'24] Large Language Model Enhanced Recommender Systems: Taxonomy, Trend, Application and Future

Notifications You must be signed in to change notification settings

liuqidong07/Awesome-LLM-Enhanced-Recommender-Systems

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

9 Commits
 
 
 
 

Repository files navigation

Awesome LLM-Enhanced Recommender Systems

This is the collection of the papers on LLM-Enhanced Recommender Systems (LLMERS).

Due to the latency requirements by the online recommenders, LLMERS has gained considerable attention recently. We would like to give the definition of the LLMERS in our survey.

💡 Definition: The conventional recommender systems are enhanced by large language models via assistance in training or supplementary for data, while no need for LLM inference during the service

⭐️ Category: LLMERS augments the conventional RS from its basic components, i.e., interaction data and recommendation model, so that we categorize them into three lines: Knowledge Enhancement, Interaction Enhancement and Model Enhancement.

News

🔥 [2024.12] We have released the survey and repo!

🔥 [2025.3] We have updated recent papers to v.2.

1. Knowledge Enhancement

Date / Venue Model Paper Knowledge Type Foundation Model (Finetuned/Non-finetuned) Code
2023.5 / WSDM'24 ONCE ONCE: Boosting Content-based Recommendation with Both Open- and Closed-source Large Language Models Summarization & Reasoning LLaMA-7B (F) + GPT-3.5 (N) Link
2023.6 / RecSys'24 KAR Towards Open-World Recommendation with Knowledge Augmentation from Large Language Models Summarization & Reasoning ChatGLM (N) Link
2023.8 / AAAI'24 LLMRG LLMRG: Improving Recommendations through Large Language Model Reasoning Graphs Knowledge Graph GPT-4 (N) / GPT-3.5 (N) N/A
2023.12 / arXiv'23 SAGCN Understanding Before Recommendation: Semantic Aspect-Aware Review Exploitation via Large Language Models Knowledge Graph Vicuna-13B (N) N/A
2024.1 / arXiv'24 LLMHG LLM-Guided Multi-View Hypergraph Learning for Human-Centric Explainable Recommendation Knowledge Graph GPT-4 (N) / GPT-3.5 (N) N/A
2024.2 / arXiv'24 LLM-KERec Breaking the Barrier: Utilizing Large Language Models for Industrial Recommendation Systems through an Inferential Knowledge Graph Knowledge Graph GPT-3.5 (N) / ChatGLM2 (N) N/A
2024.2 / arXiv'24 GaCLLM Large Language Model with Graph Convolution for Recommendation Summarization & Reasoning ChatGLM2-6B (F) N/A
2024.3 / arXiv'24 CSRec Common Sense Enhanced Knowledge-based Recommendation with Large Language Model Knowledge Graph GPT-3.5 (N) Link
2024.3 / arXiv'24 KELLMRec KELLMRec: Knowledge-Enhanced Large Language Models for Recommendation Both InternLM-7B (N) N/A
2024.4 / ICASSP'24 LAMAR Large Language Models Augmented Rating Prediction in Recommender System Summarization & Reasoning LLaMA (N) Link
2024.5 / arXiv'24 News Recommendation with Category Description by a Large Language Model Summarization & Reasoning GPT-4 (N) Link
2024.5 / SIGIRW'24 LLM-BRec LLM-BRec: Personalizing Session-based Social Recommendation with LLM-BERT Fusion Framework Summarization & Reasoning LLaMA2-7B (N) N/A
2024.5 / arXiv'24 SKarREC Learning Structure and Knowledge Aware Representation with Large Language Models for Concept Recommendation Both GPT-3.5 (N) N/A
2024.7 / arXiv'24 LANE LANE: Logic Alignment of Non-tuning Large Language Models and Online Recommendation Systems for Explainable Reason Generation Summarization & Reasoning GPT-3.5 (N) N/A
2024.7 / SIGIR'24 SeRALM Enhancing Sequential Recommenders with Augmented Knowledge from Aligned Large Language Models Summarization & Reasoning LLaMA2-7B (F) N/A
2024.8 / ACLW'24 HRGraph HRGraph: Leveraging LLMs for HR Data Knowledge Graphs with Information Propagation-based Job Recommendation Knowledge Graph unknown Link
2024.8 / arXiv'24 MMRec MMREC: LLM Based Multi-Modal Recommender System Summarization & Reasoning GPT-3.5 (N) N/A
2024.8 / arXiv'24 REKI Efficient and Deployable Knowledge Infusion for Open-World Recommendations via Large Language Models Summarization & Reasoning GPT-3.5 (N) Link
2024.8 / arXiv'24 X-REFLECT X-REFLECT: Cross-Reflection Prompting for Multimodal Recommendation Summarization & Reasoning GPT-4V (N) / LLaVA1.5-7B (N) / InternLM-7B (N) N/A
2024.10 / arXiv'24 CoLaKG Comprehending Knowledge Graphs with Large Language Models for Recommender Systems Knowledge Graph DeepSeek (N) N/A
2024.11 / arXiv'24 LLM-PKG Enabling Explainable Recommendation in E-commerce with LLM-powered Product Knowledge Graph Knowledge Graph Unknown N/A
2024.12 / arXiv'24 AutoGraph An Automatic Graph Construction Framework based on Large Language Models for Recommendation Knowledge Graph Vicuna-7B (N) Link
2024.12 / AAAI'25 CIKG Bridging the User-side Knowledge Gap in Knowledge-aware Recommendations with Large Language Models Knowledge Graph GPT-3.5 (N) Link
2024.12 / arXiv'24 RecLM RECLM: RECOMMENDATION INSTRUCTION TUNING Summarization & Reasoning GPT-3.5 (N) / LLaMA2-7B (F) Link

2. Interaction Enhancement

Date / Venue Model Paper Generation Method Foundation Model (Finetuned/Non-finetuned) Code
2023.6 / WSDM'24 LLMRec LLMRec: Large Language Models with Graph Augmentation for Recommendation Text-based GPT-3.5 + text-embedding-ada-002 (N) Link
2024.1 / arXiv'24 LlamaRec Integrating Large Language Models into Recommendation via Mutual Augmentation and Adaptive Aggregation Text-based LLaMA2-7B (F) N/A
2024.2 / arXiv'24 LLM-InS Large Language Model Interaction Simulator for Cold-Start Item Recommendation Score-based LLaMA2 (F) N/A
2024.2 / WWW'24 ColdAug Large Language Models as Data Augmenters for Cold-Start Item Recommendation Text-based PaLM2 (N) N/A
2024.8 / arXiv'24 LLMDSR LLM4DSR: Leveraing Large Language Model for Denoising Sequential Recommendation Score-based LLaMA3-8B (F) N/A
2024.9 / arXiv'24 LLMHD Large Language Model Enhanced Hard Sample Identification for Denoising Recommendation Text-based GPT-3.5 (N) N/A
2024.11 / arXiv'24 EIMF LLM-assisted Explicit and Implicit Multi-interest Learning Framework for Sequential Recommendation Score-based QWen (N) N/A
2024.11 / arXiv'24 LLM4IDRec Enhancing ID-based Recommendation with Large Language Models Text-based LLaMA2-7B (F) N/A
2025.1 / WWW'25 SampleLLM SampleLLM: Optimizing Tabular Data Synthesis in Recommendations Text-based LLaMA3-70B (N) N/A

3. Model Enhancement

Date / Venue Model Paper Integration Type Foundation Model (Finetuned/Non-finetuned) Code
2023.8 / arXiv'23 CTRL CTRL: Connect Collaborative and Language Model for CTR Prediction Model Initialization ChatGLM-6B (F) N/A
2023.9 / RecSys'23 LLM Leveraging Large Language Models for Sequential Recommendation Model Initialization text-embedding-ada-002 (N) Link
2023.10 / RecSys'24 FLIP FLIP: Towards Fine-grained Alignment between ID-based Models and Pretrained Language Models for CTR Prediction Model Initialization TinyBERT Link
2023.10 / WWW'24 RLMRec Representation Learning with Large Language Models for Recommendation Embedding Guidance text-embedding-ada-002 (N) + GPT-3.5 (N) Link
2023.11 / WWW'24 SINGLE Modeling User Viewing Flow using Large Language Models for Article Recommendation Embedding Utilization ChatGLM-6B (F) N/A
2024.2 / arXiv'24 LEADER Large Language Model Distilling Medication Recommendation Model Model Distillation LLaMA-7B (F) Link
2024.2 / arXiv'24 LLM2X Improving Sequential Recommendations with LLMs Model Initialization text-embedding-ada-002 (N) Link
2024.2 / arXiv'24 LLM4SBR LLM4SBR: A Lightweight and Effective Framework for Integrating Large Language Models in Session-based Recommendation Embedding Guidance QWen-7B (N) N/A
2024.2 / arXiv'24 TedRec Sequence-level Semantic Representation Fusion for Recommender Systems Embedding Utilization LLaMA2-7B (N), T5 (N) Link
2024.3 / CIKM'24 LLM-CF Large Language Models Enhanced Collaborative Filtering Embedding Utilization LLaMA2-7B (F) Link
2024.3 / CIKM'24 LoID Enhancing Content-based Recommendation via Large Language Model Embedding Utilization BERT (F) Link
2024.3 / arXiv'24 LSVCR A Large Language Model Enhanced Sequential Recommender for Joint Video and Comment Recommendation Embedding Utilization ChatGLM3-6B (F) Link
2024.3 / SIGIR'24 BAHE Breaking the Length Barrier: LLM-Enhanced CTR Prediction in Long Textual User Behaviors Embedding Utilization QWen-8B (F) N/A
2024.3 / SIGIR'24 LRD Sequential Recommendation with Latent Relations based on Large Language Model Embedding Utilization text-embedding-ada-002 (N) Link
2024.3 / WWW'24 SLIM Can Small Language Models be Good Reasoners for Sequential Recommendation? Model Initialization LLaMA2-7B (F) N/A
2024.3 / WWW'24 NoteLLM NoteLLM: A Retrievable Large Language Model for Note Recommendation Embedding Utilization LLaMA2-7B (F) N/A
2024.5 / NeurIPS'24 LLM-ESR LLMESR: Large Language Models Enhancement for Long-tailed Sequential Recommendation Embedding Utilization / Embedding Guidance text-embedding-ada-002 (N) Link
2024.5 / WWW'24 SAID Enhancing sequential recommendation via LLM-based item semantic embedding learning Model Initialization LLaMA2-7B (F) N/A
2024.5 / arXiv'24 CELA CELA: Cost-Efficient Language Model Alignment for CTR Prediction Embedding Utilization OPT-1.3B (F) N/A
2024.5 / arXiv'24 DLLM2Rec Distillation Matters: Empowering Sequential Recommenders to Match the Performance of Large Language Models Model Distillation LLaMA2-7B (F) N/A
2024.5 / arXiv'24 DynLLM DynLLM: When Large Language Models Meet Dynamic Graph Recommendation Embedding Utilization QWen-max-1201 (N) + text-embedding-v2 (N) N/A
2024.5 / RecSys'24 EmbSum EmbSum: Leveraging the Summarization Capabilities of Large Language Models for Content-Based Recommendations Embedding Utilization T5-small (F) + Mistral-8*22B (N) N/A
2024.5 / arXiv'24 LEARN Knowledge Adaptation from Large Language Model to Recommendation for Practical Industrial Application Model Initialization Baichuan2-7B (N) N/A
2024.5 / arXiv'24 NoteLLM-2 NoteLLM-2: Multimodal Large Representation Models for Recommendation Embedding Utilization LLaMA2 (F) / QWen (F) N/A
2024.5 / arXiv'24 SLMRec SLMRec: Empowering Small Language Models for Sequential Recommendation Model Distillation LLaMA-7B (F) N/A
2024.6 / FCS'24 Laser Large Language Models Make Sample-Efficient Recommender Systems Embedding Utilization Mistral-7B (F) / Vicuna-7B (F) / Vicuna-13B (F) N/A
2024.6 / CIKM'24 LLM4MSR LLM4MSR: An LLM-Enhanced Paradigm for Multi-Scenario Recommendation Embedding Guidance ChatGLM-6B (N) Link
2024.6 / arXiv'24 TSLRec A Practice-Friendly Two-Stage LLM-Enhanced Paradigm in Sequential Recommendation Model Initialization LLaMA-13B (F) N/A
2024.7 / arXiv'24 AlphaRec Language Models Encode Collaborative Signals in Recommendation Embedding Utilization text-embedding-3-large (N) Link
2024.8 / arXiv'24 DaRec DaRec: A Disentangled Alignment Framework for Large Language Model and Recommender System Embedding Guidance GPT-3.5 (N) + text-embedding-ada-002 (N) N/A
2024.8 / RecSys'24 LARR LARR: Large Language Model Aided Real-time Scene Recommendation with Semantic Understanding Embedding Utilization / Embedding Guidance Baichuan-7B (F) N/A
2024.9 / arXiv'24 Flare FLARE: Fusing Language Models and Collaborative Architectures for Recommender Enhancement Embedding Utilization mT5 (N) N/A
2024.9 / arXiv'24 HLLM HLLM: Enhancing Sequential Recommendations via Hierarchical Large Language Models for Item and User Modeling Embedding Utilization TinyLLaMA-1.1B (F) / Baichuan2-7B (F) Link
2024.9 / AAAI'25 LLMEmb Large Language Model Empowered Embedding Generator for Sequential Recommendation Embedding Initialization LLaMA-7B (F) Link
2024.11 / arXiv'24 HARec HARec: Hyperbolic Graph-LLM Alignment for Exploration and Exploitation in Recommender Systems Embedding Guidance GPT-3.5 (N) + text-embedding-ada-02 (N) + LLaMA3-8B (N) N/A
2024.11 / arXiv'24 LLMGPR Unleashing the Power of Large Language Models for Group POI Recommendations Embedding Utilization LLaMA3-8B (F) N/A
2024.11 / arXiv'24 QARM QARM: Quantitative Alignment Multi-Modal Recommendation at Kuaishou Embedding Utilization Unknown N/A
2024.12 / arXiv'24 Molar Molar: Multimodal LLMs with Collaborative Filtering Alignment for Enhanced Sequential Recommendation Embedding Utilization QWen2-VL-2B (N) Link
2024.12 / arXiv'24 PRECISE PRECISE: Pre-training Sequential Recommenders with Collaborative and Semantic Information Embedding Utilization QWen2 (N) N/A
2024.12 / arXiv'24 PAD Pre-train, Align, and Disentangle: Empowering Sequential Recommendation with Large Language Models Embedding Utilization LLaMA3-8B (F) N/A
2025.1 / arXiv'25 RecG A Zero-Shot Generalization Framework for LLM-Driven Cross-Domain Sequential Recommendation Embedding Utilization LLaMA3-8B (N) N/A
2025.2 / arXiv'25 IRLLRec Intent Representation Learning with Large Language Model for Recommendation Embedding Guidance GPT-4o (N) / text-embedding-3-large Link
2025.3 / arXiv'25 LLMInit LLMInit: A Free Lunch from Large Language Models for Selective Initialization of Recommendation Embedding Initialization QWen2-1.5B N/A

Beside, we also conclude existing surveys about Large Language Model for Recommender Systems as follows.

LLM4RS Survey

Date / Venue Paper Institution Repo
2023.6 / WWWJ'24 A Survey on Large Language Models for Recommendation USTC, BOSS, HKUST Link
2023.6 / TOIS'24 How Can Recommender Systems Benefit from Large Language Models: A Survey SJTU, Noah's Ark Link
2023.7 / TKDE'24 Recommender Systems in the Era of Large Language Models (LLMs) PolyU, NUDT, Amazon, CityU, MSU N/A
2023.7 / WWWJ'24 When Large Language Models Meet Personalization: Perspectives of Challenges and Opportunities HKUST, BAAI, USTC, UESTC N/A
2024.9 / COLING'24 Large Language Models for Generative Recommendation: A Survey and Visionary Discussions HKBU, Rutgers N/A
2024.2 / arXiv'24 Foundation Models for Recommender Systems: A Survey and New Perspectives UNSW, Adobe, Gatech, ETH, CSIRO, UCSD N/A
2024.3 / arXiv'24 Exploring the Impact of Large Language Models on Recommender Systems: An Extensive Review SCU, Stanford, CMU N/A
2024.4 / arXiv'24 A Survey of Generative Search and Recommendation in the Era of Large Language Models PolyU, NUS, USTC, CAS, HIT N/A
2024.6 / arXiv'24 Survey for Landing Generative AI in Social and E-commerce Recsys – the Industry Perspectives Linkdin, Amazon, Tiktok, Rutgers, Microsoft N/A
2024.7 / arXiv'24 All Roads Lead to Rome: Unveiling the Trajectory of Recommender Systems Across the LLM Era Noah's Ark N/A

Releases

No releases published

Packages

No packages published