Question-Aware Knowledge Graph Prompting for Large Language Models
Its authors withdrew this paper, so there is no full text to read or summarize.
Lists
Only you see this
Abstract
Large Language Models (LLMs) have demonstrated significant advancements in various natural language processing tasks, yet they often struggle with tasks that require external domain-specific knowledge, such as Multiple Choice Question Answering (MCQA). Integrating Knowledge Graphs (KGs) with LLMs has been explored as a solution to enhance LLMs' reasoning capabilities, while existing methods either involve computationally expensive finetuning processes or rely on the noisy retrieval of KG information. Recent efforts have focused on leveraging Graph Neural Networks (GNNs) to generate KG-based soft prompts for LLMs, which face challenges of lacking question-relevance assessment in GNN and utilization of relations among options. In this paper, we propose a novel approach, QAP, to address these challenges by optimizing the utilization of KG in MCQA tasks. Our method introduces question embeddings into the GNN aggregation process, enabling the model to assess the relevance of KG information based on the question context. Additionally, QAP facilitates inter-option interactions by employing an attention module that explicitly models relationships between answer options. Specifically, we use multiple attention heads for the GNN output, allowing the model to capture and compare features across different options, thereby enhancing cross-option reasoning. Our approach not only enhances the connection between GNNs and LLMs but also enables the model to better utilize the relationships between answer options. Experimental results demonstrate that QAP outperforms state-of-the-art models on multiple public MCQA datasets, validating its effectiveness and scalability.
BibTeX
@misc{liu2025question,
author = {Haochen Liu and Song Wang and Chen Chen and Jundong Li},
title = {{Question-Aware Knowledge Graph Prompting for Large Language Models}},
year = {2025},
url = {https://openreview.net/forum?id=ds3Tcnrte8},
howpublished = {OpenReview},
note = {Submitted to ICLR 2025},
}Loading related content...