Retrieval Information Injection for Enhanced Medical Report Generation
Lists
Only you see this
Abstract
Automatically generating medical reports is an effective solution to the diagnostic bottleneck caused by physician shortage. Existing methods have demonstrated exemplary performance in generating high-textual-quality reports. Due to the high similarity among medical images as well as the structural and content homogeneity of medical reports, these methods often make it difficult to fully capture the semantic information in medical images. To address this issue, we propose a training-free Retrieval Information injectioN (RIN) method by simulating the process of Multidisciplinary Consultation. The essence of this method lies in fully utilizing similar reports of target images to enhance the performance of pre-trained medical report generation models. Specifically, we first retrieve images most similar to the target image from a pre-constructed image feature database. Then, the reports corresponding to these images are inputted into a report generator of the pre-trained model, obtaining the distributions of retrieved reports. RIN generates final reports by integrating prediction distributions of the pre-trained model and the average distributions of retrieved reports, thereby enhancing the accuracy and reliability of the generated report. Comprehensive experimental results demonstrate that RIN significantly enhances clinical efficacy in chest X-rays report generation task. Compared to the current state-of-the-art methods, it achieves competitive results.
BibTeX
@misc{liu2025retrieval,
author = {Jinghao Liu and Cong Lei and Xiaojun Chang and Linchao Zhu},
title = {{Retrieval Information Injection for Enhanced Medical Report Generation}},
year = {2025},
url = {https://openreview.net/forum?id=JNh8CCDugm},
howpublished = {OpenReview},
note = {Submitted to ICLR 2025},
}