Enabling Large Language Models to Think Twice When Its Answer Is Unreliable: A Case Study In Cancer Screening
Lists
Only you see this
Abstract
To enhance the accuracy and reliability of the response of large language models (LLMs) in professional domain-specific question answering, this paper proposes an approach to enhance the capabilities of LLMs by prompting them to "think twice." This methodology encourages a second-pass processing, allowing for deeper analysis and more refined outputs. We developed a prototype-logic-inspired query optimizer (PQO) to enhance the response of LLM. It refines initial queries using few-shot learning and self-reflection, leading to more insightful questions. Our experimental results show that the proposed approach obtains empirically validated answers.
BibTeX
@inproceedings{wu2023enabling,
author = {Minchong Wu and Hongxiang Lin and Xiaoqing Lyu and Chenrui Zhang and Sun Yu},
title = {{Enabling Large Language Models to Think Twice When Its Answer Is Unreliable: A Case Study In Cancer Screening}},
booktitle = {BIBM},
year = {2023},
url = {https://openreview.net/forum?id=vgvzaj0AOi},
}Loading related content...