RB-SQL: A Retrieval-based LLM Framework for Text-to-SQL

Zhenhe Wu, Zhongqiu Li, Jie Zhang, Mengxiang Li, Yu Zhao, Ruiyu Fang, Zhongjiang He, Xuelong Li, Zhoujun Li, Shuangyong Song

Abstract

Large language models (LLMs) with in-context learning have significantly improved the performance of text-to-SQL task. Previous works generally focus on using exclusive SQL generation prompt to improve the LLMs' reasoning ability. However, they are mostly hard to handle large databases with numerous tables and columns, and usually ignore the significance of pre-processing database and extracting valuable information for more efficient prompt engineering. Based on above analysis, we propose RB-SQL, a novel retrieval-based LLM framework for in-context prompt engineering, which consists of three modules that retrieve concise tables and columns as schema, and targeted examples for in-context learning. Experiment results demonstrate that our model achieves better performance than several competitive baselines on public datasets BIRD and Spider.
BibTeX
@misc{wu2024rb,
  author = {Zhenhe Wu and Zhongqiu Li and Jie Zhang and Mengxiang Li and Yu Zhao and Ruiyu Fang and Zhongjiang He and Xuelong Li and Zhoujun Li and Shuangyong Song},
  title = {{RB-SQL: A Retrieval-based LLM Framework for Text-to-SQL}},
  year = {2024},
  eprint = {2407.08273},
  archivePrefix = {arXiv},
  url = {https://arxiv.org/abs/2407.08273},
}

Loading related content...

Figure