Two-Phase RAG-Based Chatbot for Italian Funding Application Assistance

Tommaso Boccato, Matteo Ferrante, Nicola ToschiPreprints.org 2024 · DOI

Abstract

Securing funding is a critical yet complex task for organizations and individuals. This study presents an innovative chatbot designed to streamline the process using advanced Natural Language Processing (NLP) techniques and, specifically, a Retrieval-Augmented Generation (RAG) pipeline optimized for real-world applications. Our chatbot assists users in identifying suitable public tenders for financial support through natural language queries and a comprehensive public data database. The chatbot operates in a two-stage interaction model, initially providing summarized tender information for exploratory brainstorming, followed by detailed data upon user selection. A custom filtering mechanism ensures that the user interface elements responsible for swapping the interaction stages are consistent with the responses generated by the conversational agent. Human-evaluation tests demonstrated an average accuracy of 90.4% in document retrieval, with an average of 2.11 interactions required to find a specific tender. User satisfaction, rated on a scale of 1 to 5, averaged 3.14 (±1.73), indicating generally positive user experience with room for improvement. This approach addresses challenges of relevance, accuracy, and conversational flow, resulting in a reliable chatbot that simplifies the process of finding funding opportunities.
BibTeX
@misc{boccato2024two,
  author = {Tommaso Boccato and Matteo Ferrante and Nicola Toschi},
  title = {{Two-Phase RAG-Based Chatbot for Italian Funding Application Assistance}},
  year = {2024},
  doi = {10.20944/preprints202406.1999.v1},
  howpublished = {Preprints.org},
}

Loading related content...

Figure