“Where Does This Strange Smell Come from?”: Enabling Conversational Interfaces for Artificial Olfaction

Xueyi Zhou, Qi Lu, Dong-Kyu Chae

TL;DR

This paper introduces CIAO, a novel system that enables conversational interfaces for Artificial Olfaction (AO) in smart homes. By leveraging Large Language Models (LLMs) and a new olfaction-specific corpus, CIAO allows for natural, multi-turn interactions to classify odors and localize their sources, moving beyond simple data visualization.

What Problem Does This Paper Address?

Existing Artificial Olfaction (AO) systems primarily focus on odor classification (OC) and odor source localization (OSL), often using dedicated hardware and presenting results through basic dashboards or mobile apps. While effective for specific tasks, these systems lack natural interaction capabilities and fail to integrate seamlessly into smart home environments, which are characterized by diverse obstacles and the need for intuitive user experiences. Furthermore, current AO research often lacks comprehensive datasets for evaluating LLM integration, particularly for conversational scenarios. This paper addresses the gap by proposing a conversational interface for AO that can understand context, answer questions naturally, and leverage LLMs as intelligent agents within a smart home setting.

Methods

The core of the CIAO system is its integration of AO capabilities with LLM-based conversational agents. The system utilizes a multi-end olfactory sensory network composed of e-noses. Dedicated models for OC and OSL were trained on a custom dataset. These models are integrated into a data API within an IoT system, which is then accessed by LLMs acting as Model Context Protocol (MCP) clients. The authors developed a novel olfaction-oriented corpus for evaluating LLM performance in this domain. Five commercial LLMs were tested as MCP clients, prompted to act as smart housekeepers capable of invoking API tools.

Datasets

The paper introduces a new olfaction-oriented corpus for evaluating LLM capabilities in AO tasks. This corpus includes questions of various types (open-end, closed-end, factual, fill-in-the-blank, tag) and emotions (anger, fear, sadness, enjoyment, disgust, surprise). The dataset for training the OC and OSL models was collected using self-developed e-noses, featuring samples of three Korean beers (Cass, Kelly, Terra) placed at different positions.

Key Insights and Ideas

  • Conversational AO is feasible: The study demonstrates that LLMs can effectively power conversational interfaces for AO, enabling natural interactions for odor detection tasks.
  • LLMs can act as intelligent agents: By integrating with AO tools via an MCP, LLMs can act as sophisticated "smart housekeepers," interpreting sensor data and responding to user queries contextually.
  • A dedicated corpus is crucial: The creation of an olfaction-specific question corpus is vital for systematically evaluating LLM performance in this domain, going beyond general QA benchmarks.
  • LLM performance varies significantly: Different LLMs exhibit distinct strengths and weaknesses in tool use, contextual understanding, and response quality, highlighting the importance of model selection for specific applications.

Key Results

  • Technical Feasibility: The CIAO system is technically feasible and applicable in smart home scenarios.
  • LLM Performance:
    • ChatGPT-4o demonstrated superior performance in terms of answer quality and overall LLM usability in pervasive IoT scenarios. It achieved high tool use accuracy (≥ 90%) and generally provided concise, accurate responses.
  • Qwen-Plus showed promise for robot-compatible applications, exhibiting good empathy and conversational capabilities.
  • DeepSeek-V3 and Gemini-2.0-Flash showed some limitations in satisfaction and helpfulness, with Gemini-2.0-Flash exhibiting notable issues with lexical generalization.
  • Model Accuracy: The trained OC and OSL models, when combined with a majority-voting mechanism, achieved 100% accuracy.

Limitations and Future Work

  • Odor Sample Limitations: The current system and dataset are primarily based on beer odor samples due to safety constraints. The authors acknowledge the need to expand this to a wider range of odors for broader applicability.
  • Domain Adaptation: The current system relies on general-purpose LLMs. Future work aims to build an olfaction-specific LLM, which could improve comprehension and reduce errors related to domain-specific knowledge.
  • Expert Knowledge Integration: The system currently lacks explicit integration of olfaction/task-related expert knowledge, which could further enhance performance.
  • Future Directions: The authors plan to develop an olfaction-specific LLM, incorporate visual aids (e.g., visual reality), customize prompts for different answering styles, and enhance LLM capabilities for handling uncertain recognition. They also aim to expand experiments to other applications like hazardous gas detection.

Summary updated

Abstract

Existing Artificial Olfaction (AO) primarily serves two tasks: Odor Classification (OC) and Odor Source Localization (OSL). Both tasks wrt indoor event detection scenarios are studied either using a single electronic nose (enose) mounted on the ceiling or mobile robot (s) equipped with e-noses. However, they are not compatible with smart home scenarios due to diverse obstacles (eg, chairs and tables) and the need for natural interaction. In this paper, we explore the feasibility and usability of a Conversational Interfaces for Artificial Olfaction (CIAO) system using Large Language Models (LLMs) in Smart Home. We made the first olfaction-oriented corpus for LLM evaluation, as well as an olfaction dataset via a self-developed olfactory sensory network. We train the dedicated models for OSL and OC using the dataset and integrate them into a tool within the MCP (Model Context Protocol) server. Five commercial LLMs are used as MCP clients for experiments and validation. Our experimental results indicate that our CIAO system is technically feasible and applicable. Besides, we observe that ChatGPT-4o relatively outperforms in terms of both answer quality and overall LLM usability in pervasive IoT scenarios. Qwen-Plus, in contrast, appears to be a promising solution for robot-compatible applications. To our knowledge, this work is the first effort to bring forward conversational interfaces for AO, enabling multi-turn conversations with contexts beyond one-off question answering. Our codes and partial corpus are available at https://github. com/HokyeeJau/CIAO.
BibTeX
@inproceedings{zhou2025where,
  author = {Xueyi Zhou and Qi Lu and Dong-Kyu Chae},
  title = {{“Where Does This Strange Smell Come from?”: Enabling Conversational Interfaces for Artificial Olfaction}},
  booktitle = {Conference on Empirical Methods in Natural Language Processing},
  year = {2025},
}
Figure