Development of Half-Mirror Interface System and Its Application for Ubiquitous Environment

Young-Joon Kwon, Daejin Kim, Sang Wan Lee, Zeungnam BienJournal of Control Automation and Systems Engineering 2005 · DOI

Abstract

As ubiquitous computing integrates technology into daily life, the demand for non-intrusive, human-friendly interfaces grows. This paper presents the Half-Mirror Interface System (HMIS), a novel man-machine interface that utilizes a half-mirror to transition between a functional mirror and a digital display. Equipped with a webcam, microphone, and speakers, the HMIS offers personalized services such as makeup assistance, weather updates, and health diagnostics based on Sasang constitutional medicine. Experimental results show high accuracy in constitutional classification (89.7%), demonstrating the system's potential as a versatile home interface.

Introduction

The paradigm of ubiquitous computing envisions technology embedded seamlessly into the human environment. However, traditional interfaces like monitors and keyboards often clash with domestic aesthetics. The HMIS addresses this by repurposing the mirror—a common household object—into a multi-functional interface. By leveraging the optical properties of a half-mirror, the system provides utility when the user is present and serves as a decorative element when idle.

System Design and Operation

The HMIS hardware comprises a half-mirror, an LCD panel, a USB webcam, a microphone, and speakers. The system's behavior is governed by two primary modes, determined by real-time face detection.

The half-mirror functions as a standard mirror when the internal display is dark, enabling the system's interactive mirror-mode.

Principal Modes

  1. Mirror-Mode (User Present): Activated upon face detection. It offers makeup assistance (magnifying facial features with TTS guidance), weather updates, and health diagnostics. Hands-free operation is enabled via voice recognition software.
  2. Display-Mode (User Absent): In the absence of a user, the system transitions to display-mode. The LCD panel displays decorative art, family photos, or "healing windows" accompanied by music designed for psychological relaxation.

Health Monitoring and Constitutional Classification

A key innovation of the HMIS is its health monitoring engine based on Sasang constitutional medicine. The system uses image processing to identify facial proportions and color variances in specific zones.

Facial region mapping used by the fuzzy logic system to perform health diagnostics based on traditional medical knowledge.

A fuzzy logic system classifies the user into one of three constitutional types: Tae-eumin, So-eumin, or So-yangin. It further analyzes skin tone (e.g., checking for redness in the "heart" zone or bluish tints in the "liver" zone) to assess current health status, providing an objective quantification of traditional medical observations.

Experimental Results

The HMIS was evaluated with 100 male subjects in their 20s. For constitution classification, data from 50 subjects was used for training and 50 for testing. The system achieved an average accuracy of 89.7% (100% for Tae-eumin, 85.7% for So-eumin, and 83.3% for So-yangin). This performance significantly exceeds the ~60% accuracy typical of traditional survey-based classification methods. Additionally, the system's health diagnostic mapping was verified against expert medical knowledge using reference facial images representing various health conditions.

Discussion and Future Work

While the HMIS offers a promising "human-friendly" interface, several challenges remain. The current color-based diagnostic system is sensitive to ambient lighting, which can vary significantly in home environments. Furthermore, the initial study's demographic focus on young men necessitates future work to include broader age groups and diverse skin tones. Future iterations will also incorporate larger clinical databases to refine the diagnostic accuracy of the fuzzy logic engine.

Summary updated

Abstract

In the era of ubiquitous computing, human-friendly man-machine interface is getting more attention due to its possibility to offer convenient services. For this, in this paper, we introduce a 'Half-Mirror Interface System (HMIS)' as a novel type of human-friendly man-machine interfaces. Basically, HMIS consists of half-mirror, USB-Webcam, microphone, 2ch-speaker, and high-speed processing unit. In our HMIS, two principal operation modes are selected by the existence of the user in front of it. The first one, 'mirror-mode', is activated when the user's face is detected via USB-Webcam. In this mode, HMIS provides three basic functions such as 1) make-up assistance by magnifying an interested facial component and TTS (Text-To-Speech) guide for appropriate make-up, 2) Daily weather information provider via WWW service, 3) Health monitoring/diagnosis service using Chinese medicine knowledge. The second one, 'display-mode' is designed to show decorative pictures, family photos, art paintings and so on. This mode is activated when the user's face is not detected for a time being. In display-mode, we also added a 'healing-window' function and 'healing-music player' function for user's psychological comfort and/or relaxation. All these functions are accessible by commercially available voice synthesis/recognition package.
BibTeX
@article{kwon2005development,
  author = {Young-Joon Kwon and Daejin Kim and Sang Wan Lee and Zeungnam Bien},
  title = {{Development of Half-Mirror Interface System and Its Application for Ubiquitous Environment}},
  journal = {Journal of Control Automation and Systems Engineering},
  year = {2005},
  doi = {10.5302/j.icros.2005.11.12.1020},
}
Figure