Abstract
This study evaluates the use of novel optomyography (OMG) based smart glasses, OCOsense™, for the monitoring and recognition of facial expressions. Experiments were conducted on data gathered from 27 young adult participants performing expressions including smiling, frowning, raising eyebrows, and squeezing eyes. The statistical analysis demonstrated that OMG sensors capture distinct variations in cheek and brow movements with high accuracy. A machine learning model trained on this data achieved an overall accuracy of 93% (0.90 F1-score) using leave-one-subject-out cross-validation, maintaining robustness across variations in expression intensity, head movement, and glasses positioning.
Introduction: The Challenge of Facial Expression Recognition
Facial expression recognition (FER) is a cornerstone of affective computing, with significant implications for mental health monitoring and human-computer interaction. However, current sensing methods face a "Goldilocks" problem. Camera-based systems raise privacy concerns and struggle in low light or during head movement. Conversely, Electromyography (EMG) is highly accurate but requires intrusive electrodes attached to the face. This paper investigates whether Optomyography (OMG)—which uses optical sensors to measure the mechanical movement of the skin from a distance—can bridge this gap by being non-contact, privacy-sensitive, and wearable.
Methods and Hardware
The researchers evaluated the OCOsense™ glasses, which integrate six OMG sensors positioned to monitor key facial muscles: the frontalis (forehead/eyebrows), zygomaticus (cheeks/smiling), and corrugator (between eyebrows).
The technical approach involved sophisticated signal processing to remove linear drift and calculate 3D skin movement magnitudes. A Random Forest model was trained on 162 statistical features extracted from 18 sensor streams. To ensure the model could generalize to new users, the team utilized a "leave-one-subject-out" (LOSO) cross-validation technique on a dataset of 27 healthy volunteers.
Experimental Design
Participants performed expressions across three distinct tasks to simulate real-world conditions:
- Intensity and Duration: Variations between low/high intensity and short/long durations.
- Head Movement: Expressions performed while moving the head (up, down, left, right).
- Glasses Fit: Testing three different physical positions on the nose bridge (low, medium, high).
Results and Discussion: Muscle Fingerprints
A key insight from the study is the identification of distinct "muscle fingerprints" for specific expressions. The OMG sensors, which boast a high resolution down to ±4.0μm, allowed the team to quantify these differences statistically.
As shown in the data, smiles and squeezed eyes are primarily "cheek-heavy" movements, while frowns and eyebrow raises are "brow-heavy." The system achieved impressive quantitative benchmarks:
- Overall Accuracy: 93%.
- Movement Immunity: Performance remained stable at 92% accuracy even during active head movement, suggesting the glasses are viable for "in-the-wild" use.
- Fit Sensitivity: The study found that a "high" fit on the bridge of the nose yielded the best results for upper-face expressions like frowns.
Conclusion and Future Work
The OCOsense™ glasses demonstrate that OMG is a robust technology for wearable FER. While this study focused on voluntary, posed expressions, it lays the groundwork for detecting spontaneous emotional reactions. Future research will focus on expanding demographic diversity and validating the glasses as a clinical tool for longitudinal monitoring of mood disorders, where facial expression patterns serve as critical clinical markers.
Summary updated