ERIS: An Energy-Guided Feature Disentanglement Framework for Out-of-Distribution Time Series Classification

Xin Wu, Fei Teng, Ji Zhang, Xingwang Li, Yuxuan Liang

TL;DR

This paper introduces ERIS, a novel framework for time series classification that tackles the challenge of out-of-distribution (OOD) data by disentangling domain-specific features from label-relevant ones. ERIS uses an energy-guided approach and weight-level orthogonality to achieve robust and generalizable representations, significantly outperforming existing methods.

What Problem Does This Paper Address?

Time series classification (TSC) models often struggle when faced with data that differs from their training distribution (OOD data). This failure stems from models learning "spurious correlations," where they associate specific features with labels that are actually tied to the data's origin (domain) rather than the underlying activity. For example, a model might learn to associate high signal energy with "running" because the training data features athletes with energetic movements, but this association breaks down when applied to an elderly person whose movements are less energetic. Feature disentanglement aims to solve this by separating domain-specific and label-relevant features, but current methods often lack the guidance to effectively isolate truly universal, domain-invariant features. This paper addresses the critical need for a guided approach to feature disentanglement that can lead to reliable OOD generalization in TSC.

Methods

ERIS is an end-to-end framework built on three key mechanisms:

  • Energy-Guided Calibration Mechanism: This is the core innovation. It uses energy functions (Domain-Specific Energy - DSE, and Label-Specific Energy - LSE) to provide semantic guidance. Lower energy values indicate better compatibility between features and their corresponding domain or label. This mechanism helps the model self-calibrate by assigning low energy to well-aligned features and high energy to poorly aligned ones. It also helps in detecting OOD samples by triggering high-energy responses, leading to lower confidence.
  • Weight-Level Orthogonality Strategy: This mechanism enforces structural independence between the projection matrices for domain-specific and label-relevant features. Unlike feature-level orthogonality, which is instance-specific, this global constraint on the model's weights ensures that the learned feature subspaces are decorrelated, preventing interference and promoting cleaner disentanglement.
  • Auxiliary Adversarial Generalization (AG) Mechanism: This component enhances robustness by injecting structured perturbations into the feature space. It uses an adversarial game to align features across domains and also smooths the latent feature space by making the model resilient to adversarial perturbations. This helps in learning domain-agnostic and locally invariant features.

The overall loss function, $L_{total}$, is a weighted sum of the losses from these components: $L_{total} = \lambda_1 L_{DSE} + \lambda_2 L_{LSE} + L_{ortho} + L_{reg}$.

Datasets

The paper evaluates ERIS on four large sensor benchmark datasets:

  • UCI-HAR: Smartphone sensor data for human activity recognition.
  • UniMiB-SHAR: Smartphone accelerometer data for fine-grained activity and fall recognition.
  • Opportunity: A multi-modal dataset for recognizing complex daily activities.
  • EMG: Electromyographic signals for hand gesture classification.

These datasets are chosen for their diverse domains and labels, making them suitable for evaluating OOD generalization capabilities.

Key Insights and Ideas

  • Semantic Guidance is Crucial: The paper strongly argues that mathematical constraints alone are insufficient for effective feature disentanglement. Semantic guidance, like the "physical energy" of a signal, is essential to anchor the separation process and isolate truly universal features.
  • Weight-Level Orthogonality is Key: The study highlights that enforcing orthogonality at the weight level, rather than just the feature level, provides a more robust guarantee of feature separation and significantly improves performance, especially for OOD scenarios.
  • Model Capacity is Not the Sole Determinant: ERIS demonstrates that effective OOD generalization is not solely dependent on model size. Even smaller models, when equipped with ERIS's guided disentanglement mechanisms, can achieve superior performance compared to larger, unguided models.
  • Energy as a Guide, Not Just a Detector: ERIS redefines the role of energy-based models, using energy scores not just for OOD detection but as a fundamental guide within the representation learning process.

Key Results

  • Superior Performance: ERIS significantly outperforms state-of-the-art (SOTA) methods across all four benchmark datasets, achieving the highest overall average accuracy of 75.47% and the best average rank of 1.375.
  • Robustness Across Architectures: ERIS shows consistent performance gains across different model architectures (MLP, CNN, Transformer), indicating its broad applicability.
  • Improved Calibration: ERIS achieves a lower Expected Calibration Error (ECE) of 0.12 compared to other energy-based methods, indicating more reliable model confidence estimates and mitigating overconfidence in OOD scenarios.
  • Effective Feature Disentanglement: t-SNE visualizations show that ERIS produces highly compact and well-separated clusters, with domain-specific features effectively discarded, leading to domain-invariant representations.
  • Ablation Study Confirmation: Ablation studies confirm that the weight-level orthogonality loss ($L_{ortho}$) is a pivotal component for achieving ERIS's peak performance, leading to substantial accuracy increases.

Limitations and Future Work

  • Theoretical Boundaries of Energy-Based Models: The authors suggest that future work could investigate the theoretical boundaries of energy-based modeling in the context of temporal uncertainty.
  • Hyperparameter Sensitivity: While the paper explores the impact of loss weighting factors ($\lambda_1, \lambda_2$), further research could delve deeper into the optimal tuning of these parameters for various scenarios.
  • Computational Cost: While not explicitly detailed as a limitation, the multi-component nature of ERIS might imply a higher computational cost during training compared to simpler models. The paper does mention that inference is simplified.

Summary updated

Abstract

An ideal time series classification (TSC) should be able to capture invariant representations, but achieving reliable performance on out-of-distribution (OOD) data remains a core obstacle. This obstacle arises from the way models inherently entangle domain-specific and label-relevant features, resulting in spurious correlations. While feature disentanglement aims to solve this, current methods are largely unguided, lacking the semantic direction required to isolate truly universal features. To address this, we propose an end-to-end Energy-Regularized Information for Shift-Robustness (ERIS) framework to enable guided and reliable feature disentanglement. The core idea is that effective disentanglement requires not only mathematical constraints but also semantic guidance to anchor the separation process. ERIS incorporates three key mechanisms to achieve this goal. Specifically, we first introduce an energy-guided calibration mechanism, which provides crucial semantic guidance for the separation, enabling the model to self-calibrate. Additionally, a weight-level orthogonality strategy enforces structural independence between domain-specific and label-relevant features, thereby mitigating their interference. Moreover, an auxiliary adversarial generalization mechanism enhances robustness by injecting structured perturbations. Experiments across four benchmarks demonstrate that ERIS achieves a statistically significant improvement over state-of-the-art baselines, consistently securing the top performance rank.
BibTeX
@article{wu2026eris,
  author = {Xin Wu and Fei Teng and Ji Zhang and Xingwang Li and Yuxuan Liang},
  title = {{ERIS: An Energy-Guided Feature Disentanglement Framework for Out-of-Distribution Time Series Classification}},
  journal = {Information Fusion},
  year = {2026},
  doi = {10.1016/j.inffus.2026.104407},
}
Figure