Multi-Surrogate-Teacher Assistance for Representation Alignment in Fingerprint-Based Indoor Localization

Son Minh Nguyen, Tran Duy Linh, Duc Viet Le, Paul J. M. Havinga

TL;DR

This paper introduces a "Plug-and-Play" (PnP) framework that significantly boosts the accuracy of indoor localization by allowing models to "borrow" knowledge from existing WiFi fingerprint datasets. By using multiple surrogate generative teachers to align representations, the researchers achieved an 11% to 20% reduction in localization error across various neural architectures without requiring direct access to the original source data during target training.

What Problem Does This Paper Address?

Indoor localization often relies on Received Signal Strength (RSS) fingerprinting—essentially a "map" of WiFi or Bluetooth signal strengths at specific locations. While deep learning has made great strides here, these models are notoriously brittle. A model trained for Building A (with 500 WiFi anchors and a specific layout) usually fails miserably in Building B (with 200 anchors and different wall materials).

The core challenge is non-conformity: RSS datasets vary wildly in input size, anchor disposition, and environmental noise. Traditional transfer learning fails because the feature spaces are too different. Consequently, most state-of-the-art models remain "isolated" in the specific environments where they were trained, unable to leverage the vast amount of data available from other buildings.

Methods

The authors propose a two-phase framework designed to foster "environment-insensitive" representations:

  1. Expert Training Phase: Instead of transferring raw data, the researchers train surrogate generative teachers (using WGANs) to model the representation spaces of various source datasets. These teachers act as a "global adapter," homogenizing disparate inputs while preserving the unique characteristics of the source environments.
  2. Expert Distilling Phase: The specialized model (the "student") is trained on the target dataset. However, its learning is guided by a triplet of unsupervised constraints that align its internal representations with those of the surrogate teachers:
  3. Angular Similarity ($J_{Sim}$): Ensures the "direction" of the learned feature vectors matches the teachers.
  4. Cross-Mutual Information ($J_{MI}$): Maximizes the shared essential knowledge between the target and source representations while filtering out environment-specific noise.
  5. Functional Information ($J_{FI}$): A novel constraint using the Lipschitz constant (estimated via the Power Iteration Method) to match the functional sensitivity and robustness of the networks.

This PnP scheme is architecture-agnostic, meaning it can be "plugged" into existing DNNs, CNNs, or Transformers.

Datasets

The framework was evaluated on three major benchmark WiFi RSS fingerprint datasets:

  • UJIIndoorLoc: A massive multi-building, multi-floor campus dataset (approx. 110,000 $m^2$).
  • UTS: A dataset collected in a smaller, more controlled area.
  • Tampere: A large-scale dataset characterized by high anchor sparsity (992 total anchors, but only a fraction active at any time).

Key Insights and Ideas

  • Knowledge over Raw Data: By distilling knowledge through surrogate teachers rather than direct data transfer, the framework sidesteps privacy concerns and the technical nightmare of resizing heterogeneous RSS inputs.
  • The Power of Lipschitz: Using the spectral norm to align "Functional Information" is a clever way to transfer the robustness of a model. It ensures the student network reacts to signal perturbations in a similar way to the "expert" teachers.
  • Simplicity Wins: Interestingly, simpler models like basic DNNs often saw the most dramatic improvements (up to 14.67% in MAE), sometimes even outperforming more complex architectures after receiving "assistance" from the framework.
  • Alignment as a Filter: The framework encourages the model to prioritize "transferable" features—those that are consistent across different buildings—effectively filtering out the environmental "clutter" that usually leads to overfitting.

Key Results

The "fully enhanced" versions of the models (denoted with +++) consistently outperformed their standalone counterparts:

  • Accuracy Boost: Mean Absolute Error (MAE) was reduced by 11% to 20% across different models.
  • Concrete Gains: In the UJIIndoorLoc dataset, a standard DNN's error dropped by 2.06 meters.
  • Reliability: The probability of the localization error being under 10 meters ($P(X < 10m)$) jumped from ~50-60% to 62-75% across the various datasets, making the systems much more viable for real-world use.
  • Stability: The framework significantly improved the 75th and 95th percentile error rates, indicating fewer "wild" miscalculations.

Limitations and Future Work

  • Transformer Discontinuity: The authors noted that the Functional Information ($J_{FI}$) constraint struggled with Transformer-based architectures (like bAaT) due to the Lipschitz discontinuity inherent in dot-product self-attention. For these models, they had to omit the $J_{FI}$ constraint to avoid performance degradation.
  • Small-Scale Diminishing Returns: While the framework worked everywhere, the gains were more marginal in smaller areas (like the UTS dataset) where there is less environmental complexity to "align" against.
  • Future Directions: The authors suggest exploring ways to adapt the functional information constraint specifically for the non-smooth nature of attention mechanisms in Transformers.

Summary updated

Abstract

Despite remarkable progress in knowledge transfer across visual and textual domains, extending these achievements to indoor localization, particularly for learning transferable representations among Received Signal Strength (RSS) fingerprint datasets, remains a challenge. This is due to inherent discrepancies among these RSS datasets, largely including variations in building structure, the input number and disposition of WiFi anchors11An anchor describes a radio-emitting source. (e.g., WiFi access points, Bluetooth beacons.). Accordingly, specialized networks, which were deprived of the ability to discern transferable representations, readily incorporate environment-sensitive clues into the learning process, hence limiting their potential when applied to specific RSS datasets. In this work, we propose a plug-and-play (PnP) framework of knowledge transfer, facilitating the exploitation of transferable representations for specialized networks directly on target RSS datasets through two main phases. Initially, we design an Expert Training phase, which features multiple surrogate generative teachers, all serving as a global adapter that homogenizes the input disparities among independent source RSS datasets while preserving their unique characteristics. In a subsequent Expert Distilling phase, we continue introducing a triplet of underlying constraints that requires minimizing the differences in essential knowledge between the specialized network and surrogate teachers through refining its representation learning on the target dataset. This process implicitly fosters a representational alignment in such a way that is less sensitive to specific environmental dynamics. Extensive experiments conducted on three benchmark WiFi RSS fingerprint datasets underscore the effectiveness of the framework that significantly exerts the full potential of specialized networks in localization22Our code is available at https://github.com/Minh-Son-Nguyen/RSS_TL..
BibTeX
@inproceedings{nguyen2025multi,
  author = {Son Minh Nguyen and Tran Duy Linh and Duc Viet Le and Paul J. M. Havinga},
  title = {{Multi-Surrogate-Teacher Assistance for Representation Alignment in Fingerprint-Based Indoor Localization}},
  booktitle = {IEEE/CVF Winter Conference on Applications of Computer Vision},
  year = {2025},
  url = {https://openreview.net/forum?id=Sx1FRETfeT},
}

Loading related content...

Figure