No article text was recorded for this version.
multi-teacher distillation interference
Version 1 of 134 papers40 conceptsfrozen 2026-10-04
Papers in this version
- Blog: From Mimicking to Integrating: Knowledge Integration for Pre-Trained Language Models
- Blog: Learning from All: Concept Alignment for Autonomous Distillation from Multiple Drifting MLLMs
- Blog: Theia: Distilling Diverse Vision Foundation Models for Robot Learning
- Blog: Merge-of-Thought Distillation
- Blog: CDFKD-MFS: Collaborative Data-free Knowledge Distillation via Multi-level Feature Sharing
- Blog: All-in-One: Transferring Vision Foundation Models into Stereo Matching
- Blog: Boosting Graph Neural Networks via Adaptive Knowledge Distillation
- Blog: Reinforced Multi-teacher Knowledge Distillation for Efficient General Image Forgery Detection and Localization
- Blog: Ensemble Distillation for Unsupervised Constituency Parsing
- Blog: Swiss Army Knife: Synergizing Biases in Knowledge from Vision Foundation Models for Multi-Task Learning
- Blog: Turning Drift into Constraint: Robust Reasoning Alignment in Non-Stationary Multi-Stream Environments
- Blog: Exploring Knowledge Purification in Multi-Teacher Knowledge Distillation for LLMs
- Blog: Customizing Student Networks From Heterogeneous Teachers via Adaptive Knowledge Amalgamation
- Blog: Graph Consistency Based Mean-Teaching for Unsupervised Domain Adaptive Person Re-Identification
- Blog: Layer Pruning on Demand with Intermediate CTC
- Blog: Knowledge Distillation Meets Open-Set Semi-supervised Learning
- Blog: Improving the recall of biomedical named entity recognition with label re-correction and knowledge distillation
- Blog: UNIC: Universal Classification Models via Multi-teacher Distillation
- Blog: GOVERN: Gradient Orientation Vote Ensemble for Multi-Teacher Reinforced Distillation
- Blog: Learning Lightweight Object Detectors via Multi-Teacher Progressive Distillation
- Blog: MoVE-KD: Knowledge Distillation for VLMs with Mixture of Visual Encoders
- Blog: FuseChat: Knowledge Fusion of Chat Models
- Blog: Hawaii: Hierarchical Visual Knowledge Transfer for Efficient Vision-Language Models
- Blog: One Teacher is Enough? Pre-trained Language Model Distillation from Multiple Teachers
- Blog: Mode-conditioning unlocks superior test-time compute scaling
- Blog: Distilling the Knowledge of Specialist Deep Neural Networks in Acoustic Scene Classification
- Blog: Contrastive Knowledge Amalgamation for Unsupervised Image Classification
- Blog: CIARD: Cyclic Iterative Adversarial Robustness Distillation
- Blog: EBBS: An Ensemble with Bi-Level Beam Search for Zero-Shot Machine Translation
- Blog: Enabling Visual Foundation Models to Teach Compact Students via Mixture of Distillation
- Blog: Multi-Knowledge Aggregation and Transfer for Semantic Segmentation
- Blog: An Unsupervised Multiple-Task and Multiple-Teacher Model for Cross-lingual Named Entity Recognition
- Blog: DMT: Comprehensive Distillation with Multiple Self-supervised Teachers
- Blog: CrossKD: Cross-Head Knowledge Distillation for Dense Object Detection
History & citation
Current · Permanent link
- This direction split from Resolving Teacher Interference in Multi-Teacher Knowledge Distillation (85% overlap)
Cite this direction
Latest version (a living page):
@misc{lacuna_multi_teacher_distillation_interference_a6b2af69,
title = {multi-teacher distillation interference},
author = {{Lacuna}},
howpublished = {Lacuna research direction},
year = {2026},
url = {https://lacuna.tiptreesystems.com/direction/multi-teacher-distillation-interference/rdr_a6b2af6935b2417685017c9d5486376a},
note = {Latest version of a living research direction; cite a version for a fixed text. Accessed 2026-11-20},
}This exact version (version 1, frozen text):
@misc{lacuna_multi_teacher_distillation_interference_a6b2af69_v1,
title = {multi-teacher distillation interference},
author = {{Lacuna}},
howpublished = {Lacuna research direction},
year = {2026},
url = {https://lacuna.tiptreesystems.com/direction/multi-teacher-distillation-interference/rdr_a6b2af6935b2417685017c9d5486376a/v/1},
note = {Version 1, frozen 2026-10-04. Accessed 2026-11-20},
}