No article text was recorded for this version.
temperature-scaled distillation
Version 1 of 141 papers47 conceptsfrozen 2026-10-04
Papers in this version
- Blog: Revisiting Label Smoothing and Knowledge Distillation Compatibility: What was Missing?
- Blog: Dataset Distillation for Memorized Data: Soft Labels can Leak Held-Out Teacher Knowledge
- Blog: Revisiting Label Smoothing and Knowledge Distillation Compatibility: What was Missing?
- Blog: What's Left After Distillation? How Knowledge Transfer Impacts Fairness and Bias
- Blog: Acoustic Scene Classification Using Teacher-Student Learning with Soft-Labels
- Blog: Improving DNNs Trained with Non-Native Transcriptions Using Knowledge Distillation and Target Interpolation
- Blog: Neural Regularized Domain Adaptation for Chinese Word Segmentation
- Blog: Collaborative Distillation for Top-N Recommendation
- Blog: Exploiting Mixed Unlabeled Data for Detecting Samples of Seen and Unseen Out-of-Distribution Classes
- Blog: Tying Word Vectors and Word Classifiers: A Loss Framework for Language Modeling
- Blog: Knowledge distillation for incremental learning in semantic segmentation
- Blog: Hierarchical Retrieval: The Geometry and a Pretrain-Finetune Recipe
- Blog: Unifying distillation and privileged information David Lopez-Paz
- Blog: Revisiting Knowledge Distillation: The Hidden Role of Dataset Size
- Blog: Knowledge Distillation for Semi-supervised Domain Adaptation
- Blog: Viewpoint robust knowledge distillation for accelerating vehicle re-identification
- Blog: Model Compression for Faster Structural Separation of Macromolecules Captured by Cellular Electron Cryo-Tomography
- Blog: Label Efficient Learning of Transferable Representations acrosss Domains and Tasks
- Blog: Constructing Deep Spiking Neural Networks from Artificial Neural Networks with Knowledge Distillation
- Blog: Learning Topology Actions for Power Grid Control: A Graph-Based Soft-Label Imitation Learning Approach
- Blog: Application of Knowledge Distillation Based on Transfer Learning of ERNIE Model in Intelligent Dialogue Intention Recognition
- Blog: Multi Model-Based Distillation for Sound Event Detection
- Blog: Bayes Conditional Distribution Estimation for Knowledge Distillation Based on Conditional Mutual Information
- Blog: Knowledge Distillation for Improved Accuracy in Spoken Question Answering
- Blog: Ensemble Distribution Distillation
- Blog: A Knowledge Distillation-Based Approach to Enhance Transparency of Classifier Models
- Blog: Knowledge Distillation for Optimization of Quantized Deep Neural Networks
- Blog: Fast-ELECTRA for Efficient Pre-training
- Blog: Cosine Similarity Knowledge Distillation for Individual Class Information Transfer
- Blog: MaskCon: Masked Contrastive Learning for Coarse-Labelled Dataset
- Blog: Developing Multi-Task Recommendations with Long-Term Rewards via Policy Distilled Reinforcement Learning
- Blog: Regularizing Class-Wise Predictions via Self-Knowledge Distillation
- Blog: GIM: Improved Interpretability for Large Language Models
- Blog: Revisiting Label Smoothing Regularization with Knowledge Distillation
- Blog: Progressive Feature Alignment for Unsupervised Domain Adaptation.
- Blog: Emotion Recognition in Speech using Cross-Modal Transfer in the Wild
- Blog: Distilling the Undistillable: Learning from a Nasty Teacher
- Blog: Distillation as a Defense to Adversarial Perturbations against Deep Neural Networks
- Blog: Learning from Stochastic Teacher Representations Using Student-Guided Knowledge Distillation
- Blog: Supervision Complexity and its Role in Knowledge Distillation
- Blog: Temper-Then-Tilt: Principled Unlearning for Generative Models through Tempering and Classifier Guidance
History & citation
Current · Permanent link
- This direction split from Temperature Scaling for Knowledge Transfer and Regularization (66% overlap)
Cite this direction
Latest version (a living page):
@misc{lacuna_temperature_scaled_distillation_4e9acf78,
title = {temperature-scaled distillation},
author = {{Lacuna}},
howpublished = {Lacuna research direction},
year = {2026},
url = {https://lacuna.tiptreesystems.com/direction/temperature-scaled-distillation/rdr_4e9acf784bf64e4891a6a82aec7e7f70},
note = {Latest version of a living research direction; cite a version for a fixed text. Accessed 2026-11-19},
}This exact version (version 1, frozen text):
@misc{lacuna_temperature_scaled_distillation_4e9acf78_v1,
title = {temperature-scaled distillation},
author = {{Lacuna}},
howpublished = {Lacuna research direction},
year = {2026},
url = {https://lacuna.tiptreesystems.com/direction/temperature-scaled-distillation/rdr_4e9acf784bf64e4891a6a82aec7e7f70/v/1},
note = {Version 1, frozen 2026-10-04. Accessed 2026-11-19},
}