No article text was recorded for this version.
soft label distillation
Version 2 of 2425 papers545 conceptsfrozen 2026-10-04
Papers in this version
- Blog: Rectified Decoupled Dataset Distillation: A Closer Look for Fair and Comprehensive Evaluation
- Blog: CKD-EHR:Clinical Knowledge Distillation for Electronic Health Records
- Blog: Knowledge Distillation of LLM for Education
- Blog: A Label is Worth A Thousand Images in Dataset Distillation
- Blog: One Model to Recognize Them All: Marginal Distillation from NER Models with Different Tag Sets
- Blog: Hybrid Dynamic Contrast and Probability Distillation for Unsupervised Person Re-Id
- Blog: DualNet: Robust Self-Supervised Stereo Matching with Pseudo-Label Supervision
- Blog: Large-Scale Domain Adaptation via Teacher-Student Learning
- Blog: Domain Adaptation Through Task Distillation
- Blog: Semi-supervised Domain Adaptation based on Dual-level Domain Mixing for Semantic Segmentation
- Blog: RocketQAv2: A Joint Training Method for Dense Passage Retrieval and Passage Re-ranking
- Blog: Self-training Improves Pre-training for Natural Language Understanding
- Blog: Domain Adaptation via Teacher-Student Learning for End-to-End Speech Recognition
- Blog: Align and Distill: Unifying and Improving Domain Adaptive Object Detection
- Blog: Collaborative Distillation for Top-N Recommendation
- Blog: Distilling Knowledge Using Parallel Data for Far-field Speech Recognition
- Blog: LMTurk: Few-Shot Learners as Crowdsourcing Workers in a Language-Model-as-a-Service Framework
- Blog: Knowledge Distillation for End-to-End Monaural Multi-Talker ASR System
- Blog: Self-supervision on Unlabelled or Data for Multi-person 2D/3D Human Pose Estimation
- Blog: Learning Proposals for Practical Energy-Based Regression
- Blog: Why distillation helps: a statistical perspective
- Blog: Few-Shot Learning with a Strong Teacher
- Blog: Teacher-Student Framework Enhanced Multi-domain Dialogue Generation
- Blog: Multi-Task Learning of Pairwise Sequence Classification Tasks over Disparate Label Spaces
- Blog: BERTtoCNN: Similarity-preserving enhanced knowledge distillation for stance detection
- Blog: Cross-Lingual Knowledge Distillation for Answer Sentence Selection in Low-Resource Languages
- Blog: MonoSIM: Simulating Learning Behaviors of Heterogeneous Point Cloud Object Detectors for Monocular 3D Object Detection
- Blog: Revisiting Adversarial Robustness Distillation: Robust Soft Labels Make Student Better
- Blog: Real-Time Aerial Fire Detection on Resource-Constrained Devices Using Knowledge Distillation
- Blog: Progressive Label Distillation: Learning Input-Efficient Deep Neural Networks
- Blog: Model Mimic Attack: Knowledge Distillation for Provably Transferable Adversarial Examples
- Blog: Knockoff Nets: Stealing Functionality of Black-Box Models
- Blog: Dataset distillation for memorized data: Soft labels can leak held-out teacher knowledge
- Blog: Knowledge Distillation for Semi-supervised Domain Adaptation
- Blog: Boot and Switch: Alternating Distillation for Zero-Shot Dense Retrieval
- Blog: Synthetic Image Learning: Preserving Performance and Preventing Membership Inference Attacks
- Blog: Transferring Knowledge from a RNN to a DNN
- Blog: Single-/Multi-Source Cross-Lingual NER via Teacher-Student Learning on Unlabeled Data in Target Language
- Blog: Compression of CTC-Trained Acoustic Models by Dynamic Frame-Wise Distillation or Segment-Wise N-Best Hypotheses Imitation
- Blog: Knowledge Distillation and Student-Teacher Learning for Visual Intelligence: A Review and New Outlooks
- Blog: Revisiting Prompt Pretraining of Vision-Language Models
- Blog: Sample Efficient Reinforcement Learning via Large Vision Language Model Distillation
- Blog: Three for one and one for three: Flow, Segmentation, and Surface Normals
- Blog: Self-distillation for Surgical Action Recognition
- Blog: Distilling Knowledge from Deep Networks with Applications to Healthcare Domain
- Blog: DARD: Dice Adversarial Robustness Distillation against Adversarial Attacks
- Blog: Semi-Supervised End-to-End ASR via Teacher-Student Learning with Conditional Posterior Distribution
- Blog: Self-Supervised Knowledge Transfer via Loosely Supervised Auxiliary Tasks
- Blog: Progressive Joint Modeling in Unsupervised Single-Channel Overlapped Speech Recognition
- Blog: Cross-Lingual Knowledge Distillation for Answer Sentence Selection in Low-Resource Languages
- Blog: Scaling Down, Serving Fast: Compressing and Deploying Efficient LLMs for Recommendation Systems
- Blog: Dataset Distillation for Memorized Data: Soft Labels can Leak Held-Out Teacher Knowledge
- Blog: Single-/Multi-Source Cross-Lingual NER via Teacher-Student Learning on Unlabeled Data in Target Language
- Blog: End-to-End Speech Translation with Knowledge Distillation
- Blog: Noisy Self-Knowledge Distillation for Text Summarization
- Blog: Knowledge Distillation as Semiparametric Inference
- Blog: GPT3Mix: Leveraging Large-scale Language Models for Text Augmentation
- Blog: Rectified Decision Trees: Exploring the Landscape of Interpretable and Effective Machine Learning
- Blog: Black-box Source-free Domain Adaptation via Two-stage Knowledge Distillation
- Blog: Oracle Teacher: Towards Better Knowledge Distillation
Showing 60 of 425 papers.
History & citation
Current · Permanent link
Cite this direction
Latest version (a living page):
@misc{lacuna_soft_label_distillation_2c5ce380,
title = {soft label distillation},
author = {{Lacuna}},
howpublished = {Lacuna research direction},
year = {2026},
url = {https://lacuna.tiptreesystems.com/direction/soft-label-distillation/rdr_2c5ce380ae6048ed9bff6afd87174d32},
note = {Latest version of a living research direction; cite a version for a fixed text. Accessed 2026-11-22},
}This exact version (version 2, frozen text):
@misc{lacuna_soft_label_distillation_2c5ce380_v2,
title = {soft label distillation},
author = {{Lacuna}},
howpublished = {Lacuna research direction},
year = {2026},
url = {https://lacuna.tiptreesystems.com/direction/soft-label-distillation/rdr_2c5ce380ae6048ed9bff6afd87174d32/v/2},
note = {Version 2, frozen 2026-10-04. Accessed 2026-11-22},
}