No article text was recorded for this version.
truncated distribution matching
Version 1 of 137 papers48 conceptsfrozen 2026-10-04
Papers in this version
- Blog: FIRST: Teach A Reliable Large Language Model Through Efficient Trustworthy Distillation
- Blog: FDBPL: Faster Distillation-Based Prompt Learning for Region-Aware Vision-Language Models Adaptation
- Blog: Sparse Logits Suffice to Fail Knowledge Distillation
- Blog: Distilling Knowledge Learned in BERT for Text Generation
- Blog: DUET: DISTILLED LLM UNLEARNING FROM AN EFFICIENTLY CONTEXTUALIZED TEACHER
- Blog: TinyViT: Fast Pretraining Distillation for Small Vision Transformers
- Blog: Apertus LLM Family Expansion via Distillation and Quantization
- Blog: Pre-training Distillation for Large Language Models: A Design Space Exploration
- Blog: Lightweight Task-Oriented Semantic Communication Empowered by Large-Scale AI Models
- Blog: Sparse Logit Sampling: Accelerating Knowledge Distillation in LLMs
- Blog: Transferring knowledge from a RNN to a DNN
- Blog: OSTQuant: Refining Large Language Model Quantization with Orthogonal and Scaling Transformations for Better Distribution Fitting
- Blog: Lossless Vocabulary Reduction for Auto-Regressive Language Models
- Blog: Make a Long Image Short: Adaptive Token Length for Vision Transformers
- Blog: Efficient Knowledge Distillation for RNN-Transducer Models
- Blog: Multi-Level Optimal Transport for Universal Cross-Tokenizer Knowledge Distillation on Language Models
- Blog: FastDraft: How to Train Your Draft
- Blog: EMA Policy Gradient: Taming Reinforcement Learning for LLMs with EMA Anchor and Top-k KL
- Blog: Conformal Sparsification for Bandwidth-Efficient Edge-Cloud Speculative Decoding
- Blog: Distilling Knowledge for Search-based Structured Prediction
- Blog: Effective Distillation to Hybrid xLSTM Architectures
- Blog: Multilingual Neural Machine Translation with Knowledge Distillation
- Blog: Ensemble Distillation for Structured Prediction: Calibrated, Accurate, Fast - Choose Three
- Blog: MixFormerV2: Efficient Fully Transformer Tracking
- Blog: EMA Policy Gradient: Taming Reinforcement Learning for LLMs with EMA Anchor and Top-k KL
- Blog: On Knowledge Distillation for Direct Speech Translation
- Blog: Entropy-Aware On-Policy Distillation of Language Models
- Blog: Efficiently Computing Susceptibility to Context in Language Models
- Blog: CED: Consistent ensemble distillation for audio tagging
- Blog: Sparse Teachers Can Be Dense with Knowledge
- Blog: TEDDY: Trimming Edges with Degree-based Discrimination Strategy
- Blog: Ranking Distillation: Learning Compact Ranking Models With High Performance for Recommender System
- Blog: Beyond Next Token Probabilities: Learnable, Fast Detection of Hallucinations and Data Contamination on LLM Output Distributions
- Blog: Towards Understanding and Improving Knowledge Distillation for Neural Machine Translation
- Blog: Distilling Knowledge from Large-Scale Image Models for Object Detection
- Blog: A Universal Detection Method for Adversarial Examples and Fake Images
- Blog: DSD²: Can We Dodge Sparse Double Descent and Compress the Neural Network Worry-Free?
History & citation
Current · Permanent link
- This direction split from Sparse Logit Distillation for Efficient Model Alignment (68% overlap)
Cite this direction
Latest version (a living page):
@misc{lacuna_truncated_distribution_matching_9f938eb1,
title = {truncated distribution matching},
author = {{Lacuna}},
howpublished = {Lacuna research direction},
year = {2026},
url = {https://lacuna.tiptreesystems.com/direction/truncated-distribution-matching/rdr_9f938eb1482841f294462c72e26744d3},
note = {Latest version of a living research direction; cite a version for a fixed text. Accessed 2026-11-22},
}This exact version (version 1, frozen text):
@misc{lacuna_truncated_distribution_matching_9f938eb1_v1,
title = {truncated distribution matching},
author = {{Lacuna}},
howpublished = {Lacuna research direction},
year = {2026},
url = {https://lacuna.tiptreesystems.com/direction/truncated-distribution-matching/rdr_9f938eb1482841f294462c72e26744d3/v/1},
note = {Version 1, frozen 2026-10-04. Accessed 2026-11-22},
}