No article text was recorded for this version.
distributional knowledge distillation
Version 1 of 122 papers28 conceptsfrozen 2026-10-04
Papers in this version
- Blog: SD$^2$: Self-Distilled Sparse Drafters
- Blog: Recurrent Drafter for Fast Speculative Decoding in Large Language Models
- Blog: Spec-LLaVA: Accelerating Vision-Language Models with Dynamic Tree-Based Speculative Decoding
- Blog: SpecForge: A Flexible and Efficient Open-Source Training Framework for Speculative Decoding
- Blog: Faster Speculative Decoding via Effective Draft Decoder with Pruned Candidate Tree
- Blog: ReActNet: Towards Precise Binary Neural Network with Generalized Activation Functions
- Blog: Self-Updatable Large Language Models by Integrating Context into Model Parameters
- Blog: Distribution Backtracking Builds A Faster Convergence Trajectory for Diffusion Distillation
- Blog: Noisy Self-Training with Synthetic Queries for Dense Retrieval
- Blog: Speculative Decoding: Exploiting Speculative Execution for Accelerating Seq2seq Generation
- Blog: CR-UTP: Certified Robustness against Universal Text Perturbations on Large Language Models
- Blog: GRIFFIN: Effective Token Alignment for Faster Speculative Decoding
- Blog: RAPID: Long-Context Inference with Retrieval-Augmented Speculative Decoding
- Blog: Specializing Smaller Language Models towards Multi-Step Reasoning
- Blog: Deep Transferring Quantization
- Blog: Speculative Decoding with CTC-based Draft Model for LLM Inference Acceleration
- Blog: Improving Zero-Shot Generalization of Learned Prompts via Unsupervised Knowledge Distillation
- Blog: Knowledge Distillation for Closed-Source Language Models
- Blog: DALD: Improving Logits-based Detector without Logits from Black-box LLMs
- Blog: ENGINE: Energy-Based Inference Networks for Non-Autoregressive Machine Translation
- Blog: An Efficient Private GPT Never Autoregressively Decodes
- Blog: Distill BERT to Traditional Models in Chinese Machine Reading Comprehension (Student Abstract)
History & citation
Current · Permanent link
Cite this direction
Latest version (a living page):
@misc{lacuna_distributional_knowledge_distillation_eca25c03,
title = {distributional knowledge distillation},
author = {{Lacuna}},
howpublished = {Lacuna research direction},
year = {2026},
url = {https://lacuna.tiptreesystems.com/direction/distributional-knowledge-distillation/rdr_eca25c03c38047079d562b8b60aba7d8},
note = {Latest version of a living research direction; cite a version for a fixed text. Accessed 2026-11-19},
}This exact version (version 1, frozen text):
@misc{lacuna_distributional_knowledge_distillation_eca25c03_v1,
title = {distributional knowledge distillation},
author = {{Lacuna}},
howpublished = {Lacuna research direction},
year = {2026},
url = {https://lacuna.tiptreesystems.com/direction/distributional-knowledge-distillation/rdr_eca25c03c38047079d562b8b60aba7d8/v/1},
note = {Version 1, frozen 2026-10-04. Accessed 2026-11-19},
}