No article text was recorded for this version.
quantization-aware distillation
Version 2 of 2111 papers136 conceptsfrozen 2026-10-04
Papers in this version
- Blog: Collaborative Multi-Teacher Knowledge Distillation for Learning Low Bit-width Deep Neural Networks
- Blog: Quantized Feature Distillation for Network Quantization
- Blog: PTMQ: Post-training Multi-Bit Quantization of Neural Networks
- Blog: Training a Binary Weight Object Detector by Knowledge Transfer for Autonomous Driving
- Blog: Understanding and Improving Knowledge Distillation for Quantization Aware Training of Large Transformer Encoders
- Blog: Q-DM: An Efficient Low-bit Quantized Diffusion Model
- Blog: Collaborative Multi-Teacher Knowledge Distillation for Learning Low Bit-width Deep Neural Networks
- Blog: Toward Accurate Post-Training Quantization for Image Super Resolution
- Blog: CFD: Communication-Efficient Federated Distillation via Soft-Label Quantization and Delta Coding
- Blog: BitsFusion: 1.99 bits Weight Quantization of Diffusion Model
- Blog: Apprentice: Using Knowledge Distillation Techniques To Improve Low-Precision Network Accuracy
- Blog: Whisper-KDQ: A Lightweight Whisper via Guided Knowledge Distillation and Quantization for Efficient ASR
- Blog: HW-TSC's Submission for the WMT22 Efficiency Task
- Blog: Predicting Multi-Codebook Vector Quantization Indexes for Knowledge Distillation
- Blog: Squashed Weight Distribution for Low Bit Quantization of Deep Models
- Blog: AQ-DETR: Low-Bit Quantized Detection Transformer with Auxiliary Queries
- Blog: Quantized Distillation: Optimizing Driver Activity Recognition Models for Resource-Constrained Environments
- Blog: QUADS: Quantized Distillation Framework for Efficient Speech Language Understanding
- Blog: DQ-BART: Efficient Sequence-to-Sequence Model via Joint Distillation and Quantization
- Blog: USDN: A Unified Sample-Wise Dynamic Network With Mixed-Precision and Early-Exit
- Blog: PMQ-VE: Progressive Multi-Frame Quantization for Video Enhancement
- Blog: Quantization Mimic: Towards Very Tiny CNN for Object Detection
- Blog: Training binary neural networks with real-to-binary convolutions
- Blog: Compressed MoE ASR Model Based on Knowledge Distillation and Quantization
- Blog: ReQAT: Achieving Full-Precision Reasoning Accuracy with 4-bit Floating-Point Quantization-Aware Training
- Blog: BitNet Distillation
- Blog: Rotation Symmetry in Vision Quantization: The Objective Function is the Bottleneck
- Blog: BinaryBERT: Pushing the Limit of BERT Quantization
- Blog: UNGER: Generative Recommendation with A Unified Code via Semantic and Collaborative Integration
- Blog: DQ-Whisper: Joint Distillation and Quantization for Efficient Multilingual Speech Recognition
- Blog: Improving Conversational Abilities of Quantized Large Language Models via Direct Preference Alignment
- Blog: Ditto: Quantization-aware Secure Inference of Transformers upon MPC
- Blog: Stochastic Precision Ensemble: Self-Knowledge Distillation for Quantized Deep Neural Networks
- Blog: HAWQ-V3: Dyadic Neural Network Quantization
- Blog: FTL: A Universal Framework for Training Low-Bit DNNs via Feature Transfer
- Blog: Bitwidth Heterogeneous Federated Learning with Progressive Weight Dequantization
- Blog: IDa-Det: An Information Discrepancy-Aware Distillation for 1-Bit Detectors
- Blog: Oh! We Freeze: Improving Quantized Knowledge Distillation via Signal Propagation Analysis for Large Language Models
- Blog: Self-Distilled Quantization: Achieving High Compression Rates in Transformer-Based Language Models
- Blog: CP-NAS: Child-Parent Neural Architecture Search for 1-bit CNNs
- Blog: Towards One-bit ASR: Extremely Low-bit Conformer Quantization Using Co-training and Stochastic Precision
- Blog: MBQuant: A novel multi-branch topology method for arbitrary bit-width network quantization
- Blog: Fast DistilBERT on CPUs
- Blog: EQ-Net: Elastic Quantization Neural Networks
- Blog: Soft Label Pruning and Quantization for Large-Scale Dataset Distillation
- Blog: Effective and Efficient Mixed Precision Quantization of Speech Foundation Models
- Blog: S2-BNN: Bridging the Gap Between Self-Supervised Real and 1-Bit Neural Networks via Guided Distribution Calibration
- Blog: Mixture of Scales: Memory-Efficient Token-Adaptive Binarization for Large Language Models
- Blog: Oh! We Freeze: Improving Quantized Knowledge Distillation via Signal Propagation Analysis for Large Language Models
- Blog: Quantization Mimic: Towards Very Tiny CNN for Object Detection
- Blog: TernaryBERT: Distillation-aware Ultra-low Bit BERT
- Blog: Binary Graph Neural Networks
- Blog: Understanding and Improving Knowledge Distillation for Quantization-Aware Training of Large Transformer Encoders
- Blog: Apertus LLM Family Expansion via Distillation and Quantization
- Blog: 2DQuant: Low-bit Post-Training Quantization for Image Super-Resolution
- Blog: AugKD: Ingenious Augmentations Empower Knowledge Distillation for Image Super-Resolution
- Blog: Knowledge Representing: Efficient, Sparse Representation of Prior Knowledge for Knowledge Distillation
- Blog: Effective Quantization for Diffusion Models on CPUs
- Blog: QFT: Post-training Quantization via Fast Joint Finetuning of All Degrees of Freedom
- Blog: Knowledge distillation via softmax regression representation learning
Showing 60 of 111 papers.
History & citation
Current · Permanent link
Cite this direction
Latest version (a living page):
@misc{lacuna_quantization_aware_distillation_109de434,
title = {quantization-aware distillation},
author = {{Lacuna}},
howpublished = {Lacuna research direction},
year = {2026},
url = {https://lacuna.tiptreesystems.com/direction/quantization-aware-distillation/rdr_109de43441a941b38b1afed88e7b8da8},
note = {Latest version of a living research direction; cite a version for a fixed text. Accessed 2026-11-20},
}This exact version (version 2, frozen text):
@misc{lacuna_quantization_aware_distillation_109de434_v2,
title = {quantization-aware distillation},
author = {{Lacuna}},
howpublished = {Lacuna research direction},
year = {2026},
url = {https://lacuna.tiptreesystems.com/direction/quantization-aware-distillation/rdr_109de43441a941b38b1afed88e7b8da8/v/2},
note = {Version 2, frozen 2026-10-04. Accessed 2026-11-20},
}