No article text was recorded for this version.
homogeneous architecture distillation
Version 1 of 142 papers57 conceptsfrozen 2026-10-04
Papers in this version
- Blog: Search to Distill: Pearls Are Everywhere but Not the Eyes
- Blog: Aligning Large and Small Language Models via Chain-of-Thought Reasoning
- Blog: Make a Strong Teacher with Label Assistance: A Novel Knowledge Distillation Approach for Semantic Segmentation
- Blog: CS-CTCSCONV1D: Small footprint speaker verification with channel split time-channel-time separable 1-dimensional convolution
- Blog: Stronger Models are Not Always Stronger Teachers for Instruction Tuning
- Blog: InternVQA: Advancing Compressed Video Quality Assessment with Distilling Large Foundation Model
- Blog: Inflate and Shrink:Enriching and Reducing Interactions for Fast Text-Image Retrieval
- Blog: Are Large Kernels Better Teachers than Transformers for ConvNets?
- Blog: Learning with Privileged Information for Efficient Image Super-Resolution
- Blog: Leveraging Vision-Centric Multi-Modal Expertise for 3D Object Detection
- Blog: Text-to-image Synthesis via Symmetrical Distillation Networks
- Blog: Meta-prediction Model for Distillation-Aware NAS on Unseen Datasets
- Blog: STAFF: Speculative Coreset Selection for Task-Specific Fine-tuning
- Blog: When Gradient Descent Meets Derivative-Free Optimization: A Match Made in Black-Box Scenario
- Blog: AMFD: Distillation via Adaptive Multimodal Fusion for Multispectral Pedestrian Detection
- Blog: DRAG: Distilling RAG for SLMs from LLMs to Transfer Knowledge and Mitigate Hallucination via Evidence and Graph-based Distillation
- Blog: ProxyLM: Predicting Language Model Performance on Multilingual Tasks via Proxy Models
- Blog: Knowledge Distillation: The Functional Perspective
- Blog: The Emperor’s New Reasoning: Format Imitation Overshadows Genuine Mathematical Understanding in SFT
- Blog: Understanding the Distillation Process from Deep Generative Models to Tractable Probabilistic Circuits
- Blog: Self-Distilled Quantization: Achieving High Compression Rates in Transformer-Based Language Models
- Blog: Multi-Agent Mutual Learning at Sentence-Level and Token-Level for Neural Machine Translation
- Blog: Procedure Knowledge Decoupled Distillation Strategy for Procedure Planning in Instructional Videos
- Blog: Progressive Network Grafting for Few-Shot Knowledge Distillation
- Blog: Put Teacher in Student's Shoes: Cross-Distillation for Ultra-compact Model Compression Framework
- Blog: Fully Attentional Networks with Self-emerging Token Labeling
- Blog: Knowledge Distillation for Learned Image Compression
- Blog: SCTNet: Single-Branch CNN with Transformer Semantic Information for Real-Time Segmentation
- Blog: Improving Knowledge Distillation with Teacher's Explanation
- Blog: MIDAS: Multi-level Intent, Domain, And Slot Knowledge Distillation for Multi-turn NLU
- Blog: Search for Better Students to Learn Distilled Knowledge
- Blog: Matryoshka Model Learning for Improved Elastic Student Models
- Blog: Towards Efficient Pre-Trained Language Model via Feature Correlation Distillation
- Blog: Knowledge distillation for In-memory keyword spotting model
- Blog: Merge-of-Thought Distillation
- Blog: Deep versus Wide: An Analysis of Student Architectures for Task-Agnostic Knowledge Distillation of Self-Supervised Speech Models
- Blog: An Empirical Study of End-to-End Video-Language Transformers with Masked Visual Modeling
- Blog: UniADS: Universal Architecture-Distiller Search for Distillation Gap
- Blog: Compressing Pre-trained Models of Code into 3 MB
- Blog: Explainable Knowledge Distillation for On-Device Chest X-Ray Classification
- Blog: Auxiliary Modality Learning with Generalized Curriculum Distillation
- Blog: BitDistiller: Unleashing the Potential of Sub-4-Bit LLMs via Self-Distillation
History & citation
Current · Permanent link
Cite this direction
Latest version (a living page):
@misc{lacuna_homogeneous_architecture_distillation_85f95f9f,
title = {homogeneous architecture distillation},
author = {{Lacuna}},
howpublished = {Lacuna research direction},
year = {2026},
url = {https://lacuna.tiptreesystems.com/direction/homogeneous-architecture-distillation/rdr_85f95f9faded455cb92f33f7187cd1ed},
note = {Latest version of a living research direction; cite a version for a fixed text. Accessed 2026-11-21},
}This exact version (version 1, frozen text):
@misc{lacuna_homogeneous_architecture_distillation_85f95f9f_v1,
title = {homogeneous architecture distillation},
author = {{Lacuna}},
howpublished = {Lacuna research direction},
year = {2026},
url = {https://lacuna.tiptreesystems.com/direction/homogeneous-architecture-distillation/rdr_85f95f9faded455cb92f33f7187cd1ed/v/1},
note = {Version 1, frozen 2026-10-04. Accessed 2026-11-21},
}