No article text was recorded for this version.
manual layer alignment
Version 2 of 236 papers40 conceptsfrozen 2026-10-04
Papers in this version
- Blog: Heterogeneous Knowledge Distillation Using Information Flow Modeling
- Blog: Study Selectively: An Adaptive Knowledge Distillation based on a Voting Network for Heart Sound Classification
- Blog: Why Skip If You Can Combine: A Simple Knowledge Distillation Technique for Intermediate Layers
- Blog: Show, Attend and Distill: Knowledge Distillation via Attention-based Feature Matching
- Blog: Adaptive Multi-Teacher Multi-level Knowledge Distillation
- Blog: RNAS-CL: Robust Neural Architecture Search by Cross-Layer Knowledge Distillation
- Blog: RAIL-KD: RAndom Intermediate Layer Mapping for Knowledge Distillation
- Blog: FitNets: Hints for Thin Deep Nets
- Blog: Variational Information Distillation for Knowledge Transfer
- Blog: MergeNet: Knowledge Migration Across Heterogeneous Models, Tasks, and Modalities
- Blog: Locality Guidance for Improving Vision Transformers on Tiny Datasets
- Blog: Student Network Learning via Evolutionary Knowledge Distillation
- Blog: Online Cross-Layer Knowledge Distillation on Graph Neural Networks with Deep Supervision
- Blog: Can MLLMs Absorb Math Reasoning Abilities from LLMs as Free Lunch?
- Blog: Learning What and Where to Transfer
- Blog: Knowledge Distillation from Internal Representations
- Blog: Improving Reasoning Capabilities in Small Models through Mixture-of-layers Distillation with Stepwise Attention on Key Information
- Blog: LLM Augmented LLMs: Expanding Capabilities through Composition
- Blog: Activation Space Interventions Can Be Transferred Between Large Language Models
- Blog: Training the Untrainable: Introducing Inductive Bias via Representational Alignment
- Blog: TinyBERT: Distilling BERT for Natural Language Understanding
- Blog: DT-LET: Deep Transfer Learning by Exploring where to Transfer
- Blog: Unifying and Merging Well-trained Deep Neural Networks for Inference Stage
- Blog: Intermediate Layer Distillation with the Reused Teacher Classifier: A Study on the Importance of the Classifier of Attention-based Models
- Blog: Learning to Steer by Mimicking Features from Heterogeneous Auxiliary Networks
- Blog: Causal Distillation for Language Models
- Blog: VLsI: Verbalized Layers-to-Interactions from Large to Small Vision Language Models
- Blog: Aligning Sizes of Intermediate Layers by LoRA Adapter for Knowledge Distillation
- Blog: Knowledge Flow: Improve Upon Your Teachers
- Blog: $V_{k}D$: Improving Knowledge Distillation Using Orthogonal Projections
- Blog: ALP-KD: Attention-Based Layer Projection for Knowledge Distillation
- Blog: Differentiable Feature Aggregation Search for Knowledge Distillation
- Blog: Universal-KD: Attention-based Output-Grounded Intermediate Layer Knowledge Distillation
- Blog: Knowledge Transfer via Distillation of Activation Boundaries Formed by Hidden Neurons
- Blog: Efficient Knowledge Distillation via Curriculum Extraction
- Blog: Tree-Like Decision Distillation
History & citation
Current · Permanent link
Cite this direction
Latest version (a living page):
@misc{lacuna_manual_layer_alignment_de00fdb9,
title = {manual layer alignment},
author = {{Lacuna}},
howpublished = {Lacuna research direction},
year = {2026},
url = {https://lacuna.tiptreesystems.com/direction/manual-layer-alignment/rdr_de00fdb9b21e4cb3b481dfa592f3b328},
note = {Latest version of a living research direction; cite a version for a fixed text. Accessed 2026-11-21},
}This exact version (version 2, frozen text):
@misc{lacuna_manual_layer_alignment_de00fdb9_v2,
title = {manual layer alignment},
author = {{Lacuna}},
howpublished = {Lacuna research direction},
year = {2026},
url = {https://lacuna.tiptreesystems.com/direction/manual-layer-alignment/rdr_de00fdb9b21e4cb3b481dfa592f3b328/v/2},
note = {Version 2, frozen 2026-10-04. Accessed 2026-11-21},
}