No article text was recorded for this version.
parameter-efficient mixture-of-experts
Version 1 of 150 papers54 conceptsfrozen 2026-10-04
Papers in this version
- Blog: Enabling Instructional Image Editing with In-Context Generation in Large Scale Diffusion Transformer
- Blog: Decoupling Primitive with Experts: Dynamic Feature Alignment for Compositional Zero-Shot Learning
- Blog: Low-Rank Mixture-of-Experts for Continual Medical Image Segmentation
- Blog: ACO-MoE-LoRA: Evolving-while-Training for Adapting Segment Anything Model 2 to Specialized Domains
- Blog: DevFD : Developmental Face Forgery Detection by Learning Shared and Orthogonal LoRA Subspaces
- Blog: MMLoRA: Multitask Memory Parameter-Efficient Fine-Tuning for Multimodal SER
- Blog: HDMoLE: Mixture of LoRA Experts with Hierarchical Routing and Dynamic Thresholds for Fine-Tuning LLM-based ASR Models
- Blog: MiLoRA: Efficient Mixture of Low-Rank Adaptation for Large Language Models Fine-tuning
- Blog: Domain Generalization using Large Pretrained Models with Mixture-of-Adapters
- Blog: Pushing Mixture of Experts to the Limit: Extremely Parameter Efficient MoE for Instruction Tuning
- Blog: Harmonizing Visual Text Comprehension and Generation
- Blog: Parameter-Efficient Sparsity Crafting from Dense to Mixture-of-Experts for Instruction Tuning on General Tasks
- Blog: LiME: Lightweight Mixture of Experts for Efficient Multimodal Multi-task Learning
- Blog: Condensing Multilingual Knowledge with Lightweight Language-Specific Modules
- Blog: When Large Multimodal Models Confront Evolving Knowledge: Challenges and Explorations
- Blog: S'MoRE: Structural Mixture of Residual Experts for LLM Fine-tuning
- Blog: Efficient Fine-tuning of Audio Spectrogram Transformers via Soft Mixture of Adapters
- Blog: Exploring the Benefits of Training Expert Language Models over Instruction Tuning
- Blog: Efficient Deweahter Mixture-of-Experts with Uncertainty-Aware Feature-Wise Linear Modulation
- Blog: GroundingFace: Fine-grained Face Understanding via Pixel Grounding Multimodal Large Language Model
- Blog: A Case Study of Instruction Tuning with Mixture of Parameter-Efficient Experts
- Blog: SPMTrack: Spatio-Temporal Parameter-Efficient Fine-Tuning with Mixture of Experts for Scalable Visual Tracking
- Blog: Self-MoE: Towards Compositional Large Language Models with Self-Specialized Experts
- Blog: MINGLE: Mixture of Null-Space Gated Low-Rank Experts for Test-Time Continual Model Merging
- Blog: Selecting and Merging: Towards Adaptable and Scalable Named Entity Recognition with Large Language Models
- Blog: MixLoRA: Enhancing Large Language Models Fine-Tuning with LoRA based Mixture of Experts
- Blog: Emergent Compositional Skills in Mixture-of-Experts VLAs
- Blog: MoVE-KD: Knowledge Distillation for VLMs with Mixture of Visual Encoders
- Blog: Pixel-Aware Deep Function-Mixture Network for Spectral Super-Resolution
- Blog: Omni-SMoLA: Boosting Generalist Multimodal Models with Soft Mixture of Low-Rank Experts
- Blog: Customizing Language Models with Instance-wise LoRA for Sequential Recommendation
- Blog: Towards Practical Plug-and-Play Diffusion Models
- Blog: Divide, Conquer, and Combine: Mixture of Semantic-Independent Experts for Zero-Shot Dialogue State Tracking
- Blog: PERFT: Parameter-Efficient Routed Fine-Tuning for Mixture-of-Expert Model
- Blog: On Minimax Estimation of Parameters in Softmax-Contaminated Mixture of Experts
- Blog: Phased DMD: Few-step Distribution Matching Distillation via Score Matching within Subintervals
- Blog: LoRA-Mixer: Coordinate Modular LoRA Experts Through Serial Attention Routing
- Blog: RouterRetriever: Routing over a Mixture of Expert Embedding Models
- Blog: CL-MoE: Enhancing Multimodal Large Language Model with Dual Momentum Mixture-of-Experts for Continual Visual Question Answering
- Blog: PT-MoE: An Efficient Finetuning Framework for Integrating Mixture-of-Experts into Prompt Tuning
- Blog: LoRAMoE: Alleviating World Knowledge Forgetting in Large Language Models via MoE-Style Plugin
- Blog: PRoLoRA: Partial Rotation Empowers More Parameter-Efficient LoRA
- Blog: Phase-Aware Mixture of Experts for Agentic Reinforcement Learning
- Blog: MTL-LoRA: Low-Rank Adaptation for Multi-Task Learning
- Blog: Matina: A Culturally-Aligned Persian Language Model Using Multiple LoRA Experts
- Blog: Diff-MoE: Diffusion Transformer with Time-Aware and Space-Adaptive Experts
- Blog: SEMPO: Lightweight Foundation Models for Time Series Forecasting
- Blog: HealthGPT: A Medical Large Vision-Language Model for Unifying Comprehension and Generation via Heterogeneous Knowledge Adaptation
- Blog: M$^3$E: Continual Vision-and-Language Navigation via Mixture of Macro and Micro Experts
- Blog: MoDr: Mixture-of-Depth-Recurrent Transformers for Test-Time Reasoning
History & citation
Current · Permanent link
- This direction split from Scaling Model Capacity with Mixture of Low Rank Adapters (66% overlap)
Cite this direction
Latest version (a living page):
@misc{lacuna_parameter_efficient_mixture_of_experts_536c653e,
title = {parameter-efficient mixture-of-experts},
author = {{Lacuna}},
howpublished = {Lacuna research direction},
year = {2026},
url = {https://lacuna.tiptreesystems.com/direction/parameter-efficient-mixture-of-experts/rdr_536c653e436d4f64aad6ffdae1dda196},
note = {Latest version of a living research direction; cite a version for a fixed text. Accessed 2026-11-20},
}This exact version (version 1, frozen text):
@misc{lacuna_parameter_efficient_mixture_of_experts_536c653e_v1,
title = {parameter-efficient mixture-of-experts},
author = {{Lacuna}},
howpublished = {Lacuna research direction},
year = {2026},
url = {https://lacuna.tiptreesystems.com/direction/parameter-efficient-mixture-of-experts/rdr_536c653e436d4f64aad6ffdae1dda196/v/1},
note = {Version 1, frozen 2026-10-04. Accessed 2026-11-20},
}