No article text was recorded for this version.
differentiable expert routing
Version 1 of 141 papers60 conceptsfrozen 2026-10-04
Papers in this version
- Blog: cMoLLM at Scale: Horizontal Scaling Laws for Convolutionally-Gated Mixture-of-LLMs
- Blog: Routers in Vision Mixture of Experts: An Empirical Study
- Blog: SoftMoE: Soft Differentiable Routing for Mixture-of-Experts in LLMs
- Blog: Mixture of Experts in a Mixture of RL settings
- Blog: Pushing Mixture of Experts to the Limit: Extremely Parameter Efficient MoE for Instruction Tuning
- Blog: ReMoE: Fully Differentiable Mixture-of-Experts with ReLU Routing
- Blog: Ares: Loss-Free Mixture-of-Experts Routing for Bidirectional Protein Encoders
- Blog: Receptive Fields As Experts in Convolutional Neural Architectures
- Blog: Mamba Goes HoME: Hierarchical Soft Mixture-of-Experts for 3D Medical Image Segmentation
- Blog: From Sparse to Soft Mixtures of Experts
- Blog: Geometric and Stochastic Analysis of Discontinuities in Sparse Mixture-of-Experts
- Blog: Zero-shot Learning with Many Classes by High-rank Deep Embedding Networks
- Blog: BAM! Just Like That: Simple and Efficient Parameter Upcycling for Mixture of Experts
- Blog: Soft Merging of Experts with Adaptive Routing
- Blog: Mixtures of Experts Unlock Parameter Scaling for Deep RL
- Blog: Maximum Score Routing For Mixture-of-Experts
- Blog: Lory: Fully Differentiable Mixture-of-Experts for Autoregressive Language Model Pre-training
- Blog: Graph Neural Architecture Search Under Distribution Shifts
- Blog: OVS Meets Continual Learning: Towards Sustainable Open-Vocabulary Segmentation
- Blog: DSelect-k: Differentiable Selection in the Mixture of Experts with Applications to Multi-Task Learning
- Blog: Overcoming Domain Limitations in Open-vocabulary Segmentation
- Blog: Mixture of Tokens: Continuous MoE through Cross-Example Aggregation
- Blog: Soft Task-Aware Routing of Experts for Equivariant Representation Learning
- Blog: La-SoftMoE CLIP for Unified Physical-Digital Face Attack Detection
- Blog: ADMN: Agent-Driven Modular Network for Dynamic Parameter Sharing in Cooperative Multi-Agent Reinforcement Learning
- Blog: Efficient Fine-tuning of Audio Spectrogram Transformers via Soft Mixture of Adapters
- Blog: Diff-MN: Diffusion Parameterized MoE-NCDE for Continuous Time Series Generation with Irregular Observations
- Blog: TA-MoE: Topology-Aware Large Scale Mixture-of-Expert Training
- Blog: Gate to the Vessel: Residual Experts Restore What SAM Overlooks
- Blog: Beyond Parameter Count: Implicit Bias in Soft Mixture of Experts
- Blog: Omni-SMoLA: Boosting Generalist Multimodal Models with Soft Mixture of Low-Rank Experts
- Blog: Adaptive Knowledge Sharing in Multi-Task Learning: Improving Low-Resource Neural Machine Translation
- Blog: Mamba Goes HoME: Hierarchical Soft Mixture-of-Experts for 3D Medical Image Segmentation
- Blog: $\phi$-Balancing for Mixture-of-Experts Training
- Blog: Mixture of Mini Experts: Overcoming the Linear Layer Bottleneck in Multiple Instance Learning
- Blog: Multimodal Learning and Reasoning for Visual Question Answering
- Blog: FeRA: Frequency-Energy Constrained Routing for Effective Diffusion Adaptation Fine-Tuning
- Blog: RobIA: Robust Instance-aware Continual Test-time Adaptation for Deep Stereo
- Blog: Soft Task-Aware Routing of Experts for Equivariant Representation Learning
- Blog: Towards Stable and Effective Reinforcement Learning for Mixture-of-Experts
- Blog: COMET: Learning Cardinality Constrained Mixture of Experts with Trees and Local Search
History & citation
Current · Permanent link
- This direction split from Continuous Routing for Stable Mixture of Experts (93% overlap)
Cite this direction
Latest version (a living page):
@misc{lacuna_differentiable_expert_routing_a40d707d,
title = {differentiable expert routing},
author = {{Lacuna}},
howpublished = {Lacuna research direction},
year = {2026},
url = {https://lacuna.tiptreesystems.com/direction/differentiable-expert-routing/rdr_a40d707d76bc45bfa0b1f24acec0abfc},
note = {Latest version of a living research direction; cite a version for a fixed text. Accessed 2026-11-20},
}This exact version (version 1, frozen text):
@misc{lacuna_differentiable_expert_routing_a40d707d_v1,
title = {differentiable expert routing},
author = {{Lacuna}},
howpublished = {Lacuna research direction},
year = {2026},
url = {https://lacuna.tiptreesystems.com/direction/differentiable-expert-routing/rdr_a40d707d76bc45bfa0b1f24acec0abfc/v/1},
note = {Version 1, frozen 2026-10-04. Accessed 2026-11-20},
}