No article text was recorded for this version.
mixture-of-experts scaling limits
Version 1 of 177 papers86 conceptsfrozen 2026-10-04
Papers in this version
- Blog: Theory on Mixture-of-Experts in Continual Learning
- Blog: Facebook AI's WMT21 News Translation Task Submission
- Blog: TimeExpert: An Expert-Guided Video LLM for Video Temporal Grounding
- Blog: Nash Bargaining for Gate-Free Mixture-of-Experts
- Blog: Integrating Multi-view Analysis: Multi-view Mixture-of-Expert for Textual Personality Detection
- Blog: MoEController: Instruction-based Arbitrary Image Manipulation with Mixture-of-Expert Controllers
- Blog: Mixture of Experts for Biomedical Question Answering
- Blog: Scaling and Enhancing LLM-based AVSR: A Sparse Mixture of Projectors Approach
- Blog: Robust Face Alignment Using a Mixture of Invariant Experts
- Blog: RouterRetriever: Exploring the Benefits of Routing over Multiple Expert Embedding Models
- Blog: Mixpert: Mitigating Multimodal Learning Conflicts with Efficient Mixture-of-Vision-Experts
- Blog: SAME: Scenario Adaptive Mixture-of-Experts for Promotion-Aware Click-Through Rate Prediction
- Blog: AdaMixT: Adaptive Weighted Mixture of Multi-Scale Expert Transformers for Time Series Forecasting
- Blog: Generative Large-Scale Pre-trained Models for Automated Ad Bidding Optimization
- Blog: Unified Multimodal Visual Tracking with Dual Mixture-of-Experts
- Blog: Divide and Grow: Capturing Huge Diversity in Crowd Images With Incrementally Growing CNN
- Blog: Unchosen Experts Can Contribute Too: Unleashing MoE Models' Power by Self-Contrast
- Blog: LLaMA-MoE v2: Exploring Sparsity of LLaMA from Perspective of Mixture-of-Experts with Post-Training
- Blog: Modeling non-uniform uncertainty in Reaction Prediction via Boosting and Dropout
- Blog: LiME: Lightweight Mixture of Experts for Efficient Multimodal Multi-task Learning
- Blog: Towards a Comprehensive Scaling Law of Mixture-of-Experts
- Blog: Unified Scaling Laws for Routed Language Models
- Blog: Query-Level Ranker Specialization
- Blog: Exploring Diverse Representations for Open Set Recognition
- Blog: A Hybrid Tensor-Expert-Data Parallelism Approach to Optimize Mixture-of-Experts Training
- Blog: Curriculum Model Merging: Harmonizing Chemical LLMs for Enhanced Cross-Task Generalization
- Blog: A Bridge from Audio to Video: Phoneme-Viseme Alignment Allows Every Face to Speak Multiple Languages
- Blog: Hard Mixtures of Experts for Large Scale Weakly Supervised Vision
- Blog: Locally Activated Gated Neural Network for Automatic Music Genre Classification
- Blog: Meta-Meta Classification for One-Shot Learning
- Blog: DM-Adapter: Domain-Aware Mixture-of-Adapters for Text-Based Person Retrieval
- Blog: Speech Enhancement using a Deep Mixture of Experts
- Blog: TimeExpert: An Expert-Guided Video LLM for Video Temporal Grounding
- Blog: MoRE: Mixture of Reused Experts
- Blog: Scaling Vision-Language Models with Sparse Mixture of Experts
- Blog: Mixture-of-Experts for Biomedical Question Answering
- Blog: Beyond Student: An Asymmetric Network for Neural Network Inheritance
- Blog: Mixture of Experts Fusion for Fake Audio Detection Using Frozen wav2vec 2.0
- Blog: BIG-MoE: Bypass Isolated Gating MoE for Generalized Multimodal Face Anti-Spoofing
- Blog: Locally Aligned Feature Transforms across Views
- Blog: Learning Multiple Stock Trading Patterns with Temporal Routing Adaptor and Optimal Transport
- Blog: Diversifying the Mixture-of-Experts Representation for Language Models with Orthogonal Optimizer
- Blog: AdaMV-MoE: Adaptive Multi-Task Vision Mixture-of-Experts
- Blog: Advancing MoE Efficiency: A Collaboration-Constrained Routing (C2R) Strategy for Better Expert Parallelism Design
- Blog: Stage-Aware Graph Contrastive Learning with Node-oriented Mixture of Experts
- Blog: Turn Waste into Worth: Rectifying Top-k Router of MoE
- Blog: MOEF: Modeling Occasion Evolution in Frequency Domain for Promotion-Aware Click-Through Rate Prediction
- Blog: TMoE-P: Towards the Pareto Optimum for Multivariate Soft Sensors
- Blog: Mixture Dense Regression for Object Detection and Human Pose Estimation
- Blog: SAML: Speaker Adaptive Mixture of LoRA Experts for End-to-End ASR
- Blog: MoE-SPNet: A Mixture-of-Experts Scene Parsing Network
- Blog: DM-Adapter: Domain-Aware Mixture-of-Adapters for Text-Based Person Retrieval
- Blog: Customizing Language Models with Instance-wise LoRA for Sequential Recommendation
- Blog: Elastic MoE: Unlocking the Inference-Time Scalability of Mixture-of-Experts
- Blog: M-IDoL: Information Decomposition for Modality-Specific and Diverse Representation Learning in Medical Foundation Model
- Blog: Poly-Visual-Expert Vision-Language Models
- Blog: Unity in Diversity: Multi-expert Knowledge Confrontation and Collaboration for Generalizable Vehicle Re-identification
- Blog: MixANT: Observation-dependent Memory Propagation for Stochastic Dense Action Anticipation
- Blog: AFM-Net: Advanced Fusing Hierarchical CNN Visual Priors with Global Sequence Modeling for Remote Sensing Image Scene Classification
- Blog: Towards Generalizable PDE Dynamics Forecasting via Physics-Guided Invariant Learning
Showing 60 of 77 papers.
History & citation
Current · Permanent link
- This direction split from Scaling and Specialization in Mixture of Experts (96% overlap)
Cite this direction
Latest version (a living page):
@misc{lacuna_mixture_of_experts_scaling_limits_3597b85c,
title = {mixture-of-experts scaling limits},
author = {{Lacuna}},
howpublished = {Lacuna research direction},
year = {2026},
url = {https://lacuna.tiptreesystems.com/direction/mixture-of-experts-scaling-limits/rdr_3597b85c9cf8492592f2cd83c7274761},
note = {Latest version of a living research direction; cite a version for a fixed text. Accessed 2026-11-19},
}This exact version (version 1, frozen text):
@misc{lacuna_mixture_of_experts_scaling_limits_3597b85c_v1,
title = {mixture-of-experts scaling limits},
author = {{Lacuna}},
howpublished = {Lacuna research direction},
year = {2026},
url = {https://lacuna.tiptreesystems.com/direction/mixture-of-experts-scaling-limits/rdr_3597b85c9cf8492592f2cd83c7274761/v/1},
note = {Version 1, frozen 2026-10-04. Accessed 2026-11-19},
}