No article text was recorded for this version.
conditional computation
Version 1 of 1884 papers1,219 conceptsfrozen 2026-10-04
Papers in this version
- Blog: Revisiting MoE and Dense Speed-Accuracy Comparisons for LLM Training
- Blog: Mobile V-MoEs: Scaling Down Vision Transformers via Sparse Mixture-of-Experts
- Blog: SpeechMoE: Scaling to Large Acoustic Models with Dynamic Routing Mixture of Experts
- Blog: GLaM: Efficient Scaling of Language Models with Mixture-of-Experts
- Blog: Sparse Mixture of Local Experts for Efficient Speech Enhancement
- Blog: Adaptive Conditional Expert Selection Network for Multi-domain Recommendation
- Blog: Multi-level Mixture of Experts for Multimodal Entity Linking
- Blog: Integration of Mixture of Experts and Multimodal Generative AI in Internet of Vehicles: A Survey
- Blog: Generalization and Scaling Laws for Mixture-of-ExpertsTransformers
- Blog: Parameter-Efficient Sparsity Crafting from Dense to Mixture-of-Experts for Instruction Tuning on General Tasks
- Blog: Efficient Large Scale Language Modeling with Mixtures of Experts
- Blog: ModuleFormer: Modularity Emerges from Mixture-of-Experts
- Blog: Cross-token Modeling with Conditional Computation
- Blog: Multi-Head Mixture-of-Experts
- Blog: Breaking trade-offs in speech separation with sparsely-gated mixture of experts
- Blog: LOLA – An Open-Source Massively Multilingual Large Language Model
- Blog: JetMoE: Reaching Llama2 Performance with 0.1M Dollars
- Blog: Scaling Laws for Fine-Grained Mixture of Experts
- Blog: Beyond Parameter Count: Implicit Bias in Soft Mixture of Experts
- Blog: Sparse Mixture-of-Experts for Compositional Generalization: Empirical Evidence and Theoretical Foundations of Optimal Sparsity
- Blog: Scaling Vision-Language Models with Sparse Mixture of Experts
- Blog: MoE-Mamba: Efficient Selective State Space Models with Mixture of Experts
- Blog: MoMoE: A Mixture of Expert Agent Model for Financial Sentiment Analysis
- Blog: Scaling Vision with Sparse Mixture of Experts
- Blog: Parameter-Efficient Conformers via Sharing Sparsely-Gated Experts for End-to-End Speech Recognition
- Blog: Lifting the Curse of Capacity Gap in Distilling Large Language Models
- Blog: Preference-Driven Multi-Objective Combinatorial Optimization with Conditional Computation
- Blog: No Language Left Behind: Scaling Human-Centered Machine Translation
- Blog: Go Wider Instead of Deeper
- Blog: PlantBiMoE: A Bidirectional Foundation Model with SparseMoE for Plant Genomes
- Blog: Mixture-of-Experts Meets Instruction Tuning: A Winning Combination for Large Language Models
- Blog: DM-Adapter: Domain-Aware Mixture-of-Adapters for Text-Based Person Retrieval
- Blog: Multi-level Mixture of Experts for Multimodal Entity Linking
- Blog: Scaling Laws Across Model Architectures: A Comparative Analysis of Dense and MoE Models in Large Language Models
- Blog: Flan-MoE: Scaling Instruction-Finetuned Language Models with Sparse Mixture of Experts
- Blog: Sparse Mixture-of-Experts for Multi-Channel Imaging: Are All Channel Interactions Required?
- Blog: Can Mixture-of-Experts Surpass Dense LLMs Under Strictly Equal Resources?
- Blog: Towards Greater Leverage: Scaling Laws for Efficient Mixture-of-Experts Language Models
- Blog: Parameter-Efficient Conformers via Sharing Sparsely-Gated Experts for End-to-End Speech Recognition
- Blog: Chasing All-Round Graph Representation Robustness: Model, Training, and Optimization
- Blog: MoEMoE: Question Guided Dense and Scalable Sparse Mixture-of-Expert for Multi-source Multi-modal Answering
- Blog: BiMediX: Bilingual Medical Mixture of Experts LLM
- Blog: ST-LINK: Spatially-Aware Large Language Models for Spatio-Temporal Forecasting
- Blog: SiRA: Sparse Mixture of Low Rank Adaptation
- Blog: Exploring Sparse MoE in GANs for Text-conditioned Image Synthesis
- Blog: Every Attention Matters: An Efficient Hybrid Architecture for Long-Context Reasoning
- Blog: Mixpert: Mitigating Multimodal Learning Conflicts with Efficient Mixture-of-Vision-Experts
- Blog: 3M: Multi-loss, Multi-path and Multi-level Neural Networks for speech recognition
- Blog: CrossEarth-SAR: A SAR-Centric and Billion-Scale Geospatial Foundation Model for Domain Generalizable Semantic Segmentation
- Blog: Switch-BERT: Learning to Model Multimodal Interactions by Switching Attention and Input
- Blog: RoDE: Linear Rectified Mixture of Diverse Experts for Food Large Multi-Modal Models
- Blog: On the Adversarial Robustness of Mixture of Experts
- Blog: Balancing Expert Utilization in Mixture-of-Experts Layers Embedded in CNNs
- Blog: Learning Large-scale Universal User Representation with Sparse Mixture of Experts
- Blog: MegaBlocks: Efficient Sparse Training with Mixture-of-Experts
- Blog: Lifting the Curse of Capacity Gap in Distilling Language Models
- Blog: Boost Your NeRF: A Model-Agnostic Mixture of Experts Framework for High Quality and Efficient Rendering
- Blog: A Survey of Large Language Models for European Languages
- Blog: Split & Merge: Unlocking the Potential of Visual Adapters via Sparse Training
- Blog: Doubly Sparse: Sparse Mixture of Sparse Experts for Efficient Softmax Inference
Showing 60 of 884 papers.
History & citation
Current · Permanent link
- Sparse Mixture of Experts for Efficient Scaling merged into this direction (71% overlap)
- Scaling Intelligence with Sparse Mixture of Experts merged into this direction (92% overlap)
- Sparse Modular Routing for Efficient Model Scaling merged into this direction (85% overlap)
Cite this direction
Latest version (a living page):
@misc{lacuna_conditional_computation_2d393b52,
title = {conditional computation},
author = {{Lacuna}},
howpublished = {Lacuna research direction},
year = {2026},
url = {https://lacuna.tiptreesystems.com/direction/conditional-computation/rdr_2d393b52ba8b47aca748c48d84ceb7b7},
note = {Latest version of a living research direction; cite a version for a fixed text. Accessed 2026-11-21},
}This exact version (version 1, frozen text):
@misc{lacuna_conditional_computation_2d393b52_v1,
title = {conditional computation},
author = {{Lacuna}},
howpublished = {Lacuna research direction},
year = {2026},
url = {https://lacuna.tiptreesystems.com/direction/conditional-computation/rdr_2d393b52ba8b47aca748c48d84ceb7b7/v/1},
note = {Version 1, frozen 2026-10-04. Accessed 2026-11-21},
}