混合专家论文趋势 2023–2026

主要结论

• 混合专家论文从 2023 年的 236 篇增长到 2026 年的 326 篇，三年间扩大到约 1.4 倍。
• NeurIPS 是发混合专家论文最多的会议，2023–2026 年共 354 篇，占四个会议总量的 39%。
• 交叉方向里涨得最快的是多模态大模型：同时属于两个主题的论文从 2023 年的 4 篇增至 2026 年的 79 篇。
• 在「优化与缩放」的 5 个主题里，它的 2026 年论文数排第 4；同组增长最快的缩放定律是 4.1 倍，混合专家是 1.4 倍。

代表论文

按年份和会议均匀挑选，方便快速看到每一届的样貌

• NeurIPS 2026A Biconvex Formulation for Stable Transport of Mixture Models with a Unique Solution
• ICML 2026$\phi$-Balancing for Mixture-of-Experts Training
• ICLR 2026A Federated Generalized Expectation-Maximization Algorithm for Mixture Models with an Unknown Number of Components
• CVPR 2026Divide Conquer and Aggregate Asymmetric Experts for Class-Imbalanced Semi-Supervised Medical
• NeurIPS 2025Advancing Expert Specialization for Better MoE
• ICML 2025$\texttt{I$^2$MoE}$: Interpretable Multimodal Interaction-aware Mixture-of-Experts
• ICLR 2025A Sanity Check for AI-generated Image Detection
• CVPR 2025Complexity Experts are Task-Discriminative Learners for Any Image Restoration
• NeurIPS 2024$\texttt{Model-GLUE}$: Democratized LLM Scaling for A Large Model Zoo in the Wild
• ICML 2024$\texttt{MoE-RBench}$: Towards Building Reliable Language Models with Sparse Mixture-of-Experts
• ICLR 2024Fusing Models with Complementary Expertise
• CVPR 2024MoDE: CLIP Data Experts via Clustering
• NeurIPS 2023[Re] Numerical influence of ReLU'(0) on backpropagation
• ICML 2023A Distribution Optimization Framework for Confidence Bounds of Risk Measures
• ICLR 2023Knowledge-in-Context: Towards Knowledgeable Semi-Parametric Language Models
• CVPR 2023Balanced Product of Calibrated Experts for Long-Tailed Recognition
• NeurIPS 2026AdERA: Adaptive Exponent Reuse for Lossless Allgather in Sharded MoE Training
• ICML 2026Attention Sink Forges Native MoE in Attention Layers: Sink-Aware Training to Address Head Collapse
• ICLR 2026Abstracting Robot Manipulation Skills via Mixture-of-Experts Diffusion Policies
• CVPR 2026ERMoE Eigen-Reparameterized Mixture-of-Experts for Stable Routing and Interpretable Specialization

全部混合专家论文

共 24 篇，第 1 / 1 页

1. ICLR 2024Chain-of-Experts: When LLMs Meet Complex Operations Research Problems
2. ICLR 2024Divide and not forget: Ensemble of selectively trained experts in Continual Learning
3. ICLR 2024From Sparse to Soft Mixtures of Experts
4. ICLR 2024Fusing Models with Complementary Expertise
5. ICLR 2024High-dimensional SGD aligns with emerging outlier eigenspaces
6. ICLR 2024Horizon-free Reinforcement Learning in Adversarial Linear Mixture MDPs
7. ICLR 2024Hybrid Sharing for Multi-Label Image Classification
8. ICLR 2024Large Language Model Cascades with Mixture of Thought Representations for Cost-Efficient Reasoning
9. ICLR 2024Learning with Mixture of Prototypes for Out-of-Distribution Detection
10. ICLR 2024M3C: A Framework towards Convergent, Flexible, and Unsupervised Learning of Mixture Graph Matching and Clustering
11. ICLR 2024Merge, Then Compress: Demystify Efficient SMoE with Hints from Its Routing Policy
12. ICLR 2024Mixture of LoRA Experts
13. ICLR 2024Mixture of Weak and Strong Experts on Graphs
14. ICLR 2024Mixture-of-Experts Meets Instruction Tuning: A Winning Combination for Large Language Models
15. ICLR 2024Object-Centric Learning with Slot Mixture Module
16. ICLR 2024Octavius: Mitigating Task Interference in MLLMs via LoRA-MoE
17. ICLR 2024Pushing Mixture of Experts to the Limit: Extremely Parameter Efficient MoE for Instruction Tuning
18. ICLR 2024Scaling physics-informed hard constraints with mixture-of-experts
19. ICLR 2024Soft Mixture Denoising: Beyond the Expressive Bottleneck of Diffusion Models
20. ICLR 2024Sparse MoE with Language Guided Routing for Multilingual Machine Translation
21. ICLR 2024Statistical Perspective of Top-K Sparse Softmax Gating Mixture of Experts
22. ICLR 2024Subtractive Mixture Models via Squaring: Representation and Learning
23. ICLR 2024TESTAM: A Time-Enhanced Spatio-Temporal Attention Model with Mixture of Experts
24. ICLR 2024Transformers can optimally learn regression mixture models

常见问题

2023–2026 年四大会议一共有多少篇混合专家论文？

共 904 篇，按年份分别是 2023 年 236 篇、2024 年 119 篇、2025 年 223 篇、2026 年 326 篇。

NeurIPS 2026 有多少篇混合专家论文？

NeurIPS 2026 有 75 篇混合专家论文，上一届是 86 篇。

ICLR 2026 有多少篇混合专家论文？

ICLR 2026 有 73 篇混合专家论文，上一届是 59 篇。

ICML 2026 有多少篇混合专家论文？

ICML 2026 有 132 篇混合专家论文，上一届是 57 篇。

CVPR 2026 有多少篇混合专家论文？

CVPR 2026 有 46 篇混合专家论文，上一届是 21 篇。

哪个会议的混合专家论文最多？

NeurIPS，2023–2026 年共 354 篇。