混合专家论文趋势 2023–2026
MoE 路由与训练
统计范围:NeurIPS、ICLR、ICML、CVPR 四个会议,2023–2026 年,共 904 篇被归入该主题的论文。
主要结论
- 混合专家论文从 2023 年的 236 篇增长到 2026 年的 326 篇,三年间扩大到约 1.4 倍。
- NeurIPS 是发混合专家论文最多的会议,2023–2026 年共 354 篇,占四个会议总量的 39%。
- 交叉方向里涨得最快的是多模态大模型:同时属于两个主题的论文从 2023 年的 4 篇增至 2026 年的 79 篇。
- 在「优化与缩放」的 5 个主题里,它的 2026 年论文数排第 4;同组增长最快的缩放定律是 4.1 倍,混合专家是 1.4 倍。
各会议论文数
按年份和会议统计
| 年份 | NeurIPS | ICLR | ICML | CVPR | 合计 |
|---|---|---|---|---|---|
| 2023 | 138 | 16 | 76 | 6 | 236 |
| 2024 | 55 | 24 | 31 | 9 | 119 |
| 2025 | 86 | 59 | 57 | 21 | 223 |
| 2026 | 75 | 73 | 132 | 46 | 326 |
代表论文
按年份和会议均匀挑选,方便快速看到每一届的样貌
- NeurIPS 2026A Biconvex Formulation for Stable Transport of Mixture Models with a Unique Solution
- ICML 2026$\phi$-Balancing for Mixture-of-Experts Training
- ICLR 2026A Federated Generalized Expectation-Maximization Algorithm for Mixture Models with an Unknown Number of Components
- CVPR 2026Divide Conquer and Aggregate Asymmetric Experts for Class-Imbalanced Semi-Supervised Medical
- NeurIPS 2025Advancing Expert Specialization for Better MoE
- ICML 2025$\texttt{I$^2$MoE}$: Interpretable Multimodal Interaction-aware Mixture-of-Experts
- ICLR 2025A Sanity Check for AI-generated Image Detection
- CVPR 2025Complexity Experts are Task-Discriminative Learners for Any Image Restoration
- NeurIPS 2024$\texttt{Model-GLUE}$: Democratized LLM Scaling for A Large Model Zoo in the Wild
- ICML 2024$\texttt{MoE-RBench}$: Towards Building Reliable Language Models with Sparse Mixture-of-Experts
- ICLR 2024Fusing Models with Complementary Expertise
- CVPR 2024MoDE: CLIP Data Experts via Clustering
- NeurIPS 2023[Re] Numerical influence of ReLU'(0) on backpropagation
- ICML 2023A Distribution Optimization Framework for Confidence Bounds of Risk Measures
- ICLR 2023Knowledge-in-Context: Towards Knowledgeable Semi-Parametric Language Models
- CVPR 2023Balanced Product of Calibrated Experts for Long-Tailed Recognition
- NeurIPS 2026AdERA: Adaptive Exponent Reuse for Lossless Allgather in Sharded MoE Training
- ICML 2026Attention Sink Forges Native MoE in Attention Layers: Sink-Aware Training to Address Head Collapse
- ICLR 2026Abstracting Robot Manipulation Skills via Mixture-of-Experts Diffusion Policies
- CVPR 2026ERMoE Eigen-Reparameterized Mixture-of-Experts for Stable Routing and Interpretable Specialization
全部混合专家论文
共 904 篇,第 14 / 19 页
- NeurIPS 2024Neural Experts: Mixture of Experts for Implicit Neural Representations
- NeurIPS 2024Non-Euclidean Mixture Model for Social Network Embedding
- NeurIPS 2024Once Read is Enough: Domain-specific Pretraining-free Language Models with Cluster-guided Sparse Experts for Long-tail Domain Knowledge
- NeurIPS 2024Parameter Efficient Adaptation for Image Restoration with Heterogeneous Mixture-of-Experts
- NeurIPS 2024Personalized Federated Learning with Mixture of Models for Adaptive Prediction and Model Fine-Tuning
- NeurIPS 2024ProxyFusion: Face Feature Aggregation Through Sparse Experts
- NeurIPS 2024Robust Mixture Learning when Outliers Overwhelm Small Groups
- NeurIPS 2024Sigmoid Gating is More Sample Efficient than Softmax Gating in Mixture of Experts
- NeurIPS 2024Smoothie: Label Free Language Model Routing
- NeurIPS 2024Spiking Transformer with Experts Mixture
- NeurIPS 2024Sub-optimal Experts mitigate Ambiguity in Inverse Reinforcement Learning
- NeurIPS 2024SwitchHead: Accelerating Transformers with Mixture-of-Experts Attention
- NeurIPS 2024Toward Efficient Inference for Mixture of Experts
- NeurIPS 2024Transcendence: Generative Models Can Outperform The Experts That Train Them
- NeurIPS 2024Twin-Merging: Dynamic Integration of Modular Expertise in Model Merging
- NeurIPS 2024Unchosen Experts Can Contribute Too: Unleashing MoE Models’ Power by Self-Contrast
- NeurIPS 2024Uni-Med: A Unified Medical Generalist Foundation Model For Multi-Task Learning Via Connector-MoE
- NeurIPS 2024Variational Distillation of Diffusion Policies into Mixture of Experts
- CVPR 2023Balanced Product of Calibrated Experts for Long-Tailed Recognition
- CVPR 2023ERNIE-ViLG 2.0: Improving Text-to-Image Diffusion Model With Knowledge-Enhanced Mixture-of-Denoising-Experts
- CVPR 2023Global and Local Mixture Consistency Cumulative Learning for Long-Tailed Visual Recognitions
- CVPR 2023MixNeRF: Modeling a Ray With Mixture Density for Novel View Synthesis From Sparse Inputs
- CVPR 2023Mod-Squad: Designing Mixtures of Experts As Modular Multi-Task Learners
- CVPR 2023RepMode: Learning to Re-Parameterize Diverse Experts for Subcellular Structure Prediction
- ICLR 2023A Mixture-of-Expert Approach to RL-based Dialogue Management
- ICLR 2023Chasing All-Round Graph Representation Robustness: Model, Training, and Optimization
- ICLR 2023DINO as a von Mises-Fisher mixture model
- ICLR 2023Impossibly Good Experts and How to Follow Them
- ICLR 2023Knowledge-in-Context: Towards Knowledgeable Semi-Parametric Language Models
- ICLR 2023Learning About Progress From Experts
- ICLR 2023Learning Adversarial Linear Mixture Markov Decision Processes with Bandit Feedback and Unknown Transition
- ICLR 2023Learning to CROSS exchange to solve min-max vehicle routing problems
- ICLR 2023Modeling Multimodal Aleatoric Uncertainty in Segmentation with Mixture of Stochastic Experts
- ICLR 2023SCoMoE: Efficient Mixtures of Experts with Structured Communication
- ICLR 2023Sparse Mixture-of-Experts are Domain Generalizable Learners
- ICLR 2023Sparse MoE as the New Dropout: Scaling Dense and Self-Slimmable Transformers
- ICLR 2023Sparse Upcycling: Training Mixture-of-Experts from Dense Checkpoints
- ICLR 2023Sparsity-Constrained Optimal Transport
- ICLR 2023Switch-NeRF: Learning Scene Decomposition with Mixture of Experts for Large-scale Neural Radiance Fields
- ICLR 2023Task-customized Masked Autoencoder via Mixture of Cluster-conditional Experts
- ICML 2023A Distribution Optimization Framework for Confidence Bounds of Risk Measures
- ICML 2023A Gromov--Wasserstein Geometric View of Spectrum-Preserving Graph Coarsening
- ICML 2023A Study of Global and Episodic Bonuses for Exploration in Contextual MDPs
- ICML 2023A theory of continuous generative flow networks
- ICML 2023A Unified Optimization Framework of ANN-SNN Conversion: Towards Optimal Mapping from Activation Values to Firing Rates
- ICML 2023Active Ranking of Experts Based on their Performances in Many Tasks
- ICML 2023Algorithmic Stability of Heavy-Tailed SGD with General Loss Functions
- ICML 2023Beyond the Edge of Stability via Two-step Gradient Updates
- ICML 2023Chemically Transferable Generative Backmapping of Coarse-Grained Proteins
- ICML 2023Cold Analysis of Rao-Blackwellized Straight-Through Gumbel-Softmax Gradient Estimator
在 Claude、Cursor 里直接问这个趋势
接上 Paperlist MCP 后,写综述、挑方向或准备投稿时,不用离开对话框就能拿到这页的数字:每年各会议的论文数、增长倍数、涨得最快的子方向和代表论文,AI 会按你的问题整理。
可以直接复制这句话问 AI
用 paperlist 查混合专家在 NeurIPS 2023–2026 的论文趋势,哪一年涨得最快?
AI 会调用的工具:get_topic_stats {"topic": "mixture-of-experts"}
常见问题
- 2023–2026 年四大会议一共有多少篇混合专家论文?
- 共 904 篇,按年份分别是 2023 年 236 篇、2024 年 119 篇、2025 年 223 篇、2026 年 326 篇。
- NeurIPS 2026 有多少篇混合专家论文?
- NeurIPS 2026 有 75 篇混合专家论文,上一届是 86 篇。
- ICLR 2026 有多少篇混合专家论文?
- ICLR 2026 有 73 篇混合专家论文,上一届是 59 篇。
- ICML 2026 有多少篇混合专家论文?
- ICML 2026 有 132 篇混合专家论文,上一届是 57 篇。
- CVPR 2026 有多少篇混合专家论文?
- CVPR 2026 有 46 篇混合专家论文,上一届是 21 篇。
- 哪个会议的混合专家论文最多?
- NeurIPS,2023–2026 年共 354 篇。