混合专家论文趋势 2023–2026

主要结论

• 混合专家论文从 2023 年的 236 篇增长到 2026 年的 326 篇，三年间扩大到约 1.4 倍。
• NeurIPS 是发混合专家论文最多的会议，2023–2026 年共 354 篇，占四个会议总量的 39%。
• 交叉方向里涨得最快的是多模态大模型：同时属于两个主题的论文从 2023 年的 4 篇增至 2026 年的 79 篇。
• 在「优化与缩放」的 5 个主题里，它的 2026 年论文数排第 4；同组增长最快的缩放定律是 4.1 倍，混合专家是 1.4 倍。

代表论文

按年份和会议均匀挑选，方便快速看到每一届的样貌

• NeurIPS 2026A Biconvex Formulation for Stable Transport of Mixture Models with a Unique Solution
• ICML 2026$\phi$-Balancing for Mixture-of-Experts Training
• ICLR 2026A Federated Generalized Expectation-Maximization Algorithm for Mixture Models with an Unknown Number of Components
• CVPR 2026Divide Conquer and Aggregate Asymmetric Experts for Class-Imbalanced Semi-Supervised Medical
• NeurIPS 2025Advancing Expert Specialization for Better MoE
• ICML 2025$\texttt{I$^2$MoE}$: Interpretable Multimodal Interaction-aware Mixture-of-Experts
• ICLR 2025A Sanity Check for AI-generated Image Detection
• CVPR 2025Complexity Experts are Task-Discriminative Learners for Any Image Restoration
• NeurIPS 2024$\texttt{Model-GLUE}$: Democratized LLM Scaling for A Large Model Zoo in the Wild
• ICML 2024$\texttt{MoE-RBench}$: Towards Building Reliable Language Models with Sparse Mixture-of-Experts
• ICLR 2024Fusing Models with Complementary Expertise
• CVPR 2024MoDE: CLIP Data Experts via Clustering
• NeurIPS 2023[Re] Numerical influence of ReLU'(0) on backpropagation
• ICML 2023A Distribution Optimization Framework for Confidence Bounds of Risk Measures
• ICLR 2023Knowledge-in-Context: Towards Knowledgeable Semi-Parametric Language Models
• CVPR 2023Balanced Product of Calibrated Experts for Long-Tailed Recognition
• NeurIPS 2026AdERA: Adaptive Exponent Reuse for Lossless Allgather in Sharded MoE Training
• ICML 2026Attention Sink Forges Native MoE in Attention Layers: Sink-Aware Training to Address Head Collapse
• ICLR 2026Abstracting Robot Manipulation Skills via Mixture-of-Experts Diffusion Policies
• CVPR 2026ERMoE Eigen-Reparameterized Mixture-of-Experts for Stable Routing and Interpretable Specialization

全部混合专家论文

共 236 篇，第 3 / 5 页

101. NeurIPS 2023[Re] On Explainability of Graph Neural Networks via Subgraph Explorations
102. NeurIPS 2023[Re] On the Reproducibility of “FairCal: Fairness Calibration for Face Verification”
103. NeurIPS 2023[Re] On the Reproducibility of CartoonX
104. NeurIPS 2023[Re] Pure Noise to the Rescue of Insufficient Data
105. NeurIPS 2023$\mathbf{\mathbb{E}^{FWI}}$: Multiparameter Benchmark Datasets for Elastic Full Waveform Inversion of Geophysical Properties
106. NeurIPS 2023A benchmark of categorical encoders for binary classification
107. NeurIPS 2023A Dataset of Relighted 3D Interacting Hands
108. NeurIPS 2023A Dynamical System View of Langevin-Based Non-Convex Sampling
109. NeurIPS 2023A Guide Through the Zoo of Biased SGD
110. NeurIPS 2023A Massive Scale Semantic Similarity Dataset of Historical English
111. NeurIPS 2023A normative theory of social conflict
112. NeurIPS 2023Adversarial Examples Might be Avoidable: The Role of Data Concentration in Adversarial Robustness
113. NeurIPS 2023Aiming towards the minimizers: fast convergence of SGD for overparametrized problems
114. NeurIPS 2023Alternating Gradient Descent and Mixture-of-Experts for Integrated Multimodal Perception
115. NeurIPS 2023An Empirical Investigation of the Role of Pre-training in Lifelong Learning
116. NeurIPS 2023Bootstrapped Training of Score-Conditioned Generator for Offline Design of Biological Sequences
117. NeurIPS 2023Bounded rationality in structured density estimation
118. NeurIPS 2023Bounding the Invertibility of Privacy-preserving Instance Encoding using Fisher Information
119. NeurIPS 2023Causal Effect Regularization: Automated Detection and Removal of Spurious Correlations
120. NeurIPS 2023Characterization of Overfitting in Robust Multiclass Classification
121. NeurIPS 2023Circuit as Set of Points
122. NeurIPS 2023Classification of Heavy-tailed Features in High Dimensions: a Superstatistical Approach
123. NeurIPS 2023Concentration analysis of multivariate elliptic diffusions
124. NeurIPS 2023Convergence of Alternating Gradient Descent for Matrix Factorization
125. NeurIPS 2023DAMEX: Dataset-aware Mixture-of-Experts for visual understanding of mixture-of-datasets
126. NeurIPS 2023DeepfakeBench: A Comprehensive Benchmark of Deepfake Detection
127. NeurIPS 2023Demystifying Softmax Gating Function in Gaussian Mixture of Experts
128. NeurIPS 2023Dense-Exponential Random Features: Sharp Positive Estimators of the Gaussian Kernel
129. NeurIPS 2023Density of States Prediction of Crystalline Materials via Prompt-guided Multi-Modal Transformer
130. NeurIPS 2023Differentiable and Stable Long-Range Tracking of Multiple Posterior Modes
131. NeurIPS 2023Differentiable Registration of Images and LiDAR Point Clouds with VoxelPoint-to-Pixel Matching
132. NeurIPS 2023Differentiable Sampling of Categorical Distributions Using the CatLog-Derivative Trick
133. NeurIPS 2023Direct Training of SNN using Local Zeroth Order Method
134. NeurIPS 2023Distributionally Robust Ensemble of Lottery Tickets Towards Calibrated Sparse Network Training
135. NeurIPS 2023Diversified Outlier Exposure for Out-of-Distribution Detection via Informative Extrapolation
136. NeurIPS 2023Diversify \& Conquer: Outcome-directed Curriculum RL via Out-of-Distribution Disagreement
137. NeurIPS 2023Dynamic Regret of Adversarial Linear Mixture MDPs
138. NeurIPS 2023Ego4D Goal-Step: Toward Hierarchical Understanding of Procedural Activities
139. NeurIPS 2023Embracing the chaos: analysis and diagnosis of numerical instability in variational flows
140. NeurIPS 2023EV-Eye: Rethinking High-frequency Eye Tracking through the Lenses of Event Cameras
141. NeurIPS 2023Exact Optimality of Communication-Privacy-Utility Tradeoffs in Distributed Mean Estimation
142. NeurIPS 2023Exact recovery and Bregman hard clustering of node-attributed Stochastic Block Model
143. NeurIPS 2023Fantastic Robustness Measures: The Secrets of Robust Generalization
144. NeurIPS 2023Fast Approximation of Similarity Graphs with Kernel Density Estimation
145. NeurIPS 2023Gaussian Mixture Solvers for Diffusion Models
146. NeurIPS 2023Generalization in the Face of Adaptivity: A Bayesian Perspective
147. NeurIPS 2023Generative Modeling through the Semi-dual Formulation of Unbalanced Optimal Transport
148. NeurIPS 2023Geometric Analysis of Matrix Sensing over Graphs
149. NeurIPS 2023Global Optimality and Finite Sample Analysis of Softmax Off-Policy Actor Critic under State Distribution Mismatch
150. NeurIPS 2023Graph Mixture of Experts: Learning on Large-Scale Graphs with Explicit Diversity Modeling

常见问题

2023–2026 年四大会议一共有多少篇混合专家论文？

共 904 篇，按年份分别是 2023 年 236 篇、2024 年 119 篇、2025 年 223 篇、2026 年 326 篇。

NeurIPS 2026 有多少篇混合专家论文？

NeurIPS 2026 有 75 篇混合专家论文，上一届是 86 篇。

ICLR 2026 有多少篇混合专家论文？

ICLR 2026 有 73 篇混合专家论文，上一届是 59 篇。

ICML 2026 有多少篇混合专家论文？

ICML 2026 有 132 篇混合专家论文，上一届是 57 篇。

CVPR 2026 有多少篇混合专家论文？

CVPR 2026 有 46 篇混合专家论文，上一届是 21 篇。

哪个会议的混合专家论文最多？

NeurIPS，2023–2026 年共 354 篇。