分布式训练论文趋势 2023–2026
并行与大规模训练
统计范围：NeurIPS、ICLR、ICML、CVPR 四个会议，2023–2026 年，共 396 篇被归入该主题的论文。
主要结论
- 分布式训练论文从 2023 年的 95 篇增长到 2026 年的 98 篇，三年间扩大到约 1.0 倍。
- NeurIPS 是发分布式训练论文最多的会议，2023–2026 年共 208 篇，占四个会议总量的 53%。
- 交叉方向里涨得最快的是多模态大模型：同时属于两个主题的论文从 2023 年的 1 篇增至 2026 年的 10 篇。
- 在「效率与系统」的 5 个主题里，它的 2026 年论文数排第 4；同组增长最快的硬件协同是 4.4 倍，分布式训练是 1.0 倍。
各会议论文数
按年份和会议统计
| 年份 | NeurIPS | ICLR | ICML | CVPR | 合计 |
|---|---|---|---|---|---|
| 2023 | 54 | 10 | 28 | 3 | 95 |
| 2024 | 49 | 12 | 8 | 5 | 74 |
| 2025 | 69 | 18 | 40 | 2 | 129 |
| 2026 | 36 | 18 | 42 | 2 | 98 |
代表论文
按年份和会议均匀挑选，方便快速看到每一届的样貌
- NeurIPS 2026AgentWeave: Efficient Distributed Agent Serving via Flow Decomposition
- ICML 2026Breaking the Capacity Bottleneck in Model-Heterogeneous Federated Learning via Gradual Model Restoration
- ICLR 2026Cascadia: An Efficient Cascade Serving System for Large Language Models
- CVPR 2026Finding Distributed Object-Centric Properties in Self-Supervised Transformers
- NeurIPS 2025A Fair Federated Learning Method for Handling Client Participation Probability Inconsistencies in Heterogeneous Environments
- ICML 2025BSemiFL: Semi-supervised Federated Learning via a Bayesian Approach
- ICLR 2025Addressing Label Shift in Distributed Learning via Entropy Regularization
- CVPR 2025Real-time High-fidelity Gaussian Human Avatars with Position-based Interpolation of Spatially Distributed MLPs
- NeurIPS 2024Communication Efficient Distributed Training with Distributed Lion
- ICML 2024Embarrassingly Parallel GFlowNets
- ICLR 2024Benchmarking Algorithms for Federated Domain Generalization
- CVPR 2024Deciphering 'What' and 'Where' Visual Pathways from Spectral Clustering of Layer-Distributed Neural Representations
- NeurIPS 20232Direction: Theoretically Faster Distributed Training with Bidirectional Communication Compression
- ICML 2023Block Subsampled Randomized Hadamard Transform for Nyström Approximation on Distributed Architectures
- ICLR 2023Distributed Extra-gradient with Optimal Complexity and Communication Guarantees
- CVPR 2023DisCo-CLIP: A Distributed Contrastive Loss for Memory Efficient CLIP Training
- NeurIPS 2026Do We Need Asynchronous SGD? On the Near-Optimality of Synchronous Methods
- ICML 2026Clipping Makes Distributed and Federated Asynchronous SGD Robust to Stragglers
- ICLR 2026DualMap: Enabling Both Cache Affinity and Load Balancing for Distributed LLM Serving
- CVPR 2026Parallel Rigidity Matters for Bundle Adjustment
全部分布式训练论文
共 396 篇，第 7 / 8 页
- NeurIPS 2024Toward Efficient Inference for Mixture of Experts
- CVPR 2023Compacting Binary Neural Networks by Sparse Kernel Selection
- CVPR 2023DisCo-CLIP: A Distributed Contrastive Loss for Memory Efficient CLIP Training
- CVPR 2023Out-of-Distributed Semantic Pruning for Robust Semi-Supervised Learning
- ICLR 2023Asynchronous Distributed Bilevel Optimization
- ICLR 2023DASHA: Distributed Nonconvex Optimization with Communication Compression and Optimal Oracle Complexity
- ICLR 2023Distributed Differential Privacy in Multi-Armed Bandits
- ICLR 2023Distributed Extra-gradient with Optimal Complexity and Communication Guarantees
- ICLR 2023Does Deep Learning Learn to Abstract? A Systematic Probing Framework
- ICLR 2023LDMIC: Learning-based Distributed Multi-view Image Coding
- ICLR 2023Learning Kernelized Contextual Bandits in a Distributed and Asynchronous Environment
- ICLR 2023Sparse Distributed Memory is a Continual Learner
- ICLR 2023The Symmetric Generalized Eigenvalue Problem as a Nash Equilibrium
- ICLR 2023Why (and When) does Local SGD Generalize Better than SGD?
- ICML 2023Better Diffusion Models Further Improve Adversarial Training
- ICML 2023Bi-directional Masks for Efficient N:M Sparse Training
- ICML 2023Block Subsampled Randomized Hadamard Transform for Nyström Approximation on Distributed Architectures
- ICML 2023DIFF2: Differential Private Optimization via Gradient Differences for Nonconvex Distributed Learning
- ICML 2023Differentially Private Distributed Bayesian Linear Regression with MCMC
- ICML 2023Distributed Contextual Linear Bandits with Minimax Optimal Communication Cost
- ICML 2023Distributed Linear Bandits under Communication Constraints
- ICML 2023Distributed Stochastic Gradient Descent: Nonconvexity, Nonsmoothness, and Convergence to Local Minima
- ICML 2023DIVISION: Memory Efficient Training via Dual Activation Precision
- ICML 2023EF21-P and Friends: Improved Theoretical Communication Complexity for Distributed Optimization with Bidirectional Compression
- ICML 2023Existence and Estimation of Critical Batch Size for Training Generative Adversarial Networks with Two Time-Scale Update Rule
- ICML 2023Fast Algorithms for Distributed k-Clustering with Outliers
- ICML 2023Federated Conformal Predictors for Distributed Uncertainty Quantification
- ICML 2023FlexRound: Learnable Rounding based on Element-wise Division for Post-Training Quantization
- ICML 2023GAT: Guided Adversarial Training with Pareto-optimal Auxiliary Tasks
- ICML 2023Learn to Accumulate Evidence from All Training Samples: Theory and Practice
- ICML 2023Lowering the Pre-training Tax for Gradient-based Subset Training: A Lightweight Distributed Pre-Training Toolkit
- ICML 2023Multi-Objective Population Based Training
- ICML 2023Optimal Shrinkage for Distributed Second-Order Optimization
- ICML 2023Parallel Neurosymbolic Integration with Concordia
- ICML 2023Project and Forget: Solving Large-Scale Metric Constrained Problems
- ICML 2023Quantized Distributed Training of Large Models with Convergence Guarantees
- ICML 2023SGD with Large Step Sizes Learns Sparse Features
- ICML 2023Spatial Implicit Neural Representations for Global-Scale Species Mapping
- ICML 2023Stabilizing GANs' Training with Brownian Motion Controller
- ICML 2023Unit Scaling: Out-of-the-Box Low-Precision Training
- ICML 2023When does Privileged information Explain Away Label Noise?
- ICML 2023Wrapped Cauchy Distributed Angular Softmax for Long-Tailed Visual Recognition
- NeurIPS 20232Direction: Theoretically Faster Distributed Training with Bidirectional Communication Compression
- NeurIPS 2023A Computation and Communication Efficient Method for Distributed Nonconvex Problems in the Partial Participation Setting
- NeurIPS 2023A Fast and Accurate Estimator for Large Scale Linear Model via Data Averaging
- NeurIPS 2023A Hierarchical Training Paradigm for Antibody Structure-sequence Co-design
- NeurIPS 2023AD-PT: Autonomous Driving Pre-Training with Large-scale Point Cloud Dataset
- NeurIPS 2023Adversarial Training from Mean Field Perspective
- NeurIPS 2023Adversarially Robust Distributed Count Tracking via Partial Differential Privacy
- NeurIPS 2023American Stories: A Large-Scale Structured Text Dataset of Historical U.S. Newspapers
在 Claude、Cursor 里直接问这个趋势
接上 Paperlist MCP 后，写综述、挑方向或准备投稿时，不用离开对话框就能拿到这页的数字：每年各会议的论文数、增长倍数、涨得最快的子方向和代表论文，AI 会按你的问题整理。
可以直接复制这句话问 AI
用 paperlist 查分布式训练在 NeurIPS 2023–2026 的论文趋势，哪一年涨得最快？
AI 会调用的工具：get_topic_stats {"topic": "distributed-training"}
常见问题
- 2023–2026 年四大会议一共有多少篇分布式训练论文？
- 共 396 篇，按年份分别是 2023 年 95 篇、2024 年 74 篇、2025 年 129 篇、2026 年 98 篇。
- NeurIPS 2026 有多少篇分布式训练论文？
- NeurIPS 2026 有 36 篇分布式训练论文，上一届是 69 篇。
- ICLR 2026 有多少篇分布式训练论文？
- ICLR 2026 有 18 篇分布式训练论文，上一届是 18 篇。
- ICML 2026 有多少篇分布式训练论文？
- ICML 2026 有 42 篇分布式训练论文，上一届是 40 篇。
- CVPR 2026 有多少篇分布式训练论文？
- CVPR 2026 有 2 篇分布式训练论文，上一届是 2 篇。
- 哪个会议的分布式训练论文最多？
- NeurIPS，2023–2026 年共 208 篇。