深度学习 · optimization论文趋势 2023–2026

主要结论

• 深度学习 · optimization论文从 2023 年的 256 篇降到 2026 年的 240 篇，热度在回落。
• NeurIPS 是发深度学习 · optimization论文最多的会议，2023–2026 年共 500 篇，占四个会议总量的 52%。
• 交叉方向里涨得最快的是对齐与安全：同时属于两个主题的论文从 2023 年的 5 篇增至 2026 年的 23 篇。
• 在「深度学习」的 11 个主题里，它的 2026 年论文数排第 6；同组增长最快的扩散模型是 4.1 倍，深度学习 · optimization是 0.9 倍。

代表论文

按年份和会议均匀挑选，方便快速看到每一届的样貌

• NeurIPS 2026Achieving Directional-Stationarity from a Single Random Direction Step
• ICML 2026Bottleneck Communication Delay Minimization for Communication-Efficient Decentralized Learning
• ICLR 2026From Sorting Algorithms to Scalable Kernels: Bayesian Optimization in High-Dimensional Permutation Spaces
• CVPR 2026Coverage Optimization for Camera View Selection
• NeurIPS 2025High-Performance Arithmetic Circuit Optimization via Differentiable Architecture Search
• ICML 2025Feature-Mapping Topology Optimization with Neural Heaviside Signed Distance Functions
• ICLR 2025Boosting Neural Combinatorial Optimization for Large-Scale Vehicle Routing Problems
• CVPR 2025HotSpot: Signed Distance Function Optimization with an Asymptotically Sufficient Condition
• NeurIPS 2024$\boldsymbol{\mu}\mathbf{P^2}$: Effective Sharpness Aware Minimization Requires Layerwise Perturbation Scaling
• ICML 2024Barrier Algorithms for Constrained Non-Convex Optimization
• ICLR 2024Bayesian Coreset Optimization for Personalized Federated Learning
• CVPR 2024Multi-Session SLAM with Differentiable Wide-Baseline Pose Optimization
• NeurIPS 2023$\textbf{A}^2\textbf{CiD}^2$: Accelerating Asynchronous Communication in Decentralized Deep Learning
• ICML 2023Buying Information for Stochastic Optimization
• ICLR 2023Alternating Differentiation for Optimization Layers
• CVPR 2023Visual-Language Prompt Tuning With Knowledge-Guided Context Optimization
• NeurIPS 2026Adaptive Conditional Gradient Sliding: Projection-Free and Line-Search-Free Acceleration
• ICML 2026Riemannian Optimization for Fair Spectral Clustering
• ICLR 2026Gradient-Based Diversity Optimization with Differentiable Top-$k$ Objective
• CVPR 2026Its Never Too Late Noise Optimization for Collapse Recovery in

全部深度学习 · optimization论文

共 44 篇，第 1 / 1 页

1. ICLR 2026A Block Coordinate Descent Method for Nonsmooth Composite Optimization under Orthogonality Constraints
2. ICLR 2026Beyond Short Steps in Frank-Wolfe Algorithms
3. ICLR 2026Cautious Weight Decay
4. ICLR 2026Clipped Gradient Methods for Nonsmooth Convex Optimization under Heavy-Tailed Noise: A Refined Analysis
5. ICLR 2026Combinatorial Bandit Bayesian Optimization for Tensor Outputs
6. ICLR 2026Communication-Efficient Decentralized Optimization via Double-Communication Symmetric ADMM
7. ICLR 2026Composite Optimization with Error Feedback: the Dual Averaging Approach
8. ICLR 2026Convergence of Muon with Newton-Schulz
9. ICLR 2026Deep FlexQP: Accelerated Nonlinear Programming via Deep Unfolding
10. ICLR 2026Discounted Online Convex Optimization: Uniform Regret Across a Continuous Interval
11. ICLR 2026DNT: a Deeply Normalized Transformer that can be trained by Momentum SGD
12. ICLR 2026Faster Gradient Methods for Highly-smooth Stochastic Bilevel Optimization
13. ICLR 2026FedMuon: Federated Learning with Bias-corrected LMO-based Optimization
14. ICLR 2026From Sorting Algorithms to Scalable Kernels: Bayesian Optimization in High-Dimensional Permutation Spaces
15. ICLR 2026GoalRank: Group-Relative Optimization for a Large Ranking Model
16. ICLR 2026Gradient-Based Diversity Optimization with Differentiable Top-$k$ Objective
17. ICLR 2026Gradient-Normalized Smoothness for Optimization with Approximate Hessians
18. ICLR 2026Incorporating Expert Priors into Bayesian Optimization via Dynamic Mean Decay
19. ICLR 2026Learning of Population Dynamics: Inverse Optimization Meets JKO Scheme
20. ICLR 2026LMask: Learn to Solve Constrained Routing Problems with Lazy Masking
21. ICLR 2026Local Entropy Search over Descent Sequences for Bayesian Optimization
22. ICLR 2026Machine Unlearning under Retain–Forget Entanglement
23. ICLR 2026MaskInversion: Localized Embeddings via Optimization of Explainability Maps
24. ICLR 2026Mitigating Mismatch within Reference-based Preference Optimization
25. ICLR 2026MuonBP: Faster Muon via Block-Periodic Orthogonalization
26. ICLR 2026On The Surprising Effectiveness of a Single Global Merging in Decentralized Learning
27. ICLR 2026Online Black-Box Prompt Optimization with Regret Guarantees under Noisy Feedback
28. ICLR 2026Pinet: Optimizing hard-constrained neural networks with orthogonal projection layers
29. ICLR 2026Reducing Contextual Stochastic Bilevel Optimization via Structured Function Approximation
30. ICLR 2026Robust Optimization for Mitigating Reward Hacking with Correlated Proxies
31. ICLR 2026Scalable Second-order Riemannian Optimization for $K$-means Clustering
32. ICLR 2026Single-Loop Byzantine-Resilient Federated Bilevel Optimization
33. ICLR 2026Soft Quality-Diversity Optimization
34. ICLR 2026Special Unitary Parameterized Estimators of Rotation
35. ICLR 2026SPRIG: Improving Large Language Model Performance by System Prompt Optimization
36. ICLR 2026Stop Guessing: Choosing the Optimization-Consistent Uncertainty Measurement for Evidential Deep Learning
37. ICLR 2026Strongly Convex Sets in Riemannian Manifolds
38. ICLR 2026Submodular Function Minimization with Dueling Oracle
39. ICLR 2026SVD Provably Denoises Nearest Neighbor Data
40. ICLR 2026Symmetry-Aware Bayesian Optimization via Max Kernels
41. ICLR 2026The Potential of Second-Order Optimization for LLMs: A Study with Full Gauss-Newton
42. ICLR 2026Thinking on the Fly: Test-Time Reasoning Enhancement via Latent Thought Policy Optimization
43. ICLR 2026Token-Importance Guided Direct Preference Optimization
44. ICLR 2026Towards Learned Optimization Free Lunch

常见问题

2023–2026 年四大会议一共有多少篇深度学习 · optimization论文？

共 953 篇，按年份分别是 2023 年 256 篇、2024 年 294 篇、2025 年 163 篇、2026 年 240 篇。

NeurIPS 2026 有多少篇深度学习 · optimization论文？

NeurIPS 2026 有 103 篇深度学习 · optimization论文，上一届是 62 篇。

ICLR 2026 有多少篇深度学习 · optimization论文？

ICLR 2026 有 44 篇深度学习 · optimization论文，上一届是 51 篇。

ICML 2026 有多少篇深度学习 · optimization论文？

ICML 2026 有 86 篇深度学习 · optimization论文，上一届是 44 篇。

CVPR 2026 有多少篇深度学习 · optimization论文？

CVPR 2026 有 7 篇深度学习 · optimization论文，上一届是 6 篇。

哪个会议的深度学习 · optimization论文最多？

NeurIPS，2023–2026 年共 500 篇。