深度学习 · optimization论文趋势 2023–2026

主要结论

• 深度学习 · optimization论文从 2023 年的 256 篇降到 2026 年的 240 篇，热度在回落。
• NeurIPS 是发深度学习 · optimization论文最多的会议，2023–2026 年共 500 篇，占四个会议总量的 52%。
• 交叉方向里涨得最快的是对齐与安全：同时属于两个主题的论文从 2023 年的 5 篇增至 2026 年的 23 篇。
• 在「深度学习」的 11 个主题里，它的 2026 年论文数排第 6；同组增长最快的扩散模型是 4.1 倍，深度学习 · optimization是 0.9 倍。

代表论文

按年份和会议均匀挑选，方便快速看到每一届的样貌

• NeurIPS 2026Achieving Directional-Stationarity from a Single Random Direction Step
• ICML 2026Bottleneck Communication Delay Minimization for Communication-Efficient Decentralized Learning
• ICLR 2026From Sorting Algorithms to Scalable Kernels: Bayesian Optimization in High-Dimensional Permutation Spaces
• CVPR 2026Coverage Optimization for Camera View Selection
• NeurIPS 2025High-Performance Arithmetic Circuit Optimization via Differentiable Architecture Search
• ICML 2025Feature-Mapping Topology Optimization with Neural Heaviside Signed Distance Functions
• ICLR 2025Boosting Neural Combinatorial Optimization for Large-Scale Vehicle Routing Problems
• CVPR 2025HotSpot: Signed Distance Function Optimization with an Asymptotically Sufficient Condition
• NeurIPS 2024$\boldsymbol{\mu}\mathbf{P^2}$: Effective Sharpness Aware Minimization Requires Layerwise Perturbation Scaling
• ICML 2024Barrier Algorithms for Constrained Non-Convex Optimization
• ICLR 2024Bayesian Coreset Optimization for Personalized Federated Learning
• CVPR 2024Multi-Session SLAM with Differentiable Wide-Baseline Pose Optimization
• NeurIPS 2023$\textbf{A}^2\textbf{CiD}^2$: Accelerating Asynchronous Communication in Decentralized Deep Learning
• ICML 2023Buying Information for Stochastic Optimization
• ICLR 2023Alternating Differentiation for Optimization Layers
• CVPR 2023Visual-Language Prompt Tuning With Knowledge-Guided Context Optimization
• NeurIPS 2026Adaptive Conditional Gradient Sliding: Projection-Free and Line-Search-Free Acceleration
• ICML 2026Riemannian Optimization for Fair Spectral Clustering
• ICLR 2026Gradient-Based Diversity Optimization with Differentiable Top-$k$ Objective
• CVPR 2026Its Never Too Late Noise Optimization for Collapse Recovery in

全部深度学习 · optimization论文

共 103 篇，第 1 / 3 页

1. NeurIPS 2026A Doubly Smoothed Decentralized Stochastic Minimax Optimization Algorithm
2. NeurIPS 2026Achieving Better Local Regret Bound for Online Non-Convex Bilevel Optimization
3. NeurIPS 2026Achieving Directional-Stationarity from a Single Random Direction Step
4. NeurIPS 2026Adaptive Conditional Gradient Sliding: Projection-Free and Line-Search-Free Acceleration
5. NeurIPS 2026Adaptive-Margin Masking and Restoration for Balanced Multimodal Learning
6. NeurIPS 2026Adaptively Incorporating Directional Hints into Zeroth-Order Optimization
7. NeurIPS 2026An Educated Guess: Deriving Statistically Aligned Gradient Estimates for Zeroth-Order Optimization
8. NeurIPS 2026BBOWP-Bench: Evaluating LLMs on Black-Box Optimization Word Problems
9. NeurIPS 2026Beyond Bounded Variance: Variance-Reduced Normalized Methods for Nonconvex Optimization under Blum-Gladyshev Noise
10. NeurIPS 2026Capacity Allocation at the Source: Sparse Target Optimization for LLM Knowledge Editing
11. NeurIPS 2026Certified Single-Level Reformulation for Tri-Level Cyber-Physical Grid Security
12. NeurIPS 2026Closed-Form Last Layer Optimization
13. NeurIPS 2026Continuous p-adic Optimization
14. NeurIPS 2026Decoupled Optimization for Teacher-Student Semi-Supervised Learning via a Pioneer Student
15. NeurIPS 2026Differentiable Nonlinear Model Predictive Control
16. NeurIPS 2026DisCoMBO: Steering Expert-in-the-Loop Black Box Optimization via Distributional Conformance
17. NeurIPS 2026Disentangling Optimization Geometry via Hierarchical Polar Adapters for Class-Incremental Learning
18. NeurIPS 2026Distributionally Robust Black Box Optimization-based Bidding Strategy in Auction-based Federated Learning
19. NeurIPS 2026Distributionally Robust Listwise Preference Optimization
20. NeurIPS 2026Don't Waste Population: Post-Anneal Refinement for Combinatorial Optimization
21. NeurIPS 2026EDISCO: Equivariant Discrete Diffusion for Euclidean Combinatorial Optimization
22. NeurIPS 2026EMA-Nesterov: Stabilizing Nesterov's Lookahead for Accelerated Deep Learning Optimization
23. NeurIPS 2026Evolution Fine-Tuning: Learning to Discover Across 371 Optimization Tasks
24. NeurIPS 2026Expected Batch Optimal Transport Plans and Consequences for Flow Matching
25. NeurIPS 2026Federated Distributionally Robust Neural Combinatorial Optimization with Convergence Guarantees
26. NeurIPS 2026Finding Simple Proofs for First-Order Optimization
27. NeurIPS 2026Finite-Resolution Decision Sufficiency for Linear Optimization
28. NeurIPS 2026Flow-Corrected Shape Optimization: Taming Manifold Drift in High-Dimensional 3D Models
29. NeurIPS 2026Follow the Regularized Leader Does Not Converge in Constrained Optimization
30. NeurIPS 2026From Cursed to Competitive: Closing the ZO–FO Gap via Input-to-State Stability
31. NeurIPS 2026Fully First-Order Algorithms for Online Non-Convex Bilevel Optimization
32. NeurIPS 2026GNES: Neural-Guided Evolutionary Program Search for Interpretable Multi-Agent Control
33. NeurIPS 2026Gradient Descent’s Last Iterate is Often (slightly) Suboptimal
34. NeurIPS 2026Gradient Regularized Newton Boosting Trees with Global Convergence
35. NeurIPS 2026Group Distributionally Robust Optimization with Flexible Sample Queries
36. NeurIPS 2026Guaranteed Noisy CP Tensor Recovery via Riemannian Optimization on the Segre Manifold
37. NeurIPS 2026Improving Quantized Zeroth-Order Optimization through Reconstructed Low-Rank Structures
38. NeurIPS 2026Improving the Optimization Landscape of Matrix Completion with $\epsilon$-close Surrogates
39. NeurIPS 2026In-Context Black-Box Optimization with Unreliable Feedback
40. NeurIPS 2026In-Expectation Convergence of Stochastic Gradient Methods under Heavy-Tailed Noise
41. NeurIPS 2026Instance-Dependent Bandit Convex Optimization in One Dimension
42. NeurIPS 2026Interpreting Neural Combinatorial Optimization via Evolving Programmatic Bottlenecks
43. NeurIPS 2026Intrinsic Muon: Spectral Optimization on Riemannian Matrix Manifolds
44. NeurIPS 2026KDASO: Knowledge-Data Dual-Driven Automated Skill Optimization for Liability Adjudication Task
45. NeurIPS 2026KiteNorm: Variance Regularisation for Stable and Scalable Post-LN Transformers
46. NeurIPS 2026LDPCache: Locally Differentially Private Multi-Query Processing with Cache Optimization for Large Language Models
47. NeurIPS 2026Learning Polyhedral Conformal Sets for Robust Optimization
48. NeurIPS 2026Learning Rate Decay Can Exponentially Accelerate SGD for Global Optimization of Nonconvex Functions
49. NeurIPS 2026Learning-Augmented Online Portfolio Selection: Optimal Robustness-Consistency Tradeoffs
50. NeurIPS 2026Literati: Towards Anytime Optimal Shape Generalized Trees via AO*

常见问题

2023–2026 年四大会议一共有多少篇深度学习 · optimization论文？

共 953 篇，按年份分别是 2023 年 256 篇、2024 年 294 篇、2025 年 163 篇、2026 年 240 篇。

NeurIPS 2026 有多少篇深度学习 · optimization论文？

NeurIPS 2026 有 103 篇深度学习 · optimization论文，上一届是 62 篇。

ICLR 2026 有多少篇深度学习 · optimization论文？

ICLR 2026 有 44 篇深度学习 · optimization论文，上一届是 51 篇。

ICML 2026 有多少篇深度学习 · optimization论文？

ICML 2026 有 86 篇深度学习 · optimization论文，上一届是 44 篇。

CVPR 2026 有多少篇深度学习 · optimization论文？

CVPR 2026 有 7 篇深度学习 · optimization论文，上一届是 6 篇。

哪个会议的深度学习 · optimization论文最多？

NeurIPS，2023–2026 年共 500 篇。