深度学习 · optimization论文趋势 2023–2026

主要结论

• 深度学习 · optimization论文从 2023 年的 256 篇降到 2026 年的 240 篇，热度在回落。
• NeurIPS 是发深度学习 · optimization论文最多的会议，2023–2026 年共 500 篇，占四个会议总量的 52%。
• 交叉方向里涨得最快的是对齐与安全：同时属于两个主题的论文从 2023 年的 5 篇增至 2026 年的 23 篇。
• 在「深度学习」的 11 个主题里，它的 2026 年论文数排第 6；同组增长最快的扩散模型是 4.1 倍，深度学习 · optimization是 0.9 倍。

代表论文

按年份和会议均匀挑选，方便快速看到每一届的样貌

• NeurIPS 2026Achieving Directional-Stationarity from a Single Random Direction Step
• ICML 2026Bottleneck Communication Delay Minimization for Communication-Efficient Decentralized Learning
• ICLR 2026From Sorting Algorithms to Scalable Kernels: Bayesian Optimization in High-Dimensional Permutation Spaces
• CVPR 2026Coverage Optimization for Camera View Selection
• NeurIPS 2025High-Performance Arithmetic Circuit Optimization via Differentiable Architecture Search
• ICML 2025Feature-Mapping Topology Optimization with Neural Heaviside Signed Distance Functions
• ICLR 2025Boosting Neural Combinatorial Optimization for Large-Scale Vehicle Routing Problems
• CVPR 2025HotSpot: Signed Distance Function Optimization with an Asymptotically Sufficient Condition
• NeurIPS 2024$\boldsymbol{\mu}\mathbf{P^2}$: Effective Sharpness Aware Minimization Requires Layerwise Perturbation Scaling
• ICML 2024Barrier Algorithms for Constrained Non-Convex Optimization
• ICLR 2024Bayesian Coreset Optimization for Personalized Federated Learning
• CVPR 2024Multi-Session SLAM with Differentiable Wide-Baseline Pose Optimization
• NeurIPS 2023$\textbf{A}^2\textbf{CiD}^2$: Accelerating Asynchronous Communication in Decentralized Deep Learning
• ICML 2023Buying Information for Stochastic Optimization
• ICLR 2023Alternating Differentiation for Optimization Layers
• CVPR 2023Visual-Language Prompt Tuning With Knowledge-Guided Context Optimization
• NeurIPS 2026Adaptive Conditional Gradient Sliding: Projection-Free and Line-Search-Free Acceleration
• ICML 2026Riemannian Optimization for Fair Spectral Clustering
• ICLR 2026Gradient-Based Diversity Optimization with Differentiable Top-$k$ Objective
• CVPR 2026Its Never Too Late Noise Optimization for Collapse Recovery in

全部深度学习 · optimization论文

共 953 篇，第 10 / 20 页

451. ICML 2024Differentiable Mapper for Topological Optimization of Data Representation
452. ICML 2024Distributed Bilevel Optimization with Communication Compression
453. ICML 2024Distribution Alignment Optimization through Neural Collapse for Long-tailed Classification
454. ICML 2024Double Variance Reduction: A Smoothing Trick for Composite Optimization Problems without First-Order Gradient
455. ICML 2024Dynamic Anisotropic Smoothing for Noisy Derivative-Free Optimization
456. ICML 2024Efficient Algorithms for Sum-Of-Minimum Optimization
457. ICML 2024Efficient Stochastic Approximation of Minimax Excess Risk Optimization
458. ICML 2024FADAS: Towards Federated Adaptive Asynchronous Optimization
459. ICML 2024Federated Optimization with Doubly Regularized Drift Correction
460. ICML 2024From Generalization Analysis to Optimization Designs for State Space Models
461. ICML 2024From Inverse Optimization to Feasibility to ERM
462. ICML 2024Fundamental Benefit of Alternating Updates in Minimax Optimization
463. ICML 2024Gradient Compressed Sensing: A Query-Efficient Gradient Estimator for High-Dimensional Zeroth-Order Optimization
464. ICML 2024High-Probability Bound for Non-Smooth Non-Convex Stochastic Optimization with Heavy Tails
465. ICML 2024How Free is Parameter-Free Stochastic Optimization?
466. ICML 2024How to Make the Gradients Small Privately: Improved Rates for Differentially Private Non-Convex Optimization
467. ICML 2024Implicit Bias of AdamW: $\ell_\infty$-Norm Constrained Optimization
468. ICML 2024Improving SAM Requires Rethinking its Optimization Formulation
469. ICML 2024In-Context Freeze-Thaw Bayesian Optimization for Hyperparameter Optimization
470. ICML 2024InstructZero: Efficient Instruction Optimization for Black-Box Large Language Models
471. ICML 2024Joint Composite Latent Space Bayesian Optimization
472. ICML 2024KernelSHAP-IQ: Weighted Least Square Optimization for Shapley Interactions
473. ICML 2024LASER: Linear Compression in Wireless Distributed Optimization
474. ICML 2024Learning-Rate-Free Stochastic Optimization over Riemannian Manifolds
475. ICML 2024Locally Differentially Private Decentralized Stochastic Bilevel Optimization with Guaranteed Convergence Accuracy
476. ICML 2024LPGD: A General Framework for Backpropagation through Embedded Optimization Layers
477. ICML 2024No Wrong Turns: The Simple Geometry Of Neural Networks Optimization Paths
478. ICML 2024Non-convex Stochastic Composite Optimization with Polyak Momentum
479. ICML 2024Non-stationary Online Convex Optimization with Arbitrary Delays
480. ICML 2024On Discrete Prompt Optimization for Diffusion Models
481. ICML 2024On PI Controllers for Updating Lagrange Multipliers in Constrained Optimization
482. ICML 2024On the Complexity of Finite-Sum Smooth Optimization under the Polyak–Łojasiewicz Condition
483. ICML 2024On The Complexity of First-Order Methods in Stochastic Bilevel Optimization
484. ICML 2024Optimal Hessian/Jacobian-Free Nonconvex-PL Bilevel Optimization
485. ICML 2024Optimization without Retraction on the Random Generalized Stiefel Manifold
486. ICML 2024Plug-in Performative Optimization
487. ICML 2024Position: Leverage Foundational Models for Black-Box Optimization
488. ICML 2024Position: Optimization in SciML Should Employ the Function Space Geometry
489. ICML 2024Posterior Sampling-Based Bayesian Optimization with Tighter Bayesian Regret Bounds
490. ICML 2024Principled Preferential Bayesian Optimization
491. ICML 2024Probability Distribution of Hypervolume Improvement in Bi-objective Bayesian Optimization
492. ICML 2024Projection-Free Online Convex Optimization with Time-Varying Constraints
493. ICML 2024Quantum Algorithm for Online Exp-concave Optimization
494. ICML 2024Robust Data-driven Prescriptiveness Optimization
495. ICML 2024Robust Optimization in Protein Fitness Landscapes Using Reinforcement Learning in Latent Space
496. ICML 2024Sample Average Approximation for Conditional Stochastic Optimization with Dependent Data
497. ICML 2024Skill Set Optimization: Reinforcing Language Model Behavior via Transferable Skills
498. ICML 2024Stochastic Optimization with Arbitrary Recurrent Data Sampling
499. ICML 2024Stochastic Weakly Convex Optimization beyond Lipschitz Continuity
500. ICML 2024Symmetric Replay Training: Enhancing Sample Efficiency in Deep Reinforcement Learning for Combinatorial Optimization

常见问题

2023–2026 年四大会议一共有多少篇深度学习 · optimization论文？

共 953 篇，按年份分别是 2023 年 256 篇、2024 年 294 篇、2025 年 163 篇、2026 年 240 篇。

NeurIPS 2026 有多少篇深度学习 · optimization论文？

NeurIPS 2026 有 103 篇深度学习 · optimization论文，上一届是 62 篇。

ICLR 2026 有多少篇深度学习 · optimization论文？

ICLR 2026 有 44 篇深度学习 · optimization论文，上一届是 51 篇。

ICML 2026 有多少篇深度学习 · optimization论文？

ICML 2026 有 86 篇深度学习 · optimization论文，上一届是 44 篇。

CVPR 2026 有多少篇深度学习 · optimization论文？

CVPR 2026 有 7 篇深度学习 · optimization论文，上一届是 6 篇。

哪个会议的深度学习 · optimization论文最多？

NeurIPS，2023–2026 年共 500 篇。