Deep learning · large language models papers, 2023–2026

Key findings

• Deep learning · large language models went from 488 papers in 2023 to 1,131 in 2026, roughly 2.3x in three years.
• ICML publishes the most Deep learning · large language models work: 1,608 papers from 2023 to 2026, 69% of the four-venue total.
• The fastest-growing overlap is with AI Agents: papers tagged with both rose from 5 in 2023 to 184 in 2026.
• Among the 11 topics under Deep Learning, it ranks #3 by 2026 paper count; the fastest grower in the group, Diffusion Models, is up 4.1x versus 2.3x here.

Representative papers

Spread across years and venues so every edition shows up

• ICML 2026“very likely” Means “uncertain”? How LLMs Diverge from Humans in Linguistic Uncertainty Quantification
• ICML 2025(How) Do Language Models Track State?
• ICLR 2025AdvWave: Stealthy Adversarial Jailbreak Attack against Large Audio-Language Models
• NeurIPS 2024$\beta$-DPO: Direct Preference Optimization with Dynamic $\beta$
• NeurIPS 20233D-LLM: Injecting the 3D World into Large Language Models
• ICML 2023Are Large Kernels Better Teachers than Transformers for ConvNets?
• ICML 2026$f$-Divergence Self-Play for Tabular Anomaly Detection via Large Language Models
• ICML 2025A Tale of Two Structures: Do LLMs Capture the Fractal Complexity of Language?
• ICLR 2025Emergence of a High-Dimensional Abstraction Phase in Language Transformers
• NeurIPS 2024$\textit{Trans-LoRA}$: towards data-free Transferable Parameter Efficient Finetuning
• NeurIPS 2023A fast heuristic to optimize time-space tradeoff for large models
• ICML 2023Arithmetic Sampling: Parallel Diverse Decoding for Large Language Models
• ICML 2026$L^3$: Large Lookup Layers
• ICML 2025Accelerating LLM Inference with Lossless Speculative Decoding Algorithms for Heterogeneous Vocabularies
• ICLR 2025Holistically Evaluating the Environmental Impact of Creating Language Models
• NeurIPS 2024A distributional simplicity bias in the learning dynamics of transformers
• NeurIPS 2023A Pseudo-Semantic Loss for Autoregressive Models with Logical Constraints
• ICML 2023Auto-Differentiation of Relational Computations for Very Large Scale Machine Learning
• ICML 2026$V_0$: A Generalist Value Model for Any Policy at State Zero
• ICML 2025Accelerating Unbiased LLM Evaluation via Synthetic Feedback

All Deep learning · large language models papers

404 papers, page 6 of 9

251. ICML 2025Over-Tokenized Transformer: Vocabulary is Generally Worth Scaling
252. ICML 2025Overcoming Multi-step Complexity in Multimodal Theory-of-Mind Reasoning: A Scalable Bayesian Planner
253. ICML 2025Overcoming Vocabulary Mismatch: Vocabulary-agnostic Teacher Guided Language Modeling
254. ICML 2025Overtrained Language Models Are Harder to Fine-Tune
255. ICML 2025PANDAS: Improving Many-shot Jailbreaking via Positive Affirmation, Negative Demonstration, and Adaptive Sampling
256. ICML 2025Parameters vs FLOPs: Scaling Laws for Optimal Sparsity for Mixture-of-Experts Language Models
257. ICML 2025PARM: Multi-Objective Test-Time Alignment via Preference-Aware Autoregressive Reward Model
258. ICML 2025Parrot: Multilingual Visual Instruction Tuning
259. ICML 2025PENCIL: Long Thoughts with Short Memory
260. ICML 2025Perception in Reflection
261. ICML 2025Peripheral Memory for LLMs: Integration of Sequential Memory Banks with Adaptive Querying
262. ICML 2025Persistent Topological Features in Large Language Models
263. ICML 2025PILAF: Optimal Human Preference Sampling for Reward Modeling
264. ICML 2025PIPA: Preference Alignment as Prior-Informed Statistical Estimation
265. ICML 2025Pivoting Factorization: A Compact Meta Low-Rank Representation of Sparsity for Efficient Inference in Large Language Models
266. ICML 2025Plan-and-Act: Improving Planning of Agents for Long-Horizon Tasks
267. ICML 2025PoisonBench: Assessing Language Model Vulnerability to Poisoned Preference Data
268. ICML 2025Policy Guided Tree Search for Enhanced LLM Reasoning
269. ICML 2025polybasic Speculative Decoding Through a Theoretical Perspective
270. ICML 2025Potemkin Understanding in Large Language Models
271. ICML 2025Predictive Data Selection: The Data That Predicts Is the Data That Teaches
272. ICML 2025Preference Learning for AI Alignment: a Causal Perspective
273. ICML 2025Premise-Augmented Reasoning Chains Improve Error Identification in Math reasoning with LLMs
274. ICML 2025Principled Data Selection for Alignment: The Hidden Risks of Difficult Examples
275. ICML 2025Product of Experts with LLMs: Boosting Performance on ARC Is a Matter of Perspective
276. ICML 2025Programming Every Example: Lifting Pre-training Data Quality Like Experts at Scale
277. ICML 2025Progressively Label Enhancement for Large Language Model Alignment
278. ICML 2025ProofAug: Efficient Neural Theorem Proving via Fine-grained Proof Structure Analysis
279. ICML 2025Proposer-Agent-Evaluator (PAE): Autonomous Skill Discovery For Foundation Model Internet Agents
280. ICML 2025ProSec: Fortifying Code LLMs with Proactive Security Alignment
281. ICML 2025PROXSPARSE: REGULARIZED LEARNING OF SEMI-STRUCTURED SPARSITY MASKS FOR PRETRAINED LLMS
282. ICML 2025Prune 'n Predict: Optimizing LLM Decision-making with Conformal Prediction
283. ICML 2025Puzzle: Distillation-Based NAS for Inference-Optimized LLMs
284. ICML 2025QLASS: Boosting Language Agent Inference via Q-Guided Stepwise Search
285. ICML 2025Quamba2: A Robust and Scalable Post-training Quantization Framework for Selective State Space Models
286. ICML 2025QuantSpec: Self-Speculative Decoding with Hierarchical Quantized KV Cache
287. ICML 2025R.I.P.: Better Models by Survival of the Fittest Prompts
288. ICML 2025RATE: Causal Explainability of Reward Models with Imperfect Counterfactuals
289. ICML 2025RE-Bench: Evaluating Frontier AI R&D Capabilities of Language Model Agents against Human Experts
290. ICML 2025Reasoning-as-Logic-Units: Scaling Test-Time Reasoning in Large Language Models Through Logic Unit Alignment
291. ICML 2025Reflection-Window Decoding: Text Generation with Selective Refinement
292. ICML 2025Regress, Don't Guess: A Regression-like Loss on Number Tokens for Language Models
293. ICML 2025Reinforced Lifelong Editing for Language Models
294. ICML 2025Reliable and Efficient Amortized Model-based Evaluation
295. ICML 2025Residual Matrix Transformers: Scaling the Size of the Residual Stream
296. ICML 2025Resolving Lexical Bias in Model Editing
297. ICML 2025ResQ: Mixed-Precision Quantization of Large Language Models with Low-Rank Residuals
298. ICML 2025Restoring Calibration for Aligned Large Language Models: A Calibration-Aware Fine-Tuning Approach
299. ICML 2025Rethinking Addressing in Language Models via Contextualized Equivariant Positional Encoding
300. ICML 2025Rethinking Chain-of-Thought from the Perspective of Self-Training

FAQ

How many Deep learning · large language models papers were published at NeurIPS, ICLR, ICML and CVPR from 2023 to 2026?

2,334 in total: 488 in 2023, 298 in 2024, 417 in 2025, 1,131 in 2026.

How many Deep learning · large language models papers are at NeurIPS 2024?

NeurIPS 2024 has 298 Deep learning · large language models papers, versus 415 the year before.

How many Deep learning · large language models papers are at ICLR 2025?

ICLR 2025 has 13 Deep learning · large language models papers.

How many Deep learning · large language models papers are at ICML 2026?

ICML 2026 has 1,131 Deep learning · large language models papers, versus 404 the year before.

Which conference publishes the most Deep learning · large language models papers?

ICML, with 1,608 papers from 2023 to 2026.