Deep learning · large language models papers, 2023–2026

Key findings

• Deep learning · large language models went from 488 papers in 2023 to 1,131 in 2026, roughly 2.3x in three years.
• ICML publishes the most Deep learning · large language models work: 1,608 papers from 2023 to 2026, 69% of the four-venue total.
• The fastest-growing overlap is with AI Agents: papers tagged with both rose from 5 in 2023 to 184 in 2026.
• Among the 11 topics under Deep Learning, it ranks #3 by 2026 paper count; the fastest grower in the group, Diffusion Models, is up 4.1x versus 2.3x here.

Representative papers

Spread across years and venues so every edition shows up

• ICML 2026“very likely” Means “uncertain”? How LLMs Diverge from Humans in Linguistic Uncertainty Quantification
• ICML 2025(How) Do Language Models Track State?
• ICLR 2025AdvWave: Stealthy Adversarial Jailbreak Attack against Large Audio-Language Models
• NeurIPS 2024$\beta$-DPO: Direct Preference Optimization with Dynamic $\beta$
• NeurIPS 20233D-LLM: Injecting the 3D World into Large Language Models
• ICML 2023Are Large Kernels Better Teachers than Transformers for ConvNets?
• ICML 2026$f$-Divergence Self-Play for Tabular Anomaly Detection via Large Language Models
• ICML 2025A Tale of Two Structures: Do LLMs Capture the Fractal Complexity of Language?
• ICLR 2025Emergence of a High-Dimensional Abstraction Phase in Language Transformers
• NeurIPS 2024$\textit{Trans-LoRA}$: towards data-free Transferable Parameter Efficient Finetuning
• NeurIPS 2023A fast heuristic to optimize time-space tradeoff for large models
• ICML 2023Arithmetic Sampling: Parallel Diverse Decoding for Large Language Models
• ICML 2026$L^3$: Large Lookup Layers
• ICML 2025Accelerating LLM Inference with Lossless Speculative Decoding Algorithms for Heterogeneous Vocabularies
• ICLR 2025Holistically Evaluating the Environmental Impact of Creating Language Models
• NeurIPS 2024A distributional simplicity bias in the learning dynamics of transformers
• NeurIPS 2023A Pseudo-Semantic Loss for Autoregressive Models with Logical Constraints
• ICML 2023Auto-Differentiation of Relational Computations for Very Large Scale Machine Learning
• ICML 2026$V_0$: A Generalist Value Model for Any Policy at State Zero
• ICML 2025Accelerating Unbiased LLM Evaluation via Synthetic Feedback

All Deep learning · large language models papers

417 papers, page 5 of 9

201. ICML 2025Learning to Plan & Reason for Evaluation with Thinking-LLM-as-a-Judge
202. ICML 2025LensLLM: Unveiling Fine-Tuning Dynamics for LLM Selection
203. ICML 2025Let LLM Tell What to Prune and How Much to Prune
204. ICML 2025Lexico: Extreme KV Cache Compression via Sparse Coding over Universal Dictionaries
205. ICML 2025LIFT the Veil for the Truth: Principal Weights Emerge after Rank Reduction for Reasoning-Focused Supervised Fine-Tuning
206. ICML 2025Liger: Linearizing Large Language Models to Gated Recurrent Structures
207. ICML 2025LLM Alignment as Retriever Optimization: An Information Retrieval Perspective
208. ICML 2025LLM Data Selection and Utilization via Dynamic Bi-level Optimization
209. ICML 2025LLMs Can Reason Faster Only If We Let Them
210. ICML 2025LLMs on the Line: Data Determines Loss-to-Loss Scaling Laws
211. ICML 2025Locate-then-edit for Multi-hop Factual Recall under Knowledge Editing
212. ICML 2025Logits are All We Need to Adapt Closed Models
213. ICML 2025LongRoPE2: Near-Lossless LLM Context Window Scaling
214. ICML 2025Look Twice Before You Answer: Memory-Space Visual Retracing for Hallucination Mitigation in Multimodal Large Language Models
215. ICML 2025Looking Beyond the Top-1: Transformers Determine Top Tokens in Order
216. ICML 2025LoRA-Gen: Specializing Large Language Model via Online LoRA Generation
217. ICML 2025MAGELLAN: Metacognitive predictions of learning progress guide autotelic LLM agents in large goal spaces
218. ICML 2025MAPLE: Many-Shot Adaptive Pseudo-Labeling for In-Context Learning
219. ICML 2025MAS-GPT: Training LLMs to Build LLM-based Multi-Agent Systems
220. ICML 2025Mask-Enhanced Autoregressive Prediction: Pay Less Attention to Learn More
221. ICML 2025MASS: Mathematical Data Selection via Skill Graphs for Pretraining Large Language Models
222. ICML 2025Mastering Board Games by External and Internal Planning with Language Models
223. ICML 2025MATH-Perturb: Benchmarking LLMs' Math Reasoning Abilities against Hard Perturbations
224. ICML 2025MATS: An Audio Language Model under Text-only Supervision
225. ICML 2025Maximizing Intermediate Checkpoint Value in LLM Pretraining with Bayesian Optimization
226. ICML 2025Memorization Sinks: Isolating Memorization during LLM Training
227. ICML 2025Memory Layers at Scale
228. ICML 2025MetaAgent: Automatically Constructing Multi-Agent Systems Based on Finite State Machines
229. ICML 2025Metadata Conditioning Accelerates Language Model Pre-training
230. ICML 2025Mitigating Heterogeneous Token Overfitting in LLM Knowledge Editing
231. ICML 2025Mitigating Object Hallucination in Large Vision-Language Models via Image-Grounded Guidance
232. ICML 2025Mixture of Hidden-Dimensions: Not All Hidden-States’ Dimensions are Needed in Transformer
233. ICML 2025Mixture of Lookup Experts
234. ICML 2025MMInference: Accelerating Pre-filling for Long-Context Visual Language Models via Modality-Aware Permutation Sparse Attention
235. ICML 2025Model Swarms: Collaborative Search to Adapt LLM Experts via Swarm Intelligence
236. ICML 2025Modularized Self-Reflected Video Reasoner for Multimodal LLM with Application to Video Question Answering
237. ICML 2025MoE-SVD: Structured Mixture-of-Experts LLMs Compression via Singular Value Decomposition
238. ICML 2025MoEQuant: Enhancing Quantization for Mixture-of-Experts Large Language Models via Expert-Balanced Sampling and Affinity Guidance
239. ICML 2025MoRAgent: Parameter Efficient Agent Tuning with Mixture-of-Roles
240. ICML 2025MPO: An Efficient Post-Processing Framework for Mixing Diverse Preference Alignment
241. ICML 2025Multi-agent Architecture Search via Agentic Supernet
242. ICML 2025Multi-Turn Code Generation Through Single-Step Rewards
243. ICML 2025Nemotron-CORTEXA: Enhancing LLM Agents for Software Engineering Tasks via Improved Localization and Solution Diversity
244. ICML 2025NestQuant: nested lattice quantization for matrix products and LLMs
245. ICML 2025Neutral residues: revisiting adapters for model extension
246. ICML 2025NextCoder: Robust Adaptation of Code LMs to Diverse Code Edits
247. ICML 2025NExtLong: Toward Effective Long-Context Training without Long Documents
248. ICML 2025NICE Data Selection for Instruction Tuning in LLMs with Non-differentiable Evaluation Metric
249. ICML 2025NoLiMa: Long-Context Evaluation Beyond Literal Matching
250. ICML 2025Non-Asymptotic Length Generalization

FAQ

How many Deep learning · large language models papers were published at NeurIPS, ICLR, ICML and CVPR from 2023 to 2026?

2,334 in total: 488 in 2023, 298 in 2024, 417 in 2025, 1,131 in 2026.

How many Deep learning · large language models papers are at NeurIPS 2024?

NeurIPS 2024 has 298 Deep learning · large language models papers, versus 415 the year before.

How many Deep learning · large language models papers are at ICLR 2025?

ICLR 2025 has 13 Deep learning · large language models papers.

How many Deep learning · large language models papers are at ICML 2026?

ICML 2026 has 1,131 Deep learning · large language models papers, versus 404 the year before.

Which conference publishes the most Deep learning · large language models papers?

ICML, with 1,608 papers from 2023 to 2026.