Deep learning · large language models papers, 2023–2026

Key findings

• Deep learning · large language models went from 488 papers in 2023 to 1,131 in 2026, roughly 2.3x in three years.
• ICML publishes the most Deep learning · large language models work: 1,608 papers from 2023 to 2026, 69% of the four-venue total.
• The fastest-growing overlap is with AI Agents: papers tagged with both rose from 5 in 2023 to 184 in 2026.
• Among the 11 topics under Deep Learning, it ranks #3 by 2026 paper count; the fastest grower in the group, Diffusion Models, is up 4.1x versus 2.3x here.

Representative papers

Spread across years and venues so every edition shows up

• ICML 2026“very likely” Means “uncertain”? How LLMs Diverge from Humans in Linguistic Uncertainty Quantification
• ICML 2025(How) Do Language Models Track State?
• ICLR 2025AdvWave: Stealthy Adversarial Jailbreak Attack against Large Audio-Language Models
• NeurIPS 2024$\beta$-DPO: Direct Preference Optimization with Dynamic $\beta$
• NeurIPS 20233D-LLM: Injecting the 3D World into Large Language Models
• ICML 2023Are Large Kernels Better Teachers than Transformers for ConvNets?
• ICML 2026$f$-Divergence Self-Play for Tabular Anomaly Detection via Large Language Models
• ICML 2025A Tale of Two Structures: Do LLMs Capture the Fractal Complexity of Language?
• ICLR 2025Emergence of a High-Dimensional Abstraction Phase in Language Transformers
• NeurIPS 2024$\textit{Trans-LoRA}$: towards data-free Transferable Parameter Efficient Finetuning
• NeurIPS 2023A fast heuristic to optimize time-space tradeoff for large models
• ICML 2023Arithmetic Sampling: Parallel Diverse Decoding for Large Language Models
• ICML 2026$L^3$: Large Lookup Layers
• ICML 2025Accelerating LLM Inference with Lossless Speculative Decoding Algorithms for Heterogeneous Vocabularies
• ICLR 2025Holistically Evaluating the Environmental Impact of Creating Language Models
• NeurIPS 2024A distributional simplicity bias in the learning dynamics of transformers
• NeurIPS 2023A Pseudo-Semantic Loss for Autoregressive Models with Logical Constraints
• ICML 2023Auto-Differentiation of Relational Computations for Very Large Scale Machine Learning
• ICML 2026$V_0$: A Generalist Value Model for Any Policy at State Zero
• ICML 2025Accelerating Unbiased LLM Evaluation via Synthetic Feedback

All Deep learning · large language models papers

298 papers, page 6 of 6

251. NeurIPS 2024Smoothie: Label Free Language Model Routing
252. NeurIPS 2024SnapKV: LLM Knows What You are Looking for Before Generation
253. NeurIPS 2024SpaceByte: Towards Deleting Tokenization from Large Language Modeling
254. NeurIPS 2024SparseLLM: Towards Global Pruning of Pre-trained Language Models
255. NeurIPS 2024SpecExec: Massively Parallel Speculative Decoding For Interactive LLM Inference on Consumer Devices
256. NeurIPS 2024Spectral Editing of Activations for Large Language Model Alignment
257. NeurIPS 2024Speculative Decoding with CTC-based Draft Model for LLM Inference Acceleration
258. NeurIPS 2024Stacking Your Transformers: A Closer Look at Model Growth for Efficient LLM Pre-Training
259. NeurIPS 2024Star-Agents: Automatic Data Optimization with LLM Agents for Instruction Tuning
260. NeurIPS 2024Stealth edits to large language models
261. NeurIPS 2024StrategyLLM: Large Language Models as Strategy Generators, Executors, Optimizers, and Evaluators for Problem Solving
262. NeurIPS 2024StreamingDialogue: Prolonged Dialogue Learning via Long Context Compression with Minimal Losses
263. NeurIPS 2024SWE-agent: Agent-Computer Interfaces Enable Automated Software Engineering
264. NeurIPS 2024SWT-Bench: Testing and Validating Real-World Bug-Fixes with Code Agents
265. NeurIPS 2024Synatra: Turning Indirect Knowledge into Direct Demonstrations for Digital Agents at Scale
266. NeurIPS 2024TableRAG: Million-Token Table Understanding with Language Models
267. NeurIPS 2024Tackling Uncertain Correspondences for Multi-Modal Entity Alignment
268. NeurIPS 2024TAIA: Large Language Models are Out-of-Distribution Data Learners
269. NeurIPS 2024Teach Better or Show Smarter? On Instructions and Exemplars in Automatic Prompt Optimization
270. NeurIPS 2024Text2NKG: Fine-Grained N-ary Relation Extraction for N-ary relational Knowledge Graph Construction
271. NeurIPS 2024The Factorization Curse: Which Tokens You Predict Underlie the Reversal Curse and More
272. NeurIPS 2024Theoretical Analysis of Weak-to-Strong Generalization
273. NeurIPS 2024Toward Self-Improvement of LLMs via Imagination, Searching, and Criticizing
274. NeurIPS 2024Towards Next-Level Post-Training Quantization of Hyper-Scale Transformers
275. NeurIPS 2024Toxicity Detection for Free
276. NeurIPS 2024Train-Attention: Meta-Learning Where to Focus in Continual Knowledge Learning
277. NeurIPS 2024Transformers need glasses! Information over-squashing in language tasks
278. NeurIPS 2024Twin-Merging: Dynamic Integration of Modular Expertise in Model Merging
279. NeurIPS 2024Uncertainty of Thoughts: Uncertainty-Aware Planning Enhances Information Seeking in LLMs
280. NeurIPS 2024Unchosen Experts Can Contribute Too: Unleashing MoE Models’ Power by Self-Contrast
281. NeurIPS 2024Understanding Emergent Abilities of Language Models from the Loss Perspective
282. NeurIPS 2024Understanding Transformers via N-Gram Statistics
283. NeurIPS 2024UniBias: Unveiling and Mitigating LLM Bias through Internal Attention and FFN Manipulation
284. NeurIPS 2024Unlocking the Capabilities of Thought: A Reasoning Boundary Framework to Quantify and Optimize Chain-of-Thought
285. NeurIPS 2024Unpacking DPO and PPO: Disentangling Best Practices for Learning from Preference Feedback
286. NeurIPS 2024UrbanKGent: A Unified Large Language Model Agent Framework for Urban Knowledge Graph Construction
287. NeurIPS 2024Visual Sketchpad: Sketching as a Visual Chain of Thought for Multimodal Language Models
288. NeurIPS 2024Watermarking Makes Language Models Radioactive
289. NeurIPS 2024Weak-eval-Strong: Evaluating and Eliciting Lateral Thinking of LLMs with Situation Puzzles
290. NeurIPS 2024Weak-to-Strong Search: Align Large Language Models via Searching over Small Language Models
291. NeurIPS 2024What Factors Affect Multi-Modal In-Context Learning? An In-Depth Exploration
292. NeurIPS 2024What Rotary Position Embedding Can Tell Us: Identifying Query and Key Weights Corresponding to Basic Syntactic or High-level Semantic Information
293. NeurIPS 2024WISE: Rethinking the Knowledge Memory for Lifelong Model Editing of Large Language Models
294. NeurIPS 2024WizardArena: Post-training Large Language Models via Simulated Offline Chatbot Arena
295. NeurIPS 2024Would I Lie To You? Inference Time Alignment of Language Models using Direct Preference Heads
296. NeurIPS 2024xRAG: Extreme Context Compression for Retrieval-augmented Generation with One Token
297. NeurIPS 2024Zero-Shot Tokenizer Transfer
298. NeurIPS 2024Zipfian Whitening

FAQ

How many Deep learning · large language models papers were published at NeurIPS, ICLR, ICML and CVPR from 2023 to 2026?

2,334 in total: 488 in 2023, 298 in 2024, 417 in 2025, 1,131 in 2026.

How many Deep learning · large language models papers are at NeurIPS 2024?

NeurIPS 2024 has 298 Deep learning · large language models papers, versus 415 the year before.

How many Deep learning · large language models papers are at ICLR 2025?

ICLR 2025 has 13 Deep learning · large language models papers.

How many Deep learning · large language models papers are at ICML 2026?

ICML 2026 has 1,131 Deep learning · large language models papers, versus 404 the year before.

Which conference publishes the most Deep learning · large language models papers?

ICML, with 1,608 papers from 2023 to 2026.