Deep learning · large language models papers, 2023–2026

Key findings

• Deep learning · large language models went from 488 papers in 2023 to 1,131 in 2026, roughly 2.3x in three years.
• ICML publishes the most Deep learning · large language models work: 1,608 papers from 2023 to 2026, 69% of the four-venue total.
• The fastest-growing overlap is with AI Agents: papers tagged with both rose from 5 in 2023 to 184 in 2026.
• Among the 11 topics under Deep Learning, it ranks #3 by 2026 paper count; the fastest grower in the group, Diffusion Models, is up 4.1x versus 2.3x here.

Representative papers

Spread across years and venues so every edition shows up

• ICML 2026“very likely” Means “uncertain”? How LLMs Diverge from Humans in Linguistic Uncertainty Quantification
• ICML 2025(How) Do Language Models Track State?
• ICLR 2025AdvWave: Stealthy Adversarial Jailbreak Attack against Large Audio-Language Models
• NeurIPS 2024$\beta$-DPO: Direct Preference Optimization with Dynamic $\beta$
• NeurIPS 20233D-LLM: Injecting the 3D World into Large Language Models
• ICML 2023Are Large Kernels Better Teachers than Transformers for ConvNets?
• ICML 2026$f$-Divergence Self-Play for Tabular Anomaly Detection via Large Language Models
• ICML 2025A Tale of Two Structures: Do LLMs Capture the Fractal Complexity of Language?
• ICLR 2025Emergence of a High-Dimensional Abstraction Phase in Language Transformers
• NeurIPS 2024$\textit{Trans-LoRA}$: towards data-free Transferable Parameter Efficient Finetuning
• NeurIPS 2023A fast heuristic to optimize time-space tradeoff for large models
• ICML 2023Arithmetic Sampling: Parallel Diverse Decoding for Large Language Models
• ICML 2026$L^3$: Large Lookup Layers
• ICML 2025Accelerating LLM Inference with Lossless Speculative Decoding Algorithms for Heterogeneous Vocabularies
• ICLR 2025Holistically Evaluating the Environmental Impact of Creating Language Models
• NeurIPS 2024A distributional simplicity bias in the learning dynamics of transformers
• NeurIPS 2023A Pseudo-Semantic Loss for Autoregressive Models with Logical Constraints
• ICML 2023Auto-Differentiation of Relational Computations for Very Large Scale Machine Learning
• ICML 2026$V_0$: A Generalist Value Model for Any Policy at State Zero
• ICML 2025Accelerating Unbiased LLM Evaluation via Synthetic Feedback

All Deep learning · large language models papers

404 papers, page 5 of 9

201. ICML 2025Look Twice Before You Answer: Memory-Space Visual Retracing for Hallucination Mitigation in Multimodal Large Language Models
202. ICML 2025Looking Beyond the Top-1: Transformers Determine Top Tokens in Order
203. ICML 2025LoRA-Gen: Specializing Large Language Model via Online LoRA Generation
204. ICML 2025MAGELLAN: Metacognitive predictions of learning progress guide autotelic LLM agents in large goal spaces
205. ICML 2025MAPLE: Many-Shot Adaptive Pseudo-Labeling for In-Context Learning
206. ICML 2025MAS-GPT: Training LLMs to Build LLM-based Multi-Agent Systems
207. ICML 2025Mask-Enhanced Autoregressive Prediction: Pay Less Attention to Learn More
208. ICML 2025MASS: Mathematical Data Selection via Skill Graphs for Pretraining Large Language Models
209. ICML 2025Mastering Board Games by External and Internal Planning with Language Models
210. ICML 2025MATH-Perturb: Benchmarking LLMs' Math Reasoning Abilities against Hard Perturbations
211. ICML 2025MATS: An Audio Language Model under Text-only Supervision
212. ICML 2025Maximizing Intermediate Checkpoint Value in LLM Pretraining with Bayesian Optimization
213. ICML 2025Memorization Sinks: Isolating Memorization during LLM Training
214. ICML 2025Memory Layers at Scale
215. ICML 2025MetaAgent: Automatically Constructing Multi-Agent Systems Based on Finite State Machines
216. ICML 2025Metadata Conditioning Accelerates Language Model Pre-training
217. ICML 2025Mitigating Heterogeneous Token Overfitting in LLM Knowledge Editing
218. ICML 2025Mitigating Object Hallucination in Large Vision-Language Models via Image-Grounded Guidance
219. ICML 2025Mixture of Hidden-Dimensions: Not All Hidden-States’ Dimensions are Needed in Transformer
220. ICML 2025Mixture of Lookup Experts
221. ICML 2025MMInference: Accelerating Pre-filling for Long-Context Visual Language Models via Modality-Aware Permutation Sparse Attention
222. ICML 2025Model Swarms: Collaborative Search to Adapt LLM Experts via Swarm Intelligence
223. ICML 2025Modularized Self-Reflected Video Reasoner for Multimodal LLM with Application to Video Question Answering
224. ICML 2025MoE-SVD: Structured Mixture-of-Experts LLMs Compression via Singular Value Decomposition
225. ICML 2025MoEQuant: Enhancing Quantization for Mixture-of-Experts Large Language Models via Expert-Balanced Sampling and Affinity Guidance
226. ICML 2025MoRAgent: Parameter Efficient Agent Tuning with Mixture-of-Roles
227. ICML 2025MPO: An Efficient Post-Processing Framework for Mixing Diverse Preference Alignment
228. ICML 2025Multi-agent Architecture Search via Agentic Supernet
229. ICML 2025Multi-Turn Code Generation Through Single-Step Rewards
230. ICML 2025Nemotron-CORTEXA: Enhancing LLM Agents for Software Engineering Tasks via Improved Localization and Solution Diversity
231. ICML 2025NestQuant: nested lattice quantization for matrix products and LLMs
232. ICML 2025Neutral residues: revisiting adapters for model extension
233. ICML 2025NextCoder: Robust Adaptation of Code LMs to Diverse Code Edits
234. ICML 2025NExtLong: Toward Effective Long-Context Training without Long Documents
235. ICML 2025NICE Data Selection for Instruction Tuning in LLMs with Non-differentiable Evaluation Metric
236. ICML 2025NoLiMa: Long-Context Evaluation Beyond Literal Matching
237. ICML 2025Non-Asymptotic Length Generalization
238. ICML 2025Occult: Optimizing Collaborative Communications across Experts for Accelerated Parallel MoE Training and Inference
239. ICML 2025Olica: Efficient Structured Pruning of Large Language Models without Retraining
240. ICML 2025OmniBal: Towards Fast Instruction-Tuning for Vision-Language Models via Omniverse Computation Balance
241. ICML 2025On Teacher Hacking in Language Model Distillation
242. ICML 2025On the Duality between Gradient Transformations and Adapters
243. ICML 2025On the Robustness of Reward Models for Language Model Alignment
244. ICML 2025On-the-Fly Adaptive Distillation of Transformer to Dual-State Linear Attention for Long-Context LLM Serving
245. ICML 2025Optimizing Large Language Model Training Using FP4 Quantization
246. ICML 2025Optimizing Temperature for Language Models with Multi-Sample Inference
247. ICML 2025Optimizing Test-Time Compute via Meta Reinforcement Finetuning
248. ICML 2025Oracle-MoE: Locality-preserving Routing in the Oracle Space for Memory-constrained Large Language Model Inference
249. ICML 2025Organize the Web: Constructing Domains Enhances Pre-Training Data Curation
250. ICML 2025OrthoRank: Token Selection via Sink Token Orthogonality for Efficient LLM inference

FAQ

How many Deep learning · large language models papers were published at NeurIPS, ICLR, ICML and CVPR from 2023 to 2026?

2,334 in total: 488 in 2023, 298 in 2024, 417 in 2025, 1,131 in 2026.

How many Deep learning · large language models papers are at NeurIPS 2024?

NeurIPS 2024 has 298 Deep learning · large language models papers, versus 415 the year before.

How many Deep learning · large language models papers are at ICLR 2025?

ICLR 2025 has 13 Deep learning · large language models papers.

How many Deep learning · large language models papers are at ICML 2026?

ICML 2026 has 1,131 Deep learning · large language models papers, versus 404 the year before.

Which conference publishes the most Deep learning · large language models papers?

ICML, with 1,608 papers from 2023 to 2026.