Deep learning · large language models papers, 2023–2026

Key findings

• Deep learning · large language models went from 488 papers in 2023 to 1,131 in 2026, roughly 2.3x in three years.
• ICML publishes the most Deep learning · large language models work: 1,608 papers from 2023 to 2026, 69% of the four-venue total.
• The fastest-growing overlap is with AI Agents: papers tagged with both rose from 5 in 2023 to 184 in 2026.
• Among the 11 topics under Deep Learning, it ranks #3 by 2026 paper count; the fastest grower in the group, Diffusion Models, is up 4.1x versus 2.3x here.

Representative papers

Spread across years and venues so every edition shows up

• ICML 2026“very likely” Means “uncertain”? How LLMs Diverge from Humans in Linguistic Uncertainty Quantification
• ICML 2025(How) Do Language Models Track State?
• ICLR 2025AdvWave: Stealthy Adversarial Jailbreak Attack against Large Audio-Language Models
• NeurIPS 2024$\beta$-DPO: Direct Preference Optimization with Dynamic $\beta$
• NeurIPS 20233D-LLM: Injecting the 3D World into Large Language Models
• ICML 2023Are Large Kernels Better Teachers than Transformers for ConvNets?
• ICML 2026$f$-Divergence Self-Play for Tabular Anomaly Detection via Large Language Models
• ICML 2025A Tale of Two Structures: Do LLMs Capture the Fractal Complexity of Language?
• ICLR 2025Emergence of a High-Dimensional Abstraction Phase in Language Transformers
• NeurIPS 2024$\textit{Trans-LoRA}$: towards data-free Transferable Parameter Efficient Finetuning
• NeurIPS 2023A fast heuristic to optimize time-space tradeoff for large models
• ICML 2023Arithmetic Sampling: Parallel Diverse Decoding for Large Language Models
• ICML 2026$L^3$: Large Lookup Layers
• ICML 2025Accelerating LLM Inference with Lossless Speculative Decoding Algorithms for Heterogeneous Vocabularies
• ICLR 2025Holistically Evaluating the Environmental Impact of Creating Language Models
• NeurIPS 2024A distributional simplicity bias in the learning dynamics of transformers
• NeurIPS 2023A Pseudo-Semantic Loss for Autoregressive Models with Logical Constraints
• ICML 2023Auto-Differentiation of Relational Computations for Very Large Scale Machine Learning
• ICML 2026$V_0$: A Generalist Value Model for Any Policy at State Zero
• ICML 2025Accelerating Unbiased LLM Evaluation via Synthetic Feedback

All Deep learning · large language models papers

1,608 papers, page 28 of 33

1351. ICML 2025Mixture of Lookup Experts
1352. ICML 2025MMInference: Accelerating Pre-filling for Long-Context Visual Language Models via Modality-Aware Permutation Sparse Attention
1353. ICML 2025Model Swarms: Collaborative Search to Adapt LLM Experts via Swarm Intelligence
1354. ICML 2025Modularized Self-Reflected Video Reasoner for Multimodal LLM with Application to Video Question Answering
1355. ICML 2025MoE-SVD: Structured Mixture-of-Experts LLMs Compression via Singular Value Decomposition
1356. ICML 2025MoEQuant: Enhancing Quantization for Mixture-of-Experts Large Language Models via Expert-Balanced Sampling and Affinity Guidance
1357. ICML 2025MoRAgent: Parameter Efficient Agent Tuning with Mixture-of-Roles
1358. ICML 2025MPO: An Efficient Post-Processing Framework for Mixing Diverse Preference Alignment
1359. ICML 2025Multi-agent Architecture Search via Agentic Supernet
1360. ICML 2025Multi-Turn Code Generation Through Single-Step Rewards
1361. ICML 2025Nemotron-CORTEXA: Enhancing LLM Agents for Software Engineering Tasks via Improved Localization and Solution Diversity
1362. ICML 2025NestQuant: nested lattice quantization for matrix products and LLMs
1363. ICML 2025Neutral residues: revisiting adapters for model extension
1364. ICML 2025NextCoder: Robust Adaptation of Code LMs to Diverse Code Edits
1365. ICML 2025NExtLong: Toward Effective Long-Context Training without Long Documents
1366. ICML 2025NICE Data Selection for Instruction Tuning in LLMs with Non-differentiable Evaluation Metric
1367. ICML 2025NoLiMa: Long-Context Evaluation Beyond Literal Matching
1368. ICML 2025Non-Asymptotic Length Generalization
1369. ICML 2025Occult: Optimizing Collaborative Communications across Experts for Accelerated Parallel MoE Training and Inference
1370. ICML 2025Olica: Efficient Structured Pruning of Large Language Models without Retraining
1371. ICML 2025OmniBal: Towards Fast Instruction-Tuning for Vision-Language Models via Omniverse Computation Balance
1372. ICML 2025On Teacher Hacking in Language Model Distillation
1373. ICML 2025On the Duality between Gradient Transformations and Adapters
1374. ICML 2025On the Robustness of Reward Models for Language Model Alignment
1375. ICML 2025On-the-Fly Adaptive Distillation of Transformer to Dual-State Linear Attention for Long-Context LLM Serving
1376. ICML 2025Optimizing Large Language Model Training Using FP4 Quantization
1377. ICML 2025Optimizing Temperature for Language Models with Multi-Sample Inference
1378. ICML 2025Optimizing Test-Time Compute via Meta Reinforcement Finetuning
1379. ICML 2025Oracle-MoE: Locality-preserving Routing in the Oracle Space for Memory-constrained Large Language Model Inference
1380. ICML 2025Organize the Web: Constructing Domains Enhances Pre-Training Data Curation
1381. ICML 2025OrthoRank: Token Selection via Sink Token Orthogonality for Efficient LLM inference
1382. ICML 2025Over-Tokenized Transformer: Vocabulary is Generally Worth Scaling
1383. ICML 2025Overcoming Multi-step Complexity in Multimodal Theory-of-Mind Reasoning: A Scalable Bayesian Planner
1384. ICML 2025Overcoming Vocabulary Mismatch: Vocabulary-agnostic Teacher Guided Language Modeling
1385. ICML 2025Overtrained Language Models Are Harder to Fine-Tune
1386. ICML 2025PANDAS: Improving Many-shot Jailbreaking via Positive Affirmation, Negative Demonstration, and Adaptive Sampling
1387. ICML 2025Parameters vs FLOPs: Scaling Laws for Optimal Sparsity for Mixture-of-Experts Language Models
1388. ICML 2025PARM: Multi-Objective Test-Time Alignment via Preference-Aware Autoregressive Reward Model
1389. ICML 2025Parrot: Multilingual Visual Instruction Tuning
1390. ICML 2025PENCIL: Long Thoughts with Short Memory
1391. ICML 2025Perception in Reflection
1392. ICML 2025Peripheral Memory for LLMs: Integration of Sequential Memory Banks with Adaptive Querying
1393. ICML 2025Persistent Topological Features in Large Language Models
1394. ICML 2025PILAF: Optimal Human Preference Sampling for Reward Modeling
1395. ICML 2025PIPA: Preference Alignment as Prior-Informed Statistical Estimation
1396. ICML 2025Pivoting Factorization: A Compact Meta Low-Rank Representation of Sparsity for Efficient Inference in Large Language Models
1397. ICML 2025Plan-and-Act: Improving Planning of Agents for Long-Horizon Tasks
1398. ICML 2025PoisonBench: Assessing Language Model Vulnerability to Poisoned Preference Data
1399. ICML 2025Policy Guided Tree Search for Enhanced LLM Reasoning
1400. ICML 2025polybasic Speculative Decoding Through a Theoretical Perspective

FAQ

How many Deep learning · large language models papers were published at NeurIPS, ICLR, ICML and CVPR from 2023 to 2026?

2,334 in total: 488 in 2023, 298 in 2024, 417 in 2025, 1,131 in 2026.

How many Deep learning · large language models papers are at NeurIPS 2024?

NeurIPS 2024 has 298 Deep learning · large language models papers, versus 415 the year before.

How many Deep learning · large language models papers are at ICLR 2025?

ICLR 2025 has 13 Deep learning · large language models papers.

How many Deep learning · large language models papers are at ICML 2026?

ICML 2026 has 1,131 Deep learning · large language models papers, versus 404 the year before.

Which conference publishes the most Deep learning · large language models papers?

ICML, with 1,608 papers from 2023 to 2026.