Deep learning · large language models papers, 2023–2026

Key findings

• Deep learning · large language models went from 488 papers in 2023 to 1,131 in 2026, roughly 2.3x in three years.
• ICML publishes the most Deep learning · large language models work: 1,608 papers from 2023 to 2026, 69% of the four-venue total.
• The fastest-growing overlap is with AI Agents: papers tagged with both rose from 5 in 2023 to 184 in 2026.
• Among the 11 topics under Deep Learning, it ranks #3 by 2026 paper count; the fastest grower in the group, Diffusion Models, is up 4.1x versus 2.3x here.

Representative papers

Spread across years and venues so every edition shows up

• ICML 2026“very likely” Means “uncertain”? How LLMs Diverge from Humans in Linguistic Uncertainty Quantification
• ICML 2025(How) Do Language Models Track State?
• ICLR 2025AdvWave: Stealthy Adversarial Jailbreak Attack against Large Audio-Language Models
• NeurIPS 2024$\beta$-DPO: Direct Preference Optimization with Dynamic $\beta$
• NeurIPS 20233D-LLM: Injecting the 3D World into Large Language Models
• ICML 2023Are Large Kernels Better Teachers than Transformers for ConvNets?
• ICML 2026$f$-Divergence Self-Play for Tabular Anomaly Detection via Large Language Models
• ICML 2025A Tale of Two Structures: Do LLMs Capture the Fractal Complexity of Language?
• ICLR 2025Emergence of a High-Dimensional Abstraction Phase in Language Transformers
• NeurIPS 2024$\textit{Trans-LoRA}$: towards data-free Transferable Parameter Efficient Finetuning
• NeurIPS 2023A fast heuristic to optimize time-space tradeoff for large models
• ICML 2023Arithmetic Sampling: Parallel Diverse Decoding for Large Language Models
• ICML 2026$L^3$: Large Lookup Layers
• ICML 2025Accelerating LLM Inference with Lossless Speculative Decoding Algorithms for Heterogeneous Vocabularies
• ICLR 2025Holistically Evaluating the Environmental Impact of Creating Language Models
• NeurIPS 2024A distributional simplicity bias in the learning dynamics of transformers
• NeurIPS 2023A Pseudo-Semantic Loss for Autoregressive Models with Logical Constraints
• ICML 2023Auto-Differentiation of Relational Computations for Very Large Scale Machine Learning
• ICML 2026$V_0$: A Generalist Value Model for Any Policy at State Zero
• ICML 2025Accelerating Unbiased LLM Evaluation via Synthetic Feedback

All Deep learning · large language models papers

2,334 papers, page 28 of 47

1351. ICML 2025Mask-Enhanced Autoregressive Prediction: Pay Less Attention to Learn More
1352. ICML 2025MASS: Mathematical Data Selection via Skill Graphs for Pretraining Large Language Models
1353. ICML 2025Mastering Board Games by External and Internal Planning with Language Models
1354. ICML 2025MATH-Perturb: Benchmarking LLMs' Math Reasoning Abilities against Hard Perturbations
1355. ICML 2025MATS: An Audio Language Model under Text-only Supervision
1356. ICML 2025Maximizing Intermediate Checkpoint Value in LLM Pretraining with Bayesian Optimization
1357. ICML 2025Memorization Sinks: Isolating Memorization during LLM Training
1358. ICML 2025Memory Layers at Scale
1359. ICML 2025MetaAgent: Automatically Constructing Multi-Agent Systems Based on Finite State Machines
1360. ICML 2025Metadata Conditioning Accelerates Language Model Pre-training
1361. ICML 2025Mitigating Heterogeneous Token Overfitting in LLM Knowledge Editing
1362. ICML 2025Mitigating Object Hallucination in Large Vision-Language Models via Image-Grounded Guidance
1363. ICML 2025Mixture of Hidden-Dimensions: Not All Hidden-States’ Dimensions are Needed in Transformer
1364. ICML 2025Mixture of Lookup Experts
1365. ICML 2025MMInference: Accelerating Pre-filling for Long-Context Visual Language Models via Modality-Aware Permutation Sparse Attention
1366. ICML 2025Model Swarms: Collaborative Search to Adapt LLM Experts via Swarm Intelligence
1367. ICML 2025Modularized Self-Reflected Video Reasoner for Multimodal LLM with Application to Video Question Answering
1368. ICML 2025MoE-SVD: Structured Mixture-of-Experts LLMs Compression via Singular Value Decomposition
1369. ICML 2025MoEQuant: Enhancing Quantization for Mixture-of-Experts Large Language Models via Expert-Balanced Sampling and Affinity Guidance
1370. ICML 2025MoRAgent: Parameter Efficient Agent Tuning with Mixture-of-Roles
1371. ICML 2025MPO: An Efficient Post-Processing Framework for Mixing Diverse Preference Alignment
1372. ICML 2025Multi-agent Architecture Search via Agentic Supernet
1373. ICML 2025Multi-Turn Code Generation Through Single-Step Rewards
1374. ICML 2025Nemotron-CORTEXA: Enhancing LLM Agents for Software Engineering Tasks via Improved Localization and Solution Diversity
1375. ICML 2025NestQuant: nested lattice quantization for matrix products and LLMs
1376. ICML 2025Neutral residues: revisiting adapters for model extension
1377. ICML 2025NextCoder: Robust Adaptation of Code LMs to Diverse Code Edits
1378. ICML 2025NExtLong: Toward Effective Long-Context Training without Long Documents
1379. ICML 2025NICE Data Selection for Instruction Tuning in LLMs with Non-differentiable Evaluation Metric
1380. ICML 2025NoLiMa: Long-Context Evaluation Beyond Literal Matching
1381. ICML 2025Non-Asymptotic Length Generalization
1382. ICML 2025Occult: Optimizing Collaborative Communications across Experts for Accelerated Parallel MoE Training and Inference
1383. ICML 2025Olica: Efficient Structured Pruning of Large Language Models without Retraining
1384. ICML 2025OmniBal: Towards Fast Instruction-Tuning for Vision-Language Models via Omniverse Computation Balance
1385. ICML 2025On Teacher Hacking in Language Model Distillation
1386. ICML 2025On the Duality between Gradient Transformations and Adapters
1387. ICML 2025On the Robustness of Reward Models for Language Model Alignment
1388. ICML 2025On-the-Fly Adaptive Distillation of Transformer to Dual-State Linear Attention for Long-Context LLM Serving
1389. ICML 2025Optimizing Large Language Model Training Using FP4 Quantization
1390. ICML 2025Optimizing Temperature for Language Models with Multi-Sample Inference
1391. ICML 2025Optimizing Test-Time Compute via Meta Reinforcement Finetuning
1392. ICML 2025Oracle-MoE: Locality-preserving Routing in the Oracle Space for Memory-constrained Large Language Model Inference
1393. ICML 2025Organize the Web: Constructing Domains Enhances Pre-Training Data Curation
1394. ICML 2025OrthoRank: Token Selection via Sink Token Orthogonality for Efficient LLM inference
1395. ICML 2025Over-Tokenized Transformer: Vocabulary is Generally Worth Scaling
1396. ICML 2025Overcoming Multi-step Complexity in Multimodal Theory-of-Mind Reasoning: A Scalable Bayesian Planner
1397. ICML 2025Overcoming Vocabulary Mismatch: Vocabulary-agnostic Teacher Guided Language Modeling
1398. ICML 2025Overtrained Language Models Are Harder to Fine-Tune
1399. ICML 2025PANDAS: Improving Many-shot Jailbreaking via Positive Affirmation, Negative Demonstration, and Adaptive Sampling
1400. ICML 2025Parameters vs FLOPs: Scaling Laws for Optimal Sparsity for Mixture-of-Experts Language Models

FAQ

How many Deep learning · large language models papers were published at NeurIPS, ICLR, ICML and CVPR from 2023 to 2026?

2,334 in total: 488 in 2023, 298 in 2024, 417 in 2025, 1,131 in 2026.

How many Deep learning · large language models papers are at NeurIPS 2024?

NeurIPS 2024 has 298 Deep learning · large language models papers, versus 415 the year before.

How many Deep learning · large language models papers are at ICLR 2025?

ICLR 2025 has 13 Deep learning · large language models papers.

How many Deep learning · large language models papers are at ICML 2026?

ICML 2026 has 1,131 Deep learning · large language models papers, versus 404 the year before.

Which conference publishes the most Deep learning · large language models papers?

ICML, with 1,608 papers from 2023 to 2026.