Deep learning · large language models papers, 2023–2026

Key findings

• Deep learning · large language models went from 488 papers in 2023 to 1,131 in 2026, roughly 2.3x in three years.
• ICML publishes the most Deep learning · large language models work: 1,608 papers from 2023 to 2026, 69% of the four-venue total.
• The fastest-growing overlap is with AI Agents: papers tagged with both rose from 5 in 2023 to 184 in 2026.
• Among the 11 topics under Deep Learning, it ranks #3 by 2026 paper count; the fastest grower in the group, Diffusion Models, is up 4.1x versus 2.3x here.

Representative papers

Spread across years and venues so every edition shows up

• ICML 2026“very likely” Means “uncertain”? How LLMs Diverge from Humans in Linguistic Uncertainty Quantification
• ICML 2025(How) Do Language Models Track State?
• ICLR 2025AdvWave: Stealthy Adversarial Jailbreak Attack against Large Audio-Language Models
• NeurIPS 2024$\beta$-DPO: Direct Preference Optimization with Dynamic $\beta$
• NeurIPS 20233D-LLM: Injecting the 3D World into Large Language Models
• ICML 2023Are Large Kernels Better Teachers than Transformers for ConvNets?
• ICML 2026$f$-Divergence Self-Play for Tabular Anomaly Detection via Large Language Models
• ICML 2025A Tale of Two Structures: Do LLMs Capture the Fractal Complexity of Language?
• ICLR 2025Emergence of a High-Dimensional Abstraction Phase in Language Transformers
• NeurIPS 2024$\textit{Trans-LoRA}$: towards data-free Transferable Parameter Efficient Finetuning
• NeurIPS 2023A fast heuristic to optimize time-space tradeoff for large models
• ICML 2023Arithmetic Sampling: Parallel Diverse Decoding for Large Language Models
• ICML 2026$L^3$: Large Lookup Layers
• ICML 2025Accelerating LLM Inference with Lossless Speculative Decoding Algorithms for Heterogeneous Vocabularies
• ICLR 2025Holistically Evaluating the Environmental Impact of Creating Language Models
• NeurIPS 2024A distributional simplicity bias in the learning dynamics of transformers
• NeurIPS 2023A Pseudo-Semantic Loss for Autoregressive Models with Logical Constraints
• ICML 2023Auto-Differentiation of Relational Computations for Very Large Scale Machine Learning
• ICML 2026$V_0$: A Generalist Value Model for Any Policy at State Zero
• ICML 2025Accelerating Unbiased LLM Evaluation via Synthetic Feedback

All Deep learning · large language models papers

2,334 papers, page 38 of 47

1851. ICML 2023Auto-Differentiation of Relational Computations for Very Large Scale Machine Learning
1852. ICML 2023Bag of Tricks for Training Data Extraction from Language Models
1853. ICML 2023Bayes-optimal Learning of Deep Random Networks of Extensive-width
1854. ICML 2023Bidirectional Learning for Offline Model-based Biological Sequence Design
1855. ICML 2023BPipe: Memory-Balanced Pipeline Parallelism for Training Large Language Models
1856. ICML 2023Can We Scale Transformers to Predict Parameters of Diverse ImageNet Models?
1857. ICML 2023CataBEEM: Integrating Latent Interaction Categories in Node-wise Community Detection Models for Network Data
1858. ICML 2023CleanRL: High-quality Single-file Implementations of Deep Reinforcement Learning Algorithms
1859. ICML 2023Compositional Exemplars for In-context Learning
1860. ICML 2023Compute-Efficient Deep Learning: Algorithmic Trends and Opportunities
1861. ICML 2023ConCerNet: A Contrastive Learning Based Framework for Automated Conservation Law Discovery and Trustworthy Dynamical System Prediction
1862. ICML 2023Controlled Text Generation with Natural Language Instructions
1863. ICML 2023Cramming: Training a Language Model on a single GPU in one day.
1864. ICML 2023DecompDiff: Diffusion Models with Decomposed Priors for Structure-Based Drug Design
1865. ICML 2023Deep linear networks can benignly overfit when shallow ones do
1866. ICML 2023Differentially Private Optimization on Large Model at Small Cost
1867. ICML 2023Distilling Internet-Scale Vision-Language Models into Embodied Agents
1868. ICML 2023Do Machine Learning Models Learn Statistical Rules Inferred from Data?
1869. ICML 2023Doubly Optimal No-Regret Learning in Monotone Games
1870. ICML 2023Dropout Reduces Underfitting
1871. ICML 2023Efficient Algorithms for Exact Graph Matching on Correlated Stochastic Block Models with Constant Correlation
1872. ICML 2023FedVS: Straggler-Resilient and Privacy-Preserving Vertical Federated Learning for Split Models
1873. ICML 2023FlexRound: Learnable Rounding based on Element-wise Division for Post-Training Quantization
1874. ICML 2023Grounding Language Models to Images for Multimodal Inputs and Outputs
1875. ICML 2023Guiding Pretraining in Reinforcement Learning with Large Language Models
1876. ICML 2023Hindsight Learning for MDPs with Exogenous Inputs
1877. ICML 2023Hyena Hierarchy: Towards Larger Convolutional Language Models
1878. ICML 2023Identifying Interpretable Subspaces in Image Representations
1879. ICML 2023ILLUME: Rationalizing Vision-Language Models through Human Interactions
1880. ICML 2023Improving Hyperparameter Learning under Approximate Inference in Gaussian Process Models
1881. ICML 2023Instant Soup: Cheap Pruning Ensembles in A Single Pass Can Draw Lottery Tickets from Large Models
1882. ICML 2023Language Instructed Reinforcement Learning for Human-AI Coordination
1883. ICML 2023Large Language Models Can Be Easily Distracted by Irrelevant Context
1884. ICML 2023Learning Hidden Markov Models When the Locations of Missing Observations are Unknown
1885. ICML 2023Learning Optimal Group-structured Individualized Treatment Rules with Many Treatments
1886. ICML 2023Learning Unnormalized Statistical Models via Compositional Optimization
1887. ICML 2023Learning-augmented private algorithms for multiple quantile release
1888. ICML 2023Learning-Rate-Free Learning by D-Adaptation
1889. ICML 2023Less is More: Task-aware Layer-wise Distillation for Language Model Compression
1890. ICML 2023LEVER: Learning to Verify Language-to-Code Generation with Execution
1891. ICML 2023LongCoder: A Long-Range Pre-trained Language Model for Code Completion
1892. ICML 2023MALTS: Matching After Learning to Stretch
1893. ICML 2023Maximal Initial Learning Rates in Deep ReLU Networks
1894. ICML 2023Minimal Width for Universal Property of Deep RNN
1895. ICML 2023OCD: Learning to Overfit with Conditional Diffusion Models
1896. ICML 2023One-Shot Compression of Large Edge-Exchangeable Graphs using Bits-Back Coding
1897. ICML 2023PAC Prediction Sets for Large Language Models of Code
1898. ICML 2023Parallel $Q$-Learning: Scaling Off-policy Reinforcement Learning under Massively Parallel Simulation
1899. ICML 2023Pareto Manifold Learning: Tackling multiple tasks via ensembles of single-task models
1900. ICML 2023Poisoning Language Models During Instruction Tuning

FAQ

How many Deep learning · large language models papers were published at NeurIPS, ICLR, ICML and CVPR from 2023 to 2026?

2,334 in total: 488 in 2023, 298 in 2024, 417 in 2025, 1,131 in 2026.

How many Deep learning · large language models papers are at NeurIPS 2024?

NeurIPS 2024 has 298 Deep learning · large language models papers, versus 415 the year before.

How many Deep learning · large language models papers are at ICLR 2025?

ICLR 2025 has 13 Deep learning · large language models papers.

How many Deep learning · large language models papers are at ICML 2026?

ICML 2026 has 1,131 Deep learning · large language models papers, versus 404 the year before.

Which conference publishes the most Deep learning · large language models papers?

ICML, with 1,608 papers from 2023 to 2026.