Deep learning · foundation models papers, 2023–2026

Key findings

• Deep learning · foundation models went from 72 papers in 2023 to 177 in 2026, roughly 2.5x in three years.
• NeurIPS publishes the most Deep learning · foundation models work: 299 papers from 2023 to 2026, 56% of the four-venue total.
• The fastest-growing overlap is with Foundation Model Adaptation: papers tagged with both rose from 7 in 2023 to 66 in 2026.
• Among the 11 topics under Deep Learning, it ranks #8 by 2026 paper count; the fastest grower in the group, Diffusion Models, is up 4.1x versus 2.5x here.

Representative papers

Spread across years and venues so every edition shows up

• NeurIPS 2026Inferotemporal Cortex Collaborates Before It Codes: Non-Serial Inter-Area Synergy in the Macaque Ventral Stream
• ICML 2026ACO-MoE-LoRA: Evolving-while-Training for Adapting Segment Anything Model 2 to Specialized Domains
• ICLR 2026Qronos: Correcting the Past by Shaping the Future... in Post-Training Quantization
• CVPR 2026Adapting a Pre-trained Single-Cell Foundation Model to Spatial Gene Expression
• NeurIPS 2025An Investigation of Memorization Risk in Healthcare Foundation Models
• ICML 2025Contrastive Localized Language-Image Pre-Training
• ICLR 2025Revisiting Convolution Architecture in the Realm of DNA Foundation Models
• CVPR 2025DEFOM-Stereo: Depth Foundation Model Based Stereo Matching
• NeurIPS 2024$\textit{Read-ME}$: Refactorizing LLMs as Router-Decoupled Mixture of Experts with System Co-Design
• ICML 2024Position: On the Societal Impact of Open Foundation Models
• CVPR 20243D-LFM: Lifting Foundation Model
• NeurIPS 2023Bridging the Domain Gap: Self-Supervised 3D Scene Understanding with Foundation Models
• ICML 2023Improving Hyperparameter Learning under Approximate Inference in Gaussian Process Models
• NeurIPS 2026Do Pathology Foundation Models Encode Disease Progression? A Pseudotime Analysis of Visual Representations
• ICML 2026Alethia: a Foundational Encoder for Voice Deepfakes
• ICLR 2026DND: Boosting Large Language Models with Dynamic Nested Depth
• CVPR 2026UniSER A Foundation Model for Unified Soft Effects Removal
• NeurIPS 2025ChromFound: Towards A Universal Foundation Model for Single-Cell Chromatin Accessibiltiy Data
• ICML 2025Exploring Criteria of Loss Reweighting to Enhance LLM Unlearning
• ICLR 2025Recite, Reconstruct, Recollect: Memorization in LMs as a Multifaceted Phenomenon

All Deep learning · foundation models papers

209 papers, page 2 of 5

51. NeurIPS 2024CODA: A Correlation-Oriented Disentanglement and Augmentation Modeling Scheme for Better Resisting Subpopulation Shifts
52. NeurIPS 2024Compressing Large Language Models using Low Rank and Low Precision Decomposition
53. NeurIPS 2024CondTSF: One-line Plugin of Dataset Condensation for Time Series Forecasting
54. NeurIPS 2024ContactField: Implicit Field Representation for Multi-Person Interaction Geometry
55. NeurIPS 2024ControlSynth Neural ODEs: Modeling Dynamical Systems with Guaranteed Convergence
56. NeurIPS 2024CosAE: Learnable Fourier Series for Image Restoration
57. NeurIPS 2024Counter-Current Learning: A Biologically Plausible Dual Network Approach for Deep Learning
58. NeurIPS 2024Coupled Mamba: Enhanced Multimodal Fusion with Coupled State Space Model
59. NeurIPS 2024CRT-Fusion: Camera, Radar, Temporal Fusion Using Motion Information for 3D Object Detection
60. NeurIPS 2024D-MiSo: Editing Dynamic 3D Scenes using Multi-Gaussians Soup
61. NeurIPS 2024D2R2: Diffusion-based Representation with Random Distance Matching for Tabular Few-shot Learning
62. NeurIPS 2024DeeR-VLA: Dynamic Inference of Multimodal Large Language Models for Efficient Robot Execution
63. NeurIPS 2024DeltaDEQ: Exploiting Heterogeneous Convergence for Accelerating Deep Equilibrium Iterations
64. NeurIPS 2024Demystify Mamba in Vision: A Linear Attention Perspective
65. NeurIPS 2024Dendritic Integration Inspired Artificial Neural Networks Capture Data Correlation
66. NeurIPS 2024Dense Associative Memory Through the Lens of Random Features
67. NeurIPS 2024DenseFormer: Enhancing Information Flow in Transformers via Depth Weighted Averaging
68. NeurIPS 2024DEPrune: Depth-wise Separable Convolution Pruning for Maximizing GPU Parallelism
69. NeurIPS 2024Derivative-enhanced Deep Operator Network
70. NeurIPS 2024DeTrack: In-model Latent Denoising Learning for Visual Object Tracking
71. NeurIPS 2024DiffTORI: Differentiable Trajectory Optimization for Deep Reinforcement and Imitation Learning
72. NeurIPS 2024DisCEdit: Model Editing by Identifying Discriminative Components
73. NeurIPS 2024Discrete Dictionary-based Decomposition Layer for Structured Representation Learning
74. NeurIPS 2024Do Multimodal Foundation Models Understand Enterprise Workflows? A Benchmark for Business Process Management Tasks
75. NeurIPS 2024DOFEN: Deep Oblivious Forest ENsemble
76. NeurIPS 2024ECMamba: Consolidating Selective State Space Model with Retinex Guidance for Efficient Multiple Exposure Correction
77. NeurIPS 2024einspace: Searching for Neural Architectures from Fundamental Operations
78. NeurIPS 2024ElasTST: Towards Robust Varied-Horizon Forecasting with Elastic Time-Series Transformer
79. NeurIPS 2024Elliptical Attention
80. NeurIPS 2024Error Correction Output Codes for Robust Neural Networks against Weight-errors: A Neural Tangent Kernel Point of View
81. NeurIPS 2024Eye-gaze Guided Multi-modal Alignment for Medical Representation Learning
82. NeurIPS 2024Facilitating Multimodal Classification via Dynamically Learning Modality Gap
83. NeurIPS 2024FactorizePhys: Matrix Factorization for Multidimensional Attention in Remote Physiological Sensing
84. NeurIPS 2024Federated Transformer: Multi-Party Vertical Federated Learning on Practical Fuzzily Linked Data
85. NeurIPS 2024FilterNet: Harnessing Frequency Filters for Time Series Forecasting
86. NeurIPS 2024FM-Delta: Lossless Compression for Storing Massive Fine-tuned Foundation Models
87. NeurIPS 2024Frequency Adaptive Normalization For Non-stationary Time Series Forecasting
88. NeurIPS 2024From Instance Training to Instruction Learning: Task Adapters Generation from Instructions
89. NeurIPS 2024From Similarity to Superiority: Channel Clustering for Time Series Forecasting
90. NeurIPS 2024FuseMoE: Mixture-of-Experts Transformers for Fleximodal Fusion
91. NeurIPS 2024Graph Convolutions Enrich the Self-Attention in Transformers!
92. NeurIPS 2024Group and Shuffle: Efficient Structured Orthogonal Parametrization
93. NeurIPS 2024How does Architecture Influence the Base Capabilities of Pre-trained Language Models? A Case Study Based on FFN-Wider and MoE Transformers
94. NeurIPS 2024Hydra: Bidirectional State Space Models Through Generalized Matrix Mixers
95. NeurIPS 2024Improving Generalization of Dynamic Graph Learning via Environment Prompt
96. NeurIPS 2024Improving Neural ODE Training with Temporal Adaptive Batch Normalization
97. NeurIPS 2024In Pursuit of Causal Label Correlations for Multi-label Image Recognition
98. NeurIPS 2024Incorporating Test-Time Optimization into Training with Dual Networks for Human Mesh Recovery
99. NeurIPS 2024Infinite-Dimensional Feature Interaction
100. NeurIPS 2024Initializing Variable-sized Vision Transformers from Learngene with Learnable Transformation

FAQ

How many Deep learning · foundation models papers were published at NeurIPS, ICLR, ICML and CVPR from 2023 to 2026?

536 in total: 72 in 2023, 209 in 2024, 78 in 2025, 177 in 2026.

How many Deep learning · foundation models papers are at NeurIPS 2026?

NeurIPS 2026 has 27 Deep learning · foundation models papers, versus 15 the year before.

How many Deep learning · foundation models papers are at ICLR 2026?

ICLR 2026 has 8 Deep learning · foundation models papers, versus 6 the year before.

How many Deep learning · foundation models papers are at ICML 2026?

ICML 2026 has 135 Deep learning · foundation models papers, versus 53 the year before.

How many Deep learning · foundation models papers are at CVPR 2026?

CVPR 2026 has 7 Deep learning · foundation models papers, versus 4 the year before.

Which conference publishes the most Deep learning · foundation models papers?

NeurIPS, with 299 papers from 2023 to 2026.