Deep learning · foundation models papers, 2023–2026

Key findings

• Deep learning · foundation models went from 72 papers in 2023 to 177 in 2026, roughly 2.5x in three years.
• NeurIPS publishes the most Deep learning · foundation models work: 299 papers from 2023 to 2026, 56% of the four-venue total.
• The fastest-growing overlap is with Foundation Model Adaptation: papers tagged with both rose from 7 in 2023 to 66 in 2026.
• Among the 11 topics under Deep Learning, it ranks #8 by 2026 paper count; the fastest grower in the group, Diffusion Models, is up 4.1x versus 2.5x here.

Representative papers

Spread across years and venues so every edition shows up

• NeurIPS 2026Inferotemporal Cortex Collaborates Before It Codes: Non-Serial Inter-Area Synergy in the Macaque Ventral Stream
• ICML 2026ACO-MoE-LoRA: Evolving-while-Training for Adapting Segment Anything Model 2 to Specialized Domains
• ICLR 2026Qronos: Correcting the Past by Shaping the Future... in Post-Training Quantization
• CVPR 2026Adapting a Pre-trained Single-Cell Foundation Model to Spatial Gene Expression
• NeurIPS 2025An Investigation of Memorization Risk in Healthcare Foundation Models
• ICML 2025Contrastive Localized Language-Image Pre-Training
• ICLR 2025Revisiting Convolution Architecture in the Realm of DNA Foundation Models
• CVPR 2025DEFOM-Stereo: Depth Foundation Model Based Stereo Matching
• NeurIPS 2024$\textit{Read-ME}$: Refactorizing LLMs as Router-Decoupled Mixture of Experts with System Co-Design
• ICML 2024Position: On the Societal Impact of Open Foundation Models
• CVPR 20243D-LFM: Lifting Foundation Model
• NeurIPS 2023Bridging the Domain Gap: Self-Supervised 3D Scene Understanding with Foundation Models
• ICML 2023Improving Hyperparameter Learning under Approximate Inference in Gaussian Process Models
• NeurIPS 2026Do Pathology Foundation Models Encode Disease Progression? A Pseudotime Analysis of Visual Representations
• ICML 2026Alethia: a Foundational Encoder for Voice Deepfakes
• ICLR 2026DND: Boosting Large Language Models with Dynamic Nested Depth
• CVPR 2026UniSER A Foundation Model for Unified Soft Effects Removal
• NeurIPS 2025ChromFound: Towards A Universal Foundation Model for Single-Cell Chromatin Accessibiltiy Data
• ICML 2025Exploring Criteria of Loss Reweighting to Enhance LLM Unlearning
• ICLR 2025Recite, Reconstruct, Recollect: Memorization in LMs as a Multifaceted Phenomenon

All Deep learning · foundation models papers

536 papers, page 7 of 11

301. NeurIPS 2024CE-NAS: An End-to-End Carbon-Efficient Neural Architecture Search Framework
302. NeurIPS 2024Cell ontology guided transcriptome foundation model
303. NeurIPS 2024Cherry on Top: Parameter Heterogeneity and Quantization in Large Language Models
304. NeurIPS 2024Chimera: Effectively Modeling Multivariate Time Series with 2-Dimensional State Space Models
305. NeurIPS 2024Cluster-Learngene: Inheriting Adaptive Clusters for Vision Transformers
306. NeurIPS 2024CODA: A Correlation-Oriented Disentanglement and Augmentation Modeling Scheme for Better Resisting Subpopulation Shifts
307. NeurIPS 2024Compressing Large Language Models using Low Rank and Low Precision Decomposition
308. NeurIPS 2024CondTSF: One-line Plugin of Dataset Condensation for Time Series Forecasting
309. NeurIPS 2024ContactField: Implicit Field Representation for Multi-Person Interaction Geometry
310. NeurIPS 2024ControlSynth Neural ODEs: Modeling Dynamical Systems with Guaranteed Convergence
311. NeurIPS 2024CosAE: Learnable Fourier Series for Image Restoration
312. NeurIPS 2024Counter-Current Learning: A Biologically Plausible Dual Network Approach for Deep Learning
313. NeurIPS 2024Coupled Mamba: Enhanced Multimodal Fusion with Coupled State Space Model
314. NeurIPS 2024CRT-Fusion: Camera, Radar, Temporal Fusion Using Motion Information for 3D Object Detection
315. NeurIPS 2024D-MiSo: Editing Dynamic 3D Scenes using Multi-Gaussians Soup
316. NeurIPS 2024D2R2: Diffusion-based Representation with Random Distance Matching for Tabular Few-shot Learning
317. NeurIPS 2024DeeR-VLA: Dynamic Inference of Multimodal Large Language Models for Efficient Robot Execution
318. NeurIPS 2024DeltaDEQ: Exploiting Heterogeneous Convergence for Accelerating Deep Equilibrium Iterations
319. NeurIPS 2024Demystify Mamba in Vision: A Linear Attention Perspective
320. NeurIPS 2024Dendritic Integration Inspired Artificial Neural Networks Capture Data Correlation
321. NeurIPS 2024Dense Associative Memory Through the Lens of Random Features
322. NeurIPS 2024DenseFormer: Enhancing Information Flow in Transformers via Depth Weighted Averaging
323. NeurIPS 2024DEPrune: Depth-wise Separable Convolution Pruning for Maximizing GPU Parallelism
324. NeurIPS 2024Derivative-enhanced Deep Operator Network
325. NeurIPS 2024DeTrack: In-model Latent Denoising Learning for Visual Object Tracking
326. NeurIPS 2024DiffTORI: Differentiable Trajectory Optimization for Deep Reinforcement and Imitation Learning
327. NeurIPS 2024DisCEdit: Model Editing by Identifying Discriminative Components
328. NeurIPS 2024Discrete Dictionary-based Decomposition Layer for Structured Representation Learning
329. NeurIPS 2024Do Multimodal Foundation Models Understand Enterprise Workflows? A Benchmark for Business Process Management Tasks
330. NeurIPS 2024DOFEN: Deep Oblivious Forest ENsemble
331. NeurIPS 2024ECMamba: Consolidating Selective State Space Model with Retinex Guidance for Efficient Multiple Exposure Correction
332. NeurIPS 2024einspace: Searching for Neural Architectures from Fundamental Operations
333. NeurIPS 2024ElasTST: Towards Robust Varied-Horizon Forecasting with Elastic Time-Series Transformer
334. NeurIPS 2024Elliptical Attention
335. NeurIPS 2024Error Correction Output Codes for Robust Neural Networks against Weight-errors: A Neural Tangent Kernel Point of View
336. NeurIPS 2024Eye-gaze Guided Multi-modal Alignment for Medical Representation Learning
337. NeurIPS 2024Facilitating Multimodal Classification via Dynamically Learning Modality Gap
338. NeurIPS 2024FactorizePhys: Matrix Factorization for Multidimensional Attention in Remote Physiological Sensing
339. NeurIPS 2024Federated Transformer: Multi-Party Vertical Federated Learning on Practical Fuzzily Linked Data
340. NeurIPS 2024FilterNet: Harnessing Frequency Filters for Time Series Forecasting
341. NeurIPS 2024FM-Delta: Lossless Compression for Storing Massive Fine-tuned Foundation Models
342. NeurIPS 2024Frequency Adaptive Normalization For Non-stationary Time Series Forecasting
343. NeurIPS 2024From Instance Training to Instruction Learning: Task Adapters Generation from Instructions
344. NeurIPS 2024From Similarity to Superiority: Channel Clustering for Time Series Forecasting
345. NeurIPS 2024FuseMoE: Mixture-of-Experts Transformers for Fleximodal Fusion
346. NeurIPS 2024Graph Convolutions Enrich the Self-Attention in Transformers!
347. NeurIPS 2024Group and Shuffle: Efficient Structured Orthogonal Parametrization
348. NeurIPS 2024How does Architecture Influence the Base Capabilities of Pre-trained Language Models? A Case Study Based on FFN-Wider and MoE Transformers
349. NeurIPS 2024Hydra: Bidirectional State Space Models Through Generalized Matrix Mixers
350. NeurIPS 2024Improving Generalization of Dynamic Graph Learning via Environment Prompt

FAQ

How many Deep learning · foundation models papers were published at NeurIPS, ICLR, ICML and CVPR from 2023 to 2026?

536 in total: 72 in 2023, 209 in 2024, 78 in 2025, 177 in 2026.

How many Deep learning · foundation models papers are at NeurIPS 2026?

NeurIPS 2026 has 27 Deep learning · foundation models papers, versus 15 the year before.

How many Deep learning · foundation models papers are at ICLR 2026?

ICLR 2026 has 8 Deep learning · foundation models papers, versus 6 the year before.

How many Deep learning · foundation models papers are at ICML 2026?

ICML 2026 has 135 Deep learning · foundation models papers, versus 53 the year before.

How many Deep learning · foundation models papers are at CVPR 2026?

CVPR 2026 has 7 Deep learning · foundation models papers, versus 4 the year before.

Which conference publishes the most Deep learning · foundation models papers?

NeurIPS, with 299 papers from 2023 to 2026.