Foundation Model Adaptation papers, 2023–2026

Key findings

• Foundation Model Adaptation went from 159 papers in 2023 to 602 in 2026, roughly 3.8x in three years.
• NeurIPS publishes the most Foundation Model Adaptation work: 531 papers from 2023 to 2026, 36% of the four-venue total.
• The fastest-growing overlap is with Deep learning · foundation models: papers tagged with both rose from 7 in 2023 to 66 in 2026.
• Among the 5 topics under Meta-Learning and Transfer, it ranks #1 by 2026 paper count; the fastest grower in the group, Continual Learning, is up 1.7x versus 3.8x here.

Representative papers

Spread across years and venues so every edition shows up

• NeurIPS 2026(Mis)generalization of Helpful-Only Fine-Tuning
• ICML 2026Active Learning with Foundation Model Priors: Efficient Learning under Class Imbalance
• ICLR 2026Benchmarking ECG Foundational Models: A Reality Check Across Clinical Tasks
• CVPR 2026CD-Buffer Complementary Dual-Buffer Framework for Test-Time Adaptation in Adverse Weather
• NeurIPS 2025An Investigation of Memorization Risk in Healthcare Foundation Models
• ICML 2025A Bayesian Model Selection Criterion for Selecting Pretraining Checkpoints
• ICLR 2025Better autoregressive regression with LLMs via regression-aware fine-tuning
• CVPR 20255%>100%: Breaking Performance Shackles of Full Fine-Tuning on Visual Recognition Tasks
• NeurIPS 2024Instruction Tuning Large Language Models to Understand Electronic Health Records
• ICML 2024By Tying Embeddings You Are Assuming the Distributional Hypothesis
• ICLR 2024A Hard-to-Beat Baseline for Training-free CLIP-based Adaptation
• CVPR 2024DePT: Decoupled Prompt Tuning
• NeurIPS 2023A Fast and Accurate Estimator for Large Scale Linear Model via Data Averaging
• ICML 2023Are Neurons Actually Collapsed? On the Fine-Grained Structure in Neural Representations
• ICLR 2023A Closer Look at Model Adaptation using Feature Distortion and Simplicity Bias
• CVPR 2023A-La-Carte Prompt Tuning (APT): Combining Distinct Data via Composable Prompting
• NeurIPS 2026A Graph Foundation Model for Unified Clustering
• ICML 2026AdaMeZO: Adam-style Zeroth-Order Optimizer for LLM Fine-tuning Without Maintaining the Moments
• ICLR 2026Bridging Radiology and Pathology Foundation Models via Concept-Based Multimodal Co-Adaptation
• CVPR 2026Fed-ADE Adaptive Learning Rate for Federated Post-adaptation under Distribution Shift

All Foundation Model Adaptation papers

324 papers, page 4 of 7

151. ICML 2025Boosting Multi-Domain Fine-Tuning of Large Language Models through Evolving Interactions between Samples
152. ICML 2025Canonical Rank Adaptation: An Efficient Fine-Tuning Strategy for Vision Transformers
153. ICML 2025Come Together, But Not Right Now: A Progressive Strategy to Boost Low-Rank Adaptation
154. ICML 2025Contextures: Representations from Contexts
155. ICML 2025Does Low Rank Adaptation Lead to Lower Robustness against Training-Time Attacks?
156. ICML 2025Efficient Personalized Adaptation for Physiological Signal Foundation Model
157. ICML 2025ELoRA: Low-Rank Adaptation for Equivariant GNNs
158. ICML 2025Enhancing Foundation Models for Time Series Forecasting via Wavelet-based Tokenization
159. ICML 2025Enhancing Foundation Models with Federated Domain Knowledge Infusion
160. ICML 2025ExPLoRA: Parameter-Efficient Extended Pre-Training to Adapt Vision Transformers under Domain Shifts
161. ICML 2025Fast and Low-Cost Genomic Foundation Models via Outlier Removal
162. ICML 2025Flat-LoRA: Low-Rank Adaptation over a Flat Loss Landscape
163. ICML 2025Foundation Model Insights and a Multi-Model Approach for Superior Fine-Grained One-shot Subset Selection
164. ICML 2025From Weight-Based to State-Based Fine-Tuning: Further Memory Reduction on LoRA with Parallel Control
165. ICML 2025GAPrompt: Geometry-Aware Point Cloud Prompt for 3D Vision Model
166. ICML 2025Griffin: Towards a Graph-Centric Relational Database Foundation Model
167. ICML 2025In-Context Adaptation to Concept Drift for Learned Database Operations
168. ICML 2025In-Context Fine-Tuning for Time-Series Foundation Models
169. ICML 2025InfoSAM: Fine-Tuning the Segment Anything Model from An Information-Theoretic Perspective
170. ICML 2025Invariance Makes LLM Unlearning Resilient Even to Unanticipated Downstream Fine-Tuning
171. ICML 2025L3A: Label-Augmented Analytic Adaptation for Multi-Label Class Incremental Learning
172. ICML 2025Large Continual Instruction Assistant
173. ICML 2025Learn from Downstream and Be Yourself in Multimodal Large Language Models Fine-Tuning
174. ICML 2025Lightweight Online Adaption for Time Series Foundation Model Forecasts
175. ICML 2025LoRA Training Provably Converges to a Low-Rank Global Minimum Or It Fails Loudly (But it Probably Won't Fail)
176. ICML 2025MixMin: Finding Data Mixtures via Convex Minimization
177. ICML 2025Moirai-MoE: Empowering Time Series Foundation Models with Sparse Mixture of Experts
178. ICML 2025NextCoder: Robust Adaptation of Code LMs to Diverse Code Edits
179. ICML 2025OmniArch: Building Foundation Model for Scientific Computing
180. ICML 2025On Fine-Grained Distinct Element Estimation
181. ICML 2025Parameter-Efficient Fine-Tuning of State Space Models
182. ICML 2025Peri-LN: Revisiting Normalization Layer in the Transformer Architecture
183. ICML 2025PertEval-scFM: Benchmarking Single-Cell Foundation Models for Perturbation Effect Prediction
184. ICML 2025Portable Reward Tuning: Towards Reusable Fine-Tuning across Different Pretrained Models
185. ICML 2025Projection Pursuit Density Ratio Estimation
186. ICML 2025Promoting Ensemble Diversity with Interactive Bayesian Distributional Robustness for Fine-tuning Foundation Models
187. ICML 2025Provable and Practical Online Learning Rate Adaptation with Hypergradient Descent
188. ICML 2025Proxy-FDA: Proxy-based Feature Distribution Alignment for Fine-tuning Vision Foundation Models without Forgetting
189. ICML 2025Raptor: Scalable Train-Free Embeddings for 3D Medical Volumes Leveraging Pretrained 2D Foundation Models
190. ICML 2025RepLoRA: Reparameterizing Low-rank Adaptation via the Perspective of Mixture of Experts
191. ICML 2025Restoring Calibration for Aligned Large Language Models: A Calibration-Aware Fine-Tuning Approach
192. ICML 2025Rethinking the Bias of Foundation Model under Long-tailed Distribution
193. ICML 2025SAM2Act: Integrating Visual Foundation Model with A Memory Architecture for Robotic Manipulation
194. ICML 2025SAN: Hypothesizing Long-Term Synaptic Development and Neural Engram Mechanism in Scalable Model's Parameter-Efficient Fine-Tuning
195. ICML 2025Scaling Laws for Forgetting during Finetuning with Pretraining Data Injection
196. ICML 2025SeedLoRA: A Fusion Approach to Efficient LLM Fine-Tuning
197. ICML 2025Sketch to Adapt: Fine-Tunable Sketches for Efficient LLM Adaptation
198. ICML 2025SPACE: Your Genomic Profile Predictor is a Powerful DNA Foundation Model
199. ICML 2025SparseLoRA: Accelerating LLM Fine-Tuning with Contextual Sparsity
200. ICML 2025SToFM: a Multi-scale Foundation Model for Spatial Transcriptomics

FAQ

How many Foundation Model Adaptation papers were published at NeurIPS, ICLR, ICML and CVPR from 2023 to 2026?

1,492 in total: 159 in 2023, 270 in 2024, 461 in 2025, 602 in 2026.

How many Foundation Model Adaptation papers are at NeurIPS 2026?

NeurIPS 2026 has 182 Foundation Model Adaptation papers, versus 174 the year before.

How many Foundation Model Adaptation papers are at ICLR 2026?

ICLR 2026 has 187 Foundation Model Adaptation papers, versus 149 the year before.

How many Foundation Model Adaptation papers are at ICML 2026?

ICML 2026 has 142 Foundation Model Adaptation papers, versus 76 the year before.

How many Foundation Model Adaptation papers are at CVPR 2026?

CVPR 2026 has 91 Foundation Model Adaptation papers, versus 62 the year before.

Which conference publishes the most Foundation Model Adaptation papers?

NeurIPS, with 531 papers from 2023 to 2026.