Foundation Model Adaptation papers, 2023–2026

Key findings

• Foundation Model Adaptation went from 159 papers in 2023 to 602 in 2026, roughly 3.8x in three years.
• NeurIPS publishes the most Foundation Model Adaptation work: 531 papers from 2023 to 2026, 36% of the four-venue total.
• The fastest-growing overlap is with Deep learning · foundation models: papers tagged with both rose from 7 in 2023 to 66 in 2026.
• Among the 5 topics under Meta-Learning and Transfer, it ranks #1 by 2026 paper count; the fastest grower in the group, Continual Learning, is up 1.7x versus 3.8x here.

Representative papers

Spread across years and venues so every edition shows up

• NeurIPS 2026(Mis)generalization of Helpful-Only Fine-Tuning
• ICML 2026Active Learning with Foundation Model Priors: Efficient Learning under Class Imbalance
• ICLR 2026Benchmarking ECG Foundational Models: A Reality Check Across Clinical Tasks
• CVPR 2026CD-Buffer Complementary Dual-Buffer Framework for Test-Time Adaptation in Adverse Weather
• NeurIPS 2025An Investigation of Memorization Risk in Healthcare Foundation Models
• ICML 2025A Bayesian Model Selection Criterion for Selecting Pretraining Checkpoints
• ICLR 2025Better autoregressive regression with LLMs via regression-aware fine-tuning
• CVPR 20255%>100%: Breaking Performance Shackles of Full Fine-Tuning on Visual Recognition Tasks
• NeurIPS 2024Instruction Tuning Large Language Models to Understand Electronic Health Records
• ICML 2024By Tying Embeddings You Are Assuming the Distributional Hypothesis
• ICLR 2024A Hard-to-Beat Baseline for Training-free CLIP-based Adaptation
• CVPR 2024DePT: Decoupled Prompt Tuning
• NeurIPS 2023A Fast and Accurate Estimator for Large Scale Linear Model via Data Averaging
• ICML 2023Are Neurons Actually Collapsed? On the Fine-Grained Structure in Neural Representations
• ICLR 2023A Closer Look at Model Adaptation using Feature Distortion and Simplicity Bias
• CVPR 2023A-La-Carte Prompt Tuning (APT): Combining Distinct Data via Composable Prompting
• NeurIPS 2026A Graph Foundation Model for Unified Clustering
• ICML 2026AdaMeZO: Adam-style Zeroth-Order Optimizer for LLM Fine-tuning Without Maintaining the Moments
• ICLR 2026Bridging Radiology and Pathology Foundation Models via Concept-Based Multimodal Co-Adaptation
• CVPR 2026Fed-ADE Adaptive Learning Rate for Federated Post-adaptation under Distribution Shift

All Foundation Model Adaptation papers

270 papers, page 4 of 6

151. ICML 2024Position: Graph Foundation Models Are Already Here
152. ICML 2024Position: On the Societal Impact of Open Foundation Models
153. ICML 2024Position: Why Tabular Foundation Models Should Be a Research Priority
154. ICML 2024Preference Fine-Tuning of LLMs Should Leverage Suboptimal, On-Policy Data
155. ICML 2024Prior Mismatch and Adaptation in PnP-ADMM with a Nonconvex Convergence Analysis
156. ICML 2024Prompting a Pretrained Transformer Can Be a Universal Approximator
157. ICML 2024Prompting is a Double-Edged Sword: Improving Worst-Group Robustness of Foundation Models
158. ICML 2024Random Masking Finds Winning Tickets for Parameter Efficient Fine-tuning
159. ICML 2024Recovering the Pre-Fine-Tuning Weights of Generative Models
160. ICML 2024Reducing Fine-Tuning Memory Overhead by Approximate and Memory-Sharing Backpropagation
161. ICML 2024Revisiting the Power of Prompt for Visual Tuning
162. ICML 2024Riemannian Preconditioned LoRA for Fine-Tuning Foundation Models
163. ICML 2024Robust CLIP: Unsupervised Adversarial Fine-Tuning of Vision Embeddings for Robust Large Vision-Language Models
164. ICML 2024RoSA: Accurate Parameter-Efficient Fine-Tuning via Robust Adaptation
165. ICML 2024Safety Fine-Tuning at (Almost) No Cost: A Baseline for Vision Large Language Models
166. ICML 2024SAM-E: Leveraging Visual Foundation Model with Sequence Imitation for Embodied Manipulation
167. ICML 2024Selecting Large Language Model to Fine-tune via Rectified Scaling Law
168. ICML 2024Self-Play Fine-Tuning Converts Weak Language Models to Strong Language Models
169. ICML 2024Sparse is Enough in Fine-tuning Pre-trained Large Language Models
170. ICML 2024SPP: Sparsity-Preserved Parameter-Efficient Fine-Tuning for Large Language Models
171. ICML 2024SuDA: Support-based Domain Adaptation for Sim2Real Hinge Joint Tracking with Flexible Sensors
172. ICML 2024To Cool or not to Cool? Temperature Network Meets Large Foundation Models via DRO
173. ICML 2024Towards Causal Foundation Model: on Duality between Optimal Balancing and Attention
174. ICML 2024Transferring Knowledge From Large Foundation Models to Small Downstream Models
175. ICML 2024Unleashing the Power of Meta-tuning for Few-shot Generalization Through Sparse Interpolated Experts
176. ICML 2024Variance-reduced Zeroth-Order Methods for Fine-Tuning Language Models
177. NeurIPS 2024A Hitchhiker's Guide to Fine-Grained Face Forgery Detection Using Common Sense Reasoning
178. NeurIPS 2024A Simple yet Universal Framework for Depth Completion
179. NeurIPS 2024B'MOJO: Hybrid State Space Realizations of Foundation Models with Eidetic and Fading Memory
180. NeurIPS 2024BackdoorAlign: Mitigating Fine-tuning based Jailbreak Attack with Backdoor Enhanced Safety Alignment
181. NeurIPS 2024Be Confident in What You Know: Bayesian Parameter Efficient Fine-Tuning of Vision Foundation Models
182. NeurIPS 2024BLoB: Bayesian Low-Rank Adaptation by Backpropagation for Large Language Models
183. NeurIPS 2024Brain-JEPA: Brain Dynamics Foundation Model with Gradient Positioning and Spatiotemporal Masking
184. NeurIPS 2024Cell ontology guided transcriptome foundation model
185. NeurIPS 2024Conformal Alignment: Knowing When to Trust Foundation Models with Guarantees
186. NeurIPS 2024CorDA: Context-Oriented Decomposition Adaptation of Large Language Models for Task-Aware Parameter-Efficient Fine-tuning
187. NeurIPS 2024Curriculum Fine-tuning of Vision Foundation Model for Medical Image Classification Under Label Noise
188. NeurIPS 2024Diffusion Tuning: Transferring Diffusion Models via Chain of Forgetting
189. NeurIPS 2024DistillNeRF: Perceiving 3D Scenes from Single-Glance Images by Distilling Neural Fields and Foundation Model Features
190. NeurIPS 2024Do Multimodal Foundation Models Understand Enterprise Workflows? A Benchmark for Business Process Management Tasks
191. NeurIPS 2024DropBP: Accelerating Fine-Tuning of Large Language Models by Dropping Backward Propagation
192. NeurIPS 2024Dual Risk Minimization: Towards Next-Level Robustness in Fine-tuning Zero-Shot Models
193. NeurIPS 2024Dual-Personalizing Adapter for Federated Foundation Models
194. NeurIPS 2024Dynamic Tuning Towards Parameter and Inference Efficiency for ViT Adaptation
195. NeurIPS 2024Efficient Adaptation of Pre-trained Vision Transformer via Householder Transformation
196. NeurIPS 2024EMGBench: Benchmarking Out-of-Distribution Generalization and Adaptation for Electromyography
197. NeurIPS 2024Empowering Visible-Infrared Person Re-Identification with Large Foundation Models
198. NeurIPS 2024EMVP: Embracing Visual Foundation Model for Visual Place Recognition with Centroid-Free Probing
199. NeurIPS 2024FairMedFM: Fairness Benchmarking for Medical Imaging Foundation Models
200. NeurIPS 2024Federated Fine-tuning of Large Language Models under Heterogeneous Tasks and Client Resources

FAQ

How many Foundation Model Adaptation papers were published at NeurIPS, ICLR, ICML and CVPR from 2023 to 2026?

1,492 in total: 159 in 2023, 270 in 2024, 461 in 2025, 602 in 2026.

How many Foundation Model Adaptation papers are at NeurIPS 2026?

NeurIPS 2026 has 182 Foundation Model Adaptation papers, versus 174 the year before.

How many Foundation Model Adaptation papers are at ICLR 2026?

ICLR 2026 has 187 Foundation Model Adaptation papers, versus 149 the year before.

How many Foundation Model Adaptation papers are at ICML 2026?

ICML 2026 has 142 Foundation Model Adaptation papers, versus 76 the year before.

How many Foundation Model Adaptation papers are at CVPR 2026?

CVPR 2026 has 91 Foundation Model Adaptation papers, versus 62 the year before.

Which conference publishes the most Foundation Model Adaptation papers?

NeurIPS, with 531 papers from 2023 to 2026.