Foundation Model Adaptation papers, 2023–2026

Key findings

• Foundation Model Adaptation went from 159 papers in 2023 to 602 in 2026, roughly 3.8x in three years.
• NeurIPS publishes the most Foundation Model Adaptation work: 531 papers from 2023 to 2026, 36% of the four-venue total.
• The fastest-growing overlap is with Deep learning · foundation models: papers tagged with both rose from 7 in 2023 to 66 in 2026.
• Among the 5 topics under Meta-Learning and Transfer, it ranks #1 by 2026 paper count; the fastest grower in the group, Continual Learning, is up 1.7x versus 3.8x here.

Representative papers

Spread across years and venues so every edition shows up

• NeurIPS 2026(Mis)generalization of Helpful-Only Fine-Tuning
• ICML 2026Active Learning with Foundation Model Priors: Efficient Learning under Class Imbalance
• ICLR 2026Benchmarking ECG Foundational Models: A Reality Check Across Clinical Tasks
• CVPR 2026CD-Buffer Complementary Dual-Buffer Framework for Test-Time Adaptation in Adverse Weather
• NeurIPS 2025An Investigation of Memorization Risk in Healthcare Foundation Models
• ICML 2025A Bayesian Model Selection Criterion for Selecting Pretraining Checkpoints
• ICLR 2025Better autoregressive regression with LLMs via regression-aware fine-tuning
• CVPR 20255%>100%: Breaking Performance Shackles of Full Fine-Tuning on Visual Recognition Tasks
• NeurIPS 2024Instruction Tuning Large Language Models to Understand Electronic Health Records
• ICML 2024By Tying Embeddings You Are Assuming the Distributional Hypothesis
• ICLR 2024A Hard-to-Beat Baseline for Training-free CLIP-based Adaptation
• CVPR 2024DePT: Decoupled Prompt Tuning
• NeurIPS 2023A Fast and Accurate Estimator for Large Scale Linear Model via Data Averaging
• ICML 2023Are Neurons Actually Collapsed? On the Fine-Grained Structure in Neural Representations
• ICLR 2023A Closer Look at Model Adaptation using Feature Distortion and Simplicity Bias
• CVPR 2023A-La-Carte Prompt Tuning (APT): Combining Distinct Data via Composable Prompting
• NeurIPS 2026A Graph Foundation Model for Unified Clustering
• ICML 2026AdaMeZO: Adam-style Zeroth-Order Optimizer for LLM Fine-tuning Without Maintaining the Moments
• ICLR 2026Bridging Radiology and Pathology Foundation Models via Concept-Based Multimodal Co-Adaptation
• CVPR 2026Fed-ADE Adaptive Learning Rate for Federated Post-adaptation under Distribution Shift

All Foundation Model Adaptation papers

81 papers, page 1 of 2

1. NeurIPS 2023A Fast and Accurate Estimator for Large Scale Linear Model via Data Averaging
2. NeurIPS 2023A Simple Yet Effective Strategy to Robustify the Meta Learning Paradigm
3. NeurIPS 2023AdaVAE: Bayesian Structural Adaptation for Variational Autoencoders
4. NeurIPS 2023BayesTune: Bayesian Sparse Deep Model Fine-tuning
5. NeurIPS 2023Benchmarking Foundation Models with Language-Model-as-an-Examiner
6. NeurIPS 2023Benchmarking Robustness of Adaptation Methods on Pre-trained Vision-Language Models
7. NeurIPS 2023Beyond Invariance: Test-Time Label-Shift Adaptation for Addressing "Spurious" Correlations
8. NeurIPS 2023Brant: Foundation Model for Intracranial Neural Signal
9. NeurIPS 2023Chasing Fairness Under Distribution Shift: A Model Weight Perturbation Approach
10. NeurIPS 2023Combinatorial Optimization with Policy Adaptation using Latent Space Search
11. NeurIPS 2023Composing Parameter-Efficient Modules with Arithmetic Operation
12. NeurIPS 2023Concept Distillation: Leveraging Human-Centered Explanations for Model Improvement
13. NeurIPS 2023Context-guided Embedding Adaptation for Effective Topic Modeling in Low-Resource Regimes
14. NeurIPS 2023Counting Distinct Elements in the Turnstile Model with Differential Privacy under Continual Observation
15. NeurIPS 2023Customizable Image Synthesis with Multiple Subjects
16. NeurIPS 2023Data Portraits: Recording Foundation Model Training Data
17. NeurIPS 2023Data Selection for Language Models via Importance Resampling
18. NeurIPS 2023Demographic Parity Constrained Minimax Optimal Regression under Linear Model
19. NeurIPS 2023Don’t Stop Pretraining? Make Prompt-based Fine-tuning Powerful Learner
20. NeurIPS 2023DPM-Solver-v3: Improved Diffusion ODE Solver with Empirical Model Statistics
21. NeurIPS 2023Efficient Low-rank Backpropagation for Vision Transformer Adaptation
22. NeurIPS 2023EHRSHOT: An EHR Benchmark for Few-Shot Evaluation of Foundation Models
23. NeurIPS 2023Equivariant Adaptation of Large Pretrained Models
24. NeurIPS 2023Exact recovery and Bregman hard clustering of node-attributed Stochastic Block Model
25. NeurIPS 2023Fast Trainable Projection for Robust Fine-tuning
26. NeurIPS 2023Feature Adaptation for Sparse Linear Regression
27. NeurIPS 2023Fine-Grained Human Feedback Gives Better Rewards for Language Model Training
28. NeurIPS 2023FineMoGen: Fine-Grained Spatio-Temporal Motion Generation and Editing
29. NeurIPS 2023Foundation Model is Efficient Multimodal Multitask Model Selector
30. NeurIPS 2023Generalized Logit Adjustment: Calibrating Fine-tuned Models by Removing Label Bias in Foundation Models
31. NeurIPS 2023Generalized Semi-Supervised Learning via Self-Supervised Feature Adaptation
32. NeurIPS 2023Geodesic Multi-Modal Mixup for Robust Fine-Tuning
33. NeurIPS 2023Getting ViT in Shape: Scaling Laws for Compute-Optimal Model Design
34. NeurIPS 2023GPT4Tools: Teaching Large Language Model to Use Tools via Self-instruction
35. NeurIPS 2023HiBug: On Human-Interpretable Model Debug
36. NeurIPS 2023Holistic Transfer: Towards Non-Disruptive Fine-Tuning with Partial Target Data
37. NeurIPS 2023How to Fine-tune the Model: Unified Model Shift and Model Bias Policy Optimization
38. NeurIPS 2023HyenaDNA: Long-Range Genomic Sequence Modeling at Single Nucleotide Resolution
39. NeurIPS 2023Importance-aware Co-teaching for Offline Model-based Optimization
40. NeurIPS 2023Inner-Outer Aware Reconstruction Model for Monocular 3D Scene Reconstruction
41. NeurIPS 2023Interactive Multi-fidelity Learning for Cost-effective Adaptation of Language Model with Sparse Human Supervision
42. NeurIPS 2023Make Pre-trained Model Reversible: From Parameter to Memory Efficient Fine-Tuning
43. NeurIPS 2023Mixed Samples as Probes for Unsupervised Model Selection in Domain Adaptation
44. NeurIPS 2023MixFormerV2: Efficient Fully Transformer Tracking
45. NeurIPS 2023Mixture Weight Estimation and Model Prediction in Multi-source Multi-target Domain Adaptation
46. NeurIPS 2023Model Shapley: Equitable Model Valuation with Black-box Access
47. NeurIPS 2023Model Sparsity Can Simplify Machine Unlearning
48. NeurIPS 2023Model-enhanced Vector Index
49. NeurIPS 2023Moment Matching Denoising Gibbs Sampling
50. NeurIPS 2023MoVie: Visual Model-Based Policy Adaptation for View Generalization

FAQ

How many Foundation Model Adaptation papers were published at NeurIPS, ICLR, ICML and CVPR from 2023 to 2026?

1,492 in total: 159 in 2023, 270 in 2024, 461 in 2025, 602 in 2026.

How many Foundation Model Adaptation papers are at NeurIPS 2026?

NeurIPS 2026 has 182 Foundation Model Adaptation papers, versus 174 the year before.

How many Foundation Model Adaptation papers are at ICLR 2026?

ICLR 2026 has 187 Foundation Model Adaptation papers, versus 149 the year before.

How many Foundation Model Adaptation papers are at ICML 2026?

ICML 2026 has 142 Foundation Model Adaptation papers, versus 76 the year before.

How many Foundation Model Adaptation papers are at CVPR 2026?

CVPR 2026 has 91 Foundation Model Adaptation papers, versus 62 the year before.

Which conference publishes the most Foundation Model Adaptation papers?

NeurIPS, with 531 papers from 2023 to 2026.