Foundation Model Adaptation papers, 2023–2026

Key findings

• Foundation Model Adaptation went from 159 papers in 2023 to 602 in 2026, roughly 3.8x in three years.
• NeurIPS publishes the most Foundation Model Adaptation work: 531 papers from 2023 to 2026, 36% of the four-venue total.
• The fastest-growing overlap is with Deep learning · foundation models: papers tagged with both rose from 7 in 2023 to 66 in 2026.
• Among the 5 topics under Meta-Learning and Transfer, it ranks #1 by 2026 paper count; the fastest grower in the group, Continual Learning, is up 1.7x versus 3.8x here.

Representative papers

Spread across years and venues so every edition shows up

• NeurIPS 2026(Mis)generalization of Helpful-Only Fine-Tuning
• ICML 2026Active Learning with Foundation Model Priors: Efficient Learning under Class Imbalance
• ICLR 2026Benchmarking ECG Foundational Models: A Reality Check Across Clinical Tasks
• CVPR 2026CD-Buffer Complementary Dual-Buffer Framework for Test-Time Adaptation in Adverse Weather
• NeurIPS 2025An Investigation of Memorization Risk in Healthcare Foundation Models
• ICML 2025A Bayesian Model Selection Criterion for Selecting Pretraining Checkpoints
• ICLR 2025Better autoregressive regression with LLMs via regression-aware fine-tuning
• CVPR 20255%>100%: Breaking Performance Shackles of Full Fine-Tuning on Visual Recognition Tasks
• NeurIPS 2024Instruction Tuning Large Language Models to Understand Electronic Health Records
• ICML 2024By Tying Embeddings You Are Assuming the Distributional Hypothesis
• ICLR 2024A Hard-to-Beat Baseline for Training-free CLIP-based Adaptation
• CVPR 2024DePT: Decoupled Prompt Tuning
• NeurIPS 2023A Fast and Accurate Estimator for Large Scale Linear Model via Data Averaging
• ICML 2023Are Neurons Actually Collapsed? On the Fine-Grained Structure in Neural Representations
• ICLR 2023A Closer Look at Model Adaptation using Feature Distortion and Simplicity Bias
• CVPR 2023A-La-Carte Prompt Tuning (APT): Combining Distinct Data via Composable Prompting
• NeurIPS 2026A Graph Foundation Model for Unified Clustering
• ICML 2026AdaMeZO: Adam-style Zeroth-Order Optimizer for LLM Fine-tuning Without Maintaining the Moments
• ICLR 2026Bridging Radiology and Pathology Foundation Models via Concept-Based Multimodal Co-Adaptation
• CVPR 2026Fed-ADE Adaptive Learning Rate for Federated Post-adaptation under Distribution Shift

All Foundation Model Adaptation papers

1,492 papers, page 28 of 30

1351. CVPR 2023Semi-Supervised Domain Adaptation With Source Label Adaptation
1352. CVPR 2023Test Time Adaptation With Regularized Loss for Weakly Supervised Salient Object Detection
1353. CVPR 2023Towards Better Stability and Adaptability: Improve Online Self-Training for Model Adaptation in Semantic Segmentation
1354. CVPR 2023Towards Fast Adaptation of Pretrained Contrastive Models for Multi-Channel Video-Language Retrieval
1355. CVPR 2023Train/Test-Time Adaptation With Retrieval
1356. CVPR 2023Trainable Projected Gradient Method for Robust Fine-Tuning
1357. CVPR 2023TWINS: A Fine-Tuning Framework for Improved Transferability of Adversarial Robustness and Generalization
1358. ICLR 2023A Closer Look at Model Adaptation using Feature Distortion and Simplicity Bias
1359. ICLR 2023Consolidator: Mergable Adapter with Group Connections for Visual Adaptation
1360. ICLR 2023Dirichlet-based Uncertainty Calibration for Active Domain Adaptation
1361. ICLR 2023Divide to Adapt: Mitigating Confirmation Bias for Domain Adaptation of Black-Box Predictors
1362. ICLR 2023Energy-Based Test Sample Adaptation for Domain Generalization
1363. ICLR 2023ESD: Expected Squared Difference as a Tuning-Free Trainable Calibration Measure
1364. ICLR 2023Graph Domain Adaptation via Theory-Grounded Spectral Regularization
1365. ICLR 2023Hyper-Decision Transformer for Efficient Online Policy Adaptation
1366. ICLR 2023Interneurons accelerate learning dynamics in recurrent neural networks for statistical adaptation
1367. ICLR 2023Lossless Adaptation of Pretrained Vision Models For Robotic Manipulation
1368. ICLR 2023Preserving Pre-trained Features Helps Calibrate Fine-tuned Language Models
1369. ICLR 2023Self-Distillation for Further Pre-training of Transformers
1370. ICLR 2023Surgical Fine-Tuning Improves Adaptation to Distribution Shifts
1371. ICLR 2023The Trade-off between Universality and Label Efficiency of Representations from Contrastive Learning
1372. ICLR 2023Token Merging: Your ViT But Faster
1373. ICLR 2023TVSPrune - Pruning Non-discriminative filters via Total Variation separability of intermediate representations without fine tuning
1374. ICLR 2023Using Language to Extend to Unseen Domains
1375. ICLR 2023When Source-Free Domain Adaptation Meets Learning with Noisy Labels
1376. ICML 2023A Kernel-Based View of Language Model Fine-Tuning
1377. ICML 2023AdaNPC: Exploring Non-Parametric Classifier for Test-Time Adaptation
1378. ICML 2023Are Neurons Actually Collapsed? On the Fine-Grained Structure in Neural Representations
1379. ICML 2023Bidirectional Adaptation for Robust Semi-Supervised Learning with Inconsistent Data Distributions
1380. ICML 2023ClimaX: A foundation model for weather and climate
1381. ICML 2023CocktailSGD: Fine-tuning Foundation Models over 500Mbps Networks
1382. ICML 2023Conditional Tree Matching for Inference-Time Adaptation of Tree Prediction Models
1383. ICML 2023Constant Matters: Fine-grained Error Bound on Differentially Private Continual Observation
1384. ICML 2023Cross-Modal Fine-Tuning: Align then Refine
1385. ICML 2023Curious Replay for Model-based Adaptation
1386. ICML 2023Double-Weighting for Covariate Shift Adaptation
1387. ICML 2023Efficient Personalized Federated Learning via Sparse Model-Adaptation
1388. ICML 2023Explore and Exploit the Diverse Knowledge in Model Zoo for Domain Generalization
1389. ICML 2023Exploring the Benefits of Training Expert Language Models over Instruction Tuning
1390. ICML 2023Flash: Concept Drift Adaptation in Federated Learning
1391. ICML 2023Flexible Model Aggregation for Quantile Regression
1392. ICML 2023How Many Perturbations Break This Model? Evaluating Robustness Beyond Adversarial Accuracy
1393. ICML 2023Human-Timescale Adaptation in an Open-Ended Task Space
1394. ICML 2023In Search for a Generalizable Method for Source Free Domain Adaptation
1395. ICML 2023LegendreTron: Uprising Proper Multiclass Loss Learning
1396. ICML 2023Magneto: A Foundation Transformer
1397. ICML 2023Master-ASR: Achieving Multilingual Scalability and Low-Resource Adaptation in ASR with Modular Learning
1398. ICML 2023MetaDiffuser: Diffusion Model as Conditional Planner for Offline Meta-RL
1399. ICML 2023Mitigating Spurious Correlations in Multi-modal Models during Fine-tuning
1400. ICML 2023Model Transferability with Responsive Decision Subjects

FAQ

How many Foundation Model Adaptation papers were published at NeurIPS, ICLR, ICML and CVPR from 2023 to 2026?

1,492 in total: 159 in 2023, 270 in 2024, 461 in 2025, 602 in 2026.

How many Foundation Model Adaptation papers are at NeurIPS 2026?

NeurIPS 2026 has 182 Foundation Model Adaptation papers, versus 174 the year before.

How many Foundation Model Adaptation papers are at ICLR 2026?

ICLR 2026 has 187 Foundation Model Adaptation papers, versus 149 the year before.

How many Foundation Model Adaptation papers are at ICML 2026?

ICML 2026 has 142 Foundation Model Adaptation papers, versus 76 the year before.

How many Foundation Model Adaptation papers are at CVPR 2026?

CVPR 2026 has 91 Foundation Model Adaptation papers, versus 62 the year before.

Which conference publishes the most Foundation Model Adaptation papers?

NeurIPS, with 531 papers from 2023 to 2026.