Vision-Language Pretraining papers, 2023–2026

Key findings

• Vision-Language Pretraining went from 65 papers in 2023 to 87 in 2026, roughly 1.3x in three years.
• NeurIPS publishes the most Vision-Language Pretraining work: 93 papers from 2023 to 2026, 35% of the four-venue total.
• The fastest-growing overlap is with Applications · computer vision: papers tagged with both rose from 0 in 2023 to 9 in 2026.
• Among the 5 topics under Open-Vocabulary Vision, it ranks #4 by 2026 paper count; the fastest grower in the group, Visual Grounding, is up 4.3x versus 1.3x here.

Representative papers

Spread across years and venues so every edition shows up

• NeurIPS 2026Benchmarking Optimizers for Large Language Model Pretraining
• ICML 2026How Does the Pretraining Distribution Shape In-Context Learning? A Fundamental Trade-Off
• ICLR 2026PonderLM: Pretraining Language Models to Ponder in Continuous Space
• CVPR 2026Large-scale Codec Avatars The Unreasonable Effectiveness of Large-scale Avatar Pretraining
• NeurIPS 2025ADPretrain: Advancing Industrial Anomaly Detection via Anomaly Representation Pretraining
• ICML 2025Soup-of-Experts: Pretraining Specialist Models via Parameters Averaging
• ICLR 2025Attributing Culture-Conditioned Generations to Pretraining Corpora
• CVPR 2025MAP: Unleashing Hybrid Mamba-Transformer Vision Backbone's Potential with Masked Autoregressive Pretraining
• NeurIPS 2024Data curation via joint example selection further accelerates multimodal learning
• ICML 2024Position: Considerations for Differentially Private Learning with Large-Scale Public Pretraining
• ICLR 2024Demystifying CLIP Data
• CVPR 2024ParameterNet: Parameters Are All You Need for Large-scale Visual Pretraining of Mobile Networks
• NeurIPS 2023Bootstrapping Vision-Language Learning with Decoupled Language Pre-training
• ICML 2023Contrastive Learning Meets Homophily: Two Birds with One Stone
• ICLR 2023Energy-Inspired Self-Supervised Pretraining for Vision Models
• CVPR 2023Active Finetuning: Exploiting Annotation Budget in the Pretraining-Finetuning Paradigm
• NeurIPS 2026C3P: Contrastive promoter-protein pretraining yields representations capturing bacterial gene regulation
• ICML 2026Multipole Semantic Attention: A Fast Approximation of Softmax Attention for Pretraining
• ICLR 2026MICLIP: Learning to Interpret Representation in Vision Models
• CVPR 2026The Surprising Effectiveness of Noise Pretraining for Implicit Neural Representations

All Vision-Language Pretraining papers

75 papers, page 1 of 2

1. CVPR 2026b-CLIP Text-Conditioned Contrastive Learning for Multi-Granular Vision-Language Alignment
2. CVPR 2026BabyVLM-V2 Toward Developmentally Grounded Pretraining and Benchmarking of Vision Foundation
3. CVPR 2026Beyond 3D VQAs Injecting 3D Spatial Priors into Vision-Language Models
4. CVPR 2026CLEP Contrastive Language-Pose Pretraining
5. CVPR 2026Concept-Aware Batch Sampling Improves Language-Image Pretraining
6. CVPR 2026EthoCLIP Ontology-Enhanced Video-Language Pretraining for Animal Behavior Understanding
7. CVPR 2026Evo-1 Lightweight Vision-Language-Action Model with Preserved Semantic Alignment
8. CVPR 2026FALCON False-Negative Aware Learning of Contrastive Negatives in Vision-Language Alignment
9. CVPR 2026From Panel to Pixel Zoom-In Vision-Language Pretraining from Biomedical Scientific
10. CVPR 2026Improving Calibration in Test-Time Prompt Tuning for Vision-Language Models via
11. CVPR 2026Joint-Aligned Latent Action Towards Scalable VLA Pretraining in the Wild
12. CVPR 2026LA-Pose Latent Action Pretraining Meets Pose Estimation
13. CVPR 2026Large-scale Codec Avatars The Unreasonable Effectiveness of Large-scale Avatar Pretraining
14. CVPR 2026Learning from Itself Mining Internal Knowledge from Vision Language Models
15. CVPR 2026MedKCO Medical Vision-Language Pretraining via Knowledge-Driven Cognitive Orchestration
16. CVPR 2026Modeling Cross-vision Synergy for Unified Large Vision Model
17. CVPR 2026MuViT Multi-Resolution Vision Transformers for Learning Across Scales in Microscopy
18. CVPR 2026PowerCLIP Powerset Alignment for Contrastive Pre-Training
19. CVPR 2026Scaling Parallel Sequence Models to Vision Foundation Models
20. CVPR 2026Selective Amnesia using Contrastive Subnet Erasure for Class Level Unlearning
21. CVPR 2026Spatial-Aware VLA Pretraining through Visual-Physical Alignment from Human Videos
22. CVPR 2026The Surprising Effectiveness of Noise Pretraining for Implicit Neural Representations
23. CVPR 2026TIPSv2 Advancing Vision-Language Pretraining with Enhanced Patch-Text Alignment
24. CVPR 2026Towards Highly Transferable Vision-Language Attack via Semantic-Augmented Dynamic Contrastive Interaction
25. CVPR 2026Uncertainty-guided Compositional Alignment with Part-to-Whole Semantic Representativeness in Hyperbolic Vision-Language
26. CVPR 2026UniRefiner Teaching Pre-trained ViTs to Self-Dispose Dross via Contrastive Register
27. CVPR 2026Unlearning without Forgetting Securely Removing Targeted Concepts from Large-Scale Vision-Language
28. CVPR 20253D-MVP: 3D Multiview Pretraining for Manipulation
29. CVPR 2025Context-Aware Multimodal Pretraining
30. CVPR 2025MAP: Unleashing Hybrid Mamba-Transformer Vision Backbone's Potential with Masked Autoregressive Pretraining
31. CVPR 2025Octopus: Alleviating Hallucination via Dynamic Contrastive Decoding
32. CVPR 2025Perceptual Inductive Bias Is What You Need Before Contrastive Learning
33. CVPR 2025Probing the Mid-level Vision Capabilities of Self-Supervised Learning
34. CVPR 2025Reproducible Vision-Language Models Meet Concepts Out of Pre-Training
35. CVPR 2025SAIST: Segment Any Infrared Small Target Model Guided by Contrastive Language-Image Pretraining
36. CVPR 2025SLADE: Shielding against Dual Exploits in Large Vision-Language Models
37. CVPR 2025Video Language Model Pretraining with Spatio-temporal Masking
38. CVPR 2024Anchor-based Robust Finetuning of Vision-Language Models
39. CVPR 2024BadCLIP: Dual-Embedding Guided Backdoor Attack on Multimodal Contrastive Learning
40. CVPR 2024Building Vision-Language Models on Solid Foundations with Masked Distillation
41. CVPR 2024Efficient Vision-Language Pre-training by Cluster Masking
42. CVPR 2024EfficientSAM: Leveraged Masked Image Pretraining for Efficient Segment Anything
43. CVPR 2024FFF: Fixing Flawed Foundations in Contrastive Pre-Training Results in Very Strong Vision-Language Models
44. CVPR 2024Iterated Learning Improves Compositionality in Large Vision-Language Models
45. CVPR 2024MAFA: Managing False Negatives for Vision-Language Pre-training
46. CVPR 2024Mitigating Object Hallucinations in Large Vision-Language Models through Visual Contrastive Decoding
47. CVPR 2024MULTIFLOW: Shifting Towards Task-Agnostic Vision-Language Pruning
48. CVPR 2024OmniSeg3D: Omniversal 3D Segmentation via Hierarchical Contrastive Learning
49. CVPR 2024ParameterNet: Parameters Are All You Need for Large-scale Visual Pretraining of Mobile Networks
50. CVPR 2024PeVL: Pose-Enhanced Vision-Language Model for Fine-Grained Human Action Recognition

FAQ

How many Vision-Language Pretraining papers were published at NeurIPS, ICLR, ICML and CVPR from 2023 to 2026?

263 in total: 65 in 2023, 55 in 2024, 56 in 2025, 87 in 2026.

How many Vision-Language Pretraining papers are at NeurIPS 2026?

NeurIPS 2026 has 27 Vision-Language Pretraining papers, versus 26 the year before.

How many Vision-Language Pretraining papers are at ICLR 2026?

ICLR 2026 has 14 Vision-Language Pretraining papers, versus 17 the year before.

How many Vision-Language Pretraining papers are at ICML 2026?

ICML 2026 has 19 Vision-Language Pretraining papers, versus 3 the year before.

How many Vision-Language Pretraining papers are at CVPR 2026?

CVPR 2026 has 27 Vision-Language Pretraining papers, versus 10 the year before.

Which conference publishes the most Vision-Language Pretraining papers?

NeurIPS, with 93 papers from 2023 to 2026.