Vision-Language Pretraining papers, 2023–2026

Key findings

• Vision-Language Pretraining went from 65 papers in 2023 to 87 in 2026, roughly 1.3x in three years.
• NeurIPS publishes the most Vision-Language Pretraining work: 93 papers from 2023 to 2026, 35% of the four-venue total.
• The fastest-growing overlap is with Applications · computer vision: papers tagged with both rose from 0 in 2023 to 9 in 2026.
• Among the 5 topics under Open-Vocabulary Vision, it ranks #4 by 2026 paper count; the fastest grower in the group, Visual Grounding, is up 4.3x versus 1.3x here.

Representative papers

Spread across years and venues so every edition shows up

• NeurIPS 2026Benchmarking Optimizers for Large Language Model Pretraining
• ICML 2026How Does the Pretraining Distribution Shape In-Context Learning? A Fundamental Trade-Off
• ICLR 2026PonderLM: Pretraining Language Models to Ponder in Continuous Space
• CVPR 2026Large-scale Codec Avatars The Unreasonable Effectiveness of Large-scale Avatar Pretraining
• NeurIPS 2025ADPretrain: Advancing Industrial Anomaly Detection via Anomaly Representation Pretraining
• ICML 2025Soup-of-Experts: Pretraining Specialist Models via Parameters Averaging
• ICLR 2025Attributing Culture-Conditioned Generations to Pretraining Corpora
• CVPR 2025MAP: Unleashing Hybrid Mamba-Transformer Vision Backbone's Potential with Masked Autoregressive Pretraining
• NeurIPS 2024Data curation via joint example selection further accelerates multimodal learning
• ICML 2024Position: Considerations for Differentially Private Learning with Large-Scale Public Pretraining
• ICLR 2024Demystifying CLIP Data
• CVPR 2024ParameterNet: Parameters Are All You Need for Large-scale Visual Pretraining of Mobile Networks
• NeurIPS 2023Bootstrapping Vision-Language Learning with Decoupled Language Pre-training
• ICML 2023Contrastive Learning Meets Homophily: Two Birds with One Stone
• ICLR 2023Energy-Inspired Self-Supervised Pretraining for Vision Models
• CVPR 2023Active Finetuning: Exploiting Annotation Budget in the Pretraining-Finetuning Paradigm
• NeurIPS 2026C3P: Contrastive promoter-protein pretraining yields representations capturing bacterial gene regulation
• ICML 2026Multipole Semantic Attention: A Fast Approximation of Softmax Attention for Pretraining
• ICLR 2026MICLIP: Learning to Interpret Representation in Vision Models
• CVPR 2026The Surprising Effectiveness of Noise Pretraining for Implicit Neural Representations

All Vision-Language Pretraining papers

263 papers, page 4 of 6

151. CVPR 2024MAFA: Managing False Negatives for Vision-Language Pre-training
152. CVPR 2024Mitigating Object Hallucinations in Large Vision-Language Models through Visual Contrastive Decoding
153. CVPR 2024MULTIFLOW: Shifting Towards Task-Agnostic Vision-Language Pruning
154. CVPR 2024OmniSeg3D: Omniversal 3D Segmentation via Hierarchical Contrastive Learning
155. CVPR 2024ParameterNet: Parameters Are All You Need for Large-scale Visual Pretraining of Mobile Networks
156. CVPR 2024PeVL: Pose-Enhanced Vision-Language Model for Fine-Grained Human Action Recognition
157. CVPR 2024S2MAE: A Spatial-Spectral Pretraining Foundation Model for Spectral Remote Sensing Data
158. CVPR 2024SaCo Loss: Sample-wise Affinity Consistency for Vision-Language Pre-training
159. CVPR 2024SyncMask: Synchronized Attentional Masking for Fashion-centric Vision-Language Pretraining
160. CVPR 2024ViTamin: Designing Scalable Vision Models in the Vision-Language Era
161. CVPR 2024ZeroRF: Fast Sparse View 360deg Reconstruction with Zero Pretraining
162. ICLR 20243D Feature Prediction for Masked-AutoEncoder-Based Point Cloud Pretraining
163. ICLR 2024CLIP the Bias: How Useful is Balancing Data in Multimodal Learning?
164. ICLR 2024COSA: Concatenated Sample Pretrained Vision-Language Foundation Model
165. ICLR 2024Demystifying CLIP Data
166. ICLR 2024Detecting Pretraining Data from Large Language Models
167. ICLR 2024Headless Language Models: Learning without Predicting with Contrastive Weight Tying
168. ICLR 2024In-Context Pretraining: Language Modeling Beyond Document Boundaries
169. ICLR 2024LanguageBind: Extending Video-Language Pretraining to N-modality by Language-based Semantic Alignment
170. ICLR 2024On the Provable Advantage of Unsupervised Pretraining
171. ICLR 2024Tag2Text: Guiding Vision-Language Model via Image Tagging
172. ICLR 2024Unified Language-Vision Pretraining in LLM with Dynamic Discrete Visual Tokenization
173. ICLR 2024Unsupervised Pretraining for Fact Verification by Language Model Distillation
174. ICML 2024Amend to Alignment: Decoupled Prompt Tuning for Mitigating Spurious Correlation in Vision-Language Models
175. ICML 2024Modeling Caption Diversity in Contrastive Vision-Language Pretraining
176. ICML 2024OLLIE: Imitation Learning from Offline Pretraining to Online Finetuning
177. ICML 2024Position: Considerations for Differentially Private Learning with Large-Scale Public Pretraining
178. ICML 2024Premier-TACO is a Few-Shot Policy Learner: Pretraining Multitask Representation via Temporal Action-Driven Contrastive Loss
179. ICML 2024Provable Contrastive Continual Learning
180. ICML 2024Revealing Vision-Language Integration in the Brain with Multimodal Networks
181. ICML 2024SyCoCa: Symmetrizing Contrastive Captioners with Attentive Masking for Multimodal Alignment
182. ICML 2024Two Tales of Single-Phase Contrastive Hebbian Learning
183. NeurIPS 2024A Practitioner's Guide to Real-World Continual Multimodal Pretraining
184. NeurIPS 2024Accelerating Augmentation Invariance Pretraining
185. NeurIPS 2024BenchX: A Unified Benchmark Framework for Medical Vision-Language Pretraining on Chest X-Rays
186. NeurIPS 2024Boundary Matters: A Bi-Level Active Finetuning Method
187. NeurIPS 2024Classification Done Right for Vision-Language Pre-Training
188. NeurIPS 2024Data curation via joint example selection further accelerates multimodal learning
189. NeurIPS 2024Easy Regional Contrastive Learning of Expressive Fashion Representations
190. NeurIPS 2024Exploring Molecular Pretraining Model at Scale
191. NeurIPS 2024Harnessing small projectors and multiple views for efficient vision pretraining
192. NeurIPS 2024LocCa: Visual Pretraining with Location-aware Captioners
193. NeurIPS 2024Long-tailed Object Detection Pretraining: Dynamic Rebalancing Contrastive Learning with Dual Reconstruction
194. NeurIPS 2024Multi-view Masked Contrastive Representation Learning for Endoscopic Video Analysis
195. NeurIPS 2024Not All Tokens Are What You Need for Pretraining
196. NeurIPS 2024Pretraining Codomain Attention Neural Operators for Solving Multiphysics PDEs
197. NeurIPS 2024TripletCLIP: Improving Compositional Reasoning of CLIP via Synthetic Vision-Language Negatives
198. NeurIPS 2024Your contrastive learning problem is secretly a distribution alignment problem
199. CVPR 2023Accelerating Vision-Language Pretraining With Free Language Modeling
200. CVPR 2023Active Finetuning: Exploiting Annotation Budget in the Pretraining-Finetuning Paradigm

FAQ

How many Vision-Language Pretraining papers were published at NeurIPS, ICLR, ICML and CVPR from 2023 to 2026?

263 in total: 65 in 2023, 55 in 2024, 56 in 2025, 87 in 2026.

How many Vision-Language Pretraining papers are at NeurIPS 2026?

NeurIPS 2026 has 27 Vision-Language Pretraining papers, versus 26 the year before.

How many Vision-Language Pretraining papers are at ICLR 2026?

ICLR 2026 has 14 Vision-Language Pretraining papers, versus 17 the year before.

How many Vision-Language Pretraining papers are at ICML 2026?

ICML 2026 has 19 Vision-Language Pretraining papers, versus 3 the year before.

How many Vision-Language Pretraining papers are at CVPR 2026?

CVPR 2026 has 27 Vision-Language Pretraining papers, versus 10 the year before.

Which conference publishes the most Vision-Language Pretraining papers?

NeurIPS, with 93 papers from 2023 to 2026.