Vision-Language Pretraining papers, 2023–2026

Key findings

• Vision-Language Pretraining went from 65 papers in 2023 to 87 in 2026, roughly 1.3x in three years.
• NeurIPS publishes the most Vision-Language Pretraining work: 93 papers from 2023 to 2026, 35% of the four-venue total.
• The fastest-growing overlap is with Applications · computer vision: papers tagged with both rose from 0 in 2023 to 9 in 2026.
• Among the 5 topics under Open-Vocabulary Vision, it ranks #4 by 2026 paper count; the fastest grower in the group, Visual Grounding, is up 4.3x versus 1.3x here.

Representative papers

Spread across years and venues so every edition shows up

• NeurIPS 2026Benchmarking Optimizers for Large Language Model Pretraining
• ICML 2026How Does the Pretraining Distribution Shape In-Context Learning? A Fundamental Trade-Off
• ICLR 2026PonderLM: Pretraining Language Models to Ponder in Continuous Space
• CVPR 2026Large-scale Codec Avatars The Unreasonable Effectiveness of Large-scale Avatar Pretraining
• NeurIPS 2025ADPretrain: Advancing Industrial Anomaly Detection via Anomaly Representation Pretraining
• ICML 2025Soup-of-Experts: Pretraining Specialist Models via Parameters Averaging
• ICLR 2025Attributing Culture-Conditioned Generations to Pretraining Corpora
• CVPR 2025MAP: Unleashing Hybrid Mamba-Transformer Vision Backbone's Potential with Masked Autoregressive Pretraining
• NeurIPS 2024Data curation via joint example selection further accelerates multimodal learning
• ICML 2024Position: Considerations for Differentially Private Learning with Large-Scale Public Pretraining
• ICLR 2024Demystifying CLIP Data
• CVPR 2024ParameterNet: Parameters Are All You Need for Large-scale Visual Pretraining of Mobile Networks
• NeurIPS 2023Bootstrapping Vision-Language Learning with Decoupled Language Pre-training
• ICML 2023Contrastive Learning Meets Homophily: Two Birds with One Stone
• ICLR 2023Energy-Inspired Self-Supervised Pretraining for Vision Models
• CVPR 2023Active Finetuning: Exploiting Annotation Budget in the Pretraining-Finetuning Paradigm
• NeurIPS 2026C3P: Contrastive promoter-protein pretraining yields representations capturing bacterial gene regulation
• ICML 2026Multipole Semantic Attention: A Fast Approximation of Softmax Attention for Pretraining
• ICLR 2026MICLIP: Learning to Interpret Representation in Vision Models
• CVPR 2026The Surprising Effectiveness of Noise Pretraining for Implicit Neural Representations

All Vision-Language Pretraining papers

93 papers, page 2 of 2

51. NeurIPS 2025Tracing the Representation Geometry of Language Models from Pretraining to Post-training
52. NeurIPS 2025UniDomain: Pretraining a Unified PDDL Domain from Real-World Demonstrations for Generalizable Robot Task Planning
53. NeurIPS 2025VITRIX-UniViTAR: Unified Vision Transformer with Native Resolution
54. NeurIPS 2024A Practitioner's Guide to Real-World Continual Multimodal Pretraining
55. NeurIPS 2024Accelerating Augmentation Invariance Pretraining
56. NeurIPS 2024BenchX: A Unified Benchmark Framework for Medical Vision-Language Pretraining on Chest X-Rays
57. NeurIPS 2024Boundary Matters: A Bi-Level Active Finetuning Method
58. NeurIPS 2024Classification Done Right for Vision-Language Pre-Training
59. NeurIPS 2024Data curation via joint example selection further accelerates multimodal learning
60. NeurIPS 2024Easy Regional Contrastive Learning of Expressive Fashion Representations
61. NeurIPS 2024Exploring Molecular Pretraining Model at Scale
62. NeurIPS 2024Harnessing small projectors and multiple views for efficient vision pretraining
63. NeurIPS 2024LocCa: Visual Pretraining with Location-aware Captioners
64. NeurIPS 2024Long-tailed Object Detection Pretraining: Dynamic Rebalancing Contrastive Learning with Dual Reconstruction
65. NeurIPS 2024Multi-view Masked Contrastive Representation Learning for Endoscopic Video Analysis
66. NeurIPS 2024Not All Tokens Are What You Need for Pretraining
67. NeurIPS 2024Pretraining Codomain Attention Neural Operators for Solving Multiphysics PDEs
68. NeurIPS 2024TripletCLIP: Improving Compositional Reasoning of CLIP via Synthetic Vision-Language Negatives
69. NeurIPS 2024Your contrastive learning problem is secretly a distribution alignment problem
70. NeurIPS 2023Bootstrapping Vision-Language Learning with Decoupled Language Pre-training
71. NeurIPS 2023Brain encoding models based on multimodal transformers can transfer across language and vision
72. NeurIPS 2023CoDet: Co-occurrence Guided Region-Word Alignment for Open-Vocabulary Object Detection
73. NeurIPS 2023Convolutions Die Hard: Open-Vocabulary Segmentation with Single Frozen Convolutional CLIP
74. NeurIPS 2023D4: Improving LLM Pretraining via Document De-Duplication and Diversification
75. NeurIPS 2023DiffVL: Scaling Up Soft Body Manipulation using Vision-Language Driven Differentiable Physics
76. NeurIPS 2023Don’t Stop Pretraining? Make Prompt-based Fine-tuning Powerful Learner
77. NeurIPS 2023DoReMi: Optimizing Data Mixtures Speeds Up Language Model Pretraining
78. NeurIPS 2023Enhancing Adversarial Contrastive Learning via Adversarial Invariant Regularization
79. NeurIPS 2023Frequency-Enhanced Data Augmentation for Vision-and-Language Navigation
80. NeurIPS 2023Image Captioners Are Scalable Vision Learners Too
81. NeurIPS 2023Implicit variance regularization in non-contrastive SSL
82. NeurIPS 2023Improving CLIP Training with Language Rewrites
83. NeurIPS 2023Inverse Dynamics Pretraining Learns Good Representations for Multitask Imitation
84. NeurIPS 2023LOVM: Language-Only Vision Model Selection
85. NeurIPS 2023Med-UniC: Unifying Cross-Lingual Medical Vision-Language Pre-Training by Diminishing Bias
86. NeurIPS 2023MEGABYTE: Predicting Million-byte Sequences with Multiscale Transformers
87. NeurIPS 2023MosaicBERT: A Bidirectional Encoder Optimized for Fast Pretraining
88. NeurIPS 2023Rewrite Caption Semantics: Bridging Semantic Gaps for Language-Supervised Semantic Segmentation
89. NeurIPS 2023Robust Contrastive Language-Image Pretraining against Data Poisoning and Backdoor Attacks
90. NeurIPS 2023SugarCrepe: Fixing Hackable Benchmarks for Vision-Language Compositionality
91. NeurIPS 2023Towards In-context Scene Understanding
92. NeurIPS 2023Type-to-Track: Retrieve Any Object via Prompt-based Tracking
93. NeurIPS 2023Uncovering Prototypical Knowledge for Weakly Open-Vocabulary Semantic Segmentation

FAQ

How many Vision-Language Pretraining papers were published at NeurIPS, ICLR, ICML and CVPR from 2023 to 2026?

263 in total: 65 in 2023, 55 in 2024, 56 in 2025, 87 in 2026.

How many Vision-Language Pretraining papers are at NeurIPS 2026?

NeurIPS 2026 has 27 Vision-Language Pretraining papers, versus 26 the year before.

How many Vision-Language Pretraining papers are at ICLR 2026?

ICLR 2026 has 14 Vision-Language Pretraining papers, versus 17 the year before.

How many Vision-Language Pretraining papers are at ICML 2026?

ICML 2026 has 19 Vision-Language Pretraining papers, versus 3 the year before.

How many Vision-Language Pretraining papers are at CVPR 2026?

CVPR 2026 has 27 Vision-Language Pretraining papers, versus 10 the year before.

Which conference publishes the most Vision-Language Pretraining papers?

NeurIPS, with 93 papers from 2023 to 2026.