Vision-Language Pretraining papers, 2023–2026

Key findings

• Vision-Language Pretraining went from 65 papers in 2023 to 87 in 2026, roughly 1.3x in three years.
• NeurIPS publishes the most Vision-Language Pretraining work: 93 papers from 2023 to 2026, 35% of the four-venue total.
• The fastest-growing overlap is with Applications · computer vision: papers tagged with both rose from 0 in 2023 to 9 in 2026.
• Among the 5 topics under Open-Vocabulary Vision, it ranks #4 by 2026 paper count; the fastest grower in the group, Visual Grounding, is up 4.3x versus 1.3x here.

Representative papers

Spread across years and venues so every edition shows up

• NeurIPS 2026Benchmarking Optimizers for Large Language Model Pretraining
• ICML 2026How Does the Pretraining Distribution Shape In-Context Learning? A Fundamental Trade-Off
• ICLR 2026PonderLM: Pretraining Language Models to Ponder in Continuous Space
• CVPR 2026Large-scale Codec Avatars The Unreasonable Effectiveness of Large-scale Avatar Pretraining
• NeurIPS 2025ADPretrain: Advancing Industrial Anomaly Detection via Anomaly Representation Pretraining
• ICML 2025Soup-of-Experts: Pretraining Specialist Models via Parameters Averaging
• ICLR 2025Attributing Culture-Conditioned Generations to Pretraining Corpora
• CVPR 2025MAP: Unleashing Hybrid Mamba-Transformer Vision Backbone's Potential with Masked Autoregressive Pretraining
• NeurIPS 2024Data curation via joint example selection further accelerates multimodal learning
• ICML 2024Position: Considerations for Differentially Private Learning with Large-Scale Public Pretraining
• ICLR 2024Demystifying CLIP Data
• CVPR 2024ParameterNet: Parameters Are All You Need for Large-scale Visual Pretraining of Mobile Networks
• NeurIPS 2023Bootstrapping Vision-Language Learning with Decoupled Language Pre-training
• ICML 2023Contrastive Learning Meets Homophily: Two Birds with One Stone
• ICLR 2023Energy-Inspired Self-Supervised Pretraining for Vision Models
• CVPR 2023Active Finetuning: Exploiting Annotation Budget in the Pretraining-Finetuning Paradigm
• NeurIPS 2026C3P: Contrastive promoter-protein pretraining yields representations capturing bacterial gene regulation
• ICML 2026Multipole Semantic Attention: A Fast Approximation of Softmax Attention for Pretraining
• ICLR 2026MICLIP: Learning to Interpret Representation in Vision Models
• CVPR 2026The Surprising Effectiveness of Noise Pretraining for Implicit Neural Representations

All Vision-Language Pretraining papers

24 papers, page 1 of 1

1. NeurIPS 2023Bootstrapping Vision-Language Learning with Decoupled Language Pre-training
2. NeurIPS 2023Brain encoding models based on multimodal transformers can transfer across language and vision
3. NeurIPS 2023CoDet: Co-occurrence Guided Region-Word Alignment for Open-Vocabulary Object Detection
4. NeurIPS 2023Convolutions Die Hard: Open-Vocabulary Segmentation with Single Frozen Convolutional CLIP
5. NeurIPS 2023D4: Improving LLM Pretraining via Document De-Duplication and Diversification
6. NeurIPS 2023DiffVL: Scaling Up Soft Body Manipulation using Vision-Language Driven Differentiable Physics
7. NeurIPS 2023Don’t Stop Pretraining? Make Prompt-based Fine-tuning Powerful Learner
8. NeurIPS 2023DoReMi: Optimizing Data Mixtures Speeds Up Language Model Pretraining
9. NeurIPS 2023Enhancing Adversarial Contrastive Learning via Adversarial Invariant Regularization
10. NeurIPS 2023Frequency-Enhanced Data Augmentation for Vision-and-Language Navigation
11. NeurIPS 2023Image Captioners Are Scalable Vision Learners Too
12. NeurIPS 2023Implicit variance regularization in non-contrastive SSL
13. NeurIPS 2023Improving CLIP Training with Language Rewrites
14. NeurIPS 2023Inverse Dynamics Pretraining Learns Good Representations for Multitask Imitation
15. NeurIPS 2023LOVM: Language-Only Vision Model Selection
16. NeurIPS 2023Med-UniC: Unifying Cross-Lingual Medical Vision-Language Pre-Training by Diminishing Bias
17. NeurIPS 2023MEGABYTE: Predicting Million-byte Sequences with Multiscale Transformers
18. NeurIPS 2023MosaicBERT: A Bidirectional Encoder Optimized for Fast Pretraining
19. NeurIPS 2023Rewrite Caption Semantics: Bridging Semantic Gaps for Language-Supervised Semantic Segmentation
20. NeurIPS 2023Robust Contrastive Language-Image Pretraining against Data Poisoning and Backdoor Attacks
21. NeurIPS 2023SugarCrepe: Fixing Hackable Benchmarks for Vision-Language Compositionality
22. NeurIPS 2023Towards In-context Scene Understanding
23. NeurIPS 2023Type-to-Track: Retrieve Any Object via Prompt-based Tracking
24. NeurIPS 2023Uncovering Prototypical Knowledge for Weakly Open-Vocabulary Semantic Segmentation

FAQ

How many Vision-Language Pretraining papers were published at NeurIPS, ICLR, ICML and CVPR from 2023 to 2026?

263 in total: 65 in 2023, 55 in 2024, 56 in 2025, 87 in 2026.

How many Vision-Language Pretraining papers are at NeurIPS 2026?

NeurIPS 2026 has 27 Vision-Language Pretraining papers, versus 26 the year before.

How many Vision-Language Pretraining papers are at ICLR 2026?

ICLR 2026 has 14 Vision-Language Pretraining papers, versus 17 the year before.

How many Vision-Language Pretraining papers are at ICML 2026?

ICML 2026 has 19 Vision-Language Pretraining papers, versus 3 the year before.

How many Vision-Language Pretraining papers are at CVPR 2026?

CVPR 2026 has 27 Vision-Language Pretraining papers, versus 10 the year before.

Which conference publishes the most Vision-Language Pretraining papers?

NeurIPS, with 93 papers from 2023 to 2026.