视觉语言预训练论文趋势 2023–2026
对比预训练
统计范围:NeurIPS、ICLR、ICML、CVPR 四个会议,2023–2026 年,共 263 篇被归入该主题的论文。
主要结论
- 视觉语言预训练论文从 2023 年的 65 篇增长到 2026 年的 87 篇,三年间扩大到约 1.3 倍。
- NeurIPS 是发视觉语言预训练论文最多的会议,2023–2026 年共 93 篇,占四个会议总量的 35%。
- 交叉方向里涨得最快的是应用 · computer vision:同时属于两个主题的论文从 2023 年的 0 篇增至 2026 年的 9 篇。
- 在「开放词汇视觉」的 5 个主题里,它的 2026 年论文数排第 4;同组增长最快的视觉定位是 4.3 倍,视觉语言预训练是 1.3 倍。
各会议论文数
按年份和会议统计
| 年份 | NeurIPS | ICLR | ICML | CVPR | 合计 |
|---|---|---|---|---|---|
| 2023 | 24 | 13 | 8 | 20 | 65 |
| 2024 | 16 | 12 | 9 | 18 | 55 |
| 2025 | 26 | 17 | 3 | 10 | 56 |
| 2026 | 27 | 14 | 19 | 27 | 87 |
代表论文
按年份和会议均匀挑选,方便快速看到每一届的样貌
- NeurIPS 2026Benchmarking Optimizers for Large Language Model Pretraining
- ICML 2026How Does the Pretraining Distribution Shape In-Context Learning? A Fundamental Trade-Off
- ICLR 2026PonderLM: Pretraining Language Models to Ponder in Continuous Space
- CVPR 2026Large-scale Codec Avatars The Unreasonable Effectiveness of Large-scale Avatar Pretraining
- NeurIPS 2025ADPretrain: Advancing Industrial Anomaly Detection via Anomaly Representation Pretraining
- ICML 2025Soup-of-Experts: Pretraining Specialist Models via Parameters Averaging
- ICLR 2025Attributing Culture-Conditioned Generations to Pretraining Corpora
- CVPR 2025MAP: Unleashing Hybrid Mamba-Transformer Vision Backbone's Potential with Masked Autoregressive Pretraining
- NeurIPS 2024Data curation via joint example selection further accelerates multimodal learning
- ICML 2024Position: Considerations for Differentially Private Learning with Large-Scale Public Pretraining
- ICLR 2024Demystifying CLIP Data
- CVPR 2024ParameterNet: Parameters Are All You Need for Large-scale Visual Pretraining of Mobile Networks
- NeurIPS 2023Bootstrapping Vision-Language Learning with Decoupled Language Pre-training
- ICML 2023Contrastive Learning Meets Homophily: Two Birds with One Stone
- ICLR 2023Energy-Inspired Self-Supervised Pretraining for Vision Models
- CVPR 2023Active Finetuning: Exploiting Annotation Budget in the Pretraining-Finetuning Paradigm
- NeurIPS 2026C3P: Contrastive promoter-protein pretraining yields representations capturing bacterial gene regulation
- ICML 2026Multipole Semantic Attention: A Fast Approximation of Softmax Attention for Pretraining
- ICLR 2026MICLIP: Learning to Interpret Representation in Vision Models
- CVPR 2026The Surprising Effectiveness of Noise Pretraining for Implicit Neural Representations
全部视觉语言预训练论文
共 55 篇,第 1 / 2 页
- CVPR 2024Anchor-based Robust Finetuning of Vision-Language Models
- CVPR 2024BadCLIP: Dual-Embedding Guided Backdoor Attack on Multimodal Contrastive Learning
- CVPR 2024Building Vision-Language Models on Solid Foundations with Masked Distillation
- CVPR 2024Efficient Vision-Language Pre-training by Cluster Masking
- CVPR 2024EfficientSAM: Leveraged Masked Image Pretraining for Efficient Segment Anything
- CVPR 2024FFF: Fixing Flawed Foundations in Contrastive Pre-Training Results in Very Strong Vision-Language Models
- CVPR 2024Iterated Learning Improves Compositionality in Large Vision-Language Models
- CVPR 2024MAFA: Managing False Negatives for Vision-Language Pre-training
- CVPR 2024Mitigating Object Hallucinations in Large Vision-Language Models through Visual Contrastive Decoding
- CVPR 2024MULTIFLOW: Shifting Towards Task-Agnostic Vision-Language Pruning
- CVPR 2024OmniSeg3D: Omniversal 3D Segmentation via Hierarchical Contrastive Learning
- CVPR 2024ParameterNet: Parameters Are All You Need for Large-scale Visual Pretraining of Mobile Networks
- CVPR 2024PeVL: Pose-Enhanced Vision-Language Model for Fine-Grained Human Action Recognition
- CVPR 2024S2MAE: A Spatial-Spectral Pretraining Foundation Model for Spectral Remote Sensing Data
- CVPR 2024SaCo Loss: Sample-wise Affinity Consistency for Vision-Language Pre-training
- CVPR 2024SyncMask: Synchronized Attentional Masking for Fashion-centric Vision-Language Pretraining
- CVPR 2024ViTamin: Designing Scalable Vision Models in the Vision-Language Era
- CVPR 2024ZeroRF: Fast Sparse View 360deg Reconstruction with Zero Pretraining
- ICLR 20243D Feature Prediction for Masked-AutoEncoder-Based Point Cloud Pretraining
- ICLR 2024CLIP the Bias: How Useful is Balancing Data in Multimodal Learning?
- ICLR 2024COSA: Concatenated Sample Pretrained Vision-Language Foundation Model
- ICLR 2024Demystifying CLIP Data
- ICLR 2024Detecting Pretraining Data from Large Language Models
- ICLR 2024Headless Language Models: Learning without Predicting with Contrastive Weight Tying
- ICLR 2024In-Context Pretraining: Language Modeling Beyond Document Boundaries
- ICLR 2024LanguageBind: Extending Video-Language Pretraining to N-modality by Language-based Semantic Alignment
- ICLR 2024On the Provable Advantage of Unsupervised Pretraining
- ICLR 2024Tag2Text: Guiding Vision-Language Model via Image Tagging
- ICLR 2024Unified Language-Vision Pretraining in LLM with Dynamic Discrete Visual Tokenization
- ICLR 2024Unsupervised Pretraining for Fact Verification by Language Model Distillation
- ICML 2024Amend to Alignment: Decoupled Prompt Tuning for Mitigating Spurious Correlation in Vision-Language Models
- ICML 2024Modeling Caption Diversity in Contrastive Vision-Language Pretraining
- ICML 2024OLLIE: Imitation Learning from Offline Pretraining to Online Finetuning
- ICML 2024Position: Considerations for Differentially Private Learning with Large-Scale Public Pretraining
- ICML 2024Premier-TACO is a Few-Shot Policy Learner: Pretraining Multitask Representation via Temporal Action-Driven Contrastive Loss
- ICML 2024Provable Contrastive Continual Learning
- ICML 2024Revealing Vision-Language Integration in the Brain with Multimodal Networks
- ICML 2024SyCoCa: Symmetrizing Contrastive Captioners with Attentive Masking for Multimodal Alignment
- ICML 2024Two Tales of Single-Phase Contrastive Hebbian Learning
- NeurIPS 2024A Practitioner's Guide to Real-World Continual Multimodal Pretraining
- NeurIPS 2024Accelerating Augmentation Invariance Pretraining
- NeurIPS 2024BenchX: A Unified Benchmark Framework for Medical Vision-Language Pretraining on Chest X-Rays
- NeurIPS 2024Boundary Matters: A Bi-Level Active Finetuning Method
- NeurIPS 2024Classification Done Right for Vision-Language Pre-Training
- NeurIPS 2024Data curation via joint example selection further accelerates multimodal learning
- NeurIPS 2024Easy Regional Contrastive Learning of Expressive Fashion Representations
- NeurIPS 2024Exploring Molecular Pretraining Model at Scale
- NeurIPS 2024Harnessing small projectors and multiple views for efficient vision pretraining
- NeurIPS 2024LocCa: Visual Pretraining with Location-aware Captioners
- NeurIPS 2024Long-tailed Object Detection Pretraining: Dynamic Rebalancing Contrastive Learning with Dual Reconstruction
在 Claude、Cursor 里直接问这个趋势
接上 Paperlist MCP 后,写综述、挑方向或准备投稿时,不用离开对话框就能拿到这页的数字:每年各会议的论文数、增长倍数、涨得最快的子方向和代表论文,AI 会按你的问题整理。
可以直接复制这句话问 AI
用 paperlist 查视觉语言预训练在 NeurIPS 2023–2026 的论文趋势,哪一年涨得最快?
AI 会调用的工具:get_topic_stats {"topic": "vision-language-pretraining"}
常见问题
- 2023–2026 年四大会议一共有多少篇视觉语言预训练论文?
- 共 263 篇,按年份分别是 2023 年 65 篇、2024 年 55 篇、2025 年 56 篇、2026 年 87 篇。
- NeurIPS 2026 有多少篇视觉语言预训练论文?
- NeurIPS 2026 有 27 篇视觉语言预训练论文,上一届是 26 篇。
- ICLR 2026 有多少篇视觉语言预训练论文?
- ICLR 2026 有 14 篇视觉语言预训练论文,上一届是 17 篇。
- ICML 2026 有多少篇视觉语言预训练论文?
- ICML 2026 有 19 篇视觉语言预训练论文,上一届是 3 篇。
- CVPR 2026 有多少篇视觉语言预训练论文?
- CVPR 2026 有 27 篇视觉语言预训练论文,上一届是 10 篇。
- 哪个会议的视觉语言预训练论文最多?
- NeurIPS,2023–2026 年共 93 篇。