Datasets and Benchmarks papers, 2023–2026
New datasets and evaluation protocols
Scope: NeurIPS, ICLR, ICML and CVPR, 2023–2026. 5,856 papers are tagged with this topic.
Key findings
- Datasets and Benchmarks went from 937 papers in 2023 to 1,991 in 2026, roughly 2.1x in three years.
- NeurIPS publishes the most Datasets and Benchmarks work: 1,935 papers from 2023 to 2026, 33% of the four-venue total.
- The fastest-growing overlap is with AI Agents: papers tagged with both rose from 8 in 2023 to 194 in 2026.
- Among the 5 topics under Efficiency and Systems, it ranks #1 by 2026 paper count; the fastest grower in the group, Hardware-Aware ML, is up 4.4x versus 2.1x here.
Papers per venue
Counts by year and venue
| Year | NeurIPS | ICLR | ICML | CVPR | Total |
|---|---|---|---|---|---|
| 2023 | 227 | 162 | 166 | 382 | 937 |
| 2024 | 448 | 216 | 318 | 364 | 1,346 |
| 2025 | 637 | 419 | 189 | 337 | 1,582 |
| 2026 | 623 | 635 | 275 | 458 | 1,991 |
Representative papers
Spread across years and venues so every edition shows up
- NeurIPS 2026A Surrogate Perspective on Convergence of Fixed-Target DQN
- ICML 2026$\mu$pscaling small models: Principled warm starts and hyperparameter transfer
- ICLR 2026**TandemFoilSet**: Datasets for Flow Field Prediction of Tandem-Airfoil Through the Reuse of Single Airfoils
- CVPR 20264DEquine Disentangling Motion and Appearance for 4D Equine Reconstruction from
- NeurIPS 2025A Dataset for Distilling Knowledge Priors from Literature for Therapeutic Design
- ICML 2025Active Evaluation Acquisition for Efficient LLM Benchmarking
- ICLR 2025$F^3Set$: Towards Analyzing Fast, Frequent, and Fine-grained Events from Videos
- CVPR 20253D-GRAND: A Million-Scale Dataset for 3D-LLMs with Better Grounding and Less Hallucination
- NeurIPS 2024A Benchmark Dataset for Event-Guided Human Pose Estimation and Tracking in Extreme Conditions
- ICML 2024A connection between Tempering and Entropic Mirror Descent
- ICLR 2024A Benchmark Study on Calibration
- CVPR 2024Data Valuation and Detections in Federated Learning
- NeurIPS 2023$\mathbf{\mathbb{E}^{FWI}}$: Multiparameter Benchmark Datasets for Elastic Full Waveform Inversion of Geophysical Properties
- ICML 2023A Picture of the Space of Typical Learnable Tasks
- ICLR 2023$\Lambda$-DARTS: Mitigating Performance Collapse by Harmonizing Operation Selection among Cells
- CVPR 2023A Bag-of-Prototypes Representation for Dataset-Level Applications
- NeurIPS 2026A Theoretical Bridge Between Long-Tailed Recognition and Continual Learning
- ICML 2026A Semantically Consistent Dataset for Data-Efficient Query-Based Universal Sound Separation
- ICLR 2026A Fictional Q&A Dataset for Studying Memorization and Knowledge Acquisition
- CVPR 2026Advancing Cancer Prognosis with Hierarchical Fusion of Genomic Proteomic and
All Datasets and Benchmarks papers
635 papers, page 3 of 13
- ICLR 2026CityLens: Evaluating Large Vision-Language Models for Urban Socioeconomic Sensing
- ICLR 2026CitySeeker: How Do VLMs Explore Embodied Urban Navigation with Implicit Human Needs?
- ICLR 2026CLARC: C/C++ Benchmark for Robust Code Search
- ICLR 2026ClarifyVC: Clarifying Ambiguous Commands in Vehicle Control with a Hybrid Data Augmentation Pipeline
- ICLR 2026CLEAR: Calibrated Learning for Epistemic and Aleatoric Risk
- ICLR 2026Clustering by Denoising: Latent plug-and-play diffusion for single-cell embeddings
- ICLR 2026CMPhysBench: A Benchmark for Evaluating Large Language Models in Condensed Matter Physics
- ICLR 2026CMT-Benchmark: A Benchmark for Condensed Matter Theory Built by Expert Researchers
- ICLR 2026CoDA: From Text-to-Image Diffusion Models to Training-Free Dataset Distillation
- ICLR 2026Code2Bench: Scaling Source and Rigor for Dynamic Benchmark Construction
- ICLR 2026CodeSense: a Real-World Benchmark and Dataset for Code Semantic Reasoning
- ICLR 2026CogniLoad: A Synthetic Natural Language Reasoning Benchmark With Tunable Length, Intrinsic Difficulty, and Distractor Density
- ICLR 2026Common Corpus: The Largest Collection of Ethical Data for LLM Pre-Training
- ICLR 2026Compactness and Consistency: A Conjoint Framework for Deep Graph Clustering
- ICLR 2026Comparing AI Agents to Cybersecurity Professionals in Real-World Penetration Testing
- ICLR 2026Complexity Analysis of Normalizing Constant Estimation: from Jarzynski Equality to Annealed Importance Sampling and beyond
- ICLR 2026Composable Sparse Subnetworks via Maximum-Entropy Principle
- ICLR 2026Computer Agent Arena: Toward Human-Centric Evaluation and Analysis of Computer-Use Agents
- ICLR 2026CoNavBench: Collaborative Long-Horizon Vision-Language Navigation Benchmark
- ICLR 2026Concepts' Information Bottleneck Models
- ICLR 2026CONCUR: A Framework for Continual Constrained and Unconstrained Routing
- ICLR 2026Conformal Prediction with Corrupted Labels: Uncertain Imputation and Robust Re-weighting
- ICLR 2026Consistency-Driven Calibration and Matching for Few-Shot Class Incremental Learning
- ICLR 2026Constant Degree Matrix-Driven Incomplete Multi-View Clustering via Connectivity-Structure and Embedding Tensor Learning
- ICLR 2026Constantly Improving Image Models Need Constantly Improving Benchmarks
- ICLR 2026Contextual and Seasonal LSTMs for Time Series Anomaly Detection
- ICLR 2026Cooperative Sheaf Neural Networks
- ICLR 2026Cost-of-Pass: An Economic Framework for Evaluating Language Models
- ICLR 2026CounselBench: A Large-Scale Expert Evaluation and Adversarial Benchmarking of Large Language Models in Mental Health Question Answering
- ICLR 2026Credit-Budgeted ICPC-Style Coding: When LLM Agents Must Pay for Every Decision
- ICLR 2026CrossPL: Systematic Evaluation of Large Language Models for Cross Programming Language Interoperating Code Generation
- ICLR 2026CTBench: Cryptocurrency Time Series Generation Benchmark
- ICLR 2026CubeBench: Diagnosing Interactive, Long-Horizon Physical Intelligence under Partial Observations
- ICLR 2026Cultivating Pluralism In Algorithmic Monoculture: The Community Alignment Dataset
- ICLR 2026Culture In a Frame: C$^3$B as a Comic-Based Benchmark for Multimodal Culturally Awareness
- ICLR 2026Customizing Visual Emotion Evaluation for MLLMs: An Open-vocabulary, Multifaceted, and Scalable Approach
- ICLR 2026CyberGym: Evaluating AI Agents' Real-World Cybersecurity Capabilities at Scale
- ICLR 2026DAComp: Benchmarking Data Agents across the Full Data Intelligence Lifecycle
- ICLR 2026DARE-bench: Evaluating Modeling and Instruction Fidelity of LLMs in Data Science
- ICLR 2026Dataset Color Quantization: A Training-Oriented Framework for Dataset-Level Compression
- ICLR 2026Dataset Distillation as Pushforward Optimal Quantization
- ICLR 2026Dataset Distillation for Memorized Data: Soft Labels can Leak Held-Out Teacher Knowledge
- ICLR 2026Decoupling the Class Label and the Target Concept in Machine Unlearning
- ICLR 2026Deep Latent Variable Model based Vertical Federated Learning with Flexible Alignment and Labeling Scenarios
- ICLR 2026DeepFRC: An End-to-End Deep Learning Model for Functional Registration and Classification
- ICLR 2026DeepMath-103K: A Large-Scale, Challenging, Decontaminated, and Verifiable Mathematical Dataset for Advancing Reasoning
- ICLR 2026DeepResearch Bench: A Comprehensive Benchmark for Deep Research Agents
- ICLR 2026DELTA-Code: How RL Unlocks and Transfers New Programming Algorithms in LLMs
- ICLR 2026Demystifying Deep Search: A Holistic Evaluation with Hint-free Multi-Hop Questions and Factorised Metrics
- ICLR 2026DESIGNER: Design-Logic-Guided Multidisciplinary Data Synthesis for LLM Reasoning
Ask about this trend from Claude or Cursor
Connect the Paperlist MCP and your assistant can pull the numbers on this page while you draft a survey, pick a direction or plan a submission: papers per year and venue, growth, the fastest-rising sub-themes and representative papers, shaped around your question.
Copy this prompt into your assistant
Use paperlist to show how Datasets and Benchmarks papers grew at NeurIPS from 2023 to 2026, and which year jumped the most.
Tool the assistant calls: get_topic_stats {"topic": "dataset-and-benchmarks"}
Set up Paperlist MCP in two minutes (Claude Code, Cursor, Codex, ChatGPT)
FAQ
- How many Datasets and Benchmarks papers were published at NeurIPS, ICLR, ICML and CVPR from 2023 to 2026?
- 5,856 in total: 937 in 2023, 1,346 in 2024, 1,582 in 2025, 1,991 in 2026.
- How many Datasets and Benchmarks papers are at NeurIPS 2026?
- NeurIPS 2026 has 623 Datasets and Benchmarks papers, versus 637 the year before.
- How many Datasets and Benchmarks papers are at ICLR 2026?
- ICLR 2026 has 635 Datasets and Benchmarks papers, versus 419 the year before.
- How many Datasets and Benchmarks papers are at ICML 2026?
- ICML 2026 has 275 Datasets and Benchmarks papers, versus 189 the year before.
- How many Datasets and Benchmarks papers are at CVPR 2026?
- CVPR 2026 has 458 Datasets and Benchmarks papers, versus 337 the year before.
- Which conference publishes the most Datasets and Benchmarks papers?
- NeurIPS, with 1,935 papers from 2023 to 2026.