Datasets and Benchmarks papers, 2023–2026
New datasets and evaluation protocols
Scope: NeurIPS, ICLR, ICML and CVPR, 2023–2026. 5,856 papers are tagged with this topic.
Key findings
- Datasets and Benchmarks went from 937 papers in 2023 to 1,991 in 2026, roughly 2.1x in three years.
- NeurIPS publishes the most Datasets and Benchmarks work: 1,935 papers from 2023 to 2026, 33% of the four-venue total.
- The fastest-growing overlap is with AI Agents: papers tagged with both rose from 8 in 2023 to 194 in 2026.
- Among the 5 topics under Efficiency and Systems, it ranks #1 by 2026 paper count; the fastest grower in the group, Hardware-Aware ML, is up 4.4x versus 2.1x here.
Papers per venue
Counts by year and venue
| Year | NeurIPS | ICLR | ICML | CVPR | Total |
|---|---|---|---|---|---|
| 2023 | 227 | 162 | 166 | 382 | 937 |
| 2024 | 448 | 216 | 318 | 364 | 1,346 |
| 2025 | 637 | 419 | 189 | 337 | 1,582 |
| 2026 | 623 | 635 | 275 | 458 | 1,991 |
Representative papers
Spread across years and venues so every edition shows up
- NeurIPS 2026A Surrogate Perspective on Convergence of Fixed-Target DQN
- ICML 2026$\mu$pscaling small models: Principled warm starts and hyperparameter transfer
- ICLR 2026**TandemFoilSet**: Datasets for Flow Field Prediction of Tandem-Airfoil Through the Reuse of Single Airfoils
- CVPR 20264DEquine Disentangling Motion and Appearance for 4D Equine Reconstruction from
- NeurIPS 2025A Dataset for Distilling Knowledge Priors from Literature for Therapeutic Design
- ICML 2025Active Evaluation Acquisition for Efficient LLM Benchmarking
- ICLR 2025$F^3Set$: Towards Analyzing Fast, Frequent, and Fine-grained Events from Videos
- CVPR 20253D-GRAND: A Million-Scale Dataset for 3D-LLMs with Better Grounding and Less Hallucination
- NeurIPS 2024A Benchmark Dataset for Event-Guided Human Pose Estimation and Tracking in Extreme Conditions
- ICML 2024A connection between Tempering and Entropic Mirror Descent
- ICLR 2024A Benchmark Study on Calibration
- CVPR 2024Data Valuation and Detections in Federated Learning
- NeurIPS 2023$\mathbf{\mathbb{E}^{FWI}}$: Multiparameter Benchmark Datasets for Elastic Full Waveform Inversion of Geophysical Properties
- ICML 2023A Picture of the Space of Typical Learnable Tasks
- ICLR 2023$\Lambda$-DARTS: Mitigating Performance Collapse by Harmonizing Operation Selection among Cells
- CVPR 2023A Bag-of-Prototypes Representation for Dataset-Level Applications
- NeurIPS 2026A Theoretical Bridge Between Long-Tailed Recognition and Continual Learning
- ICML 2026A Semantically Consistent Dataset for Data-Efficient Query-Based Universal Sound Separation
- ICLR 2026A Fictional Q&A Dataset for Studying Memorization and Knowledge Acquisition
- CVPR 2026Advancing Cancer Prognosis with Hierarchical Fusion of Genomic Proteomic and
All Datasets and Benchmarks papers
1,935 papers, page 1 of 39
- NeurIPS 2026$\mathbf{D^{3}S^{2}}$: Diffusion-Guided Dataset Distillation for Semantic Segmentation
- NeurIPS 2026$\mathrm{Bounded\mbox{-}RS}$: A Bounded Evaluation Protocol and Testbed for Representational Systematicity
- NeurIPS 2026$\varphi$TD: Distributional Reinforcement Learning using Characteristic Functions
- NeurIPS 20263D Consistency Tokens
- NeurIPS 2026A Diagnostic Benchmark for Layered Layout and Template-Variant Reasoning
- NeurIPS 2026A Mahalanobis Margin \texorpdfstring{$\gamma_{\min}$}{gamma\_min} Bound on Task Confusion in Pretrained Class-Incremental Learning: From Infeasibility to Exponential Attenuation
- NeurIPS 2026A Margin Perspective on LoRA: Robustness to Catastrophic Forgetting and Adapter Merging (MaLoRA)
- NeurIPS 2026A Method-Class Divide in Sub-4-Bit Quantization:\\Iterative vs.\ Single-Pass Sensitivity to Data Composition
- NeurIPS 2026A Multimodal Benchmark for Evaluating Cause-of-Death Inference Using Child Health and Mortality Data
- NeurIPS 2026A New Framework for Quantum Reinforcement Learning
- NeurIPS 2026A Simple Class-Agnostic Approach to Enhance Fair Adversarial Training
- NeurIPS 2026A Simple Unigram Cross-Entropy Lens on the Lexical Imprint of Pre-training Data
- NeurIPS 2026A Surrogate Perspective on Convergence of Fixed-Target DQN
- NeurIPS 2026A Systematic Analysis of Out-of-Distribution Detection Under Representation and Training Paradigm Shifts
- NeurIPS 2026A Theoretical Bridge Between Long-Tailed Recognition and Continual Learning
- NeurIPS 2026A2Eval: Agentic and Automated Evaluation for Embodied Brain
- NeurIPS 2026Accuracy of Noise Ceiling Estimators for Brain Scores
- NeurIPS 2026ACDP: Architecture-aware Cross-Dataset Performance Predictor for NAS
- NeurIPS 2026ACED-Bench: Evaluating How LLM Agents Acquire and Act on Causal Evidence
- NeurIPS 2026Achieving Optimal Static and Dynamic Regret Simultaneously in Bandits with Deterministic Losses
- NeurIPS 2026Active Learning as Nullspace Regulation: A Spectral Representation Perspective
- NeurIPS 2026Adaptive Random Forests from Online Learning and Testing by Betting
- NeurIPS 2026Adaptive Target-Charging with Privacy Filters and Individual Accounting
- NeurIPS 2026Addressing Sparse-Rewards in RL with Scalable Hierarchical Novel Eigen Options
- NeurIPS 2026AET-Bench: Pixel-Accurate Atomic Tomography Is Not Atom-Accurate
- NeurIPS 2026Affine Tracing: A New Paradigm for Probabilistic Linear Solvers
- NeurIPS 2026AgentKernelArena: Benchmarking Performance and Generalization of AI Coding Agents on GPU Kernels Optimization
- NeurIPS 2026Agents' Last Exam
- NeurIPS 2026AgentSSL: Can MLE Agents Leverage Unlabeled Data?
- NeurIPS 2026AgroOmni: A Large-Scale Multi-view Agricultural Dataset for Cross-Scale Multimodal Reasoning
- NeurIPS 2026AI Construct Lexis: An Ontology of the Hidden Assumptions in AI Evaluation
- NeurIPS 2026AI for Drug Discovery Models Often Do Not Learn as Expected and How to Diagnose These Failure Modes
- NeurIPS 2026Aligning Language Model Benchmarks with Pairwise Preferences
- NeurIPS 2026AlphaPROBE: Alpha Mining via principled retriveval and on-graph biased evolution
- NeurIPS 2026AMGenC: Generating Charge Balanced Amorphous Materials
- NeurIPS 2026Amortized Optimal Transport from Sliced Potentials
- NeurIPS 2026AMUSE: Anytime Muon with Stable Gradient Evaluation
- NeurIPS 2026An Assessment of Human vs. Model Uncertainty in Soft-Label Learning and Calibration
- NeurIPS 2026An Axiomatic Analysis of DPO and NLHF as Reference-Dependent Probabilistic Voting Rules
- NeurIPS 2026An Embarrassingly Simple Graph Heuristic Reveals Shortcut-Solvable Benchmarks for Sequential Recommendation
- NeurIPS 2026An Empirical Study on Noisy Data and LLM Pretraining Loss Divergence
- NeurIPS 2026An Open-Source Training Dataset for Foundation Models for Black-box Optimization
- NeurIPS 2026Anchored Protein Engineering
- NeurIPS 2026Answering At Any Cost: Frontier LLMs Are Consequence-Insensitive
- NeurIPS 2026AnyHand: A Large-Scale Synthetic Dataset for RGB(-D) Hand Pose Estimation
- NeurIPS 2026Anymotion: A Dataset, Benchmark, and Baseline for Controllable Human Motion Editing
- NeurIPS 2026Anytime-Valid Conformal Risk Control
- NeurIPS 2026AptaBench: A Benchmark for Aptamer-Small Molecule Binding
- NeurIPS 2026Are Multimodal Benchmarks Really Useful? Item-Level Multimodal Benchmark Diagnosis via Structure-Response Co-Calibration
- NeurIPS 2026Arena-T2I Hard: Benchmarking and Improving Faithfulness with Dependency-Aware Checklist Rewards
Ask about this trend from Claude or Cursor
Connect the Paperlist MCP and your assistant can pull the numbers on this page while you draft a survey, pick a direction or plan a submission: papers per year and venue, growth, the fastest-rising sub-themes and representative papers, shaped around your question.
Copy this prompt into your assistant
Use paperlist to show how Datasets and Benchmarks papers grew at NeurIPS from 2023 to 2026, and which year jumped the most.
Tool the assistant calls: get_topic_stats {"topic": "dataset-and-benchmarks"}
Set up Paperlist MCP in two minutes (Claude Code, Cursor, Codex, ChatGPT)
FAQ
- How many Datasets and Benchmarks papers were published at NeurIPS, ICLR, ICML and CVPR from 2023 to 2026?
- 5,856 in total: 937 in 2023, 1,346 in 2024, 1,582 in 2025, 1,991 in 2026.
- How many Datasets and Benchmarks papers are at NeurIPS 2026?
- NeurIPS 2026 has 623 Datasets and Benchmarks papers, versus 637 the year before.
- How many Datasets and Benchmarks papers are at ICLR 2026?
- ICLR 2026 has 635 Datasets and Benchmarks papers, versus 419 the year before.
- How many Datasets and Benchmarks papers are at ICML 2026?
- ICML 2026 has 275 Datasets and Benchmarks papers, versus 189 the year before.
- How many Datasets and Benchmarks papers are at CVPR 2026?
- CVPR 2026 has 458 Datasets and Benchmarks papers, versus 337 the year before.
- Which conference publishes the most Datasets and Benchmarks papers?
- NeurIPS, with 1,935 papers from 2023 to 2026.