Datasets and Benchmarks papers, 2023–2026
New datasets and evaluation protocols
Scope: NeurIPS, ICLR, ICML and CVPR, 2023–2026. 5,856 papers are tagged with this topic.
Key findings
- Datasets and Benchmarks went from 937 papers in 2023 to 1,991 in 2026, roughly 2.1x in three years.
- NeurIPS publishes the most Datasets and Benchmarks work: 1,935 papers from 2023 to 2026, 33% of the four-venue total.
- The fastest-growing overlap is with AI Agents: papers tagged with both rose from 8 in 2023 to 194 in 2026.
- Among the 5 topics under Efficiency and Systems, it ranks #1 by 2026 paper count; the fastest grower in the group, Hardware-Aware ML, is up 4.4x versus 2.1x here.
Papers per venue
Counts by year and venue
| Year | NeurIPS | ICLR | ICML | CVPR | Total |
|---|---|---|---|---|---|
| 2023 | 227 | 162 | 166 | 382 | 937 |
| 2024 | 448 | 216 | 318 | 364 | 1,346 |
| 2025 | 637 | 419 | 189 | 337 | 1,582 |
| 2026 | 623 | 635 | 275 | 458 | 1,991 |
Representative papers
Spread across years and venues so every edition shows up
- NeurIPS 2026A Surrogate Perspective on Convergence of Fixed-Target DQN
- ICML 2026$\mu$pscaling small models: Principled warm starts and hyperparameter transfer
- ICLR 2026**TandemFoilSet**: Datasets for Flow Field Prediction of Tandem-Airfoil Through the Reuse of Single Airfoils
- CVPR 20264DEquine Disentangling Motion and Appearance for 4D Equine Reconstruction from
- NeurIPS 2025A Dataset for Distilling Knowledge Priors from Literature for Therapeutic Design
- ICML 2025Active Evaluation Acquisition for Efficient LLM Benchmarking
- ICLR 2025$F^3Set$: Towards Analyzing Fast, Frequent, and Fine-grained Events from Videos
- CVPR 20253D-GRAND: A Million-Scale Dataset for 3D-LLMs with Better Grounding and Less Hallucination
- NeurIPS 2024A Benchmark Dataset for Event-Guided Human Pose Estimation and Tracking in Extreme Conditions
- ICML 2024A connection between Tempering and Entropic Mirror Descent
- ICLR 2024A Benchmark Study on Calibration
- CVPR 2024Data Valuation and Detections in Federated Learning
- NeurIPS 2023$\mathbf{\mathbb{E}^{FWI}}$: Multiparameter Benchmark Datasets for Elastic Full Waveform Inversion of Geophysical Properties
- ICML 2023A Picture of the Space of Typical Learnable Tasks
- ICLR 2023$\Lambda$-DARTS: Mitigating Performance Collapse by Harmonizing Operation Selection among Cells
- CVPR 2023A Bag-of-Prototypes Representation for Dataset-Level Applications
- NeurIPS 2026A Theoretical Bridge Between Long-Tailed Recognition and Continual Learning
- ICML 2026A Semantically Consistent Dataset for Data-Efficient Query-Based Universal Sound Separation
- ICLR 2026A Fictional Q&A Dataset for Studying Memorization and Knowledge Acquisition
- CVPR 2026Advancing Cancer Prognosis with Hierarchical Fusion of Genomic Proteomic and
All Datasets and Benchmarks papers
948 papers, page 2 of 19
- ICML 2026Correct Looks Better: Pairwise Comparisons Reveal Accuracy Rankings
- ICML 2026Courtroom Analogy: New Perspective on Uncertainty-Aware Classification
- ICML 2026Cram Less to Fit More: Training Data Pruning Improves Memorization of Facts
- ICML 2026CriticalKV: Optimizing KV Cache Eviction from an Output Perturbation Perspective
- ICML 2026CryoACE: An Atom-centric Framework for Accurate and Automated Model Building in Cryo-EM
- ICML 2026Curating the Future: A Scalable Recipe for Training Open-Ended Forecasters
- ICML 2026Data Agent: Learning to Select Data via End-to-End Dynamic Optimization
- ICML 2026DataGuard: A Non-intrusive Dataset Auditing Framework via Differential Information Forensics
- ICML 2026Decompose and Recompose: Reasoning New Skills from Existing Abilities for Cross-Task Robotic Manipulation
- ICML 2026Decompose, Structure, and Repair: A Neuro-Symbolic Framework for Autoformalization via Operator Trees
- ICML 2026Decouple Searching from Training: Scaling Data Mixing via Model Merging for Large Language Model Pre-training
- ICML 2026Decoupling The "What" and "Where" With Polar Coordinate Positional Embedding
- ICML 2026Deep Trajectory Supervision: Deep Supervision Strikes Back
- ICML 2026Delegation and Verification under AI
- ICML 2026Detecting Errors in AI-Generated Annotations: When and Why Semantic Neighbors Help
- ICML 2026Diffusion Models Preferentially Memorize Prototypical Examples or: Why Does My Diffusion Model Love Slop?
- ICML 2026Dimensionality Reduction with Point-distributions Similarity Invariant
- ICML 2026DISCO: Mitigating Bias in Deep Learning with Conditional Distance Correlation
- ICML 2026Dispersion Loss Counteracts Embedding Condensation and Improves Generalization in Small Language Models
- ICML 2026Divide and Contrast: Learning Robust Temporal Features without Augmentation
- ICML 2026DIYHealth Suite: Dataset, Model, and Benchmark for Health Management at Home
- ICML 2026Do Activation Verbalization Methods Convey Privileged Information?
- ICML 2026Does a Hybrid Space-Aware Randomized Defense Improve Empirical and Certified Adversarial Robustness?
- ICML 2026DRIVE: Distributional and Retrieval-Augmented Bidding with Value Evaluation
- ICML 2026DualCOIL: Offline Imitation Learning from Contrasting Demonstrations
- ICML 2026Dynamic Linear Attention
- ICML 2026Dynamic Multimodal Evaluation via Knowledge-Enhanced Benchmark Evolution
- ICML 2026DynaSchedBench: Calibrated Dynamic Scheduling Benchmarks and Observability Paradox in LLM-based Scheduling Agents
- ICML 2026EEG-FM-Bench: A Comprehensive Benchmark for the Systematic Evaluation and Diagnostic Analyses of EEG Foundation Models
- ICML 2026Efficient Multi-modal Dataset Distillation via Analytic Parameter Matching
- ICML 2026Efficient, Validation-Free Intrinsic Quality Estimation for Large-Scale Face Recognition Datasets
- ICML 2026Empirical Gaussian Processes
- ICML 2026Error Propagation Mechanisms and Compensation Strategies for Quantized Diffusion Models
- ICML 2026Evaluating and Explaining Prompt Sensitivity of LLMs Using Interactions
- ICML 2026Evaluating Language Models in Realistic Conversational Contexts
- ICML 2026Evaluating Object-Centric Models beyond Object Discovery
- ICML 2026Expanding the AI Evaluation Toolbox with Statistical Models
- ICML 2026Expectation Consistency Loss: Rethink Confidence Calibration under Covariate Shift
- ICML 2026Exploring 3D Dataset Pruning
- ICML 2026FairJudge : An Adaptive, Debiased, and Consistent LLM-as-a-Judge
- ICML 2026Falling Trees: A Model Class for Interpretable Risk Prioritization
- ICML 2026Fast k-means Seeding Under The Manifold Hypothesis
- ICML 2026Faults in Our Formal Benchmarking: Dataset Defects and Evaluation Failures in Lean Theorem Proving
- ICML 2026FedARC: Anchor-Guided Residual Compensation for Data and Model Heterogeneous Federated Learning
- ICML 2026Federated Data and Feature Selection by Generalized CUR Decomposition
- ICML 2026Federated Learning with Unlabeled Clients: Personalization Can Happen in Low Dimensions
- ICML 2026Fine-Tune Once, Reuse Across Models: Bayesian Task-Update Factors and Approximations
- ICML 2026FiX: Introducing Fine-grained Forget Gate into Softmax Attention
- ICML 2026Fixed Aggregation Features Can Rival GNNs
- ICML 2026FLIP2: Expanding Protein Fitness Landscape Benchmarks for Real-World Machine Learning Applications
Ask about this trend from Claude or Cursor
Connect the Paperlist MCP and your assistant can pull the numbers on this page while you draft a survey, pick a direction or plan a submission: papers per year and venue, growth, the fastest-rising sub-themes and representative papers, shaped around your question.
Copy this prompt into your assistant
Use paperlist to show how Datasets and Benchmarks papers grew at NeurIPS from 2023 to 2026, and which year jumped the most.
Tool the assistant calls: get_topic_stats {"topic": "dataset-and-benchmarks"}
Set up Paperlist MCP in two minutes (Claude Code, Cursor, Codex, ChatGPT)
FAQ
- How many Datasets and Benchmarks papers were published at NeurIPS, ICLR, ICML and CVPR from 2023 to 2026?
- 5,856 in total: 937 in 2023, 1,346 in 2024, 1,582 in 2025, 1,991 in 2026.
- How many Datasets and Benchmarks papers are at NeurIPS 2026?
- NeurIPS 2026 has 623 Datasets and Benchmarks papers, versus 637 the year before.
- How many Datasets and Benchmarks papers are at ICLR 2026?
- ICLR 2026 has 635 Datasets and Benchmarks papers, versus 419 the year before.
- How many Datasets and Benchmarks papers are at ICML 2026?
- ICML 2026 has 275 Datasets and Benchmarks papers, versus 189 the year before.
- How many Datasets and Benchmarks papers are at CVPR 2026?
- CVPR 2026 has 458 Datasets and Benchmarks papers, versus 337 the year before.
- Which conference publishes the most Datasets and Benchmarks papers?
- NeurIPS, with 1,935 papers from 2023 to 2026.