Datasets and Benchmarks papers, 2023–2026
New datasets and evaluation protocols
Scope: NeurIPS, ICLR, ICML and CVPR, 2023–2026. 5,856 papers are tagged with this topic.
Key findings
- Datasets and Benchmarks went from 937 papers in 2023 to 1,991 in 2026, roughly 2.1x in three years.
- NeurIPS publishes the most Datasets and Benchmarks work: 1,935 papers from 2023 to 2026, 33% of the four-venue total.
- The fastest-growing overlap is with AI Agents: papers tagged with both rose from 8 in 2023 to 194 in 2026.
- Among the 5 topics under Efficiency and Systems, it ranks #1 by 2026 paper count; the fastest grower in the group, Hardware-Aware ML, is up 4.4x versus 2.1x here.
Papers per venue
Counts by year and venue
| Year | NeurIPS | ICLR | ICML | CVPR | Total |
|---|---|---|---|---|---|
| 2023 | 227 | 162 | 166 | 382 | 937 |
| 2024 | 448 | 216 | 318 | 364 | 1,346 |
| 2025 | 637 | 419 | 189 | 337 | 1,582 |
| 2026 | 623 | 635 | 275 | 458 | 1,991 |
Representative papers
Spread across years and venues so every edition shows up
- NeurIPS 2026A Surrogate Perspective on Convergence of Fixed-Target DQN
- ICML 2026$\mu$pscaling small models: Principled warm starts and hyperparameter transfer
- ICLR 2026**TandemFoilSet**: Datasets for Flow Field Prediction of Tandem-Airfoil Through the Reuse of Single Airfoils
- CVPR 20264DEquine Disentangling Motion and Appearance for 4D Equine Reconstruction from
- NeurIPS 2025A Dataset for Distilling Knowledge Priors from Literature for Therapeutic Design
- ICML 2025Active Evaluation Acquisition for Efficient LLM Benchmarking
- ICLR 2025$F^3Set$: Towards Analyzing Fast, Frequent, and Fine-grained Events from Videos
- CVPR 20253D-GRAND: A Million-Scale Dataset for 3D-LLMs with Better Grounding and Less Hallucination
- NeurIPS 2024A Benchmark Dataset for Event-Guided Human Pose Estimation and Tracking in Extreme Conditions
- ICML 2024A connection between Tempering and Entropic Mirror Descent
- ICLR 2024A Benchmark Study on Calibration
- CVPR 2024Data Valuation and Detections in Federated Learning
- NeurIPS 2023$\mathbf{\mathbb{E}^{FWI}}$: Multiparameter Benchmark Datasets for Elastic Full Waveform Inversion of Geophysical Properties
- ICML 2023A Picture of the Space of Typical Learnable Tasks
- ICLR 2023$\Lambda$-DARTS: Mitigating Performance Collapse by Harmonizing Operation Selection among Cells
- CVPR 2023A Bag-of-Prototypes Representation for Dataset-Level Applications
- NeurIPS 2026A Theoretical Bridge Between Long-Tailed Recognition and Continual Learning
- ICML 2026A Semantically Consistent Dataset for Data-Efficient Query-Based Universal Sound Separation
- ICLR 2026A Fictional Q&A Dataset for Studying Memorization and Knowledge Acquisition
- CVPR 2026Advancing Cancer Prognosis with Hierarchical Fusion of Genomic Proteomic and
All Datasets and Benchmarks papers
5,852 papers, page 96 of 118
- NeurIPS 2024On the Stability and Generalization of Meta-Learning
- NeurIPS 2024On-Road Object Importance Estimation: A New Dataset and A Model with Multi-Fold Top-Down Guidance
- NeurIPS 2024OpenDebateEvidence: A Massive-Scale Argument Mining and Summarization Dataset
- NeurIPS 2024OpenMathInstruct-1: A 1.8 Million Math Instruction Tuning Dataset
- NeurIPS 2024OpenSatMap: A Fine-grained High-resolution Satellite Dataset for Large-scale Map Construction
- NeurIPS 2024OVT-B: A New Large-Scale Benchmark for Open-Vocabulary Multi-Object Tracking
- NeurIPS 2024Paloma: A Benchmark for Evaluating Language Model Fit
- NeurIPS 2024PEACE: A Dataset of Pharmaceutical Care for Cancer Pain Analgesia Evaluation and Medication Decision
- NeurIPS 2024Pedestrian Trajectory Prediction with Missing Data: Datasets, Imputation, and Benchmarking
- NeurIPS 2024Pedestrian-Centric 3D Pre-collision Pose and Shape Estimation from Dashcam Perspective
- NeurIPS 2024PersonalSum: A User-Subjective Guided Personalized Summarization Dataset for Large Language Models
- NeurIPS 2024Piecewise-Stationary Bandits with Knapsacks
- NeurIPS 2024Post-Hoc Reversal: Are We Selecting Models Prematurely?
- NeurIPS 2024PowerGraph: A power grid benchmark dataset for graph neural networks
- NeurIPS 2024Predictor-Corrector Enhanced Transformers with Exponential Moving Average Coefficient Learning
- NeurIPS 2024Pretraining with Random Noise for Fast and Robust Learning without Weight Transport
- NeurIPS 2024Pricing and Competition for Generative AI
- NeurIPS 2024Prism: A Framework for Decoupling and Assessing the Capabilities of VLMs
- NeurIPS 2024Private and Personalized Frequency Estimation in a Federated Setting
- NeurIPS 2024Probabilistic Federated Prompt-Tuning with Non-IID and Imbalanced Data
- NeurIPS 2024ProgressGym: Alignment with a Millennium of Moral Progress
- NeurIPS 2024Progressive Entropic Optimal Transport Solvers
- NeurIPS 2024PROSPECT PTMs: Rich Labeled Tandem Mass Spectrometry Dataset of Modified Peptides for Machine Learning in Proteomics
- NeurIPS 2024Provable and Efficient Dataset Distillation for Kernel Ridge Regression
- NeurIPS 2024Provable Posterior Sampling with Denoising Oracles via Tilted Transport
- NeurIPS 2024Provable Tempered Overfitting of Minimal Nets and Typical Nets
- NeurIPS 2024QKFormer: Hierarchical Spiking Transformer using Q-K Attention
- NeurIPS 2024Quantifying and Optimizing Global Faithfulness in Persona-driven Role-playing
- NeurIPS 2024Quantifying the Bitter Lesson: How Safety Benchmarks Measure Capabilities Instead of Safety
- NeurIPS 2024QUEST: Quadruple Multimodal Contrastive Learning with Constraints and Self-Penalization
- NeurIPS 2024Re-assembling the past: The RePAIR dataset and benchmark for real world 2D and 3D puzzle solving
- NeurIPS 2024RealMAN: A Real-Recorded and Annotated Microphone Array Dataset for Dynamic Speech Enhancement and Localization
- NeurIPS 2024Reasons and Solutions for the Decline in Model Performance after Editing
- NeurIPS 2024Recovering Complete Actions for Cross-dataset Skeleton Action Recognition
- NeurIPS 2024RedPajama: an Open Dataset for Training Large Language Models
- NeurIPS 2024RegExplainer: Generating Explanations for Graph Neural Networks in Regression Tasks
- NeurIPS 2024ReMI: A Dataset for Reasoning with Multiple Images
- NeurIPS 2024Renovating Names in Open-Vocabulary Segmentation Benchmarks
- NeurIPS 2024Replay-and-Forget-Free Graph Class-Incremental Learning: A Task Profiling and Prompting Approach
- NeurIPS 2024Replicability in Learning: Geometric Partitions and KKM-Sperner Lemma
- NeurIPS 2024RepLiQA: A Question-Answering Dataset for Benchmarking LLMs on Unseen Reference Content
- NeurIPS 2024Rethinking Memory and Communication Costs for Efficient Data Parallel Training of Large Language Models
- NeurIPS 2024Rethinking Model-based, Policy-based, and Value-based Reinforcement Learning via the Lens of Representation Complexity
- NeurIPS 2024Rethinking No-reference Image Exposure Assessment from Holism to Pixel: Models, Datasets and Benchmarks
- NeurIPS 2024Rethinking Optimal Transport in Offline Reinforcement Learning
- NeurIPS 2024Rethinking the Evaluation of Out-of-Distribution Detection: A Sorites Paradox
- NeurIPS 2024Safe and Efficient: A Primal-Dual Method for Offline Convex CMDPs under Partial Data Coverage
- NeurIPS 2024Safe and Sparse Newton Method for Entropic-Regularized Optimal Transport
- NeurIPS 2024SAFE: Slow and Fast Parameter-Efficient Tuning for Continual Learning with Pre-Trained Models
- NeurIPS 2024Safetywashing: Do AI Safety Benchmarks Actually Measure Safety Progress?
Ask about this trend from Claude or Cursor
Connect the Paperlist MCP and your assistant can pull the numbers on this page while you draft a survey, pick a direction or plan a submission: papers per year and venue, growth, the fastest-rising sub-themes and representative papers, shaped around your question.
Copy this prompt into your assistant
Use paperlist to show how Datasets and Benchmarks papers grew at NeurIPS from 2023 to 2026, and which year jumped the most.
Tool the assistant calls: get_topic_stats {"topic": "dataset-and-benchmarks"}
Set up Paperlist MCP in two minutes (Claude Code, Cursor, Codex, ChatGPT)
FAQ
- How many Datasets and Benchmarks papers were published at NeurIPS, ICLR, ICML and CVPR from 2023 to 2026?
- 5,856 in total: 937 in 2023, 1,346 in 2024, 1,582 in 2025, 1,991 in 2026.
- How many Datasets and Benchmarks papers are at NeurIPS 2026?
- NeurIPS 2026 has 623 Datasets and Benchmarks papers, versus 637 the year before.
- How many Datasets and Benchmarks papers are at ICLR 2026?
- ICLR 2026 has 635 Datasets and Benchmarks papers, versus 419 the year before.
- How many Datasets and Benchmarks papers are at ICML 2026?
- ICML 2026 has 275 Datasets and Benchmarks papers, versus 189 the year before.
- How many Datasets and Benchmarks papers are at CVPR 2026?
- CVPR 2026 has 458 Datasets and Benchmarks papers, versus 337 the year before.
- Which conference publishes the most Datasets and Benchmarks papers?
- NeurIPS, with 1,935 papers from 2023 to 2026.