Datasets and Benchmarks papers, 2023–2026
New datasets and evaluation protocols
Scope: NeurIPS, ICLR, ICML and CVPR, 2023–2026. 5,856 papers are tagged with this topic.
Key findings
- Datasets and Benchmarks went from 937 papers in 2023 to 1,991 in 2026, roughly 2.1x in three years.
- NeurIPS publishes the most Datasets and Benchmarks work: 1,935 papers from 2023 to 2026, 33% of the four-venue total.
- The fastest-growing overlap is with AI Agents: papers tagged with both rose from 8 in 2023 to 194 in 2026.
- Among the 5 topics under Efficiency and Systems, it ranks #1 by 2026 paper count; the fastest grower in the group, Hardware-Aware ML, is up 4.4x versus 2.1x here.
Papers per venue
Counts by year and venue
| Year | NeurIPS | ICLR | ICML | CVPR | Total |
|---|---|---|---|---|---|
| 2023 | 227 | 162 | 166 | 382 | 937 |
| 2024 | 448 | 216 | 318 | 364 | 1,346 |
| 2025 | 637 | 419 | 189 | 337 | 1,582 |
| 2026 | 623 | 635 | 275 | 458 | 1,991 |
Representative papers
Spread across years and venues so every edition shows up
- NeurIPS 2026A Surrogate Perspective on Convergence of Fixed-Target DQN
- ICML 2026$\mu$pscaling small models: Principled warm starts and hyperparameter transfer
- ICLR 2026**TandemFoilSet**: Datasets for Flow Field Prediction of Tandem-Airfoil Through the Reuse of Single Airfoils
- CVPR 20264DEquine Disentangling Motion and Appearance for 4D Equine Reconstruction from
- NeurIPS 2025A Dataset for Distilling Knowledge Priors from Literature for Therapeutic Design
- ICML 2025Active Evaluation Acquisition for Efficient LLM Benchmarking
- ICLR 2025$F^3Set$: Towards Analyzing Fast, Frequent, and Fine-grained Events from Videos
- CVPR 20253D-GRAND: A Million-Scale Dataset for 3D-LLMs with Better Grounding and Less Hallucination
- NeurIPS 2024A Benchmark Dataset for Event-Guided Human Pose Estimation and Tracking in Extreme Conditions
- ICML 2024A connection between Tempering and Entropic Mirror Descent
- ICLR 2024A Benchmark Study on Calibration
- CVPR 2024Data Valuation and Detections in Federated Learning
- NeurIPS 2023$\mathbf{\mathbb{E}^{FWI}}$: Multiparameter Benchmark Datasets for Elastic Full Waveform Inversion of Geophysical Properties
- ICML 2023A Picture of the Space of Typical Learnable Tasks
- ICLR 2023$\Lambda$-DARTS: Mitigating Performance Collapse by Harmonizing Operation Selection among Cells
- CVPR 2023A Bag-of-Prototypes Representation for Dataset-Level Applications
- NeurIPS 2026A Theoretical Bridge Between Long-Tailed Recognition and Continual Learning
- ICML 2026A Semantically Consistent Dataset for Data-Efficient Query-Based Universal Sound Separation
- ICLR 2026A Fictional Q&A Dataset for Studying Memorization and Knowledge Acquisition
- CVPR 2026Advancing Cancer Prognosis with Hierarchical Fusion of Genomic Proteomic and
All Datasets and Benchmarks papers
419 papers, page 5 of 9
- ICLR 2025KOR-Bench: Benchmarking Language Models on Knowledge-Orthogonal Reasoning Tasks
- ICLR 2025LaGeM: A Large Geometry Model for 3D Representation Learning and Diffusion
- ICLR 2025Language Model Alignment in Multilingual Trolley Problems
- ICLR 2025Language Models Learn to Mislead Humans via RLHF
- ICLR 2025Language Representations Can be What Recommenders Need: Findings and Potentials
- ICLR 2025Large Language Models Often Say One Thing and Do Another
- ICLR 2025Law of the Weakest Link: Cross Capabilities of Large Language Models
- ICLR 2025Lawma: The Power of Specialization for Legal Annotation
- ICLR 2025Learning Color Equivariant Representations
- ICLR 2025Learning Continually by Spectral Regularization
- ICLR 2025Learning Interleaved Image-Text Comprehension in Vision-Language Large Models
- ICLR 2025Learning Splitting Heuristics in Divide-and-Conquer SAT Solvers with Reinforcement Learning
- ICLR 2025LiveCodeBench: Holistic and Contamination Free Evaluation of Large Language Models for Code
- ICLR 2025LiveXiv - A Multi-Modal live benchmark based on Arxiv papers content
- ICLR 2025LLaMaFlex: Many-in-one LLMs via Generalized Pruning and Weight Sharing
- ICLR 2025LLaVA-Interleave: Tackling Multi-image, Video, and 3D in Large Multimodal Models
- ICLR 2025LocoVR: Multiuser Indoor Locomotion Dataset in Virtual Reality
- ICLR 2025LOKI: A Comprehensive Synthetic Data Detection Benchmark using Large Multimodal Models
- ICLR 2025LoRanPAC: Low-rank Random Features and Pre-trained Models for Bridging Theory and Practice in Continual Learning
- ICLR 2025Magpie: Alignment Data Synthesis from Scratch by Prompting Aligned LLMs with Nothing
- ICLR 2025ManiSkill-HAB: A Benchmark for Low-Level Manipulation in Home Rearrangement Tasks
- ICLR 2025MANTRA: The Manifold Triangulations Assemblage
- ICLR 2025Mask-DPO: Generalizable Fine-grained Factuality Alignment of LLMs
- ICLR 2025Matryoshka Multimodal Models
- ICLR 2025McEval: Massively Multilingual Code Evaluation
- ICLR 2025MediConfusion: Can you trust your AI radiologist? Probing the reliability of multimodal medical foundation models
- ICLR 2025Medium-Difficulty Samples Constitute Smoothed Decision Boundary for Knowledge Distillation on Pruned Datasets
- ICLR 2025MedTrinity-25M: A Large-scale Multimodal Dataset with Multigranular Annotations for Medicine
- ICLR 2025MEGA-Bench: Scaling Multimodal Evaluation to over 500 Real-World Tasks
- ICLR 2025metabench - A Sparse Benchmark of Reasoning and Knowledge in Large Language Models
- ICLR 2025MetaOOD: Automatic Selection of OOD Detection Models
- ICLR 2025MetaUrban: An Embodied AI Simulation Platform for Urban Micromobility
- ICLR 2025MIA-Bench: Towards Better Instruction Following Evaluation of Multimodal LLMs
- ICLR 2025miniCTX: Neural Theorem Proving with (Long-)Contexts
- ICLR 2025Mitigating Memorization in Language Models
- ICLR 2025MixEval-X: Any-to-any Evaluations from Real-world Data Mixture
- ICLR 2025Mixture of In-Context Prompters for Tabular PFNs
- ICLR 2025MLE-bench: Evaluating Machine Learning Agents on Machine Learning Engineering
- ICLR 2025MMAD: A Comprehensive Benchmark for Multimodal Large Language Models in Industrial Anomaly Detection
- ICLR 2025MMAU: A Massive Multi-Task Audio Understanding and Reasoning Benchmark
- ICLR 2025MMDT: Decoding the Trustworthiness and Safety of Multimodal Foundation Models
- ICLR 2025MMIE: Massive Multimodal Interleaved Comprehension Benchmark for Large Vision-Language Models
- ICLR 2025MMIU: Multimodal Multi-image Understanding for Evaluating Large Vision-Language Models
- ICLR 2025MMKE-Bench: A Multimodal Editing Benchmark for Diverse Visual Knowledge
- ICLR 2025MMQA: Evaluating LLMs with Multi-Table Multi-Hop Complex Questions
- ICLR 2025MMR: A Large-scale Benchmark Dataset for Multi-target and Multi-granularity Reasoning Segmentation
- ICLR 2025MMRole: A Comprehensive Framework for Developing and Evaluating Multimodal Role-Playing Agents
- ICLR 2025MMTEB: Massive Multilingual Text Embedding Benchmark
- ICLR 2025MMWorld: Towards Multi-discipline Multi-faceted World Model Evaluation in Videos
- ICLR 2025MotherNet: Fast Training and Inference via Hyper-Network Transformers
Ask about this trend from Claude or Cursor
Connect the Paperlist MCP and your assistant can pull the numbers on this page while you draft a survey, pick a direction or plan a submission: papers per year and venue, growth, the fastest-rising sub-themes and representative papers, shaped around your question.
Copy this prompt into your assistant
Use paperlist to show how Datasets and Benchmarks papers grew at NeurIPS from 2023 to 2026, and which year jumped the most.
Tool the assistant calls: get_topic_stats {"topic": "dataset-and-benchmarks"}
Set up Paperlist MCP in two minutes (Claude Code, Cursor, Codex, ChatGPT)
FAQ
- How many Datasets and Benchmarks papers were published at NeurIPS, ICLR, ICML and CVPR from 2023 to 2026?
- 5,856 in total: 937 in 2023, 1,346 in 2024, 1,582 in 2025, 1,991 in 2026.
- How many Datasets and Benchmarks papers are at NeurIPS 2026?
- NeurIPS 2026 has 623 Datasets and Benchmarks papers, versus 637 the year before.
- How many Datasets and Benchmarks papers are at ICLR 2026?
- ICLR 2026 has 635 Datasets and Benchmarks papers, versus 419 the year before.
- How many Datasets and Benchmarks papers are at ICML 2026?
- ICML 2026 has 275 Datasets and Benchmarks papers, versus 189 the year before.
- How many Datasets and Benchmarks papers are at CVPR 2026?
- CVPR 2026 has 458 Datasets and Benchmarks papers, versus 337 the year before.
- Which conference publishes the most Datasets and Benchmarks papers?
- NeurIPS, with 1,935 papers from 2023 to 2026.