Datasets and Benchmarks papers, 2023–2026

Key findings

• Datasets and Benchmarks went from 937 papers in 2023 to 1,991 in 2026, roughly 2.1x in three years.
• NeurIPS publishes the most Datasets and Benchmarks work: 1,935 papers from 2023 to 2026, 33% of the four-venue total.
• The fastest-growing overlap is with AI Agents: papers tagged with both rose from 8 in 2023 to 194 in 2026.
• Among the 5 topics under Efficiency and Systems, it ranks #1 by 2026 paper count; the fastest grower in the group, Hardware-Aware ML, is up 4.4x versus 2.1x here.

Representative papers

Spread across years and venues so every edition shows up

• NeurIPS 2026A Surrogate Perspective on Convergence of Fixed-Target DQN
• ICML 2026$\mu$pscaling small models: Principled warm starts and hyperparameter transfer
• ICLR 2026**TandemFoilSet**: Datasets for Flow Field Prediction of Tandem-Airfoil Through the Reuse of Single Airfoils
• CVPR 20264DEquine Disentangling Motion and Appearance for 4D Equine Reconstruction from
• NeurIPS 2025A Dataset for Distilling Knowledge Priors from Literature for Therapeutic Design
• ICML 2025Active Evaluation Acquisition for Efficient LLM Benchmarking
• ICLR 2025$F^3Set$: Towards Analyzing Fast, Frequent, and Fine-grained Events from Videos
• CVPR 20253D-GRAND: A Million-Scale Dataset for 3D-LLMs with Better Grounding and Less Hallucination
• NeurIPS 2024A Benchmark Dataset for Event-Guided Human Pose Estimation and Tracking in Extreme Conditions
• ICML 2024A connection between Tempering and Entropic Mirror Descent
• ICLR 2024A Benchmark Study on Calibration
• CVPR 2024Data Valuation and Detections in Federated Learning
• NeurIPS 2023$\mathbf{\mathbb{E}^{FWI}}$: Multiparameter Benchmark Datasets for Elastic Full Waveform Inversion of Geophysical Properties
• ICML 2023A Picture of the Space of Typical Learnable Tasks
• ICLR 2023$\Lambda$-DARTS: Mitigating Performance Collapse by Harmonizing Operation Selection among Cells
• CVPR 2023A Bag-of-Prototypes Representation for Dataset-Level Applications
• NeurIPS 2026A Theoretical Bridge Between Long-Tailed Recognition and Continual Learning
• ICML 2026A Semantically Consistent Dataset for Data-Efficient Query-Based Universal Sound Separation
• ICLR 2026A Fictional Q&A Dataset for Studying Memorization and Knowledge Acquisition
• CVPR 2026Advancing Cancer Prognosis with Hierarchical Fusion of Genomic Proteomic and

All Datasets and Benchmarks papers

1,582 papers, page 12 of 32

551. ICLR 2025LiveXiv - A Multi-Modal live benchmark based on Arxiv papers content
552. ICLR 2025LLaMaFlex: Many-in-one LLMs via Generalized Pruning and Weight Sharing
553. ICLR 2025LLaVA-Interleave: Tackling Multi-image, Video, and 3D in Large Multimodal Models
554. ICLR 2025LocoVR: Multiuser Indoor Locomotion Dataset in Virtual Reality
555. ICLR 2025LOKI: A Comprehensive Synthetic Data Detection Benchmark using Large Multimodal Models
556. ICLR 2025LoRanPAC: Low-rank Random Features and Pre-trained Models for Bridging Theory and Practice in Continual Learning
557. ICLR 2025Magpie: Alignment Data Synthesis from Scratch by Prompting Aligned LLMs with Nothing
558. ICLR 2025ManiSkill-HAB: A Benchmark for Low-Level Manipulation in Home Rearrangement Tasks
559. ICLR 2025MANTRA: The Manifold Triangulations Assemblage
560. ICLR 2025Mask-DPO: Generalizable Fine-grained Factuality Alignment of LLMs
561. ICLR 2025Matryoshka Multimodal Models
562. ICLR 2025McEval: Massively Multilingual Code Evaluation
563. ICLR 2025MediConfusion: Can you trust your AI radiologist? Probing the reliability of multimodal medical foundation models
564. ICLR 2025Medium-Difficulty Samples Constitute Smoothed Decision Boundary for Knowledge Distillation on Pruned Datasets
565. ICLR 2025MedTrinity-25M: A Large-scale Multimodal Dataset with Multigranular Annotations for Medicine
566. ICLR 2025MEGA-Bench: Scaling Multimodal Evaluation to over 500 Real-World Tasks
567. ICLR 2025metabench - A Sparse Benchmark of Reasoning and Knowledge in Large Language Models
568. ICLR 2025MetaOOD: Automatic Selection of OOD Detection Models
569. ICLR 2025MetaUrban: An Embodied AI Simulation Platform for Urban Micromobility
570. ICLR 2025MIA-Bench: Towards Better Instruction Following Evaluation of Multimodal LLMs
571. ICLR 2025miniCTX: Neural Theorem Proving with (Long-)Contexts
572. ICLR 2025Mitigating Memorization in Language Models
573. ICLR 2025MixEval-X: Any-to-any Evaluations from Real-world Data Mixture
574. ICLR 2025Mixture of In-Context Prompters for Tabular PFNs
575. ICLR 2025MLE-bench: Evaluating Machine Learning Agents on Machine Learning Engineering
576. ICLR 2025MMAD: A Comprehensive Benchmark for Multimodal Large Language Models in Industrial Anomaly Detection
577. ICLR 2025MMAU: A Massive Multi-Task Audio Understanding and Reasoning Benchmark
578. ICLR 2025MMDT: Decoding the Trustworthiness and Safety of Multimodal Foundation Models
579. ICLR 2025MMIE: Massive Multimodal Interleaved Comprehension Benchmark for Large Vision-Language Models
580. ICLR 2025MMIU: Multimodal Multi-image Understanding for Evaluating Large Vision-Language Models
581. ICLR 2025MMKE-Bench: A Multimodal Editing Benchmark for Diverse Visual Knowledge
582. ICLR 2025MMQA: Evaluating LLMs with Multi-Table Multi-Hop Complex Questions
583. ICLR 2025MMR: A Large-scale Benchmark Dataset for Multi-target and Multi-granularity Reasoning Segmentation
584. ICLR 2025MMRole: A Comprehensive Framework for Developing and Evaluating Multimodal Role-Playing Agents
585. ICLR 2025MMTEB: Massive Multilingual Text Embedding Benchmark
586. ICLR 2025MMWorld: Towards Multi-discipline Multi-faceted World Model Evaluation in Videos
587. ICLR 2025MotherNet: Fast Training and Inference via Hyper-Network Transformers
588. ICLR 2025MQuAKE-Remastered: Multi-Hop Knowledge Editing Can Only Be Advanced with Reliable Evaluations
589. ICLR 2025MR-GSM8K: A Meta-Reasoning Benchmark for Large Language Model Evaluation
590. ICLR 2025MRAG-Bench: Vision-Centric Evaluation for Retrieval-Augmented Multimodal Models
591. ICLR 2025MTU-Bench: A Multi-granularity Tool-Use Benchmark for Large Language Models
592. ICLR 2025MuirBench: A Comprehensive Benchmark for Robust Multi-image Understanding
593. ICLR 2025Multimodal Lego: Model Merging and Fine-Tuning Across Topologies and Modalities in Biomedicine
594. ICLR 2025Multimodal Situational Safety
595. ICLR 2025MUSE: Machine Unlearning Six-Way Evaluation for Language Models
596. ICLR 2025N-ForGOT: Towards Not-forgetting and Generalization of Open Temporal Graph Learning
597. ICLR 2025Needle In A Video Haystack: A Scalable Synthetic Evaluator for Video MLLMs
598. ICLR 2025Neural Causal Graph for Interpretable and Intervenable Classification
599. ICLR 2025Neural networks on Symmetric Spaces of Noncompact Type
600. ICLR 2025New Algorithms for the Learning-Augmented k-means Problem

FAQ

How many Datasets and Benchmarks papers were published at NeurIPS, ICLR, ICML and CVPR from 2023 to 2026?

5,856 in total: 937 in 2023, 1,346 in 2024, 1,582 in 2025, 1,991 in 2026.

How many Datasets and Benchmarks papers are at NeurIPS 2026?

NeurIPS 2026 has 623 Datasets and Benchmarks papers, versus 637 the year before.

How many Datasets and Benchmarks papers are at ICLR 2026?

ICLR 2026 has 635 Datasets and Benchmarks papers, versus 419 the year before.

How many Datasets and Benchmarks papers are at ICML 2026?

ICML 2026 has 275 Datasets and Benchmarks papers, versus 189 the year before.

How many Datasets and Benchmarks papers are at CVPR 2026?

CVPR 2026 has 458 Datasets and Benchmarks papers, versus 337 the year before.

Which conference publishes the most Datasets and Benchmarks papers?

NeurIPS, with 1,935 papers from 2023 to 2026.