Datasets and Benchmarks papers, 2023–2026

Key findings

• Datasets and Benchmarks went from 937 papers in 2023 to 1,991 in 2026, roughly 2.1x in three years.
• NeurIPS publishes the most Datasets and Benchmarks work: 1,935 papers from 2023 to 2026, 33% of the four-venue total.
• The fastest-growing overlap is with AI Agents: papers tagged with both rose from 8 in 2023 to 194 in 2026.
• Among the 5 topics under Efficiency and Systems, it ranks #1 by 2026 paper count; the fastest grower in the group, Hardware-Aware ML, is up 4.4x versus 2.1x here.

Representative papers

Spread across years and venues so every edition shows up

• NeurIPS 2026A Surrogate Perspective on Convergence of Fixed-Target DQN
• ICML 2026$\mu$pscaling small models: Principled warm starts and hyperparameter transfer
• ICLR 2026**TandemFoilSet**: Datasets for Flow Field Prediction of Tandem-Airfoil Through the Reuse of Single Airfoils
• CVPR 20264DEquine Disentangling Motion and Appearance for 4D Equine Reconstruction from
• NeurIPS 2025A Dataset for Distilling Knowledge Priors from Literature for Therapeutic Design
• ICML 2025Active Evaluation Acquisition for Efficient LLM Benchmarking
• ICLR 2025$F^3Set$: Towards Analyzing Fast, Frequent, and Fine-grained Events from Videos
• CVPR 20253D-GRAND: A Million-Scale Dataset for 3D-LLMs with Better Grounding and Less Hallucination
• NeurIPS 2024A Benchmark Dataset for Event-Guided Human Pose Estimation and Tracking in Extreme Conditions
• ICML 2024A connection between Tempering and Entropic Mirror Descent
• ICLR 2024A Benchmark Study on Calibration
• CVPR 2024Data Valuation and Detections in Federated Learning
• NeurIPS 2023$\mathbf{\mathbb{E}^{FWI}}$: Multiparameter Benchmark Datasets for Elastic Full Waveform Inversion of Geophysical Properties
• ICML 2023A Picture of the Space of Typical Learnable Tasks
• ICLR 2023$\Lambda$-DARTS: Mitigating Performance Collapse by Harmonizing Operation Selection among Cells
• CVPR 2023A Bag-of-Prototypes Representation for Dataset-Level Applications
• NeurIPS 2026A Theoretical Bridge Between Long-Tailed Recognition and Continual Learning
• ICML 2026A Semantically Consistent Dataset for Data-Efficient Query-Based Universal Sound Separation
• ICLR 2026A Fictional Q&A Dataset for Studying Memorization and Knowledge Acquisition
• CVPR 2026Advancing Cancer Prognosis with Hierarchical Fusion of Genomic Proteomic and

All Datasets and Benchmarks papers

1,987 papers, page 17 of 40

801. ICLR 2026MCIF: Multimodal Crosslingual Instruction-Following Benchmark from Scientific Talks
802. ICLR 2026MCP Security Bench (MSB): Benchmarking Attacks Against Model Context Protocol in LLM Agents
803. ICLR 2026MCP-Bench: Benchmarking Tool-Using LLM Agents with Complex Real-World Tasks via MCP Servers
804. ICLR 2026MCP-SafetyBench: A Benchmark for Safety Evaluation of Large Language Models with Real-World MCP Servers
805. ICLR 2026MCPMark: A Benchmark for Stress-Testing Realistic and Comprehensive MCP Use
806. ICLR 2026Measuring LLM Novelty As The Frontier Of Original And High-Quality Output
807. ICLR 2026Measuring Uncertainty Calibration
808. ICLR 2026MedAraBench: Large-scale Arabic Medical Question Answering Dataset and Benchmark
809. ICLR 2026Medical thinking with multiple images
810. ICLR 2026MedLesionVQA: A Multimodal Benchmark Emulating Clinical Visual Diagnosis for Body Surface Health
811. ICLR 2026MIMIC-Bench: Exploring the User-Like Thinking and Mimicking Capabilities of Multimodal Large Language Models
812. ICLR 2026Minimax Sample Complexity of Graph Neural Networks: Lower Bounds and Structural Effects
813. ICLR 2026Mix-Ecom: Towards Mixed-Type E-Commerce Dialogues with Complex Domain Rules
814. ICLR 2026Mixed-Curvature Tree-Sliced Wasserstein Distance
815. ICLR 2026MLE-Smith: Scaling MLE Tasks with Automated Multi-agent Pipeline
816. ICLR 2026MME-Unify: A Comprehensive Benchmark for Unified Multimodal Understanding and Generation Models
817. ICLR 2026MMR-Life: Piecing Together Real-life Scenes for Multimodal Multi-image Reasoning
818. ICLR 2026MMR-V: What's Left Unsaid? A Benchmark for Multimodal Deep Reasoning in Videos
819. ICLR 2026MMSI-Bench: A Benchmark for Multi-Image Spatial Intelligence
820. ICLR 2026MMSU: A Massive Multi-task Spoken Language Understanding and Reasoning Benchmark
821. ICLR 2026MnemoDyn: Learning Resting State Dynamics from $40$K FMRI sequences
822. ICLR 2026MolecularIQ: Characterizing Chemical Reasoning Capabilities Through Symbolic Verification on Molecular Graphs
823. ICLR 2026MolLangBench: A Comprehensive Benchmark for Language-Prompted Molecular Structure Recognition, Editing, and Generation
824. ICLR 2026Monocular Normal Estimation via Shading Sequence Estimation
825. ICLR 2026MoReBench: Evaluating Procedural and Pluralistic Moral Reasoning in Language Models, More than Outcomes
826. ICLR 2026Moving Beyond Medical Exams: A Clinician-Annotated Fairness Dataset of Real-World Tasks and Ambiguity in Mental Healthcare
827. ICLR 2026MRMR: A Realistic and Expert-Level Multidisciplinary Benchmark for Reasoning-Intensive Multimodal Retrieval
828. ICLR 2026Multi-LCB: Extending LiveCodeBench to Multiple Programming Languages
829. ICLR 2026Multi-modal Data Spectrum: Multi-modal Datasets are Multi-dimensional
830. ICLR 2026Multilingual Routing in Mixture-of-Experts
831. ICLR 2026Multimodal Dataset Distillation via Phased Teacher Models
832. ICLR 2026NarrLV: Towards a Comprehensive Narrative-Centric Evaluation for Long Video Generation
833. ICLR 2026Natural Identifiers for Privacy and Data Audits in Large Language Models
834. ICLR 2026NC-Bench and NCfold: A Benchmark and Closed-Loop Framework for RNA Non-Canonical Base-Pair Prediction
835. ICLR 2026Negative Pre-activations Differentiate Syntax
836. ICLR 2026Nemotron-CC-Math: A 133 Billion-Token-Scale High Quality Math Pretraining Dataset
837. ICLR 2026NetArena: Dynamically Generated LLM Benchmarks for Network Applications
838. ICLR 2026Neural Sum-of-Squares: Certifying the Nonnegativity of Polynomials with Transformers
839. ICLR 2026Neural Theorem Proving for Verification Conditions: A Real-World Benchmark
840. ICLR 2026NewtonBench: Benchmarking Generalizable Scientific Law Discovery in LLM Agents
841. ICLR 2026Noise-Aware Generalization: Robustness to In-Domain Noise and Out-of-Domain Generalization
842. ICLR 2026Non-Collaborative User Simulators for Tool Agents
843. ICLR 2026Nonparametric Teaching of Attention Learners
844. ICLR 2026NurValues: Real-World Nursing Values Evaluation for Large Language Models in Clinical Context
845. ICLR 2026OD$^3$: Optimization-free Dataset Distillation for Object Detection
846. ICLR 2026ODI-Bench: Can MLLMs Understand Immersive Omnidirectional Environments?
847. ICLR 2026Omni-iEEG: A Large-Scale, Comprehensive iEEG Dataset and Benchmark for Epilepsy Research
848. ICLR 2026OmniSpatial: Towards Comprehensive Spatial Reasoning Benchmark for Vision Language Models
849. ICLR 2026OmniSTVG: Toward Spatio-Temporal Omni-Object Video Grounding
850. ICLR 2026OmniWorld: A Multi-Domain and Multi-Modal Dataset for 4D World Modeling

FAQ

How many Datasets and Benchmarks papers were published at NeurIPS, ICLR, ICML and CVPR from 2023 to 2026?

5,856 in total: 937 in 2023, 1,346 in 2024, 1,582 in 2025, 1,991 in 2026.

How many Datasets and Benchmarks papers are at NeurIPS 2026?

NeurIPS 2026 has 623 Datasets and Benchmarks papers, versus 637 the year before.

How many Datasets and Benchmarks papers are at ICLR 2026?

ICLR 2026 has 635 Datasets and Benchmarks papers, versus 419 the year before.

How many Datasets and Benchmarks papers are at ICML 2026?

ICML 2026 has 275 Datasets and Benchmarks papers, versus 189 the year before.

How many Datasets and Benchmarks papers are at CVPR 2026?

CVPR 2026 has 458 Datasets and Benchmarks papers, versus 337 the year before.

Which conference publishes the most Datasets and Benchmarks papers?

NeurIPS, with 1,935 papers from 2023 to 2026.