Datasets and Benchmarks papers, 2023–2026

New datasets and evaluation protocols

Scope: NeurIPS, ICLR, ICML and CVPR, 2023–2026. 5,856 papers are tagged with this topic.

Key findings

Papers per year

Papers per venue

Counts by year and venue

Datasets and Benchmarks papers by year and venue
YearNeurIPSICLRICMLCVPRTotal
2023227162166382937
20244482163183641,346
20256374191893371,582
20266236352754581,991

Representative papers

Spread across years and venues so every edition shows up

All Datasets and Benchmarks papers

5,852 papers, page 17 of 118

  1. ICLR 2026MCIF: Multimodal Crosslingual Instruction-Following Benchmark from Scientific Talks
  2. ICLR 2026MCP Security Bench (MSB): Benchmarking Attacks Against Model Context Protocol in LLM Agents
  3. ICLR 2026MCP-Bench: Benchmarking Tool-Using LLM Agents with Complex Real-World Tasks via MCP Servers
  4. ICLR 2026MCP-SafetyBench: A Benchmark for Safety Evaluation of Large Language Models with Real-World MCP Servers
  5. ICLR 2026MCPMark: A Benchmark for Stress-Testing Realistic and Comprehensive MCP Use
  6. ICLR 2026Measuring LLM Novelty As The Frontier Of Original And High-Quality Output
  7. ICLR 2026Measuring Uncertainty Calibration
  8. ICLR 2026MedAraBench: Large-scale Arabic Medical Question Answering Dataset and Benchmark
  9. ICLR 2026Medical thinking with multiple images
  10. ICLR 2026MedLesionVQA: A Multimodal Benchmark Emulating Clinical Visual Diagnosis for Body Surface Health
  11. ICLR 2026MIMIC-Bench: Exploring the User-Like Thinking and Mimicking Capabilities of Multimodal Large Language Models
  12. ICLR 2026Minimax Sample Complexity of Graph Neural Networks: Lower Bounds and Structural Effects
  13. ICLR 2026Mix-Ecom: Towards Mixed-Type E-Commerce Dialogues with Complex Domain Rules
  14. ICLR 2026Mixed-Curvature Tree-Sliced Wasserstein Distance
  15. ICLR 2026MLE-Smith: Scaling MLE Tasks with Automated Multi-agent Pipeline
  16. ICLR 2026MME-Unify: A Comprehensive Benchmark for Unified Multimodal Understanding and Generation Models
  17. ICLR 2026MMR-Life: Piecing Together Real-life Scenes for Multimodal Multi-image Reasoning
  18. ICLR 2026MMR-V: What's Left Unsaid? A Benchmark for Multimodal Deep Reasoning in Videos
  19. ICLR 2026MMSI-Bench: A Benchmark for Multi-Image Spatial Intelligence
  20. ICLR 2026MMSU: A Massive Multi-task Spoken Language Understanding and Reasoning Benchmark
  21. ICLR 2026MnemoDyn: Learning Resting State Dynamics from $40$K FMRI sequences
  22. ICLR 2026MolecularIQ: Characterizing Chemical Reasoning Capabilities Through Symbolic Verification on Molecular Graphs
  23. ICLR 2026MolLangBench: A Comprehensive Benchmark for Language-Prompted Molecular Structure Recognition, Editing, and Generation
  24. ICLR 2026Monocular Normal Estimation via Shading Sequence Estimation
  25. ICLR 2026MoReBench: Evaluating Procedural and Pluralistic Moral Reasoning in Language Models, More than Outcomes
  26. ICLR 2026Moving Beyond Medical Exams: A Clinician-Annotated Fairness Dataset of Real-World Tasks and Ambiguity in Mental Healthcare
  27. ICLR 2026MRMR: A Realistic and Expert-Level Multidisciplinary Benchmark for Reasoning-Intensive Multimodal Retrieval
  28. ICLR 2026Multi-LCB: Extending LiveCodeBench to Multiple Programming Languages
  29. ICLR 2026Multi-modal Data Spectrum: Multi-modal Datasets are Multi-dimensional
  30. ICLR 2026Multilingual Routing in Mixture-of-Experts
  31. ICLR 2026Multimodal Dataset Distillation via Phased Teacher Models
  32. ICLR 2026NarrLV: Towards a Comprehensive Narrative-Centric Evaluation for Long Video Generation
  33. ICLR 2026Natural Identifiers for Privacy and Data Audits in Large Language Models
  34. ICLR 2026NC-Bench and NCfold: A Benchmark and Closed-Loop Framework for RNA Non-Canonical Base-Pair Prediction
  35. ICLR 2026Negative Pre-activations Differentiate Syntax
  36. ICLR 2026Nemotron-CC-Math: A 133 Billion-Token-Scale High Quality Math Pretraining Dataset
  37. ICLR 2026NetArena: Dynamically Generated LLM Benchmarks for Network Applications
  38. ICLR 2026Neural Sum-of-Squares: Certifying the Nonnegativity of Polynomials with Transformers
  39. ICLR 2026Neural Theorem Proving for Verification Conditions: A Real-World Benchmark
  40. ICLR 2026NewtonBench: Benchmarking Generalizable Scientific Law Discovery in LLM Agents
  41. ICLR 2026Noise-Aware Generalization: Robustness to In-Domain Noise and Out-of-Domain Generalization
  42. ICLR 2026Non-Collaborative User Simulators for Tool Agents
  43. ICLR 2026Nonparametric Teaching of Attention Learners
  44. ICLR 2026NurValues: Real-World Nursing Values Evaluation for Large Language Models in Clinical Context
  45. ICLR 2026OD$^3$: Optimization-free Dataset Distillation for Object Detection
  46. ICLR 2026ODI-Bench: Can MLLMs Understand Immersive Omnidirectional Environments?
  47. ICLR 2026Omni-iEEG: A Large-Scale, Comprehensive iEEG Dataset and Benchmark for Epilepsy Research
  48. ICLR 2026OmniSpatial: Towards Comprehensive Spatial Reasoning Benchmark for Vision Language Models
  49. ICLR 2026OmniSTVG: Toward Spatio-Temporal Omni-Object Video Grounding
  50. ICLR 2026OmniWorld: A Multi-Domain and Multi-Modal Dataset for 4D World Modeling

Ask about this trend from Claude or Cursor

Connect the Paperlist MCP and your assistant can pull the numbers on this page while you draft a survey, pick a direction or plan a submission: papers per year and venue, growth, the fastest-rising sub-themes and representative papers, shaped around your question.

Copy this prompt into your assistant

Use paperlist to show how Datasets and Benchmarks papers grew at NeurIPS from 2023 to 2026, and which year jumped the most.

Tool the assistant calls: get_topic_stats {"topic": "dataset-and-benchmarks"}

Set up Paperlist MCP in two minutes (Claude Code, Cursor, Codex, ChatGPT)

FAQ

How many Datasets and Benchmarks papers were published at NeurIPS, ICLR, ICML and CVPR from 2023 to 2026?
5,856 in total: 937 in 2023, 1,346 in 2024, 1,582 in 2025, 1,991 in 2026.
How many Datasets and Benchmarks papers are at NeurIPS 2026?
NeurIPS 2026 has 623 Datasets and Benchmarks papers, versus 637 the year before.
How many Datasets and Benchmarks papers are at ICLR 2026?
ICLR 2026 has 635 Datasets and Benchmarks papers, versus 419 the year before.
How many Datasets and Benchmarks papers are at ICML 2026?
ICML 2026 has 275 Datasets and Benchmarks papers, versus 189 the year before.
How many Datasets and Benchmarks papers are at CVPR 2026?
CVPR 2026 has 458 Datasets and Benchmarks papers, versus 337 the year before.
Which conference publishes the most Datasets and Benchmarks papers?
NeurIPS, with 1,935 papers from 2023 to 2026.

More in Efficiency and Systems