Datasets and Benchmarks papers, 2023–2026

New datasets and evaluation protocols

Scope: NeurIPS, ICLR, ICML and CVPR, 2023–2026. 5,856 papers are tagged with this topic.

Key findings

Papers per year

Papers per venue

Counts by year and venue

Datasets and Benchmarks papers by year and venue
YearNeurIPSICLRICMLCVPRTotal
2023227162166382937
20244482163183641,346
20256374191893371,582
20266236352754581,991

Representative papers

Spread across years and venues so every edition shows up

All Datasets and Benchmarks papers

948 papers, page 9 of 19

  1. ICML 2025Position: In-House Evaluation Is Not Enough. Towards Robust Third-Party Evaluation and Flaw Disclosure for General-Purpose AI
  2. ICML 2025Position: Medical Large Language Model Benchmarks Should Prioritize Construct Validity
  3. ICML 2025Position: Societal Impacts Research Requires Benchmarks for Creative Composition Tasks
  4. ICML 2025Position: Stop treating `AGI' as the north-star goal of AI research
  5. ICML 2025Position: The Categorization of Race in ML is a Flawed Premise
  6. ICML 2025Position: Theory of Mind Benchmarks are Broken for Large Language Models
  7. ICML 2025Position: Truly Self-Improving Agents Require Intrinsic Metacognitive Learning
  8. ICML 2025Positive-unlabeled AUC Maximization under Covariate Shift
  9. ICML 2025Potemkin Understanding in Large Language Models
  10. ICML 2025Predicting the Susceptibility of Examples to Catastrophic Forgetting
  11. ICML 2025Predictive Data Selection: The Data That Predicts Is the Data That Teaches
  12. ICML 2025Prompt-based Depth Pruning of Large Language Models
  13. ICML 2025Protein Structure Tokenization: Benchmarking and New Recipe
  14. ICML 2025QEM-Bench: Benchmarking Learning-based Quantum Error Mitigation and QEMFormer as a Multi-ranged Context Learning Baseline
  15. ICML 2025RAGGED: Towards Informed Design of Scalable and Stable RAG Systems
  16. ICML 2025Reconstructing Cell Lineage Trees from Phenotypic Features with Metric Learning
  17. ICML 2025Regression for the Mean: Auto-Evaluation and Inference with Few Labels through Post-hoc Regression
  18. ICML 2025Reliable and Efficient Amortized Model-based Evaluation
  19. ICML 2025Rényi Neural Processes
  20. ICML 2025Rethinking the Stability-Plasticity Trade-off in Continual Learning from an Architectural Perspective
  21. ICML 2025Robust ML Auditing using Prior Knowledge
  22. ICML 2025Robust Offline Reinforcement Learning with Linearly Structured $f$-Divergence Regularization
  23. ICML 2025ROME is Forged in Adversity: Robust Distilled Datasets via Information Bottleneck
  24. ICML 2025Safe Delta: Consistently Preserving Safety when Fine-Tuning LLMs on Diverse Datasets
  25. ICML 2025Sanity Checking Causal Representation Learning on a Simple Real-World System
  26. ICML 2025Scalable Approximation Algorithms for $p$-Wasserstein Distance and Its Variants
  27. ICML 2025SEFE: Superficial and Essential Forgetting Eliminator for Multimodal Continual Instruction Tuning
  28. ICML 2025Semantic Shift Estimation via Dual-Projection and Classifier Reconstruction for Exemplar-Free Class-Incremental Learning
  29. ICML 2025SIMPLEMIX: Frustratingly Simple Mixing of Off- and On-policy Data in Language Model Preference Learning
  30. ICML 2025SLiM: One-shot Quantization and Sparsity with Low-rank Approximation for LLM Weight Compression
  31. ICML 2025SNS-Bench: Defining, Building, and Assessing Capabilities of Large Language Models in Social Networking Services
  32. ICML 2025Solving Probabilistic Verification Problems of Neural Networks using Branch and Bound
  33. ICML 2025Spurious Correlations in High Dimensional Regression: The Roles of Regularization, Simplicity Bias and Over-Parameterization
  34. ICML 2025Stable Offline Value Function Learning with Bisimulation-based Representations
  35. ICML 2025STAMP Your Content: Proving Dataset Membership via Watermarked Rephrasings
  36. ICML 2025Stochastic Forward–Backward Deconvolution: Training Diffusion Models with Finite Noisy Datasets
  37. ICML 2025TabPFN Unleashed: A Scalable and Effective Solution to Tabular Classification Problems
  38. ICML 2025TabSDS: a Lightweight, Fully Non-Parametric, and Model Free Approach for Generating Synthetic Tabular Data
  39. ICML 2025Taming Diffusion for Dataset Distillation with High Representativeness
  40. ICML 2025TeDS: Joint Learning of Diachronic and Synchronic Perspectives in Quaternion Space for Temporal Knowledge Graph Completion
  41. ICML 2025The Best of Both Worlds: Bridging Quality and Diversity in Data Selection with Bipartite Graph
  42. ICML 2025The Emperor's New Clothes in Benchmarking? A Rigorous Examination of Mitigation Strategies for LLM Benchmark Data Contamination
  43. ICML 2025The Power of Random Features and the Limits of Distribution-Free Gradient Descent
  44. ICML 2025The Price of Freedom: Exploring Expressivity and Runtime Tradeoffs in Equivariant Tensor Products
  45. ICML 2025The Underlying Universal Statistical Structure of Natural Datasets
  46. ICML 2025Three-Dimensional Trajectory Prediction with 3DMoTraj Dataset
  47. ICML 2025Toward Robust Hyper-Detailed Image Captioning: A Multiagent Approach and Dual Evaluation Metrics for Factuality and Coverage
  48. ICML 2025Towards a General Time Series Forecasting Model with Unified Representation and Adaptive Transfer
  49. ICML 2025Training Software Engineering Agents and Verifiers with SWE-Gym
  50. ICML 2025Trajectory World Models for Heterogeneous Environments

Ask about this trend from Claude or Cursor

Connect the Paperlist MCP and your assistant can pull the numbers on this page while you draft a survey, pick a direction or plan a submission: papers per year and venue, growth, the fastest-rising sub-themes and representative papers, shaped around your question.

Copy this prompt into your assistant

Use paperlist to show how Datasets and Benchmarks papers grew at NeurIPS from 2023 to 2026, and which year jumped the most.

Tool the assistant calls: get_topic_stats {"topic": "dataset-and-benchmarks"}

Set up Paperlist MCP in two minutes (Claude Code, Cursor, Codex, ChatGPT)

FAQ

How many Datasets and Benchmarks papers were published at NeurIPS, ICLR, ICML and CVPR from 2023 to 2026?
5,856 in total: 937 in 2023, 1,346 in 2024, 1,582 in 2025, 1,991 in 2026.
How many Datasets and Benchmarks papers are at NeurIPS 2026?
NeurIPS 2026 has 623 Datasets and Benchmarks papers, versus 637 the year before.
How many Datasets and Benchmarks papers are at ICLR 2026?
ICLR 2026 has 635 Datasets and Benchmarks papers, versus 419 the year before.
How many Datasets and Benchmarks papers are at ICML 2026?
ICML 2026 has 275 Datasets and Benchmarks papers, versus 189 the year before.
How many Datasets and Benchmarks papers are at CVPR 2026?
CVPR 2026 has 458 Datasets and Benchmarks papers, versus 337 the year before.
Which conference publishes the most Datasets and Benchmarks papers?
NeurIPS, with 1,935 papers from 2023 to 2026.

More in Efficiency and Systems