Datasets and Benchmarks papers, 2023–2026

New datasets and evaluation protocols

Scope: NeurIPS, ICLR, ICML and CVPR, 2023–2026. 5,856 papers are tagged with this topic.

Key findings

Papers per year

Papers per venue

Counts by year and venue

Datasets and Benchmarks papers by year and venue
YearNeurIPSICLRICMLCVPRTotal
2023227162166382937
20244482163183641,346
20256374191893371,582
20266236352754581,991

Representative papers

Spread across years and venues so every edition shows up

All Datasets and Benchmarks papers

448 papers, page 6 of 9

  1. NeurIPS 2024MmCows: A Multimodal Dataset for Dairy Cattle Monitoring
  2. NeurIPS 2024MMDU: A Multi-Turn Multi-Image Dialog Understanding Benchmark and Instruction-Tuning Dataset for LVLMs
  3. NeurIPS 2024MMLU-Pro: A More Robust and Challenging Multi-Task Language Understanding Benchmark
  4. NeurIPS 2024MMScan: A Multi-Modal 3D Scene Dataset with Hierarchical Grounded Language Annotations
  5. NeurIPS 2024Mobility-LLM: Learning Visiting Intentions and Travel Preference from Human Mobility Data with Large Language Models
  6. NeurIPS 2024Most Influential Subset Selection: Challenges, Promises, and Beyond
  7. NeurIPS 2024Muharaf: Manuscripts of Handwritten Arabic Dataset for Cursive Text Recognition
  8. NeurIPS 2024Multi-Chain Graphs of Graphs: A New Approach to Analyzing Blockchain Datasets
  9. NeurIPS 2024MultiOrg: A Multi-rater Organoid-detection Dataset
  10. NeurIPS 2024MultiTrust: A Comprehensive Benchmark Towards Trustworthy Multimodal Large Language Models
  11. NeurIPS 2024Navigating the Maze of Explainable AI: A Systematic Approach to Evaluating Methods and Metrics
  12. NeurIPS 2024NAVSIM: Data-Driven Non-Reactive Autonomous Vehicle Simulation and Benchmarking
  13. NeurIPS 2024Neural Characteristic Activation Analysis and Geometric Parameterization for ReLU Networks
  14. NeurIPS 2024NewTerm: Benchmarking Real-Time New Terms for Large Language Models with Annual Updates
  15. NeurIPS 2024No Filter: Cultural and Socioeconomic Diversity in Contrastive Vision-Language Models
  16. NeurIPS 2024Noisy Ostracods: A Fine-Grained, Imbalanced Real-World Dataset for Benchmarking Robust Machine Learning and Label Correction Methods
  17. NeurIPS 2024Non-parametric classification via expand-and-sparsify representation
  18. NeurIPS 2024Normalization and effective learning rates in reinforcement learning
  19. NeurIPS 2024Norms for Managing Datasets: A Systematic Review of NeurIPS Datasets
  20. NeurIPS 2024NovoBench: Benchmarking Deep Learning-based \emph{De Novo} Sequencing Methods in Proteomics
  21. NeurIPS 2024Nuclear Fusion Diamond Polishing Dataset
  22. NeurIPS 2024OAM-TCD: A globally diverse dataset of high-resolution tree cover maps
  23. NeurIPS 2024OASIS: Conditional Distribution Shaping for Offline Safe Reinforcement Learning
  24. NeurIPS 2024OccamLLM: Fast and Exact Language Model Arithmetic in a Single Step
  25. NeurIPS 2024Off to new Shores: A Dataset & Benchmark for (near-)coastal Flood Inundation Forecasting
  26. NeurIPS 2024Offline Behavior Distillation
  27. NeurIPS 2024Offline Reinforcement Learning with OOD State Correction and OOD Action Suppression
  28. NeurIPS 2024On Affine Homotopy between Language Encoders
  29. NeurIPS 2024On the cohesion and separability of average-link for hierarchical agglomerative clustering
  30. NeurIPS 2024On the Curses of Future and History in Future-dependent Value Functions for Off-policy Evaluation
  31. NeurIPS 2024On the Effects of Data Scale on UI Control Agents
  32. NeurIPS 2024On the Expressivity and Sample Complexity of Node-Individualized Graph Neural Networks
  33. NeurIPS 2024On the Optimality of Dilated Entropy and Lower Bounds for Online Learning in Extensive-Form Games
  34. NeurIPS 2024On the Stability and Generalization of Meta-Learning
  35. NeurIPS 2024On-Road Object Importance Estimation: A New Dataset and A Model with Multi-Fold Top-Down Guidance
  36. NeurIPS 2024OpenDebateEvidence: A Massive-Scale Argument Mining and Summarization Dataset
  37. NeurIPS 2024OpenMathInstruct-1: A 1.8 Million Math Instruction Tuning Dataset
  38. NeurIPS 2024OpenSatMap: A Fine-grained High-resolution Satellite Dataset for Large-scale Map Construction
  39. NeurIPS 2024OVT-B: A New Large-Scale Benchmark for Open-Vocabulary Multi-Object Tracking
  40. NeurIPS 2024Paloma: A Benchmark for Evaluating Language Model Fit
  41. NeurIPS 2024PEACE: A Dataset of Pharmaceutical Care for Cancer Pain Analgesia Evaluation and Medication Decision
  42. NeurIPS 2024Pedestrian Trajectory Prediction with Missing Data: Datasets, Imputation, and Benchmarking
  43. NeurIPS 2024Pedestrian-Centric 3D Pre-collision Pose and Shape Estimation from Dashcam Perspective
  44. NeurIPS 2024PersonalSum: A User-Subjective Guided Personalized Summarization Dataset for Large Language Models
  45. NeurIPS 2024Piecewise-Stationary Bandits with Knapsacks
  46. NeurIPS 2024Post-Hoc Reversal: Are We Selecting Models Prematurely?
  47. NeurIPS 2024PowerGraph: A power grid benchmark dataset for graph neural networks
  48. NeurIPS 2024Predictor-Corrector Enhanced Transformers with Exponential Moving Average Coefficient Learning
  49. NeurIPS 2024Pretraining with Random Noise for Fast and Robust Learning without Weight Transport
  50. NeurIPS 2024Pricing and Competition for Generative AI

Ask about this trend from Claude or Cursor

Connect the Paperlist MCP and your assistant can pull the numbers on this page while you draft a survey, pick a direction or plan a submission: papers per year and venue, growth, the fastest-rising sub-themes and representative papers, shaped around your question.

Copy this prompt into your assistant

Use paperlist to show how Datasets and Benchmarks papers grew at NeurIPS from 2023 to 2026, and which year jumped the most.

Tool the assistant calls: get_topic_stats {"topic": "dataset-and-benchmarks"}

Set up Paperlist MCP in two minutes (Claude Code, Cursor, Codex, ChatGPT)

FAQ

How many Datasets and Benchmarks papers were published at NeurIPS, ICLR, ICML and CVPR from 2023 to 2026?
5,856 in total: 937 in 2023, 1,346 in 2024, 1,582 in 2025, 1,991 in 2026.
How many Datasets and Benchmarks papers are at NeurIPS 2026?
NeurIPS 2026 has 623 Datasets and Benchmarks papers, versus 637 the year before.
How many Datasets and Benchmarks papers are at ICLR 2026?
ICLR 2026 has 635 Datasets and Benchmarks papers, versus 419 the year before.
How many Datasets and Benchmarks papers are at ICML 2026?
ICML 2026 has 275 Datasets and Benchmarks papers, versus 189 the year before.
How many Datasets and Benchmarks papers are at CVPR 2026?
CVPR 2026 has 458 Datasets and Benchmarks papers, versus 337 the year before.
Which conference publishes the most Datasets and Benchmarks papers?
NeurIPS, with 1,935 papers from 2023 to 2026.

More in Efficiency and Systems