Datasets and Benchmarks papers, 2023–2026

New datasets and evaluation protocols

Scope: NeurIPS, ICLR, ICML and CVPR, 2023–2026. 5,856 papers are tagged with this topic.

Key findings

Papers per year

Papers per venue

Counts by year and venue

Datasets and Benchmarks papers by year and venue
YearNeurIPSICLRICMLCVPRTotal
2023227162166382937
20244482163183641,346
20256374191893371,582
20266236352754581,991

Representative papers

Spread across years and venues so every edition shows up

All Datasets and Benchmarks papers

419 papers, page 5 of 9

  1. ICLR 2025KOR-Bench: Benchmarking Language Models on Knowledge-Orthogonal Reasoning Tasks
  2. ICLR 2025LaGeM: A Large Geometry Model for 3D Representation Learning and Diffusion
  3. ICLR 2025Language Model Alignment in Multilingual Trolley Problems
  4. ICLR 2025Language Models Learn to Mislead Humans via RLHF
  5. ICLR 2025Language Representations Can be What Recommenders Need: Findings and Potentials
  6. ICLR 2025Large Language Models Often Say One Thing and Do Another
  7. ICLR 2025Law of the Weakest Link: Cross Capabilities of Large Language Models
  8. ICLR 2025Lawma: The Power of Specialization for Legal Annotation
  9. ICLR 2025Learning Color Equivariant Representations
  10. ICLR 2025Learning Continually by Spectral Regularization
  11. ICLR 2025Learning Interleaved Image-Text Comprehension in Vision-Language Large Models
  12. ICLR 2025Learning Splitting Heuristics in Divide-and-Conquer SAT Solvers with Reinforcement Learning
  13. ICLR 2025LiveCodeBench: Holistic and Contamination Free Evaluation of Large Language Models for Code
  14. ICLR 2025LiveXiv - A Multi-Modal live benchmark based on Arxiv papers content
  15. ICLR 2025LLaMaFlex: Many-in-one LLMs via Generalized Pruning and Weight Sharing
  16. ICLR 2025LLaVA-Interleave: Tackling Multi-image, Video, and 3D in Large Multimodal Models
  17. ICLR 2025LocoVR: Multiuser Indoor Locomotion Dataset in Virtual Reality
  18. ICLR 2025LOKI: A Comprehensive Synthetic Data Detection Benchmark using Large Multimodal Models
  19. ICLR 2025LoRanPAC: Low-rank Random Features and Pre-trained Models for Bridging Theory and Practice in Continual Learning
  20. ICLR 2025Magpie: Alignment Data Synthesis from Scratch by Prompting Aligned LLMs with Nothing
  21. ICLR 2025ManiSkill-HAB: A Benchmark for Low-Level Manipulation in Home Rearrangement Tasks
  22. ICLR 2025MANTRA: The Manifold Triangulations Assemblage
  23. ICLR 2025Mask-DPO: Generalizable Fine-grained Factuality Alignment of LLMs
  24. ICLR 2025Matryoshka Multimodal Models
  25. ICLR 2025McEval: Massively Multilingual Code Evaluation
  26. ICLR 2025MediConfusion: Can you trust your AI radiologist? Probing the reliability of multimodal medical foundation models
  27. ICLR 2025Medium-Difficulty Samples Constitute Smoothed Decision Boundary for Knowledge Distillation on Pruned Datasets
  28. ICLR 2025MedTrinity-25M: A Large-scale Multimodal Dataset with Multigranular Annotations for Medicine
  29. ICLR 2025MEGA-Bench: Scaling Multimodal Evaluation to over 500 Real-World Tasks
  30. ICLR 2025metabench - A Sparse Benchmark of Reasoning and Knowledge in Large Language Models
  31. ICLR 2025MetaOOD: Automatic Selection of OOD Detection Models
  32. ICLR 2025MetaUrban: An Embodied AI Simulation Platform for Urban Micromobility
  33. ICLR 2025MIA-Bench: Towards Better Instruction Following Evaluation of Multimodal LLMs
  34. ICLR 2025miniCTX: Neural Theorem Proving with (Long-)Contexts
  35. ICLR 2025Mitigating Memorization in Language Models
  36. ICLR 2025MixEval-X: Any-to-any Evaluations from Real-world Data Mixture
  37. ICLR 2025Mixture of In-Context Prompters for Tabular PFNs
  38. ICLR 2025MLE-bench: Evaluating Machine Learning Agents on Machine Learning Engineering
  39. ICLR 2025MMAD: A Comprehensive Benchmark for Multimodal Large Language Models in Industrial Anomaly Detection
  40. ICLR 2025MMAU: A Massive Multi-Task Audio Understanding and Reasoning Benchmark
  41. ICLR 2025MMDT: Decoding the Trustworthiness and Safety of Multimodal Foundation Models
  42. ICLR 2025MMIE: Massive Multimodal Interleaved Comprehension Benchmark for Large Vision-Language Models
  43. ICLR 2025MMIU: Multimodal Multi-image Understanding for Evaluating Large Vision-Language Models
  44. ICLR 2025MMKE-Bench: A Multimodal Editing Benchmark for Diverse Visual Knowledge
  45. ICLR 2025MMQA: Evaluating LLMs with Multi-Table Multi-Hop Complex Questions
  46. ICLR 2025MMR: A Large-scale Benchmark Dataset for Multi-target and Multi-granularity Reasoning Segmentation
  47. ICLR 2025MMRole: A Comprehensive Framework for Developing and Evaluating Multimodal Role-Playing Agents
  48. ICLR 2025MMTEB: Massive Multilingual Text Embedding Benchmark
  49. ICLR 2025MMWorld: Towards Multi-discipline Multi-faceted World Model Evaluation in Videos
  50. ICLR 2025MotherNet: Fast Training and Inference via Hyper-Network Transformers

Ask about this trend from Claude or Cursor

Connect the Paperlist MCP and your assistant can pull the numbers on this page while you draft a survey, pick a direction or plan a submission: papers per year and venue, growth, the fastest-rising sub-themes and representative papers, shaped around your question.

Copy this prompt into your assistant

Use paperlist to show how Datasets and Benchmarks papers grew at NeurIPS from 2023 to 2026, and which year jumped the most.

Tool the assistant calls: get_topic_stats {"topic": "dataset-and-benchmarks"}

Set up Paperlist MCP in two minutes (Claude Code, Cursor, Codex, ChatGPT)

FAQ

How many Datasets and Benchmarks papers were published at NeurIPS, ICLR, ICML and CVPR from 2023 to 2026?
5,856 in total: 937 in 2023, 1,346 in 2024, 1,582 in 2025, 1,991 in 2026.
How many Datasets and Benchmarks papers are at NeurIPS 2026?
NeurIPS 2026 has 623 Datasets and Benchmarks papers, versus 637 the year before.
How many Datasets and Benchmarks papers are at ICLR 2026?
ICLR 2026 has 635 Datasets and Benchmarks papers, versus 419 the year before.
How many Datasets and Benchmarks papers are at ICML 2026?
ICML 2026 has 275 Datasets and Benchmarks papers, versus 189 the year before.
How many Datasets and Benchmarks papers are at CVPR 2026?
CVPR 2026 has 458 Datasets and Benchmarks papers, versus 337 the year before.
Which conference publishes the most Datasets and Benchmarks papers?
NeurIPS, with 1,935 papers from 2023 to 2026.

More in Efficiency and Systems