General ML · evaluation papers, 2023–2026

Key findings

• General ML · evaluation went from 53 papers in 2023 to 230 in 2026, roughly 4.3x in three years.
• NeurIPS publishes the most General ML · evaluation work: 270 papers from 2023 to 2026, 45% of the four-venue total.
• The fastest-growing overlap is with AI Agents: papers tagged with both rose from 0 in 2023 to 47 in 2026.
• Among the 6 topics under General Machine Learning, it ranks #4 by 2026 paper count; the fastest grower in the group, General ML · reinforcement learning, is up 2.0x versus 4.3x here.

Representative papers

Spread across years and venues so every edition shows up

• NeurIPS 2026AI Construct Lexis: An Ontology of the Hidden Assumptions in AI Evaluation
• ICML 2026A Computational Framework for Evaluating Human-likeness in LLMs' Open-ended Human Behaviors
• ICLR 2026Unlearning Evaluation through Subset Statistical Independence
• CVPR 2026Bridging the Perception Gap in Image Super-Resolution Evaluation
• NeurIPS 2025Adaptive Distraction: Probing LLM Contextual Robustness with Automated Tree Search
• ICML 2025AKRMap: Adaptive Kernel Regression for Trustworthy Visualization of Cross-Modal Embeddings
• ICLR 2025On Speeding Up Language Model Evaluation
• CVPR 2025ODE: Open-Set Evaluation of Hallucinations in Multimodal Large Language Models
• NeurIPS 2024Accuracy is Not All You Need
• ICML 2024A Fine-grained Analysis of Fitted Q-evaluation: Beyond Parametric Models
• ICLR 2024BatchPrompt: Accomplish more with less
• CVPR 2024Animating General Image with Large Visual Motion Model
• NeurIPS 2023AQuA: A Benchmarking Tool for Label Quality Assessment
• ICML 2023Regions of Reliability in the Evaluation of Multivariate Probabilistic Forecasts
• ICLR 2023Beyond calibration: estimating the grouping loss of modern neural networks
• CVPR 2023GeneCIS: A Benchmark for General Conditional Image Similarity
• NeurIPS 2026AMUSE: Anytime Muon with Stable Gradient Evaluation
• ICML 2026A Two-Tier Perspective on Inference-Time Parallelism in Multi-Agent LLM Systems
• ICLR 2026Choices Speak Louder than Questions
• CVPR 2026Towards Reliable Evaluation of Adversarial Robustness for Spiking Neural Networks

All General ML · evaluation papers

208 papers, page 2 of 5

51. ICML 2025MCU: An Evaluation Framework for Open-Ended Game Agents
52. ICML 2025Measuring Diversity in Synthetic Datasets
53. ICML 2025MetricEmbedding: Accelerate Metric Nearness by Tropical Inner Product
54. ICML 2025Minerva: A Programmable Memory Test Benchmark for Language Models
55. ICML 2025Modified K-means Algorithm with Local Optimality Guarantees
56. ICML 2025Multiple-policy Evaluation via Density Estimation
57. ICML 2025Off-Policy Evaluation under Nonignorable Missing Data
58. ICML 2025On the Diversity of Adversarial Ensemble Learning
59. ICML 2025Overestimation in LLM Evaluation: A Controlled Large-Scale Study on Data Contamination’s Impact on Machine Translation
60. ICML 2025PaperBench: Evaluating AI’s Ability to Replicate AI Research
61. ICML 2025Position: AI Competitions Provide the Gold Standard for Empirical Rigor in GenAI Evaluation
62. ICML 2025Position: AI Evaluation Should Learn from How We Test Humans
63. ICML 2025Position: In-House Evaluation Is Not Enough. Towards Robust Third-Party Evaluation and Flaw Disclosure for General-Purpose AI
64. ICML 2025Position: Stop treating `AGI' as the north-star goal of AI research
65. ICML 2025Prompt-to-Leaderboard: Prompt-Adaptive LLM Evaluations
66. ICML 2025Provable Efficiency of Guidance in Diffusion Models for General Data Distribution
67. ICML 2025RAGGED: Towards Informed Design of Scalable and Stable RAG Systems
68. ICML 2025Raising the Bar: Investigating the Values of Large Language Models via Generative Evolving Testing
69. ICML 2025RBench: Graduate-level Multi-disciplinary Benchmarks for LLM & MLLM Complex Reasoning Evaluation
70. ICML 2025RE-IMAGINE: Symbolic Benchmark Synthesis for Reasoning Evaluation
71. ICML 2025Reflection-Bench: Evaluating Epistemic Agency in Large Language Models
72. ICML 2025Regression for the Mean: Auto-Evaluation and Inference with Few Labels through Post-hoc Regression
73. ICML 2025Rethinking Causal Ranking: A Balanced Perspective on Uplift Model Evaluation
74. ICML 2025Robust ML Auditing using Prior Knowledge
75. ICML 2025SWE-Lancer: Can Frontier LLMs Earn $1 Million from Real-World Freelance Software Engineering?
76. ICML 2025SyncMind: Measuring Agent Out-of-Sync Recovery in Collaborative Software Engineering
77. ICML 2025The Berkeley Function Calling Leaderboard (BFCL): From Tool Use to Agentic Evaluation of Large Language Models
78. ICML 2025The Hidden Joules: Evaluating the Energy Consumption of Vision Backbones for Progress Towards More Efficient Model Inference
79. ICML 2025To Each Metric Its Decoding: Post-Hoc Optimal Decision Rules of Probabilistic Hierarchical Classifiers
80. ICML 2025Triple-Optimistic Learning for Stochastic Contextual Bandits with General Constraints
81. ICML 2025TypyBench: Evaluating LLM Type Inference for Untyped Python Repositories
82. ICML 2025Uncertainty Quantification for LLM-Based Survey Simulations
83. ICML 2025Unified K-Means Clustering with Label-Guided Manifold Learning
84. ICML 2025WATCH: Adaptive Monitoring for AI Deployments via Weighted-Conformal Martingales
85. NeurIPS 2025A Finite Sample Analysis of Distributional TD Learning with Linear Function Approximation
86. NeurIPS 2025A General-Purpose Theorem for High-Probability Bounds of Stochastic Approximation with Polyak Averaging
87. NeurIPS 2025A Principled Path to Fitted Distributional Evaluation
88. NeurIPS 2025Adaptive Distraction: Probing LLM Contextual Robustness with Automated Tree Search
89. NeurIPS 2025AGI-Elo: How Far Are We From Mastering A Task?
90. NeurIPS 2025AI Debate Aids Assessment of Controversial Claims
91. NeurIPS 2025AI Testing Should Account for Sophisticated Strategic Behaviour
92. NeurIPS 2025Aligning Evaluation with Clinical Priorities: Calibration, Label Shift, and Error Costs
93. NeurIPS 2025AnaCP: Toward Upper-Bound Continual Learning via Analytic Contrastive Projection
94. NeurIPS 2025APIGen-MT: Agentic Pipeline for Multi-Turn Data Generation via Simulated Agent-Human Interplay
95. NeurIPS 2025Are Large Reasoning Models Good Translation Evaluators? Analysis and Performance Boost
96. NeurIPS 2025Ascent Fails to Forget
97. NeurIPS 2025Atomic Thinking of LLMs: Decoupling and Exploring Mathematical Reasoning Abilities
98. NeurIPS 2025Attention! Your Vision Language Model Could Be Maliciously Manipulated
99. NeurIPS 2025Automated Detection of Visual Attribute Reliance with a Self-Reflective Agent
100. NeurIPS 2025Benchmarking End-To-End Performance of AI-Based Chip Placement Algorithms

FAQ

How many General ML · evaluation papers were published at NeurIPS, ICLR, ICML and CVPR from 2023 to 2026?

606 in total: 53 in 2023, 115 in 2024, 208 in 2025, 230 in 2026.

How many General ML · evaluation papers are at NeurIPS 2026?

NeurIPS 2026 has 57 General ML · evaluation papers, versus 124 the year before.

How many General ML · evaluation papers are at ICLR 2026?

ICLR 2026 has 19 General ML · evaluation papers, versus 19 the year before.

How many General ML · evaluation papers are at ICML 2026?

ICML 2026 has 148 General ML · evaluation papers, versus 58 the year before.

How many General ML · evaluation papers are at CVPR 2026?

CVPR 2026 has 6 General ML · evaluation papers, versus 7 the year before.

Which conference publishes the most General ML · evaluation papers?

NeurIPS, with 270 papers from 2023 to 2026.