General ML · evaluation papers, 2023–2026

Key findings

• General ML · evaluation went from 53 papers in 2023 to 230 in 2026, roughly 4.3x in three years.
• NeurIPS publishes the most General ML · evaluation work: 270 papers from 2023 to 2026, 45% of the four-venue total.
• The fastest-growing overlap is with AI Agents: papers tagged with both rose from 0 in 2023 to 47 in 2026.
• Among the 6 topics under General Machine Learning, it ranks #4 by 2026 paper count; the fastest grower in the group, General ML · reinforcement learning, is up 2.0x versus 4.3x here.

Representative papers

Spread across years and venues so every edition shows up

• NeurIPS 2026AI Construct Lexis: An Ontology of the Hidden Assumptions in AI Evaluation
• ICML 2026A Computational Framework for Evaluating Human-likeness in LLMs' Open-ended Human Behaviors
• ICLR 2026Unlearning Evaluation through Subset Statistical Independence
• CVPR 2026Bridging the Perception Gap in Image Super-Resolution Evaluation
• NeurIPS 2025Adaptive Distraction: Probing LLM Contextual Robustness with Automated Tree Search
• ICML 2025AKRMap: Adaptive Kernel Regression for Trustworthy Visualization of Cross-Modal Embeddings
• ICLR 2025On Speeding Up Language Model Evaluation
• CVPR 2025ODE: Open-Set Evaluation of Hallucinations in Multimodal Large Language Models
• NeurIPS 2024Accuracy is Not All You Need
• ICML 2024A Fine-grained Analysis of Fitted Q-evaluation: Beyond Parametric Models
• ICLR 2024BatchPrompt: Accomplish more with less
• CVPR 2024Animating General Image with Large Visual Motion Model
• NeurIPS 2023AQuA: A Benchmarking Tool for Label Quality Assessment
• ICML 2023Regions of Reliability in the Evaluation of Multivariate Probabilistic Forecasts
• ICLR 2023Beyond calibration: estimating the grouping loss of modern neural networks
• CVPR 2023GeneCIS: A Benchmark for General Conditional Image Similarity
• NeurIPS 2026AMUSE: Anytime Muon with Stable Gradient Evaluation
• ICML 2026A Two-Tier Perspective on Inference-Time Parallelism in Multi-Agent LLM Systems
• ICLR 2026Choices Speak Louder than Questions
• CVPR 2026Towards Reliable Evaluation of Adversarial Robustness for Spiking Neural Networks

All General ML · evaluation papers

58 papers, page 1 of 2

1. ICML 2025A General Graph Spectral Wavelet Convolution via Chebyshev Order Decomposition
2. ICML 2025AAAR-1.0: Assessing AI’s Potential to Assist Research
3. ICML 2025AKRMap: Adaptive Kernel Regression for Trustworthy Visualization of Cross-Modal Embeddings
4. ICML 2025Almost Optimal Fully Dynamic $k$-Center Clustering with Recourse
5. ICML 2025am-ELO: A Stable Framework for Arena-based LLM Evaluation
6. ICML 2025Approximately Correct Label Distribution Learning
7. ICML 2025AutoEval Done Right: Using Synthetic Data for Model Evaluation
8. ICML 2025Bridging Fairness and Efficiency in Conformal Inference: A Surrogate-Assisted Group-Clustered Approach
9. ICML 2025CogMath: Assessing LLMs' Authentic Mathematical Ability from a Human Cognitive Perspective
10. ICML 2025Copilot Arena: A Platform for Code LLM Evaluation in the Wild
11. ICML 2025Correlation Clustering Beyond the Pivot Algorithm
12. ICML 2025Do Vision-Language Models Really Understand Visual Language?
13. ICML 2025Feature Importance Metrics in the Presence of Missing Data
14. ICML 2025FedClean: A General Robust Label Noise Correction for Federated Learning
15. ICML 2025From Crowdsourced Data to High-quality Benchmarks: Arena-Hard and Benchbuilder Pipeline
16. ICML 2025From Jack of All Trades to Master of One: Specializing LLM-based Autoraters to a Test Set
17. ICML 2025Guardians of Image Quality: Benchmarking Defenses Against Adversarial Attacks on Image Quality Metrics
18. ICML 2025High-Dimensional Tensor Regression With Oracle Properties
19. ICML 2025How Do Large Language Monkeys Get Their Power (Laws)?
20. ICML 2025Is Complex Query Answering Really Complex?
21. ICML 2025KernelBench: Can LLMs Write Efficient GPU Kernels?
22. ICML 2025KoopSTD: Reliable Similarity Analysis between Dynamical Systems via Approximating Koopman Spectrum with Timescale Decoupling
23. ICML 2025LMAct: A Benchmark for In-Context Imitation Learning with Long Multimodal Demonstrations
24. ICML 2025MathConstruct: Challenging LLM Reasoning with Constructive Proofs
25. ICML 2025MCU: An Evaluation Framework for Open-Ended Game Agents
26. ICML 2025Measuring Diversity in Synthetic Datasets
27. ICML 2025MetricEmbedding: Accelerate Metric Nearness by Tropical Inner Product
28. ICML 2025Minerva: A Programmable Memory Test Benchmark for Language Models
29. ICML 2025Modified K-means Algorithm with Local Optimality Guarantees
30. ICML 2025Multiple-policy Evaluation via Density Estimation
31. ICML 2025Off-Policy Evaluation under Nonignorable Missing Data
32. ICML 2025On the Diversity of Adversarial Ensemble Learning
33. ICML 2025Overestimation in LLM Evaluation: A Controlled Large-Scale Study on Data Contamination’s Impact on Machine Translation
34. ICML 2025PaperBench: Evaluating AI’s Ability to Replicate AI Research
35. ICML 2025Position: AI Competitions Provide the Gold Standard for Empirical Rigor in GenAI Evaluation
36. ICML 2025Position: AI Evaluation Should Learn from How We Test Humans
37. ICML 2025Position: In-House Evaluation Is Not Enough. Towards Robust Third-Party Evaluation and Flaw Disclosure for General-Purpose AI
38. ICML 2025Position: Stop treating `AGI' as the north-star goal of AI research
39. ICML 2025Prompt-to-Leaderboard: Prompt-Adaptive LLM Evaluations
40. ICML 2025Provable Efficiency of Guidance in Diffusion Models for General Data Distribution
41. ICML 2025RAGGED: Towards Informed Design of Scalable and Stable RAG Systems
42. ICML 2025Raising the Bar: Investigating the Values of Large Language Models via Generative Evolving Testing
43. ICML 2025RBench: Graduate-level Multi-disciplinary Benchmarks for LLM & MLLM Complex Reasoning Evaluation
44. ICML 2025RE-IMAGINE: Symbolic Benchmark Synthesis for Reasoning Evaluation
45. ICML 2025Reflection-Bench: Evaluating Epistemic Agency in Large Language Models
46. ICML 2025Regression for the Mean: Auto-Evaluation and Inference with Few Labels through Post-hoc Regression
47. ICML 2025Rethinking Causal Ranking: A Balanced Perspective on Uplift Model Evaluation
48. ICML 2025Robust ML Auditing using Prior Knowledge
49. ICML 2025SWE-Lancer: Can Frontier LLMs Earn $1 Million from Real-World Freelance Software Engineering?
50. ICML 2025SyncMind: Measuring Agent Out-of-Sync Recovery in Collaborative Software Engineering

FAQ

How many General ML · evaluation papers were published at NeurIPS, ICLR, ICML and CVPR from 2023 to 2026?

606 in total: 53 in 2023, 115 in 2024, 208 in 2025, 230 in 2026.

How many General ML · evaluation papers are at NeurIPS 2026?

NeurIPS 2026 has 57 General ML · evaluation papers, versus 124 the year before.

How many General ML · evaluation papers are at ICLR 2026?

ICLR 2026 has 19 General ML · evaluation papers, versus 19 the year before.

How many General ML · evaluation papers are at ICML 2026?

ICML 2026 has 148 General ML · evaluation papers, versus 58 the year before.

How many General ML · evaluation papers are at CVPR 2026?

CVPR 2026 has 6 General ML · evaluation papers, versus 7 the year before.

Which conference publishes the most General ML · evaluation papers?

NeurIPS, with 270 papers from 2023 to 2026.