General ML · evaluation papers, 2023–2026

Key findings

• General ML · evaluation went from 53 papers in 2023 to 230 in 2026, roughly 4.3x in three years.
• NeurIPS publishes the most General ML · evaluation work: 270 papers from 2023 to 2026, 45% of the four-venue total.
• The fastest-growing overlap is with AI Agents: papers tagged with both rose from 0 in 2023 to 47 in 2026.
• Among the 6 topics under General Machine Learning, it ranks #4 by 2026 paper count; the fastest grower in the group, General ML · reinforcement learning, is up 2.0x versus 4.3x here.

Representative papers

Spread across years and venues so every edition shows up

• NeurIPS 2026AI Construct Lexis: An Ontology of the Hidden Assumptions in AI Evaluation
• ICML 2026A Computational Framework for Evaluating Human-likeness in LLMs' Open-ended Human Behaviors
• ICLR 2026Unlearning Evaluation through Subset Statistical Independence
• CVPR 2026Bridging the Perception Gap in Image Super-Resolution Evaluation
• NeurIPS 2025Adaptive Distraction: Probing LLM Contextual Robustness with Automated Tree Search
• ICML 2025AKRMap: Adaptive Kernel Regression for Trustworthy Visualization of Cross-Modal Embeddings
• ICLR 2025On Speeding Up Language Model Evaluation
• CVPR 2025ODE: Open-Set Evaluation of Hallucinations in Multimodal Large Language Models
• NeurIPS 2024Accuracy is Not All You Need
• ICML 2024A Fine-grained Analysis of Fitted Q-evaluation: Beyond Parametric Models
• ICLR 2024BatchPrompt: Accomplish more with less
• CVPR 2024Animating General Image with Large Visual Motion Model
• NeurIPS 2023AQuA: A Benchmarking Tool for Label Quality Assessment
• ICML 2023Regions of Reliability in the Evaluation of Multivariate Probabilistic Forecasts
• ICLR 2023Beyond calibration: estimating the grouping loss of modern neural networks
• CVPR 2023GeneCIS: A Benchmark for General Conditional Image Similarity
• NeurIPS 2026AMUSE: Anytime Muon with Stable Gradient Evaluation
• ICML 2026A Two-Tier Perspective on Inference-Time Parallelism in Multi-Agent LLM Systems
• ICLR 2026Choices Speak Louder than Questions
• CVPR 2026Towards Reliable Evaluation of Adversarial Robustness for Spiking Neural Networks

All General ML · evaluation papers

148 papers, page 1 of 3

1. ICML 2026A Benchmark and Framework for Evaluating Next Action Predictions in Spreadsheets
2. ICML 2026A Computational Framework for Evaluating Human-likeness in LLMs' Open-ended Human Behaviors
3. ICML 2026A Diagnostic Study of Multi-Agent LLMs for Real-World Debates
4. ICML 2026A General Framework for Dynamic Consistent Submodular Maximization
5. ICML 2026A Two-Tier Perspective on Inference-Time Parallelism in Multi-Agent LLM Systems
6. ICML 2026Accuracy and Normalized Accuracy under Length Bias: Analysis, Guidelines, and a Bayesian Alternative
7. ICML 2026Accurate Evaluation of Quickest Changepoint Detectors via Non-parametric Survival Analysis
8. ICML 2026Adaptive Testing for LLM Evaluation: A Psychometric Alternative to Static Benchmarks
9. ICML 2026AgentNoiseBench: Benchmarking Robustness of Tool-Using LLM Agents Under Noisy Condition
10. ICML 2026AgentSuite: Toward More Reliable Agent Evaluation with a Component-Based Benchmark Auditing Pipeline
11. ICML 2026AI Cartography: Mapping the Latent Landscape of AI Benchmark Ecosystems
12. ICML 2026Anytime-Valid Inference for Online Ranking of Large Language Models
13. ICML 2026Approximation Preserving Coresets
14. ICML 2026Are VLMs Seeing or Just Saying? Uncovering the Illusion of Visual Re-examination
15. ICML 2026Assistive Prompt Mediation: Evaluating Language Models Under Accessibility Constraints
16. ICML 2026AtelierEval: Agentic Evaluation of Humans & LLMs as Text-to-Image Prompters
17. ICML 2026Attention Sinks in Diffusion Transformers: A Causal Analysis
18. ICML 2026BEDTime: A Unified Benchmark for Automatically Describing Time Series
19. ICML 2026Benchmarking Agent Memory in Interdependent Multi-Session Agentic Tasks
20. ICML 2026Benchmarking at the Edge of Comprehension
21. ICML 2026Benchmarking Reward Hack Detection in Code Environments via Contrastive Analysis
22. ICML 2026Benchmarking the Limits of In-Context Reinforcement Learning for Ad-Hoc Teamwork
23. ICML 2026Benchmarking World-Model Learning with Environment-Level Queries
24. ICML 2026BEST: Benchmarking Efficiency in Space and Time for LLM-Generated Code
25. ICML 2026Beyond Benchmarks: Toward Causally Faithful Evaluation of Large Language Models
26. ICML 2026Beyond the Final Answer: Evaluating the Reasoning Trajectories of Tool-Augmented Agents
27. ICML 2026Causally Evaluating the Learnability of Formal Language Tasks
28. ICML 2026CausalProfiler: Generating Synthetic Benchmarks for Rigorous and Transparent Evaluation of Causal Machine Learning
29. ICML 2026CentaurEval: Benchmarking Human-in-the-Loop Value in Agentic Coding
30. ICML 2026Certifying Capabilities from Finite Tests: When Is It Possible?
31. ICML 2026CHB: A Diagnostic Toolkit for Hardness-Aware Clustering Evaluation
32. ICML 2026CIRBench: Evaluating Large Language Models as LLVM IR Optimizers
33. ICML 2026CiteGuard: Conformal False-Discovery Control for Faithful Retrieval-Augmented Generation
34. ICML 2026Clustered Influence Functions
35. ICML 2026CodeClash: Benchmarking Goal-Oriented Software Engineering
36. ICML 2026Conditional Coverage Diagnostics for Conformal Prediction
37. ICML 2026Conformal Reliability: A New Evaluation Metric for Conditional Generation
38. ICML 2026Contrastive Order Learning: A General Framework for Ordinal Regression
39. ICML 2026Correct Looks Better: Pairwise Comparisons Reveal Accuracy Rankings
40. ICML 2026Coverage, Not Averages: Semantic Stratification for Trustworthy Retrieval Evaluation
41. ICML 2026Cutting LLM Evaluation Costs with SySRs: A Bandit Algorithm That Provably Exploits Model Similarity
42. ICML 2026CyberGym-E2E: Scalable Real-World Benchmark for AI Agents' End-to-End Cybersecurity Capabilities
43. ICML 2026DEER: A Benchmark for Evaluating Deep Research Agents on Expert Report Generation
44. ICML 2026Divisiveness-Consistent Label Distribution Learning
45. ICML 2026DLEBench: Evaluating Small-scale Object Editing Ability for Instruction-based Image Editing Model
46. ICML 2026Do LLMs Signal When They’re Right? Evidence from Neuron Agreement
47. ICML 2026Do Text Edits Generalize to Visual Generation? Benchmarking Cross-Modal Knowledge Editing in UMMs
48. ICML 2026DocHop: Benchmarking Out-of-domain Multi-hop Reasoning in Information-Dense Documents
49. ICML 2026DRIFT-BENCH: Diagnosing CoopeRative Breakdowns in LLM Agents under Input Faults via Multi-Turn Interaction
50. ICML 2026DRPBench: Evaluating LLMs in Concurrent Code Comprehension via Fine-Grained Data Race Prediction

FAQ

How many General ML · evaluation papers were published at NeurIPS, ICLR, ICML and CVPR from 2023 to 2026?

606 in total: 53 in 2023, 115 in 2024, 208 in 2025, 230 in 2026.

How many General ML · evaluation papers are at NeurIPS 2026?

NeurIPS 2026 has 57 General ML · evaluation papers, versus 124 the year before.

How many General ML · evaluation papers are at ICLR 2026?

ICLR 2026 has 19 General ML · evaluation papers, versus 19 the year before.

How many General ML · evaluation papers are at ICML 2026?

ICML 2026 has 148 General ML · evaluation papers, versus 58 the year before.

How many General ML · evaluation papers are at CVPR 2026?

CVPR 2026 has 6 General ML · evaluation papers, versus 7 the year before.

Which conference publishes the most General ML · evaluation papers?

NeurIPS, with 270 papers from 2023 to 2026.