General ML · evaluation papers, 2023–2026

Key findings

• General ML · evaluation went from 53 papers in 2023 to 230 in 2026, roughly 4.3x in three years.
• NeurIPS publishes the most General ML · evaluation work: 270 papers from 2023 to 2026, 45% of the four-venue total.
• The fastest-growing overlap is with AI Agents: papers tagged with both rose from 0 in 2023 to 47 in 2026.
• Among the 6 topics under General Machine Learning, it ranks #4 by 2026 paper count; the fastest grower in the group, General ML · reinforcement learning, is up 2.0x versus 4.3x here.

Representative papers

Spread across years and venues so every edition shows up

• NeurIPS 2026AI Construct Lexis: An Ontology of the Hidden Assumptions in AI Evaluation
• ICML 2026A Computational Framework for Evaluating Human-likeness in LLMs' Open-ended Human Behaviors
• ICLR 2026Unlearning Evaluation through Subset Statistical Independence
• CVPR 2026Bridging the Perception Gap in Image Super-Resolution Evaluation
• NeurIPS 2025Adaptive Distraction: Probing LLM Contextual Robustness with Automated Tree Search
• ICML 2025AKRMap: Adaptive Kernel Regression for Trustworthy Visualization of Cross-Modal Embeddings
• ICLR 2025On Speeding Up Language Model Evaluation
• CVPR 2025ODE: Open-Set Evaluation of Hallucinations in Multimodal Large Language Models
• NeurIPS 2024Accuracy is Not All You Need
• ICML 2024A Fine-grained Analysis of Fitted Q-evaluation: Beyond Parametric Models
• ICLR 2024BatchPrompt: Accomplish more with less
• CVPR 2024Animating General Image with Large Visual Motion Model
• NeurIPS 2023AQuA: A Benchmarking Tool for Label Quality Assessment
• ICML 2023Regions of Reliability in the Evaluation of Multivariate Probabilistic Forecasts
• ICLR 2023Beyond calibration: estimating the grouping loss of modern neural networks
• CVPR 2023GeneCIS: A Benchmark for General Conditional Image Similarity
• NeurIPS 2026AMUSE: Anytime Muon with Stable Gradient Evaluation
• ICML 2026A Two-Tier Perspective on Inference-Time Parallelism in Multi-Agent LLM Systems
• ICLR 2026Choices Speak Louder than Questions
• CVPR 2026Towards Reliable Evaluation of Adversarial Robustness for Spiking Neural Networks

All General ML · evaluation papers

148 papers, page 3 of 3

101. ICML 2026MVI-Bench: A Comprehensive Benchmark for Evaluating Robustness to Misleading Visual Inputs in LVLMs
102. ICML 2026Neuromem: A Granular Decomposition of the Streaming Lifecycle in External Memory for LLMs
103. ICML 2026Nonparametric LLM Evaluation from Preference Data
104. ICML 2026Off-Policy Evaluation with Strategic Agents via Local Disclosure
105. ICML 2026Omitted Variable Bias in Language Models Under Distribution Shift
106. ICML 2026On Stable Long-Form Generation: Benchmarking and Mitigating Length Volatility
107. ICML 2026ORLoopBench: Solver-in-the-Loop Benchmarks for Self-Correction and Behavioral Rationality in Operations Research
108. ICML 2026Prescriptive Scaling Reveals the Evolution of Language Model Capabilities
109. ICML 2026Probing the Knowledge Boundary: An Interactive Agentic Framework for Deep Knowledge Extraction
110. ICML 2026QiMeng-LibBench: Benchmarking LLM Agents for Library-Scale Cross-Architecture Migration
111. ICML 2026Quantifying Frontier LLM Capabilities for Container Sandbox Escape
112. ICML 2026Query-efficient model evaluation using cached responses
113. ICML 2026Realizable Bayes-Consistency for General Metric Losses
114. ICML 2026Reasoning Models Are Test Exploiters: Rethinking Multiple Choice
115. ICML 2026REG: In-Sample RL via Regularizing the Evaluation Gap
116. ICML 2026Rethinking Evaluation Paradigms in IBP-based Certified Training
117. ICML 2026Revisiting the Platonic Representation Hypothesis: An Aristotelian View
118. ICML 2026Routing and Reasoned Evaluation with Large Language Models
119. ICML 2026SciAgentGym: Benchmarking Multi-Step Scientific Tool-Use in LLM Agents
120. ICML 2026SEDRAS: Symbolically Evaluated Deep Research And Science
121. ICML 2026ShapCCS: Shapley-Driven Client Coreset Selection in Federated Learning
122. ICML 2026STABLEVAL: Disagreement-Aware and Stable Evaluation of AI Systems
123. ICML 2026Strategic Navigation or Stochastic Search? How Agents and Humans Reason Over Document Collections
124. ICML 2026Systematic Failures in Collective Reasoning under Distributed Information in Multi-Agent LLMs
125. ICML 2026TadA-Bench: A Million-Variant Benchmark for Future-Round Discovery Toward Agentic Protein Engineering
126. ICML 2026Tempora: Characterising the Time-Contingent Utility of Online Test-Time Adaptation
127. ICML 2026The Abstraction Gap in Vision-Language Causal Reasoning
128. ICML 2026The Consistency Dilemma in LLMs: Generator-Evaluator Agreement and Vulnerability to Mistakes
129. ICML 2026The Relative Instability of Model Comparison with Cross-validation
130. ICML 2026Thinking in Structures: Evaluating Spatial Intelligence in Constraint-Governed Spaces
131. ICML 2026Towards a Science of AI Agent Reliability
132. ICML 2026TritonGym: A Benchmark for Agentic LLM Workflows in Triton GPU Code Generation
133. ICML 2026Uncovering Competency Gaps in Large Language Models and Their Benchmarks
134. ICML 2026UniCode: Augmenting Evaluation for Code Reasoning
135. ICML 2026Unison: Benchmarking Unified Multimodal Models via Synergistic Understanding and Generation
136. ICML 2026Unveiling Multi-regime Patterns in SciML: Distinct Failure Modes and Regime-specific Optimization
137. ICML 2026VenusBench-Mobile: A Challenging and User-Centric Benchmark for Mobile GUI Agents with Capability Diagnostics
138. ICML 2026VeRO: A Harness for Agents to Optimize Agents
139. ICML 2026Vision2Web: A Hierarchical Benchmark for Visual Website Development with Agent Verification
140. ICML 2026VisualPuzzles: Decoupling Multimodal Reasoning Evaluation from Domain Knowledge
141. ICML 2026VLA-Arena: An Open-Source Framework for Benchmarking Vision-Language-Action Models
142. ICML 2026VocSim A Training-free Benchmark for Zero-shot Content Identity in Single-source Audio
143. ICML 2026VT-Bench: A Unified Benchmark for Visual-Tabular Multi-Modal Learning
144. ICML 2026What Language is This? Ask Your Tokenizer.
145. ICML 2026When AI Benchmarks Plateau: A Systematic Study of Benchmark Saturation
146. ICML 2026When Can We Trust Survival Model Evaluation ?
147. ICML 2026WISE: World Knowledge-Informed Semantic Evaluation for Text-to-Image Generation
148. ICML 2026ZeroBench: An Impossible Visual Benchmark for Contemporary Large Multimodal Models

FAQ

How many General ML · evaluation papers were published at NeurIPS, ICLR, ICML and CVPR from 2023 to 2026?

606 in total: 53 in 2023, 115 in 2024, 208 in 2025, 230 in 2026.

How many General ML · evaluation papers are at NeurIPS 2026?

NeurIPS 2026 has 57 General ML · evaluation papers, versus 124 the year before.

How many General ML · evaluation papers are at ICLR 2026?

ICLR 2026 has 19 General ML · evaluation papers, versus 19 the year before.

How many General ML · evaluation papers are at ICML 2026?

ICML 2026 has 148 General ML · evaluation papers, versus 58 the year before.

How many General ML · evaluation papers are at CVPR 2026?

CVPR 2026 has 6 General ML · evaluation papers, versus 7 the year before.

Which conference publishes the most General ML · evaluation papers?

NeurIPS, with 270 papers from 2023 to 2026.