General ML · evaluation papers, 2023–2026

Key findings

• General ML · evaluation went from 53 papers in 2023 to 230 in 2026, roughly 4.3x in three years.
• NeurIPS publishes the most General ML · evaluation work: 270 papers from 2023 to 2026, 45% of the four-venue total.
• The fastest-growing overlap is with AI Agents: papers tagged with both rose from 0 in 2023 to 47 in 2026.
• Among the 6 topics under General Machine Learning, it ranks #4 by 2026 paper count; the fastest grower in the group, General ML · reinforcement learning, is up 2.0x versus 4.3x here.

Representative papers

Spread across years and venues so every edition shows up

• NeurIPS 2026AI Construct Lexis: An Ontology of the Hidden Assumptions in AI Evaluation
• ICML 2026A Computational Framework for Evaluating Human-likeness in LLMs' Open-ended Human Behaviors
• ICLR 2026Unlearning Evaluation through Subset Statistical Independence
• CVPR 2026Bridging the Perception Gap in Image Super-Resolution Evaluation
• NeurIPS 2025Adaptive Distraction: Probing LLM Contextual Robustness with Automated Tree Search
• ICML 2025AKRMap: Adaptive Kernel Regression for Trustworthy Visualization of Cross-Modal Embeddings
• ICLR 2025On Speeding Up Language Model Evaluation
• CVPR 2025ODE: Open-Set Evaluation of Hallucinations in Multimodal Large Language Models
• NeurIPS 2024Accuracy is Not All You Need
• ICML 2024A Fine-grained Analysis of Fitted Q-evaluation: Beyond Parametric Models
• ICLR 2024BatchPrompt: Accomplish more with less
• CVPR 2024Animating General Image with Large Visual Motion Model
• NeurIPS 2023AQuA: A Benchmarking Tool for Label Quality Assessment
• ICML 2023Regions of Reliability in the Evaluation of Multivariate Probabilistic Forecasts
• ICLR 2023Beyond calibration: estimating the grouping loss of modern neural networks
• CVPR 2023GeneCIS: A Benchmark for General Conditional Image Similarity
• NeurIPS 2026AMUSE: Anytime Muon with Stable Gradient Evaluation
• ICML 2026A Two-Tier Perspective on Inference-Time Parallelism in Multi-Agent LLM Systems
• ICLR 2026Choices Speak Louder than Questions
• CVPR 2026Towards Reliable Evaluation of Adversarial Robustness for Spiking Neural Networks

All General ML · evaluation papers

230 papers, page 4 of 5

151. ICML 2026Tempora: Characterising the Time-Contingent Utility of Online Test-Time Adaptation
152. ICML 2026The Abstraction Gap in Vision-Language Causal Reasoning
153. ICML 2026The Consistency Dilemma in LLMs: Generator-Evaluator Agreement and Vulnerability to Mistakes
154. ICML 2026The Relative Instability of Model Comparison with Cross-validation
155. ICML 2026Thinking in Structures: Evaluating Spatial Intelligence in Constraint-Governed Spaces
156. ICML 2026Towards a Science of AI Agent Reliability
157. ICML 2026TritonGym: A Benchmark for Agentic LLM Workflows in Triton GPU Code Generation
158. ICML 2026Uncovering Competency Gaps in Large Language Models and Their Benchmarks
159. ICML 2026UniCode: Augmenting Evaluation for Code Reasoning
160. ICML 2026Unison: Benchmarking Unified Multimodal Models via Synergistic Understanding and Generation
161. ICML 2026Unveiling Multi-regime Patterns in SciML: Distinct Failure Modes and Regime-specific Optimization
162. ICML 2026VenusBench-Mobile: A Challenging and User-Centric Benchmark for Mobile GUI Agents with Capability Diagnostics
163. ICML 2026VeRO: A Harness for Agents to Optimize Agents
164. ICML 2026Vision2Web: A Hierarchical Benchmark for Visual Website Development with Agent Verification
165. ICML 2026VisualPuzzles: Decoupling Multimodal Reasoning Evaluation from Domain Knowledge
166. ICML 2026VLA-Arena: An Open-Source Framework for Benchmarking Vision-Language-Action Models
167. ICML 2026VocSim A Training-free Benchmark for Zero-shot Content Identity in Single-source Audio
168. ICML 2026VT-Bench: A Unified Benchmark for Visual-Tabular Multi-Modal Learning
169. ICML 2026What Language is This? Ask Your Tokenizer.
170. ICML 2026When AI Benchmarks Plateau: A Systematic Study of Benchmark Saturation
171. ICML 2026When Can We Trust Survival Model Evaluation ?
172. ICML 2026WISE: World Knowledge-Informed Semantic Evaluation for Text-to-Image Generation
173. ICML 2026ZeroBench: An Impossible Visual Benchmark for Contemporary Large Multimodal Models
174. NeurIPS 2026A general kernel framework for non-CND distance measures using $|\mathcal{D}|$-dimensional sparse landmark embeddings
175. NeurIPS 2026A Reproducible Evaluation Protocol for Quantum Non-Linearity in Variational Quantum Models
176. NeurIPS 2026A Systematic Evaluation of Co-folding Model Representations for Small-Molecule Learning
177. NeurIPS 2026A systematic evaluation of vision-language models for observational astronomical reasoning tasks
178. NeurIPS 2026Agentick: A Unified Benchmark for General Sequential Decision-Making Agents
179. NeurIPS 2026AI Construct Lexis: An Ontology of the Hidden Assumptions in AI Evaluation
180. NeurIPS 2026AMUSE: Anytime Muon with Stable Gradient Evaluation
181. NeurIPS 2026Auditing Single-Query Recoverability in Self-Supervised Representations
182. NeurIPS 2026BenchRep-T: A Systematic Evaluation of T-Cell Repertoire-Based Disease Diagnostics
183. NeurIPS 2026Beyond IID: How General Are Tabular Foundation Models, Really?
184. NeurIPS 2026Closed-Form Implicit Neural Representations
185. NeurIPS 2026DD-Ranking: Rethinking the Evaluation of Dataset Distillation
186. NeurIPS 2026DiagEval: Trajectory-Conditioned Diagnosis for Reliable Software Evaluation with GUI Agents
187. NeurIPS 2026DiffScore: Text Evaluation Beyond Autoregressive Likelihood
188. NeurIPS 2026DynaCell: an Evaluation Framework for Dynamic 3D Virtual Staining of Live Cells
189. NeurIPS 2026EvalAwareBench: A Benchmark for Measuring Evaluation Awareness in Frontier Language Models
190. NeurIPS 2026EVALUATION CARDS: An Interpretive Layer for AI Evaluation Reporting
191. NeurIPS 2026Evaluation of Visual Processing Should Be Human-Centered, Not Metric-Centered
192. NeurIPS 2026Faithfulness Metrics Don't Measure Faithfulness: A Meta-Evaluation with Ground Truth
193. NeurIPS 2026Finding Koopman Invariant Subspaces via Personalized PageRank
194. NeurIPS 2026From Contexts to Conditionals: Statistical Self-Consistency of Persona Prompting
195. NeurIPS 2026GenAI Evaluation Results are Largely Artifacts of Evaluation Design Choices: Evidence from Audit Studies of Resume Screening
196. NeurIPS 2026General Agent Evaluation
197. NeurIPS 2026GISA: A Benchmark for General Information-Seeking Assistant
198. NeurIPS 2026GPA: General Principled Framework for Linearizing Softmax Attention via KV Cache Approximation
199. NeurIPS 2026Harness the Memory: A Holistic Evaluation of Memory Substrates in Memory Agents
200. NeurIPS 2026IDEAFix: Evaluation Framework for Creative Defixation Prompting in LLMs

FAQ

How many General ML · evaluation papers were published at NeurIPS, ICLR, ICML and CVPR from 2023 to 2026?

606 in total: 53 in 2023, 115 in 2024, 208 in 2025, 230 in 2026.

How many General ML · evaluation papers are at NeurIPS 2026?

NeurIPS 2026 has 57 General ML · evaluation papers, versus 124 the year before.

How many General ML · evaluation papers are at ICLR 2026?

ICLR 2026 has 19 General ML · evaluation papers, versus 19 the year before.

How many General ML · evaluation papers are at ICML 2026?

ICML 2026 has 148 General ML · evaluation papers, versus 58 the year before.

How many General ML · evaluation papers are at CVPR 2026?

CVPR 2026 has 6 General ML · evaluation papers, versus 7 the year before.

Which conference publishes the most General ML · evaluation papers?

NeurIPS, with 270 papers from 2023 to 2026.