General ML · evaluation papers, 2023–2026

Key findings

• General ML · evaluation went from 53 papers in 2023 to 230 in 2026, roughly 4.3x in three years.
• NeurIPS publishes the most General ML · evaluation work: 270 papers from 2023 to 2026, 45% of the four-venue total.
• The fastest-growing overlap is with AI Agents: papers tagged with both rose from 0 in 2023 to 47 in 2026.
• Among the 6 topics under General Machine Learning, it ranks #4 by 2026 paper count; the fastest grower in the group, General ML · reinforcement learning, is up 2.0x versus 4.3x here.

Representative papers

Spread across years and venues so every edition shows up

• NeurIPS 2026AI Construct Lexis: An Ontology of the Hidden Assumptions in AI Evaluation
• ICML 2026A Computational Framework for Evaluating Human-likeness in LLMs' Open-ended Human Behaviors
• ICLR 2026Unlearning Evaluation through Subset Statistical Independence
• CVPR 2026Bridging the Perception Gap in Image Super-Resolution Evaluation
• NeurIPS 2025Adaptive Distraction: Probing LLM Contextual Robustness with Automated Tree Search
• ICML 2025AKRMap: Adaptive Kernel Regression for Trustworthy Visualization of Cross-Modal Embeddings
• ICLR 2025On Speeding Up Language Model Evaluation
• CVPR 2025ODE: Open-Set Evaluation of Hallucinations in Multimodal Large Language Models
• NeurIPS 2024Accuracy is Not All You Need
• ICML 2024A Fine-grained Analysis of Fitted Q-evaluation: Beyond Parametric Models
• ICLR 2024BatchPrompt: Accomplish more with less
• CVPR 2024Animating General Image with Large Visual Motion Model
• NeurIPS 2023AQuA: A Benchmarking Tool for Label Quality Assessment
• ICML 2023Regions of Reliability in the Evaluation of Multivariate Probabilistic Forecasts
• ICLR 2023Beyond calibration: estimating the grouping loss of modern neural networks
• CVPR 2023GeneCIS: A Benchmark for General Conditional Image Similarity
• NeurIPS 2026AMUSE: Anytime Muon with Stable Gradient Evaluation
• ICML 2026A Two-Tier Perspective on Inference-Time Parallelism in Multi-Agent LLM Systems
• ICLR 2026Choices Speak Louder than Questions
• CVPR 2026Towards Reliable Evaluation of Adversarial Robustness for Spiking Neural Networks

All General ML · evaluation papers

606 papers, page 3 of 13

101. ICML 2026Identifying Learnwares via Reduced Neural Conditional Mean Embedding
102. ICML 2026Inference from Quantized Data via Normal Variance-Mean Mixtures
103. ICML 2026Instance-Level Costs for Nuanced Classifier Evaluation
104. ICML 2026InteractBench: Benchmarking LLMs on Competitive Programming under Unrevealed Information
105. ICML 2026Is Graph Mixup Beneficial? Investigating Interpolation And Empirical Performance of Graph Mixup Methods
106. ICML 2026Is Your Diffusion Sampler Actually Correct? A Sampler-Centric Evaluation of Discrete Diffusion Language Models
107. ICML 2026Item Response Scaling Laws: A Measurement Theory Approach for Efficient and Generalizable Neural Scaling Estimation
108. ICML 2026iWorld-Bench: A Benchmark for Interactive World Models with a Unified Action Generation Framework
109. ICML 2026Judging What We Cannot Solve: A Consequence-Based Approach for Oracle-Free Evaluation of Research-Level Math
110. ICML 2026KAGE-Bench: Fast Known-Axis Visual Generalization Evaluation for Reinforcement Learning
111. ICML 2026KernelCraft: Benchmarking for Agentic Close-to-Metal Kernel Generation on Emerging Hardware
112. ICML 2026L-CUBE: Isolating Long-Context Capacity from Knowledge with Controllable Mutual Information Scaling
113. ICML 2026Leaderboard Incentives: Model Rankings under Strategic Post-Training
114. ICML 2026Linguistic Nepotism: Trading-off Quality for Language Preference in Multilingual RAG
115. ICML 2026LiveOIBench: Can Large Language Models Outperform Human Contestants in Informatics Olympiads?
116. ICML 2026LOCA-bench: Benchmarking Language Agents Under Controllable and Extreme Context Growth
117. ICML 2026LoRe: Adaptive Interaction-Evaluation Routing with Per-step Interaction Budgets for Iterative Graph Solvers
118. ICML 2026Lost in Context: Adressing Context Anxiety in Large Language Models
119. ICML 2026Measuring Intent Comprehension in LLMs
120. ICML 2026MECAT: A Multi-Experts Constructed Benchmark for Fine-Grained Audio Understanding Tasks
121. ICML 2026MemoryBench: A Benchmark for Memory and Continual Learning in LLM Systems
122. ICML 2026MGAL: A Multilingual Granularity-Aware Long-Context Benchmark
123. ICML 2026MiniAppBench: Evaluating the Shift from Text to Interactive HTML Responses in LLM-Powered Assistants
124. ICML 2026MLUBench: A Benchmark for Lifelong Unlearning Evaluation in MLLMs
125. ICML 2026MMBench-Live: A Continuously Evolving Benchmark for Multimodal Models
126. ICML 2026MVI-Bench: A Comprehensive Benchmark for Evaluating Robustness to Misleading Visual Inputs in LVLMs
127. ICML 2026Neuromem: A Granular Decomposition of the Streaming Lifecycle in External Memory for LLMs
128. ICML 2026Nonparametric LLM Evaluation from Preference Data
129. ICML 2026Off-Policy Evaluation with Strategic Agents via Local Disclosure
130. ICML 2026Omitted Variable Bias in Language Models Under Distribution Shift
131. ICML 2026On Stable Long-Form Generation: Benchmarking and Mitigating Length Volatility
132. ICML 2026ORLoopBench: Solver-in-the-Loop Benchmarks for Self-Correction and Behavioral Rationality in Operations Research
133. ICML 2026Prescriptive Scaling Reveals the Evolution of Language Model Capabilities
134. ICML 2026Probing the Knowledge Boundary: An Interactive Agentic Framework for Deep Knowledge Extraction
135. ICML 2026QiMeng-LibBench: Benchmarking LLM Agents for Library-Scale Cross-Architecture Migration
136. ICML 2026Quantifying Frontier LLM Capabilities for Container Sandbox Escape
137. ICML 2026Query-efficient model evaluation using cached responses
138. ICML 2026Realizable Bayes-Consistency for General Metric Losses
139. ICML 2026Reasoning Models Are Test Exploiters: Rethinking Multiple Choice
140. ICML 2026REG: In-Sample RL via Regularizing the Evaluation Gap
141. ICML 2026Rethinking Evaluation Paradigms in IBP-based Certified Training
142. ICML 2026Revisiting the Platonic Representation Hypothesis: An Aristotelian View
143. ICML 2026Routing and Reasoned Evaluation with Large Language Models
144. ICML 2026SciAgentGym: Benchmarking Multi-Step Scientific Tool-Use in LLM Agents
145. ICML 2026SEDRAS: Symbolically Evaluated Deep Research And Science
146. ICML 2026ShapCCS: Shapley-Driven Client Coreset Selection in Federated Learning
147. ICML 2026STABLEVAL: Disagreement-Aware and Stable Evaluation of AI Systems
148. ICML 2026Strategic Navigation or Stochastic Search? How Agents and Humans Reason Over Document Collections
149. ICML 2026Systematic Failures in Collective Reasoning under Distributed Information in Multi-Agent LLMs
150. ICML 2026TadA-Bench: A Million-Variant Benchmark for Future-Round Discovery Toward Agentic Protein Engineering

FAQ

How many General ML · evaluation papers were published at NeurIPS, ICLR, ICML and CVPR from 2023 to 2026?

606 in total: 53 in 2023, 115 in 2024, 208 in 2025, 230 in 2026.

How many General ML · evaluation papers are at NeurIPS 2026?

NeurIPS 2026 has 57 General ML · evaluation papers, versus 124 the year before.

How many General ML · evaluation papers are at ICLR 2026?

ICLR 2026 has 19 General ML · evaluation papers, versus 19 the year before.

How many General ML · evaluation papers are at ICML 2026?

ICML 2026 has 148 General ML · evaluation papers, versus 58 the year before.

How many General ML · evaluation papers are at CVPR 2026?

CVPR 2026 has 6 General ML · evaluation papers, versus 7 the year before.

Which conference publishes the most General ML · evaluation papers?

NeurIPS, with 270 papers from 2023 to 2026.