Human Evaluation papers, 2023–2026

Key findings

• Human Evaluation went from 33 papers in 2023 to 108 in 2026, roughly 3.3x in three years.
• NeurIPS publishes the most Human Evaluation work: 90 papers from 2023 to 2026, 33% of the four-venue total.
• The fastest-growing overlap is with Datasets and Benchmarks: papers tagged with both rose from 3 in 2023 to 31 in 2026.
• Among the 5 topics under Evaluation and Benchmarks, it ranks #3 by 2026 paper count; the fastest grower in the group, LLM Benchmarks, is up 154x versus 3.3x here.

Representative papers

Spread across years and venues so every edition shows up

• NeurIPS 2026Ad-Hoc Teamwork from Human Demonstrations
• ICML 2026SWE-IF: Aligning Code Evaluation with Human Preference
• ICLR 2026Human-LLM Collaborative Feature Engineering for Tabular Data
• CVPR 2026Bridging Human Evaluation to Infrared and Visible Image Fusion
• NeurIPS 2025Deep Edge Filter: Return of the Human-Crafted Layer in Deep Learning
• ICML 2025Position: When Incentives Backfire, Data Stops Being Human
• ICLR 2025Eliciting Human Preferences with Language Models
• CVPR 2025DynPose: Largely Improving the Efficiency of Human Pose Estimation by a Simple Dynamic Framework
• NeurIPS 2024DART-Eval: A Comprehensive DNA Language Model Evaluation Benchmark on Regulatory DNA
• ICML 2024A Fine-grained Analysis of Fitted Q-evaluation: Beyond Parametric Models
• ICLR 2024Human Feedback is not Gold Standard
• CVPR 2024LocLLM: Exploiting Generalizable Human Keypoint Localization via Large Language Model
• NeurIPS 2023Privacy Assessment on Reconstructed Images: Are Existing Evaluation Metrics Faithful to Human Perception?
• ICML 2023Regions of Reliability in the Evaluation of Multivariate Probabilistic Forecasts
• ICLR 2023Beyond calibration: estimating the grouping loss of modern neural networks
• CVPR 20233D Human Keypoints Estimation From Point Clouds in the Wild Without Human Labels
• NeurIPS 2026AI Construct Lexis: An Ontology of the Hidden Assumptions in AI Evaluation
• ICML 2026Rethinking Evaluation Paradigms in IBP-based Certified Training
• ICLR 2026Multi-turn Evaluation of Anthropomorphic Behaviours in Large Language Models
• CVPR 2026Ground Reaction Inertial Poser Physics-based Human Motion Capture from Sparse

All Human Evaluation papers

271 papers, page 5 of 6

201. ICML 2024A Fine-grained Analysis of Fitted Q-evaluation: Beyond Parametric Models
202. ICML 2024AutoOS: Make Your OS More Powerful by Exploiting Large Language Models
203. ICML 2024Chatbot Arena: An Open Platform for Evaluating LLMs by Human Preference
204. ICML 2024Evaluation of Trajectory Distribution Predictions with Energy Score
205. ICML 2024Human-like Category Learning by Injecting Ecological Priors from Large Language Models into Neural Networks
206. ICML 2024Kernel-Based Evaluation of Conditional Biological Sequence Models
207. ICML 2024ODIN: Disentangled Reward Mitigates Hacking in RLHF
208. ICML 2024On the Calibration of Human Pose Estimation
209. ICML 2024Open-Domain Text Evaluation via Contrastive Distribution Methods
210. ICML 2024PerceptAnon: Exploring the Human Perception of Image Anonymization Beyond Pseudonymization for GDPR
211. ICML 2024Rethinking Generative Large Language Model Evaluation for Semantic Comprehension
212. ICML 2024Stability Evaluation through Distributional Perturbation Analysis
213. ICML 2024Using AI Uncertainty Quantification to Improve Human Decision-Making
214. NeurIPS 2024A Large-Scale Human-Centric Benchmark for Referring Expression Comprehension in the LMM Era
215. NeurIPS 2024ALI-Agent: Assessing LLMs' Alignment with Human Values via Agent-based Evaluation
216. NeurIPS 2024Apathetic or Empathetic? Evaluating LLMs' Emotional Alignments with Humans
217. NeurIPS 2024Are Large Language Models Good Statisticians?
218. NeurIPS 2024Benchmarking Complex Instruction-Following with Multiple Constraints Composition
219. NeurIPS 2024BiVLC: Extending Vision-Language Compositionality Evaluation with Text-to-Image Retrieval
220. NeurIPS 2024CoSy: Evaluating Textual Explanations of Neurons
221. NeurIPS 2024DART-Eval: A Comprehensive DNA Language Model Evaluation Benchmark on Regulatory DNA
222. NeurIPS 2024DevBench: A multimodal developmental benchmark for language learning
223. NeurIPS 2024GenAI Arena: An Open Evaluation Platform for Generative Models
224. NeurIPS 2024Interactive Deep Clustering via Value Mining
225. NeurIPS 2024IQA-EVAL: Automatic Evaluation of Human-Model Interactive Question Answering
226. NeurIPS 2024ManiPose: Manifold-Constrained Multi-Hypothesis 3D Human Pose Estimation
227. NeurIPS 2024MixEval: Deriving Wisdom of the Crowd from LLM Benchmark Mixtures
228. NeurIPS 2024Nonparametric Evaluation of Noisy ICA Solutions
229. NeurIPS 2024Overcoming Common Flaws in the Evaluation of Selective Classification Systems
230. NeurIPS 2024Rethinking Human Evaluation Protocol for Text-to-Video Models: Enhancing Reliability, Reproducibility, and Practicality
231. NeurIPS 2024Should We Really Edit Language Models? On the Evaluation of Edited Language Models
232. NeurIPS 2024StackEval: Benchmarking LLMs in Coding Assistance
233. NeurIPS 2024Stratified Prediction-Powered Inference for Effective Hybrid Evaluation of Language Models
234. NeurIPS 2024To Err Like Human: Affective Bias-Inspired Measures for Visual Emotion Recognition Evaluation
235. NeurIPS 2024Towards Robust Multimodal Sentiment Analysis with Incomplete Data
236. NeurIPS 2024Unveiling the Bias Impact on Symmetric Moral Consistency of Large Language Models
237. NeurIPS 2024Weak Supervision Performance Evaluation via Partial Identification
238. NeurIPS 2024WildVision: Evaluating Vision-Language Models in the Wild with Human Preferences
239. CVPR 20233D Human Keypoints Estimation From Point Clouds in the Wild Without Human Labels
240. CVPR 20233D Human Mesh Estimation From Virtual Markers
241. CVPR 2023Beyond mAP: Towards Better Evaluation of Instance Segmentation
242. CVPR 2023Clothed Human Performance Capture With a Double-Layer Neural Radiance Fields
243. CVPR 2023GFPose: Learning 3D Human Pose Prior With Gradient Fields
244. CVPR 2023High-Fidelity 3D Human Digitization From Single 2K Resolution Images
245. CVPR 2023Human Pose As Compositional Tokens
246. CVPR 2023HumanGen: Generating Human Radiance Fields With Explicit Priors
247. CVPR 2023Humans As Light Bulbs: 3D Human Reconstruction From Thermal Reflection
248. CVPR 2023Learning Human Mesh Recovery in 3D Scenes
249. CVPR 2023Listening Human Behavior: 3D Human Pose Estimation With Acoustic Signals
250. CVPR 2023Putting People in Their Place: Affordance-Aware Human Insertion Into Scenes

FAQ

How many Human Evaluation papers were published at NeurIPS, ICLR, ICML and CVPR from 2023 to 2026?

271 in total: 33 in 2023, 70 in 2024, 60 in 2025, 108 in 2026.

How many Human Evaluation papers are at NeurIPS 2026?

NeurIPS 2026 has 39 Human Evaluation papers, versus 17 the year before.

How many Human Evaluation papers are at ICLR 2026?

ICLR 2026 has 29 Human Evaluation papers, versus 16 the year before.

How many Human Evaluation papers are at ICML 2026?

ICML 2026 has 21 Human Evaluation papers, versus 14 the year before.

How many Human Evaluation papers are at CVPR 2026?

CVPR 2026 has 19 Human Evaluation papers, versus 13 the year before.

Which conference publishes the most Human Evaluation papers?

NeurIPS, with 90 papers from 2023 to 2026.