Human Evaluation papers, 2023–2026

Key findings

• Human Evaluation went from 33 papers in 2023 to 108 in 2026, roughly 3.3x in three years.
• NeurIPS publishes the most Human Evaluation work: 90 papers from 2023 to 2026, 33% of the four-venue total.
• The fastest-growing overlap is with Datasets and Benchmarks: papers tagged with both rose from 3 in 2023 to 31 in 2026.
• Among the 5 topics under Evaluation and Benchmarks, it ranks #3 by 2026 paper count; the fastest grower in the group, LLM Benchmarks, is up 154x versus 3.3x here.

Representative papers

Spread across years and venues so every edition shows up

• NeurIPS 2026Ad-Hoc Teamwork from Human Demonstrations
• ICML 2026SWE-IF: Aligning Code Evaluation with Human Preference
• ICLR 2026Human-LLM Collaborative Feature Engineering for Tabular Data
• CVPR 2026Bridging Human Evaluation to Infrared and Visible Image Fusion
• NeurIPS 2025Deep Edge Filter: Return of the Human-Crafted Layer in Deep Learning
• ICML 2025Position: When Incentives Backfire, Data Stops Being Human
• ICLR 2025Eliciting Human Preferences with Language Models
• CVPR 2025DynPose: Largely Improving the Efficiency of Human Pose Estimation by a Simple Dynamic Framework
• NeurIPS 2024DART-Eval: A Comprehensive DNA Language Model Evaluation Benchmark on Regulatory DNA
• ICML 2024A Fine-grained Analysis of Fitted Q-evaluation: Beyond Parametric Models
• ICLR 2024Human Feedback is not Gold Standard
• CVPR 2024LocLLM: Exploiting Generalizable Human Keypoint Localization via Large Language Model
• NeurIPS 2023Privacy Assessment on Reconstructed Images: Are Existing Evaluation Metrics Faithful to Human Perception?
• ICML 2023Regions of Reliability in the Evaluation of Multivariate Probabilistic Forecasts
• ICLR 2023Beyond calibration: estimating the grouping loss of modern neural networks
• CVPR 20233D Human Keypoints Estimation From Point Clouds in the Wild Without Human Labels
• NeurIPS 2026AI Construct Lexis: An Ontology of the Hidden Assumptions in AI Evaluation
• ICML 2026Rethinking Evaluation Paradigms in IBP-based Certified Training
• ICLR 2026Multi-turn Evaluation of Anthropomorphic Behaviours in Large Language Models
• CVPR 2026Ground Reaction Inertial Poser Physics-based Human Motion Capture from Sparse

All Human Evaluation papers

70 papers, page 1 of 2

1. CVPR 20243D Human Pose Perception from Egocentric Stereo Videos
2. CVPR 2024Can Biases in ImageNet Models Explain Generalization?
3. CVPR 2024CG-HOI: Contact-Guided 3D Human-Object Interaction Generation
4. CVPR 2024GPT-4V(ision) is a Human-Aligned Evaluator for Text-to-3D Generation
5. CVPR 2024HIT: Estimating Internal Human Implicit Tissues from the Body Surface
6. CVPR 2024HIVE: Harnessing Human Feedback for Instructional Visual Editing
7. CVPR 2024HOIAnimator: Generating Text-prompt Human-object Animations using Novel Perceptive Diffusion Models
8. CVPR 2024Inter-X: Towards Versatile Human-Human Interaction Analysis
9. CVPR 2024Learning Multi-Dimensional Human Preference for Text-to-Image Generation
10. CVPR 2024LEMON: Learning 3D Human-Object Interaction Relation from 2D Images
11. CVPR 2024LocLLM: Exploiting Generalizable Human Keypoint Localization via Large Language Model
12. CVPR 2024MaGGIe: Masked Guided Gradual Human Instance Matting
13. CVPR 2024NECA: Neural Customizable Human Avatar
14. CVPR 2024PhotoMaker: Customizing Realistic Human Photos via Stacked ID Embedding
15. CVPR 2024Polos: Multimodal Metric Learning from Human Feedback for Image Captioning
16. CVPR 2024Rethinking FID: Towards a Better Evaluation Metric for Image Generation
17. CVPR 2024RLHF-V: Towards Trustworthy MLLMs via Behavior Alignment from Fine-grained Correctional Human Feedback
18. CVPR 2024SiTH: Single-view Textured Human Reconstruction with Image-Conditioned Diffusion
19. CVPR 2024Spectrum AUC Difference (SAUCD): Human-aligned 3D Shape Evaluation
20. CVPR 2024TexVocab: Texture Vocabulary-conditioned Human Avatars
21. CVPR 2024Towards a Perceptual Evaluation Framework for Lighting Estimation
22. ICLR 2024Can LLMs Express Their Uncertainty? An Empirical Evaluation of Confidence Elicitation in LLMs
23. ICLR 2024Does Writing with Language Models Reduce Content Diversity?
24. ICLR 2024Evaluating Large Language Models at Evaluating Instruction Following
25. ICLR 2024FLASK: Fine-grained Language Model Evaluation based on Alignment Skill Sets
26. ICLR 2024Foundation Model-oriented Robustness: Robust Image Model Evaluation with Pretrained Models
27. ICLR 2024Human Feedback is not Gold Standard
28. ICLR 2024Identifying the Risks of LM Agents with an LM-Emulated Sandbox
29. ICLR 2024MT-Ranker: Reference-free machine translation evaluation by inter-system ranking
30. ICLR 2024On the Humanity of Conversational AI: Evaluating the Psychological Portrayal of LLMs
31. ICLR 2024Towards Diverse Behaviors: A Benchmark for Imitation Learning with Human Demonstrations
32. ICLR 2024Unified Human-Scene Interaction via Prompted Chain-of-Contacts
33. ICML 2024A Fine-grained Analysis of Fitted Q-evaluation: Beyond Parametric Models
34. ICML 2024AutoOS: Make Your OS More Powerful by Exploiting Large Language Models
35. ICML 2024Chatbot Arena: An Open Platform for Evaluating LLMs by Human Preference
36. ICML 2024Evaluation of Trajectory Distribution Predictions with Energy Score
37. ICML 2024Human-like Category Learning by Injecting Ecological Priors from Large Language Models into Neural Networks
38. ICML 2024Kernel-Based Evaluation of Conditional Biological Sequence Models
39. ICML 2024ODIN: Disentangled Reward Mitigates Hacking in RLHF
40. ICML 2024On the Calibration of Human Pose Estimation
41. ICML 2024Open-Domain Text Evaluation via Contrastive Distribution Methods
42. ICML 2024PerceptAnon: Exploring the Human Perception of Image Anonymization Beyond Pseudonymization for GDPR
43. ICML 2024Rethinking Generative Large Language Model Evaluation for Semantic Comprehension
44. ICML 2024Stability Evaluation through Distributional Perturbation Analysis
45. ICML 2024Using AI Uncertainty Quantification to Improve Human Decision-Making
46. NeurIPS 2024A Large-Scale Human-Centric Benchmark for Referring Expression Comprehension in the LMM Era
47. NeurIPS 2024ALI-Agent: Assessing LLMs' Alignment with Human Values via Agent-based Evaluation
48. NeurIPS 2024Apathetic or Empathetic? Evaluating LLMs' Emotional Alignments with Humans
49. NeurIPS 2024Are Large Language Models Good Statisticians?
50. NeurIPS 2024Benchmarking Complex Instruction-Following with Multiple Constraints Composition

FAQ

How many Human Evaluation papers were published at NeurIPS, ICLR, ICML and CVPR from 2023 to 2026?

271 in total: 33 in 2023, 70 in 2024, 60 in 2025, 108 in 2026.

How many Human Evaluation papers are at NeurIPS 2026?

NeurIPS 2026 has 39 Human Evaluation papers, versus 17 the year before.

How many Human Evaluation papers are at ICLR 2026?

ICLR 2026 has 29 Human Evaluation papers, versus 16 the year before.

How many Human Evaluation papers are at ICML 2026?

ICML 2026 has 21 Human Evaluation papers, versus 14 the year before.

How many Human Evaluation papers are at CVPR 2026?

CVPR 2026 has 19 Human Evaluation papers, versus 13 the year before.

Which conference publishes the most Human Evaluation papers?

NeurIPS, with 90 papers from 2023 to 2026.