Human Evaluation papers, 2023–2026

Key findings

• Human Evaluation went from 33 papers in 2023 to 108 in 2026, roughly 3.3x in three years.
• NeurIPS publishes the most Human Evaluation work: 90 papers from 2023 to 2026, 33% of the four-venue total.
• The fastest-growing overlap is with Datasets and Benchmarks: papers tagged with both rose from 3 in 2023 to 31 in 2026.
• Among the 5 topics under Evaluation and Benchmarks, it ranks #3 by 2026 paper count; the fastest grower in the group, LLM Benchmarks, is up 154x versus 3.3x here.

Representative papers

Spread across years and venues so every edition shows up

• NeurIPS 2026Ad-Hoc Teamwork from Human Demonstrations
• ICML 2026SWE-IF: Aligning Code Evaluation with Human Preference
• ICLR 2026Human-LLM Collaborative Feature Engineering for Tabular Data
• CVPR 2026Bridging Human Evaluation to Infrared and Visible Image Fusion
• NeurIPS 2025Deep Edge Filter: Return of the Human-Crafted Layer in Deep Learning
• ICML 2025Position: When Incentives Backfire, Data Stops Being Human
• ICLR 2025Eliciting Human Preferences with Language Models
• CVPR 2025DynPose: Largely Improving the Efficiency of Human Pose Estimation by a Simple Dynamic Framework
• NeurIPS 2024DART-Eval: A Comprehensive DNA Language Model Evaluation Benchmark on Regulatory DNA
• ICML 2024A Fine-grained Analysis of Fitted Q-evaluation: Beyond Parametric Models
• ICLR 2024Human Feedback is not Gold Standard
• CVPR 2024LocLLM: Exploiting Generalizable Human Keypoint Localization via Large Language Model
• NeurIPS 2023Privacy Assessment on Reconstructed Images: Are Existing Evaluation Metrics Faithful to Human Perception?
• ICML 2023Regions of Reliability in the Evaluation of Multivariate Probabilistic Forecasts
• ICLR 2023Beyond calibration: estimating the grouping loss of modern neural networks
• CVPR 20233D Human Keypoints Estimation From Point Clouds in the Wild Without Human Labels
• NeurIPS 2026AI Construct Lexis: An Ontology of the Hidden Assumptions in AI Evaluation
• ICML 2026Rethinking Evaluation Paradigms in IBP-based Certified Training
• ICLR 2026Multi-turn Evaluation of Anthropomorphic Behaviours in Large Language Models
• CVPR 2026Ground Reaction Inertial Poser Physics-based Human Motion Capture from Sparse

All Human Evaluation papers

271 papers, page 4 of 6

151. ICML 2025Raising the Bar: Investigating the Values of Large Language Models via Generative Evolving Testing
152. NeurIPS 2025A Principled Path to Fitted Distributional Evaluation
153. NeurIPS 2025AGENTIF: Benchmarking Large Language Models Instruction Following Ability in Agentic Scenarios
154. NeurIPS 2025AI Debate Aids Assessment of Controversial Claims
155. NeurIPS 2025Beyond the Surface: Enhancing LLM-as-a-Judge Alignment with Human via Internal Representations
156. NeurIPS 2025Can Large Language Models Master Complex Card Games?
157. NeurIPS 2025Can LLMs Outshine Conventional Recommenders? A Comparative Evaluation
158. NeurIPS 2025Clean First, Align Later: Benchmarking Preference Data Cleaning for Reliable LLM Alignment
159. NeurIPS 2025Consistently Simulating Human Personas with Multi-Turn Reinforcement Learning
160. NeurIPS 2025Deep Edge Filter: Return of the Human-Crafted Layer in Deep Learning
161. NeurIPS 2025Don’t call it privacy-preserving or human-centric pose estimation if you don’t measure privacy
162. NeurIPS 2025Handling Missing Responses under Cluster Dependence with Applications to Language Model Evaluation
163. NeurIPS 2025Learning Human-Like RL Agents Through Trajectory Optimization With Action Quantization
164. NeurIPS 2025Tackling Biased Evaluators in Dueling Bandits
165. NeurIPS 2025Toward Human Deictic Gesture Target Estimation
166. NeurIPS 2025Toward Interpretable Evaluation Measures for Time Series Segmentation
167. NeurIPS 2025What's Producible May Not Be Reachable: Measuring the Steerability of Generative Models
168. NeurIPS 2025Words That Unite The World: A Unified Framework for Deciphering Central Bank Communications
169. CVPR 20243D Human Pose Perception from Egocentric Stereo Videos
170. CVPR 2024Can Biases in ImageNet Models Explain Generalization?
171. CVPR 2024CG-HOI: Contact-Guided 3D Human-Object Interaction Generation
172. CVPR 2024GPT-4V(ision) is a Human-Aligned Evaluator for Text-to-3D Generation
173. CVPR 2024HIT: Estimating Internal Human Implicit Tissues from the Body Surface
174. CVPR 2024HIVE: Harnessing Human Feedback for Instructional Visual Editing
175. CVPR 2024HOIAnimator: Generating Text-prompt Human-object Animations using Novel Perceptive Diffusion Models
176. CVPR 2024Inter-X: Towards Versatile Human-Human Interaction Analysis
177. CVPR 2024Learning Multi-Dimensional Human Preference for Text-to-Image Generation
178. CVPR 2024LEMON: Learning 3D Human-Object Interaction Relation from 2D Images
179. CVPR 2024LocLLM: Exploiting Generalizable Human Keypoint Localization via Large Language Model
180. CVPR 2024MaGGIe: Masked Guided Gradual Human Instance Matting
181. CVPR 2024NECA: Neural Customizable Human Avatar
182. CVPR 2024PhotoMaker: Customizing Realistic Human Photos via Stacked ID Embedding
183. CVPR 2024Polos: Multimodal Metric Learning from Human Feedback for Image Captioning
184. CVPR 2024Rethinking FID: Towards a Better Evaluation Metric for Image Generation
185. CVPR 2024RLHF-V: Towards Trustworthy MLLMs via Behavior Alignment from Fine-grained Correctional Human Feedback
186. CVPR 2024SiTH: Single-view Textured Human Reconstruction with Image-Conditioned Diffusion
187. CVPR 2024Spectrum AUC Difference (SAUCD): Human-aligned 3D Shape Evaluation
188. CVPR 2024TexVocab: Texture Vocabulary-conditioned Human Avatars
189. CVPR 2024Towards a Perceptual Evaluation Framework for Lighting Estimation
190. ICLR 2024Can LLMs Express Their Uncertainty? An Empirical Evaluation of Confidence Elicitation in LLMs
191. ICLR 2024Does Writing with Language Models Reduce Content Diversity?
192. ICLR 2024Evaluating Large Language Models at Evaluating Instruction Following
193. ICLR 2024FLASK: Fine-grained Language Model Evaluation based on Alignment Skill Sets
194. ICLR 2024Foundation Model-oriented Robustness: Robust Image Model Evaluation with Pretrained Models
195. ICLR 2024Human Feedback is not Gold Standard
196. ICLR 2024Identifying the Risks of LM Agents with an LM-Emulated Sandbox
197. ICLR 2024MT-Ranker: Reference-free machine translation evaluation by inter-system ranking
198. ICLR 2024On the Humanity of Conversational AI: Evaluating the Psychological Portrayal of LLMs
199. ICLR 2024Towards Diverse Behaviors: A Benchmark for Imitation Learning with Human Demonstrations
200. ICLR 2024Unified Human-Scene Interaction via Prompted Chain-of-Contacts

FAQ

How many Human Evaluation papers were published at NeurIPS, ICLR, ICML and CVPR from 2023 to 2026?

271 in total: 33 in 2023, 70 in 2024, 60 in 2025, 108 in 2026.

How many Human Evaluation papers are at NeurIPS 2026?

NeurIPS 2026 has 39 Human Evaluation papers, versus 17 the year before.

How many Human Evaluation papers are at ICLR 2026?

ICLR 2026 has 29 Human Evaluation papers, versus 16 the year before.

How many Human Evaluation papers are at ICML 2026?

ICML 2026 has 21 Human Evaluation papers, versus 14 the year before.

How many Human Evaluation papers are at CVPR 2026?

CVPR 2026 has 19 Human Evaluation papers, versus 13 the year before.

Which conference publishes the most Human Evaluation papers?

NeurIPS, with 90 papers from 2023 to 2026.