Human Evaluation papers, 2023–2026
Human eval protocols
Scope: NeurIPS, ICLR, ICML and CVPR, 2023–2026. 271 papers are tagged with this topic.
Key findings
- Human Evaluation went from 33 papers in 2023 to 108 in 2026, roughly 3.3x in three years.
- NeurIPS publishes the most Human Evaluation work: 90 papers from 2023 to 2026, 33% of the four-venue total.
- The fastest-growing overlap is with Datasets and Benchmarks: papers tagged with both rose from 3 in 2023 to 31 in 2026.
- Among the 5 topics under Evaluation and Benchmarks, it ranks #3 by 2026 paper count; the fastest grower in the group, LLM Benchmarks, is up 154x versus 3.3x here.
Papers per venue
Counts by year and venue
| Year | NeurIPS | ICLR | ICML | CVPR | Total |
|---|---|---|---|---|---|
| 2023 | 9 | 6 | 1 | 17 | 33 |
| 2024 | 25 | 11 | 13 | 21 | 70 |
| 2025 | 17 | 16 | 14 | 13 | 60 |
| 2026 | 39 | 29 | 21 | 19 | 108 |
Representative papers
Spread across years and venues so every edition shows up
- NeurIPS 2026Ad-Hoc Teamwork from Human Demonstrations
- ICML 2026SWE-IF: Aligning Code Evaluation with Human Preference
- ICLR 2026Human-LLM Collaborative Feature Engineering for Tabular Data
- CVPR 2026Bridging Human Evaluation to Infrared and Visible Image Fusion
- NeurIPS 2025Deep Edge Filter: Return of the Human-Crafted Layer in Deep Learning
- ICML 2025Position: When Incentives Backfire, Data Stops Being Human
- ICLR 2025Eliciting Human Preferences with Language Models
- CVPR 2025DynPose: Largely Improving the Efficiency of Human Pose Estimation by a Simple Dynamic Framework
- NeurIPS 2024DART-Eval: A Comprehensive DNA Language Model Evaluation Benchmark on Regulatory DNA
- ICML 2024A Fine-grained Analysis of Fitted Q-evaluation: Beyond Parametric Models
- ICLR 2024Human Feedback is not Gold Standard
- CVPR 2024LocLLM: Exploiting Generalizable Human Keypoint Localization via Large Language Model
- NeurIPS 2023Privacy Assessment on Reconstructed Images: Are Existing Evaluation Metrics Faithful to Human Perception?
- ICML 2023Regions of Reliability in the Evaluation of Multivariate Probabilistic Forecasts
- ICLR 2023Beyond calibration: estimating the grouping loss of modern neural networks
- CVPR 20233D Human Keypoints Estimation From Point Clouds in the Wild Without Human Labels
- NeurIPS 2026AI Construct Lexis: An Ontology of the Hidden Assumptions in AI Evaluation
- ICML 2026Rethinking Evaluation Paradigms in IBP-based Certified Training
- ICLR 2026Multi-turn Evaluation of Anthropomorphic Behaviours in Large Language Models
- CVPR 2026Ground Reaction Inertial Poser Physics-based Human Motion Capture from Sparse
All Human Evaluation papers
271 papers, page 6 of 6
- CVPR 2023Scene-Aware Egocentric 3D Human Pose Estimation
- CVPR 2023Sketch2Saliency: Learning To Detect Salient Objects From Human Drawings
- CVPR 2023Toward Verifiable and Reproducible Human Evaluation for Text-to-Image Generation
- CVPR 2023UniHCP: A Unified Model for Human-Centric Perceptions
- CVPR 2023X-Avatar: Expressive Human Avatars
- ICLR 2023Beyond calibration: estimating the grouping loss of modern neural networks
- ICLR 2023Dr.Spider: A Diagnostic Evaluation Benchmark towards Text-to-SQL Robustness
- ICLR 2023Human-Guided Fair Classification for Natural Language Processing
- ICLR 2023Humanly Certifying Superhuman Classifiers
- ICLR 2023The Role of ImageNet Classes in Fréchet Inception Distance
- ICLR 2023Words are all you need? Language as an approximation for human similarity judgments
- ICML 2023Regions of Reliability in the Evaluation of Multivariate Probabilistic Forecasts
- NeurIPS 2023A Comprehensive Benchmark for Neural Human Radiance Fields
- NeurIPS 2023Aligning Synthetic Medical Images with Clinical Knowledge using Human Feedback
- NeurIPS 2023Automated Classification of Model Errors on ImageNet
- NeurIPS 2023Holistic Evaluation of Text-to-Image Models
- NeurIPS 2023How Far Can Camels Go? Exploring the State of Instruction Tuning on Open Resources
- NeurIPS 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arena
- NeurIPS 2023Off-Policy Evaluation for Human Feedback
- NeurIPS 2023Privacy Assessment on Reconstructed Images: Are Existing Evaluation Metrics Faithful to Human Perception?
- NeurIPS 2023Statistical Knowledge Assessment for Large Language Models
Ask about this trend from Claude or Cursor
Connect the Paperlist MCP and your assistant can pull the numbers on this page while you draft a survey, pick a direction or plan a submission: papers per year and venue, growth, the fastest-rising sub-themes and representative papers, shaped around your question.
Copy this prompt into your assistant
Use paperlist to show how Human Evaluation papers grew at NeurIPS from 2023 to 2026, and which year jumped the most.
Tool the assistant calls: get_topic_stats {"topic": "human-evaluation"}
Set up Paperlist MCP in two minutes (Claude Code, Cursor, Codex, ChatGPT)
FAQ
- How many Human Evaluation papers were published at NeurIPS, ICLR, ICML and CVPR from 2023 to 2026?
- 271 in total: 33 in 2023, 70 in 2024, 60 in 2025, 108 in 2026.
- How many Human Evaluation papers are at NeurIPS 2026?
- NeurIPS 2026 has 39 Human Evaluation papers, versus 17 the year before.
- How many Human Evaluation papers are at ICLR 2026?
- ICLR 2026 has 29 Human Evaluation papers, versus 16 the year before.
- How many Human Evaluation papers are at ICML 2026?
- ICML 2026 has 21 Human Evaluation papers, versus 14 the year before.
- How many Human Evaluation papers are at CVPR 2026?
- CVPR 2026 has 19 Human Evaluation papers, versus 13 the year before.
- Which conference publishes the most Human Evaluation papers?
- NeurIPS, with 90 papers from 2023 to 2026.