人工评测论文趋势 2023–2026

主要结论

• 人工评测论文从 2023 年的 33 篇增长到 2026 年的 108 篇，三年间扩大到约 3.3 倍。
• NeurIPS 是发人工评测论文最多的会议，2023–2026 年共 90 篇，占四个会议总量的 33%。
• 交叉方向里涨得最快的是数据集与基准：同时属于两个主题的论文从 2023 年的 3 篇增至 2026 年的 31 篇。
• 在「评测与基准」的 5 个主题里，它的 2026 年论文数排第 3；同组增长最快的大模型基准是 154 倍，人工评测是 3.3 倍。

代表论文

按年份和会议均匀挑选，方便快速看到每一届的样貌

• NeurIPS 2026Ad-Hoc Teamwork from Human Demonstrations
• ICML 2026SWE-IF: Aligning Code Evaluation with Human Preference
• ICLR 2026Human-LLM Collaborative Feature Engineering for Tabular Data
• CVPR 2026Bridging Human Evaluation to Infrared and Visible Image Fusion
• NeurIPS 2025Deep Edge Filter: Return of the Human-Crafted Layer in Deep Learning
• ICML 2025Position: When Incentives Backfire, Data Stops Being Human
• ICLR 2025Eliciting Human Preferences with Language Models
• CVPR 2025DynPose: Largely Improving the Efficiency of Human Pose Estimation by a Simple Dynamic Framework
• NeurIPS 2024DART-Eval: A Comprehensive DNA Language Model Evaluation Benchmark on Regulatory DNA
• ICML 2024A Fine-grained Analysis of Fitted Q-evaluation: Beyond Parametric Models
• ICLR 2024Human Feedback is not Gold Standard
• CVPR 2024LocLLM: Exploiting Generalizable Human Keypoint Localization via Large Language Model
• NeurIPS 2023Privacy Assessment on Reconstructed Images: Are Existing Evaluation Metrics Faithful to Human Perception?
• ICML 2023Regions of Reliability in the Evaluation of Multivariate Probabilistic Forecasts
• ICLR 2023Beyond calibration: estimating the grouping loss of modern neural networks
• CVPR 20233D Human Keypoints Estimation From Point Clouds in the Wild Without Human Labels
• NeurIPS 2026AI Construct Lexis: An Ontology of the Hidden Assumptions in AI Evaluation
• ICML 2026Rethinking Evaluation Paradigms in IBP-based Certified Training
• ICLR 2026Multi-turn Evaluation of Anthropomorphic Behaviours in Large Language Models
• CVPR 2026Ground Reaction Inertial Poser Physics-based Human Motion Capture from Sparse

全部人工评测论文

共 90 篇，第 2 / 2 页

51. NeurIPS 2025Learning Human-Like RL Agents Through Trajectory Optimization With Action Quantization
52. NeurIPS 2025Tackling Biased Evaluators in Dueling Bandits
53. NeurIPS 2025Toward Human Deictic Gesture Target Estimation
54. NeurIPS 2025Toward Interpretable Evaluation Measures for Time Series Segmentation
55. NeurIPS 2025What's Producible May Not Be Reachable: Measuring the Steerability of Generative Models
56. NeurIPS 2025Words That Unite The World: A Unified Framework for Deciphering Central Bank Communications
57. NeurIPS 2024A Large-Scale Human-Centric Benchmark for Referring Expression Comprehension in the LMM Era
58. NeurIPS 2024ALI-Agent: Assessing LLMs' Alignment with Human Values via Agent-based Evaluation
59. NeurIPS 2024Apathetic or Empathetic? Evaluating LLMs' Emotional Alignments with Humans
60. NeurIPS 2024Are Large Language Models Good Statisticians?
61. NeurIPS 2024Benchmarking Complex Instruction-Following with Multiple Constraints Composition
62. NeurIPS 2024BiVLC: Extending Vision-Language Compositionality Evaluation with Text-to-Image Retrieval
63. NeurIPS 2024CoSy: Evaluating Textual Explanations of Neurons
64. NeurIPS 2024DART-Eval: A Comprehensive DNA Language Model Evaluation Benchmark on Regulatory DNA
65. NeurIPS 2024DevBench: A multimodal developmental benchmark for language learning
66. NeurIPS 2024GenAI Arena: An Open Evaluation Platform for Generative Models
67. NeurIPS 2024Interactive Deep Clustering via Value Mining
68. NeurIPS 2024IQA-EVAL: Automatic Evaluation of Human-Model Interactive Question Answering
69. NeurIPS 2024ManiPose: Manifold-Constrained Multi-Hypothesis 3D Human Pose Estimation
70. NeurIPS 2024MixEval: Deriving Wisdom of the Crowd from LLM Benchmark Mixtures
71. NeurIPS 2024Nonparametric Evaluation of Noisy ICA Solutions
72. NeurIPS 2024Overcoming Common Flaws in the Evaluation of Selective Classification Systems
73. NeurIPS 2024Rethinking Human Evaluation Protocol for Text-to-Video Models: Enhancing Reliability, Reproducibility, and Practicality
74. NeurIPS 2024Should We Really Edit Language Models? On the Evaluation of Edited Language Models
75. NeurIPS 2024StackEval: Benchmarking LLMs in Coding Assistance
76. NeurIPS 2024Stratified Prediction-Powered Inference for Effective Hybrid Evaluation of Language Models
77. NeurIPS 2024To Err Like Human: Affective Bias-Inspired Measures for Visual Emotion Recognition Evaluation
78. NeurIPS 2024Towards Robust Multimodal Sentiment Analysis with Incomplete Data
79. NeurIPS 2024Unveiling the Bias Impact on Symmetric Moral Consistency of Large Language Models
80. NeurIPS 2024Weak Supervision Performance Evaluation via Partial Identification
81. NeurIPS 2024WildVision: Evaluating Vision-Language Models in the Wild with Human Preferences
82. NeurIPS 2023A Comprehensive Benchmark for Neural Human Radiance Fields
83. NeurIPS 2023Aligning Synthetic Medical Images with Clinical Knowledge using Human Feedback
84. NeurIPS 2023Automated Classification of Model Errors on ImageNet
85. NeurIPS 2023Holistic Evaluation of Text-to-Image Models
86. NeurIPS 2023How Far Can Camels Go? Exploring the State of Instruction Tuning on Open Resources
87. NeurIPS 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arena
88. NeurIPS 2023Off-Policy Evaluation for Human Feedback
89. NeurIPS 2023Privacy Assessment on Reconstructed Images: Are Existing Evaluation Metrics Faithful to Human Perception?
90. NeurIPS 2023Statistical Knowledge Assessment for Large Language Models

常见问题

2023–2026 年四大会议一共有多少篇人工评测论文？

共 271 篇，按年份分别是 2023 年 33 篇、2024 年 70 篇、2025 年 60 篇、2026 年 108 篇。

NeurIPS 2026 有多少篇人工评测论文？

NeurIPS 2026 有 39 篇人工评测论文，上一届是 17 篇。

ICLR 2026 有多少篇人工评测论文？

ICLR 2026 有 29 篇人工评测论文，上一届是 16 篇。

ICML 2026 有多少篇人工评测论文？

ICML 2026 有 21 篇人工评测论文，上一届是 14 篇。

CVPR 2026 有多少篇人工评测论文？

CVPR 2026 有 19 篇人工评测论文，上一届是 13 篇。

哪个会议的人工评测论文最多？

NeurIPS，2023–2026 年共 90 篇。