人工评测论文趋势 2023–2026

主要结论

• 人工评测论文从 2023 年的 33 篇增长到 2026 年的 108 篇，三年间扩大到约 3.3 倍。
• NeurIPS 是发人工评测论文最多的会议，2023–2026 年共 90 篇，占四个会议总量的 33%。
• 交叉方向里涨得最快的是数据集与基准：同时属于两个主题的论文从 2023 年的 3 篇增至 2026 年的 31 篇。
• 在「评测与基准」的 5 个主题里，它的 2026 年论文数排第 3；同组增长最快的大模型基准是 154 倍，人工评测是 3.3 倍。

代表论文

按年份和会议均匀挑选，方便快速看到每一届的样貌

• NeurIPS 2026Ad-Hoc Teamwork from Human Demonstrations
• ICML 2026SWE-IF: Aligning Code Evaluation with Human Preference
• ICLR 2026Human-LLM Collaborative Feature Engineering for Tabular Data
• CVPR 2026Bridging Human Evaluation to Infrared and Visible Image Fusion
• NeurIPS 2025Deep Edge Filter: Return of the Human-Crafted Layer in Deep Learning
• ICML 2025Position: When Incentives Backfire, Data Stops Being Human
• ICLR 2025Eliciting Human Preferences with Language Models
• CVPR 2025DynPose: Largely Improving the Efficiency of Human Pose Estimation by a Simple Dynamic Framework
• NeurIPS 2024DART-Eval: A Comprehensive DNA Language Model Evaluation Benchmark on Regulatory DNA
• ICML 2024A Fine-grained Analysis of Fitted Q-evaluation: Beyond Parametric Models
• ICLR 2024Human Feedback is not Gold Standard
• CVPR 2024LocLLM: Exploiting Generalizable Human Keypoint Localization via Large Language Model
• NeurIPS 2023Privacy Assessment on Reconstructed Images: Are Existing Evaluation Metrics Faithful to Human Perception?
• ICML 2023Regions of Reliability in the Evaluation of Multivariate Probabilistic Forecasts
• ICLR 2023Beyond calibration: estimating the grouping loss of modern neural networks
• CVPR 20233D Human Keypoints Estimation From Point Clouds in the Wild Without Human Labels
• NeurIPS 2026AI Construct Lexis: An Ontology of the Hidden Assumptions in AI Evaluation
• ICML 2026Rethinking Evaluation Paradigms in IBP-based Certified Training
• ICLR 2026Multi-turn Evaluation of Anthropomorphic Behaviours in Large Language Models
• CVPR 2026Ground Reaction Inertial Poser Physics-based Human Motion Capture from Sparse

全部人工评测论文

共 21 篇，第 1 / 1 页

1. ICML 2026A Computational Framework for Evaluating Human-likeness in LLMs' Open-ended Human Behaviors
2. ICML 2026AppWorld-UL: Benchmarking Diverse Agent-User Interactions for Tool-Use
3. ICML 2026Benchmarking World-Model Learning with Environment-Level Queries
4. ICML 2026Certifying Capabilities from Finite Tests: When Is It Possible?
5. ICML 2026Conversation for Non-verifiable Learning: Self-Evolving Large Language Models through Meta-Evaluation
6. ICML 2026Efficient Inference for Noisy LLM-as-a-Judge Evaluation
7. ICML 2026Expectation Alignment of Language Models for Real-World User Expectations
8. ICML 2026Explanations are a Means to an End: Decision Theoretic Explanation Evaluation
9. ICML 2026FiRE: Fine-grained Ranking Evaluation for Machine Translation
10. ICML 2026GICDM: Mitigating Hubness for Reliable Distance-Based Generative Model Evaluation
11. ICML 2026Hair-Trigger Alignment: Black-Box Evaluation Cannot Guarantee Post-Update Alignment
12. ICML 2026LiveOIBench: Can Large Language Models Outperform Human Contestants in Informatics Olympiads?
13. ICML 2026Moving Out: Physically-grounded Human-AI Collaboration
14. ICML 2026Nonparametric LLM Evaluation from Preference Data
15. ICML 2026PerceptionRubrics: Calibrating Multimodal Evaluation to Human Perception
16. ICML 2026QEDBench: Quantifying the Alignment Gap in Automated Evaluation of University-Level Mathematical Proofs
17. ICML 2026Query-efficient model evaluation using cached responses
18. ICML 2026Rethinking Evaluation Paradigms in IBP-based Certified Training
19. ICML 2026Reward Modeling from Natural Language Human Feedback
20. ICML 2026STABLEVAL: Disagreement-Aware and Stable Evaluation of AI Systems
21. ICML 2026SWE-IF: Aligning Code Evaluation with Human Preference

常见问题

2023–2026 年四大会议一共有多少篇人工评测论文？

共 271 篇，按年份分别是 2023 年 33 篇、2024 年 70 篇、2025 年 60 篇、2026 年 108 篇。

NeurIPS 2026 有多少篇人工评测论文？

NeurIPS 2026 有 39 篇人工评测论文，上一届是 17 篇。

ICLR 2026 有多少篇人工评测论文？

ICLR 2026 有 29 篇人工评测论文，上一届是 16 篇。

ICML 2026 有多少篇人工评测论文？

ICML 2026 有 21 篇人工评测论文，上一届是 14 篇。

CVPR 2026 有多少篇人工评测论文？

CVPR 2026 有 19 篇人工评测论文，上一届是 13 篇。

哪个会议的人工评测论文最多？

NeurIPS，2023–2026 年共 90 篇。