模型即裁判论文趋势 2023–2026
自动评测
统计范围:NeurIPS、ICLR、ICML、CVPR 四个会议,2023–2026 年,共 401 篇被归入该主题的论文。
主要结论
- 模型即裁判论文从 2023 年的 8 篇增长到 2026 年的 219 篇,三年间扩大到约 27 倍。
- NeurIPS 是发模型即裁判论文最多的会议,2023–2026 年共 173 篇,占四个会议总量的 43%。
- 交叉方向里涨得最快的是AI 智能体:同时属于两个主题的论文从 2023 年的 1 篇增至 2026 年的 78 篇。
- 在「评测与基准」的 5 个主题里,它的 2026 年论文数排第 2;同组增长最快的大模型基准是 154 倍,模型即裁判是 27 倍。
各会议论文数
按年份和会议统计
| 年份 | NeurIPS | ICLR | ICML | CVPR | 合计 |
|---|---|---|---|---|---|
| 2023 | 5 | 1 | 2 | 0 | 8 |
| 2024 | 27 | 12 | 9 | 0 | 48 |
| 2025 | 53 | 37 | 33 | 3 | 126 |
| 2026 | 88 | 62 | 64 | 5 | 219 |
代表论文
按年份和会议均匀挑选,方便快速看到每一届的样貌
- NeurIPS 2026A Free Lunch in LLM Compression: Revisiting Retraining after Pruning
- ICML 2026A Judge-Aware Ranking Framework for Evaluating Large Language Models without Ground Truth
- ICLR 2026Addressing Pitfalls in the Evaluation of Uncertainty Estimation Methods for Natural Language Generation
- CVPR 2026Pixels Dont Lie But Your Detector Might Bootstrapping MLLM-as-a-Judge for
- NeurIPS 2025$\texttt{BetaConform}$: Efficient MAP Estimation of LLM Ensemble Judgment Performance with Prior Transfer
- ICML 2025Active Evaluation Acquisition for Efficient LLM Benchmarking
- ICLR 2025An Empirical Analysis of Uncertainty in Large Language Model Evaluations
- CVPR 2025ASHiTA: Automatic Scene-grounded HIerarchical Task Analysis
- NeurIPS 2024BertaQA: How Much Do Language Models Know About Local Culture?
- ICML 2024CHAI: Clustered Head Attention for Efficient LLM Inference
- ICLR 2024PandaLM: An Automatic Evaluation Benchmark for LLM Instruction Tuning Optimization
- NeurIPS 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arena
- ICML 2023SAM operates far from home: eigenvalue regularization as a dynamical phenomenon
- ICLR 2023On the complexity of nonsmooth automatic differentiation
- NeurIPS 2026A Stratified Multi-Rater Evaluation of LLM-Based Virtual Standardized Patients with a Deployed Data-Generation Platform
- ICML 2026Are LLM Evaluators Really Narcissists? Sanity Checking Self-Preference Evaluations
- ICLR 2026AutoMetrics: Approximate Human Judgments with Automatically Generated Evaluators
- CVPR 20263DrawAgent Teaching LLM to Draw in 3D with Early Contrastive
- NeurIPS 2025Adaptive Prediction-Powered AutoEval with Reliability and Efficiency Guarantees
- ICML 2025Evaluating Judges as Evaluators: The JETTS Benchmark of LLM-as-Judges as Test-Time Scaling Evaluators
全部模型即裁判论文
共 219 篇,第 2 / 5 页
- ICLR 2026Rethinking LLM-as-a-Judge: Representation-as-a-Judge with Small Language Models via Semantic Capacity Asymmetry
- ICLR 2026RouterArena: An Open Platform for Comprehensive Comparison of LLM Routers
- ICLR 2026SCI-Verifier: Scientific Verifier with Thinking
- ICLR 2026Semantic Voting: A Self-Evaluation-Free Approach for Efficient LLM Self-Improvement on Unverifiable Open-ended Tasks
- ICLR 2026SK2Decompile: LLM-based Two-Phase Binary Decompilation from Skeleton to Skin
- ICLR 2026SocialHarmBench: Revealing LLM Vulnerabilities to Socially Harmful Requests
- ICLR 2026SparseEval: Efficient Evaluation of Large Language Models by Sparse Optimization
- ICLR 2026STAR: Strategy-driven Automatic Jailbreak Red-teaming For Large Language Model
- ICLR 2026Talk, Evaluate, Diagnose: User-aware Agent Evaluation with Automated Error Analysis
- ICLR 2026The Ideation-Execution Gap: Execution Outcomes of LLM-Generated versus Human Research Ideas
- ICLR 2026The Unseen Frontier: Pushing the Limits of LLM Sparsity with Surrogate-Free ADMM
- ICLR 2026Towards Reliable Benchmarking: A Contamination Free, Controllable Evaluation Framework for Multi-step LLM Function Calling
- ICLR 2026TrustJudge: Inconsistencies of LLM-as-a-Judge and How to Alleviate Them
- ICLR 2026Unlocking Full Efficiency of Token Filtering in Large Language Model Training
- ICLR 2026Watermarking Diffusion Language Models
- ICLR 2026WebDevJudge: Evaluating (M)LLMs as Critiques for Web Development Quality
- ICLR 2026Your Agent May Misevolve: Emergent Risks in Self-evolving LLM Agents
- ICML 2026A Coin Flip for Safety: LLM Judges Fail to Reliably Measure Adversarial Robustness
- ICML 2026A Judge-Aware Ranking Framework for Evaluating Large Language Models without Ground Truth
- ICML 2026Adaptive Contracts for Cost-Effective AI Delegation
- ICML 2026Are LLM Evaluators Really Narcissists? Sanity Checking Self-Preference Evaluations
- ICML 2026Automatic Construction of Clinical Scoring Systems with LLM Agents
- ICML 2026Beyond Drift: Stabilizing Subjective LLM Evaluation with Information-Theoretic Rubrics
- ICML 2026Breaking the Exploration Bottleneck: Rubric-Scaffolded Reinforcement Learning for Open-Ended LLM Reasoning
- ICML 2026CARE: Confounder-Aware Aggregation for Reliable LLM Evaluation
- ICML 2026Controlled LLM Training on Spectral Sphere
- ICML 2026Cutting LLM Evaluation Costs with SySRs: A Bandit Algorithm That Provably Exploits Model Similarity
- ICML 2026D-Judge: Disrupting Multi-Turn Jailbreaks using Semantics-Preserving Output Rewriting
- ICML 2026Demystifying LLM-as-a-Judge: Analytically Tractable Model for Inference-Time Scaling
- ICML 2026Dependence-Aware Label Aggregation for LLM-as-a-Judge via Ising Models
- ICML 2026Diagnosing the Reliability of LLM-as-a-Judge via Item Response Theory
- ICML 2026Distribution-Calibrated Inference Time Compute for Thinking LLM-as-a-Judge
- ICML 2026Distributional Open-Ended Evaluation of LLM Cultural Value Alignment Based on Value Codebook
- ICML 2026Does Reinforcement Fine-Tuning Improve Generalization of LLM Agents? An Empirical Study
- ICML 2026Easier to Judge than to Find: Predicting In-Context Learning Success for Demonstration Selection
- ICML 2026Efficient Distributed MLLM Training with Cornstarch
- ICML 2026Efficient Inference for Noisy LLM-as-a-Judge Evaluation
- ICML 2026Enhancing LLM Training via Spectral Clipping
- ICML 2026Evaluating Language Models in Realistic Conversational Contexts
- ICML 2026ExCyTIn-Bench: Evaluating LLM agents on Cyber Threat Investigation
- ICML 2026FairJudge : An Adaptive, Debiased, and Consistent LLM-as-a-Judge
- ICML 2026FiRE: Fine-grained Ranking Evaluation for Machine Translation
- ICML 2026Game-Theoretic Co-Evolution for LLM-Based Heuristic Discovery
- ICML 2026How to Correctly Report LLM-as-a-Judge Evaluations
- ICML 2026InnoEval: On Research Idea Evaluation as a Knowledge-Grounded, Multi-Perspective Reasoning Problem
- ICML 2026JADE: Expert-Grounded Dynamic Evaluation for Open-Ended Professional Tasks
- ICML 2026Judging What We Cannot Solve: A Consequence-Based Approach for Oracle-Free Evaluation of Research-Level Math
- ICML 2026Learn-to-learn on Arbitrary Textual Conditioning: A Hypernetwork-Driven Meta-gated LLM
- ICML 2026LitReview Arena: Evaluating Literature Review Agents with Battle-style Peer Review Platform
- ICML 2026LLM Priors for ERM over Programs
在 Claude、Cursor 里直接问这个趋势
接上 Paperlist MCP 后,写综述、挑方向或准备投稿时,不用离开对话框就能拿到这页的数字:每年各会议的论文数、增长倍数、涨得最快的子方向和代表论文,AI 会按你的问题整理。
可以直接复制这句话问 AI
用 paperlist 查模型即裁判在 NeurIPS 2023–2026 的论文趋势,哪一年涨得最快?
AI 会调用的工具:get_topic_stats {"topic": "llm-as-judge"}
常见问题
- 2023–2026 年四大会议一共有多少篇模型即裁判论文?
- 共 401 篇,按年份分别是 2023 年 8 篇、2024 年 48 篇、2025 年 126 篇、2026 年 219 篇。
- NeurIPS 2026 有多少篇模型即裁判论文?
- NeurIPS 2026 有 88 篇模型即裁判论文,上一届是 53 篇。
- ICLR 2026 有多少篇模型即裁判论文?
- ICLR 2026 有 62 篇模型即裁判论文,上一届是 37 篇。
- ICML 2026 有多少篇模型即裁判论文?
- ICML 2026 有 64 篇模型即裁判论文,上一届是 33 篇。
- CVPR 2026 有多少篇模型即裁判论文?
- CVPR 2026 有 5 篇模型即裁判论文,上一届是 3 篇。
- 哪个会议的模型即裁判论文最多?
- NeurIPS,2023–2026 年共 173 篇。