高效训练论文趋势 2023–2026

Scaling law、MoE、蒸馏与训练效率

统计范围：NeurIPS、ICLR、ICML、CVPR 四个会议，2023–2026 年，共 1,765 篇被归入该主题的论文。

主要结论

每年论文数

各会议论文数

按年份和会议统计

高效训练论文数，按年份和会议
年份NeurIPSICLRICMLCVPR合计
2023112678384346
2024207812280300
202519012611882516
2026177148169109603

代表论文

按年份和会议均匀挑选，方便快速看到每一届的样貌

全部高效训练论文

年份全部2023202420252026
会议全部NeurIPSICLRICMLCVPR

共 419 篇，第 7 / 9 页

  1. ICLR 2024Fast-DetectGPT: Efficient Zero-Shot Detection of Machine-Generated Text via Conditional Probability Curvature
  2. ICLR 2024Fast-ELECTRA for Efficient Pre-training
  3. ICLR 2024Faster Sampling from Log-Concave Densities over Polytopes via Efficient Linear Solvers
  4. ICLR 2024FedCompass: Efficient Cross-Silo Federated Learning on Heterogeneous Client Devices Using a Computing Power-Aware Scheduler
  5. ICLR 2024Finite-State Autoregressive Entropy Coding for Efficient Learned Lossless Compression
  6. ICLR 2024FlashFFTConv: Efficient Convolutions for Long Sequences with Tensor Cores
  7. ICLR 2024Hybrid LLM: Cost-Efficient and Quality-Aware Query Routing
  8. ICLR 2024IceFormer: Accelerated Inference with Long-Sequence Transformers on CPUs
  9. ICLR 2024Increasing Model Capacity for Free: A Simple Strategy for Parameter Efficient Fine-tuning
  10. ICLR 2024Jointly-Learned Exit and Inference for a Dynamic Neural Network
  11. ICLR 2024Knowledge Distillation Based on Transformed Teacher Matching
  12. ICLR 2024Language Model Cascades: Token-Level Uncertainty And Beyond
  13. ICLR 2024Large Language Models are Efficient Learners of Noise-Robust Speech Recognition
  14. ICLR 2024LEMON: Lossless model expansion
  15. ICLR 2024Linear Log-Normal Attention with Unbiased Concentration
  16. ICLR 2024LLaMA-Adapter: Efficient Fine-tuning of Large Language Models with Zero-initialized Attention
  17. ICLR 2024LongLoRA: Efficient Fine-tuning of Long-Context Large Language Models
  18. ICLR 2024LUT-GEMM: Quantized Matrix Multiplication based on LUTs for Efficient Inference in Large-Scale Generative Language Models
  19. ICLR 2024Manipulating dropout reveals an optimal balance of efficiency and robustness in biological and machine visual systems
  20. ICLR 2024MAPE-PPI: Towards Effective and Efficient Protein-Protein Interaction Prediction via Microenvironment-Aware Protein Embedding
  21. ICLR 2024MEND: Meta Demonstration Distillation for Efficient and Effective In-Context Learning
  22. ICLR 2024Merge, Then Compress: Demystify Efficient SMoE with Hints from Its Routing Policy
  23. ICLR 2024Network Memory Footprint Compression Through Jointly Learnable Codebooks and Mappings
  24. ICLR 2024Node2ket: Efficient High-Dimensional Network Embedding in Quantum Hilbert Space
  25. ICLR 2024Object centric architectures enable efficient causal representation learning
  26. ICLR 2024OVOR: OnePrompt with Virtual Outlier Regularization for Rehearsal-Free Class-Incremental Learning
  27. ICLR 2024Plug-and-Play: An Efficient Post-training Pruning Method for Large Language Models
  28. ICLR 2024PoSE: Efficient Context Window Extension of LLMs via Positional Skip-wise Training
  29. ICLR 2024Project and Probe: Sample-Efficient Adaptation by Interpolating Orthogonal Features
  30. ICLR 2024Pushing Mixture of Experts to the Limit: Extremely Parameter Efficient MoE for Instruction Tuning
  31. ICLR 2024QLLM: Accurate and Efficient Low-Bitwidth Quantization for Large Language Models
  32. ICLR 2024RDesign: Hierarchical Data-efficient Representation Learning for Tertiary Structure-based RNA Design
  33. ICLR 2024ReFusion: Improving Natural Language Understanding with Computation-Efficient Retrieval Representation Fusion
  34. ICLR 2024Repeated Random Sampling for Minimizing the Time-to-Accuracy of Learning
  35. ICLR 2024RETSim: Resilient and Efficient Text Similarity
  36. ICLR 2024Scaling Laws for Sparsely-Connected Foundation Models
  37. ICLR 2024Scaling Laws of RoPE-based Extrapolation
  38. ICLR 2024Skeleton-of-Thought: Prompting LLMs for Efficient Parallel Generation
  39. ICLR 2024SPTNet: An Efficient Alternative Framework for Generalized Category Discovery with Spatial Prompt Tuning
  40. ICLR 2024ToolChain*: Efficient Action Space Navigation in Large Language Models with A* Search
  41. ICLR 2024Towards Energy Efficient Spiking Neural Networks: An Unstructured Pruning Framework
  42. ICLR 2024Towards Reliable and Efficient Backdoor Trigger Inversion via Decoupling Benign Features
  43. ICLR 2024Towards Robust and Efficient Cloud-Edge Elastic Model Adaptation via Selective Entropy Distillation
  44. ICLR 2024Tree-Planner: Efficient Close-loop Task Planning with Large Language Models
  45. ICLR 2024Tuning LayerNorm in Attention: Towards Efficient Multi-Modal LLM Finetuning
  46. ICLR 2024VQGraph: Rethinking Graph Representation Space for Bridging GNNs and MLPs
  47. ICLR 2024Waxing-and-Waning: a Generic Similarity-based Framework for Efficient Self-Supervised Learning
  48. ICLR 2024When Scaling Meets LLM Finetuning: The Effect of Data, Model and Finetuning Method
  49. ICLR 2024YaRN: Efficient Context Window Extension of Large Language Models
  50. ICLR 2024You Only Query Once: An Efficient Label-Only Membership Inference Attack

在 Claude、Cursor 里直接问这个趋势

接上 Paperlist MCP 后，写综述、挑方向或准备投稿时，不用离开对话框就能拿到这页的数字：每年各会议的论文数、增长倍数、涨得最快的子方向和代表论文，AI 会按你的问题整理。

可以直接复制这句话问 AI

用 paperlist 查高效训练在 NeurIPS 2023–2026 的论文趋势，哪一年涨得最快？

AI 会调用的工具：get_topic_stats {"topic": "efficient-training"}

两分钟接入 Paperlist MCP（Claude Code、Cursor、Codex、ChatGPT）

常见问题

2023–2026 年四大会议一共有多少篇高效训练论文？
共 1,765 篇，按年份分别是 2023 年 346 篇、2024 年 300 篇、2025 年 516 篇、2026 年 603 篇。
NeurIPS 2026 有多少篇高效训练论文？
NeurIPS 2026 有 177 篇高效训练论文，上一届是 190 篇。
ICLR 2026 有多少篇高效训练论文？
ICLR 2026 有 148 篇高效训练论文，上一届是 126 篇。
ICML 2026 有多少篇高效训练论文？
ICML 2026 有 169 篇高效训练论文，上一届是 118 篇。
CVPR 2026 有多少篇高效训练论文？
CVPR 2026 有 109 篇高效训练论文，上一届是 82 篇。
哪个会议的高效训练论文最多？
NeurIPS，2023–2026 年共 499 篇。

「效率与系统」下的其他主题